2026-02-13T20:03:38.673 INFO:root:teuthology version: 1.2.4.dev5+g8bec0da71 2026-02-13T20:03:38.686 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T20:03:38.783 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/yuriw-2026-02-13_16:37:03-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/49987 branch: wip-yuri4-testing-2026-02-11-2126 description: rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/{bluestore/{alloc$/{stupid} base mem$/{low} onode-segment$/{256K} write$/{v2/{compr$/{yes$/{zlib}} v2}}}} rados supported-random-distro$/{centos_latest} thrashers/force-sync-many workloads/snaps-few-objects} email: yweinste@redhat.com first_in_suite: false flavor: default job_id: '49987' kernel: branch: distro kdb: true sha1: distro last_in_suite: false machine_type: trial name: yuriw-2026-02-13_16:37:03-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-yuri4-testing-2026-02-11-2126 ceph: conf: client: debug monc: 20 debug ms: 1 global: mon client directed command retry: 5 mon election default strategy: 3 ms bind msgr2: false ms inject socket failures: 5000 ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 30 debug ms: 20 debug paxos: 20 mon min osdmap epochs: 25 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub inject crc mismatch: 0.01 mon scrub inject missing keys: 0.05 mon scrub interval: 300 paxos service trim min: 5 osd: bdev async discard: true bdev enable discard: true bluestore allocator: stupid bluestore block size: 96636764160 bluestore compression algorithm: zlib bluestore compression mode: aggressive bluestore fsck on mount: true bluestore onode segment size: 256K bluestore write v2: true bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd mclock skip benchmark: true osd memory target: 1610612736 osd objectstore: bluestore osd op num shards: 1 osd op num threads per shard: 2 osd op queue: debug_random osd op queue cut off: debug_random osd_mclock_skip_benchmark: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - ScrubResult - scrub mismatch - overall HEALTH_ - \(MGR_DOWN\) - \(PG_AVAILABILITY\) - \(SLOW_OPS\) - slow request - \(OSD_SLOW_PING_TIME - \(MON_NETSPLIT) - overall HEALTH_ - \(MON_DOWN\) - \(TOO_FEW_PGS\) - \(POOL_APP_NOT_ENABLED\) mon_bind_msgr2: false sha1: afefaa40503a4bf024e96f97dd7f852b75f00ad6 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: afefaa40503a4bf024e96f97dd7f852b75f00ad6 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri4-testing-2026-02-11-2126 sha1: afefaa40503a4bf024e96f97dd7f852b75f00ad6 owner: scheduled_yuriw@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - osd.0 - osd.1 - osd.2 - - mon.b - mgr.x - osd.3 - osd.4 - osd.5 - client.0 seed: 5319 sha1: afefaa40503a4bf024e96f97dd7f852b75f00ad6 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-yuri4-testing-2026-02-11-2126 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_afefaa40503a4bf024e96f97dd7f852b75f00ad6/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: afefaa40503a4bf024e96f97dd7f852b75f00ad6 targets: trial110.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD8UsWvzq8QgRO1jRYTg3zOV8Lj8OnP+NIaES1DrBEFvcS5jOg8ATdnrfv1d62tllvgl0xbPdVBywSgnkeE2kVk= trial188.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO4vRdE2q3oZf4dVkbdQhN4dUkZuNBEQ0p9a0F9E+1L9DaH9gz8hGRX8Ih3Jhrdb/YmtWdacO6psxLbNmC11SYc= tasks: - install: null - ceph: null - mon_thrash: revive_delay: 90 store_thrash: true thrash_delay: 1 thrash_many: true - rados: clients: - client.0 objects: 50 op_weights: copy_from: 50 delete: 50 read: 100 rollback: 50 snap_create: 50 snap_remove: 50 write: 100 ops: 4000 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 8bec0da71becad44414c54979f64c9ef0e7099c6 timestamp: 2026-02-13_16:37:03 tube: trial user: yuriw verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3932482 2026-02-13T20:03:38.783 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_afefaa40503a4bf024e96f97dd7f852b75f00ad6/qa; will attempt to use it 2026-02-13T20:03:38.783 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_afefaa40503a4bf024e96f97dd7f852b75f00ad6/qa/tasks 2026-02-13T20:03:38.783 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-13T20:03:38.785 INFO:teuthology.task.internal:Checking packages... 2026-02-13T20:03:38.785 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'afefaa40503a4bf024e96f97dd7f852b75f00ad6' 2026-02-13T20:03:38.785 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-13T20:03:38.785 INFO:teuthology.packaging:ref: None 2026-02-13T20:03:38.785 INFO:teuthology.packaging:tag: None 2026-02-13T20:03:38.785 INFO:teuthology.packaging:branch: wip-yuri4-testing-2026-02-11-2126 2026-02-13T20:03:38.785 INFO:teuthology.packaging:sha1: afefaa40503a4bf024e96f97dd7f852b75f00ad6 2026-02-13T20:03:38.785 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-yuri4-testing-2026-02-11-2126 2026-02-13T20:03:38.914 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5230.gafefaa40 2026-02-13T20:03:38.916 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-13T20:03:38.927 INFO:teuthology.task.internal:no buildpackages task found 2026-02-13T20:03:38.927 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-13T20:03:38.941 INFO:teuthology.task.internal:Saving configuration 2026-02-13T20:03:38.957 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-13T20:03:38.972 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-13T20:03:39.054 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial110.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-13_16:37:03-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/49987', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-13 20:00:09.585875', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD8UsWvzq8QgRO1jRYTg3zOV8Lj8OnP+NIaES1DrBEFvcS5jOg8ATdnrfv1d62tllvgl0xbPdVBywSgnkeE2kVk='} 2026-02-13T20:03:39.136 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial188.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-13_16:37:03-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/49987', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-13 20:00:09.585230', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO4vRdE2q3oZf4dVkbdQhN4dUkZuNBEQ0p9a0F9E+1L9DaH9gz8hGRX8Ih3Jhrdb/YmtWdacO6psxLbNmC11SYc='} 2026-02-13T20:03:39.136 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-13T20:03:39.148 INFO:teuthology.task.internal:roles: ubuntu@trial110.front.sepia.ceph.com - ['mon.a', 'mon.c', 'osd.0', 'osd.1', 'osd.2'] 2026-02-13T20:03:39.148 INFO:teuthology.task.internal:roles: ubuntu@trial188.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.3', 'osd.4', 'osd.5', 'client.0'] 2026-02-13T20:03:39.148 INFO:teuthology.run_tasks:Running task console_log... 2026-02-13T20:03:39.285 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x72b80cc3ba60>, signals=[15]) 2026-02-13T20:03:39.285 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-13T20:03:39.296 INFO:teuthology.task.internal:Opening connections... 2026-02-13T20:03:39.296 DEBUG:teuthology.task.internal:connecting to ubuntu@trial110.front.sepia.ceph.com 2026-02-13T20:03:39.297 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T20:03:39.370 DEBUG:teuthology.task.internal:connecting to ubuntu@trial188.front.sepia.ceph.com 2026-02-13T20:03:39.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T20:03:39.432 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-13T20:03:39.443 DEBUG:teuthology.orchestra.run.trial110:> uname -m 2026-02-13T20:03:39.459 INFO:teuthology.orchestra.run.trial110.stdout:x86_64 2026-02-13T20:03:39.459 DEBUG:teuthology.orchestra.run.trial110:> cat /etc/os-release 2026-02-13T20:03:39.516 INFO:teuthology.orchestra.run.trial110.stdout:NAME="CentOS Stream" 2026-02-13T20:03:39.516 INFO:teuthology.orchestra.run.trial110.stdout:VERSION="9" 2026-02-13T20:03:39.516 INFO:teuthology.orchestra.run.trial110.stdout:ID="centos" 2026-02-13T20:03:39.516 INFO:teuthology.orchestra.run.trial110.stdout:ID_LIKE="rhel fedora" 2026-02-13T20:03:39.516 INFO:teuthology.orchestra.run.trial110.stdout:VERSION_ID="9" 2026-02-13T20:03:39.516 INFO:teuthology.orchestra.run.trial110.stdout:PLATFORM_ID="platform:el9" 2026-02-13T20:03:39.516 INFO:teuthology.orchestra.run.trial110.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-13T20:03:39.516 INFO:teuthology.orchestra.run.trial110.stdout:ANSI_COLOR="0;31" 2026-02-13T20:03:39.516 INFO:teuthology.orchestra.run.trial110.stdout:LOGO="fedora-logo-icon" 2026-02-13T20:03:39.516 INFO:teuthology.orchestra.run.trial110.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-13T20:03:39.516 INFO:teuthology.orchestra.run.trial110.stdout:HOME_URL="https://centos.org/" 2026-02-13T20:03:39.516 INFO:teuthology.orchestra.run.trial110.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-13T20:03:39.516 INFO:teuthology.orchestra.run.trial110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-13T20:03:39.517 INFO:teuthology.orchestra.run.trial110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-13T20:03:39.517 INFO:teuthology.lock.ops:Updating trial110.front.sepia.ceph.com on lock server 2026-02-13T20:03:39.590 DEBUG:teuthology.orchestra.run.trial188:> uname -m 2026-02-13T20:03:39.605 INFO:teuthology.orchestra.run.trial188.stdout:x86_64 2026-02-13T20:03:39.606 DEBUG:teuthology.orchestra.run.trial188:> cat /etc/os-release 2026-02-13T20:03:39.661 INFO:teuthology.orchestra.run.trial188.stdout:NAME="CentOS Stream" 2026-02-13T20:03:39.661 INFO:teuthology.orchestra.run.trial188.stdout:VERSION="9" 2026-02-13T20:03:39.661 INFO:teuthology.orchestra.run.trial188.stdout:ID="centos" 2026-02-13T20:03:39.661 INFO:teuthology.orchestra.run.trial188.stdout:ID_LIKE="rhel fedora" 2026-02-13T20:03:39.661 INFO:teuthology.orchestra.run.trial188.stdout:VERSION_ID="9" 2026-02-13T20:03:39.661 INFO:teuthology.orchestra.run.trial188.stdout:PLATFORM_ID="platform:el9" 2026-02-13T20:03:39.661 INFO:teuthology.orchestra.run.trial188.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-13T20:03:39.661 INFO:teuthology.orchestra.run.trial188.stdout:ANSI_COLOR="0;31" 2026-02-13T20:03:39.662 INFO:teuthology.orchestra.run.trial188.stdout:LOGO="fedora-logo-icon" 2026-02-13T20:03:39.662 INFO:teuthology.orchestra.run.trial188.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-13T20:03:39.662 INFO:teuthology.orchestra.run.trial188.stdout:HOME_URL="https://centos.org/" 2026-02-13T20:03:39.662 INFO:teuthology.orchestra.run.trial188.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-13T20:03:39.662 INFO:teuthology.orchestra.run.trial188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-13T20:03:39.662 INFO:teuthology.orchestra.run.trial188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-13T20:03:39.662 INFO:teuthology.lock.ops:Updating trial188.front.sepia.ceph.com on lock server 2026-02-13T20:03:39.738 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-13T20:03:39.752 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-13T20:03:39.764 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-13T20:03:39.764 DEBUG:teuthology.orchestra.run.trial110:> test '!' -e /home/ubuntu/cephtest 2026-02-13T20:03:39.766 DEBUG:teuthology.orchestra.run.trial188:> test '!' -e /home/ubuntu/cephtest 2026-02-13T20:03:39.780 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-13T20:03:39.794 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-13T20:03:39.794 DEBUG:teuthology.orchestra.run.trial110:> test -z $(ls -A /var/lib/ceph) 2026-02-13T20:03:39.821 DEBUG:teuthology.orchestra.run.trial188:> test -z $(ls -A /var/lib/ceph) 2026-02-13T20:03:39.837 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-13T20:03:39.974 INFO:teuthology.run_tasks:Running task kernel... 2026-02-13T20:03:39.994 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': True, 'sha1': 'distro'} 2026-02-13T20:03:39.994 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'mon.b': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, timeout 300 2026-02-13T20:03:39.994 DEBUG:teuthology.orchestra.run.trial110:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-13T20:03:39.994 DEBUG:teuthology.orchestra.run.trial188:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-13T20:03:40.009 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T20:03:40.009 DEBUG:teuthology.orchestra.run.trial110:> uname -r 2026-02-13T20:03:40.009 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T20:03:40.009 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-13T20:03:40.065 INFO:teuthology.orchestra.run.trial110.stdout:5.14.0-645.el9.x86_64 2026-02-13T20:03:40.065 INFO:teuthology.task.kernel:Running kernel on trial110: 5.14.0-645.el9.x86_64 2026-02-13T20:03:40.065 DEBUG:teuthology.orchestra.run.trial110:> sudo yum install -y kernel 2026-02-13T20:03:40.065 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-13T20:03:40.065 INFO:teuthology.task.kernel:Running kernel on trial188: 5.14.0-645.el9.x86_64 2026-02-13T20:03:40.065 DEBUG:teuthology.orchestra.run.trial188:> sudo yum install -y kernel 2026-02-13T20:03:41.171 INFO:teuthology.orchestra.run.trial110.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.9 MB 00:00 2026-02-13T20:03:43.981 INFO:teuthology.orchestra.run.trial110.stdout:CentOS Stream 9 - AppStream 12 MB/s | 27 MB 00:02 2026-02-13T20:03:47.130 INFO:teuthology.orchestra.run.trial188.stdout:CentOS Stream 9 - BaseOS 1.3 MB/s | 8.9 MB 00:06 2026-02-13T20:03:47.450 INFO:teuthology.orchestra.run.trial110.stdout:CentOS Stream 9 - CRB 7.5 MB/s | 7.8 MB 00:01 2026-02-13T20:03:48.659 INFO:teuthology.orchestra.run.trial110.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 20 kB 00:00 2026-02-13T20:03:50.028 INFO:teuthology.orchestra.run.trial110.stdout:Extra Packages for Enterprise Linux 16 MB/s | 20 MB 00:01 2026-02-13T20:03:53.225 INFO:teuthology.orchestra.run.trial110.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-13T20:03:54.286 INFO:teuthology.orchestra.run.trial110.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-13T20:03:54.306 INFO:teuthology.orchestra.run.trial110.stdout:Dependencies resolved. 2026-02-13T20:03:54.307 INFO:teuthology.orchestra.run.trial110.stdout:================================================================================ 2026-02-13T20:03:54.307 INFO:teuthology.orchestra.run.trial110.stdout: Package Architecture Version Repository Size 2026-02-13T20:03:54.307 INFO:teuthology.orchestra.run.trial110.stdout:================================================================================ 2026-02-13T20:03:54.307 INFO:teuthology.orchestra.run.trial110.stdout:Installing: 2026-02-13T20:03:54.307 INFO:teuthology.orchestra.run.trial110.stdout: kernel x86_64 5.14.0-677.el9 baseos 768 k 2026-02-13T20:03:54.307 INFO:teuthology.orchestra.run.trial110.stdout:Installing dependencies: 2026-02-13T20:03:54.308 INFO:teuthology.orchestra.run.trial110.stdout: kernel-core x86_64 5.14.0-677.el9 baseos 17 M 2026-02-13T20:03:54.308 INFO:teuthology.orchestra.run.trial110.stdout: kernel-modules x86_64 5.14.0-677.el9 baseos 40 M 2026-02-13T20:03:54.308 INFO:teuthology.orchestra.run.trial110.stdout: kernel-modules-core x86_64 5.14.0-677.el9 baseos 31 M 2026-02-13T20:03:54.308 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:03:54.308 INFO:teuthology.orchestra.run.trial110.stdout:Transaction Summary 2026-02-13T20:03:54.308 INFO:teuthology.orchestra.run.trial110.stdout:================================================================================ 2026-02-13T20:03:54.308 INFO:teuthology.orchestra.run.trial110.stdout:Install 4 Packages 2026-02-13T20:03:54.308 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:03:54.308 INFO:teuthology.orchestra.run.trial110.stdout:Total download size: 88 M 2026-02-13T20:03:54.308 INFO:teuthology.orchestra.run.trial110.stdout:Installed size: 135 M 2026-02-13T20:03:54.308 INFO:teuthology.orchestra.run.trial110.stdout:Downloading Packages: 2026-02-13T20:03:55.270 INFO:teuthology.orchestra.run.trial110.stdout:(1/4): kernel-5.14.0-677.el9.x86_64.rpm 861 kB/s | 768 kB 00:00 2026-02-13T20:03:55.747 INFO:teuthology.orchestra.run.trial110.stdout:(2/4): kernel-core-5.14.0-677.el9.x86_64.rpm 12 MB/s | 17 MB 00:01 2026-02-13T20:03:56.252 INFO:teuthology.orchestra.run.trial110.stdout:(3/4): kernel-modules-5.14.0-677.el9.x86_64.rpm 21 MB/s | 40 MB 00:01 2026-02-13T20:03:56.988 INFO:teuthology.orchestra.run.trial110.stdout:(4/4): kernel-modules-core-5.14.0-677.el9.x86_6 18 MB/s | 31 MB 00:01 2026-02-13T20:03:56.989 INFO:teuthology.orchestra.run.trial110.stdout:-------------------------------------------------------------------------------- 2026-02-13T20:03:56.989 INFO:teuthology.orchestra.run.trial110.stdout:Total 33 MB/s | 88 MB 00:02 2026-02-13T20:03:57.180 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction check 2026-02-13T20:03:57.382 INFO:teuthology.orchestra.run.trial110.stdout:Transaction check succeeded. 2026-02-13T20:03:57.383 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction test 2026-02-13T20:03:57.727 INFO:teuthology.orchestra.run.trial110.stdout:Transaction test succeeded. 2026-02-13T20:03:57.727 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction 2026-02-13T20:03:58.821 INFO:teuthology.orchestra.run.trial110.stdout: Preparing : 1/1 2026-02-13T20:03:59.105 INFO:teuthology.orchestra.run.trial110.stdout: Installing : kernel-modules-core-5.14.0-677.el9.x86_64 1/4 2026-02-13T20:03:59.124 INFO:teuthology.orchestra.run.trial110.stdout: Installing : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-13T20:04:00.895 INFO:teuthology.orchestra.run.trial110.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-13T20:04:00.924 INFO:teuthology.orchestra.run.trial110.stdout: Installing : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-13T20:04:01.888 INFO:teuthology.orchestra.run.trial188.stdout:CentOS Stream 9 - AppStream 1.9 MB/s | 27 MB 00:14 2026-02-13T20:04:03.950 INFO:teuthology.orchestra.run.trial110.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-13T20:04:03.956 INFO:teuthology.orchestra.run.trial110.stdout: Installing : kernel-5.14.0-677.el9.x86_64 4/4 2026-02-13T20:04:05.848 INFO:teuthology.orchestra.run.trial188.stdout:CentOS Stream 9 - CRB 4.9 MB/s | 7.8 MB 00:01 2026-02-13T20:04:07.013 INFO:teuthology.orchestra.run.trial110.stdout: Running scriptlet: kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-13T20:04:07.277 INFO:teuthology.orchestra.run.trial188.stdout:CentOS Stream 9 - Extras packages 28 kB/s | 20 kB 00:00 2026-02-13T20:04:08.535 INFO:teuthology.orchestra.run.trial188.stdout:Extra Packages for Enterprise Linux 17 MB/s | 20 MB 00:01 2026-02-13T20:04:11.778 INFO:teuthology.orchestra.run.trial188.stdout:lab-extras 1.7 MB/s | 50 kB 00:00 2026-02-13T20:04:12.840 INFO:teuthology.orchestra.run.trial188.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-13T20:04:12.860 INFO:teuthology.orchestra.run.trial188.stdout:Dependencies resolved. 2026-02-13T20:04:12.861 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-13T20:04:12.861 INFO:teuthology.orchestra.run.trial188.stdout: Package Architecture Version Repository Size 2026-02-13T20:04:12.861 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-13T20:04:12.861 INFO:teuthology.orchestra.run.trial188.stdout:Installing: 2026-02-13T20:04:12.861 INFO:teuthology.orchestra.run.trial188.stdout: kernel x86_64 5.14.0-677.el9 baseos 768 k 2026-02-13T20:04:12.861 INFO:teuthology.orchestra.run.trial188.stdout:Installing dependencies: 2026-02-13T20:04:12.861 INFO:teuthology.orchestra.run.trial188.stdout: kernel-core x86_64 5.14.0-677.el9 baseos 17 M 2026-02-13T20:04:12.862 INFO:teuthology.orchestra.run.trial188.stdout: kernel-modules x86_64 5.14.0-677.el9 baseos 40 M 2026-02-13T20:04:12.862 INFO:teuthology.orchestra.run.trial188.stdout: kernel-modules-core x86_64 5.14.0-677.el9 baseos 31 M 2026-02-13T20:04:12.862 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:04:12.862 INFO:teuthology.orchestra.run.trial188.stdout:Transaction Summary 2026-02-13T20:04:12.862 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-13T20:04:12.862 INFO:teuthology.orchestra.run.trial188.stdout:Install 4 Packages 2026-02-13T20:04:12.862 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:04:12.862 INFO:teuthology.orchestra.run.trial188.stdout:Total download size: 88 M 2026-02-13T20:04:12.862 INFO:teuthology.orchestra.run.trial188.stdout:Installed size: 135 M 2026-02-13T20:04:12.862 INFO:teuthology.orchestra.run.trial188.stdout:Downloading Packages: 2026-02-13T20:04:14.076 INFO:teuthology.orchestra.run.trial188.stdout:(1/4): kernel-5.14.0-677.el9.x86_64.rpm 844 kB/s | 768 kB 00:00 2026-02-13T20:04:14.544 INFO:teuthology.orchestra.run.trial188.stdout:(2/4): kernel-core-5.14.0-677.el9.x86_64.rpm 12 MB/s | 17 MB 00:01 2026-02-13T20:04:15.072 INFO:teuthology.orchestra.run.trial188.stdout:(3/4): kernel-modules-5.14.0-677.el9.x86_64.rpm 21 MB/s | 40 MB 00:01 2026-02-13T20:04:15.742 INFO:teuthology.orchestra.run.trial188.stdout:(4/4): kernel-modules-core-5.14.0-677.el9.x86_6 18 MB/s | 31 MB 00:01 2026-02-13T20:04:15.743 INFO:teuthology.orchestra.run.trial188.stdout:-------------------------------------------------------------------------------- 2026-02-13T20:04:15.743 INFO:teuthology.orchestra.run.trial188.stdout:Total 31 MB/s | 88 MB 00:02 2026-02-13T20:04:15.929 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction check 2026-02-13T20:04:16.142 INFO:teuthology.orchestra.run.trial188.stdout:Transaction check succeeded. 2026-02-13T20:04:16.142 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction test 2026-02-13T20:04:16.486 INFO:teuthology.orchestra.run.trial188.stdout:Transaction test succeeded. 2026-02-13T20:04:16.486 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction 2026-02-13T20:04:17.579 INFO:teuthology.orchestra.run.trial188.stdout: Preparing : 1/1 2026-02-13T20:04:17.866 INFO:teuthology.orchestra.run.trial188.stdout: Installing : kernel-modules-core-5.14.0-677.el9.x86_64 1/4 2026-02-13T20:04:17.885 INFO:teuthology.orchestra.run.trial188.stdout: Installing : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-13T20:04:19.657 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-13T20:04:19.686 INFO:teuthology.orchestra.run.trial188.stdout: Installing : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-13T20:04:22.713 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-13T20:04:22.719 INFO:teuthology.orchestra.run.trial188.stdout: Installing : kernel-5.14.0-677.el9.x86_64 4/4 2026-02-13T20:04:25.753 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-13T20:04:37.588 INFO:teuthology.orchestra.run.trial110.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 4/4 2026-02-13T20:04:37.610 INFO:teuthology.orchestra.run.trial110.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 4/4 2026-02-13T20:04:37.674 INFO:teuthology.orchestra.run.trial110.stdout: Running scriptlet: kernel-5.14.0-677.el9.x86_64 4/4 2026-02-13T20:04:37.674 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : kernel-5.14.0-677.el9.x86_64 1/4 2026-02-13T20:04:37.674 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-13T20:04:37.674 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-13T20:04:37.726 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-13T20:04:37.726 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:04:37.726 INFO:teuthology.orchestra.run.trial110.stdout:Installed: 2026-02-13T20:04:37.726 INFO:teuthology.orchestra.run.trial110.stdout: kernel-5.14.0-677.el9.x86_64 2026-02-13T20:04:37.726 INFO:teuthology.orchestra.run.trial110.stdout: kernel-core-5.14.0-677.el9.x86_64 2026-02-13T20:04:37.726 INFO:teuthology.orchestra.run.trial110.stdout: kernel-modules-5.14.0-677.el9.x86_64 2026-02-13T20:04:37.726 INFO:teuthology.orchestra.run.trial110.stdout: kernel-modules-core-5.14.0-677.el9.x86_64 2026-02-13T20:04:37.727 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:04:37.727 INFO:teuthology.orchestra.run.trial110.stdout:Complete! 2026-02-13T20:04:37.786 DEBUG:teuthology.orchestra.run.trial110:> rpm -q kernel | sort -rV | head -n 1 2026-02-13T20:04:37.811 INFO:teuthology.orchestra.run.trial110.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-13T20:04:37.812 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-13T20:04:37.812 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-677.el9.x86_64 2026-02-13T20:04:37.812 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-13T20:04:37.813 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-13T20:04:37.813 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-13T20:04:37.813 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial110.front.sepia.ceph.com, path=None, version=distro) 2026-02-13T20:04:37.813 DEBUG:teuthology.orchestra.run.trial110:> rpm -q kernel | sort -rV | head -n 1 2026-02-13T20:04:37.874 INFO:teuthology.orchestra.run.trial110.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-13T20:04:37.875 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-13T20:04:37.875 DEBUG:teuthology.orchestra.run.trial110:> sudo rpm -qi grub2-tools 2026-02-13T20:04:37.945 INFO:teuthology.orchestra.run.trial110.stdout:Name : grub2-tools 2026-02-13T20:04:37.945 INFO:teuthology.orchestra.run.trial110.stdout:Epoch : 1 2026-02-13T20:04:37.946 INFO:teuthology.orchestra.run.trial110.stdout:Version : 2.06 2026-02-13T20:04:37.946 INFO:teuthology.orchestra.run.trial110.stdout:Release : 118.el9 2026-02-13T20:04:37.946 INFO:teuthology.orchestra.run.trial110.stdout:Architecture: x86_64 2026-02-13T20:04:37.946 INFO:teuthology.orchestra.run.trial110.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-13T20:04:37.946 INFO:teuthology.orchestra.run.trial110.stdout:Group : Unspecified 2026-02-13T20:04:37.946 INFO:teuthology.orchestra.run.trial110.stdout:Size : 8393909 2026-02-13T20:04:37.946 INFO:teuthology.orchestra.run.trial110.stdout:License : GPLv3+ 2026-02-13T20:04:37.946 INFO:teuthology.orchestra.run.trial110.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-13T20:04:37.946 INFO:teuthology.orchestra.run.trial110.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-13T20:04:37.946 INFO:teuthology.orchestra.run.trial110.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-13T20:04:37.946 INFO:teuthology.orchestra.run.trial110.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-13T20:04:37.946 INFO:teuthology.orchestra.run.trial110.stdout:Packager : builder@centos.org 2026-02-13T20:04:37.946 INFO:teuthology.orchestra.run.trial110.stdout:Vendor : CentOS 2026-02-13T20:04:37.946 INFO:teuthology.orchestra.run.trial110.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-13T20:04:37.946 INFO:teuthology.orchestra.run.trial110.stdout:Summary : Support tools for GRUB. 2026-02-13T20:04:37.946 INFO:teuthology.orchestra.run.trial110.stdout:Description : 2026-02-13T20:04:37.946 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:04:37.947 INFO:teuthology.orchestra.run.trial110.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-13T20:04:37.947 INFO:teuthology.orchestra.run.trial110.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-13T20:04:37.947 INFO:teuthology.orchestra.run.trial110.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-13T20:04:37.947 INFO:teuthology.orchestra.run.trial110.stdout:hardware devices. 2026-02-13T20:04:37.947 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:04:37.947 INFO:teuthology.orchestra.run.trial110.stdout:This subpackage provides tools for support of all platforms. 2026-02-13T20:04:37.948 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-13T20:04:37.948 INFO:teuthology.task.kernel:Updating grub on trial110 to boot 5.14.0-677.el9.x86_64 2026-02-13T20:04:37.948 DEBUG:teuthology.orchestra.run.trial110:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-13T20:04:38.011 INFO:teuthology.orchestra.run.trial110.stdout:/boot/loader/entries/2734456005d743dca7f3dc77c35a2d0d-0-rescue.conf 2026-02-13T20:04:38.012 DEBUG:teuthology.orchestra.run.trial110:> sudo command -v grubby && echo yes || echo no 2026-02-13T20:04:38.076 INFO:teuthology.orchestra.run.trial110.stdout:/sbin/grubby 2026-02-13T20:04:38.077 INFO:teuthology.orchestra.run.trial110.stdout:yes 2026-02-13T20:04:38.078 DEBUG:teuthology.orchestra.run.trial110:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-677.el9.x86_64" | head -n 1 2026-02-13T20:04:38.143 INFO:teuthology.orchestra.run.trial110.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64.conf 2026-02-13T20:04:38.144 DEBUG:teuthology.orchestra.run.trial110:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64 2026-02-13T20:04:38.216 DEBUG:teuthology.orchestra.run.trial110:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-13T20:04:38.427 INFO:teuthology.orchestra.run.trial110.stderr:Generating grub configuration file ... 2026-02-13T20:04:38.492 INFO:teuthology.orchestra.run.trial110.stderr:Found linux image: /boot/vmlinuz-5.14.0-677.el9.x86_64 2026-02-13T20:04:38.498 INFO:teuthology.orchestra.run.trial110.stderr:Found initrd image: /boot/initramfs-5.14.0-677.el9.x86_64.img 2026-02-13T20:04:38.757 INFO:teuthology.orchestra.run.trial110.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-13T20:04:38.763 INFO:teuthology.orchestra.run.trial110.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-13T20:04:38.795 INFO:teuthology.orchestra.run.trial110.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-13T20:04:38.802 INFO:teuthology.orchestra.run.trial110.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-13T20:04:38.825 INFO:teuthology.orchestra.run.trial110.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-13T20:04:38.832 INFO:teuthology.orchestra.run.trial110.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-13T20:04:38.915 INFO:teuthology.orchestra.run.trial110.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-13T20:04:38.923 INFO:teuthology.orchestra.run.trial110.stderr:done 2026-02-13T20:04:38.925 DEBUG:teuthology.orchestra.run.trial110:> test -d /sys/firmware/efi 2026-02-13T20:04:38.940 DEBUG:teuthology.orchestra.run.trial110:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-13T20:04:39.005 INFO:teuthology.orchestra.run.trial110.stdout:/boot/efi/EFI/BOOT 2026-02-13T20:04:39.006 INFO:teuthology.orchestra.run.trial110.stdout:/boot/efi/EFI/centos 2026-02-13T20:04:39.007 DEBUG:teuthology.orchestra.run.trial110:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-13T20:04:39.074 INFO:teuthology.orchestra.run.trial110.stdout:no 2026-02-13T20:04:39.075 DEBUG:teuthology.orchestra.run.trial110:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-13T20:04:39.139 INFO:teuthology.orchestra.run.trial110.stdout:yes 2026-02-13T20:04:39.139 DEBUG:teuthology.orchestra.run.trial110:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-13T20:04:39.203 DEBUG:teuthology.orchestra.run.trial110:> sudo shutdown -r now 2026-02-13T20:04:56.257 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 4/4 2026-02-13T20:04:56.277 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 4/4 2026-02-13T20:04:56.342 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: kernel-5.14.0-677.el9.x86_64 4/4 2026-02-13T20:04:56.342 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : kernel-5.14.0-677.el9.x86_64 1/4 2026-02-13T20:04:56.342 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-13T20:04:56.342 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-13T20:04:56.393 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-13T20:04:56.393 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:04:56.393 INFO:teuthology.orchestra.run.trial188.stdout:Installed: 2026-02-13T20:04:56.394 INFO:teuthology.orchestra.run.trial188.stdout: kernel-5.14.0-677.el9.x86_64 2026-02-13T20:04:56.394 INFO:teuthology.orchestra.run.trial188.stdout: kernel-core-5.14.0-677.el9.x86_64 2026-02-13T20:04:56.394 INFO:teuthology.orchestra.run.trial188.stdout: kernel-modules-5.14.0-677.el9.x86_64 2026-02-13T20:04:56.394 INFO:teuthology.orchestra.run.trial188.stdout: kernel-modules-core-5.14.0-677.el9.x86_64 2026-02-13T20:04:56.394 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:04:56.394 INFO:teuthology.orchestra.run.trial188.stdout:Complete! 2026-02-13T20:04:56.450 DEBUG:teuthology.orchestra.run.trial188:> rpm -q kernel | sort -rV | head -n 1 2026-02-13T20:04:56.475 INFO:teuthology.orchestra.run.trial188.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-13T20:04:56.475 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-13T20:04:56.476 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-677.el9.x86_64 2026-02-13T20:04:56.476 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-13T20:04:56.476 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-13T20:04:56.476 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2026-02-13T20:04:56.476 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial188.front.sepia.ceph.com, path=None, version=distro) 2026-02-13T20:04:56.476 DEBUG:teuthology.orchestra.run.trial188:> rpm -q kernel | sort -rV | head -n 1 2026-02-13T20:04:56.538 INFO:teuthology.orchestra.run.trial188.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-13T20:04:56.539 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-13T20:04:56.539 DEBUG:teuthology.orchestra.run.trial188:> sudo rpm -qi grub2-tools 2026-02-13T20:04:56.608 INFO:teuthology.orchestra.run.trial188.stdout:Name : grub2-tools 2026-02-13T20:04:56.609 INFO:teuthology.orchestra.run.trial188.stdout:Epoch : 1 2026-02-13T20:04:56.609 INFO:teuthology.orchestra.run.trial188.stdout:Version : 2.06 2026-02-13T20:04:56.609 INFO:teuthology.orchestra.run.trial188.stdout:Release : 118.el9 2026-02-13T20:04:56.609 INFO:teuthology.orchestra.run.trial188.stdout:Architecture: x86_64 2026-02-13T20:04:56.609 INFO:teuthology.orchestra.run.trial188.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-13T20:04:56.609 INFO:teuthology.orchestra.run.trial188.stdout:Group : Unspecified 2026-02-13T20:04:56.609 INFO:teuthology.orchestra.run.trial188.stdout:Size : 8393909 2026-02-13T20:04:56.609 INFO:teuthology.orchestra.run.trial188.stdout:License : GPLv3+ 2026-02-13T20:04:56.609 INFO:teuthology.orchestra.run.trial188.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-13T20:04:56.610 INFO:teuthology.orchestra.run.trial188.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-13T20:04:56.610 INFO:teuthology.orchestra.run.trial188.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-13T20:04:56.610 INFO:teuthology.orchestra.run.trial188.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-13T20:04:56.610 INFO:teuthology.orchestra.run.trial188.stdout:Packager : builder@centos.org 2026-02-13T20:04:56.610 INFO:teuthology.orchestra.run.trial188.stdout:Vendor : CentOS 2026-02-13T20:04:56.610 INFO:teuthology.orchestra.run.trial188.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-13T20:04:56.610 INFO:teuthology.orchestra.run.trial188.stdout:Summary : Support tools for GRUB. 2026-02-13T20:04:56.610 INFO:teuthology.orchestra.run.trial188.stdout:Description : 2026-02-13T20:04:56.610 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:04:56.610 INFO:teuthology.orchestra.run.trial188.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-13T20:04:56.610 INFO:teuthology.orchestra.run.trial188.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-13T20:04:56.611 INFO:teuthology.orchestra.run.trial188.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-13T20:04:56.611 INFO:teuthology.orchestra.run.trial188.stdout:hardware devices. 2026-02-13T20:04:56.611 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:04:56.611 INFO:teuthology.orchestra.run.trial188.stdout:This subpackage provides tools for support of all platforms. 2026-02-13T20:04:56.612 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-13T20:04:56.613 INFO:teuthology.task.kernel:Updating grub on trial188 to boot 5.14.0-677.el9.x86_64 2026-02-13T20:04:56.613 DEBUG:teuthology.orchestra.run.trial188:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-13T20:04:56.675 INFO:teuthology.orchestra.run.trial188.stdout:/boot/loader/entries/2734456005d743dca7f3dc77c35a2d0d-0-rescue.conf 2026-02-13T20:04:56.677 DEBUG:teuthology.orchestra.run.trial188:> sudo command -v grubby && echo yes || echo no 2026-02-13T20:04:56.742 INFO:teuthology.orchestra.run.trial188.stdout:/sbin/grubby 2026-02-13T20:04:56.744 INFO:teuthology.orchestra.run.trial188.stdout:yes 2026-02-13T20:04:56.744 DEBUG:teuthology.orchestra.run.trial188:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-677.el9.x86_64" | head -n 1 2026-02-13T20:04:56.808 INFO:teuthology.orchestra.run.trial188.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64.conf 2026-02-13T20:04:56.809 DEBUG:teuthology.orchestra.run.trial188:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64 2026-02-13T20:04:56.881 DEBUG:teuthology.orchestra.run.trial188:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-13T20:04:57.087 INFO:teuthology.orchestra.run.trial188.stderr:Generating grub configuration file ... 2026-02-13T20:04:57.151 INFO:teuthology.orchestra.run.trial188.stderr:Found linux image: /boot/vmlinuz-5.14.0-677.el9.x86_64 2026-02-13T20:04:57.157 INFO:teuthology.orchestra.run.trial188.stderr:Found initrd image: /boot/initramfs-5.14.0-677.el9.x86_64.img 2026-02-13T20:04:57.405 INFO:teuthology.orchestra.run.trial188.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-13T20:04:57.412 INFO:teuthology.orchestra.run.trial188.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-13T20:04:57.443 INFO:teuthology.orchestra.run.trial188.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-13T20:04:57.449 INFO:teuthology.orchestra.run.trial188.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-13T20:04:57.473 INFO:teuthology.orchestra.run.trial188.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-13T20:04:57.479 INFO:teuthology.orchestra.run.trial188.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-13T20:04:57.561 INFO:teuthology.orchestra.run.trial188.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-13T20:04:57.569 INFO:teuthology.orchestra.run.trial188.stderr:done 2026-02-13T20:04:57.571 DEBUG:teuthology.orchestra.run.trial188:> test -d /sys/firmware/efi 2026-02-13T20:04:57.586 DEBUG:teuthology.orchestra.run.trial188:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-13T20:04:57.651 INFO:teuthology.orchestra.run.trial188.stdout:/boot/efi/EFI/BOOT 2026-02-13T20:04:57.651 INFO:teuthology.orchestra.run.trial188.stdout:/boot/efi/EFI/centos 2026-02-13T20:04:57.653 DEBUG:teuthology.orchestra.run.trial188:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-13T20:04:57.718 INFO:teuthology.orchestra.run.trial188.stdout:no 2026-02-13T20:04:57.718 DEBUG:teuthology.orchestra.run.trial188:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-13T20:04:57.782 INFO:teuthology.orchestra.run.trial188.stdout:yes 2026-02-13T20:04:57.783 DEBUG:teuthology.orchestra.run.trial188:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-13T20:04:57.848 DEBUG:teuthology.orchestra.run.trial188:> sudo shutdown -r now 2026-02-13T20:04:57.920 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2026-02-13T20:05:09.256 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-13T20:05:09.257 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial110.front.sepia.ceph.com' 2026-02-13T20:05:09.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T20:05:27.908 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-13T20:05:27.908 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-13T20:05:27.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T20:06:09.300 DEBUG:teuthology.orchestra.remote:timed out 2026-02-13T20:06:18.309 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial110.front.sepia.ceph.com' 2026-02-13T20:06:18.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T20:06:18.410 DEBUG:teuthology.orchestra.run.trial110:> true 2026-02-13T20:06:18.563 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial110.front.sepia.ceph.com' 2026-02-13T20:06:18.563 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-13T20:06:18.563 DEBUG:teuthology.orchestra.run.trial110:> uname -r 2026-02-13T20:06:18.622 INFO:teuthology.orchestra.run.trial110.stdout:5.14.0-677.el9.x86_64 2026-02-13T20:06:18.622 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-677.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-13T20:06:18.622 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-13T20:06:18.622 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-13T20:06:19.624 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-13T20:06:19.624 DEBUG:teuthology.orchestra.run.trial110:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-13T20:06:19.653 INFO:teuthology.orchestra.run.trial110.stdout:ttyS1 2026-02-13T20:06:19.677 DEBUG:teuthology.parallel:result is None 2026-02-13T20:06:27.910 DEBUG:teuthology.orchestra.remote:timed out 2026-02-13T20:06:36.911 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-13T20:06:36.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T20:06:37.051 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-13T20:06:37.207 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-13T20:06:37.207 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-13T20:06:37.207 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-13T20:06:37.263 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-677.el9.x86_64 2026-02-13T20:06:37.263 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-677.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-13T20:06:37.264 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-13T20:06:37.264 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-13T20:06:38.265 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2026-02-13T20:06:38.265 DEBUG:teuthology.orchestra.run.trial188:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-13T20:06:38.293 INFO:teuthology.orchestra.run.trial188.stdout:ttyS1 2026-02-13T20:06:38.315 DEBUG:teuthology.parallel:result is None 2026-02-13T20:06:38.316 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-13T20:06:38.329 INFO:teuthology.task.internal:Creating test directory... 2026-02-13T20:06:38.329 DEBUG:teuthology.orchestra.run.trial110:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-13T20:06:38.331 DEBUG:teuthology.orchestra.run.trial188:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-13T20:06:38.372 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-13T20:06:38.384 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-13T20:06:38.398 INFO:teuthology.task.internal:Creating archive directory... 2026-02-13T20:06:38.399 DEBUG:teuthology.orchestra.run.trial110:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-13T20:06:38.401 DEBUG:teuthology.orchestra.run.trial188:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-13T20:06:38.438 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-13T20:06:38.450 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-13T20:06:38.450 DEBUG:teuthology.orchestra.run.trial110:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-13T20:06:38.458 DEBUG:teuthology.orchestra.run.trial188:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-13T20:06:38.481 INFO:teuthology.orchestra.run.trial110.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T20:06:38.490 INFO:teuthology.orchestra.run.trial110.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T20:06:38.492 INFO:teuthology.orchestra.run.trial188.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T20:06:38.501 INFO:teuthology.orchestra.run.trial188.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T20:06:38.503 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-13T20:06:38.514 INFO:teuthology.task.internal:Configuring sudo... 2026-02-13T20:06:38.514 DEBUG:teuthology.orchestra.run.trial110:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-13T20:06:38.533 DEBUG:teuthology.orchestra.run.trial188:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-13T20:06:38.568 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-13T20:06:38.586 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-13T20:06:38.586 DEBUG:teuthology.orchestra.run.trial110:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-13T20:06:38.598 DEBUG:teuthology.orchestra.run.trial188:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-13T20:06:38.624 DEBUG:teuthology.orchestra.run.trial110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T20:06:38.775 DEBUG:teuthology.orchestra.run.trial110:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T20:06:38.801 DEBUG:teuthology.orchestra.run.trial110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T20:06:38.916 DEBUG:teuthology.orchestra.run.trial110:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T20:06:38.939 DEBUG:teuthology.orchestra.run.trial110:> set -ex 2026-02-13T20:06:38.939 DEBUG:teuthology.orchestra.run.trial110:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-13T20:06:39.003 DEBUG:teuthology.orchestra.run.trial188:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T20:06:39.096 DEBUG:teuthology.orchestra.run.trial188:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T20:06:39.121 DEBUG:teuthology.orchestra.run.trial188:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T20:06:39.255 DEBUG:teuthology.orchestra.run.trial188:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T20:06:39.279 DEBUG:teuthology.orchestra.run.trial188:> set -ex 2026-02-13T20:06:39.279 DEBUG:teuthology.orchestra.run.trial188:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-13T20:06:39.343 DEBUG:teuthology.orchestra.run.trial110:> sudo service rsyslog restart 2026-02-13T20:06:39.345 DEBUG:teuthology.orchestra.run.trial188:> sudo service rsyslog restart 2026-02-13T20:06:39.372 INFO:teuthology.orchestra.run.trial110.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T20:06:39.409 INFO:teuthology.orchestra.run.trial188.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T20:06:39.687 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-13T20:06:39.703 INFO:teuthology.task.internal:Starting timer... 2026-02-13T20:06:39.704 INFO:teuthology.run_tasks:Running task pcp... 2026-02-13T20:06:39.730 INFO:teuthology.run_tasks:Running task selinux... 2026-02-13T20:06:39.748 DEBUG:teuthology.orchestra.run.trial110:> sudo service auditd rotate 2026-02-13T20:06:39.778 INFO:teuthology.orchestra.run.trial110.stdout:Rotating logs: 2026-02-13T20:06:39.780 DEBUG:teuthology.orchestra.run.trial188:> sudo service auditd rotate 2026-02-13T20:06:39.810 INFO:teuthology.orchestra.run.trial188.stdout:Rotating logs: 2026-02-13T20:06:39.812 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-13T20:06:39.812 DEBUG:teuthology.orchestra.run.trial110:> /usr/sbin/getenforce 2026-02-13T20:06:39.835 INFO:teuthology.orchestra.run.trial110.stdout:Permissive 2026-02-13T20:06:39.836 DEBUG:teuthology.orchestra.run.trial188:> /usr/sbin/getenforce 2026-02-13T20:06:39.867 INFO:teuthology.orchestra.run.trial188.stdout:Permissive 2026-02-13T20:06:39.867 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial110.front.sepia.ceph.com': 'permissive', 'ubuntu@trial188.front.sepia.ceph.com': 'permissive'} 2026-02-13T20:06:39.868 DEBUG:teuthology.orchestra.run.trial110:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-13T20:06:39.900 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T20:06:39.900 DEBUG:teuthology.orchestra.run.trial188:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-13T20:06:39.930 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T20:06:39.930 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-13T20:06:39.930 DEBUG:teuthology.orchestra.run.trial110:> sudo /usr/sbin/setenforce permissive 2026-02-13T20:06:39.966 DEBUG:teuthology.orchestra.run.trial188:> sudo /usr/sbin/setenforce permissive 2026-02-13T20:06:39.994 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-13T20:06:40.010 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-13T20:06:40.017 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-13T20:06:40.018 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial110.front.sepia.ceph.com,trial188.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-13T20:09:25.123 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial110.front.sepia.ceph.com'), Remote(name='ubuntu@trial188.front.sepia.ceph.com')] 2026-02-13T20:09:25.127 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial110.front.sepia.ceph.com' 2026-02-13T20:09:25.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T20:09:25.238 DEBUG:teuthology.orchestra.run.trial110:> true 2026-02-13T20:09:25.314 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial110.front.sepia.ceph.com' 2026-02-13T20:09:25.315 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-13T20:09:25.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T20:09:25.420 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-13T20:09:25.502 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-13T20:09:25.502 INFO:teuthology.run_tasks:Running task clock... 2026-02-13T20:09:25.517 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-13T20:09:25.517 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-13T20:09:25.518 DEBUG:teuthology.orchestra.run.trial110:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T20:09:25.520 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-13T20:09:25.520 DEBUG:teuthology.orchestra.run.trial188:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T20:09:25.546 INFO:teuthology.orchestra.run.trial110.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-13T20:09:25.558 INFO:teuthology.orchestra.run.trial110.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-13T20:09:25.567 INFO:teuthology.orchestra.run.trial188.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-13T20:09:25.578 INFO:teuthology.orchestra.run.trial110.stderr:sudo: ntpd: command not found 2026-02-13T20:09:25.580 INFO:teuthology.orchestra.run.trial188.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-13T20:09:25.587 INFO:teuthology.orchestra.run.trial110.stdout:506 Cannot talk to daemon 2026-02-13T20:09:25.599 INFO:teuthology.orchestra.run.trial110.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-13T20:09:25.601 INFO:teuthology.orchestra.run.trial188.stderr:sudo: ntpd: command not found 2026-02-13T20:09:25.610 INFO:teuthology.orchestra.run.trial110.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-13T20:09:25.610 INFO:teuthology.orchestra.run.trial188.stdout:506 Cannot talk to daemon 2026-02-13T20:09:25.622 INFO:teuthology.orchestra.run.trial188.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-13T20:09:25.634 INFO:teuthology.orchestra.run.trial188.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-13T20:09:25.652 INFO:teuthology.orchestra.run.trial110.stderr:bash: line 1: ntpq: command not found 2026-02-13T20:09:25.674 INFO:teuthology.orchestra.run.trial110.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T20:09:25.674 INFO:teuthology.orchestra.run.trial110.stdout:=============================================================================== 2026-02-13T20:09:25.675 INFO:teuthology.orchestra.run.trial110.stdout:^? 198.71.50.75 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T20:09:25.675 INFO:teuthology.orchestra.run.trial110.stdout:^? 157.245.125.229 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T20:09:25.675 INFO:teuthology.orchestra.run.trial110.stdout:^? 209.205.228.50 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T20:09:25.675 INFO:teuthology.orchestra.run.trial110.stdout:^? 172-234-25-10.ip.linodeu> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T20:09:25.678 INFO:teuthology.orchestra.run.trial188.stderr:bash: line 1: ntpq: command not found 2026-02-13T20:09:25.703 INFO:teuthology.orchestra.run.trial188.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T20:09:25.703 INFO:teuthology.orchestra.run.trial188.stdout:=============================================================================== 2026-02-13T20:09:25.703 INFO:teuthology.orchestra.run.trial188.stdout:^? ntp.maxhost.io 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T20:09:25.703 INFO:teuthology.orchestra.run.trial188.stdout:^? 66.205.249.28 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T20:09:25.703 INFO:teuthology.orchestra.run.trial188.stdout:^? ntp1.lax.us.hojmark.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T20:09:25.703 INFO:teuthology.orchestra.run.trial188.stdout:^? s2-b.time.mci1.us.rozint> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T20:09:25.703 INFO:teuthology.run_tasks:Running task install... 2026-02-13T20:09:25.715 DEBUG:teuthology.task.install:project ceph 2026-02-13T20:09:25.715 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6'}} 2026-02-13T20:09:25.716 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6'} 2026-02-13T20:09:25.716 INFO:teuthology.task.install:Using flavor: default 2026-02-13T20:09:25.725 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-13T20:09:25.726 INFO:teuthology.task.install:extra packages: [] 2026-02-13T20:09:25.727 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6', 'tag': None, 'wait_for_package': False} 2026-02-13T20:09:25.728 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=afefaa40503a4bf024e96f97dd7f852b75f00ad6 2026-02-13T20:09:25.733 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6', 'tag': None, 'wait_for_package': False} 2026-02-13T20:09:25.733 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=afefaa40503a4bf024e96f97dd7f852b75f00ad6 2026-02-13T20:09:25.911 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/centos/9/flavors/default/ 2026-02-13T20:09:25.911 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5230.gafefaa40 2026-02-13T20:09:25.920 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/centos/9/flavors/default/ 2026-02-13T20:09:25.920 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5230.gafefaa40 2026-02-13T20:09:26.062 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-13T20:09:26.062 DEBUG:teuthology.orchestra.run.trial110:> set -ex 2026-02-13T20:09:26.062 DEBUG:teuthology.orchestra.run.trial110:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-13T20:09:26.068 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-13T20:09:26.068 DEBUG:teuthology.orchestra.run.trial188:> set -ex 2026-02-13T20:09:26.068 DEBUG:teuthology.orchestra.run.trial188:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-13T20:09:26.087 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-13T20:09:26.087 DEBUG:teuthology.orchestra.run.trial110:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/afefaa40503a4bf024e96f97dd7f852b75f00ad6/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-13T20:09:26.094 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-13T20:09:26.094 DEBUG:teuthology.orchestra.run.trial188:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/afefaa40503a4bf024e96f97dd7f852b75f00ad6/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-13T20:09:26.152 DEBUG:teuthology.orchestra.run.trial110:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-13T20:09:26.159 DEBUG:teuthology.orchestra.run.trial188:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-13T20:09:26.226 DEBUG:teuthology.orchestra.run.trial110:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-13T20:09:26.232 DEBUG:teuthology.orchestra.run.trial188:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-13T20:09:26.290 INFO:teuthology.orchestra.run.trial110.stdout:check_obsoletes = 1 2026-02-13T20:09:26.291 DEBUG:teuthology.orchestra.run.trial110:> sudo yum clean all 2026-02-13T20:09:26.296 INFO:teuthology.orchestra.run.trial188.stdout:check_obsoletes = 1 2026-02-13T20:09:26.297 DEBUG:teuthology.orchestra.run.trial188:> sudo yum clean all 2026-02-13T20:09:26.439 INFO:teuthology.orchestra.run.trial110.stdout:41 files removed 2026-02-13T20:09:26.447 INFO:teuthology.orchestra.run.trial188.stdout:41 files removed 2026-02-13T20:09:26.453 DEBUG:teuthology.orchestra.run.trial110:> sudo yum -y install ceph-radosgw 2026-02-13T20:09:26.463 DEBUG:teuthology.orchestra.run.trial188:> sudo yum -y install ceph-radosgw 2026-02-13T20:09:27.093 INFO:teuthology.orchestra.run.trial110.stdout:ceph packages for x86_64 185 kB/s | 91 kB 00:00 2026-02-13T20:09:27.150 INFO:teuthology.orchestra.run.trial188.stdout:ceph packages for x86_64 169 kB/s | 91 kB 00:00 2026-02-13T20:09:27.378 INFO:teuthology.orchestra.run.trial110.stdout:ceph noarch packages 91 kB/s | 24 kB 00:00 2026-02-13T20:09:27.392 INFO:teuthology.orchestra.run.trial188.stdout:ceph noarch packages 109 kB/s | 24 kB 00:00 2026-02-13T20:09:27.504 INFO:teuthology.orchestra.run.trial110.stdout:ceph source packages 20 kB/s | 2.1 kB 00:00 2026-02-13T20:09:27.517 INFO:teuthology.orchestra.run.trial188.stdout:ceph source packages 20 kB/s | 2.1 kB 00:00 2026-02-13T20:09:28.599 INFO:teuthology.orchestra.run.trial188.stdout:CentOS Stream 9 - BaseOS 8.4 MB/s | 8.9 MB 00:01 2026-02-13T20:09:31.674 INFO:teuthology.orchestra.run.trial188.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-13T20:09:33.128 INFO:teuthology.orchestra.run.trial110.stdout:CentOS Stream 9 - BaseOS 1.6 MB/s | 8.9 MB 00:05 2026-02-13T20:09:35.293 INFO:teuthology.orchestra.run.trial188.stdout:CentOS Stream 9 - CRB 6.3 MB/s | 7.8 MB 00:01 2026-02-13T20:09:36.229 INFO:teuthology.orchestra.run.trial110.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-13T20:09:37.023 INFO:teuthology.orchestra.run.trial188.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 20 kB 00:01 2026-02-13T20:09:37.610 INFO:teuthology.orchestra.run.trial188.stdout:Extra Packages for Enterprise Linux 40 MB/s | 20 MB 00:00 2026-02-13T20:09:39.132 INFO:teuthology.orchestra.run.trial110.stdout:CentOS Stream 9 - CRB 17 MB/s | 7.8 MB 00:00 2026-02-13T20:09:39.970 INFO:teuthology.orchestra.run.trial110.stdout:CentOS Stream 9 - Extras packages 177 kB/s | 20 kB 00:00 2026-02-13T20:09:40.540 INFO:teuthology.orchestra.run.trial110.stdout:Extra Packages for Enterprise Linux 41 MB/s | 20 MB 00:00 2026-02-13T20:09:40.826 INFO:teuthology.orchestra.run.trial188.stdout:lab-extras 2.5 MB/s | 50 kB 00:00 2026-02-13T20:09:42.118 INFO:teuthology.orchestra.run.trial188.stdout:Dependencies resolved. 2026-02-13T20:09:42.120 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-13T20:09:42.120 INFO:teuthology.orchestra.run.trial188.stdout: Package Arch Version Repository Size 2026-02-13T20:09:42.120 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-13T20:09:42.120 INFO:teuthology.orchestra.run.trial188.stdout:Installing: 2026-02-13T20:09:42.120 INFO:teuthology.orchestra.run.trial188.stdout: ceph-radosgw x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 13 M 2026-02-13T20:09:42.120 INFO:teuthology.orchestra.run.trial188.stdout:Upgrading: 2026-02-13T20:09:42.120 INFO:teuthology.orchestra.run.trial188.stdout: librados2 x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 3.5 M 2026-02-13T20:09:42.121 INFO:teuthology.orchestra.run.trial188.stdout: librbd1 x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 2.8 M 2026-02-13T20:09:42.121 INFO:teuthology.orchestra.run.trial188.stdout:Installing dependencies: 2026-02-13T20:09:42.121 INFO:teuthology.orchestra.run.trial188.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-13T20:09:42.121 INFO:teuthology.orchestra.run.trial188.stdout: ceph-base x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 5.2 M 2026-02-13T20:09:42.121 INFO:teuthology.orchestra.run.trial188.stdout: ceph-common x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 24 M 2026-02-13T20:09:42.121 INFO:teuthology.orchestra.run.trial188.stdout: ceph-selinux x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 25 k 2026-02-13T20:09:42.121 INFO:teuthology.orchestra.run.trial188.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-13T20:09:42.121 INFO:teuthology.orchestra.run.trial188.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-13T20:09:42.121 INFO:teuthology.orchestra.run.trial188.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-13T20:09:42.121 INFO:teuthology.orchestra.run.trial188.stdout: libcephfs2 x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 909 k 2026-02-13T20:09:42.121 INFO:teuthology.orchestra.run.trial188.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-13T20:09:42.121 INFO:teuthology.orchestra.run.trial188.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-13T20:09:42.122 INFO:teuthology.orchestra.run.trial188.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-13T20:09:42.122 INFO:teuthology.orchestra.run.trial188.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-13T20:09:42.122 INFO:teuthology.orchestra.run.trial188.stdout: libradosstriper1 x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 248 k 2026-02-13T20:09:42.122 INFO:teuthology.orchestra.run.trial188.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-13T20:09:42.122 INFO:teuthology.orchestra.run.trial188.stdout: librgw2 x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 6.5 M 2026-02-13T20:09:42.122 INFO:teuthology.orchestra.run.trial188.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-13T20:09:42.122 INFO:teuthology.orchestra.run.trial188.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-13T20:09:42.122 INFO:teuthology.orchestra.run.trial188.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-13T20:09:42.122 INFO:teuthology.orchestra.run.trial188.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-13T20:09:42.122 INFO:teuthology.orchestra.run.trial188.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-13T20:09:42.123 INFO:teuthology.orchestra.run.trial188.stdout: python3-ceph-argparse x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 45 k 2026-02-13T20:09:42.123 INFO:teuthology.orchestra.run.trial188.stdout: python3-ceph-common x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 185 k 2026-02-13T20:09:42.123 INFO:teuthology.orchestra.run.trial188.stdout: python3-cephfs x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 203 k 2026-02-13T20:09:42.123 INFO:teuthology.orchestra.run.trial188.stdout: python3-rados x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 324 k 2026-02-13T20:09:42.123 INFO:teuthology.orchestra.run.trial188.stdout: python3-rbd x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 305 k 2026-02-13T20:09:42.123 INFO:teuthology.orchestra.run.trial188.stdout: python3-rgw x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 100 k 2026-02-13T20:09:42.123 INFO:teuthology.orchestra.run.trial188.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-13T20:09:42.123 INFO:teuthology.orchestra.run.trial188.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-13T20:09:42.123 INFO:teuthology.orchestra.run.trial188.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-13T20:09:42.123 INFO:teuthology.orchestra.run.trial188.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-13T20:09:42.123 INFO:teuthology.orchestra.run.trial188.stdout:Installing weak dependencies: 2026-02-13T20:09:42.124 INFO:teuthology.orchestra.run.trial188.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-13T20:09:42.124 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:09:42.124 INFO:teuthology.orchestra.run.trial188.stdout:Transaction Summary 2026-02-13T20:09:42.124 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-13T20:09:42.124 INFO:teuthology.orchestra.run.trial188.stdout:Install 32 Packages 2026-02-13T20:09:42.124 INFO:teuthology.orchestra.run.trial188.stdout:Upgrade 2 Packages 2026-02-13T20:09:42.124 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:09:42.125 INFO:teuthology.orchestra.run.trial188.stdout:Total download size: 67 M 2026-02-13T20:09:42.125 INFO:teuthology.orchestra.run.trial188.stdout:Downloading Packages: 2026-02-13T20:09:43.791 INFO:teuthology.orchestra.run.trial110.stdout:lab-extras 2.5 MB/s | 50 kB 00:00 2026-02-13T20:09:44.014 INFO:teuthology.orchestra.run.trial188.stdout:(1/34): ceph-base-20.3.0-5230.gafefaa40.el9.x86 3.2 MB/s | 5.2 MB 00:01 2026-02-13T20:09:44.039 INFO:teuthology.orchestra.run.trial188.stdout:(2/34): ceph-selinux-20.3.0-5230.gafefaa40.el9. 985 kB/s | 25 kB 00:00 2026-02-13T20:09:44.129 INFO:teuthology.orchestra.run.trial188.stdout:(3/34): libcephfs2-20.3.0-5230.gafefaa40.el9.x8 9.9 MB/s | 909 kB 00:00 2026-02-13T20:09:44.165 INFO:teuthology.orchestra.run.trial188.stdout:(4/34): libradosstriper1-20.3.0-5230.gafefaa40. 6.9 MB/s | 248 kB 00:00 2026-02-13T20:09:44.691 INFO:teuthology.orchestra.run.trial188.stdout:(5/34): ceph-radosgw-20.3.0-5230.gafefaa40.el9. 5.7 MB/s | 13 MB 00:02 2026-02-13T20:09:44.746 INFO:teuthology.orchestra.run.trial188.stdout:(6/34): python3-ceph-argparse-20.3.0-5230.gafef 815 kB/s | 45 kB 00:00 2026-02-13T20:09:44.806 INFO:teuthology.orchestra.run.trial188.stdout:(7/34): python3-ceph-common-20.3.0-5230.gafefaa 3.0 MB/s | 185 kB 00:00 2026-02-13T20:09:44.816 INFO:teuthology.orchestra.run.trial188.stdout:(8/34): librgw2-20.3.0-5230.gafefaa40.el9.x86_6 9.9 MB/s | 6.5 MB 00:00 2026-02-13T20:09:44.860 INFO:teuthology.orchestra.run.trial188.stdout:(9/34): python3-cephfs-20.3.0-5230.gafefaa40.el 3.7 MB/s | 203 kB 00:00 2026-02-13T20:09:44.871 INFO:teuthology.orchestra.run.trial188.stdout:(10/34): python3-rados-20.3.0-5230.gafefaa40.el 5.8 MB/s | 324 kB 00:00 2026-02-13T20:09:44.919 INFO:teuthology.orchestra.run.trial188.stdout:(11/34): python3-rbd-20.3.0-5230.gafefaa40.el9. 5.0 MB/s | 305 kB 00:00 2026-02-13T20:09:44.927 INFO:teuthology.orchestra.run.trial188.stdout:(12/34): python3-rgw-20.3.0-5230.gafefaa40.el9. 1.8 MB/s | 100 kB 00:00 2026-02-13T20:09:44.946 INFO:teuthology.orchestra.run.trial188.stdout:(13/34): mailcap-2.1.49-5.el9.noarch.rpm 1.2 MB/s | 33 kB 00:00 2026-02-13T20:09:44.963 INFO:teuthology.orchestra.run.trial188.stdout:(14/34): boost-program-options-1.75.0-13.el9.x8 5.8 MB/s | 104 kB 00:00 2026-02-13T20:09:44.971 INFO:teuthology.orchestra.run.trial188.stdout:(15/34): pciutils-3.7.0-7.el9.x86_64.rpm 2.1 MB/s | 93 kB 00:00 2026-02-13T20:09:44.972 INFO:teuthology.orchestra.run.trial188.stdout:(16/34): libnbd-1.20.3-4.el9.x86_64.rpm 18 MB/s | 164 kB 00:00 2026-02-13T20:09:44.977 INFO:teuthology.orchestra.run.trial188.stdout:(17/34): librabbitmq-0.11.0-7.el9.x86_64.rpm 9.4 MB/s | 45 kB 00:00 2026-02-13T20:09:44.988 INFO:teuthology.orchestra.run.trial188.stdout:(18/34): librdkafka-1.6.1-102.el9.x86_64.rpm 62 MB/s | 662 kB 00:00 2026-02-13T20:09:44.991 INFO:teuthology.orchestra.run.trial188.stdout:(19/34): libpmemobj-1.12.1-1.el9.x86_64.rpm 7.7 MB/s | 160 kB 00:00 2026-02-13T20:09:44.994 INFO:teuthology.orchestra.run.trial188.stdout:(20/34): lttng-ust-2.12.0-6.el9.x86_64.rpm 44 MB/s | 292 kB 00:00 2026-02-13T20:09:44.999 INFO:teuthology.orchestra.run.trial188.stdout:(21/34): qatlib-service-25.08.0-2.el9.x86_64.rp 8.5 MB/s | 37 kB 00:00 2026-02-13T20:09:45.003 INFO:teuthology.orchestra.run.trial188.stdout:(22/34): qatlib-25.08.0-2.el9.x86_64.rpm 19 MB/s | 240 kB 00:00 2026-02-13T20:09:45.004 INFO:teuthology.orchestra.run.trial188.stdout:(23/34): qatzip-libs-1.3.1-1.el9.x86_64.rpm 13 MB/s | 66 kB 00:00 2026-02-13T20:09:45.068 INFO:teuthology.orchestra.run.trial110.stdout:Dependencies resolved. 2026-02-13T20:09:45.070 INFO:teuthology.orchestra.run.trial110.stdout:================================================================================ 2026-02-13T20:09:45.070 INFO:teuthology.orchestra.run.trial110.stdout: Package Arch Version Repository Size 2026-02-13T20:09:45.070 INFO:teuthology.orchestra.run.trial110.stdout:================================================================================ 2026-02-13T20:09:45.070 INFO:teuthology.orchestra.run.trial110.stdout:Installing: 2026-02-13T20:09:45.070 INFO:teuthology.orchestra.run.trial110.stdout: ceph-radosgw x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 13 M 2026-02-13T20:09:45.070 INFO:teuthology.orchestra.run.trial110.stdout:Upgrading: 2026-02-13T20:09:45.070 INFO:teuthology.orchestra.run.trial110.stdout: librados2 x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 3.5 M 2026-02-13T20:09:45.070 INFO:teuthology.orchestra.run.trial110.stdout: librbd1 x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 2.8 M 2026-02-13T20:09:45.070 INFO:teuthology.orchestra.run.trial110.stdout:Installing dependencies: 2026-02-13T20:09:45.070 INFO:teuthology.orchestra.run.trial110.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-13T20:09:45.070 INFO:teuthology.orchestra.run.trial110.stdout: ceph-base x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 5.2 M 2026-02-13T20:09:45.070 INFO:teuthology.orchestra.run.trial110.stdout: ceph-common x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 24 M 2026-02-13T20:09:45.070 INFO:teuthology.orchestra.run.trial110.stdout: ceph-selinux x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 25 k 2026-02-13T20:09:45.070 INFO:teuthology.orchestra.run.trial110.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-13T20:09:45.070 INFO:teuthology.orchestra.run.trial110.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-13T20:09:45.070 INFO:teuthology.orchestra.run.trial110.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-13T20:09:45.070 INFO:teuthology.orchestra.run.trial110.stdout: libcephfs2 x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 909 k 2026-02-13T20:09:45.070 INFO:teuthology.orchestra.run.trial110.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-13T20:09:45.070 INFO:teuthology.orchestra.run.trial110.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-13T20:09:45.070 INFO:teuthology.orchestra.run.trial110.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-13T20:09:45.070 INFO:teuthology.orchestra.run.trial110.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-13T20:09:45.070 INFO:teuthology.orchestra.run.trial110.stdout: libradosstriper1 x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 248 k 2026-02-13T20:09:45.070 INFO:teuthology.orchestra.run.trial110.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-13T20:09:45.070 INFO:teuthology.orchestra.run.trial110.stdout: librgw2 x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 6.5 M 2026-02-13T20:09:45.070 INFO:teuthology.orchestra.run.trial110.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-13T20:09:45.070 INFO:teuthology.orchestra.run.trial110.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-13T20:09:45.070 INFO:teuthology.orchestra.run.trial110.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-13T20:09:45.070 INFO:teuthology.orchestra.run.trial110.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-13T20:09:45.070 INFO:teuthology.orchestra.run.trial110.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-13T20:09:45.070 INFO:teuthology.orchestra.run.trial110.stdout: python3-ceph-argparse x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 45 k 2026-02-13T20:09:45.070 INFO:teuthology.orchestra.run.trial110.stdout: python3-ceph-common x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 185 k 2026-02-13T20:09:45.070 INFO:teuthology.orchestra.run.trial110.stdout: python3-cephfs x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 203 k 2026-02-13T20:09:45.070 INFO:teuthology.orchestra.run.trial110.stdout: python3-rados x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 324 k 2026-02-13T20:09:45.070 INFO:teuthology.orchestra.run.trial110.stdout: python3-rbd x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 305 k 2026-02-13T20:09:45.070 INFO:teuthology.orchestra.run.trial110.stdout: python3-rgw x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 100 k 2026-02-13T20:09:45.070 INFO:teuthology.orchestra.run.trial110.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-13T20:09:45.070 INFO:teuthology.orchestra.run.trial110.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-13T20:09:45.070 INFO:teuthology.orchestra.run.trial110.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-13T20:09:45.071 INFO:teuthology.orchestra.run.trial110.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-13T20:09:45.071 INFO:teuthology.orchestra.run.trial110.stdout:Installing weak dependencies: 2026-02-13T20:09:45.071 INFO:teuthology.orchestra.run.trial110.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-13T20:09:45.071 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:09:45.071 INFO:teuthology.orchestra.run.trial110.stdout:Transaction Summary 2026-02-13T20:09:45.071 INFO:teuthology.orchestra.run.trial110.stdout:================================================================================ 2026-02-13T20:09:45.071 INFO:teuthology.orchestra.run.trial110.stdout:Install 32 Packages 2026-02-13T20:09:45.071 INFO:teuthology.orchestra.run.trial110.stdout:Upgrade 2 Packages 2026-02-13T20:09:45.071 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:09:45.071 INFO:teuthology.orchestra.run.trial110.stdout:Total download size: 67 M 2026-02-13T20:09:45.071 INFO:teuthology.orchestra.run.trial110.stdout:Downloading Packages: 2026-02-13T20:09:45.174 INFO:teuthology.orchestra.run.trial188.stdout:(24/34): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.8 MB/s | 308 kB 00:00 2026-02-13T20:09:45.194 INFO:teuthology.orchestra.run.trial188.stdout:(25/34): libarrow-doc-9.0.0-15.el9.noarch.rpm 1.2 MB/s | 25 kB 00:00 2026-02-13T20:09:45.215 INFO:teuthology.orchestra.run.trial188.stdout:(26/34): liboath-2.6.12-1.el9.x86_64.rpm 2.3 MB/s | 49 kB 00:00 2026-02-13T20:09:45.236 INFO:teuthology.orchestra.run.trial188.stdout:(27/34): libunwind-1.6.2-1.el9.x86_64.rpm 3.2 MB/s | 67 kB 00:00 2026-02-13T20:09:45.277 INFO:teuthology.orchestra.run.trial188.stdout:(28/34): parquet-libs-9.0.0-15.el9.x86_64.rpm 20 MB/s | 838 kB 00:00 2026-02-13T20:09:45.301 INFO:teuthology.orchestra.run.trial188.stdout:(29/34): re2-20211101-20.el9.x86_64.rpm 7.9 MB/s | 191 kB 00:00 2026-02-13T20:09:45.346 INFO:teuthology.orchestra.run.trial188.stdout:(30/34): thrift-0.15.0-4.el9.x86_64.rpm 35 MB/s | 1.6 MB 00:00 2026-02-13T20:09:45.391 INFO:teuthology.orchestra.run.trial188.stdout:(31/34): ceph-common-20.3.0-5230.gafefaa40.el9. 8.0 MB/s | 24 MB 00:03 2026-02-13T20:09:45.552 INFO:teuthology.orchestra.run.trial188.stdout:(32/34): librbd1-20.3.0-5230.gafefaa40.el9.x86_ 18 MB/s | 2.8 MB 00:00 2026-02-13T20:09:45.736 INFO:teuthology.orchestra.run.trial188.stdout:(33/34): libarrow-9.0.0-15.el9.x86_64.rpm 6.0 MB/s | 4.4 MB 00:00 2026-02-13T20:09:45.878 INFO:teuthology.orchestra.run.trial188.stdout:(34/34): librados2-20.3.0-5230.gafefaa40.el9.x8 6.6 MB/s | 3.5 MB 00:00 2026-02-13T20:09:45.881 INFO:teuthology.orchestra.run.trial188.stdout:-------------------------------------------------------------------------------- 2026-02-13T20:09:45.881 INFO:teuthology.orchestra.run.trial188.stdout:Total 18 MB/s | 67 MB 00:03 2026-02-13T20:09:45.980 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction check 2026-02-13T20:09:45.998 INFO:teuthology.orchestra.run.trial188.stdout:Transaction check succeeded. 2026-02-13T20:09:45.999 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction test 2026-02-13T20:09:46.258 INFO:teuthology.orchestra.run.trial188.stdout:Transaction test succeeded. 2026-02-13T20:09:46.258 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction 2026-02-13T20:09:46.505 INFO:teuthology.orchestra.run.trial110.stdout:(1/34): ceph-base-20.3.0-5230.gafefaa40.el9.x86 5.8 MB/s | 5.2 MB 00:00 2026-02-13T20:09:46.542 INFO:teuthology.orchestra.run.trial110.stdout:(2/34): ceph-selinux-20.3.0-5230.gafefaa40.el9. 679 kB/s | 25 kB 00:00 2026-02-13T20:09:46.557 INFO:teuthology.orchestra.run.trial188.stdout: Preparing : 1/1 2026-02-13T20:09:46.642 INFO:teuthology.orchestra.run.trial110.stdout:(3/34): libcephfs2-20.3.0-5230.gafefaa40.el9.x8 8.9 MB/s | 909 kB 00:00 2026-02-13T20:09:46.690 INFO:teuthology.orchestra.run.trial110.stdout:(4/34): libradosstriper1-20.3.0-5230.gafefaa40. 5.1 MB/s | 248 kB 00:00 2026-02-13T20:09:46.708 INFO:teuthology.orchestra.run.trial188.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/36 2026-02-13T20:09:46.712 INFO:teuthology.orchestra.run.trial188.stdout: Upgrading : librados2-2:20.3.0-5230.gafefaa40.el9.x86_64 2/36 2026-02-13T20:09:46.741 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: librados2-2:20.3.0-5230.gafefaa40.el9.x86_64 2/36 2026-02-13T20:09:46.779 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-rados-2:20.3.0-5230.gafefaa40.el9.x86_64 3/36 2026-02-13T20:09:46.780 INFO:teuthology.orchestra.run.trial188.stdout: Installing : libcephfs2-2:20.3.0-5230.gafefaa40.el9.x86_64 4/36 2026-02-13T20:09:46.793 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: libcephfs2-2:20.3.0-5230.gafefaa40.el9.x86_64 4/36 2026-02-13T20:09:46.803 INFO:teuthology.orchestra.run.trial188.stdout: Installing : liboath-2.6.12-1.el9.x86_64 5/36 2026-02-13T20:09:46.806 INFO:teuthology.orchestra.run.trial188.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/36 2026-02-13T20:09:46.809 INFO:teuthology.orchestra.run.trial188.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/36 2026-02-13T20:09:46.814 INFO:teuthology.orchestra.run.trial188.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 8/36 2026-02-13T20:09:46.825 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-ceph-argparse-2:20.3.0-5230.gafefaa40.el9. 9/36 2026-02-13T20:09:46.837 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-cephfs-2:20.3.0-5230.gafefaa40.el9.x86_64 10/36 2026-02-13T20:09:46.838 INFO:teuthology.orchestra.run.trial188.stdout: Installing : libradosstriper1-2:20.3.0-5230.gafefaa40.el9.x86_6 11/36 2026-02-13T20:09:46.861 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5230.gafefaa40.el9.x86_6 11/36 2026-02-13T20:09:46.865 INFO:teuthology.orchestra.run.trial188.stdout: Installing : thrift-0.15.0-4.el9.x86_64 12/36 2026-02-13T20:09:46.895 INFO:teuthology.orchestra.run.trial188.stdout: Installing : re2-1:20211101-20.el9.x86_64 13/36 2026-02-13T20:09:46.900 INFO:teuthology.orchestra.run.trial188.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 14/36 2026-02-13T20:09:46.906 INFO:teuthology.orchestra.run.trial188.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 15/36 2026-02-13T20:09:46.908 INFO:teuthology.orchestra.run.trial188.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 16/36 2026-02-13T20:09:46.913 INFO:teuthology.orchestra.run.trial188.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 17/36 2026-02-13T20:09:47.033 INFO:teuthology.orchestra.run.trial188.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/36 2026-02-13T20:09:47.035 INFO:teuthology.orchestra.run.trial188.stdout: Upgrading : librbd1-2:20.3.0-5230.gafefaa40.el9.x86_64 19/36 2026-02-13T20:09:47.062 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: librbd1-2:20.3.0-5230.gafefaa40.el9.x86_64 19/36 2026-02-13T20:09:47.065 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-rbd-2:20.3.0-5230.gafefaa40.el9.x86_64 20/36 2026-02-13T20:09:47.071 INFO:teuthology.orchestra.run.trial188.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/36 2026-02-13T20:09:47.182 INFO:teuthology.orchestra.run.trial110.stdout:(5/34): ceph-radosgw-20.3.0-5230.gafefaa40.el9. 8.4 MB/s | 13 MB 00:01 2026-02-13T20:09:47.238 INFO:teuthology.orchestra.run.trial110.stdout:(6/34): python3-ceph-argparse-20.3.0-5230.gafef 813 kB/s | 45 kB 00:00 2026-02-13T20:09:47.299 INFO:teuthology.orchestra.run.trial110.stdout:(7/34): librgw2-20.3.0-5230.gafefaa40.el9.x86_6 11 MB/s | 6.5 MB 00:00 2026-02-13T20:09:47.300 INFO:teuthology.orchestra.run.trial110.stdout:(8/34): python3-ceph-common-20.3.0-5230.gafefaa 2.9 MB/s | 185 kB 00:00 2026-02-13T20:09:47.349 INFO:teuthology.orchestra.run.trial110.stdout:(9/34): python3-cephfs-20.3.0-5230.gafefaa40.el 3.9 MB/s | 203 kB 00:00 2026-02-13T20:09:47.352 INFO:teuthology.orchestra.run.trial188.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/36 2026-02-13T20:09:47.353 INFO:teuthology.orchestra.run.trial188.stdout: Installing : librgw2-2:20.3.0-5230.gafefaa40.el9.x86_64 23/36 2026-02-13T20:09:47.356 INFO:teuthology.orchestra.run.trial110.stdout:(10/34): python3-rados-20.3.0-5230.gafefaa40.el 5.7 MB/s | 324 kB 00:00 2026-02-13T20:09:47.371 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: librgw2-2:20.3.0-5230.gafefaa40.el9.x86_64 23/36 2026-02-13T20:09:47.374 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-rgw-2:20.3.0-5230.gafefaa40.el9.x86_64 24/36 2026-02-13T20:09:47.379 INFO:teuthology.orchestra.run.trial188.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/36 2026-02-13T20:09:47.381 INFO:teuthology.orchestra.run.trial188.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/36 2026-02-13T20:09:47.382 INFO:teuthology.orchestra.run.trial188.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-13T20:09:47.401 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-13T20:09:47.405 INFO:teuthology.orchestra.run.trial188.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/36 2026-02-13T20:09:47.408 INFO:teuthology.orchestra.run.trial110.stdout:(11/34): python3-rbd-20.3.0-5230.gafefaa40.el9. 5.1 MB/s | 305 kB 00:00 2026-02-13T20:09:47.416 INFO:teuthology.orchestra.run.trial110.stdout:(12/34): python3-rgw-20.3.0-5230.gafefaa40.el9. 1.6 MB/s | 100 kB 00:00 2026-02-13T20:09:47.439 INFO:teuthology.orchestra.run.trial188.stdout: Installing : mailcap-2.1.49-5.el9.noarch 29/36 2026-02-13T20:09:47.441 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-ceph-common-2:20.3.0-5230.gafefaa40.el9.x8 30/36 2026-02-13T20:09:47.450 INFO:teuthology.orchestra.run.trial110.stdout:(13/34): mailcap-2.1.49-5.el9.noarch.rpm 782 kB/s | 33 kB 00:00 2026-02-13T20:09:47.467 INFO:teuthology.orchestra.run.trial110.stdout:(14/34): pciutils-3.7.0-7.el9.x86_64.rpm 1.8 MB/s | 93 kB 00:00 2026-02-13T20:09:47.589 INFO:teuthology.orchestra.run.trial110.stdout:(15/34): ceph-common-20.3.0-5230.gafefaa40.el9. 12 MB/s | 24 MB 00:01 2026-02-13T20:09:48.121 INFO:teuthology.orchestra.run.trial110.stdout:(16/34): boost-program-options-1.75.0-13.el9.x8 155 kB/s | 104 kB 00:00 2026-02-13T20:09:48.187 INFO:teuthology.orchestra.run.trial110.stdout:(17/34): libnbd-1.20.3-4.el9.x86_64.rpm 228 kB/s | 164 kB 00:00 2026-02-13T20:09:48.302 INFO:teuthology.orchestra.run.trial110.stdout:(18/34): libpmemobj-1.12.1-1.el9.x86_64.rpm 224 kB/s | 160 kB 00:00 2026-02-13T20:09:48.537 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: ceph-common-2:20.3.0-5230.gafefaa40.el9.x86_64 31/36 2026-02-13T20:09:48.540 INFO:teuthology.orchestra.run.trial188.stdout: Installing : ceph-common-2:20.3.0-5230.gafefaa40.el9.x86_64 31/36 2026-02-13T20:09:48.709 INFO:teuthology.orchestra.run.trial110.stdout:(19/34): librabbitmq-0.11.0-7.el9.x86_64.rpm 77 kB/s | 45 kB 00:00 2026-02-13T20:09:48.804 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: ceph-common-2:20.3.0-5230.gafefaa40.el9.x86_64 31/36 2026-02-13T20:09:48.807 INFO:teuthology.orchestra.run.trial188.stdout: Installing : ceph-base-2:20.3.0-5230.gafefaa40.el9.x86_64 32/36 2026-02-13T20:09:48.849 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: ceph-base-2:20.3.0-5230.gafefaa40.el9.x86_64 32/36 2026-02-13T20:09:48.849 INFO:teuthology.orchestra.run.trial188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-13T20:09:48.850 INFO:teuthology.orchestra.run.trial188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-13T20:09:48.850 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:09:48.853 INFO:teuthology.orchestra.run.trial188.stdout: Installing : ceph-selinux-2:20.3.0-5230.gafefaa40.el9.x86_64 33/36 2026-02-13T20:09:49.058 INFO:teuthology.orchestra.run.trial110.stdout:(20/34): librdkafka-1.6.1-102.el9.x86_64.rpm 761 kB/s | 662 kB 00:00 2026-02-13T20:09:49.086 INFO:teuthology.orchestra.run.trial110.stdout:(21/34): lttng-ust-2.12.0-6.el9.x86_64.rpm 373 kB/s | 292 kB 00:00 2026-02-13T20:09:49.468 INFO:teuthology.orchestra.run.trial110.stdout:(22/34): qatlib-25.08.0-2.el9.x86_64.rpm 316 kB/s | 240 kB 00:00 2026-02-13T20:09:49.629 INFO:teuthology.orchestra.run.trial110.stdout:(23/34): qatlib-service-25.08.0-2.el9.x86_64.rp 65 kB/s | 37 kB 00:00 2026-02-13T20:09:49.711 INFO:teuthology.orchestra.run.trial110.stdout:(24/34): qatzip-libs-1.3.1-1.el9.x86_64.rpm 106 kB/s | 66 kB 00:00 2026-02-13T20:09:49.982 INFO:teuthology.orchestra.run.trial110.stdout:(25/34): libarrow-doc-9.0.0-15.el9.noarch.rpm 92 kB/s | 25 kB 00:00 2026-02-13T20:09:50.174 INFO:teuthology.orchestra.run.trial110.stdout:(26/34): liboath-2.6.12-1.el9.x86_64.rpm 255 kB/s | 49 kB 00:00 2026-02-13T20:09:50.266 INFO:teuthology.orchestra.run.trial110.stdout:(27/34): libunwind-1.6.2-1.el9.x86_64.rpm 731 kB/s | 67 kB 00:00 2026-02-13T20:09:50.507 INFO:teuthology.orchestra.run.trial110.stdout:(28/34): libarrow-9.0.0-15.el9.x86_64.rpm 5.0 MB/s | 4.4 MB 00:00 2026-02-13T20:09:50.648 INFO:teuthology.orchestra.run.trial110.stdout:(29/34): re2-20211101-20.el9.x86_64.rpm 1.3 MB/s | 191 kB 00:00 2026-02-13T20:09:50.787 INFO:teuthology.orchestra.run.trial110.stdout:(30/34): thrift-0.15.0-4.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2026-02-13T20:09:51.015 INFO:teuthology.orchestra.run.trial110.stdout:(31/34): librados2-20.3.0-5230.gafefaa40.el9.x8 15 MB/s | 3.5 MB 00:00 2026-02-13T20:09:51.153 INFO:teuthology.orchestra.run.trial110.stdout:(32/34): librbd1-20.3.0-5230.gafefaa40.el9.x86_ 20 MB/s | 2.8 MB 00:00 2026-02-13T20:09:51.184 INFO:teuthology.orchestra.run.trial110.stdout:(33/34): parquet-libs-9.0.0-15.el9.x86_64.rpm 912 kB/s | 838 kB 00:00 2026-02-13T20:09:51.239 INFO:teuthology.orchestra.run.trial110.stdout:(34/34): gperftools-libs-2.9.1-3.el9.x86_64.rpm 174 kB/s | 308 kB 00:01 2026-02-13T20:09:51.243 INFO:teuthology.orchestra.run.trial110.stdout:-------------------------------------------------------------------------------- 2026-02-13T20:09:51.243 INFO:teuthology.orchestra.run.trial110.stdout:Total 11 MB/s | 67 MB 00:06 2026-02-13T20:09:51.332 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction check 2026-02-13T20:09:51.351 INFO:teuthology.orchestra.run.trial110.stdout:Transaction check succeeded. 2026-02-13T20:09:51.351 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction test 2026-02-13T20:09:51.613 INFO:teuthology.orchestra.run.trial110.stdout:Transaction test succeeded. 2026-02-13T20:09:51.613 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction 2026-02-13T20:09:51.913 INFO:teuthology.orchestra.run.trial110.stdout: Preparing : 1/1 2026-02-13T20:09:52.066 INFO:teuthology.orchestra.run.trial110.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/36 2026-02-13T20:09:52.070 INFO:teuthology.orchestra.run.trial110.stdout: Upgrading : librados2-2:20.3.0-5230.gafefaa40.el9.x86_64 2/36 2026-02-13T20:09:52.098 INFO:teuthology.orchestra.run.trial110.stdout: Running scriptlet: librados2-2:20.3.0-5230.gafefaa40.el9.x86_64 2/36 2026-02-13T20:09:52.136 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-rados-2:20.3.0-5230.gafefaa40.el9.x86_64 3/36 2026-02-13T20:09:52.137 INFO:teuthology.orchestra.run.trial110.stdout: Installing : libcephfs2-2:20.3.0-5230.gafefaa40.el9.x86_64 4/36 2026-02-13T20:09:52.148 INFO:teuthology.orchestra.run.trial110.stdout: Running scriptlet: libcephfs2-2:20.3.0-5230.gafefaa40.el9.x86_64 4/36 2026-02-13T20:09:52.157 INFO:teuthology.orchestra.run.trial110.stdout: Installing : liboath-2.6.12-1.el9.x86_64 5/36 2026-02-13T20:09:52.159 INFO:teuthology.orchestra.run.trial110.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/36 2026-02-13T20:09:52.162 INFO:teuthology.orchestra.run.trial110.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/36 2026-02-13T20:09:52.166 INFO:teuthology.orchestra.run.trial110.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 8/36 2026-02-13T20:09:52.177 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-ceph-argparse-2:20.3.0-5230.gafefaa40.el9. 9/36 2026-02-13T20:09:52.189 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-cephfs-2:20.3.0-5230.gafefaa40.el9.x86_64 10/36 2026-02-13T20:09:52.190 INFO:teuthology.orchestra.run.trial110.stdout: Installing : libradosstriper1-2:20.3.0-5230.gafefaa40.el9.x86_6 11/36 2026-02-13T20:09:52.212 INFO:teuthology.orchestra.run.trial110.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5230.gafefaa40.el9.x86_6 11/36 2026-02-13T20:09:52.217 INFO:teuthology.orchestra.run.trial110.stdout: Installing : thrift-0.15.0-4.el9.x86_64 12/36 2026-02-13T20:09:52.247 INFO:teuthology.orchestra.run.trial110.stdout: Installing : re2-1:20211101-20.el9.x86_64 13/36 2026-02-13T20:09:52.251 INFO:teuthology.orchestra.run.trial110.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 14/36 2026-02-13T20:09:52.258 INFO:teuthology.orchestra.run.trial110.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 15/36 2026-02-13T20:09:52.260 INFO:teuthology.orchestra.run.trial110.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 16/36 2026-02-13T20:09:52.264 INFO:teuthology.orchestra.run.trial110.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 17/36 2026-02-13T20:09:52.387 INFO:teuthology.orchestra.run.trial110.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/36 2026-02-13T20:09:52.388 INFO:teuthology.orchestra.run.trial110.stdout: Upgrading : librbd1-2:20.3.0-5230.gafefaa40.el9.x86_64 19/36 2026-02-13T20:09:52.414 INFO:teuthology.orchestra.run.trial110.stdout: Running scriptlet: librbd1-2:20.3.0-5230.gafefaa40.el9.x86_64 19/36 2026-02-13T20:09:52.416 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-rbd-2:20.3.0-5230.gafefaa40.el9.x86_64 20/36 2026-02-13T20:09:52.422 INFO:teuthology.orchestra.run.trial110.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/36 2026-02-13T20:09:52.703 INFO:teuthology.orchestra.run.trial110.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/36 2026-02-13T20:09:52.705 INFO:teuthology.orchestra.run.trial110.stdout: Installing : librgw2-2:20.3.0-5230.gafefaa40.el9.x86_64 23/36 2026-02-13T20:09:52.722 INFO:teuthology.orchestra.run.trial110.stdout: Running scriptlet: librgw2-2:20.3.0-5230.gafefaa40.el9.x86_64 23/36 2026-02-13T20:09:52.726 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-rgw-2:20.3.0-5230.gafefaa40.el9.x86_64 24/36 2026-02-13T20:09:52.730 INFO:teuthology.orchestra.run.trial110.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/36 2026-02-13T20:09:52.732 INFO:teuthology.orchestra.run.trial110.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/36 2026-02-13T20:09:52.733 INFO:teuthology.orchestra.run.trial110.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-13T20:09:52.751 INFO:teuthology.orchestra.run.trial110.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-13T20:09:52.754 INFO:teuthology.orchestra.run.trial110.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/36 2026-02-13T20:09:52.788 INFO:teuthology.orchestra.run.trial110.stdout: Installing : mailcap-2.1.49-5.el9.noarch 29/36 2026-02-13T20:09:52.790 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-ceph-common-2:20.3.0-5230.gafefaa40.el9.x8 30/36 2026-02-13T20:09:53.429 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5230.gafefaa40.el9.x86_64 33/36 2026-02-13T20:09:53.429 INFO:teuthology.orchestra.run.trial188.stdout:skipping the directory /sys 2026-02-13T20:09:53.429 INFO:teuthology.orchestra.run.trial188.stdout:skipping the directory /proc 2026-02-13T20:09:53.429 INFO:teuthology.orchestra.run.trial188.stdout:skipping the directory /mnt 2026-02-13T20:09:53.429 INFO:teuthology.orchestra.run.trial188.stdout:skipping the directory /var/tmp 2026-02-13T20:09:53.429 INFO:teuthology.orchestra.run.trial188.stdout:skipping the directory /home 2026-02-13T20:09:53.429 INFO:teuthology.orchestra.run.trial188.stdout:skipping the directory /root 2026-02-13T20:09:53.429 INFO:teuthology.orchestra.run.trial188.stdout:skipping the directory /tmp 2026-02-13T20:09:53.429 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:09:53.878 INFO:teuthology.orchestra.run.trial110.stdout: Running scriptlet: ceph-common-2:20.3.0-5230.gafefaa40.el9.x86_64 31/36 2026-02-13T20:09:53.881 INFO:teuthology.orchestra.run.trial110.stdout: Installing : ceph-common-2:20.3.0-5230.gafefaa40.el9.x86_64 31/36 2026-02-13T20:09:54.004 INFO:teuthology.orchestra.run.trial188.stdout: Installing : ceph-radosgw-2:20.3.0-5230.gafefaa40.el9.x86_64 34/36 2026-02-13T20:09:54.029 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5230.gafefaa40.el9.x86_64 34/36 2026-02-13T20:09:54.029 INFO:teuthology.orchestra.run.trial188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T20:09:54.029 INFO:teuthology.orchestra.run.trial188.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-13T20:09:54.029 INFO:teuthology.orchestra.run.trial188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T20:09:54.029 INFO:teuthology.orchestra.run.trial188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T20:09:54.029 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:09:54.031 INFO:teuthology.orchestra.run.trial188.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-13T20:09:54.044 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-13T20:09:54.045 INFO:teuthology.orchestra.run.trial188.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-13T20:09:54.102 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-13T20:09:54.102 INFO:teuthology.orchestra.run.trial188.stdout:Creating group 'qat' with GID 992. 2026-02-13T20:09:54.102 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:09:54.147 INFO:teuthology.orchestra.run.trial110.stdout: Running scriptlet: ceph-common-2:20.3.0-5230.gafefaa40.el9.x86_64 31/36 2026-02-13T20:09:54.151 INFO:teuthology.orchestra.run.trial110.stdout: Installing : ceph-base-2:20.3.0-5230.gafefaa40.el9.x86_64 32/36 2026-02-13T20:09:54.191 INFO:teuthology.orchestra.run.trial110.stdout: Running scriptlet: ceph-base-2:20.3.0-5230.gafefaa40.el9.x86_64 32/36 2026-02-13T20:09:54.191 INFO:teuthology.orchestra.run.trial110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-13T20:09:54.191 INFO:teuthology.orchestra.run.trial110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-13T20:09:54.191 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:09:54.194 INFO:teuthology.orchestra.run.trial110.stdout: Installing : ceph-selinux-2:20.3.0-5230.gafefaa40.el9.x86_64 33/36 2026-02-13T20:09:54.395 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : ceph-base-2:20.3.0-5230.gafefaa40.el9.x86_64 1/36 2026-02-13T20:09:54.395 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : ceph-common-2:20.3.0-5230.gafefaa40.el9.x86_64 2/36 2026-02-13T20:09:54.395 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : ceph-radosgw-2:20.3.0-5230.gafefaa40.el9.x86_64 3/36 2026-02-13T20:09:54.395 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : ceph-selinux-2:20.3.0-5230.gafefaa40.el9.x86_64 4/36 2026-02-13T20:09:54.395 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : libcephfs2-2:20.3.0-5230.gafefaa40.el9.x86_64 5/36 2026-02-13T20:09:54.395 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : libradosstriper1-2:20.3.0-5230.gafefaa40.el9.x86_6 6/36 2026-02-13T20:09:54.395 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : librgw2-2:20.3.0-5230.gafefaa40.el9.x86_64 7/36 2026-02-13T20:09:54.395 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5230.gafefaa40.el9. 8/36 2026-02-13T20:09:54.395 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-ceph-common-2:20.3.0-5230.gafefaa40.el9.x8 9/36 2026-02-13T20:09:54.395 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-cephfs-2:20.3.0-5230.gafefaa40.el9.x86_64 10/36 2026-02-13T20:09:54.395 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-rados-2:20.3.0-5230.gafefaa40.el9.x86_64 11/36 2026-02-13T20:09:54.395 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-rbd-2:20.3.0-5230.gafefaa40.el9.x86_64 12/36 2026-02-13T20:09:54.395 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-rgw-2:20.3.0-5230.gafefaa40.el9.x86_64 13/36 2026-02-13T20:09:54.395 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/36 2026-02-13T20:09:54.395 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 15/36 2026-02-13T20:09:54.395 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 16/36 2026-02-13T20:09:54.395 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 17/36 2026-02-13T20:09:54.395 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 18/36 2026-02-13T20:09:54.395 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/36 2026-02-13T20:09:54.395 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 20/36 2026-02-13T20:09:54.395 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 21/36 2026-02-13T20:09:54.395 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 22/36 2026-02-13T20:09:54.395 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 23/36 2026-02-13T20:09:54.395 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 24/36 2026-02-13T20:09:54.395 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 25/36 2026-02-13T20:09:54.395 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 26/36 2026-02-13T20:09:54.395 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 27/36 2026-02-13T20:09:54.395 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 28/36 2026-02-13T20:09:54.395 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 29/36 2026-02-13T20:09:54.395 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 30/36 2026-02-13T20:09:54.395 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : re2-1:20211101-20.el9.x86_64 31/36 2026-02-13T20:09:54.396 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 32/36 2026-02-13T20:09:54.396 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : librados2-2:20.3.0-5230.gafefaa40.el9.x86_64 33/36 2026-02-13T20:09:54.396 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 34/36 2026-02-13T20:09:54.396 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : librbd1-2:20.3.0-5230.gafefaa40.el9.x86_64 35/36 2026-02-13T20:09:54.456 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 36/36 2026-02-13T20:09:54.456 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:09:54.456 INFO:teuthology.orchestra.run.trial188.stdout:Upgraded: 2026-02-13T20:09:54.456 INFO:teuthology.orchestra.run.trial188.stdout: librados2-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:09:54.456 INFO:teuthology.orchestra.run.trial188.stdout: librbd1-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:09:54.456 INFO:teuthology.orchestra.run.trial188.stdout:Installed: 2026-02-13T20:09:54.456 INFO:teuthology.orchestra.run.trial188.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-13T20:09:54.456 INFO:teuthology.orchestra.run.trial188.stdout: ceph-base-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:09:54.456 INFO:teuthology.orchestra.run.trial188.stdout: ceph-common-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:09:54.456 INFO:teuthology.orchestra.run.trial188.stdout: ceph-radosgw-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:09:54.456 INFO:teuthology.orchestra.run.trial188.stdout: ceph-selinux-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:09:54.456 INFO:teuthology.orchestra.run.trial188.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-13T20:09:54.456 INFO:teuthology.orchestra.run.trial188.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-13T20:09:54.456 INFO:teuthology.orchestra.run.trial188.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-13T20:09:54.456 INFO:teuthology.orchestra.run.trial188.stdout: libcephfs2-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:09:54.456 INFO:teuthology.orchestra.run.trial188.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-13T20:09:54.456 INFO:teuthology.orchestra.run.trial188.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-13T20:09:54.456 INFO:teuthology.orchestra.run.trial188.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-13T20:09:54.456 INFO:teuthology.orchestra.run.trial188.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-13T20:09:54.456 INFO:teuthology.orchestra.run.trial188.stdout: libradosstriper1-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:09:54.456 INFO:teuthology.orchestra.run.trial188.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-13T20:09:54.456 INFO:teuthology.orchestra.run.trial188.stdout: librgw2-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:09:54.456 INFO:teuthology.orchestra.run.trial188.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-13T20:09:54.456 INFO:teuthology.orchestra.run.trial188.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-13T20:09:54.456 INFO:teuthology.orchestra.run.trial188.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-13T20:09:54.456 INFO:teuthology.orchestra.run.trial188.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-13T20:09:54.456 INFO:teuthology.orchestra.run.trial188.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-13T20:09:54.456 INFO:teuthology.orchestra.run.trial188.stdout: python3-ceph-argparse-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:09:54.456 INFO:teuthology.orchestra.run.trial188.stdout: python3-ceph-common-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:09:54.456 INFO:teuthology.orchestra.run.trial188.stdout: python3-cephfs-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:09:54.456 INFO:teuthology.orchestra.run.trial188.stdout: python3-rados-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:09:54.456 INFO:teuthology.orchestra.run.trial188.stdout: python3-rbd-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:09:54.457 INFO:teuthology.orchestra.run.trial188.stdout: python3-rgw-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:09:54.457 INFO:teuthology.orchestra.run.trial188.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-13T20:09:54.457 INFO:teuthology.orchestra.run.trial188.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-13T20:09:54.457 INFO:teuthology.orchestra.run.trial188.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-13T20:09:54.457 INFO:teuthology.orchestra.run.trial188.stdout: re2-1:20211101-20.el9.x86_64 2026-02-13T20:09:54.457 INFO:teuthology.orchestra.run.trial188.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-13T20:09:54.457 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:09:54.457 INFO:teuthology.orchestra.run.trial188.stdout:Complete! 2026-02-13T20:09:54.499 DEBUG:teuthology.orchestra.run.trial188:> sudo yum -y install ceph-test 2026-02-13T20:09:54.802 INFO:teuthology.orchestra.run.trial188.stdout:Last metadata expiration check: 0:00:14 ago on Fri 13 Feb 2026 08:09:40 PM UTC. 2026-02-13T20:09:54.887 INFO:teuthology.orchestra.run.trial188.stdout:Dependencies resolved. 2026-02-13T20:09:54.888 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-13T20:09:54.888 INFO:teuthology.orchestra.run.trial188.stdout: Package Arch Version Repository Size 2026-02-13T20:09:54.888 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-13T20:09:54.888 INFO:teuthology.orchestra.run.trial188.stdout:Installing: 2026-02-13T20:09:54.888 INFO:teuthology.orchestra.run.trial188.stdout: ceph-test x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 78 M 2026-02-13T20:09:54.888 INFO:teuthology.orchestra.run.trial188.stdout:Installing dependencies: 2026-02-13T20:09:54.888 INFO:teuthology.orchestra.run.trial188.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-13T20:09:54.888 INFO:teuthology.orchestra.run.trial188.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-13T20:09:54.888 INFO:teuthology.orchestra.run.trial188.stdout: libcephsqlite x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 159 k 2026-02-13T20:09:54.888 INFO:teuthology.orchestra.run.trial188.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-13T20:09:54.888 INFO:teuthology.orchestra.run.trial188.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-13T20:09:54.888 INFO:teuthology.orchestra.run.trial188.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-13T20:09:54.888 INFO:teuthology.orchestra.run.trial188.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-13T20:09:54.888 INFO:teuthology.orchestra.run.trial188.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-13T20:09:54.888 INFO:teuthology.orchestra.run.trial188.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-13T20:09:54.888 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:09:54.888 INFO:teuthology.orchestra.run.trial188.stdout:Transaction Summary 2026-02-13T20:09:54.888 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-13T20:09:54.888 INFO:teuthology.orchestra.run.trial188.stdout:Install 10 Packages 2026-02-13T20:09:54.888 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:09:54.888 INFO:teuthology.orchestra.run.trial188.stdout:Total download size: 82 M 2026-02-13T20:09:54.888 INFO:teuthology.orchestra.run.trial188.stdout:Installed size: 339 M 2026-02-13T20:09:54.888 INFO:teuthology.orchestra.run.trial188.stdout:Downloading Packages: 2026-02-13T20:09:55.231 INFO:teuthology.orchestra.run.trial188.stdout:(1/10): hwloc-libs-2.4.1-6.el9.x86_64.rpm 23 MB/s | 2.1 MB 00:00 2026-02-13T20:09:55.239 INFO:teuthology.orchestra.run.trial188.stdout:(2/10): libatomic-11.5.0-14.el9.x86_64.rpm 2.6 MB/s | 23 kB 00:00 2026-02-13T20:09:55.249 INFO:teuthology.orchestra.run.trial188.stdout:(3/10): lksctp-tools-1.0.19-2.el9.x86_64.rpm 9.9 MB/s | 94 kB 00:00 2026-02-13T20:09:55.319 INFO:teuthology.orchestra.run.trial188.stdout:(4/10): libxslt-1.1.34-12.el9.x86_64.rpm 3.2 MB/s | 233 kB 00:00 2026-02-13T20:09:55.353 INFO:teuthology.orchestra.run.trial188.stdout:(5/10): protobuf-3.14.0-17.el9.x86_64.rpm 30 MB/s | 1.0 MB 00:00 2026-02-13T20:09:55.386 INFO:teuthology.orchestra.run.trial188.stdout:(6/10): socat-1.7.4.1-8.el9.x86_64.rpm 9.0 MB/s | 303 kB 00:00 2026-02-13T20:09:55.410 INFO:teuthology.orchestra.run.trial188.stdout:(7/10): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.6 MB/s | 64 kB 00:00 2026-02-13T20:09:55.677 INFO:teuthology.orchestra.run.trial188.stdout:(8/10): libcephsqlite-20.3.0-5230.gafefaa40.el9 295 kB/s | 159 kB 00:00 2026-02-13T20:09:55.928 INFO:teuthology.orchestra.run.trial188.stdout:(9/10): yaml-cpp-0.6.3-5.el9.x86_64.rpm 235 kB/s | 122 kB 00:00 2026-02-13T20:09:58.731 INFO:teuthology.orchestra.run.trial110.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5230.gafefaa40.el9.x86_64 33/36 2026-02-13T20:09:58.731 INFO:teuthology.orchestra.run.trial110.stdout:skipping the directory /sys 2026-02-13T20:09:58.732 INFO:teuthology.orchestra.run.trial110.stdout:skipping the directory /proc 2026-02-13T20:09:58.732 INFO:teuthology.orchestra.run.trial110.stdout:skipping the directory /mnt 2026-02-13T20:09:58.732 INFO:teuthology.orchestra.run.trial110.stdout:skipping the directory /var/tmp 2026-02-13T20:09:58.732 INFO:teuthology.orchestra.run.trial110.stdout:skipping the directory /home 2026-02-13T20:09:58.732 INFO:teuthology.orchestra.run.trial110.stdout:skipping the directory /root 2026-02-13T20:09:58.732 INFO:teuthology.orchestra.run.trial110.stdout:skipping the directory /tmp 2026-02-13T20:09:58.732 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:09:59.313 INFO:teuthology.orchestra.run.trial110.stdout: Installing : ceph-radosgw-2:20.3.0-5230.gafefaa40.el9.x86_64 34/36 2026-02-13T20:09:59.337 INFO:teuthology.orchestra.run.trial110.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5230.gafefaa40.el9.x86_64 34/36 2026-02-13T20:09:59.337 INFO:teuthology.orchestra.run.trial110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T20:09:59.337 INFO:teuthology.orchestra.run.trial110.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-13T20:09:59.337 INFO:teuthology.orchestra.run.trial110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T20:09:59.337 INFO:teuthology.orchestra.run.trial110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T20:09:59.337 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:09:59.338 INFO:teuthology.orchestra.run.trial110.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-13T20:09:59.351 INFO:teuthology.orchestra.run.trial110.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-13T20:09:59.351 INFO:teuthology.orchestra.run.trial110.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-13T20:09:59.405 INFO:teuthology.orchestra.run.trial110.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-13T20:09:59.405 INFO:teuthology.orchestra.run.trial110.stdout:Creating group 'qat' with GID 992. 2026-02-13T20:09:59.405 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:09:59.691 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : ceph-base-2:20.3.0-5230.gafefaa40.el9.x86_64 1/36 2026-02-13T20:09:59.691 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : ceph-common-2:20.3.0-5230.gafefaa40.el9.x86_64 2/36 2026-02-13T20:09:59.691 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : ceph-radosgw-2:20.3.0-5230.gafefaa40.el9.x86_64 3/36 2026-02-13T20:09:59.691 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : ceph-selinux-2:20.3.0-5230.gafefaa40.el9.x86_64 4/36 2026-02-13T20:09:59.691 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : libcephfs2-2:20.3.0-5230.gafefaa40.el9.x86_64 5/36 2026-02-13T20:09:59.691 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : libradosstriper1-2:20.3.0-5230.gafefaa40.el9.x86_6 6/36 2026-02-13T20:09:59.691 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : librgw2-2:20.3.0-5230.gafefaa40.el9.x86_64 7/36 2026-02-13T20:09:59.691 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5230.gafefaa40.el9. 8/36 2026-02-13T20:09:59.691 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-ceph-common-2:20.3.0-5230.gafefaa40.el9.x8 9/36 2026-02-13T20:09:59.691 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-cephfs-2:20.3.0-5230.gafefaa40.el9.x86_64 10/36 2026-02-13T20:09:59.691 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-rados-2:20.3.0-5230.gafefaa40.el9.x86_64 11/36 2026-02-13T20:09:59.691 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-rbd-2:20.3.0-5230.gafefaa40.el9.x86_64 12/36 2026-02-13T20:09:59.691 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-rgw-2:20.3.0-5230.gafefaa40.el9.x86_64 13/36 2026-02-13T20:09:59.691 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/36 2026-02-13T20:09:59.691 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 15/36 2026-02-13T20:09:59.692 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 16/36 2026-02-13T20:09:59.692 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 17/36 2026-02-13T20:09:59.692 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 18/36 2026-02-13T20:09:59.692 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/36 2026-02-13T20:09:59.692 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 20/36 2026-02-13T20:09:59.692 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 21/36 2026-02-13T20:09:59.692 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 22/36 2026-02-13T20:09:59.692 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 23/36 2026-02-13T20:09:59.692 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 24/36 2026-02-13T20:09:59.692 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 25/36 2026-02-13T20:09:59.692 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 26/36 2026-02-13T20:09:59.692 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 27/36 2026-02-13T20:09:59.692 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 28/36 2026-02-13T20:09:59.692 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 29/36 2026-02-13T20:09:59.692 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 30/36 2026-02-13T20:09:59.692 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : re2-1:20211101-20.el9.x86_64 31/36 2026-02-13T20:09:59.692 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 32/36 2026-02-13T20:09:59.692 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : librados2-2:20.3.0-5230.gafefaa40.el9.x86_64 33/36 2026-02-13T20:09:59.692 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 34/36 2026-02-13T20:09:59.693 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : librbd1-2:20.3.0-5230.gafefaa40.el9.x86_64 35/36 2026-02-13T20:09:59.752 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 36/36 2026-02-13T20:09:59.752 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:09:59.752 INFO:teuthology.orchestra.run.trial110.stdout:Upgraded: 2026-02-13T20:09:59.752 INFO:teuthology.orchestra.run.trial110.stdout: librados2-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:09:59.752 INFO:teuthology.orchestra.run.trial110.stdout: librbd1-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:09:59.752 INFO:teuthology.orchestra.run.trial110.stdout:Installed: 2026-02-13T20:09:59.752 INFO:teuthology.orchestra.run.trial110.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-13T20:09:59.752 INFO:teuthology.orchestra.run.trial110.stdout: ceph-base-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:09:59.752 INFO:teuthology.orchestra.run.trial110.stdout: ceph-common-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:09:59.752 INFO:teuthology.orchestra.run.trial110.stdout: ceph-radosgw-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:09:59.752 INFO:teuthology.orchestra.run.trial110.stdout: ceph-selinux-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:09:59.752 INFO:teuthology.orchestra.run.trial110.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-13T20:09:59.752 INFO:teuthology.orchestra.run.trial110.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-13T20:09:59.752 INFO:teuthology.orchestra.run.trial110.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-13T20:09:59.752 INFO:teuthology.orchestra.run.trial110.stdout: libcephfs2-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:09:59.752 INFO:teuthology.orchestra.run.trial110.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-13T20:09:59.752 INFO:teuthology.orchestra.run.trial110.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-13T20:09:59.752 INFO:teuthology.orchestra.run.trial110.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-13T20:09:59.752 INFO:teuthology.orchestra.run.trial110.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-13T20:09:59.752 INFO:teuthology.orchestra.run.trial110.stdout: libradosstriper1-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:09:59.752 INFO:teuthology.orchestra.run.trial110.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-13T20:09:59.752 INFO:teuthology.orchestra.run.trial110.stdout: librgw2-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:09:59.752 INFO:teuthology.orchestra.run.trial110.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-13T20:09:59.752 INFO:teuthology.orchestra.run.trial110.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-13T20:09:59.752 INFO:teuthology.orchestra.run.trial110.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-13T20:09:59.752 INFO:teuthology.orchestra.run.trial110.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-13T20:09:59.752 INFO:teuthology.orchestra.run.trial110.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-13T20:09:59.753 INFO:teuthology.orchestra.run.trial110.stdout: python3-ceph-argparse-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:09:59.753 INFO:teuthology.orchestra.run.trial110.stdout: python3-ceph-common-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:09:59.753 INFO:teuthology.orchestra.run.trial110.stdout: python3-cephfs-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:09:59.753 INFO:teuthology.orchestra.run.trial110.stdout: python3-rados-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:09:59.753 INFO:teuthology.orchestra.run.trial110.stdout: python3-rbd-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:09:59.753 INFO:teuthology.orchestra.run.trial110.stdout: python3-rgw-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:09:59.753 INFO:teuthology.orchestra.run.trial110.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-13T20:09:59.753 INFO:teuthology.orchestra.run.trial110.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-13T20:09:59.753 INFO:teuthology.orchestra.run.trial110.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-13T20:09:59.753 INFO:teuthology.orchestra.run.trial110.stdout: re2-1:20211101-20.el9.x86_64 2026-02-13T20:09:59.753 INFO:teuthology.orchestra.run.trial110.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-13T20:09:59.753 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:09:59.753 INFO:teuthology.orchestra.run.trial110.stdout:Complete! 2026-02-13T20:09:59.799 DEBUG:teuthology.orchestra.run.trial110:> sudo yum -y install ceph-test 2026-02-13T20:10:00.107 INFO:teuthology.orchestra.run.trial110.stdout:Last metadata expiration check: 0:00:17 ago on Fri 13 Feb 2026 08:09:43 PM UTC. 2026-02-13T20:10:00.190 INFO:teuthology.orchestra.run.trial110.stdout:Dependencies resolved. 2026-02-13T20:10:00.190 INFO:teuthology.orchestra.run.trial110.stdout:================================================================================ 2026-02-13T20:10:00.190 INFO:teuthology.orchestra.run.trial110.stdout: Package Arch Version Repository Size 2026-02-13T20:10:00.190 INFO:teuthology.orchestra.run.trial110.stdout:================================================================================ 2026-02-13T20:10:00.190 INFO:teuthology.orchestra.run.trial110.stdout:Installing: 2026-02-13T20:10:00.190 INFO:teuthology.orchestra.run.trial110.stdout: ceph-test x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 78 M 2026-02-13T20:10:00.191 INFO:teuthology.orchestra.run.trial110.stdout:Installing dependencies: 2026-02-13T20:10:00.191 INFO:teuthology.orchestra.run.trial110.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-13T20:10:00.191 INFO:teuthology.orchestra.run.trial110.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-13T20:10:00.191 INFO:teuthology.orchestra.run.trial110.stdout: libcephsqlite x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 159 k 2026-02-13T20:10:00.191 INFO:teuthology.orchestra.run.trial110.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-13T20:10:00.191 INFO:teuthology.orchestra.run.trial110.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-13T20:10:00.191 INFO:teuthology.orchestra.run.trial110.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-13T20:10:00.191 INFO:teuthology.orchestra.run.trial110.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-13T20:10:00.191 INFO:teuthology.orchestra.run.trial110.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-13T20:10:00.191 INFO:teuthology.orchestra.run.trial110.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-13T20:10:00.191 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:00.191 INFO:teuthology.orchestra.run.trial110.stdout:Transaction Summary 2026-02-13T20:10:00.191 INFO:teuthology.orchestra.run.trial110.stdout:================================================================================ 2026-02-13T20:10:00.191 INFO:teuthology.orchestra.run.trial110.stdout:Install 10 Packages 2026-02-13T20:10:00.191 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:00.191 INFO:teuthology.orchestra.run.trial110.stdout:Total download size: 82 M 2026-02-13T20:10:00.191 INFO:teuthology.orchestra.run.trial110.stdout:Installed size: 339 M 2026-02-13T20:10:00.191 INFO:teuthology.orchestra.run.trial110.stdout:Downloading Packages: 2026-02-13T20:10:00.908 INFO:teuthology.orchestra.run.trial110.stdout:(1/10): hwloc-libs-2.4.1-6.el9.x86_64.rpm 8.7 MB/s | 2.1 MB 00:00 2026-02-13T20:10:00.933 INFO:teuthology.orchestra.run.trial110.stdout:(2/10): libatomic-11.5.0-14.el9.x86_64.rpm 906 kB/s | 23 kB 00:00 2026-02-13T20:10:00.960 INFO:teuthology.orchestra.run.trial110.stdout:(3/10): lksctp-tools-1.0.19-2.el9.x86_64.rpm 3.5 MB/s | 94 kB 00:00 2026-02-13T20:10:00.986 INFO:teuthology.orchestra.run.trial110.stdout:(4/10): libxslt-1.1.34-12.el9.x86_64.rpm 8.7 MB/s | 233 kB 00:00 2026-02-13T20:10:01.019 INFO:teuthology.orchestra.run.trial110.stdout:(5/10): protobuf-3.14.0-17.el9.x86_64.rpm 30 MB/s | 1.0 MB 00:00 2026-02-13T20:10:01.047 INFO:teuthology.orchestra.run.trial110.stdout:(6/10): socat-1.7.4.1-8.el9.x86_64.rpm 11 MB/s | 303 kB 00:00 2026-02-13T20:10:01.070 INFO:teuthology.orchestra.run.trial110.stdout:(7/10): libcephsqlite-20.3.0-5230.gafefaa40.el9 394 kB/s | 159 kB 00:00 2026-02-13T20:10:01.072 INFO:teuthology.orchestra.run.trial110.stdout:(8/10): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.4 MB/s | 64 kB 00:00 2026-02-13T20:10:01.145 INFO:teuthology.orchestra.run.trial110.stdout:(9/10): yaml-cpp-0.6.3-5.el9.x86_64.rpm 1.6 MB/s | 122 kB 00:00 2026-02-13T20:10:09.652 INFO:teuthology.orchestra.run.trial110.stdout:(10/10): ceph-test-20.3.0-5230.gafefaa40.el9.x8 8.7 MB/s | 78 MB 00:08 2026-02-13T20:10:09.654 INFO:teuthology.orchestra.run.trial110.stdout:-------------------------------------------------------------------------------- 2026-02-13T20:10:09.654 INFO:teuthology.orchestra.run.trial110.stdout:Total 8.7 MB/s | 82 MB 00:09 2026-02-13T20:10:09.721 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction check 2026-02-13T20:10:09.732 INFO:teuthology.orchestra.run.trial110.stdout:Transaction check succeeded. 2026-02-13T20:10:09.732 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction test 2026-02-13T20:10:10.014 INFO:teuthology.orchestra.run.trial110.stdout:Transaction test succeeded. 2026-02-13T20:10:10.015 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction 2026-02-13T20:10:10.326 INFO:teuthology.orchestra.run.trial110.stdout: Preparing : 1/1 2026-02-13T20:10:10.335 INFO:teuthology.orchestra.run.trial110.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/10 2026-02-13T20:10:10.344 INFO:teuthology.orchestra.run.trial110.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 2/10 2026-02-13T20:10:10.349 INFO:teuthology.orchestra.run.trial110.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/10 2026-02-13T20:10:10.353 INFO:teuthology.orchestra.run.trial110.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 4/10 2026-02-13T20:10:10.358 INFO:teuthology.orchestra.run.trial110.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 5/10 2026-02-13T20:10:10.362 INFO:teuthology.orchestra.run.trial110.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 6/10 2026-02-13T20:10:10.372 INFO:teuthology.orchestra.run.trial110.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 7/10 2026-02-13T20:10:10.380 INFO:teuthology.orchestra.run.trial110.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 8/10 2026-02-13T20:10:10.381 INFO:teuthology.orchestra.run.trial110.stdout: Installing : libcephsqlite-2:20.3.0-5230.gafefaa40.el9.x86_64 9/10 2026-02-13T20:10:11.187 INFO:teuthology.orchestra.run.trial188.stdout:(10/10): ceph-test-20.3.0-5230.gafefaa40.el9.x8 4.9 MB/s | 78 MB 00:16 2026-02-13T20:10:11.189 INFO:teuthology.orchestra.run.trial188.stdout:-------------------------------------------------------------------------------- 2026-02-13T20:10:11.189 INFO:teuthology.orchestra.run.trial188.stdout:Total 5.0 MB/s | 82 MB 00:16 2026-02-13T20:10:11.254 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction check 2026-02-13T20:10:11.264 INFO:teuthology.orchestra.run.trial188.stdout:Transaction check succeeded. 2026-02-13T20:10:11.265 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction test 2026-02-13T20:10:11.549 INFO:teuthology.orchestra.run.trial188.stdout:Transaction test succeeded. 2026-02-13T20:10:11.549 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction 2026-02-13T20:10:11.861 INFO:teuthology.orchestra.run.trial188.stdout: Preparing : 1/1 2026-02-13T20:10:11.870 INFO:teuthology.orchestra.run.trial188.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/10 2026-02-13T20:10:11.879 INFO:teuthology.orchestra.run.trial188.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 2/10 2026-02-13T20:10:11.884 INFO:teuthology.orchestra.run.trial188.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/10 2026-02-13T20:10:11.888 INFO:teuthology.orchestra.run.trial188.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 4/10 2026-02-13T20:10:11.893 INFO:teuthology.orchestra.run.trial188.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 5/10 2026-02-13T20:10:11.895 INFO:teuthology.orchestra.run.trial188.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 6/10 2026-02-13T20:10:11.905 INFO:teuthology.orchestra.run.trial188.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 7/10 2026-02-13T20:10:11.913 INFO:teuthology.orchestra.run.trial188.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 8/10 2026-02-13T20:10:11.914 INFO:teuthology.orchestra.run.trial188.stdout: Installing : libcephsqlite-2:20.3.0-5230.gafefaa40.el9.x86_64 9/10 2026-02-13T20:10:13.827 INFO:teuthology.orchestra.run.trial110.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5230.gafefaa40.el9.x86_64 9/10 2026-02-13T20:10:13.845 INFO:teuthology.orchestra.run.trial110.stdout: Installing : ceph-test-2:20.3.0-5230.gafefaa40.el9.x86_64 10/10 2026-02-13T20:10:14.180 INFO:teuthology.orchestra.run.trial110.stdout: Running scriptlet: ceph-test-2:20.3.0-5230.gafefaa40.el9.x86_64 10/10 2026-02-13T20:10:14.180 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : ceph-test-2:20.3.0-5230.gafefaa40.el9.x86_64 1/10 2026-02-13T20:10:14.180 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : libcephsqlite-2:20.3.0-5230.gafefaa40.el9.x86_64 2/10 2026-02-13T20:10:14.180 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 3/10 2026-02-13T20:10:14.180 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 4/10 2026-02-13T20:10:14.180 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 5/10 2026-02-13T20:10:14.180 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 6/10 2026-02-13T20:10:14.181 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 7/10 2026-02-13T20:10:14.181 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 8/10 2026-02-13T20:10:14.181 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 9/10 2026-02-13T20:10:14.233 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 10/10 2026-02-13T20:10:14.234 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:14.234 INFO:teuthology.orchestra.run.trial110.stdout:Installed: 2026-02-13T20:10:14.234 INFO:teuthology.orchestra.run.trial110.stdout: ceph-test-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:10:14.234 INFO:teuthology.orchestra.run.trial110.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-13T20:10:14.234 INFO:teuthology.orchestra.run.trial110.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-13T20:10:14.234 INFO:teuthology.orchestra.run.trial110.stdout: libcephsqlite-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:10:14.234 INFO:teuthology.orchestra.run.trial110.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-13T20:10:14.234 INFO:teuthology.orchestra.run.trial110.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-13T20:10:14.234 INFO:teuthology.orchestra.run.trial110.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-13T20:10:14.234 INFO:teuthology.orchestra.run.trial110.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-13T20:10:14.235 INFO:teuthology.orchestra.run.trial110.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-13T20:10:14.235 INFO:teuthology.orchestra.run.trial110.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-13T20:10:14.235 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:14.235 INFO:teuthology.orchestra.run.trial110.stdout:Complete! 2026-02-13T20:10:14.272 DEBUG:teuthology.orchestra.run.trial110:> sudo yum -y install ceph 2026-02-13T20:10:14.575 INFO:teuthology.orchestra.run.trial110.stdout:Last metadata expiration check: 0:00:31 ago on Fri 13 Feb 2026 08:09:43 PM UTC. 2026-02-13T20:10:14.659 INFO:teuthology.orchestra.run.trial110.stdout:Dependencies resolved. 2026-02-13T20:10:14.660 INFO:teuthology.orchestra.run.trial110.stdout:================================================================================ 2026-02-13T20:10:14.660 INFO:teuthology.orchestra.run.trial110.stdout: Package Arch Version Repository Size 2026-02-13T20:10:14.660 INFO:teuthology.orchestra.run.trial110.stdout:================================================================================ 2026-02-13T20:10:14.660 INFO:teuthology.orchestra.run.trial110.stdout:Installing: 2026-02-13T20:10:14.660 INFO:teuthology.orchestra.run.trial110.stdout: ceph x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 6.5 k 2026-02-13T20:10:14.660 INFO:teuthology.orchestra.run.trial110.stdout:Installing dependencies: 2026-02-13T20:10:14.660 INFO:teuthology.orchestra.run.trial110.stdout: ceph-mds x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 2.4 M 2026-02-13T20:10:14.660 INFO:teuthology.orchestra.run.trial110.stdout: ceph-mgr x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 936 k 2026-02-13T20:10:14.660 INFO:teuthology.orchestra.run.trial110.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 297 k 2026-02-13T20:10:14.660 INFO:teuthology.orchestra.run.trial110.stdout: ceph-mon x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 5.0 M 2026-02-13T20:10:14.661 INFO:teuthology.orchestra.run.trial110.stdout: ceph-osd x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 166 k 2026-02-13T20:10:14.661 INFO:teuthology.orchestra.run.trial110.stdout: ceph-osd-classic x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 16 M 2026-02-13T20:10:14.661 INFO:teuthology.orchestra.run.trial110.stdout: ceph-osd-crimson x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 19 M 2026-02-13T20:10:14.661 INFO:teuthology.orchestra.run.trial110.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-13T20:10:14.661 INFO:teuthology.orchestra.run.trial110.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-13T20:10:14.661 INFO:teuthology.orchestra.run.trial110.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-13T20:10:14.661 INFO:teuthology.orchestra.run.trial110.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-13T20:10:14.661 INFO:teuthology.orchestra.run.trial110.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-13T20:10:14.661 INFO:teuthology.orchestra.run.trial110.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-13T20:10:14.661 INFO:teuthology.orchestra.run.trial110.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-13T20:10:14.661 INFO:teuthology.orchestra.run.trial110.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-13T20:10:14.661 INFO:teuthology.orchestra.run.trial110.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-13T20:10:14.661 INFO:teuthology.orchestra.run.trial110.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-13T20:10:14.661 INFO:teuthology.orchestra.run.trial110.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-13T20:10:14.661 INFO:teuthology.orchestra.run.trial110.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-13T20:10:14.661 INFO:teuthology.orchestra.run.trial110.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-13T20:10:14.661 INFO:teuthology.orchestra.run.trial110.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-13T20:10:14.661 INFO:teuthology.orchestra.run.trial110.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-13T20:10:14.661 INFO:teuthology.orchestra.run.trial110.stdout: python3-jaraco-collections 2026-02-13T20:10:14.661 INFO:teuthology.orchestra.run.trial110.stdout: noarch 3.0.0-8.el9 epel 23 k 2026-02-13T20:10:14.661 INFO:teuthology.orchestra.run.trial110.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-13T20:10:14.661 INFO:teuthology.orchestra.run.trial110.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-13T20:10:14.661 INFO:teuthology.orchestra.run.trial110.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-13T20:10:14.661 INFO:teuthology.orchestra.run.trial110.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-13T20:10:14.661 INFO:teuthology.orchestra.run.trial110.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-13T20:10:14.661 INFO:teuthology.orchestra.run.trial110.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-13T20:10:14.661 INFO:teuthology.orchestra.run.trial110.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-13T20:10:14.661 INFO:teuthology.orchestra.run.trial110.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-13T20:10:14.661 INFO:teuthology.orchestra.run.trial110.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-13T20:10:14.661 INFO:teuthology.orchestra.run.trial110.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-13T20:10:14.661 INFO:teuthology.orchestra.run.trial110.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-13T20:10:14.661 INFO:teuthology.orchestra.run.trial110.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-13T20:10:14.661 INFO:teuthology.orchestra.run.trial110.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-13T20:10:14.661 INFO:teuthology.orchestra.run.trial110.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-13T20:10:14.661 INFO:teuthology.orchestra.run.trial110.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-13T20:10:14.661 INFO:teuthology.orchestra.run.trial110.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-13T20:10:14.661 INFO:teuthology.orchestra.run.trial110.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-13T20:10:14.661 INFO:teuthology.orchestra.run.trial110.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-13T20:10:14.661 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:14.662 INFO:teuthology.orchestra.run.trial110.stdout:Transaction Summary 2026-02-13T20:10:14.662 INFO:teuthology.orchestra.run.trial110.stdout:================================================================================ 2026-02-13T20:10:14.662 INFO:teuthology.orchestra.run.trial110.stdout:Install 42 Packages 2026-02-13T20:10:14.662 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:14.662 INFO:teuthology.orchestra.run.trial110.stdout:Total download size: 48 M 2026-02-13T20:10:14.662 INFO:teuthology.orchestra.run.trial110.stdout:Installed size: 167 M 2026-02-13T20:10:14.662 INFO:teuthology.orchestra.run.trial110.stdout:Downloading Packages: 2026-02-13T20:10:15.071 INFO:teuthology.orchestra.run.trial110.stdout:(1/42): ceph-20.3.0-5230.gafefaa40.el9.x86_64.r 72 kB/s | 6.5 kB 00:00 2026-02-13T20:10:15.213 INFO:teuthology.orchestra.run.trial110.stdout:(2/42): ceph-mgr-20.3.0-5230.gafefaa40.el9.x86_ 3.9 MB/s | 936 kB 00:00 2026-02-13T20:10:15.243 INFO:teuthology.orchestra.run.trial110.stdout:(3/42): ceph-osd-20.3.0-5230.gafefaa40.el9.x86_ 5.5 MB/s | 166 kB 00:00 2026-02-13T20:10:15.311 INFO:teuthology.orchestra.run.trial110.stdout:(4/42): ceph-mds-20.3.0-5230.gafefaa40.el9.x86_ 7.2 MB/s | 2.4 MB 00:00 2026-02-13T20:10:15.416 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5230.gafefaa40.el9.x86_64 9/10 2026-02-13T20:10:15.435 INFO:teuthology.orchestra.run.trial188.stdout: Installing : ceph-test-2:20.3.0-5230.gafefaa40.el9.x86_64 10/10 2026-02-13T20:10:15.576 INFO:teuthology.orchestra.run.trial110.stdout:(5/42): ceph-mon-20.3.0-5230.gafefaa40.el9.x86_ 9.9 MB/s | 5.0 MB 00:00 2026-02-13T20:10:15.611 INFO:teuthology.orchestra.run.trial110.stdout:(6/42): ceph-mgr-modules-core-20.3.0-5230.gafef 8.2 MB/s | 297 kB 00:00 2026-02-13T20:10:15.627 INFO:teuthology.orchestra.run.trial110.stdout:(7/42): ledmon-libs-1.1.0-3.el9.x86_64.rpm 2.6 MB/s | 40 kB 00:00 2026-02-13T20:10:15.634 INFO:teuthology.orchestra.run.trial110.stdout:(8/42): libconfig-1.7.2-9.el9.x86_64.rpm 9.3 MB/s | 72 kB 00:00 2026-02-13T20:10:15.644 INFO:teuthology.orchestra.run.trial110.stdout:(9/42): python3-cffi-1.14.5-5.el9.x86_64.rpm 25 MB/s | 253 kB 00:00 2026-02-13T20:10:15.678 INFO:teuthology.orchestra.run.trial110.stdout:(10/42): python3-cryptography-36.0.1-5.el9.x86_ 37 MB/s | 1.2 MB 00:00 2026-02-13T20:10:15.684 INFO:teuthology.orchestra.run.trial110.stdout:(11/42): python3-ply-3.11-14.el9.noarch.rpm 18 MB/s | 106 kB 00:00 2026-02-13T20:10:15.690 INFO:teuthology.orchestra.run.trial110.stdout:(12/42): python3-pycparser-2.20-6.el9.noarch.rp 21 MB/s | 135 kB 00:00 2026-02-13T20:10:15.697 INFO:teuthology.orchestra.run.trial110.stdout:(13/42): python3-pyparsing-2.4.7-9.el9.noarch.r 24 MB/s | 150 kB 00:00 2026-02-13T20:10:15.703 INFO:teuthology.orchestra.run.trial110.stdout:(14/42): python3-requests-2.25.1-10.el9.noarch. 19 MB/s | 126 kB 00:00 2026-02-13T20:10:15.710 INFO:teuthology.orchestra.run.trial110.stdout:(15/42): python3-urllib3-1.26.5-7.el9.noarch.rp 33 MB/s | 218 kB 00:00 2026-02-13T20:10:15.717 INFO:teuthology.orchestra.run.trial110.stdout:(16/42): unzip-6.0-59.el9.x86_64.rpm 26 MB/s | 182 kB 00:00 2026-02-13T20:10:15.723 INFO:teuthology.orchestra.run.trial110.stdout:(17/42): zip-3.0-35.el9.x86_64.rpm 42 MB/s | 266 kB 00:00 2026-02-13T20:10:15.732 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: ceph-test-2:20.3.0-5230.gafefaa40.el9.x86_64 10/10 2026-02-13T20:10:15.732 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : ceph-test-2:20.3.0-5230.gafefaa40.el9.x86_64 1/10 2026-02-13T20:10:15.732 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : libcephsqlite-2:20.3.0-5230.gafefaa40.el9.x86_64 2/10 2026-02-13T20:10:15.733 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 3/10 2026-02-13T20:10:15.733 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 4/10 2026-02-13T20:10:15.733 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 5/10 2026-02-13T20:10:15.733 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 6/10 2026-02-13T20:10:15.733 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 7/10 2026-02-13T20:10:15.733 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 8/10 2026-02-13T20:10:15.733 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 9/10 2026-02-13T20:10:15.785 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 10/10 2026-02-13T20:10:15.785 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:15.786 INFO:teuthology.orchestra.run.trial188.stdout:Installed: 2026-02-13T20:10:15.786 INFO:teuthology.orchestra.run.trial188.stdout: ceph-test-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:10:15.786 INFO:teuthology.orchestra.run.trial188.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-13T20:10:15.786 INFO:teuthology.orchestra.run.trial188.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-13T20:10:15.786 INFO:teuthology.orchestra.run.trial188.stdout: libcephsqlite-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:10:15.786 INFO:teuthology.orchestra.run.trial188.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-13T20:10:15.786 INFO:teuthology.orchestra.run.trial188.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-13T20:10:15.786 INFO:teuthology.orchestra.run.trial188.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-13T20:10:15.786 INFO:teuthology.orchestra.run.trial188.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-13T20:10:15.786 INFO:teuthology.orchestra.run.trial188.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-13T20:10:15.786 INFO:teuthology.orchestra.run.trial188.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-13T20:10:15.786 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:15.787 INFO:teuthology.orchestra.run.trial188.stdout:Complete! 2026-02-13T20:10:15.824 DEBUG:teuthology.orchestra.run.trial188:> sudo yum -y install ceph 2026-02-13T20:10:15.877 INFO:teuthology.orchestra.run.trial110.stdout:(18/42): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 1.6 MB/s | 246 kB 00:00 2026-02-13T20:10:15.914 INFO:teuthology.orchestra.run.trial110.stdout:(19/42): lua-5.4.4-4.el9.x86_64.rpm 5.0 MB/s | 188 kB 00:00 2026-02-13T20:10:15.950 INFO:teuthology.orchestra.run.trial110.stdout:(20/42): python3-libstoragemgmt-1.10.1-1.el9.x8 4.8 MB/s | 177 kB 00:00 2026-02-13T20:10:15.980 INFO:teuthology.orchestra.run.trial110.stdout:(21/42): python3-packaging-20.9-5.el9.noarch.rp 2.6 MB/s | 77 kB 00:00 2026-02-13T20:10:16.017 INFO:teuthology.orchestra.run.trial110.stdout:(22/42): ceph-osd-classic-20.3.0-5230.gafefaa40 20 MB/s | 16 MB 00:00 2026-02-13T20:10:16.018 INFO:teuthology.orchestra.run.trial110.stdout:(23/42): python3-toml-0.10.2-6.el9.noarch.rpm 1.1 MB/s | 42 kB 00:00 2026-02-13T20:10:16.120 INFO:teuthology.orchestra.run.trial110.stdout:(24/42): ceph-osd-crimson-20.3.0-5230.gafefaa40 24 MB/s | 19 MB 00:00 2026-02-13T20:10:16.125 INFO:teuthology.orchestra.run.trial188.stdout:Last metadata expiration check: 0:00:36 ago on Fri 13 Feb 2026 08:09:40 PM UTC. 2026-02-13T20:10:16.209 INFO:teuthology.orchestra.run.trial188.stdout:Dependencies resolved. 2026-02-13T20:10:16.211 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-13T20:10:16.211 INFO:teuthology.orchestra.run.trial188.stdout: Package Arch Version Repository Size 2026-02-13T20:10:16.211 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-13T20:10:16.211 INFO:teuthology.orchestra.run.trial188.stdout:Installing: 2026-02-13T20:10:16.211 INFO:teuthology.orchestra.run.trial188.stdout: ceph x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 6.5 k 2026-02-13T20:10:16.211 INFO:teuthology.orchestra.run.trial188.stdout:Installing dependencies: 2026-02-13T20:10:16.211 INFO:teuthology.orchestra.run.trial188.stdout: ceph-mds x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 2.4 M 2026-02-13T20:10:16.212 INFO:teuthology.orchestra.run.trial188.stdout: ceph-mgr x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 936 k 2026-02-13T20:10:16.212 INFO:teuthology.orchestra.run.trial188.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 297 k 2026-02-13T20:10:16.212 INFO:teuthology.orchestra.run.trial188.stdout: ceph-mon x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 5.0 M 2026-02-13T20:10:16.212 INFO:teuthology.orchestra.run.trial188.stdout: ceph-osd x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 166 k 2026-02-13T20:10:16.212 INFO:teuthology.orchestra.run.trial188.stdout: ceph-osd-classic x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 16 M 2026-02-13T20:10:16.212 INFO:teuthology.orchestra.run.trial188.stdout: ceph-osd-crimson x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 19 M 2026-02-13T20:10:16.212 INFO:teuthology.orchestra.run.trial188.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-13T20:10:16.212 INFO:teuthology.orchestra.run.trial188.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-13T20:10:16.212 INFO:teuthology.orchestra.run.trial188.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-13T20:10:16.212 INFO:teuthology.orchestra.run.trial188.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-13T20:10:16.212 INFO:teuthology.orchestra.run.trial188.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-13T20:10:16.212 INFO:teuthology.orchestra.run.trial188.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-13T20:10:16.212 INFO:teuthology.orchestra.run.trial188.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-13T20:10:16.213 INFO:teuthology.orchestra.run.trial188.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-13T20:10:16.213 INFO:teuthology.orchestra.run.trial188.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-13T20:10:16.213 INFO:teuthology.orchestra.run.trial188.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-13T20:10:16.213 INFO:teuthology.orchestra.run.trial188.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-13T20:10:16.213 INFO:teuthology.orchestra.run.trial188.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-13T20:10:16.213 INFO:teuthology.orchestra.run.trial188.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-13T20:10:16.213 INFO:teuthology.orchestra.run.trial188.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-13T20:10:16.213 INFO:teuthology.orchestra.run.trial188.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-13T20:10:16.213 INFO:teuthology.orchestra.run.trial188.stdout: python3-jaraco-collections 2026-02-13T20:10:16.213 INFO:teuthology.orchestra.run.trial188.stdout: noarch 3.0.0-8.el9 epel 23 k 2026-02-13T20:10:16.213 INFO:teuthology.orchestra.run.trial188.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-13T20:10:16.213 INFO:teuthology.orchestra.run.trial188.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-13T20:10:16.213 INFO:teuthology.orchestra.run.trial188.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-13T20:10:16.214 INFO:teuthology.orchestra.run.trial188.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-13T20:10:16.214 INFO:teuthology.orchestra.run.trial188.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-13T20:10:16.214 INFO:teuthology.orchestra.run.trial188.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-13T20:10:16.214 INFO:teuthology.orchestra.run.trial188.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-13T20:10:16.214 INFO:teuthology.orchestra.run.trial188.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-13T20:10:16.214 INFO:teuthology.orchestra.run.trial188.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-13T20:10:16.214 INFO:teuthology.orchestra.run.trial188.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-13T20:10:16.214 INFO:teuthology.orchestra.run.trial188.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-13T20:10:16.214 INFO:teuthology.orchestra.run.trial188.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-13T20:10:16.214 INFO:teuthology.orchestra.run.trial188.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-13T20:10:16.214 INFO:teuthology.orchestra.run.trial188.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-13T20:10:16.214 INFO:teuthology.orchestra.run.trial188.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-13T20:10:16.214 INFO:teuthology.orchestra.run.trial188.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-13T20:10:16.215 INFO:teuthology.orchestra.run.trial188.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-13T20:10:16.215 INFO:teuthology.orchestra.run.trial188.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-13T20:10:16.215 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:16.215 INFO:teuthology.orchestra.run.trial188.stdout:Transaction Summary 2026-02-13T20:10:16.215 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-13T20:10:16.215 INFO:teuthology.orchestra.run.trial188.stdout:Install 42 Packages 2026-02-13T20:10:16.215 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:16.216 INFO:teuthology.orchestra.run.trial188.stdout:Total download size: 48 M 2026-02-13T20:10:16.216 INFO:teuthology.orchestra.run.trial188.stdout:Installed size: 167 M 2026-02-13T20:10:16.216 INFO:teuthology.orchestra.run.trial188.stdout:Downloading Packages: 2026-02-13T20:10:16.237 INFO:teuthology.orchestra.run.trial110.stdout:(25/42): luarocks-3.9.2-5.el9.noarch.rpm 691 kB/s | 151 kB 00:00 2026-02-13T20:10:16.247 INFO:teuthology.orchestra.run.trial110.stdout:(26/42): python3-autocommand-2.2.2-8.el9.noarch 231 kB/s | 29 kB 00:00 2026-02-13T20:10:16.291 INFO:teuthology.orchestra.run.trial110.stdout:(27/42): python3-backports-tarfile-1.2.0-1.el9. 1.1 MB/s | 60 kB 00:00 2026-02-13T20:10:16.318 INFO:teuthology.orchestra.run.trial110.stdout:(28/42): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 616 kB/s | 43 kB 00:00 2026-02-13T20:10:16.366 INFO:teuthology.orchestra.run.trial110.stdout:(29/42): python3-cheroot-10.0.1-4.el9.noarch.rp 2.3 MB/s | 173 kB 00:00 2026-02-13T20:10:16.411 INFO:teuthology.orchestra.run.trial110.stdout:(30/42): python3-jaraco-8.2.1-3.el9.noarch.rpm 234 kB/s | 11 kB 00:00 2026-02-13T20:10:16.448 INFO:teuthology.orchestra.run.trial110.stdout:(31/42): python3-jaraco-classes-3.2.1-5.el9.noa 481 kB/s | 18 kB 00:00 2026-02-13T20:10:16.453 INFO:teuthology.orchestra.run.trial110.stdout:(32/42): lua-devel-5.4.4-4.el9.x86_64.rpm 51 kB/s | 22 kB 00:00 2026-02-13T20:10:16.459 INFO:teuthology.orchestra.run.trial110.stdout:(33/42): python3-cherrypy-18.6.1-2.el9.noarch.r 2.5 MB/s | 358 kB 00:00 2026-02-13T20:10:16.486 INFO:teuthology.orchestra.run.trial110.stdout:(34/42): python3-jaraco-collections-3.0.0-8.el9 618 kB/s | 23 kB 00:00 2026-02-13T20:10:16.495 INFO:teuthology.orchestra.run.trial110.stdout:(35/42): python3-jaraco-functools-3.5.0-2.el9.n 533 kB/s | 19 kB 00:00 2026-02-13T20:10:16.529 INFO:teuthology.orchestra.run.trial110.stdout:(36/42): python3-jaraco-text-4.0.0-2.el9.noarch 633 kB/s | 26 kB 00:00 2026-02-13T20:10:16.540 INFO:teuthology.orchestra.run.trial110.stdout:(37/42): python3-more-itertools-8.12.0-2.el9.no 1.7 MB/s | 79 kB 00:00 2026-02-13T20:10:16.563 INFO:teuthology.orchestra.run.trial110.stdout:(38/42): python3-jaraco-context-6.0.1-3.el9.noa 178 kB/s | 20 kB 00:00 2026-02-13T20:10:16.570 INFO:teuthology.orchestra.run.trial110.stdout:(39/42): python3-portend-3.1.0-2.el9.noarch.rpm 385 kB/s | 16 kB 00:00 2026-02-13T20:10:16.587 INFO:teuthology.orchestra.run.trial110.stdout:(40/42): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.9 MB/s | 90 kB 00:00 2026-02-13T20:10:16.612 INFO:teuthology.orchestra.run.trial110.stdout:(41/42): python3-zc-lockfile-2.0-10.el9.noarch. 479 kB/s | 20 kB 00:00 2026-02-13T20:10:16.637 INFO:teuthology.orchestra.run.trial110.stdout:(42/42): python3-tempora-5.0.0-2.el9.noarch.rpm 481 kB/s | 36 kB 00:00 2026-02-13T20:10:16.639 INFO:teuthology.orchestra.run.trial110.stdout:-------------------------------------------------------------------------------- 2026-02-13T20:10:16.639 INFO:teuthology.orchestra.run.trial110.stdout:Total 24 MB/s | 48 MB 00:01 2026-02-13T20:10:16.785 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction check 2026-02-13T20:10:16.803 INFO:teuthology.orchestra.run.trial110.stdout:Transaction check succeeded. 2026-02-13T20:10:16.803 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction test 2026-02-13T20:10:16.815 INFO:teuthology.orchestra.run.trial188.stdout:(1/42): ceph-20.3.0-5230.gafefaa40.el9.x86_64.r 130 kB/s | 6.5 kB 00:00 2026-02-13T20:10:16.900 INFO:teuthology.orchestra.run.trial188.stdout:(2/42): ceph-mgr-20.3.0-5230.gafefaa40.el9.x86_ 6.8 MB/s | 936 kB 00:00 2026-02-13T20:10:16.926 INFO:teuthology.orchestra.run.trial188.stdout:(3/42): ceph-mds-20.3.0-5230.gafefaa40.el9.x86_ 15 MB/s | 2.4 MB 00:00 2026-02-13T20:10:16.929 INFO:teuthology.orchestra.run.trial188.stdout:(4/42): ceph-osd-20.3.0-5230.gafefaa40.el9.x86_ 5.5 MB/s | 166 kB 00:00 2026-02-13T20:10:16.999 INFO:teuthology.orchestra.run.trial110.stdout:Transaction test succeeded. 2026-02-13T20:10:16.999 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction 2026-02-13T20:10:17.085 INFO:teuthology.orchestra.run.trial188.stdout:(5/42): ceph-mon-20.3.0-5230.gafefaa40.el9.x86_ 18 MB/s | 5.0 MB 00:00 2026-02-13T20:10:17.132 INFO:teuthology.orchestra.run.trial188.stdout:(6/42): ceph-mgr-modules-core-20.3.0-5230.gafef 6.2 MB/s | 297 kB 00:00 2026-02-13T20:10:17.230 INFO:teuthology.orchestra.run.trial110.stdout: Preparing : 1/1 2026-02-13T20:10:17.232 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/42 2026-02-13T20:10:17.237 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/42 2026-02-13T20:10:17.242 INFO:teuthology.orchestra.run.trial110.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/42 2026-02-13T20:10:17.244 INFO:teuthology.orchestra.run.trial110.stdout: Installing : unzip-6.0-59.el9.x86_64 4/42 2026-02-13T20:10:17.249 INFO:teuthology.orchestra.run.trial110.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 5/42 2026-02-13T20:10:17.273 INFO:teuthology.orchestra.run.trial110.stdout: Installing : zip-3.0-35.el9.x86_64 6/42 2026-02-13T20:10:17.277 INFO:teuthology.orchestra.run.trial110.stdout: Installing : luarocks-3.9.2-5.el9.noarch 7/42 2026-02-13T20:10:17.281 INFO:teuthology.orchestra.run.trial110.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 8/42 2026-02-13T20:10:17.286 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 9/42 2026-02-13T20:10:17.292 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 10/42 2026-02-13T20:10:17.296 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 11/42 2026-02-13T20:10:17.302 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 12/42 2026-02-13T20:10:17.307 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 13/42 2026-02-13T20:10:17.311 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 14/42 2026-02-13T20:10:17.316 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 15/42 2026-02-13T20:10:17.320 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 16/42 2026-02-13T20:10:17.327 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 17/42 2026-02-13T20:10:17.330 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 18/42 2026-02-13T20:10:17.353 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 19/42 2026-02-13T20:10:17.365 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 20/42 2026-02-13T20:10:17.371 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 21/42 2026-02-13T20:10:17.380 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 22/42 2026-02-13T20:10:17.387 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-packaging-20.9-5.el9.noarch 23/42 2026-02-13T20:10:17.400 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/42 2026-02-13T20:10:17.416 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/42 2026-02-13T20:10:17.481 INFO:teuthology.orchestra.run.trial188.stdout:(7/42): ceph-osd-classic-20.3.0-5230.gafefaa40. 28 MB/s | 16 MB 00:00 2026-02-13T20:10:17.491 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/42 2026-02-13T20:10:17.500 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 27/42 2026-02-13T20:10:17.523 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/42 2026-02-13T20:10:17.552 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 29/42 2026-02-13T20:10:17.558 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/42 2026-02-13T20:10:17.570 INFO:teuthology.orchestra.run.trial188.stdout:(8/42): ledmon-libs-1.1.0-3.el9.x86_64.rpm 92 kB/s | 40 kB 00:00 2026-02-13T20:10:17.610 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/42 2026-02-13T20:10:17.614 INFO:teuthology.orchestra.run.trial188.stdout:(9/42): ceph-osd-crimson-20.3.0-5230.gafefaa40. 28 MB/s | 19 MB 00:00 2026-02-13T20:10:17.652 INFO:teuthology.orchestra.run.trial110.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5230.gafefaa40.el9. 32/42 2026-02-13T20:10:17.654 INFO:teuthology.orchestra.run.trial110.stdout: Installing : ceph-mgr-2:20.3.0-5230.gafefaa40.el9.x86_64 33/42 2026-02-13T20:10:17.677 INFO:teuthology.orchestra.run.trial110.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5230.gafefaa40.el9.x86_64 33/42 2026-02-13T20:10:17.677 INFO:teuthology.orchestra.run.trial110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T20:10:17.677 INFO:teuthology.orchestra.run.trial110.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-13T20:10:17.678 INFO:teuthology.orchestra.run.trial110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T20:10:17.678 INFO:teuthology.orchestra.run.trial110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T20:10:17.678 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:17.682 INFO:teuthology.orchestra.run.trial110.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 34/42 2026-02-13T20:10:17.700 INFO:teuthology.orchestra.run.trial110.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/42 2026-02-13T20:10:17.700 INFO:teuthology.orchestra.run.trial110.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-13T20:10:17.700 INFO:teuthology.orchestra.run.trial110.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-13T20:10:17.700 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:17.707 INFO:teuthology.orchestra.run.trial110.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 35/42 2026-02-13T20:10:17.732 INFO:teuthology.orchestra.run.trial110.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/42 2026-02-13T20:10:17.732 INFO:teuthology.orchestra.run.trial110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-13T20:10:17.732 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:17.928 INFO:teuthology.orchestra.run.trial188.stdout:(10/42): python3-cffi-1.14.5-5.el9.x86_64.rpm 707 kB/s | 253 kB 00:00 2026-02-13T20:10:17.974 INFO:teuthology.orchestra.run.trial188.stdout:(11/42): libconfig-1.7.2-9.el9.x86_64.rpm 146 kB/s | 72 kB 00:00 2026-02-13T20:10:18.028 INFO:teuthology.orchestra.run.trial188.stdout:(12/42): python3-ply-3.11-14.el9.noarch.rpm 1.0 MB/s | 106 kB 00:00 2026-02-13T20:10:18.207 INFO:teuthology.orchestra.run.trial188.stdout:(13/42): python3-pyparsing-2.4.7-9.el9.noarch.r 844 kB/s | 150 kB 00:00 2026-02-13T20:10:18.229 INFO:teuthology.orchestra.run.trial188.stdout:(14/42): python3-pycparser-2.20-6.el9.noarch.rp 531 kB/s | 135 kB 00:00 2026-02-13T20:10:18.366 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 36/42 2026-02-13T20:10:18.385 INFO:teuthology.orchestra.run.trial188.stdout:(15/42): python3-requests-2.25.1-10.el9.noarch. 710 kB/s | 126 kB 00:00 2026-02-13T20:10:18.406 INFO:teuthology.orchestra.run.trial188.stdout:(16/42): python3-urllib3-1.26.5-7.el9.noarch.rp 1.2 MB/s | 218 kB 00:00 2026-02-13T20:10:18.484 INFO:teuthology.orchestra.run.trial188.stdout:(17/42): unzip-6.0-59.el9.x86_64.rpm 1.8 MB/s | 182 kB 00:00 2026-02-13T20:10:18.576 INFO:teuthology.orchestra.run.trial188.stdout:(18/42): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 2.6 MB/s | 246 kB 00:00 2026-02-13T20:10:18.583 INFO:teuthology.orchestra.run.trial188.stdout:(19/42): zip-3.0-35.el9.x86_64.rpm 1.5 MB/s | 266 kB 00:00 2026-02-13T20:10:18.601 INFO:teuthology.orchestra.run.trial188.stdout:(20/42): lua-5.4.4-4.el9.x86_64.rpm 7.4 MB/s | 188 kB 00:00 2026-02-13T20:10:18.624 INFO:teuthology.orchestra.run.trial188.stdout:(21/42): python3-packaging-20.9-5.el9.noarch.rp 3.3 MB/s | 77 kB 00:00 2026-02-13T20:10:18.647 INFO:teuthology.orchestra.run.trial188.stdout:(22/42): python3-toml-0.10.2-6.el9.noarch.rpm 1.8 MB/s | 42 kB 00:00 2026-02-13T20:10:18.668 INFO:teuthology.orchestra.run.trial188.stdout:(23/42): python3-libstoragemgmt-1.10.1-1.el9.x8 2.0 MB/s | 177 kB 00:00 2026-02-13T20:10:18.739 INFO:teuthology.orchestra.run.trial188.stdout:(24/42): lua-devel-5.4.4-4.el9.x86_64.rpm 243 kB/s | 22 kB 00:00 2026-02-13T20:10:18.957 INFO:teuthology.orchestra.run.trial188.stdout:(25/42): python3-autocommand-2.2.2-8.el9.noarch 135 kB/s | 29 kB 00:00 2026-02-13T20:10:19.123 INFO:teuthology.orchestra.run.trial110.stdout: Installing : ceph-osd-classic-2:20.3.0-5230.gafefaa40.el9.x86_6 37/42 2026-02-13T20:10:19.133 INFO:teuthology.orchestra.run.trial110.stdout: Installing : ceph-osd-crimson-2:20.3.0-5230.gafefaa40.el9.x86_6 38/42 2026-02-13T20:10:19.134 INFO:teuthology.orchestra.run.trial188.stdout:(26/42): python3-cryptography-36.0.1-5.el9.x86_ 838 kB/s | 1.2 MB 00:01 2026-02-13T20:10:19.134 INFO:teuthology.orchestra.run.trial110.stdout: Installing : ceph-osd-2:20.3.0-5230.gafefaa40.el9.x86_64 39/42 2026-02-13T20:10:19.160 INFO:teuthology.orchestra.run.trial110.stdout: Running scriptlet: ceph-osd-2:20.3.0-5230.gafefaa40.el9.x86_64 39/42 2026-02-13T20:10:19.160 INFO:teuthology.orchestra.run.trial110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T20:10:19.160 INFO:teuthology.orchestra.run.trial110.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-13T20:10:19.160 INFO:teuthology.orchestra.run.trial110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T20:10:19.160 INFO:teuthology.orchestra.run.trial110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T20:10:19.161 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:19.264 INFO:teuthology.orchestra.run.trial188.stdout:(27/42): luarocks-3.9.2-5.el9.noarch.rpm 254 kB/s | 151 kB 00:00 2026-02-13T20:10:19.370 INFO:teuthology.orchestra.run.trial110.stdout: Installing : ceph-mon-2:20.3.0-5230.gafefaa40.el9.x86_64 40/42 2026-02-13T20:10:19.385 INFO:teuthology.orchestra.run.trial188.stdout:(28/42): python3-backports-tarfile-1.2.0-1.el9. 141 kB/s | 60 kB 00:00 2026-02-13T20:10:19.393 INFO:teuthology.orchestra.run.trial110.stdout: Running scriptlet: ceph-mon-2:20.3.0-5230.gafefaa40.el9.x86_64 40/42 2026-02-13T20:10:19.393 INFO:teuthology.orchestra.run.trial110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T20:10:19.393 INFO:teuthology.orchestra.run.trial110.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-13T20:10:19.393 INFO:teuthology.orchestra.run.trial110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T20:10:19.393 INFO:teuthology.orchestra.run.trial110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T20:10:19.393 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:19.425 INFO:teuthology.orchestra.run.trial188.stdout:(29/42): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 149 kB/s | 43 kB 00:00 2026-02-13T20:10:19.487 INFO:teuthology.orchestra.run.trial110.stdout: Installing : ceph-mds-2:20.3.0-5230.gafefaa40.el9.x86_64 41/42 2026-02-13T20:10:19.507 INFO:teuthology.orchestra.run.trial110.stdout: Running scriptlet: ceph-mds-2:20.3.0-5230.gafefaa40.el9.x86_64 41/42 2026-02-13T20:10:19.507 INFO:teuthology.orchestra.run.trial110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T20:10:19.507 INFO:teuthology.orchestra.run.trial110.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-13T20:10:19.507 INFO:teuthology.orchestra.run.trial110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T20:10:19.507 INFO:teuthology.orchestra.run.trial110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T20:10:19.507 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:19.508 INFO:teuthology.orchestra.run.trial110.stdout: Installing : ceph-2:20.3.0-5230.gafefaa40.el9.x86_64 42/42 2026-02-13T20:10:19.515 INFO:teuthology.orchestra.run.trial110.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5230.gafefaa40.el9.x86_6 42/42 2026-02-13T20:10:19.539 INFO:teuthology.orchestra.run.trial110.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5230.gafefaa40.el9.x86_6 42/42 2026-02-13T20:10:19.709 INFO:teuthology.orchestra.run.trial188.stdout:(30/42): python3-jaraco-8.2.1-3.el9.noarch.rpm 38 kB/s | 11 kB 00:00 2026-02-13T20:10:19.748 INFO:teuthology.orchestra.run.trial188.stdout:(31/42): python3-cheroot-10.0.1-4.el9.noarch.rp 358 kB/s | 173 kB 00:00 2026-02-13T20:10:19.870 INFO:teuthology.orchestra.run.trial188.stdout:(32/42): python3-jaraco-classes-3.2.1-5.el9.noa 109 kB/s | 18 kB 00:00 2026-02-13T20:10:19.904 INFO:teuthology.orchestra.run.trial110.stdout: Running scriptlet: ceph-2:20.3.0-5230.gafefaa40.el9.x86_64 42/42 2026-02-13T20:10:19.904 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : ceph-2:20.3.0-5230.gafefaa40.el9.x86_64 1/42 2026-02-13T20:10:19.904 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : ceph-mds-2:20.3.0-5230.gafefaa40.el9.x86_64 2/42 2026-02-13T20:10:19.904 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : ceph-mgr-2:20.3.0-5230.gafefaa40.el9.x86_64 3/42 2026-02-13T20:10:19.904 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : ceph-mon-2:20.3.0-5230.gafefaa40.el9.x86_64 4/42 2026-02-13T20:10:19.904 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : ceph-osd-2:20.3.0-5230.gafefaa40.el9.x86_64 5/42 2026-02-13T20:10:19.904 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : ceph-osd-classic-2:20.3.0-5230.gafefaa40.el9.x86_6 6/42 2026-02-13T20:10:19.904 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5230.gafefaa40.el9.x86_6 7/42 2026-02-13T20:10:19.904 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5230.gafefaa40.el9. 8/42 2026-02-13T20:10:19.904 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 9/42 2026-02-13T20:10:19.904 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 10/42 2026-02-13T20:10:19.904 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 11/42 2026-02-13T20:10:19.904 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 12/42 2026-02-13T20:10:19.904 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-ply-3.11-14.el9.noarch 13/42 2026-02-13T20:10:19.904 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 14/42 2026-02-13T20:10:19.904 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 15/42 2026-02-13T20:10:19.904 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 16/42 2026-02-13T20:10:19.904 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 17/42 2026-02-13T20:10:19.904 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : unzip-6.0-59.el9.x86_64 18/42 2026-02-13T20:10:19.904 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : zip-3.0-35.el9.x86_64 19/42 2026-02-13T20:10:19.904 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 20/42 2026-02-13T20:10:19.904 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : lua-5.4.4-4.el9.x86_64 21/42 2026-02-13T20:10:19.904 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 22/42 2026-02-13T20:10:19.904 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 23/42 2026-02-13T20:10:19.904 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 24/42 2026-02-13T20:10:19.905 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 25/42 2026-02-13T20:10:19.905 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 26/42 2026-02-13T20:10:19.905 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 27/42 2026-02-13T20:10:19.905 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 28/42 2026-02-13T20:10:19.905 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 29/42 2026-02-13T20:10:19.905 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 30/42 2026-02-13T20:10:19.905 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 31/42 2026-02-13T20:10:19.905 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 32/42 2026-02-13T20:10:19.905 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 33/42 2026-02-13T20:10:19.905 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 34/42 2026-02-13T20:10:19.905 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 35/42 2026-02-13T20:10:19.905 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 36/42 2026-02-13T20:10:19.905 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 37/42 2026-02-13T20:10:19.905 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 38/42 2026-02-13T20:10:19.905 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 39/42 2026-02-13T20:10:19.905 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 40/42 2026-02-13T20:10:19.905 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 41/42 2026-02-13T20:10:19.950 INFO:teuthology.orchestra.run.trial188.stdout:(33/42): python3-jaraco-collections-3.0.0-8.el9 115 kB/s | 23 kB 00:00 2026-02-13T20:10:19.962 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 42/42 2026-02-13T20:10:19.962 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:19.962 INFO:teuthology.orchestra.run.trial110.stdout:Installed: 2026-02-13T20:10:19.962 INFO:teuthology.orchestra.run.trial110.stdout: ceph-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:10:19.962 INFO:teuthology.orchestra.run.trial110.stdout: ceph-mds-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:10:19.962 INFO:teuthology.orchestra.run.trial110.stdout: ceph-mgr-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:10:19.962 INFO:teuthology.orchestra.run.trial110.stdout: ceph-mgr-modules-core-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-13T20:10:19.962 INFO:teuthology.orchestra.run.trial110.stdout: ceph-mon-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:10:19.962 INFO:teuthology.orchestra.run.trial110.stdout: ceph-osd-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:10:19.963 INFO:teuthology.orchestra.run.trial110.stdout: ceph-osd-classic-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:10:19.963 INFO:teuthology.orchestra.run.trial110.stdout: ceph-osd-crimson-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:10:19.963 INFO:teuthology.orchestra.run.trial110.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-13T20:10:19.963 INFO:teuthology.orchestra.run.trial110.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-13T20:10:19.963 INFO:teuthology.orchestra.run.trial110.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T20:10:19.963 INFO:teuthology.orchestra.run.trial110.stdout: lua-5.4.4-4.el9.x86_64 2026-02-13T20:10:19.963 INFO:teuthology.orchestra.run.trial110.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-13T20:10:19.963 INFO:teuthology.orchestra.run.trial110.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-13T20:10:19.963 INFO:teuthology.orchestra.run.trial110.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-13T20:10:19.963 INFO:teuthology.orchestra.run.trial110.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-13T20:10:19.963 INFO:teuthology.orchestra.run.trial110.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-13T20:10:19.963 INFO:teuthology.orchestra.run.trial110.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-13T20:10:19.963 INFO:teuthology.orchestra.run.trial110.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-13T20:10:19.963 INFO:teuthology.orchestra.run.trial110.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-13T20:10:19.963 INFO:teuthology.orchestra.run.trial110.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-13T20:10:19.963 INFO:teuthology.orchestra.run.trial110.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-13T20:10:19.963 INFO:teuthology.orchestra.run.trial110.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-13T20:10:19.963 INFO:teuthology.orchestra.run.trial110.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-13T20:10:19.963 INFO:teuthology.orchestra.run.trial110.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-13T20:10:19.963 INFO:teuthology.orchestra.run.trial110.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-13T20:10:19.963 INFO:teuthology.orchestra.run.trial110.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-13T20:10:19.963 INFO:teuthology.orchestra.run.trial110.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T20:10:19.963 INFO:teuthology.orchestra.run.trial110.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-13T20:10:19.963 INFO:teuthology.orchestra.run.trial110.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-13T20:10:19.963 INFO:teuthology.orchestra.run.trial110.stdout: python3-ply-3.11-14.el9.noarch 2026-02-13T20:10:19.963 INFO:teuthology.orchestra.run.trial110.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-13T20:10:19.963 INFO:teuthology.orchestra.run.trial110.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-13T20:10:19.963 INFO:teuthology.orchestra.run.trial110.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-13T20:10:19.963 INFO:teuthology.orchestra.run.trial110.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-13T20:10:19.963 INFO:teuthology.orchestra.run.trial110.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-13T20:10:19.964 INFO:teuthology.orchestra.run.trial110.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-13T20:10:19.964 INFO:teuthology.orchestra.run.trial110.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-13T20:10:19.964 INFO:teuthology.orchestra.run.trial110.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-13T20:10:19.964 INFO:teuthology.orchestra.run.trial110.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-13T20:10:19.964 INFO:teuthology.orchestra.run.trial110.stdout: unzip-6.0-59.el9.x86_64 2026-02-13T20:10:19.964 INFO:teuthology.orchestra.run.trial110.stdout: zip-3.0-35.el9.x86_64 2026-02-13T20:10:19.964 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:19.964 INFO:teuthology.orchestra.run.trial110.stdout:Complete! 2026-02-13T20:10:20.002 DEBUG:teuthology.orchestra.run.trial110:> sudo yum -y install ceph-base 2026-02-13T20:10:20.031 INFO:teuthology.orchestra.run.trial188.stdout:(34/42): python3-jaraco-context-6.0.1-3.el9.noa 122 kB/s | 20 kB 00:00 2026-02-13T20:10:20.072 INFO:teuthology.orchestra.run.trial188.stdout:(35/42): python3-cherrypy-18.6.1-2.el9.noarch.r 521 kB/s | 358 kB 00:00 2026-02-13T20:10:20.073 INFO:teuthology.orchestra.run.trial188.stdout:(36/42): python3-jaraco-functools-3.5.0-2.el9.n 159 kB/s | 19 kB 00:00 2026-02-13T20:10:20.112 INFO:teuthology.orchestra.run.trial188.stdout:(37/42): python3-jaraco-text-4.0.0-2.el9.noarch 330 kB/s | 26 kB 00:00 2026-02-13T20:10:20.177 INFO:teuthology.orchestra.run.trial188.stdout:(38/42): python3-more-itertools-8.12.0-2.el9.no 753 kB/s | 79 kB 00:00 2026-02-13T20:10:20.192 INFO:teuthology.orchestra.run.trial188.stdout:(39/42): python3-portend-3.1.0-2.el9.noarch.rpm 137 kB/s | 16 kB 00:00 2026-02-13T20:10:20.258 INFO:teuthology.orchestra.run.trial188.stdout:(40/42): python3-pyOpenSSL-21.0.0-1.el9.noarch. 616 kB/s | 90 kB 00:00 2026-02-13T20:10:20.298 INFO:teuthology.orchestra.run.trial188.stdout:(41/42): python3-tempora-5.0.0-2.el9.noarch.rpm 296 kB/s | 36 kB 00:00 2026-02-13T20:10:20.299 INFO:teuthology.orchestra.run.trial188.stdout:(42/42): python3-zc-lockfile-2.0-10.el9.noarch. 187 kB/s | 20 kB 00:00 2026-02-13T20:10:20.306 INFO:teuthology.orchestra.run.trial188.stdout:-------------------------------------------------------------------------------- 2026-02-13T20:10:20.306 INFO:teuthology.orchestra.run.trial188.stdout:Total 12 MB/s | 48 MB 00:04 2026-02-13T20:10:20.308 INFO:teuthology.orchestra.run.trial110.stdout:Last metadata expiration check: 0:00:37 ago on Fri 13 Feb 2026 08:09:43 PM UTC. 2026-02-13T20:10:20.373 INFO:teuthology.orchestra.run.trial110.stdout:Package ceph-base-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-13T20:10:20.391 INFO:teuthology.orchestra.run.trial110.stdout:Dependencies resolved. 2026-02-13T20:10:20.392 INFO:teuthology.orchestra.run.trial110.stdout:Nothing to do. 2026-02-13T20:10:20.392 INFO:teuthology.orchestra.run.trial110.stdout:Complete! 2026-02-13T20:10:20.413 DEBUG:teuthology.orchestra.run.trial110:> sudo yum -y install cephadm 2026-02-13T20:10:20.452 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction check 2026-02-13T20:10:20.470 INFO:teuthology.orchestra.run.trial188.stdout:Transaction check succeeded. 2026-02-13T20:10:20.471 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction test 2026-02-13T20:10:20.668 INFO:teuthology.orchestra.run.trial188.stdout:Transaction test succeeded. 2026-02-13T20:10:20.668 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction 2026-02-13T20:10:20.713 INFO:teuthology.orchestra.run.trial110.stdout:Last metadata expiration check: 0:00:37 ago on Fri 13 Feb 2026 08:09:43 PM UTC. 2026-02-13T20:10:20.796 INFO:teuthology.orchestra.run.trial110.stdout:Dependencies resolved. 2026-02-13T20:10:20.796 INFO:teuthology.orchestra.run.trial110.stdout:================================================================================ 2026-02-13T20:10:20.797 INFO:teuthology.orchestra.run.trial110.stdout: Package Arch Version Repository Size 2026-02-13T20:10:20.797 INFO:teuthology.orchestra.run.trial110.stdout:================================================================================ 2026-02-13T20:10:20.797 INFO:teuthology.orchestra.run.trial110.stdout:Installing: 2026-02-13T20:10:20.797 INFO:teuthology.orchestra.run.trial110.stdout: cephadm noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 1.0 M 2026-02-13T20:10:20.797 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:20.797 INFO:teuthology.orchestra.run.trial110.stdout:Transaction Summary 2026-02-13T20:10:20.797 INFO:teuthology.orchestra.run.trial110.stdout:================================================================================ 2026-02-13T20:10:20.797 INFO:teuthology.orchestra.run.trial110.stdout:Install 1 Package 2026-02-13T20:10:20.797 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:20.797 INFO:teuthology.orchestra.run.trial110.stdout:Total download size: 1.0 M 2026-02-13T20:10:20.797 INFO:teuthology.orchestra.run.trial110.stdout:Installed size: 1.0 M 2026-02-13T20:10:20.798 INFO:teuthology.orchestra.run.trial110.stdout:Downloading Packages: 2026-02-13T20:10:20.897 INFO:teuthology.orchestra.run.trial188.stdout: Preparing : 1/1 2026-02-13T20:10:20.898 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/42 2026-02-13T20:10:20.903 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/42 2026-02-13T20:10:20.908 INFO:teuthology.orchestra.run.trial188.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/42 2026-02-13T20:10:20.910 INFO:teuthology.orchestra.run.trial188.stdout: Installing : unzip-6.0-59.el9.x86_64 4/42 2026-02-13T20:10:20.915 INFO:teuthology.orchestra.run.trial188.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 5/42 2026-02-13T20:10:20.940 INFO:teuthology.orchestra.run.trial188.stdout: Installing : zip-3.0-35.el9.x86_64 6/42 2026-02-13T20:10:20.943 INFO:teuthology.orchestra.run.trial188.stdout: Installing : luarocks-3.9.2-5.el9.noarch 7/42 2026-02-13T20:10:20.948 INFO:teuthology.orchestra.run.trial188.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 8/42 2026-02-13T20:10:20.952 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 9/42 2026-02-13T20:10:20.958 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 10/42 2026-02-13T20:10:20.962 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 11/42 2026-02-13T20:10:20.968 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 12/42 2026-02-13T20:10:20.973 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 13/42 2026-02-13T20:10:20.977 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 14/42 2026-02-13T20:10:20.982 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 15/42 2026-02-13T20:10:20.986 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 16/42 2026-02-13T20:10:20.993 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 17/42 2026-02-13T20:10:20.996 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 18/42 2026-02-13T20:10:21.019 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 19/42 2026-02-13T20:10:21.031 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 20/42 2026-02-13T20:10:21.036 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 21/42 2026-02-13T20:10:21.046 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 22/42 2026-02-13T20:10:21.052 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-packaging-20.9-5.el9.noarch 23/42 2026-02-13T20:10:21.066 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/42 2026-02-13T20:10:21.081 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/42 2026-02-13T20:10:21.155 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/42 2026-02-13T20:10:21.164 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 27/42 2026-02-13T20:10:21.187 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/42 2026-02-13T20:10:21.216 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 29/42 2026-02-13T20:10:21.221 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/42 2026-02-13T20:10:21.273 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/42 2026-02-13T20:10:21.315 INFO:teuthology.orchestra.run.trial188.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5230.gafefaa40.el9. 32/42 2026-02-13T20:10:21.316 INFO:teuthology.orchestra.run.trial188.stdout: Installing : ceph-mgr-2:20.3.0-5230.gafefaa40.el9.x86_64 33/42 2026-02-13T20:10:21.339 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5230.gafefaa40.el9.x86_64 33/42 2026-02-13T20:10:21.339 INFO:teuthology.orchestra.run.trial188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T20:10:21.340 INFO:teuthology.orchestra.run.trial188.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-13T20:10:21.340 INFO:teuthology.orchestra.run.trial188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T20:10:21.340 INFO:teuthology.orchestra.run.trial188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T20:10:21.340 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:21.344 INFO:teuthology.orchestra.run.trial188.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 34/42 2026-02-13T20:10:21.361 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/42 2026-02-13T20:10:21.361 INFO:teuthology.orchestra.run.trial188.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-13T20:10:21.361 INFO:teuthology.orchestra.run.trial188.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-13T20:10:21.361 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:21.370 INFO:teuthology.orchestra.run.trial188.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 35/42 2026-02-13T20:10:21.393 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/42 2026-02-13T20:10:21.393 INFO:teuthology.orchestra.run.trial188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-13T20:10:21.393 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:21.731 INFO:teuthology.orchestra.run.trial110.stdout:cephadm-20.3.0-5230.gafefaa40.el9.noarch.rpm 1.1 MB/s | 1.0 MB 00:00 2026-02-13T20:10:21.731 INFO:teuthology.orchestra.run.trial110.stdout:-------------------------------------------------------------------------------- 2026-02-13T20:10:21.732 INFO:teuthology.orchestra.run.trial110.stdout:Total 1.1 MB/s | 1.0 MB 00:00 2026-02-13T20:10:21.732 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction check 2026-02-13T20:10:21.734 INFO:teuthology.orchestra.run.trial110.stdout:Transaction check succeeded. 2026-02-13T20:10:21.734 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction test 2026-02-13T20:10:21.739 INFO:teuthology.orchestra.run.trial110.stdout:Transaction test succeeded. 2026-02-13T20:10:21.739 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction 2026-02-13T20:10:21.757 INFO:teuthology.orchestra.run.trial110.stdout: Preparing : 1/1 2026-02-13T20:10:21.818 INFO:teuthology.orchestra.run.trial110.stdout: Running scriptlet: cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 1/1 2026-02-13T20:10:21.832 INFO:teuthology.orchestra.run.trial110.stdout: Installing : cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 1/1 2026-02-13T20:10:21.893 INFO:teuthology.orchestra.run.trial110.stdout: Running scriptlet: cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 1/1 2026-02-13T20:10:21.947 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 1/1 2026-02-13T20:10:21.947 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:21.947 INFO:teuthology.orchestra.run.trial110.stdout:Installed: 2026-02-13T20:10:21.947 INFO:teuthology.orchestra.run.trial110.stdout: cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-13T20:10:21.947 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:21.948 INFO:teuthology.orchestra.run.trial110.stdout:Complete! 2026-02-13T20:10:21.974 DEBUG:teuthology.orchestra.run.trial110:> sudo yum -y install ceph-immutable-object-cache 2026-02-13T20:10:22.040 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 36/42 2026-02-13T20:10:22.272 INFO:teuthology.orchestra.run.trial110.stdout:Last metadata expiration check: 0:00:39 ago on Fri 13 Feb 2026 08:09:43 PM UTC. 2026-02-13T20:10:22.354 INFO:teuthology.orchestra.run.trial110.stdout:Dependencies resolved. 2026-02-13T20:10:22.354 INFO:teuthology.orchestra.run.trial110.stdout:================================================================================ 2026-02-13T20:10:22.354 INFO:teuthology.orchestra.run.trial110.stdout: Package Arch Version Repo Size 2026-02-13T20:10:22.354 INFO:teuthology.orchestra.run.trial110.stdout:================================================================================ 2026-02-13T20:10:22.354 INFO:teuthology.orchestra.run.trial110.stdout:Installing: 2026-02-13T20:10:22.355 INFO:teuthology.orchestra.run.trial110.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 147 k 2026-02-13T20:10:22.355 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:22.355 INFO:teuthology.orchestra.run.trial110.stdout:Transaction Summary 2026-02-13T20:10:22.355 INFO:teuthology.orchestra.run.trial110.stdout:================================================================================ 2026-02-13T20:10:22.355 INFO:teuthology.orchestra.run.trial110.stdout:Install 1 Package 2026-02-13T20:10:22.355 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:22.355 INFO:teuthology.orchestra.run.trial110.stdout:Total download size: 147 k 2026-02-13T20:10:22.355 INFO:teuthology.orchestra.run.trial110.stdout:Installed size: 419 k 2026-02-13T20:10:22.355 INFO:teuthology.orchestra.run.trial110.stdout:Downloading Packages: 2026-02-13T20:10:22.762 INFO:teuthology.orchestra.run.trial110.stdout:ceph-immutable-object-cache-20.3.0-5230.gafefaa 362 kB/s | 147 kB 00:00 2026-02-13T20:10:22.762 INFO:teuthology.orchestra.run.trial110.stdout:-------------------------------------------------------------------------------- 2026-02-13T20:10:22.762 INFO:teuthology.orchestra.run.trial110.stdout:Total 361 kB/s | 147 kB 00:00 2026-02-13T20:10:22.763 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction check 2026-02-13T20:10:22.767 INFO:teuthology.orchestra.run.trial110.stdout:Transaction check succeeded. 2026-02-13T20:10:22.767 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction test 2026-02-13T20:10:22.794 INFO:teuthology.orchestra.run.trial110.stdout:Transaction test succeeded. 2026-02-13T20:10:22.794 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction 2026-02-13T20:10:22.811 INFO:teuthology.orchestra.run.trial188.stdout: Installing : ceph-osd-classic-2:20.3.0-5230.gafefaa40.el9.x86_6 37/42 2026-02-13T20:10:22.821 INFO:teuthology.orchestra.run.trial188.stdout: Installing : ceph-osd-crimson-2:20.3.0-5230.gafefaa40.el9.x86_6 38/42 2026-02-13T20:10:22.823 INFO:teuthology.orchestra.run.trial188.stdout: Installing : ceph-osd-2:20.3.0-5230.gafefaa40.el9.x86_64 39/42 2026-02-13T20:10:22.843 INFO:teuthology.orchestra.run.trial110.stdout: Preparing : 1/1 2026-02-13T20:10:22.845 INFO:teuthology.orchestra.run.trial110.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5230.gafefaa40. 1/1 2026-02-13T20:10:22.847 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: ceph-osd-2:20.3.0-5230.gafefaa40.el9.x86_64 39/42 2026-02-13T20:10:22.847 INFO:teuthology.orchestra.run.trial188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T20:10:22.847 INFO:teuthology.orchestra.run.trial188.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-13T20:10:22.847 INFO:teuthology.orchestra.run.trial188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T20:10:22.847 INFO:teuthology.orchestra.run.trial188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T20:10:22.848 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:22.867 INFO:teuthology.orchestra.run.trial110.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5230.gafefaa40. 1/1 2026-02-13T20:10:22.867 INFO:teuthology.orchestra.run.trial110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T20:10:22.868 INFO:teuthology.orchestra.run.trial110.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-13T20:10:22.868 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:23.063 INFO:teuthology.orchestra.run.trial188.stdout: Installing : ceph-mon-2:20.3.0-5230.gafefaa40.el9.x86_64 40/42 2026-02-13T20:10:23.085 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: ceph-mon-2:20.3.0-5230.gafefaa40.el9.x86_64 40/42 2026-02-13T20:10:23.085 INFO:teuthology.orchestra.run.trial188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T20:10:23.085 INFO:teuthology.orchestra.run.trial188.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-13T20:10:23.085 INFO:teuthology.orchestra.run.trial188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T20:10:23.085 INFO:teuthology.orchestra.run.trial188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T20:10:23.085 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:23.173 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5230.gafefaa40. 1/1 2026-02-13T20:10:23.173 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:23.173 INFO:teuthology.orchestra.run.trial110.stdout:Installed: 2026-02-13T20:10:23.173 INFO:teuthology.orchestra.run.trial110.stdout: ceph-immutable-object-cache-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:10:23.173 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:23.173 INFO:teuthology.orchestra.run.trial110.stdout:Complete! 2026-02-13T20:10:23.182 INFO:teuthology.orchestra.run.trial188.stdout: Installing : ceph-mds-2:20.3.0-5230.gafefaa40.el9.x86_64 41/42 2026-02-13T20:10:23.201 DEBUG:teuthology.orchestra.run.trial110:> sudo yum -y install ceph-mgr 2026-02-13T20:10:23.204 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: ceph-mds-2:20.3.0-5230.gafefaa40.el9.x86_64 41/42 2026-02-13T20:10:23.205 INFO:teuthology.orchestra.run.trial188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T20:10:23.205 INFO:teuthology.orchestra.run.trial188.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-13T20:10:23.205 INFO:teuthology.orchestra.run.trial188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T20:10:23.205 INFO:teuthology.orchestra.run.trial188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T20:10:23.205 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:23.206 INFO:teuthology.orchestra.run.trial188.stdout: Installing : ceph-2:20.3.0-5230.gafefaa40.el9.x86_64 42/42 2026-02-13T20:10:23.213 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5230.gafefaa40.el9.x86_6 42/42 2026-02-13T20:10:23.236 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5230.gafefaa40.el9.x86_6 42/42 2026-02-13T20:10:23.498 INFO:teuthology.orchestra.run.trial110.stdout:Last metadata expiration check: 0:00:40 ago on Fri 13 Feb 2026 08:09:43 PM UTC. 2026-02-13T20:10:23.565 INFO:teuthology.orchestra.run.trial110.stdout:Package ceph-mgr-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-13T20:10:23.582 INFO:teuthology.orchestra.run.trial110.stdout:Dependencies resolved. 2026-02-13T20:10:23.583 INFO:teuthology.orchestra.run.trial110.stdout:Nothing to do. 2026-02-13T20:10:23.583 INFO:teuthology.orchestra.run.trial110.stdout:Complete! 2026-02-13T20:10:23.599 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: ceph-2:20.3.0-5230.gafefaa40.el9.x86_64 42/42 2026-02-13T20:10:23.599 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : ceph-2:20.3.0-5230.gafefaa40.el9.x86_64 1/42 2026-02-13T20:10:23.599 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : ceph-mds-2:20.3.0-5230.gafefaa40.el9.x86_64 2/42 2026-02-13T20:10:23.599 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : ceph-mgr-2:20.3.0-5230.gafefaa40.el9.x86_64 3/42 2026-02-13T20:10:23.599 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : ceph-mon-2:20.3.0-5230.gafefaa40.el9.x86_64 4/42 2026-02-13T20:10:23.599 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : ceph-osd-2:20.3.0-5230.gafefaa40.el9.x86_64 5/42 2026-02-13T20:10:23.599 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : ceph-osd-classic-2:20.3.0-5230.gafefaa40.el9.x86_6 6/42 2026-02-13T20:10:23.599 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5230.gafefaa40.el9.x86_6 7/42 2026-02-13T20:10:23.600 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5230.gafefaa40.el9. 8/42 2026-02-13T20:10:23.600 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 9/42 2026-02-13T20:10:23.600 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 10/42 2026-02-13T20:10:23.600 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 11/42 2026-02-13T20:10:23.600 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 12/42 2026-02-13T20:10:23.600 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-ply-3.11-14.el9.noarch 13/42 2026-02-13T20:10:23.600 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 14/42 2026-02-13T20:10:23.600 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 15/42 2026-02-13T20:10:23.600 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 16/42 2026-02-13T20:10:23.600 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 17/42 2026-02-13T20:10:23.600 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : unzip-6.0-59.el9.x86_64 18/42 2026-02-13T20:10:23.600 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : zip-3.0-35.el9.x86_64 19/42 2026-02-13T20:10:23.601 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 20/42 2026-02-13T20:10:23.601 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : lua-5.4.4-4.el9.x86_64 21/42 2026-02-13T20:10:23.601 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 22/42 2026-02-13T20:10:23.601 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 23/42 2026-02-13T20:10:23.601 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 24/42 2026-02-13T20:10:23.601 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 25/42 2026-02-13T20:10:23.601 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 26/42 2026-02-13T20:10:23.601 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 27/42 2026-02-13T20:10:23.601 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 28/42 2026-02-13T20:10:23.601 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 29/42 2026-02-13T20:10:23.601 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 30/42 2026-02-13T20:10:23.601 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 31/42 2026-02-13T20:10:23.601 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 32/42 2026-02-13T20:10:23.602 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 33/42 2026-02-13T20:10:23.602 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 34/42 2026-02-13T20:10:23.602 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 35/42 2026-02-13T20:10:23.602 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 36/42 2026-02-13T20:10:23.602 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 37/42 2026-02-13T20:10:23.602 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 38/42 2026-02-13T20:10:23.602 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 39/42 2026-02-13T20:10:23.602 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 40/42 2026-02-13T20:10:23.602 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 41/42 2026-02-13T20:10:23.604 DEBUG:teuthology.orchestra.run.trial110:> sudo yum -y install ceph-mgr-dashboard 2026-02-13T20:10:23.655 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 42/42 2026-02-13T20:10:23.656 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:23.656 INFO:teuthology.orchestra.run.trial188.stdout:Installed: 2026-02-13T20:10:23.656 INFO:teuthology.orchestra.run.trial188.stdout: ceph-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:10:23.656 INFO:teuthology.orchestra.run.trial188.stdout: ceph-mds-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:10:23.656 INFO:teuthology.orchestra.run.trial188.stdout: ceph-mgr-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:10:23.656 INFO:teuthology.orchestra.run.trial188.stdout: ceph-mgr-modules-core-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-13T20:10:23.656 INFO:teuthology.orchestra.run.trial188.stdout: ceph-mon-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:10:23.656 INFO:teuthology.orchestra.run.trial188.stdout: ceph-osd-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:10:23.656 INFO:teuthology.orchestra.run.trial188.stdout: ceph-osd-classic-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:10:23.656 INFO:teuthology.orchestra.run.trial188.stdout: ceph-osd-crimson-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:10:23.657 INFO:teuthology.orchestra.run.trial188.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-13T20:10:23.657 INFO:teuthology.orchestra.run.trial188.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-13T20:10:23.657 INFO:teuthology.orchestra.run.trial188.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T20:10:23.657 INFO:teuthology.orchestra.run.trial188.stdout: lua-5.4.4-4.el9.x86_64 2026-02-13T20:10:23.657 INFO:teuthology.orchestra.run.trial188.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-13T20:10:23.657 INFO:teuthology.orchestra.run.trial188.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-13T20:10:23.657 INFO:teuthology.orchestra.run.trial188.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-13T20:10:23.657 INFO:teuthology.orchestra.run.trial188.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-13T20:10:23.657 INFO:teuthology.orchestra.run.trial188.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-13T20:10:23.657 INFO:teuthology.orchestra.run.trial188.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-13T20:10:23.657 INFO:teuthology.orchestra.run.trial188.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-13T20:10:23.657 INFO:teuthology.orchestra.run.trial188.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-13T20:10:23.658 INFO:teuthology.orchestra.run.trial188.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-13T20:10:23.658 INFO:teuthology.orchestra.run.trial188.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-13T20:10:23.658 INFO:teuthology.orchestra.run.trial188.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-13T20:10:23.658 INFO:teuthology.orchestra.run.trial188.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-13T20:10:23.658 INFO:teuthology.orchestra.run.trial188.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-13T20:10:23.658 INFO:teuthology.orchestra.run.trial188.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-13T20:10:23.658 INFO:teuthology.orchestra.run.trial188.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-13T20:10:23.658 INFO:teuthology.orchestra.run.trial188.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T20:10:23.658 INFO:teuthology.orchestra.run.trial188.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-13T20:10:23.658 INFO:teuthology.orchestra.run.trial188.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-13T20:10:23.658 INFO:teuthology.orchestra.run.trial188.stdout: python3-ply-3.11-14.el9.noarch 2026-02-13T20:10:23.658 INFO:teuthology.orchestra.run.trial188.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-13T20:10:23.659 INFO:teuthology.orchestra.run.trial188.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-13T20:10:23.659 INFO:teuthology.orchestra.run.trial188.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-13T20:10:23.659 INFO:teuthology.orchestra.run.trial188.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-13T20:10:23.659 INFO:teuthology.orchestra.run.trial188.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-13T20:10:23.659 INFO:teuthology.orchestra.run.trial188.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-13T20:10:23.659 INFO:teuthology.orchestra.run.trial188.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-13T20:10:23.659 INFO:teuthology.orchestra.run.trial188.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-13T20:10:23.659 INFO:teuthology.orchestra.run.trial188.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-13T20:10:23.659 INFO:teuthology.orchestra.run.trial188.stdout: unzip-6.0-59.el9.x86_64 2026-02-13T20:10:23.659 INFO:teuthology.orchestra.run.trial188.stdout: zip-3.0-35.el9.x86_64 2026-02-13T20:10:23.659 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:23.659 INFO:teuthology.orchestra.run.trial188.stdout:Complete! 2026-02-13T20:10:23.693 DEBUG:teuthology.orchestra.run.trial188:> sudo yum -y install ceph-base 2026-02-13T20:10:23.901 INFO:teuthology.orchestra.run.trial110.stdout:Last metadata expiration check: 0:00:40 ago on Fri 13 Feb 2026 08:09:43 PM UTC. 2026-02-13T20:10:23.984 INFO:teuthology.orchestra.run.trial110.stdout:Dependencies resolved. 2026-02-13T20:10:23.985 INFO:teuthology.orchestra.run.trial110.stdout:================================================================================ 2026-02-13T20:10:23.985 INFO:teuthology.orchestra.run.trial110.stdout: Package Arch Version Repository Size 2026-02-13T20:10:23.985 INFO:teuthology.orchestra.run.trial110.stdout:================================================================================ 2026-02-13T20:10:23.985 INFO:teuthology.orchestra.run.trial110.stdout:Installing: 2026-02-13T20:10:23.985 INFO:teuthology.orchestra.run.trial110.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 51 M 2026-02-13T20:10:23.985 INFO:teuthology.orchestra.run.trial110.stdout:Installing dependencies: 2026-02-13T20:10:23.985 INFO:teuthology.orchestra.run.trial110.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-13T20:10:23.985 INFO:teuthology.orchestra.run.trial110.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 57 k 2026-02-13T20:10:23.985 INFO:teuthology.orchestra.run.trial110.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 17 k 2026-02-13T20:10:23.985 INFO:teuthology.orchestra.run.trial110.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-13T20:10:23.986 INFO:teuthology.orchestra.run.trial110.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-13T20:10:23.986 INFO:teuthology.orchestra.run.trial110.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-13T20:10:23.986 INFO:teuthology.orchestra.run.trial110.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-13T20:10:23.986 INFO:teuthology.orchestra.run.trial110.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-13T20:10:23.986 INFO:teuthology.orchestra.run.trial110.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-13T20:10:23.986 INFO:teuthology.orchestra.run.trial110.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-13T20:10:23.986 INFO:teuthology.orchestra.run.trial110.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-13T20:10:23.986 INFO:teuthology.orchestra.run.trial110.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-13T20:10:23.986 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:23.986 INFO:teuthology.orchestra.run.trial110.stdout:Transaction Summary 2026-02-13T20:10:23.986 INFO:teuthology.orchestra.run.trial110.stdout:================================================================================ 2026-02-13T20:10:23.987 INFO:teuthology.orchestra.run.trial110.stdout:Install 13 Packages 2026-02-13T20:10:23.987 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:23.987 INFO:teuthology.orchestra.run.trial110.stdout:Total download size: 55 M 2026-02-13T20:10:23.987 INFO:teuthology.orchestra.run.trial110.stdout:Installed size: 262 M 2026-02-13T20:10:23.988 INFO:teuthology.orchestra.run.trial110.stdout:Downloading Packages: 2026-02-13T20:10:23.995 INFO:teuthology.orchestra.run.trial188.stdout:Last metadata expiration check: 0:00:43 ago on Fri 13 Feb 2026 08:09:40 PM UTC. 2026-02-13T20:10:24.060 INFO:teuthology.orchestra.run.trial188.stdout:Package ceph-base-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-13T20:10:24.077 INFO:teuthology.orchestra.run.trial188.stdout:Dependencies resolved. 2026-02-13T20:10:24.078 INFO:teuthology.orchestra.run.trial188.stdout:Nothing to do. 2026-02-13T20:10:24.078 INFO:teuthology.orchestra.run.trial188.stdout:Complete! 2026-02-13T20:10:24.098 DEBUG:teuthology.orchestra.run.trial188:> sudo yum -y install cephadm 2026-02-13T20:10:24.393 INFO:teuthology.orchestra.run.trial188.stdout:Last metadata expiration check: 0:00:44 ago on Fri 13 Feb 2026 08:09:40 PM UTC. 2026-02-13T20:10:24.476 INFO:teuthology.orchestra.run.trial188.stdout:Dependencies resolved. 2026-02-13T20:10:24.477 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-13T20:10:24.477 INFO:teuthology.orchestra.run.trial188.stdout: Package Arch Version Repository Size 2026-02-13T20:10:24.477 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-13T20:10:24.477 INFO:teuthology.orchestra.run.trial188.stdout:Installing: 2026-02-13T20:10:24.477 INFO:teuthology.orchestra.run.trial188.stdout: cephadm noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 1.0 M 2026-02-13T20:10:24.477 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:24.477 INFO:teuthology.orchestra.run.trial188.stdout:Transaction Summary 2026-02-13T20:10:24.477 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-13T20:10:24.477 INFO:teuthology.orchestra.run.trial188.stdout:Install 1 Package 2026-02-13T20:10:24.477 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:24.478 INFO:teuthology.orchestra.run.trial188.stdout:Total download size: 1.0 M 2026-02-13T20:10:24.478 INFO:teuthology.orchestra.run.trial188.stdout:Installed size: 1.0 M 2026-02-13T20:10:24.478 INFO:teuthology.orchestra.run.trial188.stdout:Downloading Packages: 2026-02-13T20:10:24.569 INFO:teuthology.orchestra.run.trial110.stdout:(1/13): ceph-prometheus-alerts-20.3.0-5230.gafe 63 kB/s | 17 kB 00:00 2026-02-13T20:10:24.611 INFO:teuthology.orchestra.run.trial110.stdout:(2/13): ceph-grafana-dashboards-20.3.0-5230.gaf 181 kB/s | 57 kB 00:00 2026-02-13T20:10:24.632 INFO:teuthology.orchestra.run.trial110.stdout:(3/13): python3-jmespath-1.0.1-1.el9.noarch.rpm 748 kB/s | 48 kB 00:00 2026-02-13T20:10:24.647 INFO:teuthology.orchestra.run.trial110.stdout:(4/13): python3-protobuf-3.14.0-17.el9.noarch.r 7.2 MB/s | 267 kB 00:00 2026-02-13T20:10:25.486 INFO:teuthology.orchestra.run.trial188.stdout:cephadm-20.3.0-5230.gafefaa40.el9.noarch.rpm 1.0 MB/s | 1.0 MB 00:01 2026-02-13T20:10:25.486 INFO:teuthology.orchestra.run.trial188.stdout:-------------------------------------------------------------------------------- 2026-02-13T20:10:25.486 INFO:teuthology.orchestra.run.trial188.stdout:Total 1.0 MB/s | 1.0 MB 00:01 2026-02-13T20:10:25.486 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction check 2026-02-13T20:10:25.489 INFO:teuthology.orchestra.run.trial188.stdout:Transaction check succeeded. 2026-02-13T20:10:25.489 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction test 2026-02-13T20:10:25.494 INFO:teuthology.orchestra.run.trial188.stdout:Transaction test succeeded. 2026-02-13T20:10:25.494 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction 2026-02-13T20:10:25.512 INFO:teuthology.orchestra.run.trial188.stdout: Preparing : 1/1 2026-02-13T20:10:25.572 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 1/1 2026-02-13T20:10:25.586 INFO:teuthology.orchestra.run.trial188.stdout: Installing : cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 1/1 2026-02-13T20:10:25.627 INFO:teuthology.orchestra.run.trial110.stdout:[MIRROR] abseil-cpp-20211102.0-4.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for https://ftp-osl.osuosl.org/pub/fedora-epel/9/Everything/x86_64/Packages/a/abseil-cpp-20211102.0-4.el9.x86_64.rpm [Failed to connect to ftp-osl.osuosl.org port 443: No route to host] 2026-02-13T20:10:25.646 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 1/1 2026-02-13T20:10:25.700 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 1/1 2026-02-13T20:10:25.700 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:25.700 INFO:teuthology.orchestra.run.trial188.stdout:Installed: 2026-02-13T20:10:25.700 INFO:teuthology.orchestra.run.trial188.stdout: cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-13T20:10:25.700 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:25.700 INFO:teuthology.orchestra.run.trial188.stdout:Complete! 2026-02-13T20:10:25.727 DEBUG:teuthology.orchestra.run.trial188:> sudo yum -y install ceph-immutable-object-cache 2026-02-13T20:10:25.860 INFO:teuthology.orchestra.run.trial110.stdout:(5/13): protobuf-compiler-3.14.0-17.el9.x86_64. 702 kB/s | 862 kB 00:01 2026-02-13T20:10:26.026 INFO:teuthology.orchestra.run.trial188.stdout:Last metadata expiration check: 0:00:46 ago on Fri 13 Feb 2026 08:09:40 PM UTC. 2026-02-13T20:10:26.109 INFO:teuthology.orchestra.run.trial188.stdout:Dependencies resolved. 2026-02-13T20:10:26.110 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-13T20:10:26.110 INFO:teuthology.orchestra.run.trial188.stdout: Package Arch Version Repo Size 2026-02-13T20:10:26.110 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-13T20:10:26.110 INFO:teuthology.orchestra.run.trial188.stdout:Installing: 2026-02-13T20:10:26.110 INFO:teuthology.orchestra.run.trial188.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 147 k 2026-02-13T20:10:26.110 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:26.111 INFO:teuthology.orchestra.run.trial188.stdout:Transaction Summary 2026-02-13T20:10:26.111 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-13T20:10:26.111 INFO:teuthology.orchestra.run.trial188.stdout:Install 1 Package 2026-02-13T20:10:26.111 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:26.111 INFO:teuthology.orchestra.run.trial188.stdout:Total download size: 147 k 2026-02-13T20:10:26.111 INFO:teuthology.orchestra.run.trial188.stdout:Installed size: 419 k 2026-02-13T20:10:26.111 INFO:teuthology.orchestra.run.trial188.stdout:Downloading Packages: 2026-02-13T20:10:26.567 INFO:teuthology.orchestra.run.trial188.stdout:ceph-immutable-object-cache-20.3.0-5230.gafefaa 322 kB/s | 147 kB 00:00 2026-02-13T20:10:26.567 INFO:teuthology.orchestra.run.trial188.stdout:-------------------------------------------------------------------------------- 2026-02-13T20:10:26.567 INFO:teuthology.orchestra.run.trial188.stdout:Total 322 kB/s | 147 kB 00:00 2026-02-13T20:10:26.567 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction check 2026-02-13T20:10:26.572 INFO:teuthology.orchestra.run.trial188.stdout:Transaction check succeeded. 2026-02-13T20:10:26.572 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction test 2026-02-13T20:10:26.598 INFO:teuthology.orchestra.run.trial188.stdout:Transaction test succeeded. 2026-02-13T20:10:26.599 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction 2026-02-13T20:10:26.647 INFO:teuthology.orchestra.run.trial188.stdout: Preparing : 1/1 2026-02-13T20:10:26.649 INFO:teuthology.orchestra.run.trial188.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5230.gafefaa40. 1/1 2026-02-13T20:10:26.670 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5230.gafefaa40. 1/1 2026-02-13T20:10:26.670 INFO:teuthology.orchestra.run.trial188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T20:10:26.670 INFO:teuthology.orchestra.run.trial188.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-13T20:10:26.670 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:26.974 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5230.gafefaa40. 1/1 2026-02-13T20:10:26.975 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:26.975 INFO:teuthology.orchestra.run.trial188.stdout:Installed: 2026-02-13T20:10:26.975 INFO:teuthology.orchestra.run.trial188.stdout: ceph-immutable-object-cache-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:10:26.975 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:26.975 INFO:teuthology.orchestra.run.trial188.stdout:Complete! 2026-02-13T20:10:27.003 DEBUG:teuthology.orchestra.run.trial188:> sudo yum -y install ceph-mgr 2026-02-13T20:10:27.304 INFO:teuthology.orchestra.run.trial188.stdout:Last metadata expiration check: 0:00:47 ago on Fri 13 Feb 2026 08:09:40 PM UTC. 2026-02-13T20:10:27.369 INFO:teuthology.orchestra.run.trial188.stdout:Package ceph-mgr-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-13T20:10:27.387 INFO:teuthology.orchestra.run.trial188.stdout:Dependencies resolved. 2026-02-13T20:10:27.387 INFO:teuthology.orchestra.run.trial188.stdout:Nothing to do. 2026-02-13T20:10:27.387 INFO:teuthology.orchestra.run.trial188.stdout:Complete! 2026-02-13T20:10:27.409 DEBUG:teuthology.orchestra.run.trial188:> sudo yum -y install ceph-mgr-dashboard 2026-02-13T20:10:27.708 INFO:teuthology.orchestra.run.trial188.stdout:Last metadata expiration check: 0:00:47 ago on Fri 13 Feb 2026 08:09:40 PM UTC. 2026-02-13T20:10:27.791 INFO:teuthology.orchestra.run.trial188.stdout:Dependencies resolved. 2026-02-13T20:10:27.791 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-13T20:10:27.791 INFO:teuthology.orchestra.run.trial188.stdout: Package Arch Version Repository Size 2026-02-13T20:10:27.791 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-13T20:10:27.791 INFO:teuthology.orchestra.run.trial188.stdout:Installing: 2026-02-13T20:10:27.791 INFO:teuthology.orchestra.run.trial188.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 51 M 2026-02-13T20:10:27.791 INFO:teuthology.orchestra.run.trial188.stdout:Installing dependencies: 2026-02-13T20:10:27.791 INFO:teuthology.orchestra.run.trial188.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-13T20:10:27.792 INFO:teuthology.orchestra.run.trial188.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 57 k 2026-02-13T20:10:27.792 INFO:teuthology.orchestra.run.trial188.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 17 k 2026-02-13T20:10:27.792 INFO:teuthology.orchestra.run.trial188.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-13T20:10:27.792 INFO:teuthology.orchestra.run.trial188.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-13T20:10:27.792 INFO:teuthology.orchestra.run.trial188.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-13T20:10:27.792 INFO:teuthology.orchestra.run.trial188.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-13T20:10:27.792 INFO:teuthology.orchestra.run.trial188.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-13T20:10:27.792 INFO:teuthology.orchestra.run.trial188.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-13T20:10:27.792 INFO:teuthology.orchestra.run.trial188.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-13T20:10:27.792 INFO:teuthology.orchestra.run.trial188.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-13T20:10:27.792 INFO:teuthology.orchestra.run.trial188.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-13T20:10:27.792 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:27.792 INFO:teuthology.orchestra.run.trial188.stdout:Transaction Summary 2026-02-13T20:10:27.792 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-13T20:10:27.792 INFO:teuthology.orchestra.run.trial188.stdout:Install 13 Packages 2026-02-13T20:10:27.792 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:27.792 INFO:teuthology.orchestra.run.trial188.stdout:Total download size: 55 M 2026-02-13T20:10:27.792 INFO:teuthology.orchestra.run.trial188.stdout:Installed size: 262 M 2026-02-13T20:10:27.792 INFO:teuthology.orchestra.run.trial188.stdout:Downloading Packages: 2026-02-13T20:10:28.307 INFO:teuthology.orchestra.run.trial188.stdout:(1/13): ceph-prometheus-alerts-20.3.0-5230.gafe 56 kB/s | 17 kB 00:00 2026-02-13T20:10:28.331 INFO:teuthology.orchestra.run.trial188.stdout:(2/13): python3-jmespath-1.0.1-1.el9.noarch.rpm 1.9 MB/s | 48 kB 00:00 2026-02-13T20:10:28.344 INFO:teuthology.orchestra.run.trial188.stdout:(3/13): python3-protobuf-3.14.0-17.el9.noarch.r 21 MB/s | 267 kB 00:00 2026-02-13T20:10:28.355 INFO:teuthology.orchestra.run.trial188.stdout:(4/13): ceph-grafana-dashboards-20.3.0-5230.gaf 159 kB/s | 57 kB 00:00 2026-02-13T20:10:28.393 INFO:teuthology.orchestra.run.trial188.stdout:(5/13): abseil-cpp-20211102.0-4.el9.x86_64.rpm 14 MB/s | 551 kB 00:00 2026-02-13T20:10:28.398 INFO:teuthology.orchestra.run.trial188.stdout:(6/13): grpc-data-1.46.7-10.el9.noarch.rpm 3.5 MB/s | 19 kB 00:00 2026-02-13T20:10:28.418 INFO:teuthology.orchestra.run.trial188.stdout:(7/13): python3-grpcio-1.46.7-10.el9.x86_64.rpm 105 MB/s | 2.0 MB 00:00 2026-02-13T20:10:28.426 INFO:teuthology.orchestra.run.trial188.stdout:(8/13): python3-grpcio-tools-1.46.7-10.el9.x86_ 19 MB/s | 144 kB 00:00 2026-02-13T20:10:28.431 INFO:teuthology.orchestra.run.trial188.stdout:(9/13): python3-repoze-lru-0.7-16.el9.noarch.rp 5.8 MB/s | 31 kB 00:00 2026-02-13T20:10:28.439 INFO:teuthology.orchestra.run.trial188.stdout:(10/13): python3-routes-2.5.1-5.el9.noarch.rpm 22 MB/s | 188 kB 00:00 2026-02-13T20:10:28.470 INFO:teuthology.orchestra.run.trial188.stdout:(11/13): python3-xmltodict-0.12.0-15.el9.noarch 717 kB/s | 22 kB 00:00 2026-02-13T20:10:28.699 INFO:teuthology.orchestra.run.trial188.stdout:[MIRROR] protobuf-compiler-3.14.0-17.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/CRB/x86_64/os/Packages/protobuf-compiler-3.14.0-17.el9.x86_64.rpm [Failed to connect to ftp-osl.osuosl.org port 80: No route to host] 2026-02-13T20:10:28.700 INFO:teuthology.orchestra.run.trial110.stdout:[MIRROR] abseil-cpp-20211102.0-4.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for http://ftp-osl.osuosl.org/pub/fedora-epel/9/Everything/x86_64/Packages/a/abseil-cpp-20211102.0-4.el9.x86_64.rpm [Failed to connect to ftp-osl.osuosl.org port 80: No route to host] 2026-02-13T20:10:28.700 INFO:teuthology.orchestra.run.trial110.stdout:[MIRROR] grpc-data-1.46.7-10.el9.noarch.rpm: Curl error (7): Couldn't connect to server for https://ftp-osl.osuosl.org/pub/fedora-epel/9/Everything/x86_64/Packages/g/grpc-data-1.46.7-10.el9.noarch.rpm [Failed to connect to ftp-osl.osuosl.org port 443: No route to host] 2026-02-13T20:10:28.987 INFO:teuthology.orchestra.run.trial110.stdout:(6/13): abseil-cpp-20211102.0-4.el9.x86_64.rpm 127 kB/s | 551 kB 00:04 2026-02-13T20:10:31.771 INFO:teuthology.orchestra.run.trial188.stdout:[MIRROR] protobuf-compiler-3.14.0-17.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/CRB/x86_64/os/Packages/protobuf-compiler-3.14.0-17.el9.x86_64.rpm [Failed to connect to ftp-osl.osuosl.org port 443: No route to host] 2026-02-13T20:10:31.772 INFO:teuthology.orchestra.run.trial110.stdout:[MIRROR] grpc-data-1.46.7-10.el9.noarch.rpm: Curl error (7): Couldn't connect to server for http://ftp-osl.osuosl.org/pub/fedora-epel/9/Everything/x86_64/Packages/g/grpc-data-1.46.7-10.el9.noarch.rpm [Failed to connect to ftp-osl.osuosl.org port 80: No route to host] 2026-02-13T20:10:31.772 INFO:teuthology.orchestra.run.trial110.stdout:[MIRROR] python3-grpcio-1.46.7-10.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for https://ftp-osl.osuosl.org/pub/fedora-epel/9/Everything/x86_64/Packages/p/python3-grpcio-1.46.7-10.el9.x86_64.rpm [Failed to connect to ftp-osl.osuosl.org port 443: No route to host] 2026-02-13T20:10:31.852 INFO:teuthology.orchestra.run.trial110.stdout:(7/13): grpc-data-1.46.7-10.el9.noarch.rpm 3.2 kB/s | 19 kB 00:05 2026-02-13T20:10:32.686 INFO:teuthology.orchestra.run.trial188.stdout:(12/13): protobuf-compiler-3.14.0-17.el9.x86_64 199 kB/s | 862 kB 00:04 2026-02-13T20:10:33.719 INFO:teuthology.orchestra.run.trial110.stdout:(8/13): ceph-mgr-dashboard-20.3.0-5230.gafefaa4 5.4 MB/s | 51 MB 00:09 2026-02-13T20:10:33.844 INFO:teuthology.orchestra.run.trial188.stdout:(13/13): ceph-mgr-dashboard-20.3.0-5230.gafefaa 8.7 MB/s | 51 MB 00:05 2026-02-13T20:10:33.845 INFO:teuthology.orchestra.run.trial188.stdout:-------------------------------------------------------------------------------- 2026-02-13T20:10:33.845 INFO:teuthology.orchestra.run.trial188.stdout:Total 9.1 MB/s | 55 MB 00:06 2026-02-13T20:10:33.873 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction check 2026-02-13T20:10:33.883 INFO:teuthology.orchestra.run.trial188.stdout:Transaction check succeeded. 2026-02-13T20:10:33.884 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction test 2026-02-13T20:10:34.095 INFO:teuthology.orchestra.run.trial188.stdout:Transaction test succeeded. 2026-02-13T20:10:34.095 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction 2026-02-13T20:10:34.322 INFO:teuthology.orchestra.run.trial188.stdout: Preparing : 1/1 2026-02-13T20:10:34.327 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 1/13 2026-02-13T20:10:34.338 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 2/13 2026-02-13T20:10:34.340 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 3/13 2026-02-13T20:10:34.368 INFO:teuthology.orchestra.run.trial188.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 4/13 2026-02-13T20:10:34.411 INFO:teuthology.orchestra.run.trial188.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 5/13 2026-02-13T20:10:34.420 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 6/13 2026-02-13T20:10:34.448 INFO:teuthology.orchestra.run.trial188.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 7/13 2026-02-13T20:10:34.458 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 8/13 2026-02-13T20:10:34.465 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/13 2026-02-13T20:10:34.468 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 10/13 2026-02-13T20:10:34.477 INFO:teuthology.orchestra.run.trial188.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5230.gafefaa40.el9 11/13 2026-02-13T20:10:34.920 INFO:teuthology.orchestra.run.trial110.stdout:[MIRROR] python3-grpcio-1.46.7-10.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for http://ftp-osl.osuosl.org/pub/fedora-epel/9/Everything/x86_64/Packages/p/python3-grpcio-1.46.7-10.el9.x86_64.rpm [Failed to connect to ftp-osl.osuosl.org port 80: No route to host] 2026-02-13T20:10:34.920 INFO:teuthology.orchestra.run.trial110.stdout:[MIRROR] python3-grpcio-tools-1.46.7-10.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for http://ftp-osl.osuosl.org/pub/fedora-epel/9/Everything/x86_64/Packages/p/python3-grpcio-tools-1.46.7-10.el9.x86_64.rpm [Failed to connect to ftp-osl.osuosl.org port 80: No route to host] 2026-02-13T20:10:34.920 INFO:teuthology.orchestra.run.trial110.stdout:[MIRROR] python3-repoze-lru-0.7-16.el9.noarch.rpm: Curl error (7): Couldn't connect to server for http://ftp-osl.osuosl.org/pub/fedora-epel/9/Everything/x86_64/Packages/p/python3-repoze-lru-0.7-16.el9.noarch.rpm [Failed to connect to ftp-osl.osuosl.org port 80: No route to host] 2026-02-13T20:10:35.246 INFO:teuthology.orchestra.run.trial110.stdout:(9/13): python3-grpcio-1.46.7-10.el9.x86_64.rpm 333 kB/s | 2.0 MB 00:06 2026-02-13T20:10:35.289 INFO:teuthology.orchestra.run.trial110.stdout:(10/13): python3-routes-2.5.1-5.el9.noarch.rpm 4.3 MB/s | 188 kB 00:00 2026-02-13T20:10:35.337 INFO:teuthology.orchestra.run.trial110.stdout:(11/13): python3-xmltodict-0.12.0-15.el9.noarch 460 kB/s | 22 kB 00:00 2026-02-13T20:10:37.382 INFO:teuthology.orchestra.run.trial188.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5230.gafefaa40.el 12/13 2026-02-13T20:10:37.389 INFO:teuthology.orchestra.run.trial188.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5230.gafefaa40.el9.noa 13/13 2026-02-13T20:10:37.660 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5230.gafefaa40.el9.noa 13/13 2026-02-13T20:10:37.660 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5230.gafefaa40.el 1/13 2026-02-13T20:10:37.660 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5230.gafefaa40.el9.noa 2/13 2026-02-13T20:10:37.660 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5230.gafefaa40.el9 3/13 2026-02-13T20:10:37.660 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 4/13 2026-02-13T20:10:37.660 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 5/13 2026-02-13T20:10:37.660 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 6/13 2026-02-13T20:10:37.661 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 7/13 2026-02-13T20:10:37.661 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/13 2026-02-13T20:10:37.661 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/13 2026-02-13T20:10:37.661 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/13 2026-02-13T20:10:37.661 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/13 2026-02-13T20:10:37.661 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/13 2026-02-13T20:10:37.715 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 13/13 2026-02-13T20:10:37.715 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:37.715 INFO:teuthology.orchestra.run.trial188.stdout:Installed: 2026-02-13T20:10:37.715 INFO:teuthology.orchestra.run.trial188.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-13T20:10:37.716 INFO:teuthology.orchestra.run.trial188.stdout: ceph-grafana-dashboards-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-13T20:10:37.716 INFO:teuthology.orchestra.run.trial188.stdout: ceph-mgr-dashboard-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-13T20:10:37.716 INFO:teuthology.orchestra.run.trial188.stdout: ceph-prometheus-alerts-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-13T20:10:37.716 INFO:teuthology.orchestra.run.trial188.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-13T20:10:37.716 INFO:teuthology.orchestra.run.trial188.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-13T20:10:37.716 INFO:teuthology.orchestra.run.trial188.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-13T20:10:37.716 INFO:teuthology.orchestra.run.trial188.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-13T20:10:37.716 INFO:teuthology.orchestra.run.trial188.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-13T20:10:37.716 INFO:teuthology.orchestra.run.trial188.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-13T20:10:37.716 INFO:teuthology.orchestra.run.trial188.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-13T20:10:37.716 INFO:teuthology.orchestra.run.trial188.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-13T20:10:37.716 INFO:teuthology.orchestra.run.trial188.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-13T20:10:37.717 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:37.717 INFO:teuthology.orchestra.run.trial188.stdout:Complete! 2026-02-13T20:10:37.751 DEBUG:teuthology.orchestra.run.trial188:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-13T20:10:37.915 INFO:teuthology.orchestra.run.trial110.stdout:[MIRROR] python3-repoze-lru-0.7-16.el9.noarch.rpm: Curl error (7): Couldn't connect to server for https://ftp-osl.osuosl.org/pub/fedora-epel/9/Everything/x86_64/Packages/p/python3-repoze-lru-0.7-16.el9.noarch.rpm [Failed to connect to ftp-osl.osuosl.org port 443: No route to host] 2026-02-13T20:10:37.915 INFO:teuthology.orchestra.run.trial110.stdout:[MIRROR] python3-grpcio-tools-1.46.7-10.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for https://ftp-osl.osuosl.org/pub/fedora-epel/9/Everything/x86_64/Packages/p/python3-grpcio-tools-1.46.7-10.el9.x86_64.rpm [Failed to connect to ftp-osl.osuosl.org port 443: No route to host] 2026-02-13T20:10:37.995 INFO:teuthology.orchestra.run.trial110.stdout:(12/13): python3-repoze-lru-0.7-16.el9.noarch.r 7.2 kB/s | 31 kB 00:04 2026-02-13T20:10:38.048 INFO:teuthology.orchestra.run.trial188.stdout:Last metadata expiration check: 0:00:58 ago on Fri 13 Feb 2026 08:09:40 PM UTC. 2026-02-13T20:10:38.116 INFO:teuthology.orchestra.run.trial110.stdout:(13/13): python3-grpcio-tools-1.46.7-10.el9.x86 23 kB/s | 144 kB 00:06 2026-02-13T20:10:38.121 INFO:teuthology.orchestra.run.trial110.stdout:-------------------------------------------------------------------------------- 2026-02-13T20:10:38.121 INFO:teuthology.orchestra.run.trial110.stdout:Total 3.9 MB/s | 55 MB 00:14 2026-02-13T20:10:38.131 INFO:teuthology.orchestra.run.trial188.stdout:Dependencies resolved. 2026-02-13T20:10:38.132 INFO:teuthology.orchestra.run.trial188.stdout:======================================================================================= 2026-02-13T20:10:38.132 INFO:teuthology.orchestra.run.trial188.stdout: Package Arch Version Repository Size 2026-02-13T20:10:38.132 INFO:teuthology.orchestra.run.trial188.stdout:======================================================================================= 2026-02-13T20:10:38.132 INFO:teuthology.orchestra.run.trial188.stdout:Installing: 2026-02-13T20:10:38.132 INFO:teuthology.orchestra.run.trial188.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 7.4 M 2026-02-13T20:10:38.132 INFO:teuthology.orchestra.run.trial188.stdout:Installing dependencies: 2026-02-13T20:10:38.132 INFO:teuthology.orchestra.run.trial188.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2026-02-13T20:10:38.133 INFO:teuthology.orchestra.run.trial188.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2026-02-13T20:10:38.133 INFO:teuthology.orchestra.run.trial188.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2026-02-13T20:10:38.133 INFO:teuthology.orchestra.run.trial188.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-13T20:10:38.133 INFO:teuthology.orchestra.run.trial188.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-13T20:10:38.133 INFO:teuthology.orchestra.run.trial188.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-13T20:10:38.133 INFO:teuthology.orchestra.run.trial188.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-13T20:10:38.133 INFO:teuthology.orchestra.run.trial188.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-13T20:10:38.133 INFO:teuthology.orchestra.run.trial188.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-13T20:10:38.133 INFO:teuthology.orchestra.run.trial188.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-13T20:10:38.133 INFO:teuthology.orchestra.run.trial188.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-13T20:10:38.133 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:38.134 INFO:teuthology.orchestra.run.trial188.stdout:Transaction Summary 2026-02-13T20:10:38.134 INFO:teuthology.orchestra.run.trial188.stdout:======================================================================================= 2026-02-13T20:10:38.134 INFO:teuthology.orchestra.run.trial188.stdout:Install 12 Packages 2026-02-13T20:10:38.134 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:38.135 INFO:teuthology.orchestra.run.trial188.stdout:Total download size: 43 M 2026-02-13T20:10:38.135 INFO:teuthology.orchestra.run.trial188.stdout:Installed size: 234 M 2026-02-13T20:10:38.135 INFO:teuthology.orchestra.run.trial188.stdout:Downloading Packages: 2026-02-13T20:10:38.147 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction check 2026-02-13T20:10:38.158 INFO:teuthology.orchestra.run.trial110.stdout:Transaction check succeeded. 2026-02-13T20:10:38.158 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction test 2026-02-13T20:10:38.369 INFO:teuthology.orchestra.run.trial110.stdout:Transaction test succeeded. 2026-02-13T20:10:38.370 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction 2026-02-13T20:10:38.597 INFO:teuthology.orchestra.run.trial110.stdout: Preparing : 1/1 2026-02-13T20:10:38.602 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 1/13 2026-02-13T20:10:38.614 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 2/13 2026-02-13T20:10:38.616 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 3/13 2026-02-13T20:10:38.644 INFO:teuthology.orchestra.run.trial110.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 4/13 2026-02-13T20:10:38.687 INFO:teuthology.orchestra.run.trial110.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 5/13 2026-02-13T20:10:38.697 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 6/13 2026-02-13T20:10:38.725 INFO:teuthology.orchestra.run.trial110.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 7/13 2026-02-13T20:10:38.735 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 8/13 2026-02-13T20:10:38.742 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/13 2026-02-13T20:10:38.745 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 10/13 2026-02-13T20:10:38.754 INFO:teuthology.orchestra.run.trial110.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5230.gafefaa40.el9 11/13 2026-02-13T20:10:38.806 INFO:teuthology.orchestra.run.trial188.stdout:(1/12): libquadmath-11.5.0-14.el9.x86_64.rpm 355 kB/s | 184 kB 00:00 2026-02-13T20:10:38.817 INFO:teuthology.orchestra.run.trial188.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 3.0 MB/s | 33 kB 00:00 2026-02-13T20:10:38.844 INFO:teuthology.orchestra.run.trial188.stdout:(3/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 111 MB/s | 3.0 MB 00:00 2026-02-13T20:10:38.848 INFO:teuthology.orchestra.run.trial188.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 4.3 MB/s | 18 kB 00:00 2026-02-13T20:10:38.853 INFO:teuthology.orchestra.run.trial188.stdout:(5/12): openblas-0.3.29-1.el9.x86_64.rpm 9.6 MB/s | 42 kB 00:00 2026-02-13T20:10:38.873 INFO:teuthology.orchestra.run.trial188.stdout:(6/12): openblas-openmp-0.3.29-1.el9.x86_64.rpm 266 MB/s | 5.3 MB 00:00 2026-02-13T20:10:38.880 INFO:teuthology.orchestra.run.trial188.stdout:(7/12): python3-devel-3.9.25-2.el9.x86_64.rpm 34 MB/s | 244 kB 00:00 2026-02-13T20:10:38.904 INFO:teuthology.orchestra.run.trial188.stdout:(8/12): python3-numpy-1.23.5-2.el9.x86_64.rpm 254 MB/s | 6.1 MB 00:00 2026-02-13T20:10:38.912 INFO:teuthology.orchestra.run.trial188.stdout:(9/12): python3-numpy-f2py-1.23.5-2.el9.x86_64. 57 MB/s | 442 kB 00:00 2026-02-13T20:10:38.976 INFO:teuthology.orchestra.run.trial188.stdout:(10/12): python3-scipy-1.9.3-2.el9.x86_64.rpm 302 MB/s | 19 MB 00:00 2026-02-13T20:10:38.977 INFO:teuthology.orchestra.run.trial188.stdout:(11/12): libgfortran-11.5.0-14.el9.x86_64.rpm 1.1 MB/s | 794 kB 00:00 2026-02-13T20:10:39.012 INFO:teuthology.orchestra.run.trial188.stdout:(12/12): ceph-mgr-diskprediction-local-20.3.0-5 10 MB/s | 7.4 MB 00:00 2026-02-13T20:10:39.013 INFO:teuthology.orchestra.run.trial188.stdout:-------------------------------------------------------------------------------- 2026-02-13T20:10:39.013 INFO:teuthology.orchestra.run.trial188.stdout:Total 49 MB/s | 43 MB 00:00 2026-02-13T20:10:39.171 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction check 2026-02-13T20:10:39.185 INFO:teuthology.orchestra.run.trial188.stdout:Transaction check succeeded. 2026-02-13T20:10:39.185 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction test 2026-02-13T20:10:39.389 INFO:teuthology.orchestra.run.trial188.stdout:Transaction test succeeded. 2026-02-13T20:10:39.389 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction 2026-02-13T20:10:39.606 INFO:teuthology.orchestra.run.trial188.stdout: Preparing : 1/1 2026-02-13T20:10:39.609 INFO:teuthology.orchestra.run.trial188.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2026-02-13T20:10:39.615 INFO:teuthology.orchestra.run.trial188.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 2/12 2026-02-13T20:10:39.650 INFO:teuthology.orchestra.run.trial188.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 3/12 2026-02-13T20:10:39.654 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 4/12 2026-02-13T20:10:39.714 INFO:teuthology.orchestra.run.trial188.stdout: Installing : openblas-0.3.29-1.el9.x86_64 5/12 2026-02-13T20:10:39.716 INFO:teuthology.orchestra.run.trial188.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 6/12 2026-02-13T20:10:39.737 INFO:teuthology.orchestra.run.trial188.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2026-02-13T20:10:40.064 INFO:teuthology.orchestra.run.trial188.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2026-02-13T20:10:40.137 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 9/12 2026-02-13T20:10:40.813 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 10/12 2026-02-13T20:10:41.273 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 11/12 2026-02-13T20:10:41.274 INFO:teuthology.orchestra.run.trial188.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5230.gafefa 12/12 2026-02-13T20:10:41.584 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5230.gafefa 12/12 2026-02-13T20:10:41.584 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5230.gafefa 1/12 2026-02-13T20:10:41.584 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 2/12 2026-02-13T20:10:41.584 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 3/12 2026-02-13T20:10:41.584 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2026-02-13T20:10:41.584 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2026-02-13T20:10:41.585 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2026-02-13T20:10:41.585 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 7/12 2026-02-13T20:10:41.585 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 8/12 2026-02-13T20:10:41.585 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 9/12 2026-02-13T20:10:41.585 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 10/12 2026-02-13T20:10:41.585 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 11/12 2026-02-13T20:10:41.627 INFO:teuthology.orchestra.run.trial110.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5230.gafefaa40.el 12/13 2026-02-13T20:10:41.634 INFO:teuthology.orchestra.run.trial110.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5230.gafefaa40.el9.noa 13/13 2026-02-13T20:10:41.647 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 12/12 2026-02-13T20:10:41.647 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:41.647 INFO:teuthology.orchestra.run.trial188.stdout:Installed: 2026-02-13T20:10:41.647 INFO:teuthology.orchestra.run.trial188.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-13T20:10:41.647 INFO:teuthology.orchestra.run.trial188.stdout: flexiblas-3.0.4-8.el9.x86_64 2026-02-13T20:10:41.647 INFO:teuthology.orchestra.run.trial188.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2026-02-13T20:10:41.648 INFO:teuthology.orchestra.run.trial188.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2026-02-13T20:10:41.648 INFO:teuthology.orchestra.run.trial188.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-13T20:10:41.648 INFO:teuthology.orchestra.run.trial188.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-13T20:10:41.648 INFO:teuthology.orchestra.run.trial188.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-13T20:10:41.648 INFO:teuthology.orchestra.run.trial188.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-13T20:10:41.648 INFO:teuthology.orchestra.run.trial188.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-13T20:10:41.648 INFO:teuthology.orchestra.run.trial188.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-13T20:10:41.648 INFO:teuthology.orchestra.run.trial188.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-13T20:10:41.648 INFO:teuthology.orchestra.run.trial188.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-13T20:10:41.648 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:41.648 INFO:teuthology.orchestra.run.trial188.stdout:Complete! 2026-02-13T20:10:41.685 DEBUG:teuthology.orchestra.run.trial188:> sudo yum -y install ceph-mgr-rook 2026-02-13T20:10:41.909 INFO:teuthology.orchestra.run.trial110.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5230.gafefaa40.el9.noa 13/13 2026-02-13T20:10:41.909 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5230.gafefaa40.el 1/13 2026-02-13T20:10:41.909 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5230.gafefaa40.el9.noa 2/13 2026-02-13T20:10:41.909 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5230.gafefaa40.el9 3/13 2026-02-13T20:10:41.909 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 4/13 2026-02-13T20:10:41.909 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 5/13 2026-02-13T20:10:41.910 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 6/13 2026-02-13T20:10:41.910 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 7/13 2026-02-13T20:10:41.910 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/13 2026-02-13T20:10:41.910 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/13 2026-02-13T20:10:41.910 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/13 2026-02-13T20:10:41.910 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/13 2026-02-13T20:10:41.910 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/13 2026-02-13T20:10:41.965 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 13/13 2026-02-13T20:10:41.965 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:41.965 INFO:teuthology.orchestra.run.trial110.stdout:Installed: 2026-02-13T20:10:41.965 INFO:teuthology.orchestra.run.trial110.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-13T20:10:41.965 INFO:teuthology.orchestra.run.trial110.stdout: ceph-grafana-dashboards-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-13T20:10:41.965 INFO:teuthology.orchestra.run.trial110.stdout: ceph-mgr-dashboard-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-13T20:10:41.965 INFO:teuthology.orchestra.run.trial110.stdout: ceph-prometheus-alerts-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-13T20:10:41.966 INFO:teuthology.orchestra.run.trial110.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-13T20:10:41.966 INFO:teuthology.orchestra.run.trial110.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-13T20:10:41.966 INFO:teuthology.orchestra.run.trial110.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-13T20:10:41.966 INFO:teuthology.orchestra.run.trial110.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-13T20:10:41.966 INFO:teuthology.orchestra.run.trial110.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-13T20:10:41.966 INFO:teuthology.orchestra.run.trial110.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-13T20:10:41.966 INFO:teuthology.orchestra.run.trial110.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-13T20:10:41.966 INFO:teuthology.orchestra.run.trial110.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-13T20:10:41.966 INFO:teuthology.orchestra.run.trial110.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-13T20:10:41.966 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:41.966 INFO:teuthology.orchestra.run.trial110.stdout:Complete! 2026-02-13T20:10:41.986 INFO:teuthology.orchestra.run.trial188.stdout:Last metadata expiration check: 0:01:01 ago on Fri 13 Feb 2026 08:09:40 PM UTC. 2026-02-13T20:10:42.003 DEBUG:teuthology.orchestra.run.trial110:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-13T20:10:42.069 INFO:teuthology.orchestra.run.trial188.stdout:Dependencies resolved. 2026-02-13T20:10:42.069 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-13T20:10:42.069 INFO:teuthology.orchestra.run.trial188.stdout: Package Arch Version Repository Size 2026-02-13T20:10:42.070 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-13T20:10:42.070 INFO:teuthology.orchestra.run.trial188.stdout:Installing: 2026-02-13T20:10:42.070 INFO:teuthology.orchestra.run.trial188.stdout: ceph-mgr-rook noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 50 k 2026-02-13T20:10:42.070 INFO:teuthology.orchestra.run.trial188.stdout:Installing dependencies: 2026-02-13T20:10:42.070 INFO:teuthology.orchestra.run.trial188.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-13T20:10:42.070 INFO:teuthology.orchestra.run.trial188.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-13T20:10:42.070 INFO:teuthology.orchestra.run.trial188.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-13T20:10:42.070 INFO:teuthology.orchestra.run.trial188.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-13T20:10:42.070 INFO:teuthology.orchestra.run.trial188.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-13T20:10:42.071 INFO:teuthology.orchestra.run.trial188.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-13T20:10:42.071 INFO:teuthology.orchestra.run.trial188.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-13T20:10:42.071 INFO:teuthology.orchestra.run.trial188.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-13T20:10:42.071 INFO:teuthology.orchestra.run.trial188.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-13T20:10:42.071 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:42.071 INFO:teuthology.orchestra.run.trial188.stdout:Transaction Summary 2026-02-13T20:10:42.071 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-13T20:10:42.071 INFO:teuthology.orchestra.run.trial188.stdout:Install 10 Packages 2026-02-13T20:10:42.071 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:42.072 INFO:teuthology.orchestra.run.trial188.stdout:Total download size: 2.0 M 2026-02-13T20:10:42.072 INFO:teuthology.orchestra.run.trial188.stdout:Installed size: 25 M 2026-02-13T20:10:42.072 INFO:teuthology.orchestra.run.trial188.stdout:Downloading Packages: 2026-02-13T20:10:42.300 INFO:teuthology.orchestra.run.trial110.stdout:Last metadata expiration check: 0:00:59 ago on Fri 13 Feb 2026 08:09:43 PM UTC. 2026-02-13T20:10:42.334 INFO:teuthology.orchestra.run.trial188.stdout:(1/10): ceph-mgr-rook-20.3.0-5230.gafefaa40.el9 390 kB/s | 50 kB 00:00 2026-02-13T20:10:42.382 INFO:teuthology.orchestra.run.trial188.stdout:(2/10): python3-pyasn1-0.4.8-6.el9.noarch.rpm 898 kB/s | 159 kB 00:00 2026-02-13T20:10:42.383 INFO:teuthology.orchestra.run.trial110.stdout:Dependencies resolved. 2026-02-13T20:10:42.384 INFO:teuthology.orchestra.run.trial110.stdout:======================================================================================= 2026-02-13T20:10:42.384 INFO:teuthology.orchestra.run.trial110.stdout: Package Arch Version Repository Size 2026-02-13T20:10:42.384 INFO:teuthology.orchestra.run.trial110.stdout:======================================================================================= 2026-02-13T20:10:42.384 INFO:teuthology.orchestra.run.trial110.stdout:Installing: 2026-02-13T20:10:42.384 INFO:teuthology.orchestra.run.trial110.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 7.4 M 2026-02-13T20:10:42.384 INFO:teuthology.orchestra.run.trial110.stdout:Installing dependencies: 2026-02-13T20:10:42.385 INFO:teuthology.orchestra.run.trial110.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2026-02-13T20:10:42.385 INFO:teuthology.orchestra.run.trial110.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2026-02-13T20:10:42.385 INFO:teuthology.orchestra.run.trial110.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2026-02-13T20:10:42.385 INFO:teuthology.orchestra.run.trial110.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-13T20:10:42.385 INFO:teuthology.orchestra.run.trial110.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-13T20:10:42.385 INFO:teuthology.orchestra.run.trial110.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-13T20:10:42.385 INFO:teuthology.orchestra.run.trial110.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-13T20:10:42.385 INFO:teuthology.orchestra.run.trial110.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-13T20:10:42.385 INFO:teuthology.orchestra.run.trial110.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-13T20:10:42.385 INFO:teuthology.orchestra.run.trial110.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-13T20:10:42.385 INFO:teuthology.orchestra.run.trial110.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-13T20:10:42.385 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:42.386 INFO:teuthology.orchestra.run.trial110.stdout:Transaction Summary 2026-02-13T20:10:42.386 INFO:teuthology.orchestra.run.trial110.stdout:======================================================================================= 2026-02-13T20:10:42.386 INFO:teuthology.orchestra.run.trial110.stdout:Install 12 Packages 2026-02-13T20:10:42.386 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:42.386 INFO:teuthology.orchestra.run.trial110.stdout:Total download size: 43 M 2026-02-13T20:10:42.387 INFO:teuthology.orchestra.run.trial110.stdout:Installed size: 234 M 2026-02-13T20:10:42.387 INFO:teuthology.orchestra.run.trial110.stdout:Downloading Packages: 2026-02-13T20:10:42.401 INFO:teuthology.orchestra.run.trial188.stdout:(3/10): python3-pyasn1-modules-0.4.8-6.el9.noar 1.4 MB/s | 279 kB 00:00 2026-02-13T20:10:42.437 INFO:teuthology.orchestra.run.trial188.stdout:(4/10): python3-requests-oauthlib-1.3.0-12.el9. 524 kB/s | 54 kB 00:00 2026-02-13T20:10:42.493 INFO:teuthology.orchestra.run.trial188.stdout:(5/10): python3-cachetools-4.2.4-1.el9.noarch.r 291 kB/s | 32 kB 00:00 2026-02-13T20:10:42.503 INFO:teuthology.orchestra.run.trial188.stdout:(6/10): python3-certifi-2023.05.07-4.el9.noarch 139 kB/s | 14 kB 00:00 2026-02-13T20:10:42.567 INFO:teuthology.orchestra.run.trial188.stdout:(7/10): python3-google-auth-2.45.0-1.el9.noarch 1.9 MB/s | 254 kB 00:00 2026-02-13T20:10:42.620 INFO:teuthology.orchestra.run.trial188.stdout:(8/10): python3-kubernetes-26.1.0-3.el9.noarch. 8.0 MB/s | 1.0 MB 00:00 2026-02-13T20:10:42.620 INFO:teuthology.orchestra.run.trial188.stdout:(9/10): python3-rsa-4.9-2.el9.noarch.rpm 502 kB/s | 59 kB 00:00 2026-02-13T20:10:42.622 INFO:teuthology.orchestra.run.trial188.stdout:(10/10): python3-websocket-client-1.2.3-2.el9.n 1.6 MB/s | 90 kB 00:00 2026-02-13T20:10:42.624 INFO:teuthology.orchestra.run.trial188.stdout:-------------------------------------------------------------------------------- 2026-02-13T20:10:42.624 INFO:teuthology.orchestra.run.trial188.stdout:Total 3.6 MB/s | 2.0 MB 00:00 2026-02-13T20:10:42.649 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction check 2026-02-13T20:10:42.657 INFO:teuthology.orchestra.run.trial188.stdout:Transaction check succeeded. 2026-02-13T20:10:42.657 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction test 2026-02-13T20:10:42.695 INFO:teuthology.orchestra.run.trial188.stdout:Transaction test succeeded. 2026-02-13T20:10:42.696 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction 2026-02-13T20:10:42.769 INFO:teuthology.orchestra.run.trial188.stdout: Preparing : 1/1 2026-02-13T20:10:42.820 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/10 2026-02-13T20:10:42.832 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/10 2026-02-13T20:10:42.847 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/10 2026-02-13T20:10:42.851 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/10 2026-02-13T20:10:42.859 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/10 2026-02-13T20:10:42.898 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/10 2026-02-13T20:10:42.910 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-13T20:10:42.930 INFO:teuthology.orchestra.run.trial110.stdout:(1/12): libquadmath-11.5.0-14.el9.x86_64.rpm 1.2 MB/s | 184 kB 00:00 2026-02-13T20:10:42.980 INFO:teuthology.orchestra.run.trial110.stdout:(2/12): libgfortran-11.5.0-14.el9.x86_64.rpm 4.0 MB/s | 794 kB 00:00 2026-02-13T20:10:43.226 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 8/10 2026-02-13T20:10:43.241 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 9/10 2026-02-13T20:10:43.242 INFO:teuthology.orchestra.run.trial188.stdout: Installing : ceph-mgr-rook-2:20.3.0-5230.gafefaa40.el9.noarch 10/10 2026-02-13T20:10:43.277 INFO:teuthology.orchestra.run.trial110.stdout:(3/12): ceph-mgr-diskprediction-local-20.3.0-52 15 MB/s | 7.4 MB 00:00 2026-02-13T20:10:43.347 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5230.gafefaa40.el9.noarch 10/10 2026-02-13T20:10:43.347 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5230.gafefaa40.el9.noarch 1/10 2026-02-13T20:10:43.347 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 2/10 2026-02-13T20:10:43.348 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 3/10 2026-02-13T20:10:43.348 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 4/10 2026-02-13T20:10:43.348 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 5/10 2026-02-13T20:10:43.348 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 6/10 2026-02-13T20:10:43.348 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-13T20:10:43.348 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 8/10 2026-02-13T20:10:43.348 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 9/10 2026-02-13T20:10:43.403 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 10/10 2026-02-13T20:10:43.403 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:43.403 INFO:teuthology.orchestra.run.trial188.stdout:Installed: 2026-02-13T20:10:43.403 INFO:teuthology.orchestra.run.trial188.stdout: ceph-mgr-rook-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-13T20:10:43.403 INFO:teuthology.orchestra.run.trial188.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-13T20:10:43.403 INFO:teuthology.orchestra.run.trial188.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-13T20:10:43.403 INFO:teuthology.orchestra.run.trial188.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-13T20:10:43.403 INFO:teuthology.orchestra.run.trial188.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-13T20:10:43.403 INFO:teuthology.orchestra.run.trial188.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-13T20:10:43.403 INFO:teuthology.orchestra.run.trial188.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-13T20:10:43.403 INFO:teuthology.orchestra.run.trial188.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-13T20:10:43.403 INFO:teuthology.orchestra.run.trial188.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-13T20:10:43.403 INFO:teuthology.orchestra.run.trial188.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-13T20:10:43.403 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:43.403 INFO:teuthology.orchestra.run.trial188.stdout:Complete! 2026-02-13T20:10:43.433 DEBUG:teuthology.orchestra.run.trial188:> sudo yum -y install ceph-mgr-cephadm 2026-02-13T20:10:43.491 INFO:teuthology.orchestra.run.trial110.stdout:(4/12): flexiblas-3.0.4-8.el9.x86_64.rpm 58 kB/s | 33 kB 00:00 2026-02-13T20:10:43.731 INFO:teuthology.orchestra.run.trial188.stdout:Last metadata expiration check: 0:01:03 ago on Fri 13 Feb 2026 08:09:40 PM UTC. 2026-02-13T20:10:43.760 INFO:teuthology.orchestra.run.trial110.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 38 kB/s | 18 kB 00:00 2026-02-13T20:10:43.814 INFO:teuthology.orchestra.run.trial188.stdout:Dependencies resolved. 2026-02-13T20:10:43.814 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-13T20:10:43.814 INFO:teuthology.orchestra.run.trial188.stdout: Package Arch Version Repository Size 2026-02-13T20:10:43.814 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-13T20:10:43.814 INFO:teuthology.orchestra.run.trial188.stdout:Installing: 2026-02-13T20:10:43.815 INFO:teuthology.orchestra.run.trial188.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 184 k 2026-02-13T20:10:43.815 INFO:teuthology.orchestra.run.trial188.stdout:Installing dependencies: 2026-02-13T20:10:43.815 INFO:teuthology.orchestra.run.trial188.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-13T20:10:43.815 INFO:teuthology.orchestra.run.trial188.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-13T20:10:43.815 INFO:teuthology.orchestra.run.trial188.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-13T20:10:43.815 INFO:teuthology.orchestra.run.trial188.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-13T20:10:43.815 INFO:teuthology.orchestra.run.trial188.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-13T20:10:43.815 INFO:teuthology.orchestra.run.trial188.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-13T20:10:43.815 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:43.815 INFO:teuthology.orchestra.run.trial188.stdout:Transaction Summary 2026-02-13T20:10:43.815 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-13T20:10:43.815 INFO:teuthology.orchestra.run.trial188.stdout:Install 7 Packages 2026-02-13T20:10:43.816 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:43.816 INFO:teuthology.orchestra.run.trial188.stdout:Total download size: 7.1 M 2026-02-13T20:10:43.816 INFO:teuthology.orchestra.run.trial188.stdout:Installed size: 34 M 2026-02-13T20:10:43.816 INFO:teuthology.orchestra.run.trial188.stdout:Downloading Packages: 2026-02-13T20:10:44.018 INFO:teuthology.orchestra.run.trial110.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.9 MB/s | 3.0 MB 00:01 2026-02-13T20:10:44.068 INFO:teuthology.orchestra.run.trial110.stdout:(7/12): openblas-0.3.29-1.el9.x86_64.rpm 73 kB/s | 42 kB 00:00 2026-02-13T20:10:44.121 INFO:teuthology.orchestra.run.trial188.stdout:(1/7): ceph-mgr-cephadm-20.3.0-5230.gafefaa40.e 1.1 MB/s | 184 kB 00:00 2026-02-13T20:10:44.403 INFO:teuthology.orchestra.run.trial188.stdout:(2/7): python3-markupsafe-1.1.1-12.el9.x86_64.r 123 kB/s | 35 kB 00:00 2026-02-13T20:10:44.479 INFO:teuthology.orchestra.run.trial188.stdout:(3/7): python3-jinja2-2.11.3-8.el9.noarch.rpm 475 kB/s | 249 kB 00:00 2026-02-13T20:10:44.626 INFO:teuthology.orchestra.run.trial188.stdout:(4/7): python3-asyncssh-2.13.2-5.el9.noarch.rpm 2.4 MB/s | 548 kB 00:00 2026-02-13T20:10:44.646 INFO:teuthology.orchestra.run.trial188.stdout:(5/7): python3-natsort-7.1.1-5.el9.noarch.rpm 345 kB/s | 58 kB 00:00 2026-02-13T20:10:44.753 INFO:teuthology.orchestra.run.trial188.stdout:(6/7): python3-typing-extensions-4.15.0-1.el9.n 679 kB/s | 86 kB 00:00 2026-02-13T20:10:44.788 INFO:teuthology.orchestra.run.trial110.stdout:(8/12): python3-devel-3.9.25-2.el9.x86_64.rpm 318 kB/s | 244 kB 00:00 2026-02-13T20:10:44.856 INFO:teuthology.orchestra.run.trial188.stdout:(7/7): python3-babel-2.9.1-2.el9.noarch.rpm 6.6 MB/s | 6.0 MB 00:00 2026-02-13T20:10:44.857 INFO:teuthology.orchestra.run.trial188.stdout:-------------------------------------------------------------------------------- 2026-02-13T20:10:44.857 INFO:teuthology.orchestra.run.trial188.stdout:Total 6.8 MB/s | 7.1 MB 00:01 2026-02-13T20:10:44.870 INFO:teuthology.orchestra.run.trial110.stdout:(9/12): openblas-openmp-0.3.29-1.el9.x86_64.rpm 4.8 MB/s | 5.3 MB 00:01 2026-02-13T20:10:44.892 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction check 2026-02-13T20:10:44.898 INFO:teuthology.orchestra.run.trial188.stdout:Transaction check succeeded. 2026-02-13T20:10:44.898 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction test 2026-02-13T20:10:44.969 INFO:teuthology.orchestra.run.trial188.stdout:Transaction test succeeded. 2026-02-13T20:10:44.969 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction 2026-02-13T20:10:45.057 INFO:teuthology.orchestra.run.trial188.stdout: Preparing : 1/1 2026-02-13T20:10:45.106 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 1/7 2026-02-13T20:10:45.115 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/7 2026-02-13T20:10:45.121 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/7 2026-02-13T20:10:45.203 INFO:teuthology.orchestra.run.trial110.stdout:(10/12): python3-numpy-1.23.5-2.el9.x86_64.rpm 5.4 MB/s | 6.1 MB 00:01 2026-02-13T20:10:45.338 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-13T20:10:45.361 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 5/7 2026-02-13T20:10:45.385 INFO:teuthology.orchestra.run.trial188.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 6/7 2026-02-13T20:10:45.387 INFO:teuthology.orchestra.run.trial188.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 7/7 2026-02-13T20:10:45.491 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 7/7 2026-02-13T20:10:45.492 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 1/7 2026-02-13T20:10:45.492 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/7 2026-02-13T20:10:45.492 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 3/7 2026-02-13T20:10:45.492 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-13T20:10:45.492 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 5/7 2026-02-13T20:10:45.492 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 6/7 2026-02-13T20:10:45.548 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 7/7 2026-02-13T20:10:45.548 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:45.548 INFO:teuthology.orchestra.run.trial188.stdout:Installed: 2026-02-13T20:10:45.548 INFO:teuthology.orchestra.run.trial188.stdout: ceph-mgr-cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-13T20:10:45.548 INFO:teuthology.orchestra.run.trial188.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-13T20:10:45.548 INFO:teuthology.orchestra.run.trial188.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-13T20:10:45.549 INFO:teuthology.orchestra.run.trial188.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-13T20:10:45.549 INFO:teuthology.orchestra.run.trial188.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-13T20:10:45.549 INFO:teuthology.orchestra.run.trial188.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-13T20:10:45.549 INFO:teuthology.orchestra.run.trial188.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-13T20:10:45.549 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:45.549 INFO:teuthology.orchestra.run.trial188.stdout:Complete! 2026-02-13T20:10:45.578 DEBUG:teuthology.orchestra.run.trial188:> sudo yum -y install ceph-osd 2026-02-13T20:10:45.619 INFO:teuthology.orchestra.run.trial110.stdout:(11/12): python3-numpy-f2py-1.23.5-2.el9.x86_64 532 kB/s | 442 kB 00:00 2026-02-13T20:10:45.874 INFO:teuthology.orchestra.run.trial188.stdout:Last metadata expiration check: 0:01:05 ago on Fri 13 Feb 2026 08:09:40 PM UTC. 2026-02-13T20:10:45.940 INFO:teuthology.orchestra.run.trial188.stdout:Package ceph-osd-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-13T20:10:45.958 INFO:teuthology.orchestra.run.trial188.stdout:Dependencies resolved. 2026-02-13T20:10:45.958 INFO:teuthology.orchestra.run.trial188.stdout:Nothing to do. 2026-02-13T20:10:45.959 INFO:teuthology.orchestra.run.trial188.stdout:Complete! 2026-02-13T20:10:45.979 DEBUG:teuthology.orchestra.run.trial188:> sudo yum -y install ceph-osd-classic 2026-02-13T20:10:46.275 INFO:teuthology.orchestra.run.trial188.stdout:Last metadata expiration check: 0:01:06 ago on Fri 13 Feb 2026 08:09:40 PM UTC. 2026-02-13T20:10:46.285 INFO:teuthology.orchestra.run.trial110.stdout:(12/12): python3-scipy-1.9.3-2.el9.x86_64.rpm 14 MB/s | 19 MB 00:01 2026-02-13T20:10:46.285 INFO:teuthology.orchestra.run.trial110.stdout:-------------------------------------------------------------------------------- 2026-02-13T20:10:46.286 INFO:teuthology.orchestra.run.trial110.stdout:Total 11 MB/s | 43 MB 00:03 2026-02-13T20:10:46.341 INFO:teuthology.orchestra.run.trial188.stdout:Package ceph-osd-classic-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-13T20:10:46.359 INFO:teuthology.orchestra.run.trial188.stdout:Dependencies resolved. 2026-02-13T20:10:46.360 INFO:teuthology.orchestra.run.trial188.stdout:Nothing to do. 2026-02-13T20:10:46.360 INFO:teuthology.orchestra.run.trial188.stdout:Complete! 2026-02-13T20:10:46.382 DEBUG:teuthology.orchestra.run.trial188:> sudo yum -y install ceph-fuse 2026-02-13T20:10:46.453 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction check 2026-02-13T20:10:46.467 INFO:teuthology.orchestra.run.trial110.stdout:Transaction check succeeded. 2026-02-13T20:10:46.467 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction test 2026-02-13T20:10:46.670 INFO:teuthology.orchestra.run.trial110.stdout:Transaction test succeeded. 2026-02-13T20:10:46.671 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction 2026-02-13T20:10:46.678 INFO:teuthology.orchestra.run.trial188.stdout:Last metadata expiration check: 0:01:06 ago on Fri 13 Feb 2026 08:09:40 PM UTC. 2026-02-13T20:10:46.762 INFO:teuthology.orchestra.run.trial188.stdout:Dependencies resolved. 2026-02-13T20:10:46.763 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-13T20:10:46.763 INFO:teuthology.orchestra.run.trial188.stdout: Package Arch Version Repo Size 2026-02-13T20:10:46.763 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-13T20:10:46.763 INFO:teuthology.orchestra.run.trial188.stdout:Installing: 2026-02-13T20:10:46.763 INFO:teuthology.orchestra.run.trial188.stdout: ceph-fuse x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 987 k 2026-02-13T20:10:46.763 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:46.763 INFO:teuthology.orchestra.run.trial188.stdout:Transaction Summary 2026-02-13T20:10:46.764 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-13T20:10:46.764 INFO:teuthology.orchestra.run.trial188.stdout:Install 1 Package 2026-02-13T20:10:46.764 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:46.764 INFO:teuthology.orchestra.run.trial188.stdout:Total download size: 987 k 2026-02-13T20:10:46.764 INFO:teuthology.orchestra.run.trial188.stdout:Installed size: 2.9 M 2026-02-13T20:10:46.764 INFO:teuthology.orchestra.run.trial188.stdout:Downloading Packages: 2026-02-13T20:10:46.889 INFO:teuthology.orchestra.run.trial110.stdout: Preparing : 1/1 2026-02-13T20:10:46.891 INFO:teuthology.orchestra.run.trial110.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2026-02-13T20:10:46.898 INFO:teuthology.orchestra.run.trial110.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 2/12 2026-02-13T20:10:46.931 INFO:teuthology.orchestra.run.trial110.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 3/12 2026-02-13T20:10:46.936 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 4/12 2026-02-13T20:10:46.995 INFO:teuthology.orchestra.run.trial110.stdout: Installing : openblas-0.3.29-1.el9.x86_64 5/12 2026-02-13T20:10:46.997 INFO:teuthology.orchestra.run.trial110.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 6/12 2026-02-13T20:10:47.018 INFO:teuthology.orchestra.run.trial110.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2026-02-13T20:10:47.049 INFO:teuthology.orchestra.run.trial188.stdout:ceph-fuse-20.3.0-5230.gafefaa40.el9.x86_64.rpm 3.4 MB/s | 987 kB 00:00 2026-02-13T20:10:47.049 INFO:teuthology.orchestra.run.trial188.stdout:-------------------------------------------------------------------------------- 2026-02-13T20:10:47.050 INFO:teuthology.orchestra.run.trial188.stdout:Total 3.4 MB/s | 987 kB 00:00 2026-02-13T20:10:47.050 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction check 2026-02-13T20:10:47.055 INFO:teuthology.orchestra.run.trial188.stdout:Transaction check succeeded. 2026-02-13T20:10:47.055 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction test 2026-02-13T20:10:47.092 INFO:teuthology.orchestra.run.trial188.stdout:Transaction test succeeded. 2026-02-13T20:10:47.092 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction 2026-02-13T20:10:47.185 INFO:teuthology.orchestra.run.trial188.stdout: Preparing : 1/1 2026-02-13T20:10:47.202 INFO:teuthology.orchestra.run.trial188.stdout: Installing : ceph-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-13T20:10:47.341 INFO:teuthology.orchestra.run.trial110.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2026-02-13T20:10:47.413 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 9/12 2026-02-13T20:10:47.437 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: ceph-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-13T20:10:47.493 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : ceph-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-13T20:10:47.493 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:47.493 INFO:teuthology.orchestra.run.trial188.stdout:Installed: 2026-02-13T20:10:47.493 INFO:teuthology.orchestra.run.trial188.stdout: ceph-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:10:47.493 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:47.493 INFO:teuthology.orchestra.run.trial188.stdout:Complete! 2026-02-13T20:10:47.519 DEBUG:teuthology.orchestra.run.trial188:> sudo yum -y install ceph-volume 2026-02-13T20:10:47.824 INFO:teuthology.orchestra.run.trial188.stdout:Last metadata expiration check: 0:01:07 ago on Fri 13 Feb 2026 08:09:40 PM UTC. 2026-02-13T20:10:47.910 INFO:teuthology.orchestra.run.trial188.stdout:Dependencies resolved. 2026-02-13T20:10:47.910 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-13T20:10:47.910 INFO:teuthology.orchestra.run.trial188.stdout: Package Arch Version Repository Size 2026-02-13T20:10:47.910 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-13T20:10:47.911 INFO:teuthology.orchestra.run.trial188.stdout:Installing: 2026-02-13T20:10:47.911 INFO:teuthology.orchestra.run.trial188.stdout: ceph-volume noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 299 k 2026-02-13T20:10:47.911 INFO:teuthology.orchestra.run.trial188.stdout:Installing dependencies: 2026-02-13T20:10:47.911 INFO:teuthology.orchestra.run.trial188.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-13T20:10:47.911 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:47.911 INFO:teuthology.orchestra.run.trial188.stdout:Transaction Summary 2026-02-13T20:10:47.912 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-13T20:10:47.912 INFO:teuthology.orchestra.run.trial188.stdout:Install 2 Packages 2026-02-13T20:10:47.912 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:47.912 INFO:teuthology.orchestra.run.trial188.stdout:Total download size: 649 k 2026-02-13T20:10:47.912 INFO:teuthology.orchestra.run.trial188.stdout:Installed size: 2.2 M 2026-02-13T20:10:47.912 INFO:teuthology.orchestra.run.trial188.stdout:Downloading Packages: 2026-02-13T20:10:48.080 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 10/12 2026-02-13T20:10:48.403 INFO:teuthology.orchestra.run.trial188.stdout:(1/2): ceph-volume-20.3.0-5230.gafefaa40.el9.no 743 kB/s | 299 kB 00:00 2026-02-13T20:10:48.535 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 11/12 2026-02-13T20:10:48.535 INFO:teuthology.orchestra.run.trial110.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5230.gafefa 12/12 2026-02-13T20:10:48.558 INFO:teuthology.orchestra.run.trial188.stdout:(2/2): cryptsetup-2.8.1-2.el9.x86_64.rpm 628 kB/s | 350 kB 00:00 2026-02-13T20:10:48.559 INFO:teuthology.orchestra.run.trial188.stdout:-------------------------------------------------------------------------------- 2026-02-13T20:10:48.559 INFO:teuthology.orchestra.run.trial188.stdout:Total 1.0 MB/s | 649 kB 00:00 2026-02-13T20:10:48.567 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction check 2026-02-13T20:10:48.573 INFO:teuthology.orchestra.run.trial188.stdout:Transaction check succeeded. 2026-02-13T20:10:48.573 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction test 2026-02-13T20:10:48.616 INFO:teuthology.orchestra.run.trial188.stdout:Transaction test succeeded. 2026-02-13T20:10:48.616 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction 2026-02-13T20:10:48.695 INFO:teuthology.orchestra.run.trial188.stdout: Preparing : 1/1 2026-02-13T20:10:48.757 INFO:teuthology.orchestra.run.trial188.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 1/2 2026-02-13T20:10:48.758 INFO:teuthology.orchestra.run.trial188.stdout: Installing : ceph-volume-2:20.3.0-5230.gafefaa40.el9.noarch 2/2 2026-02-13T20:10:48.774 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: ceph-volume-2:20.3.0-5230.gafefaa40.el9.noarch 2/2 2026-02-13T20:10:48.774 INFO:teuthology.orchestra.run.trial188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T20:10:48.774 INFO:teuthology.orchestra.run.trial188.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-13T20:10:48.774 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:48.837 INFO:teuthology.orchestra.run.trial110.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5230.gafefa 12/12 2026-02-13T20:10:48.837 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5230.gafefa 1/12 2026-02-13T20:10:48.837 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 2/12 2026-02-13T20:10:48.837 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 3/12 2026-02-13T20:10:48.837 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2026-02-13T20:10:48.837 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2026-02-13T20:10:48.837 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2026-02-13T20:10:48.837 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 7/12 2026-02-13T20:10:48.838 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 8/12 2026-02-13T20:10:48.838 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 9/12 2026-02-13T20:10:48.838 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 10/12 2026-02-13T20:10:48.838 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 11/12 2026-02-13T20:10:48.894 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 12/12 2026-02-13T20:10:48.895 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:48.895 INFO:teuthology.orchestra.run.trial110.stdout:Installed: 2026-02-13T20:10:48.895 INFO:teuthology.orchestra.run.trial110.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-13T20:10:48.895 INFO:teuthology.orchestra.run.trial110.stdout: flexiblas-3.0.4-8.el9.x86_64 2026-02-13T20:10:48.895 INFO:teuthology.orchestra.run.trial110.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2026-02-13T20:10:48.895 INFO:teuthology.orchestra.run.trial110.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2026-02-13T20:10:48.895 INFO:teuthology.orchestra.run.trial110.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-13T20:10:48.895 INFO:teuthology.orchestra.run.trial110.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-13T20:10:48.895 INFO:teuthology.orchestra.run.trial110.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-13T20:10:48.896 INFO:teuthology.orchestra.run.trial110.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-13T20:10:48.896 INFO:teuthology.orchestra.run.trial110.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-13T20:10:48.896 INFO:teuthology.orchestra.run.trial110.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-13T20:10:48.896 INFO:teuthology.orchestra.run.trial110.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-13T20:10:48.896 INFO:teuthology.orchestra.run.trial110.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-13T20:10:48.896 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:48.896 INFO:teuthology.orchestra.run.trial110.stdout:Complete! 2026-02-13T20:10:48.934 DEBUG:teuthology.orchestra.run.trial110:> sudo yum -y install ceph-mgr-rook 2026-02-13T20:10:48.989 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : ceph-volume-2:20.3.0-5230.gafefaa40.el9.noarch 1/2 2026-02-13T20:10:49.047 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 2/2 2026-02-13T20:10:49.047 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:49.047 INFO:teuthology.orchestra.run.trial188.stdout:Installed: 2026-02-13T20:10:49.047 INFO:teuthology.orchestra.run.trial188.stdout: ceph-volume-2:20.3.0-5230.gafefaa40.el9.noarch cryptsetup-2.8.1-2.el9.x86_64 2026-02-13T20:10:49.048 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:49.048 INFO:teuthology.orchestra.run.trial188.stdout:Complete! 2026-02-13T20:10:49.076 DEBUG:teuthology.orchestra.run.trial188:> sudo yum -y install librados-devel 2026-02-13T20:10:49.233 INFO:teuthology.orchestra.run.trial110.stdout:Last metadata expiration check: 0:01:06 ago on Fri 13 Feb 2026 08:09:43 PM UTC. 2026-02-13T20:10:49.316 INFO:teuthology.orchestra.run.trial110.stdout:Dependencies resolved. 2026-02-13T20:10:49.317 INFO:teuthology.orchestra.run.trial110.stdout:================================================================================ 2026-02-13T20:10:49.317 INFO:teuthology.orchestra.run.trial110.stdout: Package Arch Version Repository Size 2026-02-13T20:10:49.317 INFO:teuthology.orchestra.run.trial110.stdout:================================================================================ 2026-02-13T20:10:49.317 INFO:teuthology.orchestra.run.trial110.stdout:Installing: 2026-02-13T20:10:49.317 INFO:teuthology.orchestra.run.trial110.stdout: ceph-mgr-rook noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 50 k 2026-02-13T20:10:49.317 INFO:teuthology.orchestra.run.trial110.stdout:Installing dependencies: 2026-02-13T20:10:49.317 INFO:teuthology.orchestra.run.trial110.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-13T20:10:49.317 INFO:teuthology.orchestra.run.trial110.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-13T20:10:49.317 INFO:teuthology.orchestra.run.trial110.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-13T20:10:49.317 INFO:teuthology.orchestra.run.trial110.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-13T20:10:49.317 INFO:teuthology.orchestra.run.trial110.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-13T20:10:49.317 INFO:teuthology.orchestra.run.trial110.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-13T20:10:49.317 INFO:teuthology.orchestra.run.trial110.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-13T20:10:49.317 INFO:teuthology.orchestra.run.trial110.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-13T20:10:49.317 INFO:teuthology.orchestra.run.trial110.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-13T20:10:49.317 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:49.317 INFO:teuthology.orchestra.run.trial110.stdout:Transaction Summary 2026-02-13T20:10:49.317 INFO:teuthology.orchestra.run.trial110.stdout:================================================================================ 2026-02-13T20:10:49.317 INFO:teuthology.orchestra.run.trial110.stdout:Install 10 Packages 2026-02-13T20:10:49.317 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:49.318 INFO:teuthology.orchestra.run.trial110.stdout:Total download size: 2.0 M 2026-02-13T20:10:49.318 INFO:teuthology.orchestra.run.trial110.stdout:Installed size: 25 M 2026-02-13T20:10:49.318 INFO:teuthology.orchestra.run.trial110.stdout:Downloading Packages: 2026-02-13T20:10:49.381 INFO:teuthology.orchestra.run.trial188.stdout:Last metadata expiration check: 0:01:09 ago on Fri 13 Feb 2026 08:09:40 PM UTC. 2026-02-13T20:10:49.466 INFO:teuthology.orchestra.run.trial188.stdout:Dependencies resolved. 2026-02-13T20:10:49.466 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-13T20:10:49.466 INFO:teuthology.orchestra.run.trial188.stdout: Package Arch Version Repo Size 2026-02-13T20:10:49.466 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-13T20:10:49.466 INFO:teuthology.orchestra.run.trial188.stdout:Installing: 2026-02-13T20:10:49.466 INFO:teuthology.orchestra.run.trial188.stdout: librados-devel x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 123 k 2026-02-13T20:10:49.466 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:49.467 INFO:teuthology.orchestra.run.trial188.stdout:Transaction Summary 2026-02-13T20:10:49.467 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-13T20:10:49.467 INFO:teuthology.orchestra.run.trial188.stdout:Install 1 Package 2026-02-13T20:10:49.467 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:49.467 INFO:teuthology.orchestra.run.trial188.stdout:Total download size: 123 k 2026-02-13T20:10:49.467 INFO:teuthology.orchestra.run.trial188.stdout:Installed size: 437 k 2026-02-13T20:10:49.467 INFO:teuthology.orchestra.run.trial188.stdout:Downloading Packages: 2026-02-13T20:10:49.632 INFO:teuthology.orchestra.run.trial188.stdout:librados-devel-20.3.0-5230.gafefaa40.el9.x86_64 741 kB/s | 123 kB 00:00 2026-02-13T20:10:49.633 INFO:teuthology.orchestra.run.trial188.stdout:-------------------------------------------------------------------------------- 2026-02-13T20:10:49.633 INFO:teuthology.orchestra.run.trial188.stdout:Total 736 kB/s | 123 kB 00:00 2026-02-13T20:10:49.634 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction check 2026-02-13T20:10:49.637 INFO:teuthology.orchestra.run.trial188.stdout:Transaction check succeeded. 2026-02-13T20:10:49.637 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction test 2026-02-13T20:10:49.669 INFO:teuthology.orchestra.run.trial188.stdout:Transaction test succeeded. 2026-02-13T20:10:49.670 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction 2026-02-13T20:10:49.676 INFO:teuthology.orchestra.run.trial110.stdout:(1/10): ceph-mgr-rook-20.3.0-5230.gafefaa40.el9 345 kB/s | 50 kB 00:00 2026-02-13T20:10:49.725 INFO:teuthology.orchestra.run.trial188.stdout: Preparing : 1/1 2026-02-13T20:10:49.741 INFO:teuthology.orchestra.run.trial188.stdout: Installing : librados-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-13T20:10:49.820 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: librados-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-13T20:10:49.876 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : librados-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-13T20:10:49.876 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:49.876 INFO:teuthology.orchestra.run.trial188.stdout:Installed: 2026-02-13T20:10:49.876 INFO:teuthology.orchestra.run.trial188.stdout: librados-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:10:49.876 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:49.876 INFO:teuthology.orchestra.run.trial188.stdout:Complete! 2026-02-13T20:10:49.905 DEBUG:teuthology.orchestra.run.trial188:> sudo yum -y install libcephfs2 2026-02-13T20:10:50.128 INFO:teuthology.orchestra.run.trial110.stdout:(2/10): python3-pyasn1-0.4.8-6.el9.noarch.rpm 265 kB/s | 159 kB 00:00 2026-02-13T20:10:50.174 INFO:teuthology.orchestra.run.trial110.stdout:(3/10): python3-requests-oauthlib-1.3.0-12.el9. 108 kB/s | 54 kB 00:00 2026-02-13T20:10:50.203 INFO:teuthology.orchestra.run.trial110.stdout:(4/10): python3-pyasn1-modules-0.4.8-6.el9.noar 415 kB/s | 279 kB 00:00 2026-02-13T20:10:50.205 INFO:teuthology.orchestra.run.trial188.stdout:Last metadata expiration check: 0:01:10 ago on Fri 13 Feb 2026 08:09:40 PM UTC. 2026-02-13T20:10:50.255 INFO:teuthology.orchestra.run.trial110.stdout:(5/10): python3-certifi-2023.05.07-4.el9.noarch 174 kB/s | 14 kB 00:00 2026-02-13T20:10:50.258 INFO:teuthology.orchestra.run.trial110.stdout:(6/10): python3-cachetools-4.2.4-1.el9.noarch.r 248 kB/s | 32 kB 00:00 2026-02-13T20:10:50.270 INFO:teuthology.orchestra.run.trial188.stdout:Package libcephfs2-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-13T20:10:50.289 INFO:teuthology.orchestra.run.trial188.stdout:Dependencies resolved. 2026-02-13T20:10:50.289 INFO:teuthology.orchestra.run.trial188.stdout:Nothing to do. 2026-02-13T20:10:50.289 INFO:teuthology.orchestra.run.trial188.stdout:Complete! 2026-02-13T20:10:50.311 DEBUG:teuthology.orchestra.run.trial188:> sudo yum -y install libcephfs-devel 2026-02-13T20:10:50.328 INFO:teuthology.orchestra.run.trial110.stdout:(7/10): python3-google-auth-2.45.0-1.el9.noarch 2.0 MB/s | 254 kB 00:00 2026-02-13T20:10:50.395 INFO:teuthology.orchestra.run.trial110.stdout:(8/10): python3-kubernetes-26.1.0-3.el9.noarch. 7.4 MB/s | 1.0 MB 00:00 2026-02-13T20:10:50.395 INFO:teuthology.orchestra.run.trial110.stdout:(9/10): python3-rsa-4.9-2.el9.noarch.rpm 433 kB/s | 59 kB 00:00 2026-02-13T20:10:50.395 INFO:teuthology.orchestra.run.trial110.stdout:(10/10): python3-websocket-client-1.2.3-2.el9.n 1.3 MB/s | 90 kB 00:00 2026-02-13T20:10:50.401 INFO:teuthology.orchestra.run.trial110.stdout:-------------------------------------------------------------------------------- 2026-02-13T20:10:50.401 INFO:teuthology.orchestra.run.trial110.stdout:Total 1.8 MB/s | 2.0 MB 00:01 2026-02-13T20:10:50.426 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction check 2026-02-13T20:10:50.434 INFO:teuthology.orchestra.run.trial110.stdout:Transaction check succeeded. 2026-02-13T20:10:50.434 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction test 2026-02-13T20:10:50.473 INFO:teuthology.orchestra.run.trial110.stdout:Transaction test succeeded. 2026-02-13T20:10:50.473 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction 2026-02-13T20:10:50.546 INFO:teuthology.orchestra.run.trial110.stdout: Preparing : 1/1 2026-02-13T20:10:50.597 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/10 2026-02-13T20:10:50.609 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/10 2026-02-13T20:10:50.618 INFO:teuthology.orchestra.run.trial188.stdout:Last metadata expiration check: 0:01:10 ago on Fri 13 Feb 2026 08:09:40 PM UTC. 2026-02-13T20:10:50.624 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/10 2026-02-13T20:10:50.628 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/10 2026-02-13T20:10:50.636 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/10 2026-02-13T20:10:50.675 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/10 2026-02-13T20:10:50.688 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-13T20:10:50.703 INFO:teuthology.orchestra.run.trial188.stdout:Dependencies resolved. 2026-02-13T20:10:50.703 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-13T20:10:50.703 INFO:teuthology.orchestra.run.trial188.stdout: Package Arch Version Repo Size 2026-02-13T20:10:50.703 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-13T20:10:50.703 INFO:teuthology.orchestra.run.trial188.stdout:Installing: 2026-02-13T20:10:50.703 INFO:teuthology.orchestra.run.trial188.stdout: libcephfs-devel x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 37 k 2026-02-13T20:10:50.703 INFO:teuthology.orchestra.run.trial188.stdout:Installing dependencies: 2026-02-13T20:10:50.703 INFO:teuthology.orchestra.run.trial188.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 25 k 2026-02-13T20:10:50.703 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:50.703 INFO:teuthology.orchestra.run.trial188.stdout:Transaction Summary 2026-02-13T20:10:50.704 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-13T20:10:50.704 INFO:teuthology.orchestra.run.trial188.stdout:Install 2 Packages 2026-02-13T20:10:50.704 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:50.704 INFO:teuthology.orchestra.run.trial188.stdout:Total download size: 62 k 2026-02-13T20:10:50.704 INFO:teuthology.orchestra.run.trial188.stdout:Installed size: 223 k 2026-02-13T20:10:50.704 INFO:teuthology.orchestra.run.trial188.stdout:Downloading Packages: 2026-02-13T20:10:50.839 INFO:teuthology.orchestra.run.trial188.stdout:(1/2): libcephfs-devel-20.3.0-5230.gafefaa40.el 277 kB/s | 37 kB 00:00 2026-02-13T20:10:50.842 INFO:teuthology.orchestra.run.trial188.stdout:(2/2): libcephfs-proxy2-20.3.0-5230.gafefaa40.e 180 kB/s | 25 kB 00:00 2026-02-13T20:10:50.843 INFO:teuthology.orchestra.run.trial188.stdout:-------------------------------------------------------------------------------- 2026-02-13T20:10:50.843 INFO:teuthology.orchestra.run.trial188.stdout:Total 445 kB/s | 62 kB 00:00 2026-02-13T20:10:50.843 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction check 2026-02-13T20:10:50.846 INFO:teuthology.orchestra.run.trial188.stdout:Transaction check succeeded. 2026-02-13T20:10:50.846 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction test 2026-02-13T20:10:50.878 INFO:teuthology.orchestra.run.trial188.stdout:Transaction test succeeded. 2026-02-13T20:10:50.878 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction 2026-02-13T20:10:50.926 INFO:teuthology.orchestra.run.trial188.stdout: Preparing : 1/1 2026-02-13T20:10:50.927 INFO:teuthology.orchestra.run.trial188.stdout: Installing : libcephfs-proxy2-2:20.3.0-5230.gafefaa40.el9.x86_64 1/2 2026-02-13T20:10:50.941 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5230.gafefaa40.el9.x86_64 1/2 2026-02-13T20:10:50.958 INFO:teuthology.orchestra.run.trial188.stdout: Installing : libcephfs-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 2/2 2026-02-13T20:10:51.007 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 8/10 2026-02-13T20:10:51.014 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: libcephfs-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 2/2 2026-02-13T20:10:51.014 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : libcephfs-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 1/2 2026-02-13T20:10:51.022 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 9/10 2026-02-13T20:10:51.023 INFO:teuthology.orchestra.run.trial110.stdout: Installing : ceph-mgr-rook-2:20.3.0-5230.gafefaa40.el9.noarch 10/10 2026-02-13T20:10:51.071 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5230.gafefaa40.el9.x86_64 2/2 2026-02-13T20:10:51.071 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:51.071 INFO:teuthology.orchestra.run.trial188.stdout:Installed: 2026-02-13T20:10:51.071 INFO:teuthology.orchestra.run.trial188.stdout: libcephfs-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:10:51.071 INFO:teuthology.orchestra.run.trial188.stdout: libcephfs-proxy2-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:10:51.071 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:51.071 INFO:teuthology.orchestra.run.trial188.stdout:Complete! 2026-02-13T20:10:51.098 DEBUG:teuthology.orchestra.run.trial188:> sudo yum -y install librados2 2026-02-13T20:10:51.127 INFO:teuthology.orchestra.run.trial110.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5230.gafefaa40.el9.noarch 10/10 2026-02-13T20:10:51.127 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5230.gafefaa40.el9.noarch 1/10 2026-02-13T20:10:51.127 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 2/10 2026-02-13T20:10:51.127 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 3/10 2026-02-13T20:10:51.127 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 4/10 2026-02-13T20:10:51.127 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 5/10 2026-02-13T20:10:51.127 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 6/10 2026-02-13T20:10:51.127 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-13T20:10:51.127 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 8/10 2026-02-13T20:10:51.127 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 9/10 2026-02-13T20:10:51.184 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 10/10 2026-02-13T20:10:51.184 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:51.184 INFO:teuthology.orchestra.run.trial110.stdout:Installed: 2026-02-13T20:10:51.184 INFO:teuthology.orchestra.run.trial110.stdout: ceph-mgr-rook-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-13T20:10:51.184 INFO:teuthology.orchestra.run.trial110.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-13T20:10:51.184 INFO:teuthology.orchestra.run.trial110.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-13T20:10:51.184 INFO:teuthology.orchestra.run.trial110.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-13T20:10:51.184 INFO:teuthology.orchestra.run.trial110.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-13T20:10:51.185 INFO:teuthology.orchestra.run.trial110.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-13T20:10:51.185 INFO:teuthology.orchestra.run.trial110.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-13T20:10:51.185 INFO:teuthology.orchestra.run.trial110.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-13T20:10:51.185 INFO:teuthology.orchestra.run.trial110.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-13T20:10:51.185 INFO:teuthology.orchestra.run.trial110.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-13T20:10:51.185 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:51.185 INFO:teuthology.orchestra.run.trial110.stdout:Complete! 2026-02-13T20:10:51.216 DEBUG:teuthology.orchestra.run.trial110:> sudo yum -y install ceph-mgr-cephadm 2026-02-13T20:10:51.400 INFO:teuthology.orchestra.run.trial188.stdout:Last metadata expiration check: 0:01:11 ago on Fri 13 Feb 2026 08:09:40 PM UTC. 2026-02-13T20:10:51.467 INFO:teuthology.orchestra.run.trial188.stdout:Package librados2-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-13T20:10:51.485 INFO:teuthology.orchestra.run.trial188.stdout:Dependencies resolved. 2026-02-13T20:10:51.486 INFO:teuthology.orchestra.run.trial188.stdout:Nothing to do. 2026-02-13T20:10:51.487 INFO:teuthology.orchestra.run.trial188.stdout:Complete! 2026-02-13T20:10:51.508 DEBUG:teuthology.orchestra.run.trial188:> sudo yum -y install librbd1 2026-02-13T20:10:51.521 INFO:teuthology.orchestra.run.trial110.stdout:Last metadata expiration check: 0:01:08 ago on Fri 13 Feb 2026 08:09:43 PM UTC. 2026-02-13T20:10:51.605 INFO:teuthology.orchestra.run.trial110.stdout:Dependencies resolved. 2026-02-13T20:10:51.606 INFO:teuthology.orchestra.run.trial110.stdout:================================================================================ 2026-02-13T20:10:51.606 INFO:teuthology.orchestra.run.trial110.stdout: Package Arch Version Repository Size 2026-02-13T20:10:51.606 INFO:teuthology.orchestra.run.trial110.stdout:================================================================================ 2026-02-13T20:10:51.606 INFO:teuthology.orchestra.run.trial110.stdout:Installing: 2026-02-13T20:10:51.606 INFO:teuthology.orchestra.run.trial110.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 184 k 2026-02-13T20:10:51.606 INFO:teuthology.orchestra.run.trial110.stdout:Installing dependencies: 2026-02-13T20:10:51.607 INFO:teuthology.orchestra.run.trial110.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-13T20:10:51.607 INFO:teuthology.orchestra.run.trial110.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-13T20:10:51.607 INFO:teuthology.orchestra.run.trial110.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-13T20:10:51.607 INFO:teuthology.orchestra.run.trial110.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-13T20:10:51.607 INFO:teuthology.orchestra.run.trial110.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-13T20:10:51.607 INFO:teuthology.orchestra.run.trial110.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-13T20:10:51.607 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:51.607 INFO:teuthology.orchestra.run.trial110.stdout:Transaction Summary 2026-02-13T20:10:51.607 INFO:teuthology.orchestra.run.trial110.stdout:================================================================================ 2026-02-13T20:10:51.607 INFO:teuthology.orchestra.run.trial110.stdout:Install 7 Packages 2026-02-13T20:10:51.607 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:51.608 INFO:teuthology.orchestra.run.trial110.stdout:Total download size: 7.1 M 2026-02-13T20:10:51.608 INFO:teuthology.orchestra.run.trial110.stdout:Installed size: 34 M 2026-02-13T20:10:51.608 INFO:teuthology.orchestra.run.trial110.stdout:Downloading Packages: 2026-02-13T20:10:51.808 INFO:teuthology.orchestra.run.trial188.stdout:Last metadata expiration check: 0:01:11 ago on Fri 13 Feb 2026 08:09:40 PM UTC. 2026-02-13T20:10:51.874 INFO:teuthology.orchestra.run.trial188.stdout:Package librbd1-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-13T20:10:51.892 INFO:teuthology.orchestra.run.trial188.stdout:Dependencies resolved. 2026-02-13T20:10:51.893 INFO:teuthology.orchestra.run.trial188.stdout:Nothing to do. 2026-02-13T20:10:51.893 INFO:teuthology.orchestra.run.trial188.stdout:Complete! 2026-02-13T20:10:51.904 INFO:teuthology.orchestra.run.trial110.stdout:(1/7): python3-jinja2-2.11.3-8.el9.noarch.rpm 1.5 MB/s | 249 kB 00:00 2026-02-13T20:10:51.915 DEBUG:teuthology.orchestra.run.trial188:> sudo yum -y install python3-rados 2026-02-13T20:10:51.931 INFO:teuthology.orchestra.run.trial110.stdout:(2/7): python3-markupsafe-1.1.1-12.el9.x86_64.r 1.3 MB/s | 35 kB 00:00 2026-02-13T20:10:51.965 INFO:teuthology.orchestra.run.trial110.stdout:(3/7): ceph-mgr-cephadm-20.3.0-5230.gafefaa40.e 840 kB/s | 184 kB 00:00 2026-02-13T20:10:52.025 INFO:teuthology.orchestra.run.trial110.stdout:(4/7): python3-babel-2.9.1-2.el9.noarch.rpm 21 MB/s | 6.0 MB 00:00 2026-02-13T20:10:52.093 INFO:teuthology.orchestra.run.trial110.stdout:(5/7): python3-natsort-7.1.1-5.el9.noarch.rpm 452 kB/s | 58 kB 00:00 2026-02-13T20:10:52.122 INFO:teuthology.orchestra.run.trial110.stdout:(6/7): python3-asyncssh-2.13.2-5.el9.noarch.rpm 2.8 MB/s | 548 kB 00:00 2026-02-13T20:10:52.140 INFO:teuthology.orchestra.run.trial110.stdout:(7/7): python3-typing-extensions-4.15.0-1.el9.n 758 kB/s | 86 kB 00:00 2026-02-13T20:10:52.140 INFO:teuthology.orchestra.run.trial110.stdout:-------------------------------------------------------------------------------- 2026-02-13T20:10:52.140 INFO:teuthology.orchestra.run.trial110.stdout:Total 13 MB/s | 7.1 MB 00:00 2026-02-13T20:10:52.179 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction check 2026-02-13T20:10:52.185 INFO:teuthology.orchestra.run.trial110.stdout:Transaction check succeeded. 2026-02-13T20:10:52.185 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction test 2026-02-13T20:10:52.216 INFO:teuthology.orchestra.run.trial188.stdout:Last metadata expiration check: 0:01:12 ago on Fri 13 Feb 2026 08:09:40 PM UTC. 2026-02-13T20:10:52.257 INFO:teuthology.orchestra.run.trial110.stdout:Transaction test succeeded. 2026-02-13T20:10:52.257 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction 2026-02-13T20:10:52.281 INFO:teuthology.orchestra.run.trial188.stdout:Package python3-rados-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-13T20:10:52.300 INFO:teuthology.orchestra.run.trial188.stdout:Dependencies resolved. 2026-02-13T20:10:52.301 INFO:teuthology.orchestra.run.trial188.stdout:Nothing to do. 2026-02-13T20:10:52.301 INFO:teuthology.orchestra.run.trial188.stdout:Complete! 2026-02-13T20:10:52.323 DEBUG:teuthology.orchestra.run.trial188:> sudo yum -y install python3-rgw 2026-02-13T20:10:52.346 INFO:teuthology.orchestra.run.trial110.stdout: Preparing : 1/1 2026-02-13T20:10:52.395 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 1/7 2026-02-13T20:10:52.405 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/7 2026-02-13T20:10:52.410 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/7 2026-02-13T20:10:52.623 INFO:teuthology.orchestra.run.trial188.stdout:Last metadata expiration check: 0:01:12 ago on Fri 13 Feb 2026 08:09:40 PM UTC. 2026-02-13T20:10:52.630 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-13T20:10:52.653 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 5/7 2026-02-13T20:10:52.677 INFO:teuthology.orchestra.run.trial110.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 6/7 2026-02-13T20:10:52.679 INFO:teuthology.orchestra.run.trial110.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 7/7 2026-02-13T20:10:52.689 INFO:teuthology.orchestra.run.trial188.stdout:Package python3-rgw-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-13T20:10:52.707 INFO:teuthology.orchestra.run.trial188.stdout:Dependencies resolved. 2026-02-13T20:10:52.708 INFO:teuthology.orchestra.run.trial188.stdout:Nothing to do. 2026-02-13T20:10:52.708 INFO:teuthology.orchestra.run.trial188.stdout:Complete! 2026-02-13T20:10:52.729 DEBUG:teuthology.orchestra.run.trial188:> sudo yum -y install python3-cephfs 2026-02-13T20:10:52.788 INFO:teuthology.orchestra.run.trial110.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 7/7 2026-02-13T20:10:52.788 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 1/7 2026-02-13T20:10:52.788 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/7 2026-02-13T20:10:52.788 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 3/7 2026-02-13T20:10:52.788 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-13T20:10:52.788 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 5/7 2026-02-13T20:10:52.788 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 6/7 2026-02-13T20:10:52.846 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 7/7 2026-02-13T20:10:52.846 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:52.846 INFO:teuthology.orchestra.run.trial110.stdout:Installed: 2026-02-13T20:10:52.846 INFO:teuthology.orchestra.run.trial110.stdout: ceph-mgr-cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-13T20:10:52.846 INFO:teuthology.orchestra.run.trial110.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-13T20:10:52.846 INFO:teuthology.orchestra.run.trial110.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-13T20:10:52.847 INFO:teuthology.orchestra.run.trial110.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-13T20:10:52.847 INFO:teuthology.orchestra.run.trial110.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-13T20:10:52.847 INFO:teuthology.orchestra.run.trial110.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-13T20:10:52.847 INFO:teuthology.orchestra.run.trial110.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-13T20:10:52.847 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:52.847 INFO:teuthology.orchestra.run.trial110.stdout:Complete! 2026-02-13T20:10:52.880 DEBUG:teuthology.orchestra.run.trial110:> sudo yum -y install ceph-osd 2026-02-13T20:10:53.037 INFO:teuthology.orchestra.run.trial188.stdout:Last metadata expiration check: 0:01:13 ago on Fri 13 Feb 2026 08:09:40 PM UTC. 2026-02-13T20:10:53.103 INFO:teuthology.orchestra.run.trial188.stdout:Package python3-cephfs-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-13T20:10:53.121 INFO:teuthology.orchestra.run.trial188.stdout:Dependencies resolved. 2026-02-13T20:10:53.122 INFO:teuthology.orchestra.run.trial188.stdout:Nothing to do. 2026-02-13T20:10:53.122 INFO:teuthology.orchestra.run.trial188.stdout:Complete! 2026-02-13T20:10:53.144 DEBUG:teuthology.orchestra.run.trial188:> sudo yum -y install python3-rbd 2026-02-13T20:10:53.182 INFO:teuthology.orchestra.run.trial110.stdout:Last metadata expiration check: 0:01:10 ago on Fri 13 Feb 2026 08:09:43 PM UTC. 2026-02-13T20:10:53.248 INFO:teuthology.orchestra.run.trial110.stdout:Package ceph-osd-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-13T20:10:53.266 INFO:teuthology.orchestra.run.trial110.stdout:Dependencies resolved. 2026-02-13T20:10:53.267 INFO:teuthology.orchestra.run.trial110.stdout:Nothing to do. 2026-02-13T20:10:53.267 INFO:teuthology.orchestra.run.trial110.stdout:Complete! 2026-02-13T20:10:53.289 DEBUG:teuthology.orchestra.run.trial110:> sudo yum -y install ceph-osd-classic 2026-02-13T20:10:53.441 INFO:teuthology.orchestra.run.trial188.stdout:Last metadata expiration check: 0:01:13 ago on Fri 13 Feb 2026 08:09:40 PM UTC. 2026-02-13T20:10:53.507 INFO:teuthology.orchestra.run.trial188.stdout:Package python3-rbd-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-13T20:10:53.525 INFO:teuthology.orchestra.run.trial188.stdout:Dependencies resolved. 2026-02-13T20:10:53.526 INFO:teuthology.orchestra.run.trial188.stdout:Nothing to do. 2026-02-13T20:10:53.526 INFO:teuthology.orchestra.run.trial188.stdout:Complete! 2026-02-13T20:10:53.547 DEBUG:teuthology.orchestra.run.trial188:> sudo yum -y install rbd-fuse 2026-02-13T20:10:53.596 INFO:teuthology.orchestra.run.trial110.stdout:Last metadata expiration check: 0:01:10 ago on Fri 13 Feb 2026 08:09:43 PM UTC. 2026-02-13T20:10:53.661 INFO:teuthology.orchestra.run.trial110.stdout:Package ceph-osd-classic-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-13T20:10:53.680 INFO:teuthology.orchestra.run.trial110.stdout:Dependencies resolved. 2026-02-13T20:10:53.681 INFO:teuthology.orchestra.run.trial110.stdout:Nothing to do. 2026-02-13T20:10:53.681 INFO:teuthology.orchestra.run.trial110.stdout:Complete! 2026-02-13T20:10:53.703 DEBUG:teuthology.orchestra.run.trial110:> sudo yum -y install ceph-fuse 2026-02-13T20:10:53.843 INFO:teuthology.orchestra.run.trial188.stdout:Last metadata expiration check: 0:01:13 ago on Fri 13 Feb 2026 08:09:40 PM UTC. 2026-02-13T20:10:53.927 INFO:teuthology.orchestra.run.trial188.stdout:Dependencies resolved. 2026-02-13T20:10:53.927 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-13T20:10:53.927 INFO:teuthology.orchestra.run.trial188.stdout: Package Architecture Version Repository Size 2026-02-13T20:10:53.927 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-13T20:10:53.927 INFO:teuthology.orchestra.run.trial188.stdout:Installing: 2026-02-13T20:10:53.927 INFO:teuthology.orchestra.run.trial188.stdout: rbd-fuse x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 84 k 2026-02-13T20:10:53.927 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:53.927 INFO:teuthology.orchestra.run.trial188.stdout:Transaction Summary 2026-02-13T20:10:53.927 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-13T20:10:53.927 INFO:teuthology.orchestra.run.trial188.stdout:Install 1 Package 2026-02-13T20:10:53.927 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:53.927 INFO:teuthology.orchestra.run.trial188.stdout:Total download size: 84 k 2026-02-13T20:10:53.927 INFO:teuthology.orchestra.run.trial188.stdout:Installed size: 209 k 2026-02-13T20:10:53.927 INFO:teuthology.orchestra.run.trial188.stdout:Downloading Packages: 2026-02-13T20:10:54.003 INFO:teuthology.orchestra.run.trial110.stdout:Last metadata expiration check: 0:01:11 ago on Fri 13 Feb 2026 08:09:43 PM UTC. 2026-02-13T20:10:54.086 INFO:teuthology.orchestra.run.trial110.stdout:Dependencies resolved. 2026-02-13T20:10:54.086 INFO:teuthology.orchestra.run.trial110.stdout:================================================================================ 2026-02-13T20:10:54.086 INFO:teuthology.orchestra.run.trial110.stdout: Package Arch Version Repo Size 2026-02-13T20:10:54.086 INFO:teuthology.orchestra.run.trial110.stdout:================================================================================ 2026-02-13T20:10:54.086 INFO:teuthology.orchestra.run.trial110.stdout:Installing: 2026-02-13T20:10:54.086 INFO:teuthology.orchestra.run.trial110.stdout: ceph-fuse x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 987 k 2026-02-13T20:10:54.086 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:54.086 INFO:teuthology.orchestra.run.trial110.stdout:Transaction Summary 2026-02-13T20:10:54.086 INFO:teuthology.orchestra.run.trial110.stdout:================================================================================ 2026-02-13T20:10:54.086 INFO:teuthology.orchestra.run.trial110.stdout:Install 1 Package 2026-02-13T20:10:54.086 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:54.086 INFO:teuthology.orchestra.run.trial110.stdout:Total download size: 987 k 2026-02-13T20:10:54.086 INFO:teuthology.orchestra.run.trial110.stdout:Installed size: 2.9 M 2026-02-13T20:10:54.086 INFO:teuthology.orchestra.run.trial110.stdout:Downloading Packages: 2026-02-13T20:10:54.250 INFO:teuthology.orchestra.run.trial188.stdout:rbd-fuse-20.3.0-5230.gafefaa40.el9.x86_64.rpm 261 kB/s | 84 kB 00:00 2026-02-13T20:10:54.251 INFO:teuthology.orchestra.run.trial188.stdout:-------------------------------------------------------------------------------- 2026-02-13T20:10:54.251 INFO:teuthology.orchestra.run.trial188.stdout:Total 260 kB/s | 84 kB 00:00 2026-02-13T20:10:54.251 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction check 2026-02-13T20:10:54.255 INFO:teuthology.orchestra.run.trial188.stdout:Transaction check succeeded. 2026-02-13T20:10:54.255 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction test 2026-02-13T20:10:54.286 INFO:teuthology.orchestra.run.trial188.stdout:Transaction test succeeded. 2026-02-13T20:10:54.286 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction 2026-02-13T20:10:54.336 INFO:teuthology.orchestra.run.trial188.stdout: Preparing : 1/1 2026-02-13T20:10:54.353 INFO:teuthology.orchestra.run.trial188.stdout: Installing : rbd-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-13T20:10:54.433 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: rbd-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-13T20:10:54.490 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : rbd-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-13T20:10:54.490 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:54.490 INFO:teuthology.orchestra.run.trial188.stdout:Installed: 2026-02-13T20:10:54.490 INFO:teuthology.orchestra.run.trial188.stdout: rbd-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:10:54.490 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:54.491 INFO:teuthology.orchestra.run.trial188.stdout:Complete! 2026-02-13T20:10:54.517 DEBUG:teuthology.orchestra.run.trial188:> sudo yum -y install rbd-mirror 2026-02-13T20:10:54.603 INFO:teuthology.orchestra.run.trial110.stdout:ceph-fuse-20.3.0-5230.gafefaa40.el9.x86_64.rpm 1.9 MB/s | 987 kB 00:00 2026-02-13T20:10:54.603 INFO:teuthology.orchestra.run.trial110.stdout:-------------------------------------------------------------------------------- 2026-02-13T20:10:54.603 INFO:teuthology.orchestra.run.trial110.stdout:Total 1.9 MB/s | 987 kB 00:00 2026-02-13T20:10:54.603 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction check 2026-02-13T20:10:54.608 INFO:teuthology.orchestra.run.trial110.stdout:Transaction check succeeded. 2026-02-13T20:10:54.608 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction test 2026-02-13T20:10:54.643 INFO:teuthology.orchestra.run.trial110.stdout:Transaction test succeeded. 2026-02-13T20:10:54.644 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction 2026-02-13T20:10:54.736 INFO:teuthology.orchestra.run.trial110.stdout: Preparing : 1/1 2026-02-13T20:10:54.753 INFO:teuthology.orchestra.run.trial110.stdout: Installing : ceph-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-13T20:10:54.819 INFO:teuthology.orchestra.run.trial188.stdout:Last metadata expiration check: 0:01:14 ago on Fri 13 Feb 2026 08:09:40 PM UTC. 2026-02-13T20:10:54.904 INFO:teuthology.orchestra.run.trial188.stdout:Dependencies resolved. 2026-02-13T20:10:54.904 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-13T20:10:54.904 INFO:teuthology.orchestra.run.trial188.stdout: Package Arch Version Repo Size 2026-02-13T20:10:54.904 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-13T20:10:54.904 INFO:teuthology.orchestra.run.trial188.stdout:Installing: 2026-02-13T20:10:54.904 INFO:teuthology.orchestra.run.trial188.stdout: rbd-mirror x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 2.9 M 2026-02-13T20:10:54.904 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:54.905 INFO:teuthology.orchestra.run.trial188.stdout:Transaction Summary 2026-02-13T20:10:54.905 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-13T20:10:54.905 INFO:teuthology.orchestra.run.trial188.stdout:Install 1 Package 2026-02-13T20:10:54.905 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:54.905 INFO:teuthology.orchestra.run.trial188.stdout:Total download size: 2.9 M 2026-02-13T20:10:54.905 INFO:teuthology.orchestra.run.trial188.stdout:Installed size: 11 M 2026-02-13T20:10:54.905 INFO:teuthology.orchestra.run.trial188.stdout:Downloading Packages: 2026-02-13T20:10:54.980 INFO:teuthology.orchestra.run.trial110.stdout: Running scriptlet: ceph-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-13T20:10:55.037 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : ceph-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-13T20:10:55.037 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:55.037 INFO:teuthology.orchestra.run.trial110.stdout:Installed: 2026-02-13T20:10:55.037 INFO:teuthology.orchestra.run.trial110.stdout: ceph-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:10:55.037 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:55.037 INFO:teuthology.orchestra.run.trial110.stdout:Complete! 2026-02-13T20:10:55.065 DEBUG:teuthology.orchestra.run.trial110:> sudo yum -y install ceph-volume 2026-02-13T20:10:55.376 INFO:teuthology.orchestra.run.trial110.stdout:Last metadata expiration check: 0:01:12 ago on Fri 13 Feb 2026 08:09:43 PM UTC. 2026-02-13T20:10:55.460 INFO:teuthology.orchestra.run.trial110.stdout:Dependencies resolved. 2026-02-13T20:10:55.461 INFO:teuthology.orchestra.run.trial110.stdout:================================================================================ 2026-02-13T20:10:55.461 INFO:teuthology.orchestra.run.trial110.stdout: Package Arch Version Repository Size 2026-02-13T20:10:55.461 INFO:teuthology.orchestra.run.trial110.stdout:================================================================================ 2026-02-13T20:10:55.461 INFO:teuthology.orchestra.run.trial110.stdout:Installing: 2026-02-13T20:10:55.461 INFO:teuthology.orchestra.run.trial110.stdout: ceph-volume noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 299 k 2026-02-13T20:10:55.461 INFO:teuthology.orchestra.run.trial110.stdout:Installing dependencies: 2026-02-13T20:10:55.461 INFO:teuthology.orchestra.run.trial110.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-13T20:10:55.461 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:55.461 INFO:teuthology.orchestra.run.trial110.stdout:Transaction Summary 2026-02-13T20:10:55.461 INFO:teuthology.orchestra.run.trial110.stdout:================================================================================ 2026-02-13T20:10:55.461 INFO:teuthology.orchestra.run.trial110.stdout:Install 2 Packages 2026-02-13T20:10:55.461 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:55.461 INFO:teuthology.orchestra.run.trial110.stdout:Total download size: 649 k 2026-02-13T20:10:55.461 INFO:teuthology.orchestra.run.trial110.stdout:Installed size: 2.2 M 2026-02-13T20:10:55.461 INFO:teuthology.orchestra.run.trial110.stdout:Downloading Packages: 2026-02-13T20:10:55.586 INFO:teuthology.orchestra.run.trial188.stdout:rbd-mirror-20.3.0-5230.gafefaa40.el9.x86_64.rpm 4.2 MB/s | 2.9 MB 00:00 2026-02-13T20:10:55.586 INFO:teuthology.orchestra.run.trial188.stdout:-------------------------------------------------------------------------------- 2026-02-13T20:10:55.586 INFO:teuthology.orchestra.run.trial188.stdout:Total 4.2 MB/s | 2.9 MB 00:00 2026-02-13T20:10:55.586 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction check 2026-02-13T20:10:55.591 INFO:teuthology.orchestra.run.trial188.stdout:Transaction check succeeded. 2026-02-13T20:10:55.591 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction test 2026-02-13T20:10:55.630 INFO:teuthology.orchestra.run.trial188.stdout:Transaction test succeeded. 2026-02-13T20:10:55.631 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction 2026-02-13T20:10:55.809 INFO:teuthology.orchestra.run.trial188.stdout: Preparing : 1/1 2026-02-13T20:10:55.810 INFO:teuthology.orchestra.run.trial188.stdout: Installing : rbd-mirror-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-13T20:10:55.834 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-13T20:10:55.834 INFO:teuthology.orchestra.run.trial188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T20:10:55.834 INFO:teuthology.orchestra.run.trial188.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-13T20:10:55.834 INFO:teuthology.orchestra.run.trial188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T20:10:55.834 INFO:teuthology.orchestra.run.trial188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T20:10:55.834 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:55.835 INFO:teuthology.orchestra.run.trial110.stdout:(1/2): cryptsetup-2.8.1-2.el9.x86_64.rpm 5.1 MB/s | 350 kB 00:00 2026-02-13T20:10:56.151 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : rbd-mirror-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-13T20:10:56.151 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:56.151 INFO:teuthology.orchestra.run.trial188.stdout:Installed: 2026-02-13T20:10:56.151 INFO:teuthology.orchestra.run.trial188.stdout: rbd-mirror-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:10:56.151 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:56.151 INFO:teuthology.orchestra.run.trial188.stdout:Complete! 2026-02-13T20:10:56.154 INFO:teuthology.orchestra.run.trial110.stdout:(2/2): ceph-volume-20.3.0-5230.gafefaa40.el9.no 772 kB/s | 299 kB 00:00 2026-02-13T20:10:56.155 INFO:teuthology.orchestra.run.trial110.stdout:-------------------------------------------------------------------------------- 2026-02-13T20:10:56.155 INFO:teuthology.orchestra.run.trial110.stdout:Total 936 kB/s | 649 kB 00:00 2026-02-13T20:10:56.166 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction check 2026-02-13T20:10:56.173 INFO:teuthology.orchestra.run.trial110.stdout:Transaction check succeeded. 2026-02-13T20:10:56.173 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction test 2026-02-13T20:10:56.178 DEBUG:teuthology.orchestra.run.trial188:> sudo yum -y install rbd-nbd 2026-02-13T20:10:56.217 INFO:teuthology.orchestra.run.trial110.stdout:Transaction test succeeded. 2026-02-13T20:10:56.217 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction 2026-02-13T20:10:56.297 INFO:teuthology.orchestra.run.trial110.stdout: Preparing : 1/1 2026-02-13T20:10:56.360 INFO:teuthology.orchestra.run.trial110.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 1/2 2026-02-13T20:10:56.362 INFO:teuthology.orchestra.run.trial110.stdout: Installing : ceph-volume-2:20.3.0-5230.gafefaa40.el9.noarch 2/2 2026-02-13T20:10:56.377 INFO:teuthology.orchestra.run.trial110.stdout: Running scriptlet: ceph-volume-2:20.3.0-5230.gafefaa40.el9.noarch 2/2 2026-02-13T20:10:56.378 INFO:teuthology.orchestra.run.trial110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T20:10:56.378 INFO:teuthology.orchestra.run.trial110.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-13T20:10:56.378 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:56.484 INFO:teuthology.orchestra.run.trial188.stdout:Last metadata expiration check: 0:01:16 ago on Fri 13 Feb 2026 08:09:40 PM UTC. 2026-02-13T20:10:56.568 INFO:teuthology.orchestra.run.trial188.stdout:Dependencies resolved. 2026-02-13T20:10:56.568 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-13T20:10:56.568 INFO:teuthology.orchestra.run.trial188.stdout: Package Architecture Version Repository Size 2026-02-13T20:10:56.568 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-13T20:10:56.568 INFO:teuthology.orchestra.run.trial188.stdout:Installing: 2026-02-13T20:10:56.568 INFO:teuthology.orchestra.run.trial188.stdout: rbd-nbd x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 172 k 2026-02-13T20:10:56.568 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:56.568 INFO:teuthology.orchestra.run.trial188.stdout:Transaction Summary 2026-02-13T20:10:56.568 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-13T20:10:56.568 INFO:teuthology.orchestra.run.trial188.stdout:Install 1 Package 2026-02-13T20:10:56.568 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:56.569 INFO:teuthology.orchestra.run.trial188.stdout:Total download size: 172 k 2026-02-13T20:10:56.569 INFO:teuthology.orchestra.run.trial188.stdout:Installed size: 462 k 2026-02-13T20:10:56.569 INFO:teuthology.orchestra.run.trial188.stdout:Downloading Packages: 2026-02-13T20:10:56.604 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : ceph-volume-2:20.3.0-5230.gafefaa40.el9.noarch 1/2 2026-02-13T20:10:56.660 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 2/2 2026-02-13T20:10:56.660 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:56.661 INFO:teuthology.orchestra.run.trial110.stdout:Installed: 2026-02-13T20:10:56.661 INFO:teuthology.orchestra.run.trial110.stdout: ceph-volume-2:20.3.0-5230.gafefaa40.el9.noarch cryptsetup-2.8.1-2.el9.x86_64 2026-02-13T20:10:56.661 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:56.661 INFO:teuthology.orchestra.run.trial110.stdout:Complete! 2026-02-13T20:10:56.688 DEBUG:teuthology.orchestra.run.trial110:> sudo yum -y install librados-devel 2026-02-13T20:10:56.906 INFO:teuthology.orchestra.run.trial188.stdout:rbd-nbd-20.3.0-5230.gafefaa40.el9.x86_64.rpm 511 kB/s | 172 kB 00:00 2026-02-13T20:10:56.907 INFO:teuthology.orchestra.run.trial188.stdout:-------------------------------------------------------------------------------- 2026-02-13T20:10:56.908 INFO:teuthology.orchestra.run.trial188.stdout:Total 509 kB/s | 172 kB 00:00 2026-02-13T20:10:56.908 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction check 2026-02-13T20:10:56.913 INFO:teuthology.orchestra.run.trial188.stdout:Transaction check succeeded. 2026-02-13T20:10:56.913 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction test 2026-02-13T20:10:56.944 INFO:teuthology.orchestra.run.trial188.stdout:Transaction test succeeded. 2026-02-13T20:10:56.944 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction 2026-02-13T20:10:56.988 INFO:teuthology.orchestra.run.trial110.stdout:Last metadata expiration check: 0:01:13 ago on Fri 13 Feb 2026 08:09:43 PM UTC. 2026-02-13T20:10:56.999 INFO:teuthology.orchestra.run.trial188.stdout: Preparing : 1/1 2026-02-13T20:10:57.016 INFO:teuthology.orchestra.run.trial188.stdout: Installing : rbd-nbd-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-13T20:10:57.074 INFO:teuthology.orchestra.run.trial110.stdout:Dependencies resolved. 2026-02-13T20:10:57.074 INFO:teuthology.orchestra.run.trial110.stdout:================================================================================ 2026-02-13T20:10:57.074 INFO:teuthology.orchestra.run.trial110.stdout: Package Arch Version Repo Size 2026-02-13T20:10:57.074 INFO:teuthology.orchestra.run.trial110.stdout:================================================================================ 2026-02-13T20:10:57.074 INFO:teuthology.orchestra.run.trial110.stdout:Installing: 2026-02-13T20:10:57.074 INFO:teuthology.orchestra.run.trial110.stdout: librados-devel x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 123 k 2026-02-13T20:10:57.075 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:57.075 INFO:teuthology.orchestra.run.trial110.stdout:Transaction Summary 2026-02-13T20:10:57.075 INFO:teuthology.orchestra.run.trial110.stdout:================================================================================ 2026-02-13T20:10:57.075 INFO:teuthology.orchestra.run.trial110.stdout:Install 1 Package 2026-02-13T20:10:57.075 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:57.075 INFO:teuthology.orchestra.run.trial110.stdout:Total download size: 123 k 2026-02-13T20:10:57.075 INFO:teuthology.orchestra.run.trial110.stdout:Installed size: 437 k 2026-02-13T20:10:57.075 INFO:teuthology.orchestra.run.trial110.stdout:Downloading Packages: 2026-02-13T20:10:57.096 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: rbd-nbd-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-13T20:10:57.153 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : rbd-nbd-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-13T20:10:57.154 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:57.154 INFO:teuthology.orchestra.run.trial188.stdout:Installed: 2026-02-13T20:10:57.154 INFO:teuthology.orchestra.run.trial188.stdout: rbd-nbd-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:10:57.154 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:10:57.154 INFO:teuthology.orchestra.run.trial188.stdout:Complete! 2026-02-13T20:10:57.189 DEBUG:teuthology.parallel:result is None 2026-02-13T20:10:57.411 INFO:teuthology.orchestra.run.trial110.stdout:librados-devel-20.3.0-5230.gafefaa40.el9.x86_64 366 kB/s | 123 kB 00:00 2026-02-13T20:10:57.411 INFO:teuthology.orchestra.run.trial110.stdout:-------------------------------------------------------------------------------- 2026-02-13T20:10:57.411 INFO:teuthology.orchestra.run.trial110.stdout:Total 365 kB/s | 123 kB 00:00 2026-02-13T20:10:57.411 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction check 2026-02-13T20:10:57.414 INFO:teuthology.orchestra.run.trial110.stdout:Transaction check succeeded. 2026-02-13T20:10:57.414 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction test 2026-02-13T20:10:57.446 INFO:teuthology.orchestra.run.trial110.stdout:Transaction test succeeded. 2026-02-13T20:10:57.446 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction 2026-02-13T20:10:57.500 INFO:teuthology.orchestra.run.trial110.stdout: Preparing : 1/1 2026-02-13T20:10:57.516 INFO:teuthology.orchestra.run.trial110.stdout: Installing : librados-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-13T20:10:57.598 INFO:teuthology.orchestra.run.trial110.stdout: Running scriptlet: librados-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-13T20:10:57.655 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : librados-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-13T20:10:57.656 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:57.656 INFO:teuthology.orchestra.run.trial110.stdout:Installed: 2026-02-13T20:10:57.656 INFO:teuthology.orchestra.run.trial110.stdout: librados-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:10:57.656 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:57.656 INFO:teuthology.orchestra.run.trial110.stdout:Complete! 2026-02-13T20:10:57.684 DEBUG:teuthology.orchestra.run.trial110:> sudo yum -y install libcephfs2 2026-02-13T20:10:57.984 INFO:teuthology.orchestra.run.trial110.stdout:Last metadata expiration check: 0:01:14 ago on Fri 13 Feb 2026 08:09:43 PM UTC. 2026-02-13T20:10:58.050 INFO:teuthology.orchestra.run.trial110.stdout:Package libcephfs2-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-13T20:10:58.068 INFO:teuthology.orchestra.run.trial110.stdout:Dependencies resolved. 2026-02-13T20:10:58.069 INFO:teuthology.orchestra.run.trial110.stdout:Nothing to do. 2026-02-13T20:10:58.069 INFO:teuthology.orchestra.run.trial110.stdout:Complete! 2026-02-13T20:10:58.090 DEBUG:teuthology.orchestra.run.trial110:> sudo yum -y install libcephfs-devel 2026-02-13T20:10:58.393 INFO:teuthology.orchestra.run.trial110.stdout:Last metadata expiration check: 0:01:15 ago on Fri 13 Feb 2026 08:09:43 PM UTC. 2026-02-13T20:10:58.478 INFO:teuthology.orchestra.run.trial110.stdout:Dependencies resolved. 2026-02-13T20:10:58.479 INFO:teuthology.orchestra.run.trial110.stdout:================================================================================ 2026-02-13T20:10:58.479 INFO:teuthology.orchestra.run.trial110.stdout: Package Arch Version Repo Size 2026-02-13T20:10:58.479 INFO:teuthology.orchestra.run.trial110.stdout:================================================================================ 2026-02-13T20:10:58.479 INFO:teuthology.orchestra.run.trial110.stdout:Installing: 2026-02-13T20:10:58.479 INFO:teuthology.orchestra.run.trial110.stdout: libcephfs-devel x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 37 k 2026-02-13T20:10:58.479 INFO:teuthology.orchestra.run.trial110.stdout:Installing dependencies: 2026-02-13T20:10:58.479 INFO:teuthology.orchestra.run.trial110.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 25 k 2026-02-13T20:10:58.479 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:58.480 INFO:teuthology.orchestra.run.trial110.stdout:Transaction Summary 2026-02-13T20:10:58.480 INFO:teuthology.orchestra.run.trial110.stdout:================================================================================ 2026-02-13T20:10:58.480 INFO:teuthology.orchestra.run.trial110.stdout:Install 2 Packages 2026-02-13T20:10:58.480 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:58.480 INFO:teuthology.orchestra.run.trial110.stdout:Total download size: 62 k 2026-02-13T20:10:58.480 INFO:teuthology.orchestra.run.trial110.stdout:Installed size: 223 k 2026-02-13T20:10:58.480 INFO:teuthology.orchestra.run.trial110.stdout:Downloading Packages: 2026-02-13T20:10:58.709 INFO:teuthology.orchestra.run.trial110.stdout:(1/2): libcephfs-devel-20.3.0-5230.gafefaa40.el 162 kB/s | 37 kB 00:00 2026-02-13T20:10:58.709 INFO:teuthology.orchestra.run.trial110.stdout:(2/2): libcephfs-proxy2-20.3.0-5230.gafefaa40.e 108 kB/s | 25 kB 00:00 2026-02-13T20:10:58.710 INFO:teuthology.orchestra.run.trial110.stdout:-------------------------------------------------------------------------------- 2026-02-13T20:10:58.710 INFO:teuthology.orchestra.run.trial110.stdout:Total 268 kB/s | 62 kB 00:00 2026-02-13T20:10:58.710 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction check 2026-02-13T20:10:58.713 INFO:teuthology.orchestra.run.trial110.stdout:Transaction check succeeded. 2026-02-13T20:10:58.713 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction test 2026-02-13T20:10:58.746 INFO:teuthology.orchestra.run.trial110.stdout:Transaction test succeeded. 2026-02-13T20:10:58.747 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction 2026-02-13T20:10:58.795 INFO:teuthology.orchestra.run.trial110.stdout: Preparing : 1/1 2026-02-13T20:10:58.796 INFO:teuthology.orchestra.run.trial110.stdout: Installing : libcephfs-proxy2-2:20.3.0-5230.gafefaa40.el9.x86_64 1/2 2026-02-13T20:10:58.810 INFO:teuthology.orchestra.run.trial110.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5230.gafefaa40.el9.x86_64 1/2 2026-02-13T20:10:58.826 INFO:teuthology.orchestra.run.trial110.stdout: Installing : libcephfs-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 2/2 2026-02-13T20:10:58.879 INFO:teuthology.orchestra.run.trial110.stdout: Running scriptlet: libcephfs-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 2/2 2026-02-13T20:10:58.880 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : libcephfs-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 1/2 2026-02-13T20:10:58.937 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5230.gafefaa40.el9.x86_64 2/2 2026-02-13T20:10:58.937 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:58.937 INFO:teuthology.orchestra.run.trial110.stdout:Installed: 2026-02-13T20:10:58.937 INFO:teuthology.orchestra.run.trial110.stdout: libcephfs-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:10:58.938 INFO:teuthology.orchestra.run.trial110.stdout: libcephfs-proxy2-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:10:58.938 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:10:58.938 INFO:teuthology.orchestra.run.trial110.stdout:Complete! 2026-02-13T20:10:58.965 DEBUG:teuthology.orchestra.run.trial110:> sudo yum -y install librados2 2026-02-13T20:10:59.262 INFO:teuthology.orchestra.run.trial110.stdout:Last metadata expiration check: 0:01:16 ago on Fri 13 Feb 2026 08:09:43 PM UTC. 2026-02-13T20:10:59.328 INFO:teuthology.orchestra.run.trial110.stdout:Package librados2-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-13T20:10:59.346 INFO:teuthology.orchestra.run.trial110.stdout:Dependencies resolved. 2026-02-13T20:10:59.347 INFO:teuthology.orchestra.run.trial110.stdout:Nothing to do. 2026-02-13T20:10:59.347 INFO:teuthology.orchestra.run.trial110.stdout:Complete! 2026-02-13T20:10:59.367 DEBUG:teuthology.orchestra.run.trial110:> sudo yum -y install librbd1 2026-02-13T20:10:59.663 INFO:teuthology.orchestra.run.trial110.stdout:Last metadata expiration check: 0:01:16 ago on Fri 13 Feb 2026 08:09:43 PM UTC. 2026-02-13T20:10:59.727 INFO:teuthology.orchestra.run.trial110.stdout:Package librbd1-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-13T20:10:59.745 INFO:teuthology.orchestra.run.trial110.stdout:Dependencies resolved. 2026-02-13T20:10:59.746 INFO:teuthology.orchestra.run.trial110.stdout:Nothing to do. 2026-02-13T20:10:59.746 INFO:teuthology.orchestra.run.trial110.stdout:Complete! 2026-02-13T20:10:59.766 DEBUG:teuthology.orchestra.run.trial110:> sudo yum -y install python3-rados 2026-02-13T20:11:00.062 INFO:teuthology.orchestra.run.trial110.stdout:Last metadata expiration check: 0:01:17 ago on Fri 13 Feb 2026 08:09:43 PM UTC. 2026-02-13T20:11:00.128 INFO:teuthology.orchestra.run.trial110.stdout:Package python3-rados-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-13T20:11:00.147 INFO:teuthology.orchestra.run.trial110.stdout:Dependencies resolved. 2026-02-13T20:11:00.148 INFO:teuthology.orchestra.run.trial110.stdout:Nothing to do. 2026-02-13T20:11:00.148 INFO:teuthology.orchestra.run.trial110.stdout:Complete! 2026-02-13T20:11:00.169 DEBUG:teuthology.orchestra.run.trial110:> sudo yum -y install python3-rgw 2026-02-13T20:11:00.470 INFO:teuthology.orchestra.run.trial110.stdout:Last metadata expiration check: 0:01:17 ago on Fri 13 Feb 2026 08:09:43 PM UTC. 2026-02-13T20:11:00.535 INFO:teuthology.orchestra.run.trial110.stdout:Package python3-rgw-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-13T20:11:00.554 INFO:teuthology.orchestra.run.trial110.stdout:Dependencies resolved. 2026-02-13T20:11:00.554 INFO:teuthology.orchestra.run.trial110.stdout:Nothing to do. 2026-02-13T20:11:00.554 INFO:teuthology.orchestra.run.trial110.stdout:Complete! 2026-02-13T20:11:00.576 DEBUG:teuthology.orchestra.run.trial110:> sudo yum -y install python3-cephfs 2026-02-13T20:11:00.874 INFO:teuthology.orchestra.run.trial110.stdout:Last metadata expiration check: 0:01:17 ago on Fri 13 Feb 2026 08:09:43 PM UTC. 2026-02-13T20:11:00.939 INFO:teuthology.orchestra.run.trial110.stdout:Package python3-cephfs-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-13T20:11:00.958 INFO:teuthology.orchestra.run.trial110.stdout:Dependencies resolved. 2026-02-13T20:11:00.958 INFO:teuthology.orchestra.run.trial110.stdout:Nothing to do. 2026-02-13T20:11:00.959 INFO:teuthology.orchestra.run.trial110.stdout:Complete! 2026-02-13T20:11:00.980 DEBUG:teuthology.orchestra.run.trial110:> sudo yum -y install python3-rbd 2026-02-13T20:11:01.279 INFO:teuthology.orchestra.run.trial110.stdout:Last metadata expiration check: 0:01:18 ago on Fri 13 Feb 2026 08:09:43 PM UTC. 2026-02-13T20:11:01.345 INFO:teuthology.orchestra.run.trial110.stdout:Package python3-rbd-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-13T20:11:01.363 INFO:teuthology.orchestra.run.trial110.stdout:Dependencies resolved. 2026-02-13T20:11:01.364 INFO:teuthology.orchestra.run.trial110.stdout:Nothing to do. 2026-02-13T20:11:01.364 INFO:teuthology.orchestra.run.trial110.stdout:Complete! 2026-02-13T20:11:01.385 DEBUG:teuthology.orchestra.run.trial110:> sudo yum -y install rbd-fuse 2026-02-13T20:11:01.689 INFO:teuthology.orchestra.run.trial110.stdout:Last metadata expiration check: 0:01:18 ago on Fri 13 Feb 2026 08:09:43 PM UTC. 2026-02-13T20:11:01.774 INFO:teuthology.orchestra.run.trial110.stdout:Dependencies resolved. 2026-02-13T20:11:01.774 INFO:teuthology.orchestra.run.trial110.stdout:================================================================================ 2026-02-13T20:11:01.775 INFO:teuthology.orchestra.run.trial110.stdout: Package Architecture Version Repository Size 2026-02-13T20:11:01.775 INFO:teuthology.orchestra.run.trial110.stdout:================================================================================ 2026-02-13T20:11:01.775 INFO:teuthology.orchestra.run.trial110.stdout:Installing: 2026-02-13T20:11:01.775 INFO:teuthology.orchestra.run.trial110.stdout: rbd-fuse x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 84 k 2026-02-13T20:11:01.775 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:01.775 INFO:teuthology.orchestra.run.trial110.stdout:Transaction Summary 2026-02-13T20:11:01.775 INFO:teuthology.orchestra.run.trial110.stdout:================================================================================ 2026-02-13T20:11:01.775 INFO:teuthology.orchestra.run.trial110.stdout:Install 1 Package 2026-02-13T20:11:01.775 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:01.775 INFO:teuthology.orchestra.run.trial110.stdout:Total download size: 84 k 2026-02-13T20:11:01.776 INFO:teuthology.orchestra.run.trial110.stdout:Installed size: 209 k 2026-02-13T20:11:01.776 INFO:teuthology.orchestra.run.trial110.stdout:Downloading Packages: 2026-02-13T20:11:01.855 INFO:teuthology.orchestra.run.trial110.stdout:rbd-fuse-20.3.0-5230.gafefaa40.el9.x86_64.rpm 1.0 MB/s | 84 kB 00:00 2026-02-13T20:11:01.856 INFO:teuthology.orchestra.run.trial110.stdout:-------------------------------------------------------------------------------- 2026-02-13T20:11:01.856 INFO:teuthology.orchestra.run.trial110.stdout:Total 1.0 MB/s | 84 kB 00:00 2026-02-13T20:11:01.856 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction check 2026-02-13T20:11:01.860 INFO:teuthology.orchestra.run.trial110.stdout:Transaction check succeeded. 2026-02-13T20:11:01.860 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction test 2026-02-13T20:11:01.893 INFO:teuthology.orchestra.run.trial110.stdout:Transaction test succeeded. 2026-02-13T20:11:01.893 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction 2026-02-13T20:11:01.944 INFO:teuthology.orchestra.run.trial110.stdout: Preparing : 1/1 2026-02-13T20:11:01.960 INFO:teuthology.orchestra.run.trial110.stdout: Installing : rbd-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-13T20:11:02.039 INFO:teuthology.orchestra.run.trial110.stdout: Running scriptlet: rbd-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-13T20:11:02.097 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : rbd-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-13T20:11:02.098 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:02.098 INFO:teuthology.orchestra.run.trial110.stdout:Installed: 2026-02-13T20:11:02.098 INFO:teuthology.orchestra.run.trial110.stdout: rbd-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:11:02.098 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:02.098 INFO:teuthology.orchestra.run.trial110.stdout:Complete! 2026-02-13T20:11:02.126 DEBUG:teuthology.orchestra.run.trial110:> sudo yum -y install rbd-mirror 2026-02-13T20:11:02.428 INFO:teuthology.orchestra.run.trial110.stdout:Last metadata expiration check: 0:01:19 ago on Fri 13 Feb 2026 08:09:43 PM UTC. 2026-02-13T20:11:02.512 INFO:teuthology.orchestra.run.trial110.stdout:Dependencies resolved. 2026-02-13T20:11:02.513 INFO:teuthology.orchestra.run.trial110.stdout:================================================================================ 2026-02-13T20:11:02.513 INFO:teuthology.orchestra.run.trial110.stdout: Package Arch Version Repo Size 2026-02-13T20:11:02.513 INFO:teuthology.orchestra.run.trial110.stdout:================================================================================ 2026-02-13T20:11:02.513 INFO:teuthology.orchestra.run.trial110.stdout:Installing: 2026-02-13T20:11:02.513 INFO:teuthology.orchestra.run.trial110.stdout: rbd-mirror x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 2.9 M 2026-02-13T20:11:02.513 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:02.513 INFO:teuthology.orchestra.run.trial110.stdout:Transaction Summary 2026-02-13T20:11:02.514 INFO:teuthology.orchestra.run.trial110.stdout:================================================================================ 2026-02-13T20:11:02.514 INFO:teuthology.orchestra.run.trial110.stdout:Install 1 Package 2026-02-13T20:11:02.514 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:02.514 INFO:teuthology.orchestra.run.trial110.stdout:Total download size: 2.9 M 2026-02-13T20:11:02.514 INFO:teuthology.orchestra.run.trial110.stdout:Installed size: 11 M 2026-02-13T20:11:02.514 INFO:teuthology.orchestra.run.trial110.stdout:Downloading Packages: 2026-02-13T20:11:02.658 INFO:teuthology.orchestra.run.trial110.stdout:rbd-mirror-20.3.0-5230.gafefaa40.el9.x86_64.rpm 20 MB/s | 2.9 MB 00:00 2026-02-13T20:11:02.658 INFO:teuthology.orchestra.run.trial110.stdout:-------------------------------------------------------------------------------- 2026-02-13T20:11:02.658 INFO:teuthology.orchestra.run.trial110.stdout:Total 20 MB/s | 2.9 MB 00:00 2026-02-13T20:11:02.658 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction check 2026-02-13T20:11:02.663 INFO:teuthology.orchestra.run.trial110.stdout:Transaction check succeeded. 2026-02-13T20:11:02.663 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction test 2026-02-13T20:11:02.703 INFO:teuthology.orchestra.run.trial110.stdout:Transaction test succeeded. 2026-02-13T20:11:02.703 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction 2026-02-13T20:11:02.879 INFO:teuthology.orchestra.run.trial110.stdout: Preparing : 1/1 2026-02-13T20:11:02.880 INFO:teuthology.orchestra.run.trial110.stdout: Installing : rbd-mirror-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-13T20:11:02.905 INFO:teuthology.orchestra.run.trial110.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-13T20:11:02.905 INFO:teuthology.orchestra.run.trial110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T20:11:02.905 INFO:teuthology.orchestra.run.trial110.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-13T20:11:02.905 INFO:teuthology.orchestra.run.trial110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T20:11:02.905 INFO:teuthology.orchestra.run.trial110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T20:11:02.906 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:03.202 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : rbd-mirror-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-13T20:11:03.203 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:03.203 INFO:teuthology.orchestra.run.trial110.stdout:Installed: 2026-02-13T20:11:03.203 INFO:teuthology.orchestra.run.trial110.stdout: rbd-mirror-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:11:03.203 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:03.203 INFO:teuthology.orchestra.run.trial110.stdout:Complete! 2026-02-13T20:11:03.232 DEBUG:teuthology.orchestra.run.trial110:> sudo yum -y install rbd-nbd 2026-02-13T20:11:03.543 INFO:teuthology.orchestra.run.trial110.stdout:Last metadata expiration check: 0:01:20 ago on Fri 13 Feb 2026 08:09:43 PM UTC. 2026-02-13T20:11:03.628 INFO:teuthology.orchestra.run.trial110.stdout:Dependencies resolved. 2026-02-13T20:11:03.629 INFO:teuthology.orchestra.run.trial110.stdout:================================================================================ 2026-02-13T20:11:03.629 INFO:teuthology.orchestra.run.trial110.stdout: Package Architecture Version Repository Size 2026-02-13T20:11:03.629 INFO:teuthology.orchestra.run.trial110.stdout:================================================================================ 2026-02-13T20:11:03.629 INFO:teuthology.orchestra.run.trial110.stdout:Installing: 2026-02-13T20:11:03.630 INFO:teuthology.orchestra.run.trial110.stdout: rbd-nbd x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 172 k 2026-02-13T20:11:03.630 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:03.630 INFO:teuthology.orchestra.run.trial110.stdout:Transaction Summary 2026-02-13T20:11:03.630 INFO:teuthology.orchestra.run.trial110.stdout:================================================================================ 2026-02-13T20:11:03.630 INFO:teuthology.orchestra.run.trial110.stdout:Install 1 Package 2026-02-13T20:11:03.630 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:03.631 INFO:teuthology.orchestra.run.trial110.stdout:Total download size: 172 k 2026-02-13T20:11:03.631 INFO:teuthology.orchestra.run.trial110.stdout:Installed size: 462 k 2026-02-13T20:11:03.631 INFO:teuthology.orchestra.run.trial110.stdout:Downloading Packages: 2026-02-13T20:11:03.714 INFO:teuthology.orchestra.run.trial110.stdout:rbd-nbd-20.3.0-5230.gafefaa40.el9.x86_64.rpm 2.0 MB/s | 172 kB 00:00 2026-02-13T20:11:03.714 INFO:teuthology.orchestra.run.trial110.stdout:-------------------------------------------------------------------------------- 2026-02-13T20:11:03.714 INFO:teuthology.orchestra.run.trial110.stdout:Total 2.0 MB/s | 172 kB 00:00 2026-02-13T20:11:03.714 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction check 2026-02-13T20:11:03.718 INFO:teuthology.orchestra.run.trial110.stdout:Transaction check succeeded. 2026-02-13T20:11:03.718 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction test 2026-02-13T20:11:03.750 INFO:teuthology.orchestra.run.trial110.stdout:Transaction test succeeded. 2026-02-13T20:11:03.750 INFO:teuthology.orchestra.run.trial110.stdout:Running transaction 2026-02-13T20:11:03.805 INFO:teuthology.orchestra.run.trial110.stdout: Preparing : 1/1 2026-02-13T20:11:03.822 INFO:teuthology.orchestra.run.trial110.stdout: Installing : rbd-nbd-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-13T20:11:03.899 INFO:teuthology.orchestra.run.trial110.stdout: Running scriptlet: rbd-nbd-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-13T20:11:03.956 INFO:teuthology.orchestra.run.trial110.stdout: Verifying : rbd-nbd-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-13T20:11:03.956 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:03.956 INFO:teuthology.orchestra.run.trial110.stdout:Installed: 2026-02-13T20:11:03.957 INFO:teuthology.orchestra.run.trial110.stdout: rbd-nbd-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-13T20:11:03.957 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:03.957 INFO:teuthology.orchestra.run.trial110.stdout:Complete! 2026-02-13T20:11:03.989 DEBUG:teuthology.parallel:result is None 2026-02-13T20:11:03.990 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=afefaa40503a4bf024e96f97dd7f852b75f00ad6 2026-02-13T20:11:04.160 DEBUG:teuthology.orchestra.run.trial110:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-13T20:11:04.179 INFO:teuthology.orchestra.run.trial110.stdout:20.3.0-5230.gafefaa40.el9 2026-02-13T20:11:04.180 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5230.gafefaa40.el9 2026-02-13T20:11:04.180 INFO:teuthology.task.install:The correct ceph version 20.3.0-5230.gafefaa40 is installed. 2026-02-13T20:11:04.182 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=afefaa40503a4bf024e96f97dd7f852b75f00ad6 2026-02-13T20:11:04.326 DEBUG:teuthology.orchestra.run.trial188:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-13T20:11:04.347 INFO:teuthology.orchestra.run.trial188.stdout:20.3.0-5230.gafefaa40.el9 2026-02-13T20:11:04.348 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5230.gafefaa40.el9 2026-02-13T20:11:04.348 INFO:teuthology.task.install:The correct ceph version 20.3.0-5230.gafefaa40 is installed. 2026-02-13T20:11:04.352 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-13T20:11:04.352 DEBUG:teuthology.orchestra.run.trial110:> set -ex 2026-02-13T20:11:04.352 DEBUG:teuthology.orchestra.run.trial110:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-13T20:11:04.379 DEBUG:teuthology.orchestra.run.trial188:> set -ex 2026-02-13T20:11:04.380 DEBUG:teuthology.orchestra.run.trial188:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-13T20:11:04.415 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-13T20:11:04.415 DEBUG:teuthology.orchestra.run.trial110:> set -ex 2026-02-13T20:11:04.415 DEBUG:teuthology.orchestra.run.trial110:> sudo dd of=/usr/bin/daemon-helper 2026-02-13T20:11:04.444 DEBUG:teuthology.orchestra.run.trial110:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-13T20:11:04.507 DEBUG:teuthology.orchestra.run.trial188:> set -ex 2026-02-13T20:11:04.507 DEBUG:teuthology.orchestra.run.trial188:> sudo dd of=/usr/bin/daemon-helper 2026-02-13T20:11:04.533 DEBUG:teuthology.orchestra.run.trial188:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-13T20:11:04.599 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-13T20:11:04.599 DEBUG:teuthology.orchestra.run.trial110:> set -ex 2026-02-13T20:11:04.599 DEBUG:teuthology.orchestra.run.trial110:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-13T20:11:04.625 DEBUG:teuthology.orchestra.run.trial110:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-13T20:11:04.691 DEBUG:teuthology.orchestra.run.trial188:> set -ex 2026-02-13T20:11:04.691 DEBUG:teuthology.orchestra.run.trial188:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-13T20:11:04.715 DEBUG:teuthology.orchestra.run.trial188:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-13T20:11:04.779 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-13T20:11:04.779 DEBUG:teuthology.orchestra.run.trial110:> set -ex 2026-02-13T20:11:04.779 DEBUG:teuthology.orchestra.run.trial110:> sudo dd of=/usr/bin/stdin-killer 2026-02-13T20:11:04.804 DEBUG:teuthology.orchestra.run.trial110:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-13T20:11:04.869 DEBUG:teuthology.orchestra.run.trial188:> set -ex 2026-02-13T20:11:04.869 DEBUG:teuthology.orchestra.run.trial188:> sudo dd of=/usr/bin/stdin-killer 2026-02-13T20:11:04.894 DEBUG:teuthology.orchestra.run.trial188:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-13T20:11:04.958 INFO:teuthology.run_tasks:Running task ceph... 2026-02-13T20:11:05.068 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-13T20:11:05.068 DEBUG:teuthology.orchestra.run.trial110:> sudo chmod 777 /var/log/ceph 2026-02-13T20:11:05.070 DEBUG:teuthology.orchestra.run.trial188:> sudo chmod 777 /var/log/ceph 2026-02-13T20:11:05.095 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-13T20:11:05.095 DEBUG:teuthology.orchestra.run.trial110:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-13T20:11:05.135 DEBUG:teuthology.orchestra.run.trial188:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-13T20:11:05.158 INFO:tasks.ceph:Creating extra log directories... 2026-02-13T20:11:05.158 DEBUG:teuthology.orchestra.run.trial110:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-13T20:11:05.198 DEBUG:teuthology.orchestra.run.trial188:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-13T20:11:05.240 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-13T20:11:05.240 INFO:tasks.ceph:config {'conf': {'client': {'debug monc': 20, 'debug ms': 1}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 30, 'debug ms': 20, 'debug paxos': 20, 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos service trim min': 5}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zlib', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore onode segment size': '256K', 'bluestore write v2': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd op num shards': 1, 'osd op num threads per shard': 2, 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd_mclock_skip_benchmark': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'ScrubResult', 'scrub mismatch', 'overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_AVAILABILITY\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(OSD_SLOW_PING_TIME', '\\(MON_NETSPLIT)', 'overall HEALTH_', '\\(MON_DOWN\\)', '\\(TOO_FEW_PGS\\)', '\\(POOL_APP_NOT_ENABLED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': False, 'mon_bind_addrvec': True} 2026-02-13T20:11:05.241 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-13_16:37:03-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/49987', 'branch': 'wip-yuri4-testing-2026-02-11-2126', 'description': 'rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/{bluestore/{alloc$/{stupid} base mem$/{low} onode-segment$/{256K} write$/{v2/{compr$/{yes$/{zlib}} v2}}}} rados supported-random-distro$/{centos_latest} thrashers/force-sync-many workloads/snaps-few-objects}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'flavor': 'default', 'job_id': '49987', 'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'yuriw-2026-02-13_16:37:03-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuri4-testing-2026-02-11-2126'}, 'ceph': {'conf': {'client': {'debug monc': 20, 'debug ms': 1}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 30, 'debug ms': 20, 'debug paxos': 20, 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos service trim min': 5}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zlib', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore onode segment size': '256K', 'bluestore write v2': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd op num shards': 1, 'osd op num threads per shard': 2, 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd_mclock_skip_benchmark': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'ScrubResult', 'scrub mismatch', 'overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_AVAILABILITY\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(OSD_SLOW_PING_TIME', '\\(MON_NETSPLIT)', 'overall HEALTH_', '\\(MON_DOWN\\)', '\\(TOO_FEW_PGS\\)', '\\(POOL_APP_NOT_ENABLED\\)'], 'mon_bind_msgr2': False, 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri4-testing-2026-02-11-2126', 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6'}}, 'owner': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'priority': 69, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'osd.0', 'osd.1', 'osd.2'], ['mon.b', 'mgr.x', 'osd.3', 'osd.4', 'osd.5', 'client.0']], 'seed': 5319, 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-yuri4-testing-2026-02-11-2126', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_afefaa40503a4bf024e96f97dd7f852b75f00ad6/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6', 'targets': {'trial110.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD8UsWvzq8QgRO1jRYTg3zOV8Lj8OnP+NIaES1DrBEFvcS5jOg8ATdnrfv1d62tllvgl0xbPdVBywSgnkeE2kVk=', 'trial188.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO4vRdE2q3oZf4dVkbdQhN4dUkZuNBEQ0p9a0F9E+1L9DaH9gz8hGRX8Ih3Jhrdb/YmtWdacO6psxLbNmC11SYc='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'mon_thrash': {'revive_delay': 90, 'store_thrash': True, 'thrash_delay': 1, 'thrash_many': True}}, {'rados': {'clients': ['client.0'], 'objects': 50, 'op_weights': {'copy_from': 50, 'delete': 50, 'read': 100, 'rollback': 50, 'snap_create': 50, 'snap_remove': 50, 'write': 100}, 'ops': 4000}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '8bec0da71becad44414c54979f64c9ef0e7099c6', 'timestamp': '2026-02-13_16:37:03', 'tube': 'trial', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3932482'} 2026-02-13T20:11:05.242 DEBUG:teuthology.orchestra.run.trial110:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-13T20:11:05.264 DEBUG:teuthology.orchestra.run.trial188:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-13T20:11:05.281 DEBUG:teuthology.orchestra.run.trial110:> sudo install -d -m0777 -- /var/run/ceph 2026-02-13T20:11:05.320 DEBUG:teuthology.orchestra.run.trial188:> sudo install -d -m0777 -- /var/run/ceph 2026-02-13T20:11:05.346 DEBUG:teuthology.orchestra.run.trial110:> set -ex 2026-02-13T20:11:05.346 DEBUG:teuthology.orchestra.run.trial110:> dd if=/scratch_devs of=/dev/stdout 2026-02-13T20:11:05.400 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-13T20:11:05.400 DEBUG:teuthology.orchestra.run.trial110:> stat /dev/vg_nvme/lv_1 2026-02-13T20:11:05.456 INFO:teuthology.orchestra.run.trial110.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-13T20:11:05.456 INFO:teuthology.orchestra.run.trial110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T20:11:05.456 INFO:teuthology.orchestra.run.trial110.stdout:Device: 6h/6d Inode: 910 Links: 1 2026-02-13T20:11:05.456 INFO:teuthology.orchestra.run.trial110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T20:11:05.456 INFO:teuthology.orchestra.run.trial110.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T20:11:05.456 INFO:teuthology.orchestra.run.trial110.stdout:Access: 2026-02-13 20:11:03.045545513 +0000 2026-02-13T20:11:05.456 INFO:teuthology.orchestra.run.trial110.stdout:Modify: 2026-02-13 20:09:12.658148330 +0000 2026-02-13T20:11:05.456 INFO:teuthology.orchestra.run.trial110.stdout:Change: 2026-02-13 20:09:12.658148330 +0000 2026-02-13T20:11:05.456 INFO:teuthology.orchestra.run.trial110.stdout: Birth: 2026-02-13 20:09:12.658148330 +0000 2026-02-13T20:11:05.457 DEBUG:teuthology.orchestra.run.trial110:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-13T20:11:05.518 INFO:teuthology.orchestra.run.trial110.stderr:1+0 records in 2026-02-13T20:11:05.519 INFO:teuthology.orchestra.run.trial110.stderr:1+0 records out 2026-02-13T20:11:05.519 INFO:teuthology.orchestra.run.trial110.stderr:512 bytes copied, 0.000158414 s, 3.2 MB/s 2026-02-13T20:11:05.520 DEBUG:teuthology.orchestra.run.trial110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-13T20:11:05.577 DEBUG:teuthology.orchestra.run.trial110:> stat /dev/vg_nvme/lv_2 2026-02-13T20:11:05.633 INFO:teuthology.orchestra.run.trial110.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-13T20:11:05.633 INFO:teuthology.orchestra.run.trial110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T20:11:05.634 INFO:teuthology.orchestra.run.trial110.stdout:Device: 6h/6d Inode: 939 Links: 1 2026-02-13T20:11:05.634 INFO:teuthology.orchestra.run.trial110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T20:11:05.634 INFO:teuthology.orchestra.run.trial110.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T20:11:05.634 INFO:teuthology.orchestra.run.trial110.stdout:Access: 2026-02-13 20:11:03.045545513 +0000 2026-02-13T20:11:05.634 INFO:teuthology.orchestra.run.trial110.stdout:Modify: 2026-02-13 20:09:12.886143121 +0000 2026-02-13T20:11:05.634 INFO:teuthology.orchestra.run.trial110.stdout:Change: 2026-02-13 20:09:12.886143121 +0000 2026-02-13T20:11:05.634 INFO:teuthology.orchestra.run.trial110.stdout: Birth: 2026-02-13 20:09:12.886143121 +0000 2026-02-13T20:11:05.634 DEBUG:teuthology.orchestra.run.trial110:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-13T20:11:05.698 INFO:teuthology.orchestra.run.trial110.stderr:1+0 records in 2026-02-13T20:11:05.698 INFO:teuthology.orchestra.run.trial110.stderr:1+0 records out 2026-02-13T20:11:05.699 INFO:teuthology.orchestra.run.trial110.stderr:512 bytes copied, 0.000153095 s, 3.3 MB/s 2026-02-13T20:11:05.700 DEBUG:teuthology.orchestra.run.trial110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-13T20:11:05.757 DEBUG:teuthology.orchestra.run.trial110:> stat /dev/vg_nvme/lv_3 2026-02-13T20:11:05.813 INFO:teuthology.orchestra.run.trial110.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-13T20:11:05.813 INFO:teuthology.orchestra.run.trial110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T20:11:05.813 INFO:teuthology.orchestra.run.trial110.stdout:Device: 6h/6d Inode: 968 Links: 1 2026-02-13T20:11:05.813 INFO:teuthology.orchestra.run.trial110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T20:11:05.813 INFO:teuthology.orchestra.run.trial110.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T20:11:05.813 INFO:teuthology.orchestra.run.trial110.stdout:Access: 2026-02-13 20:11:03.045545513 +0000 2026-02-13T20:11:05.814 INFO:teuthology.orchestra.run.trial110.stdout:Modify: 2026-02-13 20:09:13.157136929 +0000 2026-02-13T20:11:05.814 INFO:teuthology.orchestra.run.trial110.stdout:Change: 2026-02-13 20:09:13.157136929 +0000 2026-02-13T20:11:05.814 INFO:teuthology.orchestra.run.trial110.stdout: Birth: 2026-02-13 20:09:13.157136929 +0000 2026-02-13T20:11:05.814 DEBUG:teuthology.orchestra.run.trial110:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-13T20:11:05.875 INFO:teuthology.orchestra.run.trial110.stderr:1+0 records in 2026-02-13T20:11:05.876 INFO:teuthology.orchestra.run.trial110.stderr:1+0 records out 2026-02-13T20:11:05.876 INFO:teuthology.orchestra.run.trial110.stderr:512 bytes copied, 0.000137726 s, 3.7 MB/s 2026-02-13T20:11:05.877 DEBUG:teuthology.orchestra.run.trial110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-13T20:11:05.934 DEBUG:teuthology.orchestra.run.trial110:> stat /dev/vg_nvme/lv_4 2026-02-13T20:11:05.990 INFO:teuthology.orchestra.run.trial110.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-13T20:11:05.990 INFO:teuthology.orchestra.run.trial110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T20:11:05.990 INFO:teuthology.orchestra.run.trial110.stdout:Device: 6h/6d Inode: 997 Links: 1 2026-02-13T20:11:05.991 INFO:teuthology.orchestra.run.trial110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T20:11:05.991 INFO:teuthology.orchestra.run.trial110.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T20:11:05.991 INFO:teuthology.orchestra.run.trial110.stdout:Access: 2026-02-13 20:11:03.046545491 +0000 2026-02-13T20:11:05.991 INFO:teuthology.orchestra.run.trial110.stdout:Modify: 2026-02-13 20:09:13.414131058 +0000 2026-02-13T20:11:05.991 INFO:teuthology.orchestra.run.trial110.stdout:Change: 2026-02-13 20:09:13.414131058 +0000 2026-02-13T20:11:05.991 INFO:teuthology.orchestra.run.trial110.stdout: Birth: 2026-02-13 20:09:13.414131058 +0000 2026-02-13T20:11:05.991 DEBUG:teuthology.orchestra.run.trial110:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-13T20:11:06.053 INFO:teuthology.orchestra.run.trial110.stderr:1+0 records in 2026-02-13T20:11:06.053 INFO:teuthology.orchestra.run.trial110.stderr:1+0 records out 2026-02-13T20:11:06.053 INFO:teuthology.orchestra.run.trial110.stderr:512 bytes copied, 0.000160739 s, 3.2 MB/s 2026-02-13T20:11:06.054 DEBUG:teuthology.orchestra.run.trial110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-13T20:11:06.113 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-13T20:11:06.114 DEBUG:teuthology.orchestra.run.trial188:> set -ex 2026-02-13T20:11:06.114 DEBUG:teuthology.orchestra.run.trial188:> dd if=/scratch_devs of=/dev/stdout 2026-02-13T20:11:06.132 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-13T20:11:06.132 DEBUG:teuthology.orchestra.run.trial188:> stat /dev/vg_nvme/lv_1 2026-02-13T20:11:06.188 INFO:teuthology.orchestra.run.trial188.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-13T20:11:06.188 INFO:teuthology.orchestra.run.trial188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T20:11:06.188 INFO:teuthology.orchestra.run.trial188.stdout:Device: 6h/6d Inode: 912 Links: 1 2026-02-13T20:11:06.189 INFO:teuthology.orchestra.run.trial188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T20:11:06.189 INFO:teuthology.orchestra.run.trial188.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T20:11:06.189 INFO:teuthology.orchestra.run.trial188.stdout:Access: 2026-02-13 20:10:55.972778422 +0000 2026-02-13T20:11:06.189 INFO:teuthology.orchestra.run.trial188.stdout:Modify: 2026-02-13 20:09:12.666266587 +0000 2026-02-13T20:11:06.189 INFO:teuthology.orchestra.run.trial188.stdout:Change: 2026-02-13 20:09:12.666266587 +0000 2026-02-13T20:11:06.189 INFO:teuthology.orchestra.run.trial188.stdout: Birth: 2026-02-13 20:09:12.666266587 +0000 2026-02-13T20:11:06.189 DEBUG:teuthology.orchestra.run.trial188:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-13T20:11:06.250 INFO:teuthology.orchestra.run.trial188.stderr:1+0 records in 2026-02-13T20:11:06.250 INFO:teuthology.orchestra.run.trial188.stderr:1+0 records out 2026-02-13T20:11:06.250 INFO:teuthology.orchestra.run.trial188.stderr:512 bytes copied, 0.000164929 s, 3.1 MB/s 2026-02-13T20:11:06.251 DEBUG:teuthology.orchestra.run.trial188:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-13T20:11:06.308 DEBUG:teuthology.orchestra.run.trial188:> stat /dev/vg_nvme/lv_2 2026-02-13T20:11:06.365 INFO:teuthology.orchestra.run.trial188.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-13T20:11:06.365 INFO:teuthology.orchestra.run.trial188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T20:11:06.365 INFO:teuthology.orchestra.run.trial188.stdout:Device: 6h/6d Inode: 939 Links: 1 2026-02-13T20:11:06.365 INFO:teuthology.orchestra.run.trial188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T20:11:06.366 INFO:teuthology.orchestra.run.trial188.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T20:11:06.366 INFO:teuthology.orchestra.run.trial188.stdout:Access: 2026-02-13 20:10:55.972778422 +0000 2026-02-13T20:11:06.366 INFO:teuthology.orchestra.run.trial188.stdout:Modify: 2026-02-13 20:09:12.899268302 +0000 2026-02-13T20:11:06.366 INFO:teuthology.orchestra.run.trial188.stdout:Change: 2026-02-13 20:09:12.899268302 +0000 2026-02-13T20:11:06.366 INFO:teuthology.orchestra.run.trial188.stdout: Birth: 2026-02-13 20:09:12.899268302 +0000 2026-02-13T20:11:06.366 DEBUG:teuthology.orchestra.run.trial188:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-13T20:11:06.430 INFO:teuthology.orchestra.run.trial188.stderr:1+0 records in 2026-02-13T20:11:06.430 INFO:teuthology.orchestra.run.trial188.stderr:1+0 records out 2026-02-13T20:11:06.431 INFO:teuthology.orchestra.run.trial188.stderr:512 bytes copied, 0.000151073 s, 3.4 MB/s 2026-02-13T20:11:06.432 DEBUG:teuthology.orchestra.run.trial188:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-13T20:11:06.489 DEBUG:teuthology.orchestra.run.trial188:> stat /dev/vg_nvme/lv_3 2026-02-13T20:11:06.546 INFO:teuthology.orchestra.run.trial188.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-13T20:11:06.546 INFO:teuthology.orchestra.run.trial188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T20:11:06.546 INFO:teuthology.orchestra.run.trial188.stdout:Device: 6h/6d Inode: 970 Links: 1 2026-02-13T20:11:06.546 INFO:teuthology.orchestra.run.trial188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T20:11:06.546 INFO:teuthology.orchestra.run.trial188.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T20:11:06.546 INFO:teuthology.orchestra.run.trial188.stdout:Access: 2026-02-13 20:10:55.973778422 +0000 2026-02-13T20:11:06.547 INFO:teuthology.orchestra.run.trial188.stdout:Modify: 2026-02-13 20:09:13.147270128 +0000 2026-02-13T20:11:06.547 INFO:teuthology.orchestra.run.trial188.stdout:Change: 2026-02-13 20:09:13.147270128 +0000 2026-02-13T20:11:06.547 INFO:teuthology.orchestra.run.trial188.stdout: Birth: 2026-02-13 20:09:13.147270128 +0000 2026-02-13T20:11:06.547 DEBUG:teuthology.orchestra.run.trial188:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-13T20:11:06.609 INFO:teuthology.orchestra.run.trial188.stderr:1+0 records in 2026-02-13T20:11:06.610 INFO:teuthology.orchestra.run.trial188.stderr:1+0 records out 2026-02-13T20:11:06.610 INFO:teuthology.orchestra.run.trial188.stderr:512 bytes copied, 0.000144511 s, 3.5 MB/s 2026-02-13T20:11:06.611 DEBUG:teuthology.orchestra.run.trial188:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-13T20:11:06.667 DEBUG:teuthology.orchestra.run.trial188:> stat /dev/vg_nvme/lv_4 2026-02-13T20:11:06.723 INFO:teuthology.orchestra.run.trial188.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-13T20:11:06.723 INFO:teuthology.orchestra.run.trial188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T20:11:06.724 INFO:teuthology.orchestra.run.trial188.stdout:Device: 6h/6d Inode: 995 Links: 1 2026-02-13T20:11:06.724 INFO:teuthology.orchestra.run.trial188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T20:11:06.724 INFO:teuthology.orchestra.run.trial188.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T20:11:06.724 INFO:teuthology.orchestra.run.trial188.stdout:Access: 2026-02-13 20:10:55.973778422 +0000 2026-02-13T20:11:06.724 INFO:teuthology.orchestra.run.trial188.stdout:Modify: 2026-02-13 20:09:13.371271777 +0000 2026-02-13T20:11:06.724 INFO:teuthology.orchestra.run.trial188.stdout:Change: 2026-02-13 20:09:13.371271777 +0000 2026-02-13T20:11:06.724 INFO:teuthology.orchestra.run.trial188.stdout: Birth: 2026-02-13 20:09:13.371271777 +0000 2026-02-13T20:11:06.725 DEBUG:teuthology.orchestra.run.trial188:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-13T20:11:06.787 INFO:teuthology.orchestra.run.trial188.stderr:1+0 records in 2026-02-13T20:11:06.788 INFO:teuthology.orchestra.run.trial188.stderr:1+0 records out 2026-02-13T20:11:06.788 INFO:teuthology.orchestra.run.trial188.stderr:512 bytes copied, 0.00015479 s, 3.3 MB/s 2026-02-13T20:11:06.789 DEBUG:teuthology.orchestra.run.trial188:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-13T20:11:06.846 INFO:tasks.ceph:osd dev map: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2026-02-13T20:11:06.846 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial110.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@trial188.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2026-02-13T20:11:06.846 INFO:tasks.ceph:Generating config... 2026-02-13T20:11:06.849 INFO:tasks.ceph:[client] debug monc = 20 2026-02-13T20:11:06.849 INFO:tasks.ceph:[client] debug ms = 1 2026-02-13T20:11:06.850 INFO:tasks.ceph:[global] mon client directed command retry = 5 2026-02-13T20:11:06.850 INFO:tasks.ceph:[global] mon election default strategy = 3 2026-02-13T20:11:06.850 INFO:tasks.ceph:[global] ms bind msgr2 = False 2026-02-13T20:11:06.850 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2026-02-13T20:11:06.850 INFO:tasks.ceph:[global] ms type = async 2026-02-13T20:11:06.850 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-13T20:11:06.850 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-13T20:11:06.850 INFO:tasks.ceph:[mon] debug mon = 30 2026-02-13T20:11:06.850 INFO:tasks.ceph:[mon] debug ms = 20 2026-02-13T20:11:06.850 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-13T20:11:06.850 INFO:tasks.ceph:[mon] mon min osdmap epochs = 25 2026-02-13T20:11:06.851 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2026-02-13T20:11:06.851 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2026-02-13T20:11:06.851 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2026-02-13T20:11:06.851 INFO:tasks.ceph:[mon] mon scrub inject crc mismatch = 0.01 2026-02-13T20:11:06.851 INFO:tasks.ceph:[mon] mon scrub inject missing keys = 0.05 2026-02-13T20:11:06.851 INFO:tasks.ceph:[mon] mon scrub interval = 300 2026-02-13T20:11:06.851 INFO:tasks.ceph:[mon] paxos service trim min = 5 2026-02-13T20:11:06.851 INFO:tasks.ceph:[osd] bdev async discard = True 2026-02-13T20:11:06.851 INFO:tasks.ceph:[osd] bdev enable discard = True 2026-02-13T20:11:06.851 INFO:tasks.ceph:[osd] bluestore allocator = stupid 2026-02-13T20:11:06.851 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2026-02-13T20:11:06.852 INFO:tasks.ceph:[osd] bluestore compression algorithm = zlib 2026-02-13T20:11:06.852 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2026-02-13T20:11:06.852 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2026-02-13T20:11:06.852 INFO:tasks.ceph:[osd] bluestore onode segment size = 256K 2026-02-13T20:11:06.852 INFO:tasks.ceph:[osd] bluestore write v2 = True 2026-02-13T20:11:06.852 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2026-02-13T20:11:06.852 INFO:tasks.ceph:[osd] debug bluefs = 20 2026-02-13T20:11:06.852 INFO:tasks.ceph:[osd] debug bluestore = 20 2026-02-13T20:11:06.852 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-13T20:11:06.852 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-13T20:11:06.852 INFO:tasks.ceph:[osd] debug rocksdb = 10 2026-02-13T20:11:06.852 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2026-02-13T20:11:06.852 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2026-02-13T20:11:06.853 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2026-02-13T20:11:06.853 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2026-02-13T20:11:06.853 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2026-02-13T20:11:06.853 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2026-02-13T20:11:06.853 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2026-02-13T20:11:06.853 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2026-02-13T20:11:06.853 INFO:tasks.ceph:[osd] osd mclock skip benchmark = True 2026-02-13T20:11:06.853 INFO:tasks.ceph:[osd] osd memory target = 1610612736 2026-02-13T20:11:06.853 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2026-02-13T20:11:06.853 INFO:tasks.ceph:[osd] osd op num shards = 1 2026-02-13T20:11:06.853 INFO:tasks.ceph:[osd] osd op num threads per shard = 2 2026-02-13T20:11:06.853 INFO:tasks.ceph:[osd] osd op queue = debug_random 2026-02-13T20:11:06.854 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2026-02-13T20:11:06.854 INFO:tasks.ceph:[osd] osd_mclock_skip_benchmark = True 2026-02-13T20:11:06.854 INFO:tasks.ceph:Setting up mon.a... 2026-02-13T20:11:06.854 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-13T20:11:06.889 INFO:teuthology.orchestra.run.trial110.stdout:creating /etc/ceph/ceph.keyring 2026-02-13T20:11:06.891 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-13T20:11:06.965 DEBUG:teuthology.orchestra.run.trial110:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-13T20:11:07.030 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '[v1:10.20.193.110:6789]'), ('mon.c', '[v1:10.20.193.110:6790]'), ('mon.b', '[v1:10.20.193.188:6789]')] 2026-02-13T20:11:07.031 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '[v1:10.20.193.110:6789],[v1:10.20.193.110:6790],[v1:10.20.193.188:6789]', 'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zlib', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore onode segment size': '256K', 'bluestore write v2': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd op num shards': 1, 'osd op num threads per shard': 2, 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd_mclock_skip_benchmark': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 20, 'debug mon': 30, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos service trim min': 5}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug monc': 20, 'debug ms': 1}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2026-02-13T20:11:07.032 DEBUG:teuthology.orchestra.run.trial110:> set -ex 2026-02-13T20:11:07.032 DEBUG:teuthology.orchestra.run.trial110:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-13T20:11:07.089 DEBUG:teuthology.orchestra.run.trial110:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --addv a '[v1:10.20.193.110:6789]' --addv c '[v1:10.20.193.110:6790]' --addv b '[v1:10.20.193.188:6789]' --print /home/ubuntu/cephtest/ceph.monmap 2026-02-13T20:11:07.162 INFO:teuthology.orchestra.run.trial110.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-13T20:11:07.162 INFO:teuthology.orchestra.run.trial110.stdout:monmaptool: generated fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:07.162 INFO:teuthology.orchestra.run.trial110.stdout:setting min_mon_release = tentacle 2026-02-13T20:11:07.162 INFO:teuthology.orchestra.run.trial110.stdout:epoch 0 2026-02-13T20:11:07.162 INFO:teuthology.orchestra.run.trial110.stdout:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:07.163 INFO:teuthology.orchestra.run.trial110.stdout:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:07.163 INFO:teuthology.orchestra.run.trial110.stdout:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:07.163 INFO:teuthology.orchestra.run.trial110.stdout:min_mon_release 20 (tentacle) 2026-02-13T20:11:07.163 INFO:teuthology.orchestra.run.trial110.stdout:election_strategy: 3 2026-02-13T20:11:07.163 INFO:teuthology.orchestra.run.trial110.stdout:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:07.163 INFO:teuthology.orchestra.run.trial110.stdout:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:07.163 INFO:teuthology.orchestra.run.trial110.stdout:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:07.163 INFO:teuthology.orchestra.run.trial110.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2026-02-13T20:11:07.165 DEBUG:teuthology.orchestra.run.trial110:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-13T20:11:07.222 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID edd4d072-2e11-43ec-9240-2fd608d0b4f8... 2026-02-13T20:11:07.223 DEBUG:teuthology.orchestra.run.trial110:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-13T20:11:07.264 DEBUG:teuthology.orchestra.run.trial188:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-13T20:11:07.300 INFO:teuthology.orchestra.run.trial110.stdout:[global] 2026-02-13T20:11:07.300 INFO:teuthology.orchestra.run.trial110.stdout: chdir = "" 2026-02-13T20:11:07.300 INFO:teuthology.orchestra.run.trial110.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-13T20:11:07.300 INFO:teuthology.orchestra.run.trial110.stdout: auth supported = cephx 2026-02-13T20:11:07.300 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:07.300 INFO:teuthology.orchestra.run.trial110.stdout: filestore xattr use omap = true 2026-02-13T20:11:07.301 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:07.301 INFO:teuthology.orchestra.run.trial110.stdout: mon clock drift allowed = 1.000 2026-02-13T20:11:07.301 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:07.301 INFO:teuthology.orchestra.run.trial110.stdout: osd crush chooseleaf type = 0 2026-02-13T20:11:07.301 INFO:teuthology.orchestra.run.trial110.stdout: auth debug = true 2026-02-13T20:11:07.301 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:07.301 INFO:teuthology.orchestra.run.trial110.stdout: ms die on old message = true 2026-02-13T20:11:07.301 INFO:teuthology.orchestra.run.trial110.stdout: ms die on bug = true 2026-02-13T20:11:07.301 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:07.301 INFO:teuthology.orchestra.run.trial110.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-13T20:11:07.301 INFO:teuthology.orchestra.run.trial110.stdout: mon pg warn max object skew = 0 2026-02-13T20:11:07.301 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:07.301 INFO:teuthology.orchestra.run.trial110.stdout: # disable pg_autoscaler by default for new pools 2026-02-13T20:11:07.301 INFO:teuthology.orchestra.run.trial110.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-13T20:11:07.301 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:07.301 INFO:teuthology.orchestra.run.trial110.stdout: osd pool default size = 2 2026-02-13T20:11:07.301 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:07.301 INFO:teuthology.orchestra.run.trial110.stdout: mon osd allow primary affinity = true 2026-02-13T20:11:07.301 INFO:teuthology.orchestra.run.trial110.stdout: mon osd allow pg remap = true 2026-02-13T20:11:07.301 INFO:teuthology.orchestra.run.trial110.stdout: mon warn on legacy crush tunables = false 2026-02-13T20:11:07.301 INFO:teuthology.orchestra.run.trial110.stdout: mon warn on crush straw calc version zero = false 2026-02-13T20:11:07.301 INFO:teuthology.orchestra.run.trial110.stdout: mon warn on no sortbitwise = false 2026-02-13T20:11:07.301 INFO:teuthology.orchestra.run.trial110.stdout: mon warn on osd down out interval zero = false 2026-02-13T20:11:07.301 INFO:teuthology.orchestra.run.trial110.stdout: mon warn on too few osds = false 2026-02-13T20:11:07.301 INFO:teuthology.orchestra.run.trial110.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-13T20:11:07.301 INFO:teuthology.orchestra.run.trial110.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-13T20:11:07.301 INFO:teuthology.orchestra.run.trial110.stdout: mon_allow_pool_size_one = true 2026-02-13T20:11:07.301 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:07.301 INFO:teuthology.orchestra.run.trial110.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-13T20:11:07.301 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:07.301 INFO:teuthology.orchestra.run.trial110.stdout: osd default data pool replay window = 5 2026-02-13T20:11:07.301 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:07.301 INFO:teuthology.orchestra.run.trial110.stdout: mon allow pool delete = true 2026-02-13T20:11:07.301 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:07.301 INFO:teuthology.orchestra.run.trial110.stdout: mon cluster log file level = debug 2026-02-13T20:11:07.301 INFO:teuthology.orchestra.run.trial110.stdout: debug asserts on shutdown = true 2026-02-13T20:11:07.302 INFO:teuthology.orchestra.run.trial110.stdout: mon health detail to clog = false 2026-02-13T20:11:07.302 INFO:teuthology.orchestra.run.trial110.stdout: mon host = "[v1:10.20.193.110:6789],[v1:10.20.193.110:6790],[v1:10.20.193.188:6789]" 2026-02-13T20:11:07.302 INFO:teuthology.orchestra.run.trial110.stdout: mon client directed command retry = 5 2026-02-13T20:11:07.302 INFO:teuthology.orchestra.run.trial110.stdout: mon election default strategy = 3 2026-02-13T20:11:07.302 INFO:teuthology.orchestra.run.trial110.stdout: ms bind msgr2 = False 2026-02-13T20:11:07.302 INFO:teuthology.orchestra.run.trial110.stdout: ms inject socket failures = 5000 2026-02-13T20:11:07.302 INFO:teuthology.orchestra.run.trial110.stdout: ms type = async 2026-02-13T20:11:07.302 INFO:teuthology.orchestra.run.trial110.stdout: fsid = edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:07.302 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:07.302 INFO:teuthology.orchestra.run.trial110.stdout:[osd] 2026-02-13T20:11:07.302 INFO:teuthology.orchestra.run.trial110.stdout: osd journal size = 100 2026-02-13T20:11:07.302 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:07.302 INFO:teuthology.orchestra.run.trial110.stdout: osd scrub load threshold = 5.0 2026-02-13T20:11:07.302 INFO:teuthology.orchestra.run.trial110.stdout: osd scrub max interval = 600 2026-02-13T20:11:07.302 INFO:teuthology.orchestra.run.trial110.stdout: osd mclock profile = high_recovery_ops 2026-02-13T20:11:07.302 INFO:teuthology.orchestra.run.trial110.stdout: osd mclock skip benchmark = True 2026-02-13T20:11:07.302 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:07.302 INFO:teuthology.orchestra.run.trial110.stdout: osd recover clone overlap = true 2026-02-13T20:11:07.302 INFO:teuthology.orchestra.run.trial110.stdout: osd recovery max chunk = 1048576 2026-02-13T20:11:07.302 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:07.302 INFO:teuthology.orchestra.run.trial110.stdout: osd debug shutdown = true 2026-02-13T20:11:07.302 INFO:teuthology.orchestra.run.trial110.stdout: osd debug op order = true 2026-02-13T20:11:07.302 INFO:teuthology.orchestra.run.trial110.stdout: osd debug verify stray on activate = true 2026-02-13T20:11:07.302 INFO:teuthology.orchestra.run.trial110.stdout: osd debug trim objects = true 2026-02-13T20:11:07.302 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:07.302 INFO:teuthology.orchestra.run.trial110.stdout: osd open classes on start = true 2026-02-13T20:11:07.302 INFO:teuthology.orchestra.run.trial110.stdout: osd debug pg log writeout = true 2026-02-13T20:11:07.302 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:07.302 INFO:teuthology.orchestra.run.trial110.stdout: osd deep scrub update digest min age = 30 2026-02-13T20:11:07.302 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:07.302 INFO:teuthology.orchestra.run.trial110.stdout: osd map max advance = 10 2026-02-13T20:11:07.302 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:07.302 INFO:teuthology.orchestra.run.trial110.stdout: journal zero on create = true 2026-02-13T20:11:07.302 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:07.302 INFO:teuthology.orchestra.run.trial110.stdout: filestore ondisk finisher threads = 3 2026-02-13T20:11:07.302 INFO:teuthology.orchestra.run.trial110.stdout: filestore apply finisher threads = 3 2026-02-13T20:11:07.302 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:07.302 INFO:teuthology.orchestra.run.trial110.stdout: bdev debug aio = true 2026-02-13T20:11:07.303 INFO:teuthology.orchestra.run.trial110.stdout: osd debug misdirected ops = true 2026-02-13T20:11:07.303 INFO:teuthology.orchestra.run.trial110.stdout: bdev async discard = True 2026-02-13T20:11:07.303 INFO:teuthology.orchestra.run.trial110.stdout: bdev enable discard = True 2026-02-13T20:11:07.303 INFO:teuthology.orchestra.run.trial110.stdout: bluestore allocator = stupid 2026-02-13T20:11:07.303 INFO:teuthology.orchestra.run.trial110.stdout: bluestore block size = 96636764160 2026-02-13T20:11:07.303 INFO:teuthology.orchestra.run.trial110.stdout: bluestore compression algorithm = zlib 2026-02-13T20:11:07.303 INFO:teuthology.orchestra.run.trial110.stdout: bluestore compression mode = aggressive 2026-02-13T20:11:07.303 INFO:teuthology.orchestra.run.trial110.stdout: bluestore fsck on mount = True 2026-02-13T20:11:07.303 INFO:teuthology.orchestra.run.trial110.stdout: bluestore onode segment size = 256K 2026-02-13T20:11:07.303 INFO:teuthology.orchestra.run.trial110.stdout: bluestore write v2 = True 2026-02-13T20:11:07.303 INFO:teuthology.orchestra.run.trial110.stdout: bluestore zero block detection = True 2026-02-13T20:11:07.303 INFO:teuthology.orchestra.run.trial110.stdout: debug bluefs = 20 2026-02-13T20:11:07.303 INFO:teuthology.orchestra.run.trial110.stdout: debug bluestore = 20 2026-02-13T20:11:07.303 INFO:teuthology.orchestra.run.trial110.stdout: debug ms = 1 2026-02-13T20:11:07.303 INFO:teuthology.orchestra.run.trial110.stdout: debug osd = 20 2026-02-13T20:11:07.303 INFO:teuthology.orchestra.run.trial110.stdout: debug rocksdb = 10 2026-02-13T20:11:07.303 INFO:teuthology.orchestra.run.trial110.stdout: mon osd backfillfull_ratio = 0.85 2026-02-13T20:11:07.303 INFO:teuthology.orchestra.run.trial110.stdout: mon osd full ratio = 0.9 2026-02-13T20:11:07.303 INFO:teuthology.orchestra.run.trial110.stdout: mon osd nearfull ratio = 0.8 2026-02-13T20:11:07.303 INFO:teuthology.orchestra.run.trial110.stdout: osd debug verify cached snaps = True 2026-02-13T20:11:07.303 INFO:teuthology.orchestra.run.trial110.stdout: osd debug verify missing on start = True 2026-02-13T20:11:07.303 INFO:teuthology.orchestra.run.trial110.stdout: osd failsafe full ratio = 0.95 2026-02-13T20:11:07.303 INFO:teuthology.orchestra.run.trial110.stdout: osd mclock override recovery settings = True 2026-02-13T20:11:07.303 INFO:teuthology.orchestra.run.trial110.stdout: osd memory target = 1610612736 2026-02-13T20:11:07.303 INFO:teuthology.orchestra.run.trial110.stdout: osd objectstore = bluestore 2026-02-13T20:11:07.303 INFO:teuthology.orchestra.run.trial110.stdout: osd op num shards = 1 2026-02-13T20:11:07.303 INFO:teuthology.orchestra.run.trial110.stdout: osd op num threads per shard = 2 2026-02-13T20:11:07.303 INFO:teuthology.orchestra.run.trial110.stdout: osd op queue = debug_random 2026-02-13T20:11:07.303 INFO:teuthology.orchestra.run.trial110.stdout: osd op queue cut off = debug_random 2026-02-13T20:11:07.303 INFO:teuthology.orchestra.run.trial110.stdout: osd_mclock_skip_benchmark = True 2026-02-13T20:11:07.303 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:07.303 INFO:teuthology.orchestra.run.trial110.stdout:[mgr] 2026-02-13T20:11:07.303 INFO:teuthology.orchestra.run.trial110.stdout: debug ms = 1 2026-02-13T20:11:07.303 INFO:teuthology.orchestra.run.trial110.stdout: debug mgr = 20 2026-02-13T20:11:07.303 INFO:teuthology.orchestra.run.trial110.stdout: debug mon = 20 2026-02-13T20:11:07.303 INFO:teuthology.orchestra.run.trial110.stdout: debug auth = 20 2026-02-13T20:11:07.303 INFO:teuthology.orchestra.run.trial110.stdout: mon reweight min pgs per osd = 4 2026-02-13T20:11:07.303 INFO:teuthology.orchestra.run.trial110.stdout: mon reweight min bytes per osd = 10 2026-02-13T20:11:07.304 INFO:teuthology.orchestra.run.trial110.stdout: mgr/telemetry/nag = false 2026-02-13T20:11:07.304 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:07.304 INFO:teuthology.orchestra.run.trial110.stdout:[mon] 2026-02-13T20:11:07.304 INFO:teuthology.orchestra.run.trial110.stdout: debug ms = 20 2026-02-13T20:11:07.304 INFO:teuthology.orchestra.run.trial110.stdout: debug mon = 30 2026-02-13T20:11:07.304 INFO:teuthology.orchestra.run.trial110.stdout: debug paxos = 20 2026-02-13T20:11:07.304 INFO:teuthology.orchestra.run.trial110.stdout: debug auth = 20 2026-02-13T20:11:07.304 INFO:teuthology.orchestra.run.trial110.stdout: mon data avail warn = 5 2026-02-13T20:11:07.304 INFO:teuthology.orchestra.run.trial110.stdout: mon mgr mkfs grace = 240 2026-02-13T20:11:07.304 INFO:teuthology.orchestra.run.trial110.stdout: mon reweight min pgs per osd = 4 2026-02-13T20:11:07.304 INFO:teuthology.orchestra.run.trial110.stdout: mon osd reporter subtree level = osd 2026-02-13T20:11:07.304 INFO:teuthology.orchestra.run.trial110.stdout: mon osd prime pg temp = true 2026-02-13T20:11:07.304 INFO:teuthology.orchestra.run.trial110.stdout: mon reweight min bytes per osd = 10 2026-02-13T20:11:07.304 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:07.304 INFO:teuthology.orchestra.run.trial110.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-13T20:11:07.304 INFO:teuthology.orchestra.run.trial110.stdout: auth mon ticket ttl = 660 # 11m 2026-02-13T20:11:07.304 INFO:teuthology.orchestra.run.trial110.stdout: auth service ticket ttl = 240 # 4m 2026-02-13T20:11:07.304 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:07.304 INFO:teuthology.orchestra.run.trial110.stdout: # don't complain about insecure global_id in the test suite 2026-02-13T20:11:07.304 INFO:teuthology.orchestra.run.trial110.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-13T20:11:07.304 INFO:teuthology.orchestra.run.trial110.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-13T20:11:07.304 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:07.304 INFO:teuthology.orchestra.run.trial110.stdout: # 1m isn't quite enough 2026-02-13T20:11:07.304 INFO:teuthology.orchestra.run.trial110.stdout: mon_down_mkfs_grace = 2m 2026-02-13T20:11:07.304 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:07.304 INFO:teuthology.orchestra.run.trial110.stdout: mon_warn_on_filestore_osds = false 2026-02-13T20:11:07.304 INFO:teuthology.orchestra.run.trial110.stdout: mon min osdmap epochs = 25 2026-02-13T20:11:07.304 INFO:teuthology.orchestra.run.trial110.stdout: mon osdmap full prune interval = 2 2026-02-13T20:11:07.304 INFO:teuthology.orchestra.run.trial110.stdout: mon osdmap full prune min = 15 2026-02-13T20:11:07.304 INFO:teuthology.orchestra.run.trial110.stdout: mon osdmap full prune txsize = 2 2026-02-13T20:11:07.304 INFO:teuthology.orchestra.run.trial110.stdout: mon scrub inject crc mismatch = 0.01 2026-02-13T20:11:07.304 INFO:teuthology.orchestra.run.trial110.stdout: mon scrub inject missing keys = 0.05 2026-02-13T20:11:07.304 INFO:teuthology.orchestra.run.trial110.stdout: mon scrub interval = 300 2026-02-13T20:11:07.304 INFO:teuthology.orchestra.run.trial110.stdout: paxos service trim min = 5 2026-02-13T20:11:07.304 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:07.304 INFO:teuthology.orchestra.run.trial110.stdout:[client] 2026-02-13T20:11:07.304 INFO:teuthology.orchestra.run.trial110.stdout: rgw cache enabled = true 2026-02-13T20:11:07.304 INFO:teuthology.orchestra.run.trial110.stdout: rgw enable ops log = true 2026-02-13T20:11:07.304 INFO:teuthology.orchestra.run.trial110.stdout: rgw enable usage log = true 2026-02-13T20:11:07.304 INFO:teuthology.orchestra.run.trial110.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-13T20:11:07.304 INFO:teuthology.orchestra.run.trial110.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-13T20:11:07.305 INFO:teuthology.orchestra.run.trial110.stdout: debug monc = 20 2026-02-13T20:11:07.305 INFO:teuthology.orchestra.run.trial110.stdout: debug ms = 1 2026-02-13T20:11:07.305 INFO:teuthology.orchestra.run.trial110.stdout:[mon.a] 2026-02-13T20:11:07.305 INFO:teuthology.orchestra.run.trial110.stdout:[mon.c] 2026-02-13T20:11:07.305 INFO:teuthology.orchestra.run.trial110.stdout:[mon.b] 2026-02-13T20:11:07.305 INFO:teuthology.orchestra.run.trial188.stdout:[global] 2026-02-13T20:11:07.305 INFO:teuthology.orchestra.run.trial188.stdout: chdir = "" 2026-02-13T20:11:07.305 INFO:teuthology.orchestra.run.trial188.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-13T20:11:07.305 INFO:teuthology.orchestra.run.trial188.stdout: auth supported = cephx 2026-02-13T20:11:07.305 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:11:07.305 INFO:teuthology.orchestra.run.trial188.stdout: filestore xattr use omap = true 2026-02-13T20:11:07.305 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:11:07.305 INFO:teuthology.orchestra.run.trial188.stdout: mon clock drift allowed = 1.000 2026-02-13T20:11:07.305 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:11:07.305 INFO:teuthology.orchestra.run.trial188.stdout: osd crush chooseleaf type = 0 2026-02-13T20:11:07.305 INFO:teuthology.orchestra.run.trial188.stdout: auth debug = true 2026-02-13T20:11:07.305 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:11:07.305 INFO:teuthology.orchestra.run.trial188.stdout: ms die on old message = true 2026-02-13T20:11:07.305 INFO:teuthology.orchestra.run.trial188.stdout: ms die on bug = true 2026-02-13T20:11:07.305 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:11:07.305 INFO:teuthology.orchestra.run.trial188.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-13T20:11:07.305 INFO:teuthology.orchestra.run.trial188.stdout: mon pg warn max object skew = 0 2026-02-13T20:11:07.305 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:11:07.305 INFO:teuthology.orchestra.run.trial188.stdout: # disable pg_autoscaler by default for new pools 2026-02-13T20:11:07.305 INFO:teuthology.orchestra.run.trial188.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-13T20:11:07.305 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:11:07.305 INFO:teuthology.orchestra.run.trial188.stdout: osd pool default size = 2 2026-02-13T20:11:07.305 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:11:07.305 INFO:teuthology.orchestra.run.trial188.stdout: mon osd allow primary affinity = true 2026-02-13T20:11:07.305 INFO:teuthology.orchestra.run.trial188.stdout: mon osd allow pg remap = true 2026-02-13T20:11:07.306 INFO:teuthology.orchestra.run.trial188.stdout: mon warn on legacy crush tunables = false 2026-02-13T20:11:07.306 INFO:teuthology.orchestra.run.trial188.stdout: mon warn on crush straw calc version zero = false 2026-02-13T20:11:07.306 INFO:teuthology.orchestra.run.trial188.stdout: mon warn on no sortbitwise = false 2026-02-13T20:11:07.306 INFO:teuthology.orchestra.run.trial188.stdout: mon warn on osd down out interval zero = false 2026-02-13T20:11:07.306 INFO:teuthology.orchestra.run.trial188.stdout: mon warn on too few osds = false 2026-02-13T20:11:07.306 INFO:teuthology.orchestra.run.trial188.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-13T20:11:07.306 INFO:teuthology.orchestra.run.trial188.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-13T20:11:07.306 INFO:teuthology.orchestra.run.trial188.stdout: mon_allow_pool_size_one = true 2026-02-13T20:11:07.306 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:11:07.306 INFO:teuthology.orchestra.run.trial188.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-13T20:11:07.306 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:11:07.306 INFO:teuthology.orchestra.run.trial188.stdout: osd default data pool replay window = 5 2026-02-13T20:11:07.306 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:11:07.306 INFO:teuthology.orchestra.run.trial188.stdout: mon allow pool delete = true 2026-02-13T20:11:07.306 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:11:07.306 INFO:teuthology.orchestra.run.trial188.stdout: mon cluster log file level = debug 2026-02-13T20:11:07.306 INFO:teuthology.orchestra.run.trial188.stdout: debug asserts on shutdown = true 2026-02-13T20:11:07.306 INFO:teuthology.orchestra.run.trial188.stdout: mon health detail to clog = false 2026-02-13T20:11:07.306 INFO:teuthology.orchestra.run.trial188.stdout: mon host = "[v1:10.20.193.110:6789],[v1:10.20.193.110:6790],[v1:10.20.193.188:6789]" 2026-02-13T20:11:07.306 INFO:teuthology.orchestra.run.trial188.stdout: mon client directed command retry = 5 2026-02-13T20:11:07.306 INFO:teuthology.orchestra.run.trial188.stdout: mon election default strategy = 3 2026-02-13T20:11:07.306 INFO:teuthology.orchestra.run.trial188.stdout: ms bind msgr2 = False 2026-02-13T20:11:07.306 INFO:teuthology.orchestra.run.trial188.stdout: ms inject socket failures = 5000 2026-02-13T20:11:07.306 INFO:teuthology.orchestra.run.trial188.stdout: ms type = async 2026-02-13T20:11:07.306 INFO:teuthology.orchestra.run.trial188.stdout: fsid = edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:07.306 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:11:07.306 INFO:teuthology.orchestra.run.trial188.stdout:[osd] 2026-02-13T20:11:07.306 INFO:teuthology.orchestra.run.trial188.stdout: osd journal size = 100 2026-02-13T20:11:07.306 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:11:07.306 INFO:teuthology.orchestra.run.trial188.stdout: osd scrub load threshold = 5.0 2026-02-13T20:11:07.306 INFO:teuthology.orchestra.run.trial188.stdout: osd scrub max interval = 600 2026-02-13T20:11:07.306 INFO:teuthology.orchestra.run.trial188.stdout: osd mclock profile = high_recovery_ops 2026-02-13T20:11:07.306 INFO:teuthology.orchestra.run.trial188.stdout: osd mclock skip benchmark = True 2026-02-13T20:11:07.306 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:11:07.306 INFO:teuthology.orchestra.run.trial188.stdout: osd recover clone overlap = true 2026-02-13T20:11:07.306 INFO:teuthology.orchestra.run.trial188.stdout: osd recovery max chunk = 1048576 2026-02-13T20:11:07.306 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:11:07.306 INFO:teuthology.orchestra.run.trial188.stdout: osd debug shutdown = true 2026-02-13T20:11:07.307 INFO:teuthology.orchestra.run.trial188.stdout: osd debug op order = true 2026-02-13T20:11:07.307 INFO:teuthology.orchestra.run.trial188.stdout: osd debug verify stray on activate = true 2026-02-13T20:11:07.307 INFO:teuthology.orchestra.run.trial188.stdout: osd debug trim objects = true 2026-02-13T20:11:07.307 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:11:07.307 INFO:teuthology.orchestra.run.trial188.stdout: osd open classes on start = true 2026-02-13T20:11:07.307 INFO:teuthology.orchestra.run.trial188.stdout: osd debug pg log writeout = true 2026-02-13T20:11:07.307 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:11:07.307 INFO:teuthology.orchestra.run.trial188.stdout: osd deep scrub update digest min age = 30 2026-02-13T20:11:07.307 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:11:07.307 INFO:teuthology.orchestra.run.trial188.stdout: osd map max advance = 10 2026-02-13T20:11:07.307 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:11:07.307 INFO:teuthology.orchestra.run.trial188.stdout: journal zero on create = true 2026-02-13T20:11:07.307 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:11:07.307 INFO:teuthology.orchestra.run.trial188.stdout: filestore ondisk finisher threads = 3 2026-02-13T20:11:07.307 INFO:teuthology.orchestra.run.trial188.stdout: filestore apply finisher threads = 3 2026-02-13T20:11:07.307 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:11:07.307 INFO:teuthology.orchestra.run.trial188.stdout: bdev debug aio = true 2026-02-13T20:11:07.307 INFO:teuthology.orchestra.run.trial188.stdout: osd debug misdirected ops = true 2026-02-13T20:11:07.307 INFO:teuthology.orchestra.run.trial188.stdout: bdev async discard = True 2026-02-13T20:11:07.307 INFO:teuthology.orchestra.run.trial188.stdout: bdev enable discard = True 2026-02-13T20:11:07.307 INFO:teuthology.orchestra.run.trial188.stdout: bluestore allocator = stupid 2026-02-13T20:11:07.307 INFO:teuthology.orchestra.run.trial188.stdout: bluestore block size = 96636764160 2026-02-13T20:11:07.307 INFO:teuthology.orchestra.run.trial188.stdout: bluestore compression algorithm = zlib 2026-02-13T20:11:07.307 INFO:teuthology.orchestra.run.trial188.stdout: bluestore compression mode = aggressive 2026-02-13T20:11:07.307 INFO:teuthology.orchestra.run.trial188.stdout: bluestore fsck on mount = True 2026-02-13T20:11:07.307 INFO:teuthology.orchestra.run.trial188.stdout: bluestore onode segment size = 256K 2026-02-13T20:11:07.307 INFO:teuthology.orchestra.run.trial188.stdout: bluestore write v2 = True 2026-02-13T20:11:07.307 INFO:teuthology.orchestra.run.trial188.stdout: bluestore zero block detection = True 2026-02-13T20:11:07.307 INFO:teuthology.orchestra.run.trial188.stdout: debug bluefs = 20 2026-02-13T20:11:07.307 INFO:teuthology.orchestra.run.trial188.stdout: debug bluestore = 20 2026-02-13T20:11:07.307 INFO:teuthology.orchestra.run.trial188.stdout: debug ms = 1 2026-02-13T20:11:07.307 INFO:teuthology.orchestra.run.trial188.stdout: debug osd = 20 2026-02-13T20:11:07.307 INFO:teuthology.orchestra.run.trial188.stdout: debug rocksdb = 10 2026-02-13T20:11:07.307 INFO:teuthology.orchestra.run.trial188.stdout: mon osd backfillfull_ratio = 0.85 2026-02-13T20:11:07.307 INFO:teuthology.orchestra.run.trial188.stdout: mon osd full ratio = 0.9 2026-02-13T20:11:07.307 INFO:teuthology.orchestra.run.trial188.stdout: mon osd nearfull ratio = 0.8 2026-02-13T20:11:07.307 INFO:teuthology.orchestra.run.trial188.stdout: osd debug verify cached snaps = True 2026-02-13T20:11:07.307 INFO:teuthology.orchestra.run.trial188.stdout: osd debug verify missing on start = True 2026-02-13T20:11:07.307 INFO:teuthology.orchestra.run.trial188.stdout: osd failsafe full ratio = 0.95 2026-02-13T20:11:07.307 INFO:teuthology.orchestra.run.trial188.stdout: osd mclock override recovery settings = True 2026-02-13T20:11:07.307 INFO:teuthology.orchestra.run.trial188.stdout: osd memory target = 1610612736 2026-02-13T20:11:07.308 INFO:teuthology.orchestra.run.trial188.stdout: osd objectstore = bluestore 2026-02-13T20:11:07.308 INFO:teuthology.orchestra.run.trial188.stdout: osd op num shards = 1 2026-02-13T20:11:07.308 INFO:teuthology.orchestra.run.trial188.stdout: osd op num threads per shard = 2 2026-02-13T20:11:07.308 INFO:teuthology.orchestra.run.trial188.stdout: osd op queue = debug_random 2026-02-13T20:11:07.308 INFO:teuthology.orchestra.run.trial188.stdout: osd op queue cut off = debug_random 2026-02-13T20:11:07.308 INFO:teuthology.orchestra.run.trial188.stdout: osd_mclock_skip_benchmark = True 2026-02-13T20:11:07.308 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:11:07.308 INFO:teuthology.orchestra.run.trial188.stdout:[mgr] 2026-02-13T20:11:07.308 INFO:teuthology.orchestra.run.trial188.stdout: debug ms = 1 2026-02-13T20:11:07.308 INFO:teuthology.orchestra.run.trial188.stdout: debug mgr = 20 2026-02-13T20:11:07.308 INFO:teuthology.orchestra.run.trial188.stdout: debug mon = 20 2026-02-13T20:11:07.308 INFO:teuthology.orchestra.run.trial188.stdout: debug auth = 20 2026-02-13T20:11:07.308 INFO:teuthology.orchestra.run.trial188.stdout: mon reweight min pgs per osd = 4 2026-02-13T20:11:07.308 INFO:teuthology.orchestra.run.trial188.stdout: mon reweight min bytes per osd = 10 2026-02-13T20:11:07.308 INFO:teuthology.orchestra.run.trial188.stdout: mgr/telemetry/nag = false 2026-02-13T20:11:07.308 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:11:07.308 INFO:teuthology.orchestra.run.trial188.stdout:[mon] 2026-02-13T20:11:07.308 INFO:teuthology.orchestra.run.trial188.stdout: debug ms = 20 2026-02-13T20:11:07.308 INFO:teuthology.orchestra.run.trial188.stdout: debug mon = 30 2026-02-13T20:11:07.308 INFO:teuthology.orchestra.run.trial188.stdout: debug paxos = 20 2026-02-13T20:11:07.308 INFO:teuthology.orchestra.run.trial188.stdout: debug auth = 20 2026-02-13T20:11:07.308 INFO:teuthology.orchestra.run.trial188.stdout: mon data avail warn = 5 2026-02-13T20:11:07.308 INFO:teuthology.orchestra.run.trial188.stdout: mon mgr mkfs grace = 240 2026-02-13T20:11:07.308 INFO:teuthology.orchestra.run.trial188.stdout: mon reweight min pgs per osd = 4 2026-02-13T20:11:07.308 INFO:teuthology.orchestra.run.trial188.stdout: mon osd reporter subtree level = osd 2026-02-13T20:11:07.308 INFO:teuthology.orchestra.run.trial188.stdout: mon osd prime pg temp = true 2026-02-13T20:11:07.308 INFO:teuthology.orchestra.run.trial188.stdout: mon reweight min bytes per osd = 10 2026-02-13T20:11:07.308 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:11:07.308 INFO:teuthology.orchestra.run.trial188.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-13T20:11:07.308 INFO:teuthology.orchestra.run.trial188.stdout: auth mon ticket ttl = 660 # 11m 2026-02-13T20:11:07.308 INFO:teuthology.orchestra.run.trial188.stdout: auth service ticket ttl = 240 # 4m 2026-02-13T20:11:07.308 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:11:07.308 INFO:teuthology.orchestra.run.trial188.stdout: # don't complain about insecure global_id in the test suite 2026-02-13T20:11:07.308 INFO:teuthology.orchestra.run.trial188.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-13T20:11:07.308 INFO:teuthology.orchestra.run.trial188.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-13T20:11:07.308 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:11:07.308 INFO:teuthology.orchestra.run.trial188.stdout: # 1m isn't quite enough 2026-02-13T20:11:07.308 INFO:teuthology.orchestra.run.trial188.stdout: mon_down_mkfs_grace = 2m 2026-02-13T20:11:07.308 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:11:07.309 INFO:teuthology.orchestra.run.trial188.stdout: mon_warn_on_filestore_osds = false 2026-02-13T20:11:07.309 INFO:teuthology.orchestra.run.trial188.stdout: mon min osdmap epochs = 25 2026-02-13T20:11:07.309 INFO:teuthology.orchestra.run.trial188.stdout: mon osdmap full prune interval = 2 2026-02-13T20:11:07.309 INFO:teuthology.orchestra.run.trial188.stdout: mon osdmap full prune min = 15 2026-02-13T20:11:07.309 INFO:teuthology.orchestra.run.trial188.stdout: mon osdmap full prune txsize = 2 2026-02-13T20:11:07.309 INFO:teuthology.orchestra.run.trial188.stdout: mon scrub inject crc mismatch = 0.01 2026-02-13T20:11:07.309 INFO:teuthology.orchestra.run.trial188.stdout: mon scrub inject missing keys = 0.05 2026-02-13T20:11:07.309 INFO:teuthology.orchestra.run.trial188.stdout: mon scrub interval = 300 2026-02-13T20:11:07.309 INFO:teuthology.orchestra.run.trial188.stdout: paxos service trim min = 5 2026-02-13T20:11:07.309 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-13T20:11:07.309 INFO:teuthology.orchestra.run.trial188.stdout:[client] 2026-02-13T20:11:07.309 INFO:teuthology.orchestra.run.trial188.stdout: rgw cache enabled = true 2026-02-13T20:11:07.309 INFO:teuthology.orchestra.run.trial188.stdout: rgw enable ops log = true 2026-02-13T20:11:07.309 INFO:teuthology.orchestra.run.trial188.stdout: rgw enable usage log = true 2026-02-13T20:11:07.309 INFO:teuthology.orchestra.run.trial188.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-13T20:11:07.309 INFO:teuthology.orchestra.run.trial188.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-13T20:11:07.309 INFO:teuthology.orchestra.run.trial188.stdout: debug monc = 20 2026-02-13T20:11:07.309 INFO:teuthology.orchestra.run.trial188.stdout: debug ms = 1 2026-02-13T20:11:07.309 INFO:teuthology.orchestra.run.trial188.stdout:[mon.a] 2026-02-13T20:11:07.309 INFO:teuthology.orchestra.run.trial188.stdout:[mon.c] 2026-02-13T20:11:07.309 INFO:teuthology.orchestra.run.trial188.stdout:[mon.b] 2026-02-13T20:11:07.313 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-13T20:11:07.313 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-13T20:11:07.390 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-13T20:11:07.390 DEBUG:teuthology.orchestra.run.trial110:> set -ex 2026-02-13T20:11:07.390 DEBUG:teuthology.orchestra.run.trial110:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-13T20:11:07.446 DEBUG:teuthology.orchestra.run.trial110:> set -ex 2026-02-13T20:11:07.446 DEBUG:teuthology.orchestra.run.trial110:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-13T20:11:07.501 INFO:tasks.ceph:Sending monmap to node ubuntu@trial110.front.sepia.ceph.com 2026-02-13T20:11:07.502 DEBUG:teuthology.orchestra.run.trial110:> set -ex 2026-02-13T20:11:07.502 DEBUG:teuthology.orchestra.run.trial110:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-13T20:11:07.502 DEBUG:teuthology.orchestra.run.trial110:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-13T20:11:07.575 DEBUG:teuthology.orchestra.run.trial110:> set -ex 2026-02-13T20:11:07.575 DEBUG:teuthology.orchestra.run.trial110:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-13T20:11:07.631 INFO:tasks.ceph:Sending monmap to node ubuntu@trial188.front.sepia.ceph.com 2026-02-13T20:11:07.632 DEBUG:teuthology.orchestra.run.trial188:> set -ex 2026-02-13T20:11:07.632 DEBUG:teuthology.orchestra.run.trial188:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-13T20:11:07.632 DEBUG:teuthology.orchestra.run.trial188:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-13T20:11:07.665 DEBUG:teuthology.orchestra.run.trial188:> set -ex 2026-02-13T20:11:07.665 DEBUG:teuthology.orchestra.run.trial188:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-13T20:11:07.721 INFO:tasks.ceph:Setting up mon nodes... 2026-02-13T20:11:07.721 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-13T20:11:07.722 DEBUG:teuthology.orchestra.run.trial188:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-13T20:11:07.805 INFO:teuthology.orchestra.run.trial188.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-13T20:11:07.807 INFO:tasks.ceph:Setting up mds nodes... 2026-02-13T20:11:07.808 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-13T20:11:07.808 DEBUG:teuthology.orchestra.run.trial188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-13T20:11:07.840 INFO:teuthology.orchestra.run.trial188.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-13T20:11:07.851 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-13T20:11:07.851 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial110.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@trial188.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2026-02-13T20:11:07.852 DEBUG:teuthology.orchestra.run.trial110:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-13T20:11:07.877 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-13T20:11:07.878 INFO:tasks.ceph:role: osd.0 2026-02-13T20:11:07.878 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial110.front.sepia.ceph.com 2026-02-13T20:11:07.878 DEBUG:teuthology.orchestra.run.trial110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-13T20:11:07.945 INFO:teuthology.orchestra.run.trial110.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-13T20:11:07.945 INFO:teuthology.orchestra.run.trial110.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-13T20:11:07.945 INFO:teuthology.orchestra.run.trial110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-13T20:11:07.945 INFO:teuthology.orchestra.run.trial110.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-13T20:11:07.945 INFO:teuthology.orchestra.run.trial110.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-13T20:11:07.945 INFO:teuthology.orchestra.run.trial110.stdout: = sunit=0 swidth=0 blks 2026-02-13T20:11:07.945 INFO:teuthology.orchestra.run.trial110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-13T20:11:07.945 INFO:teuthology.orchestra.run.trial110.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-13T20:11:07.946 INFO:teuthology.orchestra.run.trial110.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-13T20:11:07.946 INFO:teuthology.orchestra.run.trial110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-13T20:11:08.519 INFO:teuthology.orchestra.run.trial110.stdout:Discarding blocks...Done. 2026-02-13T20:11:08.521 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial110.front.sepia.ceph.com -o noatime 2026-02-13T20:11:08.521 DEBUG:teuthology.orchestra.run.trial110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-13T20:11:08.590 DEBUG:teuthology.orchestra.run.trial110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-13T20:11:08.657 DEBUG:teuthology.orchestra.run.trial110:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-13T20:11:08.721 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-13T20:11:08.721 INFO:tasks.ceph:role: osd.1 2026-02-13T20:11:08.721 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial110.front.sepia.ceph.com 2026-02-13T20:11:08.721 DEBUG:teuthology.orchestra.run.trial110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-13T20:11:08.786 INFO:teuthology.orchestra.run.trial110.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-13T20:11:08.786 INFO:teuthology.orchestra.run.trial110.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-13T20:11:08.786 INFO:teuthology.orchestra.run.trial110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-13T20:11:08.787 INFO:teuthology.orchestra.run.trial110.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-13T20:11:08.787 INFO:teuthology.orchestra.run.trial110.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-13T20:11:08.787 INFO:teuthology.orchestra.run.trial110.stdout: = sunit=0 swidth=0 blks 2026-02-13T20:11:08.787 INFO:teuthology.orchestra.run.trial110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-13T20:11:08.787 INFO:teuthology.orchestra.run.trial110.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-13T20:11:08.787 INFO:teuthology.orchestra.run.trial110.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-13T20:11:08.787 INFO:teuthology.orchestra.run.trial110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-13T20:11:09.345 INFO:teuthology.orchestra.run.trial110.stdout:Discarding blocks...Done. 2026-02-13T20:11:09.347 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial110.front.sepia.ceph.com -o noatime 2026-02-13T20:11:09.347 DEBUG:teuthology.orchestra.run.trial110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-13T20:11:09.414 DEBUG:teuthology.orchestra.run.trial110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-13T20:11:09.480 DEBUG:teuthology.orchestra.run.trial110:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-13T20:11:09.545 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-13T20:11:09.545 INFO:tasks.ceph:role: osd.2 2026-02-13T20:11:09.545 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial110.front.sepia.ceph.com 2026-02-13T20:11:09.545 DEBUG:teuthology.orchestra.run.trial110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-13T20:11:09.609 INFO:teuthology.orchestra.run.trial110.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-13T20:11:09.610 INFO:teuthology.orchestra.run.trial110.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-13T20:11:09.610 INFO:teuthology.orchestra.run.trial110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-13T20:11:09.610 INFO:teuthology.orchestra.run.trial110.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-13T20:11:09.610 INFO:teuthology.orchestra.run.trial110.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-13T20:11:09.610 INFO:teuthology.orchestra.run.trial110.stdout: = sunit=0 swidth=0 blks 2026-02-13T20:11:09.610 INFO:teuthology.orchestra.run.trial110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-13T20:11:09.610 INFO:teuthology.orchestra.run.trial110.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-13T20:11:09.610 INFO:teuthology.orchestra.run.trial110.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-13T20:11:09.610 INFO:teuthology.orchestra.run.trial110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-13T20:11:10.170 INFO:teuthology.orchestra.run.trial110.stdout:Discarding blocks...Done. 2026-02-13T20:11:10.172 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial110.front.sepia.ceph.com -o noatime 2026-02-13T20:11:10.172 DEBUG:teuthology.orchestra.run.trial110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2026-02-13T20:11:10.241 DEBUG:teuthology.orchestra.run.trial110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-13T20:11:10.307 DEBUG:teuthology.orchestra.run.trial110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-13T20:11:10.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:10.383+0000 7fe5b7c73780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-13T20:11:10.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:10.383+0000 7fe5b7c73780 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-13T20:11:10.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:10.383+0000 7fe5b7c73780 -1 bdev(0x3297400 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2026-02-13T20:11:10.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:10.383+0000 7fe5b7c73780 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-13T20:11:10.777 DEBUG:teuthology.orchestra.run.trial110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-13T20:11:10.841 DEBUG:teuthology.orchestra.run.trial110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-13T20:11:10.918 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:10.918+0000 7fe47f21d780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-13T20:11:10.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:10.918+0000 7fe47f21d780 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-13T20:11:10.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:10.918+0000 7fe47f21d780 -1 bdev(0x408f400 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2026-02-13T20:11:10.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:10.918+0000 7fe47f21d780 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-13T20:11:11.302 DEBUG:teuthology.orchestra.run.trial110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-13T20:11:11.367 DEBUG:teuthology.orchestra.run.trial110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-13T20:11:11.441 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:11.440+0000 7f92a680d780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-02-13T20:11:11.441 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:11.440+0000 7f92a680d780 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-02-13T20:11:11.441 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:11.440+0000 7f92a680d780 -1 bdev(0x393d400 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2026-02-13T20:11:11.441 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:11.440+0000 7f92a680d780 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-02-13T20:11:11.837 DEBUG:teuthology.orchestra.run.trial110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-13T20:11:11.903 DEBUG:teuthology.orchestra.run.trial188:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-13T20:11:11.928 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2026-02-13T20:11:11.928 INFO:tasks.ceph:role: osd.3 2026-02-13T20:11:11.928 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial188.front.sepia.ceph.com 2026-02-13T20:11:11.928 DEBUG:teuthology.orchestra.run.trial188:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-13T20:11:11.993 INFO:teuthology.orchestra.run.trial188.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-13T20:11:11.993 INFO:teuthology.orchestra.run.trial188.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-13T20:11:11.993 INFO:teuthology.orchestra.run.trial188.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-13T20:11:11.993 INFO:teuthology.orchestra.run.trial188.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-13T20:11:11.994 INFO:teuthology.orchestra.run.trial188.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-13T20:11:11.994 INFO:teuthology.orchestra.run.trial188.stdout: = sunit=0 swidth=0 blks 2026-02-13T20:11:11.994 INFO:teuthology.orchestra.run.trial188.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-13T20:11:11.994 INFO:teuthology.orchestra.run.trial188.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-13T20:11:11.994 INFO:teuthology.orchestra.run.trial188.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-13T20:11:11.994 INFO:teuthology.orchestra.run.trial188.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-13T20:11:12.567 INFO:teuthology.orchestra.run.trial188.stdout:Discarding blocks...Done. 2026-02-13T20:11:12.569 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial188.front.sepia.ceph.com -o noatime 2026-02-13T20:11:12.569 DEBUG:teuthology.orchestra.run.trial188:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2026-02-13T20:11:12.639 DEBUG:teuthology.orchestra.run.trial188:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-13T20:11:12.705 DEBUG:teuthology.orchestra.run.trial188:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2026-02-13T20:11:12.769 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2026-02-13T20:11:12.770 INFO:tasks.ceph:role: osd.4 2026-02-13T20:11:12.770 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial188.front.sepia.ceph.com 2026-02-13T20:11:12.770 DEBUG:teuthology.orchestra.run.trial188:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-13T20:11:12.834 INFO:teuthology.orchestra.run.trial188.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-13T20:11:12.834 INFO:teuthology.orchestra.run.trial188.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-13T20:11:12.834 INFO:teuthology.orchestra.run.trial188.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-13T20:11:12.834 INFO:teuthology.orchestra.run.trial188.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-13T20:11:12.834 INFO:teuthology.orchestra.run.trial188.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-13T20:11:12.835 INFO:teuthology.orchestra.run.trial188.stdout: = sunit=0 swidth=0 blks 2026-02-13T20:11:12.835 INFO:teuthology.orchestra.run.trial188.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-13T20:11:12.835 INFO:teuthology.orchestra.run.trial188.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-13T20:11:12.835 INFO:teuthology.orchestra.run.trial188.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-13T20:11:12.835 INFO:teuthology.orchestra.run.trial188.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-13T20:11:13.394 INFO:teuthology.orchestra.run.trial188.stdout:Discarding blocks...Done. 2026-02-13T20:11:13.396 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial188.front.sepia.ceph.com -o noatime 2026-02-13T20:11:13.396 DEBUG:teuthology.orchestra.run.trial188:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2026-02-13T20:11:13.463 DEBUG:teuthology.orchestra.run.trial188:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2026-02-13T20:11:13.529 DEBUG:teuthology.orchestra.run.trial188:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2026-02-13T20:11:13.593 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2026-02-13T20:11:13.593 INFO:tasks.ceph:role: osd.5 2026-02-13T20:11:13.593 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial188.front.sepia.ceph.com 2026-02-13T20:11:13.594 DEBUG:teuthology.orchestra.run.trial188:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-13T20:11:13.658 INFO:teuthology.orchestra.run.trial188.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-13T20:11:13.658 INFO:teuthology.orchestra.run.trial188.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-13T20:11:13.658 INFO:teuthology.orchestra.run.trial188.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-13T20:11:13.658 INFO:teuthology.orchestra.run.trial188.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-13T20:11:13.658 INFO:teuthology.orchestra.run.trial188.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-13T20:11:13.658 INFO:teuthology.orchestra.run.trial188.stdout: = sunit=0 swidth=0 blks 2026-02-13T20:11:13.659 INFO:teuthology.orchestra.run.trial188.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-13T20:11:13.659 INFO:teuthology.orchestra.run.trial188.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-13T20:11:13.659 INFO:teuthology.orchestra.run.trial188.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-13T20:11:13.659 INFO:teuthology.orchestra.run.trial188.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-13T20:11:14.220 INFO:teuthology.orchestra.run.trial188.stdout:Discarding blocks...Done. 2026-02-13T20:11:14.222 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial188.front.sepia.ceph.com -o noatime 2026-02-13T20:11:14.222 DEBUG:teuthology.orchestra.run.trial188:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5 2026-02-13T20:11:14.292 DEBUG:teuthology.orchestra.run.trial188:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2026-02-13T20:11:14.359 DEBUG:teuthology.orchestra.run.trial188:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-13T20:11:14.437 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:14.435+0000 7f5babe2f780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2026-02-13T20:11:14.438 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:14.435+0000 7f5babe2f780 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2026-02-13T20:11:14.438 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:14.435+0000 7f5babe2f780 -1 bdev(0x33b5400 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2026-02-13T20:11:14.438 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:14.435+0000 7f5babe2f780 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2026-02-13T20:11:14.831 DEBUG:teuthology.orchestra.run.trial188:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-13T20:11:14.898 DEBUG:teuthology.orchestra.run.trial188:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-13T20:11:14.974 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:14.972+0000 7f6d7f1fd780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2026-02-13T20:11:14.975 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:14.973+0000 7f6d7f1fd780 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2026-02-13T20:11:14.975 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:14.973+0000 7f6d7f1fd780 -1 bdev(0x32a3400 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2026-02-13T20:11:14.976 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:14.973+0000 7f6d7f1fd780 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2026-02-13T20:11:15.410 DEBUG:teuthology.orchestra.run.trial188:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2026-02-13T20:11:15.475 DEBUG:teuthology.orchestra.run.trial188:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-13T20:11:15.549 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:15.547+0000 7fb445dc6780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2026-02-13T20:11:15.550 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:15.548+0000 7fb445dc6780 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2026-02-13T20:11:15.550 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:15.548+0000 7fb445dc6780 -1 bdev(0x3943400 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2026-02-13T20:11:15.550 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:15.548+0000 7fb445dc6780 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2026-02-13T20:11:15.946 DEBUG:teuthology.orchestra.run.trial188:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2026-02-13T20:11:16.011 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-13T20:11:16.012 DEBUG:teuthology.orchestra.run.trial110:> set -ex 2026-02-13T20:11:16.012 DEBUG:teuthology.orchestra.run.trial110:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-13T20:11:16.037 DEBUG:teuthology.orchestra.run.trial110:> set -ex 2026-02-13T20:11:16.038 DEBUG:teuthology.orchestra.run.trial110:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-13T20:11:16.101 DEBUG:teuthology.orchestra.run.trial110:> set -ex 2026-02-13T20:11:16.102 DEBUG:teuthology.orchestra.run.trial110:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-13T20:11:16.165 DEBUG:teuthology.orchestra.run.trial188:> set -ex 2026-02-13T20:11:16.165 DEBUG:teuthology.orchestra.run.trial188:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-13T20:11:16.191 DEBUG:teuthology.orchestra.run.trial188:> set -ex 2026-02-13T20:11:16.191 DEBUG:teuthology.orchestra.run.trial188:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-13T20:11:16.256 DEBUG:teuthology.orchestra.run.trial188:> set -ex 2026-02-13T20:11:16.256 DEBUG:teuthology.orchestra.run.trial188:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2026-02-13T20:11:16.320 DEBUG:teuthology.orchestra.run.trial188:> set -ex 2026-02-13T20:11:16.320 DEBUG:teuthology.orchestra.run.trial188:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2026-02-13T20:11:16.384 DEBUG:teuthology.orchestra.run.trial188:> set -ex 2026-02-13T20:11:16.384 DEBUG:teuthology.orchestra.run.trial188:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-13T20:11:16.441 INFO:tasks.ceph:Adding keys to all mons... 2026-02-13T20:11:16.441 DEBUG:teuthology.orchestra.run.trial110:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-13T20:11:16.443 DEBUG:teuthology.orchestra.run.trial188:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-13T20:11:16.484 INFO:teuthology.orchestra.run.trial110.stdout:[osd.0] 2026-02-13T20:11:16.484 INFO:teuthology.orchestra.run.trial110.stdout: key = AQBehY9pp3viFhAAVY66noozsVXhWMOepOJfug== 2026-02-13T20:11:16.485 INFO:teuthology.orchestra.run.trial110.stdout:[osd.1] 2026-02-13T20:11:16.485 INFO:teuthology.orchestra.run.trial110.stdout: key = AQBehY9pqu++NhAA7TxH4qTr7pJiRLypy3t7bg== 2026-02-13T20:11:16.485 INFO:teuthology.orchestra.run.trial110.stdout:[osd.2] 2026-02-13T20:11:16.485 INFO:teuthology.orchestra.run.trial110.stdout: key = AQBfhY9p8MBEGhAA65dKiD678aQm29np8MRSKA== 2026-02-13T20:11:16.485 INFO:teuthology.orchestra.run.trial110.stdout:[mgr.x] 2026-02-13T20:11:16.485 INFO:teuthology.orchestra.run.trial110.stdout: key = AQBbhY9pjE/xLxAAXnqpMsE826bQtcV1foTRQw== 2026-02-13T20:11:16.485 INFO:teuthology.orchestra.run.trial110.stdout:[osd.3] 2026-02-13T20:11:16.485 INFO:teuthology.orchestra.run.trial110.stdout: key = AQBihY9pCeoAGhAAB3/7/nMiPNap3UsdVlFqlg== 2026-02-13T20:11:16.485 INFO:teuthology.orchestra.run.trial110.stdout:[osd.4] 2026-02-13T20:11:16.485 INFO:teuthology.orchestra.run.trial110.stdout: key = AQBihY9pWWUJOhAAUlm/IPcwFXdVnmGbfUa8AA== 2026-02-13T20:11:16.485 INFO:teuthology.orchestra.run.trial110.stdout:[osd.5] 2026-02-13T20:11:16.485 INFO:teuthology.orchestra.run.trial110.stdout: key = AQBjhY9pb8a0IBAApMbqPls8wzt66HIb7TCtcA== 2026-02-13T20:11:16.486 INFO:teuthology.orchestra.run.trial110.stdout:[client.0] 2026-02-13T20:11:16.486 INFO:teuthology.orchestra.run.trial110.stdout: key = AQBbhY9pmzoJMhAAPFFqe9OVBYl7D9LynInMRA== 2026-02-13T20:11:16.503 INFO:teuthology.orchestra.run.trial188.stdout:[osd.0] 2026-02-13T20:11:16.503 INFO:teuthology.orchestra.run.trial188.stdout: key = AQBehY9pp3viFhAAVY66noozsVXhWMOepOJfug== 2026-02-13T20:11:16.504 INFO:teuthology.orchestra.run.trial188.stdout:[osd.1] 2026-02-13T20:11:16.504 INFO:teuthology.orchestra.run.trial188.stdout: key = AQBehY9pqu++NhAA7TxH4qTr7pJiRLypy3t7bg== 2026-02-13T20:11:16.504 INFO:teuthology.orchestra.run.trial188.stdout:[osd.2] 2026-02-13T20:11:16.504 INFO:teuthology.orchestra.run.trial188.stdout: key = AQBfhY9p8MBEGhAA65dKiD678aQm29np8MRSKA== 2026-02-13T20:11:16.504 INFO:teuthology.orchestra.run.trial188.stdout:[mgr.x] 2026-02-13T20:11:16.504 INFO:teuthology.orchestra.run.trial188.stdout: key = AQBbhY9pjE/xLxAAXnqpMsE826bQtcV1foTRQw== 2026-02-13T20:11:16.504 INFO:teuthology.orchestra.run.trial188.stdout:[osd.3] 2026-02-13T20:11:16.504 INFO:teuthology.orchestra.run.trial188.stdout: key = AQBihY9pCeoAGhAAB3/7/nMiPNap3UsdVlFqlg== 2026-02-13T20:11:16.504 INFO:teuthology.orchestra.run.trial188.stdout:[osd.4] 2026-02-13T20:11:16.504 INFO:teuthology.orchestra.run.trial188.stdout: key = AQBihY9pWWUJOhAAUlm/IPcwFXdVnmGbfUa8AA== 2026-02-13T20:11:16.504 INFO:teuthology.orchestra.run.trial188.stdout:[osd.5] 2026-02-13T20:11:16.505 INFO:teuthology.orchestra.run.trial188.stdout: key = AQBjhY9pb8a0IBAApMbqPls8wzt66HIb7TCtcA== 2026-02-13T20:11:16.505 INFO:teuthology.orchestra.run.trial188.stdout:[client.0] 2026-02-13T20:11:16.505 INFO:teuthology.orchestra.run.trial188.stdout: key = AQBbhY9pmzoJMhAAPFFqe9OVBYl7D9LynInMRA== 2026-02-13T20:11:16.506 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T20:11:16.529 DEBUG:teuthology.orchestra.run.trial188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T20:11:16.585 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T20:11:16.607 DEBUG:teuthology.orchestra.run.trial188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T20:11:16.666 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T20:11:16.686 DEBUG:teuthology.orchestra.run.trial188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T20:11:16.744 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-13T20:11:16.762 DEBUG:teuthology.orchestra.run.trial188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-13T20:11:16.822 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T20:11:16.842 DEBUG:teuthology.orchestra.run.trial188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T20:11:16.903 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T20:11:16.919 DEBUG:teuthology.orchestra.run.trial188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T20:11:16.982 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T20:11:16.996 DEBUG:teuthology.orchestra.run.trial188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T20:11:17.059 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-13T20:11:17.074 DEBUG:teuthology.orchestra.run.trial188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-13T20:11:17.137 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-13T20:11:17.138 DEBUG:teuthology.orchestra.run.trial110:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-13T20:11:17.174 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-13T20:11:17.255 DEBUG:teuthology.orchestra.run.trial110:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-13T20:11:17.318 DEBUG:teuthology.orchestra.run.trial110:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2026-02-13T20:11:17.382 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-13T20:11:17.464 DEBUG:teuthology.orchestra.run.trial110:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2026-02-13T20:11:17.529 DEBUG:teuthology.orchestra.run.trial188:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2026-02-13T20:11:17.554 DEBUG:teuthology.orchestra.run.trial188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-13T20:11:17.635 DEBUG:teuthology.orchestra.run.trial188:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2026-02-13T20:11:17.699 DEBUG:teuthology.orchestra.run.trial110:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-13T20:11:17.701 DEBUG:teuthology.orchestra.run.trial188:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-13T20:11:17.756 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-13T20:11:17.756 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-13T20:11:17.756 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-13T20:11:17.759 INFO:tasks.ceph.mon.a:Started 2026-02-13T20:11:17.759 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-13T20:11:17.759 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-13T20:11:17.762 INFO:tasks.ceph.mon.c:Started 2026-02-13T20:11:17.762 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-13T20:11:17.762 DEBUG:teuthology.orchestra.run.trial188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-13T20:11:17.799 INFO:tasks.ceph.mon.b:Started 2026-02-13T20:11:17.799 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-13T20:11:17.800 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-13T20:11:17.800 DEBUG:teuthology.orchestra.run.trial188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-13T20:11:17.802 INFO:tasks.ceph.mgr.x:Started 2026-02-13T20:11:17.802 DEBUG:tasks.ceph:set 0 configs 2026-02-13T20:11:17.803 DEBUG:teuthology.orchestra.run.trial110:> sudo ceph --cluster ceph config dump 2026-02-13T20:11:17.868 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:17.865+0000 7f94a3c47640 10 monclient: get_monmap_and_config 2026-02-13T20:11:17.868 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:17.865+0000 7f94a3c47640 10 monclient: build_initial_monmap 2026-02-13T20:11:17.868 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:17.865+0000 7f94a3c47640 10 monclient: monmap: 2026-02-13T20:11:17.868 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:17.869 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:17.869 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:17.866398+0000 2026-02-13T20:11:17.869 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:17.866398+0000 2026-02-13T20:11:17.869 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:17.869 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:17.869 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:17.869 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:17.869 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:17.869 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:17.869 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:17.866+0000 7f94a3c47640 1 Processor -- start 2026-02-13T20:11:17.869 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:17.866+0000 7f94a3c47640 1 -- start start 2026-02-13T20:11:17.869 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:17.866+0000 7f94a3c47640 10 monclient: init 2026-02-13T20:11:17.870 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:17.866+0000 7f94a3c47640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:17.870 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:17.866+0000 7f94a3c47640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:11:17.870 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:17.866+0000 7f94a3c47640 10 monclient(hunting): picked mon.noname-c con 0x7f949c1401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:17.870 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:17.866+0000 7f94a3c47640 10 monclient(hunting): picked mon.noname-a con 0x7f949c092020 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:17.870 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:17.866+0000 7f94a3c47640 10 monclient(hunting): picked mon.noname-b con 0x7f949c091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:17.870 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:17.866+0000 7f94a3c47640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f949c08b730 con 0x7f949c092020 2026-02-13T20:11:17.870 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:17.866+0000 7f94a3c47640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f949c05c5b0 con 0x7f949c1401c0 2026-02-13T20:11:17.870 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:17.866+0000 7f94a3c47640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f949c08bcf0 con 0x7f949c091950 2026-02-13T20:11:17.870 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:17.866+0000 7f94a3c47640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:17.870 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:17.866+0000 7f94a3c47640 10 monclient(hunting): authenticate will time out at 639.556759s 2026-02-13T20:11:17.870 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:17.866+0000 7f94a11bb640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f949c092020 0x7f949c1812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:34958/0 (socket says 10.20.193.110:34958) 2026-02-13T20:11:17.871 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:17.866+0000 7f94a21bd640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f949c091950 0x7f949c1a2a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:44002/0 (socket says 10.20.193.110:44002) 2026-02-13T20:11:17.871 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:17.866+0000 7f94a11bb640 1 -- 10.20.193.110:0/1994581439 learned_addr learned my addr 10.20.193.110:0/1994581439 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:18.060 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.053+0000 7f94a09ba640 1 -- 10.20.193.110:0/1994581439 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3820403334 0 0) 0x7f949c08b730 con 0x7f949c092020 2026-02-13T20:11:18.060 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.053+0000 7f94a09ba640 10 monclient(hunting): _negotiate 2026-02-13T20:11:18.060 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.053+0000 7f94a09ba640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:18.060 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.053+0000 7f94a09ba640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:18.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.053+0000 7f94a09ba640 10 monclient(hunting): my global_id is 4098 2026-02-13T20:11:18.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.053+0000 7f94a09ba640 1 -- 10.20.193.110:0/1994581439 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94840035e0 con 0x7f949c092020 2026-02-13T20:11:18.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.053+0000 7f94a09ba640 1 -- 10.20.193.110:0/1994581439 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2415543988 0 0) 0x7f949c05c5b0 con 0x7f949c1401c0 2026-02-13T20:11:18.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.053+0000 7f94a09ba640 10 monclient(hunting): _negotiate 2026-02-13T20:11:18.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.053+0000 7f94a09ba640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:18.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.053+0000 7f94a09ba640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:18.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.053+0000 7f94a09ba640 10 monclient(hunting): my global_id is 4099 2026-02-13T20:11:18.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.053+0000 7f94a09ba640 1 -- 10.20.193.110:0/1994581439 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f949c08b730 con 0x7f949c1401c0 2026-02-13T20:11:18.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.053+0000 7f94a09ba640 1 -- 10.20.193.110:0/1994581439 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2527364779 0 0) 0x7f949c08bcf0 con 0x7f949c091950 2026-02-13T20:11:18.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.053+0000 7f94a09ba640 10 monclient(hunting): _negotiate 2026-02-13T20:11:18.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.053+0000 7f94a09ba640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:18.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.053+0000 7f94a09ba640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:18.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.053+0000 7f94a09ba640 10 monclient(hunting): my global_id is 4103 2026-02-13T20:11:18.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.053+0000 7f94a09ba640 1 -- 10.20.193.110:0/1994581439 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f949c05c5b0 con 0x7f949c091950 2026-02-13T20:11:18.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.053+0000 7f94a09ba640 1 -- 10.20.193.110:0/1994581439 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3569478656 0 0) 0x7f949c08b730 con 0x7f949c1401c0 2026-02-13T20:11:18.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.053+0000 7f94a09ba640 1 -- 10.20.193.110:0/1994581439 >> v1:10.20.193.110:6790/0 conn(0x7f949c091950 legacy=0x7f949c1a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:18.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.053+0000 7f94a09ba640 1 -- 10.20.193.110:0/1994581439 >> v1:10.20.193.110:6789/0 conn(0x7f949c092020 legacy=0x7f949c1812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:18.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.053+0000 7f94a09ba640 10 monclient: _finish_hunting 0 2026-02-13T20:11:18.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.053+0000 7f94a09ba640 1 monclient: found mon.noname-c 2026-02-13T20:11:18.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.053+0000 7f94a09ba640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:18.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.053+0000 7f94a09ba640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.188:6789/0 2026-02-13T20:11:18.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.053+0000 7f94a09ba640 1 -- 10.20.193.110:0/1994581439 --> v1:10.20.193.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f949c140590 con 0x7f949c1401c0 2026-02-13T20:11:18.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.053+0000 7f94a09ba640 10 monclient: _finish_auth 0 2026-02-13T20:11:18.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.053+0000 7f94a09ba640 10 monclient: _check_auth_tickets 2026-02-13T20:11:18.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.053+0000 7f94a09ba640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:18.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.053+0000 7f94a09ba640 1 -- 10.20.193.110:0/1994581439 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f948c002dd0 con 0x7f949c1401c0 2026-02-13T20:11:18.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.053+0000 7f94a09ba640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:18.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.053+0000 7f94a09ba640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:11:18.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.053+0000 7f94a09ba640 10 monclient: dump: 2026-02-13T20:11:18.061 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:18.061 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:18.061 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.061 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.061 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:18.061 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:18.061 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:18.061 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:18.061 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:18.061 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:18.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.053+0000 7f94a3c47640 5 monclient: authenticate success, global_id 4099 2026-02-13T20:11:18.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.053+0000 7f94a3c47640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:18.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.053+0000 7f94a09ba640 1 -- 10.20.193.110:0/1994581439 <== mon.1 v1:10.20.193.188:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f948c002fe0 con 0x7f949c1401c0 2026-02-13T20:11:18.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.053+0000 7f94a09ba640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:18.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.053+0000 7f94a09ba640 1 -- 10.20.193.110:0/1994581439 <== mon.1 v1:10.20.193.188:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f948c0033f0 con 0x7f949c1401c0 2026-02-13T20:11:18.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.053+0000 7f94a09ba640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:18.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.053+0000 7f94a09ba640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:11:18.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.053+0000 7f94a09ba640 10 monclient: dump: 2026-02-13T20:11:18.062 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:18.062 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:18.062 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.062 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.062 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:18.062 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:18.062 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:18.062 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:18.062 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:18.062 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:18.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.053+0000 7f94a3c47640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:18.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.053+0000 7f94a3c47640 4 set_mon_vals no callback set 2026-02-13T20:11:18.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.054+0000 7f94a3c47640 10 monclient: shutdown 2026-02-13T20:11:18.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.054+0000 7f94a3c47640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:18.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.054+0000 7f94a3c47640 1 -- 10.20.193.110:0/1994581439 >> v1:10.20.193.188:6789/0 conn(0x7f949c1401c0 legacy=0x7f949c091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:18.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.054+0000 7f94a3c47640 1 -- 10.20.193.110:0/1994581439 shutdown_connections 2026-02-13T20:11:18.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.054+0000 7f94a3c47640 1 -- 10.20.193.110:0/1994581439 >> 10.20.193.110:0/1994581439 conn(0x7f949c054e90 msgr2=0x7f949c058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:18.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.054+0000 7f94a3c47640 1 -- 10.20.193.110:0/1994581439 shutdown_connections 2026-02-13T20:11:18.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.054+0000 7f94a3c47640 1 -- 10.20.193.110:0/1994581439 wait complete. 2026-02-13T20:11:18.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.054+0000 7f94a3c47640 10 monclient: build_initial_monmap 2026-02-13T20:11:18.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.054+0000 7f94a3c47640 10 monclient: monmap: 2026-02-13T20:11:18.062 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:18.062 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:18.062 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:11:18.062 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:11:18.062 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:18.062 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:11:18.062 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:18.062 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:18.062 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:18.062 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:18.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.054+0000 7f94a3c47640 1 Processor -- start 2026-02-13T20:11:18.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.054+0000 7f94a3c47640 1 -- start start 2026-02-13T20:11:18.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.054+0000 7f94a3c47640 10 monclient: init 2026-02-13T20:11:18.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.055+0000 7f94a3c47640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:18.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.055+0000 7f94a3c47640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:11:18.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.055+0000 7f94a3c47640 10 monclient(hunting): picked mon.noname-c con 0x7f949c091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:18.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.055+0000 7f94a3c47640 10 monclient(hunting): picked mon.noname-a con 0x7f949c1401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:18.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.055+0000 7f94a3c47640 10 monclient(hunting): picked mon.noname-b con 0x7f949c13ee10 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:18.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.055+0000 7f94a3c47640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f949c12dda0 con 0x7f949c1401c0 2026-02-13T20:11:18.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.055+0000 7f94a3c47640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f949c08c310 con 0x7f949c13ee10 2026-02-13T20:11:18.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.055+0000 7f94a3c47640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f949c05d320 con 0x7f949c091950 2026-02-13T20:11:18.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.055+0000 7f94a3c47640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:18.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.055+0000 7f94a3c47640 10 monclient(hunting): authenticate will time out at 639.745369s 2026-02-13T20:11:18.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.055+0000 7f94a19bc640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f949c091950 0x7f949c13e700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:44032/0 (socket says 10.20.193.110:44032) 2026-02-13T20:11:18.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.055+0000 7f94a19bc640 1 -- 10.20.193.110:0/3324668623 learned_addr learned my addr 10.20.193.110:0/3324668623 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:18.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.055+0000 7f94a11bb640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f949c1401c0 0x7f949c191770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:34972/0 (socket says 10.20.193.110:34972) 2026-02-13T20:11:18.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.055+0000 7f948a7fc640 1 -- 10.20.193.110:0/3324668623 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2998261095 0 0) 0x7f949c08c310 con 0x7f949c13ee10 2026-02-13T20:11:18.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.055+0000 7f948a7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:11:18.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.055+0000 7f948a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:18.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.055+0000 7f948a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:18.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.055+0000 7f948a7fc640 10 monclient(hunting): my global_id is 4108 2026-02-13T20:11:18.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.055+0000 7f948a7fc640 1 -- 10.20.193.110:0/3324668623 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f946c0035e0 con 0x7f949c13ee10 2026-02-13T20:11:18.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.055+0000 7f948a7fc640 1 -- 10.20.193.110:0/3324668623 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3477571836 0 0) 0x7f949c05d320 con 0x7f949c091950 2026-02-13T20:11:18.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.055+0000 7f948a7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:11:18.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.055+0000 7f948a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:18.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.055+0000 7f948a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:18.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.055+0000 7f948a7fc640 10 monclient(hunting): my global_id is 4109 2026-02-13T20:11:18.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.055+0000 7f948a7fc640 1 -- 10.20.193.110:0/3324668623 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f949c08c310 con 0x7f949c091950 2026-02-13T20:11:18.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.056+0000 7f948a7fc640 1 -- 10.20.193.110:0/3324668623 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1673205637 0 0) 0x7f946c0035e0 con 0x7f949c13ee10 2026-02-13T20:11:18.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.056+0000 7f948a7fc640 1 -- 10.20.193.110:0/3324668623 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f949c05d320 con 0x7f949c13ee10 2026-02-13T20:11:18.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.056+0000 7f948a7fc640 1 -- 10.20.193.110:0/3324668623 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f9498004150 con 0x7f949c13ee10 2026-02-13T20:11:18.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.056+0000 7f948a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:18.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.056+0000 7f948a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:11:18.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.056+0000 7f948a7fc640 10 monclient(hunting): dump: 2026-02-13T20:11:18.063 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:18.063 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:18.063 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.063 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.063 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:18.063 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:18.063 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:18.063 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:18.063 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:18.063 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:18.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.056+0000 7f948a7fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:18.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.056+0000 7f948a7fc640 1 -- 10.20.193.110:0/3324668623 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4279131678 0 0) 0x7f949c08c310 con 0x7f949c091950 2026-02-13T20:11:18.064 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.056+0000 7f948a7fc640 1 -- 10.20.193.110:0/3324668623 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f946c0035e0 con 0x7f949c091950 2026-02-13T20:11:18.064 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.056+0000 7f948a7fc640 1 -- 10.20.193.110:0/3324668623 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f948c003380 con 0x7f949c091950 2026-02-13T20:11:18.064 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.056+0000 7f948a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:18.064 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.056+0000 7f948a7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:18.064 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.056+0000 7f948a7fc640 10 monclient(hunting): dump: 2026-02-13T20:11:18.064 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:18.064 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:18.064 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.064 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.064 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:18.064 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:18.064 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:18.064 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:18.064 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:18.064 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:18.064 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.056+0000 7f948a7fc640 1 -- 10.20.193.110:0/3324668623 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4014596498 0 0) 0x7f949c12dda0 con 0x7f949c1401c0 2026-02-13T20:11:18.064 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.056+0000 7f948a7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:11:18.064 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.056+0000 7f948a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:18.064 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.056+0000 7f948a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:18.064 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.056+0000 7f948a7fc640 10 monclient(hunting): my global_id is 4101 2026-02-13T20:11:18.064 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.056+0000 7f948a7fc640 1 -- 10.20.193.110:0/3324668623 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f949c08c310 con 0x7f949c1401c0 2026-02-13T20:11:18.064 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.056+0000 7f948a7fc640 1 -- 10.20.193.110:0/3324668623 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2618383361 0 0) 0x7f949c08c310 con 0x7f949c1401c0 2026-02-13T20:11:18.064 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.056+0000 7f948a7fc640 1 -- 10.20.193.110:0/3324668623 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f949c12dda0 con 0x7f949c1401c0 2026-02-13T20:11:18.064 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.056+0000 7f948a7fc640 1 -- 10.20.193.110:0/3324668623 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f9490002ee0 con 0x7f949c1401c0 2026-02-13T20:11:18.064 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.056+0000 7f948a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:18.064 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.056+0000 7f948a7fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:18.064 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.056+0000 7f948a7fc640 10 monclient(hunting): dump: 2026-02-13T20:11:18.064 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:18.064 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:18.064 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.064 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.064 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:18.064 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:18.064 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:18.064 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:18.064 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:18.064 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:18.064 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.057+0000 7f948a7fc640 1 -- 10.20.193.110:0/3324668623 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2319569027 0 0) 0x7f946c0035e0 con 0x7f949c091950 2026-02-13T20:11:18.064 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.057+0000 7f948a7fc640 1 -- 10.20.193.110:0/3324668623 >> v1:10.20.193.188:6789/0 conn(0x7f949c13ee10 legacy=0x7f949c192e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:18.064 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.057+0000 7f948a7fc640 1 -- 10.20.193.110:0/3324668623 >> v1:10.20.193.110:6789/0 conn(0x7f949c1401c0 legacy=0x7f949c191770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:18.064 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.057+0000 7f948a7fc640 10 monclient: _finish_hunting 0 2026-02-13T20:11:18.064 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.057+0000 7f948a7fc640 1 monclient: found mon.c 2026-02-13T20:11:18.064 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.057+0000 7f948a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:18.065 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.057+0000 7f948a7fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:18.065 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.057+0000 7f948a7fc640 1 -- 10.20.193.110:0/3324668623 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f949c130100 con 0x7f949c091950 2026-02-13T20:11:18.065 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.057+0000 7f948a7fc640 10 monclient: _finish_auth 0 2026-02-13T20:11:18.065 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.057+0000 7f948a7fc640 10 monclient: _check_auth_tickets 2026-02-13T20:11:18.065 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.057+0000 7f948a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:18.065 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.057+0000 7f94a3c47640 5 monclient: authenticate success, global_id 4109 2026-02-13T20:11:18.065 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.057+0000 7f94a3c47640 10 monclient: _renew_subs 2026-02-13T20:11:18.065 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.057+0000 7f94a3c47640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:18.065 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.057+0000 7f94a3c47640 1 -- 10.20.193.110:0/3324668623 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f949c12f860 con 0x7f949c091950 2026-02-13T20:11:18.065 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.057+0000 7f94a3c47640 10 monclient: _renew_subs 2026-02-13T20:11:18.065 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.057+0000 7f94a3c47640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:18.065 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.057+0000 7f94a3c47640 1 -- 10.20.193.110:0/3324668623 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f949c150640 con 0x7f949c091950 2026-02-13T20:11:18.065 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.057+0000 7f948a7fc640 1 -- 10.20.193.110:0/3324668623 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f948c002970 con 0x7f949c091950 2026-02-13T20:11:18.065 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.057+0000 7f948a7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:18.065 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.057+0000 7f948a7fc640 1 -- 10.20.193.110:0/3324668623 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f948c003ac0 con 0x7f949c091950 2026-02-13T20:11:18.065 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.057+0000 7f948a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:18.065 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.057+0000 7f948a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:18.065 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.057+0000 7f948a7fc640 10 monclient: dump: 2026-02-13T20:11:18.065 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:18.065 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:18.065 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.065 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.065 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:18.065 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:18.065 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:18.065 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:18.065 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:18.065 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:18.065 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.057+0000 7f948bfff640 4 set_mon_vals no callback set 2026-02-13T20:11:18.065 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.057+0000 7f948a7fc640 1 -- 10.20.193.110:0/3324668623 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f948c004030 con 0x7f949c091950 2026-02-13T20:11:18.065 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.057+0000 7f948a7fc640 1 -- 10.20.193.110:0/3324668623 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (unknown 1702619060 0 0) 0x7f948c006a60 con 0x7f949c091950 2026-02-13T20:11:18.065 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.057+0000 7f94a3c47640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:18.065 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.057+0000 7f94a3c47640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:18.065 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.057+0000 7f94a3c47640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:18.065 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.057+0000 7f94a3c47640 1 -- 10.20.193.110:0/3324668623 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f949c12fcd0 con 0x7f949c091950 2026-02-13T20:11:18.065 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.059+0000 7f948a7fc640 1 -- 10.20.193.110:0/3324668623 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (unknown 1092875540 0 2392355004) 0x7f948c0057f0 con 0x7f949c091950 2026-02-13T20:11:18.065 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.059+0000 7f948a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:18.065 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.059+0000 7f948a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:11:18.089 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.088+0000 7f94a3c47640 10 start_mon_command cmd=[{"prefix": "config dump"}] 2026-02-13T20:11:18.089 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.088+0000 7f94a3c47640 10 monclient: _send_command 2 [{"prefix": "config dump"}] 2026-02-13T20:11:18.089 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.088+0000 7f94a3c47640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:18.089 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.088+0000 7f94a3c47640 1 -- 10.20.193.110:0/3324668623 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "config dump"} v 0) -- 0x7f949c055bb0 con 0x7f949c091950 2026-02-13T20:11:18.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.088+0000 7f948a7fc640 1 -- 10.20.193.110:0/3324668623 <== mon.2 v1:10.20.193.110:6790/0 10 ==== mon_command_ack([{"prefix": "config dump"}]=0 v1) ==== 59+0+36 (unknown 4069917974 0 2919340917) 0x7f948c005990 con 0x7f949c091950 2026-02-13T20:11:18.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.088+0000 7f948a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config dump"}] 2026-02-13T20:11:18.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.088+0000 7f948a7fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:11:18.090 INFO:teuthology.orchestra.run.trial110.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-13T20:11:18.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.089+0000 7f94a3c47640 10 monclient: shutdown 2026-02-13T20:11:18.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.089+0000 7f94a3c47640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:18.091 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.089+0000 7f94a3c47640 1 -- 10.20.193.110:0/3324668623 >> v1:10.20.193.110:6790/0 conn(0x7f949c091950 legacy=0x7f949c13e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:18.091 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.089+0000 7f94a3c47640 1 -- 10.20.193.110:0/3324668623 shutdown_connections 2026-02-13T20:11:18.091 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.089+0000 7f94a3c47640 1 -- 10.20.193.110:0/3324668623 >> 10.20.193.110:0/3324668623 conn(0x7f949c054e90 msgr2=0x7f949c08dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:18.091 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.089+0000 7f94a3c47640 1 -- 10.20.193.110:0/3324668623 shutdown_connections 2026-02-13T20:11:18.091 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.089+0000 7f94a3c47640 1 -- 10.20.193.110:0/3324668623 wait complete. 2026-02-13T20:11:18.098 INFO:tasks.ceph:Setting crush tunables to default 2026-02-13T20:11:18.098 DEBUG:teuthology.orchestra.run.trial110:> sudo ceph --cluster ceph osd crush tunables default 2026-02-13T20:11:18.173 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.160+0000 7f715c794640 10 monclient: get_monmap_and_config 2026-02-13T20:11:18.173 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.160+0000 7f715c794640 10 monclient: build_initial_monmap 2026-02-13T20:11:18.173 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.160+0000 7f715c794640 10 monclient: monmap: 2026-02-13T20:11:18.173 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:18.173 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:18.174 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:18.161403+0000 2026-02-13T20:11:18.174 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:18.161403+0000 2026-02-13T20:11:18.174 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:18.174 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:18.174 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:18.174 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:18.174 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:18.174 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:18.174 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.161+0000 7f715c794640 1 Processor -- start 2026-02-13T20:11:18.174 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.161+0000 7f715c794640 1 -- start start 2026-02-13T20:11:18.174 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.161+0000 7f715c794640 10 monclient: init 2026-02-13T20:11:18.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.161+0000 7f715c794640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:18.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.161+0000 7f715c794640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:11:18.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.161+0000 7f715c794640 10 monclient(hunting): picked mon.noname-c con 0x7f71541401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:18.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.161+0000 7f715c794640 10 monclient(hunting): picked mon.noname-a con 0x7f7154092020 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:18.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.161+0000 7f715c794640 10 monclient(hunting): picked mon.noname-b con 0x7f7154091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:18.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.161+0000 7f715c794640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f715408b730 con 0x7f7154092020 2026-02-13T20:11:18.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.161+0000 7f715c794640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f715405c5b0 con 0x7f71541401c0 2026-02-13T20:11:18.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.161+0000 7f715c794640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f715408bcf0 con 0x7f7154091950 2026-02-13T20:11:18.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.161+0000 7f715c794640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:18.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.161+0000 7f715c794640 10 monclient(hunting): authenticate will time out at 639.851761s 2026-02-13T20:11:18.176 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.161+0000 7f7159d08640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f7154092020 0x7f71541812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:34988/0 (socket says 10.20.193.110:34988) 2026-02-13T20:11:18.176 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.161+0000 7f7159d08640 1 -- 10.20.193.110:0/492307401 learned_addr learned my addr 10.20.193.110:0/492307401 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:18.176 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.162+0000 7f7159507640 1 -- 10.20.193.110:0/492307401 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1150903801 0 0) 0x7f715408bcf0 con 0x7f7154091950 2026-02-13T20:11:18.176 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.162+0000 7f7159507640 10 monclient(hunting): _negotiate 2026-02-13T20:11:18.176 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.162+0000 7f7159507640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:18.176 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.162+0000 7f7159507640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:18.176 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.162+0000 7f7159507640 10 monclient(hunting): my global_id is 4112 2026-02-13T20:11:18.176 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.162+0000 7f7159507640 1 -- 10.20.193.110:0/492307401 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f713c0035e0 con 0x7f7154091950 2026-02-13T20:11:18.176 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.162+0000 7f7159507640 1 -- 10.20.193.110:0/492307401 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2459224535 0 0) 0x7f715408b730 con 0x7f7154092020 2026-02-13T20:11:18.176 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.162+0000 7f7159507640 10 monclient(hunting): _negotiate 2026-02-13T20:11:18.176 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.162+0000 7f7159507640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:18.177 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.162+0000 7f7159507640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:18.177 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.162+0000 7f7159507640 10 monclient(hunting): my global_id is 4107 2026-02-13T20:11:18.177 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.162+0000 7f7159507640 1 -- 10.20.193.110:0/492307401 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f715408bcf0 con 0x7f7154092020 2026-02-13T20:11:18.177 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.162+0000 7f7159507640 1 -- 10.20.193.110:0/492307401 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3466031728 0 0) 0x7f715405c5b0 con 0x7f71541401c0 2026-02-13T20:11:18.177 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.162+0000 7f7159507640 10 monclient(hunting): _negotiate 2026-02-13T20:11:18.177 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.162+0000 7f7159507640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:18.177 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.162+0000 7f7159507640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:18.177 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.162+0000 7f7159507640 10 monclient(hunting): my global_id is 4111 2026-02-13T20:11:18.177 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.162+0000 7f7159507640 1 -- 10.20.193.110:0/492307401 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f715408b730 con 0x7f71541401c0 2026-02-13T20:11:18.177 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.162+0000 7f7159507640 1 -- 10.20.193.110:0/492307401 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1495099262 0 0) 0x7f713c0035e0 con 0x7f7154091950 2026-02-13T20:11:18.177 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.162+0000 7f7159507640 1 -- 10.20.193.110:0/492307401 >> v1:10.20.193.188:6789/0 conn(0x7f71541401c0 legacy=0x7f7154091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:18.177 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.162+0000 7f7159507640 1 -- 10.20.193.110:0/492307401 >> v1:10.20.193.110:6789/0 conn(0x7f7154092020 legacy=0x7f71541812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:18.178 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.162+0000 7f7159507640 10 monclient: _finish_hunting 0 2026-02-13T20:11:18.178 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.162+0000 7f7159507640 1 monclient: found mon.noname-b 2026-02-13T20:11:18.178 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.162+0000 7f7159507640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:18.178 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.162+0000 7f7159507640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:11:18.178 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.162+0000 7f7159507640 1 -- 10.20.193.110:0/492307401 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7154140590 con 0x7f7154091950 2026-02-13T20:11:18.178 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.162+0000 7f7159507640 10 monclient: _finish_auth 0 2026-02-13T20:11:18.178 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.162+0000 7f7159507640 10 monclient: _check_auth_tickets 2026-02-13T20:11:18.178 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.162+0000 7f7159507640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:18.178 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.162+0000 7f7159507640 1 -- 10.20.193.110:0/492307401 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f7150003de0 con 0x7f7154091950 2026-02-13T20:11:18.178 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.162+0000 7f715c794640 5 monclient: authenticate success, global_id 4112 2026-02-13T20:11:18.178 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.162+0000 7f7159507640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:18.178 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.162+0000 7f7159507640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:11:18.179 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.162+0000 7f7159507640 10 monclient: dump: 2026-02-13T20:11:18.179 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:18.179 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:18.179 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.179 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.179 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:18.179 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:18.179 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:18.179 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:18.179 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:18.179 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:18.179 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.162+0000 7f715c794640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:18.179 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.162+0000 7f7159507640 1 -- 10.20.193.110:0/492307401 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7150003ff0 con 0x7f7154091950 2026-02-13T20:11:18.180 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.162+0000 7f7159507640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:18.180 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.162+0000 7f7159507640 1 -- 10.20.193.110:0/492307401 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f7150004400 con 0x7f7154091950 2026-02-13T20:11:18.180 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.162+0000 7f715c794640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:18.180 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.162+0000 7f715c794640 4 set_mon_vals no callback set 2026-02-13T20:11:18.180 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.162+0000 7f7159507640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:18.180 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.162+0000 7f7159507640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:18.180 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.162+0000 7f7159507640 10 monclient: dump: 2026-02-13T20:11:18.180 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:18.180 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:18.180 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.180 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.180 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:18.181 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:18.181 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:18.181 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:18.181 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:18.181 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:18.181 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.162+0000 7f715c794640 10 monclient: shutdown 2026-02-13T20:11:18.181 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.162+0000 7f715c794640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:18.181 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.162+0000 7f715c794640 1 -- 10.20.193.110:0/492307401 >> v1:10.20.193.110:6790/0 conn(0x7f7154091950 legacy=0x7f71541a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:18.181 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.162+0000 7f715c794640 1 -- 10.20.193.110:0/492307401 shutdown_connections 2026-02-13T20:11:18.181 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.162+0000 7f715c794640 1 -- 10.20.193.110:0/492307401 >> 10.20.193.110:0/492307401 conn(0x7f7154054e90 msgr2=0x7f7154058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:18.181 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.162+0000 7f715c794640 1 -- 10.20.193.110:0/492307401 shutdown_connections 2026-02-13T20:11:18.182 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.162+0000 7f715c794640 1 -- 10.20.193.110:0/492307401 wait complete. 2026-02-13T20:11:18.182 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.163+0000 7f715c794640 10 monclient: build_initial_monmap 2026-02-13T20:11:18.182 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.163+0000 7f715c794640 10 monclient: monmap: 2026-02-13T20:11:18.182 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:18.182 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:18.182 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:11:18.182 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:11:18.182 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:18.182 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:11:18.182 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:18.182 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:18.183 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:18.183 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:18.183 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.163+0000 7f715c794640 1 Processor -- start 2026-02-13T20:11:18.183 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.163+0000 7f715c794640 1 -- start start 2026-02-13T20:11:18.183 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.163+0000 7f715c794640 10 monclient: init 2026-02-13T20:11:18.183 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.163+0000 7f715c794640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:18.183 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.163+0000 7f715c794640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:11:18.183 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.163+0000 7f715c794640 10 monclient(hunting): picked mon.noname-a con 0x7f7154091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:18.183 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.163+0000 7f715c794640 10 monclient(hunting): picked mon.noname-c con 0x7f71541401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:18.183 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.163+0000 7f715c794640 10 monclient(hunting): picked mon.noname-b con 0x7f7154089e80 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:18.183 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.163+0000 7f715c794640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f715405d320 con 0x7f7154091950 2026-02-13T20:11:18.183 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.163+0000 7f715c794640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f715408c380 con 0x7f7154089e80 2026-02-13T20:11:18.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.163+0000 7f715c794640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f715408a880 con 0x7f71541401c0 2026-02-13T20:11:18.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.163+0000 7f715c794640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:18.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.163+0000 7f715c794640 10 monclient(hunting): authenticate will time out at 639.853538s 2026-02-13T20:11:18.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.163+0000 7f7159d08640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f71541401c0 0x7f7154089770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:44064/0 (socket says 10.20.193.110:44064) 2026-02-13T20:11:18.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.163+0000 7f7159d08640 1 -- 10.20.193.110:0/1183599631 learned_addr learned my addr 10.20.193.110:0/1183599631 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:18.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.163+0000 7f713affd640 1 -- 10.20.193.110:0/1183599631 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 640287644 0 0) 0x7f715408a880 con 0x7f71541401c0 2026-02-13T20:11:18.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.163+0000 7f713affd640 10 monclient(hunting): _negotiate 2026-02-13T20:11:18.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.163+0000 7f713affd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:18.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.163+0000 7f713affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:18.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.163+0000 7f713affd640 10 monclient(hunting): my global_id is 4115 2026-02-13T20:11:18.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.163+0000 7f713affd640 1 -- 10.20.193.110:0/1183599631 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71240035e0 con 0x7f71541401c0 2026-02-13T20:11:18.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.163+0000 7f713affd640 1 -- 10.20.193.110:0/1183599631 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 587518181 0 0) 0x7f715405d320 con 0x7f7154091950 2026-02-13T20:11:18.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.163+0000 7f713affd640 10 monclient(hunting): _negotiate 2026-02-13T20:11:18.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.163+0000 7f713affd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:18.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.163+0000 7f713affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:18.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.163+0000 7f713affd640 10 monclient(hunting): my global_id is 4110 2026-02-13T20:11:18.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.163+0000 7f713affd640 1 -- 10.20.193.110:0/1183599631 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f715408a880 con 0x7f7154091950 2026-02-13T20:11:18.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.163+0000 7f713affd640 1 -- 10.20.193.110:0/1183599631 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3722934714 0 0) 0x7f71240035e0 con 0x7f71541401c0 2026-02-13T20:11:18.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.163+0000 7f713affd640 1 -- 10.20.193.110:0/1183599631 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f715405d320 con 0x7f71541401c0 2026-02-13T20:11:18.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.163+0000 7f713affd640 1 -- 10.20.193.110:0/1183599631 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f7148003090 con 0x7f71541401c0 2026-02-13T20:11:18.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.163+0000 7f713affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:18.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.163+0000 7f713affd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:11:18.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.163+0000 7f713affd640 10 monclient(hunting): dump: 2026-02-13T20:11:18.185 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:18.186 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:18.186 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.186 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.186 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:18.186 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:18.186 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:18.186 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:18.186 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:18.186 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:18.186 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.163+0000 7f713affd640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:18.186 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.163+0000 7f713affd640 1 -- 10.20.193.110:0/1183599631 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3563143652 0 0) 0x7f715405d320 con 0x7f71541401c0 2026-02-13T20:11:18.186 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.163+0000 7f713affd640 1 -- 10.20.193.110:0/1183599631 >> v1:10.20.193.188:6789/0 conn(0x7f7154089e80 legacy=0x7f71541a2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:18.187 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.163+0000 7f713affd640 1 -- 10.20.193.110:0/1183599631 >> v1:10.20.193.110:6789/0 conn(0x7f7154091950 legacy=0x7f7154089060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:18.187 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.163+0000 7f713affd640 10 monclient: _finish_hunting 0 2026-02-13T20:11:18.187 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.163+0000 7f713affd640 1 monclient: found mon.c 2026-02-13T20:11:18.187 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.163+0000 7f713affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:18.187 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.163+0000 7f713affd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:18.187 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.163+0000 7f713affd640 1 -- 10.20.193.110:0/1183599631 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f715412f990 con 0x7f71541401c0 2026-02-13T20:11:18.187 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.163+0000 7f713affd640 10 monclient: _finish_auth 0 2026-02-13T20:11:18.187 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.163+0000 7f713affd640 10 monclient: _check_auth_tickets 2026-02-13T20:11:18.187 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.163+0000 7f713affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:18.187 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.164+0000 7f715c794640 5 monclient: authenticate success, global_id 4115 2026-02-13T20:11:18.187 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.164+0000 7f715c794640 10 monclient: _renew_subs 2026-02-13T20:11:18.187 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.164+0000 7f715c794640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:18.188 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.164+0000 7f715c794640 1 -- 10.20.193.110:0/1183599631 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f715412f6b0 con 0x7f71541401c0 2026-02-13T20:11:18.188 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.164+0000 7f715c794640 10 monclient: _renew_subs 2026-02-13T20:11:18.188 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.164+0000 7f715c794640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:18.188 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.164+0000 7f715c794640 1 -- 10.20.193.110:0/1183599631 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f71541a3770 con 0x7f71541401c0 2026-02-13T20:11:18.188 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.164+0000 7f713affd640 1 -- 10.20.193.110:0/1183599631 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7148003260 con 0x7f71541401c0 2026-02-13T20:11:18.188 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.164+0000 7f713affd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:18.188 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.164+0000 7f713affd640 1 -- 10.20.193.110:0/1183599631 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f7148004ad0 con 0x7f71541401c0 2026-02-13T20:11:18.188 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.164+0000 7f713affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:18.188 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.164+0000 7f713affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:18.188 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.164+0000 7f713affd640 10 monclient: dump: 2026-02-13T20:11:18.188 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:18.189 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:18.189 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.189 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.189 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:18.189 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:18.189 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:18.189 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:18.189 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:18.189 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:18.189 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.164+0000 7f7158d06640 4 set_mon_vals no callback set 2026-02-13T20:11:18.189 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.164+0000 7f713affd640 1 -- 10.20.193.110:0/1183599631 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f7148005040 con 0x7f71541401c0 2026-02-13T20:11:18.190 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.164+0000 7f713affd640 1 -- 10.20.193.110:0/1183599631 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (unknown 1702619060 0 0) 0x7f71480069a0 con 0x7f71541401c0 2026-02-13T20:11:18.190 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.164+0000 7f715c794640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:18.190 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.164+0000 7f715c794640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:18.190 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.164+0000 7f715c794640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:18.190 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.164+0000 7f715c794640 1 -- 10.20.193.110:0/1183599631 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71540008d0 con 0x7f71541401c0 2026-02-13T20:11:18.190 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.164+0000 7f7159d08640 1 -- 10.20.193.110:0/1183599631 >> v1:10.20.193.110:6790/0 conn(0x7f71541401c0 legacy=0x7f7154089770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-13T20:11:18.190 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.164+0000 7f7159d08640 1 -- 10.20.193.110:0/1183599631 >> v1:10.20.193.110:6790/0 conn(0x7f71541401c0 legacy=0x7f7154089770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T20:11:18.190 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.164+0000 7f7159d08640 1 --1- 10.20.193.110:0/1183599631 >> v1:10.20.193.110:6790/0 conn(0x7f71541401c0 0x7f7154089770 :-1 s=OPENED pgs=12 gs=2 cs=1 l=1).handle_message read tag failed 2026-02-13T20:11:18.190 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.164+0000 7f7159d08640 1 --1- 10.20.193.110:0/1183599631 >> v1:10.20.193.110:6790/0 conn(0x7f71541401c0 0x7f7154089770 :-1 s=OPENED pgs=12 gs=2 cs=1 l=1).fault on lossy channel, failing 2026-02-13T20:11:18.190 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.164+0000 7f713affd640 10 monclient: ms_handle_reset current mon v1:10.20.193.110:6790/0 2026-02-13T20:11:18.190 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.164+0000 7f713affd640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:18.190 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.164+0000 7f713affd640 1 -- 10.20.193.110:0/1183599631 >> v1:10.20.193.110:6790/0 conn(0x7f71541401c0 legacy=0x7f7154089770 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:11:18.190 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.164+0000 7f713affd640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:11:18.191 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.164+0000 7f713affd640 10 monclient(hunting): picked mon.a con 0x7f7154091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:18.191 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.164+0000 7f713affd640 10 monclient(hunting): picked mon.c con 0x7f7124028060 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:18.191 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.164+0000 7f713affd640 10 monclient(hunting): picked mon.b con 0x7f7154089e80 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:18.191 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.164+0000 7f713affd640 1 -- 10.20.193.110:0/1183599631 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f715405d320 con 0x7f7154091950 2026-02-13T20:11:18.191 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.164+0000 7f713affd640 1 -- 10.20.193.110:0/1183599631 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f715408a880 con 0x7f7154089e80 2026-02-13T20:11:18.191 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.164+0000 7f713affd640 1 -- 10.20.193.110:0/1183599631 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f715408c380 con 0x7f7124028060 2026-02-13T20:11:18.191 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.164+0000 7f713affd640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:18.191 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.164+0000 7f713affd640 1 -- 10.20.193.110:0/1183599631 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2731638838 0 0) 0x7f715405d320 con 0x7f7154091950 2026-02-13T20:11:18.191 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.164+0000 7f713affd640 10 monclient(hunting): _negotiate 2026-02-13T20:11:18.191 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.164+0000 7f713affd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:18.191 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.164+0000 7f713affd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-13T20:11:18.191 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.164+0000 7f713affd640 1 -- 10.20.193.110:0/1183599631 --> v1:10.20.193.110:6789/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7f712406bcf0 con 0x7f7154091950 2026-02-13T20:11:18.191 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.165+0000 7f713affd640 1 -- 10.20.193.110:0/1183599631 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (unknown 4015993428 0 0) 0x7f712406bcf0 con 0x7f7154091950 2026-02-13T20:11:18.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.165+0000 7f713affd640 1 -- 10.20.193.110:0/1183599631 >> v1:10.20.193.110:6790/0 conn(0x7f7124028060 legacy=0x7f71240484e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:18.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.165+0000 7f713affd640 1 -- 10.20.193.110:0/1183599631 >> v1:10.20.193.188:6789/0 conn(0x7f7154089e80 legacy=0x7f712406a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:18.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.165+0000 7f713affd640 10 monclient: _finish_hunting 0 2026-02-13T20:11:18.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.165+0000 7f713affd640 1 monclient: found mon.a 2026-02-13T20:11:18.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.165+0000 7f713affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:18.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.165+0000 7f713affd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:18.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.165+0000 7f713affd640 1 -- 10.20.193.110:0/1183599631 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+}) -- 0x7f71240035e0 con 0x7f7154091950 2026-02-13T20:11:18.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.165+0000 7f713affd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:18.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.165+0000 7f713affd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:18.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.165+0000 7f713affd640 1 -- 10.20.193.110:0/1183599631 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f715405d320 con 0x7f7154091950 2026-02-13T20:11:18.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.165+0000 7f713affd640 10 monclient: _finish_auth 0 2026-02-13T20:11:18.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.165+0000 7f713affd640 10 monclient: _check_auth_tickets 2026-02-13T20:11:18.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.165+0000 7f713affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:18.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.165+0000 7f713affd640 1 -- 10.20.193.110:0/1183599631 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f7144003660 con 0x7f7154091950 2026-02-13T20:11:18.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.165+0000 7f713affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:18.193 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.165+0000 7f713affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:18.193 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.165+0000 7f713affd640 10 monclient: dump: 2026-02-13T20:11:18.193 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:18.193 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:18.193 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.193 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.193 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:18.193 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:18.193 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:18.193 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:18.193 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:18.193 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:18.193 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.165+0000 7f713affd640 1 -- 10.20.193.110:0/1183599631 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f71440037c0 con 0x7f7154091950 2026-02-13T20:11:18.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.165+0000 7f713affd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:18.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.165+0000 7f713affd640 1 -- 10.20.193.110:0/1183599631 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f7144003dc0 con 0x7f7154091950 2026-02-13T20:11:18.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.165+0000 7f713bfff640 4 set_mon_vals no callback set 2026-02-13T20:11:18.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.166+0000 7f713affd640 1 -- 10.20.193.110:0/1183599631 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (unknown 1092875540 0 2392355004) 0x7f7144005480 con 0x7f7154091950 2026-02-13T20:11:18.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.166+0000 7f713affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:18.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.166+0000 7f713affd640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:11:18.198 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.197+0000 7f715c794640 10 start_mon_command cmd=[{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-13T20:11:18.198 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.197+0000 7f715c794640 10 monclient: _send_command 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-13T20:11:18.198 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.197+0000 7f715c794640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:18.198 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.197+0000 7f715c794640 1 -- 10.20.193.110:0/1183599631 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f7154058410 con 0x7f7154091950 2026-02-13T20:11:18.200 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.199+0000 7f713affd640 1 -- 10.20.193.110:0/1183599631 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (unknown 2277712955 0 0) 0x7f71440040a0 con 0x7f7154091950 2026-02-13T20:11:18.200 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.199+0000 7f713affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-13T20:11:18.201 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.199+0000 7f713affd640 10 monclient: _finish_command 2 = system:0 adjusted tunables profile to default 2026-02-13T20:11:18.201 INFO:teuthology.orchestra.run.trial110.stderr:adjusted tunables profile to default 2026-02-13T20:11:18.202 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.200+0000 7f715c794640 10 monclient: shutdown 2026-02-13T20:11:18.202 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.200+0000 7f715c794640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:18.202 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.200+0000 7f715c794640 1 -- 10.20.193.110:0/1183599631 >> v1:10.20.193.110:6789/0 conn(0x7f7154091950 legacy=0x7f71240266f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:18.202 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.200+0000 7f715c794640 1 -- 10.20.193.110:0/1183599631 shutdown_connections 2026-02-13T20:11:18.202 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.200+0000 7f715c794640 1 -- 10.20.193.110:0/1183599631 >> 10.20.193.110:0/1183599631 conn(0x7f7154054e90 msgr2=0x7f715408ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:18.202 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.200+0000 7f715c794640 1 -- 10.20.193.110:0/1183599631 shutdown_connections 2026-02-13T20:11:18.202 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:18.200+0000 7f715c794640 1 -- 10.20.193.110:0/1183599631 wait complete. 2026-02-13T20:11:18.208 INFO:tasks.ceph:check_enable_crimson: False 2026-02-13T20:11:18.208 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-13T20:11:18.208 DEBUG:teuthology.orchestra.run.trial110:> set -ex 2026-02-13T20:11:18.208 DEBUG:teuthology.orchestra.run.trial110:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-13T20:11:18.234 DEBUG:teuthology.orchestra.run.trial110:> set -ex 2026-02-13T20:11:18.234 DEBUG:teuthology.orchestra.run.trial110:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-13T20:11:18.297 DEBUG:teuthology.orchestra.run.trial110:> set -ex 2026-02-13T20:11:18.297 DEBUG:teuthology.orchestra.run.trial110:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-13T20:11:18.360 DEBUG:teuthology.orchestra.run.trial188:> set -ex 2026-02-13T20:11:18.361 DEBUG:teuthology.orchestra.run.trial188:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-13T20:11:18.385 DEBUG:teuthology.orchestra.run.trial188:> set -ex 2026-02-13T20:11:18.385 DEBUG:teuthology.orchestra.run.trial188:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2026-02-13T20:11:18.450 DEBUG:teuthology.orchestra.run.trial188:> set -ex 2026-02-13T20:11:18.450 DEBUG:teuthology.orchestra.run.trial188:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2026-02-13T20:11:18.513 DEBUG:teuthology.orchestra.run.trial188:> sudo ceph --cluster ceph osd new 88457b09-7bbe-4ebe-8a8b-4c980153af2c 0 2026-02-13T20:11:18.621 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.611+0000 7f23c1d0c640 10 monclient: get_monmap_and_config 2026-02-13T20:11:18.621 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.611+0000 7f23c1d0c640 10 monclient: build_initial_monmap 2026-02-13T20:11:18.621 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.611+0000 7f23c1d0c640 10 monclient: monmap: 2026-02-13T20:11:18.621 INFO:teuthology.orchestra.run.trial188.stderr:epoch 0 2026-02-13T20:11:18.621 INFO:teuthology.orchestra.run.trial188.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:18.621 INFO:teuthology.orchestra.run.trial188.stderr:last_changed 2026-02-13T20:11:18.612867+0000 2026-02-13T20:11:18.621 INFO:teuthology.orchestra.run.trial188.stderr:created 2026-02-13T20:11:18.612867+0000 2026-02-13T20:11:18.621 INFO:teuthology.orchestra.run.trial188.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:18.621 INFO:teuthology.orchestra.run.trial188.stderr:election_strategy: 3 2026-02-13T20:11:18.622 INFO:teuthology.orchestra.run.trial188.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:18.622 INFO:teuthology.orchestra.run.trial188.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:18.622 INFO:teuthology.orchestra.run.trial188.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:18.622 INFO:teuthology.orchestra.run.trial188.stderr: 2026-02-13T20:11:18.622 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.612+0000 7f23c1d0c640 1 Processor -- start 2026-02-13T20:11:18.622 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.612+0000 7f23c1d0c640 1 -- start start 2026-02-13T20:11:18.622 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.612+0000 7f23c1d0c640 10 monclient: init 2026-02-13T20:11:18.622 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.612+0000 7f23c1d0c640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:18.622 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.612+0000 7f23c1d0c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:11:18.622 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.612+0000 7f23c1d0c640 10 monclient(hunting): picked mon.noname-b con 0x7f23bc1401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:18.622 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.612+0000 7f23c1d0c640 10 monclient(hunting): picked mon.noname-c con 0x7f23bc092020 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:18.622 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.612+0000 7f23c1d0c640 10 monclient(hunting): picked mon.noname-a con 0x7f23bc091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:18.623 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.612+0000 7f23c1d0c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23bc08b730 con 0x7f23bc091950 2026-02-13T20:11:18.623 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.612+0000 7f23c1d0c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23bc05c5b0 con 0x7f23bc092020 2026-02-13T20:11:18.623 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.612+0000 7f23c1d0c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23bc08bcf0 con 0x7f23bc1401c0 2026-02-13T20:11:18.623 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.612+0000 7f23c1d0c640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:18.623 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.612+0000 7f23c1d0c640 10 monclient(hunting): authenticate will time out at 622.181764s 2026-02-13T20:11:18.623 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.612+0000 7f23baffd640 1 --1- >> v1:10.20.193.188:6789/0 conn(0x7f23bc092020 0x7f23bc1812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.188:6789/0 says I am v1:10.20.193.188:42482/0 (socket says 10.20.193.188:42482) 2026-02-13T20:11:18.623 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.612+0000 7f23baffd640 1 -- 10.20.193.188:0/566225838 learned_addr learned my addr 10.20.193.188:0/566225838 (peer_addr_for_me v1:10.20.193.188:0/0) 2026-02-13T20:11:18.623 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.613+0000 7f23ba7fc640 1 -- 10.20.193.188:0/566225838 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1253730041 0 0) 0x7f23bc05c5b0 con 0x7f23bc092020 2026-02-13T20:11:18.623 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.613+0000 7f23ba7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:11:18.623 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.613+0000 7f23ba7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:18.623 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.613+0000 7f23ba7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:18.623 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.613+0000 7f23ba7fc640 10 monclient(hunting): my global_id is 4114 2026-02-13T20:11:18.624 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.613+0000 7f23ba7fc640 1 -- 10.20.193.188:0/566225838 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23a00035e0 con 0x7f23bc092020 2026-02-13T20:11:18.624 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.613+0000 7f23ba7fc640 1 -- 10.20.193.188:0/566225838 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 666495580 0 0) 0x7f23a00035e0 con 0x7f23bc092020 2026-02-13T20:11:18.624 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.613+0000 7f23ba7fc640 1 -- 10.20.193.188:0/566225838 >> v1:10.20.193.110:6790/0 conn(0x7f23bc1401c0 legacy=0x7f23bc091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T20:11:18.624 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.613+0000 7f23ba7fc640 1 -- 10.20.193.188:0/566225838 >> v1:10.20.193.110:6789/0 conn(0x7f23bc091950 legacy=0x7f23bc1a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:18.624 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.613+0000 7f23ba7fc640 10 monclient: _finish_hunting 0 2026-02-13T20:11:18.624 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.613+0000 7f23ba7fc640 1 monclient: found mon.noname-c 2026-02-13T20:11:18.624 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.613+0000 7f23ba7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:18.624 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.613+0000 7f23ba7fc640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.188:6789/0 2026-02-13T20:11:18.624 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.613+0000 7f23ba7fc640 1 -- 10.20.193.188:0/566225838 --> v1:10.20.193.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23bc140590 con 0x7f23bc092020 2026-02-13T20:11:18.624 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.613+0000 7f23ba7fc640 10 monclient: _finish_auth 0 2026-02-13T20:11:18.624 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.613+0000 7f23ba7fc640 10 monclient: _check_auth_tickets 2026-02-13T20:11:18.624 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.613+0000 7f23ba7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:18.624 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.613+0000 7f23ba7fc640 1 -- 10.20.193.188:0/566225838 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f23ac002dd0 con 0x7f23bc092020 2026-02-13T20:11:18.625 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.613+0000 7f23c1d0c640 5 monclient: authenticate success, global_id 4114 2026-02-13T20:11:18.625 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.613+0000 7f23ba7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:18.625 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.613+0000 7f23ba7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:11:18.625 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.613+0000 7f23ba7fc640 10 monclient: dump: 2026-02-13T20:11:18.625 INFO:teuthology.orchestra.run.trial188.stderr:epoch 1 2026-02-13T20:11:18.625 INFO:teuthology.orchestra.run.trial188.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:18.625 INFO:teuthology.orchestra.run.trial188.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.625 INFO:teuthology.orchestra.run.trial188.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.625 INFO:teuthology.orchestra.run.trial188.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:18.625 INFO:teuthology.orchestra.run.trial188.stderr:election_strategy: 3 2026-02-13T20:11:18.625 INFO:teuthology.orchestra.run.trial188.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:18.625 INFO:teuthology.orchestra.run.trial188.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:18.626 INFO:teuthology.orchestra.run.trial188.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:18.626 INFO:teuthology.orchestra.run.trial188.stderr: 2026-02-13T20:11:18.626 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.613+0000 7f23c1d0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:18.626 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.613+0000 7f23ba7fc640 1 -- 10.20.193.188:0/566225838 <== mon.1 v1:10.20.193.188:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f23ac003020 con 0x7f23bc092020 2026-02-13T20:11:18.626 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.613+0000 7f23ba7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:18.626 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.613+0000 7f23ba7fc640 1 -- 10.20.193.188:0/566225838 <== mon.1 v1:10.20.193.188:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f23ac003430 con 0x7f23bc092020 2026-02-13T20:11:18.626 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.613+0000 7f23c1d0c640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:18.626 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.613+0000 7f23c1d0c640 4 set_mon_vals no callback set 2026-02-13T20:11:18.626 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.613+0000 7f23ba7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:18.626 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.613+0000 7f23ba7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:11:18.626 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.613+0000 7f23ba7fc640 10 monclient: dump: 2026-02-13T20:11:18.626 INFO:teuthology.orchestra.run.trial188.stderr:epoch 1 2026-02-13T20:11:18.626 INFO:teuthology.orchestra.run.trial188.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:18.627 INFO:teuthology.orchestra.run.trial188.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.627 INFO:teuthology.orchestra.run.trial188.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.627 INFO:teuthology.orchestra.run.trial188.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:18.627 INFO:teuthology.orchestra.run.trial188.stderr:election_strategy: 3 2026-02-13T20:11:18.627 INFO:teuthology.orchestra.run.trial188.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:18.627 INFO:teuthology.orchestra.run.trial188.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:18.627 INFO:teuthology.orchestra.run.trial188.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:18.627 INFO:teuthology.orchestra.run.trial188.stderr: 2026-02-13T20:11:18.627 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.613+0000 7f23c1d0c640 10 monclient: shutdown 2026-02-13T20:11:18.627 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.613+0000 7f23c1d0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:18.627 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.613+0000 7f23c1d0c640 1 -- 10.20.193.188:0/566225838 >> v1:10.20.193.188:6789/0 conn(0x7f23bc092020 legacy=0x7f23bc1812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:18.627 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.613+0000 7f23c1d0c640 1 -- 10.20.193.188:0/566225838 shutdown_connections 2026-02-13T20:11:18.628 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.613+0000 7f23c1d0c640 1 -- 10.20.193.188:0/566225838 >> 10.20.193.188:0/566225838 conn(0x7f23bc054e90 msgr2=0x7f23bc058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:18.628 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.613+0000 7f23c1d0c640 1 -- 10.20.193.188:0/566225838 shutdown_connections 2026-02-13T20:11:18.628 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.613+0000 7f23c1d0c640 1 -- 10.20.193.188:0/566225838 wait complete. 2026-02-13T20:11:18.628 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.614+0000 7f23c1d0c640 10 monclient: build_initial_monmap 2026-02-13T20:11:18.628 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.614+0000 7f23c1d0c640 10 monclient: monmap: 2026-02-13T20:11:18.628 INFO:teuthology.orchestra.run.trial188.stderr:epoch 0 2026-02-13T20:11:18.628 INFO:teuthology.orchestra.run.trial188.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:18.628 INFO:teuthology.orchestra.run.trial188.stderr:last_changed 0.000000 2026-02-13T20:11:18.628 INFO:teuthology.orchestra.run.trial188.stderr:created 0.000000 2026-02-13T20:11:18.628 INFO:teuthology.orchestra.run.trial188.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:18.628 INFO:teuthology.orchestra.run.trial188.stderr:election_strategy: 1 2026-02-13T20:11:18.628 INFO:teuthology.orchestra.run.trial188.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:18.628 INFO:teuthology.orchestra.run.trial188.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:18.629 INFO:teuthology.orchestra.run.trial188.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:18.629 INFO:teuthology.orchestra.run.trial188.stderr: 2026-02-13T20:11:18.629 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.614+0000 7f23c1d0c640 1 Processor -- start 2026-02-13T20:11:18.629 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.614+0000 7f23c1d0c640 1 -- start start 2026-02-13T20:11:18.629 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.614+0000 7f23c1d0c640 10 monclient: init 2026-02-13T20:11:18.629 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.614+0000 7f23c1d0c640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:18.629 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.614+0000 7f23c1d0c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:11:18.629 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.614+0000 7f23c1d0c640 10 monclient(hunting): picked mon.noname-b con 0x7f23bc091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:18.629 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.614+0000 7f23c1d0c640 10 monclient(hunting): picked mon.noname-c con 0x7f23bc1401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:18.629 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.614+0000 7f23c1d0c640 10 monclient(hunting): picked mon.noname-a con 0x7f23bc13f170 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:18.629 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.614+0000 7f23c1d0c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23bc08c2a0 con 0x7f23bc13f170 2026-02-13T20:11:18.629 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.614+0000 7f23c1d0c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23bc132580 con 0x7f23bc091950 2026-02-13T20:11:18.630 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.614+0000 7f23c1d0c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23bc05d320 con 0x7f23bc1401c0 2026-02-13T20:11:18.630 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.614+0000 7f23c1d0c640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:18.630 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.614+0000 7f23c1d0c640 10 monclient(hunting): authenticate will time out at 622.183589s 2026-02-13T20:11:18.630 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.614+0000 7f23bb7fe640 1 --1- >> v1:10.20.193.188:6789/0 conn(0x7f23bc091950 0x7f23bc13ea60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.188:6789/0 says I am v1:10.20.193.188:42488/0 (socket says 10.20.193.188:42488) 2026-02-13T20:11:18.630 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.614+0000 7f23bb7fe640 1 -- 10.20.193.188:0/2006337066 learned_addr learned my addr 10.20.193.188:0/2006337066 (peer_addr_for_me v1:10.20.193.188:0/0) 2026-02-13T20:11:18.630 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.614+0000 7f2397fff640 1 -- 10.20.193.188:0/2006337066 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3347545605 0 0) 0x7f23bc132580 con 0x7f23bc091950 2026-02-13T20:11:18.630 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.614+0000 7f2397fff640 10 monclient(hunting): _negotiate 2026-02-13T20:11:18.630 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.614+0000 7f2397fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:18.630 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.614+0000 7f2397fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:18.630 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.614+0000 7f2397fff640 10 monclient(hunting): my global_id is 4117 2026-02-13T20:11:18.630 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.614+0000 7f2397fff640 1 -- 10.20.193.188:0/2006337066 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f238c0035e0 con 0x7f23bc091950 2026-02-13T20:11:18.630 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.614+0000 7f2397fff640 1 -- 10.20.193.188:0/2006337066 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3205479107 0 0) 0x7f238c0035e0 con 0x7f23bc091950 2026-02-13T20:11:18.631 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.614+0000 7f2397fff640 1 -- 10.20.193.188:0/2006337066 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f23bc132580 con 0x7f23bc091950 2026-02-13T20:11:18.631 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.614+0000 7f2397fff640 1 -- 10.20.193.188:0/2006337066 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f23a80040b0 con 0x7f23bc091950 2026-02-13T20:11:18.631 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.614+0000 7f2397fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:18.631 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.614+0000 7f2397fff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:11:18.631 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.614+0000 7f2397fff640 10 monclient(hunting): dump: 2026-02-13T20:11:18.631 INFO:teuthology.orchestra.run.trial188.stderr:epoch 1 2026-02-13T20:11:18.631 INFO:teuthology.orchestra.run.trial188.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:18.631 INFO:teuthology.orchestra.run.trial188.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.631 INFO:teuthology.orchestra.run.trial188.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.631 INFO:teuthology.orchestra.run.trial188.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:18.631 INFO:teuthology.orchestra.run.trial188.stderr:election_strategy: 3 2026-02-13T20:11:18.631 INFO:teuthology.orchestra.run.trial188.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:18.631 INFO:teuthology.orchestra.run.trial188.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:18.632 INFO:teuthology.orchestra.run.trial188.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:18.632 INFO:teuthology.orchestra.run.trial188.stderr: 2026-02-13T20:11:18.632 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.614+0000 7f2397fff640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:18.632 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.615+0000 7f2397fff640 1 -- 10.20.193.188:0/2006337066 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1087512684 0 0) 0x7f23bc132580 con 0x7f23bc091950 2026-02-13T20:11:18.632 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.615+0000 7f2397fff640 1 -- 10.20.193.188:0/2006337066 >> v1:10.20.193.110:6790/0 conn(0x7f23bc1401c0 legacy=0x7f23bc193a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:18.632 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.615+0000 7f2397fff640 1 -- 10.20.193.188:0/2006337066 >> v1:10.20.193.110:6789/0 conn(0x7f23bc13f170 legacy=0x7f23bc195160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:18.632 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.615+0000 7f2397fff640 10 monclient: _finish_hunting 0 2026-02-13T20:11:18.632 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.615+0000 7f2397fff640 1 monclient: found mon.b 2026-02-13T20:11:18.632 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.615+0000 7f2397fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:18.632 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.615+0000 7f2397fff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:11:18.632 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.615+0000 7f2397fff640 1 -- 10.20.193.188:0/2006337066 --> v1:10.20.193.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23bc090ee0 con 0x7f23bc091950 2026-02-13T20:11:18.632 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.615+0000 7f2397fff640 10 monclient: _finish_auth 0 2026-02-13T20:11:18.632 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.615+0000 7f2397fff640 10 monclient: _check_auth_tickets 2026-02-13T20:11:18.633 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.615+0000 7f2397fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:18.633 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.615+0000 7f23c1d0c640 5 monclient: authenticate success, global_id 4117 2026-02-13T20:11:18.633 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.615+0000 7f23c1d0c640 10 monclient: _renew_subs 2026-02-13T20:11:18.633 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.615+0000 7f23c1d0c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:11:18.633 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.615+0000 7f23c1d0c640 1 -- 10.20.193.188:0/2006337066 --> v1:10.20.193.188:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f23bc08a8d0 con 0x7f23bc091950 2026-02-13T20:11:18.633 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.615+0000 7f23c1d0c640 10 monclient: _renew_subs 2026-02-13T20:11:18.633 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.615+0000 7f23c1d0c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:11:18.633 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.615+0000 7f23c1d0c640 1 -- 10.20.193.188:0/2006337066 --> v1:10.20.193.188:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f23bc1526c0 con 0x7f23bc091950 2026-02-13T20:11:18.633 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.615+0000 7f2397fff640 1 -- 10.20.193.188:0/2006337066 <== mon.1 v1:10.20.193.188:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f23a8004280 con 0x7f23bc091950 2026-02-13T20:11:18.633 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.615+0000 7f2397fff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:18.633 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.615+0000 7f2397fff640 1 -- 10.20.193.188:0/2006337066 <== mon.1 v1:10.20.193.188:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f23a8002910 con 0x7f23bc091950 2026-02-13T20:11:18.633 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.615+0000 7f2397fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:18.633 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.615+0000 7f23b9ffb640 4 set_mon_vals no callback set 2026-02-13T20:11:18.634 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.615+0000 7f2397fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:11:18.634 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.615+0000 7f2397fff640 10 monclient: dump: 2026-02-13T20:11:18.634 INFO:teuthology.orchestra.run.trial188.stderr:epoch 1 2026-02-13T20:11:18.634 INFO:teuthology.orchestra.run.trial188.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:18.634 INFO:teuthology.orchestra.run.trial188.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.634 INFO:teuthology.orchestra.run.trial188.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.634 INFO:teuthology.orchestra.run.trial188.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:18.634 INFO:teuthology.orchestra.run.trial188.stderr:election_strategy: 3 2026-02-13T20:11:18.634 INFO:teuthology.orchestra.run.trial188.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:18.634 INFO:teuthology.orchestra.run.trial188.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:18.634 INFO:teuthology.orchestra.run.trial188.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:18.634 INFO:teuthology.orchestra.run.trial188.stderr: 2026-02-13T20:11:18.635 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.615+0000 7f2397fff640 1 -- 10.20.193.188:0/2006337066 <== mon.1 v1:10.20.193.188:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f23a8002ec0 con 0x7f23bc091950 2026-02-13T20:11:18.635 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.615+0000 7f2397fff640 1 -- 10.20.193.188:0/2006337066 <== mon.1 v1:10.20.193.188:6789/0 8 ==== osd_map(2..2 src has 1..2) ==== 720+0+0 (unknown 2430059666 0 0) 0x7f23a8006950 con 0x7f23bc091950 2026-02-13T20:11:18.635 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.615+0000 7f23c1d0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:18.635 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.615+0000 7f23c1d0c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:18.635 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.615+0000 7f23c1d0c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:11:18.635 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.615+0000 7f23c1d0c640 1 -- 10.20.193.188:0/2006337066 --> v1:10.20.193.188:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23bc0008d0 con 0x7f23bc091950 2026-02-13T20:11:18.635 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.616+0000 7f2397fff640 1 -- 10.20.193.188:0/2006337066 <== mon.1 v1:10.20.193.188:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (unknown 1092875540 0 2392355004) 0x7f23a8003430 con 0x7f23bc091950 2026-02-13T20:11:18.635 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.616+0000 7f2397fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:18.635 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.616+0000 7f2397fff640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:11:18.652 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.650+0000 7f23c1d0c640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "88457b09-7bbe-4ebe-8a8b-4c980153af2c", "id": 0}] 2026-02-13T20:11:18.653 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.650+0000 7f23c1d0c640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "88457b09-7bbe-4ebe-8a8b-4c980153af2c", "id": 0}] 2026-02-13T20:11:18.653 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.650+0000 7f23c1d0c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:11:18.653 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.650+0000 7f23c1d0c640 1 -- 10.20.193.188:0/2006337066 --> v1:10.20.193.188:6789/0 -- mon_command({"prefix": "osd new", "uuid": "88457b09-7bbe-4ebe-8a8b-4c980153af2c", "id": 0} v 0) -- 0x7f23bc1529c0 con 0x7f23bc091950 2026-02-13T20:11:18.655 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.653+0000 7f2397fff640 1 -- 10.20.193.188:0/2006337066 <== mon.1 v1:10.20.193.188:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "88457b09-7bbe-4ebe-8a8b-4c980153af2c", "id": 0}]=0 v3) ==== 112+0+2 (unknown 3753178086 0 732707515) 0x7f23a8005ff0 con 0x7f23bc091950 2026-02-13T20:11:18.656 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.653+0000 7f2397fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "88457b09-7bbe-4ebe-8a8b-4c980153af2c", "id": 0}] 2026-02-13T20:11:18.656 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.653+0000 7f2397fff640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:11:18.656 INFO:teuthology.orchestra.run.trial188.stdout:0 2026-02-13T20:11:18.657 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.654+0000 7f23c1d0c640 10 monclient: shutdown 2026-02-13T20:11:18.657 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.654+0000 7f23c1d0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:18.657 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.654+0000 7f23c1d0c640 1 -- 10.20.193.188:0/2006337066 >> v1:10.20.193.188:6789/0 conn(0x7f23bc091950 legacy=0x7f23bc13ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:18.657 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.654+0000 7f23c1d0c640 1 -- 10.20.193.188:0/2006337066 shutdown_connections 2026-02-13T20:11:18.657 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.654+0000 7f23c1d0c640 1 -- 10.20.193.188:0/2006337066 >> 10.20.193.188:0/2006337066 conn(0x7f23bc054e90 msgr2=0x7f23bc08dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:18.657 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.654+0000 7f23c1d0c640 1 -- 10.20.193.188:0/2006337066 shutdown_connections 2026-02-13T20:11:18.657 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.654+0000 7f23c1d0c640 1 -- 10.20.193.188:0/2006337066 wait complete. 2026-02-13T20:11:18.664 DEBUG:teuthology.orchestra.run.trial188:> sudo ceph --cluster ceph osd new efb2f419-77ef-44b0-ae26-4c448073556b 1 2026-02-13T20:11:18.726 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.724+0000 7fc440a12640 10 monclient: get_monmap_and_config 2026-02-13T20:11:18.726 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.724+0000 7fc440a12640 10 monclient: build_initial_monmap 2026-02-13T20:11:18.727 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.724+0000 7fc440a12640 10 monclient: monmap: 2026-02-13T20:11:18.727 INFO:teuthology.orchestra.run.trial188.stderr:epoch 0 2026-02-13T20:11:18.727 INFO:teuthology.orchestra.run.trial188.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:18.727 INFO:teuthology.orchestra.run.trial188.stderr:last_changed 2026-02-13T20:11:18.724996+0000 2026-02-13T20:11:18.727 INFO:teuthology.orchestra.run.trial188.stderr:created 2026-02-13T20:11:18.724996+0000 2026-02-13T20:11:18.727 INFO:teuthology.orchestra.run.trial188.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:18.727 INFO:teuthology.orchestra.run.trial188.stderr:election_strategy: 3 2026-02-13T20:11:18.727 INFO:teuthology.orchestra.run.trial188.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:18.727 INFO:teuthology.orchestra.run.trial188.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:18.727 INFO:teuthology.orchestra.run.trial188.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:18.727 INFO:teuthology.orchestra.run.trial188.stderr: 2026-02-13T20:11:18.727 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.724+0000 7fc440a12640 1 Processor -- start 2026-02-13T20:11:18.728 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.724+0000 7fc440a12640 1 -- start start 2026-02-13T20:11:18.728 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.724+0000 7fc440a12640 10 monclient: init 2026-02-13T20:11:18.734 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.724+0000 7fc440a12640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:18.735 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.724+0000 7fc440a12640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:11:18.735 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.724+0000 7fc440a12640 10 monclient(hunting): picked mon.noname-b con 0x7fc43c1401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:18.735 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.724+0000 7fc440a12640 10 monclient(hunting): picked mon.noname-c con 0x7fc43c092020 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:18.735 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.724+0000 7fc440a12640 10 monclient(hunting): picked mon.noname-a con 0x7fc43c091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:18.735 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.724+0000 7fc440a12640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc43c08b730 con 0x7fc43c091950 2026-02-13T20:11:18.735 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.724+0000 7fc440a12640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc43c05c5b0 con 0x7fc43c092020 2026-02-13T20:11:18.735 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.724+0000 7fc440a12640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc43c08bcf0 con 0x7fc43c1401c0 2026-02-13T20:11:18.735 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.724+0000 7fc440a12640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:18.735 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.724+0000 7fc440a12640 10 monclient(hunting): authenticate will time out at 622.293835s 2026-02-13T20:11:18.735 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.724+0000 7fc439d74640 1 --1- >> v1:10.20.193.188:6789/0 conn(0x7fc43c092020 0x7fc43c1812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.188:6789/0 says I am v1:10.20.193.188:42502/0 (socket says 10.20.193.188:42502) 2026-02-13T20:11:18.736 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.724+0000 7fc439d74640 1 -- 10.20.193.188:0/751691786 learned_addr learned my addr 10.20.193.188:0/751691786 (peer_addr_for_me v1:10.20.193.188:0/0) 2026-02-13T20:11:18.736 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.725+0000 7fc439573640 1 -- 10.20.193.188:0/751691786 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1130633515 0 0) 0x7fc43c05c5b0 con 0x7fc43c092020 2026-02-13T20:11:18.736 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.725+0000 7fc439573640 10 monclient(hunting): _negotiate 2026-02-13T20:11:18.736 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.725+0000 7fc439573640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:18.736 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.725+0000 7fc439573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:18.736 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.725+0000 7fc439573640 10 monclient(hunting): my global_id is 4120 2026-02-13T20:11:18.736 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.725+0000 7fc439573640 1 -- 10.20.193.188:0/751691786 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4280035e0 con 0x7fc43c092020 2026-02-13T20:11:18.736 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.725+0000 7fc439573640 1 -- 10.20.193.188:0/751691786 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2317376261 0 0) 0x7fc43c08bcf0 con 0x7fc43c1401c0 2026-02-13T20:11:18.736 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.725+0000 7fc439573640 10 monclient(hunting): _negotiate 2026-02-13T20:11:18.736 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.725+0000 7fc439573640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:18.736 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.725+0000 7fc439573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:18.736 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.725+0000 7fc439573640 10 monclient(hunting): my global_id is 4121 2026-02-13T20:11:18.737 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.725+0000 7fc439573640 1 -- 10.20.193.188:0/751691786 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc43c05c5b0 con 0x7fc43c1401c0 2026-02-13T20:11:18.737 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.725+0000 7fc439573640 1 -- 10.20.193.188:0/751691786 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3626129455 0 0) 0x7fc4280035e0 con 0x7fc43c092020 2026-02-13T20:11:18.737 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.725+0000 7fc439573640 1 -- 10.20.193.188:0/751691786 >> v1:10.20.193.110:6790/0 conn(0x7fc43c1401c0 legacy=0x7fc43c091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:18.737 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.725+0000 7fc439573640 1 -- 10.20.193.188:0/751691786 >> v1:10.20.193.110:6789/0 conn(0x7fc43c091950 legacy=0x7fc43c1a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T20:11:18.737 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.725+0000 7fc439573640 10 monclient: _finish_hunting 0 2026-02-13T20:11:18.737 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.725+0000 7fc439573640 1 monclient: found mon.noname-c 2026-02-13T20:11:18.737 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.725+0000 7fc439573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:18.737 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.725+0000 7fc439573640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.188:6789/0 2026-02-13T20:11:18.737 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.725+0000 7fc439573640 1 -- 10.20.193.188:0/751691786 --> v1:10.20.193.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc43c140590 con 0x7fc43c092020 2026-02-13T20:11:18.737 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.725+0000 7fc439573640 10 monclient: _finish_auth 0 2026-02-13T20:11:18.737 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.725+0000 7fc439573640 10 monclient: _check_auth_tickets 2026-02-13T20:11:18.737 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.725+0000 7fc439573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:18.738 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.725+0000 7fc440a12640 5 monclient: authenticate success, global_id 4120 2026-02-13T20:11:18.738 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.725+0000 7fc439573640 1 -- 10.20.193.188:0/751691786 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc424002dd0 con 0x7fc43c092020 2026-02-13T20:11:18.738 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.725+0000 7fc440a12640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:18.738 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.725+0000 7fc439573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:18.738 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.725+0000 7fc439573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:11:18.738 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.725+0000 7fc439573640 10 monclient: dump: 2026-02-13T20:11:18.738 INFO:teuthology.orchestra.run.trial188.stderr:epoch 1 2026-02-13T20:11:18.738 INFO:teuthology.orchestra.run.trial188.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:18.738 INFO:teuthology.orchestra.run.trial188.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.738 INFO:teuthology.orchestra.run.trial188.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.738 INFO:teuthology.orchestra.run.trial188.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:18.738 INFO:teuthology.orchestra.run.trial188.stderr:election_strategy: 3 2026-02-13T20:11:18.738 INFO:teuthology.orchestra.run.trial188.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:18.739 INFO:teuthology.orchestra.run.trial188.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:18.739 INFO:teuthology.orchestra.run.trial188.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:18.739 INFO:teuthology.orchestra.run.trial188.stderr: 2026-02-13T20:11:18.739 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.725+0000 7fc440a12640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:18.739 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.725+0000 7fc439573640 1 -- 10.20.193.188:0/751691786 <== mon.1 v1:10.20.193.188:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc424003020 con 0x7fc43c092020 2026-02-13T20:11:18.739 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.725+0000 7fc439573640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:18.739 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.725+0000 7fc440a12640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:18.739 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.725+0000 7fc439573640 1 -- 10.20.193.188:0/751691786 <== mon.1 v1:10.20.193.188:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc424003430 con 0x7fc43c092020 2026-02-13T20:11:18.739 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.725+0000 7fc439573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:18.739 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.725+0000 7fc440a12640 4 set_mon_vals no callback set 2026-02-13T20:11:18.739 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.725+0000 7fc439573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:11:18.739 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.725+0000 7fc439573640 10 monclient: dump: 2026-02-13T20:11:18.740 INFO:teuthology.orchestra.run.trial188.stderr:epoch 1 2026-02-13T20:11:18.740 INFO:teuthology.orchestra.run.trial188.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:18.740 INFO:teuthology.orchestra.run.trial188.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.740 INFO:teuthology.orchestra.run.trial188.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.740 INFO:teuthology.orchestra.run.trial188.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:18.740 INFO:teuthology.orchestra.run.trial188.stderr:election_strategy: 3 2026-02-13T20:11:18.740 INFO:teuthology.orchestra.run.trial188.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:18.740 INFO:teuthology.orchestra.run.trial188.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:18.740 INFO:teuthology.orchestra.run.trial188.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:18.740 INFO:teuthology.orchestra.run.trial188.stderr: 2026-02-13T20:11:18.741 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.725+0000 7fc440a12640 10 monclient: shutdown 2026-02-13T20:11:18.741 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.725+0000 7fc440a12640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:18.741 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.725+0000 7fc440a12640 1 -- 10.20.193.188:0/751691786 >> v1:10.20.193.188:6789/0 conn(0x7fc43c092020 legacy=0x7fc43c1812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:18.741 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.725+0000 7fc440a12640 1 -- 10.20.193.188:0/751691786 shutdown_connections 2026-02-13T20:11:18.741 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.725+0000 7fc440a12640 1 -- 10.20.193.188:0/751691786 >> 10.20.193.188:0/751691786 conn(0x7fc43c054e90 msgr2=0x7fc43c058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:18.741 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.725+0000 7fc440a12640 1 -- 10.20.193.188:0/751691786 shutdown_connections 2026-02-13T20:11:18.741 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.725+0000 7fc440a12640 1 -- 10.20.193.188:0/751691786 wait complete. 2026-02-13T20:11:18.741 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.726+0000 7fc440a12640 10 monclient: build_initial_monmap 2026-02-13T20:11:18.741 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.726+0000 7fc440a12640 10 monclient: monmap: 2026-02-13T20:11:18.741 INFO:teuthology.orchestra.run.trial188.stderr:epoch 0 2026-02-13T20:11:18.741 INFO:teuthology.orchestra.run.trial188.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:18.741 INFO:teuthology.orchestra.run.trial188.stderr:last_changed 0.000000 2026-02-13T20:11:18.742 INFO:teuthology.orchestra.run.trial188.stderr:created 0.000000 2026-02-13T20:11:18.742 INFO:teuthology.orchestra.run.trial188.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:18.742 INFO:teuthology.orchestra.run.trial188.stderr:election_strategy: 1 2026-02-13T20:11:18.742 INFO:teuthology.orchestra.run.trial188.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:18.742 INFO:teuthology.orchestra.run.trial188.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:18.742 INFO:teuthology.orchestra.run.trial188.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:18.742 INFO:teuthology.orchestra.run.trial188.stderr: 2026-02-13T20:11:18.742 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.726+0000 7fc440a12640 1 Processor -- start 2026-02-13T20:11:18.742 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.726+0000 7fc440a12640 1 -- start start 2026-02-13T20:11:18.742 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.726+0000 7fc440a12640 10 monclient: init 2026-02-13T20:11:18.742 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.726+0000 7fc440a12640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:18.742 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.726+0000 7fc440a12640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:11:18.742 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.726+0000 7fc440a12640 10 monclient(hunting): picked mon.noname-a con 0x7fc43c091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:18.743 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.726+0000 7fc440a12640 10 monclient(hunting): picked mon.noname-b con 0x7fc43c1401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:18.743 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.726+0000 7fc440a12640 10 monclient(hunting): picked mon.noname-c con 0x7fc43c13f000 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:18.743 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.726+0000 7fc440a12640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc43c08c410 con 0x7fc43c091950 2026-02-13T20:11:18.743 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.726+0000 7fc440a12640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc43c08a920 con 0x7fc43c1401c0 2026-02-13T20:11:18.743 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.726+0000 7fc440a12640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc43c05d320 con 0x7fc43c13f000 2026-02-13T20:11:18.743 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.726+0000 7fc440a12640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:18.743 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.726+0000 7fc440a12640 10 monclient(hunting): authenticate will time out at 622.295874s 2026-02-13T20:11:18.743 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.726+0000 7fc439d74640 1 --1- >> v1:10.20.193.188:6789/0 conn(0x7fc43c1401c0 0x7fc43c193a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.188:6789/0 says I am v1:10.20.193.188:42518/0 (socket says 10.20.193.188:42518) 2026-02-13T20:11:18.743 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.726+0000 7fc439d74640 1 -- 10.20.193.188:0/1804383255 learned_addr learned my addr 10.20.193.188:0/1804383255 (peer_addr_for_me v1:10.20.193.188:0/0) 2026-02-13T20:11:18.743 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.727+0000 7fc422ffd640 1 -- 10.20.193.188:0/1804383255 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1409605538 0 0) 0x7fc43c08a920 con 0x7fc43c1401c0 2026-02-13T20:11:18.743 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.727+0000 7fc422ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:11:18.743 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.727+0000 7fc422ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:18.744 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.727+0000 7fc422ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:18.744 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.727+0000 7fc422ffd640 10 monclient(hunting): my global_id is 4123 2026-02-13T20:11:18.744 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.727+0000 7fc422ffd640 1 -- 10.20.193.188:0/1804383255 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4080035e0 con 0x7fc43c1401c0 2026-02-13T20:11:18.744 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.727+0000 7fc422ffd640 1 -- 10.20.193.188:0/1804383255 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3829271657 0 0) 0x7fc4080035e0 con 0x7fc43c1401c0 2026-02-13T20:11:18.744 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.727+0000 7fc422ffd640 1 -- 10.20.193.188:0/1804383255 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc43c08a920 con 0x7fc43c1401c0 2026-02-13T20:11:18.744 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.727+0000 7fc422ffd640 1 -- 10.20.193.188:0/1804383255 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc424003340 con 0x7fc43c1401c0 2026-02-13T20:11:18.744 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.727+0000 7fc422ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:18.744 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.727+0000 7fc422ffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:11:18.744 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.727+0000 7fc422ffd640 10 monclient(hunting): dump: 2026-02-13T20:11:18.744 INFO:teuthology.orchestra.run.trial188.stderr:epoch 1 2026-02-13T20:11:18.744 INFO:teuthology.orchestra.run.trial188.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:18.744 INFO:teuthology.orchestra.run.trial188.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.744 INFO:teuthology.orchestra.run.trial188.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.745 INFO:teuthology.orchestra.run.trial188.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:18.745 INFO:teuthology.orchestra.run.trial188.stderr:election_strategy: 3 2026-02-13T20:11:18.745 INFO:teuthology.orchestra.run.trial188.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:18.745 INFO:teuthology.orchestra.run.trial188.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:18.745 INFO:teuthology.orchestra.run.trial188.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:18.745 INFO:teuthology.orchestra.run.trial188.stderr: 2026-02-13T20:11:18.745 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.727+0000 7fc422ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:18.745 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.727+0000 7fc422ffd640 1 -- 10.20.193.188:0/1804383255 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1879331705 0 0) 0x7fc43c05d320 con 0x7fc43c13f000 2026-02-13T20:11:18.745 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.727+0000 7fc422ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:11:18.745 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.727+0000 7fc422ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:18.745 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.727+0000 7fc422ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:18.745 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.727+0000 7fc422ffd640 10 monclient(hunting): my global_id is 4124 2026-02-13T20:11:18.746 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.727+0000 7fc422ffd640 1 -- 10.20.193.188:0/1804383255 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4080035e0 con 0x7fc43c13f000 2026-02-13T20:11:18.746 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.727+0000 7fc422ffd640 1 -- 10.20.193.188:0/1804383255 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2547619406 0 0) 0x7fc43c08a920 con 0x7fc43c1401c0 2026-02-13T20:11:18.746 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.727+0000 7fc422ffd640 1 -- 10.20.193.188:0/1804383255 >> v1:10.20.193.110:6790/0 conn(0x7fc43c13f000 legacy=0x7fc43c195120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:18.746 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.727+0000 7fc422ffd640 1 -- 10.20.193.188:0/1804383255 >> v1:10.20.193.110:6789/0 conn(0x7fc43c091950 legacy=0x7fc43c13e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:18.746 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.727+0000 7fc422ffd640 10 monclient: _finish_hunting 0 2026-02-13T20:11:18.746 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.727+0000 7fc422ffd640 1 monclient: found mon.b 2026-02-13T20:11:18.746 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.727+0000 7fc422ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:18.746 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.727+0000 7fc422ffd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:11:18.746 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.727+0000 7fc422ffd640 1 -- 10.20.193.188:0/1804383255 --> v1:10.20.193.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc43c153260 con 0x7fc43c1401c0 2026-02-13T20:11:18.746 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.727+0000 7fc422ffd640 10 monclient: _finish_auth 0 2026-02-13T20:11:18.746 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.727+0000 7fc422ffd640 10 monclient: _check_auth_tickets 2026-02-13T20:11:18.746 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.727+0000 7fc422ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:18.747 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.727+0000 7fc440a12640 5 monclient: authenticate success, global_id 4123 2026-02-13T20:11:18.747 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.727+0000 7fc440a12640 10 monclient: _renew_subs 2026-02-13T20:11:18.747 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.727+0000 7fc440a12640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:11:18.747 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.727+0000 7fc440a12640 1 -- 10.20.193.188:0/1804383255 --> v1:10.20.193.188:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc43c132310 con 0x7fc43c1401c0 2026-02-13T20:11:18.747 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.727+0000 7fc440a12640 10 monclient: _renew_subs 2026-02-13T20:11:18.747 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.727+0000 7fc440a12640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:11:18.747 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.727+0000 7fc440a12640 1 -- 10.20.193.188:0/1804383255 --> v1:10.20.193.188:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc43c131b20 con 0x7fc43c1401c0 2026-02-13T20:11:18.747 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.727+0000 7fc422ffd640 1 -- 10.20.193.188:0/1804383255 <== mon.1 v1:10.20.193.188:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc424004b50 con 0x7fc43c1401c0 2026-02-13T20:11:18.747 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.727+0000 7fc422ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:18.747 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.727+0000 7fc422ffd640 1 -- 10.20.193.188:0/1804383255 <== mon.1 v1:10.20.193.188:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc424004f30 con 0x7fc43c1401c0 2026-02-13T20:11:18.747 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.727+0000 7fc422ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:18.747 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.727+0000 7fc422ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:11:18.748 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.727+0000 7fc422ffd640 10 monclient: dump: 2026-02-13T20:11:18.748 INFO:teuthology.orchestra.run.trial188.stderr:epoch 1 2026-02-13T20:11:18.748 INFO:teuthology.orchestra.run.trial188.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:18.748 INFO:teuthology.orchestra.run.trial188.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.748 INFO:teuthology.orchestra.run.trial188.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.748 INFO:teuthology.orchestra.run.trial188.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:18.748 INFO:teuthology.orchestra.run.trial188.stderr:election_strategy: 3 2026-02-13T20:11:18.748 INFO:teuthology.orchestra.run.trial188.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:18.748 INFO:teuthology.orchestra.run.trial188.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:18.748 INFO:teuthology.orchestra.run.trial188.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:18.748 INFO:teuthology.orchestra.run.trial188.stderr: 2026-02-13T20:11:18.748 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.727+0000 7fc422ffd640 1 -- 10.20.193.188:0/1804383255 <== mon.1 v1:10.20.193.188:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7fc424005510 con 0x7fc43c1401c0 2026-02-13T20:11:18.749 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.727+0000 7fc438d72640 4 set_mon_vals no callback set 2026-02-13T20:11:18.749 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.727+0000 7fc422ffd640 1 -- 10.20.193.188:0/1804383255 <== mon.1 v1:10.20.193.188:6789/0 8 ==== osd_map(3..3 src has 1..3) ==== 835+0+0 (unknown 3271236013 0 0) 0x7fc424006dd0 con 0x7fc43c1401c0 2026-02-13T20:11:18.749 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.727+0000 7fc440a12640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:18.749 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.727+0000 7fc440a12640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:18.749 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.727+0000 7fc440a12640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:11:18.749 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.727+0000 7fc440a12640 1 -- 10.20.193.188:0/1804383255 --> v1:10.20.193.188:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc43c0008d0 con 0x7fc43c1401c0 2026-02-13T20:11:18.749 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.728+0000 7fc422ffd640 1 -- 10.20.193.188:0/1804383255 <== mon.1 v1:10.20.193.188:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (unknown 1092875540 0 2392355004) 0x7fc424005b30 con 0x7fc43c1401c0 2026-02-13T20:11:18.749 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.728+0000 7fc422ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:18.749 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.728+0000 7fc422ffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:11:18.763 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.761+0000 7fc440a12640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "efb2f419-77ef-44b0-ae26-4c448073556b", "id": 1}] 2026-02-13T20:11:18.764 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.761+0000 7fc440a12640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "efb2f419-77ef-44b0-ae26-4c448073556b", "id": 1}] 2026-02-13T20:11:18.764 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.761+0000 7fc440a12640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:11:18.764 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.761+0000 7fc440a12640 1 -- 10.20.193.188:0/1804383255 --> v1:10.20.193.188:6789/0 -- mon_command({"prefix": "osd new", "uuid": "efb2f419-77ef-44b0-ae26-4c448073556b", "id": 1} v 0) -- 0x7fc43c058410 con 0x7fc43c1401c0 2026-02-13T20:11:18.765 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.763+0000 7fc422ffd640 1 -- 10.20.193.188:0/1804383255 <== mon.1 v1:10.20.193.188:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "efb2f419-77ef-44b0-ae26-4c448073556b", "id": 1}]=0 v4) ==== 112+0+2 (unknown 319653343 0 940483276) 0x7fc424005e40 con 0x7fc43c1401c0 2026-02-13T20:11:18.765 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.763+0000 7fc422ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "efb2f419-77ef-44b0-ae26-4c448073556b", "id": 1}] 2026-02-13T20:11:18.766 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.763+0000 7fc422ffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:11:18.766 INFO:teuthology.orchestra.run.trial188.stdout:1 2026-02-13T20:11:18.767 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.764+0000 7fc440a12640 10 monclient: shutdown 2026-02-13T20:11:18.767 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.764+0000 7fc440a12640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:18.767 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.764+0000 7fc440a12640 1 -- 10.20.193.188:0/1804383255 >> v1:10.20.193.188:6789/0 conn(0x7fc43c1401c0 legacy=0x7fc43c193a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:18.767 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.764+0000 7fc440a12640 1 -- 10.20.193.188:0/1804383255 shutdown_connections 2026-02-13T20:11:18.767 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.764+0000 7fc440a12640 1 -- 10.20.193.188:0/1804383255 >> 10.20.193.188:0/1804383255 conn(0x7fc43c054e90 msgr2=0x7fc43c08dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:18.767 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.764+0000 7fc440a12640 1 -- 10.20.193.188:0/1804383255 shutdown_connections 2026-02-13T20:11:18.767 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.764+0000 7fc440a12640 1 -- 10.20.193.188:0/1804383255 wait complete. 2026-02-13T20:11:18.774 DEBUG:teuthology.orchestra.run.trial188:> sudo ceph --cluster ceph osd new c5a08402-8e10-4d4d-87fe-6236a6766128 2 2026-02-13T20:11:18.837 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.834+0000 7f137b5b9640 10 monclient: get_monmap_and_config 2026-02-13T20:11:18.837 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.834+0000 7f137b5b9640 10 monclient: build_initial_monmap 2026-02-13T20:11:18.837 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.834+0000 7f137b5b9640 10 monclient: monmap: 2026-02-13T20:11:18.837 INFO:teuthology.orchestra.run.trial188.stderr:epoch 0 2026-02-13T20:11:18.837 INFO:teuthology.orchestra.run.trial188.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:18.837 INFO:teuthology.orchestra.run.trial188.stderr:last_changed 2026-02-13T20:11:18.835433+0000 2026-02-13T20:11:18.837 INFO:teuthology.orchestra.run.trial188.stderr:created 2026-02-13T20:11:18.835433+0000 2026-02-13T20:11:18.838 INFO:teuthology.orchestra.run.trial188.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:18.838 INFO:teuthology.orchestra.run.trial188.stderr:election_strategy: 3 2026-02-13T20:11:18.838 INFO:teuthology.orchestra.run.trial188.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:18.838 INFO:teuthology.orchestra.run.trial188.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:18.838 INFO:teuthology.orchestra.run.trial188.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:18.838 INFO:teuthology.orchestra.run.trial188.stderr: 2026-02-13T20:11:18.838 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.834+0000 7f137b5b9640 1 Processor -- start 2026-02-13T20:11:18.838 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.834+0000 7f137b5b9640 1 -- start start 2026-02-13T20:11:18.838 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.834+0000 7f137b5b9640 10 monclient: init 2026-02-13T20:11:18.845 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.835+0000 7f137b5b9640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:18.846 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.835+0000 7f137b5b9640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:11:18.846 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.835+0000 7f137b5b9640 10 monclient(hunting): picked mon.noname-c con 0x7f13741401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:18.846 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.835+0000 7f137b5b9640 10 monclient(hunting): picked mon.noname-b con 0x7f1374092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:18.846 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.835+0000 7f137b5b9640 10 monclient(hunting): picked mon.noname-a con 0x7f1374091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:18.846 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.835+0000 7f137b5b9640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f137408b730 con 0x7f1374091950 2026-02-13T20:11:18.846 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.835+0000 7f137b5b9640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f137405c5b0 con 0x7f13741401c0 2026-02-13T20:11:18.846 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.835+0000 7f137b5b9640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f137408bcf0 con 0x7f1374092020 2026-02-13T20:11:18.846 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.835+0000 7f137b5b9640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:18.846 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.835+0000 7f137b5b9640 10 monclient(hunting): authenticate will time out at 622.404429s 2026-02-13T20:11:18.846 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.835+0000 7f137932e640 1 --1- >> v1:10.20.193.188:6789/0 conn(0x7f13741401c0 0x7f1374091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.188:6789/0 says I am v1:10.20.193.188:42522/0 (socket says 10.20.193.188:42522) 2026-02-13T20:11:18.846 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.835+0000 7f137932e640 1 -- 10.20.193.188:0/3037464227 learned_addr learned my addr 10.20.193.188:0/3037464227 (peer_addr_for_me v1:10.20.193.188:0/0) 2026-02-13T20:11:18.847 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.835+0000 7f1363fff640 1 -- 10.20.193.188:0/3037464227 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2326138892 0 0) 0x7f137405c5b0 con 0x7f13741401c0 2026-02-13T20:11:18.847 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.835+0000 7f1363fff640 10 monclient(hunting): _negotiate 2026-02-13T20:11:18.847 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.835+0000 7f1363fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:18.847 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.835+0000 7f1363fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:18.847 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.835+0000 7f1363fff640 10 monclient(hunting): my global_id is 4126 2026-02-13T20:11:18.847 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.835+0000 7f1363fff640 1 -- 10.20.193.188:0/3037464227 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f135c0035e0 con 0x7f13741401c0 2026-02-13T20:11:18.847 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.835+0000 7f1363fff640 1 -- 10.20.193.188:0/3037464227 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 864631849 0 0) 0x7f135c0035e0 con 0x7f13741401c0 2026-02-13T20:11:18.847 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.835+0000 7f1363fff640 1 -- 10.20.193.188:0/3037464227 >> v1:10.20.193.110:6790/0 conn(0x7f1374092020 legacy=0x7f13741812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:18.847 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.835+0000 7f1363fff640 1 -- 10.20.193.188:0/3037464227 >> v1:10.20.193.110:6789/0 conn(0x7f1374091950 legacy=0x7f13741a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:18.847 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.835+0000 7f1363fff640 10 monclient: _finish_hunting 0 2026-02-13T20:11:18.847 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.835+0000 7f1363fff640 1 monclient: found mon.noname-c 2026-02-13T20:11:18.847 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.835+0000 7f1363fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:18.847 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.835+0000 7f1363fff640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.188:6789/0 2026-02-13T20:11:18.848 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.835+0000 7f1363fff640 1 -- 10.20.193.188:0/3037464227 --> v1:10.20.193.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1374140590 con 0x7f13741401c0 2026-02-13T20:11:18.848 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.835+0000 7f1363fff640 10 monclient: _finish_auth 0 2026-02-13T20:11:18.848 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.835+0000 7f1363fff640 10 monclient: _check_auth_tickets 2026-02-13T20:11:18.848 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.835+0000 7f1363fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:18.848 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.835+0000 7f1363fff640 1 -- 10.20.193.188:0/3037464227 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f1364002dd0 con 0x7f13741401c0 2026-02-13T20:11:18.848 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.835+0000 7f1363fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:18.848 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.835+0000 7f1363fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:11:18.848 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.835+0000 7f1363fff640 10 monclient: dump: 2026-02-13T20:11:18.848 INFO:teuthology.orchestra.run.trial188.stderr:epoch 1 2026-02-13T20:11:18.848 INFO:teuthology.orchestra.run.trial188.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:18.848 INFO:teuthology.orchestra.run.trial188.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.848 INFO:teuthology.orchestra.run.trial188.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.849 INFO:teuthology.orchestra.run.trial188.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:18.849 INFO:teuthology.orchestra.run.trial188.stderr:election_strategy: 3 2026-02-13T20:11:18.849 INFO:teuthology.orchestra.run.trial188.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:18.849 INFO:teuthology.orchestra.run.trial188.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:18.849 INFO:teuthology.orchestra.run.trial188.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:18.849 INFO:teuthology.orchestra.run.trial188.stderr: 2026-02-13T20:11:18.849 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.835+0000 7f137b5b9640 5 monclient: authenticate success, global_id 4126 2026-02-13T20:11:18.849 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.836+0000 7f137b5b9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:18.849 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.836+0000 7f1363fff640 1 -- 10.20.193.188:0/3037464227 <== mon.1 v1:10.20.193.188:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1364003020 con 0x7f13741401c0 2026-02-13T20:11:18.849 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.836+0000 7f1363fff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:18.849 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.836+0000 7f1363fff640 1 -- 10.20.193.188:0/3037464227 <== mon.1 v1:10.20.193.188:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f13640033f0 con 0x7f13741401c0 2026-02-13T20:11:18.849 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.836+0000 7f137b5b9640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:18.850 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.836+0000 7f137b5b9640 4 set_mon_vals no callback set 2026-02-13T20:11:18.850 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.836+0000 7f1363fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:18.850 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.836+0000 7f1363fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:11:18.850 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.836+0000 7f1363fff640 10 monclient: dump: 2026-02-13T20:11:18.850 INFO:teuthology.orchestra.run.trial188.stderr:epoch 1 2026-02-13T20:11:18.850 INFO:teuthology.orchestra.run.trial188.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:18.850 INFO:teuthology.orchestra.run.trial188.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.850 INFO:teuthology.orchestra.run.trial188.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.850 INFO:teuthology.orchestra.run.trial188.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:18.850 INFO:teuthology.orchestra.run.trial188.stderr:election_strategy: 3 2026-02-13T20:11:18.850 INFO:teuthology.orchestra.run.trial188.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:18.850 INFO:teuthology.orchestra.run.trial188.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:18.850 INFO:teuthology.orchestra.run.trial188.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:18.851 INFO:teuthology.orchestra.run.trial188.stderr: 2026-02-13T20:11:18.851 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.836+0000 7f137b5b9640 10 monclient: shutdown 2026-02-13T20:11:18.851 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.836+0000 7f137b5b9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:18.851 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.836+0000 7f137b5b9640 1 -- 10.20.193.188:0/3037464227 >> v1:10.20.193.188:6789/0 conn(0x7f13741401c0 legacy=0x7f1374091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:18.851 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.836+0000 7f137b5b9640 1 -- 10.20.193.188:0/3037464227 shutdown_connections 2026-02-13T20:11:18.851 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.836+0000 7f137b5b9640 1 -- 10.20.193.188:0/3037464227 >> 10.20.193.188:0/3037464227 conn(0x7f1374054e90 msgr2=0x7f1374058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:18.851 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.836+0000 7f137b5b9640 1 -- 10.20.193.188:0/3037464227 shutdown_connections 2026-02-13T20:11:18.851 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.836+0000 7f137b5b9640 1 -- 10.20.193.188:0/3037464227 wait complete. 2026-02-13T20:11:18.851 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.837+0000 7f137b5b9640 10 monclient: build_initial_monmap 2026-02-13T20:11:18.851 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.837+0000 7f137b5b9640 10 monclient: monmap: 2026-02-13T20:11:18.851 INFO:teuthology.orchestra.run.trial188.stderr:epoch 0 2026-02-13T20:11:18.851 INFO:teuthology.orchestra.run.trial188.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:18.852 INFO:teuthology.orchestra.run.trial188.stderr:last_changed 0.000000 2026-02-13T20:11:18.852 INFO:teuthology.orchestra.run.trial188.stderr:created 0.000000 2026-02-13T20:11:18.852 INFO:teuthology.orchestra.run.trial188.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:18.852 INFO:teuthology.orchestra.run.trial188.stderr:election_strategy: 1 2026-02-13T20:11:18.852 INFO:teuthology.orchestra.run.trial188.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:18.852 INFO:teuthology.orchestra.run.trial188.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:18.852 INFO:teuthology.orchestra.run.trial188.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:18.852 INFO:teuthology.orchestra.run.trial188.stderr: 2026-02-13T20:11:18.852 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.837+0000 7f137b5b9640 1 Processor -- start 2026-02-13T20:11:18.852 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.837+0000 7f137b5b9640 1 -- start start 2026-02-13T20:11:18.852 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.837+0000 7f137b5b9640 10 monclient: init 2026-02-13T20:11:18.852 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.837+0000 7f137b5b9640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:18.852 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.837+0000 7f137b5b9640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:11:18.853 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.837+0000 7f137b5b9640 10 monclient(hunting): picked mon.noname-b con 0x7f1374091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:18.853 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.837+0000 7f137b5b9640 10 monclient(hunting): picked mon.noname-c con 0x7f13741401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:18.853 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.837+0000 7f137b5b9640 10 monclient(hunting): picked mon.noname-a con 0x7f137412fa70 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:18.853 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.837+0000 7f137b5b9640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f137413e8b0 con 0x7f137412fa70 2026-02-13T20:11:18.853 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.837+0000 7f137b5b9640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f137405d320 con 0x7f1374091950 2026-02-13T20:11:18.853 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.837+0000 7f137b5b9640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1374130cb0 con 0x7f13741401c0 2026-02-13T20:11:18.853 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.837+0000 7f137b5b9640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:18.853 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.837+0000 7f137b5b9640 10 monclient(hunting): authenticate will time out at 622.406678s 2026-02-13T20:11:18.853 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.837+0000 7f137932e640 1 --1- >> v1:10.20.193.188:6789/0 conn(0x7f1374091950 0x7f137412d5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.188:6789/0 says I am v1:10.20.193.188:42538/0 (socket says 10.20.193.188:42538) 2026-02-13T20:11:18.853 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.837+0000 7f137932e640 1 -- 10.20.193.188:0/1355935311 learned_addr learned my addr 10.20.193.188:0/1355935311 (peer_addr_for_me v1:10.20.193.188:0/0) 2026-02-13T20:11:18.853 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.837+0000 7f1361ffb640 1 -- 10.20.193.188:0/1355935311 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2775484450 0 0) 0x7f137405d320 con 0x7f1374091950 2026-02-13T20:11:18.853 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.837+0000 7f1361ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:11:18.853 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.837+0000 7f1361ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:18.854 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.837+0000 7f1361ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:18.854 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.837+0000 7f1361ffb640 10 monclient(hunting): my global_id is 4129 2026-02-13T20:11:18.854 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.837+0000 7f1361ffb640 1 -- 10.20.193.188:0/1355935311 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13440035e0 con 0x7f1374091950 2026-02-13T20:11:18.854 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.838+0000 7f1361ffb640 1 -- 10.20.193.188:0/1355935311 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4122198717 0 0) 0x7f1374130cb0 con 0x7f13741401c0 2026-02-13T20:11:18.854 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.838+0000 7f1361ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:11:18.854 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.838+0000 7f1361ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:18.854 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.838+0000 7f1361ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:18.854 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.838+0000 7f1361ffb640 10 monclient(hunting): my global_id is 4130 2026-02-13T20:11:18.854 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.838+0000 7f1361ffb640 1 -- 10.20.193.188:0/1355935311 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f137405d320 con 0x7f13741401c0 2026-02-13T20:11:18.854 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.838+0000 7f1361ffb640 1 -- 10.20.193.188:0/1355935311 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1522766488 0 0) 0x7f13440035e0 con 0x7f1374091950 2026-02-13T20:11:18.854 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.838+0000 7f1361ffb640 1 -- 10.20.193.188:0/1355935311 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1374130cb0 con 0x7f1374091950 2026-02-13T20:11:18.854 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.838+0000 7f1361ffb640 1 -- 10.20.193.188:0/1355935311 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f1364002d90 con 0x7f1374091950 2026-02-13T20:11:18.855 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.838+0000 7f1361ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:18.855 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.838+0000 7f1361ffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:11:18.855 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.838+0000 7f1361ffb640 10 monclient(hunting): dump: 2026-02-13T20:11:18.855 INFO:teuthology.orchestra.run.trial188.stderr:epoch 1 2026-02-13T20:11:18.855 INFO:teuthology.orchestra.run.trial188.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:18.855 INFO:teuthology.orchestra.run.trial188.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.855 INFO:teuthology.orchestra.run.trial188.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.855 INFO:teuthology.orchestra.run.trial188.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:18.855 INFO:teuthology.orchestra.run.trial188.stderr:election_strategy: 3 2026-02-13T20:11:18.855 INFO:teuthology.orchestra.run.trial188.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:18.855 INFO:teuthology.orchestra.run.trial188.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:18.855 INFO:teuthology.orchestra.run.trial188.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:18.855 INFO:teuthology.orchestra.run.trial188.stderr: 2026-02-13T20:11:18.856 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.838+0000 7f1361ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:18.856 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.838+0000 7f1361ffb640 1 -- 10.20.193.188:0/1355935311 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1377733878 0 0) 0x7f1374130cb0 con 0x7f1374091950 2026-02-13T20:11:18.856 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.838+0000 7f1361ffb640 1 -- 10.20.193.188:0/1355935311 >> v1:10.20.193.110:6790/0 conn(0x7f13741401c0 legacy=0x7f137412dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:18.856 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.838+0000 7f1361ffb640 1 -- 10.20.193.188:0/1355935311 >> v1:10.20.193.110:6789/0 conn(0x7f137412fa70 legacy=0x7f1374195150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:18.856 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.838+0000 7f1361ffb640 10 monclient: _finish_hunting 0 2026-02-13T20:11:18.856 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.838+0000 7f1361ffb640 1 monclient: found mon.b 2026-02-13T20:11:18.856 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.838+0000 7f1361ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:18.856 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.838+0000 7f1361ffb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:11:18.856 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.838+0000 7f1361ffb640 1 -- 10.20.193.188:0/1355935311 --> v1:10.20.193.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1374130f90 con 0x7f1374091950 2026-02-13T20:11:18.856 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.838+0000 7f1361ffb640 10 monclient: _finish_auth 0 2026-02-13T20:11:18.856 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.838+0000 7f1361ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:11:18.856 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.838+0000 7f1361ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:18.856 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.838+0000 7f137b5b9640 5 monclient: authenticate success, global_id 4129 2026-02-13T20:11:18.857 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.838+0000 7f137b5b9640 10 monclient: _renew_subs 2026-02-13T20:11:18.857 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.838+0000 7f137b5b9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:11:18.857 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.838+0000 7f137b5b9640 1 -- 10.20.193.188:0/1355935311 --> v1:10.20.193.188:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f137412e3c0 con 0x7f1374091950 2026-02-13T20:11:18.857 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.838+0000 7f137b5b9640 10 monclient: _renew_subs 2026-02-13T20:11:18.857 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.838+0000 7f137b5b9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:11:18.857 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.838+0000 7f137b5b9640 1 -- 10.20.193.188:0/1355935311 --> v1:10.20.193.188:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f137412ef10 con 0x7f1374091950 2026-02-13T20:11:18.857 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.838+0000 7f1361ffb640 1 -- 10.20.193.188:0/1355935311 <== mon.1 v1:10.20.193.188:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1364002930 con 0x7f1374091950 2026-02-13T20:11:18.857 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.838+0000 7f1361ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:18.857 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.838+0000 7f1361ffb640 1 -- 10.20.193.188:0/1355935311 <== mon.1 v1:10.20.193.188:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f1364004d00 con 0x7f1374091950 2026-02-13T20:11:18.857 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.838+0000 7f1361ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:18.857 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.838+0000 7f1361ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:11:18.857 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.838+0000 7f1361ffb640 10 monclient: dump: 2026-02-13T20:11:18.857 INFO:teuthology.orchestra.run.trial188.stderr:epoch 1 2026-02-13T20:11:18.858 INFO:teuthology.orchestra.run.trial188.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:18.858 INFO:teuthology.orchestra.run.trial188.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.858 INFO:teuthology.orchestra.run.trial188.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.858 INFO:teuthology.orchestra.run.trial188.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:18.858 INFO:teuthology.orchestra.run.trial188.stderr:election_strategy: 3 2026-02-13T20:11:18.858 INFO:teuthology.orchestra.run.trial188.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:18.858 INFO:teuthology.orchestra.run.trial188.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:18.858 INFO:teuthology.orchestra.run.trial188.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:18.858 INFO:teuthology.orchestra.run.trial188.stderr: 2026-02-13T20:11:18.858 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.838+0000 7f13637fe640 4 set_mon_vals no callback set 2026-02-13T20:11:18.858 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.838+0000 7f1361ffb640 1 -- 10.20.193.188:0/1355935311 <== mon.1 v1:10.20.193.188:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f13640052e0 con 0x7f1374091950 2026-02-13T20:11:18.858 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.838+0000 7f1361ffb640 1 -- 10.20.193.188:0/1355935311 <== mon.1 v1:10.20.193.188:6789/0 8 ==== osd_map(4..4 src has 1..4) ==== 950+0+0 (unknown 394835619 0 0) 0x7f1364006d60 con 0x7f1374091950 2026-02-13T20:11:18.859 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.838+0000 7f137b5b9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:18.859 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.838+0000 7f137b5b9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:18.859 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.838+0000 7f137b5b9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:11:18.859 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.838+0000 7f137b5b9640 1 -- 10.20.193.188:0/1355935311 --> v1:10.20.193.188:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f137413db80 con 0x7f1374091950 2026-02-13T20:11:18.859 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.839+0000 7f1361ffb640 1 -- 10.20.193.188:0/1355935311 <== mon.1 v1:10.20.193.188:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (unknown 1092875540 0 2392355004) 0x7f13640069c0 con 0x7f1374091950 2026-02-13T20:11:18.859 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.839+0000 7f1361ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:18.859 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.839+0000 7f1361ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:11:18.875 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.872+0000 7f137b5b9640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "c5a08402-8e10-4d4d-87fe-6236a6766128", "id": 2}] 2026-02-13T20:11:18.875 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.872+0000 7f137b5b9640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "c5a08402-8e10-4d4d-87fe-6236a6766128", "id": 2}] 2026-02-13T20:11:18.875 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.872+0000 7f137b5b9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:11:18.875 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.872+0000 7f137b5b9640 1 -- 10.20.193.188:0/1355935311 --> v1:10.20.193.188:6789/0 -- mon_command({"prefix": "osd new", "uuid": "c5a08402-8e10-4d4d-87fe-6236a6766128", "id": 2} v 0) -- 0x7f13741312d0 con 0x7f1374091950 2026-02-13T20:11:18.877 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.874+0000 7f1361ffb640 1 -- 10.20.193.188:0/1355935311 <== mon.1 v1:10.20.193.188:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c5a08402-8e10-4d4d-87fe-6236a6766128", "id": 2}]=0 v5) ==== 112+0+2 (unknown 761510116 0 216599125) 0x7f1364005750 con 0x7f1374091950 2026-02-13T20:11:18.877 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.874+0000 7f1361ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "c5a08402-8e10-4d4d-87fe-6236a6766128", "id": 2}] 2026-02-13T20:11:18.877 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.874+0000 7f1361ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:11:18.877 INFO:teuthology.orchestra.run.trial188.stdout:2 2026-02-13T20:11:18.878 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.875+0000 7f137b5b9640 10 monclient: shutdown 2026-02-13T20:11:18.878 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.875+0000 7f137b5b9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:18.878 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.875+0000 7f137b5b9640 1 -- 10.20.193.188:0/1355935311 >> v1:10.20.193.188:6789/0 conn(0x7f1374091950 legacy=0x7f137412d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:18.878 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.875+0000 7f137b5b9640 1 -- 10.20.193.188:0/1355935311 shutdown_connections 2026-02-13T20:11:18.878 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.875+0000 7f137b5b9640 1 -- 10.20.193.188:0/1355935311 >> 10.20.193.188:0/1355935311 conn(0x7f1374054e90 msgr2=0x7f1374089500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:18.878 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.875+0000 7f137b5b9640 1 -- 10.20.193.188:0/1355935311 shutdown_connections 2026-02-13T20:11:18.879 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.875+0000 7f137b5b9640 1 -- 10.20.193.188:0/1355935311 wait complete. 2026-02-13T20:11:18.885 DEBUG:teuthology.orchestra.run.trial188:> sudo ceph --cluster ceph osd new 3062e357-c62b-4a5d-a4b2-9715c16cfd37 3 2026-02-13T20:11:18.895 INFO:tasks.ceph.mgr.x.trial188.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-13T20:11:18.895 INFO:tasks.ceph.mgr.x.trial188.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-13T20:11:18.896 INFO:tasks.ceph.mgr.x.trial188.stderr: from numpy import show_config as show_numpy_config 2026-02-13T20:11:18.954 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.945+0000 7fa3b559d640 10 monclient: get_monmap_and_config 2026-02-13T20:11:18.955 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.945+0000 7fa3b559d640 10 monclient: build_initial_monmap 2026-02-13T20:11:18.955 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.945+0000 7fa3b559d640 10 monclient: monmap: 2026-02-13T20:11:18.955 INFO:teuthology.orchestra.run.trial188.stderr:epoch 0 2026-02-13T20:11:18.955 INFO:teuthology.orchestra.run.trial188.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:18.955 INFO:teuthology.orchestra.run.trial188.stderr:last_changed 2026-02-13T20:11:18.946813+0000 2026-02-13T20:11:18.955 INFO:teuthology.orchestra.run.trial188.stderr:created 2026-02-13T20:11:18.946813+0000 2026-02-13T20:11:18.955 INFO:teuthology.orchestra.run.trial188.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:18.955 INFO:teuthology.orchestra.run.trial188.stderr:election_strategy: 3 2026-02-13T20:11:18.955 INFO:teuthology.orchestra.run.trial188.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:18.955 INFO:teuthology.orchestra.run.trial188.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:18.955 INFO:teuthology.orchestra.run.trial188.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:18.956 INFO:teuthology.orchestra.run.trial188.stderr: 2026-02-13T20:11:18.956 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.946+0000 7fa3b559d640 1 Processor -- start 2026-02-13T20:11:18.956 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.946+0000 7fa3b559d640 1 -- start start 2026-02-13T20:11:18.956 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.946+0000 7fa3b559d640 10 monclient: init 2026-02-13T20:11:18.956 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.946+0000 7fa3b559d640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:18.956 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.946+0000 7fa3b559d640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:11:18.956 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.946+0000 7fa3b559d640 10 monclient(hunting): picked mon.noname-a con 0x7fa3b01401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:18.956 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.946+0000 7fa3b559d640 10 monclient(hunting): picked mon.noname-b con 0x7fa3b0092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:18.956 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.946+0000 7fa3b559d640 10 monclient(hunting): picked mon.noname-c con 0x7fa3b0091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:18.956 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.946+0000 7fa3b559d640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3b008b730 con 0x7fa3b01401c0 2026-02-13T20:11:18.956 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.946+0000 7fa3b559d640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3b005c5b0 con 0x7fa3b0091950 2026-02-13T20:11:18.957 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.946+0000 7fa3b559d640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3b008bcf0 con 0x7fa3b0092020 2026-02-13T20:11:18.957 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.946+0000 7fa3b559d640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:18.957 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.946+0000 7fa3b559d640 10 monclient(hunting): authenticate will time out at 622.515646s 2026-02-13T20:11:18.957 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.946+0000 7fa3af7fe640 1 --1- >> v1:10.20.193.188:6789/0 conn(0x7fa3b0091950 0x7fa3b01a2a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.188:6789/0 says I am v1:10.20.193.188:42546/0 (socket says 10.20.193.188:42546) 2026-02-13T20:11:18.957 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.946+0000 7fa3af7fe640 1 -- 10.20.193.188:0/1748070725 learned_addr learned my addr 10.20.193.188:0/1748070725 (peer_addr_for_me v1:10.20.193.188:0/0) 2026-02-13T20:11:18.957 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.947+0000 7fa3adffb640 1 -- 10.20.193.188:0/1748070725 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1746541043 0 0) 0x7fa3b005c5b0 con 0x7fa3b0091950 2026-02-13T20:11:18.957 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.947+0000 7fa3adffb640 10 monclient(hunting): _negotiate 2026-02-13T20:11:18.957 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.947+0000 7fa3adffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:18.957 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.947+0000 7fa3adffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:18.957 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.947+0000 7fa3adffb640 10 monclient(hunting): my global_id is 4132 2026-02-13T20:11:18.957 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.947+0000 7fa3adffb640 1 -- 10.20.193.188:0/1748070725 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa39c0035e0 con 0x7fa3b0091950 2026-02-13T20:11:18.958 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.947+0000 7fa3adffb640 1 -- 10.20.193.188:0/1748070725 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2851060883 0 0) 0x7fa39c0035e0 con 0x7fa3b0091950 2026-02-13T20:11:18.958 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.947+0000 7fa3adffb640 1 -- 10.20.193.188:0/1748070725 >> v1:10.20.193.110:6790/0 conn(0x7fa3b0092020 legacy=0x7fa3b01812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:18.958 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.947+0000 7fa3adffb640 1 -- 10.20.193.188:0/1748070725 >> v1:10.20.193.110:6789/0 conn(0x7fa3b01401c0 legacy=0x7fa3b0091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:18.958 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.947+0000 7fa3adffb640 10 monclient: _finish_hunting 0 2026-02-13T20:11:18.958 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.947+0000 7fa3adffb640 1 monclient: found mon.noname-c 2026-02-13T20:11:18.958 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.947+0000 7fa3adffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:18.958 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.947+0000 7fa3adffb640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.188:6789/0 2026-02-13T20:11:18.958 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.947+0000 7fa3adffb640 1 -- 10.20.193.188:0/1748070725 --> v1:10.20.193.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3b0140590 con 0x7fa3b0091950 2026-02-13T20:11:18.958 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.947+0000 7fa3adffb640 10 monclient: _finish_auth 0 2026-02-13T20:11:18.958 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.947+0000 7fa3adffb640 10 monclient: _check_auth_tickets 2026-02-13T20:11:18.958 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.947+0000 7fa3adffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:18.958 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.947+0000 7fa3adffb640 1 -- 10.20.193.188:0/1748070725 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa3a0003eb0 con 0x7fa3b0091950 2026-02-13T20:11:18.959 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.947+0000 7fa3adffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:18.959 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.947+0000 7fa3adffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:11:18.959 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.947+0000 7fa3adffb640 10 monclient: dump: 2026-02-13T20:11:18.959 INFO:teuthology.orchestra.run.trial188.stderr:epoch 1 2026-02-13T20:11:18.959 INFO:teuthology.orchestra.run.trial188.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:18.959 INFO:teuthology.orchestra.run.trial188.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.959 INFO:teuthology.orchestra.run.trial188.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.959 INFO:teuthology.orchestra.run.trial188.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:18.959 INFO:teuthology.orchestra.run.trial188.stderr:election_strategy: 3 2026-02-13T20:11:18.959 INFO:teuthology.orchestra.run.trial188.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:18.959 INFO:teuthology.orchestra.run.trial188.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:18.959 INFO:teuthology.orchestra.run.trial188.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:18.960 INFO:teuthology.orchestra.run.trial188.stderr: 2026-02-13T20:11:18.960 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.947+0000 7fa3b559d640 5 monclient: authenticate success, global_id 4132 2026-02-13T20:11:18.960 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.947+0000 7fa3b559d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:18.960 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.947+0000 7fa3adffb640 1 -- 10.20.193.188:0/1748070725 <== mon.1 v1:10.20.193.188:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa3a0004080 con 0x7fa3b0091950 2026-02-13T20:11:18.960 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.947+0000 7fa3adffb640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:18.960 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.947+0000 7fa3adffb640 1 -- 10.20.193.188:0/1748070725 <== mon.1 v1:10.20.193.188:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa3a0004490 con 0x7fa3b0091950 2026-02-13T20:11:18.960 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.947+0000 7fa3adffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:18.960 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.947+0000 7fa3adffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:11:18.960 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.947+0000 7fa3adffb640 10 monclient: dump: 2026-02-13T20:11:18.960 INFO:teuthology.orchestra.run.trial188.stderr:epoch 1 2026-02-13T20:11:18.960 INFO:teuthology.orchestra.run.trial188.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:18.960 INFO:teuthology.orchestra.run.trial188.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.960 INFO:teuthology.orchestra.run.trial188.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.961 INFO:teuthology.orchestra.run.trial188.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:18.961 INFO:teuthology.orchestra.run.trial188.stderr:election_strategy: 3 2026-02-13T20:11:18.961 INFO:teuthology.orchestra.run.trial188.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:18.961 INFO:teuthology.orchestra.run.trial188.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:18.961 INFO:teuthology.orchestra.run.trial188.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:18.961 INFO:teuthology.orchestra.run.trial188.stderr: 2026-02-13T20:11:18.961 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.947+0000 7fa3b559d640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:18.961 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.947+0000 7fa3b559d640 4 set_mon_vals no callback set 2026-02-13T20:11:18.961 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.947+0000 7fa3b559d640 10 monclient: shutdown 2026-02-13T20:11:18.961 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.947+0000 7fa3b559d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:18.961 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.947+0000 7fa3b559d640 1 -- 10.20.193.188:0/1748070725 >> v1:10.20.193.188:6789/0 conn(0x7fa3b0091950 legacy=0x7fa3b01a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:18.961 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.947+0000 7fa3b559d640 1 -- 10.20.193.188:0/1748070725 shutdown_connections 2026-02-13T20:11:18.962 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.947+0000 7fa3b559d640 1 -- 10.20.193.188:0/1748070725 >> 10.20.193.188:0/1748070725 conn(0x7fa3b0054e90 msgr2=0x7fa3b0058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:18.962 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.947+0000 7fa3b559d640 1 -- 10.20.193.188:0/1748070725 shutdown_connections 2026-02-13T20:11:18.962 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.947+0000 7fa3b559d640 1 -- 10.20.193.188:0/1748070725 wait complete. 2026-02-13T20:11:18.962 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.947+0000 7fa3b559d640 10 monclient: build_initial_monmap 2026-02-13T20:11:18.962 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.947+0000 7fa3b559d640 10 monclient: monmap: 2026-02-13T20:11:18.962 INFO:teuthology.orchestra.run.trial188.stderr:epoch 0 2026-02-13T20:11:18.962 INFO:teuthology.orchestra.run.trial188.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:18.962 INFO:teuthology.orchestra.run.trial188.stderr:last_changed 0.000000 2026-02-13T20:11:18.962 INFO:teuthology.orchestra.run.trial188.stderr:created 0.000000 2026-02-13T20:11:18.962 INFO:teuthology.orchestra.run.trial188.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:18.963 INFO:teuthology.orchestra.run.trial188.stderr:election_strategy: 1 2026-02-13T20:11:18.963 INFO:teuthology.orchestra.run.trial188.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:18.963 INFO:teuthology.orchestra.run.trial188.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:18.963 INFO:teuthology.orchestra.run.trial188.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:18.963 INFO:teuthology.orchestra.run.trial188.stderr: 2026-02-13T20:11:18.963 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.948+0000 7fa3b559d640 1 Processor -- start 2026-02-13T20:11:18.963 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.948+0000 7fa3b559d640 1 -- start start 2026-02-13T20:11:18.963 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.948+0000 7fa3b559d640 10 monclient: init 2026-02-13T20:11:18.963 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.948+0000 7fa3b559d640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:18.963 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.948+0000 7fa3b559d640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:11:18.963 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.948+0000 7fa3b559d640 10 monclient(hunting): picked mon.noname-c con 0x7fa3b0091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:18.963 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.948+0000 7fa3b559d640 10 monclient(hunting): picked mon.noname-a con 0x7fa3b01401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:18.964 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.948+0000 7fa3b559d640 10 monclient(hunting): picked mon.noname-b con 0x7fa3b0114930 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:18.964 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.948+0000 7fa3b559d640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3b012d150 con 0x7fa3b01401c0 2026-02-13T20:11:18.964 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.948+0000 7fa3b559d640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3b005d320 con 0x7fa3b0114930 2026-02-13T20:11:18.964 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.948+0000 7fa3b559d640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3b012d680 con 0x7fa3b0091950 2026-02-13T20:11:18.964 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.948+0000 7fa3b559d640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:18.964 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.948+0000 7fa3b559d640 10 monclient(hunting): authenticate will time out at 622.517728s 2026-02-13T20:11:18.964 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.948+0000 7fa3af7fe640 1 --1- >> v1:10.20.193.188:6789/0 conn(0x7fa3b0114930 0x7fa3b01a2740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.188:6789/0 says I am v1:10.20.193.188:42552/0 (socket says 10.20.193.188:42552) 2026-02-13T20:11:18.964 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.948+0000 7fa3af7fe640 1 -- 10.20.193.188:0/2301397630 learned_addr learned my addr 10.20.193.188:0/2301397630 (peer_addr_for_me v1:10.20.193.188:0/0) 2026-02-13T20:11:18.964 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.948+0000 7fa38f7fe640 1 -- 10.20.193.188:0/2301397630 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 899599470 0 0) 0x7fa3b005d320 con 0x7fa3b0114930 2026-02-13T20:11:18.964 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.948+0000 7fa38f7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:11:18.964 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.948+0000 7fa38f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:18.964 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.948+0000 7fa38f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:18.964 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.948+0000 7fa38f7fe640 10 monclient(hunting): my global_id is 4135 2026-02-13T20:11:18.965 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.948+0000 7fa38f7fe640 1 -- 10.20.193.188:0/2301397630 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa37c0035e0 con 0x7fa3b0114930 2026-02-13T20:11:18.965 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.949+0000 7fa38f7fe640 1 -- 10.20.193.188:0/2301397630 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3828557723 0 0) 0x7fa37c0035e0 con 0x7fa3b0114930 2026-02-13T20:11:18.965 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.949+0000 7fa38f7fe640 1 -- 10.20.193.188:0/2301397630 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa3b005d320 con 0x7fa3b0114930 2026-02-13T20:11:18.965 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.949+0000 7fa38f7fe640 1 -- 10.20.193.188:0/2301397630 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa3a0003dc0 con 0x7fa3b0114930 2026-02-13T20:11:18.965 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.949+0000 7fa38f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:18.965 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.949+0000 7fa38f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:11:18.965 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.949+0000 7fa38f7fe640 10 monclient(hunting): dump: 2026-02-13T20:11:18.965 INFO:teuthology.orchestra.run.trial188.stderr:epoch 1 2026-02-13T20:11:18.965 INFO:teuthology.orchestra.run.trial188.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:18.965 INFO:teuthology.orchestra.run.trial188.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.965 INFO:teuthology.orchestra.run.trial188.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.965 INFO:teuthology.orchestra.run.trial188.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:18.966 INFO:teuthology.orchestra.run.trial188.stderr:election_strategy: 3 2026-02-13T20:11:18.966 INFO:teuthology.orchestra.run.trial188.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:18.966 INFO:teuthology.orchestra.run.trial188.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:18.966 INFO:teuthology.orchestra.run.trial188.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:18.966 INFO:teuthology.orchestra.run.trial188.stderr: 2026-02-13T20:11:18.966 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.949+0000 7fa38f7fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:18.966 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.949+0000 7fa38f7fe640 1 -- 10.20.193.188:0/2301397630 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1000187793 0 0) 0x7fa3b012d150 con 0x7fa3b01401c0 2026-02-13T20:11:18.966 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.949+0000 7fa38f7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:11:18.966 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.949+0000 7fa38f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:18.966 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.949+0000 7fa38f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:18.966 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.949+0000 7fa38f7fe640 10 monclient(hunting): my global_id is 4125 2026-02-13T20:11:18.967 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.949+0000 7fa38f7fe640 1 -- 10.20.193.188:0/2301397630 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa37c0035e0 con 0x7fa3b01401c0 2026-02-13T20:11:18.967 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.949+0000 7fa38f7fe640 1 -- 10.20.193.188:0/2301397630 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1171761264 0 0) 0x7fa3b005d320 con 0x7fa3b0114930 2026-02-13T20:11:18.967 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.949+0000 7fa38f7fe640 1 -- 10.20.193.188:0/2301397630 >> v1:10.20.193.110:6790/0 conn(0x7fa3b0091950 legacy=0x7fa3b0114220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:18.967 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.949+0000 7fa38f7fe640 1 -- 10.20.193.188:0/2301397630 >> v1:10.20.193.110:6789/0 conn(0x7fa3b01401c0 legacy=0x7fa3b01a1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:18.967 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.949+0000 7fa38f7fe640 10 monclient: _finish_hunting 0 2026-02-13T20:11:18.967 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.949+0000 7fa38f7fe640 1 monclient: found mon.b 2026-02-13T20:11:18.967 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.949+0000 7fa38f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:18.967 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.949+0000 7fa38f7fe640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:11:18.967 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.949+0000 7fa38f7fe640 1 -- 10.20.193.188:0/2301397630 --> v1:10.20.193.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3b012b320 con 0x7fa3b0114930 2026-02-13T20:11:18.967 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.949+0000 7fa38f7fe640 10 monclient: _finish_auth 0 2026-02-13T20:11:18.967 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.949+0000 7fa38f7fe640 10 monclient: _check_auth_tickets 2026-02-13T20:11:18.968 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.949+0000 7fa38f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:18.968 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.949+0000 7fa3b559d640 5 monclient: authenticate success, global_id 4135 2026-02-13T20:11:18.968 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.949+0000 7fa3b559d640 10 monclient: _renew_subs 2026-02-13T20:11:18.968 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.949+0000 7fa3b559d640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:11:18.968 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.949+0000 7fa3b559d640 1 -- 10.20.193.188:0/2301397630 --> v1:10.20.193.188:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa3b012add0 con 0x7fa3b0114930 2026-02-13T20:11:18.968 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.949+0000 7fa3b559d640 10 monclient: _renew_subs 2026-02-13T20:11:18.968 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.949+0000 7fa3b559d640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:11:18.968 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.949+0000 7fa3b559d640 1 -- 10.20.193.188:0/2301397630 --> v1:10.20.193.188:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa3b0124650 con 0x7fa3b0114930 2026-02-13T20:11:18.968 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.949+0000 7fa38f7fe640 1 -- 10.20.193.188:0/2301397630 <== mon.1 v1:10.20.193.188:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa3a00038f0 con 0x7fa3b0114930 2026-02-13T20:11:18.968 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.949+0000 7fa38f7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:18.968 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.949+0000 7fa38f7fe640 1 -- 10.20.193.188:0/2301397630 <== mon.1 v1:10.20.193.188:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa3a0005de0 con 0x7fa3b0114930 2026-02-13T20:11:18.968 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.949+0000 7fa38f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:18.969 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.949+0000 7fa38f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:11:18.969 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.949+0000 7fa38f7fe640 10 monclient: dump: 2026-02-13T20:11:18.969 INFO:teuthology.orchestra.run.trial188.stderr:epoch 1 2026-02-13T20:11:18.969 INFO:teuthology.orchestra.run.trial188.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:18.969 INFO:teuthology.orchestra.run.trial188.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.969 INFO:teuthology.orchestra.run.trial188.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:18.969 INFO:teuthology.orchestra.run.trial188.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:18.969 INFO:teuthology.orchestra.run.trial188.stderr:election_strategy: 3 2026-02-13T20:11:18.969 INFO:teuthology.orchestra.run.trial188.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:18.969 INFO:teuthology.orchestra.run.trial188.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:18.969 INFO:teuthology.orchestra.run.trial188.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:18.969 INFO:teuthology.orchestra.run.trial188.stderr: 2026-02-13T20:11:18.970 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.949+0000 7fa3ad7fa640 4 set_mon_vals no callback set 2026-02-13T20:11:18.970 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.949+0000 7fa38f7fe640 1 -- 10.20.193.188:0/2301397630 <== mon.1 v1:10.20.193.188:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7fa3a0006350 con 0x7fa3b0114930 2026-02-13T20:11:18.970 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.949+0000 7fa38f7fe640 1 -- 10.20.193.188:0/2301397630 <== mon.1 v1:10.20.193.188:6789/0 8 ==== osd_map(5..5 src has 1..5) ==== 1065+0+0 (unknown 3000136574 0 0) 0x7fa3a0007d20 con 0x7fa3b0114930 2026-02-13T20:11:18.970 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.949+0000 7fa3b559d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:18.970 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.949+0000 7fa3b559d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:18.970 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.949+0000 7fa3b559d640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:11:18.970 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.949+0000 7fa3b559d640 1 -- 10.20.193.188:0/2301397630 --> v1:10.20.193.188:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3b012d300 con 0x7fa3b0114930 2026-02-13T20:11:18.970 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.950+0000 7fa38f7fe640 1 -- 10.20.193.188:0/2301397630 <== mon.1 v1:10.20.193.188:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (unknown 1092875540 0 2392355004) 0x7fa3b012d300 con 0x7fa3b0114930 2026-02-13T20:11:18.970 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.950+0000 7fa38f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:18.970 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.950+0000 7fa38f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:11:18.986 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.984+0000 7fa3b559d640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "3062e357-c62b-4a5d-a4b2-9715c16cfd37", "id": 3}] 2026-02-13T20:11:18.986 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.984+0000 7fa3b559d640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "3062e357-c62b-4a5d-a4b2-9715c16cfd37", "id": 3}] 2026-02-13T20:11:18.986 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.984+0000 7fa3b559d640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:11:18.987 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.984+0000 7fa3b559d640 1 -- 10.20.193.188:0/2301397630 --> v1:10.20.193.188:6789/0 -- mon_command({"prefix": "osd new", "uuid": "3062e357-c62b-4a5d-a4b2-9715c16cfd37", "id": 3} v 0) -- 0x7fa3b0055bb0 con 0x7fa3b0114930 2026-02-13T20:11:18.988 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.986+0000 7fa38f7fe640 1 -- 10.20.193.188:0/2301397630 <== mon.1 v1:10.20.193.188:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3062e357-c62b-4a5d-a4b2-9715c16cfd37", "id": 3}]=0 v6) ==== 112+0+2 (unknown 3857741731 0 525046306) 0x7fa3a00079b0 con 0x7fa3b0114930 2026-02-13T20:11:18.988 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.986+0000 7fa38f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "3062e357-c62b-4a5d-a4b2-9715c16cfd37", "id": 3}] 2026-02-13T20:11:18.988 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.986+0000 7fa38f7fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:11:18.988 INFO:teuthology.orchestra.run.trial188.stdout:3 2026-02-13T20:11:18.989 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.986+0000 7fa3b559d640 10 monclient: shutdown 2026-02-13T20:11:18.989 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.986+0000 7fa3b559d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:18.989 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.986+0000 7fa3b559d640 1 -- 10.20.193.188:0/2301397630 >> v1:10.20.193.188:6789/0 conn(0x7fa3b0114930 legacy=0x7fa3b01a2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:18.989 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.986+0000 7fa3b559d640 1 -- 10.20.193.188:0/2301397630 shutdown_connections 2026-02-13T20:11:18.990 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.986+0000 7fa3b559d640 1 -- 10.20.193.188:0/2301397630 >> 10.20.193.188:0/2301397630 conn(0x7fa3b0054e90 msgr2=0x7fa3b008ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:18.990 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.986+0000 7fa3b559d640 1 -- 10.20.193.188:0/2301397630 shutdown_connections 2026-02-13T20:11:18.990 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:18.986+0000 7fa3b559d640 1 -- 10.20.193.188:0/2301397630 wait complete. 2026-02-13T20:11:18.996 DEBUG:teuthology.orchestra.run.trial188:> sudo ceph --cluster ceph osd new 718e9755-3c16-47c8-9df8-c08e4193063d 4 2026-02-13T20:11:19.107 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.097+0000 7fe8a625b640 10 monclient: get_monmap_and_config 2026-02-13T20:11:19.107 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.097+0000 7fe8a625b640 10 monclient: build_initial_monmap 2026-02-13T20:11:19.108 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.097+0000 7fe8a625b640 10 monclient: monmap: 2026-02-13T20:11:19.108 INFO:teuthology.orchestra.run.trial188.stderr:epoch 0 2026-02-13T20:11:19.108 INFO:teuthology.orchestra.run.trial188.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:19.108 INFO:teuthology.orchestra.run.trial188.stderr:last_changed 2026-02-13T20:11:19.098216+0000 2026-02-13T20:11:19.108 INFO:teuthology.orchestra.run.trial188.stderr:created 2026-02-13T20:11:19.098216+0000 2026-02-13T20:11:19.108 INFO:teuthology.orchestra.run.trial188.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:19.108 INFO:teuthology.orchestra.run.trial188.stderr:election_strategy: 3 2026-02-13T20:11:19.108 INFO:teuthology.orchestra.run.trial188.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:19.108 INFO:teuthology.orchestra.run.trial188.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:19.109 INFO:teuthology.orchestra.run.trial188.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:19.109 INFO:teuthology.orchestra.run.trial188.stderr: 2026-02-13T20:11:19.109 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.097+0000 7fe8a625b640 1 Processor -- start 2026-02-13T20:11:19.109 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.097+0000 7fe8a625b640 1 -- start start 2026-02-13T20:11:19.109 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.097+0000 7fe8a625b640 10 monclient: init 2026-02-13T20:11:19.109 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.098+0000 7fe8a625b640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:19.109 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.098+0000 7fe8a625b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:11:19.109 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.098+0000 7fe8a625b640 10 monclient(hunting): picked mon.noname-a con 0x7fe8a01401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:19.109 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.098+0000 7fe8a625b640 10 monclient(hunting): picked mon.noname-b con 0x7fe8a0092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:19.109 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.098+0000 7fe8a625b640 10 monclient(hunting): picked mon.noname-c con 0x7fe8a0091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:19.109 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.098+0000 7fe8a625b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8a008b730 con 0x7fe8a01401c0 2026-02-13T20:11:19.110 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.098+0000 7fe8a625b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8a005c5b0 con 0x7fe8a0091950 2026-02-13T20:11:19.110 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.098+0000 7fe8a625b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8a008bcf0 con 0x7fe8a0092020 2026-02-13T20:11:19.110 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.098+0000 7fe8a625b640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:19.110 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.098+0000 7fe8a625b640 10 monclient(hunting): authenticate will time out at 622.667075s 2026-02-13T20:11:19.110 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.098+0000 7fe89ffff640 1 --1- >> v1:10.20.193.188:6789/0 conn(0x7fe8a0091950 0x7fe8a01a2a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.188:6789/0 says I am v1:10.20.193.188:42560/0 (socket says 10.20.193.188:42560) 2026-02-13T20:11:19.110 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.098+0000 7fe89ffff640 1 -- 10.20.193.188:0/945733938 learned_addr learned my addr 10.20.193.188:0/945733938 (peer_addr_for_me v1:10.20.193.188:0/0) 2026-02-13T20:11:19.110 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.098+0000 7fe89e7fc640 1 -- 10.20.193.188:0/945733938 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2935382912 0 0) 0x7fe8a005c5b0 con 0x7fe8a0091950 2026-02-13T20:11:19.110 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.098+0000 7fe89e7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:11:19.110 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.098+0000 7fe89e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:19.110 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.098+0000 7fe89e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:19.110 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.098+0000 7fe89e7fc640 10 monclient(hunting): my global_id is 4138 2026-02-13T20:11:19.111 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.098+0000 7fe89e7fc640 1 -- 10.20.193.188:0/945733938 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8840035e0 con 0x7fe8a0091950 2026-02-13T20:11:19.111 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.098+0000 7fe89e7fc640 1 -- 10.20.193.188:0/945733938 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3088663730 0 0) 0x7fe8840035e0 con 0x7fe8a0091950 2026-02-13T20:11:19.111 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.098+0000 7fe89e7fc640 1 -- 10.20.193.188:0/945733938 >> v1:10.20.193.110:6790/0 conn(0x7fe8a0092020 legacy=0x7fe8a01812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:19.111 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.098+0000 7fe89e7fc640 1 -- 10.20.193.188:0/945733938 >> v1:10.20.193.110:6789/0 conn(0x7fe8a01401c0 legacy=0x7fe8a0091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:19.111 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.098+0000 7fe89e7fc640 10 monclient: _finish_hunting 0 2026-02-13T20:11:19.111 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.098+0000 7fe89e7fc640 1 monclient: found mon.noname-c 2026-02-13T20:11:19.111 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.098+0000 7fe89e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:19.111 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.098+0000 7fe89e7fc640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.188:6789/0 2026-02-13T20:11:19.111 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.098+0000 7fe89e7fc640 1 -- 10.20.193.188:0/945733938 --> v1:10.20.193.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8a0140590 con 0x7fe8a0091950 2026-02-13T20:11:19.111 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.098+0000 7fe89e7fc640 10 monclient: _finish_auth 0 2026-02-13T20:11:19.111 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.098+0000 7fe89e7fc640 10 monclient: _check_auth_tickets 2026-02-13T20:11:19.111 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.098+0000 7fe89e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:19.112 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.098+0000 7fe89e7fc640 1 -- 10.20.193.188:0/945733938 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe894003eb0 con 0x7fe8a0091950 2026-02-13T20:11:19.112 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.098+0000 7fe8a625b640 5 monclient: authenticate success, global_id 4138 2026-02-13T20:11:19.112 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.098+0000 7fe8a625b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:19.112 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.098+0000 7fe89e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:19.112 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.098+0000 7fe89e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:11:19.112 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.098+0000 7fe89e7fc640 10 monclient: dump: 2026-02-13T20:11:19.112 INFO:teuthology.orchestra.run.trial188.stderr:epoch 1 2026-02-13T20:11:19.112 INFO:teuthology.orchestra.run.trial188.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:19.112 INFO:teuthology.orchestra.run.trial188.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:19.112 INFO:teuthology.orchestra.run.trial188.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:19.112 INFO:teuthology.orchestra.run.trial188.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:19.112 INFO:teuthology.orchestra.run.trial188.stderr:election_strategy: 3 2026-02-13T20:11:19.113 INFO:teuthology.orchestra.run.trial188.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:19.113 INFO:teuthology.orchestra.run.trial188.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:19.113 INFO:teuthology.orchestra.run.trial188.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:19.113 INFO:teuthology.orchestra.run.trial188.stderr: 2026-02-13T20:11:19.113 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.098+0000 7fe8a625b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:19.113 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.098+0000 7fe89e7fc640 1 -- 10.20.193.188:0/945733938 <== mon.1 v1:10.20.193.188:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe894004100 con 0x7fe8a0091950 2026-02-13T20:11:19.113 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.098+0000 7fe89e7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:19.113 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.098+0000 7fe89e7fc640 1 -- 10.20.193.188:0/945733938 <== mon.1 v1:10.20.193.188:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe8940044d0 con 0x7fe8a0091950 2026-02-13T20:11:19.113 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.098+0000 7fe89e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:19.113 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.098+0000 7fe89e7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:11:19.113 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.098+0000 7fe89e7fc640 10 monclient: dump: 2026-02-13T20:11:19.113 INFO:teuthology.orchestra.run.trial188.stderr:epoch 1 2026-02-13T20:11:19.114 INFO:teuthology.orchestra.run.trial188.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:19.114 INFO:teuthology.orchestra.run.trial188.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:19.114 INFO:teuthology.orchestra.run.trial188.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:19.114 INFO:teuthology.orchestra.run.trial188.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:19.114 INFO:teuthology.orchestra.run.trial188.stderr:election_strategy: 3 2026-02-13T20:11:19.114 INFO:teuthology.orchestra.run.trial188.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:19.114 INFO:teuthology.orchestra.run.trial188.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:19.114 INFO:teuthology.orchestra.run.trial188.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:19.114 INFO:teuthology.orchestra.run.trial188.stderr: 2026-02-13T20:11:19.114 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.098+0000 7fe8a625b640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:19.114 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.098+0000 7fe8a625b640 4 set_mon_vals no callback set 2026-02-13T20:11:19.114 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.098+0000 7fe8a625b640 10 monclient: shutdown 2026-02-13T20:11:19.114 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.098+0000 7fe8a625b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:19.115 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.098+0000 7fe8a625b640 1 -- 10.20.193.188:0/945733938 >> v1:10.20.193.188:6789/0 conn(0x7fe8a0091950 legacy=0x7fe8a01a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:19.115 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.098+0000 7fe8a625b640 1 -- 10.20.193.188:0/945733938 shutdown_connections 2026-02-13T20:11:19.115 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.098+0000 7fe8a625b640 1 -- 10.20.193.188:0/945733938 >> 10.20.193.188:0/945733938 conn(0x7fe8a0054e90 msgr2=0x7fe8a0058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:19.115 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.099+0000 7fe8a625b640 1 -- 10.20.193.188:0/945733938 shutdown_connections 2026-02-13T20:11:19.115 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.099+0000 7fe8a625b640 1 -- 10.20.193.188:0/945733938 wait complete. 2026-02-13T20:11:19.115 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.099+0000 7fe8a625b640 10 monclient: build_initial_monmap 2026-02-13T20:11:19.115 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.099+0000 7fe8a625b640 10 monclient: monmap: 2026-02-13T20:11:19.115 INFO:teuthology.orchestra.run.trial188.stderr:epoch 0 2026-02-13T20:11:19.115 INFO:teuthology.orchestra.run.trial188.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:19.115 INFO:teuthology.orchestra.run.trial188.stderr:last_changed 0.000000 2026-02-13T20:11:19.115 INFO:teuthology.orchestra.run.trial188.stderr:created 0.000000 2026-02-13T20:11:19.116 INFO:teuthology.orchestra.run.trial188.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:19.116 INFO:teuthology.orchestra.run.trial188.stderr:election_strategy: 1 2026-02-13T20:11:19.116 INFO:teuthology.orchestra.run.trial188.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:19.116 INFO:teuthology.orchestra.run.trial188.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:19.116 INFO:teuthology.orchestra.run.trial188.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:19.116 INFO:teuthology.orchestra.run.trial188.stderr: 2026-02-13T20:11:19.116 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.099+0000 7fe8a625b640 1 Processor -- start 2026-02-13T20:11:19.116 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.099+0000 7fe8a625b640 1 -- start start 2026-02-13T20:11:19.116 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.099+0000 7fe8a625b640 10 monclient: init 2026-02-13T20:11:19.116 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.099+0000 7fe8a625b640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:19.116 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.099+0000 7fe8a625b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:11:19.116 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.099+0000 7fe8a625b640 10 monclient(hunting): picked mon.noname-a con 0x7fe8a0091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:19.117 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.099+0000 7fe8a625b640 10 monclient(hunting): picked mon.noname-b con 0x7fe8a01401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:19.117 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.099+0000 7fe8a625b640 10 monclient(hunting): picked mon.noname-c con 0x7fe8a0089e80 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:19.117 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.099+0000 7fe8a625b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8a008c380 con 0x7fe8a0091950 2026-02-13T20:11:19.117 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.099+0000 7fe8a625b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8a008a880 con 0x7fe8a01401c0 2026-02-13T20:11:19.117 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.099+0000 7fe8a625b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8a005d320 con 0x7fe8a0089e80 2026-02-13T20:11:19.117 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.099+0000 7fe8a625b640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:19.117 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.099+0000 7fe8a625b640 10 monclient(hunting): authenticate will time out at 622.668794s 2026-02-13T20:11:19.117 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.099+0000 7fe89effd640 1 --1- >> v1:10.20.193.188:6789/0 conn(0x7fe8a01401c0 0x7fe8a0089770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.188:6789/0 says I am v1:10.20.193.188:42572/0 (socket says 10.20.193.188:42572) 2026-02-13T20:11:19.117 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.099+0000 7fe89effd640 1 -- 10.20.193.188:0/2023841188 learned_addr learned my addr 10.20.193.188:0/2023841188 (peer_addr_for_me v1:10.20.193.188:0/0) 2026-02-13T20:11:19.117 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe87bfff640 1 -- 10.20.193.188:0/2023841188 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1894541125 0 0) 0x7fe8a008a880 con 0x7fe8a01401c0 2026-02-13T20:11:19.117 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe87bfff640 10 monclient(hunting): _negotiate 2026-02-13T20:11:19.117 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe87bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:19.118 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe87bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:19.118 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe87bfff640 10 monclient(hunting): my global_id is 4141 2026-02-13T20:11:19.118 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe87bfff640 1 -- 10.20.193.188:0/2023841188 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8700035e0 con 0x7fe8a01401c0 2026-02-13T20:11:19.118 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe87bfff640 1 -- 10.20.193.188:0/2023841188 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1097921756 0 0) 0x7fe8a008c380 con 0x7fe8a0091950 2026-02-13T20:11:19.118 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe87bfff640 10 monclient(hunting): _negotiate 2026-02-13T20:11:19.118 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe87bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:19.118 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe87bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:19.118 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe87bfff640 10 monclient(hunting): my global_id is 4131 2026-02-13T20:11:19.118 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe87bfff640 1 -- 10.20.193.188:0/2023841188 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8a008a880 con 0x7fe8a0091950 2026-02-13T20:11:19.118 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe87bfff640 1 -- 10.20.193.188:0/2023841188 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1958391573 0 0) 0x7fe8700035e0 con 0x7fe8a01401c0 2026-02-13T20:11:19.118 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe87bfff640 1 -- 10.20.193.188:0/2023841188 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe8a008c380 con 0x7fe8a01401c0 2026-02-13T20:11:19.118 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe87bfff640 1 -- 10.20.193.188:0/2023841188 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe8900030e0 con 0x7fe8a01401c0 2026-02-13T20:11:19.119 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe87bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:19.119 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe87bfff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:11:19.119 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe87bfff640 10 monclient(hunting): dump: 2026-02-13T20:11:19.119 INFO:teuthology.orchestra.run.trial188.stderr:epoch 1 2026-02-13T20:11:19.119 INFO:teuthology.orchestra.run.trial188.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:19.119 INFO:teuthology.orchestra.run.trial188.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:19.119 INFO:teuthology.orchestra.run.trial188.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:19.119 INFO:teuthology.orchestra.run.trial188.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:19.119 INFO:teuthology.orchestra.run.trial188.stderr:election_strategy: 3 2026-02-13T20:11:19.119 INFO:teuthology.orchestra.run.trial188.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:19.119 INFO:teuthology.orchestra.run.trial188.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:19.119 INFO:teuthology.orchestra.run.trial188.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:19.119 INFO:teuthology.orchestra.run.trial188.stderr: 2026-02-13T20:11:19.120 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe87bfff640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:19.120 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe87bfff640 1 -- 10.20.193.188:0/2023841188 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3202823438 0 0) 0x7fe8a005d320 con 0x7fe8a0089e80 2026-02-13T20:11:19.120 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe87bfff640 10 monclient(hunting): _negotiate 2026-02-13T20:11:19.120 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe87bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:19.120 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe87bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:19.120 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe87bfff640 10 monclient(hunting): my global_id is 4142 2026-02-13T20:11:19.120 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe87bfff640 1 -- 10.20.193.188:0/2023841188 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8700035e0 con 0x7fe8a0089e80 2026-02-13T20:11:19.120 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe87bfff640 1 -- 10.20.193.188:0/2023841188 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3445857752 0 0) 0x7fe8a008c380 con 0x7fe8a01401c0 2026-02-13T20:11:19.120 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe87bfff640 1 -- 10.20.193.188:0/2023841188 >> v1:10.20.193.110:6790/0 conn(0x7fe8a0089e80 legacy=0x7fe8a01a2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:19.120 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe87bfff640 1 -- 10.20.193.188:0/2023841188 >> v1:10.20.193.110:6789/0 conn(0x7fe8a0091950 legacy=0x7fe8a0089060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:19.120 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe87bfff640 10 monclient: _finish_hunting 0 2026-02-13T20:11:19.120 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe87bfff640 1 monclient: found mon.b 2026-02-13T20:11:19.121 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe87bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:19.121 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe87bfff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:11:19.121 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe87bfff640 1 -- 10.20.193.188:0/2023841188 --> v1:10.20.193.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8a012f900 con 0x7fe8a01401c0 2026-02-13T20:11:19.121 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe87bfff640 10 monclient: _finish_auth 0 2026-02-13T20:11:19.121 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe87bfff640 10 monclient: _check_auth_tickets 2026-02-13T20:11:19.121 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe87bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:19.121 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe8a625b640 5 monclient: authenticate success, global_id 4141 2026-02-13T20:11:19.121 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe8a625b640 10 monclient: _renew_subs 2026-02-13T20:11:19.121 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe8a625b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:11:19.121 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe8a625b640 1 -- 10.20.193.188:0/2023841188 --> v1:10.20.193.188:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe8a012f060 con 0x7fe8a01401c0 2026-02-13T20:11:19.121 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe8a625b640 10 monclient: _renew_subs 2026-02-13T20:11:19.121 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe8a625b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:11:19.121 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe8a625b640 1 -- 10.20.193.188:0/2023841188 --> v1:10.20.193.188:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe8a012e100 con 0x7fe8a01401c0 2026-02-13T20:11:19.121 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe87bfff640 1 -- 10.20.193.188:0/2023841188 <== mon.1 v1:10.20.193.188:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe8900032b0 con 0x7fe8a01401c0 2026-02-13T20:11:19.122 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe87bfff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:19.122 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe87bfff640 1 -- 10.20.193.188:0/2023841188 <== mon.1 v1:10.20.193.188:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe890003b30 con 0x7fe8a01401c0 2026-02-13T20:11:19.122 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe87bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:19.122 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe87bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:11:19.122 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe89dffb640 4 set_mon_vals no callback set 2026-02-13T20:11:19.122 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe87bfff640 10 monclient: dump: 2026-02-13T20:11:19.122 INFO:teuthology.orchestra.run.trial188.stderr:epoch 1 2026-02-13T20:11:19.122 INFO:teuthology.orchestra.run.trial188.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:19.122 INFO:teuthology.orchestra.run.trial188.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:19.122 INFO:teuthology.orchestra.run.trial188.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:19.122 INFO:teuthology.orchestra.run.trial188.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:19.122 INFO:teuthology.orchestra.run.trial188.stderr:election_strategy: 3 2026-02-13T20:11:19.123 INFO:teuthology.orchestra.run.trial188.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:19.123 INFO:teuthology.orchestra.run.trial188.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:19.123 INFO:teuthology.orchestra.run.trial188.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:19.123 INFO:teuthology.orchestra.run.trial188.stderr: 2026-02-13T20:11:19.123 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe87bfff640 1 -- 10.20.193.188:0/2023841188 <== mon.1 v1:10.20.193.188:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7fe890004110 con 0x7fe8a01401c0 2026-02-13T20:11:19.123 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.100+0000 7fe87bfff640 1 -- 10.20.193.188:0/2023841188 <== mon.1 v1:10.20.193.188:6789/0 8 ==== osd_map(6..6 src has 1..6) ==== 1180+0+0 (unknown 968888239 0 0) 0x7fe890006be0 con 0x7fe8a01401c0 2026-02-13T20:11:19.123 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.101+0000 7fe8a625b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:19.123 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.101+0000 7fe8a625b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:19.123 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.101+0000 7fe8a625b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:11:19.123 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.101+0000 7fe8a625b640 1 -- 10.20.193.188:0/2023841188 --> v1:10.20.193.188:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8a00008d0 con 0x7fe8a01401c0 2026-02-13T20:11:19.123 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.102+0000 7fe87bfff640 1 -- 10.20.193.188:0/2023841188 <== mon.1 v1:10.20.193.188:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (unknown 1092875540 0 2392355004) 0x7fe8900066e0 con 0x7fe8a01401c0 2026-02-13T20:11:19.123 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.102+0000 7fe87bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:19.123 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.102+0000 7fe87bfff640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:11:19.139 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.136+0000 7fe8a625b640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "718e9755-3c16-47c8-9df8-c08e4193063d", "id": 4}] 2026-02-13T20:11:19.139 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.136+0000 7fe8a625b640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "718e9755-3c16-47c8-9df8-c08e4193063d", "id": 4}] 2026-02-13T20:11:19.139 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.136+0000 7fe8a625b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:11:19.139 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.136+0000 7fe8a625b640 1 -- 10.20.193.188:0/2023841188 --> v1:10.20.193.188:6789/0 -- mon_command({"prefix": "osd new", "uuid": "718e9755-3c16-47c8-9df8-c08e4193063d", "id": 4} v 0) -- 0x7fe8a0058410 con 0x7fe8a01401c0 2026-02-13T20:11:19.141 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.139+0000 7fe87bfff640 1 -- 10.20.193.188:0/2023841188 <== mon.1 v1:10.20.193.188:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "718e9755-3c16-47c8-9df8-c08e4193063d", "id": 4}]=0 v7) ==== 112+0+2 (unknown 1347364443 0 1697012583) 0x7fe890006920 con 0x7fe8a01401c0 2026-02-13T20:11:19.141 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.139+0000 7fe87bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "718e9755-3c16-47c8-9df8-c08e4193063d", "id": 4}] 2026-02-13T20:11:19.141 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.139+0000 7fe87bfff640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:11:19.142 INFO:teuthology.orchestra.run.trial188.stdout:4 2026-02-13T20:11:19.142 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.139+0000 7fe8a625b640 10 monclient: shutdown 2026-02-13T20:11:19.143 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.139+0000 7fe8a625b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:19.143 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.139+0000 7fe8a625b640 1 -- 10.20.193.188:0/2023841188 >> v1:10.20.193.188:6789/0 conn(0x7fe8a01401c0 legacy=0x7fe8a0089770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:19.143 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.139+0000 7fe8a625b640 1 -- 10.20.193.188:0/2023841188 shutdown_connections 2026-02-13T20:11:19.143 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.139+0000 7fe8a625b640 1 -- 10.20.193.188:0/2023841188 >> 10.20.193.188:0/2023841188 conn(0x7fe8a0054e90 msgr2=0x7fe8a008ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:19.143 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.139+0000 7fe8a625b640 1 -- 10.20.193.188:0/2023841188 shutdown_connections 2026-02-13T20:11:19.143 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.139+0000 7fe8a625b640 1 -- 10.20.193.188:0/2023841188 wait complete. 2026-02-13T20:11:19.149 DEBUG:teuthology.orchestra.run.trial188:> sudo ceph --cluster ceph osd new 1508f970-10c7-486a-96d1-76881e826af8 5 2026-02-13T20:11:19.213 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.210+0000 7f1227da5640 10 monclient: get_monmap_and_config 2026-02-13T20:11:19.213 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.210+0000 7f1227da5640 10 monclient: build_initial_monmap 2026-02-13T20:11:19.213 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.210+0000 7f1227da5640 10 monclient: monmap: 2026-02-13T20:11:19.213 INFO:teuthology.orchestra.run.trial188.stderr:epoch 0 2026-02-13T20:11:19.213 INFO:teuthology.orchestra.run.trial188.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:19.213 INFO:teuthology.orchestra.run.trial188.stderr:last_changed 2026-02-13T20:11:19.211644+0000 2026-02-13T20:11:19.213 INFO:teuthology.orchestra.run.trial188.stderr:created 2026-02-13T20:11:19.211644+0000 2026-02-13T20:11:19.213 INFO:teuthology.orchestra.run.trial188.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:19.213 INFO:teuthology.orchestra.run.trial188.stderr:election_strategy: 3 2026-02-13T20:11:19.214 INFO:teuthology.orchestra.run.trial188.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:19.214 INFO:teuthology.orchestra.run.trial188.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:19.214 INFO:teuthology.orchestra.run.trial188.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:19.214 INFO:teuthology.orchestra.run.trial188.stderr: 2026-02-13T20:11:19.220 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.211+0000 7f1227da5640 1 Processor -- start 2026-02-13T20:11:19.220 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.211+0000 7f1227da5640 1 -- start start 2026-02-13T20:11:19.221 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.211+0000 7f1227da5640 10 monclient: init 2026-02-13T20:11:19.221 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.211+0000 7f1227da5640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:19.221 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.211+0000 7f1227da5640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:11:19.221 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.211+0000 7f1227da5640 10 monclient(hunting): picked mon.noname-a con 0x7f12201401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:19.221 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.211+0000 7f1227da5640 10 monclient(hunting): picked mon.noname-c con 0x7f1220092020 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:19.221 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.211+0000 7f1227da5640 10 monclient(hunting): picked mon.noname-b con 0x7f1220091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:19.221 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.211+0000 7f1227da5640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f122008b730 con 0x7f12201401c0 2026-02-13T20:11:19.221 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.211+0000 7f1227da5640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f122005c5b0 con 0x7f1220092020 2026-02-13T20:11:19.221 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.211+0000 7f1227da5640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f122008bcf0 con 0x7f1220091950 2026-02-13T20:11:19.222 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.211+0000 7f1227da5640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:19.222 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.211+0000 7f1227da5640 10 monclient(hunting): authenticate will time out at 622.780547s 2026-02-13T20:11:19.222 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.211+0000 7f1225319640 1 --1- >> v1:10.20.193.188:6789/0 conn(0x7f1220092020 0x7f12201812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.188:6789/0 says I am v1:10.20.193.188:44802/0 (socket says 10.20.193.188:44802) 2026-02-13T20:11:19.222 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.211+0000 7f1225319640 1 -- 10.20.193.188:0/3092045660 learned_addr learned my addr 10.20.193.188:0/3092045660 (peer_addr_for_me v1:10.20.193.188:0/0) 2026-02-13T20:11:19.222 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.211+0000 7f1224b18640 1 -- 10.20.193.188:0/3092045660 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2177383712 0 0) 0x7f122005c5b0 con 0x7f1220092020 2026-02-13T20:11:19.222 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.211+0000 7f1224b18640 10 monclient(hunting): _negotiate 2026-02-13T20:11:19.222 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.211+0000 7f1224b18640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:19.222 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.211+0000 7f1224b18640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:19.222 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.211+0000 7f1224b18640 10 monclient(hunting): my global_id is 4144 2026-02-13T20:11:19.222 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.211+0000 7f1224b18640 1 -- 10.20.193.188:0/3092045660 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12080035e0 con 0x7f1220092020 2026-02-13T20:11:19.223 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.212+0000 7f1224b18640 1 -- 10.20.193.188:0/3092045660 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 506004134 0 0) 0x7f12080035e0 con 0x7f1220092020 2026-02-13T20:11:19.223 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.212+0000 7f1224b18640 1 -- 10.20.193.188:0/3092045660 >> v1:10.20.193.110:6790/0 conn(0x7f1220091950 legacy=0x7f12201a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:19.223 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.212+0000 7f1224b18640 1 -- 10.20.193.188:0/3092045660 >> v1:10.20.193.110:6789/0 conn(0x7f12201401c0 legacy=0x7f1220091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:19.223 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.212+0000 7f1224b18640 10 monclient: _finish_hunting 0 2026-02-13T20:11:19.223 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.212+0000 7f1224b18640 1 monclient: found mon.noname-c 2026-02-13T20:11:19.223 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.212+0000 7f1224b18640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:19.223 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.212+0000 7f1224b18640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.188:6789/0 2026-02-13T20:11:19.223 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.212+0000 7f1224b18640 1 -- 10.20.193.188:0/3092045660 --> v1:10.20.193.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1220140590 con 0x7f1220092020 2026-02-13T20:11:19.223 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.212+0000 7f1224b18640 10 monclient: _finish_auth 0 2026-02-13T20:11:19.223 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.212+0000 7f1224b18640 10 monclient: _check_auth_tickets 2026-02-13T20:11:19.223 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.212+0000 7f1224b18640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:19.223 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.212+0000 7f1224b18640 1 -- 10.20.193.188:0/3092045660 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f1214002dd0 con 0x7f1220092020 2026-02-13T20:11:19.224 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.212+0000 7f1224b18640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:19.224 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.212+0000 7f1224b18640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:11:19.224 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.212+0000 7f1224b18640 10 monclient: dump: 2026-02-13T20:11:19.224 INFO:teuthology.orchestra.run.trial188.stderr:epoch 1 2026-02-13T20:11:19.224 INFO:teuthology.orchestra.run.trial188.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:19.224 INFO:teuthology.orchestra.run.trial188.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:19.224 INFO:teuthology.orchestra.run.trial188.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:19.224 INFO:teuthology.orchestra.run.trial188.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:19.224 INFO:teuthology.orchestra.run.trial188.stderr:election_strategy: 3 2026-02-13T20:11:19.224 INFO:teuthology.orchestra.run.trial188.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:19.224 INFO:teuthology.orchestra.run.trial188.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:19.224 INFO:teuthology.orchestra.run.trial188.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:19.224 INFO:teuthology.orchestra.run.trial188.stderr: 2026-02-13T20:11:19.225 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.212+0000 7f1227da5640 5 monclient: authenticate success, global_id 4144 2026-02-13T20:11:19.225 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.212+0000 7f1227da5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:19.225 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.212+0000 7f1224b18640 1 -- 10.20.193.188:0/3092045660 <== mon.1 v1:10.20.193.188:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1214003020 con 0x7f1220092020 2026-02-13T20:11:19.225 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.212+0000 7f1224b18640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:19.225 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.212+0000 7f1224b18640 1 -- 10.20.193.188:0/3092045660 <== mon.1 v1:10.20.193.188:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f1214003430 con 0x7f1220092020 2026-02-13T20:11:19.225 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.212+0000 7f1224b18640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:19.225 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.212+0000 7f1224b18640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:11:19.225 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.212+0000 7f1224b18640 10 monclient: dump: 2026-02-13T20:11:19.225 INFO:teuthology.orchestra.run.trial188.stderr:epoch 1 2026-02-13T20:11:19.225 INFO:teuthology.orchestra.run.trial188.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:19.225 INFO:teuthology.orchestra.run.trial188.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:19.225 INFO:teuthology.orchestra.run.trial188.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:19.226 INFO:teuthology.orchestra.run.trial188.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:19.226 INFO:teuthology.orchestra.run.trial188.stderr:election_strategy: 3 2026-02-13T20:11:19.226 INFO:teuthology.orchestra.run.trial188.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:19.226 INFO:teuthology.orchestra.run.trial188.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:19.226 INFO:teuthology.orchestra.run.trial188.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:19.226 INFO:teuthology.orchestra.run.trial188.stderr: 2026-02-13T20:11:19.226 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.212+0000 7f1227da5640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:19.226 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.212+0000 7f1227da5640 4 set_mon_vals no callback set 2026-02-13T20:11:19.226 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.212+0000 7f1227da5640 10 monclient: shutdown 2026-02-13T20:11:19.226 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.212+0000 7f1227da5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:19.226 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.212+0000 7f1227da5640 1 -- 10.20.193.188:0/3092045660 >> v1:10.20.193.188:6789/0 conn(0x7f1220092020 legacy=0x7f12201812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:19.226 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.212+0000 7f1227da5640 1 -- 10.20.193.188:0/3092045660 shutdown_connections 2026-02-13T20:11:19.226 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.212+0000 7f1227da5640 1 -- 10.20.193.188:0/3092045660 >> 10.20.193.188:0/3092045660 conn(0x7f1220054e90 msgr2=0x7f1220058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:19.226 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.212+0000 7f1227da5640 1 -- 10.20.193.188:0/3092045660 shutdown_connections 2026-02-13T20:11:19.227 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.212+0000 7f1227da5640 1 -- 10.20.193.188:0/3092045660 wait complete. 2026-02-13T20:11:19.227 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.212+0000 7f1227da5640 10 monclient: build_initial_monmap 2026-02-13T20:11:19.227 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.212+0000 7f1227da5640 10 monclient: monmap: 2026-02-13T20:11:19.227 INFO:teuthology.orchestra.run.trial188.stderr:epoch 0 2026-02-13T20:11:19.227 INFO:teuthology.orchestra.run.trial188.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:19.227 INFO:teuthology.orchestra.run.trial188.stderr:last_changed 0.000000 2026-02-13T20:11:19.227 INFO:teuthology.orchestra.run.trial188.stderr:created 0.000000 2026-02-13T20:11:19.227 INFO:teuthology.orchestra.run.trial188.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:19.227 INFO:teuthology.orchestra.run.trial188.stderr:election_strategy: 1 2026-02-13T20:11:19.227 INFO:teuthology.orchestra.run.trial188.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:19.227 INFO:teuthology.orchestra.run.trial188.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:19.227 INFO:teuthology.orchestra.run.trial188.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:19.227 INFO:teuthology.orchestra.run.trial188.stderr: 2026-02-13T20:11:19.228 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.212+0000 7f1227da5640 1 Processor -- start 2026-02-13T20:11:19.228 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f1227da5640 1 -- start start 2026-02-13T20:11:19.228 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f1227da5640 10 monclient: init 2026-02-13T20:11:19.228 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f1227da5640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:19.228 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f1227da5640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:11:19.228 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f1227da5640 10 monclient(hunting): picked mon.noname-a con 0x7f1220091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:19.228 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f1227da5640 10 monclient(hunting): picked mon.noname-c con 0x7f12201401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:19.228 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f1227da5640 10 monclient(hunting): picked mon.noname-b con 0x7f122012f010 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:19.228 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f1227da5640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f122012f5c0 con 0x7f1220091950 2026-02-13T20:11:19.228 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f1227da5640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f122005d320 con 0x7f122012f010 2026-02-13T20:11:19.228 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f1227da5640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12201309d0 con 0x7f12201401c0 2026-02-13T20:11:19.228 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f1227da5640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:19.229 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f1227da5640 10 monclient(hunting): authenticate will time out at 622.782292s 2026-02-13T20:11:19.229 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f122631b640 1 --1- >> v1:10.20.193.188:6789/0 conn(0x7f122012f010 0x7f122012e4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.188:6789/0 says I am v1:10.20.193.188:44814/0 (socket says 10.20.193.188:44814) 2026-02-13T20:11:19.229 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f122631b640 1 -- 10.20.193.188:0/3982284279 learned_addr learned my addr 10.20.193.188:0/3982284279 (peer_addr_for_me v1:10.20.193.188:0/0) 2026-02-13T20:11:19.229 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f120e7fc640 1 -- 10.20.193.188:0/3982284279 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3318404680 0 0) 0x7f122005d320 con 0x7f122012f010 2026-02-13T20:11:19.229 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f120e7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:11:19.229 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f120e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:19.229 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f120e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:19.229 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f120e7fc640 10 monclient(hunting): my global_id is 4147 2026-02-13T20:11:19.229 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f120e7fc640 1 -- 10.20.193.188:0/3982284279 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11f00035e0 con 0x7f122012f010 2026-02-13T20:11:19.229 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f120e7fc640 1 -- 10.20.193.188:0/3982284279 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1872922294 0 0) 0x7f11f00035e0 con 0x7f122012f010 2026-02-13T20:11:19.229 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f120e7fc640 1 -- 10.20.193.188:0/3982284279 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f122005d320 con 0x7f122012f010 2026-02-13T20:11:19.229 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f120e7fc640 1 -- 10.20.193.188:0/3982284279 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f121c004140 con 0x7f122012f010 2026-02-13T20:11:19.230 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f120e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:19.230 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f120e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:11:19.230 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f120e7fc640 10 monclient(hunting): dump: 2026-02-13T20:11:19.230 INFO:teuthology.orchestra.run.trial188.stderr:epoch 1 2026-02-13T20:11:19.230 INFO:teuthology.orchestra.run.trial188.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:19.230 INFO:teuthology.orchestra.run.trial188.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:19.230 INFO:teuthology.orchestra.run.trial188.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:19.230 INFO:teuthology.orchestra.run.trial188.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:19.230 INFO:teuthology.orchestra.run.trial188.stderr:election_strategy: 3 2026-02-13T20:11:19.230 INFO:teuthology.orchestra.run.trial188.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:19.230 INFO:teuthology.orchestra.run.trial188.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:19.230 INFO:teuthology.orchestra.run.trial188.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:19.230 INFO:teuthology.orchestra.run.trial188.stderr: 2026-02-13T20:11:19.231 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f120e7fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:19.231 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f120e7fc640 1 -- 10.20.193.188:0/3982284279 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1414750274 0 0) 0x7f122005d320 con 0x7f122012f010 2026-02-13T20:11:19.231 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f120e7fc640 1 -- 10.20.193.188:0/3982284279 >> v1:10.20.193.110:6790/0 conn(0x7f12201401c0 legacy=0x7f122012ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:19.231 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f120e7fc640 1 -- 10.20.193.188:0/3982284279 >> v1:10.20.193.110:6789/0 conn(0x7f1220091950 legacy=0x7f122012d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:19.231 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f120e7fc640 10 monclient: _finish_hunting 0 2026-02-13T20:11:19.231 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f120e7fc640 1 monclient: found mon.b 2026-02-13T20:11:19.231 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f120e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:19.231 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f120e7fc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:11:19.231 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f120e7fc640 1 -- 10.20.193.188:0/3982284279 --> v1:10.20.193.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1220130cb0 con 0x7f122012f010 2026-02-13T20:11:19.231 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f120e7fc640 10 monclient: _finish_auth 0 2026-02-13T20:11:19.231 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f120e7fc640 10 monclient: _check_auth_tickets 2026-02-13T20:11:19.232 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f120e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:19.232 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f1227da5640 5 monclient: authenticate success, global_id 4147 2026-02-13T20:11:19.232 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f1227da5640 10 monclient: _renew_subs 2026-02-13T20:11:19.232 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f1227da5640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:11:19.232 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f1227da5640 1 -- 10.20.193.188:0/3982284279 --> v1:10.20.193.188:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f122012fa70 con 0x7f122012f010 2026-02-13T20:11:19.232 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f1227da5640 10 monclient: _renew_subs 2026-02-13T20:11:19.232 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f1227da5640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:11:19.232 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f1227da5640 1 -- 10.20.193.188:0/3982284279 --> v1:10.20.193.188:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1220196300 con 0x7f122012f010 2026-02-13T20:11:19.232 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f120e7fc640 1 -- 10.20.193.188:0/3982284279 <== mon.1 v1:10.20.193.188:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f121c004530 con 0x7f122012f010 2026-02-13T20:11:19.232 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f120e7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:19.232 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f120e7fc640 1 -- 10.20.193.188:0/3982284279 <== mon.1 v1:10.20.193.188:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f121c004c50 con 0x7f122012f010 2026-02-13T20:11:19.232 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f120e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:19.233 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f120e7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:11:19.233 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f120ffff640 4 set_mon_vals no callback set 2026-02-13T20:11:19.233 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f120e7fc640 10 monclient: dump: 2026-02-13T20:11:19.233 INFO:teuthology.orchestra.run.trial188.stderr:epoch 1 2026-02-13T20:11:19.233 INFO:teuthology.orchestra.run.trial188.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:19.233 INFO:teuthology.orchestra.run.trial188.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:19.233 INFO:teuthology.orchestra.run.trial188.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:19.233 INFO:teuthology.orchestra.run.trial188.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:19.233 INFO:teuthology.orchestra.run.trial188.stderr:election_strategy: 3 2026-02-13T20:11:19.233 INFO:teuthology.orchestra.run.trial188.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:19.233 INFO:teuthology.orchestra.run.trial188.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:19.233 INFO:teuthology.orchestra.run.trial188.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:19.233 INFO:teuthology.orchestra.run.trial188.stderr: 2026-02-13T20:11:19.233 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f120e7fc640 1 -- 10.20.193.188:0/3982284279 <== mon.1 v1:10.20.193.188:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f121c005230 con 0x7f122012f010 2026-02-13T20:11:19.233 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.213+0000 7f120e7fc640 1 -- 10.20.193.188:0/3982284279 <== mon.1 v1:10.20.193.188:6789/0 8 ==== osd_map(7..7 src has 1..7) ==== 1295+0+0 (unknown 4060295238 0 0) 0x7f121c007d20 con 0x7f122012f010 2026-02-13T20:11:19.233 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.214+0000 7f1227da5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:19.233 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.214+0000 7f1227da5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:19.233 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.214+0000 7f1227da5640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:11:19.233 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.214+0000 7f1227da5640 1 -- 10.20.193.188:0/3982284279 --> v1:10.20.193.188:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1220131300 con 0x7f122012f010 2026-02-13T20:11:19.233 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.215+0000 7f120e7fc640 1 -- 10.20.193.188:0/3982284279 <== mon.1 v1:10.20.193.188:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (unknown 1092875540 0 2392355004) 0x7f121c0077b0 con 0x7f122012f010 2026-02-13T20:11:19.233 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.215+0000 7f120e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:19.233 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.215+0000 7f120e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:11:19.251 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.248+0000 7f1227da5640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "1508f970-10c7-486a-96d1-76881e826af8", "id": 5}] 2026-02-13T20:11:19.251 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.248+0000 7f1227da5640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "1508f970-10c7-486a-96d1-76881e826af8", "id": 5}] 2026-02-13T20:11:19.251 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.248+0000 7f1227da5640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:11:19.251 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.248+0000 7f1227da5640 1 -- 10.20.193.188:0/3982284279 --> v1:10.20.193.188:6789/0 -- mon_command({"prefix": "osd new", "uuid": "1508f970-10c7-486a-96d1-76881e826af8", "id": 5} v 0) -- 0x7f1220055bb0 con 0x7f122012f010 2026-02-13T20:11:19.253 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.250+0000 7f120e7fc640 1 -- 10.20.193.188:0/3982284279 <== mon.1 v1:10.20.193.188:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1508f970-10c7-486a-96d1-76881e826af8", "id": 5}]=0 v8) ==== 112+0+2 (unknown 93100316 0 1988412176) 0x7f121c0079f0 con 0x7f122012f010 2026-02-13T20:11:19.253 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.250+0000 7f120e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "1508f970-10c7-486a-96d1-76881e826af8", "id": 5}] 2026-02-13T20:11:19.253 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.250+0000 7f120e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:11:19.253 INFO:teuthology.orchestra.run.trial188.stdout:5 2026-02-13T20:11:19.254 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.251+0000 7f1227da5640 10 monclient: shutdown 2026-02-13T20:11:19.254 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.251+0000 7f1227da5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:19.254 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.251+0000 7f1227da5640 1 -- 10.20.193.188:0/3982284279 >> v1:10.20.193.188:6789/0 conn(0x7f122012f010 legacy=0x7f122012e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:19.255 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.251+0000 7f1227da5640 1 -- 10.20.193.188:0/3982284279 shutdown_connections 2026-02-13T20:11:19.255 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.251+0000 7f1227da5640 1 -- 10.20.193.188:0/3982284279 >> 10.20.193.188:0/3982284279 conn(0x7f1220054e90 msgr2=0x7f1220089050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:19.255 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.251+0000 7f1227da5640 1 -- 10.20.193.188:0/3982284279 shutdown_connections 2026-02-13T20:11:19.255 INFO:teuthology.orchestra.run.trial188.stderr:2026-02-13T20:11:19.251+0000 7f1227da5640 1 -- 10.20.193.188:0/3982284279 wait complete. 2026-02-13T20:11:19.261 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-13T20:11:19.262 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2026-02-13T20:11:19.263 INFO:tasks.ceph.osd.0:Started 2026-02-13T20:11:19.263 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-13T20:11:19.263 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2026-02-13T20:11:19.264 INFO:tasks.ceph.osd.1:Started 2026-02-13T20:11:19.264 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-13T20:11:19.264 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2026-02-13T20:11:19.265 INFO:tasks.ceph.osd.2:Started 2026-02-13T20:11:19.265 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-13T20:11:19.265 DEBUG:teuthology.orchestra.run.trial188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2026-02-13T20:11:19.267 INFO:tasks.ceph.osd.3:Started 2026-02-13T20:11:19.267 INFO:tasks.ceph.osd.4:Restarting daemon 2026-02-13T20:11:19.267 DEBUG:teuthology.orchestra.run.trial188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2026-02-13T20:11:19.268 INFO:tasks.ceph.osd.4:Started 2026-02-13T20:11:19.268 INFO:tasks.ceph.osd.5:Restarting daemon 2026-02-13T20:11:19.268 DEBUG:teuthology.orchestra.run.trial188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2026-02-13T20:11:19.269 INFO:tasks.ceph.osd.5:Started 2026-02-13T20:11:19.270 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-13T20:11:19.336 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.335+0000 7f110c30c640 10 monclient: get_monmap_and_config 2026-02-13T20:11:19.336 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.335+0000 7f110c30c640 10 monclient: build_initial_monmap 2026-02-13T20:11:19.336 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.335+0000 7f110c30c640 10 monclient: monmap: 2026-02-13T20:11:19.336 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:19.336 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:19.336 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:19.335563+0000 2026-02-13T20:11:19.336 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:19.335563+0000 2026-02-13T20:11:19.336 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:19.336 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:19.336 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:19.336 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:19.336 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:19.336 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:19.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.335+0000 7f110c30c640 1 Processor -- start 2026-02-13T20:11:19.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.335+0000 7f110c30c640 1 -- start start 2026-02-13T20:11:19.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.335+0000 7f110c30c640 10 monclient: init 2026-02-13T20:11:19.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.335+0000 7f110c30c640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:19.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.335+0000 7f110c30c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:11:19.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.335+0000 7f110c30c640 10 monclient(hunting): picked mon.noname-b con 0x7f11041401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:19.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.335+0000 7f110c30c640 10 monclient(hunting): picked mon.noname-a con 0x7f1104092020 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:19.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.335+0000 7f110c30c640 10 monclient(hunting): picked mon.noname-c con 0x7f1104091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:19.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.335+0000 7f110c30c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f110408b730 con 0x7f1104092020 2026-02-13T20:11:19.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.335+0000 7f110c30c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f110405c5b0 con 0x7f1104091950 2026-02-13T20:11:19.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.335+0000 7f110c30c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f110408bcf0 con 0x7f11041401c0 2026-02-13T20:11:19.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.335+0000 7f110c30c640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:19.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.335+0000 7f110c30c640 10 monclient(hunting): authenticate will time out at 641.025885s 2026-02-13T20:11:19.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.335+0000 7f110a081640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f11041401c0 0x7f1104091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:44120/0 (socket says 10.20.193.110:44120) 2026-02-13T20:11:19.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.335+0000 7f110a081640 1 -- 10.20.193.110:0/237176179 learned_addr learned my addr 10.20.193.110:0/237176179 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:19.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.336+0000 7f110907f640 1 -- 10.20.193.110:0/237176179 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1900820193 0 0) 0x7f110408b730 con 0x7f1104092020 2026-02-13T20:11:19.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.336+0000 7f110907f640 10 monclient(hunting): _negotiate 2026-02-13T20:11:19.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.336+0000 7f110907f640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:19.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.336+0000 7f110907f640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:19.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.336+0000 7f110907f640 10 monclient(hunting): my global_id is 4158 2026-02-13T20:11:19.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.336+0000 7f110907f640 1 -- 10.20.193.110:0/237176179 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10ec0035e0 con 0x7f1104092020 2026-02-13T20:11:19.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.336+0000 7f110907f640 1 -- 10.20.193.110:0/237176179 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4124412781 0 0) 0x7f110408bcf0 con 0x7f11041401c0 2026-02-13T20:11:19.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.336+0000 7f110907f640 10 monclient(hunting): _negotiate 2026-02-13T20:11:19.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.336+0000 7f110907f640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:19.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.336+0000 7f110907f640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:19.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.336+0000 7f110907f640 10 monclient(hunting): my global_id is 4157 2026-02-13T20:11:19.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.336+0000 7f110907f640 1 -- 10.20.193.110:0/237176179 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f110408b730 con 0x7f11041401c0 2026-02-13T20:11:19.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.336+0000 7f110907f640 1 -- 10.20.193.110:0/237176179 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2519986108 0 0) 0x7f10ec0035e0 con 0x7f1104092020 2026-02-13T20:11:19.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.336+0000 7f110907f640 1 -- 10.20.193.110:0/237176179 >> v1:10.20.193.110:6790/0 conn(0x7f11041401c0 legacy=0x7f1104091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:19.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.336+0000 7f110907f640 1 -- 10.20.193.110:0/237176179 >> v1:10.20.193.188:6789/0 conn(0x7f1104091950 legacy=0x7f11041a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:19.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.336+0000 7f110907f640 10 monclient: _finish_hunting 0 2026-02-13T20:11:19.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.336+0000 7f110907f640 1 monclient: found mon.noname-a 2026-02-13T20:11:19.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.336+0000 7f110907f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:19.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.336+0000 7f110907f640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:11:19.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.336+0000 7f110907f640 1 -- 10.20.193.110:0/237176179 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1104140590 con 0x7f1104092020 2026-02-13T20:11:19.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.336+0000 7f110907f640 10 monclient: _finish_auth 0 2026-02-13T20:11:19.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.336+0000 7f110907f640 10 monclient: _check_auth_tickets 2026-02-13T20:11:19.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.336+0000 7f110907f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:19.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.336+0000 7f110907f640 1 -- 10.20.193.110:0/237176179 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f10f8002d00 con 0x7f1104092020 2026-02-13T20:11:19.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.336+0000 7f110c30c640 5 monclient: authenticate success, global_id 4158 2026-02-13T20:11:19.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.336+0000 7f110c30c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:19.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.336+0000 7f110907f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:19.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.336+0000 7f110907f640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:11:19.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.336+0000 7f110907f640 10 monclient: dump: 2026-02-13T20:11:19.338 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:19.338 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:19.338 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:19.338 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:19.338 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:19.338 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:19.338 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:19.338 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:19.338 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:19.338 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:19.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.336+0000 7f110c30c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:19.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.336+0000 7f110907f640 1 -- 10.20.193.110:0/237176179 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f10f8002e90 con 0x7f1104092020 2026-02-13T20:11:19.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.336+0000 7f110907f640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:19.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.336+0000 7f110907f640 1 -- 10.20.193.110:0/237176179 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f10f80032a0 con 0x7f1104092020 2026-02-13T20:11:19.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.336+0000 7f110907f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:19.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.336+0000 7f110907f640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:19.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.336+0000 7f110907f640 10 monclient: dump: 2026-02-13T20:11:19.338 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:19.338 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:19.338 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:19.338 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:19.338 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:19.338 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:19.338 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:19.338 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:19.338 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:19.338 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:19.339 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.336+0000 7f110c30c640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:19.339 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.336+0000 7f110c30c640 4 set_mon_vals no callback set 2026-02-13T20:11:19.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.336+0000 7f110c30c640 10 monclient: shutdown 2026-02-13T20:11:19.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.336+0000 7f110c30c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:19.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.336+0000 7f110c30c640 1 -- 10.20.193.110:0/237176179 >> v1:10.20.193.110:6789/0 conn(0x7f1104092020 legacy=0x7f11041812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:19.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.336+0000 7f110c30c640 1 -- 10.20.193.110:0/237176179 shutdown_connections 2026-02-13T20:11:19.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.336+0000 7f110c30c640 1 -- 10.20.193.110:0/237176179 >> 10.20.193.110:0/237176179 conn(0x7f1104054e90 msgr2=0x7f1104058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:19.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.336+0000 7f110c30c640 1 -- 10.20.193.110:0/237176179 shutdown_connections 2026-02-13T20:11:19.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.336+0000 7f110c30c640 1 -- 10.20.193.110:0/237176179 wait complete. 2026-02-13T20:11:19.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.337+0000 7f110c30c640 10 monclient: build_initial_monmap 2026-02-13T20:11:19.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.337+0000 7f110c30c640 10 monclient: monmap: 2026-02-13T20:11:19.340 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:19.340 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:19.340 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:11:19.340 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:11:19.340 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:19.340 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:11:19.340 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:19.340 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:19.340 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:19.340 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:19.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.337+0000 7f110c30c640 1 Processor -- start 2026-02-13T20:11:19.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.337+0000 7f110c30c640 1 -- start start 2026-02-13T20:11:19.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.337+0000 7f110c30c640 10 monclient: init 2026-02-13T20:11:19.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.337+0000 7f110c30c640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:19.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.337+0000 7f110c30c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:11:19.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.337+0000 7f110c30c640 10 monclient(hunting): picked mon.noname-b con 0x7f1104091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:19.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.337+0000 7f110c30c640 10 monclient(hunting): picked mon.noname-c con 0x7f11041401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:19.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.337+0000 7f110c30c640 10 monclient(hunting): picked mon.noname-a con 0x7f110413ef30 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:19.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.337+0000 7f110c30c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f110405d320 con 0x7f110413ef30 2026-02-13T20:11:19.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.337+0000 7f110c30c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f110412fee0 con 0x7f1104091950 2026-02-13T20:11:19.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.337+0000 7f110c30c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11041532a0 con 0x7f11041401c0 2026-02-13T20:11:19.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.337+0000 7f110c30c640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:19.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.337+0000 7f110c30c640 10 monclient(hunting): authenticate will time out at 641.027603s 2026-02-13T20:11:19.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.337+0000 7f1109880640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f11041401c0 0x7f1104193a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:44130/0 (socket says 10.20.193.110:44130) 2026-02-13T20:11:19.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.337+0000 7f1109880640 1 -- 10.20.193.110:0/847561446 learned_addr learned my addr 10.20.193.110:0/847561446 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:19.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.337+0000 7f10eaffd640 1 -- 10.20.193.110:0/847561446 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2134113197 0 0) 0x7f11041532a0 con 0x7f11041401c0 2026-02-13T20:11:19.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.337+0000 7f10eaffd640 10 monclient(hunting): _negotiate 2026-02-13T20:11:19.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.337+0000 7f10eaffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:19.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.337+0000 7f10eaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:19.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.337+0000 7f10eaffd640 10 monclient(hunting): my global_id is 4160 2026-02-13T20:11:19.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.337+0000 7f10eaffd640 1 -- 10.20.193.110:0/847561446 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10d40035e0 con 0x7f11041401c0 2026-02-13T20:11:19.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.337+0000 7f10eaffd640 1 -- 10.20.193.110:0/847561446 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1128693761 0 0) 0x7f110405d320 con 0x7f110413ef30 2026-02-13T20:11:19.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.337+0000 7f10eaffd640 10 monclient(hunting): _negotiate 2026-02-13T20:11:19.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.337+0000 7f10eaffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:19.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.337+0000 7f10eaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:19.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.337+0000 7f10eaffd640 10 monclient(hunting): my global_id is 4161 2026-02-13T20:11:19.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.337+0000 7f10eaffd640 1 -- 10.20.193.110:0/847561446 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11041532a0 con 0x7f110413ef30 2026-02-13T20:11:19.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.337+0000 7f10eaffd640 1 -- 10.20.193.110:0/847561446 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1392660852 0 0) 0x7f10d40035e0 con 0x7f11041401c0 2026-02-13T20:11:19.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.337+0000 7f10eaffd640 1 -- 10.20.193.110:0/847561446 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f110405d320 con 0x7f11041401c0 2026-02-13T20:11:19.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.337+0000 7f10eaffd640 1 -- 10.20.193.110:0/847561446 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f10f8003270 con 0x7f11041401c0 2026-02-13T20:11:19.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.337+0000 7f10eaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:19.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.337+0000 7f10eaffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:11:19.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.337+0000 7f10eaffd640 10 monclient(hunting): dump: 2026-02-13T20:11:19.341 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:19.341 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:19.341 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:19.341 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:19.341 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:19.341 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:19.341 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:19.341 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:19.341 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:19.341 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:19.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.337+0000 7f10eaffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:19.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.337+0000 7f10eaffd640 1 -- 10.20.193.110:0/847561446 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 101514832 0 0) 0x7f11041532a0 con 0x7f110413ef30 2026-02-13T20:11:19.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.337+0000 7f10eaffd640 1 -- 10.20.193.110:0/847561446 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f10d40035e0 con 0x7f110413ef30 2026-02-13T20:11:19.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.337+0000 7f10eaffd640 1 -- 10.20.193.110:0/847561446 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f11000040d0 con 0x7f110413ef30 2026-02-13T20:11:19.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.337+0000 7f10eaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:19.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.337+0000 7f10eaffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:19.342 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.337+0000 7f10eaffd640 10 monclient(hunting): dump: 2026-02-13T20:11:19.342 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:19.342 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:19.342 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:19.342 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:19.342 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:19.342 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:19.342 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:19.342 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:19.342 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:19.342 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:19.342 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.338+0000 7f10eaffd640 1 -- 10.20.193.110:0/847561446 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1055653093 0 0) 0x7f110405d320 con 0x7f11041401c0 2026-02-13T20:11:19.342 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.338+0000 7f10eaffd640 1 -- 10.20.193.110:0/847561446 >> v1:10.20.193.188:6789/0 conn(0x7f1104091950 legacy=0x7f110413e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:19.342 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.338+0000 7f10eaffd640 1 -- 10.20.193.110:0/847561446 >> v1:10.20.193.110:6789/0 conn(0x7f110413ef30 legacy=0x7f1104195160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:19.342 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.338+0000 7f10eaffd640 10 monclient: _finish_hunting 0 2026-02-13T20:11:19.342 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.338+0000 7f10eaffd640 1 monclient: found mon.c 2026-02-13T20:11:19.342 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.338+0000 7f10eaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:19.342 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.338+0000 7f10eaffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:19.342 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.338+0000 7f10eaffd640 1 -- 10.20.193.110:0/847561446 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11041319a0 con 0x7f11041401c0 2026-02-13T20:11:19.342 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.338+0000 7f10eaffd640 10 monclient: _finish_auth 0 2026-02-13T20:11:19.342 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.338+0000 7f10eaffd640 10 monclient: _check_auth_tickets 2026-02-13T20:11:19.342 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.338+0000 7f10eaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:19.342 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.338+0000 7f110c30c640 5 monclient: authenticate success, global_id 4160 2026-02-13T20:11:19.342 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.338+0000 7f110c30c640 10 monclient: _renew_subs 2026-02-13T20:11:19.342 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.338+0000 7f110c30c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:19.342 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.338+0000 7f110c30c640 1 -- 10.20.193.110:0/847561446 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1104131c80 con 0x7f11041401c0 2026-02-13T20:11:19.342 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.338+0000 7f110c30c640 10 monclient: _renew_subs 2026-02-13T20:11:19.342 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.338+0000 7f110c30c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:19.342 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.338+0000 7f110c30c640 1 -- 10.20.193.110:0/847561446 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f1104130be0 con 0x7f11041401c0 2026-02-13T20:11:19.342 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.338+0000 7f10eaffd640 1 -- 10.20.193.110:0/847561446 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f10f80037c0 con 0x7f11041401c0 2026-02-13T20:11:19.342 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.338+0000 7f10eaffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:19.342 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.338+0000 7f10eaffd640 1 -- 10.20.193.110:0/847561446 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f10f8003b60 con 0x7f11041401c0 2026-02-13T20:11:19.342 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.338+0000 7f10eaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:19.342 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.338+0000 7f10eaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:19.342 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.338+0000 7f10eaffd640 10 monclient: dump: 2026-02-13T20:11:19.342 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:19.342 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:19.342 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:19.342 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:19.342 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:19.342 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:19.342 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:19.343 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:19.343 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:19.343 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:19.343 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.338+0000 7f110887e640 4 set_mon_vals no callback set 2026-02-13T20:11:19.343 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.338+0000 7f10eaffd640 1 -- 10.20.193.110:0/847561446 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f10f80040d0 con 0x7f11041401c0 2026-02-13T20:11:19.343 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.338+0000 7f10eaffd640 1 -- 10.20.193.110:0/847561446 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(8..8 src has 1..8) ==== 1410+0+0 (unknown 2667918896 0 0) 0x7f10f8005c90 con 0x7f11041401c0 2026-02-13T20:11:19.343 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.338+0000 7f110c30c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:19.343 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.338+0000 7f110c30c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:19.343 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.338+0000 7f110c30c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:19.343 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.338+0000 7f110c30c640 1 -- 10.20.193.110:0/847561446 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11040008d0 con 0x7f11041401c0 2026-02-13T20:11:19.343 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.339+0000 7f10eaffd640 1 -- 10.20.193.110:0/847561446 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (unknown 1092875540 0 2392355004) 0x7f10f8005f70 con 0x7f11041401c0 2026-02-13T20:11:19.343 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.339+0000 7f10eaffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:19.343 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.339+0000 7f10eaffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:11:19.370 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.369+0000 7f110c30c640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-13T20:11:19.371 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.369+0000 7f110c30c640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-13T20:11:19.371 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.369+0000 7f110c30c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:19.371 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.369+0000 7f110c30c640 1 -- 10.20.193.110:0/847561446 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1104058410 con 0x7f11041401c0 2026-02-13T20:11:19.371 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.369+0000 7f10eaffd640 1 -- 10.20.193.110:0/847561446 <== mon.2 v1:10.20.193.110:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+5603 (unknown 150273500 0 3503746380) 0x7f10f8006190 con 0x7f11041401c0 2026-02-13T20:11:19.371 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.369+0000 7f10eaffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-13T20:11:19.371 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.369+0000 7f10eaffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:11:19.371 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:19.371 INFO:teuthology.orchestra.run.trial110.stdout:{"epoch":8,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","created":"2026-02-13T20:11:18.047609+0000","modified":"2026-02-13T20:11:19.250528+0000","last_up_change":"0.000000","last_in_change":"2026-02-13T20:11:19.250528+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"88457b09-7bbe-4ebe-8a8b-4c980153af2c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"efb2f419-77ef-44b0-ae26-4c448073556b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c5a08402-8e10-4d4d-87fe-6236a6766128","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3062e357-c62b-4a5d-a4b2-9715c16cfd37","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"718e9755-3c16-47c8-9df8-c08e4193063d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1508f970-10c7-486a-96d1-76881e826af8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T20:11:19.372 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.370+0000 7f110c30c640 10 monclient: shutdown 2026-02-13T20:11:19.372 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.370+0000 7f110c30c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:19.372 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.370+0000 7f110c30c640 1 -- 10.20.193.110:0/847561446 >> v1:10.20.193.110:6790/0 conn(0x7f11041401c0 legacy=0x7f1104193a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:19.372 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.370+0000 7f110c30c640 1 -- 10.20.193.110:0/847561446 shutdown_connections 2026-02-13T20:11:19.373 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.370+0000 7f110c30c640 1 -- 10.20.193.110:0/847561446 >> 10.20.193.110:0/847561446 conn(0x7f1104054e90 msgr2=0x7f1104088e30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:19.373 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.370+0000 7f110c30c640 1 -- 10.20.193.110:0/847561446 shutdown_connections 2026-02-13T20:11:19.373 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:19.370+0000 7f110c30c640 1 -- 10.20.193.110:0/847561446 wait complete. 2026-02-13T20:11:19.377 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-13T20:11:19.377 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-13T20:11:19.488 INFO:tasks.ceph.osd.1.trial110.stderr:2026-02-13T20:11:19.486+0000 7f4093dd8780 -1 Falling back to public interface 2026-02-13T20:11:19.499 INFO:tasks.ceph.osd.2.trial110.stderr:2026-02-13T20:11:19.498+0000 7f8203431780 -1 Falling back to public interface 2026-02-13T20:11:19.503 INFO:tasks.ceph.osd.0.trial110.stderr:2026-02-13T20:11:19.502+0000 7f54e985b780 -1 Falling back to public interface 2026-02-13T20:11:19.591 INFO:tasks.ceph.osd.3.trial188.stderr:2026-02-13T20:11:19.588+0000 7f2a89216780 -1 Falling back to public interface 2026-02-13T20:11:19.596 INFO:tasks.ceph.osd.4.trial188.stderr:2026-02-13T20:11:19.593+0000 7f24491d8780 -1 Falling back to public interface 2026-02-13T20:11:19.596 INFO:tasks.ceph.osd.5.trial188.stderr:2026-02-13T20:11:19.593+0000 7f13a824a780 -1 Falling back to public interface 2026-02-13T20:11:19.804 INFO:tasks.ceph.osd.1.trial110.stderr:2026-02-13T20:11:19.803+0000 7f4093dd8780 -1 osd.1 0 log_to_monitors true 2026-02-13T20:11:19.820 INFO:tasks.ceph.osd.2.trial110.stderr:2026-02-13T20:11:19.819+0000 7f8203431780 -1 osd.2 0 log_to_monitors true 2026-02-13T20:11:19.832 INFO:tasks.ceph.osd.0.trial110.stderr:2026-02-13T20:11:19.831+0000 7f54e985b780 -1 osd.0 0 log_to_monitors true 2026-02-13T20:11:19.981 DEBUG:teuthology.orchestra.run.trial110:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-13T20:11:19.982 INFO:tasks.ceph.osd.4.trial188.stderr:2026-02-13T20:11:19.979+0000 7f24491d8780 -1 osd.4 0 log_to_monitors true 2026-02-13T20:11:19.983 INFO:tasks.ceph.osd.3.trial188.stderr:2026-02-13T20:11:19.981+0000 7f2a89216780 -1 osd.3 0 log_to_monitors true 2026-02-13T20:11:19.986 INFO:tasks.ceph.osd.5.trial188.stderr:2026-02-13T20:11:19.984+0000 7f13a824a780 -1 osd.5 0 log_to_monitors true 2026-02-13T20:11:20.042 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.040+0000 7fabdf5e5640 10 monclient: get_monmap_and_config 2026-02-13T20:11:20.042 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.040+0000 7fabdf5e5640 10 monclient: build_initial_monmap 2026-02-13T20:11:20.042 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.040+0000 7fabdf5e5640 10 monclient: monmap: 2026-02-13T20:11:20.042 INFO:teuthology.misc.health.trial110.stderr:epoch 0 2026-02-13T20:11:20.042 INFO:teuthology.misc.health.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:20.042 INFO:teuthology.misc.health.trial110.stderr:last_changed 2026-02-13T20:11:20.041402+0000 2026-02-13T20:11:20.042 INFO:teuthology.misc.health.trial110.stderr:created 2026-02-13T20:11:20.041402+0000 2026-02-13T20:11:20.042 INFO:teuthology.misc.health.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:20.043 INFO:teuthology.misc.health.trial110.stderr:election_strategy: 3 2026-02-13T20:11:20.043 INFO:teuthology.misc.health.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:20.043 INFO:teuthology.misc.health.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:20.043 INFO:teuthology.misc.health.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:20.043 INFO:teuthology.misc.health.trial110.stderr: 2026-02-13T20:11:20.051 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.041+0000 7fabdf5e5640 1 Processor -- start 2026-02-13T20:11:20.051 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.041+0000 7fabdf5e5640 1 -- start start 2026-02-13T20:11:20.051 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.041+0000 7fabdf5e5640 10 monclient: init 2026-02-13T20:11:20.051 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.041+0000 7fabdf5e5640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:20.051 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.041+0000 7fabdf5e5640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:11:20.052 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.041+0000 7fabdf5e5640 10 monclient(hunting): picked mon.noname-b con 0x7fabd8091d00 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:20.052 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.041+0000 7fabdf5e5640 10 monclient(hunting): picked mon.noname-c con 0x7fabd80897c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:20.052 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.041+0000 7fabdf5e5640 10 monclient(hunting): picked mon.noname-a con 0x7fabd8089c60 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:20.052 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.041+0000 7fabdf5e5640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabd813c420 con 0x7fabd8089c60 2026-02-13T20:11:20.052 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.041+0000 7fabdf5e5640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabd80920d0 con 0x7fabd80897c0 2026-02-13T20:11:20.052 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.041+0000 7fabdf5e5640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabd808a820 con 0x7fabd8091d00 2026-02-13T20:11:20.052 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.041+0000 7fabdf5e5640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:20.052 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.041+0000 7fabdf5e5640 10 monclient(hunting): authenticate will time out at 641.731963s 2026-02-13T20:11:20.052 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.042+0000 7fabdd35a640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fabd8091d00 0x7fabd813bd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:44176/0 (socket says 10.20.193.110:44176) 2026-02-13T20:11:20.052 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.042+0000 7fabdd35a640 1 -- 10.20.193.110:0/1972498963 learned_addr learned my addr 10.20.193.110:0/1972498963 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:20.052 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.042+0000 7fabc7fff640 1 -- 10.20.193.110:0/1972498963 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3756782591 0 0) 0x7fabd808a820 con 0x7fabd8091d00 2026-02-13T20:11:20.052 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.042+0000 7fabc7fff640 10 monclient(hunting): _negotiate 2026-02-13T20:11:20.053 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.042+0000 7fabc7fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:20.053 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.042+0000 7fabc7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:20.053 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.042+0000 7fabc7fff640 10 monclient(hunting): my global_id is 4181 2026-02-13T20:11:20.053 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.042+0000 7fabc7fff640 1 -- 10.20.193.110:0/1972498963 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fabc00035e0 con 0x7fabd8091d00 2026-02-13T20:11:20.053 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.042+0000 7fabc7fff640 1 -- 10.20.193.110:0/1972498963 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2386309563 0 0) 0x7fabd813c420 con 0x7fabd8089c60 2026-02-13T20:11:20.053 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.042+0000 7fabc7fff640 10 monclient(hunting): _negotiate 2026-02-13T20:11:20.053 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.042+0000 7fabc7fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:20.053 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.042+0000 7fabc7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:20.053 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.042+0000 7fabc7fff640 10 monclient(hunting): my global_id is 4179 2026-02-13T20:11:20.053 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.042+0000 7fabc7fff640 1 -- 10.20.193.110:0/1972498963 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fabd808a820 con 0x7fabd8089c60 2026-02-13T20:11:20.053 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.042+0000 7fabc7fff640 1 -- 10.20.193.110:0/1972498963 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2217191011 0 0) 0x7fabc00035e0 con 0x7fabd8091d00 2026-02-13T20:11:20.053 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.042+0000 7fabc7fff640 1 -- 10.20.193.110:0/1972498963 >> v1:10.20.193.188:6789/0 conn(0x7fabd80897c0 legacy=0x7fabd8180130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:20.054 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.042+0000 7fabc7fff640 1 -- 10.20.193.110:0/1972498963 >> v1:10.20.193.110:6789/0 conn(0x7fabd8089c60 legacy=0x7fabd81a1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:20.054 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.042+0000 7fabc7fff640 10 monclient: _finish_hunting 0 2026-02-13T20:11:20.054 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.042+0000 7fabc7fff640 1 monclient: found mon.noname-b 2026-02-13T20:11:20.054 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.042+0000 7fabc7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:20.054 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.042+0000 7fabc7fff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:11:20.054 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.042+0000 7fabc7fff640 1 -- 10.20.193.110:0/1972498963 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabd808ab00 con 0x7fabd8091d00 2026-02-13T20:11:20.054 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.042+0000 7fabc7fff640 10 monclient: _finish_auth 0 2026-02-13T20:11:20.054 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.042+0000 7fabc7fff640 10 monclient: _check_auth_tickets 2026-02-13T20:11:20.054 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.042+0000 7fabc7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:20.054 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.042+0000 7fabc7fff640 1 -- 10.20.193.110:0/1972498963 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fabc8002dd0 con 0x7fabd8091d00 2026-02-13T20:11:20.054 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.042+0000 7fabdf5e5640 5 monclient: authenticate success, global_id 4181 2026-02-13T20:11:20.054 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.042+0000 7fabdf5e5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:20.055 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.042+0000 7fabc7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:20.055 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.042+0000 7fabc7fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:11:20.055 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.042+0000 7fabc7fff640 10 monclient: dump: 2026-02-13T20:11:20.055 INFO:teuthology.misc.health.trial110.stderr:epoch 1 2026-02-13T20:11:20.055 INFO:teuthology.misc.health.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:20.055 INFO:teuthology.misc.health.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:20.055 INFO:teuthology.misc.health.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:20.055 INFO:teuthology.misc.health.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:20.055 INFO:teuthology.misc.health.trial110.stderr:election_strategy: 3 2026-02-13T20:11:20.055 INFO:teuthology.misc.health.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:20.055 INFO:teuthology.misc.health.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:20.055 INFO:teuthology.misc.health.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:20.055 INFO:teuthology.misc.health.trial110.stderr: 2026-02-13T20:11:20.056 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.042+0000 7fabdf5e5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:20.056 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.042+0000 7fabc7fff640 1 -- 10.20.193.110:0/1972498963 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fabc8002fd0 con 0x7fabd8091d00 2026-02-13T20:11:20.056 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.042+0000 7fabc7fff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:20.056 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.042+0000 7fabc7fff640 1 -- 10.20.193.110:0/1972498963 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fabc80033e0 con 0x7fabd8091d00 2026-02-13T20:11:20.056 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.042+0000 7fabc7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:20.056 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.042+0000 7fabc7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:20.056 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.042+0000 7fabc7fff640 10 monclient: dump: 2026-02-13T20:11:20.056 INFO:teuthology.misc.health.trial110.stderr:epoch 1 2026-02-13T20:11:20.056 INFO:teuthology.misc.health.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:20.056 INFO:teuthology.misc.health.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:20.056 INFO:teuthology.misc.health.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:20.056 INFO:teuthology.misc.health.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:20.057 INFO:teuthology.misc.health.trial110.stderr:election_strategy: 3 2026-02-13T20:11:20.057 INFO:teuthology.misc.health.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:20.057 INFO:teuthology.misc.health.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:20.057 INFO:teuthology.misc.health.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:20.057 INFO:teuthology.misc.health.trial110.stderr: 2026-02-13T20:11:20.057 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.042+0000 7fabdf5e5640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:20.057 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.042+0000 7fabdf5e5640 4 set_mon_vals no callback set 2026-02-13T20:11:20.057 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.042+0000 7fabdf5e5640 10 monclient: shutdown 2026-02-13T20:11:20.057 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.042+0000 7fabdf5e5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:20.057 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.042+0000 7fabdf5e5640 1 -- 10.20.193.110:0/1972498963 >> v1:10.20.193.110:6790/0 conn(0x7fabd8091d00 legacy=0x7fabd813bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:20.057 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.042+0000 7fabdf5e5640 1 -- 10.20.193.110:0/1972498963 shutdown_connections 2026-02-13T20:11:20.057 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.042+0000 7fabdf5e5640 1 -- 10.20.193.110:0/1972498963 >> 10.20.193.110:0/1972498963 conn(0x7fabd8054b90 msgr2=0x7fabd80912b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:20.057 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.042+0000 7fabdf5e5640 1 -- 10.20.193.110:0/1972498963 shutdown_connections 2026-02-13T20:11:20.058 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.042+0000 7fabdf5e5640 1 -- 10.20.193.110:0/1972498963 wait complete. 2026-02-13T20:11:20.058 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.043+0000 7fabdf5e5640 10 monclient: build_initial_monmap 2026-02-13T20:11:20.058 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.043+0000 7fabdf5e5640 10 monclient: monmap: 2026-02-13T20:11:20.058 INFO:teuthology.misc.health.trial110.stderr:epoch 0 2026-02-13T20:11:20.058 INFO:teuthology.misc.health.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:20.058 INFO:teuthology.misc.health.trial110.stderr:last_changed 0.000000 2026-02-13T20:11:20.058 INFO:teuthology.misc.health.trial110.stderr:created 0.000000 2026-02-13T20:11:20.058 INFO:teuthology.misc.health.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:20.058 INFO:teuthology.misc.health.trial110.stderr:election_strategy: 1 2026-02-13T20:11:20.058 INFO:teuthology.misc.health.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:20.058 INFO:teuthology.misc.health.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:20.058 INFO:teuthology.misc.health.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:20.059 INFO:teuthology.misc.health.trial110.stderr: 2026-02-13T20:11:20.059 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.043+0000 7fabdf5e5640 1 Processor -- start 2026-02-13T20:11:20.059 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.043+0000 7fabdf5e5640 1 -- start start 2026-02-13T20:11:20.059 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.043+0000 7fabdf5e5640 10 monclient: init 2026-02-13T20:11:20.059 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.043+0000 7fabdf5e5640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:20.059 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.043+0000 7fabdf5e5640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:11:20.059 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.043+0000 7fabdf5e5640 10 monclient(hunting): picked mon.noname-c con 0x7fabd80897c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:20.059 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.043+0000 7fabdf5e5640 10 monclient(hunting): picked mon.noname-b con 0x7fabd8089c60 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:20.059 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.043+0000 7fabdf5e5640 10 monclient(hunting): picked mon.noname-a con 0x7fabd8091d00 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:20.059 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.043+0000 7fabdf5e5640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabd8119290 con 0x7fabd8091d00 2026-02-13T20:11:20.059 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.043+0000 7fabdf5e5640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabd8121270 con 0x7fabd8089c60 2026-02-13T20:11:20.059 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.043+0000 7fabdf5e5640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabd811b5f0 con 0x7fabd80897c0 2026-02-13T20:11:20.059 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.043+0000 7fabdf5e5640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:20.060 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.043+0000 7fabdf5e5640 10 monclient(hunting): authenticate will time out at 641.733600s 2026-02-13T20:11:20.060 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.043+0000 7fabdd35a640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fabd80897c0 0x7fabd8120b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:44186/0 (socket says 10.20.193.110:44186) 2026-02-13T20:11:20.060 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.043+0000 7fabdd35a640 1 -- 10.20.193.110:0/4055543098 learned_addr learned my addr 10.20.193.110:0/4055543098 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:20.060 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.043+0000 7fabc5ffb640 1 -- 10.20.193.110:0/4055543098 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3493295761 0 0) 0x7fabd811b5f0 con 0x7fabd80897c0 2026-02-13T20:11:20.060 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.043+0000 7fabc5ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:11:20.060 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.043+0000 7fabc5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:20.060 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.043+0000 7fabc5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:20.060 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.043+0000 7fabc5ffb640 10 monclient(hunting): my global_id is 4184 2026-02-13T20:11:20.060 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.043+0000 7fabc5ffb640 1 -- 10.20.193.110:0/4055543098 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faba80035e0 con 0x7fabd80897c0 2026-02-13T20:11:20.060 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.043+0000 7fabc5ffb640 1 -- 10.20.193.110:0/4055543098 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3301893966 0 0) 0x7fabd8119290 con 0x7fabd8091d00 2026-02-13T20:11:20.060 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.043+0000 7fabc5ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:11:20.060 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.043+0000 7fabc5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:20.061 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.043+0000 7fabc5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:20.061 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.043+0000 7fabc5ffb640 10 monclient(hunting): my global_id is 4182 2026-02-13T20:11:20.061 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.043+0000 7fabc5ffb640 1 -- 10.20.193.110:0/4055543098 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fabd811b5f0 con 0x7fabd8091d00 2026-02-13T20:11:20.061 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.043+0000 7fabc5ffb640 1 -- 10.20.193.110:0/4055543098 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 11829084 0 0) 0x7fabd8121270 con 0x7fabd8089c60 2026-02-13T20:11:20.061 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.043+0000 7fabc5ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:11:20.061 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.043+0000 7fabc5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:20.061 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.043+0000 7fabc5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:20.061 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.043+0000 7fabc5ffb640 10 monclient(hunting): my global_id is 4186 2026-02-13T20:11:20.061 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.043+0000 7fabc5ffb640 1 -- 10.20.193.110:0/4055543098 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fabd8119290 con 0x7fabd8089c60 2026-02-13T20:11:20.061 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.043+0000 7fabc5ffb640 1 -- 10.20.193.110:0/4055543098 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2907198076 0 0) 0x7faba80035e0 con 0x7fabd80897c0 2026-02-13T20:11:20.061 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.044+0000 7fabc5ffb640 1 -- 10.20.193.110:0/4055543098 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fabd8121270 con 0x7fabd80897c0 2026-02-13T20:11:20.061 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.044+0000 7fabc5ffb640 1 -- 10.20.193.110:0/4055543098 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fabc8002ce0 con 0x7fabd80897c0 2026-02-13T20:11:20.061 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.044+0000 7fabc5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:20.062 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.044+0000 7fabc5ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:11:20.062 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.044+0000 7fabc5ffb640 10 monclient(hunting): dump: 2026-02-13T20:11:20.062 INFO:teuthology.misc.health.trial110.stderr:epoch 1 2026-02-13T20:11:20.062 INFO:teuthology.misc.health.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:20.062 INFO:teuthology.misc.health.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:20.062 INFO:teuthology.misc.health.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:20.062 INFO:teuthology.misc.health.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:20.062 INFO:teuthology.misc.health.trial110.stderr:election_strategy: 3 2026-02-13T20:11:20.062 INFO:teuthology.misc.health.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:20.062 INFO:teuthology.misc.health.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:20.062 INFO:teuthology.misc.health.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:20.062 INFO:teuthology.misc.health.trial110.stderr: 2026-02-13T20:11:20.062 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.044+0000 7fabc5ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:20.063 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.044+0000 7fabc5ffb640 1 -- 10.20.193.110:0/4055543098 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2947853991 0 0) 0x7fabd811b5f0 con 0x7fabd8091d00 2026-02-13T20:11:20.063 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.044+0000 7fabc5ffb640 1 -- 10.20.193.110:0/4055543098 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faba80035e0 con 0x7fabd8091d00 2026-02-13T20:11:20.063 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.044+0000 7fabc5ffb640 1 -- 10.20.193.110:0/4055543098 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fabd4003890 con 0x7fabd8091d00 2026-02-13T20:11:20.063 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.044+0000 7fabc5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:20.063 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.044+0000 7fabc5ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:20.063 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.044+0000 7fabc5ffb640 10 monclient(hunting): dump: 2026-02-13T20:11:20.063 INFO:teuthology.misc.health.trial110.stderr:epoch 1 2026-02-13T20:11:20.063 INFO:teuthology.misc.health.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:20.063 INFO:teuthology.misc.health.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:20.063 INFO:teuthology.misc.health.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:20.063 INFO:teuthology.misc.health.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:20.063 INFO:teuthology.misc.health.trial110.stderr:election_strategy: 3 2026-02-13T20:11:20.064 INFO:teuthology.misc.health.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:20.064 INFO:teuthology.misc.health.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:20.064 INFO:teuthology.misc.health.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:20.064 INFO:teuthology.misc.health.trial110.stderr: 2026-02-13T20:11:20.064 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.044+0000 7fabc5ffb640 1 -- 10.20.193.110:0/4055543098 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3378380000 0 0) 0x7fabd8121270 con 0x7fabd80897c0 2026-02-13T20:11:20.064 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.044+0000 7fabc5ffb640 1 -- 10.20.193.110:0/4055543098 >> v1:10.20.193.188:6789/0 conn(0x7fabd8089c60 legacy=0x7fabd807f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:20.064 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.044+0000 7fabc5ffb640 1 -- 10.20.193.110:0/4055543098 >> v1:10.20.193.110:6789/0 conn(0x7fabd8091d00 legacy=0x7fabd8080b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:20.064 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.044+0000 7fabc5ffb640 10 monclient: _finish_hunting 0 2026-02-13T20:11:20.064 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.044+0000 7fabc5ffb640 1 monclient: found mon.c 2026-02-13T20:11:20.064 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.044+0000 7fabc5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:20.064 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.044+0000 7fabc5ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:20.064 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.044+0000 7fabc5ffb640 1 -- 10.20.193.110:0/4055543098 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabd811a1a0 con 0x7fabd80897c0 2026-02-13T20:11:20.064 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.044+0000 7fabc5ffb640 10 monclient: _finish_auth 0 2026-02-13T20:11:20.065 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.044+0000 7fabc5ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:11:20.065 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.044+0000 7fabc5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:20.065 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.044+0000 7fabdf5e5640 5 monclient: authenticate success, global_id 4184 2026-02-13T20:11:20.065 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.044+0000 7fabdf5e5640 10 monclient: _renew_subs 2026-02-13T20:11:20.065 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.044+0000 7fabdf5e5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:20.065 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.044+0000 7fabdf5e5640 1 -- 10.20.193.110:0/4055543098 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fabd811ad50 con 0x7fabd80897c0 2026-02-13T20:11:20.065 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.044+0000 7fabdf5e5640 10 monclient: _renew_subs 2026-02-13T20:11:20.065 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.044+0000 7fabdf5e5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:20.065 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.044+0000 7fabdf5e5640 1 -- 10.20.193.110:0/4055543098 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fabd8119df0 con 0x7fabd80897c0 2026-02-13T20:11:20.065 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.044+0000 7fabc5ffb640 1 -- 10.20.193.110:0/4055543098 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fabc80028e0 con 0x7fabd80897c0 2026-02-13T20:11:20.065 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.044+0000 7fabc5ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:20.065 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.044+0000 7fabc5ffb640 1 -- 10.20.193.110:0/4055543098 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fabc8004d00 con 0x7fabd80897c0 2026-02-13T20:11:20.066 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.044+0000 7fabc5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:20.066 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.044+0000 7fabc5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:20.066 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.044+0000 7fabc5ffb640 10 monclient: dump: 2026-02-13T20:11:20.066 INFO:teuthology.misc.health.trial110.stderr:epoch 1 2026-02-13T20:11:20.066 INFO:teuthology.misc.health.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:20.066 INFO:teuthology.misc.health.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:20.066 INFO:teuthology.misc.health.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:20.066 INFO:teuthology.misc.health.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:20.066 INFO:teuthology.misc.health.trial110.stderr:election_strategy: 3 2026-02-13T20:11:20.066 INFO:teuthology.misc.health.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:20.066 INFO:teuthology.misc.health.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:20.066 INFO:teuthology.misc.health.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:20.066 INFO:teuthology.misc.health.trial110.stderr: 2026-02-13T20:11:20.067 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.044+0000 7fabc77fe640 4 set_mon_vals no callback set 2026-02-13T20:11:20.067 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.044+0000 7fabc5ffb640 1 -- 10.20.193.110:0/4055543098 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7fabc8005270 con 0x7fabd80897c0 2026-02-13T20:11:20.067 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.044+0000 7fabc5ffb640 1 -- 10.20.193.110:0/4055543098 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(8..8 src has 1..8) ==== 1410+0+0 (unknown 2667918896 0 0) 0x7fabc8006d40 con 0x7fabd80897c0 2026-02-13T20:11:20.067 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.044+0000 7fabdf5e5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:20.067 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.044+0000 7fabdf5e5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:20.067 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.044+0000 7fabdf5e5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:20.067 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.044+0000 7fabdf5e5640 1 -- 10.20.193.110:0/4055543098 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabd8090410 con 0x7fabd80897c0 2026-02-13T20:11:20.067 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.045+0000 7fabc5ffb640 1 -- 10.20.193.110:0/4055543098 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (unknown 1092875540 0 2392355004) 0x7fabc8006860 con 0x7fabd80897c0 2026-02-13T20:11:20.067 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.045+0000 7fabc5ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:20.067 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.045+0000 7fabc5ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:11:20.075 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.073+0000 7fabdf5e5640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-13T20:11:20.075 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.073+0000 7fabdf5e5640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-13T20:11:20.075 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.073+0000 7fabdf5e5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:20.075 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.073+0000 7fabdf5e5640 1 -- 10.20.193.110:0/4055543098 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fabd808f1b0 con 0x7fabd80897c0 2026-02-13T20:11:20.075 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.074+0000 7fabc5ffb640 1 -- 10.20.193.110:0/4055543098 <== mon.2 v1:10.20.193.110:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+5603 (unknown 150273500 0 3503746380) 0x7fabc8005730 con 0x7fabd80897c0 2026-02-13T20:11:20.075 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.074+0000 7fabc5ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-13T20:11:20.075 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.074+0000 7fabc5ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:11:20.076 INFO:teuthology.misc.health.trial110.stdout: 2026-02-13T20:11:20.076 INFO:teuthology.misc.health.trial110.stdout:{"epoch":8,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","created":"2026-02-13T20:11:18.047609+0000","modified":"2026-02-13T20:11:19.250528+0000","last_up_change":"0.000000","last_in_change":"2026-02-13T20:11:19.250528+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"88457b09-7bbe-4ebe-8a8b-4c980153af2c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"efb2f419-77ef-44b0-ae26-4c448073556b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c5a08402-8e10-4d4d-87fe-6236a6766128","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3062e357-c62b-4a5d-a4b2-9715c16cfd37","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"718e9755-3c16-47c8-9df8-c08e4193063d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1508f970-10c7-486a-96d1-76881e826af8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T20:11:20.077 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.074+0000 7fabdf5e5640 10 monclient: shutdown 2026-02-13T20:11:20.077 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.074+0000 7fabdf5e5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:20.077 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.074+0000 7fabdf5e5640 1 -- 10.20.193.110:0/4055543098 >> v1:10.20.193.110:6790/0 conn(0x7fabd80897c0 legacy=0x7fabd8120b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:20.077 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.074+0000 7fabdf5e5640 1 -- 10.20.193.110:0/4055543098 shutdown_connections 2026-02-13T20:11:20.077 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.074+0000 7fabdf5e5640 1 -- 10.20.193.110:0/4055543098 >> 10.20.193.110:0/4055543098 conn(0x7fabd8054b90 msgr2=0x7fabd808e450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:20.077 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.074+0000 7fabdf5e5640 1 -- 10.20.193.110:0/4055543098 shutdown_connections 2026-02-13T20:11:20.077 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:20.074+0000 7fabdf5e5640 1 -- 10.20.193.110:0/4055543098 wait complete. 2026-02-13T20:11:20.081 DEBUG:teuthology.misc:0 of 6 OSDs are up 2026-02-13T20:11:21.126 INFO:tasks.ceph.mgr.x.trial188.stderr:2026-02-13T20:11:21.123+0000 7f26abe56640 -1 mgr.server handle_report got status from non-daemon mon.b 2026-02-13T20:11:21.126 INFO:tasks.ceph.mgr.x.trial188.stderr:2026-02-13T20:11:21.123+0000 7f26abe56640 -1 mgr.server handle_report got status from non-daemon mon.c 2026-02-13T20:11:21.255 INFO:tasks.ceph.osd.0.trial110.stderr:2026-02-13T20:11:21.254+0000 7f54e4bf7640 -1 osd.0 0 waiting for initial osdmap 2026-02-13T20:11:21.256 INFO:tasks.ceph.osd.1.trial110.stderr:2026-02-13T20:11:21.254+0000 7f408f3f7640 -1 osd.1 0 waiting for initial osdmap 2026-02-13T20:11:21.256 INFO:tasks.ceph.osd.2.trial110.stderr:2026-02-13T20:11:21.254+0000 7f81fe3f7640 -1 osd.2 0 waiting for initial osdmap 2026-02-13T20:11:21.257 INFO:tasks.ceph.osd.5.trial188.stderr:2026-02-13T20:11:21.255+0000 7f13a35f7640 -1 osd.5 0 waiting for initial osdmap 2026-02-13T20:11:21.257 INFO:tasks.ceph.osd.4.trial188.stderr:2026-02-13T20:11:21.255+0000 7f24447f7640 -1 osd.4 0 waiting for initial osdmap 2026-02-13T20:11:21.257 INFO:tasks.ceph.osd.3.trial188.stderr:2026-02-13T20:11:21.255+0000 7f2a845f7640 -1 osd.3 0 waiting for initial osdmap 2026-02-13T20:11:21.258 INFO:tasks.ceph.osd.0.trial110.stderr:2026-02-13T20:11:21.256+0000 7f54e0331640 -1 osd.0 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T20:11:21.258 INFO:tasks.ceph.osd.2.trial110.stderr:2026-02-13T20:11:21.256+0000 7f81fa3ef640 -1 osd.2 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T20:11:21.259 INFO:tasks.ceph.osd.1.trial110.stderr:2026-02-13T20:11:21.257+0000 7f408b332640 -1 osd.1 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T20:11:21.260 INFO:tasks.ceph.osd.4.trial188.stderr:2026-02-13T20:11:21.258+0000 7f2440732640 -1 osd.4 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T20:11:21.261 INFO:tasks.ceph.osd.3.trial188.stderr:2026-02-13T20:11:21.259+0000 7f2a80532640 -1 osd.3 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T20:11:21.261 INFO:tasks.ceph.osd.5.trial188.stderr:2026-02-13T20:11:21.258+0000 7f139f532640 -1 osd.5 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T20:11:26.686 DEBUG:teuthology.orchestra.run.trial110:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-13T20:11:26.751 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.742+0000 7efe293ae640 10 monclient: get_monmap_and_config 2026-02-13T20:11:26.751 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.742+0000 7efe293ae640 10 monclient: build_initial_monmap 2026-02-13T20:11:26.751 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.742+0000 7efe293ae640 10 monclient: monmap: 2026-02-13T20:11:26.751 INFO:teuthology.misc.health.trial110.stderr:epoch 0 2026-02-13T20:11:26.751 INFO:teuthology.misc.health.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:26.751 INFO:teuthology.misc.health.trial110.stderr:last_changed 2026-02-13T20:11:26.742872+0000 2026-02-13T20:11:26.751 INFO:teuthology.misc.health.trial110.stderr:created 2026-02-13T20:11:26.742872+0000 2026-02-13T20:11:26.751 INFO:teuthology.misc.health.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:26.752 INFO:teuthology.misc.health.trial110.stderr:election_strategy: 3 2026-02-13T20:11:26.752 INFO:teuthology.misc.health.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:26.752 INFO:teuthology.misc.health.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:26.752 INFO:teuthology.misc.health.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:26.752 INFO:teuthology.misc.health.trial110.stderr: 2026-02-13T20:11:26.752 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.742+0000 7efe293ae640 1 Processor -- start 2026-02-13T20:11:26.752 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.742+0000 7efe293ae640 1 -- start start 2026-02-13T20:11:26.752 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.742+0000 7efe293ae640 10 monclient: init 2026-02-13T20:11:26.752 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.743+0000 7efe293ae640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:26.752 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.743+0000 7efe293ae640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:11:26.752 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.743+0000 7efe293ae640 10 monclient(hunting): picked mon.noname-a con 0x7efe2408e050 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:26.752 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.743+0000 7efe293ae640 10 monclient(hunting): picked mon.noname-c con 0x7efe241424d0 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:26.753 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.743+0000 7efe293ae640 10 monclient(hunting): picked mon.noname-b con 0x7efe2408e420 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:26.753 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.743+0000 7efe293ae640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe24055150 con 0x7efe2408e050 2026-02-13T20:11:26.753 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.743+0000 7efe293ae640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe2408e880 con 0x7efe241424d0 2026-02-13T20:11:26.753 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.743+0000 7efe293ae640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe2405da80 con 0x7efe2408e420 2026-02-13T20:11:26.753 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.743+0000 7efe293ae640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:26.753 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.743+0000 7efe293ae640 10 monclient(hunting): authenticate will time out at 648.433285s 2026-02-13T20:11:26.753 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.743+0000 7efe22ffd640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7efe2408e050 0x7efe24054330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:44460/0 (socket says 10.20.193.110:44460) 2026-02-13T20:11:26.753 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.743+0000 7efe22ffd640 1 -- 10.20.193.110:0/3434184524 learned_addr learned my addr 10.20.193.110:0/3434184524 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:26.753 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.743+0000 7efe21ffb640 1 -- 10.20.193.110:0/3434184524 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 360836946 0 0) 0x7efe2405da80 con 0x7efe2408e420 2026-02-13T20:11:26.753 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.743+0000 7efe21ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:11:26.753 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.743+0000 7efe21ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:26.753 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.743+0000 7efe21ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:26.754 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.743+0000 7efe21ffb640 10 monclient(hunting): my global_id is 4208 2026-02-13T20:11:26.754 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.743+0000 7efe21ffb640 1 -- 10.20.193.110:0/3434184524 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe100035e0 con 0x7efe2408e420 2026-02-13T20:11:26.754 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.743+0000 7efe21ffb640 1 -- 10.20.193.110:0/3434184524 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3349821941 0 0) 0x7efe24055150 con 0x7efe2408e050 2026-02-13T20:11:26.754 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.743+0000 7efe21ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:11:26.754 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.743+0000 7efe21ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:26.754 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.743+0000 7efe21ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:26.754 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.743+0000 7efe21ffb640 10 monclient(hunting): my global_id is 4212 2026-02-13T20:11:26.754 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.743+0000 7efe21ffb640 1 -- 10.20.193.110:0/3434184524 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe2405da80 con 0x7efe2408e050 2026-02-13T20:11:26.755 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.743+0000 7efe21ffb640 1 -- 10.20.193.110:0/3434184524 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1666871864 0 0) 0x7efe100035e0 con 0x7efe2408e420 2026-02-13T20:11:26.755 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.743+0000 7efe21ffb640 1 -- 10.20.193.110:0/3434184524 >> v1:10.20.193.188:6789/0 conn(0x7efe241424d0 legacy=0x7efe24054a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:26.755 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.743+0000 7efe21ffb640 1 -- 10.20.193.110:0/3434184524 >> v1:10.20.193.110:6789/0 conn(0x7efe2408e050 legacy=0x7efe24054330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:26.755 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.743+0000 7efe21ffb640 10 monclient: _finish_hunting 0 2026-02-13T20:11:26.755 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.743+0000 7efe21ffb640 1 monclient: found mon.noname-b 2026-02-13T20:11:26.755 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.743+0000 7efe21ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:26.755 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.743+0000 7efe21ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:11:26.755 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.743+0000 7efe21ffb640 1 -- 10.20.193.110:0/3434184524 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe2405dd60 con 0x7efe2408e420 2026-02-13T20:11:26.755 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.743+0000 7efe21ffb640 10 monclient: _finish_auth 0 2026-02-13T20:11:26.755 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.743+0000 7efe21ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:11:26.755 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.743+0000 7efe21ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:26.755 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.743+0000 7efe21ffb640 1 -- 10.20.193.110:0/3434184524 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7efe14003eb0 con 0x7efe2408e420 2026-02-13T20:11:26.756 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.743+0000 7efe21ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:26.756 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.743+0000 7efe21ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:11:26.756 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.743+0000 7efe21ffb640 10 monclient: dump: 2026-02-13T20:11:26.756 INFO:teuthology.misc.health.trial110.stderr:epoch 1 2026-02-13T20:11:26.756 INFO:teuthology.misc.health.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:26.756 INFO:teuthology.misc.health.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:26.756 INFO:teuthology.misc.health.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:26.756 INFO:teuthology.misc.health.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:26.756 INFO:teuthology.misc.health.trial110.stderr:election_strategy: 3 2026-02-13T20:11:26.756 INFO:teuthology.misc.health.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:26.756 INFO:teuthology.misc.health.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:26.756 INFO:teuthology.misc.health.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:26.756 INFO:teuthology.misc.health.trial110.stderr: 2026-02-13T20:11:26.757 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.743+0000 7efe293ae640 5 monclient: authenticate success, global_id 4208 2026-02-13T20:11:26.757 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.743+0000 7efe293ae640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:26.757 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.743+0000 7efe21ffb640 1 -- 10.20.193.110:0/3434184524 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efe14004100 con 0x7efe2408e420 2026-02-13T20:11:26.757 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.743+0000 7efe21ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:26.757 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.743+0000 7efe21ffb640 1 -- 10.20.193.110:0/3434184524 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7efe14004510 con 0x7efe2408e420 2026-02-13T20:11:26.757 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.743+0000 7efe293ae640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:26.757 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.743+0000 7efe293ae640 4 set_mon_vals no callback set 2026-02-13T20:11:26.757 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.743+0000 7efe21ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:26.757 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.743+0000 7efe21ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:26.757 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.743+0000 7efe21ffb640 10 monclient: dump: 2026-02-13T20:11:26.757 INFO:teuthology.misc.health.trial110.stderr:epoch 1 2026-02-13T20:11:26.757 INFO:teuthology.misc.health.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:26.758 INFO:teuthology.misc.health.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:26.758 INFO:teuthology.misc.health.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:26.758 INFO:teuthology.misc.health.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:26.758 INFO:teuthology.misc.health.trial110.stderr:election_strategy: 3 2026-02-13T20:11:26.758 INFO:teuthology.misc.health.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:26.758 INFO:teuthology.misc.health.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:26.758 INFO:teuthology.misc.health.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:26.758 INFO:teuthology.misc.health.trial110.stderr: 2026-02-13T20:11:26.758 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.744+0000 7efe293ae640 10 monclient: shutdown 2026-02-13T20:11:26.758 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.744+0000 7efe293ae640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:26.758 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.744+0000 7efe293ae640 1 -- 10.20.193.110:0/3434184524 >> v1:10.20.193.110:6790/0 conn(0x7efe2408e420 legacy=0x7efe241a5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:26.758 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.744+0000 7efe293ae640 1 -- 10.20.193.110:0/3434184524 shutdown_connections 2026-02-13T20:11:26.759 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.744+0000 7efe293ae640 1 -- 10.20.193.110:0/3434184524 >> 10.20.193.110:0/3434184524 conn(0x7efe24091e60 msgr2=0x7efe24092410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:26.759 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.744+0000 7efe293ae640 1 -- 10.20.193.110:0/3434184524 shutdown_connections 2026-02-13T20:11:26.759 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.744+0000 7efe293ae640 1 -- 10.20.193.110:0/3434184524 wait complete. 2026-02-13T20:11:26.759 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.744+0000 7efe293ae640 10 monclient: build_initial_monmap 2026-02-13T20:11:26.759 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.744+0000 7efe293ae640 10 monclient: monmap: 2026-02-13T20:11:26.759 INFO:teuthology.misc.health.trial110.stderr:epoch 0 2026-02-13T20:11:26.759 INFO:teuthology.misc.health.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:26.759 INFO:teuthology.misc.health.trial110.stderr:last_changed 0.000000 2026-02-13T20:11:26.759 INFO:teuthology.misc.health.trial110.stderr:created 0.000000 2026-02-13T20:11:26.759 INFO:teuthology.misc.health.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:26.759 INFO:teuthology.misc.health.trial110.stderr:election_strategy: 1 2026-02-13T20:11:26.759 INFO:teuthology.misc.health.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:26.759 INFO:teuthology.misc.health.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:26.760 INFO:teuthology.misc.health.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:26.760 INFO:teuthology.misc.health.trial110.stderr: 2026-02-13T20:11:26.760 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.744+0000 7efe293ae640 1 Processor -- start 2026-02-13T20:11:26.760 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.744+0000 7efe293ae640 1 -- start start 2026-02-13T20:11:26.760 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.744+0000 7efe293ae640 10 monclient: init 2026-02-13T20:11:26.760 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.744+0000 7efe293ae640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:26.760 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.744+0000 7efe293ae640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:11:26.760 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe293ae640 10 monclient(hunting): picked mon.noname-c con 0x7efe2408e050 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:26.760 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe293ae640 10 monclient(hunting): picked mon.noname-a con 0x7efe2408e420 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:26.760 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe293ae640 10 monclient(hunting): picked mon.noname-b con 0x7efe241424d0 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:26.760 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe293ae640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe2412ce90 con 0x7efe2408e420 2026-02-13T20:11:26.760 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe293ae640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe2412d170 con 0x7efe241424d0 2026-02-13T20:11:26.760 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe293ae640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe24089600 con 0x7efe2408e050 2026-02-13T20:11:26.761 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe293ae640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:26.761 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe293ae640 10 monclient(hunting): authenticate will time out at 648.435039s 2026-02-13T20:11:26.761 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe22ffd640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7efe2408e050 0x7efe241293f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:34224/0 (socket says 10.20.193.110:34224) 2026-02-13T20:11:26.761 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe22ffd640 1 -- 10.20.193.110:0/3103069997 learned_addr learned my addr 10.20.193.110:0/3103069997 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:26.761 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe037fe640 1 -- 10.20.193.110:0/3103069997 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3421275940 0 0) 0x7efe24089600 con 0x7efe2408e050 2026-02-13T20:11:26.761 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe037fe640 10 monclient(hunting): _negotiate 2026-02-13T20:11:26.761 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe037fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:26.761 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe037fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:26.761 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe037fe640 10 monclient(hunting): my global_id is 4211 2026-02-13T20:11:26.761 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe037fe640 1 -- 10.20.193.110:0/3103069997 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efdf00035e0 con 0x7efe2408e050 2026-02-13T20:11:26.761 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe037fe640 1 -- 10.20.193.110:0/3103069997 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2633394254 0 0) 0x7efe2412ce90 con 0x7efe2408e420 2026-02-13T20:11:26.761 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe037fe640 10 monclient(hunting): _negotiate 2026-02-13T20:11:26.762 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe037fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:26.762 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe037fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:26.762 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe037fe640 10 monclient(hunting): my global_id is 4215 2026-02-13T20:11:26.762 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe037fe640 1 -- 10.20.193.110:0/3103069997 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe24089600 con 0x7efe2408e420 2026-02-13T20:11:26.762 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe037fe640 1 -- 10.20.193.110:0/3103069997 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2618776231 0 0) 0x7efe24089600 con 0x7efe2408e420 2026-02-13T20:11:26.762 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe037fe640 1 -- 10.20.193.110:0/3103069997 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efe2412ce90 con 0x7efe2408e420 2026-02-13T20:11:26.762 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe037fe640 1 -- 10.20.193.110:0/3103069997 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7efe0c003070 con 0x7efe2408e420 2026-02-13T20:11:26.762 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe037fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:26.762 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe037fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:11:26.762 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe037fe640 10 monclient(hunting): dump: 2026-02-13T20:11:26.762 INFO:teuthology.misc.health.trial110.stderr:epoch 1 2026-02-13T20:11:26.762 INFO:teuthology.misc.health.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:26.762 INFO:teuthology.misc.health.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:26.763 INFO:teuthology.misc.health.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:26.763 INFO:teuthology.misc.health.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:26.763 INFO:teuthology.misc.health.trial110.stderr:election_strategy: 3 2026-02-13T20:11:26.763 INFO:teuthology.misc.health.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:26.763 INFO:teuthology.misc.health.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:26.763 INFO:teuthology.misc.health.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:26.763 INFO:teuthology.misc.health.trial110.stderr: 2026-02-13T20:11:26.763 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe037fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:26.763 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe037fe640 1 -- 10.20.193.110:0/3103069997 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3130268207 0 0) 0x7efe2412d170 con 0x7efe241424d0 2026-02-13T20:11:26.763 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe037fe640 10 monclient(hunting): _negotiate 2026-02-13T20:11:26.763 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe037fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:26.763 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe037fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:26.763 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe037fe640 10 monclient(hunting): my global_id is 4219 2026-02-13T20:11:26.764 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe037fe640 1 -- 10.20.193.110:0/3103069997 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe24089600 con 0x7efe241424d0 2026-02-13T20:11:26.764 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe037fe640 1 -- 10.20.193.110:0/3103069997 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3876995528 0 0) 0x7efdf00035e0 con 0x7efe2408e050 2026-02-13T20:11:26.764 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe037fe640 1 -- 10.20.193.110:0/3103069997 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efe2412d170 con 0x7efe2408e050 2026-02-13T20:11:26.764 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe037fe640 1 -- 10.20.193.110:0/3103069997 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7efe18003010 con 0x7efe2408e050 2026-02-13T20:11:26.764 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe037fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:26.764 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe037fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:26.764 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe037fe640 10 monclient(hunting): dump: 2026-02-13T20:11:26.764 INFO:teuthology.misc.health.trial110.stderr:epoch 1 2026-02-13T20:11:26.764 INFO:teuthology.misc.health.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:26.764 INFO:teuthology.misc.health.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:26.764 INFO:teuthology.misc.health.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:26.765 INFO:teuthology.misc.health.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:26.765 INFO:teuthology.misc.health.trial110.stderr:election_strategy: 3 2026-02-13T20:11:26.765 INFO:teuthology.misc.health.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:26.765 INFO:teuthology.misc.health.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:26.765 INFO:teuthology.misc.health.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:26.765 INFO:teuthology.misc.health.trial110.stderr: 2026-02-13T20:11:26.765 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe037fe640 1 -- 10.20.193.110:0/3103069997 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3344206346 0 0) 0x7efe2412ce90 con 0x7efe2408e420 2026-02-13T20:11:26.765 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe037fe640 1 -- 10.20.193.110:0/3103069997 >> v1:10.20.193.110:6790/0 conn(0x7efe2408e050 legacy=0x7efe241293f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:26.765 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe037fe640 1 -- 10.20.193.110:0/3103069997 >> v1:10.20.193.188:6789/0 conn(0x7efe241424d0 legacy=0x7efe24116b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:26.766 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe037fe640 10 monclient: _finish_hunting 0 2026-02-13T20:11:26.766 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe037fe640 1 monclient: found mon.a 2026-02-13T20:11:26.766 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe037fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:26.766 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe037fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:26.766 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe037fe640 1 -- 10.20.193.110:0/3103069997 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe2412a6a0 con 0x7efe2408e420 2026-02-13T20:11:26.766 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe037fe640 10 monclient: _finish_auth 0 2026-02-13T20:11:26.766 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe037fe640 10 monclient: _check_auth_tickets 2026-02-13T20:11:26.766 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe037fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:26.766 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe293ae640 5 monclient: authenticate success, global_id 4215 2026-02-13T20:11:26.766 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe293ae640 10 monclient: _renew_subs 2026-02-13T20:11:26.766 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe293ae640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:26.766 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe293ae640 1 -- 10.20.193.110:0/3103069997 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7efe2412c300 con 0x7efe2408e420 2026-02-13T20:11:26.767 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe293ae640 10 monclient: _renew_subs 2026-02-13T20:11:26.767 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe293ae640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:26.767 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe293ae640 1 -- 10.20.193.110:0/3103069997 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7efe2412a210 con 0x7efe2408e420 2026-02-13T20:11:26.767 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe037fe640 1 -- 10.20.193.110:0/3103069997 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efe0c003240 con 0x7efe2408e420 2026-02-13T20:11:26.767 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe037fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:26.767 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe037fe640 1 -- 10.20.193.110:0/3103069997 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7efe0c003940 con 0x7efe2408e420 2026-02-13T20:11:26.767 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe037fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:26.767 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe037fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:26.767 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe037fe640 10 monclient: dump: 2026-02-13T20:11:26.767 INFO:teuthology.misc.health.trial110.stderr:epoch 1 2026-02-13T20:11:26.767 INFO:teuthology.misc.health.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:26.767 INFO:teuthology.misc.health.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:26.767 INFO:teuthology.misc.health.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:26.768 INFO:teuthology.misc.health.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:26.768 INFO:teuthology.misc.health.trial110.stderr:election_strategy: 3 2026-02-13T20:11:26.768 INFO:teuthology.misc.health.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:26.768 INFO:teuthology.misc.health.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:26.768 INFO:teuthology.misc.health.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:26.768 INFO:teuthology.misc.health.trial110.stderr: 2026-02-13T20:11:26.768 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe217fa640 4 set_mon_vals no callback set 2026-02-13T20:11:26.768 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe293ae640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:26.768 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe293ae640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:26.768 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.745+0000 7efe293ae640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:26.768 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.746+0000 7efe293ae640 1 -- 10.20.193.110:0/3103069997 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe2412ca70 con 0x7efe2408e420 2026-02-13T20:11:26.768 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.746+0000 7efe037fe640 1 -- 10.20.193.110:0/3103069997 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7efe0c003aa0 con 0x7efe2408e420 2026-02-13T20:11:26.769 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.746+0000 7efe037fe640 1 -- 10.20.193.110:0/3103069997 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(15..15 src has 1..15) ==== 3147+0+0 (unknown 2819987017 0 0) 0x7efe0c04d490 con 0x7efe2408e420 2026-02-13T20:11:26.769 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.746+0000 7efe22ffd640 10 monclient: get_auth_request con 0x7efdf003fcc0 auth_method 0 2026-02-13T20:11:26.769 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.748+0000 7efe037fe640 1 -- 10.20.193.110:0/3103069997 <== mon.0 v1:10.20.193.110:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7efe0c015ee0 con 0x7efe2408e420 2026-02-13T20:11:26.769 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.748+0000 7efe037fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:26.769 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.748+0000 7efe037fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:11:26.854 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.853+0000 7efe293ae640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-13T20:11:26.854 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.853+0000 7efe293ae640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-13T20:11:26.855 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.853+0000 7efe293ae640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:26.855 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.853+0000 7efe293ae640 1 -- 10.20.193.110:0/3103069997 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efe24055480 con 0x7efe2408e420 2026-02-13T20:11:26.855 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.853+0000 7efe037fe640 1 -- 10.20.193.110:0/3103069997 <== mon.0 v1:10.20.193.110:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+9104 (unknown 4221056075 0 2085348416) 0x7efe0c013e70 con 0x7efe2408e420 2026-02-13T20:11:26.855 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.853+0000 7efe037fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-13T20:11:26.855 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.853+0000 7efe037fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:11:26.855 INFO:teuthology.misc.health.trial110.stdout: 2026-02-13T20:11:26.856 INFO:teuthology.misc.health.trial110.stdout:{"epoch":15,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","created":"2026-02-13T20:11:18.047609+0000","modified":"2026-02-13T20:11:26.262688+0000","last_up_change":"2026-02-13T20:11:22.252754+0000","last_in_change":"2026-02-13T20:11:19.250528+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T20:11:24.136325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88457b09-7bbe-4ebe-8a8b-4c980153af2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6808","nonce":2638069221}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6809","nonce":2638069221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6811","nonce":2638069221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6810","nonce":2638069221}]},"public_addr":"10.20.193.110:6808/2638069221","cluster_addr":"10.20.193.110:6809/2638069221","heartbeat_back_addr":"10.20.193.110:6811/2638069221","heartbeat_front_addr":"10.20.193.110:6810/2638069221","state":["exists","up"]},{"osd":1,"uuid":"efb2f419-77ef-44b0-ae26-4c448073556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6800","nonce":3182322764}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6801","nonce":3182322764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6803","nonce":3182322764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6802","nonce":3182322764}]},"public_addr":"10.20.193.110:6800/3182322764","cluster_addr":"10.20.193.110:6801/3182322764","heartbeat_back_addr":"10.20.193.110:6803/3182322764","heartbeat_front_addr":"10.20.193.110:6802/3182322764","state":["exists","up"]},{"osd":2,"uuid":"c5a08402-8e10-4d4d-87fe-6236a6766128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6804","nonce":2437753968}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6805","nonce":2437753968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6807","nonce":2437753968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6806","nonce":2437753968}]},"public_addr":"10.20.193.110:6804/2437753968","cluster_addr":"10.20.193.110:6805/2437753968","heartbeat_back_addr":"10.20.193.110:6807/2437753968","heartbeat_front_addr":"10.20.193.110:6806/2437753968","state":["exists","up"]},{"osd":3,"uuid":"3062e357-c62b-4a5d-a4b2-9715c16cfd37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6800","nonce":3648478668}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6801","nonce":3648478668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6803","nonce":3648478668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6802","nonce":3648478668}]},"public_addr":"10.20.193.188:6800/3648478668","cluster_addr":"10.20.193.188:6801/3648478668","heartbeat_back_addr":"10.20.193.188:6803/3648478668","heartbeat_front_addr":"10.20.193.188:6802/3648478668","state":["exists","up"]},{"osd":4,"uuid":"718e9755-3c16-47c8-9df8-c08e4193063d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6804","nonce":1615982170}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6806","nonce":1615982170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6810","nonce":1615982170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6808","nonce":1615982170}]},"public_addr":"10.20.193.188:6804/1615982170","cluster_addr":"10.20.193.188:6806/1615982170","heartbeat_back_addr":"10.20.193.188:6810/1615982170","heartbeat_front_addr":"10.20.193.188:6808/1615982170","state":["exists","up"]},{"osd":5,"uuid":"1508f970-10c7-486a-96d1-76881e826af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6805","nonce":4130810301}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6807","nonce":4130810301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6811","nonce":4130810301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6809","nonce":4130810301}]},"public_addr":"10.20.193.188:6805/4130810301","cluster_addr":"10.20.193.188:6807/4130810301","heartbeat_back_addr":"10.20.193.188:6811/4130810301","heartbeat_front_addr":"10.20.193.188:6809/4130810301","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T20:11:20.798845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T20:11:20.817774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T20:11:20.860524+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T20:11:20.994431+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T20:11:20.970325+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T20:11:21.011291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T20:11:26.856 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.854+0000 7efe293ae640 1 -- 10.20.193.110:0/3103069997 >> v1:10.20.193.188:6812/1623052694 conn(0x7efdf003fcc0 legacy=0x7efdf0060170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:26.857 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.854+0000 7efe293ae640 10 monclient: shutdown 2026-02-13T20:11:26.857 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.854+0000 7efe293ae640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:26.857 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.854+0000 7efe293ae640 1 -- 10.20.193.110:0/3103069997 >> v1:10.20.193.110:6789/0 conn(0x7efe2408e420 legacy=0x7efe24129b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:26.857 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.854+0000 7efe293ae640 1 -- 10.20.193.110:0/3103069997 shutdown_connections 2026-02-13T20:11:26.857 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.854+0000 7efe293ae640 1 -- 10.20.193.110:0/3103069997 >> 10.20.193.110:0/3103069997 conn(0x7efe24091e60 msgr2=0x7efe24089bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:26.857 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.854+0000 7efe293ae640 1 -- 10.20.193.110:0/3103069997 shutdown_connections 2026-02-13T20:11:26.857 INFO:teuthology.misc.health.trial110.stderr:2026-02-13T20:11:26.854+0000 7efe293ae640 1 -- 10.20.193.110:0/3103069997 wait complete. 2026-02-13T20:11:26.862 DEBUG:teuthology.misc:6 of 6 OSDs are up 2026-02-13T20:11:26.862 INFO:tasks.ceph:Creating RBD pool 2026-02-13T20:11:26.862 DEBUG:teuthology.orchestra.run.trial110:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-13T20:11:26.933 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.925+0000 7fb00b847640 10 monclient: get_monmap_and_config 2026-02-13T20:11:26.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.925+0000 7fb00b847640 10 monclient: build_initial_monmap 2026-02-13T20:11:26.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.925+0000 7fb00b847640 10 monclient: monmap: 2026-02-13T20:11:26.934 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:26.934 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:26.934 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:26.926107+0000 2026-02-13T20:11:26.934 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:26.926107+0000 2026-02-13T20:11:26.934 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:26.934 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:26.935 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:26.935 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:26.935 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:26.935 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:26.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.926+0000 7fb00b847640 1 Processor -- start 2026-02-13T20:11:26.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.926+0000 7fb00b847640 1 -- start start 2026-02-13T20:11:26.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.926+0000 7fb00b847640 10 monclient: init 2026-02-13T20:11:26.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.926+0000 7fb00b847640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:26.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.926+0000 7fb00b847640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:11:26.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.926+0000 7fb00b847640 10 monclient(hunting): picked mon.noname-c con 0x7fb0041401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:26.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.926+0000 7fb00b847640 10 monclient(hunting): picked mon.noname-a con 0x7fb004092020 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:26.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.926+0000 7fb00b847640 10 monclient(hunting): picked mon.noname-b con 0x7fb004091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:26.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.926+0000 7fb00b847640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb00408b730 con 0x7fb004092020 2026-02-13T20:11:26.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.926+0000 7fb00b847640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb00405c5b0 con 0x7fb0041401c0 2026-02-13T20:11:26.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.926+0000 7fb00b847640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb00408bcf0 con 0x7fb004091950 2026-02-13T20:11:26.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.926+0000 7fb00b847640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:26.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.926+0000 7fb00b847640 10 monclient(hunting): authenticate will time out at 648.616461s 2026-02-13T20:11:26.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.926+0000 7fb009dbd640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fb004091950 0x7fb0041a2a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:34226/0 (socket says 10.20.193.110:34226) 2026-02-13T20:11:26.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.926+0000 7fb009dbd640 1 -- 10.20.193.110:0/1500498745 learned_addr learned my addr 10.20.193.110:0/1500498745 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:26.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.926+0000 7fb008dbb640 1 --1- 10.20.193.110:0/1500498745 >> v1:10.20.193.110:6789/0 conn(0x7fb004092020 0x7fb0041812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:44470/0 (socket says 10.20.193.110:44470) 2026-02-13T20:11:26.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.926+0000 7faff3fff640 1 -- 10.20.193.110:0/1500498745 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 569147581 0 0) 0x7fb00408bcf0 con 0x7fb004091950 2026-02-13T20:11:26.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.926+0000 7faff3fff640 10 monclient(hunting): _negotiate 2026-02-13T20:11:26.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.926+0000 7faff3fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:26.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.926+0000 7faff3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:26.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.926+0000 7faff3fff640 10 monclient(hunting): my global_id is 4214 2026-02-13T20:11:26.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.926+0000 7faff3fff640 1 -- 10.20.193.110:0/1500498745 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafec0035e0 con 0x7fb004091950 2026-02-13T20:11:26.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.926+0000 7faff3fff640 1 -- 10.20.193.110:0/1500498745 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2857328896 0 0) 0x7fb00408b730 con 0x7fb004092020 2026-02-13T20:11:26.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.926+0000 7faff3fff640 10 monclient(hunting): _negotiate 2026-02-13T20:11:26.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.926+0000 7faff3fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:26.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.926+0000 7faff3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:26.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.926+0000 7faff3fff640 10 monclient(hunting): my global_id is 4218 2026-02-13T20:11:26.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.926+0000 7faff3fff640 1 -- 10.20.193.110:0/1500498745 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb00408bcf0 con 0x7fb004092020 2026-02-13T20:11:26.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.926+0000 7faff3fff640 1 -- 10.20.193.110:0/1500498745 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3392223554 0 0) 0x7fafec0035e0 con 0x7fb004091950 2026-02-13T20:11:26.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.926+0000 7faff3fff640 1 -- 10.20.193.110:0/1500498745 >> v1:10.20.193.188:6789/0 conn(0x7fb0041401c0 legacy=0x7fb004091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:26.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.927+0000 7faff3fff640 1 -- 10.20.193.110:0/1500498745 >> v1:10.20.193.110:6789/0 conn(0x7fb004092020 legacy=0x7fb0041812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:26.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.927+0000 7faff3fff640 10 monclient: _finish_hunting 0 2026-02-13T20:11:26.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.927+0000 7faff3fff640 1 monclient: found mon.noname-b 2026-02-13T20:11:26.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.927+0000 7faff3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:26.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.927+0000 7faff3fff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:11:26.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.927+0000 7faff3fff640 1 -- 10.20.193.110:0/1500498745 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb004140590 con 0x7fb004091950 2026-02-13T20:11:26.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.927+0000 7faff3fff640 10 monclient: _finish_auth 0 2026-02-13T20:11:26.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.927+0000 7faff3fff640 10 monclient: _check_auth_tickets 2026-02-13T20:11:26.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.927+0000 7faff3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:26.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.927+0000 7faff3fff640 1 -- 10.20.193.110:0/1500498745 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb000003eb0 con 0x7fb004091950 2026-02-13T20:11:26.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.927+0000 7fb00b847640 5 monclient: authenticate success, global_id 4214 2026-02-13T20:11:26.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.927+0000 7fb00b847640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:26.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.927+0000 7faff3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:26.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.927+0000 7faff3fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:11:26.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.927+0000 7faff3fff640 10 monclient: dump: 2026-02-13T20:11:26.939 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:26.939 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:26.939 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:26.939 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:26.939 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:26.939 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:26.939 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:26.939 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:26.939 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:26.939 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:26.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.927+0000 7fb00b847640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:26.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.927+0000 7faff3fff640 1 -- 10.20.193.110:0/1500498745 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb000004040 con 0x7fb004091950 2026-02-13T20:11:26.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.927+0000 7faff3fff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:26.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.927+0000 7fb00b847640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:26.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.927+0000 7faff3fff640 1 -- 10.20.193.110:0/1500498745 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb000004450 con 0x7fb004091950 2026-02-13T20:11:26.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.927+0000 7fb00b847640 4 set_mon_vals no callback set 2026-02-13T20:11:26.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.927+0000 7faff3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:26.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.927+0000 7faff3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:26.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.927+0000 7faff3fff640 10 monclient: dump: 2026-02-13T20:11:26.940 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:26.940 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:26.940 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:26.940 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:26.940 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:26.940 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:26.940 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:26.941 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:26.941 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:26.941 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:26.941 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.927+0000 7fb00b847640 10 monclient: shutdown 2026-02-13T20:11:26.941 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.927+0000 7fb00b847640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:26.941 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.927+0000 7fb00b847640 1 -- 10.20.193.110:0/1500498745 >> v1:10.20.193.110:6790/0 conn(0x7fb004091950 legacy=0x7fb0041a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:26.941 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.927+0000 7fb00b847640 1 -- 10.20.193.110:0/1500498745 shutdown_connections 2026-02-13T20:11:26.941 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.927+0000 7fb00b847640 1 -- 10.20.193.110:0/1500498745 >> 10.20.193.110:0/1500498745 conn(0x7fb004054e90 msgr2=0x7fb004058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:26.941 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.927+0000 7fb00b847640 1 -- 10.20.193.110:0/1500498745 shutdown_connections 2026-02-13T20:11:26.941 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.927+0000 7fb00b847640 1 -- 10.20.193.110:0/1500498745 wait complete. 2026-02-13T20:11:26.941 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.927+0000 7fb00b847640 10 monclient: build_initial_monmap 2026-02-13T20:11:26.942 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.927+0000 7fb00b847640 10 monclient: monmap: 2026-02-13T20:11:26.942 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:26.942 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:26.942 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:11:26.942 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:11:26.942 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:26.942 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:11:26.942 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:26.942 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:26.943 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:26.943 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:26.943 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.927+0000 7fb00b847640 1 Processor -- start 2026-02-13T20:11:26.943 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7fb00b847640 1 -- start start 2026-02-13T20:11:26.943 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7fb00b847640 10 monclient: init 2026-02-13T20:11:26.943 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7fb00b847640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:26.943 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7fb00b847640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:11:26.943 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7fb00b847640 10 monclient(hunting): picked mon.noname-b con 0x7fb004091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:26.943 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7fb00b847640 10 monclient(hunting): picked mon.noname-a con 0x7fb0041401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:26.943 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7fb00b847640 10 monclient(hunting): picked mon.noname-c con 0x7fb0041139e0 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:26.943 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7fb00b847640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb00408c350 con 0x7fb0041401c0 2026-02-13T20:11:26.943 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7fb00b847640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb00412beb0 con 0x7fb004091950 2026-02-13T20:11:26.943 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7fb00b847640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb00405d320 con 0x7fb0041139e0 2026-02-13T20:11:26.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7fb00b847640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:26.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7fb00b847640 10 monclient(hunting): authenticate will time out at 648.618223s 2026-02-13T20:11:26.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7fb009dbd640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fb0041139e0 0x7fb0041a2760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:34230/0 (socket says 10.20.193.110:34230) 2026-02-13T20:11:26.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7fb009dbd640 1 -- 10.20.193.110:0/2866650517 learned_addr learned my addr 10.20.193.110:0/2866650517 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:26.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7faff1ffb640 1 -- 10.20.193.110:0/2866650517 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2476880499 0 0) 0x7fb00405d320 con 0x7fb0041139e0 2026-02-13T20:11:26.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7faff1ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:11:26.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7faff1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:26.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7faff1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:26.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7faff1ffb640 10 monclient(hunting): my global_id is 4217 2026-02-13T20:11:26.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7faff1ffb640 1 -- 10.20.193.110:0/2866650517 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafd40035e0 con 0x7fb0041139e0 2026-02-13T20:11:26.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7faff1ffb640 1 -- 10.20.193.110:0/2866650517 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 878842234 0 0) 0x7fb00408c350 con 0x7fb0041401c0 2026-02-13T20:11:26.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7faff1ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:11:26.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7faff1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:26.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7faff1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:26.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7faff1ffb640 10 monclient(hunting): my global_id is 4221 2026-02-13T20:11:26.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7faff1ffb640 1 -- 10.20.193.110:0/2866650517 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb00405d320 con 0x7fb0041401c0 2026-02-13T20:11:26.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7faff1ffb640 1 -- 10.20.193.110:0/2866650517 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1284965053 0 0) 0x7fafd40035e0 con 0x7fb0041139e0 2026-02-13T20:11:26.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7faff1ffb640 1 -- 10.20.193.110:0/2866650517 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb00408c350 con 0x7fb0041139e0 2026-02-13T20:11:26.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7faff1ffb640 1 -- 10.20.193.110:0/2866650517 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb000004360 con 0x7fb0041139e0 2026-02-13T20:11:26.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7faff1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:26.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7faff1ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:11:26.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7faff1ffb640 10 monclient(hunting): dump: 2026-02-13T20:11:26.945 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:26.945 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:26.945 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:26.946 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:26.946 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:26.946 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:26.946 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:26.946 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:26.946 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:26.946 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:26.946 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7faff1ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:26.946 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7faff1ffb640 1 -- 10.20.193.110:0/2866650517 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2350989484 0 0) 0x7fb00408c350 con 0x7fb0041139e0 2026-02-13T20:11:26.946 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7faff1ffb640 1 -- 10.20.193.110:0/2866650517 >> v1:10.20.193.188:6789/0 conn(0x7fb004091950 legacy=0x7fb0041132d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:26.946 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7faff1ffb640 1 -- 10.20.193.110:0/2866650517 >> v1:10.20.193.110:6789/0 conn(0x7fb0041401c0 legacy=0x7fb0041a1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:26.946 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7faff1ffb640 10 monclient: _finish_hunting 0 2026-02-13T20:11:26.946 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7faff1ffb640 1 monclient: found mon.c 2026-02-13T20:11:26.947 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7faff1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:26.947 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7faff1ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:26.947 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7faff1ffb640 1 -- 10.20.193.110:0/2866650517 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb00412a3f0 con 0x7fb0041139e0 2026-02-13T20:11:26.947 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7faff1ffb640 10 monclient: _finish_auth 0 2026-02-13T20:11:26.947 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7faff1ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:11:26.947 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7faff1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:26.947 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7fb00b847640 5 monclient: authenticate success, global_id 4217 2026-02-13T20:11:26.947 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7fb00b847640 10 monclient: _renew_subs 2026-02-13T20:11:26.947 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7fb00b847640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:26.947 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7fb00b847640 1 -- 10.20.193.110:0/2866650517 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb00412c750 con 0x7fb0041139e0 2026-02-13T20:11:26.947 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7fb00b847640 10 monclient: _renew_subs 2026-02-13T20:11:26.947 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7fb00b847640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:26.947 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7fb00b847640 1 -- 10.20.193.110:0/2866650517 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fb0041299d0 con 0x7fb0041139e0 2026-02-13T20:11:26.948 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7faff1ffb640 1 -- 10.20.193.110:0/2866650517 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb000003a30 con 0x7fb0041139e0 2026-02-13T20:11:26.948 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7faff1ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:26.948 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7faff1ffb640 1 -- 10.20.193.110:0/2866650517 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb000005e60 con 0x7fb0041139e0 2026-02-13T20:11:26.948 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7faff1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:26.948 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7faff1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:26.948 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7faff1ffb640 10 monclient: dump: 2026-02-13T20:11:26.948 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:26.948 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:26.948 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:26.948 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:26.948 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:26.948 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:26.948 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:26.949 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:26.949 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:26.949 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:26.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.928+0000 7faff37fe640 4 set_mon_vals no callback set 2026-02-13T20:11:26.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.929+0000 7fb00b847640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:26.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.929+0000 7fb00b847640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:26.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.929+0000 7fb00b847640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:26.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.929+0000 7fb00b847640 1 -- 10.20.193.110:0/2866650517 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb004124c10 con 0x7fb0041139e0 2026-02-13T20:11:26.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.929+0000 7faff1ffb640 1 -- 10.20.193.110:0/2866650517 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fb000005fc0 con 0x7fb0041139e0 2026-02-13T20:11:26.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.929+0000 7faff1ffb640 1 -- 10.20.193.110:0/2866650517 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(15..15 src has 1..15) ==== 3147+0+0 (unknown 2819987017 0 0) 0x7fb00004f770 con 0x7fb0041139e0 2026-02-13T20:11:26.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.929+0000 7fb0095bc640 10 monclient: get_auth_request con 0x7fafd403f850 auth_method 0 2026-02-13T20:11:26.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.932+0000 7faff1ffb640 1 -- 10.20.193.110:0/2866650517 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fb000018330 con 0x7fb0041139e0 2026-02-13T20:11:26.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.932+0000 7faff1ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:26.950 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:26.932+0000 7faff1ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:11:27.041 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.038+0000 7fb00b847640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-13T20:11:27.041 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.039+0000 7fb00b847640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-13T20:11:27.041 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.039+0000 7fb00b847640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:27.041 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.039+0000 7fb00b847640 1 -- 10.20.193.110:0/2866650517 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7fb004055bb0 con 0x7fb0041139e0 2026-02-13T20:11:27.555 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.552+0000 7faff1ffb640 1 -- 10.20.193.110:0/2866650517 <== mon.2 v1:10.20.193.110:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v16) ==== 109+0+0 (unknown 231814880 0 0) 0x7fb000017ae0 con 0x7fb0041139e0 2026-02-13T20:11:27.555 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.552+0000 7faff1ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-13T20:11:27.555 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.552+0000 7faff1ffb640 10 monclient: _finish_command 2 = system:0 pool 'rbd' created 2026-02-13T20:11:27.555 INFO:teuthology.orchestra.run.trial110.stderr:pool 'rbd' created 2026-02-13T20:11:27.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.555+0000 7fb00b847640 1 -- 10.20.193.110:0/2866650517 >> v1:10.20.193.188:6812/1623052694 conn(0x7fafd403f850 legacy=0x7fafd405fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:27.558 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.555+0000 7fb00b847640 10 monclient: shutdown 2026-02-13T20:11:27.558 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.555+0000 7fb00b847640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:27.558 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.555+0000 7fb00b847640 1 -- 10.20.193.110:0/2866650517 >> v1:10.20.193.110:6790/0 conn(0x7fb0041139e0 legacy=0x7fb0041a2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:27.558 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.555+0000 7fb00b847640 1 -- 10.20.193.110:0/2866650517 shutdown_connections 2026-02-13T20:11:27.558 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.555+0000 7fb00b847640 1 -- 10.20.193.110:0/2866650517 >> 10.20.193.110:0/2866650517 conn(0x7fb004054e90 msgr2=0x7fb004123d40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:27.558 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.555+0000 7fb00b847640 1 -- 10.20.193.110:0/2866650517 shutdown_connections 2026-02-13T20:11:27.558 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.555+0000 7fb00b847640 1 -- 10.20.193.110:0/2866650517 wait complete. 2026-02-13T20:11:27.565 DEBUG:teuthology.orchestra.run.trial110:> rbd --cluster ceph pool init rbd 2026-02-13T20:11:27.598 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.596+0000 7f1e9d8f4240 10 monclient: get_monmap_and_config 2026-02-13T20:11:27.598 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.596+0000 7f1e9d8f4240 10 monclient: build_initial_monmap 2026-02-13T20:11:27.598 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.596+0000 7f1e9d8f4240 10 monclient: monmap: 2026-02-13T20:11:27.598 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:27.598 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:27.598 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:27.597522+0000 2026-02-13T20:11:27.598 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:27.597522+0000 2026-02-13T20:11:27.598 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:27.598 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:27.598 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:27.598 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:27.598 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:27.598 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:27.598 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.596+0000 7f1e9d8f4240 1 Processor -- start 2026-02-13T20:11:27.598 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.596+0000 7f1e9d8f4240 1 -- start start 2026-02-13T20:11:27.598 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.596+0000 7f1e9d8f4240 10 monclient: init 2026-02-13T20:11:27.598 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.596+0000 7f1e9d8f4240 10 monclient: _reopen_session rank -1 2026-02-13T20:11:27.598 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.596+0000 7f1e9d8f4240 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:11:27.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.596+0000 7f1e9d8f4240 10 monclient(hunting): picked mon.noname-b con 0x1644960 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:27.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.596+0000 7f1e9d8f4240 10 monclient(hunting): picked mon.noname-c con 0x1641480 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:27.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.596+0000 7f1e9d8f4240 10 monclient(hunting): picked mon.noname-a con 0x1645b70 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:27.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.596+0000 7f1e9d8f4240 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x1493920 con 0x1645b70 2026-02-13T20:11:27.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.596+0000 7f1e9d8f4240 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x14bdac0 con 0x1641480 2026-02-13T20:11:27.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.596+0000 7f1e9d8f4240 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x14a7490 con 0x1644960 2026-02-13T20:11:27.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.596+0000 7f1e9d8f4240 10 monclient(hunting): _renew_subs 2026-02-13T20:11:27.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.596+0000 7f1e9d8f4240 10 monclient(hunting): authenticate will time out at 649.287904s 2026-02-13T20:11:27.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9b9e1640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x1644960 0x1644d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:34238/0 (socket says 10.20.193.110:34238) 2026-02-13T20:11:27.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9b9e1640 1 -- 10.20.193.110:0/191043316 learned_addr learned my addr 10.20.193.110:0/191043316 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:27.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9a9df640 1 -- 10.20.193.110:0/191043316 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3512237417 0 0) 0x14a7490 con 0x1644960 2026-02-13T20:11:27.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9a9df640 10 monclient(hunting): _negotiate 2026-02-13T20:11:27.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9a9df640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:27.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9a9df640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:27.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9a9df640 10 monclient(hunting): my global_id is 4220 2026-02-13T20:11:27.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9a9df640 1 -- 10.20.193.110:0/191043316 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e88001e10 con 0x1644960 2026-02-13T20:11:27.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9a9df640 1 -- 10.20.193.110:0/191043316 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3399672953 0 0) 0x1493920 con 0x1645b70 2026-02-13T20:11:27.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9a9df640 10 monclient(hunting): _negotiate 2026-02-13T20:11:27.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9a9df640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:27.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9a9df640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:27.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9a9df640 10 monclient(hunting): my global_id is 4224 2026-02-13T20:11:27.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9a9df640 1 -- 10.20.193.110:0/191043316 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x14a7490 con 0x1645b70 2026-02-13T20:11:27.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9a9df640 1 -- 10.20.193.110:0/191043316 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1154864703 0 0) 0x14bdac0 con 0x1641480 2026-02-13T20:11:27.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9a9df640 10 monclient(hunting): _negotiate 2026-02-13T20:11:27.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9a9df640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:27.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9a9df640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:27.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9a9df640 10 monclient(hunting): my global_id is 4228 2026-02-13T20:11:27.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9a9df640 1 -- 10.20.193.110:0/191043316 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x1493920 con 0x1641480 2026-02-13T20:11:27.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9a9df640 1 -- 10.20.193.110:0/191043316 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 267010666 0 0) 0x7f1e88001e10 con 0x1644960 2026-02-13T20:11:27.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9a9df640 1 -- 10.20.193.110:0/191043316 >> v1:10.20.193.188:6789/0 conn(0x1641480 legacy=0x1737c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:27.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9a9df640 1 -- 10.20.193.110:0/191043316 >> v1:10.20.193.110:6789/0 conn(0x1645b70 legacy=0x1759340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:27.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9a9df640 10 monclient: _finish_hunting 0 2026-02-13T20:11:27.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9a9df640 1 monclient: found mon.noname-b 2026-02-13T20:11:27.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9a9df640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:27.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9a9df640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:11:27.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9a9df640 1 -- 10.20.193.110:0/191043316 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x14a1b50 con 0x1644960 2026-02-13T20:11:27.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9a9df640 10 monclient: _finish_auth 0 2026-02-13T20:11:27.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9a9df640 10 monclient: _check_auth_tickets 2026-02-13T20:11:27.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9a9df640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:27.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9a9df640 1 -- 10.20.193.110:0/191043316 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f1e90001600 con 0x1644960 2026-02-13T20:11:27.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9a9df640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:27.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9a9df640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:11:27.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9a9df640 10 monclient: dump: 2026-02-13T20:11:27.601 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:27.601 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:27.601 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:27.601 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:27.601 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:27.601 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:27.601 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:27.601 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:27.601 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:27.601 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:27.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9d8f4240 5 monclient: authenticate success, global_id 4220 2026-02-13T20:11:27.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9d8f4240 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:27.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9a9df640 1 -- 10.20.193.110:0/191043316 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1e90001880 con 0x1644960 2026-02-13T20:11:27.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9a9df640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:27.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9a9df640 1 -- 10.20.193.110:0/191043316 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f1e90001c90 con 0x1644960 2026-02-13T20:11:27.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9a9df640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:27.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9a9df640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:27.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9a9df640 10 monclient: dump: 2026-02-13T20:11:27.601 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:27.601 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:27.601 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:27.601 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:27.601 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:27.601 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:27.601 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:27.601 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:27.601 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:27.601 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:27.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9d8f4240 10 monclient: get_monmap_and_config success 2026-02-13T20:11:27.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9d8f4240 4 set_mon_vals no callback set 2026-02-13T20:11:27.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9d8f4240 10 monclient: shutdown 2026-02-13T20:11:27.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9d8f4240 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:27.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9d8f4240 1 -- 10.20.193.110:0/191043316 >> v1:10.20.193.110:6790/0 conn(0x1644960 legacy=0x1644d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:27.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9d8f4240 1 -- 10.20.193.110:0/191043316 shutdown_connections 2026-02-13T20:11:27.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9d8f4240 1 -- 10.20.193.110:0/191043316 >> 10.20.193.110:0/191043316 conn(0x1624420 msgr2=0x1624820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:27.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9d8f4240 1 -- 10.20.193.110:0/191043316 shutdown_connections 2026-02-13T20:11:27.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.597+0000 7f1e9d8f4240 1 -- 10.20.193.110:0/191043316 wait complete. 2026-02-13T20:11:27.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.598+0000 7f1e9d8f4240 10 monclient: build_initial_monmap 2026-02-13T20:11:27.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.598+0000 7f1e9d8f4240 10 monclient: monmap: 2026-02-13T20:11:27.602 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:27.602 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:27.602 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:11:27.602 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:11:27.602 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:27.602 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:11:27.602 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:27.602 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:27.602 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:27.602 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:27.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.598+0000 7f1e9d8f4240 1 Processor -- start 2026-02-13T20:11:27.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.598+0000 7f1e9d8f4240 1 -- start start 2026-02-13T20:11:27.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.598+0000 7f1e9d8f4240 10 monclient: init 2026-02-13T20:11:27.603 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.598+0000 7f1e9d8f4240 10 monclient: _reopen_session rank -1 2026-02-13T20:11:27.603 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.598+0000 7f1e9d8f4240 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:11:27.603 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.598+0000 7f1e9d8f4240 10 monclient(hunting): picked mon.noname-b con 0x1644960 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:27.603 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.598+0000 7f1e9d8f4240 10 monclient(hunting): picked mon.noname-a con 0x1645b70 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:27.603 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.598+0000 7f1e9d8f4240 10 monclient(hunting): picked mon.noname-c con 0x16c4360 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:27.603 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.598+0000 7f1e9d8f4240 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x1493c50 con 0x1645b70 2026-02-13T20:11:27.603 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.598+0000 7f1e9d8f4240 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x14a76f0 con 0x1644960 2026-02-13T20:11:27.603 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.598+0000 7f1e9d8f4240 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x16db580 con 0x16c4360 2026-02-13T20:11:27.604 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.598+0000 7f1e9d8f4240 10 monclient(hunting): _renew_subs 2026-02-13T20:11:27.604 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.598+0000 7f1e9d8f4240 10 monclient(hunting): authenticate will time out at 649.289829s 2026-02-13T20:11:27.604 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.598+0000 7f1e9b1e0640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x1645b70 0x16ca930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:44490/0 (socket says 10.20.193.110:44490) 2026-02-13T20:11:27.604 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.598+0000 7f1e9cc6a640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x16c4360 0x16cc050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:34252/0 (socket says 10.20.193.110:34252) 2026-02-13T20:11:27.604 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.598+0000 7f1e9b1e0640 1 -- 10.20.193.110:0/499587899 learned_addr learned my addr 10.20.193.110:0/499587899 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:27.604 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e83fff640 1 -- 10.20.193.110:0/499587899 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 106529335 0 0) 0x16db580 con 0x16c4360 2026-02-13T20:11:27.604 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e83fff640 10 monclient(hunting): _negotiate 2026-02-13T20:11:27.604 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e83fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:27.604 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e83fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:27.604 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e83fff640 10 monclient(hunting): my global_id is 4223 2026-02-13T20:11:27.604 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e83fff640 1 -- 10.20.193.110:0/499587899 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e7c001e10 con 0x16c4360 2026-02-13T20:11:27.604 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e83fff640 1 -- 10.20.193.110:0/499587899 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3172445632 0 0) 0x1493c50 con 0x1645b70 2026-02-13T20:11:27.604 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e83fff640 10 monclient(hunting): _negotiate 2026-02-13T20:11:27.604 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e83fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:27.604 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e83fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:27.604 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e83fff640 10 monclient(hunting): my global_id is 4227 2026-02-13T20:11:27.604 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e83fff640 1 -- 10.20.193.110:0/499587899 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x16db580 con 0x1645b70 2026-02-13T20:11:27.604 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e83fff640 1 -- 10.20.193.110:0/499587899 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3318759393 0 0) 0x7f1e7c001e10 con 0x16c4360 2026-02-13T20:11:27.604 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e83fff640 1 -- 10.20.193.110:0/499587899 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x1493c50 con 0x16c4360 2026-02-13T20:11:27.604 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e83fff640 1 -- 10.20.193.110:0/499587899 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f1e8c002da0 con 0x16c4360 2026-02-13T20:11:27.604 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e83fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:27.604 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e83fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:11:27.604 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e83fff640 10 monclient(hunting): dump: 2026-02-13T20:11:27.604 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:27.604 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:27.604 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:27.604 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:27.604 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:27.604 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:27.604 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:27.604 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:27.604 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:27.604 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:27.604 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e83fff640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:27.604 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e83fff640 1 -- 10.20.193.110:0/499587899 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3266019061 0 0) 0x16db580 con 0x1645b70 2026-02-13T20:11:27.604 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e83fff640 1 -- 10.20.193.110:0/499587899 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1e7c001e10 con 0x1645b70 2026-02-13T20:11:27.604 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e83fff640 1 -- 10.20.193.110:0/499587899 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f1e84001980 con 0x1645b70 2026-02-13T20:11:27.604 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e83fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:27.604 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e83fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:27.604 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e83fff640 10 monclient(hunting): dump: 2026-02-13T20:11:27.605 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:27.605 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:27.605 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:27.605 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:27.605 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:27.605 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:27.605 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:27.605 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:27.605 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:27.605 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:27.605 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e83fff640 1 -- 10.20.193.110:0/499587899 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 448307806 0 0) 0x1493c50 con 0x16c4360 2026-02-13T20:11:27.605 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e83fff640 1 -- 10.20.193.110:0/499587899 >> v1:10.20.193.188:6789/0 conn(0x1644960 legacy=0x16c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:27.605 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e83fff640 1 -- 10.20.193.110:0/499587899 >> v1:10.20.193.110:6789/0 conn(0x1645b70 legacy=0x16ca930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:27.605 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e83fff640 10 monclient: _finish_hunting 0 2026-02-13T20:11:27.605 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e83fff640 1 monclient: found mon.c 2026-02-13T20:11:27.605 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e83fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:27.605 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e83fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:27.605 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e83fff640 1 -- 10.20.193.110:0/499587899 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x16c7120 con 0x16c4360 2026-02-13T20:11:27.605 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e83fff640 10 monclient: _finish_auth 0 2026-02-13T20:11:27.605 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e83fff640 10 monclient: _check_auth_tickets 2026-02-13T20:11:27.605 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e83fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:27.605 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e9d8f4240 5 monclient: authenticate success, global_id 4223 2026-02-13T20:11:27.605 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e9d8f4240 10 monclient: _renew_subs 2026-02-13T20:11:27.605 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e9d8f4240 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:27.605 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e9d8f4240 1 -- 10.20.193.110:0/499587899 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x1641150 con 0x16c4360 2026-02-13T20:11:27.605 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e9d8f4240 10 monclient: _renew_subs 2026-02-13T20:11:27.605 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e9d8f4240 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:27.605 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e9d8f4240 1 -- 10.20.193.110:0/499587899 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x16c4dc0 con 0x16c4360 2026-02-13T20:11:27.605 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e83fff640 1 -- 10.20.193.110:0/499587899 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1e8c003300 con 0x16c4360 2026-02-13T20:11:27.605 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e83fff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:27.605 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e83fff640 1 -- 10.20.193.110:0/499587899 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f1e8c0036e0 con 0x16c4360 2026-02-13T20:11:27.605 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e83fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:27.605 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e83fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:27.605 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e83fff640 10 monclient: dump: 2026-02-13T20:11:27.605 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:27.605 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:27.605 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:27.605 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:27.605 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:27.605 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:27.605 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:27.606 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:27.606 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:27.606 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:27.606 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e9a1de640 4 set_mon_vals no callback set 2026-02-13T20:11:27.606 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.599+0000 7f1e83fff640 1 -- 10.20.193.110:0/499587899 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f1e8c003840 con 0x16c4360 2026-02-13T20:11:27.606 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.600+0000 7f1e83fff640 1 -- 10.20.193.110:0/499587899 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(16..16 src has 1..16) ==== 3492+0+0 (unknown 1849165598 0 0) 0x7f1e8c04e370 con 0x16c4360 2026-02-13T20:11:27.606 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.600+0000 7f1e9d8f4240 10 start_mon_command cmd=[{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-13T20:11:27.606 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.600+0000 7f1e9d8f4240 10 monclient: _send_command 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-13T20:11:27.606 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.600+0000 7f1e9d8f4240 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:27.606 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.600+0000 7f1e9d8f4240 1 -- 10.20.193.110:0/499587899 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x16c5920 con 0x16c4360 2026-02-13T20:11:27.606 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:27.600+0000 7f1e9b9e1640 10 monclient: get_auth_request con 0x7f1e7c03e250 auth_method 0 2026-02-13T20:11:28.558 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:28.555+0000 7f1e83fff640 1 -- 10.20.193.110:0/499587899 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v17) ==== 141+0+0 (unknown 1851909647 0 0) 0x7f1e8c016650 con 0x16c4360 2026-02-13T20:11:28.558 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:28.555+0000 7f1e83fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-13T20:11:28.558 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:28.555+0000 7f1e83fff640 10 monclient: _finish_command 1 = system:0 enabled application 'rbd' on pool 'rbd' 2026-02-13T20:11:28.558 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:28.555+0000 7f1e9d8f4240 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:28.558 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:28.555+0000 7f1e9d8f4240 1 -- 10.20.193.110:0/499587899 --> v1:10.20.193.110:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x1497320 con 0x16c4360 2026-02-13T20:11:28.559 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:28.556+0000 7f1e83fff640 1 -- 10.20.193.110:0/499587899 <== mon.2 v1:10.20.193.110:6790/0 10 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (unknown 391748328 0 0) 0x7f1e8c016650 con 0x16c4360 2026-02-13T20:11:28.560 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:28.556+0000 7f1e83fff640 10 monclient: handle_get_version_reply finishing 1 version 17 2026-02-13T20:11:28.560 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:28.556+0000 7f1e9a1de640 10 monclient: _renew_subs 2026-02-13T20:11:28.560 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:28.556+0000 7f1e9a1de640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:28.560 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:28.556+0000 7f1e9a1de640 1 -- 10.20.193.110:0/499587899 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=17}) -- 0x7f1e74002ae0 con 0x16c4360 2026-02-13T20:11:28.560 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:28.556+0000 7f1e83fff640 1 -- 10.20.193.110:0/499587899 <== mon.2 v1:10.20.193.110:6790/0 11 ==== osd_map(17..17 src has 1..17) ==== 661+0+0 (unknown 4143725120 0 0) 0x7f1e8c004080 con 0x16c4360 2026-02-13T20:11:28.560 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:28.556+0000 7f1e9d8f4240 1 -- 10.20.193.110:0/499587899 --> v1:10.20.193.188:6805/4130810301 -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17) -- 0x16cf7d0 con 0x16cdc80 2026-02-13T20:11:28.560 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:28.557+0000 7f1e9b1e0640 10 monclient: get_auth_request con 0x16cdc80 auth_method 0 2026-02-13T20:11:28.561 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:28.558+0000 7f1e9b1e0640 1 -- 10.20.193.110:0/499587899 <== osd.5 v1:10.20.193.188:6805/4130810301 1 ==== osd_op_reply(1 rbd_trash [create] v17'1 uv1 ondisk = 0) ==== 153+0+0 (unknown 1703302865 0 0) 0x7f1e840022f0 con 0x16cdc80 2026-02-13T20:11:28.562 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:28.560+0000 7f1e9d8f4240 1 -- 10.20.193.110:0/499587899 --> v1:10.20.193.188:6805/4130810301 -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e17) -- 0x17c7890 con 0x16cdc80 2026-02-13T20:11:28.562 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:28.560+0000 7f1e9b1e0640 1 -- 10.20.193.110:0/499587899 <== osd.5 v1:10.20.193.188:6805/4130810301 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (unknown 4274215525 0 0) 0x7f1e840022f0 con 0x16cdc80 2026-02-13T20:11:28.562 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:28.560+0000 7f1e9d8f4240 1 -- 10.20.193.110:0/499587899 --> v1:10.20.193.188:6805/4130810301 -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e17) -- 0x17c69a0 con 0x16cdc80 2026-02-13T20:11:28.562 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:28.560+0000 7f1e9b1e0640 1 -- 10.20.193.110:0/499587899 <== osd.5 v1:10.20.193.188:6805/4130810301 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (unknown 4287864937 0 0) 0x7f1e840022f0 con 0x16cdc80 2026-02-13T20:11:28.562 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:28.560+0000 7f1e999dd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:28.563 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:28.560+0000 7f1e999dd640 1 -- 10.20.193.110:0/499587899 --> v1:10.20.193.110:6790/0 -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7f1e78001f40 con 0x16c4360 2026-02-13T20:11:29.559 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:29.556+0000 7f1e83fff640 1 -- 10.20.193.110:0/499587899 <== mon.2 v1:10.20.193.110:6790/0 12 ==== pool_op_reply(tid 4 (0) Success v18) ==== 55+0+0 (unknown 3848640833 0 0) 0x7f1e8c016470 con 0x16c4360 2026-02-13T20:11:29.559 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:29.556+0000 7f1e83fff640 10 monclient: _renew_subs 2026-02-13T20:11:29.559 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:29.556+0000 7f1e83fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:29.560 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:29.556+0000 7f1e83fff640 1 -- 10.20.193.110:0/499587899 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=18}) -- 0x1493c50 con 0x16c4360 2026-02-13T20:11:29.560 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:29.557+0000 7f1e83fff640 1 -- 10.20.193.110:0/499587899 <== mon.2 v1:10.20.193.110:6790/0 13 ==== osd_map(18..18 src has 1..18) ==== 629+0+0 (unknown 1639655265 0 0) 0x7f1e8c017610 con 0x16c4360 2026-02-13T20:11:29.560 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:29.557+0000 7f1e9a1de640 1 -- 10.20.193.110:0/499587899 --> v1:10.20.193.188:6805/4130810301 -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18) -- 0x7f1e74005810 con 0x16cdc80 2026-02-13T20:11:29.561 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:29.559+0000 7f1e9b1e0640 1 -- 10.20.193.110:0/499587899 <== osd.5 v1:10.20.193.188:6805/4130810301 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v18'1 uv1 ondisk = 0) ==== 194+0+0 (unknown 2910594948 0 0) 0x7f1e840022f0 con 0x16cdc80 2026-02-13T20:11:29.561 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:29.559+0000 7f1e999dd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:29.561 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:29.559+0000 7f1e999dd640 1 -- 10.20.193.110:0/499587899 --> v1:10.20.193.110:6790/0 -- pool_op(delete unmanaged snap pool 2 tid 6 name v18) -- 0x7f1e78003370 con 0x16c4360 2026-02-13T20:11:30.562 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.560+0000 7f1e83fff640 1 -- 10.20.193.110:0/499587899 <== mon.2 v1:10.20.193.110:6790/0 14 ==== pool_op_reply(tid 6 (0) Success v19) ==== 43+0+0 (unknown 2562133104 0 0) 0x7f1e8c016470 con 0x16c4360 2026-02-13T20:11:30.562 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.560+0000 7f1e83fff640 10 monclient: _renew_subs 2026-02-13T20:11:30.562 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.560+0000 7f1e83fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:30.562 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.560+0000 7f1e83fff640 1 -- 10.20.193.110:0/499587899 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=19}) -- 0x7f1e7c001e10 con 0x16c4360 2026-02-13T20:11:30.562 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.560+0000 7f1e83fff640 1 -- 10.20.193.110:0/499587899 <== mon.2 v1:10.20.193.110:6790/0 15 ==== osd_map(19..19 src has 1..19) ==== 657+0+0 (unknown 2245893603 0 0) 0x7f1e8c016ef0 con 0x16c4360 2026-02-13T20:11:30.563 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.560+0000 7f1e9a1de640 1 -- 10.20.193.110:0/499587899 --> v1:10.20.193.188:6805/4130810301 -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19) -- 0x7f1e74005bb0 con 0x16cdc80 2026-02-13T20:11:30.564 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.562+0000 7f1e9b1e0640 1 -- 10.20.193.110:0/499587899 <== osd.5 v1:10.20.193.188:6805/4130810301 5 ==== osd_op_reply(7 rbd_info [write 0~19] v19'2 uv2 ondisk = 0) ==== 152+0+0 (unknown 900577457 0 0) 0x7f1e840022f0 con 0x16cdc80 2026-02-13T20:11:30.565 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.562+0000 7f1e9d8f4240 1 -- 10.20.193.110:0/499587899 >> v1:10.20.193.188:6805/4130810301 conn(0x16cdc80 legacy=0x16ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:30.565 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.562+0000 7f1e9d8f4240 1 -- 10.20.193.110:0/499587899 >> v1:10.20.193.188:6812/1623052694 conn(0x7f1e7c03e250 legacy=0x7f1e7c05e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:30.565 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.562+0000 7f1e9d8f4240 10 monclient: shutdown 2026-02-13T20:11:30.565 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.562+0000 7f1e9d8f4240 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:30.565 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.562+0000 7f1e9d8f4240 1 -- 10.20.193.110:0/499587899 >> v1:10.20.193.110:6790/0 conn(0x16c4360 legacy=0x16cc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:30.565 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.562+0000 7f1e9cc6a640 1 -- 10.20.193.110:0/499587899 reap_dead start 2026-02-13T20:11:30.565 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.562+0000 7f1e9d8f4240 1 -- 10.20.193.110:0/499587899 shutdown_connections 2026-02-13T20:11:30.565 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.562+0000 7f1e9d8f4240 1 -- 10.20.193.110:0/499587899 >> 10.20.193.110:0/499587899 conn(0x1624420 msgr2=0x16436b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:30.565 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.562+0000 7f1e9d8f4240 1 -- 10.20.193.110:0/499587899 shutdown_connections 2026-02-13T20:11:30.565 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.562+0000 7f1e9d8f4240 1 -- 10.20.193.110:0/499587899 wait complete. 2026-02-13T20:11:30.567 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-13T20:11:30.570 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2026-02-13T20:11:30.571 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-13T20:11:30.681 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.673+0000 7fa7105f6640 10 monclient: get_monmap_and_config 2026-02-13T20:11:30.681 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.673+0000 7fa7105f6640 10 monclient: build_initial_monmap 2026-02-13T20:11:30.681 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.673+0000 7fa7105f6640 10 monclient: monmap: 2026-02-13T20:11:30.681 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:30.682 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:30.682 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:30.674892+0000 2026-02-13T20:11:30.682 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:30.674892+0000 2026-02-13T20:11:30.682 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:30.682 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:30.682 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:30.682 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:30.682 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:30.682 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:30.682 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.673+0000 7fa7105f6640 1 Processor -- start 2026-02-13T20:11:30.682 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.673+0000 7fa7105f6640 1 -- start start 2026-02-13T20:11:30.682 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.673+0000 7fa7105f6640 10 monclient: init 2026-02-13T20:11:30.682 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.674+0000 7fa7105f6640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:30.682 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.674+0000 7fa7105f6640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:11:30.683 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.674+0000 7fa7105f6640 10 monclient(hunting): picked mon.noname-a con 0x7fa708091e20 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:30.683 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.674+0000 7fa7105f6640 10 monclient(hunting): picked mon.noname-c con 0x7fa708089540 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:30.683 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.674+0000 7fa7105f6640 10 monclient(hunting): picked mon.noname-b con 0x7fa708089980 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:30.683 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.674+0000 7fa7105f6640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa70805b3d0 con 0x7fa708091e20 2026-02-13T20:11:30.683 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.674+0000 7fa7105f6640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa70805b6b0 con 0x7fa708089540 2026-02-13T20:11:30.683 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.674+0000 7fa7105f6640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa70805cd90 con 0x7fa708089980 2026-02-13T20:11:30.683 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.674+0000 7fa7105f6640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:30.683 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.674+0000 7fa7105f6640 10 monclient(hunting): authenticate will time out at 652.365230s 2026-02-13T20:11:30.683 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.674+0000 7fa70eb6c640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fa708089980 0x7fa7081a5430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:34262/0 (socket says 10.20.193.110:34262) 2026-02-13T20:11:30.683 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.674+0000 7fa70eb6c640 1 -- 10.20.193.110:0/3412188282 learned_addr learned my addr 10.20.193.110:0/3412188282 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:30.683 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.674+0000 7fa70d369640 1 -- 10.20.193.110:0/3412188282 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2440453848 0 0) 0x7fa70805cd90 con 0x7fa708089980 2026-02-13T20:11:30.683 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.674+0000 7fa70d369640 10 monclient(hunting): _negotiate 2026-02-13T20:11:30.683 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.674+0000 7fa70d369640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:30.683 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.674+0000 7fa70d369640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:30.684 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.674+0000 7fa70d369640 10 monclient(hunting): my global_id is 4226 2026-02-13T20:11:30.684 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.674+0000 7fa70d369640 1 -- 10.20.193.110:0/3412188282 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6f00035e0 con 0x7fa708089980 2026-02-13T20:11:30.684 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.674+0000 7fa70d369640 1 -- 10.20.193.110:0/3412188282 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1327423752 0 0) 0x7fa70805b3d0 con 0x7fa708091e20 2026-02-13T20:11:30.684 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.674+0000 7fa70d369640 10 monclient(hunting): _negotiate 2026-02-13T20:11:30.684 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.674+0000 7fa70d369640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:30.684 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.674+0000 7fa70d369640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:30.684 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.674+0000 7fa70d369640 10 monclient(hunting): my global_id is 4230 2026-02-13T20:11:30.684 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.674+0000 7fa70d369640 1 -- 10.20.193.110:0/3412188282 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa70805cd90 con 0x7fa708091e20 2026-02-13T20:11:30.684 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.674+0000 7fa70d369640 1 -- 10.20.193.110:0/3412188282 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2252510441 0 0) 0x7fa6f00035e0 con 0x7fa708089980 2026-02-13T20:11:30.684 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.674+0000 7fa70d369640 1 -- 10.20.193.110:0/3412188282 >> v1:10.20.193.188:6789/0 conn(0x7fa708089540 legacy=0x7fa708183d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:30.684 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.674+0000 7fa70d369640 1 -- 10.20.193.110:0/3412188282 >> v1:10.20.193.110:6789/0 conn(0x7fa708091e20 legacy=0x7fa708088e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:30.684 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.674+0000 7fa70d369640 10 monclient: _finish_hunting 0 2026-02-13T20:11:30.684 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.674+0000 7fa70d369640 1 monclient: found mon.noname-b 2026-02-13T20:11:30.684 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.674+0000 7fa70d369640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:30.684 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.674+0000 7fa70d369640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:11:30.685 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.674+0000 7fa70d369640 1 -- 10.20.193.110:0/3412188282 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa70808ad10 con 0x7fa708089980 2026-02-13T20:11:30.685 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.674+0000 7fa70d369640 10 monclient: _finish_auth 0 2026-02-13T20:11:30.685 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.674+0000 7fa70d369640 10 monclient: _check_auth_tickets 2026-02-13T20:11:30.685 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.674+0000 7fa70d369640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:30.685 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.674+0000 7fa70d369640 1 -- 10.20.193.110:0/3412188282 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa704003eb0 con 0x7fa708089980 2026-02-13T20:11:30.685 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.674+0000 7fa70d369640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:30.685 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.674+0000 7fa70d369640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:11:30.685 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.674+0000 7fa70d369640 10 monclient: dump: 2026-02-13T20:11:30.685 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:30.685 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:30.685 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:30.685 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:30.685 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:30.685 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:30.686 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:30.686 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:30.686 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:30.686 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:30.686 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.674+0000 7fa7105f6640 5 monclient: authenticate success, global_id 4226 2026-02-13T20:11:30.686 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.674+0000 7fa7105f6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:30.686 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.674+0000 7fa70d369640 1 -- 10.20.193.110:0/3412188282 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa7040040b0 con 0x7fa708089980 2026-02-13T20:11:30.686 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.674+0000 7fa70d369640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:30.686 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.674+0000 7fa7105f6640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:30.686 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.674+0000 7fa7105f6640 4 set_mon_vals no callback set 2026-02-13T20:11:30.686 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.674+0000 7fa70d369640 1 -- 10.20.193.110:0/3412188282 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa7040044c0 con 0x7fa708089980 2026-02-13T20:11:30.686 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.674+0000 7fa70d369640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:30.686 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.674+0000 7fa70d369640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:30.686 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.674+0000 7fa70d369640 10 monclient: dump: 2026-02-13T20:11:30.686 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:30.687 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:30.687 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:30.687 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:30.687 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:30.687 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:30.687 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:30.687 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:30.687 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:30.687 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:30.687 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.675+0000 7fa7105f6640 10 monclient: shutdown 2026-02-13T20:11:30.687 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.675+0000 7fa7105f6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:30.687 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.675+0000 7fa7105f6640 1 -- 10.20.193.110:0/3412188282 >> v1:10.20.193.110:6790/0 conn(0x7fa708089980 legacy=0x7fa7081a5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:30.687 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.675+0000 7fa7105f6640 1 -- 10.20.193.110:0/3412188282 shutdown_connections 2026-02-13T20:11:30.687 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.675+0000 7fa7105f6640 1 -- 10.20.193.110:0/3412188282 >> 10.20.193.110:0/3412188282 conn(0x7fa708054e90 msgr2=0x7fa708058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:30.687 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.675+0000 7fa7105f6640 1 -- 10.20.193.110:0/3412188282 shutdown_connections 2026-02-13T20:11:30.688 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.675+0000 7fa7105f6640 1 -- 10.20.193.110:0/3412188282 wait complete. 2026-02-13T20:11:30.688 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.675+0000 7fa7105f6640 10 monclient: build_initial_monmap 2026-02-13T20:11:30.688 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.675+0000 7fa7105f6640 10 monclient: monmap: 2026-02-13T20:11:30.688 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:30.688 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:30.688 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:11:30.688 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:11:30.688 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:30.688 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:11:30.688 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:30.688 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:30.688 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:30.688 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:30.688 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.675+0000 7fa7105f6640 1 Processor -- start 2026-02-13T20:11:30.688 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa7105f6640 1 -- start start 2026-02-13T20:11:30.689 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa7105f6640 10 monclient: init 2026-02-13T20:11:30.689 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa7105f6640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:30.689 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa7105f6640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:11:30.689 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa7105f6640 10 monclient(hunting): picked mon.noname-a con 0x7fa708089540 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:30.689 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa7105f6640 10 monclient(hunting): picked mon.noname-b con 0x7fa708089980 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:30.689 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa7105f6640 10 monclient(hunting): picked mon.noname-c con 0x7fa708091e20 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:30.689 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa7105f6640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7080591b0 con 0x7fa708089540 2026-02-13T20:11:30.689 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa7105f6640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa708193fd0 con 0x7fa708089980 2026-02-13T20:11:30.689 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa7105f6640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa708191110 con 0x7fa708091e20 2026-02-13T20:11:30.689 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa7105f6640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:30.689 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa7105f6640 10 monclient(hunting): authenticate will time out at 652.367375s 2026-02-13T20:11:30.689 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa70e36b640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fa708089540 0x7fa7081902f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:44520/0 (socket says 10.20.193.110:44520) 2026-02-13T20:11:30.689 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa70e36b640 1 -- 10.20.193.110:0/2003632551 learned_addr learned my addr 10.20.193.110:0/2003632551 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:30.689 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa6eeffd640 1 -- 10.20.193.110:0/2003632551 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3367125772 0 0) 0x7fa7080591b0 con 0x7fa708089540 2026-02-13T20:11:30.689 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa6eeffd640 10 monclient(hunting): _negotiate 2026-02-13T20:11:30.690 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa6eeffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:30.690 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa6eeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:30.690 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa6eeffd640 10 monclient(hunting): my global_id is 4233 2026-02-13T20:11:30.690 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa6eeffd640 1 -- 10.20.193.110:0/2003632551 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6d80035e0 con 0x7fa708089540 2026-02-13T20:11:30.690 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa6eeffd640 1 -- 10.20.193.110:0/2003632551 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 769339464 0 0) 0x7fa708191110 con 0x7fa708091e20 2026-02-13T20:11:30.690 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa6eeffd640 10 monclient(hunting): _negotiate 2026-02-13T20:11:30.690 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa6eeffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:30.690 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa6eeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:30.690 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa6eeffd640 10 monclient(hunting): my global_id is 4229 2026-02-13T20:11:30.690 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa6eeffd640 1 -- 10.20.193.110:0/2003632551 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7080591b0 con 0x7fa708091e20 2026-02-13T20:11:30.690 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa6eeffd640 1 -- 10.20.193.110:0/2003632551 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 825371335 0 0) 0x7fa6d80035e0 con 0x7fa708089540 2026-02-13T20:11:30.690 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa6eeffd640 1 -- 10.20.193.110:0/2003632551 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa708191110 con 0x7fa708089540 2026-02-13T20:11:30.690 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa6eeffd640 1 -- 10.20.193.110:0/2003632551 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa6f8003170 con 0x7fa708089540 2026-02-13T20:11:30.690 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa6eeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:30.690 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa6eeffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:11:30.690 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa6eeffd640 10 monclient(hunting): dump: 2026-02-13T20:11:30.691 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:30.691 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:30.691 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:30.691 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:30.691 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:30.691 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:30.691 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:30.691 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:30.691 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:30.691 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:30.691 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa6eeffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:30.691 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa6eeffd640 1 -- 10.20.193.110:0/2003632551 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3667287088 0 0) 0x7fa7080591b0 con 0x7fa708091e20 2026-02-13T20:11:30.691 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa6eeffd640 1 -- 10.20.193.110:0/2003632551 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa6d80035e0 con 0x7fa708091e20 2026-02-13T20:11:30.691 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa6eeffd640 1 -- 10.20.193.110:0/2003632551 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa704004220 con 0x7fa708091e20 2026-02-13T20:11:30.691 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa6eeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:30.692 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa6eeffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:30.692 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa6eeffd640 10 monclient(hunting): dump: 2026-02-13T20:11:30.692 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:30.692 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:30.692 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:30.692 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:30.692 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:30.692 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:30.692 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:30.692 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:30.692 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:30.692 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:30.692 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa6eeffd640 1 -- 10.20.193.110:0/2003632551 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 308580130 0 0) 0x7fa708191110 con 0x7fa708089540 2026-02-13T20:11:30.692 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa6eeffd640 1 -- 10.20.193.110:0/2003632551 >> v1:10.20.193.110:6790/0 conn(0x7fa708091e20 legacy=0x7fa70823bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:30.692 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa6eeffd640 1 -- 10.20.193.110:0/2003632551 >> v1:10.20.193.188:6789/0 conn(0x7fa708089980 legacy=0x7fa708190a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:30.693 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa6eeffd640 10 monclient: _finish_hunting 0 2026-02-13T20:11:30.693 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa6eeffd640 1 monclient: found mon.a 2026-02-13T20:11:30.693 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa6eeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:30.693 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa6eeffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:30.693 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa6eeffd640 1 -- 10.20.193.110:0/2003632551 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa70805d320 con 0x7fa708089540 2026-02-13T20:11:30.693 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa6eeffd640 10 monclient: _finish_auth 0 2026-02-13T20:11:30.693 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa6eeffd640 10 monclient: _check_auth_tickets 2026-02-13T20:11:30.693 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa6eeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:30.693 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa7105f6640 5 monclient: authenticate success, global_id 4233 2026-02-13T20:11:30.693 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa7105f6640 10 monclient: _renew_subs 2026-02-13T20:11:30.693 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa7105f6640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:30.693 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa7105f6640 1 -- 10.20.193.110:0/2003632551 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa708193160 con 0x7fa708089540 2026-02-13T20:11:30.693 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa7105f6640 10 monclient: _renew_subs 2026-02-13T20:11:30.693 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa7105f6640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:30.693 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.676+0000 7fa7105f6640 1 -- 10.20.193.110:0/2003632551 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa708192a00 con 0x7fa708089540 2026-02-13T20:11:30.693 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.677+0000 7fa6eeffd640 1 -- 10.20.193.110:0/2003632551 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa6f8004490 con 0x7fa708089540 2026-02-13T20:11:30.694 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.677+0000 7fa6eeffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:30.694 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.677+0000 7fa6eeffd640 1 -- 10.20.193.110:0/2003632551 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa6f80037a0 con 0x7fa708089540 2026-02-13T20:11:30.694 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.677+0000 7fa6eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:30.694 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.677+0000 7fa6eeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:30.694 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.677+0000 7fa6eeffd640 10 monclient: dump: 2026-02-13T20:11:30.694 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:30.694 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:30.694 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:30.694 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:30.694 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:30.694 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:30.694 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:30.694 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:30.694 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:30.694 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:30.695 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.677+0000 7fa70cb68640 4 set_mon_vals no callback set 2026-02-13T20:11:30.695 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.677+0000 7fa7105f6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:30.695 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.677+0000 7fa7105f6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:30.695 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.677+0000 7fa7105f6640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:30.695 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.677+0000 7fa7105f6640 1 -- 10.20.193.110:0/2003632551 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7080008d0 con 0x7fa708089540 2026-02-13T20:11:30.695 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.677+0000 7fa6eeffd640 1 -- 10.20.193.110:0/2003632551 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fa6f8003900 con 0x7fa708089540 2026-02-13T20:11:30.695 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.677+0000 7fa6eeffd640 1 -- 10.20.193.110:0/2003632551 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3559+0+0 (unknown 1530614704 0 0) 0x7fa6f804e750 con 0x7fa708089540 2026-02-13T20:11:30.695 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.677+0000 7fa70db6a640 10 monclient: get_auth_request con 0x7fa6d803faf0 auth_method 0 2026-02-13T20:11:30.695 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.680+0000 7fa6eeffd640 1 -- 10.20.193.110:0/2003632551 <== mon.0 v1:10.20.193.110:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fa6f8017060 con 0x7fa708089540 2026-02-13T20:11:30.696 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.680+0000 7fa6eeffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:30.696 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.680+0000 7fa6eeffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:11:30.784 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.782+0000 7fa7105f6640 10 start_mon_command cmd=[{"prefix": "config log", "num": 1, "format": "json"}] 2026-02-13T20:11:30.785 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.782+0000 7fa7105f6640 10 monclient: _send_command 2 [{"prefix": "config log", "num": 1, "format": "json"}] 2026-02-13T20:11:30.785 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.782+0000 7fa7105f6640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:30.785 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.782+0000 7fa7105f6640 1 -- 10.20.193.110:0/2003632551 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7fa70805bd00 con 0x7fa708089540 2026-02-13T20:11:30.785 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.782+0000 7fa6eeffd640 1 -- 10.20.193.110:0/2003632551 <== mon.0 v1:10.20.193.110:6789/0 10 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v1) ==== 86+0+61 (unknown 4269106227 0 102270264) 0x7fa6f8016810 con 0x7fa708089540 2026-02-13T20:11:30.785 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.782+0000 7fa6eeffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config log", "num": 1, "format": "json"}] 2026-02-13T20:11:30.785 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.782+0000 7fa6eeffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:11:30.786 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:30.786 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.783+0000 7fa7105f6640 1 -- 10.20.193.110:0/2003632551 >> v1:10.20.193.188:6812/1623052694 conn(0x7fa6d803faf0 legacy=0x7fa6d805ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:30.787 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.783+0000 7fa7105f6640 10 monclient: shutdown 2026-02-13T20:11:30.787 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.783+0000 7fa7105f6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:30.787 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.783+0000 7fa7105f6640 1 -- 10.20.193.110:0/2003632551 >> v1:10.20.193.110:6789/0 conn(0x7fa708089540 legacy=0x7fa7081902f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:30.787 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.783+0000 7fa7105f6640 1 -- 10.20.193.110:0/2003632551 shutdown_connections 2026-02-13T20:11:30.787 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.783+0000 7fa7105f6640 1 -- 10.20.193.110:0/2003632551 >> 10.20.193.110:0/2003632551 conn(0x7fa708054e90 msgr2=0x7fa7081ae3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:30.787 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.783+0000 7fa7105f6640 1 -- 10.20.193.110:0/2003632551 shutdown_connections 2026-02-13T20:11:30.787 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.783+0000 7fa7105f6640 1 -- 10.20.193.110:0/2003632551 wait complete. 2026-02-13T20:11:30.793 INFO:teuthology.orchestra.run.trial110.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2026-02-13T20:11:30.794 INFO:tasks.ceph_manager:config epoch is 1 2026-02-13T20:11:30.794 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-13T20:11:30.794 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-13T20:11:30.794 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-13T20:11:30.867 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.858+0000 7fb69ef0c640 10 monclient: get_monmap_and_config 2026-02-13T20:11:30.867 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.858+0000 7fb69ef0c640 10 monclient: build_initial_monmap 2026-02-13T20:11:30.867 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.858+0000 7fb69ef0c640 10 monclient: monmap: 2026-02-13T20:11:30.867 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:30.867 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:30.867 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:30.859895+0000 2026-02-13T20:11:30.867 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:30.859895+0000 2026-02-13T20:11:30.867 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:30.867 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:30.867 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:30.867 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:30.867 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:30.867 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:30.867 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.858+0000 7fb69ef0c640 1 Processor -- start 2026-02-13T20:11:30.867 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.858+0000 7fb69ef0c640 1 -- start start 2026-02-13T20:11:30.867 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.858+0000 7fb69ef0c640 10 monclient: init 2026-02-13T20:11:30.867 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.859+0000 7fb69ef0c640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:30.867 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.859+0000 7fb69ef0c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:11:30.867 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.859+0000 7fb69ef0c640 10 monclient(hunting): picked mon.noname-b con 0x7fb6981401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:30.867 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.859+0000 7fb69ef0c640 10 monclient(hunting): picked mon.noname-c con 0x7fb698092020 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:30.867 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.859+0000 7fb69ef0c640 10 monclient(hunting): picked mon.noname-a con 0x7fb698091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:30.867 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.859+0000 7fb69ef0c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb69808b730 con 0x7fb698091950 2026-02-13T20:11:30.867 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.859+0000 7fb69ef0c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb69805c5b0 con 0x7fb698092020 2026-02-13T20:11:30.867 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.859+0000 7fb69ef0c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb69808bcf0 con 0x7fb6981401c0 2026-02-13T20:11:30.867 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.859+0000 7fb69ef0c640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:30.867 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.859+0000 7fb69ef0c640 10 monclient(hunting): authenticate will time out at 652.550267s 2026-02-13T20:11:30.867 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.859+0000 7fb69cc81640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fb6981401c0 0x7fb698091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:34286/0 (socket says 10.20.193.110:34286) 2026-02-13T20:11:30.867 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.859+0000 7fb69cc81640 1 -- 10.20.193.110:0/1866528821 learned_addr learned my addr 10.20.193.110:0/1866528821 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:30.867 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.859+0000 7fb68f7fe640 1 -- 10.20.193.110:0/1866528821 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3508529074 0 0) 0x7fb69808bcf0 con 0x7fb6981401c0 2026-02-13T20:11:30.867 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.859+0000 7fb68f7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:11:30.867 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.859+0000 7fb68f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:30.867 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.859+0000 7fb68f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:30.867 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.859+0000 7fb68f7fe640 10 monclient(hunting): my global_id is 4232 2026-02-13T20:11:30.867 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.859+0000 7fb68f7fe640 1 -- 10.20.193.110:0/1866528821 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6840035e0 con 0x7fb6981401c0 2026-02-13T20:11:30.867 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.859+0000 7fb68f7fe640 1 -- 10.20.193.110:0/1866528821 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4201943810 0 0) 0x7fb69808b730 con 0x7fb698091950 2026-02-13T20:11:30.868 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.859+0000 7fb68f7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:11:30.868 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.859+0000 7fb68f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:30.868 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.859+0000 7fb68f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:30.868 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.859+0000 7fb68f7fe640 10 monclient(hunting): my global_id is 4236 2026-02-13T20:11:30.868 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.859+0000 7fb68f7fe640 1 -- 10.20.193.110:0/1866528821 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb69808bcf0 con 0x7fb698091950 2026-02-13T20:11:30.868 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.859+0000 7fb68f7fe640 1 -- 10.20.193.110:0/1866528821 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2368915988 0 0) 0x7fb69808bcf0 con 0x7fb698091950 2026-02-13T20:11:30.868 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.859+0000 7fb68f7fe640 1 -- 10.20.193.110:0/1866528821 >> v1:10.20.193.110:6790/0 conn(0x7fb6981401c0 legacy=0x7fb698091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:30.868 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.859+0000 7fb68f7fe640 1 -- 10.20.193.110:0/1866528821 >> v1:10.20.193.188:6789/0 conn(0x7fb698092020 legacy=0x7fb6981812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:30.868 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.859+0000 7fb68f7fe640 10 monclient: _finish_hunting 0 2026-02-13T20:11:30.868 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.859+0000 7fb68f7fe640 1 monclient: found mon.noname-a 2026-02-13T20:11:30.868 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.859+0000 7fb68f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:30.868 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.859+0000 7fb68f7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:11:30.868 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.859+0000 7fb68f7fe640 1 -- 10.20.193.110:0/1866528821 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb698140590 con 0x7fb698091950 2026-02-13T20:11:30.868 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.859+0000 7fb68f7fe640 10 monclient: _finish_auth 0 2026-02-13T20:11:30.868 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.859+0000 7fb68f7fe640 10 monclient: _check_auth_tickets 2026-02-13T20:11:30.868 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.859+0000 7fb68f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:30.868 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.859+0000 7fb68f7fe640 1 -- 10.20.193.110:0/1866528821 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb694003eb0 con 0x7fb698091950 2026-02-13T20:11:30.868 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.859+0000 7fb68f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:30.868 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.859+0000 7fb68f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:11:30.868 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.859+0000 7fb68f7fe640 10 monclient: dump: 2026-02-13T20:11:30.868 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:30.868 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:30.868 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:30.868 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:30.868 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:30.868 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:30.868 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:30.868 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:30.868 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:30.868 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:30.868 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.859+0000 7fb69ef0c640 5 monclient: authenticate success, global_id 4236 2026-02-13T20:11:30.868 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.859+0000 7fb69ef0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:30.868 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.859+0000 7fb68f7fe640 1 -- 10.20.193.110:0/1866528821 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb694004040 con 0x7fb698091950 2026-02-13T20:11:30.868 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.859+0000 7fb68f7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:30.868 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.859+0000 7fb68f7fe640 1 -- 10.20.193.110:0/1866528821 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb694004450 con 0x7fb698091950 2026-02-13T20:11:30.868 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.859+0000 7fb69ef0c640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:30.868 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.859+0000 7fb69ef0c640 4 set_mon_vals no callback set 2026-02-13T20:11:30.868 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.859+0000 7fb68f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:30.868 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.859+0000 7fb68f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:30.868 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.859+0000 7fb68f7fe640 10 monclient: dump: 2026-02-13T20:11:30.868 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:30.869 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:30.869 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:30.869 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:30.869 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:30.869 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:30.869 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:30.869 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:30.869 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:30.869 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:30.869 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.860+0000 7fb69ef0c640 10 monclient: shutdown 2026-02-13T20:11:30.869 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.860+0000 7fb69ef0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:30.869 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.860+0000 7fb69ef0c640 1 -- 10.20.193.110:0/1866528821 >> v1:10.20.193.110:6789/0 conn(0x7fb698091950 legacy=0x7fb6981a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:30.869 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.860+0000 7fb69ef0c640 1 -- 10.20.193.110:0/1866528821 shutdown_connections 2026-02-13T20:11:30.869 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.860+0000 7fb69ef0c640 1 -- 10.20.193.110:0/1866528821 >> 10.20.193.110:0/1866528821 conn(0x7fb698054e90 msgr2=0x7fb698058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:30.869 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.860+0000 7fb69ef0c640 1 -- 10.20.193.110:0/1866528821 shutdown_connections 2026-02-13T20:11:30.869 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.860+0000 7fb69ef0c640 1 -- 10.20.193.110:0/1866528821 wait complete. 2026-02-13T20:11:30.869 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.860+0000 7fb69ef0c640 10 monclient: build_initial_monmap 2026-02-13T20:11:30.869 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.860+0000 7fb69ef0c640 10 monclient: monmap: 2026-02-13T20:11:30.869 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:30.869 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:30.869 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:11:30.869 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:11:30.869 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:30.869 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:11:30.869 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:30.869 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:30.869 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:30.869 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:30.869 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.860+0000 7fb69ef0c640 1 Processor -- start 2026-02-13T20:11:30.869 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.860+0000 7fb69ef0c640 1 -- start start 2026-02-13T20:11:30.869 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.860+0000 7fb69ef0c640 10 monclient: init 2026-02-13T20:11:30.869 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb69ef0c640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:30.869 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb69ef0c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:11:30.869 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb69ef0c640 10 monclient(hunting): picked mon.noname-b con 0x7fb698091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:30.869 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb69ef0c640 10 monclient(hunting): picked mon.noname-a con 0x7fb6981401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:30.869 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb69ef0c640 10 monclient(hunting): picked mon.noname-c con 0x7fb6981526e0 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:30.869 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb69ef0c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb698131d80 con 0x7fb6981401c0 2026-02-13T20:11:30.869 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb69ef0c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb69808c410 con 0x7fb698091950 2026-02-13T20:11:30.869 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb69ef0c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb69808a360 con 0x7fb6981526e0 2026-02-13T20:11:30.869 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb69ef0c640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:30.869 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb69ef0c640 10 monclient(hunting): authenticate will time out at 652.552146s 2026-02-13T20:11:30.869 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68ffff640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fb6981401c0 0x7fb698193a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:44530/0 (socket says 10.20.193.110:44530) 2026-02-13T20:11:30.870 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68ffff640 1 -- 10.20.193.110:0/4104280496 learned_addr learned my addr 10.20.193.110:0/4104280496 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:30.870 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb69d482640 1 --1- 10.20.193.110:0/4104280496 >> v1:10.20.193.110:6790/0 conn(0x7fb6981526e0 0x7fb698195180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:34294/0 (socket says 10.20.193.110:34294) 2026-02-13T20:11:30.870 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68d7fa640 1 -- 10.20.193.110:0/4104280496 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 864116380 0 0) 0x7fb698131d80 con 0x7fb6981401c0 2026-02-13T20:11:30.870 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68d7fa640 10 monclient(hunting): _negotiate 2026-02-13T20:11:30.870 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:30.870 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:30.870 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68d7fa640 10 monclient(hunting): my global_id is 4239 2026-02-13T20:11:30.870 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68d7fa640 1 -- 10.20.193.110:0/4104280496 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6680035e0 con 0x7fb6981401c0 2026-02-13T20:11:30.870 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68d7fa640 1 -- 10.20.193.110:0/4104280496 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 722422700 0 0) 0x7fb698140590 con 0x7fb6981526e0 2026-02-13T20:11:30.870 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68d7fa640 10 monclient(hunting): _negotiate 2026-02-13T20:11:30.870 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:30.870 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:30.870 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68d7fa640 10 monclient(hunting): my global_id is 4235 2026-02-13T20:11:30.870 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68d7fa640 1 -- 10.20.193.110:0/4104280496 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb698131d80 con 0x7fb6981526e0 2026-02-13T20:11:30.870 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68d7fa640 1 -- 10.20.193.110:0/4104280496 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3151651035 0 0) 0x7fb6680035e0 con 0x7fb6981401c0 2026-02-13T20:11:30.870 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68d7fa640 1 -- 10.20.193.110:0/4104280496 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb698140590 con 0x7fb6981401c0 2026-02-13T20:11:30.870 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68d7fa640 1 -- 10.20.193.110:0/4104280496 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb680003170 con 0x7fb6981401c0 2026-02-13T20:11:30.870 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:30.870 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:11:30.870 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68d7fa640 10 monclient(hunting): dump: 2026-02-13T20:11:30.870 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:30.870 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:30.870 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:30.870 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:30.870 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:30.870 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:30.870 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:30.870 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:30.870 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:30.870 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:30.870 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68d7fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:30.870 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68d7fa640 1 -- 10.20.193.110:0/4104280496 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4069039794 0 0) 0x7fb698131d80 con 0x7fb6981526e0 2026-02-13T20:11:30.870 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68d7fa640 1 -- 10.20.193.110:0/4104280496 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb6680035e0 con 0x7fb6981526e0 2026-02-13T20:11:30.870 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68d7fa640 1 -- 10.20.193.110:0/4104280496 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb694004360 con 0x7fb6981526e0 2026-02-13T20:11:30.870 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:30.870 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68d7fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:30.870 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68d7fa640 10 monclient(hunting): dump: 2026-02-13T20:11:30.870 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:30.870 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:30.870 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:30.870 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:30.870 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:30.871 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:30.871 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:30.871 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:30.871 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:30.871 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:30.871 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68d7fa640 1 -- 10.20.193.110:0/4104280496 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3657989337 0 0) 0x7fb69808c410 con 0x7fb698091950 2026-02-13T20:11:30.871 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68d7fa640 10 monclient(hunting): _negotiate 2026-02-13T20:11:30.871 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:30.871 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:30.871 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68d7fa640 10 monclient(hunting): my global_id is 4243 2026-02-13T20:11:30.871 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68d7fa640 1 -- 10.20.193.110:0/4104280496 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb698131d80 con 0x7fb698091950 2026-02-13T20:11:30.871 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68d7fa640 1 -- 10.20.193.110:0/4104280496 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4277853454 0 0) 0x7fb698140590 con 0x7fb6981401c0 2026-02-13T20:11:30.871 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68d7fa640 1 -- 10.20.193.110:0/4104280496 >> v1:10.20.193.110:6790/0 conn(0x7fb6981526e0 legacy=0x7fb698195180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:30.871 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68d7fa640 1 -- 10.20.193.110:0/4104280496 >> v1:10.20.193.188:6789/0 conn(0x7fb698091950 legacy=0x7fb69813e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:30.871 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68d7fa640 10 monclient: _finish_hunting 0 2026-02-13T20:11:30.871 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68d7fa640 1 monclient: found mon.a 2026-02-13T20:11:30.871 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:30.871 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68d7fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:30.871 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68d7fa640 1 -- 10.20.193.110:0/4104280496 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb69805d320 con 0x7fb6981401c0 2026-02-13T20:11:30.871 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68d7fa640 10 monclient: _finish_auth 0 2026-02-13T20:11:30.871 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68d7fa640 10 monclient: _check_auth_tickets 2026-02-13T20:11:30.871 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:30.871 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb69ef0c640 5 monclient: authenticate success, global_id 4239 2026-02-13T20:11:30.871 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb69ef0c640 10 monclient: _renew_subs 2026-02-13T20:11:30.871 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb69ef0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:30.871 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb69ef0c640 1 -- 10.20.193.110:0/4104280496 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb698090f70 con 0x7fb6981401c0 2026-02-13T20:11:30.871 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb69ef0c640 10 monclient: _renew_subs 2026-02-13T20:11:30.871 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb69ef0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:30.871 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb69ef0c640 1 -- 10.20.193.110:0/4104280496 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb6981309f0 con 0x7fb6981401c0 2026-02-13T20:11:30.871 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68d7fa640 1 -- 10.20.193.110:0/4104280496 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb680003380 con 0x7fb6981401c0 2026-02-13T20:11:30.871 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68d7fa640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:30.871 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68d7fa640 1 -- 10.20.193.110:0/4104280496 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb680003b30 con 0x7fb6981401c0 2026-02-13T20:11:30.871 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:30.871 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:30.871 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68d7fa640 10 monclient: dump: 2026-02-13T20:11:30.871 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:30.871 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:30.871 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:30.871 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:30.871 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:30.871 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:30.871 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:30.871 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:30.872 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:30.872 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:30.872 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.861+0000 7fb68effd640 4 set_mon_vals no callback set 2026-02-13T20:11:30.872 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.862+0000 7fb69ef0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:30.872 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.862+0000 7fb69ef0c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:30.872 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.862+0000 7fb69ef0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:30.872 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.862+0000 7fb69ef0c640 1 -- 10.20.193.110:0/4104280496 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6980008d0 con 0x7fb6981401c0 2026-02-13T20:11:30.872 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.862+0000 7fb68d7fa640 1 -- 10.20.193.110:0/4104280496 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fb680003c90 con 0x7fb6981401c0 2026-02-13T20:11:30.872 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.862+0000 7fb68d7fa640 1 -- 10.20.193.110:0/4104280496 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3559+0+0 (unknown 1530614704 0 0) 0x7fb68004e810 con 0x7fb6981401c0 2026-02-13T20:11:30.872 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.862+0000 7fb69cc81640 10 monclient: get_auth_request con 0x7fb66803fc10 auth_method 0 2026-02-13T20:11:30.872 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.864+0000 7fb68d7fa640 1 -- 10.20.193.110:0/4104280496 <== mon.0 v1:10.20.193.110:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fb680017140 con 0x7fb6981401c0 2026-02-13T20:11:30.872 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.864+0000 7fb68d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:30.872 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.864+0000 7fb68d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:11:31.000 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.998+0000 7fb69ef0c640 10 start_mon_command cmd=[{"prefix": "mgr dump", "format": "json"}] 2026-02-13T20:11:31.001 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.998+0000 7fb69ef0c640 10 monclient: _send_command 2 [{"prefix": "mgr dump", "format": "json"}] 2026-02-13T20:11:31.001 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.998+0000 7fb69ef0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:31.001 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.998+0000 7fb69ef0c640 1 -- 10.20.193.110:0/4104280496 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fb698058410 con 0x7fb6981401c0 2026-02-13T20:11:31.001 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.999+0000 7fb68d7fa640 1 -- 10.20.193.110:0/4104280496 <== mon.0 v1:10.20.193.110:6789/0 10 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+98533 (unknown 481731318 0 3235876366) 0x7fb6800168f0 con 0x7fb6981401c0 2026-02-13T20:11:31.001 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.999+0000 7fb68d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mgr dump", "format": "json"}] 2026-02-13T20:11:31.002 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:30.999+0000 7fb68d7fa640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:11:31.002 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:31.003 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.001+0000 7fb69ef0c640 1 -- 10.20.193.110:0/4104280496 >> v1:10.20.193.188:6812/1623052694 conn(0x7fb66803fc10 legacy=0x7fb6680600c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.003 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.001+0000 7fb69ef0c640 10 monclient: shutdown 2026-02-13T20:11:31.003 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.001+0000 7fb69ef0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:31.003 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.001+0000 7fb69ef0c640 1 -- 10.20.193.110:0/4104280496 >> v1:10.20.193.110:6789/0 conn(0x7fb6981401c0 legacy=0x7fb698193a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.003 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.001+0000 7fb69ef0c640 1 -- 10.20.193.110:0/4104280496 shutdown_connections 2026-02-13T20:11:31.004 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.001+0000 7fb69ef0c640 1 -- 10.20.193.110:0/4104280496 >> 10.20.193.110:0/4104280496 conn(0x7fb698054e90 msgr2=0x7fb69808dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:31.004 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.001+0000 7fb69ef0c640 1 -- 10.20.193.110:0/4104280496 shutdown_connections 2026-02-13T20:11:31.004 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.001+0000 7fb69ef0c640 1 -- 10.20.193.110:0/4104280496 wait complete. 2026-02-13T20:11:31.010 INFO:teuthology.orchestra.run.trial110.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6812","nonce":1623052694}]},"active_addr":"10.20.193.188:6812/1623052694","active_change":"2026-02-13T20:11:20.117814+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[],"modules":["iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.188:0","nonce":1822880117}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.188:0","nonce":1735030726}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.188:0","nonce":2048199607}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.188:0","nonce":1832920512}]}]} 2026-02-13T20:11:31.013 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-13T20:11:31.013 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-13T20:11:31.013 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-13T20:11:31.086 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.077+0000 7fe7095ae640 10 monclient: get_monmap_and_config 2026-02-13T20:11:31.087 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.077+0000 7fe7095ae640 10 monclient: build_initial_monmap 2026-02-13T20:11:31.087 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.077+0000 7fe7095ae640 10 monclient: monmap: 2026-02-13T20:11:31.087 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:31.087 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.087 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:31.079284+0000 2026-02-13T20:11:31.087 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:31.079284+0000 2026-02-13T20:11:31.087 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:31.087 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.088 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:31.088 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:31.088 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:31.088 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.088 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.078+0000 7fe7095ae640 1 Processor -- start 2026-02-13T20:11:31.088 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.078+0000 7fe7095ae640 1 -- start start 2026-02-13T20:11:31.088 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.078+0000 7fe7095ae640 10 monclient: init 2026-02-13T20:11:31.088 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.078+0000 7fe7095ae640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:31.088 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.078+0000 7fe7095ae640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:11:31.088 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.078+0000 7fe7095ae640 10 monclient(hunting): picked mon.noname-c con 0x7fe7041401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:31.088 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.078+0000 7fe7095ae640 10 monclient(hunting): picked mon.noname-a con 0x7fe704092020 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:31.088 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.078+0000 7fe7095ae640 10 monclient(hunting): picked mon.noname-b con 0x7fe704091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:31.089 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.078+0000 7fe7095ae640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe70408b730 con 0x7fe704092020 2026-02-13T20:11:31.089 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.078+0000 7fe7095ae640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe70405c5b0 con 0x7fe7041401c0 2026-02-13T20:11:31.089 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.078+0000 7fe7095ae640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe70408bcf0 con 0x7fe704091950 2026-02-13T20:11:31.089 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.078+0000 7fe7095ae640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:31.089 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.078+0000 7fe7095ae640 10 monclient(hunting): authenticate will time out at 652.769643s 2026-02-13T20:11:31.089 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.078+0000 7fe7027fc640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fe704092020 0x7fe7041812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:59824/0 (socket says 10.20.193.110:59824) 2026-02-13T20:11:31.089 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.078+0000 7fe7027fc640 1 -- 10.20.193.110:0/3171424094 learned_addr learned my addr 10.20.193.110:0/3171424094 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:31.089 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.078+0000 7fe701ffb640 1 -- 10.20.193.110:0/3171424094 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1530613496 0 0) 0x7fe70408b730 con 0x7fe704092020 2026-02-13T20:11:31.089 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.078+0000 7fe701ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.089 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.078+0000 7fe701ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.089 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.078+0000 7fe701ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.089 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.078+0000 7fe701ffb640 10 monclient(hunting): my global_id is 4242 2026-02-13T20:11:31.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.078+0000 7fe701ffb640 1 -- 10.20.193.110:0/3171424094 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6f00035e0 con 0x7fe704092020 2026-02-13T20:11:31.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.078+0000 7fe701ffb640 1 -- 10.20.193.110:0/3171424094 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 547386385 0 0) 0x7fe70408bcf0 con 0x7fe704091950 2026-02-13T20:11:31.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.078+0000 7fe701ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.078+0000 7fe701ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.078+0000 7fe701ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.078+0000 7fe701ffb640 10 monclient(hunting): my global_id is 4238 2026-02-13T20:11:31.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.078+0000 7fe701ffb640 1 -- 10.20.193.110:0/3171424094 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe70408b730 con 0x7fe704091950 2026-02-13T20:11:31.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.079+0000 7fe701ffb640 1 -- 10.20.193.110:0/3171424094 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2219142015 0 0) 0x7fe6f00035e0 con 0x7fe704092020 2026-02-13T20:11:31.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.079+0000 7fe701ffb640 1 -- 10.20.193.110:0/3171424094 >> v1:10.20.193.110:6790/0 conn(0x7fe704091950 legacy=0x7fe7041a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.079+0000 7fe701ffb640 1 -- 10.20.193.110:0/3171424094 >> v1:10.20.193.188:6789/0 conn(0x7fe7041401c0 legacy=0x7fe704091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.079+0000 7fe701ffb640 10 monclient: _finish_hunting 0 2026-02-13T20:11:31.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.079+0000 7fe701ffb640 1 monclient: found mon.noname-a 2026-02-13T20:11:31.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.079+0000 7fe701ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:31.091 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.079+0000 7fe701ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:11:31.091 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.079+0000 7fe701ffb640 1 -- 10.20.193.110:0/3171424094 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe704140590 con 0x7fe704092020 2026-02-13T20:11:31.091 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.079+0000 7fe701ffb640 10 monclient: _finish_auth 0 2026-02-13T20:11:31.091 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.079+0000 7fe701ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:11:31.091 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.079+0000 7fe701ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:31.091 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.079+0000 7fe701ffb640 1 -- 10.20.193.110:0/3171424094 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe6ec002dd0 con 0x7fe704092020 2026-02-13T20:11:31.091 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.079+0000 7fe701ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:31.091 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.079+0000 7fe701ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:11:31.091 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.079+0000 7fe701ffb640 10 monclient: dump: 2026-02-13T20:11:31.091 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.091 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.091 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.092 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.092 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.092 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.092 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.092 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.092 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.092 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.079+0000 7fe7095ae640 5 monclient: authenticate success, global_id 4242 2026-02-13T20:11:31.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.079+0000 7fe7095ae640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:31.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.079+0000 7fe701ffb640 1 -- 10.20.193.110:0/3171424094 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe6ec002fa0 con 0x7fe704092020 2026-02-13T20:11:31.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.079+0000 7fe701ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:31.093 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.079+0000 7fe7095ae640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:31.093 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.079+0000 7fe7095ae640 4 set_mon_vals no callback set 2026-02-13T20:11:31.093 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.079+0000 7fe701ffb640 1 -- 10.20.193.110:0/3171424094 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe6ec0033b0 con 0x7fe704092020 2026-02-13T20:11:31.093 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.079+0000 7fe701ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:31.093 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.079+0000 7fe701ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:31.093 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.079+0000 7fe701ffb640 10 monclient: dump: 2026-02-13T20:11:31.093 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.093 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.093 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.093 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.093 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.093 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.094 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.094 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.094 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.094 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.079+0000 7fe7095ae640 10 monclient: shutdown 2026-02-13T20:11:31.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.079+0000 7fe7095ae640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:31.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.079+0000 7fe7095ae640 1 -- 10.20.193.110:0/3171424094 >> v1:10.20.193.110:6789/0 conn(0x7fe704092020 legacy=0x7fe7041812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.079+0000 7fe7095ae640 1 -- 10.20.193.110:0/3171424094 shutdown_connections 2026-02-13T20:11:31.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.079+0000 7fe7095ae640 1 -- 10.20.193.110:0/3171424094 >> 10.20.193.110:0/3171424094 conn(0x7fe704054e90 msgr2=0x7fe704058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:31.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.079+0000 7fe7095ae640 1 -- 10.20.193.110:0/3171424094 shutdown_connections 2026-02-13T20:11:31.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.079+0000 7fe7095ae640 1 -- 10.20.193.110:0/3171424094 wait complete. 2026-02-13T20:11:31.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.079+0000 7fe7095ae640 10 monclient: build_initial_monmap 2026-02-13T20:11:31.095 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.079+0000 7fe7095ae640 10 monclient: monmap: 2026-02-13T20:11:31.095 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:31.095 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:31.095 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:11:31.095 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:11:31.095 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:31.095 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:11:31.095 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:31.095 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:31.095 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:31.095 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.095 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe7095ae640 1 Processor -- start 2026-02-13T20:11:31.096 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe7095ae640 1 -- start start 2026-02-13T20:11:31.096 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe7095ae640 10 monclient: init 2026-02-13T20:11:31.096 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe7095ae640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:31.096 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe7095ae640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:11:31.096 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe7095ae640 10 monclient(hunting): picked mon.noname-c con 0x7fe704091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:31.096 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe7095ae640 10 monclient(hunting): picked mon.noname-b con 0x7fe7041401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:31.096 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe7095ae640 10 monclient(hunting): picked mon.noname-a con 0x7fe704089c50 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:31.096 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe7095ae640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe70412ee80 con 0x7fe704089c50 2026-02-13T20:11:31.096 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe7095ae640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe70412f700 con 0x7fe7041401c0 2026-02-13T20:11:31.096 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe7095ae640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe704090fc0 con 0x7fe704091950 2026-02-13T20:11:31.096 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe7095ae640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:31.096 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe7095ae640 10 monclient(hunting): authenticate will time out at 652.771320s 2026-02-13T20:11:31.096 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe7037fe640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fe704089c50 0x7fe7041a2050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:59830/0 (socket says 10.20.193.110:59830) 2026-02-13T20:11:31.097 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe702ffd640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fe704091950 0x7fe704088e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:39566/0 (socket says 10.20.193.110:39566) 2026-02-13T20:11:31.097 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe7037fe640 1 -- 10.20.193.110:0/2784636638 learned_addr learned my addr 10.20.193.110:0/2784636638 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:31.097 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe6e37fe640 1 -- 10.20.193.110:0/2784636638 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 593858884 0 0) 0x7fe70412ee80 con 0x7fe704089c50 2026-02-13T20:11:31.097 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe6e37fe640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.097 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe6e37fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.097 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe6e37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.097 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe6e37fe640 10 monclient(hunting): my global_id is 4245 2026-02-13T20:11:31.097 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe6e37fe640 1 -- 10.20.193.110:0/2784636638 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6d00035e0 con 0x7fe704089c50 2026-02-13T20:11:31.097 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe6e37fe640 1 -- 10.20.193.110:0/2784636638 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3461547279 0 0) 0x7fe704090fc0 con 0x7fe704091950 2026-02-13T20:11:31.097 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe6e37fe640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.097 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe6e37fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.097 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe6e37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.098 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe6e37fe640 10 monclient(hunting): my global_id is 4241 2026-02-13T20:11:31.098 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe6e37fe640 1 -- 10.20.193.110:0/2784636638 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe70412ee80 con 0x7fe704091950 2026-02-13T20:11:31.098 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe6e37fe640 1 -- 10.20.193.110:0/2784636638 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1044285043 0 0) 0x7fe6d00035e0 con 0x7fe704089c50 2026-02-13T20:11:31.098 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe6e37fe640 1 -- 10.20.193.110:0/2784636638 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe704090fc0 con 0x7fe704089c50 2026-02-13T20:11:31.098 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe6e37fe640 1 -- 10.20.193.110:0/2784636638 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe6f40041b0 con 0x7fe704089c50 2026-02-13T20:11:31.098 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe6e37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:31.098 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe6e37fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:11:31.098 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe6e37fe640 10 monclient(hunting): dump: 2026-02-13T20:11:31.098 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.098 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.098 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.098 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.098 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.099 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.099 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.099 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.099 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.099 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.099 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe6e37fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:31.099 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe6e37fe640 1 -- 10.20.193.110:0/2784636638 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 271739202 0 0) 0x7fe70412ee80 con 0x7fe704091950 2026-02-13T20:11:31.099 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe6e37fe640 1 -- 10.20.193.110:0/2784636638 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe6d00035e0 con 0x7fe704091950 2026-02-13T20:11:31.099 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe6e37fe640 1 -- 10.20.193.110:0/2784636638 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe6f80030b0 con 0x7fe704091950 2026-02-13T20:11:31.099 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe6e37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:31.099 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe6e37fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:31.099 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe6e37fe640 10 monclient(hunting): dump: 2026-02-13T20:11:31.100 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.100 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.100 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.100 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.100 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.100 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.100 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.100 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.100 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.100 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.100 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe6e37fe640 1 -- 10.20.193.110:0/2784636638 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 355094709 0 0) 0x7fe704090fc0 con 0x7fe704089c50 2026-02-13T20:11:31.100 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe6e37fe640 1 -- 10.20.193.110:0/2784636638 >> v1:10.20.193.110:6790/0 conn(0x7fe704091950 legacy=0x7fe704088e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.100 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe6e37fe640 1 -- 10.20.193.110:0/2784636638 >> v1:10.20.193.188:6789/0 conn(0x7fe7041401c0 legacy=0x7fe704089540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.101 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe6e37fe640 10 monclient: _finish_hunting 0 2026-02-13T20:11:31.101 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe6e37fe640 1 monclient: found mon.a 2026-02-13T20:11:31.101 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe6e37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:31.101 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe6e37fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:31.101 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe6e37fe640 1 -- 10.20.193.110:0/2784636638 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe70408c4a0 con 0x7fe704089c50 2026-02-13T20:11:31.101 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe6e37fe640 10 monclient: _finish_auth 0 2026-02-13T20:11:31.101 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe6e37fe640 10 monclient: _check_auth_tickets 2026-02-13T20:11:31.101 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe6e37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:31.101 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe7095ae640 5 monclient: authenticate success, global_id 4245 2026-02-13T20:11:31.101 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe7095ae640 10 monclient: _renew_subs 2026-02-13T20:11:31.101 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe7095ae640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:31.101 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe7095ae640 1 -- 10.20.193.110:0/2784636638 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe70408a830 con 0x7fe704089c50 2026-02-13T20:11:31.102 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe7095ae640 10 monclient: _renew_subs 2026-02-13T20:11:31.102 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe7095ae640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:31.102 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe7095ae640 1 -- 10.20.193.110:0/2784636638 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe70412f140 con 0x7fe704089c50 2026-02-13T20:11:31.102 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe6e37fe640 1 -- 10.20.193.110:0/2784636638 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe6f4004380 con 0x7fe704089c50 2026-02-13T20:11:31.102 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe6e37fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:31.102 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe6e37fe640 1 -- 10.20.193.110:0/2784636638 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe6f4004a60 con 0x7fe704089c50 2026-02-13T20:11:31.102 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe6e37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:31.102 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe6e37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:31.102 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe6e37fe640 10 monclient: dump: 2026-02-13T20:11:31.102 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.102 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.102 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.102 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.103 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.103 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.103 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.103 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.103 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.103 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.103 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.080+0000 7fe7017fa640 4 set_mon_vals no callback set 2026-02-13T20:11:31.103 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.081+0000 7fe7095ae640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:31.103 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.081+0000 7fe7095ae640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:31.103 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.081+0000 7fe7095ae640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:31.103 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.081+0000 7fe7095ae640 1 -- 10.20.193.110:0/2784636638 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7040008d0 con 0x7fe704089c50 2026-02-13T20:11:31.103 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.081+0000 7fe6e37fe640 1 -- 10.20.193.110:0/2784636638 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fe6f4004bc0 con 0x7fe704089c50 2026-02-13T20:11:31.103 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.081+0000 7fe6e37fe640 1 -- 10.20.193.110:0/2784636638 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3559+0+0 (unknown 1530614704 0 0) 0x7fe6f404f840 con 0x7fe704089c50 2026-02-13T20:11:31.104 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.081+0000 7fe702ffd640 10 monclient: get_auth_request con 0x7fe6d003fa70 auth_method 0 2026-02-13T20:11:31.104 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.083+0000 7fe6e37fe640 1 -- 10.20.193.110:0/2784636638 <== mon.0 v1:10.20.193.110:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fe6f4005280 con 0x7fe704089c50 2026-02-13T20:11:31.104 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.083+0000 7fe6e37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:31.104 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.083+0000 7fe6e37fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:11:31.190 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.187+0000 7fe7095ae640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-13T20:11:31.190 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.187+0000 7fe7095ae640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-13T20:11:31.190 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.187+0000 7fe7095ae640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:31.190 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.187+0000 7fe7095ae640 1 -- 10.20.193.110:0/2784636638 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe704058410 con 0x7fe704089c50 2026-02-13T20:11:31.190 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.188+0000 7fe6e37fe640 1 -- 10.20.193.110:0/2784636638 <== mon.0 v1:10.20.193.110:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+11033 (unknown 941590788 0 3918766763) 0x7fe6f4017900 con 0x7fe704089c50 2026-02-13T20:11:31.191 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.188+0000 7fe6e37fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-13T20:11:31.191 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.188+0000 7fe6e37fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:11:31.191 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:31.191 INFO:teuthology.orchestra.run.trial110.stdout:{"epoch":19,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","created":"2026-02-13T20:11:18.047609+0000","modified":"2026-02-13T20:11:30.558875+0000","last_up_change":"2026-02-13T20:11:22.252754+0000","last_in_change":"2026-02-13T20:11:19.250528+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T20:11:24.136325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-13T20:11:27.043171+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88457b09-7bbe-4ebe-8a8b-4c980153af2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6808","nonce":2638069221}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6809","nonce":2638069221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6811","nonce":2638069221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6810","nonce":2638069221}]},"public_addr":"10.20.193.110:6808/2638069221","cluster_addr":"10.20.193.110:6809/2638069221","heartbeat_back_addr":"10.20.193.110:6811/2638069221","heartbeat_front_addr":"10.20.193.110:6810/2638069221","state":["exists","up"]},{"osd":1,"uuid":"efb2f419-77ef-44b0-ae26-4c448073556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6800","nonce":3182322764}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6801","nonce":3182322764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6803","nonce":3182322764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6802","nonce":3182322764}]},"public_addr":"10.20.193.110:6800/3182322764","cluster_addr":"10.20.193.110:6801/3182322764","heartbeat_back_addr":"10.20.193.110:6803/3182322764","heartbeat_front_addr":"10.20.193.110:6802/3182322764","state":["exists","up"]},{"osd":2,"uuid":"c5a08402-8e10-4d4d-87fe-6236a6766128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6804","nonce":2437753968}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6805","nonce":2437753968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6807","nonce":2437753968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6806","nonce":2437753968}]},"public_addr":"10.20.193.110:6804/2437753968","cluster_addr":"10.20.193.110:6805/2437753968","heartbeat_back_addr":"10.20.193.110:6807/2437753968","heartbeat_front_addr":"10.20.193.110:6806/2437753968","state":["exists","up"]},{"osd":3,"uuid":"3062e357-c62b-4a5d-a4b2-9715c16cfd37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6800","nonce":3648478668}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6801","nonce":3648478668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6803","nonce":3648478668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6802","nonce":3648478668}]},"public_addr":"10.20.193.188:6800/3648478668","cluster_addr":"10.20.193.188:6801/3648478668","heartbeat_back_addr":"10.20.193.188:6803/3648478668","heartbeat_front_addr":"10.20.193.188:6802/3648478668","state":["exists","up"]},{"osd":4,"uuid":"718e9755-3c16-47c8-9df8-c08e4193063d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6804","nonce":1615982170}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6806","nonce":1615982170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6810","nonce":1615982170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6808","nonce":1615982170}]},"public_addr":"10.20.193.188:6804/1615982170","cluster_addr":"10.20.193.188:6806/1615982170","heartbeat_back_addr":"10.20.193.188:6810/1615982170","heartbeat_front_addr":"10.20.193.188:6808/1615982170","state":["exists","up"]},{"osd":5,"uuid":"1508f970-10c7-486a-96d1-76881e826af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6805","nonce":4130810301}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6807","nonce":4130810301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6811","nonce":4130810301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6809","nonce":4130810301}]},"public_addr":"10.20.193.188:6805/4130810301","cluster_addr":"10.20.193.188:6807/4130810301","heartbeat_back_addr":"10.20.193.188:6811/4130810301","heartbeat_front_addr":"10.20.193.188:6809/4130810301","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T20:11:20.798845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T20:11:20.817774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T20:11:20.860524+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T20:11:20.994431+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T20:11:20.970325+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T20:11:21.011291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T20:11:31.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.189+0000 7fe7095ae640 1 -- 10.20.193.110:0/2784636638 >> v1:10.20.193.188:6812/1623052694 conn(0x7fe6d003fa70 legacy=0x7fe6d005ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.189+0000 7fe7095ae640 10 monclient: shutdown 2026-02-13T20:11:31.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.189+0000 7fe7095ae640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:31.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.189+0000 7fe7095ae640 1 -- 10.20.193.110:0/2784636638 >> v1:10.20.193.110:6789/0 conn(0x7fe704089c50 legacy=0x7fe7041a2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.193 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.189+0000 7fe7095ae640 1 -- 10.20.193.110:0/2784636638 shutdown_connections 2026-02-13T20:11:31.193 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.189+0000 7fe7095ae640 1 -- 10.20.193.110:0/2784636638 >> 10.20.193.110:0/2784636638 conn(0x7fe704054e90 msgr2=0x7fe70408de10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:31.193 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.189+0000 7fe7095ae640 1 -- 10.20.193.110:0/2784636638 shutdown_connections 2026-02-13T20:11:31.193 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.189+0000 7fe7095ae640 1 -- 10.20.193.110:0/2784636638 wait complete. 2026-02-13T20:11:31.199 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-13T20:11:31.199 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-13T20:11:31.266 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.264+0000 7f7518c47640 10 monclient: get_monmap_and_config 2026-02-13T20:11:31.266 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.264+0000 7f7518c47640 10 monclient: build_initial_monmap 2026-02-13T20:11:31.267 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.264+0000 7f7518c47640 10 monclient: monmap: 2026-02-13T20:11:31.267 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:31.267 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.267 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:31.266312+0000 2026-02-13T20:11:31.267 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:31.266312+0000 2026-02-13T20:11:31.267 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:31.267 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.267 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:31.267 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:31.267 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:31.267 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.267 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.265+0000 7f7518c47640 1 Processor -- start 2026-02-13T20:11:31.267 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.265+0000 7f7518c47640 1 -- start start 2026-02-13T20:11:31.267 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.265+0000 7f7518c47640 10 monclient: init 2026-02-13T20:11:31.267 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.265+0000 7f7518c47640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:31.267 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.265+0000 7f7518c47640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:11:31.267 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.265+0000 7f7518c47640 10 monclient(hunting): picked mon.noname-b con 0x7f7514091470 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:31.267 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.265+0000 7f7518c47640 10 monclient(hunting): picked mon.noname-a con 0x7f7514092020 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:31.267 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.265+0000 7f7518c47640 10 monclient(hunting): picked mon.noname-c con 0x7f75141401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:31.267 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.265+0000 7f7518c47640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f751405c5b0 con 0x7f7514092020 2026-02-13T20:11:31.268 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.265+0000 7f7518c47640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7514140620 con 0x7f75141401c0 2026-02-13T20:11:31.268 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.265+0000 7f7518c47640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f751408b450 con 0x7f7514091470 2026-02-13T20:11:31.268 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.265+0000 7f7518c47640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:31.268 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.265+0000 7f7518c47640 10 monclient(hunting): authenticate will time out at 652.956895s 2026-02-13T20:11:31.268 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.265+0000 7f7512575640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f7514091470 0x7f7514091840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:39572/0 (socket says 10.20.193.110:39572) 2026-02-13T20:11:31.269 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.265+0000 7f7512575640 1 -- 10.20.193.110:0/346275205 learned_addr learned my addr 10.20.193.110:0/346275205 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:31.269 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.266+0000 7f7511573640 1 -- 10.20.193.110:0/346275205 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2498246720 0 0) 0x7f751408b450 con 0x7f7514091470 2026-02-13T20:11:31.269 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.266+0000 7f7511573640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.269 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.266+0000 7f7511573640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.269 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.266+0000 7f7511573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.269 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.266+0000 7f7511573640 10 monclient(hunting): my global_id is 4244 2026-02-13T20:11:31.269 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.266+0000 7f7511573640 1 -- 10.20.193.110:0/346275205 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f75000035e0 con 0x7f7514091470 2026-02-13T20:11:31.269 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.266+0000 7f7511573640 1 -- 10.20.193.110:0/346275205 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 242602250 0 0) 0x7f751405c5b0 con 0x7f7514092020 2026-02-13T20:11:31.269 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.266+0000 7f7511573640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.269 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.266+0000 7f7511573640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.269 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.266+0000 7f7511573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.269 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.266+0000 7f7511573640 10 monclient(hunting): my global_id is 4248 2026-02-13T20:11:31.269 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.266+0000 7f7511573640 1 -- 10.20.193.110:0/346275205 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f751408b450 con 0x7f7514092020 2026-02-13T20:11:31.269 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.266+0000 7f7511573640 1 -- 10.20.193.110:0/346275205 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 283750757 0 0) 0x7f751408b450 con 0x7f7514092020 2026-02-13T20:11:31.269 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.266+0000 7f7511573640 1 -- 10.20.193.110:0/346275205 >> v1:10.20.193.110:6790/0 conn(0x7f7514091470 legacy=0x7f7514091840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.269 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.266+0000 7f7511573640 1 -- 10.20.193.110:0/346275205 >> v1:10.20.193.188:6789/0 conn(0x7f75141401c0 legacy=0x7f75141a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.269 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.266+0000 7f7511573640 10 monclient: _finish_hunting 0 2026-02-13T20:11:31.269 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.266+0000 7f7511573640 1 monclient: found mon.noname-a 2026-02-13T20:11:31.269 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.266+0000 7f7511573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:31.269 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.266+0000 7f7511573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:11:31.269 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.266+0000 7f7511573640 1 -- 10.20.193.110:0/346275205 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f751408b730 con 0x7f7514092020 2026-02-13T20:11:31.269 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.266+0000 7f7511573640 10 monclient: _finish_auth 0 2026-02-13T20:11:31.269 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.266+0000 7f7511573640 10 monclient: _check_auth_tickets 2026-02-13T20:11:31.269 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.266+0000 7f7511573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:31.269 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.266+0000 7f7511573640 1 -- 10.20.193.110:0/346275205 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f74fc002dd0 con 0x7f7514092020 2026-02-13T20:11:31.269 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.266+0000 7f7511573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:31.269 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.266+0000 7f7511573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:11:31.269 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.266+0000 7f7511573640 10 monclient: dump: 2026-02-13T20:11:31.269 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.269 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.269 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.269 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.269 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.269 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.269 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.269 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.269 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.270 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.270 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.266+0000 7f7518c47640 5 monclient: authenticate success, global_id 4248 2026-02-13T20:11:31.270 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.266+0000 7f7518c47640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:31.270 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.266+0000 7f7511573640 1 -- 10.20.193.110:0/346275205 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f74fc003050 con 0x7f7514092020 2026-02-13T20:11:31.270 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.266+0000 7f7511573640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:31.270 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.266+0000 7f7511573640 1 -- 10.20.193.110:0/346275205 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f74fc003460 con 0x7f7514092020 2026-02-13T20:11:31.270 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.266+0000 7f7511573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:31.270 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.266+0000 7f7511573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:31.270 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.266+0000 7f7511573640 10 monclient: dump: 2026-02-13T20:11:31.270 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.270 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.270 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.270 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.270 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.270 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.270 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.270 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.270 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.270 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.270 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.266+0000 7f7518c47640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:31.270 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.266+0000 7f7518c47640 4 set_mon_vals no callback set 2026-02-13T20:11:31.270 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.266+0000 7f7518c47640 10 monclient: shutdown 2026-02-13T20:11:31.270 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.266+0000 7f7518c47640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:31.270 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.266+0000 7f7518c47640 1 -- 10.20.193.110:0/346275205 >> v1:10.20.193.110:6789/0 conn(0x7f7514092020 legacy=0x7f75141812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.270 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.266+0000 7f7518c47640 1 -- 10.20.193.110:0/346275205 shutdown_connections 2026-02-13T20:11:31.270 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.266+0000 7f7518c47640 1 -- 10.20.193.110:0/346275205 >> 10.20.193.110:0/346275205 conn(0x7f7514054e90 msgr2=0x7f7514058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:31.270 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.266+0000 7f7518c47640 1 -- 10.20.193.110:0/346275205 shutdown_connections 2026-02-13T20:11:31.270 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.266+0000 7f7518c47640 1 -- 10.20.193.110:0/346275205 wait complete. 2026-02-13T20:11:31.271 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.267+0000 7f7518c47640 10 monclient: build_initial_monmap 2026-02-13T20:11:31.272 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.267+0000 7f7518c47640 10 monclient: monmap: 2026-02-13T20:11:31.272 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:31.272 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:31.272 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:11:31.272 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:11:31.272 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:31.272 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:11:31.272 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:31.272 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:31.272 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:31.272 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.272 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.267+0000 7f7518c47640 1 Processor -- start 2026-02-13T20:11:31.272 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.267+0000 7f7518c47640 1 -- start start 2026-02-13T20:11:31.272 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.267+0000 7f7518c47640 10 monclient: init 2026-02-13T20:11:31.272 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.267+0000 7f7518c47640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:31.272 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.267+0000 7f7518c47640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:11:31.272 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.267+0000 7f7518c47640 10 monclient(hunting): picked mon.noname-b con 0x7f7514091470 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:31.272 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.267+0000 7f7518c47640 10 monclient(hunting): picked mon.noname-a con 0x7f75141401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:31.272 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.267+0000 7f7518c47640 10 monclient(hunting): picked mon.noname-c con 0x7f751408f3c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:31.272 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.267+0000 7f7518c47640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f751405d320 con 0x7f75141401c0 2026-02-13T20:11:31.272 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.267+0000 7f7518c47640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f751413f450 con 0x7f7514091470 2026-02-13T20:11:31.272 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.267+0000 7f7518c47640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f751413ed50 con 0x7f751408f3c0 2026-02-13T20:11:31.272 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.267+0000 7f7518c47640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:31.272 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.267+0000 7f7518c47640 10 monclient(hunting): authenticate will time out at 652.958798s 2026-02-13T20:11:31.272 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.267+0000 7f7511d74640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f75141401c0 0x7f751413e640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:59842/0 (socket says 10.20.193.110:59842) 2026-02-13T20:11:31.272 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.267+0000 7f7511d74640 1 -- 10.20.193.110:0/710743091 learned_addr learned my addr 10.20.193.110:0/710743091 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:31.272 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.267+0000 7f7512d76640 1 --1- 10.20.193.110:0/710743091 >> v1:10.20.193.110:6790/0 conn(0x7f751408f3c0 0x7f75141a20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:39580/0 (socket says 10.20.193.110:39580) 2026-02-13T20:11:31.272 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.267+0000 7f74faffd640 1 -- 10.20.193.110:0/710743091 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3913877592 0 0) 0x7f751405d320 con 0x7f75141401c0 2026-02-13T20:11:31.272 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.267+0000 7f74faffd640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.272 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.267+0000 7f74faffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.272 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.267+0000 7f74faffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.272 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.267+0000 7f74faffd640 10 monclient(hunting): my global_id is 4251 2026-02-13T20:11:31.272 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.268+0000 7f74faffd640 1 -- 10.20.193.110:0/710743091 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74e00035e0 con 0x7f75141401c0 2026-02-13T20:11:31.272 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.268+0000 7f74faffd640 1 -- 10.20.193.110:0/710743091 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2722780652 0 0) 0x7f751413ed50 con 0x7f751408f3c0 2026-02-13T20:11:31.272 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.268+0000 7f74faffd640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.272 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.268+0000 7f74faffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.272 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.268+0000 7f74faffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.272 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.268+0000 7f74faffd640 10 monclient(hunting): my global_id is 4247 2026-02-13T20:11:31.272 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.268+0000 7f74faffd640 1 -- 10.20.193.110:0/710743091 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f751405d320 con 0x7f751408f3c0 2026-02-13T20:11:31.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.268+0000 7f74faffd640 1 -- 10.20.193.110:0/710743091 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3265023366 0 0) 0x7f74e00035e0 con 0x7f75141401c0 2026-02-13T20:11:31.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.268+0000 7f74faffd640 1 -- 10.20.193.110:0/710743091 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f751413ed50 con 0x7f75141401c0 2026-02-13T20:11:31.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.268+0000 7f74faffd640 1 -- 10.20.193.110:0/710743091 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f74fc003370 con 0x7f75141401c0 2026-02-13T20:11:31.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.268+0000 7f74faffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:31.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.268+0000 7f74faffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:11:31.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.268+0000 7f74faffd640 10 monclient(hunting): dump: 2026-02-13T20:11:31.273 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.273 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.273 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.273 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.273 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.273 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.273 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.273 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.273 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.273 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.268+0000 7f74faffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:31.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.268+0000 7f74faffd640 1 -- 10.20.193.110:0/710743091 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1639107 0 0) 0x7f751405d320 con 0x7f751408f3c0 2026-02-13T20:11:31.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.268+0000 7f74faffd640 1 -- 10.20.193.110:0/710743091 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f74e00035e0 con 0x7f751408f3c0 2026-02-13T20:11:31.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.268+0000 7f74faffd640 1 -- 10.20.193.110:0/710743091 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f7504004110 con 0x7f751408f3c0 2026-02-13T20:11:31.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.268+0000 7f74faffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:31.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.268+0000 7f74faffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:31.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.268+0000 7f74faffd640 10 monclient(hunting): dump: 2026-02-13T20:11:31.273 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.273 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.273 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.273 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.273 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.273 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.273 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.273 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.273 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.273 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.268+0000 7f74faffd640 1 -- 10.20.193.110:0/710743091 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 964565139 0 0) 0x7f751413ed50 con 0x7f75141401c0 2026-02-13T20:11:31.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.268+0000 7f74faffd640 1 -- 10.20.193.110:0/710743091 >> v1:10.20.193.110:6790/0 conn(0x7f751408f3c0 legacy=0x7f75141a20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.268+0000 7f74faffd640 1 -- 10.20.193.110:0/710743091 >> v1:10.20.193.188:6789/0 conn(0x7f7514091470 legacy=0x7f751413df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.268+0000 7f74faffd640 10 monclient: _finish_hunting 0 2026-02-13T20:11:31.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.268+0000 7f74faffd640 1 monclient: found mon.a 2026-02-13T20:11:31.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.268+0000 7f74faffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:31.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.268+0000 7f74faffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:31.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.268+0000 7f74faffd640 1 -- 10.20.193.110:0/710743091 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f751408fdd0 con 0x7f75141401c0 2026-02-13T20:11:31.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.268+0000 7f74faffd640 10 monclient: _finish_auth 0 2026-02-13T20:11:31.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.268+0000 7f74faffd640 10 monclient: _check_auth_tickets 2026-02-13T20:11:31.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.268+0000 7f74faffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:31.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.268+0000 7f7518c47640 5 monclient: authenticate success, global_id 4251 2026-02-13T20:11:31.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.268+0000 7f7518c47640 10 monclient: _renew_subs 2026-02-13T20:11:31.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.268+0000 7f7518c47640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:31.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.268+0000 7f7518c47640 1 -- 10.20.193.110:0/710743091 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7514090dc0 con 0x7f75141401c0 2026-02-13T20:11:31.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.268+0000 7f7518c47640 10 monclient: _renew_subs 2026-02-13T20:11:31.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.268+0000 7f7518c47640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:31.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.268+0000 7f7518c47640 1 -- 10.20.193.110:0/710743091 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f751410d950 con 0x7f75141401c0 2026-02-13T20:11:31.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.268+0000 7f74faffd640 1 -- 10.20.193.110:0/710743091 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f74fc002960 con 0x7f75141401c0 2026-02-13T20:11:31.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.268+0000 7f74faffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:31.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.268+0000 7f74faffd640 1 -- 10.20.193.110:0/710743091 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f74fc003bd0 con 0x7f75141401c0 2026-02-13T20:11:31.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.268+0000 7f74faffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:31.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.268+0000 7f74faffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:31.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.268+0000 7f74faffd640 10 monclient: dump: 2026-02-13T20:11:31.274 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.274 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.274 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.274 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.274 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.274 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.274 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.274 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.274 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.274 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.268+0000 7f7510d72640 4 set_mon_vals no callback set 2026-02-13T20:11:31.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.268+0000 7f74faffd640 1 -- 10.20.193.110:0/710743091 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f74fc003d30 con 0x7f75141401c0 2026-02-13T20:11:31.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.268+0000 7f7518c47640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:31.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.268+0000 7f7518c47640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:31.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.268+0000 7f7518c47640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:31.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.268+0000 7f7518c47640 1 -- 10.20.193.110:0/710743091 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f751410c440 con 0x7f75141401c0 2026-02-13T20:11:31.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.269+0000 7f74faffd640 1 -- 10.20.193.110:0/710743091 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3559+0+0 (unknown 1530614704 0 0) 0x7f74fc04e8d0 con 0x7f75141401c0 2026-02-13T20:11:31.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.269+0000 7f7512575640 10 monclient: get_auth_request con 0x7f74e003fa70 auth_method 0 2026-02-13T20:11:31.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.271+0000 7f74faffd640 1 -- 10.20.193.110:0/710743091 <== mon.0 v1:10.20.193.110:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f74fc004430 con 0x7f75141401c0 2026-02-13T20:11:31.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.271+0000 7f74faffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:31.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.271+0000 7f74faffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:11:31.377 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.375+0000 7f7518c47640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-13T20:11:31.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.375+0000 7f7518c47640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-13T20:11:31.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.375+0000 7f7518c47640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:31.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.375+0000 7f7518c47640 1 -- 10.20.193.110:0/710743091 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f75140908a0 con 0x7f75141401c0 2026-02-13T20:11:31.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.375+0000 7f74faffd640 1 -- 10.20.193.110:0/710743091 <== mon.0 v1:10.20.193.110:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+11033 (unknown 941590788 0 3918766763) 0x7f74fc0169f0 con 0x7f75141401c0 2026-02-13T20:11:31.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.375+0000 7f74faffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-13T20:11:31.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.375+0000 7f74faffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:11:31.379 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:31.379 INFO:teuthology.orchestra.run.trial110.stdout:{"epoch":19,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","created":"2026-02-13T20:11:18.047609+0000","modified":"2026-02-13T20:11:30.558875+0000","last_up_change":"2026-02-13T20:11:22.252754+0000","last_in_change":"2026-02-13T20:11:19.250528+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T20:11:24.136325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-13T20:11:27.043171+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88457b09-7bbe-4ebe-8a8b-4c980153af2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6808","nonce":2638069221}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6809","nonce":2638069221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6811","nonce":2638069221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6810","nonce":2638069221}]},"public_addr":"10.20.193.110:6808/2638069221","cluster_addr":"10.20.193.110:6809/2638069221","heartbeat_back_addr":"10.20.193.110:6811/2638069221","heartbeat_front_addr":"10.20.193.110:6810/2638069221","state":["exists","up"]},{"osd":1,"uuid":"efb2f419-77ef-44b0-ae26-4c448073556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6800","nonce":3182322764}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6801","nonce":3182322764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6803","nonce":3182322764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6802","nonce":3182322764}]},"public_addr":"10.20.193.110:6800/3182322764","cluster_addr":"10.20.193.110:6801/3182322764","heartbeat_back_addr":"10.20.193.110:6803/3182322764","heartbeat_front_addr":"10.20.193.110:6802/3182322764","state":["exists","up"]},{"osd":2,"uuid":"c5a08402-8e10-4d4d-87fe-6236a6766128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6804","nonce":2437753968}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6805","nonce":2437753968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6807","nonce":2437753968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6806","nonce":2437753968}]},"public_addr":"10.20.193.110:6804/2437753968","cluster_addr":"10.20.193.110:6805/2437753968","heartbeat_back_addr":"10.20.193.110:6807/2437753968","heartbeat_front_addr":"10.20.193.110:6806/2437753968","state":["exists","up"]},{"osd":3,"uuid":"3062e357-c62b-4a5d-a4b2-9715c16cfd37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6800","nonce":3648478668}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6801","nonce":3648478668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6803","nonce":3648478668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6802","nonce":3648478668}]},"public_addr":"10.20.193.188:6800/3648478668","cluster_addr":"10.20.193.188:6801/3648478668","heartbeat_back_addr":"10.20.193.188:6803/3648478668","heartbeat_front_addr":"10.20.193.188:6802/3648478668","state":["exists","up"]},{"osd":4,"uuid":"718e9755-3c16-47c8-9df8-c08e4193063d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6804","nonce":1615982170}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6806","nonce":1615982170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6810","nonce":1615982170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6808","nonce":1615982170}]},"public_addr":"10.20.193.188:6804/1615982170","cluster_addr":"10.20.193.188:6806/1615982170","heartbeat_back_addr":"10.20.193.188:6810/1615982170","heartbeat_front_addr":"10.20.193.188:6808/1615982170","state":["exists","up"]},{"osd":5,"uuid":"1508f970-10c7-486a-96d1-76881e826af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6805","nonce":4130810301}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6807","nonce":4130810301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6811","nonce":4130810301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6809","nonce":4130810301}]},"public_addr":"10.20.193.188:6805/4130810301","cluster_addr":"10.20.193.188:6807/4130810301","heartbeat_back_addr":"10.20.193.188:6811/4130810301","heartbeat_front_addr":"10.20.193.188:6809/4130810301","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T20:11:20.798845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T20:11:20.817774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T20:11:20.860524+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T20:11:20.994431+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T20:11:20.970325+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T20:11:21.011291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T20:11:31.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.376+0000 7f7518c47640 1 -- 10.20.193.110:0/710743091 >> v1:10.20.193.188:6812/1623052694 conn(0x7f74e003fa70 legacy=0x7f74e005ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.376+0000 7f7518c47640 10 monclient: shutdown 2026-02-13T20:11:31.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.376+0000 7f7518c47640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:31.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.376+0000 7f7518c47640 1 -- 10.20.193.110:0/710743091 >> v1:10.20.193.110:6789/0 conn(0x7f75141401c0 legacy=0x7f751413e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.376+0000 7f7518c47640 1 -- 10.20.193.110:0/710743091 shutdown_connections 2026-02-13T20:11:31.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.376+0000 7f7518c47640 1 -- 10.20.193.110:0/710743091 >> 10.20.193.110:0/710743091 conn(0x7f7514054e90 msgr2=0x7f7514125730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:31.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.376+0000 7f7518c47640 1 -- 10.20.193.110:0/710743091 shutdown_connections 2026-02-13T20:11:31.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.376+0000 7f7518c47640 1 -- 10.20.193.110:0/710743091 wait complete. 2026-02-13T20:11:31.387 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-13T20:11:31.388 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-13T20:11:31.389 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-13T20:11:31.389 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-13T20:11:31.389 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2026-02-13T20:11:31.390 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2026-02-13T20:11:31.457 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.455+0000 7ff6a4c8c640 10 monclient: get_monmap_and_config 2026-02-13T20:11:31.458 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.455+0000 7ff6a4c8c640 10 monclient: build_initial_monmap 2026-02-13T20:11:31.458 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.455+0000 7ff6a4c8c640 10 monclient: monmap: 2026-02-13T20:11:31.458 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:31.458 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.458 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:31.456773+0000 2026-02-13T20:11:31.458 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:31.456773+0000 2026-02-13T20:11:31.458 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:31.458 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.458 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:31.459 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:31.459 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:31.459 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.459 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.455+0000 7f2bfa812640 10 monclient: get_monmap_and_config 2026-02-13T20:11:31.460 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.455+0000 7f2bfa812640 10 monclient: build_initial_monmap 2026-02-13T20:11:31.460 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.455+0000 7f2bfa812640 10 monclient: monmap: 2026-02-13T20:11:31.460 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:31.460 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.460 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:31.456974+0000 2026-02-13T20:11:31.460 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:31.456974+0000 2026-02-13T20:11:31.460 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:31.460 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.460 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:31.460 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:31.461 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:31.461 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.461 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.455+0000 7ff6a4c8c640 1 Processor -- start 2026-02-13T20:11:31.461 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.455+0000 7ff6a4c8c640 1 -- start start 2026-02-13T20:11:31.461 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.455+0000 7ff6a4c8c640 10 monclient: init 2026-02-13T20:11:31.462 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.455+0000 7f2bfa812640 1 Processor -- start 2026-02-13T20:11:31.462 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7f2bfa812640 1 -- start start 2026-02-13T20:11:31.462 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7f2bfa812640 10 monclient: init 2026-02-13T20:11:31.464 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7ff6a4c8c640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:31.464 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7ff6a4c8c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:11:31.464 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7ff6a4c8c640 10 monclient(hunting): picked mon.noname-a con 0x7ff6a01401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:31.464 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7ff6a4c8c640 10 monclient(hunting): picked mon.noname-c con 0x7ff6a0092020 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:31.464 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7ff6a4c8c640 10 monclient(hunting): picked mon.noname-b con 0x7ff6a0091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:31.464 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7ff6a4c8c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6a008b730 con 0x7ff6a01401c0 2026-02-13T20:11:31.464 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7ff6a4c8c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6a005c5b0 con 0x7ff6a0092020 2026-02-13T20:11:31.464 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7ff6a4c8c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6a008bcf0 con 0x7ff6a0091950 2026-02-13T20:11:31.464 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7ff6a4c8c640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:31.465 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7ff6a4c8c640 10 monclient(hunting): authenticate will time out at 653.147169s 2026-02-13T20:11:31.465 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7ff69ed76640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7ff6a0091950 0x7ff6a01a2a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:39586/0 (socket says 10.20.193.110:39586) 2026-02-13T20:11:31.465 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7ff69ed76640 1 -- 10.20.193.110:0/404722735 learned_addr learned my addr 10.20.193.110:0/404722735 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:31.465 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7ff69e575640 1 --1- 10.20.193.110:0/404722735 >> v1:10.20.193.110:6789/0 conn(0x7ff6a01401c0 0x7ff6a0091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:59846/0 (socket says 10.20.193.110:59846) 2026-02-13T20:11:31.465 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7f2bfa812640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:31.465 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7f2bfa812640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:11:31.466 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7fede679d640 10 monclient: get_monmap_and_config 2026-02-13T20:11:31.466 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7fede679d640 10 monclient: build_initial_monmap 2026-02-13T20:11:31.466 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7f2bfa812640 10 monclient(hunting): picked mon.noname-a con 0x7f2bf4089250 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:31.467 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7fede679d640 10 monclient: monmap: 2026-02-13T20:11:31.467 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:31.467 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.467 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:31.457720+0000 2026-02-13T20:11:31.467 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:31.457720+0000 2026-02-13T20:11:31.467 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:31.467 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.467 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:31.468 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:31.468 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:31.468 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.469 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7f2bfa812640 10 monclient(hunting): picked mon.noname-c con 0x7f2bf4057780 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:31.469 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7f2bfa812640 10 monclient(hunting): picked mon.noname-b con 0x7f2bf4184b60 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:31.469 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7f2bfa812640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bf408a950 con 0x7f2bf4089250 2026-02-13T20:11:31.469 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7f2bfa812640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bf4089620 con 0x7f2bf4057780 2026-02-13T20:11:31.469 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7f2bfa812640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bf4057c60 con 0x7f2bf4184b60 2026-02-13T20:11:31.469 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7f2bfa812640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:31.469 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7f2bfa812640 10 monclient(hunting): authenticate will time out at 653.147406s 2026-02-13T20:11:31.469 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7f2bf3fff640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f2bf4089250 0x7f2bf40580b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:59852/0 (socket says 10.20.193.110:59852) 2026-02-13T20:11:31.470 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7f2bf3fff640 1 -- 10.20.193.110:0/2330999558 learned_addr learned my addr 10.20.193.110:0/2330999558 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:31.471 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7ff69d573640 1 -- 10.20.193.110:0/404722735 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 116266097 0 0) 0x7ff6a008bcf0 con 0x7ff6a0091950 2026-02-13T20:11:31.471 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7ff69d573640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.471 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7ff69d573640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.471 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7ff69d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.471 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7ff69d573640 10 monclient(hunting): my global_id is 4250 2026-02-13T20:11:31.471 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7ff69d573640 1 -- 10.20.193.110:0/404722735 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff68c0035e0 con 0x7ff6a0091950 2026-02-13T20:11:31.472 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7ff69d573640 1 -- 10.20.193.110:0/404722735 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3549968899 0 0) 0x7ff6a008b730 con 0x7ff6a01401c0 2026-02-13T20:11:31.472 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7ff69d573640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.472 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7ff69d573640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.472 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7ff69d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.472 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7ff69d573640 10 monclient(hunting): my global_id is 4254 2026-02-13T20:11:31.472 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7ff69d573640 1 -- 10.20.193.110:0/404722735 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6a008bcf0 con 0x7ff6a01401c0 2026-02-13T20:11:31.472 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7ff69d573640 1 -- 10.20.193.110:0/404722735 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 181991283 0 0) 0x7ff6a005c5b0 con 0x7ff6a0092020 2026-02-13T20:11:31.472 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7ff69d573640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.472 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7ff69d573640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.472 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7ff69d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.473 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7ff69d573640 10 monclient(hunting): my global_id is 4258 2026-02-13T20:11:31.473 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7ff69d573640 1 -- 10.20.193.110:0/404722735 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6a008b730 con 0x7ff6a0092020 2026-02-13T20:11:31.473 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7f2bf2ffd640 1 -- 10.20.193.110:0/2330999558 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 683756551 0 0) 0x7f2bf408a950 con 0x7f2bf4089250 2026-02-13T20:11:31.473 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7f2bf2ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.473 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7f2bf2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7f2bf2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7f2bf2ffd640 10 monclient(hunting): my global_id is 4257 2026-02-13T20:11:31.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7f2bf2ffd640 1 -- 10.20.193.110:0/2330999558 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2bd80035e0 con 0x7f2bf4089250 2026-02-13T20:11:31.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7fede679d640 1 Processor -- start 2026-02-13T20:11:31.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7fede679d640 1 -- start start 2026-02-13T20:11:31.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7fede679d640 10 monclient: init 2026-02-13T20:11:31.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7ff69d573640 1 -- 10.20.193.110:0/404722735 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3701009450 0 0) 0x7ff68c0035e0 con 0x7ff6a0091950 2026-02-13T20:11:31.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7ff69d573640 1 -- 10.20.193.110:0/404722735 >> v1:10.20.193.188:6789/0 conn(0x7ff6a0092020 legacy=0x7ff6a01812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7ff69d573640 1 -- 10.20.193.110:0/404722735 >> v1:10.20.193.110:6789/0 conn(0x7ff6a01401c0 legacy=0x7ff6a0091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7ff69d573640 10 monclient: _finish_hunting 0 2026-02-13T20:11:31.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7ff69d573640 1 monclient: found mon.noname-b 2026-02-13T20:11:31.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7ff69d573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:31.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7ff69d573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:11:31.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7ff69d573640 1 -- 10.20.193.110:0/404722735 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6a0140590 con 0x7ff6a0091950 2026-02-13T20:11:31.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7ff69d573640 10 monclient: _finish_auth 0 2026-02-13T20:11:31.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7ff69d573640 10 monclient: _check_auth_tickets 2026-02-13T20:11:31.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7ff69d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:31.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7ff69d573640 1 -- 10.20.193.110:0/404722735 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff690003eb0 con 0x7ff6a0091950 2026-02-13T20:11:31.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7ff69d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:31.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7ff69d573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:11:31.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7ff69d573640 10 monclient: dump: 2026-02-13T20:11:31.477 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.478 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.478 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.478 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.478 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.478 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.478 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.478 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.478 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.478 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7f2bf2ffd640 1 -- 10.20.193.110:0/2330999558 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1104842835 0 0) 0x7f2bf4057c60 con 0x7f2bf4184b60 2026-02-13T20:11:31.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7f2bf2ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7f2bf2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7ff6a4c8c640 5 monclient: authenticate success, global_id 4250 2026-02-13T20:11:31.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7ff6a4c8c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:31.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7f2bf2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7f2bf2ffd640 10 monclient(hunting): my global_id is 4253 2026-02-13T20:11:31.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7f2bf2ffd640 1 -- 10.20.193.110:0/2330999558 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2bf408a950 con 0x7f2bf4184b60 2026-02-13T20:11:31.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7f2bf2ffd640 1 -- 10.20.193.110:0/2330999558 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 739346233 0 0) 0x7f2bf4089620 con 0x7f2bf4057780 2026-02-13T20:11:31.482 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7f2bf2ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.482 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7f2bf2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.482 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7f2bf2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.482 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7f2bf2ffd640 10 monclient(hunting): my global_id is 4261 2026-02-13T20:11:31.482 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7f2bf2ffd640 1 -- 10.20.193.110:0/2330999558 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2bf4057c60 con 0x7f2bf4057780 2026-02-13T20:11:31.482 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7f2bf2ffd640 1 -- 10.20.193.110:0/2330999558 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 330171920 0 0) 0x7f2bd80035e0 con 0x7f2bf4089250 2026-02-13T20:11:31.482 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7f2bf2ffd640 1 -- 10.20.193.110:0/2330999558 >> v1:10.20.193.110:6790/0 conn(0x7f2bf4184b60 legacy=0x7f2bf41a4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.482 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7f2bf2ffd640 1 -- 10.20.193.110:0/2330999558 >> v1:10.20.193.188:6789/0 conn(0x7f2bf4057780 legacy=0x7f2bf4183440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.483 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7f2bf2ffd640 10 monclient: _finish_hunting 0 2026-02-13T20:11:31.483 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7f2bf2ffd640 1 monclient: found mon.noname-a 2026-02-13T20:11:31.483 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7f2bf2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:31.483 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7f2bf2ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:11:31.483 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7f2bf2ffd640 1 -- 10.20.193.110:0/2330999558 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bf4089a50 con 0x7f2bf4089250 2026-02-13T20:11:31.483 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7f2bf2ffd640 10 monclient: _finish_auth 0 2026-02-13T20:11:31.483 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7f2bf2ffd640 10 monclient: _check_auth_tickets 2026-02-13T20:11:31.483 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7f2bf2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:31.483 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7f2bf2ffd640 1 -- 10.20.193.110:0/2330999558 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f2be0002dd0 con 0x7f2bf4089250 2026-02-13T20:11:31.483 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7f2bf2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:31.483 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7f2bf2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:11:31.483 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7f2bf2ffd640 10 monclient: dump: 2026-02-13T20:11:31.484 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.484 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.484 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.484 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.484 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.484 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.484 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.484 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.484 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.484 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.484 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7f2bfa812640 5 monclient: authenticate success, global_id 4257 2026-02-13T20:11:31.484 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.456+0000 7f2bfa812640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:31.485 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7ff69d573640 1 -- 10.20.193.110:0/404722735 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff6900040c0 con 0x7ff6a0091950 2026-02-13T20:11:31.486 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7ff69d573640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:31.486 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7ff6a4c8c640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:31.486 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7ff6a4c8c640 4 set_mon_vals no callback set 2026-02-13T20:11:31.486 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7ff69d573640 1 -- 10.20.193.110:0/404722735 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff6900044a0 con 0x7ff6a0091950 2026-02-13T20:11:31.486 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7ff69d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:31.486 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7ff69d573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:31.486 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7ff69d573640 10 monclient: dump: 2026-02-13T20:11:31.486 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.486 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.486 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.486 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.486 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.487 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.487 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.487 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.487 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.487 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.487 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7f2bf2ffd640 1 -- 10.20.193.110:0/2330999558 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2be0002fd0 con 0x7f2bf4089250 2026-02-13T20:11:31.488 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7f2bf2ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:31.488 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7f2bfa812640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:31.488 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7f2bfa812640 4 set_mon_vals no callback set 2026-02-13T20:11:31.488 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7f2bf2ffd640 1 -- 10.20.193.110:0/2330999558 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f2be00033e0 con 0x7f2bf4089250 2026-02-13T20:11:31.488 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7f2bf2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:31.488 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7f2bf2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:31.488 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7f2bf2ffd640 10 monclient: dump: 2026-02-13T20:11:31.488 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.488 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.488 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.488 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.489 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.489 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.489 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.489 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.489 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.489 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.490 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7fede679d640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:31.490 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7fede679d640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:11:31.490 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7fede679d640 10 monclient(hunting): picked mon.noname-b con 0x7fede0089250 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:31.490 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7fede679d640 10 monclient(hunting): picked mon.noname-a con 0x7fede0057780 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:31.490 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7fede679d640 10 monclient(hunting): picked mon.noname-c con 0x7fede0184b60 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:31.491 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7fede679d640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fede008a950 con 0x7fede0057780 2026-02-13T20:11:31.491 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7fede679d640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fede0089620 con 0x7fede0184b60 2026-02-13T20:11:31.491 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7fede679d640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fede0057c60 con 0x7fede0089250 2026-02-13T20:11:31.491 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7fede679d640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:31.491 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7fede679d640 10 monclient(hunting): authenticate will time out at 653.148218s 2026-02-13T20:11:31.491 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7feddffff640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fede0089250 0x7fede00580b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:39608/0 (socket says 10.20.193.110:39608) 2026-02-13T20:11:31.491 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7feddffff640 1 -- 10.20.193.110:0/1966125923 learned_addr learned my addr 10.20.193.110:0/1966125923 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:31.491 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7feddf7fe640 1 --1- 10.20.193.110:0/1966125923 >> v1:10.20.193.110:6789/0 conn(0x7fede0057780 0x7fede0183440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:59866/0 (socket says 10.20.193.110:59866) 2026-02-13T20:11:31.492 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7ff6a4c8c640 10 monclient: shutdown 2026-02-13T20:11:31.492 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7ff6a4c8c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:31.492 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7ff6a4c8c640 1 -- 10.20.193.110:0/404722735 >> v1:10.20.193.110:6790/0 conn(0x7ff6a0091950 legacy=0x7ff6a01a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.492 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7ff6a4c8c640 1 -- 10.20.193.110:0/404722735 shutdown_connections 2026-02-13T20:11:31.492 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7ff6a4c8c640 1 -- 10.20.193.110:0/404722735 >> 10.20.193.110:0/404722735 conn(0x7ff6a0054e90 msgr2=0x7ff6a0058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:31.492 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7ff6a4c8c640 1 -- 10.20.193.110:0/404722735 shutdown_connections 2026-02-13T20:11:31.492 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7ff6a4c8c640 1 -- 10.20.193.110:0/404722735 wait complete. 2026-02-13T20:11:31.492 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7f21d9e12640 10 monclient: get_monmap_and_config 2026-02-13T20:11:31.493 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7f21d9e12640 10 monclient: build_initial_monmap 2026-02-13T20:11:31.493 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7f2bfa812640 10 monclient: shutdown 2026-02-13T20:11:31.493 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7f2bfa812640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:31.493 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7f2bfa812640 1 -- 10.20.193.110:0/2330999558 >> v1:10.20.193.110:6789/0 conn(0x7f2bf4089250 legacy=0x7f2bf40580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.493 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7f21d9e12640 10 monclient: monmap: 2026-02-13T20:11:31.493 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:31.493 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.493 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:31.458745+0000 2026-02-13T20:11:31.494 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:31.458745+0000 2026-02-13T20:11:31.494 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:31.494 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.494 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:31.494 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:31.494 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:31.494 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7f2bfa812640 1 -- 10.20.193.110:0/2330999558 shutdown_connections 2026-02-13T20:11:31.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7f2bfa812640 1 -- 10.20.193.110:0/2330999558 >> 10.20.193.110:0/2330999558 conn(0x7f2bf4054330 msgr2=0x7f2bf4054730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:31.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7f2bfa812640 1 -- 10.20.193.110:0/2330999558 shutdown_connections 2026-02-13T20:11:31.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7f2bfa812640 1 -- 10.20.193.110:0/2330999558 wait complete. 2026-02-13T20:11:31.496 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7feddeffd640 1 -- 10.20.193.110:0/1966125923 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1020065422 0 0) 0x7fede0057c60 con 0x7fede0089250 2026-02-13T20:11:31.496 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7feddeffd640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.496 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7feddeffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.496 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7feddeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.496 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7feddeffd640 10 monclient(hunting): my global_id is 4256 2026-02-13T20:11:31.496 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7feddeffd640 1 -- 10.20.193.110:0/1966125923 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedc40035e0 con 0x7fede0089250 2026-02-13T20:11:31.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7feddeffd640 1 -- 10.20.193.110:0/1966125923 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2173318089 0 0) 0x7fede008a950 con 0x7fede0057780 2026-02-13T20:11:31.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7feddeffd640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7feddeffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7feddeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7feddeffd640 10 monclient(hunting): my global_id is 4260 2026-02-13T20:11:31.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7feddeffd640 1 -- 10.20.193.110:0/1966125923 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fede0057c60 con 0x7fede0057780 2026-02-13T20:11:31.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7feddeffd640 1 -- 10.20.193.110:0/1966125923 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 336377185 0 0) 0x7fede0089620 con 0x7fede0184b60 2026-02-13T20:11:31.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7feddeffd640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7feddeffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7feddeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7feddeffd640 10 monclient(hunting): my global_id is 4264 2026-02-13T20:11:31.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7feddeffd640 1 -- 10.20.193.110:0/1966125923 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fede008a950 con 0x7fede0184b60 2026-02-13T20:11:31.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7feddeffd640 1 -- 10.20.193.110:0/1966125923 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3762757096 0 0) 0x7fede0057c60 con 0x7fede0057780 2026-02-13T20:11:31.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7feddeffd640 1 -- 10.20.193.110:0/1966125923 >> v1:10.20.193.110:6790/0 conn(0x7fede0089250 legacy=0x7fede00580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7feddeffd640 1 -- 10.20.193.110:0/1966125923 >> v1:10.20.193.188:6789/0 conn(0x7fede0184b60 legacy=0x7fede01a4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7feddeffd640 10 monclient: _finish_hunting 0 2026-02-13T20:11:31.498 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7feddeffd640 1 monclient: found mon.noname-a 2026-02-13T20:11:31.498 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7feddeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:31.498 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7feddeffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:11:31.498 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7feddeffd640 1 -- 10.20.193.110:0/1966125923 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fede0089a50 con 0x7fede0057780 2026-02-13T20:11:31.498 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7feddeffd640 10 monclient: _finish_auth 0 2026-02-13T20:11:31.498 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7feddeffd640 10 monclient: _check_auth_tickets 2026-02-13T20:11:31.498 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7feddeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:31.498 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7feddeffd640 1 -- 10.20.193.110:0/1966125923 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fedd0002dd0 con 0x7fede0057780 2026-02-13T20:11:31.498 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7feddeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:31.498 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7feddeffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:11:31.498 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7feddeffd640 10 monclient: dump: 2026-02-13T20:11:31.498 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.498 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.498 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.498 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.498 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.498 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.499 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.499 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.499 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.499 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.499 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7fede679d640 5 monclient: authenticate success, global_id 4260 2026-02-13T20:11:31.499 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7fede679d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:31.499 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7f21d9e12640 1 Processor -- start 2026-02-13T20:11:31.499 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7ff6a4c8c640 10 monclient: build_initial_monmap 2026-02-13T20:11:31.499 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7ff6a4c8c640 10 monclient: monmap: 2026-02-13T20:11:31.500 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:31.500 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:31.500 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:11:31.500 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:11:31.500 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:31.500 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:11:31.500 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:31.500 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:31.500 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:31.500 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.500 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7f21d9e12640 1 -- start start 2026-02-13T20:11:31.500 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7f21d9e12640 10 monclient: init 2026-02-13T20:11:31.501 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7feddeffd640 1 -- 10.20.193.110:0/1966125923 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fedd0002fd0 con 0x7fede0057780 2026-02-13T20:11:31.501 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7feddeffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:31.501 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7feddeffd640 1 -- 10.20.193.110:0/1966125923 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fedd00033e0 con 0x7fede0057780 2026-02-13T20:11:31.501 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7fede679d640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:31.501 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7fede679d640 4 set_mon_vals no callback set 2026-02-13T20:11:31.501 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7feddeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:31.501 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7feddeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:31.501 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7feddeffd640 10 monclient: dump: 2026-02-13T20:11:31.501 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.501 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.501 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.501 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.501 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.501 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.501 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.501 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.502 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.502 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.502 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.457+0000 7ff6a4c8c640 1 Processor -- start 2026-02-13T20:11:31.502 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f2bfa812640 10 monclient: build_initial_monmap 2026-02-13T20:11:31.502 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f2bfa812640 10 monclient: monmap: 2026-02-13T20:11:31.502 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:31.502 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:31.502 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:11:31.502 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:11:31.502 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:31.502 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:11:31.503 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:31.503 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:31.503 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:31.503 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.503 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff6a4c8c640 1 -- start start 2026-02-13T20:11:31.503 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff6a4c8c640 10 monclient: init 2026-02-13T20:11:31.503 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7fede679d640 10 monclient: shutdown 2026-02-13T20:11:31.503 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7fede679d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:31.503 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7fede679d640 1 -- 10.20.193.110:0/1966125923 >> v1:10.20.193.110:6789/0 conn(0x7fede0057780 legacy=0x7fede0183440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.504 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f21d9e12640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:31.504 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f21d9e12640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:11:31.504 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f21d9e12640 10 monclient(hunting): picked mon.noname-b con 0x7f21d4094040 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:31.504 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7fede679d640 1 -- 10.20.193.110:0/1966125923 shutdown_connections 2026-02-13T20:11:31.504 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7fede679d640 1 -- 10.20.193.110:0/1966125923 >> 10.20.193.110:0/1966125923 conn(0x7fede0054330 msgr2=0x7fede0054730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:31.504 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f21d9e12640 10 monclient(hunting): picked mon.noname-a con 0x7f21d4094410 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:31.505 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7fede679d640 1 -- 10.20.193.110:0/1966125923 shutdown_connections 2026-02-13T20:11:31.505 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f21d9e12640 10 monclient(hunting): picked mon.noname-c con 0x7f21d4094870 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:31.505 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f21d9e12640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21d4095450 con 0x7f21d4094410 2026-02-13T20:11:31.505 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7fede679d640 1 -- 10.20.193.110:0/1966125923 wait complete. 2026-02-13T20:11:31.505 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f21d9e12640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21d408a740 con 0x7f21d4094870 2026-02-13T20:11:31.505 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f21d9e12640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21d4093e70 con 0x7f21d4094040 2026-02-13T20:11:31.505 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f21d9e12640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:31.505 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f21d9e12640 10 monclient(hunting): authenticate will time out at 653.149206s 2026-02-13T20:11:31.506 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff6a4c8c640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:31.506 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f21d37fe640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f21d4094040 0x7f21d4093760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:39620/0 (socket says 10.20.193.110:39620) 2026-02-13T20:11:31.506 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff6a4c8c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:11:31.506 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff6a4c8c640 10 monclient(hunting): picked mon.noname-a con 0x7ff6a0091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:31.506 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f21d37fe640 1 -- 10.20.193.110:0/3026729557 learned_addr learned my addr 10.20.193.110:0/3026729557 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:31.507 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f2bfa812640 1 Processor -- start 2026-02-13T20:11:31.507 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f2bfa812640 1 -- start start 2026-02-13T20:11:31.507 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f2bfa812640 10 monclient: init 2026-02-13T20:11:31.507 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff6a4c8c640 10 monclient(hunting): picked mon.noname-c con 0x7ff6a01401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:31.507 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff6a4c8c640 10 monclient(hunting): picked mon.noname-b con 0x7ff6a012dc80 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:31.507 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff6a4c8c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6a005d320 con 0x7ff6a0091950 2026-02-13T20:11:31.507 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff6a4c8c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6a012eec0 con 0x7ff6a012dc80 2026-02-13T20:11:31.507 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff6a4c8c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6a012f1a0 con 0x7ff6a01401c0 2026-02-13T20:11:31.507 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff6a4c8c640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:31.507 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff6a4c8c640 10 monclient(hunting): authenticate will time out at 653.149274s 2026-02-13T20:11:31.507 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff69e575640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7ff6a0091950 0x7ff6a012b930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:59878/0 (socket says 10.20.193.110:59878) 2026-02-13T20:11:31.507 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff69e575640 1 -- 10.20.193.110:0/3868269685 learned_addr learned my addr 10.20.193.110:0/3868269685 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:31.508 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f21d27fc640 1 -- 10.20.193.110:0/3026729557 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 658322655 0 0) 0x7f21d4093e70 con 0x7f21d4094040 2026-02-13T20:11:31.508 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f21d27fc640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.508 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f21d27fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.508 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f21d27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.508 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f21d27fc640 10 monclient(hunting): my global_id is 4259 2026-02-13T20:11:31.508 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f21d27fc640 1 -- 10.20.193.110:0/3026729557 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21b80035e0 con 0x7f21d4094040 2026-02-13T20:11:31.508 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f21d27fc640 1 -- 10.20.193.110:0/3026729557 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1552213647 0 0) 0x7f21d4095450 con 0x7f21d4094410 2026-02-13T20:11:31.508 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f21d27fc640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.508 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f21d27fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.508 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f21d27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.508 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f21d27fc640 10 monclient(hunting): my global_id is 4263 2026-02-13T20:11:31.508 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f21d27fc640 1 -- 10.20.193.110:0/3026729557 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21d4093e70 con 0x7f21d4094410 2026-02-13T20:11:31.509 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff686ffd640 1 -- 10.20.193.110:0/3868269685 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3445086763 0 0) 0x7ff6a005d320 con 0x7ff6a0091950 2026-02-13T20:11:31.509 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff686ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.509 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff686ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.509 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff686ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.509 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff686ffd640 10 monclient(hunting): my global_id is 4266 2026-02-13T20:11:31.509 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff686ffd640 1 -- 10.20.193.110:0/3868269685 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff66c0035e0 con 0x7ff6a0091950 2026-02-13T20:11:31.509 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff686ffd640 1 -- 10.20.193.110:0/3868269685 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1979523128 0 0) 0x7ff6a012f1a0 con 0x7ff6a01401c0 2026-02-13T20:11:31.509 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff686ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.509 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff686ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.509 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff686ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.509 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff686ffd640 10 monclient(hunting): my global_id is 4262 2026-02-13T20:11:31.509 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff686ffd640 1 -- 10.20.193.110:0/3868269685 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6a005d320 con 0x7ff6a01401c0 2026-02-13T20:11:31.510 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f2bfa812640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:31.510 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f2bfa812640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:11:31.510 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f2bfa812640 10 monclient(hunting): picked mon.noname-c con 0x7f2bf4057780 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:31.510 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f2bfa812640 10 monclient(hunting): picked mon.noname-b con 0x7f2bf4089250 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:31.510 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f2bfa812640 10 monclient(hunting): picked mon.noname-a con 0x7f2bf4184b60 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:31.510 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f2bfa812640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bf408a160 con 0x7f2bf4184b60 2026-02-13T20:11:31.510 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f2bfa812640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bf412b3a0 con 0x7f2bf4089250 2026-02-13T20:11:31.510 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f2bfa812640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bf4062290 con 0x7f2bf4057780 2026-02-13T20:11:31.510 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f21d27fc640 1 -- 10.20.193.110:0/3026729557 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 65471131 0 0) 0x7f21b80035e0 con 0x7f21d4094040 2026-02-13T20:11:31.510 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f21d27fc640 1 -- 10.20.193.110:0/3026729557 >> v1:10.20.193.188:6789/0 conn(0x7f21d4094870 legacy=0x7f21d41a4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.510 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f21d27fc640 1 -- 10.20.193.110:0/3026729557 >> v1:10.20.193.110:6789/0 conn(0x7f21d4094410 legacy=0x7f21d4183410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.510 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f21d27fc640 10 monclient: _finish_hunting 0 2026-02-13T20:11:31.510 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f21d27fc640 1 monclient: found mon.noname-b 2026-02-13T20:11:31.510 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f21d27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:31.510 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f21d27fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:11:31.511 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f21d27fc640 1 -- 10.20.193.110:0/3026729557 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21d408a180 con 0x7f21d4094040 2026-02-13T20:11:31.511 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f21d27fc640 10 monclient: _finish_auth 0 2026-02-13T20:11:31.511 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f21d27fc640 10 monclient: _check_auth_tickets 2026-02-13T20:11:31.511 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f21d27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:31.511 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f21d9e12640 5 monclient: authenticate success, global_id 4259 2026-02-13T20:11:31.511 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f21d9e12640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:31.511 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f21d27fc640 1 -- 10.20.193.110:0/3026729557 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f21c0002dd0 con 0x7f21d4094040 2026-02-13T20:11:31.511 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f21d27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:31.511 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f21d27fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:11:31.511 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f21d27fc640 10 monclient: dump: 2026-02-13T20:11:31.511 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.511 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.511 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.511 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.511 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.511 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.511 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.511 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.511 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.511 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.511 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f21d9e12640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:31.512 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7fede679d640 10 monclient: build_initial_monmap 2026-02-13T20:11:31.512 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7fede679d640 10 monclient: monmap: 2026-02-13T20:11:31.512 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:31.512 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:31.512 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:11:31.512 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:11:31.512 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:31.512 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:11:31.512 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:31.512 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:31.512 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:31.512 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.512 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff686ffd640 1 -- 10.20.193.110:0/3868269685 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 575007797 0 0) 0x7ff6a005d320 con 0x7ff6a01401c0 2026-02-13T20:11:31.512 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff686ffd640 1 -- 10.20.193.110:0/3868269685 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff6a012f1a0 con 0x7ff6a01401c0 2026-02-13T20:11:31.512 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff686ffd640 1 -- 10.20.193.110:0/3868269685 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff6880030d0 con 0x7ff6a01401c0 2026-02-13T20:11:31.512 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f2bfa812640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:31.513 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f2bfa812640 10 monclient(hunting): authenticate will time out at 653.149692s 2026-02-13T20:11:31.513 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff686ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:31.513 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff686ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:11:31.513 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff686ffd640 10 monclient(hunting): dump: 2026-02-13T20:11:31.513 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.513 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.513 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.513 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.513 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.513 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.513 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.513 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.513 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.513 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.513 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff686ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:31.513 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f2bf3fff640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f2bf4057780 0x7f2bf412ac90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:39638/0 (socket says 10.20.193.110:39638) 2026-02-13T20:11:31.513 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f2bf3fff640 1 -- 10.20.193.110:0/2848305932 learned_addr learned my addr 10.20.193.110:0/2848305932 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:31.514 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f21d27fc640 1 -- 10.20.193.110:0/3026729557 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f21c0003010 con 0x7f21d4094040 2026-02-13T20:11:31.514 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f21d27fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:31.514 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f21d27fc640 1 -- 10.20.193.110:0/3026729557 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f21c0003420 con 0x7f21d4094040 2026-02-13T20:11:31.514 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f21d27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:31.514 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f21d27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:31.514 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f21d27fc640 10 monclient: dump: 2026-02-13T20:11:31.514 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.514 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.514 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.514 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.514 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.514 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.514 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.514 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.514 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.514 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.514 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f21d9e12640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:31.514 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f21d9e12640 4 set_mon_vals no callback set 2026-02-13T20:11:31.515 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff686ffd640 1 -- 10.20.193.110:0/3868269685 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2705476620 0 0) 0x7ff66c0035e0 con 0x7ff6a0091950 2026-02-13T20:11:31.515 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff686ffd640 1 -- 10.20.193.110:0/3868269685 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff6a005d320 con 0x7ff6a0091950 2026-02-13T20:11:31.515 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff686ffd640 1 -- 10.20.193.110:0/3868269685 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff694003110 con 0x7ff6a0091950 2026-02-13T20:11:31.516 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff686ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:31.516 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff686ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:31.516 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff686ffd640 10 monclient(hunting): dump: 2026-02-13T20:11:31.516 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.516 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.516 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.516 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.516 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.516 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.516 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.516 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.516 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.516 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.516 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff686ffd640 1 -- 10.20.193.110:0/3868269685 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 157586095 0 0) 0x7ff6a012eec0 con 0x7ff6a012dc80 2026-02-13T20:11:31.516 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff686ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.516 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff686ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.516 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff686ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.516 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff686ffd640 10 monclient(hunting): my global_id is 4270 2026-02-13T20:11:31.516 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff686ffd640 1 -- 10.20.193.110:0/3868269685 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff66c0035e0 con 0x7ff6a012dc80 2026-02-13T20:11:31.516 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff686ffd640 1 -- 10.20.193.110:0/3868269685 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4293613691 0 0) 0x7ff6a012f1a0 con 0x7ff6a01401c0 2026-02-13T20:11:31.516 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff686ffd640 1 -- 10.20.193.110:0/3868269685 >> v1:10.20.193.188:6789/0 conn(0x7ff6a012dc80 legacy=0x7ff6a01a2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.516 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff686ffd640 1 -- 10.20.193.110:0/3868269685 >> v1:10.20.193.110:6789/0 conn(0x7ff6a0091950 legacy=0x7ff6a012b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.516 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff686ffd640 10 monclient: _finish_hunting 0 2026-02-13T20:11:31.516 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff686ffd640 1 monclient: found mon.c 2026-02-13T20:11:31.516 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff686ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:31.516 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff686ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:31.517 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff686ffd640 1 -- 10.20.193.110:0/3868269685 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6a012c750 con 0x7ff6a01401c0 2026-02-13T20:11:31.517 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff686ffd640 10 monclient: _finish_auth 0 2026-02-13T20:11:31.517 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff686ffd640 10 monclient: _check_auth_tickets 2026-02-13T20:11:31.517 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff686ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:31.517 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff6a4c8c640 5 monclient: authenticate success, global_id 4262 2026-02-13T20:11:31.517 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff6a4c8c640 10 monclient: _renew_subs 2026-02-13T20:11:31.517 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff6a4c8c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:31.517 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff6a4c8c640 1 -- 10.20.193.110:0/3868269685 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff6a008ae10 con 0x7ff6a01401c0 2026-02-13T20:11:31.517 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff6a4c8c640 10 monclient: _renew_subs 2026-02-13T20:11:31.517 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff6a4c8c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:31.517 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7ff6a4c8c640 1 -- 10.20.193.110:0/3868269685 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7ff6a012d120 con 0x7ff6a01401c0 2026-02-13T20:11:31.517 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f2bf0ff9640 1 -- 10.20.193.110:0/2848305932 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3220906749 0 0) 0x7f2bf4062290 con 0x7f2bf4057780 2026-02-13T20:11:31.517 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f2bf0ff9640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.517 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f2bf0ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.517 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f2bf0ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.517 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f2bf0ff9640 10 monclient(hunting): my global_id is 4265 2026-02-13T20:11:31.517 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f2bf0ff9640 1 -- 10.20.193.110:0/2848305932 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2bc40035e0 con 0x7f2bf4057780 2026-02-13T20:11:31.518 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f2bf0ff9640 1 -- 10.20.193.110:0/2848305932 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 458929760 0 0) 0x7f2bf408a160 con 0x7f2bf4184b60 2026-02-13T20:11:31.518 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f2bf0ff9640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.518 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f2bf0ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.518 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f2bf0ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.518 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f2bf0ff9640 10 monclient(hunting): my global_id is 4269 2026-02-13T20:11:31.518 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7fede679d640 1 Processor -- start 2026-02-13T20:11:31.518 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.458+0000 7f2bf0ff9640 1 -- 10.20.193.110:0/2848305932 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2bf4062290 con 0x7f2bf4184b60 2026-02-13T20:11:31.518 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7fede679d640 1 -- start start 2026-02-13T20:11:31.518 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7fede679d640 10 monclient: init 2026-02-13T20:11:31.518 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f2bf0ff9640 1 -- 10.20.193.110:0/2848305932 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1817052946 0 0) 0x7f2bf412b3a0 con 0x7f2bf4089250 2026-02-13T20:11:31.518 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f2bf0ff9640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.518 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f2bf0ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.519 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f2bf0ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.519 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f2bf0ff9640 10 monclient(hunting): my global_id is 4273 2026-02-13T20:11:31.519 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f6506c52640 10 monclient: get_monmap_and_config 2026-02-13T20:11:31.519 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f6506c52640 10 monclient: build_initial_monmap 2026-02-13T20:11:31.519 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f6506c52640 10 monclient: monmap: 2026-02-13T20:11:31.519 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:31.519 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.519 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:31.460453+0000 2026-02-13T20:11:31.519 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:31.460453+0000 2026-02-13T20:11:31.519 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:31.519 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.519 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:31.519 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:31.519 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:31.519 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f2bf0ff9640 1 -- 10.20.193.110:0/2848305932 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2bf408a160 con 0x7f2bf4089250 2026-02-13T20:11:31.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f2bf0ff9640 1 -- 10.20.193.110:0/2848305932 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3626584665 0 0) 0x7f2bf4062290 con 0x7f2bf4184b60 2026-02-13T20:11:31.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f2bf0ff9640 1 -- 10.20.193.110:0/2848305932 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2bf412b3a0 con 0x7f2bf4184b60 2026-02-13T20:11:31.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f2bf0ff9640 1 -- 10.20.193.110:0/2848305932 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f2be8004170 con 0x7f2bf4184b60 2026-02-13T20:11:31.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f2bf0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:31.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f2bf0ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:11:31.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f2bf0ff9640 10 monclient(hunting): dump: 2026-02-13T20:11:31.520 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.520 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.520 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.520 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.520 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.520 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.520 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.520 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.520 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.520 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f2bf0ff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:31.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7ff686ffd640 1 -- 10.20.193.110:0/3868269685 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff6880034e0 con 0x7ff6a01401c0 2026-02-13T20:11:31.521 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7ff686ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:31.521 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7ff686ffd640 1 -- 10.20.193.110:0/3868269685 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff6880038c0 con 0x7ff6a01401c0 2026-02-13T20:11:31.521 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7ff686ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:31.521 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7ff686ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:31.521 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7ff69cd72640 4 set_mon_vals no callback set 2026-02-13T20:11:31.521 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7ff686ffd640 10 monclient: dump: 2026-02-13T20:11:31.521 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.521 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.521 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.521 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.521 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.521 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.521 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.521 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.521 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.521 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.521 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f21d9e12640 10 monclient: shutdown 2026-02-13T20:11:31.521 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f21d9e12640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:31.522 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f21d9e12640 1 -- 10.20.193.110:0/3026729557 >> v1:10.20.193.110:6790/0 conn(0x7f21d4094040 legacy=0x7f21d4093760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.522 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f21d9e12640 1 -- 10.20.193.110:0/3026729557 shutdown_connections 2026-02-13T20:11:31.522 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f21d9e12640 1 -- 10.20.193.110:0/3026729557 >> 10.20.193.110:0/3026729557 conn(0x7f21d4054330 msgr2=0x7f21d4054730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:31.522 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f2bf0ff9640 1 -- 10.20.193.110:0/2848305932 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2583020833 0 0) 0x7f2bf412b3a0 con 0x7f2bf4184b60 2026-02-13T20:11:31.522 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f21d9e12640 1 -- 10.20.193.110:0/3026729557 shutdown_connections 2026-02-13T20:11:31.522 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f2bf0ff9640 1 -- 10.20.193.110:0/2848305932 >> v1:10.20.193.110:6790/0 conn(0x7f2bf4057780 legacy=0x7f2bf412ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.522 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f2bf0ff9640 1 -- 10.20.193.110:0/2848305932 >> v1:10.20.193.188:6789/0 conn(0x7f2bf4089250 legacy=0x7f2bf4172050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.523 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f2bf0ff9640 10 monclient: _finish_hunting 0 2026-02-13T20:11:31.523 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f2bf0ff9640 1 monclient: found mon.a 2026-02-13T20:11:31.523 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f2bf0ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:31.523 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f2bf0ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:31.523 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f2bf0ff9640 1 -- 10.20.193.110:0/2848305932 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bf4111780 con 0x7f2bf4184b60 2026-02-13T20:11:31.523 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f2bf0ff9640 10 monclient: _finish_auth 0 2026-02-13T20:11:31.523 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f2bf0ff9640 10 monclient: _check_auth_tickets 2026-02-13T20:11:31.523 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f2bf0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:31.523 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f2bfa812640 5 monclient: authenticate success, global_id 4269 2026-02-13T20:11:31.523 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f2bfa812640 10 monclient: _renew_subs 2026-02-13T20:11:31.523 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f2bfa812640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:31.523 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f2bfa812640 1 -- 10.20.193.110:0/2848305932 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2bf4110290 con 0x7f2bf4184b60 2026-02-13T20:11:31.523 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7fede679d640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:31.523 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7fede679d640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:11:31.523 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7fede679d640 10 monclient(hunting): picked mon.noname-a con 0x7fede0057780 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:31.523 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f2bfa812640 10 monclient: _renew_subs 2026-02-13T20:11:31.524 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f2bfa812640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:31.524 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f2bfa812640 1 -- 10.20.193.110:0/2848305932 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2bf4110df0 con 0x7f2bf4184b60 2026-02-13T20:11:31.524 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f21d9e12640 1 -- 10.20.193.110:0/3026729557 wait complete. 2026-02-13T20:11:31.524 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7fede679d640 10 monclient(hunting): picked mon.noname-c con 0x7fede0089250 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:31.524 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f0e8eecc640 10 monclient: get_monmap_and_config 2026-02-13T20:11:31.524 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f0e8eecc640 10 monclient: build_initial_monmap 2026-02-13T20:11:31.524 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f0e8eecc640 10 monclient: monmap: 2026-02-13T20:11:31.524 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:31.524 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.524 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:31.460744+0000 2026-02-13T20:11:31.524 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:31.460744+0000 2026-02-13T20:11:31.524 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:31.524 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.524 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:31.524 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:31.524 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:31.524 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.525 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7fede679d640 10 monclient(hunting): picked mon.noname-b con 0x7fede0184b60 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:31.525 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7fede679d640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fede008a160 con 0x7fede0057780 2026-02-13T20:11:31.525 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7fede679d640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fede0111eb0 con 0x7fede0184b60 2026-02-13T20:11:31.525 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7fede679d640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fede012b220 con 0x7fede0089250 2026-02-13T20:11:31.525 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7fede679d640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:31.525 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7fede679d640 10 monclient(hunting): authenticate will time out at 653.150388s 2026-02-13T20:11:31.525 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7ff6a4c8c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:31.525 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7ff6a4c8c640 1 -- 10.20.193.110:0/3868269685 --> v1:10.20.193.110:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7ff6a008b450 con 0x7ff6a01401c0 2026-02-13T20:11:31.525 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7feddf7fe640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fede0089250 0x7fede0171eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:39640/0 (socket says 10.20.193.110:39640) 2026-02-13T20:11:31.525 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7feddf7fe640 1 -- 10.20.193.110:0/2031406972 learned_addr learned my addr 10.20.193.110:0/2031406972 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:31.525 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f6506c52640 1 Processor -- start 2026-02-13T20:11:31.526 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f2bf0ff9640 1 -- 10.20.193.110:0/2848305932 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2be80047b0 con 0x7f2bf4184b60 2026-02-13T20:11:31.526 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f2bf0ff9640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:31.526 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f2bf0ff9640 1 -- 10.20.193.110:0/2848305932 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f2be8004ad0 con 0x7f2bf4184b60 2026-02-13T20:11:31.526 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f2bf0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:31.526 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f2bf27fc640 4 set_mon_vals no callback set 2026-02-13T20:11:31.526 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f2bf0ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:31.526 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f2bf0ff9640 10 monclient: dump: 2026-02-13T20:11:31.526 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.526 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.526 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.526 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.526 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.526 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.526 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.526 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.526 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.526 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.526 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f6506c52640 1 -- start start 2026-02-13T20:11:31.526 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f6506c52640 10 monclient: init 2026-02-13T20:11:31.527 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7feddcff9640 1 -- 10.20.193.110:0/2031406972 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 185462316 0 0) 0x7fede012b220 con 0x7fede0089250 2026-02-13T20:11:31.527 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7feddcff9640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.527 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7feddcff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.527 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7feddcff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.527 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7feddcff9640 10 monclient(hunting): my global_id is 4268 2026-02-13T20:11:31.527 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7feddcff9640 1 -- 10.20.193.110:0/2031406972 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feda80035e0 con 0x7fede0089250 2026-02-13T20:11:31.527 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7feddcff9640 1 -- 10.20.193.110:0/2031406972 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3813145989 0 0) 0x7fede008a160 con 0x7fede0057780 2026-02-13T20:11:31.527 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7feddcff9640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.527 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7feddcff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.527 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7feddcff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.527 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7feddcff9640 10 monclient(hunting): my global_id is 4272 2026-02-13T20:11:31.527 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7feddcff9640 1 -- 10.20.193.110:0/2031406972 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fede012b220 con 0x7fede0057780 2026-02-13T20:11:31.527 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7ff686ffd640 1 -- 10.20.193.110:0/3868269685 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7ff688003a20 con 0x7ff6a01401c0 2026-02-13T20:11:31.527 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7feddcff9640 1 -- 10.20.193.110:0/2031406972 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2123901359 0 0) 0x7feda80035e0 con 0x7fede0089250 2026-02-13T20:11:31.527 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7feddcff9640 1 -- 10.20.193.110:0/2031406972 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fede008a160 con 0x7fede0089250 2026-02-13T20:11:31.527 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7feddcff9640 1 -- 10.20.193.110:0/2031406972 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fedd00032f0 con 0x7fede0089250 2026-02-13T20:11:31.527 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7feddcff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:31.527 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7feddcff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:11:31.527 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7feddcff9640 10 monclient(hunting): dump: 2026-02-13T20:11:31.528 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.528 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.528 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.528 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.528 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.528 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.528 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.528 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.528 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.528 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.528 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7feddcff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:31.528 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f21d9e12640 10 monclient: build_initial_monmap 2026-02-13T20:11:31.528 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f21d9e12640 10 monclient: monmap: 2026-02-13T20:11:31.528 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:31.528 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:31.528 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:11:31.528 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:11:31.528 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:31.528 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:11:31.528 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:31.528 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:31.528 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:31.528 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7feddcff9640 1 -- 10.20.193.110:0/2031406972 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1964276924 0 0) 0x7fede012b220 con 0x7fede0057780 2026-02-13T20:11:31.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7feddcff9640 1 -- 10.20.193.110:0/2031406972 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feda80035e0 con 0x7fede0057780 2026-02-13T20:11:31.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7feddcff9640 1 -- 10.20.193.110:0/2031406972 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fedcc003090 con 0x7fede0057780 2026-02-13T20:11:31.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7feddcff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:31.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f2bfa812640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:31.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f2bfa812640 1 -- 10.20.193.110:0/2848305932 --> v1:10.20.193.110:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f2bf408a670 con 0x7f2bf4184b60 2026-02-13T20:11:31.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7feddcff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:31.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7feddcff9640 10 monclient(hunting): dump: 2026-02-13T20:11:31.529 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.529 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.529 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.529 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.529 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.529 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.529 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.529 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.529 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.529 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f0e8eecc640 1 Processor -- start 2026-02-13T20:11:31.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7ff686ffd640 1 -- 10.20.193.110:0/3868269685 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3559+0+0 (unknown 1530614704 0 0) 0x7ff68804d4b0 con 0x7ff6a01401c0 2026-02-13T20:11:31.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f6506c52640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:31.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f6506c52640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:11:31.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7feddcff9640 1 -- 10.20.193.110:0/2031406972 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3990031369 0 0) 0x7fede0111eb0 con 0x7fede0184b60 2026-02-13T20:11:31.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7feddcff9640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7feddcff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7feddcff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7feddcff9640 10 monclient(hunting): my global_id is 4276 2026-02-13T20:11:31.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7feddcff9640 1 -- 10.20.193.110:0/2031406972 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fede012b220 con 0x7fede0184b60 2026-02-13T20:11:31.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f6506c52640 10 monclient(hunting): picked mon.noname-b con 0x7f65001401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:31.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7feddcff9640 1 -- 10.20.193.110:0/2031406972 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2515612688 0 0) 0x7fede008a160 con 0x7fede0089250 2026-02-13T20:11:31.531 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f0e8eecc640 1 -- start start 2026-02-13T20:11:31.531 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f0e8eecc640 10 monclient: init 2026-02-13T20:11:31.531 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7feddcff9640 1 -- 10.20.193.110:0/2031406972 >> v1:10.20.193.188:6789/0 conn(0x7fede0184b60 legacy=0x7fede01735d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.531 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7feddcff9640 1 -- 10.20.193.110:0/2031406972 >> v1:10.20.193.110:6789/0 conn(0x7fede0057780 legacy=0x7fede012aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.531 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f6506c52640 10 monclient(hunting): picked mon.noname-c con 0x7f6500092020 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:31.531 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f6506c52640 10 monclient(hunting): picked mon.noname-a con 0x7f6500091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:31.531 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7feddcff9640 10 monclient: _finish_hunting 0 2026-02-13T20:11:31.531 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7feddcff9640 1 monclient: found mon.c 2026-02-13T20:11:31.531 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7feddcff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:31.531 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7feddcff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:31.531 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7feddcff9640 1 -- 10.20.193.110:0/2031406972 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fede0112450 con 0x7fede0089250 2026-02-13T20:11:31.531 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f6506c52640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f650008b730 con 0x7f6500091950 2026-02-13T20:11:31.531 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f6506c52640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f650005c5b0 con 0x7f6500092020 2026-02-13T20:11:31.531 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7feddcff9640 10 monclient: _finish_auth 0 2026-02-13T20:11:31.531 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7feddcff9640 10 monclient: _check_auth_tickets 2026-02-13T20:11:31.532 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7f6506c52640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f650008bcf0 con 0x7f65001401c0 2026-02-13T20:11:31.532 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7feddcff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:31.532 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7fede679d640 5 monclient: authenticate success, global_id 4268 2026-02-13T20:11:31.532 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7fede679d640 10 monclient: _renew_subs 2026-02-13T20:11:31.532 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7fede679d640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:31.532 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7fede679d640 1 -- 10.20.193.110:0/2031406972 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fede01100f0 con 0x7fede0089250 2026-02-13T20:11:31.532 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.459+0000 7ff686ffd640 1 -- 10.20.193.110:0/3868269685 --> v1:10.20.193.110:6800/3182322764 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff66c086490 con 0x7ff66c0647f0 2026-02-13T20:11:31.532 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7ff686ffd640 1 -- 10.20.193.110:0/3868269685 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (unknown 4138596325 0 0) 0x7ff68804d8c0 con 0x7ff6a01401c0 2026-02-13T20:11:31.532 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7ff686ffd640 10 monclient: handle_get_version_reply finishing 1 version 19 2026-02-13T20:11:31.532 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f6506c52640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:31.532 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f6506c52640 10 monclient(hunting): authenticate will time out at 653.151018s 2026-02-13T20:11:31.532 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7fede679d640 10 monclient: _renew_subs 2026-02-13T20:11:31.532 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7fede679d640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:31.533 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f21d9e12640 1 Processor -- start 2026-02-13T20:11:31.533 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7fede679d640 1 -- 10.20.193.110:0/2031406972 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fede010fa70 con 0x7fede0089250 2026-02-13T20:11:31.533 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f65049c7640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f65001401c0 0x7f6500091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:39642/0 (socket says 10.20.193.110:39642) 2026-02-13T20:11:31.533 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f65049c7640 1 -- 10.20.193.110:0/3008009143 learned_addr learned my addr 10.20.193.110:0/3008009143 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:31.533 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7ff69e575640 10 monclient: get_auth_request con 0x7ff66c03fcc0 auth_method 0 2026-02-13T20:11:31.533 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f2bf0ff9640 1 -- 10.20.193.110:0/2848305932 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f2be8011740 con 0x7f2bf4184b60 2026-02-13T20:11:31.533 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f21d9e12640 1 -- start start 2026-02-13T20:11:31.533 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f21d9e12640 10 monclient: init 2026-02-13T20:11:31.533 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7feddcff9640 1 -- 10.20.193.110:0/2031406972 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fedd00029f0 con 0x7fede0089250 2026-02-13T20:11:31.533 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7feddcff9640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:31.533 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7feddcff9640 1 -- 10.20.193.110:0/2031406972 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fedd0004d00 con 0x7fede0089250 2026-02-13T20:11:31.533 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7feddcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:31.534 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7feddcff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:31.534 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7fedde7fc640 4 set_mon_vals no callback set 2026-02-13T20:11:31.534 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7feddcff9640 10 monclient: dump: 2026-02-13T20:11:31.534 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.534 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.534 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.534 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.534 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.534 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.534 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.534 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.534 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.534 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.534 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f64f77fe640 1 -- 10.20.193.110:0/3008009143 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2248520709 0 0) 0x7f650008bcf0 con 0x7f65001401c0 2026-02-13T20:11:31.534 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f64f77fe640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.534 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f64f77fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.534 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f64f77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.534 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f64f77fe640 10 monclient(hunting): my global_id is 4271 2026-02-13T20:11:31.534 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f64f77fe640 1 -- 10.20.193.110:0/3008009143 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f64ec0035e0 con 0x7f65001401c0 2026-02-13T20:11:31.534 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7ff69ed76640 10 monclient: get_auth_request con 0x7ff66c0647f0 auth_method 0 2026-02-13T20:11:31.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f0e8eecc640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:31.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f0e8eecc640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:11:31.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f0e8eecc640 10 monclient(hunting): picked mon.noname-b con 0x7f0e88094040 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:31.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f0e8eecc640 10 monclient(hunting): picked mon.noname-a con 0x7f0e88094410 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:31.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f0e8eecc640 10 monclient(hunting): picked mon.noname-c con 0x7f0e88094870 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:31.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f0e8eecc640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e88095450 con 0x7f0e88094410 2026-02-13T20:11:31.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f0e8eecc640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e8808a740 con 0x7f0e88094870 2026-02-13T20:11:31.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f0e8eecc640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e88093e70 con 0x7f0e88094040 2026-02-13T20:11:31.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f0e8eecc640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:31.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f0e8eecc640 10 monclient(hunting): authenticate will time out at 653.151336s 2026-02-13T20:11:31.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f2bf0ff9640 1 -- 10.20.193.110:0/2848305932 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3559+0+0 (unknown 1530614704 0 0) 0x7f2be804e4f0 con 0x7f2bf4184b60 2026-02-13T20:11:31.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f0e8cc41640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f0e88094040 0x7f0e88093760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:39646/0 (socket says 10.20.193.110:39646) 2026-02-13T20:11:31.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f0e8cc41640 1 -- 10.20.193.110:0/300697743 learned_addr learned my addr 10.20.193.110:0/300697743 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:31.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f64f77fe640 1 -- 10.20.193.110:0/3008009143 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3366375817 0 0) 0x7f64ec0035e0 con 0x7f65001401c0 2026-02-13T20:11:31.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f64f77fe640 1 -- 10.20.193.110:0/3008009143 >> v1:10.20.193.188:6789/0 conn(0x7f6500092020 legacy=0x7f65001812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f64f77fe640 1 -- 10.20.193.110:0/3008009143 >> v1:10.20.193.110:6789/0 conn(0x7f6500091950 legacy=0x7f65001a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T20:11:31.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f64f77fe640 10 monclient: _finish_hunting 0 2026-02-13T20:11:31.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f64f77fe640 1 monclient: found mon.noname-b 2026-02-13T20:11:31.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f64f77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:31.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f64f77fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:11:31.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f64f77fe640 1 -- 10.20.193.110:0/3008009143 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6500140590 con 0x7f65001401c0 2026-02-13T20:11:31.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f64f77fe640 10 monclient: _finish_auth 0 2026-02-13T20:11:31.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f64f77fe640 10 monclient: _check_auth_tickets 2026-02-13T20:11:31.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f64f77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:31.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f64f77fe640 1 -- 10.20.193.110:0/3008009143 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f64f0002dd0 con 0x7f65001401c0 2026-02-13T20:11:31.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f6506c52640 5 monclient: authenticate success, global_id 4271 2026-02-13T20:11:31.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f6506c52640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:31.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f21d9e12640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:31.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f64f77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:31.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f64f77fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:11:31.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f64f77fe640 10 monclient: dump: 2026-02-13T20:11:31.536 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.536 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.536 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.536 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.536 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.536 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.536 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.536 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.536 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.536 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f6506c52640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:31.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f21d9e12640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:11:31.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f21d9e12640 10 monclient(hunting): picked mon.noname-a con 0x7f21d4094040 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:31.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f21d9e12640 10 monclient(hunting): picked mon.noname-b con 0x7f21d4094410 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:31.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f21d9e12640 10 monclient(hunting): picked mon.noname-c con 0x7f21d4094870 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:31.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f21d9e12640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21d4091d80 con 0x7f21d4094040 2026-02-13T20:11:31.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f21d9e12640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21d40621e0 con 0x7f21d4094410 2026-02-13T20:11:31.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f21d9e12640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21d41a5fe0 con 0x7f21d4094870 2026-02-13T20:11:31.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f21d9e12640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:31.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f21d9e12640 10 monclient(hunting): authenticate will time out at 653.151543s 2026-02-13T20:11:31.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f2bf0ff9640 1 -- 10.20.193.110:0/2848305932 --> v1:10.20.193.110:6804/2437753968 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2bc4086130 con 0x7f2bc4064490 2026-02-13T20:11:31.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f2bf0ff9640 1 -- 10.20.193.110:0/2848305932 <== mon.0 v1:10.20.193.110:6789/0 9 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (unknown 4138596325 0 0) 0x7f2be804e900 con 0x7f2bf4184b60 2026-02-13T20:11:31.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f2bf0ff9640 10 monclient: handle_get_version_reply finishing 1 version 19 2026-02-13T20:11:31.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f2bf3fff640 10 monclient: get_auth_request con 0x7f2bc403f860 auth_method 0 2026-02-13T20:11:31.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f21d37fe640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f21d4094040 0x7f21d41abcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:59926/0 (socket says 10.20.193.110:59926) 2026-02-13T20:11:31.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f21d37fe640 1 -- 10.20.193.110:0/2286628340 learned_addr learned my addr 10.20.193.110:0/2286628340 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:31.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7fede679d640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:31.538 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7fede679d640 1 -- 10.20.193.110:0/2031406972 --> v1:10.20.193.110:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fede008a670 con 0x7fede0089250 2026-02-13T20:11:31.538 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f2bf37fe640 10 monclient: get_auth_request con 0x7f2bc4064490 auth_method 0 2026-02-13T20:11:31.538 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f64f77fe640 1 -- 10.20.193.110:0/3008009143 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f64f0003020 con 0x7f65001401c0 2026-02-13T20:11:31.538 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f64f77fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:31.538 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f6506c52640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:31.538 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f6506c52640 4 set_mon_vals no callback set 2026-02-13T20:11:31.538 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7feddcff9640 1 -- 10.20.193.110:0/2031406972 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fedd0011970 con 0x7fede0089250 2026-02-13T20:11:31.538 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f64f77fe640 1 -- 10.20.193.110:0/3008009143 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f64f0003430 con 0x7f65001401c0 2026-02-13T20:11:31.538 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f64f77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:31.538 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f64f77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:31.538 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f0e7f7fe640 1 -- 10.20.193.110:0/300697743 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2039715547 0 0) 0x7f0e88095450 con 0x7f0e88094410 2026-02-13T20:11:31.538 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f0e7f7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.538 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f0e7f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f0e7f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f0e7f7fe640 10 monclient(hunting): my global_id is 4275 2026-02-13T20:11:31.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f0e7f7fe640 1 -- 10.20.193.110:0/300697743 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e740035e0 con 0x7f0e88094410 2026-02-13T20:11:31.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f0e7f7fe640 1 -- 10.20.193.110:0/300697743 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2279344999 0 0) 0x7f0e88093e70 con 0x7f0e88094040 2026-02-13T20:11:31.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f0e7f7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f21affff640 1 -- 10.20.193.110:0/2286628340 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1378418930 0 0) 0x7f21d41a5fe0 con 0x7f21d4094870 2026-02-13T20:11:31.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f21affff640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f21affff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f21affff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f0e7f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f0e7f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f0e7f7fe640 10 monclient(hunting): my global_id is 4274 2026-02-13T20:11:31.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f21affff640 10 monclient(hunting): my global_id is 4277 2026-02-13T20:11:31.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f21affff640 1 -- 10.20.193.110:0/2286628340 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21a40035e0 con 0x7f21d4094870 2026-02-13T20:11:31.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f0e7f7fe640 1 -- 10.20.193.110:0/300697743 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e88095450 con 0x7f0e88094040 2026-02-13T20:11:31.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f21affff640 1 -- 10.20.193.110:0/2286628340 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2744673457 0 0) 0x7f21d4091d80 con 0x7f21d4094040 2026-02-13T20:11:31.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f21affff640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f21affff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f21affff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f21affff640 10 monclient(hunting): my global_id is 4278 2026-02-13T20:11:31.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f21affff640 1 -- 10.20.193.110:0/2286628340 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21d41a5fe0 con 0x7f21d4094040 2026-02-13T20:11:31.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7feddcff9640 1 -- 10.20.193.110:0/2031406972 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3559+0+0 (unknown 1530614704 0 0) 0x7fedd004e890 con 0x7fede0089250 2026-02-13T20:11:31.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f0e7f7fe640 1 -- 10.20.193.110:0/300697743 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3392348642 0 0) 0x7f0e88095450 con 0x7f0e88094040 2026-02-13T20:11:31.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f0e7f7fe640 1 -- 10.20.193.110:0/300697743 >> v1:10.20.193.188:6789/0 conn(0x7f0e88094870 legacy=0x7f0e881a4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T20:11:31.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f0e7f7fe640 1 -- 10.20.193.110:0/300697743 >> v1:10.20.193.110:6789/0 conn(0x7f0e88094410 legacy=0x7f0e88183410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f0e7f7fe640 10 monclient: _finish_hunting 0 2026-02-13T20:11:31.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f0e7f7fe640 1 monclient: found mon.noname-b 2026-02-13T20:11:31.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f0e7f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:31.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f0e7f7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:11:31.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f0e7f7fe640 1 -- 10.20.193.110:0/300697743 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e8808a180 con 0x7f0e88094040 2026-02-13T20:11:31.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f0e7f7fe640 10 monclient: _finish_auth 0 2026-02-13T20:11:31.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7feddcff9640 1 -- 10.20.193.110:0/2031406972 --> v1:10.20.193.110:6808/2638069221 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feda80864a0 con 0x7feda8064820 2026-02-13T20:11:31.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7feddcff9640 1 -- 10.20.193.110:0/2031406972 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (unknown 4138596325 0 0) 0x7fedd004ec60 con 0x7fede0089250 2026-02-13T20:11:31.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f0e7f7fe640 10 monclient: _check_auth_tickets 2026-02-13T20:11:31.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f0e7f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:31.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f0e7f7fe640 1 -- 10.20.193.110:0/300697743 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f0e78002dd0 con 0x7f0e88094040 2026-02-13T20:11:31.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f0e7f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:31.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7feddcff9640 10 monclient: handle_get_version_reply finishing 1 version 19 2026-02-13T20:11:31.541 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f64f77fe640 10 monclient: dump: 2026-02-13T20:11:31.541 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.541 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.541 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.541 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.541 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.541 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.541 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.541 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.541 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.541 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.541 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f0e7f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:11:31.541 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f0e7f7fe640 10 monclient: dump: 2026-02-13T20:11:31.541 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.541 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.541 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.541 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.541 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.541 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.541 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.541 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.541 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.541 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.541 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f0e8eecc640 5 monclient: authenticate success, global_id 4274 2026-02-13T20:11:31.541 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f0e8eecc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:31.541 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f6506c52640 10 monclient: shutdown 2026-02-13T20:11:31.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7ff686ffd640 1 -- 10.20.193.110:0/3868269685 <== osd.1 v1:10.20.193.110:6800/3182322764 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (unknown 0 0 784407017) 0x7ff66c086490 con 0x7ff66c0647f0 2026-02-13T20:11:31.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f6506c52640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:31.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.460+0000 7f6506c52640 1 -- 10.20.193.110:0/3008009143 >> v1:10.20.193.110:6790/0 conn(0x7f65001401c0 legacy=0x7f6500091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f21affff640 1 -- 10.20.193.110:0/2286628340 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 329574503 0 0) 0x7f21a40035e0 con 0x7f21d4094870 2026-02-13T20:11:31.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f21affff640 1 -- 10.20.193.110:0/2286628340 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f21d4091d80 con 0x7f21d4094870 2026-02-13T20:11:31.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7fede4d13640 10 monclient: get_auth_request con 0x7feda8064820 auth_method 0 2026-02-13T20:11:31.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f21affff640 1 -- 10.20.193.110:0/2286628340 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f21c80040d0 con 0x7f21d4094870 2026-02-13T20:11:31.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f21affff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:31.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f21affff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:11:31.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f21affff640 10 monclient(hunting): dump: 2026-02-13T20:11:31.542 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.542 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.542 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.542 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.542 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.542 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.542 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.542 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.542 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.542 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f21affff640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:31.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f6506c52640 1 -- 10.20.193.110:0/3008009143 shutdown_connections 2026-02-13T20:11:31.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f6506c52640 1 -- 10.20.193.110:0/3008009143 >> 10.20.193.110:0/3008009143 conn(0x7f6500054e90 msgr2=0x7f6500058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:31.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f6506c52640 1 -- 10.20.193.110:0/3008009143 shutdown_connections 2026-02-13T20:11:31.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7feddffff640 10 monclient: get_auth_request con 0x7feda803fcc0 auth_method 0 2026-02-13T20:11:31.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f6506c52640 1 -- 10.20.193.110:0/3008009143 wait complete. 2026-02-13T20:11:31.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f21affff640 1 -- 10.20.193.110:0/2286628340 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 782194613 0 0) 0x7f21d41a5fe0 con 0x7f21d4094040 2026-02-13T20:11:31.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f21affff640 1 -- 10.20.193.110:0/2286628340 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f21a40035e0 con 0x7f21d4094040 2026-02-13T20:11:31.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f21affff640 1 -- 10.20.193.110:0/2286628340 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f21c0002ce0 con 0x7f21d4094040 2026-02-13T20:11:31.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f21affff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:31.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f21affff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:31.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f21affff640 10 monclient(hunting): dump: 2026-02-13T20:11:31.543 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.543 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.543 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.543 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.543 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.543 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.543 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.543 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.544 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.544 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f2bf0ff9640 1 -- 10.20.193.110:0/2848305932 <== osd.2 v1:10.20.193.110:6804/2437753968 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (unknown 0 0 784407017) 0x7f2bc4086130 con 0x7f2bc4064490 2026-02-13T20:11:31.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f21affff640 1 -- 10.20.193.110:0/2286628340 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3382524993 0 0) 0x7f21d40621e0 con 0x7f21d4094410 2026-02-13T20:11:31.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f21affff640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f21affff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f21affff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f21affff640 10 monclient(hunting): my global_id is 4282 2026-02-13T20:11:31.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f21affff640 1 -- 10.20.193.110:0/2286628340 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21d41a5fe0 con 0x7f21d4094410 2026-02-13T20:11:31.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f21affff640 1 -- 10.20.193.110:0/2286628340 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 507362051 0 0) 0x7f21d4091d80 con 0x7f21d4094870 2026-02-13T20:11:31.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f21affff640 1 -- 10.20.193.110:0/2286628340 >> v1:10.20.193.188:6789/0 conn(0x7f21d4094410 legacy=0x7f21d421a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f21affff640 1 -- 10.20.193.110:0/2286628340 >> v1:10.20.193.110:6789/0 conn(0x7f21d4094040 legacy=0x7f21d41abcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f21affff640 10 monclient: _finish_hunting 0 2026-02-13T20:11:31.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f21affff640 1 monclient: found mon.c 2026-02-13T20:11:31.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f21affff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:31.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f21affff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:31.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f21affff640 1 -- 10.20.193.110:0/2286628340 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21d41a8540 con 0x7f21d4094870 2026-02-13T20:11:31.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f21affff640 10 monclient: _finish_auth 0 2026-02-13T20:11:31.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f21affff640 10 monclient: _check_auth_tickets 2026-02-13T20:11:31.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f21affff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:31.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f21d9e12640 5 monclient: authenticate success, global_id 4277 2026-02-13T20:11:31.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f21d9e12640 10 monclient: _renew_subs 2026-02-13T20:11:31.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f21d9e12640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:31.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f21d9e12640 1 -- 10.20.193.110:0/2286628340 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f21d41aa5c0 con 0x7f21d4094870 2026-02-13T20:11:31.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f21d9e12640 10 monclient: _renew_subs 2026-02-13T20:11:31.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f21d9e12640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:31.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f21d9e12640 1 -- 10.20.193.110:0/2286628340 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f21d41ac3e0 con 0x7f21d4094870 2026-02-13T20:11:31.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f6506c52640 10 monclient: build_initial_monmap 2026-02-13T20:11:31.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f6506c52640 10 monclient: monmap: 2026-02-13T20:11:31.545 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:31.545 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:31.545 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:11:31.545 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:11:31.545 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:31.545 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:11:31.545 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:31.545 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:31.545 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:31.545 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7feddcff9640 1 -- 10.20.193.110:0/2031406972 <== osd.0 v1:10.20.193.110:6808/2638069221 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (unknown 0 0 784407017) 0x7feda80864a0 con 0x7feda8064820 2026-02-13T20:11:31.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f6506c52640 1 Processor -- start 2026-02-13T20:11:31.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f21affff640 1 -- 10.20.193.110:0/2286628340 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f21c80042a0 con 0x7f21d4094870 2026-02-13T20:11:31.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f21d9e12640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:31.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f21d9e12640 1 -- 10.20.193.110:0/2286628340 --> v1:10.20.193.110:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f21d41a6260 con 0x7f21d4094870 2026-02-13T20:11:31.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f21affff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:31.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f21affff640 1 -- 10.20.193.110:0/2286628340 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f21c80048e0 con 0x7f21d4094870 2026-02-13T20:11:31.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f21affff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:31.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f21affff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:31.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f21d1ffb640 4 set_mon_vals no callback set 2026-02-13T20:11:31.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f21affff640 10 monclient: dump: 2026-02-13T20:11:31.546 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.546 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.546 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.546 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.546 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.546 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.546 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.546 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.546 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.546 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f6506c52640 1 -- start start 2026-02-13T20:11:31.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f6506c52640 10 monclient: init 2026-02-13T20:11:31.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.461+0000 7f6506c52640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:31.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f6506c52640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:11:31.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f6506c52640 10 monclient(hunting): picked mon.noname-c con 0x7f6500091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:31.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f6506c52640 10 monclient(hunting): picked mon.noname-b con 0x7f65001401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:31.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f6506c52640 10 monclient(hunting): picked mon.noname-a con 0x7f6500089e40 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:31.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f6506c52640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f650012af60 con 0x7f6500089e40 2026-02-13T20:11:31.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f6506c52640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f650008ac20 con 0x7f65001401c0 2026-02-13T20:11:31.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f6506c52640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6500090e80 con 0x7f6500091950 2026-02-13T20:11:31.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f6506c52640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:31.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f6506c52640 10 monclient(hunting): authenticate will time out at 653.153044s 2026-02-13T20:11:31.547 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f0e7f7fe640 1 -- 10.20.193.110:0/300697743 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0e78003010 con 0x7f0e88094040 2026-02-13T20:11:31.547 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f0e7f7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:31.547 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f0e7f7fe640 1 -- 10.20.193.110:0/300697743 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f0e78003420 con 0x7f0e88094040 2026-02-13T20:11:31.547 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f0e7f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:31.547 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f0e7f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:31.547 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f0e7f7fe640 10 monclient: dump: 2026-02-13T20:11:31.547 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.547 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.547 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.547 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.547 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.547 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.547 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.547 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.547 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.547 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.547 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f0e8eecc640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:31.547 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f0e8eecc640 4 set_mon_vals no callback set 2026-02-13T20:11:31.547 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f21affff640 1 -- 10.20.193.110:0/2286628340 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f21c8004a80 con 0x7f21d4094870 2026-02-13T20:11:31.547 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f65049c7640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f6500091950 0x7f650013e930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:39670/0 (socket says 10.20.193.110:39670) 2026-02-13T20:11:31.547 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f65051c8640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f6500089e40 0x7f65001a2760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:59934/0 (socket says 10.20.193.110:59934) 2026-02-13T20:11:31.547 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f65049c7640 1 -- 10.20.193.110:0/699528610 learned_addr learned my addr 10.20.193.110:0/699528610 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:31.547 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f21affff640 1 -- 10.20.193.110:0/2286628340 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3559+0+0 (unknown 1530614704 0 0) 0x7f21c804e5f0 con 0x7f21d4094870 2026-02-13T20:11:31.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f21affff640 1 -- 10.20.193.110:0/2286628340 --> v1:10.20.193.188:6800/3648478668 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f21a4086530 con 0x7f21a4064890 2026-02-13T20:11:31.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f21affff640 1 -- 10.20.193.110:0/2286628340 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (unknown 4138596325 0 0) 0x7f21c804e9c0 con 0x7f21d4094870 2026-02-13T20:11:31.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f21affff640 10 monclient: handle_get_version_reply finishing 1 version 19 2026-02-13T20:11:31.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f64f57fa640 1 -- 10.20.193.110:0/699528610 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2452473129 0 0) 0x7f6500090e80 con 0x7f6500091950 2026-02-13T20:11:31.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f64f57fa640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f64f57fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f64f57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f64f57fa640 10 monclient(hunting): my global_id is 4280 2026-02-13T20:11:31.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f64f57fa640 1 -- 10.20.193.110:0/699528610 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f64d00035e0 con 0x7f6500091950 2026-02-13T20:11:31.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f21d37fe640 10 monclient: get_auth_request con 0x7f21a403fc60 auth_method 0 2026-02-13T20:11:31.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f64f57fa640 1 -- 10.20.193.110:0/699528610 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1137209987 0 0) 0x7f650012af60 con 0x7f6500089e40 2026-02-13T20:11:31.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f64f57fa640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f64f57fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f64f57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f64f57fa640 10 monclient(hunting): my global_id is 4281 2026-02-13T20:11:31.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f64f57fa640 1 -- 10.20.193.110:0/699528610 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6500090e80 con 0x7f6500089e40 2026-02-13T20:11:31.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f21d2ffd640 10 monclient: get_auth_request con 0x7f21a4064890 auth_method 0 2026-02-13T20:11:31.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f64f57fa640 1 -- 10.20.193.110:0/699528610 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3899371368 0 0) 0x7f64d00035e0 con 0x7f6500091950 2026-02-13T20:11:31.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f64f57fa640 1 -- 10.20.193.110:0/699528610 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f650012af60 con 0x7f6500091950 2026-02-13T20:11:31.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f64f57fa640 1 -- 10.20.193.110:0/699528610 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f64f0003340 con 0x7f6500091950 2026-02-13T20:11:31.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f64f57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:31.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f64f57fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:11:31.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f64f57fa640 10 monclient(hunting): dump: 2026-02-13T20:11:31.549 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.549 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.549 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.549 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.549 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.549 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.549 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.549 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.549 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.549 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f64f57fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:31.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f64f57fa640 1 -- 10.20.193.110:0/699528610 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3395999400 0 0) 0x7f6500090e80 con 0x7f6500089e40 2026-02-13T20:11:31.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f64f57fa640 1 -- 10.20.193.110:0/699528610 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f64d00035e0 con 0x7f6500089e40 2026-02-13T20:11:31.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f64f57fa640 1 -- 10.20.193.110:0/699528610 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f64fc0051b0 con 0x7f6500089e40 2026-02-13T20:11:31.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f64f57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:31.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f64f57fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:31.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f64f57fa640 10 monclient(hunting): dump: 2026-02-13T20:11:31.549 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.549 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.549 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.550 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.550 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.550 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.550 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.550 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.550 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.550 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f64f57fa640 1 -- 10.20.193.110:0/699528610 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3455375967 0 0) 0x7f650012af60 con 0x7f6500091950 2026-02-13T20:11:31.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f64f57fa640 1 -- 10.20.193.110:0/699528610 >> v1:10.20.193.188:6789/0 conn(0x7f65001401c0 legacy=0x7f65001a1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f64f57fa640 1 -- 10.20.193.110:0/699528610 >> v1:10.20.193.110:6789/0 conn(0x7f6500089e40 legacy=0x7f65001a2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f64f57fa640 10 monclient: _finish_hunting 0 2026-02-13T20:11:31.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f64f57fa640 1 monclient: found mon.c 2026-02-13T20:11:31.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f64f57fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:31.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f64f57fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:31.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f64f57fa640 1 -- 10.20.193.110:0/699528610 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f650012a9a0 con 0x7f6500091950 2026-02-13T20:11:31.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f64f57fa640 10 monclient: _finish_auth 0 2026-02-13T20:11:31.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f64f57fa640 10 monclient: _check_auth_tickets 2026-02-13T20:11:31.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f64f57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:31.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f6506c52640 5 monclient: authenticate success, global_id 4280 2026-02-13T20:11:31.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f6506c52640 10 monclient: _renew_subs 2026-02-13T20:11:31.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f6506c52640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:31.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.462+0000 7f6506c52640 1 -- 10.20.193.110:0/699528610 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f650012ac80 con 0x7f6500091950 2026-02-13T20:11:31.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.463+0000 7f6506c52640 10 monclient: _renew_subs 2026-02-13T20:11:31.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.463+0000 7f6506c52640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:31.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.463+0000 7f6506c52640 1 -- 10.20.193.110:0/699528610 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f650008c2a0 con 0x7f6500091950 2026-02-13T20:11:31.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.463+0000 7f64f57fa640 1 -- 10.20.193.110:0/699528610 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f64f0002940 con 0x7f6500091950 2026-02-13T20:11:31.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.463+0000 7f64f57fa640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:31.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.463+0000 7f64f57fa640 1 -- 10.20.193.110:0/699528610 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f64f0004e60 con 0x7f6500091950 2026-02-13T20:11:31.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.463+0000 7f64f57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:31.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.463+0000 7f64f57fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:31.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.463+0000 7f64f57fa640 10 monclient: dump: 2026-02-13T20:11:31.550 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.550 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.550 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.550 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.550 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.550 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.550 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.550 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.550 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.550 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.463+0000 7f64f6ffd640 4 set_mon_vals no callback set 2026-02-13T20:11:31.551 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.463+0000 7f0e8eecc640 10 monclient: shutdown 2026-02-13T20:11:31.551 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.463+0000 7f0e8eecc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:31.551 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.463+0000 7f0e8eecc640 1 -- 10.20.193.110:0/300697743 >> v1:10.20.193.110:6790/0 conn(0x7f0e88094040 legacy=0x7f0e88093760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.551 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.463+0000 7f0e8eecc640 1 -- 10.20.193.110:0/300697743 shutdown_connections 2026-02-13T20:11:31.551 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.463+0000 7f0e8eecc640 1 -- 10.20.193.110:0/300697743 >> 10.20.193.110:0/300697743 conn(0x7f0e88054330 msgr2=0x7f0e88054730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:31.551 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.463+0000 7f0e8eecc640 1 -- 10.20.193.110:0/300697743 shutdown_connections 2026-02-13T20:11:31.551 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.463+0000 7f0e8eecc640 1 -- 10.20.193.110:0/300697743 wait complete. 2026-02-13T20:11:31.551 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.463+0000 7f6506c52640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:31.551 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.463+0000 7f6506c52640 1 -- 10.20.193.110:0/699528610 --> v1:10.20.193.110:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f650008b450 con 0x7f6500091950 2026-02-13T20:11:31.551 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.463+0000 7f21affff640 1 -- 10.20.193.110:0/2286628340 <== osd.3 v1:10.20.193.188:6800/3648478668 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (unknown 0 0 784407017) 0x7f21a4086530 con 0x7f21a4064890 2026-02-13T20:11:31.551 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.463+0000 7f0e8eecc640 10 monclient: build_initial_monmap 2026-02-13T20:11:31.551 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.463+0000 7f0e8eecc640 10 monclient: monmap: 2026-02-13T20:11:31.551 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:31.551 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:31.551 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:11:31.551 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:11:31.551 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:31.551 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:11:31.551 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:31.551 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:31.551 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:31.551 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.463+0000 7f64f57fa640 1 -- 10.20.193.110:0/699528610 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f64f0011ad0 con 0x7f6500091950 2026-02-13T20:11:31.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.463+0000 7f64f57fa640 1 -- 10.20.193.110:0/699528610 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3559+0+0 (unknown 1530614704 0 0) 0x7f64f004e9a0 con 0x7f6500091950 2026-02-13T20:11:31.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.463+0000 7f64f57fa640 1 -- 10.20.193.110:0/699528610 --> v1:10.20.193.188:6804/1615982170 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f64d0086290 con 0x7f64d00645f0 2026-02-13T20:11:31.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.463+0000 7f64f57fa640 1 -- 10.20.193.110:0/699528610 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (unknown 4138596325 0 0) 0x7f64f004ed70 con 0x7f6500091950 2026-02-13T20:11:31.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.463+0000 7f64f57fa640 10 monclient: handle_get_version_reply finishing 1 version 19 2026-02-13T20:11:31.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.464+0000 7f0e8eecc640 1 Processor -- start 2026-02-13T20:11:31.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.464+0000 7f64f7fff640 10 monclient: get_auth_request con 0x7f64d003f9c0 auth_method 0 2026-02-13T20:11:31.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.464+0000 7f0e8eecc640 1 -- start start 2026-02-13T20:11:31.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.464+0000 7f0e8eecc640 10 monclient: init 2026-02-13T20:11:31.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.464+0000 7f65051c8640 10 monclient: get_auth_request con 0x7f64d00645f0 auth_method 0 2026-02-13T20:11:31.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.464+0000 7f0e8eecc640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:31.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.464+0000 7f0e8eecc640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:11:31.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.464+0000 7f0e8eecc640 10 monclient(hunting): picked mon.noname-c con 0x7f0e88094040 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:31.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.464+0000 7f0e8eecc640 10 monclient(hunting): picked mon.noname-b con 0x7f0e88094410 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:31.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.464+0000 7f0e8eecc640 10 monclient(hunting): picked mon.noname-a con 0x7f0e88094870 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:31.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.464+0000 7f0e8eecc640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e8808d9c0 con 0x7f0e88094870 2026-02-13T20:11:31.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.464+0000 7f0e8eecc640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e881330d0 con 0x7f0e88094410 2026-02-13T20:11:31.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.464+0000 7f0e8eecc640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e88142f30 con 0x7f0e88094040 2026-02-13T20:11:31.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.464+0000 7f0e8eecc640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:31.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.464+0000 7f0e8eecc640 10 monclient(hunting): authenticate will time out at 653.155399s 2026-02-13T20:11:31.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.464+0000 7f0e8cc41640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f0e88094040 0x7f0e881524e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:39678/0 (socket says 10.20.193.110:39678) 2026-02-13T20:11:31.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.464+0000 7f0e8cc41640 1 -- 10.20.193.110:0/3063989039 learned_addr learned my addr 10.20.193.110:0/3063989039 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:31.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.464+0000 7f0e7d7fa640 1 -- 10.20.193.110:0/3063989039 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 204115721 0 0) 0x7f0e88142f30 con 0x7f0e88094040 2026-02-13T20:11:31.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.464+0000 7f0e7d7fa640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.464+0000 7f0e7d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.464+0000 7f0e7d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.464+0000 7f0e7d7fa640 10 monclient(hunting): my global_id is 4283 2026-02-13T20:11:31.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.464+0000 7f0e7d7fa640 1 -- 10.20.193.110:0/3063989039 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e580035e0 con 0x7f0e88094040 2026-02-13T20:11:31.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.464+0000 7f0e7d7fa640 1 -- 10.20.193.110:0/3063989039 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3790377167 0 0) 0x7f0e881330d0 con 0x7f0e88094410 2026-02-13T20:11:31.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.464+0000 7f0e7d7fa640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.464+0000 7f0e7d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.464+0000 7f0e7d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.464+0000 7f0e7d7fa640 10 monclient(hunting): my global_id is 4285 2026-02-13T20:11:31.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.464+0000 7f0e7d7fa640 1 -- 10.20.193.110:0/3063989039 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e88142f30 con 0x7f0e88094410 2026-02-13T20:11:31.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.464+0000 7f0e7d7fa640 1 -- 10.20.193.110:0/3063989039 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2405816053 0 0) 0x7f0e580035e0 con 0x7f0e88094040 2026-02-13T20:11:31.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.464+0000 7f0e7d7fa640 1 -- 10.20.193.110:0/3063989039 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0e881330d0 con 0x7f0e88094040 2026-02-13T20:11:31.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.464+0000 7f0e7d7fa640 1 -- 10.20.193.110:0/3063989039 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f0e78002ce0 con 0x7f0e88094040 2026-02-13T20:11:31.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.464+0000 7f0e7d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:31.554 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.465+0000 7f64f57fa640 1 -- 10.20.193.110:0/699528610 <== osd.4 v1:10.20.193.188:6804/1615982170 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (unknown 0 0 784407017) 0x7f64d0086290 con 0x7f64d00645f0 2026-02-13T20:11:31.555 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.464+0000 7f0e7d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:11:31.555 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.464+0000 7f0e7d7fa640 10 monclient(hunting): dump: 2026-02-13T20:11:31.555 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.555 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.555 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.555 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.555 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.555 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.555 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.555 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.555 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.555 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.555 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.464+0000 7f0e7d7fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:31.555 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.464+0000 7f0e7d7fa640 1 -- 10.20.193.110:0/3063989039 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 995087286 0 0) 0x7f0e8808d9c0 con 0x7f0e88094870 2026-02-13T20:11:31.555 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.464+0000 7f0e7d7fa640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.555 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.464+0000 7f0e7d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.555 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.464+0000 7f0e7d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.555 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.464+0000 7f0e7d7fa640 10 monclient(hunting): my global_id is 4284 2026-02-13T20:11:31.555 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.464+0000 7f0e7d7fa640 1 -- 10.20.193.110:0/3063989039 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e580035e0 con 0x7f0e88094870 2026-02-13T20:11:31.555 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.465+0000 7f0e7d7fa640 1 -- 10.20.193.110:0/3063989039 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2334546131 0 0) 0x7f0e88142f30 con 0x7f0e88094410 2026-02-13T20:11:31.555 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.465+0000 7f0e7d7fa640 1 -- 10.20.193.110:0/3063989039 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0e8808d9c0 con 0x7f0e88094410 2026-02-13T20:11:31.555 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.465+0000 7f0e7d7fa640 1 -- 10.20.193.110:0/3063989039 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f0e70003090 con 0x7f0e88094410 2026-02-13T20:11:31.555 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.465+0000 7f0e7d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:31.555 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.465+0000 7f0e7d7fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-13T20:11:31.556 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.465+0000 7f0e7d7fa640 10 monclient(hunting): dump: 2026-02-13T20:11:31.556 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.556 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.556 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.556 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.556 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.556 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.556 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.556 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.556 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.556 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.556 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.465+0000 7f0e7d7fa640 1 -- 10.20.193.110:0/3063989039 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3564132835 0 0) 0x7f0e881330d0 con 0x7f0e88094040 2026-02-13T20:11:31.556 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.465+0000 7f0e7d7fa640 1 -- 10.20.193.110:0/3063989039 >> v1:10.20.193.188:6789/0 conn(0x7f0e88094410 legacy=0x7f0e88193720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.556 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.465+0000 7f0e7d7fa640 1 -- 10.20.193.110:0/3063989039 >> v1:10.20.193.110:6789/0 conn(0x7f0e88094870 legacy=0x7f0e88194e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.556 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.465+0000 7f0e7d7fa640 10 monclient: _finish_hunting 0 2026-02-13T20:11:31.556 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.465+0000 7f0e7d7fa640 1 monclient: found mon.c 2026-02-13T20:11:31.556 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.465+0000 7f0e7d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:31.556 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.465+0000 7f0e7d7fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:31.556 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.465+0000 7f0e7d7fa640 1 -- 10.20.193.110:0/3063989039 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e880621e0 con 0x7f0e88094040 2026-02-13T20:11:31.556 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.465+0000 7f0e7d7fa640 10 monclient: _finish_auth 0 2026-02-13T20:11:31.556 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.465+0000 7f0e7d7fa640 10 monclient: _check_auth_tickets 2026-02-13T20:11:31.556 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.465+0000 7f0e7d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:31.556 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.465+0000 7f0e8eecc640 5 monclient: authenticate success, global_id 4283 2026-02-13T20:11:31.556 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.465+0000 7f0e8eecc640 10 monclient: _renew_subs 2026-02-13T20:11:31.556 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.465+0000 7f0e8eecc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:31.556 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.465+0000 7f0e8eecc640 1 -- 10.20.193.110:0/3063989039 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0e88131610 con 0x7f0e88094040 2026-02-13T20:11:31.556 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.465+0000 7f0e8eecc640 10 monclient: _renew_subs 2026-02-13T20:11:31.556 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.465+0000 7f0e8eecc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:31.556 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.465+0000 7f0e8eecc640 1 -- 10.20.193.110:0/3063989039 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f0e88132170 con 0x7f0e88094040 2026-02-13T20:11:31.556 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.465+0000 7f0e8eecc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:31.556 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.465+0000 7f0e8eecc640 1 -- 10.20.193.110:0/3063989039 --> v1:10.20.193.110:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f0e8808c960 con 0x7f0e88094040 2026-02-13T20:11:31.556 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.465+0000 7f0e7d7fa640 1 -- 10.20.193.110:0/3063989039 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0e78004b50 con 0x7f0e88094040 2026-02-13T20:11:31.556 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.465+0000 7f0e7d7fa640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:31.556 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.465+0000 7f0e7d7fa640 1 -- 10.20.193.110:0/3063989039 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f0e78004eb0 con 0x7f0e88094040 2026-02-13T20:11:31.556 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.465+0000 7f0e7d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:31.556 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.465+0000 7f0e7d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:31.556 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.465+0000 7f0e7effd640 4 set_mon_vals no callback set 2026-02-13T20:11:31.556 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.465+0000 7f0e7d7fa640 10 monclient: dump: 2026-02-13T20:11:31.556 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.556 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.556 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.556 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.556 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.556 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.557 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.557 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.557 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.557 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.465+0000 7f0e7d7fa640 1 -- 10.20.193.110:0/3063989039 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f0e78005080 con 0x7f0e88094040 2026-02-13T20:11:31.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.466+0000 7f0e7d7fa640 1 -- 10.20.193.110:0/3063989039 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3559+0+0 (unknown 1530614704 0 0) 0x7f0e7804e920 con 0x7f0e88094040 2026-02-13T20:11:31.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.466+0000 7f0e7d7fa640 1 -- 10.20.193.110:0/3063989039 --> v1:10.20.193.188:6805/4130810301 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0e5808ef50 con 0x7f0e5806d2b0 2026-02-13T20:11:31.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.466+0000 7f0e7d7fa640 1 -- 10.20.193.110:0/3063989039 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (unknown 4138596325 0 0) 0x7f0e7804ecf0 con 0x7f0e88094040 2026-02-13T20:11:31.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.466+0000 7f0e7d7fa640 10 monclient: handle_get_version_reply finishing 1 version 19 2026-02-13T20:11:31.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.466+0000 7f0e7ffff640 10 monclient: get_auth_request con 0x7f0e58048680 auth_method 0 2026-02-13T20:11:31.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.466+0000 7f0e8d442640 10 monclient: get_auth_request con 0x7f0e5806d2b0 auth_method 0 2026-02-13T20:11:31.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.467+0000 7f0e7d7fa640 1 -- 10.20.193.110:0/3063989039 <== osd.5 v1:10.20.193.188:6805/4130810301 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (unknown 0 0 784407017) 0x7f0e5808ef50 con 0x7f0e5806d2b0 2026-02-13T20:11:31.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.469+0000 7f2bfa812640 1 -- 10.20.193.110:0/2848305932 --> v1:10.20.193.110:6804/2437753968 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2bf4112700 con 0x7f2bc4064490 2026-02-13T20:11:31.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.469+0000 7ff6a4c8c640 1 -- 10.20.193.110:0/3868269685 --> v1:10.20.193.110:6800/3182322764 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff6a012f540 con 0x7ff66c0647f0 2026-02-13T20:11:31.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.470+0000 7f2bf0ff9640 1 -- 10.20.193.110:0/2848305932 <== osd.2 v1:10.20.193.110:6804/2437753968 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1800444376) 0x7f2bf4112700 con 0x7f2bc4064490 2026-02-13T20:11:31.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.470+0000 7ff686ffd640 1 -- 10.20.193.110:0/3868269685 <== osd.1 v1:10.20.193.110:6800/3182322764 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1800444376) 0x7ff6a012f540 con 0x7ff66c0647f0 2026-02-13T20:11:31.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.470+0000 7f2bfa812640 1 -- 10.20.193.110:0/2848305932 >> v1:10.20.193.110:6804/2437753968 conn(0x7f2bc4064490 legacy=0x7f2bc40848c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.470+0000 7f2bfa812640 1 -- 10.20.193.110:0/2848305932 >> v1:10.20.193.188:6812/1623052694 conn(0x7f2bc403f860 legacy=0x7f2bc405fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.470+0000 7f2bfa812640 10 monclient: shutdown 2026-02-13T20:11:31.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.470+0000 7f2bfa812640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:31.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.470+0000 7f2bfa812640 1 -- 10.20.193.110:0/2848305932 >> v1:10.20.193.110:6789/0 conn(0x7f2bf4184b60 legacy=0x7f2bf4173770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.558 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.470+0000 7ff6a4c8c640 1 -- 10.20.193.110:0/3868269685 >> v1:10.20.193.110:6800/3182322764 conn(0x7ff66c0647f0 legacy=0x7ff66c084c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.558 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.470+0000 7ff6a4c8c640 1 -- 10.20.193.110:0/3868269685 >> v1:10.20.193.188:6812/1623052694 conn(0x7ff66c03fcc0 legacy=0x7ff66c060170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.558 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.470+0000 7ff6a4c8c640 10 monclient: shutdown 2026-02-13T20:11:31.558 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.470+0000 7ff6a4c8c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:31.558 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.470+0000 7ff6a4c8c640 1 -- 10.20.193.110:0/3868269685 >> v1:10.20.193.110:6790/0 conn(0x7ff6a01401c0 legacy=0x7ff6a012c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.558 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.470+0000 7ff69ed76640 1 -- 10.20.193.110:0/3868269685 reap_dead start 2026-02-13T20:11:31.558 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.470+0000 7f2bf8d88640 1 -- 10.20.193.110:0/2848305932 reap_dead start 2026-02-13T20:11:31.558 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.470+0000 7f2bfa812640 1 -- 10.20.193.110:0/2848305932 shutdown_connections 2026-02-13T20:11:31.558 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.470+0000 7f2bfa812640 1 -- 10.20.193.110:0/2848305932 >> 10.20.193.110:0/2848305932 conn(0x7f2bf4054330 msgr2=0x7f2bf408db50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:31.558 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.470+0000 7ff6a4c8c640 1 -- 10.20.193.110:0/3868269685 shutdown_connections 2026-02-13T20:11:31.558 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.470+0000 7ff6a4c8c640 1 -- 10.20.193.110:0/3868269685 >> 10.20.193.110:0/3868269685 conn(0x7ff6a0054e90 msgr2=0x7ff6a0089810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:31.558 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.470+0000 7ff6a4c8c640 1 -- 10.20.193.110:0/3868269685 shutdown_connections 2026-02-13T20:11:31.558 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.470+0000 7f2bfa812640 1 -- 10.20.193.110:0/2848305932 shutdown_connections 2026-02-13T20:11:31.558 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.470+0000 7ff6a4c8c640 1 -- 10.20.193.110:0/3868269685 wait complete. 2026-02-13T20:11:31.558 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.470+0000 7f2bfa812640 1 -- 10.20.193.110:0/2848305932 wait complete. 2026-02-13T20:11:31.558 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.472+0000 7fede679d640 1 -- 10.20.193.110:0/2031406972 --> v1:10.20.193.110:6808/2638069221 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fede0112040 con 0x7feda8064820 2026-02-13T20:11:31.559 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.473+0000 7f6506c52640 1 -- 10.20.193.110:0/699528610 --> v1:10.20.193.188:6804/1615982170 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f650008cce0 con 0x7f64d00645f0 2026-02-13T20:11:31.559 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.473+0000 7f64f57fa640 1 -- 10.20.193.110:0/699528610 <== osd.4 v1:10.20.193.188:6804/1615982170 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1800444376) 0x7f650008cce0 con 0x7f64d00645f0 2026-02-13T20:11:31.559 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.473+0000 7feddcff9640 1 -- 10.20.193.110:0/2031406972 <== osd.0 v1:10.20.193.110:6808/2638069221 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 654699149) 0x7fede0112040 con 0x7feda8064820 2026-02-13T20:11:31.559 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.473+0000 7f6506c52640 1 -- 10.20.193.110:0/699528610 >> v1:10.20.193.188:6804/1615982170 conn(0x7f64d00645f0 legacy=0x7f64d0084a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.559 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.473+0000 7f6506c52640 1 -- 10.20.193.110:0/699528610 >> v1:10.20.193.188:6812/1623052694 conn(0x7f64d003f9c0 legacy=0x7f64d005fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.559 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.473+0000 7f6506c52640 10 monclient: shutdown 2026-02-13T20:11:31.559 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.473+0000 7f6506c52640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:31.559 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.473+0000 7f6506c52640 1 -- 10.20.193.110:0/699528610 >> v1:10.20.193.110:6790/0 conn(0x7f6500091950 legacy=0x7f650013e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.559 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.473+0000 7f65051c8640 1 -- 10.20.193.110:0/699528610 reap_dead start 2026-02-13T20:11:31.559 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.474+0000 7f6506c52640 1 -- 10.20.193.110:0/699528610 shutdown_connections 2026-02-13T20:11:31.559 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.474+0000 7f6506c52640 1 -- 10.20.193.110:0/699528610 >> 10.20.193.110:0/699528610 conn(0x7f6500054e90 msgr2=0x7f650008dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:31.559 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.474+0000 7f21d9e12640 1 -- 10.20.193.110:0/2286628340 --> v1:10.20.193.188:6800/3648478668 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f21d41d9c90 con 0x7f21a4064890 2026-02-13T20:11:31.559 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.474+0000 7fede679d640 1 -- 10.20.193.110:0/2031406972 >> v1:10.20.193.110:6808/2638069221 conn(0x7feda8064820 legacy=0x7feda8084c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.559 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.474+0000 7f6506c52640 1 -- 10.20.193.110:0/699528610 shutdown_connections 2026-02-13T20:11:31.559 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.474+0000 7f6506c52640 1 -- 10.20.193.110:0/699528610 wait complete. 2026-02-13T20:11:31.560 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.474+0000 7fede679d640 1 -- 10.20.193.110:0/2031406972 >> v1:10.20.193.188:6812/1623052694 conn(0x7feda803fcc0 legacy=0x7feda8060170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.560 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.474+0000 7fede679d640 10 monclient: shutdown 2026-02-13T20:11:31.560 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.474+0000 7fede679d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:31.560 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.474+0000 7fede679d640 1 -- 10.20.193.110:0/2031406972 >> v1:10.20.193.110:6790/0 conn(0x7fede0089250 legacy=0x7fede0171eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.560 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.474+0000 7fede4d13640 1 -- 10.20.193.110:0/2031406972 reap_dead start 2026-02-13T20:11:31.560 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.474+0000 7f21affff640 1 -- 10.20.193.110:0/2286628340 <== osd.3 v1:10.20.193.188:6800/3648478668 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1800444376) 0x7f21c4004e20 con 0x7f21a4064890 2026-02-13T20:11:31.560 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.474+0000 7fede679d640 1 -- 10.20.193.110:0/2031406972 shutdown_connections 2026-02-13T20:11:31.560 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.474+0000 7fede679d640 1 -- 10.20.193.110:0/2031406972 >> 10.20.193.110:0/2031406972 conn(0x7fede0054330 msgr2=0x7fede008ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:31.560 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.474+0000 7fede679d640 1 -- 10.20.193.110:0/2031406972 shutdown_connections 2026-02-13T20:11:31.560 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.474+0000 7fede679d640 1 -- 10.20.193.110:0/2031406972 wait complete. 2026-02-13T20:11:31.560 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.474+0000 7f21d9e12640 1 -- 10.20.193.110:0/2286628340 >> v1:10.20.193.188:6800/3648478668 conn(0x7f21a4064890 legacy=0x7f21a4084cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.560 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.474+0000 7f21d9e12640 1 -- 10.20.193.110:0/2286628340 >> v1:10.20.193.188:6812/1623052694 conn(0x7f21a403fc60 legacy=0x7f21a4060110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.560 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.474+0000 7f21d9e12640 10 monclient: shutdown 2026-02-13T20:11:31.560 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.474+0000 7f21d9e12640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:31.560 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.474+0000 7f21d9e12640 1 -- 10.20.193.110:0/2286628340 >> v1:10.20.193.110:6790/0 conn(0x7f21d4094870 legacy=0x7f21d423bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.560 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.474+0000 7f21d3fff640 1 -- 10.20.193.110:0/2286628340 reap_dead start 2026-02-13T20:11:31.561 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.474+0000 7f21d9e12640 1 -- 10.20.193.110:0/2286628340 shutdown_connections 2026-02-13T20:11:31.561 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.474+0000 7f21d9e12640 1 -- 10.20.193.110:0/2286628340 >> 10.20.193.110:0/2286628340 conn(0x7f21d4054330 msgr2=0x7f21d408bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:31.561 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.474+0000 7f21d9e12640 1 -- 10.20.193.110:0/2286628340 shutdown_connections 2026-02-13T20:11:31.561 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.474+0000 7f21d9e12640 1 -- 10.20.193.110:0/2286628340 wait complete. 2026-02-13T20:11:31.561 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.475+0000 7f0e8eecc640 1 -- 10.20.193.110:0/3063989039 --> v1:10.20.193.188:6805/4130810301 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0e88089310 con 0x7f0e5806d2b0 2026-02-13T20:11:31.561 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.475+0000 7f0e7d7fa640 1 -- 10.20.193.110:0/3063989039 <== osd.5 v1:10.20.193.188:6805/4130810301 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1800444376) 0x7f0e88089310 con 0x7f0e5806d2b0 2026-02-13T20:11:31.561 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.475+0000 7f0e8eecc640 1 -- 10.20.193.110:0/3063989039 >> v1:10.20.193.188:6805/4130810301 conn(0x7f0e5806d2b0 legacy=0x7f0e5808d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.561 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.475+0000 7f0e8eecc640 1 -- 10.20.193.110:0/3063989039 >> v1:10.20.193.188:6812/1623052694 conn(0x7f0e58048680 legacy=0x7f0e58068b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.561 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.475+0000 7f0e8eecc640 10 monclient: shutdown 2026-02-13T20:11:31.561 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.475+0000 7f0e8eecc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:31.561 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.475+0000 7f0e8eecc640 1 -- 10.20.193.110:0/3063989039 >> v1:10.20.193.110:6790/0 conn(0x7f0e88094040 legacy=0x7f0e881524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.561 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.475+0000 7f0e8d442640 1 -- 10.20.193.110:0/3063989039 reap_dead start 2026-02-13T20:11:31.561 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.475+0000 7f0e8eecc640 1 -- 10.20.193.110:0/3063989039 shutdown_connections 2026-02-13T20:11:31.561 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.475+0000 7f0e8eecc640 1 -- 10.20.193.110:0/3063989039 >> 10.20.193.110:0/3063989039 conn(0x7f0e88054330 msgr2=0x7f0e8808eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:31.561 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.475+0000 7f0e8eecc640 1 -- 10.20.193.110:0/3063989039 shutdown_connections 2026-02-13T20:11:31.561 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.475+0000 7f0e8eecc640 1 -- 10.20.193.110:0/3063989039 wait complete. 2026-02-13T20:11:31.562 INFO:teuthology.orchestra.run.trial110.stdout:47244640259 2026-02-13T20:11:31.562 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-13T20:11:31.562 INFO:teuthology.orchestra.run.trial110.stdout:47244640259 2026-02-13T20:11:31.562 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-13T20:11:31.562 INFO:teuthology.orchestra.run.trial110.stdout:47244640259 2026-02-13T20:11:31.563 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-13T20:11:31.563 INFO:teuthology.orchestra.run.trial110.stdout:47244640260 2026-02-13T20:11:31.563 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-13T20:11:31.563 INFO:teuthology.orchestra.run.trial110.stdout:47244640259 2026-02-13T20:11:31.563 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-13T20:11:31.564 INFO:teuthology.orchestra.run.trial110.stdout:47244640259 2026-02-13T20:11:31.564 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-13T20:11:31.669 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.667+0000 7fc871d14640 10 monclient: get_monmap_and_config 2026-02-13T20:11:31.670 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.667+0000 7fc871d14640 10 monclient: build_initial_monmap 2026-02-13T20:11:31.670 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.667+0000 7fc871d14640 10 monclient: monmap: 2026-02-13T20:11:31.670 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:31.670 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.670 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:31.668693+0000 2026-02-13T20:11:31.670 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:31.668693+0000 2026-02-13T20:11:31.670 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:31.670 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.670 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:31.670 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:31.670 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:31.670 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.670 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.667+0000 7fc871d14640 1 Processor -- start 2026-02-13T20:11:31.670 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.667+0000 7fc871d14640 1 -- start start 2026-02-13T20:11:31.670 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.667+0000 7fc871d14640 10 monclient: init 2026-02-13T20:11:31.671 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.667+0000 7f2a7c5db640 10 monclient: get_monmap_and_config 2026-02-13T20:11:31.671 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.667+0000 7f2a7c5db640 10 monclient: build_initial_monmap 2026-02-13T20:11:31.671 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.667+0000 7f2a7c5db640 10 monclient: monmap: 2026-02-13T20:11:31.671 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:31.671 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.671 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:31.669154+0000 2026-02-13T20:11:31.671 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:31.669154+0000 2026-02-13T20:11:31.671 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:31.671 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.671 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:31.671 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:31.671 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:31.671 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.671 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.667+0000 7fc871d14640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:31.671 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.667+0000 7fc871d14640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:11:31.671 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7fc871d14640 10 monclient(hunting): picked mon.noname-a con 0x7fc86c140180 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:31.672 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.667+0000 7f83aa8cc640 10 monclient: get_monmap_and_config 2026-02-13T20:11:31.672 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.667+0000 7f83aa8cc640 10 monclient: build_initial_monmap 2026-02-13T20:11:31.672 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.667+0000 7f83aa8cc640 10 monclient: monmap: 2026-02-13T20:11:31.672 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:31.672 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.672 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:31.669364+0000 2026-02-13T20:11:31.672 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:31.669364+0000 2026-02-13T20:11:31.672 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:31.672 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.672 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:31.672 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:31.672 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:31.672 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.673 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7fc871d14640 10 monclient(hunting): picked mon.noname-c con 0x7fc86c05ca00 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:31.673 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7fc871d14640 10 monclient(hunting): picked mon.noname-b con 0x7fc86c08be90 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:31.673 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7fc871d14640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc86c08b160 con 0x7fc86c140180 2026-02-13T20:11:31.673 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7fc871d14640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc86c05bb90 con 0x7fc86c05ca00 2026-02-13T20:11:31.673 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7fc871d14640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc86c08b440 con 0x7fc86c08be90 2026-02-13T20:11:31.673 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7fc871d14640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:31.673 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7fc871d14640 10 monclient(hunting): authenticate will time out at 653.359069s 2026-02-13T20:11:31.673 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7fc870d12640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fc86c140180 0x7fc86c140550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:59950/0 (socket says 10.20.193.110:59950) 2026-02-13T20:11:31.673 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7fc870d12640 1 -- 10.20.193.110:0/3297217674 learned_addr learned my addr 10.20.193.110:0/3297217674 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:31.673 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7f95a421b640 10 monclient: get_monmap_and_config 2026-02-13T20:11:31.673 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7f95a421b640 10 monclient: build_initial_monmap 2026-02-13T20:11:31.673 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7f95a421b640 10 monclient: monmap: 2026-02-13T20:11:31.673 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:31.673 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.673 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:31.669585+0000 2026-02-13T20:11:31.673 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:31.669585+0000 2026-02-13T20:11:31.673 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:31.673 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.673 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:31.674 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:31.674 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:31.674 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.674 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7fc871513640 1 --1- 10.20.193.110:0/3297217674 >> v1:10.20.193.110:6790/0 conn(0x7fc86c08be90 0x7fc86c1a26a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:39688/0 (socket says 10.20.193.110:39688) 2026-02-13T20:11:31.674 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7f22d7379640 10 monclient: get_monmap_and_config 2026-02-13T20:11:31.674 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7f22d7379640 10 monclient: build_initial_monmap 2026-02-13T20:11:31.674 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7f22d7379640 10 monclient: monmap: 2026-02-13T20:11:31.674 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:31.674 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.674 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:31.669598+0000 2026-02-13T20:11:31.674 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:31.669598+0000 2026-02-13T20:11:31.674 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:31.674 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.674 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:31.674 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:31.674 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:31.675 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.675 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7f2a7c5db640 1 Processor -- start 2026-02-13T20:11:31.675 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7f2a7c5db640 1 -- start start 2026-02-13T20:11:31.675 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7f2a7c5db640 10 monclient: init 2026-02-13T20:11:31.675 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7f83aa8cc640 1 Processor -- start 2026-02-13T20:11:31.675 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7fc8637fe640 1 -- 10.20.193.110:0/3297217674 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4100946531 0 0) 0x7fc86c08b160 con 0x7fc86c140180 2026-02-13T20:11:31.675 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7fc8637fe640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.675 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7fc8637fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.675 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7fc8637fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.675 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7fc8637fe640 10 monclient(hunting): my global_id is 4287 2026-02-13T20:11:31.675 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7fc8637fe640 1 -- 10.20.193.110:0/3297217674 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8580035e0 con 0x7fc86c140180 2026-02-13T20:11:31.676 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7f83aa8cc640 1 -- start start 2026-02-13T20:11:31.676 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7f83aa8cc640 10 monclient: init 2026-02-13T20:11:31.676 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7fc8637fe640 1 -- 10.20.193.110:0/3297217674 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2790267277 0 0) 0x7fc86c08b440 con 0x7fc86c08be90 2026-02-13T20:11:31.676 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7fc8637fe640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.676 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7fc8637fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.676 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7fc8637fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.676 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7fc8637fe640 10 monclient(hunting): my global_id is 4286 2026-02-13T20:11:31.676 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7f22d7379640 1 Processor -- start 2026-02-13T20:11:31.676 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7fc8637fe640 1 -- 10.20.193.110:0/3297217674 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc86c08b160 con 0x7fc86c08be90 2026-02-13T20:11:31.677 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7f22d7379640 1 -- start start 2026-02-13T20:11:31.677 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7f22d7379640 10 monclient: init 2026-02-13T20:11:31.677 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7fc8637fe640 1 -- 10.20.193.110:0/3297217674 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3759620676 0 0) 0x7fc8580035e0 con 0x7fc86c140180 2026-02-13T20:11:31.677 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7fc8637fe640 1 -- 10.20.193.110:0/3297217674 >> v1:10.20.193.110:6790/0 conn(0x7fc86c08be90 legacy=0x7fc86c1a26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.677 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7fc8637fe640 1 -- 10.20.193.110:0/3297217674 >> v1:10.20.193.188:6789/0 conn(0x7fc86c05ca00 legacy=0x7fc86c180f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.677 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7fc8637fe640 10 monclient: _finish_hunting 0 2026-02-13T20:11:31.677 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7fc8637fe640 1 monclient: found mon.noname-a 2026-02-13T20:11:31.677 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7fc8637fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:31.677 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7fc8637fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:11:31.677 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7fc8637fe640 1 -- 10.20.193.110:0/3297217674 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc86c05bfe0 con 0x7fc86c140180 2026-02-13T20:11:31.677 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7fc8637fe640 10 monclient: _finish_auth 0 2026-02-13T20:11:31.677 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7fc8637fe640 10 monclient: _check_auth_tickets 2026-02-13T20:11:31.677 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7fc8637fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:31.677 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7fc8637fe640 1 -- 10.20.193.110:0/3297217674 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc85c002dd0 con 0x7fc86c140180 2026-02-13T20:11:31.678 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7fc871d14640 5 monclient: authenticate success, global_id 4287 2026-02-13T20:11:31.678 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7fc871d14640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:31.678 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7fc8637fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:31.678 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7fc8637fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:11:31.678 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7fc8637fe640 10 monclient: dump: 2026-02-13T20:11:31.678 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.678 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.678 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.678 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.678 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.678 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.678 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.678 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.678 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.678 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.678 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7fc871d14640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:31.678 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7f2a7c5db640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:31.678 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7f95a421b640 1 Processor -- start 2026-02-13T20:11:31.679 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7f2a7c5db640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:11:31.679 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7f2a7c5db640 10 monclient(hunting): picked mon.noname-a con 0x7f2a74089250 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:31.679 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7f2a7c5db640 10 monclient(hunting): picked mon.noname-c con 0x7f2a74057780 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:31.679 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7fc8637fe640 1 -- 10.20.193.110:0/3297217674 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc85c003020 con 0x7fc86c140180 2026-02-13T20:11:31.679 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7fc8637fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:31.679 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7fc8637fe640 1 -- 10.20.193.110:0/3297217674 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc85c003430 con 0x7fc86c140180 2026-02-13T20:11:31.679 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7fc871d14640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:31.679 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7f2a7c5db640 10 monclient(hunting): picked mon.noname-b con 0x7f2a74184b60 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:31.679 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7fc871d14640 4 set_mon_vals no callback set 2026-02-13T20:11:31.679 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7fc8637fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:31.680 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7fc8637fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:31.680 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7f2a7c5db640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a7408a950 con 0x7f2a74089250 2026-02-13T20:11:31.680 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7fc8637fe640 10 monclient: dump: 2026-02-13T20:11:31.680 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.680 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.680 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.680 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.680 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.680 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.680 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.680 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.680 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.680 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.680 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7f2a7c5db640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a74089620 con 0x7f2a74057780 2026-02-13T20:11:31.681 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7f2a7c5db640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a74057c60 con 0x7f2a74184b60 2026-02-13T20:11:31.681 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7f2a7c5db640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:31.681 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7f2a7c5db640 10 monclient(hunting): authenticate will time out at 653.359829s 2026-02-13T20:11:31.681 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7f95a421b640 1 -- start start 2026-02-13T20:11:31.681 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7f95a421b640 10 monclient: init 2026-02-13T20:11:31.681 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7f905c1c7640 10 monclient: get_monmap_and_config 2026-02-13T20:11:31.681 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7f905c1c7640 10 monclient: build_initial_monmap 2026-02-13T20:11:31.681 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7f905c1c7640 10 monclient: monmap: 2026-02-13T20:11:31.681 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:31.681 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.681 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:31.670248+0000 2026-02-13T20:11:31.681 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:31.670248+0000 2026-02-13T20:11:31.681 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:31.681 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.681 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:31.681 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:31.681 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:31.682 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.682 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7f83aa8cc640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:31.682 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7f83aa8cc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:11:31.682 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7f2a7ab51640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f2a74184b60 0x7f2a741a4f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:39698/0 (socket says 10.20.193.110:39698) 2026-02-13T20:11:31.682 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7f2a7ab51640 1 -- 10.20.193.110:0/4143163159 learned_addr learned my addr 10.20.193.110:0/4143163159 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:31.682 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7f2a7a350640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f2a74089250 0x7f2a740580b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:59964/0 (socket says 10.20.193.110:59964) 2026-02-13T20:11:31.682 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7f22d7379640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:31.682 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7f83aa8cc640 10 monclient(hunting): picked mon.noname-a con 0x7f83a41401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:31.683 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7f22d7379640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:11:31.683 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7f83aa8cc640 10 monclient(hunting): picked mon.noname-b con 0x7f83a4092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:31.683 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7f22d7379640 10 monclient(hunting): picked mon.noname-b con 0x7f22d01401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:31.683 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7f83aa8cc640 10 monclient(hunting): picked mon.noname-c con 0x7f83a4091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:31.683 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7f22d7379640 10 monclient(hunting): picked mon.noname-a con 0x7f22d0092020 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:31.683 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7f22d7379640 10 monclient(hunting): picked mon.noname-c con 0x7f22d0091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:31.683 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7f22d7379640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22d008b730 con 0x7f22d0092020 2026-02-13T20:11:31.683 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7f22d7379640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22d005c5b0 con 0x7f22d0091950 2026-02-13T20:11:31.684 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7f83aa8cc640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83a408b730 con 0x7f83a41401c0 2026-02-13T20:11:31.684 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7f83aa8cc640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83a405c5b0 con 0x7f83a4091950 2026-02-13T20:11:31.684 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.668+0000 7f83aa8cc640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83a408bcf0 con 0x7f83a4092020 2026-02-13T20:11:31.684 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f22d7379640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22d008bcf0 con 0x7f22d01401c0 2026-02-13T20:11:31.684 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f22d7379640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:31.684 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f22d7379640 10 monclient(hunting): authenticate will time out at 653.360022s 2026-02-13T20:11:31.684 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f83aa8cc640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:31.684 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f83aa8cc640 10 monclient(hunting): authenticate will time out at 653.360022s 2026-02-13T20:11:31.684 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7fc871d14640 10 monclient: shutdown 2026-02-13T20:11:31.684 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7fc871d14640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:31.684 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7fc871d14640 1 -- 10.20.193.110:0/3297217674 >> v1:10.20.193.110:6789/0 conn(0x7fc86c140180 legacy=0x7fc86c140550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.684 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f22d50ee640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f22d01401c0 0x7f22d0091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:39704/0 (socket says 10.20.193.110:39704) 2026-02-13T20:11:31.685 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f83a37fe640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f83a4092020 0x7f83a41812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:39700/0 (socket says 10.20.193.110:39700) 2026-02-13T20:11:31.685 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f83a37fe640 1 -- 10.20.193.110:0/2898487341 learned_addr learned my addr 10.20.193.110:0/2898487341 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:31.685 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7fc871d14640 1 -- 10.20.193.110:0/3297217674 shutdown_connections 2026-02-13T20:11:31.685 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7fc871d14640 1 -- 10.20.193.110:0/3297217674 >> 10.20.193.110:0/3297217674 conn(0x7fc86c054d30 msgr2=0x7fc86c058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:31.685 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f22d50ee640 1 -- 10.20.193.110:0/1125403389 learned_addr learned my addr 10.20.193.110:0/1125403389 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:31.685 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7fc871d14640 1 -- 10.20.193.110:0/3297217674 shutdown_connections 2026-02-13T20:11:31.685 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7fc871d14640 1 -- 10.20.193.110:0/3297217674 wait complete. 2026-02-13T20:11:31.686 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f2a7934e640 1 -- 10.20.193.110:0/4143163159 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 733048455 0 0) 0x7f2a74057c60 con 0x7f2a74184b60 2026-02-13T20:11:31.686 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f2a7934e640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.686 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f2a7934e640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.686 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f2a7934e640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.686 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f2a7934e640 10 monclient(hunting): my global_id is 4289 2026-02-13T20:11:31.686 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f2a7934e640 1 -- 10.20.193.110:0/4143163159 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a5c0035e0 con 0x7f2a74184b60 2026-02-13T20:11:31.686 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f2a7934e640 1 -- 10.20.193.110:0/4143163159 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1829063451 0 0) 0x7f2a7408a950 con 0x7f2a74089250 2026-02-13T20:11:31.686 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f2a7934e640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.686 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f2a7934e640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.686 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f2a7934e640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.686 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f2a7934e640 10 monclient(hunting): my global_id is 4290 2026-02-13T20:11:31.686 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f2a7934e640 1 -- 10.20.193.110:0/4143163159 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a74057c60 con 0x7f2a74089250 2026-02-13T20:11:31.686 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f95a421b640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:31.686 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f95a421b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:11:31.686 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f95a421b640 10 monclient(hunting): picked mon.noname-a con 0x7f959c089250 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:31.686 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f95a421b640 10 monclient(hunting): picked mon.noname-b con 0x7f959c057780 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:31.686 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f95a421b640 10 monclient(hunting): picked mon.noname-c con 0x7f959c184b60 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:31.687 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f95a421b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f959c08a950 con 0x7f959c089250 2026-02-13T20:11:31.687 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f905c1c7640 1 Processor -- start 2026-02-13T20:11:31.687 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f2a7934e640 1 -- 10.20.193.110:0/4143163159 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 197589536 0 0) 0x7f2a74089620 con 0x7f2a74057780 2026-02-13T20:11:31.687 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f2a7934e640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.687 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f2a7934e640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.687 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f2a7934e640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.687 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f22bffff640 1 -- 10.20.193.110:0/1125403389 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3588135703 0 0) 0x7f22d008bcf0 con 0x7f22d01401c0 2026-02-13T20:11:31.687 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f95a421b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f959c089620 con 0x7f959c184b60 2026-02-13T20:11:31.687 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f2a7934e640 10 monclient(hunting): my global_id is 4291 2026-02-13T20:11:31.687 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f2a7934e640 1 -- 10.20.193.110:0/4143163159 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a7408a950 con 0x7f2a74057780 2026-02-13T20:11:31.688 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f22bffff640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.688 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f22bffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.688 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f22bffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.688 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f22bffff640 10 monclient(hunting): my global_id is 4292 2026-02-13T20:11:31.688 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f95a421b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f959c057c60 con 0x7f959c057780 2026-02-13T20:11:31.688 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f95a421b640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:31.688 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f95a421b640 10 monclient(hunting): authenticate will time out at 653.360372s 2026-02-13T20:11:31.688 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f22bffff640 1 -- 10.20.193.110:0/1125403389 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22b80035e0 con 0x7f22d01401c0 2026-02-13T20:11:31.688 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f83a2ffd640 1 -- 10.20.193.110:0/2898487341 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2403835876 0 0) 0x7f83a408bcf0 con 0x7f83a4092020 2026-02-13T20:11:31.688 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f83a2ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.688 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f83a2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.689 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f83a2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.689 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f83a2ffd640 10 monclient(hunting): my global_id is 4295 2026-02-13T20:11:31.689 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f2a7934e640 1 -- 10.20.193.110:0/4143163159 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3040330157 0 0) 0x7f2a5c0035e0 con 0x7f2a74184b60 2026-02-13T20:11:31.689 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f2a7934e640 1 -- 10.20.193.110:0/4143163159 >> v1:10.20.193.188:6789/0 conn(0x7f2a74057780 legacy=0x7f2a74183440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.689 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f2a7934e640 1 -- 10.20.193.110:0/4143163159 >> v1:10.20.193.110:6789/0 conn(0x7f2a74089250 legacy=0x7f2a740580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.689 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f95a178f640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f959c057780 0x7f959c183440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:39710/0 (socket says 10.20.193.110:39710) 2026-02-13T20:11:31.689 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f95a178f640 1 -- 10.20.193.110:0/2429390507 learned_addr learned my addr 10.20.193.110:0/2429390507 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:31.689 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f83a2ffd640 1 -- 10.20.193.110:0/2898487341 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83880035e0 con 0x7f83a4092020 2026-02-13T20:11:31.689 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f2a7934e640 10 monclient: _finish_hunting 0 2026-02-13T20:11:31.690 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f2a7934e640 1 monclient: found mon.noname-b 2026-02-13T20:11:31.690 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f2a7934e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:31.690 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f2a7934e640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:11:31.690 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f2a7934e640 1 -- 10.20.193.110:0/4143163159 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a74089a50 con 0x7f2a74184b60 2026-02-13T20:11:31.690 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f2a7934e640 10 monclient: _finish_auth 0 2026-02-13T20:11:31.690 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f2a7934e640 10 monclient: _check_auth_tickets 2026-02-13T20:11:31.690 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f2a7934e640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:31.690 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f2a7934e640 1 -- 10.20.193.110:0/4143163159 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f2a70003eb0 con 0x7f2a74184b60 2026-02-13T20:11:31.690 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f2a7934e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:31.690 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f2a7934e640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:11:31.690 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f2a7934e640 10 monclient: dump: 2026-02-13T20:11:31.690 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.690 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.690 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.690 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.690 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.690 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.690 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.690 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.690 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.690 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.690 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f2a7c5db640 5 monclient: authenticate success, global_id 4289 2026-02-13T20:11:31.690 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f2a7c5db640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:31.691 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f905c1c7640 1 -- start start 2026-02-13T20:11:31.691 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f905c1c7640 10 monclient: init 2026-02-13T20:11:31.691 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f22bffff640 1 -- 10.20.193.110:0/1125403389 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 993883412 0 0) 0x7f22d008b730 con 0x7f22d0092020 2026-02-13T20:11:31.691 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f22bffff640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.691 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f22bffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.691 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f22bffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.691 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f22bffff640 10 monclient(hunting): my global_id is 4296 2026-02-13T20:11:31.691 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f22bffff640 1 -- 10.20.193.110:0/1125403389 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22d008bcf0 con 0x7f22d0092020 2026-02-13T20:11:31.691 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f22bffff640 1 -- 10.20.193.110:0/1125403389 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1210243351 0 0) 0x7f22b80035e0 con 0x7f22d01401c0 2026-02-13T20:11:31.691 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f22bffff640 1 -- 10.20.193.110:0/1125403389 >> v1:10.20.193.188:6789/0 conn(0x7f22d0091950 legacy=0x7f22d01a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.691 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f22bffff640 1 -- 10.20.193.110:0/1125403389 >> v1:10.20.193.110:6789/0 conn(0x7f22d0092020 legacy=0x7f22d01812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.691 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f22bffff640 10 monclient: _finish_hunting 0 2026-02-13T20:11:31.691 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f22bffff640 1 monclient: found mon.noname-b 2026-02-13T20:11:31.691 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f22bffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:31.692 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f22bffff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:11:31.692 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f22bffff640 1 -- 10.20.193.110:0/1125403389 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22d0140590 con 0x7f22d01401c0 2026-02-13T20:11:31.692 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f22bffff640 10 monclient: _finish_auth 0 2026-02-13T20:11:31.692 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f22bffff640 10 monclient: _check_auth_tickets 2026-02-13T20:11:31.692 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f22bffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:31.692 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f22bffff640 1 -- 10.20.193.110:0/1125403389 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f22c0002dd0 con 0x7f22d01401c0 2026-02-13T20:11:31.692 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f22d7379640 5 monclient: authenticate success, global_id 4292 2026-02-13T20:11:31.692 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f22d7379640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:31.692 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f22bffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:31.692 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f22bffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:11:31.692 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f83a2ffd640 1 -- 10.20.193.110:0/2898487341 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4127738544 0 0) 0x7f83880035e0 con 0x7f83a4092020 2026-02-13T20:11:31.692 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f83a2ffd640 1 -- 10.20.193.110:0/2898487341 >> v1:10.20.193.188:6789/0 conn(0x7f83a4091950 legacy=0x7f83a41a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T20:11:31.692 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7fc871d14640 10 monclient: build_initial_monmap 2026-02-13T20:11:31.692 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f22bffff640 10 monclient: dump: 2026-02-13T20:11:31.692 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.692 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.693 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.693 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.693 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.693 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.693 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.693 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.693 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.693 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.693 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f22d7379640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:31.693 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7fc871d14640 10 monclient: monmap: 2026-02-13T20:11:31.693 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:31.693 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:31.693 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:11:31.693 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:11:31.693 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:31.693 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:11:31.693 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:31.693 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:31.693 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:31.693 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.694 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f83a2ffd640 1 -- 10.20.193.110:0/2898487341 >> v1:10.20.193.110:6789/0 conn(0x7f83a41401c0 legacy=0x7f83a4091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.694 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f83a2ffd640 10 monclient: _finish_hunting 0 2026-02-13T20:11:31.694 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f83a2ffd640 1 monclient: found mon.noname-b 2026-02-13T20:11:31.694 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f83a2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:31.694 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f83a2ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:11:31.694 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f83a2ffd640 1 -- 10.20.193.110:0/2898487341 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83a4140590 con 0x7f83a4092020 2026-02-13T20:11:31.694 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f83a2ffd640 10 monclient: _finish_auth 0 2026-02-13T20:11:31.694 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f83a2ffd640 10 monclient: _check_auth_tickets 2026-02-13T20:11:31.694 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f83a2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:31.694 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f83a2ffd640 1 -- 10.20.193.110:0/2898487341 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f8394002dd0 con 0x7f83a4092020 2026-02-13T20:11:31.694 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f83a2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:31.694 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f83a2ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:11:31.694 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f83a2ffd640 10 monclient: dump: 2026-02-13T20:11:31.694 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.694 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.694 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.694 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.694 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.694 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.695 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.695 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.695 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.695 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.695 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f83aa8cc640 5 monclient: authenticate success, global_id 4295 2026-02-13T20:11:31.695 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f83aa8cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:31.695 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f2a7934e640 1 -- 10.20.193.110:0/4143163159 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2a70004080 con 0x7f2a74184b60 2026-02-13T20:11:31.695 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f2a7934e640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:31.695 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f2a7934e640 1 -- 10.20.193.110:0/4143163159 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f2a70004490 con 0x7f2a74184b60 2026-02-13T20:11:31.695 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f95a0f8e640 1 -- 10.20.193.110:0/2429390507 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1489698484 0 0) 0x7f959c057c60 con 0x7f959c057780 2026-02-13T20:11:31.695 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f95a0f8e640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.695 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f2a7934e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:31.696 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f2a7934e640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:31.696 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f2a7934e640 10 monclient: dump: 2026-02-13T20:11:31.696 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.696 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.696 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.696 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.696 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.696 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.696 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.696 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.696 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.696 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.696 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f95a0f8e640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.696 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f95a0f8e640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.696 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f95a0f8e640 10 monclient(hunting): my global_id is 4298 2026-02-13T20:11:31.696 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f95a0f8e640 1 -- 10.20.193.110:0/2429390507 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95840035e0 con 0x7f959c057780 2026-02-13T20:11:31.696 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f95a0f8e640 1 -- 10.20.193.110:0/2429390507 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2055825839 0 0) 0x7f959c08a950 con 0x7f959c089250 2026-02-13T20:11:31.697 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f2a7c5db640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:31.697 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f2a7c5db640 4 set_mon_vals no callback set 2026-02-13T20:11:31.697 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f95a0f8e640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.697 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f95a0f8e640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.697 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f95a0f8e640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.697 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f95a0f8e640 10 monclient(hunting): my global_id is 4299 2026-02-13T20:11:31.697 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f95a0f8e640 1 -- 10.20.193.110:0/2429390507 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f959c057c60 con 0x7f959c089250 2026-02-13T20:11:31.697 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f83a2ffd640 1 -- 10.20.193.110:0/2898487341 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8394002fa0 con 0x7f83a4092020 2026-02-13T20:11:31.697 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f83a2ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:31.697 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f83a2ffd640 1 -- 10.20.193.110:0/2898487341 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f83940033b0 con 0x7f83a4092020 2026-02-13T20:11:31.697 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f83a2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:31.697 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f83a2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:31.697 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f83a2ffd640 10 monclient: dump: 2026-02-13T20:11:31.698 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.698 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.698 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.698 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.698 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.698 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.698 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.698 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.698 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.698 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.698 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f83aa8cc640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:31.698 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f83aa8cc640 4 set_mon_vals no callback set 2026-02-13T20:11:31.698 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f22bffff640 1 -- 10.20.193.110:0/1125403389 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f22c0002fa0 con 0x7f22d01401c0 2026-02-13T20:11:31.698 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f22bffff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:31.698 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f22bffff640 1 -- 10.20.193.110:0/1125403389 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f22c00033b0 con 0x7f22d01401c0 2026-02-13T20:11:31.698 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f22bffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:31.699 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f22bffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:31.699 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f22bffff640 10 monclient: dump: 2026-02-13T20:11:31.699 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.699 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.699 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.699 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.699 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.699 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.699 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.699 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.699 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.699 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.699 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f22d7379640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:31.699 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f22d7379640 4 set_mon_vals no callback set 2026-02-13T20:11:31.699 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7fc871d14640 1 Processor -- start 2026-02-13T20:11:31.699 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f905c1c7640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:31.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f905c1c7640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:11:31.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f905c1c7640 10 monclient(hunting): picked mon.noname-c con 0x7f9054089250 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:31.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f905c1c7640 10 monclient(hunting): picked mon.noname-b con 0x7f9054057780 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:31.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f95a0f8e640 1 -- 10.20.193.110:0/2429390507 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2690086562 0 0) 0x7f959c089620 con 0x7f959c184b60 2026-02-13T20:11:31.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f95a0f8e640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f95a0f8e640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f95a0f8e640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f95a0f8e640 10 monclient(hunting): my global_id is 4297 2026-02-13T20:11:31.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f905c1c7640 10 monclient(hunting): picked mon.noname-a con 0x7f9054184b60 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:31.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f95a0f8e640 1 -- 10.20.193.110:0/2429390507 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f959c08a950 con 0x7f959c184b60 2026-02-13T20:11:31.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f95a0f8e640 1 -- 10.20.193.110:0/2429390507 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2798195069 0 0) 0x7f95840035e0 con 0x7f959c057780 2026-02-13T20:11:31.701 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f905c1c7640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f905408a950 con 0x7f9054184b60 2026-02-13T20:11:31.701 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f95a0f8e640 1 -- 10.20.193.110:0/2429390507 >> v1:10.20.193.188:6789/0 conn(0x7f959c184b60 legacy=0x7f959c1a4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.701 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f95a0f8e640 1 -- 10.20.193.110:0/2429390507 >> v1:10.20.193.110:6789/0 conn(0x7f959c089250 legacy=0x7f959c0580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.701 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f95a0f8e640 10 monclient: _finish_hunting 0 2026-02-13T20:11:31.701 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f95a0f8e640 1 monclient: found mon.noname-b 2026-02-13T20:11:31.701 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f95a0f8e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:31.701 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f95a0f8e640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:11:31.701 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f905c1c7640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9054089620 con 0x7f9054089250 2026-02-13T20:11:31.701 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f905c1c7640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9054057c60 con 0x7f9054057780 2026-02-13T20:11:31.701 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f905c1c7640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:31.701 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f905c1c7640 10 monclient(hunting): authenticate will time out at 653.360962s 2026-02-13T20:11:31.702 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f95a0f8e640 1 -- 10.20.193.110:0/2429390507 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f959c089a50 con 0x7f959c057780 2026-02-13T20:11:31.702 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f95a0f8e640 10 monclient: _finish_auth 0 2026-02-13T20:11:31.702 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f95a0f8e640 10 monclient: _check_auth_tickets 2026-02-13T20:11:31.702 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f95a0f8e640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:31.702 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f95a0f8e640 1 -- 10.20.193.110:0/2429390507 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f9590002dd0 con 0x7f959c057780 2026-02-13T20:11:31.702 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f95a0f8e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:31.702 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f95a0f8e640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:11:31.702 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f95a0f8e640 10 monclient: dump: 2026-02-13T20:11:31.702 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.702 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.702 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.702 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.702 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.702 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.702 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.702 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.702 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.702 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.702 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f95a421b640 5 monclient: authenticate success, global_id 4298 2026-02-13T20:11:31.702 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7f95a421b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:31.703 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7fc871d14640 1 -- start start 2026-02-13T20:11:31.703 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.669+0000 7fc871d14640 10 monclient: init 2026-02-13T20:11:31.703 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f905973b640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f9054057780 0x7f9054183440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:39722/0 (socket says 10.20.193.110:39722) 2026-02-13T20:11:31.703 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f905973b640 1 -- 10.20.193.110:0/860753110 learned_addr learned my addr 10.20.193.110:0/860753110 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:31.703 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f2a7c5db640 10 monclient: shutdown 2026-02-13T20:11:31.703 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f2a7c5db640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:31.703 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f2a7c5db640 1 -- 10.20.193.110:0/4143163159 >> v1:10.20.193.110:6790/0 conn(0x7f2a74184b60 legacy=0x7f2a741a4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.703 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f83aa8cc640 10 monclient: shutdown 2026-02-13T20:11:31.703 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f83aa8cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:31.703 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f83aa8cc640 1 -- 10.20.193.110:0/2898487341 >> v1:10.20.193.110:6790/0 conn(0x7f83a4092020 legacy=0x7f83a41812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f83aa8cc640 1 -- 10.20.193.110:0/2898487341 shutdown_connections 2026-02-13T20:11:31.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f83aa8cc640 1 -- 10.20.193.110:0/2898487341 >> 10.20.193.110:0/2898487341 conn(0x7f83a4054e90 msgr2=0x7f83a4058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:31.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f2a7c5db640 1 -- 10.20.193.110:0/4143163159 shutdown_connections 2026-02-13T20:11:31.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f2a7c5db640 1 -- 10.20.193.110:0/4143163159 >> 10.20.193.110:0/4143163159 conn(0x7f2a74054330 msgr2=0x7f2a74054730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:31.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f2a7c5db640 1 -- 10.20.193.110:0/4143163159 shutdown_connections 2026-02-13T20:11:31.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f22d7379640 10 monclient: shutdown 2026-02-13T20:11:31.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f22d7379640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:31.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f22d7379640 1 -- 10.20.193.110:0/1125403389 >> v1:10.20.193.110:6790/0 conn(0x7f22d01401c0 legacy=0x7f22d0091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f2a7c5db640 1 -- 10.20.193.110:0/4143163159 wait complete. 2026-02-13T20:11:31.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f95a0f8e640 1 -- 10.20.193.110:0/2429390507 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9590002fd0 con 0x7f959c057780 2026-02-13T20:11:31.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f95a0f8e640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:31.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f95a0f8e640 1 -- 10.20.193.110:0/2429390507 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f95900033e0 con 0x7f959c057780 2026-02-13T20:11:31.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f95a421b640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:31.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f95a421b640 4 set_mon_vals no callback set 2026-02-13T20:11:31.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f95a0f8e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:31.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f95a0f8e640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:31.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f95a0f8e640 10 monclient: dump: 2026-02-13T20:11:31.705 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.705 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.705 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.705 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.705 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.705 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.705 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.705 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.705 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.705 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f83aa8cc640 1 -- 10.20.193.110:0/2898487341 shutdown_connections 2026-02-13T20:11:31.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f22d7379640 1 -- 10.20.193.110:0/1125403389 shutdown_connections 2026-02-13T20:11:31.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f22d7379640 1 -- 10.20.193.110:0/1125403389 >> 10.20.193.110:0/1125403389 conn(0x7f22d0054e90 msgr2=0x7f22d0058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:31.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f83aa8cc640 1 -- 10.20.193.110:0/2898487341 wait complete. 2026-02-13T20:11:31.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f22d7379640 1 -- 10.20.193.110:0/1125403389 shutdown_connections 2026-02-13T20:11:31.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc871d14640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:31.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc871d14640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:11:31.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f22d7379640 1 -- 10.20.193.110:0/1125403389 wait complete. 2026-02-13T20:11:31.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc871d14640 10 monclient(hunting): picked mon.noname-b con 0x7fc86c08be90 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:31.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc871d14640 10 monclient(hunting): picked mon.noname-c con 0x7fc86c140180 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:31.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f9058f3a640 1 -- 10.20.193.110:0/860753110 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 131765267 0 0) 0x7f905408a950 con 0x7f9054184b60 2026-02-13T20:11:31.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f9058f3a640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f9058f3a640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f9058f3a640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f9058f3a640 10 monclient(hunting): my global_id is 4302 2026-02-13T20:11:31.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc871d14640 10 monclient(hunting): picked mon.noname-a con 0x7fc86c089c80 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:31.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc871d14640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc86c10e7f0 con 0x7fc86c089c80 2026-02-13T20:11:31.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f9058f3a640 1 -- 10.20.193.110:0/860753110 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f903c0035e0 con 0x7f9054184b60 2026-02-13T20:11:31.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc871d14640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc86c10f0c0 con 0x7fc86c08be90 2026-02-13T20:11:31.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc871d14640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc86c10f3a0 con 0x7fc86c140180 2026-02-13T20:11:31.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc871d14640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:31.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc871d14640 10 monclient(hunting): authenticate will time out at 653.361285s 2026-02-13T20:11:31.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f9058f3a640 1 -- 10.20.193.110:0/860753110 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2115093308 0 0) 0x7f9054057c60 con 0x7f9054057780 2026-02-13T20:11:31.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f9058f3a640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f9058f3a640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f9058f3a640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f9058f3a640 10 monclient(hunting): my global_id is 4301 2026-02-13T20:11:31.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f9058f3a640 1 -- 10.20.193.110:0/860753110 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f905408a950 con 0x7f9054057780 2026-02-13T20:11:31.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc863fff640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fc86c140180 0x7fc86c089570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:39736/0 (socket says 10.20.193.110:39736) 2026-02-13T20:11:31.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc863fff640 1 -- 10.20.193.110:0/1857756880 learned_addr learned my addr 10.20.193.110:0/1857756880 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:31.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f9058f3a640 1 -- 10.20.193.110:0/860753110 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 737486940 0 0) 0x7f903c0035e0 con 0x7f9054184b60 2026-02-13T20:11:31.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f9058f3a640 1 -- 10.20.193.110:0/860753110 >> v1:10.20.193.110:6790/0 conn(0x7f9054057780 legacy=0x7f9054183440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f9058f3a640 1 -- 10.20.193.110:0/860753110 >> v1:10.20.193.188:6789/0 conn(0x7f9054089250 legacy=0x7f90540580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f9058f3a640 10 monclient: _finish_hunting 0 2026-02-13T20:11:31.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f9058f3a640 1 monclient: found mon.noname-a 2026-02-13T20:11:31.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f9058f3a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:31.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f9058f3a640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:11:31.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f9058f3a640 1 -- 10.20.193.110:0/860753110 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9054089a50 con 0x7f9054184b60 2026-02-13T20:11:31.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f9058f3a640 10 monclient: _finish_auth 0 2026-02-13T20:11:31.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f9058f3a640 10 monclient: _check_auth_tickets 2026-02-13T20:11:31.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f9058f3a640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:31.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f9058f3a640 1 -- 10.20.193.110:0/860753110 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f9050003eb0 con 0x7f9054184b60 2026-02-13T20:11:31.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f9058f3a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:31.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f9058f3a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:11:31.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f9058f3a640 10 monclient: dump: 2026-02-13T20:11:31.709 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.709 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.709 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.709 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.709 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.709 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.709 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.709 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.709 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.709 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f905c1c7640 5 monclient: authenticate success, global_id 4302 2026-02-13T20:11:31.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f905c1c7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:31.710 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f2a7c5db640 10 monclient: build_initial_monmap 2026-02-13T20:11:31.710 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f2a7c5db640 10 monclient: monmap: 2026-02-13T20:11:31.710 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:31.710 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:31.710 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:11:31.710 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:11:31.710 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:31.710 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:11:31.710 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:31.710 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:31.710 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:31.710 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.710 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc8617fa640 1 -- 10.20.193.110:0/1857756880 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1785586563 0 0) 0x7fc86c10e7f0 con 0x7fc86c089c80 2026-02-13T20:11:31.710 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc8617fa640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.710 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc8617fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.710 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc8617fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.710 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc8617fa640 10 monclient(hunting): my global_id is 4305 2026-02-13T20:11:31.710 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc8617fa640 1 -- 10.20.193.110:0/1857756880 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc83c0035e0 con 0x7fc86c089c80 2026-02-13T20:11:31.711 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f9058f3a640 1 -- 10.20.193.110:0/860753110 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f90500040b0 con 0x7f9054184b60 2026-02-13T20:11:31.711 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f9058f3a640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:31.711 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f9058f3a640 1 -- 10.20.193.110:0/860753110 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f90500044c0 con 0x7f9054184b60 2026-02-13T20:11:31.711 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f905c1c7640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:31.711 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f905c1c7640 4 set_mon_vals no callback set 2026-02-13T20:11:31.711 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f9058f3a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:31.711 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f9058f3a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:31.711 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f9058f3a640 10 monclient: dump: 2026-02-13T20:11:31.711 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.711 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.711 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.711 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.711 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.711 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.711 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.711 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.711 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.711 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.711 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f95a421b640 10 monclient: shutdown 2026-02-13T20:11:31.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f95a421b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:31.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc8617fa640 1 -- 10.20.193.110:0/1857756880 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1834910051 0 0) 0x7fc86c10f3a0 con 0x7fc86c140180 2026-02-13T20:11:31.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc8617fa640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc8617fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f95a421b640 1 -- 10.20.193.110:0/2429390507 >> v1:10.20.193.110:6790/0 conn(0x7f959c057780 legacy=0x7f959c183440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc8617fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc8617fa640 10 monclient(hunting): my global_id is 4304 2026-02-13T20:11:31.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc8617fa640 1 -- 10.20.193.110:0/1857756880 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc86c10e7f0 con 0x7fc86c140180 2026-02-13T20:11:31.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f22d7379640 10 monclient: build_initial_monmap 2026-02-13T20:11:31.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f22d7379640 10 monclient: monmap: 2026-02-13T20:11:31.712 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:31.712 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:31.712 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:11:31.712 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:11:31.712 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:31.712 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:11:31.713 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:31.713 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:31.713 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:31.713 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f83aa8cc640 10 monclient: build_initial_monmap 2026-02-13T20:11:31.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f83aa8cc640 10 monclient: monmap: 2026-02-13T20:11:31.713 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:31.713 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:31.713 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:11:31.713 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:11:31.713 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:31.713 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:11:31.713 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:31.713 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:31.713 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:31.713 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f95a421b640 1 -- 10.20.193.110:0/2429390507 shutdown_connections 2026-02-13T20:11:31.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f2a7c5db640 1 Processor -- start 2026-02-13T20:11:31.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f95a421b640 1 -- 10.20.193.110:0/2429390507 >> 10.20.193.110:0/2429390507 conn(0x7f959c054330 msgr2=0x7f959c054730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:31.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f95a421b640 1 -- 10.20.193.110:0/2429390507 shutdown_connections 2026-02-13T20:11:31.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f95a421b640 1 -- 10.20.193.110:0/2429390507 wait complete. 2026-02-13T20:11:31.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc8617fa640 1 -- 10.20.193.110:0/1857756880 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4242402000 0 0) 0x7fc83c0035e0 con 0x7fc86c089c80 2026-02-13T20:11:31.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc8617fa640 1 -- 10.20.193.110:0/1857756880 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc86c10f3a0 con 0x7fc86c089c80 2026-02-13T20:11:31.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc8617fa640 1 -- 10.20.193.110:0/1857756880 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc8680040f0 con 0x7fc86c089c80 2026-02-13T20:11:31.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc8617fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:31.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc8617fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:11:31.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc8617fa640 10 monclient(hunting): dump: 2026-02-13T20:11:31.714 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.714 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.714 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.714 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.714 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.714 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.714 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.714 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.714 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.714 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc8617fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:31.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc8617fa640 1 -- 10.20.193.110:0/1857756880 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4183649118 0 0) 0x7fc86c10f0c0 con 0x7fc86c08be90 2026-02-13T20:11:31.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc8617fa640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc8617fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc8617fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc8617fa640 10 monclient(hunting): my global_id is 4303 2026-02-13T20:11:31.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f2a7c5db640 1 -- start start 2026-02-13T20:11:31.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc8617fa640 1 -- 10.20.193.110:0/1857756880 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc83c0035e0 con 0x7fc86c08be90 2026-02-13T20:11:31.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f2a7c5db640 10 monclient: init 2026-02-13T20:11:31.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f22d7379640 1 Processor -- start 2026-02-13T20:11:31.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc8617fa640 1 -- 10.20.193.110:0/1857756880 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1673397476 0 0) 0x7fc86c10e7f0 con 0x7fc86c140180 2026-02-13T20:11:31.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc8617fa640 1 -- 10.20.193.110:0/1857756880 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc86c10f0c0 con 0x7fc86c140180 2026-02-13T20:11:31.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc8617fa640 1 -- 10.20.193.110:0/1857756880 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc8540030b0 con 0x7fc86c140180 2026-02-13T20:11:31.716 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc8617fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:31.716 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc8617fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:31.716 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc8617fa640 10 monclient(hunting): dump: 2026-02-13T20:11:31.716 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.716 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.716 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.716 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.716 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.716 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.716 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.716 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.716 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.716 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.716 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f22d7379640 1 -- start start 2026-02-13T20:11:31.716 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f22d7379640 10 monclient: init 2026-02-13T20:11:31.716 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc8617fa640 1 -- 10.20.193.110:0/1857756880 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1209501437 0 0) 0x7fc86c10f3a0 con 0x7fc86c089c80 2026-02-13T20:11:31.716 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc8617fa640 1 -- 10.20.193.110:0/1857756880 >> v1:10.20.193.110:6790/0 conn(0x7fc86c140180 legacy=0x7fc86c089570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.716 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc8617fa640 1 -- 10.20.193.110:0/1857756880 >> v1:10.20.193.188:6789/0 conn(0x7fc86c08be90 legacy=0x7fc86c088e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.716 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc8617fa640 10 monclient: _finish_hunting 0 2026-02-13T20:11:31.716 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc8617fa640 1 monclient: found mon.a 2026-02-13T20:11:31.716 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc8617fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:31.717 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f905c1c7640 10 monclient: shutdown 2026-02-13T20:11:31.717 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f905c1c7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:31.717 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f905c1c7640 1 -- 10.20.193.110:0/860753110 >> v1:10.20.193.110:6789/0 conn(0x7f9054184b60 legacy=0x7f90541a4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.717 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc8617fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:31.717 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc8617fa640 1 -- 10.20.193.110:0/1857756880 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc86c11fc20 con 0x7fc86c089c80 2026-02-13T20:11:31.717 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc8617fa640 10 monclient: _finish_auth 0 2026-02-13T20:11:31.717 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc8617fa640 10 monclient: _check_auth_tickets 2026-02-13T20:11:31.717 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc8617fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:31.717 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc871d14640 5 monclient: authenticate success, global_id 4305 2026-02-13T20:11:31.717 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc871d14640 10 monclient: _renew_subs 2026-02-13T20:11:31.717 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f83aa8cc640 1 Processor -- start 2026-02-13T20:11:31.717 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc871d14640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:31.717 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc871d14640 1 -- 10.20.193.110:0/1857756880 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc86c08c4f0 con 0x7fc86c089c80 2026-02-13T20:11:31.717 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc871d14640 10 monclient: _renew_subs 2026-02-13T20:11:31.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc871d14640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:31.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7fc871d14640 1 -- 10.20.193.110:0/1857756880 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc86c10ede0 con 0x7fc86c089c80 2026-02-13T20:11:31.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f83aa8cc640 1 -- start start 2026-02-13T20:11:31.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f83aa8cc640 10 monclient: init 2026-02-13T20:11:31.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.670+0000 7f905c1c7640 1 -- 10.20.193.110:0/860753110 shutdown_connections 2026-02-13T20:11:31.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f905c1c7640 1 -- 10.20.193.110:0/860753110 >> 10.20.193.110:0/860753110 conn(0x7f9054054330 msgr2=0x7f9054054730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:31.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f905c1c7640 1 -- 10.20.193.110:0/860753110 shutdown_connections 2026-02-13T20:11:31.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f905c1c7640 1 -- 10.20.193.110:0/860753110 wait complete. 2026-02-13T20:11:31.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7fc8617fa640 1 -- 10.20.193.110:0/1857756880 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc868005980 con 0x7fc86c089c80 2026-02-13T20:11:31.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7fc8617fa640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:31.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7fc8617fa640 1 -- 10.20.193.110:0/1857756880 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc868005d60 con 0x7fc86c089c80 2026-02-13T20:11:31.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7fc8617fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:31.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7fc8617fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:31.719 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7fc8617fa640 10 monclient: dump: 2026-02-13T20:11:31.719 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.719 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.719 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.719 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.719 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.719 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.719 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.719 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.719 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.719 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.719 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f2a7c5db640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:31.719 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f2a7c5db640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:11:31.719 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f22d7379640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:31.719 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f22d7379640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:11:31.719 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f22d7379640 10 monclient(hunting): picked mon.noname-a con 0x7f22d0091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:31.719 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f22d7379640 10 monclient(hunting): picked mon.noname-c con 0x7f22d01401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:31.719 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f2a7c5db640 10 monclient(hunting): picked mon.noname-c con 0x7f2a74057780 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:31.719 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f2a7c5db640 10 monclient(hunting): picked mon.noname-b con 0x7f2a74089250 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:31.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f2a7c5db640 10 monclient(hunting): picked mon.noname-a con 0x7f2a74184b60 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:31.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f2a7c5db640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a7408a160 con 0x7f2a74184b60 2026-02-13T20:11:31.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f2a7c5db640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a7412b2c0 con 0x7f2a74089250 2026-02-13T20:11:31.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f2a7c5db640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a74112510 con 0x7f2a74057780 2026-02-13T20:11:31.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f2a7c5db640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:31.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f2a7c5db640 10 monclient(hunting): authenticate will time out at 653.362183s 2026-02-13T20:11:31.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f22d7379640 10 monclient(hunting): picked mon.noname-b con 0x7f22d012fb90 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:31.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f22d7379640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22d0131390 con 0x7f22d0091950 2026-02-13T20:11:31.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f22d7379640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22d012e3e0 con 0x7f22d012fb90 2026-02-13T20:11:31.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f22d7379640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22d013e930 con 0x7f22d01401c0 2026-02-13T20:11:31.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f22d7379640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:31.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f22d7379640 10 monclient(hunting): authenticate will time out at 653.362253s 2026-02-13T20:11:31.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f2a7a350640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f2a74057780 0x7f2a7412abb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:39738/0 (socket says 10.20.193.110:39738) 2026-02-13T20:11:31.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f2a7a350640 1 -- 10.20.193.110:0/3426359160 learned_addr learned my addr 10.20.193.110:0/3426359160 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:31.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f22d50ee640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f22d0091950 0x7f22d012d5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:60016/0 (socket says 10.20.193.110:60016) 2026-02-13T20:11:31.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f22d50ee640 1 -- 10.20.193.110:0/918903551 learned_addr learned my addr 10.20.193.110:0/918903551 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:31.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f83aa8cc640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:31.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f95a421b640 10 monclient: build_initial_monmap 2026-02-13T20:11:31.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f95a421b640 10 monclient: monmap: 2026-02-13T20:11:31.721 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:31.721 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:31.721 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:11:31.721 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:11:31.721 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:31.721 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:11:31.721 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:31.721 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:31.721 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:31.721 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7fc862ffd640 4 set_mon_vals no callback set 2026-02-13T20:11:31.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f95a421b640 1 Processor -- start 2026-02-13T20:11:31.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7fc871d14640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:31.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f83aa8cc640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:11:31.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f83aa8cc640 10 monclient(hunting): picked mon.noname-b con 0x7f83a4091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:31.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f83aa8cc640 10 monclient(hunting): picked mon.noname-a con 0x7f83a41401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:31.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f83aa8cc640 10 monclient(hunting): picked mon.noname-c con 0x7f83a4089c50 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:31.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f83aa8cc640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83a405d320 con 0x7f83a41401c0 2026-02-13T20:11:31.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f83aa8cc640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83a408c410 con 0x7f83a4091950 2026-02-13T20:11:31.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f83aa8cc640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83a408a880 con 0x7f83a4089c50 2026-02-13T20:11:31.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f83aa8cc640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:31.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f83aa8cc640 10 monclient(hunting): authenticate will time out at 653.362409s 2026-02-13T20:11:31.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f83a8e42640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f83a4089c50 0x7f83a4195170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:39748/0 (socket says 10.20.193.110:39748) 2026-02-13T20:11:31.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f83a8e42640 1 -- 10.20.193.110:0/3571951425 learned_addr learned my addr 10.20.193.110:0/3571951425 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:31.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f95a421b640 1 -- start start 2026-02-13T20:11:31.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f95a421b640 10 monclient: init 2026-02-13T20:11:31.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f2a5affd640 1 -- 10.20.193.110:0/3426359160 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1237578860 0 0) 0x7f2a74112510 con 0x7f2a74057780 2026-02-13T20:11:31.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f2a5affd640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f2a5affd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f2a5affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f2a5affd640 10 monclient(hunting): my global_id is 4307 2026-02-13T20:11:31.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f2a5affd640 1 -- 10.20.193.110:0/3426359160 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a440035e0 con 0x7f2a74057780 2026-02-13T20:11:31.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f22bdffb640 1 -- 10.20.193.110:0/918903551 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 743629310 0 0) 0x7f22d012e3e0 con 0x7f22d012fb90 2026-02-13T20:11:31.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f22bdffb640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f22bdffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f22bdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f22bdffb640 10 monclient(hunting): my global_id is 4309 2026-02-13T20:11:31.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f22bdffb640 1 -- 10.20.193.110:0/918903551 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22a00035e0 con 0x7f22d012fb90 2026-02-13T20:11:31.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f22bdffb640 1 -- 10.20.193.110:0/918903551 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1158881255 0 0) 0x7f22a00035e0 con 0x7f22d012fb90 2026-02-13T20:11:31.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f22bdffb640 1 -- 10.20.193.110:0/918903551 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f22d012e3e0 con 0x7f22d012fb90 2026-02-13T20:11:31.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f905c1c7640 10 monclient: build_initial_monmap 2026-02-13T20:11:31.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f22bdffb640 1 -- 10.20.193.110:0/918903551 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f22cc004000 con 0x7f22d012fb90 2026-02-13T20:11:31.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f905c1c7640 10 monclient: monmap: 2026-02-13T20:11:31.723 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:31.723 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:31.723 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:11:31.723 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:11:31.723 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:31.723 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:11:31.723 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:31.723 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:31.723 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:31.723 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.724 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f22bdffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:31.724 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f905c1c7640 1 Processor -- start 2026-02-13T20:11:31.724 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f22bdffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:11:31.724 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f95a421b640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:31.724 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f95a421b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:11:31.724 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f95a421b640 10 monclient(hunting): picked mon.noname-b con 0x7f959c057780 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:31.724 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f95a421b640 10 monclient(hunting): picked mon.noname-c con 0x7f959c089250 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:31.724 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f95a421b640 10 monclient(hunting): picked mon.noname-a con 0x7f959c184b60 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:31.724 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f95a421b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f959c08a160 con 0x7f959c184b60 2026-02-13T20:11:31.724 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f95a421b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f959c062290 con 0x7f959c057780 2026-02-13T20:11:31.724 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f95a421b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f959c18ece0 con 0x7f959c089250 2026-02-13T20:11:31.724 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f22bdffb640 10 monclient(hunting): dump: 2026-02-13T20:11:31.724 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.724 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.724 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.724 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.725 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.725 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.725 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.725 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.725 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.725 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.725 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f95a421b640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:31.725 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f95a421b640 10 monclient(hunting): authenticate will time out at 653.362817s 2026-02-13T20:11:31.725 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f22bdffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:31.725 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f22bdffb640 1 -- 10.20.193.110:0/918903551 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 690267806 0 0) 0x7f22d013e930 con 0x7f22d01401c0 2026-02-13T20:11:31.725 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7fc871d14640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:31.725 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f905c1c7640 1 -- start start 2026-02-13T20:11:31.725 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f905c1c7640 10 monclient: init 2026-02-13T20:11:31.725 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f22bdffb640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7fc871d14640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:31.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f2a5affd640 1 -- 10.20.193.110:0/3426359160 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2703829609 0 0) 0x7f2a7412b2c0 con 0x7f2a74089250 2026-02-13T20:11:31.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f2a5affd640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f2a5affd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f2a5affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f22bdffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f2a5affd640 10 monclient(hunting): my global_id is 4306 2026-02-13T20:11:31.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f2a5affd640 1 -- 10.20.193.110:0/3426359160 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a74112510 con 0x7f2a74089250 2026-02-13T20:11:31.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f83a0ff9640 1 -- 10.20.193.110:0/3571951425 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4292408168 0 0) 0x7f83a408a880 con 0x7f83a4089c50 2026-02-13T20:11:31.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f22bdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f83a0ff9640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f83a0ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f83a0ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f95a178f640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f959c089250 0x7f959c1763d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:39754/0 (socket says 10.20.193.110:39754) 2026-02-13T20:11:31.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f95a178f640 1 -- 10.20.193.110:0/2675030598 learned_addr learned my addr 10.20.193.110:0/2675030598 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:31.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f83a0ff9640 10 monclient(hunting): my global_id is 4313 2026-02-13T20:11:31.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f22bdffb640 10 monclient(hunting): my global_id is 4310 2026-02-13T20:11:31.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f2a5affd640 1 -- 10.20.193.110:0/3426359160 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2916957450 0 0) 0x7f2a440035e0 con 0x7f2a74057780 2026-02-13T20:11:31.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f2a5affd640 1 -- 10.20.193.110:0/3426359160 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2a7412b2c0 con 0x7f2a74057780 2026-02-13T20:11:31.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f22bdffb640 1 -- 10.20.193.110:0/918903551 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22a00035e0 con 0x7f22d01401c0 2026-02-13T20:11:31.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f2a5affd640 1 -- 10.20.193.110:0/3426359160 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f2a64003170 con 0x7f2a74057780 2026-02-13T20:11:31.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f2a5affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:31.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f2a5affd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:11:31.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f2a5affd640 10 monclient(hunting): dump: 2026-02-13T20:11:31.727 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.727 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.727 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.727 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.727 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.727 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.727 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.727 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.727 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.728 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f22bdffb640 1 -- 10.20.193.110:0/918903551 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 919927666 0 0) 0x7f22d0131390 con 0x7f22d0091950 2026-02-13T20:11:31.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f22bdffb640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7fc871d14640 1 -- 10.20.193.110:0/1857756880 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc86c13f110 con 0x7fc86c089c80 2026-02-13T20:11:31.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f2a5affd640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:31.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f22bdffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f22bdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f22bdffb640 10 monclient(hunting): my global_id is 4308 2026-02-13T20:11:31.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f22bdffb640 1 -- 10.20.193.110:0/918903551 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22d013e930 con 0x7f22d0091950 2026-02-13T20:11:31.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f22bdffb640 1 -- 10.20.193.110:0/918903551 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1542238395 0 0) 0x7f22d012e3e0 con 0x7f22d012fb90 2026-02-13T20:11:31.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f22bdffb640 1 -- 10.20.193.110:0/918903551 >> v1:10.20.193.110:6790/0 conn(0x7f22d01401c0 legacy=0x7f22d012dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f22bdffb640 1 -- 10.20.193.110:0/918903551 >> v1:10.20.193.110:6789/0 conn(0x7f22d0091950 legacy=0x7f22d012d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f22bdffb640 10 monclient: _finish_hunting 0 2026-02-13T20:11:31.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f22bdffb640 1 monclient: found mon.b 2026-02-13T20:11:31.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f22bdffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:31.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f22bdffb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:11:31.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f22bdffb640 1 -- 10.20.193.110:0/918903551 --> v1:10.20.193.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22d005d320 con 0x7f22d012fb90 2026-02-13T20:11:31.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f22bdffb640 10 monclient: _finish_auth 0 2026-02-13T20:11:31.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f22bdffb640 10 monclient: _check_auth_tickets 2026-02-13T20:11:31.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f22bdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:31.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f83a0ff9640 1 -- 10.20.193.110:0/3571951425 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83740035e0 con 0x7f83a4089c50 2026-02-13T20:11:31.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.671+0000 7f22d7379640 5 monclient: authenticate success, global_id 4309 2026-02-13T20:11:31.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f2a5affd640 1 -- 10.20.193.110:0/3426359160 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1697019496 0 0) 0x7f2a7408a160 con 0x7f2a74184b60 2026-02-13T20:11:31.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f2a5affd640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f2a5affd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f2a5affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f2a5affd640 10 monclient(hunting): my global_id is 4311 2026-02-13T20:11:31.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f2a5affd640 1 -- 10.20.193.110:0/3426359160 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a440035e0 con 0x7f2a74184b60 2026-02-13T20:11:31.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f2a5affd640 1 -- 10.20.193.110:0/3426359160 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3358802466 0 0) 0x7f2a74112510 con 0x7f2a74089250 2026-02-13T20:11:31.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f2a5affd640 1 -- 10.20.193.110:0/3426359160 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2a7408a160 con 0x7f2a74089250 2026-02-13T20:11:31.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f2a5affd640 1 -- 10.20.193.110:0/3426359160 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f2a68002f90 con 0x7f2a74089250 2026-02-13T20:11:31.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f2a5affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:31.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f2a5affd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-13T20:11:31.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f2a5affd640 10 monclient(hunting): dump: 2026-02-13T20:11:31.729 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.729 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.729 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.729 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.729 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.729 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.729 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.729 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.729 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.730 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.730 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f83a0ff9640 1 -- 10.20.193.110:0/3571951425 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4107867234 0 0) 0x7f83a408c410 con 0x7f83a4091950 2026-02-13T20:11:31.730 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f83a0ff9640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.730 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f83a0ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.730 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f83a0ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.730 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f83a0ff9640 10 monclient(hunting): my global_id is 4312 2026-02-13T20:11:31.730 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f83a0ff9640 1 -- 10.20.193.110:0/3571951425 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83a408a880 con 0x7f83a4091950 2026-02-13T20:11:31.730 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7fc8617fa640 1 -- 10.20.193.110:0/1857756880 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fc8680129d0 con 0x7fc86c089c80 2026-02-13T20:11:31.730 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f22d7379640 10 monclient: _renew_subs 2026-02-13T20:11:31.730 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f22d7379640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:11:31.730 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f958a7fc640 1 -- 10.20.193.110:0/2675030598 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3490206420 0 0) 0x7f959c18ece0 con 0x7f959c089250 2026-02-13T20:11:31.730 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f22d7379640 1 -- 10.20.193.110:0/918903551 --> v1:10.20.193.188:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f22d0130520 con 0x7f22d012fb90 2026-02-13T20:11:31.730 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f905c1c7640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:31.730 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f905c1c7640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:11:31.730 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f905c1c7640 10 monclient(hunting): picked mon.noname-a con 0x7f9054057780 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:31.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f2a5affd640 1 -- 10.20.193.110:0/3426359160 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2181994545 0 0) 0x7f2a7408a160 con 0x7f2a74089250 2026-02-13T20:11:31.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f2a5affd640 1 -- 10.20.193.110:0/3426359160 >> v1:10.20.193.110:6790/0 conn(0x7f2a74057780 legacy=0x7f2a7412abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f2a5affd640 1 -- 10.20.193.110:0/3426359160 >> v1:10.20.193.110:6789/0 conn(0x7f2a74184b60 legacy=0x7f2a74173690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f2a5affd640 10 monclient: _finish_hunting 0 2026-02-13T20:11:31.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f2a5affd640 1 monclient: found mon.b 2026-02-13T20:11:31.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f22d7379640 10 monclient: _renew_subs 2026-02-13T20:11:31.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f22d7379640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:11:31.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f22d7379640 1 -- 10.20.193.110:0/918903551 --> v1:10.20.193.188:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f22d013dca0 con 0x7f22d012fb90 2026-02-13T20:11:31.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f83a0ff9640 1 -- 10.20.193.110:0/3571951425 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2287302362 0 0) 0x7f83a408a880 con 0x7f83a4091950 2026-02-13T20:11:31.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f905c1c7640 10 monclient(hunting): picked mon.noname-c con 0x7f9054089250 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:31.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f905c1c7640 10 monclient(hunting): picked mon.noname-b con 0x7f9054184b60 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:31.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f905c1c7640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f905408a160 con 0x7f9054057780 2026-02-13T20:11:31.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f905c1c7640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f905405ce90 con 0x7f9054184b60 2026-02-13T20:11:31.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f905c1c7640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f905419fb70 con 0x7f9054089250 2026-02-13T20:11:31.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f905c1c7640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:31.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f905c1c7640 10 monclient(hunting): authenticate will time out at 653.363224s 2026-02-13T20:11:31.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f2a5affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:31.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f2a5affd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:11:31.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f2a5affd640 1 -- 10.20.193.110:0/3426359160 --> v1:10.20.193.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a741116a0 con 0x7f2a74089250 2026-02-13T20:11:31.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f83a0ff9640 1 -- 10.20.193.110:0/3571951425 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f83a408c410 con 0x7f83a4091950 2026-02-13T20:11:31.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f83a0ff9640 1 -- 10.20.193.110:0/3571951425 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f8390003070 con 0x7f83a4091950 2026-02-13T20:11:31.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f83a0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:31.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f83a0ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:11:31.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f83a0ff9640 10 monclient(hunting): dump: 2026-02-13T20:11:31.732 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.732 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.732 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.732 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.732 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.732 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.732 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.732 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.732 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.732 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f83a0ff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:31.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f905973b640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f9054089250 0x7f905419f460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:39760/0 (socket says 10.20.193.110:39760) 2026-02-13T20:11:31.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f905973b640 1 -- 10.20.193.110:0/3078315523 learned_addr learned my addr 10.20.193.110:0/3078315523 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:31.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f2a5affd640 10 monclient: _finish_auth 0 2026-02-13T20:11:31.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f2a5affd640 10 monclient: _check_auth_tickets 2026-02-13T20:11:31.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f2a5affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:31.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f2a7c5db640 5 monclient: authenticate success, global_id 4306 2026-02-13T20:11:31.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f2a7c5db640 10 monclient: _renew_subs 2026-02-13T20:11:31.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f2a7c5db640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:11:31.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f83a0ff9640 1 -- 10.20.193.110:0/3571951425 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1183679273 0 0) 0x7f83a405d320 con 0x7f83a41401c0 2026-02-13T20:11:31.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f83a0ff9640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f83a0ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f83a0ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f83a0ff9640 10 monclient(hunting): my global_id is 4314 2026-02-13T20:11:31.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f2a7c5db640 1 -- 10.20.193.110:0/3426359160 --> v1:10.20.193.188:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2a741101b0 con 0x7f2a74089250 2026-02-13T20:11:31.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f83a0ff9640 1 -- 10.20.193.110:0/3571951425 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83a408a880 con 0x7f83a41401c0 2026-02-13T20:11:31.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f83a0ff9640 1 -- 10.20.193.110:0/3571951425 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2557706230 0 0) 0x7f83740035e0 con 0x7f83a4089c50 2026-02-13T20:11:31.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f83a0ff9640 1 -- 10.20.193.110:0/3571951425 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8374004170 con 0x7f83a4089c50 2026-02-13T20:11:31.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f83a0ff9640 1 -- 10.20.193.110:0/3571951425 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f8398005110 con 0x7f83a4089c50 2026-02-13T20:11:31.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f83a0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:31.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f83a0ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:31.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f83a0ff9640 10 monclient(hunting): dump: 2026-02-13T20:11:31.733 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.733 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.733 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.733 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.733 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.733 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.733 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.733 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.733 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.733 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f2a7c5db640 10 monclient: _renew_subs 2026-02-13T20:11:31.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f2a7c5db640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:11:31.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f2a7c5db640 1 -- 10.20.193.110:0/3426359160 --> v1:10.20.193.188:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2a74110d10 con 0x7f2a74089250 2026-02-13T20:11:31.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f958a7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f958a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f958a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f958a7fc640 10 monclient(hunting): my global_id is 4316 2026-02-13T20:11:31.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f958a7fc640 1 -- 10.20.193.110:0/2675030598 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f956c0035e0 con 0x7f959c089250 2026-02-13T20:11:31.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7fc8617fa640 1 -- 10.20.193.110:0/1857756880 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3559+0+0 (unknown 1530614704 0 0) 0x7fc86804f7d0 con 0x7fc86c089c80 2026-02-13T20:11:31.734 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f83a0ff9640 1 -- 10.20.193.110:0/3571951425 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3210097110 0 0) 0x7f83a408c410 con 0x7f83a4091950 2026-02-13T20:11:31.734 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f2a5affd640 1 -- 10.20.193.110:0/3426359160 <== mon.1 v1:10.20.193.188:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2a680030f0 con 0x7f2a74089250 2026-02-13T20:11:31.734 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f22bdffb640 1 -- 10.20.193.110:0/918903551 <== mon.1 v1:10.20.193.188:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f22cc004620 con 0x7f22d012fb90 2026-02-13T20:11:31.734 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f22bdffb640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:31.734 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f22bdffb640 1 -- 10.20.193.110:0/918903551 <== mon.1 v1:10.20.193.188:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f22cc004960 con 0x7f22d012fb90 2026-02-13T20:11:31.734 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f22bdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:31.734 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f22bdffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:11:31.734 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f22bdffb640 10 monclient: dump: 2026-02-13T20:11:31.734 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.734 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.734 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.734 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.734 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.734 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.734 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.734 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.734 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.734 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.734 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7fc870d12640 10 monclient: get_auth_request con 0x7fc83c03fd50 auth_method 0 2026-02-13T20:11:31.734 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f2a5affd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:31.734 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f22bf7fe640 4 set_mon_vals no callback set 2026-02-13T20:11:31.735 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f83a0ff9640 1 -- 10.20.193.110:0/3571951425 >> v1:10.20.193.110:6790/0 conn(0x7f83a4089c50 legacy=0x7f83a4195170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.735 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f83a0ff9640 1 -- 10.20.193.110:0/3571951425 >> v1:10.20.193.110:6789/0 conn(0x7f83a41401c0 legacy=0x7f83a4089540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.735 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f83a0ff9640 10 monclient: _finish_hunting 0 2026-02-13T20:11:31.735 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f83a0ff9640 1 monclient: found mon.b 2026-02-13T20:11:31.735 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f83a0ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:31.735 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f83a0ff9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:11:31.735 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f83a0ff9640 1 -- 10.20.193.110:0/3571951425 --> v1:10.20.193.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83a4132610 con 0x7f83a4091950 2026-02-13T20:11:31.735 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f83a0ff9640 10 monclient: _finish_auth 0 2026-02-13T20:11:31.735 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f83a0ff9640 10 monclient: _check_auth_tickets 2026-02-13T20:11:31.735 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f83a0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:31.735 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f83aa8cc640 5 monclient: authenticate success, global_id 4312 2026-02-13T20:11:31.735 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f83aa8cc640 10 monclient: _renew_subs 2026-02-13T20:11:31.735 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f83aa8cc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:11:31.735 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f83aa8cc640 1 -- 10.20.193.110:0/3571951425 --> v1:10.20.193.188:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f83a4132330 con 0x7f83a4091950 2026-02-13T20:11:31.735 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f83aa8cc640 10 monclient: _renew_subs 2026-02-13T20:11:31.735 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f83aa8cc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:11:31.735 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f83aa8cc640 1 -- 10.20.193.110:0/3571951425 --> v1:10.20.193.188:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f83a408a0b0 con 0x7f83a4091950 2026-02-13T20:11:31.735 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f2a5affd640 1 -- 10.20.193.110:0/3426359160 <== mon.1 v1:10.20.193.188:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f2a68003880 con 0x7f2a74089250 2026-02-13T20:11:31.735 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f2a5affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:31.735 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f2a5affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:11:31.735 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f2a5affd640 10 monclient: dump: 2026-02-13T20:11:31.735 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.735 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.735 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.735 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.735 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.735 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.735 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.735 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.735 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.736 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f2a78b4d640 4 set_mon_vals no callback set 2026-02-13T20:11:31.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f22d7379640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:31.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f22d7379640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:31.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f22d7379640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:11:31.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f958a7fc640 1 -- 10.20.193.110:0/2675030598 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3681731171 0 0) 0x7f959c062290 con 0x7f959c057780 2026-02-13T20:11:31.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f22d7379640 1 -- 10.20.193.110:0/918903551 --> v1:10.20.193.188:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22d00008d0 con 0x7f22d012fb90 2026-02-13T20:11:31.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f2a7c5db640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:31.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f958a7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f958a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f2a7c5db640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:31.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f2a7c5db640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:11:31.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f90427fc640 1 -- 10.20.193.110:0/3078315523 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2313141945 0 0) 0x7f905405ce90 con 0x7f9054184b60 2026-02-13T20:11:31.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f90427fc640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f90427fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f90427fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f90427fc640 10 monclient(hunting): my global_id is 4318 2026-02-13T20:11:31.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f90427fc640 1 -- 10.20.193.110:0/3078315523 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90240035e0 con 0x7f9054184b60 2026-02-13T20:11:31.737 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f2a7c5db640 1 -- 10.20.193.110:0/3426359160 --> v1:10.20.193.188:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a74111d80 con 0x7f2a74089250 2026-02-13T20:11:31.737 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f958a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.737 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f958a7fc640 10 monclient(hunting): my global_id is 4315 2026-02-13T20:11:31.737 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f958a7fc640 1 -- 10.20.193.110:0/2675030598 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f959c18ece0 con 0x7f959c057780 2026-02-13T20:11:31.737 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f958a7fc640 1 -- 10.20.193.110:0/2675030598 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 472091605 0 0) 0x7f959c08a160 con 0x7f959c184b60 2026-02-13T20:11:31.737 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f90427fc640 1 -- 10.20.193.110:0/3078315523 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4028035440 0 0) 0x7f905419fb70 con 0x7f9054089250 2026-02-13T20:11:31.737 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f90427fc640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.737 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f90427fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.737 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f90427fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.737 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f90427fc640 10 monclient(hunting): my global_id is 4319 2026-02-13T20:11:31.737 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f90427fc640 1 -- 10.20.193.110:0/3078315523 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f905405ce90 con 0x7f9054089250 2026-02-13T20:11:31.737 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f958a7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:11:31.737 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f958a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:31.738 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f958a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:31.738 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f958a7fc640 10 monclient(hunting): my global_id is 4317 2026-02-13T20:11:31.738 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f958a7fc640 1 -- 10.20.193.110:0/2675030598 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f959c062290 con 0x7f959c184b60 2026-02-13T20:11:31.738 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f958a7fc640 1 -- 10.20.193.110:0/2675030598 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4125286103 0 0) 0x7f956c0035e0 con 0x7f959c089250 2026-02-13T20:11:31.738 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f958a7fc640 1 -- 10.20.193.110:0/2675030598 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f959c08a160 con 0x7f959c089250 2026-02-13T20:11:31.738 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f958a7fc640 1 -- 10.20.193.110:0/2675030598 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f95900032f0 con 0x7f959c089250 2026-02-13T20:11:31.738 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f958a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:31.738 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f958a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:11:31.738 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f958a7fc640 10 monclient(hunting): dump: 2026-02-13T20:11:31.738 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.738 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.738 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.738 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.738 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.738 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.738 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.738 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.738 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.738 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.738 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f958a7fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:31.738 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f958a7fc640 1 -- 10.20.193.110:0/2675030598 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3470070430 0 0) 0x7f959c08a160 con 0x7f959c089250 2026-02-13T20:11:31.738 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f958a7fc640 1 -- 10.20.193.110:0/2675030598 >> v1:10.20.193.188:6789/0 conn(0x7f959c057780 legacy=0x7f959c1a4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.738 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f90427fc640 1 -- 10.20.193.110:0/3078315523 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2812833077 0 0) 0x7f90240035e0 con 0x7f9054184b60 2026-02-13T20:11:31.738 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f958a7fc640 1 -- 10.20.193.110:0/2675030598 >> v1:10.20.193.110:6789/0 conn(0x7f959c184b60 legacy=0x7f959c177af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.738 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f958a7fc640 10 monclient: _finish_hunting 0 2026-02-13T20:11:31.738 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f958a7fc640 1 monclient: found mon.c 2026-02-13T20:11:31.738 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f958a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:31.738 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f958a7fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:31.738 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f958a7fc640 1 -- 10.20.193.110:0/2675030598 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f959c091c60 con 0x7f959c089250 2026-02-13T20:11:31.738 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f958a7fc640 10 monclient: _finish_auth 0 2026-02-13T20:11:31.738 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f958a7fc640 10 monclient: _check_auth_tickets 2026-02-13T20:11:31.739 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f958a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:31.739 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f95a421b640 5 monclient: authenticate success, global_id 4316 2026-02-13T20:11:31.739 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f95a421b640 10 monclient: _renew_subs 2026-02-13T20:11:31.739 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f95a421b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:31.739 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f95a421b640 1 -- 10.20.193.110:0/2675030598 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f959c18ff20 con 0x7f959c089250 2026-02-13T20:11:31.739 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f958a7fc640 1 -- 10.20.193.110:0/2675030598 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9590004b50 con 0x7f959c089250 2026-02-13T20:11:31.739 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f958a7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:31.739 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f958a7fc640 1 -- 10.20.193.110:0/2675030598 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f9590004e70 con 0x7f959c089250 2026-02-13T20:11:31.739 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f958a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:31.739 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f2a5affd640 1 -- 10.20.193.110:0/3426359160 <== mon.1 v1:10.20.193.188:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f2a680039e0 con 0x7f2a74089250 2026-02-13T20:11:31.739 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f958a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:31.739 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f958a7fc640 10 monclient: dump: 2026-02-13T20:11:31.739 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.739 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.739 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.739 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.739 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.739 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.739 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.739 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.739 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.739 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.739 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f95a421b640 10 monclient: _renew_subs 2026-02-13T20:11:31.739 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f95a421b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:31.739 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f95a421b640 1 -- 10.20.193.110:0/2675030598 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f959c18de20 con 0x7f959c089250 2026-02-13T20:11:31.739 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f90427fc640 1 -- 10.20.193.110:0/3078315523 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f905419fb70 con 0x7f9054184b60 2026-02-13T20:11:31.740 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f90427fc640 1 -- 10.20.193.110:0/3078315523 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f90500043d0 con 0x7f9054184b60 2026-02-13T20:11:31.740 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f90427fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:31.740 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f90427fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:11:31.740 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f90427fc640 10 monclient(hunting): dump: 2026-02-13T20:11:31.740 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.740 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.740 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.740 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.740 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.740 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.740 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.740 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.740 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.740 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.740 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f90427fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:31.740 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f22bdffb640 1 -- 10.20.193.110:0/918903551 <== mon.1 v1:10.20.193.188:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f22cc004ac0 con 0x7f22d012fb90 2026-02-13T20:11:31.740 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f90427fc640 1 -- 10.20.193.110:0/3078315523 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 600006897 0 0) 0x7f905405ce90 con 0x7f9054089250 2026-02-13T20:11:31.740 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f90427fc640 1 -- 10.20.193.110:0/3078315523 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f90240035e0 con 0x7f9054089250 2026-02-13T20:11:31.740 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f83a0ff9640 1 -- 10.20.193.110:0/3571951425 <== mon.1 v1:10.20.193.188:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8390003240 con 0x7f83a4091950 2026-02-13T20:11:31.740 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f90427fc640 1 -- 10.20.193.110:0/3078315523 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f9048003030 con 0x7f9054089250 2026-02-13T20:11:31.740 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f90427fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:31.740 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f90427fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:31.740 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f90427fc640 10 monclient(hunting): dump: 2026-02-13T20:11:31.740 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.741 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.741 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.741 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.741 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.741 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.741 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.741 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.741 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.741 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.741 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f90427fc640 1 -- 10.20.193.110:0/3078315523 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1782930829 0 0) 0x7f90240035e0 con 0x7f9054089250 2026-02-13T20:11:31.741 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f90427fc640 1 -- 10.20.193.110:0/3078315523 >> v1:10.20.193.188:6789/0 conn(0x7f9054184b60 legacy=0x7f90541802e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.741 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f90427fc640 1 -- 10.20.193.110:0/3078315523 >> v1:10.20.193.110:6789/0 conn(0x7f9054057780 legacy=0x7f905419ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.741 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f90427fc640 10 monclient: _finish_hunting 0 2026-02-13T20:11:31.741 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f90427fc640 1 monclient: found mon.c 2026-02-13T20:11:31.741 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f90427fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:31.741 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f90427fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:31.741 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f90427fc640 1 -- 10.20.193.110:0/3078315523 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9054091a80 con 0x7f9054089250 2026-02-13T20:11:31.741 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f95a421b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:31.741 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f95a421b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:31.741 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f95a421b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:31.741 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f95a421b640 1 -- 10.20.193.110:0/2675030598 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f959c089030 con 0x7f959c089250 2026-02-13T20:11:31.741 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f83a0ff9640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:31.741 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f83a0ff9640 1 -- 10.20.193.110:0/3571951425 <== mon.1 v1:10.20.193.188:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f8390003940 con 0x7f83a4091950 2026-02-13T20:11:31.741 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f83a0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:31.741 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f83a0ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:11:31.741 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f2a5affd640 1 -- 10.20.193.110:0/3426359160 <== mon.1 v1:10.20.193.188:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3559+0+0 (unknown 1530614704 0 0) 0x7f2a6804d4e0 con 0x7f2a74089250 2026-02-13T20:11:31.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f83a0ff9640 10 monclient: dump: 2026-02-13T20:11:31.742 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.742 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.742 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.742 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.742 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.742 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.742 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.742 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.742 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.742 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.672+0000 7f83a27fc640 4 set_mon_vals no callback set 2026-02-13T20:11:31.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f83aa8cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:31.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f83aa8cc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:31.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f83aa8cc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:11:31.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f83aa8cc640 1 -- 10.20.193.110:0/3571951425 --> v1:10.20.193.188:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83a408d090 con 0x7f83a4091950 2026-02-13T20:11:31.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f83a0ff9640 1 -- 10.20.193.110:0/3571951425 <== mon.1 v1:10.20.193.188:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f8390003aa0 con 0x7f83a4091950 2026-02-13T20:11:31.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f958a7fc640 1 -- 10.20.193.110:0/2675030598 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f9590011ae0 con 0x7f959c089250 2026-02-13T20:11:31.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f22bdffb640 1 -- 10.20.193.110:0/918903551 <== mon.1 v1:10.20.193.188:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3559+0+0 (unknown 1530614704 0 0) 0x7f22cc04e440 con 0x7f22d012fb90 2026-02-13T20:11:31.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f90427fc640 10 monclient: _finish_auth 0 2026-02-13T20:11:31.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f90427fc640 10 monclient: _check_auth_tickets 2026-02-13T20:11:31.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f90427fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:31.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f905c1c7640 5 monclient: authenticate success, global_id 4319 2026-02-13T20:11:31.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f905c1c7640 10 monclient: _renew_subs 2026-02-13T20:11:31.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f905c1c7640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:31.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f905c1c7640 1 -- 10.20.193.110:0/3078315523 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9054062290 con 0x7f9054089250 2026-02-13T20:11:31.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f905c1c7640 10 monclient: _renew_subs 2026-02-13T20:11:31.743 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f905c1c7640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:31.743 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f905c1c7640 1 -- 10.20.193.110:0/3078315523 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f90541a16e0 con 0x7f9054089250 2026-02-13T20:11:31.743 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f90427fc640 1 -- 10.20.193.110:0/3078315523 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9048003500 con 0x7f9054089250 2026-02-13T20:11:31.743 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f90427fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:31.743 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f90427fc640 1 -- 10.20.193.110:0/3078315523 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f9048004ad0 con 0x7f9054089250 2026-02-13T20:11:31.743 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f90427fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:31.743 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f90427fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:31.743 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f90427fc640 10 monclient: dump: 2026-02-13T20:11:31.743 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:31.743 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:31.743 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.743 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:31.743 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:31.743 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:31.743 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:31.743 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:31.743 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:31.743 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:31.743 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f9043fff640 4 set_mon_vals no callback set 2026-02-13T20:11:31.743 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f83a0ff9640 1 -- 10.20.193.110:0/3571951425 <== mon.1 v1:10.20.193.188:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3559+0+0 (unknown 1530614704 0 0) 0x7f839004d5f0 con 0x7f83a4091950 2026-02-13T20:11:31.743 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f22d50ee640 10 monclient: get_auth_request con 0x7f22a003fa10 auth_method 0 2026-02-13T20:11:31.743 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f958a7fc640 1 -- 10.20.193.110:0/2675030598 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3559+0+0 (unknown 1530614704 0 0) 0x7f959004e770 con 0x7f959c089250 2026-02-13T20:11:31.743 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.673+0000 7f2a7a350640 10 monclient: get_auth_request con 0x7f2a4403fcb0 auth_method 0 2026-02-13T20:11:31.743 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.674+0000 7f83a37fe640 10 monclient: get_auth_request con 0x7f837403fe80 auth_method 0 2026-02-13T20:11:31.743 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.674+0000 7f95a1f90640 10 monclient: get_auth_request con 0x7f956c03f7e0 auth_method 0 2026-02-13T20:11:31.744 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.674+0000 7f958bfff640 4 set_mon_vals no callback set 2026-02-13T20:11:31.744 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.674+0000 7f905c1c7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:31.744 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.674+0000 7f90427fc640 1 -- 10.20.193.110:0/3078315523 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f9048004c30 con 0x7f9054089250 2026-02-13T20:11:31.744 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.674+0000 7f905c1c7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:31.744 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.674+0000 7f905c1c7640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:31.744 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.674+0000 7f905c1c7640 1 -- 10.20.193.110:0/3078315523 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90200050f0 con 0x7f9054089250 2026-02-13T20:11:31.744 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.674+0000 7f90427fc640 1 -- 10.20.193.110:0/3078315523 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3559+0+0 (unknown 1530614704 0 0) 0x7f904804e6c0 con 0x7f9054089250 2026-02-13T20:11:31.744 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.674+0000 7f9059f3c640 10 monclient: get_auth_request con 0x7f902403fb20 auth_method 0 2026-02-13T20:11:31.744 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.675+0000 7fc8617fa640 1 -- 10.20.193.110:0/1857756880 <== mon.0 v1:10.20.193.110:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fc868018020 con 0x7fc86c089c80 2026-02-13T20:11:31.744 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.675+0000 7fc8617fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:31.744 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.675+0000 7fc8617fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:11:31.744 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.676+0000 7f22bdffb640 1 -- 10.20.193.110:0/918903551 <== mon.1 v1:10.20.193.188:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f22cc0166d0 con 0x7f22d012fb90 2026-02-13T20:11:31.744 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.676+0000 7f22bdffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:31.744 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.676+0000 7f22bdffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:11:31.744 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.676+0000 7f958a7fc640 1 -- 10.20.193.110:0/2675030598 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f9590017080 con 0x7f959c089250 2026-02-13T20:11:31.744 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.676+0000 7f958a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:31.744 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.676+0000 7f958a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:11:31.745 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.677+0000 7f2a5affd640 1 -- 10.20.193.110:0/3426359160 <== mon.1 v1:10.20.193.188:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f2a68015d30 con 0x7f2a74089250 2026-02-13T20:11:31.745 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.677+0000 7f2a5affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:31.745 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.677+0000 7f2a5affd640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:11:31.745 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.678+0000 7f90427fc640 1 -- 10.20.193.110:0/3078315523 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f9048016f70 con 0x7f9054089250 2026-02-13T20:11:31.745 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.678+0000 7f90427fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:31.745 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.678+0000 7f90427fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:11:31.745 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.680+0000 7f83a0ff9640 1 -- 10.20.193.110:0/3571951425 <== mon.1 v1:10.20.193.188:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f8390015e40 con 0x7f83a4091950 2026-02-13T20:11:31.745 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.680+0000 7f83a0ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:31.745 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.680+0000 7f83a0ff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:11:31.787 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.785+0000 7fc871d14640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-13T20:11:31.787 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.785+0000 7fc871d14640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-13T20:11:31.787 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.785+0000 7fc871d14640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:31.787 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.785+0000 7fc871d14640 1 -- 10.20.193.110:0/1857756880 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fc86c055bb0 con 0x7fc86c089c80 2026-02-13T20:11:31.787 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.785+0000 7fc8617fa640 1 -- 10.20.193.110:0/1857756880 <== mon.0 v1:10.20.193.110:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (unknown 1823589948 0 555833778) 0x7fc8680177d0 con 0x7fc86c089c80 2026-02-13T20:11:31.787 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.785+0000 7fc8617fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-13T20:11:31.787 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.785+0000 7fc8617fa640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:11:31.787 INFO:teuthology.orchestra.run.trial110.stdout:47244640258 2026-02-13T20:11:31.789 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.787+0000 7f22d7379640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-13T20:11:31.789 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.787+0000 7f22d7379640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-13T20:11:31.789 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.787+0000 7f22d7379640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:11:31.789 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.787+0000 7f22d7379640 1 -- 10.20.193.110:0/918903551 --> v1:10.20.193.188:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f22d0058410 con 0x7f22d012fb90 2026-02-13T20:11:31.789 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.787+0000 7f22bdffb640 1 -- 10.20.193.110:0/918903551 <== mon.1 v1:10.20.193.188:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (unknown 92182286 0 555833778) 0x7f22cc0164f0 con 0x7f22d012fb90 2026-02-13T20:11:31.789 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.787+0000 7f22bdffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-13T20:11:31.789 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.787+0000 7f22bdffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:11:31.789 INFO:teuthology.orchestra.run.trial110.stdout:47244640258 2026-02-13T20:11:31.789 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.787+0000 7f2a7c5db640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-13T20:11:31.789 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.787+0000 7f2a7c5db640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-13T20:11:31.789 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.787+0000 7f2a7c5db640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:11:31.789 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.787+0000 7f2a7c5db640 1 -- 10.20.193.110:0/3426359160 --> v1:10.20.193.188:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f2a74089030 con 0x7f2a74089250 2026-02-13T20:11:31.790 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.788+0000 7fc871d14640 1 -- 10.20.193.110:0/1857756880 >> v1:10.20.193.188:6812/1623052694 conn(0x7fc83c03fd50 legacy=0x7fc83c060200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.790 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.788+0000 7fc871d14640 10 monclient: shutdown 2026-02-13T20:11:31.790 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.788+0000 7fc871d14640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:31.790 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.788+0000 7fc871d14640 1 -- 10.20.193.110:0/1857756880 >> v1:10.20.193.110:6789/0 conn(0x7fc86c089c80 legacy=0x7fc86c1a1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.790 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.788+0000 7f95a421b640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-13T20:11:31.790 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.788+0000 7f95a421b640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-13T20:11:31.790 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.788+0000 7f905c1c7640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-13T20:11:31.790 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.788+0000 7f905c1c7640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-13T20:11:31.790 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.788+0000 7f905c1c7640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:31.790 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.788+0000 7f95a421b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:31.790 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.788+0000 7f95a421b640 1 -- 10.20.193.110:0/2675030598 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f959c055bb0 con 0x7f959c089250 2026-02-13T20:11:31.790 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.788+0000 7fc871d14640 1 -- 10.20.193.110:0/1857756880 shutdown_connections 2026-02-13T20:11:31.790 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.788+0000 7fc871d14640 1 -- 10.20.193.110:0/1857756880 >> 10.20.193.110:0/1857756880 conn(0x7fc86c054d30 msgr2=0x7fc86c11fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:31.790 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.788+0000 7f905c1c7640 1 -- 10.20.193.110:0/3078315523 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f90200053a0 con 0x7f9054089250 2026-02-13T20:11:31.790 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.788+0000 7f2a5affd640 1 -- 10.20.193.110:0/3426359160 <== mon.1 v1:10.20.193.188:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (unknown 383520633 0 555833778) 0x7f2a680154e0 con 0x7f2a74089250 2026-02-13T20:11:31.790 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.788+0000 7f2a5affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-13T20:11:31.790 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.788+0000 7f2a5affd640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:11:31.791 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.788+0000 7fc871d14640 1 -- 10.20.193.110:0/1857756880 shutdown_connections 2026-02-13T20:11:31.791 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.788+0000 7fc871d14640 1 -- 10.20.193.110:0/1857756880 wait complete. 2026-02-13T20:11:31.791 INFO:teuthology.orchestra.run.trial110.stdout:47244640258 2026-02-13T20:11:31.791 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.788+0000 7f958a7fc640 1 -- 10.20.193.110:0/2675030598 <== mon.2 v1:10.20.193.110:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (unknown 832126871 0 555833778) 0x7f9590016830 con 0x7f959c089250 2026-02-13T20:11:31.791 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.788+0000 7f958a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-13T20:11:31.791 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.788+0000 7f958a7fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:11:31.791 INFO:teuthology.orchestra.run.trial110.stdout:47244640258 2026-02-13T20:11:31.791 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.788+0000 7f90427fc640 1 -- 10.20.193.110:0/3078315523 <== mon.2 v1:10.20.193.110:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (unknown 2131975755 0 555833778) 0x7f9048016720 con 0x7f9054089250 2026-02-13T20:11:31.791 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.788+0000 7f90427fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-13T20:11:31.791 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.788+0000 7f90427fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:11:31.791 INFO:teuthology.orchestra.run.trial110.stdout:47244640258 2026-02-13T20:11:31.792 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.790+0000 7f22d7379640 1 -- 10.20.193.110:0/918903551 >> v1:10.20.193.188:6812/1623052694 conn(0x7f22a003fa10 legacy=0x7f22a005fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.792 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.790+0000 7f22d7379640 10 monclient: shutdown 2026-02-13T20:11:31.792 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.790+0000 7f22d7379640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:31.792 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.790+0000 7f22d7379640 1 -- 10.20.193.110:0/918903551 >> v1:10.20.193.188:6789/0 conn(0x7f22d012fb90 legacy=0x7f22d0195170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.792 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.790+0000 7f22d7379640 1 -- 10.20.193.110:0/918903551 shutdown_connections 2026-02-13T20:11:31.792 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.790+0000 7f22d7379640 1 -- 10.20.193.110:0/918903551 >> 10.20.193.110:0/918903551 conn(0x7f22d0054e90 msgr2=0x7f22d0089cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:31.792 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.790+0000 7f22d7379640 1 -- 10.20.193.110:0/918903551 shutdown_connections 2026-02-13T20:11:31.792 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.790+0000 7f22d7379640 1 -- 10.20.193.110:0/918903551 wait complete. 2026-02-13T20:11:31.793 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.791+0000 7f2a7c5db640 1 -- 10.20.193.110:0/3426359160 >> v1:10.20.193.188:6812/1623052694 conn(0x7f2a4403fcb0 legacy=0x7f2a44060160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.793 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.791+0000 7f2a7c5db640 10 monclient: shutdown 2026-02-13T20:11:31.793 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.791+0000 7f2a7c5db640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:31.793 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.791+0000 7f2a7c5db640 1 -- 10.20.193.110:0/3426359160 >> v1:10.20.193.188:6789/0 conn(0x7f2a74089250 legacy=0x7f2a74171f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.793 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.791+0000 7f2a7c5db640 1 -- 10.20.193.110:0/3426359160 shutdown_connections 2026-02-13T20:11:31.793 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.791+0000 7f95a421b640 1 -- 10.20.193.110:0/2675030598 >> v1:10.20.193.188:6812/1623052694 conn(0x7f956c03f7e0 legacy=0x7f956c05fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.793 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.791+0000 7f2a7c5db640 1 -- 10.20.193.110:0/3426359160 >> 10.20.193.110:0/3426359160 conn(0x7f2a74054330 msgr2=0x7f2a7408d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:31.793 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.791+0000 7f95a421b640 10 monclient: shutdown 2026-02-13T20:11:31.793 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.791+0000 7f95a421b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:31.793 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.791+0000 7f95a421b640 1 -- 10.20.193.110:0/2675030598 >> v1:10.20.193.110:6790/0 conn(0x7f959c089250 legacy=0x7f959c1763d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.793 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.791+0000 7f2a7c5db640 1 -- 10.20.193.110:0/3426359160 shutdown_connections 2026-02-13T20:11:31.793 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.791+0000 7f2a7c5db640 1 -- 10.20.193.110:0/3426359160 wait complete. 2026-02-13T20:11:31.793 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.791+0000 7f95a421b640 1 -- 10.20.193.110:0/2675030598 shutdown_connections 2026-02-13T20:11:31.793 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.791+0000 7f95a421b640 1 -- 10.20.193.110:0/2675030598 >> 10.20.193.110:0/2675030598 conn(0x7f959c054330 msgr2=0x7f959c1a5e40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:31.794 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.791+0000 7f905c1c7640 1 -- 10.20.193.110:0/3078315523 >> v1:10.20.193.188:6812/1623052694 conn(0x7f902403fb20 legacy=0x7f902405ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.794 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.791+0000 7f905c1c7640 10 monclient: shutdown 2026-02-13T20:11:31.794 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.791+0000 7f905c1c7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:31.794 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.791+0000 7f905c1c7640 1 -- 10.20.193.110:0/3078315523 >> v1:10.20.193.110:6790/0 conn(0x7f9054089250 legacy=0x7f905419f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.794 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.791+0000 7f95a421b640 1 -- 10.20.193.110:0/2675030598 shutdown_connections 2026-02-13T20:11:31.794 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.791+0000 7f95a421b640 1 -- 10.20.193.110:0/2675030598 wait complete. 2026-02-13T20:11:31.794 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.791+0000 7f905c1c7640 1 -- 10.20.193.110:0/3078315523 shutdown_connections 2026-02-13T20:11:31.794 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.791+0000 7f905c1c7640 1 -- 10.20.193.110:0/3078315523 >> 10.20.193.110:0/3078315523 conn(0x7f9054054330 msgr2=0x7f905408d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:31.794 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.791+0000 7f905c1c7640 1 -- 10.20.193.110:0/3078315523 shutdown_connections 2026-02-13T20:11:31.794 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.791+0000 7f905c1c7640 1 -- 10.20.193.110:0/3078315523 wait complete. 2026-02-13T20:11:31.795 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.793+0000 7f83aa8cc640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-13T20:11:31.795 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.793+0000 7f83aa8cc640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-13T20:11:31.795 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.793+0000 7f83aa8cc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:11:31.795 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.793+0000 7f83aa8cc640 1 -- 10.20.193.110:0/3571951425 --> v1:10.20.193.188:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f83a4055bb0 con 0x7f83a4091950 2026-02-13T20:11:31.795 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.793+0000 7f83a0ff9640 1 -- 10.20.193.110:0/3571951425 <== mon.1 v1:10.20.193.188:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (unknown 574334944 0 847495621) 0x7f83900155f0 con 0x7f83a4091950 2026-02-13T20:11:31.795 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.793+0000 7f83a0ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-13T20:11:31.795 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.793+0000 7f83a0ff9640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:11:31.795 INFO:teuthology.orchestra.run.trial110.stdout:47244640259 2026-02-13T20:11:31.798 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.796+0000 7f83aa8cc640 1 -- 10.20.193.110:0/3571951425 >> v1:10.20.193.188:6812/1623052694 conn(0x7f837403fe80 legacy=0x7f8374060330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.798 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.796+0000 7f83aa8cc640 10 monclient: shutdown 2026-02-13T20:11:31.798 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.796+0000 7f83aa8cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:31.798 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.796+0000 7f83aa8cc640 1 -- 10.20.193.110:0/3571951425 >> v1:10.20.193.188:6789/0 conn(0x7f83a4091950 legacy=0x7f83a4088e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:31.798 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.796+0000 7f83aa8cc640 1 -- 10.20.193.110:0/3571951425 shutdown_connections 2026-02-13T20:11:31.798 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.796+0000 7f83aa8cc640 1 -- 10.20.193.110:0/3571951425 >> 10.20.193.110:0/3571951425 conn(0x7f83a4054e90 msgr2=0x7f83a408dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:31.798 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.796+0000 7f83aa8cc640 1 -- 10.20.193.110:0/3571951425 shutdown_connections 2026-02-13T20:11:31.798 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:31.796+0000 7f83aa8cc640 1 -- 10.20.193.110:0/3571951425 wait complete. 2026-02-13T20:11:31.800 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.4 2026-02-13T20:11:31.801 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.1 2026-02-13T20:11:31.802 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.5 2026-02-13T20:11:31.803 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.2 2026-02-13T20:11:31.803 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.3 2026-02-13T20:11:31.806 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640259 for osd.0 2026-02-13T20:11:32.800 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-13T20:11:32.802 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-13T20:11:32.802 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-13T20:11:32.804 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-13T20:11:32.805 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-13T20:11:32.807 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-13T20:11:32.869 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.867+0000 7fb41ee3e640 10 monclient: get_monmap_and_config 2026-02-13T20:11:32.869 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.867+0000 7fb41ee3e640 10 monclient: build_initial_monmap 2026-02-13T20:11:32.869 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.867+0000 7fb41ee3e640 10 monclient: monmap: 2026-02-13T20:11:32.869 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:32.869 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:32.870 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:32.868541+0000 2026-02-13T20:11:32.870 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:32.868541+0000 2026-02-13T20:11:32.870 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:32.870 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:32.870 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:32.870 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:32.870 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:32.870 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:32.871 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.867+0000 7fb41ee3e640 1 Processor -- start 2026-02-13T20:11:32.872 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.868+0000 7fb41ee3e640 1 -- start start 2026-02-13T20:11:32.872 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.868+0000 7fb41ee3e640 10 monclient: init 2026-02-13T20:11:32.872 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.867+0000 7f47f330c640 10 monclient: get_monmap_and_config 2026-02-13T20:11:32.872 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.867+0000 7f47f330c640 10 monclient: build_initial_monmap 2026-02-13T20:11:32.872 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.867+0000 7f47f330c640 10 monclient: monmap: 2026-02-13T20:11:32.872 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:32.872 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:32.873 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:32.868988+0000 2026-02-13T20:11:32.873 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:32.868988+0000 2026-02-13T20:11:32.873 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:32.873 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:32.873 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:32.873 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:32.873 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:32.873 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:32.873 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.868+0000 7f47f330c640 1 Processor -- start 2026-02-13T20:11:32.873 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.868+0000 7f47f330c640 1 -- start start 2026-02-13T20:11:32.873 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.868+0000 7f47f330c640 10 monclient: init 2026-02-13T20:11:32.874 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.868+0000 7fa224965640 10 monclient: get_monmap_and_config 2026-02-13T20:11:32.874 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.868+0000 7fa224965640 10 monclient: build_initial_monmap 2026-02-13T20:11:32.874 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.868+0000 7fa224965640 10 monclient: monmap: 2026-02-13T20:11:32.874 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:32.874 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:32.874 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:32.869650+0000 2026-02-13T20:11:32.874 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:32.869650+0000 2026-02-13T20:11:32.874 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:32.875 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:32.875 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:32.875 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:32.875 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:32.875 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:32.876 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.868+0000 7f47f330c640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:32.876 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.868+0000 7f47f330c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:11:32.876 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.868+0000 7f47f330c640 10 monclient(hunting): picked mon.noname-a con 0x7f47ec05c540 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:32.877 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.868+0000 7f47f330c640 10 monclient(hunting): picked mon.noname-b con 0x7f47ec05d050 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:32.877 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.868+0000 7f47f330c640 10 monclient(hunting): picked mon.noname-c con 0x7f47ec142430 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:32.877 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.868+0000 7f47f330c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47ec08f370 con 0x7f47ec05c540 2026-02-13T20:11:32.877 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.868+0000 7f47f330c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47ec08f540 con 0x7f47ec142430 2026-02-13T20:11:32.877 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.868+0000 7f47f330c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47ec0905e0 con 0x7f47ec05d050 2026-02-13T20:11:32.877 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.868+0000 7f47f330c640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:32.877 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.868+0000 7f47f330c640 10 monclient(hunting): authenticate will time out at 654.559538s 2026-02-13T20:11:32.877 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.868+0000 7f47f1081640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f47ec05c540 0x7f47ec05c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:60050/0 (socket says 10.20.193.110:60050) 2026-02-13T20:11:32.877 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.868+0000 7f47f1081640 1 -- 10.20.193.110:0/2914480753 learned_addr learned my addr 10.20.193.110:0/2914480753 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:32.878 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.868+0000 7fb41ee3e640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:32.878 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.868+0000 7fb41ee3e640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:11:32.878 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.868+0000 7fb41ee3e640 10 monclient(hunting): picked mon.noname-a con 0x7fb418089250 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:32.879 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.868+0000 7fb41ee3e640 10 monclient(hunting): picked mon.noname-c con 0x7fb418057780 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:32.879 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.868+0000 7fb41ee3e640 10 monclient(hunting): picked mon.noname-b con 0x7fb418184b60 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:32.879 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.868+0000 7fb41ee3e640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb41808a950 con 0x7fb418089250 2026-02-13T20:11:32.879 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.868+0000 7fb41ee3e640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb418089620 con 0x7fb418057780 2026-02-13T20:11:32.879 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.868+0000 7fb41ee3e640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb418057c60 con 0x7fb418184b60 2026-02-13T20:11:32.879 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.868+0000 7fb41ee3e640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:32.879 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.868+0000 7fb41ee3e640 10 monclient(hunting): authenticate will time out at 654.559714s 2026-02-13T20:11:32.879 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.868+0000 7fb41cbb3640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fb418089250 0x7fb4180580b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:60064/0 (socket says 10.20.193.110:60064) 2026-02-13T20:11:32.879 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.868+0000 7fb41cbb3640 1 -- 10.20.193.110:0/1197694347 learned_addr learned my addr 10.20.193.110:0/1197694347 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:32.880 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.868+0000 7fa224965640 1 Processor -- start 2026-02-13T20:11:32.880 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.868+0000 7f47dbfff640 1 -- 10.20.193.110:0/2914480753 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4198835773 0 0) 0x7f47ec0905e0 con 0x7f47ec05d050 2026-02-13T20:11:32.880 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.868+0000 7f47dbfff640 10 monclient(hunting): _negotiate 2026-02-13T20:11:32.880 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.868+0000 7f47dbfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:32.880 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.868+0000 7f47dbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:32.880 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.868+0000 7f47dbfff640 10 monclient(hunting): my global_id is 4322 2026-02-13T20:11:32.881 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.868+0000 7f47dbfff640 1 -- 10.20.193.110:0/2914480753 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47d40035e0 con 0x7f47ec05d050 2026-02-13T20:11:32.881 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.868+0000 7f47dbfff640 1 -- 10.20.193.110:0/2914480753 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1770573649 0 0) 0x7f47ec08f370 con 0x7f47ec05c540 2026-02-13T20:11:32.881 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.868+0000 7fa224965640 1 -- start start 2026-02-13T20:11:32.881 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.868+0000 7fa224965640 10 monclient: init 2026-02-13T20:11:32.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.868+0000 7f47dbfff640 10 monclient(hunting): _negotiate 2026-02-13T20:11:32.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.868+0000 7f47dbfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:32.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.868+0000 7f47dbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:32.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.868+0000 7f47dbfff640 10 monclient(hunting): my global_id is 4320 2026-02-13T20:11:32.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.868+0000 7f47dbfff640 1 -- 10.20.193.110:0/2914480753 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47ec0905e0 con 0x7f47ec05c540 2026-02-13T20:11:32.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.868+0000 7f47dbfff640 1 -- 10.20.193.110:0/2914480753 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2205551994 0 0) 0x7f47ec08f540 con 0x7f47ec142430 2026-02-13T20:11:32.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7f47dbfff640 10 monclient(hunting): _negotiate 2026-02-13T20:11:32.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7f47dbfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:32.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7f47dbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:32.883 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7f47dbfff640 10 monclient(hunting): my global_id is 4321 2026-02-13T20:11:32.883 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fb40f7fe640 1 -- 10.20.193.110:0/1197694347 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1852744557 0 0) 0x7fb41808a950 con 0x7fb418089250 2026-02-13T20:11:32.883 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fb40f7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:11:32.883 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fb40f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:32.883 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fb40f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:32.884 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7f47dbfff640 1 -- 10.20.193.110:0/2914480753 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47ec08f370 con 0x7f47ec142430 2026-02-13T20:11:32.884 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fb40f7fe640 10 monclient(hunting): my global_id is 4323 2026-02-13T20:11:32.884 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fb40f7fe640 1 -- 10.20.193.110:0/1197694347 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4040035e0 con 0x7fb418089250 2026-02-13T20:11:32.885 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fb40f7fe640 1 -- 10.20.193.110:0/1197694347 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1798500616 0 0) 0x7fb418057c60 con 0x7fb418184b60 2026-02-13T20:11:32.885 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fb40f7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:11:32.885 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fb40f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:32.885 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fb40f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:32.885 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fb40f7fe640 10 monclient(hunting): my global_id is 4325 2026-02-13T20:11:32.885 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fb40f7fe640 1 -- 10.20.193.110:0/1197694347 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb41808a950 con 0x7fb418184b60 2026-02-13T20:11:32.886 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7f47dbfff640 1 -- 10.20.193.110:0/2914480753 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1173095461 0 0) 0x7f47ec0905e0 con 0x7f47ec05c540 2026-02-13T20:11:32.886 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7f47dbfff640 1 -- 10.20.193.110:0/2914480753 >> v1:10.20.193.110:6790/0 conn(0x7f47ec05d050 legacy=0x7f47ec183540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:32.887 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7f47dbfff640 1 -- 10.20.193.110:0/2914480753 >> v1:10.20.193.188:6789/0 conn(0x7f47ec142430 legacy=0x7f47ec1a4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:32.887 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7f47dbfff640 10 monclient: _finish_hunting 0 2026-02-13T20:11:32.887 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7f47dbfff640 1 monclient: found mon.noname-a 2026-02-13T20:11:32.887 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7f47dbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:32.887 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7f47dbfff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:11:32.887 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7f47dbfff640 1 -- 10.20.193.110:0/2914480753 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47ec142850 con 0x7f47ec05c540 2026-02-13T20:11:32.887 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7f47dbfff640 10 monclient: _finish_auth 0 2026-02-13T20:11:32.887 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7f47dbfff640 10 monclient: _check_auth_tickets 2026-02-13T20:11:32.887 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7f47dbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:32.887 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7f47dbfff640 1 -- 10.20.193.110:0/2914480753 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f47dc002dd0 con 0x7f47ec05c540 2026-02-13T20:11:32.887 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7f47dbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:32.887 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7f47dbfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:11:32.888 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7f47dbfff640 10 monclient: dump: 2026-02-13T20:11:32.888 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:32.888 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:32.888 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.888 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.888 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:32.888 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:32.888 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:32.888 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:32.888 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:32.888 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:32.888 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7f47f330c640 5 monclient: authenticate success, global_id 4320 2026-02-13T20:11:32.889 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7f47f330c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:32.889 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fb40f7fe640 1 -- 10.20.193.110:0/1197694347 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1131987862 0 0) 0x7fb4040035e0 con 0x7fb418089250 2026-02-13T20:11:32.889 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fb40f7fe640 1 -- 10.20.193.110:0/1197694347 >> v1:10.20.193.110:6790/0 conn(0x7fb418184b60 legacy=0x7fb4181a4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:32.889 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fb40f7fe640 1 -- 10.20.193.110:0/1197694347 >> v1:10.20.193.188:6789/0 conn(0x7fb418057780 legacy=0x7fb418183440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T20:11:32.889 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fa224965640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:32.890 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fb40f7fe640 10 monclient: _finish_hunting 0 2026-02-13T20:11:32.890 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fb40f7fe640 1 monclient: found mon.noname-a 2026-02-13T20:11:32.890 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fa224965640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:11:32.890 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fa224965640 10 monclient(hunting): picked mon.noname-b con 0x7fa21c1423a0 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:32.891 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fb40f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:32.891 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fb40f7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:11:32.891 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fb40f7fe640 1 -- 10.20.193.110:0/1197694347 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb418089a50 con 0x7fb418089250 2026-02-13T20:11:32.891 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fa224965640 10 monclient(hunting): picked mon.noname-c con 0x7fa21c0931d0 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:32.892 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fb40f7fe640 10 monclient: _finish_auth 0 2026-02-13T20:11:32.892 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fb40f7fe640 10 monclient: _check_auth_tickets 2026-02-13T20:11:32.892 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fb40f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:32.892 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fb40f7fe640 1 -- 10.20.193.110:0/1197694347 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb408002dd0 con 0x7fb418089250 2026-02-13T20:11:32.892 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fa224965640 10 monclient(hunting): picked mon.noname-a con 0x7fa21c092cd0 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:32.893 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7f47dbfff640 1 -- 10.20.193.110:0/2914480753 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f47dc002fe0 con 0x7f47ec05c540 2026-02-13T20:11:32.893 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7f47dbfff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:32.893 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7f47dbfff640 1 -- 10.20.193.110:0/2914480753 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f47dc0033f0 con 0x7f47ec05c540 2026-02-13T20:11:32.893 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7f47dbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:32.893 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fb40f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:32.893 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fb40f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:11:32.893 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fb40f7fe640 10 monclient: dump: 2026-02-13T20:11:32.894 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:32.894 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:32.894 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.894 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.894 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:32.894 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:32.894 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:32.894 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:32.894 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:32.894 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:32.894 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fb41ee3e640 5 monclient: authenticate success, global_id 4323 2026-02-13T20:11:32.895 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fb41ee3e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:32.895 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fa224965640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa21c057720 con 0x7fa21c092cd0 2026-02-13T20:11:32.895 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fa224965640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa21c05d1e0 con 0x7fa21c0931d0 2026-02-13T20:11:32.895 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7f47dbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:32.895 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7f47dbfff640 10 monclient: dump: 2026-02-13T20:11:32.895 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:32.896 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:32.896 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.896 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.896 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:32.896 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:32.896 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:32.896 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:32.896 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:32.896 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:32.897 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fa224965640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa21c0573a0 con 0x7fa21c1423a0 2026-02-13T20:11:32.897 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fa224965640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:32.897 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7f47f330c640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:32.897 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7f47f330c640 4 set_mon_vals no callback set 2026-02-13T20:11:32.898 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fa224965640 10 monclient(hunting): authenticate will time out at 654.560271s 2026-02-13T20:11:32.898 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fa2226da640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fa21c1423a0 0x7fa21c0925c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:39782/0 (socket says 10.20.193.110:39782) 2026-02-13T20:11:32.898 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fa2226da640 1 -- 10.20.193.110:0/883803272 learned_addr learned my addr 10.20.193.110:0/883803272 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:32.898 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fb40f7fe640 1 -- 10.20.193.110:0/1197694347 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb408002fd0 con 0x7fb418089250 2026-02-13T20:11:32.899 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fb40f7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:32.899 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fb40f7fe640 1 -- 10.20.193.110:0/1197694347 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb4080033e0 con 0x7fb418089250 2026-02-13T20:11:32.899 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fb40f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:32.899 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fb40f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:32.899 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fb40f7fe640 10 monclient: dump: 2026-02-13T20:11:32.899 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:32.899 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:32.899 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.899 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.899 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:32.899 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:32.900 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:32.900 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:32.900 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:32.900 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:32.900 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fb41ee3e640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:32.900 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fb41ee3e640 4 set_mon_vals no callback set 2026-02-13T20:11:32.900 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7f47f330c640 10 monclient: shutdown 2026-02-13T20:11:32.900 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7f47f330c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:32.901 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fa2216d8640 1 -- 10.20.193.110:0/883803272 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 690970337 0 0) 0x7fa21c0573a0 con 0x7fa21c1423a0 2026-02-13T20:11:32.901 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fa2216d8640 10 monclient(hunting): _negotiate 2026-02-13T20:11:32.901 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fa2216d8640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:32.901 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fa2216d8640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:32.901 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fa2216d8640 10 monclient(hunting): my global_id is 4328 2026-02-13T20:11:32.901 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7f47f330c640 1 -- 10.20.193.110:0/2914480753 >> v1:10.20.193.110:6789/0 conn(0x7f47ec05c540 legacy=0x7f47ec05c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:32.902 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fa2216d8640 1 -- 10.20.193.110:0/883803272 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa20c0035e0 con 0x7fa21c1423a0 2026-02-13T20:11:32.902 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7f47f330c640 1 -- 10.20.193.110:0/2914480753 shutdown_connections 2026-02-13T20:11:32.902 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7f47f330c640 1 -- 10.20.193.110:0/2914480753 >> 10.20.193.110:0/2914480753 conn(0x7f47ec093270 msgr2=0x7f47ec054330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:32.903 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7f47f330c640 1 -- 10.20.193.110:0/2914480753 shutdown_connections 2026-02-13T20:11:32.903 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7f47f330c640 1 -- 10.20.193.110:0/2914480753 wait complete. 2026-02-13T20:11:32.904 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fa2216d8640 1 -- 10.20.193.110:0/883803272 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2482848753 0 0) 0x7fa21c057720 con 0x7fa21c092cd0 2026-02-13T20:11:32.904 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fa2216d8640 10 monclient(hunting): _negotiate 2026-02-13T20:11:32.904 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fa2216d8640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:32.904 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fa2216d8640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:32.904 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fa2216d8640 10 monclient(hunting): my global_id is 4326 2026-02-13T20:11:32.904 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fa2216d8640 1 -- 10.20.193.110:0/883803272 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa21c0573a0 con 0x7fa21c092cd0 2026-02-13T20:11:32.904 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fa2216d8640 1 -- 10.20.193.110:0/883803272 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1958799203 0 0) 0x7fa20c0035e0 con 0x7fa21c1423a0 2026-02-13T20:11:32.904 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fa2216d8640 1 -- 10.20.193.110:0/883803272 >> v1:10.20.193.188:6789/0 conn(0x7fa21c0931d0 legacy=0x7fa21c183540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:32.904 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fa2216d8640 1 -- 10.20.193.110:0/883803272 >> v1:10.20.193.110:6789/0 conn(0x7fa21c092cd0 legacy=0x7fa21c1a4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:32.904 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fa2216d8640 10 monclient: _finish_hunting 0 2026-02-13T20:11:32.904 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fa2216d8640 1 monclient: found mon.noname-b 2026-02-13T20:11:32.904 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fa2216d8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:32.904 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fa2216d8640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:11:32.905 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fa2216d8640 1 -- 10.20.193.110:0/883803272 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa21c0586c0 con 0x7fa21c1423a0 2026-02-13T20:11:32.905 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fa2216d8640 10 monclient: _finish_auth 0 2026-02-13T20:11:32.905 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fa2216d8640 10 monclient: _check_auth_tickets 2026-02-13T20:11:32.905 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fa2216d8640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:32.905 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fa2216d8640 1 -- 10.20.193.110:0/883803272 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa214002dd0 con 0x7fa21c1423a0 2026-02-13T20:11:32.905 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fa2216d8640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:32.905 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fa2216d8640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:11:32.905 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fb41ee3e640 10 monclient: shutdown 2026-02-13T20:11:32.906 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fa2216d8640 10 monclient: dump: 2026-02-13T20:11:32.906 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:32.906 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:32.906 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.906 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.906 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:32.906 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:32.906 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:32.906 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:32.906 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:32.906 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:32.906 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fa224965640 5 monclient: authenticate success, global_id 4328 2026-02-13T20:11:32.907 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fb41ee3e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:32.907 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fb41ee3e640 1 -- 10.20.193.110:0/1197694347 >> v1:10.20.193.110:6789/0 conn(0x7fb418089250 legacy=0x7fb4180580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:32.907 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fa224965640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:32.907 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fb41ee3e640 1 -- 10.20.193.110:0/1197694347 shutdown_connections 2026-02-13T20:11:32.907 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fb41ee3e640 1 -- 10.20.193.110:0/1197694347 >> 10.20.193.110:0/1197694347 conn(0x7fb418054330 msgr2=0x7fb418054730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:32.908 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fb41ee3e640 1 -- 10.20.193.110:0/1197694347 shutdown_connections 2026-02-13T20:11:32.908 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fa2216d8640 1 -- 10.20.193.110:0/883803272 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa214003010 con 0x7fa21c1423a0 2026-02-13T20:11:32.908 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fa2216d8640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:32.908 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fa2216d8640 1 -- 10.20.193.110:0/883803272 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa214003420 con 0x7fa21c1423a0 2026-02-13T20:11:32.908 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fb41ee3e640 1 -- 10.20.193.110:0/1197694347 wait complete. 2026-02-13T20:11:32.909 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fa2216d8640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:32.909 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fa2216d8640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:32.909 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fa2216d8640 10 monclient: dump: 2026-02-13T20:11:32.909 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:32.909 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:32.909 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.909 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.909 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:32.909 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:32.909 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:32.909 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:32.909 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:32.909 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:32.909 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fa224965640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:32.910 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.869+0000 7fa224965640 4 set_mon_vals no callback set 2026-02-13T20:11:32.910 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7f47f330c640 10 monclient: build_initial_monmap 2026-02-13T20:11:32.910 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7f47f330c640 10 monclient: monmap: 2026-02-13T20:11:32.910 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:32.910 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:32.910 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:11:32.910 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:11:32.910 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:32.910 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:11:32.910 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:32.910 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:32.910 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:32.911 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:32.911 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7fa224965640 10 monclient: shutdown 2026-02-13T20:11:32.911 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7fa224965640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:32.911 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7fa224965640 1 -- 10.20.193.110:0/883803272 >> v1:10.20.193.110:6790/0 conn(0x7fa21c1423a0 legacy=0x7fa21c0925c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:32.911 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7fb41ee3e640 10 monclient: build_initial_monmap 2026-02-13T20:11:32.911 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7fb41ee3e640 10 monclient: monmap: 2026-02-13T20:11:32.911 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:32.911 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:32.911 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:11:32.912 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:11:32.912 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:32.912 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:11:32.912 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:32.912 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:32.912 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:32.912 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:32.912 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7fa224965640 1 -- 10.20.193.110:0/883803272 shutdown_connections 2026-02-13T20:11:32.912 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7fa224965640 1 -- 10.20.193.110:0/883803272 >> 10.20.193.110:0/883803272 conn(0x7fa21c054c10 msgr2=0x7fa21c093630 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:32.913 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7fa224965640 1 -- 10.20.193.110:0/883803272 shutdown_connections 2026-02-13T20:11:32.913 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7f47f330c640 1 Processor -- start 2026-02-13T20:11:32.913 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7fa224965640 1 -- 10.20.193.110:0/883803272 wait complete. 2026-02-13T20:11:32.913 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7f47f330c640 1 -- start start 2026-02-13T20:11:32.913 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7f47f330c640 10 monclient: init 2026-02-13T20:11:32.914 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7fb41ee3e640 1 Processor -- start 2026-02-13T20:11:32.914 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7fb41ee3e640 1 -- start start 2026-02-13T20:11:32.914 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7fb41ee3e640 10 monclient: init 2026-02-13T20:11:32.914 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7f47f330c640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:32.914 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7f47f330c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:11:32.914 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7f47f330c640 10 monclient(hunting): picked mon.noname-a con 0x7f47ec05c540 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:32.914 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7f47f330c640 10 monclient(hunting): picked mon.noname-c con 0x7f47ec05d050 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:32.915 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7fb41ee3e640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:32.915 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7f47f330c640 10 monclient(hunting): picked mon.noname-b con 0x7f47ec142430 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:32.915 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7fb41ee3e640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:11:32.915 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7f47f330c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47ec141a40 con 0x7f47ec05c540 2026-02-13T20:11:32.915 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7f47f330c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47ec131e90 con 0x7f47ec142430 2026-02-13T20:11:32.915 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7f47f330c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47ec05d590 con 0x7f47ec05d050 2026-02-13T20:11:32.916 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7fb41ee3e640 10 monclient(hunting): picked mon.noname-b con 0x7fb418057780 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:32.916 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7f47f330c640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:32.916 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7f47f330c640 10 monclient(hunting): authenticate will time out at 654.561644s 2026-02-13T20:11:32.916 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7fb41ee3e640 10 monclient(hunting): picked mon.noname-c con 0x7fb418089250 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:32.916 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7fa224965640 10 monclient: build_initial_monmap 2026-02-13T20:11:32.917 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7fb41ee3e640 10 monclient(hunting): picked mon.noname-a con 0x7fb418184b60 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:32.917 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7fb41ee3e640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb41808a160 con 0x7fb418184b60 2026-02-13T20:11:32.917 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7fb41ee3e640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb418062290 con 0x7fb418057780 2026-02-13T20:11:32.917 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7fa224965640 10 monclient: monmap: 2026-02-13T20:11:32.917 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:32.917 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:32.917 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:11:32.917 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:11:32.917 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:32.917 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:11:32.918 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:32.918 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:32.918 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:32.918 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:32.918 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7fb41ee3e640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4181a3f10 con 0x7fb418089250 2026-02-13T20:11:32.918 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7fb41ee3e640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:32.918 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7fb41ee3e640 10 monclient(hunting): authenticate will time out at 654.561677s 2026-02-13T20:11:32.918 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7f47f1081640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f47ec05c540 0x7f47ec140490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:60072/0 (socket says 10.20.193.110:60072) 2026-02-13T20:11:32.918 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7f47f1081640 1 -- 10.20.193.110:0/2865868874 learned_addr learned my addr 10.20.193.110:0/2865868874 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:32.918 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7f47f0880640 1 --1- 10.20.193.110:0/2865868874 >> v1:10.20.193.110:6790/0 conn(0x7f47ec05d050 0x7f47ec193750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:39788/0 (socket says 10.20.193.110:39788) 2026-02-13T20:11:32.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7fb41d3b4640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fb418184b60 0x7fb418172fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:60078/0 (socket says 10.20.193.110:60078) 2026-02-13T20:11:32.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7fb41d3b4640 1 -- 10.20.193.110:0/334270931 learned_addr learned my addr 10.20.193.110:0/334270931 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:32.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7fb40ffff640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fb418089250 0x7fb4181a2090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:39796/0 (socket says 10.20.193.110:39796) 2026-02-13T20:11:32.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7fb40d7fa640 1 -- 10.20.193.110:0/334270931 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3918948677 0 0) 0x7fb4181a3f10 con 0x7fb418089250 2026-02-13T20:11:32.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7fb40d7fa640 10 monclient(hunting): _negotiate 2026-02-13T20:11:32.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7fb40d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:32.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7fb40d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:32.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7fb40d7fa640 10 monclient(hunting): my global_id is 4334 2026-02-13T20:11:32.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7f47d9ffb640 1 -- 10.20.193.110:0/2865868874 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 473943483 0 0) 0x7f47ec142850 con 0x7f47ec05c540 2026-02-13T20:11:32.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7f47d9ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:11:32.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7f47d9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:32.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7f47d9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:32.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7f47d9ffb640 10 monclient(hunting): my global_id is 4329 2026-02-13T20:11:32.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7f47d9ffb640 1 -- 10.20.193.110:0/2865868874 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47bc0035e0 con 0x7f47ec05c540 2026-02-13T20:11:32.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7fb40d7fa640 1 -- 10.20.193.110:0/334270931 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3e80035e0 con 0x7fb418089250 2026-02-13T20:11:32.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7f47d9ffb640 1 -- 10.20.193.110:0/2865868874 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4026284158 0 0) 0x7f47ec05d590 con 0x7f47ec05d050 2026-02-13T20:11:32.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7f47d9ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:11:32.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7f47d9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:32.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7f47d9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:32.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7f47d9ffb640 10 monclient(hunting): my global_id is 4331 2026-02-13T20:11:32.921 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7f47d9ffb640 1 -- 10.20.193.110:0/2865868874 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47ec142850 con 0x7f47ec05d050 2026-02-13T20:11:32.921 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7fb40d7fa640 1 -- 10.20.193.110:0/334270931 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 504000199 0 0) 0x7fb41808a160 con 0x7fb418184b60 2026-02-13T20:11:32.921 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7fb40d7fa640 10 monclient(hunting): _negotiate 2026-02-13T20:11:32.921 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7fb40d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:32.921 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7fb40d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:32.921 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7fb40d7fa640 10 monclient(hunting): my global_id is 4332 2026-02-13T20:11:32.921 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7fb40d7fa640 1 -- 10.20.193.110:0/334270931 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4181a3f10 con 0x7fb418184b60 2026-02-13T20:11:32.921 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7fa224965640 1 Processor -- start 2026-02-13T20:11:32.922 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.870+0000 7fa224965640 1 -- start start 2026-02-13T20:11:32.922 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa224965640 10 monclient: init 2026-02-13T20:11:32.922 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fb40d7fa640 1 -- 10.20.193.110:0/334270931 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2872319238 0 0) 0x7fb3e80035e0 con 0x7fb418089250 2026-02-13T20:11:32.922 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fb40d7fa640 1 -- 10.20.193.110:0/334270931 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb41808a160 con 0x7fb418089250 2026-02-13T20:11:32.922 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fb40d7fa640 1 -- 10.20.193.110:0/334270931 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb400003f50 con 0x7fb418089250 2026-02-13T20:11:32.922 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fb40d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:32.922 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fb40d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:11:32.922 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fb40d7fa640 10 monclient(hunting): dump: 2026-02-13T20:11:32.922 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:32.922 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:32.922 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.922 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.922 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:32.922 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:32.922 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:32.923 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:32.923 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:32.923 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:32.923 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fb40d7fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:32.923 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7f47d9ffb640 1 -- 10.20.193.110:0/2865868874 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3248981244 0 0) 0x7f47bc0035e0 con 0x7f47ec05c540 2026-02-13T20:11:32.923 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7f47d9ffb640 1 -- 10.20.193.110:0/2865868874 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f47ec05d590 con 0x7f47ec05c540 2026-02-13T20:11:32.923 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7f47d9ffb640 1 -- 10.20.193.110:0/2865868874 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f47dc003300 con 0x7f47ec05c540 2026-02-13T20:11:32.923 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7f47d9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:32.923 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7f47d9ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:11:32.923 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7f47d9ffb640 10 monclient(hunting): dump: 2026-02-13T20:11:32.923 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:32.924 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:32.924 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.924 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.924 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:32.924 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:32.924 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:32.924 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:32.924 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:32.924 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:32.924 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7f47d9ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:32.924 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7f47d9ffb640 1 -- 10.20.193.110:0/2865868874 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1029364525 0 0) 0x7f47ec142850 con 0x7f47ec05d050 2026-02-13T20:11:32.924 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7f47d9ffb640 1 -- 10.20.193.110:0/2865868874 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f47bc0035e0 con 0x7f47ec05d050 2026-02-13T20:11:32.924 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7f47d9ffb640 1 -- 10.20.193.110:0/2865868874 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f47e0003010 con 0x7f47ec05d050 2026-02-13T20:11:32.924 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7f47d9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:32.924 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7f47d9ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:32.924 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7f47d9ffb640 10 monclient(hunting): dump: 2026-02-13T20:11:32.924 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:32.924 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:32.924 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.924 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.924 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:32.925 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:32.925 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:32.925 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:32.925 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:32.925 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:32.925 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fb40d7fa640 1 -- 10.20.193.110:0/334270931 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 547229058 0 0) 0x7fb4181a3f10 con 0x7fb418184b60 2026-02-13T20:11:32.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fb40d7fa640 1 -- 10.20.193.110:0/334270931 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb3e80035e0 con 0x7fb418184b60 2026-02-13T20:11:32.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fb40d7fa640 1 -- 10.20.193.110:0/334270931 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb414004250 con 0x7fb418184b60 2026-02-13T20:11:32.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fb40d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:32.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fb40d7fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:32.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fb40d7fa640 10 monclient(hunting): dump: 2026-02-13T20:11:32.926 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:32.926 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:32.926 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.926 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.926 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:32.926 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:32.926 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:32.926 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:32.926 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:32.926 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:32.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fb40d7fa640 1 -- 10.20.193.110:0/334270931 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1325365988 0 0) 0x7fb41808a160 con 0x7fb418089250 2026-02-13T20:11:32.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fb40d7fa640 1 -- 10.20.193.110:0/334270931 >> v1:10.20.193.188:6789/0 conn(0x7fb418057780 legacy=0x7fb4181a1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:32.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fb40d7fa640 1 -- 10.20.193.110:0/334270931 >> v1:10.20.193.110:6789/0 conn(0x7fb418184b60 legacy=0x7fb418172fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:32.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fb40d7fa640 10 monclient: _finish_hunting 0 2026-02-13T20:11:32.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fb40d7fa640 1 monclient: found mon.c 2026-02-13T20:11:32.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fb40d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:32.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fb40d7fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:32.927 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fb40d7fa640 1 -- 10.20.193.110:0/334270931 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4181a4ce0 con 0x7fb418089250 2026-02-13T20:11:32.927 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fb40d7fa640 10 monclient: _finish_auth 0 2026-02-13T20:11:32.927 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fb40d7fa640 10 monclient: _check_auth_tickets 2026-02-13T20:11:32.927 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fb40d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:32.927 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fb41ee3e640 5 monclient: authenticate success, global_id 4334 2026-02-13T20:11:32.927 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fb41ee3e640 10 monclient: _renew_subs 2026-02-13T20:11:32.927 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fb41ee3e640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:32.927 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fb41ee3e640 1 -- 10.20.193.110:0/334270931 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb4181a4400 con 0x7fb418089250 2026-02-13T20:11:32.927 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fb41ee3e640 10 monclient: _renew_subs 2026-02-13T20:11:32.927 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fb41ee3e640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:32.927 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fb41ee3e640 1 -- 10.20.193.110:0/334270931 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fb4181a37b0 con 0x7fb418089250 2026-02-13T20:11:32.927 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7f47d9ffb640 1 -- 10.20.193.110:0/2865868874 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3153098311 0 0) 0x7f47ec05d590 con 0x7f47ec05c540 2026-02-13T20:11:32.927 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7f47d9ffb640 1 -- 10.20.193.110:0/2865868874 >> v1:10.20.193.110:6790/0 conn(0x7f47ec05d050 legacy=0x7f47ec193750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:32.927 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7f47d9ffb640 1 -- 10.20.193.110:0/2865868874 >> v1:10.20.193.188:6789/0 conn(0x7f47ec142430 legacy=0x7f47ec194e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:32.927 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7f47d9ffb640 10 monclient: _finish_hunting 0 2026-02-13T20:11:32.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa224965640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:32.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7f47d9ffb640 1 monclient: found mon.a 2026-02-13T20:11:32.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7f47d9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:32.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7f47d9ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:32.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7f47d9ffb640 1 -- 10.20.193.110:0/2865868874 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47ec130a40 con 0x7f47ec05c540 2026-02-13T20:11:32.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7f47d9ffb640 10 monclient: _finish_auth 0 2026-02-13T20:11:32.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7f47d9ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:11:32.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7f47d9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:32.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7f47f330c640 5 monclient: authenticate success, global_id 4329 2026-02-13T20:11:32.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7f47f330c640 10 monclient: _renew_subs 2026-02-13T20:11:32.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7f47f330c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:32.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7f47f330c640 1 -- 10.20.193.110:0/2865868874 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f47ec12fb30 con 0x7f47ec05c540 2026-02-13T20:11:32.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa224965640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:11:32.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa224965640 10 monclient(hunting): picked mon.noname-b con 0x7fa21c092cd0 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:32.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7f47f330c640 10 monclient: _renew_subs 2026-02-13T20:11:32.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7f47f330c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:32.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7f47f330c640 1 -- 10.20.193.110:0/2865868874 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f47ec152620 con 0x7f47ec05c540 2026-02-13T20:11:32.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fb40d7fa640 1 -- 10.20.193.110:0/334270931 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb400004120 con 0x7fb418089250 2026-02-13T20:11:32.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fb40d7fa640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:32.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fb40d7fa640 1 -- 10.20.193.110:0/334270931 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb400002850 con 0x7fb418089250 2026-02-13T20:11:32.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fb40d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:32.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fb40d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:32.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fb40d7fa640 10 monclient: dump: 2026-02-13T20:11:32.929 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:32.929 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:32.929 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.930 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.930 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:32.930 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:32.930 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:32.930 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:32.930 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:32.930 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:32.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fb40effd640 4 set_mon_vals no callback set 2026-02-13T20:11:32.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa221ed9640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fa21c0931d0 0x7fa21c193840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:60092/0 (socket says 10.20.193.110:60092) 2026-02-13T20:11:32.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa221ed9640 1 -- 10.20.193.110:0/3929398204 learned_addr learned my addr 10.20.193.110:0/3929398204 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:32.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7f47d9ffb640 1 -- 10.20.193.110:0/2865868874 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f47dc004b50 con 0x7f47ec05c540 2026-02-13T20:11:32.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7f47d9ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:32.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7f47d9ffb640 1 -- 10.20.193.110:0/2865868874 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f47dc0029d0 con 0x7f47ec05c540 2026-02-13T20:11:32.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7f47d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:32.931 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7f47d9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:32.931 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7f47db7fe640 4 set_mon_vals no callback set 2026-02-13T20:11:32.931 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7f47d9ffb640 10 monclient: dump: 2026-02-13T20:11:32.931 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:32.931 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:32.931 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.931 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.931 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:32.931 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:32.931 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:32.931 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:32.931 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:32.931 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:32.932 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa224965640 10 monclient(hunting): picked mon.noname-a con 0x7fa21c0931d0 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:32.932 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa224965640 10 monclient(hunting): picked mon.noname-c con 0x7fa21c1423a0 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:32.932 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa224965640 1 -- 10.20.193.110:0/3929398204 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa21c131330 con 0x7fa21c0931d0 2026-02-13T20:11:32.932 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa224965640 1 -- 10.20.193.110:0/3929398204 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa21c0920f0 con 0x7fa21c092cd0 2026-02-13T20:11:32.932 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa224965640 1 -- 10.20.193.110:0/3929398204 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa21c12f870 con 0x7fa21c1423a0 2026-02-13T20:11:32.932 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa224965640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:32.932 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa224965640 10 monclient(hunting): authenticate will time out at 654.562583s 2026-02-13T20:11:32.932 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa206ffd640 1 -- 10.20.193.110:0/3929398204 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2047131930 0 0) 0x7fa21c131330 con 0x7fa21c0931d0 2026-02-13T20:11:32.932 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa206ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:11:32.932 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa206ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:32.932 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa206ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:32.932 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa206ffd640 10 monclient(hunting): my global_id is 4335 2026-02-13T20:11:32.932 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa206ffd640 1 -- 10.20.193.110:0/3929398204 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1ec0035e0 con 0x7fa21c0931d0 2026-02-13T20:11:32.932 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa206ffd640 1 -- 10.20.193.110:0/3929398204 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 716818394 0 0) 0x7fa21c12f870 con 0x7fa21c1423a0 2026-02-13T20:11:32.932 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa206ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:11:32.932 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa206ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:32.933 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa206ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:32.933 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa206ffd640 10 monclient(hunting): my global_id is 4337 2026-02-13T20:11:32.933 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa206ffd640 1 -- 10.20.193.110:0/3929398204 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa21c131330 con 0x7fa21c1423a0 2026-02-13T20:11:32.933 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fb41ee3e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:32.933 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fb41ee3e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:32.933 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fb41ee3e640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:32.933 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fb41ee3e640 1 -- 10.20.193.110:0/334270931 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb418089030 con 0x7fb418089250 2026-02-13T20:11:32.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa206ffd640 1 -- 10.20.193.110:0/3929398204 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 306790048 0 0) 0x7fa21c131330 con 0x7fa21c1423a0 2026-02-13T20:11:32.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa206ffd640 1 -- 10.20.193.110:0/3929398204 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa21c12f870 con 0x7fa21c1423a0 2026-02-13T20:11:32.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa206ffd640 1 -- 10.20.193.110:0/3929398204 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa210004170 con 0x7fa21c1423a0 2026-02-13T20:11:32.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa206ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:32.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa206ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:11:32.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa206ffd640 10 monclient(hunting): dump: 2026-02-13T20:11:32.934 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:32.934 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:32.934 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.934 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.934 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:32.934 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:32.934 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:32.935 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:32.935 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:32.935 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:32.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa206ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:32.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa206ffd640 1 -- 10.20.193.110:0/3929398204 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4135089530 0 0) 0x7fa1ec0035e0 con 0x7fa21c0931d0 2026-02-13T20:11:32.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa206ffd640 1 -- 10.20.193.110:0/3929398204 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa21c131330 con 0x7fa21c0931d0 2026-02-13T20:11:32.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa206ffd640 1 -- 10.20.193.110:0/3929398204 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa208003140 con 0x7fa21c0931d0 2026-02-13T20:11:32.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa206ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:32.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa206ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:32.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa206ffd640 10 monclient(hunting): dump: 2026-02-13T20:11:32.935 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:32.935 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:32.935 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.935 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.935 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:32.935 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:32.935 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:32.935 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:32.935 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:32.935 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:32.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa206ffd640 1 -- 10.20.193.110:0/3929398204 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 492006760 0 0) 0x7fa21c0920f0 con 0x7fa21c092cd0 2026-02-13T20:11:32.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa206ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:11:32.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa206ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:32.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa206ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:32.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa206ffd640 10 monclient(hunting): my global_id is 4330 2026-02-13T20:11:32.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa206ffd640 1 -- 10.20.193.110:0/3929398204 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1ec0035e0 con 0x7fa21c092cd0 2026-02-13T20:11:32.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa206ffd640 1 -- 10.20.193.110:0/3929398204 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1147523491 0 0) 0x7fa21c12f870 con 0x7fa21c1423a0 2026-02-13T20:11:32.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa206ffd640 1 -- 10.20.193.110:0/3929398204 >> v1:10.20.193.188:6789/0 conn(0x7fa21c092cd0 legacy=0x7fa21c1401d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:32.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa206ffd640 1 -- 10.20.193.110:0/3929398204 >> v1:10.20.193.110:6789/0 conn(0x7fa21c0931d0 legacy=0x7fa21c193840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:32.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa206ffd640 10 monclient: _finish_hunting 0 2026-02-13T20:11:32.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa206ffd640 1 monclient: found mon.c 2026-02-13T20:11:32.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fb40d7fa640 1 -- 10.20.193.110:0/334270931 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fb4000029b0 con 0x7fb418089250 2026-02-13T20:11:32.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa206ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:32.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa206ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:32.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa206ffd640 1 -- 10.20.193.110:0/3929398204 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa21c05d590 con 0x7fa21c1423a0 2026-02-13T20:11:32.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa206ffd640 10 monclient: _finish_auth 0 2026-02-13T20:11:32.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa206ffd640 10 monclient: _check_auth_tickets 2026-02-13T20:11:32.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa206ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:32.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa224965640 5 monclient: authenticate success, global_id 4337 2026-02-13T20:11:32.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa224965640 10 monclient: _renew_subs 2026-02-13T20:11:32.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa224965640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:32.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.871+0000 7fa224965640 1 -- 10.20.193.110:0/3929398204 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa21c131bd0 con 0x7fa21c1423a0 2026-02-13T20:11:32.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.872+0000 7fa224965640 10 monclient: _renew_subs 2026-02-13T20:11:32.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.872+0000 7fa224965640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:32.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.872+0000 7fa224965640 1 -- 10.20.193.110:0/3929398204 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fa21c1408e0 con 0x7fa21c1423a0 2026-02-13T20:11:32.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.872+0000 7f47d9ffb640 1 -- 10.20.193.110:0/2865868874 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f47dc004eb0 con 0x7f47ec05c540 2026-02-13T20:11:32.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.872+0000 7f47f330c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:32.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.872+0000 7f47f330c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:32.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.872+0000 7f47f330c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:32.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.872+0000 7f47f330c640 1 -- 10.20.193.110:0/2865868874 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47ec091630 con 0x7f47ec05c540 2026-02-13T20:11:32.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.872+0000 7fb40d7fa640 1 -- 10.20.193.110:0/334270931 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 3531+0+0 (unknown 315507976 0 0) 0x7fb40004e650 con 0x7fb418089250 2026-02-13T20:11:32.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.872+0000 7fb41cbb3640 10 monclient: get_auth_request con 0x7fb3e803faa0 auth_method 0 2026-02-13T20:11:32.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.872+0000 7f47d9ffb640 1 -- 10.20.193.110:0/2865868874 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 3531+0+0 (unknown 315507976 0 0) 0x7f47dc04e800 con 0x7f47ec05c540 2026-02-13T20:11:32.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.872+0000 7fa224965640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:32.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.872+0000 7fa224965640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:32.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.872+0000 7fa224965640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:32.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.872+0000 7fa224965640 1 -- 10.20.193.110:0/3929398204 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa21c1317a0 con 0x7fa21c1423a0 2026-02-13T20:11:32.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.872+0000 7f47f0880640 10 monclient: get_auth_request con 0x7f47bc03fa50 auth_method 0 2026-02-13T20:11:32.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.874+0000 7fa206ffd640 1 -- 10.20.193.110:0/3929398204 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa2100047b0 con 0x7fa21c1423a0 2026-02-13T20:11:32.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.874+0000 7fa206ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:32.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.874+0000 7fa206ffd640 1 -- 10.20.193.110:0/3929398204 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa210004b90 con 0x7fa21c1423a0 2026-02-13T20:11:32.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.874+0000 7fa206ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:32.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.874+0000 7fa206ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:32.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.874+0000 7fa206ffd640 10 monclient: dump: 2026-02-13T20:11:32.939 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:32.939 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:32.939 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.939 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.939 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:32.939 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:32.939 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:32.939 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:32.939 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:32.939 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:32.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.874+0000 7fa220ed7640 4 set_mon_vals no callback set 2026-02-13T20:11:32.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.874+0000 7fb40d7fa640 1 -- 10.20.193.110:0/334270931 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fb400016850 con 0x7fb418089250 2026-02-13T20:11:32.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.874+0000 7fb40d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:32.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.874+0000 7fb40d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:11:32.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.874+0000 7f47d9ffb640 1 -- 10.20.193.110:0/2865868874 <== mon.0 v1:10.20.193.110:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f47dc017130 con 0x7f47ec05c540 2026-02-13T20:11:32.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.874+0000 7f47d9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:32.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.874+0000 7f47d9ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:11:32.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.874+0000 7fa206ffd640 1 -- 10.20.193.110:0/3929398204 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fa210004cf0 con 0x7fa21c1423a0 2026-02-13T20:11:32.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.875+0000 7fa206ffd640 1 -- 10.20.193.110:0/3929398204 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 3531+0+0 (unknown 315507976 0 0) 0x7fa21004e600 con 0x7fa21c1423a0 2026-02-13T20:11:32.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.875+0000 7fa2226da640 10 monclient: get_auth_request con 0x7fa1ec03fc70 auth_method 0 2026-02-13T20:11:32.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.876+0000 7fa206ffd640 1 -- 10.20.193.110:0/3929398204 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fa210016ed0 con 0x7fa21c1423a0 2026-02-13T20:11:32.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.876+0000 7fa206ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:32.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.876+0000 7fa206ffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:11:32.942 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.911+0000 7fcec8a67640 10 monclient: get_monmap_and_config 2026-02-13T20:11:32.942 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.911+0000 7fcec8a67640 10 monclient: build_initial_monmap 2026-02-13T20:11:32.943 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.911+0000 7fcec8a67640 10 monclient: monmap: 2026-02-13T20:11:32.943 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:32.943 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:32.943 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:32.912953+0000 2026-02-13T20:11:32.943 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:32.912953+0000 2026-02-13T20:11:32.943 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:32.943 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:32.943 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:32.943 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:32.943 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:32.944 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:32.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.912+0000 7fcec8a67640 1 Processor -- start 2026-02-13T20:11:32.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.912+0000 7fcec8a67640 1 -- start start 2026-02-13T20:11:32.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.912+0000 7fcec8a67640 10 monclient: init 2026-02-13T20:11:32.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.912+0000 7fcec8a67640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:32.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.912+0000 7fcec8a67640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:11:32.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.912+0000 7fcec8a67640 10 monclient(hunting): picked mon.noname-b con 0x7fcec4089250 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:32.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.912+0000 7fcec8a67640 10 monclient(hunting): picked mon.noname-c con 0x7fcec4057780 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:32.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.912+0000 7fcec8a67640 10 monclient(hunting): picked mon.noname-a con 0x7fcec4184b60 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:32.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.912+0000 7fcec8a67640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcec408a950 con 0x7fcec4184b60 2026-02-13T20:11:32.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.912+0000 7fcec8a67640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcec4089620 con 0x7fcec4057780 2026-02-13T20:11:32.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.912+0000 7fcec8a67640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcec4057c60 con 0x7fcec4089250 2026-02-13T20:11:32.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.912+0000 7fcec8a67640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:32.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.912+0000 7fcec8a67640 10 monclient(hunting): authenticate will time out at 654.603537s 2026-02-13T20:11:32.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.912+0000 7fcec2d76640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fcec4184b60 0x7fcec41a4f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:60108/0 (socket says 10.20.193.110:60108) 2026-02-13T20:11:32.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.912+0000 7fcec2d76640 1 -- 10.20.193.110:0/3849931850 learned_addr learned my addr 10.20.193.110:0/3849931850 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:32.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.912+0000 7fcec1573640 1 -- 10.20.193.110:0/3849931850 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2508716146 0 0) 0x7fcec408a950 con 0x7fcec4184b60 2026-02-13T20:11:32.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.912+0000 7fcec1573640 10 monclient(hunting): _negotiate 2026-02-13T20:11:32.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.912+0000 7fcec1573640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:32.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.912+0000 7fcec1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:32.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.912+0000 7fcec1573640 10 monclient(hunting): my global_id is 4338 2026-02-13T20:11:32.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.912+0000 7fcec1573640 1 -- 10.20.193.110:0/3849931850 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fceb00035e0 con 0x7fcec4184b60 2026-02-13T20:11:32.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.912+0000 7fcec1573640 1 -- 10.20.193.110:0/3849931850 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2381962763 0 0) 0x7fceb00035e0 con 0x7fcec4184b60 2026-02-13T20:11:32.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.912+0000 7fcec1573640 1 -- 10.20.193.110:0/3849931850 >> v1:10.20.193.110:6790/0 conn(0x7fcec4089250 legacy=0x7fcec40580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:32.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.912+0000 7fcec1573640 1 -- 10.20.193.110:0/3849931850 >> v1:10.20.193.188:6789/0 conn(0x7fcec4057780 legacy=0x7fcec4183440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:32.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.912+0000 7fcec1573640 10 monclient: _finish_hunting 0 2026-02-13T20:11:32.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.912+0000 7fcec1573640 1 monclient: found mon.noname-a 2026-02-13T20:11:32.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.912+0000 7fcec1573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:32.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.912+0000 7fcec1573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:11:32.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.912+0000 7fcec1573640 1 -- 10.20.193.110:0/3849931850 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcec4089a50 con 0x7fcec4184b60 2026-02-13T20:11:32.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.912+0000 7fcec1573640 10 monclient: _finish_auth 0 2026-02-13T20:11:32.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.912+0000 7fcec1573640 10 monclient: _check_auth_tickets 2026-02-13T20:11:32.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.912+0000 7fcec1573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:32.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.912+0000 7fcec1573640 1 -- 10.20.193.110:0/3849931850 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fceb4003eb0 con 0x7fcec4184b60 2026-02-13T20:11:32.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.912+0000 7fcec1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:32.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.912+0000 7fcec1573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:11:32.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.912+0000 7fcec1573640 10 monclient: dump: 2026-02-13T20:11:32.945 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:32.945 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:32.945 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.945 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.945 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:32.945 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:32.945 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:32.945 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:32.945 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:32.945 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:32.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.912+0000 7fcec8a67640 5 monclient: authenticate success, global_id 4338 2026-02-13T20:11:32.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.912+0000 7fcec8a67640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:32.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.913+0000 7fcec1573640 1 -- 10.20.193.110:0/3849931850 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fceb4004170 con 0x7fcec4184b60 2026-02-13T20:11:32.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.913+0000 7fcec1573640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:32.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.913+0000 7fcec8a67640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:32.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.913+0000 7fcec8a67640 4 set_mon_vals no callback set 2026-02-13T20:11:32.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.913+0000 7fcec1573640 1 -- 10.20.193.110:0/3849931850 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fceb4004580 con 0x7fcec4184b60 2026-02-13T20:11:32.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.913+0000 7fcec1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:32.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.913+0000 7fcec1573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:32.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.913+0000 7fcec1573640 10 monclient: dump: 2026-02-13T20:11:32.945 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:32.946 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:32.946 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.946 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.946 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:32.946 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:32.946 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:32.946 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:32.946 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:32.946 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:32.946 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.913+0000 7fcec8a67640 10 monclient: shutdown 2026-02-13T20:11:32.946 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.913+0000 7fcec8a67640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:32.946 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.913+0000 7fcec8a67640 1 -- 10.20.193.110:0/3849931850 >> v1:10.20.193.110:6789/0 conn(0x7fcec4184b60 legacy=0x7fcec41a4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:32.946 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.913+0000 7fcec8a67640 1 -- 10.20.193.110:0/3849931850 shutdown_connections 2026-02-13T20:11:32.946 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.913+0000 7fcec8a67640 1 -- 10.20.193.110:0/3849931850 >> 10.20.193.110:0/3849931850 conn(0x7fcec4054330 msgr2=0x7fcec4054730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:32.946 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.913+0000 7fcec8a67640 1 -- 10.20.193.110:0/3849931850 shutdown_connections 2026-02-13T20:11:32.946 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.913+0000 7fcec8a67640 1 -- 10.20.193.110:0/3849931850 wait complete. 2026-02-13T20:11:32.946 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.913+0000 7fcec8a67640 10 monclient: build_initial_monmap 2026-02-13T20:11:32.946 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.913+0000 7fcec8a67640 10 monclient: monmap: 2026-02-13T20:11:32.946 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:32.946 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:32.946 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:11:32.946 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:11:32.946 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:32.946 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:11:32.946 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:32.946 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:32.946 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:32.946 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:32.946 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.913+0000 7fceee4cc640 10 monclient: get_monmap_and_config 2026-02-13T20:11:32.946 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.913+0000 7fceee4cc640 10 monclient: build_initial_monmap 2026-02-13T20:11:32.946 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.913+0000 7fceee4cc640 10 monclient: monmap: 2026-02-13T20:11:32.947 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:32.947 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:32.947 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:32.915145+0000 2026-02-13T20:11:32.947 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:32.915145+0000 2026-02-13T20:11:32.947 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:32.947 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:32.947 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:32.947 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:32.947 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:32.947 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:32.947 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.913+0000 7fcec8a67640 1 Processor -- start 2026-02-13T20:11:32.947 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.913+0000 7fcec8a67640 1 -- start start 2026-02-13T20:11:32.947 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.913+0000 7fcec8a67640 10 monclient: init 2026-02-13T20:11:32.947 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceee4cc640 1 Processor -- start 2026-02-13T20:11:32.947 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceee4cc640 1 -- start start 2026-02-13T20:11:32.947 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceee4cc640 10 monclient: init 2026-02-13T20:11:32.948 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fcec8a67640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:32.948 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fcec8a67640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:11:32.948 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fcec8a67640 10 monclient(hunting): picked mon.noname-a con 0x7fcec4057780 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:32.948 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fcec8a67640 10 monclient(hunting): picked mon.noname-b con 0x7fcec4089250 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:32.948 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fcec8a67640 10 monclient(hunting): picked mon.noname-c con 0x7fcec4184b60 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:32.948 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fcec8a67640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcec412b530 con 0x7fcec4057780 2026-02-13T20:11:32.948 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fcec8a67640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcec4062290 con 0x7fcec4089250 2026-02-13T20:11:32.948 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fcec8a67640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcec4111910 con 0x7fcec4184b60 2026-02-13T20:11:32.948 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fcec8a67640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:32.948 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fcec8a67640 10 monclient(hunting): authenticate will time out at 654.605286s 2026-02-13T20:11:32.948 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fcec2575640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fcec4057780 0x7fcec412ae20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:60116/0 (socket says 10.20.193.110:60116) 2026-02-13T20:11:32.948 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fcec2575640 1 -- 10.20.193.110:0/1843582890 learned_addr learned my addr 10.20.193.110:0/1843582890 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:32.948 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceee4cc640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:32.948 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceee4cc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:11:32.948 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceee4cc640 10 monclient(hunting): picked mon.noname-a con 0x7fcee8094040 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:32.948 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceee4cc640 10 monclient(hunting): picked mon.noname-b con 0x7fcee8094410 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:32.948 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceaaffd640 1 -- 10.20.193.110:0/1843582890 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2214628538 0 0) 0x7fcec412b530 con 0x7fcec4057780 2026-02-13T20:11:32.948 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceaaffd640 10 monclient(hunting): _negotiate 2026-02-13T20:11:32.948 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceaaffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:32.948 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceee4cc640 10 monclient(hunting): picked mon.noname-c con 0x7fcee8094870 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:32.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceaaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:32.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceaaffd640 10 monclient(hunting): my global_id is 4341 2026-02-13T20:11:32.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceee4cc640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcee8095450 con 0x7fcee8094040 2026-02-13T20:11:32.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceee4cc640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcee808a740 con 0x7fcee8094870 2026-02-13T20:11:32.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceaaffd640 1 -- 10.20.193.110:0/1843582890 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce900035e0 con 0x7fcec4057780 2026-02-13T20:11:32.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceaaffd640 1 -- 10.20.193.110:0/1843582890 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 215160035 0 0) 0x7fcec4111910 con 0x7fcec4184b60 2026-02-13T20:11:32.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceee4cc640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcee8093e70 con 0x7fcee8094410 2026-02-13T20:11:32.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceee4cc640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:32.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceee4cc640 10 monclient(hunting): authenticate will time out at 654.605513s 2026-02-13T20:11:32.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceaaffd640 10 monclient(hunting): _negotiate 2026-02-13T20:11:32.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceaaffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:32.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceaaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:32.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceaaffd640 10 monclient(hunting): my global_id is 4343 2026-02-13T20:11:32.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceaaffd640 1 -- 10.20.193.110:0/1843582890 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcec412b530 con 0x7fcec4184b60 2026-02-13T20:11:32.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fcee7fff640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fcee8094040 0x7fcee8093760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:60132/0 (socket says 10.20.193.110:60132) 2026-02-13T20:11:32.950 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fcee7fff640 1 -- 10.20.193.110:0/2220221484 learned_addr learned my addr 10.20.193.110:0/2220221484 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:32.950 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fcee77fe640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fcee8094410 0x7fcee8183410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:39840/0 (socket says 10.20.193.110:39840) 2026-02-13T20:11:32.950 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceaaffd640 1 -- 10.20.193.110:0/1843582890 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1365207293 0 0) 0x7fce900035e0 con 0x7fcec4057780 2026-02-13T20:11:32.950 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceaaffd640 1 -- 10.20.193.110:0/1843582890 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcec4111910 con 0x7fcec4057780 2026-02-13T20:11:32.950 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceaaffd640 1 -- 10.20.193.110:0/1843582890 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fceb80030e0 con 0x7fcec4057780 2026-02-13T20:11:32.950 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceaaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:32.950 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceaaffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:11:32.950 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceaaffd640 10 monclient(hunting): dump: 2026-02-13T20:11:32.950 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:32.950 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:32.950 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.950 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.950 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:32.950 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:32.950 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:32.950 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:32.950 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:32.950 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:32.950 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceaaffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:32.950 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceaaffd640 1 -- 10.20.193.110:0/1843582890 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3926836976 0 0) 0x7fcec412b530 con 0x7fcec4184b60 2026-02-13T20:11:32.950 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceaaffd640 1 -- 10.20.193.110:0/1843582890 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fce900035e0 con 0x7fcec4184b60 2026-02-13T20:11:32.950 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceaaffd640 1 -- 10.20.193.110:0/1843582890 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fceb40042e0 con 0x7fcec4184b60 2026-02-13T20:11:32.950 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceaaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:32.950 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fcee6ffd640 1 -- 10.20.193.110:0/2220221484 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 996640869 0 0) 0x7fcee8093e70 con 0x7fcee8094410 2026-02-13T20:11:32.950 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fcee6ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:11:32.950 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fcee6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:32.951 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fcee6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:32.951 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceaaffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:32.951 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceaaffd640 10 monclient(hunting): dump: 2026-02-13T20:11:32.951 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:32.951 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:32.951 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.951 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.951 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:32.951 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:32.951 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:32.951 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:32.951 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:32.951 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:32.951 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fcee6ffd640 10 monclient(hunting): my global_id is 4346 2026-02-13T20:11:32.951 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fcee6ffd640 1 -- 10.20.193.110:0/2220221484 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcecc0035e0 con 0x7fcee8094410 2026-02-13T20:11:32.951 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fcee6ffd640 1 -- 10.20.193.110:0/2220221484 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2148351717 0 0) 0x7fcee8095450 con 0x7fcee8094040 2026-02-13T20:11:32.951 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fcee6ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:11:32.951 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fcee6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:32.951 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fcee6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:32.951 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fcee6ffd640 10 monclient(hunting): my global_id is 4344 2026-02-13T20:11:32.951 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fcee6ffd640 1 -- 10.20.193.110:0/2220221484 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcee8093e70 con 0x7fcee8094040 2026-02-13T20:11:32.952 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceaaffd640 1 -- 10.20.193.110:0/1843582890 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4069162862 0 0) 0x7fcec4111910 con 0x7fcec4057780 2026-02-13T20:11:32.952 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceaaffd640 1 -- 10.20.193.110:0/1843582890 >> v1:10.20.193.110:6790/0 conn(0x7fcec4184b60 legacy=0x7fcec4173900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:32.952 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceaaffd640 1 -- 10.20.193.110:0/1843582890 >> v1:10.20.193.188:6789/0 conn(0x7fcec4089250 legacy=0x7fcec41721e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:32.952 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceaaffd640 10 monclient: _finish_hunting 0 2026-02-13T20:11:32.952 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceaaffd640 1 monclient: found mon.a 2026-02-13T20:11:32.952 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceaaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:32.952 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceaaffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:32.952 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceaaffd640 1 -- 10.20.193.110:0/1843582890 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcec4110420 con 0x7fcec4057780 2026-02-13T20:11:32.952 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceaaffd640 10 monclient: _finish_auth 0 2026-02-13T20:11:32.952 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceaaffd640 10 monclient: _check_auth_tickets 2026-02-13T20:11:32.952 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceaaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:32.952 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fcec8a67640 5 monclient: authenticate success, global_id 4341 2026-02-13T20:11:32.952 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fcec8a67640 10 monclient: _renew_subs 2026-02-13T20:11:32.952 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fcec8a67640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:32.952 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fcec8a67640 1 -- 10.20.193.110:0/1843582890 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fcec4112780 con 0x7fcec4057780 2026-02-13T20:11:32.952 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fcee6ffd640 1 -- 10.20.193.110:0/2220221484 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4113182129 0 0) 0x7fcecc0035e0 con 0x7fcee8094410 2026-02-13T20:11:32.952 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fcee6ffd640 1 -- 10.20.193.110:0/2220221484 >> v1:10.20.193.188:6789/0 conn(0x7fcee8094870 legacy=0x7fcee81a4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:32.952 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fcee6ffd640 1 -- 10.20.193.110:0/2220221484 >> v1:10.20.193.110:6789/0 conn(0x7fcee8094040 legacy=0x7fcee8093760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:32.952 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fcee6ffd640 10 monclient: _finish_hunting 0 2026-02-13T20:11:32.952 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fcee6ffd640 1 monclient: found mon.noname-b 2026-02-13T20:11:32.952 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fcee6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:32.952 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fcee6ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:11:32.952 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fcee6ffd640 1 -- 10.20.193.110:0/2220221484 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcee808a180 con 0x7fcee8094410 2026-02-13T20:11:32.952 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fcee6ffd640 10 monclient: _finish_auth 0 2026-02-13T20:11:32.952 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fcee6ffd640 10 monclient: _check_auth_tickets 2026-02-13T20:11:32.952 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fcee6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:32.952 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fcee6ffd640 1 -- 10.20.193.110:0/2220221484 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fced8002dd0 con 0x7fcee8094410 2026-02-13T20:11:32.952 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fcee6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:32.952 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fcee6ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:11:32.953 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fcee6ffd640 10 monclient: dump: 2026-02-13T20:11:32.953 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:32.953 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:32.953 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.953 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.953 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:32.953 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:32.953 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:32.953 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:32.953 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:32.953 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:32.953 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceee4cc640 5 monclient: authenticate success, global_id 4346 2026-02-13T20:11:32.953 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fceee4cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:32.953 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fcec8a67640 10 monclient: _renew_subs 2026-02-13T20:11:32.953 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fcec8a67640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:32.953 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.914+0000 7fcec8a67640 1 -- 10.20.193.110:0/1843582890 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fcec4110f80 con 0x7fcec4057780 2026-02-13T20:11:32.953 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.915+0000 7fcee6ffd640 1 -- 10.20.193.110:0/2220221484 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fced8003090 con 0x7fcee8094410 2026-02-13T20:11:32.953 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.915+0000 7fcee6ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:32.953 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.915+0000 7fcee6ffd640 1 -- 10.20.193.110:0/2220221484 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fced80034a0 con 0x7fcee8094410 2026-02-13T20:11:32.953 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.915+0000 7fcee6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:32.953 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.915+0000 7fcee6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:32.953 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.915+0000 7fcee6ffd640 10 monclient: dump: 2026-02-13T20:11:32.953 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:32.953 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:32.953 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.953 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.953 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:32.953 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:32.953 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:32.953 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:32.953 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:32.954 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:32.954 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.915+0000 7fceee4cc640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:32.954 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.915+0000 7fceee4cc640 4 set_mon_vals no callback set 2026-02-13T20:11:32.954 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.915+0000 7fceaaffd640 1 -- 10.20.193.110:0/1843582890 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fceb8003450 con 0x7fcec4057780 2026-02-13T20:11:32.954 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.915+0000 7fceaaffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:32.954 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.915+0000 7fceaaffd640 1 -- 10.20.193.110:0/1843582890 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fceb8003b30 con 0x7fcec4057780 2026-02-13T20:11:32.954 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.915+0000 7fceaaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:32.954 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.915+0000 7fceaaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:32.954 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.915+0000 7fcec0d72640 4 set_mon_vals no callback set 2026-02-13T20:11:32.954 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.915+0000 7fceaaffd640 10 monclient: dump: 2026-02-13T20:11:32.954 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:32.954 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:32.954 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.954 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.954 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:32.954 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:32.954 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:32.954 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:32.954 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:32.954 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:32.954 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.915+0000 7fceee4cc640 10 monclient: shutdown 2026-02-13T20:11:32.954 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.915+0000 7fceee4cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:32.954 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.915+0000 7fceee4cc640 1 -- 10.20.193.110:0/2220221484 >> v1:10.20.193.110:6790/0 conn(0x7fcee8094410 legacy=0x7fcee8183410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:32.954 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.915+0000 7fceee4cc640 1 -- 10.20.193.110:0/2220221484 shutdown_connections 2026-02-13T20:11:32.955 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.915+0000 7fceee4cc640 1 -- 10.20.193.110:0/2220221484 >> 10.20.193.110:0/2220221484 conn(0x7fcee8054330 msgr2=0x7fcee8054730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:32.955 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.915+0000 7fceee4cc640 1 -- 10.20.193.110:0/2220221484 shutdown_connections 2026-02-13T20:11:32.955 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.915+0000 7fceee4cc640 1 -- 10.20.193.110:0/2220221484 wait complete. 2026-02-13T20:11:32.955 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.915+0000 7fceaaffd640 1 -- 10.20.193.110:0/1843582890 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fceb8003c90 con 0x7fcec4057780 2026-02-13T20:11:32.955 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.915+0000 7fcec8a67640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:32.955 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.915+0000 7fcec8a67640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:32.955 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.915+0000 7fcec8a67640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:32.955 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.915+0000 7fcec8a67640 1 -- 10.20.193.110:0/1843582890 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcec4089030 con 0x7fcec4057780 2026-02-13T20:11:32.955 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.915+0000 7fceaaffd640 1 -- 10.20.193.110:0/1843582890 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 3531+0+0 (unknown 315507976 0 0) 0x7fceb804e7e0 con 0x7fcec4057780 2026-02-13T20:11:32.955 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.915+0000 7fceee4cc640 10 monclient: build_initial_monmap 2026-02-13T20:11:32.955 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.915+0000 7fceee4cc640 10 monclient: monmap: 2026-02-13T20:11:32.955 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:32.955 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:32.955 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:11:32.955 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:11:32.955 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:32.955 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:11:32.955 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:32.955 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:32.955 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:32.955 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:32.955 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.916+0000 7fcec1d74640 10 monclient: get_auth_request con 0x7fce9003f980 auth_method 0 2026-02-13T20:11:32.956 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.916+0000 7fceee4cc640 1 Processor -- start 2026-02-13T20:11:32.956 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.916+0000 7fceee4cc640 1 -- start start 2026-02-13T20:11:32.956 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.916+0000 7fceee4cc640 10 monclient: init 2026-02-13T20:11:32.956 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.916+0000 7fceee4cc640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:32.956 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.916+0000 7fceee4cc640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:11:32.956 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.916+0000 7fceee4cc640 10 monclient(hunting): picked mon.noname-c con 0x7fcee8094040 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:32.956 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.916+0000 7fceee4cc640 10 monclient(hunting): picked mon.noname-a con 0x7fcee8094410 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:32.956 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.916+0000 7fceee4cc640 10 monclient(hunting): picked mon.noname-b con 0x7fcee8094870 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:32.956 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.916+0000 7fceee4cc640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcee80621e0 con 0x7fcee8094410 2026-02-13T20:11:32.956 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.916+0000 7fceee4cc640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcee81aaa00 con 0x7fcee8094870 2026-02-13T20:11:32.956 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.916+0000 7fceee4cc640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcee81a7aa0 con 0x7fcee8094040 2026-02-13T20:11:32.956 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.916+0000 7fceee4cc640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:32.956 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.916+0000 7fceee4cc640 10 monclient(hunting): authenticate will time out at 654.607426s 2026-02-13T20:11:32.956 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.916+0000 7fcee7fff640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fcee8094040 0x7fcee81a6c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:39844/0 (socket says 10.20.193.110:39844) 2026-02-13T20:11:32.956 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.916+0000 7fcee7fff640 1 -- 10.20.193.110:0/2590083447 learned_addr learned my addr 10.20.193.110:0/2590083447 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:32.957 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.916+0000 7fcee4ff9640 1 -- 10.20.193.110:0/2590083447 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 35394096 0 0) 0x7fcee81a7aa0 con 0x7fcee8094040 2026-02-13T20:11:32.957 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.916+0000 7fcee4ff9640 10 monclient(hunting): _negotiate 2026-02-13T20:11:32.957 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.916+0000 7fcee4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:32.957 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.916+0000 7fcee4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:32.957 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.916+0000 7fcee4ff9640 10 monclient(hunting): my global_id is 4349 2026-02-13T20:11:32.957 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.916+0000 7fcee4ff9640 1 -- 10.20.193.110:0/2590083447 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fceb80035e0 con 0x7fcee8094040 2026-02-13T20:11:32.957 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.917+0000 7fcee4ff9640 1 -- 10.20.193.110:0/2590083447 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 29330104 0 0) 0x7fcee81aaa00 con 0x7fcee8094870 2026-02-13T20:11:32.957 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.917+0000 7fcee4ff9640 10 monclient(hunting): _negotiate 2026-02-13T20:11:32.957 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.917+0000 7fcee4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:32.957 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.917+0000 7fcee4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:32.957 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.917+0000 7fcee4ff9640 10 monclient(hunting): my global_id is 4339 2026-02-13T20:11:32.957 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.917+0000 7fcee4ff9640 1 -- 10.20.193.110:0/2590083447 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcee81a7aa0 con 0x7fcee8094870 2026-02-13T20:11:32.957 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.917+0000 7fcee4ff9640 1 -- 10.20.193.110:0/2590083447 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1510109287 0 0) 0x7fceb80035e0 con 0x7fcee8094040 2026-02-13T20:11:32.957 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.917+0000 7fcee4ff9640 1 -- 10.20.193.110:0/2590083447 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcee81aaa00 con 0x7fcee8094040 2026-02-13T20:11:32.957 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.917+0000 7fcee4ff9640 1 -- 10.20.193.110:0/2590083447 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fced4003090 con 0x7fcee8094040 2026-02-13T20:11:32.957 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.917+0000 7fcee4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:32.957 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.917+0000 7fcee4ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:11:32.957 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.917+0000 7fcee4ff9640 10 monclient(hunting): dump: 2026-02-13T20:11:32.957 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:32.957 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:32.957 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.957 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.957 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:32.957 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:32.957 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:32.957 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:32.957 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:32.957 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:32.957 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.917+0000 7fcee4ff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:32.957 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.917+0000 7fcee4ff9640 1 -- 10.20.193.110:0/2590083447 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1646103105 0 0) 0x7fcee81a7aa0 con 0x7fcee8094870 2026-02-13T20:11:32.957 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.917+0000 7fcee4ff9640 1 -- 10.20.193.110:0/2590083447 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fceb80035e0 con 0x7fcee8094870 2026-02-13T20:11:32.957 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.917+0000 7fcee4ff9640 1 -- 10.20.193.110:0/2590083447 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fcedc004050 con 0x7fcee8094870 2026-02-13T20:11:32.957 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.917+0000 7fcee4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:32.957 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.917+0000 7fcee4ff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-13T20:11:32.957 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.917+0000 7fcee4ff9640 10 monclient(hunting): dump: 2026-02-13T20:11:32.957 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:32.957 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:32.957 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.957 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.957 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:32.957 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:32.957 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:32.957 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:32.958 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:32.958 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:32.958 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.917+0000 7fcee4ff9640 1 -- 10.20.193.110:0/2590083447 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4113873280 0 0) 0x7fcee81aaa00 con 0x7fcee8094040 2026-02-13T20:11:32.958 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.917+0000 7fcee4ff9640 1 -- 10.20.193.110:0/2590083447 >> v1:10.20.193.188:6789/0 conn(0x7fcee8094870 legacy=0x7fcee823bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:32.958 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.917+0000 7fcee4ff9640 1 -- 10.20.193.110:0/2590083447 >> v1:10.20.193.110:6789/0 conn(0x7fcee8094410 legacy=0x7fcee81a7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:32.958 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.917+0000 7fcee4ff9640 10 monclient: _finish_hunting 0 2026-02-13T20:11:32.958 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.917+0000 7fcee4ff9640 1 monclient: found mon.c 2026-02-13T20:11:32.958 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.917+0000 7fcee4ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:32.958 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.917+0000 7fcee4ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:32.958 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.917+0000 7fcee4ff9640 1 -- 10.20.193.110:0/2590083447 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcee8093180 con 0x7fcee8094040 2026-02-13T20:11:32.958 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.917+0000 7fcee4ff9640 10 monclient: _finish_auth 0 2026-02-13T20:11:32.958 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.917+0000 7fcee4ff9640 10 monclient: _check_auth_tickets 2026-02-13T20:11:32.958 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.917+0000 7fcee4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:32.958 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.917+0000 7fceee4cc640 5 monclient: authenticate success, global_id 4349 2026-02-13T20:11:32.958 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.917+0000 7fceee4cc640 10 monclient: _renew_subs 2026-02-13T20:11:32.958 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.917+0000 7fceee4cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:32.958 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.917+0000 7fceee4cc640 1 -- 10.20.193.110:0/2590083447 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fcee81a9b90 con 0x7fcee8094040 2026-02-13T20:11:32.958 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.917+0000 7fceee4cc640 10 monclient: _renew_subs 2026-02-13T20:11:32.958 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.917+0000 7fceee4cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:32.958 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.917+0000 7fceee4cc640 1 -- 10.20.193.110:0/2590083447 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fcee81ac260 con 0x7fcee8094040 2026-02-13T20:11:32.958 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.917+0000 7fcee4ff9640 1 -- 10.20.193.110:0/2590083447 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fced40048a0 con 0x7fcee8094040 2026-02-13T20:11:32.958 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.917+0000 7fcee4ff9640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:32.958 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.917+0000 7fcee4ff9640 1 -- 10.20.193.110:0/2590083447 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fced4004bc0 con 0x7fcee8094040 2026-02-13T20:11:32.958 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.917+0000 7fcee4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:32.958 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.917+0000 7fcee4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:32.958 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.917+0000 7fcee4ff9640 10 monclient: dump: 2026-02-13T20:11:32.958 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:32.958 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:32.958 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.958 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.958 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:32.958 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:32.958 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:32.958 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:32.958 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:32.958 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:32.958 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.917+0000 7fcee67fc640 4 set_mon_vals no callback set 2026-02-13T20:11:32.958 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.917+0000 7fcee4ff9640 1 -- 10.20.193.110:0/2590083447 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fced4011830 con 0x7fcee8094040 2026-02-13T20:11:32.958 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.918+0000 7fceaaffd640 1 -- 10.20.193.110:0/1843582890 <== mon.0 v1:10.20.193.110:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fceb8003f70 con 0x7fcec4057780 2026-02-13T20:11:32.958 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.918+0000 7fceaaffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:32.959 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.918+0000 7fceaaffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:11:32.959 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.918+0000 7fceee4cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:32.959 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.918+0000 7fceee4cc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:32.959 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.918+0000 7fceee4cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:32.959 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.918+0000 7fceee4cc640 1 -- 10.20.193.110:0/2590083447 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcee808e6e0 con 0x7fcee8094040 2026-02-13T20:11:32.959 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.918+0000 7fcee4ff9640 1 -- 10.20.193.110:0/2590083447 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 3531+0+0 (unknown 315507976 0 0) 0x7fced404e6e0 con 0x7fcee8094040 2026-02-13T20:11:32.959 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.918+0000 7fcee77fe640 10 monclient: get_auth_request con 0x7fceb803faa0 auth_method 0 2026-02-13T20:11:32.959 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.922+0000 7fcee4ff9640 1 -- 10.20.193.110:0/2590083447 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fced4017070 con 0x7fcee8094040 2026-02-13T20:11:32.959 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.922+0000 7fcee4ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:32.959 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.922+0000 7fcee4ff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:11:32.961 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.934+0000 7f9d9d452640 10 monclient: get_monmap_and_config 2026-02-13T20:11:32.961 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.934+0000 7f9d9d452640 10 monclient: build_initial_monmap 2026-02-13T20:11:32.961 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.934+0000 7f9d9d452640 10 monclient: monmap: 2026-02-13T20:11:32.961 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:32.961 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:32.961 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:32.936382+0000 2026-02-13T20:11:32.961 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:32.936382+0000 2026-02-13T20:11:32.961 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:32.961 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:32.961 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:32.961 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:32.961 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:32.961 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:32.961 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.935+0000 7f9d9d452640 1 Processor -- start 2026-02-13T20:11:32.961 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.935+0000 7f9d9d452640 1 -- start start 2026-02-13T20:11:32.961 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.935+0000 7f9d9d452640 10 monclient: init 2026-02-13T20:11:32.961 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.935+0000 7f9d9d452640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:32.961 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.935+0000 7f9d9d452640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:11:32.961 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.935+0000 7f9d9d452640 10 monclient(hunting): picked mon.noname-c con 0x7f9d981401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:32.961 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.935+0000 7f9d9d452640 10 monclient(hunting): picked mon.noname-a con 0x7f9d98092020 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:32.961 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.935+0000 7f9d9d452640 10 monclient(hunting): picked mon.noname-b con 0x7f9d98091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:32.961 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.935+0000 7f9d9d452640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d9808b730 con 0x7f9d98092020 2026-02-13T20:11:32.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.935+0000 7f9d9d452640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d9805c5b0 con 0x7f9d981401c0 2026-02-13T20:11:32.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.935+0000 7f9d9d452640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d9808bcf0 con 0x7f9d98091950 2026-02-13T20:11:32.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.935+0000 7f9d9d452640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:32.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.935+0000 7f9d9d452640 10 monclient(hunting): authenticate will time out at 654.626872s 2026-02-13T20:11:32.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.935+0000 7f9d967fc640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f9d98092020 0x7f9d981812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:60144/0 (socket says 10.20.193.110:60144) 2026-02-13T20:11:32.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.935+0000 7f9d967fc640 1 -- 10.20.193.110:0/990918090 learned_addr learned my addr 10.20.193.110:0/990918090 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:32.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.936+0000 7f9d95ffb640 1 -- 10.20.193.110:0/990918090 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2972764381 0 0) 0x7f9d9808bcf0 con 0x7f9d98091950 2026-02-13T20:11:32.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.936+0000 7f9d95ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:11:32.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.936+0000 7f9d95ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:32.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.936+0000 7f9d95ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:32.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.936+0000 7f9d95ffb640 10 monclient(hunting): my global_id is 4352 2026-02-13T20:11:32.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.936+0000 7f9d95ffb640 1 -- 10.20.193.110:0/990918090 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d840035e0 con 0x7f9d98091950 2026-02-13T20:11:32.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.936+0000 7f9d95ffb640 1 -- 10.20.193.110:0/990918090 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2892281051 0 0) 0x7f9d9808b730 con 0x7f9d98092020 2026-02-13T20:11:32.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.936+0000 7f9d95ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:11:32.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.936+0000 7f9d95ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:32.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.936+0000 7f9d95ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:32.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.936+0000 7f9d95ffb640 10 monclient(hunting): my global_id is 4347 2026-02-13T20:11:32.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.936+0000 7f9d95ffb640 1 -- 10.20.193.110:0/990918090 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d9808bcf0 con 0x7f9d98092020 2026-02-13T20:11:32.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.936+0000 7f9d95ffb640 1 -- 10.20.193.110:0/990918090 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3509263409 0 0) 0x7f9d9805c5b0 con 0x7f9d981401c0 2026-02-13T20:11:32.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.936+0000 7f9d95ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:11:32.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.936+0000 7f9d95ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:32.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.936+0000 7f9d95ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:32.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.936+0000 7f9d95ffb640 10 monclient(hunting): my global_id is 4342 2026-02-13T20:11:32.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.936+0000 7f9d95ffb640 1 -- 10.20.193.110:0/990918090 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d9808b730 con 0x7f9d981401c0 2026-02-13T20:11:32.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.936+0000 7f9d95ffb640 1 -- 10.20.193.110:0/990918090 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1575757898 0 0) 0x7f9d840035e0 con 0x7f9d98091950 2026-02-13T20:11:32.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.936+0000 7f9d95ffb640 1 -- 10.20.193.110:0/990918090 >> v1:10.20.193.188:6789/0 conn(0x7f9d981401c0 legacy=0x7f9d98091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:32.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.936+0000 7f9d95ffb640 1 -- 10.20.193.110:0/990918090 >> v1:10.20.193.110:6789/0 conn(0x7f9d98092020 legacy=0x7f9d981812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:32.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.936+0000 7f9d95ffb640 10 monclient: _finish_hunting 0 2026-02-13T20:11:32.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.936+0000 7f9d95ffb640 1 monclient: found mon.noname-b 2026-02-13T20:11:32.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.936+0000 7f9d95ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:32.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.936+0000 7f9d95ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:11:32.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.936+0000 7f9d95ffb640 1 -- 10.20.193.110:0/990918090 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d98140590 con 0x7f9d98091950 2026-02-13T20:11:32.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.936+0000 7f9d95ffb640 10 monclient: _finish_auth 0 2026-02-13T20:11:32.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.936+0000 7f9d95ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:11:32.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.936+0000 7f9d95ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:32.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.936+0000 7f9d95ffb640 1 -- 10.20.193.110:0/990918090 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f9d88003eb0 con 0x7f9d98091950 2026-02-13T20:11:32.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.936+0000 7f9d95ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:32.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.936+0000 7f9d95ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:11:32.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.936+0000 7f9d95ffb640 10 monclient: dump: 2026-02-13T20:11:32.962 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:32.962 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:32.962 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.963 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.963 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:32.963 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:32.963 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:32.963 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:32.963 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:32.963 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:32.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.936+0000 7f9d9d452640 5 monclient: authenticate success, global_id 4352 2026-02-13T20:11:32.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.936+0000 7f9d9d452640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:32.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.936+0000 7f9d95ffb640 1 -- 10.20.193.110:0/990918090 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9d880040c0 con 0x7f9d98091950 2026-02-13T20:11:32.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.936+0000 7f9d95ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:32.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.936+0000 7f9d95ffb640 1 -- 10.20.193.110:0/990918090 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f9d880044a0 con 0x7f9d98091950 2026-02-13T20:11:32.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.936+0000 7f9d95ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:32.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.936+0000 7f9d95ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:32.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.936+0000 7f9d95ffb640 10 monclient: dump: 2026-02-13T20:11:32.963 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:32.963 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:32.963 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.963 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.963 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:32.963 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:32.963 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:32.963 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:32.963 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:32.963 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:32.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.936+0000 7f9d9d452640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:32.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.936+0000 7f9d9d452640 4 set_mon_vals no callback set 2026-02-13T20:11:32.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.936+0000 7f9d9d452640 10 monclient: shutdown 2026-02-13T20:11:32.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.936+0000 7f9d9d452640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:32.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.936+0000 7f9d9d452640 1 -- 10.20.193.110:0/990918090 >> v1:10.20.193.110:6790/0 conn(0x7f9d98091950 legacy=0x7f9d981a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:32.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.936+0000 7f9d9d452640 1 -- 10.20.193.110:0/990918090 shutdown_connections 2026-02-13T20:11:32.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.936+0000 7f9d9d452640 1 -- 10.20.193.110:0/990918090 >> 10.20.193.110:0/990918090 conn(0x7f9d98054e90 msgr2=0x7f9d98058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:32.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.936+0000 7f9d9d452640 1 -- 10.20.193.110:0/990918090 shutdown_connections 2026-02-13T20:11:32.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.937+0000 7f9d9d452640 1 -- 10.20.193.110:0/990918090 wait complete. 2026-02-13T20:11:32.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.937+0000 7f9d9d452640 10 monclient: build_initial_monmap 2026-02-13T20:11:32.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.937+0000 7f9d9d452640 10 monclient: monmap: 2026-02-13T20:11:32.963 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:32.963 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:32.963 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:11:32.964 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:11:32.964 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:32.964 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:11:32.964 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:32.964 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:32.964 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:32.964 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:32.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.937+0000 7f9d9d452640 1 Processor -- start 2026-02-13T20:11:32.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.937+0000 7f9d9d452640 1 -- start start 2026-02-13T20:11:32.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.937+0000 7f9d9d452640 10 monclient: init 2026-02-13T20:11:32.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.937+0000 7f9d9d452640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:32.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.937+0000 7f9d9d452640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:11:32.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.937+0000 7f9d9d452640 10 monclient(hunting): picked mon.noname-a con 0x7f9d98091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:32.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.937+0000 7f9d9d452640 10 monclient(hunting): picked mon.noname-c con 0x7f9d981401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:32.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.937+0000 7f9d9d452640 10 monclient(hunting): picked mon.noname-b con 0x7f9d98089770 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:32.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.937+0000 7f9d9d452640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d98131e80 con 0x7f9d98091950 2026-02-13T20:11:32.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.937+0000 7f9d9d452640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d98132160 con 0x7f9d98089770 2026-02-13T20:11:32.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.937+0000 7f9d9d452640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d9808c310 con 0x7f9d981401c0 2026-02-13T20:11:32.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.937+0000 7f9d9d452640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:32.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.937+0000 7f9d9d452640 10 monclient(hunting): authenticate will time out at 654.628877s 2026-02-13T20:11:32.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.937+0000 7f9d967fc640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f9d981401c0 0x7f9d981938b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:39848/0 (socket says 10.20.193.110:39848) 2026-02-13T20:11:32.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.937+0000 7f9d967fc640 1 -- 10.20.193.110:0/4259256566 learned_addr learned my addr 10.20.193.110:0/4259256566 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:32.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d777fe640 1 -- 10.20.193.110:0/4259256566 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1294844225 0 0) 0x7f9d9808c310 con 0x7f9d981401c0 2026-02-13T20:11:32.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d777fe640 10 monclient(hunting): _negotiate 2026-02-13T20:11:32.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d777fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:32.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d777fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:32.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d777fe640 10 monclient(hunting): my global_id is 4355 2026-02-13T20:11:32.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d777fe640 1 -- 10.20.193.110:0/4259256566 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d640035e0 con 0x7f9d981401c0 2026-02-13T20:11:32.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d777fe640 1 -- 10.20.193.110:0/4259256566 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3448481198 0 0) 0x7f9d98131e80 con 0x7f9d98091950 2026-02-13T20:11:32.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d777fe640 10 monclient(hunting): _negotiate 2026-02-13T20:11:32.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d777fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:32.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d777fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:32.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d777fe640 10 monclient(hunting): my global_id is 4350 2026-02-13T20:11:32.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d777fe640 1 -- 10.20.193.110:0/4259256566 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d9808c310 con 0x7f9d98091950 2026-02-13T20:11:32.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d777fe640 1 -- 10.20.193.110:0/4259256566 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4005573380 0 0) 0x7f9d640035e0 con 0x7f9d981401c0 2026-02-13T20:11:32.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d777fe640 1 -- 10.20.193.110:0/4259256566 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9d98131e80 con 0x7f9d981401c0 2026-02-13T20:11:32.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d777fe640 1 -- 10.20.193.110:0/4259256566 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f9d800031f0 con 0x7f9d981401c0 2026-02-13T20:11:32.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d777fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:32.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d777fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:11:32.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d777fe640 10 monclient(hunting): dump: 2026-02-13T20:11:32.964 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:32.964 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:32.964 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.965 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.965 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:32.965 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:32.965 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:32.965 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:32.965 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:32.965 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:32.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d777fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:32.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d777fe640 1 -- 10.20.193.110:0/4259256566 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1732648670 0 0) 0x7f9d9808c310 con 0x7f9d98091950 2026-02-13T20:11:32.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d777fe640 1 -- 10.20.193.110:0/4259256566 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9d640035e0 con 0x7f9d98091950 2026-02-13T20:11:32.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d777fe640 1 -- 10.20.193.110:0/4259256566 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f9d8c003040 con 0x7f9d98091950 2026-02-13T20:11:32.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d777fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:32.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d777fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:32.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d777fe640 10 monclient(hunting): dump: 2026-02-13T20:11:32.965 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:32.965 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:32.965 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.965 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.965 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:32.965 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:32.965 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:32.965 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:32.965 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:32.965 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:32.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d777fe640 1 -- 10.20.193.110:0/4259256566 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2475765829 0 0) 0x7f9d98132160 con 0x7f9d98089770 2026-02-13T20:11:32.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d777fe640 10 monclient(hunting): _negotiate 2026-02-13T20:11:32.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d777fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:32.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d777fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:32.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d777fe640 10 monclient(hunting): my global_id is 4345 2026-02-13T20:11:32.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d777fe640 1 -- 10.20.193.110:0/4259256566 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d9808c310 con 0x7f9d98089770 2026-02-13T20:11:32.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d777fe640 1 -- 10.20.193.110:0/4259256566 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3152132544 0 0) 0x7f9d98131e80 con 0x7f9d981401c0 2026-02-13T20:11:32.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d777fe640 1 -- 10.20.193.110:0/4259256566 >> v1:10.20.193.188:6789/0 conn(0x7f9d98089770 legacy=0x7f9d98194fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:32.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d777fe640 1 -- 10.20.193.110:0/4259256566 >> v1:10.20.193.110:6789/0 conn(0x7f9d98091950 legacy=0x7f9d98089060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:32.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d777fe640 10 monclient: _finish_hunting 0 2026-02-13T20:11:32.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d777fe640 1 monclient: found mon.c 2026-02-13T20:11:32.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d777fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:32.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d777fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:32.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d777fe640 1 -- 10.20.193.110:0/4259256566 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d9805d320 con 0x7f9d981401c0 2026-02-13T20:11:32.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d777fe640 10 monclient: _finish_auth 0 2026-02-13T20:11:32.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d777fe640 10 monclient: _check_auth_tickets 2026-02-13T20:11:32.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d777fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:32.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d9d452640 5 monclient: authenticate success, global_id 4355 2026-02-13T20:11:32.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d9d452640 10 monclient: _renew_subs 2026-02-13T20:11:32.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d9d452640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:32.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d9d452640 1 -- 10.20.193.110:0/4259256566 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9d98130960 con 0x7f9d981401c0 2026-02-13T20:11:32.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d9d452640 10 monclient: _renew_subs 2026-02-13T20:11:32.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d9d452640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:32.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d9d452640 1 -- 10.20.193.110:0/4259256566 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f9d9813f0d0 con 0x7f9d981401c0 2026-02-13T20:11:32.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d777fe640 1 -- 10.20.193.110:0/4259256566 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9d800048a0 con 0x7f9d981401c0 2026-02-13T20:11:32.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d777fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:32.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d777fe640 1 -- 10.20.193.110:0/4259256566 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f9d80004bc0 con 0x7f9d981401c0 2026-02-13T20:11:32.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d777fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:32.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d777fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:32.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d957fa640 4 set_mon_vals no callback set 2026-02-13T20:11:32.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.938+0000 7f9d777fe640 10 monclient: dump: 2026-02-13T20:11:32.966 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:32.966 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:32.966 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.966 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:32.966 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:32.966 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:32.966 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:32.966 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:32.966 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:32.966 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:32.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.939+0000 7f9d9d452640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:32.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.939+0000 7f9d9d452640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:32.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.939+0000 7f9d9d452640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:32.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.939+0000 7f9d9d452640 1 -- 10.20.193.110:0/4259256566 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d98055bb0 con 0x7f9d981401c0 2026-02-13T20:11:32.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.939+0000 7f9d777fe640 1 -- 10.20.193.110:0/4259256566 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f9d80011830 con 0x7f9d981401c0 2026-02-13T20:11:32.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.939+0000 7f9d777fe640 1 -- 10.20.193.110:0/4259256566 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 3531+0+0 (unknown 315507976 0 0) 0x7f9d8004e7f0 con 0x7f9d981401c0 2026-02-13T20:11:32.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.939+0000 7f9d96ffd640 10 monclient: get_auth_request con 0x7f9d6403fbd0 auth_method 0 2026-02-13T20:11:32.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.941+0000 7f9d777fe640 1 -- 10.20.193.110:0/4259256566 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f9d800170c0 con 0x7f9d981401c0 2026-02-13T20:11:32.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.941+0000 7f9d777fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:32.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.941+0000 7f9d777fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:11:32.986 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.984+0000 7fb41ee3e640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-13T20:11:32.986 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.984+0000 7fb41ee3e640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-13T20:11:32.986 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.984+0000 7fb41ee3e640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:32.986 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.984+0000 7fb41ee3e640 1 -- 10.20.193.110:0/334270931 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fb4181a1530 con 0x7fb418089250 2026-02-13T20:11:32.986 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.984+0000 7fb40d7fa640 1 -- 10.20.193.110:0/334270931 <== mon.2 v1:10.20.193.110:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (unknown 1823589948 0 847495621) 0x7fb400016670 con 0x7fb418089250 2026-02-13T20:11:32.986 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.984+0000 7fb40d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-13T20:11:32.986 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.984+0000 7fb40d7fa640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:11:32.986 INFO:teuthology.orchestra.run.trial110.stdout:47244640259 2026-02-13T20:11:32.987 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.985+0000 7f47f330c640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-13T20:11:32.987 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.985+0000 7f47f330c640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-13T20:11:32.987 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.985+0000 7f47f330c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:32.987 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.985+0000 7f47f330c640 1 -- 10.20.193.110:0/2865868874 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f47ec141a40 con 0x7f47ec05c540 2026-02-13T20:11:32.987 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.986+0000 7f47d9ffb640 1 -- 10.20.193.110:0/2865868874 <== mon.0 v1:10.20.193.110:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (unknown 2131975755 0 847495621) 0x7f47ec141a40 con 0x7f47ec05c540 2026-02-13T20:11:32.987 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.986+0000 7f47d9ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-13T20:11:32.988 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.986+0000 7f47d9ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:11:32.988 INFO:teuthology.orchestra.run.trial110.stdout:47244640259 2026-02-13T20:11:32.989 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.987+0000 7fb41ee3e640 1 -- 10.20.193.110:0/334270931 >> v1:10.20.193.188:6812/1623052694 conn(0x7fb3e803faa0 legacy=0x7fb3e805ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:32.989 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.987+0000 7fb41ee3e640 10 monclient: shutdown 2026-02-13T20:11:32.989 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.987+0000 7fb41ee3e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:32.989 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.987+0000 7fb41ee3e640 1 -- 10.20.193.110:0/334270931 >> v1:10.20.193.110:6790/0 conn(0x7fb418089250 legacy=0x7fb4181a2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:32.989 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.987+0000 7fb41ee3e640 1 -- 10.20.193.110:0/334270931 shutdown_connections 2026-02-13T20:11:32.989 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.987+0000 7fb41ee3e640 1 -- 10.20.193.110:0/334270931 >> 10.20.193.110:0/334270931 conn(0x7fb418054330 msgr2=0x7fb4181a0660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:32.989 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.987+0000 7fb41ee3e640 1 -- 10.20.193.110:0/334270931 shutdown_connections 2026-02-13T20:11:32.989 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.987+0000 7fb41ee3e640 1 -- 10.20.193.110:0/334270931 wait complete. 2026-02-13T20:11:32.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.988+0000 7f47f330c640 1 -- 10.20.193.110:0/2865868874 >> v1:10.20.193.188:6812/1623052694 conn(0x7f47bc03fa50 legacy=0x7f47bc05ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:32.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.988+0000 7f47f330c640 10 monclient: shutdown 2026-02-13T20:11:32.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.988+0000 7f47f330c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:32.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.988+0000 7f47f330c640 1 -- 10.20.193.110:0/2865868874 >> v1:10.20.193.110:6789/0 conn(0x7f47ec05c540 legacy=0x7f47ec140490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:32.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.988+0000 7f47f330c640 1 -- 10.20.193.110:0/2865868874 shutdown_connections 2026-02-13T20:11:32.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.988+0000 7f47f330c640 1 -- 10.20.193.110:0/2865868874 >> 10.20.193.110:0/2865868874 conn(0x7f47ec093270 msgr2=0x7f47ec058460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:32.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.988+0000 7f47f330c640 1 -- 10.20.193.110:0/2865868874 shutdown_connections 2026-02-13T20:11:32.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.988+0000 7f47f330c640 1 -- 10.20.193.110:0/2865868874 wait complete. 2026-02-13T20:11:32.993 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.991+0000 7fa224965640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-13T20:11:32.993 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.991+0000 7fa224965640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-13T20:11:32.993 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.991+0000 7fa224965640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:32.993 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.991+0000 7fa224965640 1 -- 10.20.193.110:0/3929398204 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fa21c055bb0 con 0x7fa21c1423a0 2026-02-13T20:11:32.993 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.991+0000 7fa206ffd640 1 -- 10.20.193.110:0/3929398204 <== mon.2 v1:10.20.193.110:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (unknown 832126871 0 847495621) 0x7fa21004b5a0 con 0x7fa21c1423a0 2026-02-13T20:11:32.993 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.991+0000 7fa206ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-13T20:11:32.993 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.991+0000 7fa206ffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:11:32.993 INFO:teuthology.orchestra.run.trial110.stdout:47244640259 2026-02-13T20:11:32.996 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.994+0000 7fa224965640 1 -- 10.20.193.110:0/3929398204 >> v1:10.20.193.188:6812/1623052694 conn(0x7fa1ec03fc70 legacy=0x7fa1ec060120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:32.996 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.994+0000 7fa224965640 10 monclient: shutdown 2026-02-13T20:11:32.996 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.994+0000 7fa224965640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:32.996 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.994+0000 7fa224965640 1 -- 10.20.193.110:0/3929398204 >> v1:10.20.193.110:6790/0 conn(0x7fa21c1423a0 legacy=0x7fa21c194f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:32.996 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.994+0000 7fa224965640 1 -- 10.20.193.110:0/3929398204 shutdown_connections 2026-02-13T20:11:32.996 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.994+0000 7fa224965640 1 -- 10.20.193.110:0/3929398204 >> 10.20.193.110:0/3929398204 conn(0x7fa21c054c10 msgr2=0x7fa21c08e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:32.996 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.994+0000 7fa224965640 1 -- 10.20.193.110:0/3929398204 shutdown_connections 2026-02-13T20:11:32.996 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:32.994+0000 7fa224965640 1 -- 10.20.193.110:0/3929398204 wait complete. 2026-02-13T20:11:32.997 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.4 2026-02-13T20:11:32.997 DEBUG:teuthology.parallel:result is None 2026-02-13T20:11:32.998 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.5 2026-02-13T20:11:32.998 DEBUG:teuthology.parallel:result is None 2026-02-13T20:11:33.003 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.1 2026-02-13T20:11:33.003 DEBUG:teuthology.parallel:result is None 2026-02-13T20:11:33.029 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.027+0000 7fcec8a67640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-13T20:11:33.029 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.027+0000 7fcec8a67640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-13T20:11:33.029 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.027+0000 7fcec8a67640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:33.029 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.027+0000 7fcec8a67640 1 -- 10.20.193.110:0/1843582890 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fcec408e710 con 0x7fcec4057780 2026-02-13T20:11:33.029 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.027+0000 7fceaaffd640 1 -- 10.20.193.110:0/1843582890 <== mon.0 v1:10.20.193.110:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (unknown 383520633 0 847495621) 0x7fceb8016860 con 0x7fcec4057780 2026-02-13T20:11:33.029 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.027+0000 7fceaaffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-13T20:11:33.029 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.027+0000 7fceaaffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:11:33.029 INFO:teuthology.orchestra.run.trial110.stdout:47244640259 2026-02-13T20:11:33.031 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.029+0000 7fcec8a67640 1 -- 10.20.193.110:0/1843582890 >> v1:10.20.193.188:6812/1623052694 conn(0x7fce9003f980 legacy=0x7fce9005fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:33.031 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.029+0000 7fcec8a67640 10 monclient: shutdown 2026-02-13T20:11:33.031 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.029+0000 7fcec8a67640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:33.031 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.029+0000 7fcec8a67640 1 -- 10.20.193.110:0/1843582890 >> v1:10.20.193.110:6789/0 conn(0x7fcec4057780 legacy=0x7fcec412ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:33.031 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.029+0000 7fcec8a67640 1 -- 10.20.193.110:0/1843582890 shutdown_connections 2026-02-13T20:11:33.031 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.029+0000 7fcec8a67640 1 -- 10.20.193.110:0/1843582890 >> 10.20.193.110:0/1843582890 conn(0x7fcec4054330 msgr2=0x7fcec408b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:33.031 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.030+0000 7fcec8a67640 1 -- 10.20.193.110:0/1843582890 shutdown_connections 2026-02-13T20:11:33.031 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.030+0000 7fcec8a67640 1 -- 10.20.193.110:0/1843582890 wait complete. 2026-02-13T20:11:33.033 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.031+0000 7fceee4cc640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-13T20:11:33.033 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.031+0000 7fceee4cc640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-13T20:11:33.033 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.031+0000 7fceee4cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:33.033 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.031+0000 7fceee4cc640 1 -- 10.20.193.110:0/2590083447 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fcee81aa2f0 con 0x7fcee8094040 2026-02-13T20:11:33.033 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.031+0000 7fcee4ff9640 1 -- 10.20.193.110:0/2590083447 <== mon.2 v1:10.20.193.110:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (unknown 92182286 0 847495621) 0x7fced4021020 con 0x7fcee8094040 2026-02-13T20:11:33.033 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.031+0000 7fcee4ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-13T20:11:33.033 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.031+0000 7fcee4ff9640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:11:33.033 INFO:teuthology.orchestra.run.trial110.stdout:47244640259 2026-02-13T20:11:33.036 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.034+0000 7fceee4cc640 1 -- 10.20.193.110:0/2590083447 >> v1:10.20.193.188:6812/1623052694 conn(0x7fceb803faa0 legacy=0x7fceb805ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:33.036 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.034+0000 7fceee4cc640 10 monclient: shutdown 2026-02-13T20:11:33.036 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.034+0000 7fceee4cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:33.036 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.034+0000 7fceee4cc640 1 -- 10.20.193.110:0/2590083447 >> v1:10.20.193.110:6790/0 conn(0x7fcee8094040 legacy=0x7fcee81a6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:33.036 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.034+0000 7fceee4cc640 1 -- 10.20.193.110:0/2590083447 shutdown_connections 2026-02-13T20:11:33.036 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.034+0000 7fceee4cc640 1 -- 10.20.193.110:0/2590083447 >> 10.20.193.110:0/2590083447 conn(0x7fcee8054330 msgr2=0x7fcee81aeb70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:33.036 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.034+0000 7fceee4cc640 1 -- 10.20.193.110:0/2590083447 shutdown_connections 2026-02-13T20:11:33.036 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.034+0000 7fceee4cc640 1 -- 10.20.193.110:0/2590083447 wait complete. 2026-02-13T20:11:33.039 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.3 2026-02-13T20:11:33.039 DEBUG:teuthology.parallel:result is None 2026-02-13T20:11:33.043 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.2 2026-02-13T20:11:33.043 DEBUG:teuthology.parallel:result is None 2026-02-13T20:11:33.051 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.049+0000 7f9d9d452640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-13T20:11:33.051 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.049+0000 7f9d9d452640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-13T20:11:33.051 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.049+0000 7f9d9d452640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:33.051 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.049+0000 7f9d9d452640 1 -- 10.20.193.110:0/4259256566 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f9d98089b70 con 0x7f9d981401c0 2026-02-13T20:11:33.051 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.049+0000 7f9d777fe640 1 -- 10.20.193.110:0/4259256566 <== mon.2 v1:10.20.193.110:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (unknown 574334944 0 1444633209) 0x7f9d80016870 con 0x7f9d981401c0 2026-02-13T20:11:33.051 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.049+0000 7f9d777fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-13T20:11:33.051 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.049+0000 7f9d777fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:11:33.052 INFO:teuthology.orchestra.run.trial110.stdout:47244640260 2026-02-13T20:11:33.053 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.052+0000 7f9d9d452640 1 -- 10.20.193.110:0/4259256566 >> v1:10.20.193.188:6812/1623052694 conn(0x7f9d6403fbd0 legacy=0x7f9d64060080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:33.054 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.052+0000 7f9d9d452640 10 monclient: shutdown 2026-02-13T20:11:33.054 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.052+0000 7f9d9d452640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:33.054 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.052+0000 7f9d9d452640 1 -- 10.20.193.110:0/4259256566 >> v1:10.20.193.110:6790/0 conn(0x7f9d981401c0 legacy=0x7f9d981938b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:33.054 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.052+0000 7f9d9d452640 1 -- 10.20.193.110:0/4259256566 shutdown_connections 2026-02-13T20:11:33.054 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.052+0000 7f9d9d452640 1 -- 10.20.193.110:0/4259256566 >> 10.20.193.110:0/4259256566 conn(0x7f9d98054e90 msgr2=0x7f9d9808dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:33.054 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.052+0000 7f9d9d452640 1 -- 10.20.193.110:0/4259256566 shutdown_connections 2026-02-13T20:11:33.054 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.052+0000 7f9d9d452640 1 -- 10.20.193.110:0/4259256566 wait complete. 2026-02-13T20:11:33.061 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640260 for osd.0 2026-02-13T20:11:33.061 DEBUG:teuthology.parallel:result is None 2026-02-13T20:11:33.061 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-13T20:11:33.061 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-13T20:11:33.167 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.165+0000 7f2c1ea07640 10 monclient: get_monmap_and_config 2026-02-13T20:11:33.167 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.165+0000 7f2c1ea07640 10 monclient: build_initial_monmap 2026-02-13T20:11:33.167 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.165+0000 7f2c1ea07640 10 monclient: monmap: 2026-02-13T20:11:33.168 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:33.168 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:33.168 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:33.167245+0000 2026-02-13T20:11:33.168 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:33.167245+0000 2026-02-13T20:11:33.168 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:33.168 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:33.168 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:33.168 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:33.168 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:33.168 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:33.169 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.166+0000 7f2c1ea07640 1 Processor -- start 2026-02-13T20:11:33.169 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.166+0000 7f2c1ea07640 1 -- start start 2026-02-13T20:11:33.169 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.166+0000 7f2c1ea07640 10 monclient: init 2026-02-13T20:11:33.169 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.166+0000 7f2c1ea07640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:33.169 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.166+0000 7f2c1ea07640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:11:33.169 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.166+0000 7f2c1ea07640 10 monclient(hunting): picked mon.noname-b con 0x7f2c1813f280 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:33.169 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.166+0000 7f2c1ea07640 10 monclient(hunting): picked mon.noname-a con 0x7f2c1813ee70 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:33.169 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.166+0000 7f2c1ea07640 10 monclient(hunting): picked mon.noname-c con 0x7f2c18089a90 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:33.169 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.166+0000 7f2c1ea07640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c1808a310 con 0x7f2c1813ee70 2026-02-13T20:11:33.169 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.166+0000 7f2c1ea07640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c1808a5f0 con 0x7f2c18089a90 2026-02-13T20:11:33.169 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.166+0000 7f2c1ea07640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c1808a8d0 con 0x7f2c1813f280 2026-02-13T20:11:33.169 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.166+0000 7f2c1ea07640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:33.169 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.166+0000 7f2c1ea07640 10 monclient(hunting): authenticate will time out at 654.857829s 2026-02-13T20:11:33.169 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.166+0000 7f2c17fff640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f2c1813f280 0x7f2c1813f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:39854/0 (socket says 10.20.193.110:39854) 2026-02-13T20:11:33.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.166+0000 7f2c17fff640 1 -- 10.20.193.110:0/3549026586 learned_addr learned my addr 10.20.193.110:0/3549026586 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:33.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.166+0000 7f2c177fe640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f2c1813ee70 0x7f2c18180190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:60162/0 (socket says 10.20.193.110:60162) 2026-02-13T20:11:33.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.167+0000 7f2c16ffd640 1 -- 10.20.193.110:0/3549026586 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3608519299 0 0) 0x7f2c1808a310 con 0x7f2c1813ee70 2026-02-13T20:11:33.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.167+0000 7f2c16ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:11:33.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.167+0000 7f2c16ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:33.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.167+0000 7f2c16ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:33.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.167+0000 7f2c16ffd640 10 monclient(hunting): my global_id is 4353 2026-02-13T20:11:33.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.167+0000 7f2c16ffd640 1 -- 10.20.193.110:0/3549026586 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2bfc0035e0 con 0x7f2c1813ee70 2026-02-13T20:11:33.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.167+0000 7f2c16ffd640 1 -- 10.20.193.110:0/3549026586 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1277367720 0 0) 0x7f2c1808a8d0 con 0x7f2c1813f280 2026-02-13T20:11:33.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.167+0000 7f2c16ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:11:33.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.167+0000 7f2c16ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:33.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.167+0000 7f2c16ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:33.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.167+0000 7f2c16ffd640 10 monclient(hunting): my global_id is 4358 2026-02-13T20:11:33.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.167+0000 7f2c16ffd640 1 -- 10.20.193.110:0/3549026586 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c1808a310 con 0x7f2c1813f280 2026-02-13T20:11:33.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.167+0000 7f2c16ffd640 1 -- 10.20.193.110:0/3549026586 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2548850192 0 0) 0x7f2bfc0035e0 con 0x7f2c1813ee70 2026-02-13T20:11:33.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.167+0000 7f2c16ffd640 1 -- 10.20.193.110:0/3549026586 >> v1:10.20.193.110:6790/0 conn(0x7f2c1813f280 legacy=0x7f2c1813f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:33.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.167+0000 7f2c16ffd640 1 -- 10.20.193.110:0/3549026586 >> v1:10.20.193.188:6789/0 conn(0x7f2c18089a90 legacy=0x7f2c181a18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T20:11:33.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.167+0000 7f2c16ffd640 10 monclient: _finish_hunting 0 2026-02-13T20:11:33.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.167+0000 7f2c16ffd640 1 monclient: found mon.noname-a 2026-02-13T20:11:33.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.167+0000 7f2c16ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:33.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.167+0000 7f2c16ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:11:33.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.167+0000 7f2c16ffd640 1 -- 10.20.193.110:0/3549026586 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c1808abb0 con 0x7f2c1813ee70 2026-02-13T20:11:33.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.167+0000 7f2c16ffd640 10 monclient: _finish_auth 0 2026-02-13T20:11:33.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.167+0000 7f2c16ffd640 10 monclient: _check_auth_tickets 2026-02-13T20:11:33.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.167+0000 7f2c16ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:33.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.167+0000 7f2c16ffd640 1 -- 10.20.193.110:0/3549026586 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f2c08002dd0 con 0x7f2c1813ee70 2026-02-13T20:11:33.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.167+0000 7f2c16ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:33.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.167+0000 7f2c16ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:11:33.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.167+0000 7f2c16ffd640 10 monclient: dump: 2026-02-13T20:11:33.170 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:33.170 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:33.170 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:33.170 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:33.170 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:33.171 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:33.171 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:33.171 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:33.171 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:33.171 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:33.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.167+0000 7f2c1ea07640 5 monclient: authenticate success, global_id 4353 2026-02-13T20:11:33.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.167+0000 7f2c1ea07640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:33.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.167+0000 7f2c16ffd640 1 -- 10.20.193.110:0/3549026586 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2c08003010 con 0x7f2c1813ee70 2026-02-13T20:11:33.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.167+0000 7f2c16ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:33.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.167+0000 7f2c16ffd640 1 -- 10.20.193.110:0/3549026586 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f2c08003420 con 0x7f2c1813ee70 2026-02-13T20:11:33.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.167+0000 7f2c16ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:33.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.167+0000 7f2c16ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:33.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.167+0000 7f2c16ffd640 10 monclient: dump: 2026-02-13T20:11:33.171 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:33.171 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:33.171 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:33.171 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:33.171 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:33.171 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:33.171 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:33.171 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:33.171 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:33.171 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:33.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.167+0000 7f2c1ea07640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:33.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.167+0000 7f2c1ea07640 4 set_mon_vals no callback set 2026-02-13T20:11:33.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.167+0000 7f2c1ea07640 10 monclient: shutdown 2026-02-13T20:11:33.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.167+0000 7f2c1ea07640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:33.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.167+0000 7f2c1ea07640 1 -- 10.20.193.110:0/3549026586 >> v1:10.20.193.110:6789/0 conn(0x7f2c1813ee70 legacy=0x7f2c18180190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:33.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.167+0000 7f2c1ea07640 1 -- 10.20.193.110:0/3549026586 shutdown_connections 2026-02-13T20:11:33.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.167+0000 7f2c1ea07640 1 -- 10.20.193.110:0/3549026586 >> 10.20.193.110:0/3549026586 conn(0x7f2c18054e90 msgr2=0x7f2c18058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:33.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.167+0000 7f2c1ea07640 1 -- 10.20.193.110:0/3549026586 shutdown_connections 2026-02-13T20:11:33.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.167+0000 7f2c1ea07640 1 -- 10.20.193.110:0/3549026586 wait complete. 2026-02-13T20:11:33.173 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.168+0000 7f2c1ea07640 10 monclient: build_initial_monmap 2026-02-13T20:11:33.173 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.168+0000 7f2c1ea07640 10 monclient: monmap: 2026-02-13T20:11:33.173 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:33.173 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:33.173 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:11:33.173 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:11:33.173 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:33.173 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:11:33.173 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:33.173 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:33.173 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:33.173 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:33.173 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.168+0000 7f2c1ea07640 1 Processor -- start 2026-02-13T20:11:33.173 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.168+0000 7f2c1ea07640 1 -- start start 2026-02-13T20:11:33.173 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.168+0000 7f2c1ea07640 10 monclient: init 2026-02-13T20:11:33.173 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.168+0000 7f2c1ea07640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:33.173 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.168+0000 7f2c1ea07640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:11:33.173 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.168+0000 7f2c1ea07640 10 monclient(hunting): picked mon.noname-a con 0x7f2c18089a90 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:33.173 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.168+0000 7f2c1ea07640 10 monclient(hunting): picked mon.noname-c con 0x7f2c1813ee70 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:33.173 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.168+0000 7f2c1ea07640 10 monclient(hunting): picked mon.noname-b con 0x7f2c1813f280 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:33.173 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.168+0000 7f2c1ea07640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c1808bdd0 con 0x7f2c18089a90 2026-02-13T20:11:33.173 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.168+0000 7f2c1ea07640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c1805d320 con 0x7f2c1813f280 2026-02-13T20:11:33.173 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.168+0000 7f2c1ea07640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c18110070 con 0x7f2c1813ee70 2026-02-13T20:11:33.173 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.168+0000 7f2c1ea07640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:33.173 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.168+0000 7f2c1ea07640 10 monclient(hunting): authenticate will time out at 654.859699s 2026-02-13T20:11:33.173 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.168+0000 7f2c177fe640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f2c1813ee70 0x7f2c18126f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:39860/0 (socket says 10.20.193.110:39860) 2026-02-13T20:11:33.173 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.168+0000 7f2c177fe640 1 -- 10.20.193.110:0/4136064116 learned_addr learned my addr 10.20.193.110:0/4136064116 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:33.173 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.168+0000 7f2c14ff9640 1 -- 10.20.193.110:0/4136064116 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3892402417 0 0) 0x7f2c18110070 con 0x7f2c1813ee70 2026-02-13T20:11:33.173 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.168+0000 7f2c14ff9640 10 monclient(hunting): _negotiate 2026-02-13T20:11:33.173 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.168+0000 7f2c14ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:33.173 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.168+0000 7f2c14ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:33.174 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.168+0000 7f2c14ff9640 10 monclient(hunting): my global_id is 4361 2026-02-13T20:11:33.174 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.168+0000 7f2c14ff9640 1 -- 10.20.193.110:0/4136064116 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2be80035e0 con 0x7f2c1813ee70 2026-02-13T20:11:33.174 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.168+0000 7f2c14ff9640 1 -- 10.20.193.110:0/4136064116 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2234860648 0 0) 0x7f2c1808bdd0 con 0x7f2c18089a90 2026-02-13T20:11:33.174 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.168+0000 7f2c14ff9640 10 monclient(hunting): _negotiate 2026-02-13T20:11:33.174 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.168+0000 7f2c14ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:33.174 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.168+0000 7f2c14ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:33.174 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.168+0000 7f2c14ff9640 10 monclient(hunting): my global_id is 4356 2026-02-13T20:11:33.174 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.168+0000 7f2c14ff9640 1 -- 10.20.193.110:0/4136064116 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c18110070 con 0x7f2c18089a90 2026-02-13T20:11:33.174 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.168+0000 7f2c14ff9640 1 -- 10.20.193.110:0/4136064116 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3102531028 0 0) 0x7f2be80035e0 con 0x7f2c1813ee70 2026-02-13T20:11:33.174 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.169+0000 7f2c14ff9640 1 -- 10.20.193.110:0/4136064116 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2c1808bdd0 con 0x7f2c1813ee70 2026-02-13T20:11:33.174 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.169+0000 7f2c14ff9640 1 -- 10.20.193.110:0/4136064116 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f2c08002ce0 con 0x7f2c1813ee70 2026-02-13T20:11:33.174 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.169+0000 7f2c14ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:33.174 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.169+0000 7f2c14ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:11:33.174 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.169+0000 7f2c14ff9640 10 monclient(hunting): dump: 2026-02-13T20:11:33.174 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:33.174 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:33.174 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:33.174 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:33.174 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:33.174 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:33.174 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:33.174 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:33.174 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:33.174 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:33.174 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.169+0000 7f2c14ff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:33.174 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.169+0000 7f2c14ff9640 1 -- 10.20.193.110:0/4136064116 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1183619974 0 0) 0x7f2c18110070 con 0x7f2c18089a90 2026-02-13T20:11:33.174 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.169+0000 7f2c14ff9640 1 -- 10.20.193.110:0/4136064116 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2be80035e0 con 0x7f2c18089a90 2026-02-13T20:11:33.174 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.169+0000 7f2c14ff9640 1 -- 10.20.193.110:0/4136064116 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f2c04003090 con 0x7f2c18089a90 2026-02-13T20:11:33.174 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.169+0000 7f2c14ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:33.174 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.169+0000 7f2c14ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:33.174 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.169+0000 7f2c14ff9640 10 monclient(hunting): dump: 2026-02-13T20:11:33.174 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:33.174 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:33.174 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:33.174 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:33.174 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:33.174 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:33.174 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:33.174 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:33.174 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:33.174 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:33.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.169+0000 7f2c14ff9640 1 -- 10.20.193.110:0/4136064116 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1222574784 0 0) 0x7f2c1805d320 con 0x7f2c1813f280 2026-02-13T20:11:33.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.169+0000 7f2c14ff9640 10 monclient(hunting): _negotiate 2026-02-13T20:11:33.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.169+0000 7f2c14ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:33.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.169+0000 7f2c14ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:33.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.169+0000 7f2c14ff9640 10 monclient(hunting): my global_id is 4348 2026-02-13T20:11:33.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.169+0000 7f2c14ff9640 1 -- 10.20.193.110:0/4136064116 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c18110070 con 0x7f2c1813f280 2026-02-13T20:11:33.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.169+0000 7f2c14ff9640 1 -- 10.20.193.110:0/4136064116 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2031862589 0 0) 0x7f2c1808bdd0 con 0x7f2c1813ee70 2026-02-13T20:11:33.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.169+0000 7f2c14ff9640 1 -- 10.20.193.110:0/4136064116 >> v1:10.20.193.188:6789/0 conn(0x7f2c1813f280 legacy=0x7f2c18128620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:33.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.169+0000 7f2c14ff9640 1 -- 10.20.193.110:0/4136064116 >> v1:10.20.193.110:6789/0 conn(0x7f2c18089a90 legacy=0x7f2c18120c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:33.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.169+0000 7f2c14ff9640 10 monclient: _finish_hunting 0 2026-02-13T20:11:33.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.169+0000 7f2c14ff9640 1 monclient: found mon.c 2026-02-13T20:11:33.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.169+0000 7f2c14ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:33.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.169+0000 7f2c14ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:33.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.169+0000 7f2c14ff9640 1 -- 10.20.193.110:0/4136064116 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c181120f0 con 0x7f2c1813ee70 2026-02-13T20:11:33.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.169+0000 7f2c14ff9640 10 monclient: _finish_auth 0 2026-02-13T20:11:33.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.169+0000 7f2c14ff9640 10 monclient: _check_auth_tickets 2026-02-13T20:11:33.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.169+0000 7f2c14ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:33.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.169+0000 7f2c1ea07640 5 monclient: authenticate success, global_id 4361 2026-02-13T20:11:33.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.169+0000 7f2c1ea07640 10 monclient: _renew_subs 2026-02-13T20:11:33.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.169+0000 7f2c1ea07640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:33.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.169+0000 7f2c1ea07640 1 -- 10.20.193.110:0/4136064116 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2c181123d0 con 0x7f2c1813ee70 2026-02-13T20:11:33.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.169+0000 7f2c1ea07640 10 monclient: _renew_subs 2026-02-13T20:11:33.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.169+0000 7f2c1ea07640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:33.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.169+0000 7f2c1ea07640 1 -- 10.20.193.110:0/4136064116 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f2c1810f5c0 con 0x7f2c1813ee70 2026-02-13T20:11:33.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.169+0000 7f2c14ff9640 1 -- 10.20.193.110:0/4136064116 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2c08004b50 con 0x7f2c1813ee70 2026-02-13T20:11:33.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.169+0000 7f2c14ff9640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:33.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.169+0000 7f2c14ff9640 1 -- 10.20.193.110:0/4136064116 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f2c08004e70 con 0x7f2c1813ee70 2026-02-13T20:11:33.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.169+0000 7f2c14ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:33.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.169+0000 7f2c14ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:33.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.169+0000 7f2c14ff9640 10 monclient: dump: 2026-02-13T20:11:33.175 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:33.175 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:33.175 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:33.175 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:33.175 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:33.175 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:33.175 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:33.175 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:33.175 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:33.175 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:33.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.169+0000 7f2c167fc640 4 set_mon_vals no callback set 2026-02-13T20:11:33.176 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.169+0000 7f2c1ea07640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:33.176 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.169+0000 7f2c1ea07640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:33.176 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.169+0000 7f2c1ea07640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:33.176 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.169+0000 7f2c1ea07640 1 -- 10.20.193.110:0/4136064116 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c180008d0 con 0x7f2c1813ee70 2026-02-13T20:11:33.176 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.169+0000 7f2c14ff9640 1 -- 10.20.193.110:0/4136064116 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f2c08011ae0 con 0x7f2c1813ee70 2026-02-13T20:11:33.176 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.169+0000 7f2c14ff9640 1 -- 10.20.193.110:0/4136064116 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 3531+0+0 (unknown 315507976 0 0) 0x7f2c0804e7e0 con 0x7f2c1813ee70 2026-02-13T20:11:33.176 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.170+0000 7f2c17fff640 10 monclient: get_auth_request con 0x7f2be803fc70 auth_method 0 2026-02-13T20:11:33.176 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.171+0000 7f2c14ff9640 1 -- 10.20.193.110:0/4136064116 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f2c08017170 con 0x7f2c1813ee70 2026-02-13T20:11:33.176 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.171+0000 7f2c14ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:33.176 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.171+0000 7f2c14ff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:11:33.280 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.277+0000 7f2c1ea07640 1 -- 10.20.193.110:0/4136064116 --> v1:10.20.193.188:6812/1623052694 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2c181213d0 con 0x7f2be803fc70 2026-02-13T20:11:33.281 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.278+0000 7f2c14ff9640 1 -- 10.20.193.110:0/4136064116 <== mgr.4105 v1:10.20.193.188:6812/1623052694 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34163 (unknown 2965378022 0 4041811844) 0x7f2c181213d0 con 0x7f2be803fc70 2026-02-13T20:11:33.282 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:33.284 INFO:teuthology.orchestra.run.trial110.stderr:dumped all 2026-02-13T20:11:33.284 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.279+0000 7f2c1ea07640 1 -- 10.20.193.110:0/4136064116 >> v1:10.20.193.188:6812/1623052694 conn(0x7f2be803fc70 legacy=0x7f2be8060120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:33.284 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.279+0000 7f2c1ea07640 10 monclient: shutdown 2026-02-13T20:11:33.285 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.279+0000 7f2c1ea07640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:33.285 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.279+0000 7f2c1ea07640 1 -- 10.20.193.110:0/4136064116 >> v1:10.20.193.110:6790/0 conn(0x7f2c1813ee70 legacy=0x7f2c18126f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:33.285 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.279+0000 7f2c1ea07640 1 -- 10.20.193.110:0/4136064116 shutdown_connections 2026-02-13T20:11:33.285 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.279+0000 7f2c1ea07640 1 -- 10.20.193.110:0/4136064116 >> 10.20.193.110:0/4136064116 conn(0x7f2c18054e90 msgr2=0x7f2c18122580 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:33.285 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.279+0000 7f2c1ea07640 1 -- 10.20.193.110:0/4136064116 shutdown_connections 2026-02-13T20:11:33.285 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.279+0000 7f2c1ea07640 1 -- 10.20.193.110:0/4136064116 wait complete. 2026-02-13T20:11:33.290 INFO:teuthology.orchestra.run.trial110.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2026-02-13T20:11:32.818065+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":162832,"kb_used_data":1072,"kb_used_omap":52,"kb_used_meta":161611,"kb_avail":566068208,"statfs":{"total":579820584960,"available":579653844992,"internally_reserved":0,"allocated":1097728,"data_stored":1493410,"data_compressed":16424,"data_compressed_allocated":98304,"data_compressed_original":1179648,"omap_allocated":53288,"internal_metadata":165490648},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.695998"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-13T20:11:30.561334+0000","last_change":"2026-02-13T20:11:30.561334+0000","last_active":"2026-02-13T20:11:30.561334+0000","last_peered":"2026-02-13T20:11:30.561334+0000","last_clean":"2026-02-13T20:11:30.561334+0000","last_became_active":"2026-02-13T20:11:29.018116+0000","last_became_peered":"2026-02-13T20:11:29.018116+0000","last_unstale":"2026-02-13T20:11:30.561334+0000","last_undegraded":"2026-02-13T20:11:30.561334+0000","last_fullsized":"2026-02-13T20:11:30.561334+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T03:21:19.857098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000335309,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-13T20:11:30.561637+0000","last_change":"2026-02-13T20:11:30.561637+0000","last_active":"2026-02-13T20:11:30.561637+0000","last_peered":"2026-02-13T20:11:30.561637+0000","last_clean":"2026-02-13T20:11:30.561637+0000","last_became_active":"2026-02-13T20:11:28.559585+0000","last_became_peered":"2026-02-13T20:11:28.559585+0000","last_unstale":"2026-02-13T20:11:30.561637+0000","last_undegraded":"2026-02-13T20:11:30.561637+0000","last_fullsized":"2026-02-13T20:11:30.561637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T23:13:24.610860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00021035100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-13T20:11:30.561240+0000","last_change":"2026-02-13T20:11:30.561240+0000","last_active":"2026-02-13T20:11:30.561240+0000","last_peered":"2026-02-13T20:11:30.561240+0000","last_clean":"2026-02-13T20:11:30.561240+0000","last_became_active":"2026-02-13T20:11:28.559005+0000","last_became_peered":"2026-02-13T20:11:28.559005+0000","last_unstale":"2026-02-13T20:11:30.561240+0000","last_undegraded":"2026-02-13T20:11:30.561240+0000","last_fullsized":"2026-02-13T20:11:30.561240+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T02:48:59.423627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027156000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-13T20:11:30.561668+0000","last_change":"2026-02-13T20:11:30.561668+0000","last_active":"2026-02-13T20:11:30.561668+0000","last_peered":"2026-02-13T20:11:30.561668+0000","last_clean":"2026-02-13T20:11:30.561668+0000","last_became_active":"2026-02-13T20:11:28.558441+0000","last_became_peered":"2026-02-13T20:11:28.558441+0000","last_unstale":"2026-02-13T20:11:30.561668+0000","last_undegraded":"2026-02-13T20:11:30.561668+0000","last_fullsized":"2026-02-13T20:11:30.561668+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T22:32:58.917639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000231139,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"19'2","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-13T20:11:30.563311+0000","last_change":"2026-02-13T20:11:30.563087+0000","last_active":"2026-02-13T20:11:30.563311+0000","last_peered":"2026-02-13T20:11:30.563311+0000","last_clean":"2026-02-13T20:11:30.563311+0000","last_became_active":"2026-02-13T20:11:28.557848+0000","last_became_peered":"2026-02-13T20:11:28.557848+0000","last_unstale":"2026-02-13T20:11:30.563311+0000","last_undegraded":"2026-02-13T20:11:30.563311+0000","last_fullsized":"2026-02-13T20:11:30.563311+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T21:44:09.052237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064918699999999996,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-13T20:11:30.823269+0000","last_change":"2026-02-13T20:11:30.823369+0000","last_active":"2026-02-13T20:11:30.823269+0000","last_peered":"2026-02-13T20:11:30.823269+0000","last_clean":"2026-02-13T20:11:30.823269+0000","last_became_active":"2026-02-13T20:11:28.559802+0000","last_became_peered":"2026-02-13T20:11:28.559802+0000","last_unstale":"2026-02-13T20:11:30.823269+0000","last_undegraded":"2026-02-13T20:11:30.823269+0000","last_fullsized":"2026-02-13T20:11:30.823269+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T05:27:34.220283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000230979,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-13T20:11:30.561332+0000","last_change":"2026-02-13T20:11:30.561332+0000","last_active":"2026-02-13T20:11:30.561332+0000","last_peered":"2026-02-13T20:11:30.561332+0000","last_clean":"2026-02-13T20:11:30.561332+0000","last_became_active":"2026-02-13T20:11:28.559211+0000","last_became_peered":"2026-02-13T20:11:28.559211+0000","last_unstale":"2026-02-13T20:11:30.561332+0000","last_undegraded":"2026-02-13T20:11:30.561332+0000","last_fullsized":"2026-02-13T20:11:30.561332+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T22:32:44.601301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029208800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"17'1","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-13T20:11:30.562730+0000","last_change":"2026-02-13T20:11:30.562730+0000","last_active":"2026-02-13T20:11:30.562730+0000","last_peered":"2026-02-13T20:11:30.562730+0000","last_clean":"2026-02-13T20:11:30.562730+0000","last_became_active":"2026-02-13T20:11:28.558943+0000","last_became_peered":"2026-02-13T20:11:28.558943+0000","last_unstale":"2026-02-13T20:11:30.562730+0000","last_undegraded":"2026-02-13T20:11:30.562730+0000","last_fullsized":"2026-02-13T20:11:30.562730+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T21:39:10.290168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032435800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"14'112","reported_seq":157,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-13T20:11:30.561154+0000","last_change":"2026-02-13T20:11:25.262882+0000","last_active":"2026-02-13T20:11:30.561154+0000","last_peered":"2026-02-13T20:11:30.561154+0000","last_clean":"2026-02-13T20:11:30.561154+0000","last_became_active":"2026-02-13T20:11:25.262766+0000","last_became_peered":"2026-02-13T20:11:25.262766+0000","last_unstale":"2026-02-13T20:11:30.561154+0000","last_undegraded":"2026-02-13T20:11:30.561154+0000","last_fullsized":"2026-02-13T20:11:30.561154+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:24.258524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:24.258524+0000","last_clean_scrub_stamp":"2026-02-13T20:11:24.258524+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T22:58:36.956434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1180736,"data_compressed":16424,"data_compressed_allocated":98304,"data_compressed_original":1179648,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27124,"kb_used_data":164,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344716,"statfs":{"total":96636764160,"available":96608989184,"internally_reserved":0,"allocated":167936,"data_stored":52125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8123,"internal_metadata":27582533},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640260,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27120,"kb_used_data":160,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344720,"statfs":{"total":96636764160,"available":96608993280,"internally_reserved":0,"allocated":163840,"data_stored":52106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640260,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":212,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":217088,"data_stored":642474,"data_compressed":8212,"data_compressed_allocated":49152,"data_compressed_original":589824,"omap_allocated":9421,"internal_metadata":27581235},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640259,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27120,"kb_used_data":160,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344720,"statfs":{"total":96636764160,"available":96608993280,"internally_reserved":0,"allocated":163840,"data_stored":52106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8773,"internal_metadata":27581883},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27124,"kb_used_data":164,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344716,"statfs":{"total":96636764160,"available":96608989184,"internally_reserved":0,"allocated":167936,"data_stored":52125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8773,"internal_metadata":27581883},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640260,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":212,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":217088,"data_stored":642474,"data_compressed":8212,"data_compressed_allocated":49152,"data_compressed_original":589824,"omap_allocated":9423,"internal_metadata":27581233},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":590368,"data_compressed":8212,"data_compressed_allocated":49152,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":590368,"data_compressed":8212,"data_compressed_allocated":49152,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T20:11:33.293 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-13T20:11:33.365 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.357+0000 7f34b850c640 10 monclient: get_monmap_and_config 2026-02-13T20:11:33.366 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.357+0000 7f34b850c640 10 monclient: build_initial_monmap 2026-02-13T20:11:33.366 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.357+0000 7f34b850c640 10 monclient: monmap: 2026-02-13T20:11:33.366 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:33.366 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:33.366 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:33.358463+0000 2026-02-13T20:11:33.366 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:33.358463+0000 2026-02-13T20:11:33.366 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:33.366 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:33.366 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:33.367 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:33.367 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:33.367 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:33.367 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.357+0000 7f34b850c640 1 Processor -- start 2026-02-13T20:11:33.367 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.357+0000 7f34b850c640 1 -- start start 2026-02-13T20:11:33.367 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.357+0000 7f34b850c640 10 monclient: init 2026-02-13T20:11:33.367 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.357+0000 7f34b850c640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:33.367 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.357+0000 7f34b850c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:11:33.367 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.357+0000 7f34b850c640 10 monclient(hunting): picked mon.noname-c con 0x7f34b005b7d0 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:33.367 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.357+0000 7f34b850c640 10 monclient(hunting): picked mon.noname-b con 0x7f34b0090e70 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:33.367 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.357+0000 7f34b850c640 10 monclient(hunting): picked mon.noname-a con 0x7f34b005c2b0 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:33.368 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.357+0000 7f34b850c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34b00904c0 con 0x7f34b005c2b0 2026-02-13T20:11:33.368 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.357+0000 7f34b850c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34b005ccf0 con 0x7f34b005b7d0 2026-02-13T20:11:33.368 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.357+0000 7f34b850c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34b005d3b0 con 0x7f34b0090e70 2026-02-13T20:11:33.368 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.357+0000 7f34b850c640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:33.368 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.357+0000 7f34b850c640 10 monclient(hunting): authenticate will time out at 655.048815s 2026-02-13T20:11:33.368 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.357+0000 7f34b5a80640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f34b0090e70 0x7f34b0183a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:39868/0 (socket says 10.20.193.110:39868) 2026-02-13T20:11:33.368 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.357+0000 7f34b5a80640 1 -- 10.20.193.110:0/2912272933 learned_addr learned my addr 10.20.193.110:0/2912272933 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:33.368 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.358+0000 7f34b527f640 1 -- 10.20.193.110:0/2912272933 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2894367528 0 0) 0x7f34b005d3b0 con 0x7f34b0090e70 2026-02-13T20:11:33.368 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.358+0000 7f34b527f640 10 monclient(hunting): _negotiate 2026-02-13T20:11:33.368 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.358+0000 7f34b527f640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:33.368 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.358+0000 7f34b527f640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:33.368 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.358+0000 7f34b527f640 10 monclient(hunting): my global_id is 4364 2026-02-13T20:11:33.369 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.358+0000 7f34b527f640 1 -- 10.20.193.110:0/2912272933 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34980035e0 con 0x7f34b0090e70 2026-02-13T20:11:33.369 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.358+0000 7f34b527f640 1 -- 10.20.193.110:0/2912272933 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3230853337 0 0) 0x7f34b00904c0 con 0x7f34b005c2b0 2026-02-13T20:11:33.369 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.358+0000 7f34b527f640 10 monclient(hunting): _negotiate 2026-02-13T20:11:33.369 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.358+0000 7f34b527f640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:33.369 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.358+0000 7f34b527f640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:33.369 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.358+0000 7f34b527f640 10 monclient(hunting): my global_id is 4359 2026-02-13T20:11:33.369 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.358+0000 7f34b527f640 1 -- 10.20.193.110:0/2912272933 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34b005d3b0 con 0x7f34b005c2b0 2026-02-13T20:11:33.369 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.358+0000 7f34b527f640 1 -- 10.20.193.110:0/2912272933 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2104209659 0 0) 0x7f34980035e0 con 0x7f34b0090e70 2026-02-13T20:11:33.369 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.358+0000 7f34b527f640 1 -- 10.20.193.110:0/2912272933 >> v1:10.20.193.188:6789/0 conn(0x7f34b005b7d0 legacy=0x7f34b005bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:33.369 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.358+0000 7f34b527f640 1 -- 10.20.193.110:0/2912272933 >> v1:10.20.193.110:6789/0 conn(0x7f34b005c2b0 legacy=0x7f34b01a5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:33.369 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.358+0000 7f34b527f640 10 monclient: _finish_hunting 0 2026-02-13T20:11:33.369 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.358+0000 7f34b527f640 1 monclient: found mon.noname-b 2026-02-13T20:11:33.370 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.358+0000 7f34b527f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:33.370 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.358+0000 7f34b527f640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:11:33.370 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.358+0000 7f34b527f640 1 -- 10.20.193.110:0/2912272933 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34b008c2c0 con 0x7f34b0090e70 2026-02-13T20:11:33.370 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.358+0000 7f34b527f640 10 monclient: _finish_auth 0 2026-02-13T20:11:33.370 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.358+0000 7f34b527f640 10 monclient: _check_auth_tickets 2026-02-13T20:11:33.370 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.358+0000 7f34b527f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:33.370 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.358+0000 7f34b527f640 1 -- 10.20.193.110:0/2912272933 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f34a4002dd0 con 0x7f34b0090e70 2026-02-13T20:11:33.370 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.358+0000 7f34b527f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:33.370 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.358+0000 7f34b527f640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:11:33.370 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.358+0000 7f34b527f640 10 monclient: dump: 2026-02-13T20:11:33.370 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:33.370 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:33.370 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:33.371 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:33.371 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:33.371 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:33.371 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:33.371 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:33.371 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:33.371 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:33.371 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.358+0000 7f34b850c640 5 monclient: authenticate success, global_id 4364 2026-02-13T20:11:33.371 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.358+0000 7f34b850c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:33.371 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.358+0000 7f34b527f640 1 -- 10.20.193.110:0/2912272933 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f34a4003010 con 0x7f34b0090e70 2026-02-13T20:11:33.371 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.358+0000 7f34b527f640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:33.371 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.358+0000 7f34b527f640 1 -- 10.20.193.110:0/2912272933 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f34a4003420 con 0x7f34b0090e70 2026-02-13T20:11:33.372 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.358+0000 7f34b527f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:33.372 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.358+0000 7f34b527f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:33.372 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.358+0000 7f34b527f640 10 monclient: dump: 2026-02-13T20:11:33.372 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:33.372 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:33.372 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:33.372 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:33.372 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:33.372 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:33.372 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:33.372 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:33.372 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:33.373 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:33.373 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.358+0000 7f34b850c640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:33.373 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.358+0000 7f34b850c640 4 set_mon_vals no callback set 2026-02-13T20:11:33.373 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.358+0000 7f34b850c640 10 monclient: shutdown 2026-02-13T20:11:33.373 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.358+0000 7f34b850c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:33.373 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.358+0000 7f34b850c640 1 -- 10.20.193.110:0/2912272933 >> v1:10.20.193.110:6790/0 conn(0x7f34b0090e70 legacy=0x7f34b0183a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:33.373 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.358+0000 7f34b850c640 1 -- 10.20.193.110:0/2912272933 shutdown_connections 2026-02-13T20:11:33.373 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.358+0000 7f34b850c640 1 -- 10.20.193.110:0/2912272933 >> 10.20.193.110:0/2912272933 conn(0x7f34b0054330 msgr2=0x7f34b0054730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:33.373 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.358+0000 7f34b850c640 1 -- 10.20.193.110:0/2912272933 shutdown_connections 2026-02-13T20:11:33.373 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.358+0000 7f34b850c640 1 -- 10.20.193.110:0/2912272933 wait complete. 2026-02-13T20:11:33.373 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.359+0000 7f34b850c640 10 monclient: build_initial_monmap 2026-02-13T20:11:33.373 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.359+0000 7f34b850c640 10 monclient: monmap: 2026-02-13T20:11:33.374 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:33.374 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:33.374 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:11:33.374 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:11:33.374 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:33.374 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:11:33.374 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:33.374 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:33.374 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:33.374 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:33.374 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.359+0000 7f34b850c640 1 Processor -- start 2026-02-13T20:11:33.374 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.359+0000 7f34b850c640 1 -- start start 2026-02-13T20:11:33.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.359+0000 7f34b850c640 10 monclient: init 2026-02-13T20:11:33.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.359+0000 7f34b850c640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:33.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.359+0000 7f34b850c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:11:33.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.359+0000 7f34b850c640 10 monclient(hunting): picked mon.noname-a con 0x7f34b005b7d0 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:33.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.359+0000 7f34b850c640 10 monclient(hunting): picked mon.noname-c con 0x7f34b005c2b0 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:33.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.359+0000 7f34b850c640 10 monclient(hunting): picked mon.noname-b con 0x7f34b0090e70 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:33.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.359+0000 7f34b850c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34b010e0f0 con 0x7f34b005b7d0 2026-02-13T20:11:33.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.359+0000 7f34b850c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34b010de10 con 0x7f34b0090e70 2026-02-13T20:11:33.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.359+0000 7f34b850c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34b0141e90 con 0x7f34b005c2b0 2026-02-13T20:11:33.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.359+0000 7f34b850c640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:33.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.359+0000 7f34b850c640 10 monclient(hunting): authenticate will time out at 655.050681s 2026-02-13T20:11:33.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.359+0000 7f34b5a80640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f34b005c2b0 0x7f34b010aff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:39878/0 (socket says 10.20.193.110:39878) 2026-02-13T20:11:33.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.359+0000 7f34b5a80640 1 -- 10.20.193.110:0/3275470011 learned_addr learned my addr 10.20.193.110:0/3275470011 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:33.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.359+0000 7f34b6281640 1 --1- 10.20.193.110:0/3275470011 >> v1:10.20.193.110:6789/0 conn(0x7f34b005b7d0 0x7f34b010a8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:60204/0 (socket says 10.20.193.110:60204) 2026-02-13T20:11:33.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.359+0000 7f3496ffd640 1 -- 10.20.193.110:0/3275470011 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 90205113 0 0) 0x7f34b0141e90 con 0x7f34b005c2b0 2026-02-13T20:11:33.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.359+0000 7f3496ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:11:33.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.359+0000 7f3496ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:33.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.359+0000 7f3496ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:33.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.359+0000 7f3496ffd640 10 monclient(hunting): my global_id is 4367 2026-02-13T20:11:33.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.359+0000 7f3496ffd640 1 -- 10.20.193.110:0/3275470011 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34800035e0 con 0x7f34b005c2b0 2026-02-13T20:11:33.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.359+0000 7f3496ffd640 1 -- 10.20.193.110:0/3275470011 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3793893363 0 0) 0x7f34b010e0f0 con 0x7f34b005b7d0 2026-02-13T20:11:33.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.359+0000 7f3496ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:11:33.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.359+0000 7f3496ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:33.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.359+0000 7f3496ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:33.377 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.359+0000 7f3496ffd640 10 monclient(hunting): my global_id is 4362 2026-02-13T20:11:33.377 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.359+0000 7f3496ffd640 1 -- 10.20.193.110:0/3275470011 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34b0141e90 con 0x7f34b005b7d0 2026-02-13T20:11:33.377 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.360+0000 7f3496ffd640 1 -- 10.20.193.110:0/3275470011 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 522430166 0 0) 0x7f34800035e0 con 0x7f34b005c2b0 2026-02-13T20:11:33.377 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.360+0000 7f3496ffd640 1 -- 10.20.193.110:0/3275470011 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f34b010e0f0 con 0x7f34b005c2b0 2026-02-13T20:11:33.377 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.360+0000 7f3496ffd640 1 -- 10.20.193.110:0/3275470011 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f34a4002ce0 con 0x7f34b005c2b0 2026-02-13T20:11:33.377 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.360+0000 7f3496ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:33.377 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.360+0000 7f3496ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:11:33.377 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.360+0000 7f3496ffd640 10 monclient(hunting): dump: 2026-02-13T20:11:33.377 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:33.377 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:33.377 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:33.377 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:33.378 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:33.378 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:33.378 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:33.378 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:33.378 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:33.378 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:33.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.360+0000 7f3496ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:33.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.360+0000 7f3496ffd640 1 -- 10.20.193.110:0/3275470011 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 288310254 0 0) 0x7f34b0141e90 con 0x7f34b005b7d0 2026-02-13T20:11:33.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.360+0000 7f3496ffd640 1 -- 10.20.193.110:0/3275470011 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f34800035e0 con 0x7f34b005b7d0 2026-02-13T20:11:33.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.360+0000 7f3496ffd640 1 -- 10.20.193.110:0/3275470011 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f34a0003030 con 0x7f34b005b7d0 2026-02-13T20:11:33.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.360+0000 7f3496ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:33.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.360+0000 7f3496ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:33.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.360+0000 7f3496ffd640 10 monclient(hunting): dump: 2026-02-13T20:11:33.379 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:33.379 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:33.379 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:33.379 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:33.379 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:33.379 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:33.379 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:33.379 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:33.379 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:33.379 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:33.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.360+0000 7f3496ffd640 1 -- 10.20.193.110:0/3275470011 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 551308834 0 0) 0x7f34b010e0f0 con 0x7f34b005c2b0 2026-02-13T20:11:33.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.360+0000 7f3496ffd640 1 -- 10.20.193.110:0/3275470011 >> v1:10.20.193.188:6789/0 conn(0x7f34b0090e70 legacy=0x7f34b01a4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:33.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.360+0000 7f3496ffd640 1 -- 10.20.193.110:0/3275470011 >> v1:10.20.193.110:6789/0 conn(0x7f34b005b7d0 legacy=0x7f34b010a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:33.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.360+0000 7f3496ffd640 10 monclient: _finish_hunting 0 2026-02-13T20:11:33.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.360+0000 7f3496ffd640 1 monclient: found mon.c 2026-02-13T20:11:33.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.360+0000 7f3496ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:33.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.360+0000 7f3496ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:33.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.360+0000 7f3496ffd640 1 -- 10.20.193.110:0/3275470011 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34b010bca0 con 0x7f34b005c2b0 2026-02-13T20:11:33.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.360+0000 7f3496ffd640 10 monclient: _finish_auth 0 2026-02-13T20:11:33.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.360+0000 7f3496ffd640 10 monclient: _check_auth_tickets 2026-02-13T20:11:33.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.360+0000 7f3496ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:33.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.360+0000 7f34b850c640 5 monclient: authenticate success, global_id 4367 2026-02-13T20:11:33.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.360+0000 7f34b850c640 10 monclient: _renew_subs 2026-02-13T20:11:33.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.360+0000 7f34b850c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:33.381 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.360+0000 7f34b850c640 1 -- 10.20.193.110:0/3275470011 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f34b010d840 con 0x7f34b005c2b0 2026-02-13T20:11:33.381 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.360+0000 7f34b850c640 10 monclient: _renew_subs 2026-02-13T20:11:33.381 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.360+0000 7f34b850c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:33.381 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.360+0000 7f34b850c640 1 -- 10.20.193.110:0/3275470011 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f34b010b8a0 con 0x7f34b005c2b0 2026-02-13T20:11:33.381 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.360+0000 7f3496ffd640 1 -- 10.20.193.110:0/3275470011 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f34a4004b50 con 0x7f34b005c2b0 2026-02-13T20:11:33.381 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.360+0000 7f3496ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:33.381 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.360+0000 7f3496ffd640 1 -- 10.20.193.110:0/3275470011 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f34a4004f30 con 0x7f34b005c2b0 2026-02-13T20:11:33.381 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.360+0000 7f3496ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:33.381 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.360+0000 7f3496ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:33.381 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.360+0000 7f3496ffd640 10 monclient: dump: 2026-02-13T20:11:33.381 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:33.381 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:33.382 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:33.382 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:33.382 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:33.382 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:33.382 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:33.382 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:33.382 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:33.382 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:33.382 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.360+0000 7f34b4a7e640 4 set_mon_vals no callback set 2026-02-13T20:11:33.382 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.360+0000 7f34b850c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:33.382 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.360+0000 7f34b850c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:33.382 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.360+0000 7f34b850c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:33.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.360+0000 7f34b850c640 1 -- 10.20.193.110:0/3275470011 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34b008f3b0 con 0x7f34b005c2b0 2026-02-13T20:11:33.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.360+0000 7f3496ffd640 1 -- 10.20.193.110:0/3275470011 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f34a4005090 con 0x7f34b005c2b0 2026-02-13T20:11:33.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.361+0000 7f3496ffd640 1 -- 10.20.193.110:0/3275470011 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 3531+0+0 (unknown 315507976 0 0) 0x7f34a404e880 con 0x7f34b005c2b0 2026-02-13T20:11:33.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.361+0000 7f34b6281640 10 monclient: get_auth_request con 0x7f348003fa20 auth_method 0 2026-02-13T20:11:33.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.363+0000 7f3496ffd640 1 -- 10.20.193.110:0/3275470011 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f34a40171b0 con 0x7f34b005c2b0 2026-02-13T20:11:33.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.363+0000 7f3496ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:33.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.363+0000 7f3496ffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:11:33.469 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.467+0000 7f34b850c640 1 -- 10.20.193.110:0/3275470011 --> v1:10.20.193.188:6812/1623052694 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f34b0055bb0 con 0x7f348003fa20 2026-02-13T20:11:33.470 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.468+0000 7f3496ffd640 1 -- 10.20.193.110:0/3275470011 <== mgr.4105 v1:10.20.193.188:6812/1623052694 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34163 (unknown 2965378022 0 4041811844) 0x7f34b0055bb0 con 0x7f348003fa20 2026-02-13T20:11:33.471 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:33.472 INFO:teuthology.orchestra.run.trial110.stderr:dumped all 2026-02-13T20:11:33.472 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.469+0000 7f34b850c640 1 -- 10.20.193.110:0/3275470011 >> v1:10.20.193.188:6812/1623052694 conn(0x7f348003fa20 legacy=0x7f348005fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:33.472 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.469+0000 7f34b850c640 10 monclient: shutdown 2026-02-13T20:11:33.472 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.469+0000 7f34b850c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:33.472 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.469+0000 7f34b850c640 1 -- 10.20.193.110:0/3275470011 >> v1:10.20.193.110:6790/0 conn(0x7f34b005c2b0 legacy=0x7f34b010aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:33.472 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.469+0000 7f34b850c640 1 -- 10.20.193.110:0/3275470011 shutdown_connections 2026-02-13T20:11:33.473 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.469+0000 7f34b850c640 1 -- 10.20.193.110:0/3275470011 >> 10.20.193.110:0/3275470011 conn(0x7f34b0054330 msgr2=0x7f34b01249a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:33.473 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.469+0000 7f34b850c640 1 -- 10.20.193.110:0/3275470011 shutdown_connections 2026-02-13T20:11:33.473 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.469+0000 7f34b850c640 1 -- 10.20.193.110:0/3275470011 wait complete. 2026-02-13T20:11:33.480 INFO:teuthology.orchestra.run.trial110.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2026-02-13T20:11:32.818065+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":162832,"kb_used_data":1072,"kb_used_omap":52,"kb_used_meta":161611,"kb_avail":566068208,"statfs":{"total":579820584960,"available":579653844992,"internally_reserved":0,"allocated":1097728,"data_stored":1493410,"data_compressed":16424,"data_compressed_allocated":98304,"data_compressed_original":1179648,"omap_allocated":53288,"internal_metadata":165490648},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.695998"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-13T20:11:30.561334+0000","last_change":"2026-02-13T20:11:30.561334+0000","last_active":"2026-02-13T20:11:30.561334+0000","last_peered":"2026-02-13T20:11:30.561334+0000","last_clean":"2026-02-13T20:11:30.561334+0000","last_became_active":"2026-02-13T20:11:29.018116+0000","last_became_peered":"2026-02-13T20:11:29.018116+0000","last_unstale":"2026-02-13T20:11:30.561334+0000","last_undegraded":"2026-02-13T20:11:30.561334+0000","last_fullsized":"2026-02-13T20:11:30.561334+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T03:21:19.857098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000335309,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-13T20:11:30.561637+0000","last_change":"2026-02-13T20:11:30.561637+0000","last_active":"2026-02-13T20:11:30.561637+0000","last_peered":"2026-02-13T20:11:30.561637+0000","last_clean":"2026-02-13T20:11:30.561637+0000","last_became_active":"2026-02-13T20:11:28.559585+0000","last_became_peered":"2026-02-13T20:11:28.559585+0000","last_unstale":"2026-02-13T20:11:30.561637+0000","last_undegraded":"2026-02-13T20:11:30.561637+0000","last_fullsized":"2026-02-13T20:11:30.561637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T23:13:24.610860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00021035100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-13T20:11:30.561240+0000","last_change":"2026-02-13T20:11:30.561240+0000","last_active":"2026-02-13T20:11:30.561240+0000","last_peered":"2026-02-13T20:11:30.561240+0000","last_clean":"2026-02-13T20:11:30.561240+0000","last_became_active":"2026-02-13T20:11:28.559005+0000","last_became_peered":"2026-02-13T20:11:28.559005+0000","last_unstale":"2026-02-13T20:11:30.561240+0000","last_undegraded":"2026-02-13T20:11:30.561240+0000","last_fullsized":"2026-02-13T20:11:30.561240+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T02:48:59.423627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027156000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-13T20:11:30.561668+0000","last_change":"2026-02-13T20:11:30.561668+0000","last_active":"2026-02-13T20:11:30.561668+0000","last_peered":"2026-02-13T20:11:30.561668+0000","last_clean":"2026-02-13T20:11:30.561668+0000","last_became_active":"2026-02-13T20:11:28.558441+0000","last_became_peered":"2026-02-13T20:11:28.558441+0000","last_unstale":"2026-02-13T20:11:30.561668+0000","last_undegraded":"2026-02-13T20:11:30.561668+0000","last_fullsized":"2026-02-13T20:11:30.561668+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T22:32:58.917639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000231139,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"19'2","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-13T20:11:30.563311+0000","last_change":"2026-02-13T20:11:30.563087+0000","last_active":"2026-02-13T20:11:30.563311+0000","last_peered":"2026-02-13T20:11:30.563311+0000","last_clean":"2026-02-13T20:11:30.563311+0000","last_became_active":"2026-02-13T20:11:28.557848+0000","last_became_peered":"2026-02-13T20:11:28.557848+0000","last_unstale":"2026-02-13T20:11:30.563311+0000","last_undegraded":"2026-02-13T20:11:30.563311+0000","last_fullsized":"2026-02-13T20:11:30.563311+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T21:44:09.052237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064918699999999996,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-13T20:11:30.823269+0000","last_change":"2026-02-13T20:11:30.823369+0000","last_active":"2026-02-13T20:11:30.823269+0000","last_peered":"2026-02-13T20:11:30.823269+0000","last_clean":"2026-02-13T20:11:30.823269+0000","last_became_active":"2026-02-13T20:11:28.559802+0000","last_became_peered":"2026-02-13T20:11:28.559802+0000","last_unstale":"2026-02-13T20:11:30.823269+0000","last_undegraded":"2026-02-13T20:11:30.823269+0000","last_fullsized":"2026-02-13T20:11:30.823269+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T05:27:34.220283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000230979,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-13T20:11:30.561332+0000","last_change":"2026-02-13T20:11:30.561332+0000","last_active":"2026-02-13T20:11:30.561332+0000","last_peered":"2026-02-13T20:11:30.561332+0000","last_clean":"2026-02-13T20:11:30.561332+0000","last_became_active":"2026-02-13T20:11:28.559211+0000","last_became_peered":"2026-02-13T20:11:28.559211+0000","last_unstale":"2026-02-13T20:11:30.561332+0000","last_undegraded":"2026-02-13T20:11:30.561332+0000","last_fullsized":"2026-02-13T20:11:30.561332+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T22:32:44.601301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029208800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"17'1","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-13T20:11:30.562730+0000","last_change":"2026-02-13T20:11:30.562730+0000","last_active":"2026-02-13T20:11:30.562730+0000","last_peered":"2026-02-13T20:11:30.562730+0000","last_clean":"2026-02-13T20:11:30.562730+0000","last_became_active":"2026-02-13T20:11:28.558943+0000","last_became_peered":"2026-02-13T20:11:28.558943+0000","last_unstale":"2026-02-13T20:11:30.562730+0000","last_undegraded":"2026-02-13T20:11:30.562730+0000","last_fullsized":"2026-02-13T20:11:30.562730+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T21:39:10.290168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032435800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"14'112","reported_seq":157,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-13T20:11:30.561154+0000","last_change":"2026-02-13T20:11:25.262882+0000","last_active":"2026-02-13T20:11:30.561154+0000","last_peered":"2026-02-13T20:11:30.561154+0000","last_clean":"2026-02-13T20:11:30.561154+0000","last_became_active":"2026-02-13T20:11:25.262766+0000","last_became_peered":"2026-02-13T20:11:25.262766+0000","last_unstale":"2026-02-13T20:11:30.561154+0000","last_undegraded":"2026-02-13T20:11:30.561154+0000","last_fullsized":"2026-02-13T20:11:30.561154+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:24.258524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:24.258524+0000","last_clean_scrub_stamp":"2026-02-13T20:11:24.258524+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T22:58:36.956434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1180736,"data_compressed":16424,"data_compressed_allocated":98304,"data_compressed_original":1179648,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27124,"kb_used_data":164,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344716,"statfs":{"total":96636764160,"available":96608989184,"internally_reserved":0,"allocated":167936,"data_stored":52125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8123,"internal_metadata":27582533},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640260,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27120,"kb_used_data":160,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344720,"statfs":{"total":96636764160,"available":96608993280,"internally_reserved":0,"allocated":163840,"data_stored":52106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640260,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":212,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":217088,"data_stored":642474,"data_compressed":8212,"data_compressed_allocated":49152,"data_compressed_original":589824,"omap_allocated":9421,"internal_metadata":27581235},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640259,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27120,"kb_used_data":160,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344720,"statfs":{"total":96636764160,"available":96608993280,"internally_reserved":0,"allocated":163840,"data_stored":52106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8773,"internal_metadata":27581883},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27124,"kb_used_data":164,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344716,"statfs":{"total":96636764160,"available":96608989184,"internally_reserved":0,"allocated":167936,"data_stored":52125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8773,"internal_metadata":27581883},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640260,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":212,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":217088,"data_stored":642474,"data_compressed":8212,"data_compressed_allocated":49152,"data_compressed_original":589824,"omap_allocated":9423,"internal_metadata":27581233},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":590368,"data_compressed":8212,"data_compressed_allocated":49152,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":590368,"data_compressed":8212,"data_compressed_allocated":49152,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T20:11:33.481 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-13T20:11:33.481 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-13T20:11:33.482 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-13T20:11:33.482 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-13T20:11:33.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.544+0000 7fdcb66cc640 10 monclient: get_monmap_and_config 2026-02-13T20:11:33.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.544+0000 7fdcb66cc640 10 monclient: build_initial_monmap 2026-02-13T20:11:33.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.544+0000 7fdcb66cc640 10 monclient: monmap: 2026-02-13T20:11:33.546 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:33.546 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:33.546 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:33.545495+0000 2026-02-13T20:11:33.546 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:33.545495+0000 2026-02-13T20:11:33.547 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:33.547 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:33.547 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:33.547 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:33.547 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:33.547 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:33.554 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.544+0000 7fdcb66cc640 1 Processor -- start 2026-02-13T20:11:33.554 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.544+0000 7fdcb66cc640 1 -- start start 2026-02-13T20:11:33.554 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.544+0000 7fdcb66cc640 10 monclient: init 2026-02-13T20:11:33.555 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.544+0000 7fdcb66cc640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:33.555 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.544+0000 7fdcb66cc640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:11:33.555 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.544+0000 7fdcb66cc640 10 monclient(hunting): picked mon.noname-c con 0x7fdcb0089250 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:33.555 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.544+0000 7fdcb66cc640 10 monclient(hunting): picked mon.noname-b con 0x7fdcb0057780 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:33.555 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.544+0000 7fdcb66cc640 10 monclient(hunting): picked mon.noname-a con 0x7fdcb0184b60 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:33.555 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.544+0000 7fdcb66cc640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcb008a950 con 0x7fdcb0184b60 2026-02-13T20:11:33.555 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.544+0000 7fdcb66cc640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcb0089620 con 0x7fdcb0089250 2026-02-13T20:11:33.555 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.544+0000 7fdcb66cc640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcb0057c60 con 0x7fdcb0057780 2026-02-13T20:11:33.555 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.544+0000 7fdcb66cc640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:33.555 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.544+0000 7fdcb66cc640 10 monclient(hunting): authenticate will time out at 655.235968s 2026-02-13T20:11:33.555 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.545+0000 7fdcb4c42640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fdcb0184b60 0x7fdcb01a4f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:60212/0 (socket says 10.20.193.110:60212) 2026-02-13T20:11:33.556 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.545+0000 7fdcb4c42640 1 -- 10.20.193.110:0/1521370326 learned_addr learned my addr 10.20.193.110:0/1521370326 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:33.556 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.545+0000 7fdcaf7fe640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fdcb0057780 0x7fdcb0183440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:39888/0 (socket says 10.20.193.110:39888) 2026-02-13T20:11:33.556 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.545+0000 7fdcaeffd640 1 -- 10.20.193.110:0/1521370326 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2634847731 0 0) 0x7fdcb0057c60 con 0x7fdcb0057780 2026-02-13T20:11:33.556 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.545+0000 7fdcaeffd640 10 monclient(hunting): _negotiate 2026-02-13T20:11:33.556 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.545+0000 7fdcaeffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:33.556 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.545+0000 7fdcaeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:33.556 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.545+0000 7fdcaeffd640 10 monclient(hunting): my global_id is 4370 2026-02-13T20:11:33.556 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.545+0000 7fdcaeffd640 1 -- 10.20.193.110:0/1521370326 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc940035e0 con 0x7fdcb0057780 2026-02-13T20:11:33.556 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.545+0000 7fdcaeffd640 1 -- 10.20.193.110:0/1521370326 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3830388623 0 0) 0x7fdcb008a950 con 0x7fdcb0184b60 2026-02-13T20:11:33.556 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.545+0000 7fdcaeffd640 10 monclient(hunting): _negotiate 2026-02-13T20:11:33.556 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.545+0000 7fdcaeffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:33.556 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.545+0000 7fdcaeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:33.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.545+0000 7fdcaeffd640 10 monclient(hunting): my global_id is 4365 2026-02-13T20:11:33.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.545+0000 7fdcaeffd640 1 -- 10.20.193.110:0/1521370326 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdcb0057c60 con 0x7fdcb0184b60 2026-02-13T20:11:33.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.545+0000 7fdcaeffd640 1 -- 10.20.193.110:0/1521370326 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3229677011 0 0) 0x7fdc940035e0 con 0x7fdcb0057780 2026-02-13T20:11:33.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.545+0000 7fdcaeffd640 1 -- 10.20.193.110:0/1521370326 >> v1:10.20.193.188:6789/0 conn(0x7fdcb0089250 legacy=0x7fdcb00580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:33.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.545+0000 7fdcaeffd640 1 -- 10.20.193.110:0/1521370326 >> v1:10.20.193.110:6789/0 conn(0x7fdcb0184b60 legacy=0x7fdcb01a4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:33.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.545+0000 7fdcaeffd640 10 monclient: _finish_hunting 0 2026-02-13T20:11:33.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.545+0000 7fdcaeffd640 1 monclient: found mon.noname-b 2026-02-13T20:11:33.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.545+0000 7fdcaeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:33.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.545+0000 7fdcaeffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:11:33.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.545+0000 7fdcaeffd640 1 -- 10.20.193.110:0/1521370326 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcb0089a50 con 0x7fdcb0057780 2026-02-13T20:11:33.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.545+0000 7fdcaeffd640 10 monclient: _finish_auth 0 2026-02-13T20:11:33.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.545+0000 7fdcaeffd640 10 monclient: _check_auth_tickets 2026-02-13T20:11:33.558 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.545+0000 7fdcaeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:33.558 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.545+0000 7fdcaeffd640 1 -- 10.20.193.110:0/1521370326 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fdca0002dd0 con 0x7fdcb0057780 2026-02-13T20:11:33.558 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.545+0000 7fdcaeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:33.558 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.545+0000 7fdcaeffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:11:33.558 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.545+0000 7fdcaeffd640 10 monclient: dump: 2026-02-13T20:11:33.558 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:33.558 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:33.558 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:33.558 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:33.558 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:33.558 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:33.558 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:33.558 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:33.559 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:33.559 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:33.559 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.545+0000 7fdcb66cc640 5 monclient: authenticate success, global_id 4370 2026-02-13T20:11:33.559 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.545+0000 7fdcb66cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:33.559 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.545+0000 7fdcaeffd640 1 -- 10.20.193.110:0/1521370326 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdca0003050 con 0x7fdcb0057780 2026-02-13T20:11:33.559 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.545+0000 7fdcaeffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:33.559 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.545+0000 7fdcb66cc640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:33.559 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.545+0000 7fdcb66cc640 4 set_mon_vals no callback set 2026-02-13T20:11:33.559 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.545+0000 7fdcaeffd640 1 -- 10.20.193.110:0/1521370326 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fdca0003460 con 0x7fdcb0057780 2026-02-13T20:11:33.559 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.545+0000 7fdcaeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:33.559 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.545+0000 7fdcaeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:33.559 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.545+0000 7fdcaeffd640 10 monclient: dump: 2026-02-13T20:11:33.560 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:33.560 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:33.560 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:33.560 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:33.560 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:33.560 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:33.560 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:33.560 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:33.560 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:33.560 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:33.560 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.545+0000 7fdcb66cc640 10 monclient: shutdown 2026-02-13T20:11:33.560 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.545+0000 7fdcb66cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:33.561 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.545+0000 7fdcb66cc640 1 -- 10.20.193.110:0/1521370326 >> v1:10.20.193.110:6790/0 conn(0x7fdcb0057780 legacy=0x7fdcb0183440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:33.561 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.545+0000 7fdcb66cc640 1 -- 10.20.193.110:0/1521370326 shutdown_connections 2026-02-13T20:11:33.561 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.545+0000 7fdcb66cc640 1 -- 10.20.193.110:0/1521370326 >> 10.20.193.110:0/1521370326 conn(0x7fdcb0054330 msgr2=0x7fdcb0054730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:33.561 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.545+0000 7fdcb66cc640 1 -- 10.20.193.110:0/1521370326 shutdown_connections 2026-02-13T20:11:33.561 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.545+0000 7fdcb66cc640 1 -- 10.20.193.110:0/1521370326 wait complete. 2026-02-13T20:11:33.561 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.546+0000 7fdcb66cc640 10 monclient: build_initial_monmap 2026-02-13T20:11:33.561 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.546+0000 7fdcb66cc640 10 monclient: monmap: 2026-02-13T20:11:33.561 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:33.561 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:33.561 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:11:33.561 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:11:33.561 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:33.562 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:11:33.562 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:33.562 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:33.562 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:33.562 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:33.562 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.546+0000 7fdcb66cc640 1 Processor -- start 2026-02-13T20:11:33.562 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.546+0000 7fdcb66cc640 1 -- start start 2026-02-13T20:11:33.562 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.546+0000 7fdcb66cc640 10 monclient: init 2026-02-13T20:11:33.562 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.546+0000 7fdcb66cc640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:33.562 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.546+0000 7fdcb66cc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:11:33.562 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.546+0000 7fdcb66cc640 10 monclient(hunting): picked mon.noname-a con 0x7fdcb0057780 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:33.562 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.546+0000 7fdcb66cc640 10 monclient(hunting): picked mon.noname-c con 0x7fdcb0089250 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:33.562 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.546+0000 7fdcb66cc640 10 monclient(hunting): picked mon.noname-b con 0x7fdcb0184b60 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:33.563 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.546+0000 7fdcb66cc640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcb008a160 con 0x7fdcb0057780 2026-02-13T20:11:33.563 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.546+0000 7fdcb66cc640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcb0111e40 con 0x7fdcb0184b60 2026-02-13T20:11:33.563 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.546+0000 7fdcb66cc640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcb012b1b0 con 0x7fdcb0089250 2026-02-13T20:11:33.563 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.546+0000 7fdcb66cc640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:33.563 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.546+0000 7fdcb66cc640 10 monclient(hunting): authenticate will time out at 655.237778s 2026-02-13T20:11:33.563 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.546+0000 7fdcaf7fe640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fdcb0089250 0x7fdcb0171e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:39900/0 (socket says 10.20.193.110:39900) 2026-02-13T20:11:33.563 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.546+0000 7fdcaf7fe640 1 -- 10.20.193.110:0/1764288404 learned_addr learned my addr 10.20.193.110:0/1764288404 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:33.563 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.546+0000 7fdcacff9640 1 -- 10.20.193.110:0/1764288404 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4051813149 0 0) 0x7fdcb012b1b0 con 0x7fdcb0089250 2026-02-13T20:11:33.563 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.546+0000 7fdcacff9640 10 monclient(hunting): _negotiate 2026-02-13T20:11:33.563 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.546+0000 7fdcacff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:33.563 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.546+0000 7fdcacff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:33.563 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.546+0000 7fdcacff9640 10 monclient(hunting): my global_id is 4373 2026-02-13T20:11:33.564 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.546+0000 7fdcacff9640 1 -- 10.20.193.110:0/1764288404 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc800035e0 con 0x7fdcb0089250 2026-02-13T20:11:33.564 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.546+0000 7fdcacff9640 1 -- 10.20.193.110:0/1764288404 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2180715337 0 0) 0x7fdcb008a160 con 0x7fdcb0057780 2026-02-13T20:11:33.564 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.546+0000 7fdcacff9640 10 monclient(hunting): _negotiate 2026-02-13T20:11:33.564 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.546+0000 7fdcacff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:33.564 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.546+0000 7fdcacff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:33.564 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.546+0000 7fdcacff9640 10 monclient(hunting): my global_id is 4368 2026-02-13T20:11:33.564 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.546+0000 7fdcacff9640 1 -- 10.20.193.110:0/1764288404 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdcb012b1b0 con 0x7fdcb0057780 2026-02-13T20:11:33.564 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.547+0000 7fdcacff9640 1 -- 10.20.193.110:0/1764288404 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3512762887 0 0) 0x7fdc800035e0 con 0x7fdcb0089250 2026-02-13T20:11:33.564 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.547+0000 7fdcacff9640 1 -- 10.20.193.110:0/1764288404 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdcb008a160 con 0x7fdcb0089250 2026-02-13T20:11:33.564 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.547+0000 7fdcacff9640 1 -- 10.20.193.110:0/1764288404 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fdca0003370 con 0x7fdcb0089250 2026-02-13T20:11:33.564 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.547+0000 7fdcacff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:33.564 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.547+0000 7fdcacff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:11:33.564 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.547+0000 7fdcacff9640 10 monclient(hunting): dump: 2026-02-13T20:11:33.565 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:33.565 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:33.565 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:33.565 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:33.565 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:33.565 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:33.565 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:33.565 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:33.565 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:33.565 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:33.565 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.547+0000 7fdcacff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:33.565 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.547+0000 7fdcacff9640 1 -- 10.20.193.110:0/1764288404 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2708741544 0 0) 0x7fdcb012b1b0 con 0x7fdcb0057780 2026-02-13T20:11:33.565 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.547+0000 7fdcacff9640 1 -- 10.20.193.110:0/1764288404 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdc800035e0 con 0x7fdcb0057780 2026-02-13T20:11:33.566 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.547+0000 7fdcacff9640 1 -- 10.20.193.110:0/1764288404 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fdc9c003070 con 0x7fdcb0057780 2026-02-13T20:11:33.566 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.547+0000 7fdcacff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:33.566 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.547+0000 7fdcacff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:33.566 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.547+0000 7fdcacff9640 10 monclient(hunting): dump: 2026-02-13T20:11:33.566 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:33.566 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:33.566 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:33.566 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:33.566 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:33.566 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:33.566 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:33.566 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:33.567 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:33.567 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:33.567 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.547+0000 7fdcacff9640 1 -- 10.20.193.110:0/1764288404 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1739815311 0 0) 0x7fdcb008a160 con 0x7fdcb0089250 2026-02-13T20:11:33.567 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.547+0000 7fdcacff9640 1 -- 10.20.193.110:0/1764288404 >> v1:10.20.193.188:6789/0 conn(0x7fdcb0184b60 legacy=0x7fdcb0173560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:33.567 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.547+0000 7fdcacff9640 1 -- 10.20.193.110:0/1764288404 >> v1:10.20.193.110:6789/0 conn(0x7fdcb0057780 legacy=0x7fdcb012aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:33.567 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.547+0000 7fdcacff9640 10 monclient: _finish_hunting 0 2026-02-13T20:11:33.567 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.547+0000 7fdcacff9640 1 monclient: found mon.c 2026-02-13T20:11:33.567 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.547+0000 7fdcacff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:33.567 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.547+0000 7fdcacff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:33.567 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.547+0000 7fdcacff9640 1 -- 10.20.193.110:0/1764288404 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcb01123e0 con 0x7fdcb0089250 2026-02-13T20:11:33.567 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.547+0000 7fdcacff9640 10 monclient: _finish_auth 0 2026-02-13T20:11:33.567 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.547+0000 7fdcacff9640 10 monclient: _check_auth_tickets 2026-02-13T20:11:33.567 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.547+0000 7fdcacff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:33.568 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.547+0000 7fdcb66cc640 5 monclient: authenticate success, global_id 4373 2026-02-13T20:11:33.568 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.547+0000 7fdcb66cc640 10 monclient: _renew_subs 2026-02-13T20:11:33.568 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.547+0000 7fdcb66cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:33.568 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.547+0000 7fdcb66cc640 1 -- 10.20.193.110:0/1764288404 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdcb0110080 con 0x7fdcb0089250 2026-02-13T20:11:33.568 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.547+0000 7fdcb66cc640 10 monclient: _renew_subs 2026-02-13T20:11:33.568 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.547+0000 7fdcb66cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:33.568 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.547+0000 7fdcb66cc640 1 -- 10.20.193.110:0/1764288404 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fdcb010fa50 con 0x7fdcb0089250 2026-02-13T20:11:33.568 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.547+0000 7fdcacff9640 1 -- 10.20.193.110:0/1764288404 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdca0002940 con 0x7fdcb0089250 2026-02-13T20:11:33.568 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.547+0000 7fdcacff9640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:33.568 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.547+0000 7fdcacff9640 1 -- 10.20.193.110:0/1764288404 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fdca0004d00 con 0x7fdcb0089250 2026-02-13T20:11:33.568 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.547+0000 7fdcacff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:33.568 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.547+0000 7fdcacff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:33.569 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.547+0000 7fdcae7fc640 4 set_mon_vals no callback set 2026-02-13T20:11:33.569 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.547+0000 7fdcacff9640 10 monclient: dump: 2026-02-13T20:11:33.569 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:33.569 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:33.569 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:33.569 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:33.569 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:33.569 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:33.569 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:33.569 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:33.569 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:33.569 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:33.569 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.547+0000 7fdcb66cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:33.570 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.547+0000 7fdcb66cc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:33.570 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.547+0000 7fdcb66cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:33.570 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.547+0000 7fdcb66cc640 1 -- 10.20.193.110:0/1764288404 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcb0089030 con 0x7fdcb0089250 2026-02-13T20:11:33.570 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.547+0000 7fdcacff9640 1 -- 10.20.193.110:0/1764288404 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fdca0011970 con 0x7fdcb0089250 2026-02-13T20:11:33.570 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.547+0000 7fdcacff9640 1 -- 10.20.193.110:0/1764288404 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 3531+0+0 (unknown 315507976 0 0) 0x7fdca004e810 con 0x7fdcb0089250 2026-02-13T20:11:33.570 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.548+0000 7fdcaffff640 10 monclient: get_auth_request con 0x7fdc8003fa50 auth_method 0 2026-02-13T20:11:33.570 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.550+0000 7fdcacff9640 1 -- 10.20.193.110:0/1764288404 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fdca00171a0 con 0x7fdcb0089250 2026-02-13T20:11:33.570 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.550+0000 7fdcacff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:33.570 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.550+0000 7fdcacff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:11:33.681 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.679+0000 7fdcb66cc640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-13T20:11:33.682 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.679+0000 7fdcb66cc640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-13T20:11:33.682 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.679+0000 7fdcb66cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:33.682 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.679+0000 7fdcb66cc640 1 -- 10.20.193.110:0/1764288404 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fdcb0111fd0 con 0x7fdcb0089250 2026-02-13T20:11:33.682 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.679+0000 7fdcacff9640 1 -- 10.20.193.110:0/1764288404 <== mon.2 v1:10.20.193.110:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (unknown 3730786198 0 4185958460) 0x7fdcb0111fd0 con 0x7fdcb0089250 2026-02-13T20:11:33.682 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.679+0000 7fdcacff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-13T20:11:33.682 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.679+0000 7fdcacff9640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:11:33.682 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:33.682 INFO:teuthology.orchestra.run.trial110.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-13T20:11:33.682 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.680+0000 7fdcb66cc640 1 -- 10.20.193.110:0/1764288404 >> v1:10.20.193.188:6812/1623052694 conn(0x7fdc8003fa50 legacy=0x7fdc8005ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:33.682 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.680+0000 7fdcb66cc640 10 monclient: shutdown 2026-02-13T20:11:33.683 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.680+0000 7fdcb66cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:33.683 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.680+0000 7fdcb66cc640 1 -- 10.20.193.110:0/1764288404 >> v1:10.20.193.110:6790/0 conn(0x7fdcb0089250 legacy=0x7fdcb0171e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:33.683 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.680+0000 7fdcb66cc640 1 -- 10.20.193.110:0/1764288404 shutdown_connections 2026-02-13T20:11:33.683 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.681+0000 7fdcb66cc640 1 -- 10.20.193.110:0/1764288404 >> 10.20.193.110:0/1764288404 conn(0x7fdcb0054330 msgr2=0x7fdcb0090d10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:33.683 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.681+0000 7fdcb66cc640 1 -- 10.20.193.110:0/1764288404 shutdown_connections 2026-02-13T20:11:33.683 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.681+0000 7fdcb66cc640 1 -- 10.20.193.110:0/1764288404 wait complete. 2026-02-13T20:11:33.690 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-13T20:11:33.690 INFO:teuthology.run_tasks:Running task mon_thrash... 2026-02-13T20:11:33.707 INFO:tasks.mon_thrash:Beginning mon_thrash... 2026-02-13T20:11:33.707 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-13T20:11:33.772 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.770+0000 7f236b4cc640 10 monclient: get_monmap_and_config 2026-02-13T20:11:33.772 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.770+0000 7f236b4cc640 10 monclient: build_initial_monmap 2026-02-13T20:11:33.772 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.770+0000 7f236b4cc640 10 monclient: monmap: 2026-02-13T20:11:33.772 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:33.772 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:33.772 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:33.771660+0000 2026-02-13T20:11:33.772 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:33.771660+0000 2026-02-13T20:11:33.772 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:33.772 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:33.772 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:33.772 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:33.772 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:33.772 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:33.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.770+0000 7f236b4cc640 1 Processor -- start 2026-02-13T20:11:33.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.770+0000 7f236b4cc640 1 -- start start 2026-02-13T20:11:33.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.770+0000 7f236b4cc640 10 monclient: init 2026-02-13T20:11:33.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.771+0000 7f236b4cc640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:33.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.771+0000 7f236b4cc640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:11:33.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.771+0000 7f236b4cc640 10 monclient(hunting): picked mon.noname-c con 0x7f2364089250 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:33.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.771+0000 7f236b4cc640 10 monclient(hunting): picked mon.noname-a con 0x7f2364057780 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:33.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.771+0000 7f236b4cc640 10 monclient(hunting): picked mon.noname-b con 0x7f2364184b60 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:33.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.771+0000 7f236b4cc640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f236408a950 con 0x7f2364057780 2026-02-13T20:11:33.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.771+0000 7f236b4cc640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2364089620 con 0x7f2364089250 2026-02-13T20:11:33.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.771+0000 7f236b4cc640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2364057c60 con 0x7f2364184b60 2026-02-13T20:11:33.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.771+0000 7f236b4cc640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:33.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.771+0000 7f236b4cc640 10 monclient(hunting): authenticate will time out at 655.462207s 2026-02-13T20:11:33.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.771+0000 7f2368a40640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f2364057780 0x7f2364183440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:60226/0 (socket says 10.20.193.110:60226) 2026-02-13T20:11:33.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.771+0000 7f2368a40640 1 -- 10.20.193.110:0/4200943245 learned_addr learned my addr 10.20.193.110:0/4200943245 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:33.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.771+0000 7f2353fff640 1 -- 10.20.193.110:0/4200943245 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3544781848 0 0) 0x7f236408a950 con 0x7f2364057780 2026-02-13T20:11:33.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.771+0000 7f2353fff640 10 monclient(hunting): _negotiate 2026-02-13T20:11:33.775 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.771+0000 7f2353fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:33.775 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.771+0000 7f2353fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:33.775 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.771+0000 7f2353fff640 10 monclient(hunting): my global_id is 4371 2026-02-13T20:11:33.775 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.771+0000 7f2353fff640 1 -- 10.20.193.110:0/4200943245 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f234c0035e0 con 0x7f2364057780 2026-02-13T20:11:33.775 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.771+0000 7f2353fff640 1 -- 10.20.193.110:0/4200943245 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4125425009 0 0) 0x7f2364057c60 con 0x7f2364184b60 2026-02-13T20:11:33.775 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.771+0000 7f2353fff640 10 monclient(hunting): _negotiate 2026-02-13T20:11:33.775 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.771+0000 7f2353fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:33.775 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.771+0000 7f2353fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:33.775 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.771+0000 7f2353fff640 10 monclient(hunting): my global_id is 4376 2026-02-13T20:11:33.775 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.771+0000 7f2353fff640 1 -- 10.20.193.110:0/4200943245 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f236408a950 con 0x7f2364184b60 2026-02-13T20:11:33.775 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.771+0000 7f2353fff640 1 -- 10.20.193.110:0/4200943245 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1073296648 0 0) 0x7f234c0035e0 con 0x7f2364057780 2026-02-13T20:11:33.775 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.771+0000 7f2353fff640 1 -- 10.20.193.110:0/4200943245 >> v1:10.20.193.110:6790/0 conn(0x7f2364184b60 legacy=0x7f23641a4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:33.775 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.771+0000 7f2353fff640 1 -- 10.20.193.110:0/4200943245 >> v1:10.20.193.188:6789/0 conn(0x7f2364089250 legacy=0x7f23640580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:33.775 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.771+0000 7f2353fff640 10 monclient: _finish_hunting 0 2026-02-13T20:11:33.775 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.771+0000 7f2353fff640 1 monclient: found mon.noname-a 2026-02-13T20:11:33.775 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.771+0000 7f2353fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:33.775 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.771+0000 7f2353fff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:11:33.775 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.771+0000 7f2353fff640 1 -- 10.20.193.110:0/4200943245 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2364089a50 con 0x7f2364057780 2026-02-13T20:11:33.775 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.771+0000 7f2353fff640 10 monclient: _finish_auth 0 2026-02-13T20:11:33.775 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.771+0000 7f2353fff640 10 monclient: _check_auth_tickets 2026-02-13T20:11:33.775 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.771+0000 7f2353fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:33.775 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.771+0000 7f2353fff640 1 -- 10.20.193.110:0/4200943245 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f2358002dd0 con 0x7f2364057780 2026-02-13T20:11:33.775 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.771+0000 7f2353fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:33.775 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.771+0000 7f2353fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:11:33.775 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.771+0000 7f2353fff640 10 monclient: dump: 2026-02-13T20:11:33.775 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:33.775 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:33.776 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:33.776 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:33.776 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:33.776 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:33.776 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:33.776 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:33.776 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:33.776 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:33.776 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.771+0000 7f236b4cc640 5 monclient: authenticate success, global_id 4371 2026-02-13T20:11:33.776 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.771+0000 7f236b4cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:33.776 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.771+0000 7f2353fff640 1 -- 10.20.193.110:0/4200943245 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2358003010 con 0x7f2364057780 2026-02-13T20:11:33.776 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.771+0000 7f2353fff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:33.776 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.771+0000 7f2353fff640 1 -- 10.20.193.110:0/4200943245 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f2358003420 con 0x7f2364057780 2026-02-13T20:11:33.776 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.771+0000 7f2353fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:33.776 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.771+0000 7f2353fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:33.776 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.771+0000 7f2353fff640 10 monclient: dump: 2026-02-13T20:11:33.776 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:33.776 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:33.776 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:33.776 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:33.776 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:33.776 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:33.776 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:33.776 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:33.776 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:33.776 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:33.776 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.771+0000 7f236b4cc640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:33.776 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.771+0000 7f236b4cc640 4 set_mon_vals no callback set 2026-02-13T20:11:33.776 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.772+0000 7f236b4cc640 10 monclient: shutdown 2026-02-13T20:11:33.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.772+0000 7f236b4cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:33.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.772+0000 7f236b4cc640 1 -- 10.20.193.110:0/4200943245 >> v1:10.20.193.110:6789/0 conn(0x7f2364057780 legacy=0x7f2364183440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:33.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.772+0000 7f236b4cc640 1 -- 10.20.193.110:0/4200943245 shutdown_connections 2026-02-13T20:11:33.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.772+0000 7f236b4cc640 1 -- 10.20.193.110:0/4200943245 >> 10.20.193.110:0/4200943245 conn(0x7f2364054330 msgr2=0x7f2364054730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:33.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.772+0000 7f236b4cc640 1 -- 10.20.193.110:0/4200943245 shutdown_connections 2026-02-13T20:11:33.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.772+0000 7f236b4cc640 1 -- 10.20.193.110:0/4200943245 wait complete. 2026-02-13T20:11:33.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.772+0000 7f236b4cc640 10 monclient: build_initial_monmap 2026-02-13T20:11:33.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.772+0000 7f236b4cc640 10 monclient: monmap: 2026-02-13T20:11:33.778 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:33.778 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:33.779 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:11:33.779 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:11:33.779 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:33.779 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:11:33.779 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:33.779 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:33.779 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:33.779 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:33.779 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.772+0000 7f236b4cc640 1 Processor -- start 2026-02-13T20:11:33.779 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.772+0000 7f236b4cc640 1 -- start start 2026-02-13T20:11:33.779 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.772+0000 7f236b4cc640 10 monclient: init 2026-02-13T20:11:33.779 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f236b4cc640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:33.779 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f236b4cc640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:11:33.779 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f236b4cc640 10 monclient(hunting): picked mon.noname-c con 0x7f2364057780 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:33.779 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f236b4cc640 10 monclient(hunting): picked mon.noname-b con 0x7f2364089250 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:33.779 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f236b4cc640 10 monclient(hunting): picked mon.noname-a con 0x7f2364184b60 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:33.779 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f236b4cc640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2364062300 con 0x7f2364184b60 2026-02-13T20:11:33.779 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f236b4cc640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f236412b4b0 con 0x7f2364089250 2026-02-13T20:11:33.779 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f236b4cc640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2364111890 con 0x7f2364057780 2026-02-13T20:11:33.779 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f236b4cc640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:33.779 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f236b4cc640 10 monclient(hunting): authenticate will time out at 655.464197s 2026-02-13T20:11:33.779 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f2369241640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f2364057780 0x7f236412ada0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:39920/0 (socket says 10.20.193.110:39920) 2026-02-13T20:11:33.779 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f2369241640 1 -- 10.20.193.110:0/1824534034 learned_addr learned my addr 10.20.193.110:0/1824534034 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:33.779 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f2351ffb640 1 -- 10.20.193.110:0/1824534034 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4215076910 0 0) 0x7f2364111890 con 0x7f2364057780 2026-02-13T20:11:33.779 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f2351ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:11:33.779 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f2351ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:33.779 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f2351ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:33.779 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f2351ffb640 10 monclient(hunting): my global_id is 4379 2026-02-13T20:11:33.779 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f2351ffb640 1 -- 10.20.193.110:0/1824534034 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23340035e0 con 0x7f2364057780 2026-02-13T20:11:33.780 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f2351ffb640 1 -- 10.20.193.110:0/1824534034 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 461261355 0 0) 0x7f236408a950 con 0x7f2364184b60 2026-02-13T20:11:33.780 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f2351ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:11:33.780 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f2351ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:33.780 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f2351ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:33.780 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f2351ffb640 10 monclient(hunting): my global_id is 4374 2026-02-13T20:11:33.780 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f2351ffb640 1 -- 10.20.193.110:0/1824534034 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2364111890 con 0x7f2364184b60 2026-02-13T20:11:33.780 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f2351ffb640 1 -- 10.20.193.110:0/1824534034 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2486077091 0 0) 0x7f23340035e0 con 0x7f2364057780 2026-02-13T20:11:33.780 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f2351ffb640 1 -- 10.20.193.110:0/1824534034 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f236408a950 con 0x7f2364057780 2026-02-13T20:11:33.780 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f2351ffb640 1 -- 10.20.193.110:0/1824534034 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f2354003170 con 0x7f2364057780 2026-02-13T20:11:33.780 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f2351ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:33.780 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f2351ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:11:33.780 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f2351ffb640 10 monclient(hunting): dump: 2026-02-13T20:11:33.780 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:33.780 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:33.780 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:33.780 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:33.780 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:33.780 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:33.780 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:33.780 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:33.780 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:33.780 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:33.780 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f2351ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:33.780 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f2351ffb640 1 -- 10.20.193.110:0/1824534034 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2024503777 0 0) 0x7f2364111890 con 0x7f2364184b60 2026-02-13T20:11:33.780 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f2351ffb640 1 -- 10.20.193.110:0/1824534034 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f23340035e0 con 0x7f2364184b60 2026-02-13T20:11:33.780 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f2351ffb640 1 -- 10.20.193.110:0/1824534034 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f2360004170 con 0x7f2364184b60 2026-02-13T20:11:33.780 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f2351ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:33.780 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f2351ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:33.780 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f2351ffb640 10 monclient(hunting): dump: 2026-02-13T20:11:33.781 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:33.781 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:33.781 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:33.781 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:33.781 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:33.781 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:33.781 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:33.781 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:33.781 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:33.781 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:33.781 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f2351ffb640 1 -- 10.20.193.110:0/1824534034 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4016166701 0 0) 0x7f236408a950 con 0x7f2364057780 2026-02-13T20:11:33.781 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f2351ffb640 1 -- 10.20.193.110:0/1824534034 >> v1:10.20.193.188:6789/0 conn(0x7f2364089250 legacy=0x7f2364172160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:33.781 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f2351ffb640 1 -- 10.20.193.110:0/1824534034 >> v1:10.20.193.110:6789/0 conn(0x7f2364184b60 legacy=0x7f2364173880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:33.781 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f2351ffb640 10 monclient: _finish_hunting 0 2026-02-13T20:11:33.781 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f2351ffb640 1 monclient: found mon.c 2026-02-13T20:11:33.781 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f2351ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:33.781 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f2351ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:33.781 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f2351ffb640 1 -- 10.20.193.110:0/1824534034 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23641103a0 con 0x7f2364057780 2026-02-13T20:11:33.781 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f2351ffb640 10 monclient: _finish_auth 0 2026-02-13T20:11:33.781 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f2351ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:11:33.781 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f2351ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:33.781 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f236b4cc640 5 monclient: authenticate success, global_id 4379 2026-02-13T20:11:33.781 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f236b4cc640 10 monclient: _renew_subs 2026-02-13T20:11:33.781 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f236b4cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:33.781 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f236b4cc640 1 -- 10.20.193.110:0/1824534034 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2364112700 con 0x7f2364057780 2026-02-13T20:11:33.781 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f236b4cc640 10 monclient: _renew_subs 2026-02-13T20:11:33.781 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f236b4cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:33.781 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f236b4cc640 1 -- 10.20.193.110:0/1824534034 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f2364110f00 con 0x7f2364057780 2026-02-13T20:11:33.781 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f2351ffb640 1 -- 10.20.193.110:0/1824534034 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f23540032d0 con 0x7f2364057780 2026-02-13T20:11:33.781 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f2351ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:33.781 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f2351ffb640 1 -- 10.20.193.110:0/1824534034 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f2354003b30 con 0x7f2364057780 2026-02-13T20:11:33.782 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f2351ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:33.782 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f2351ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:33.782 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f23537fe640 4 set_mon_vals no callback set 2026-02-13T20:11:33.782 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.773+0000 7f2351ffb640 10 monclient: dump: 2026-02-13T20:11:33.782 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:33.782 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:33.782 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:33.782 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:33.782 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:33.782 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:33.782 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:33.782 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:33.782 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:33.782 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:33.782 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.774+0000 7f236b4cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:33.782 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.774+0000 7f236b4cc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:33.782 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.774+0000 7f236b4cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:33.782 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.774+0000 7f236b4cc640 1 -- 10.20.193.110:0/1824534034 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2364089030 con 0x7f2364057780 2026-02-13T20:11:33.782 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.774+0000 7f2351ffb640 1 -- 10.20.193.110:0/1824534034 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f2354003c90 con 0x7f2364057780 2026-02-13T20:11:33.782 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.774+0000 7f2351ffb640 1 -- 10.20.193.110:0/1824534034 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 3531+0+0 (unknown 315507976 0 0) 0x7f235404e7d0 con 0x7f2364057780 2026-02-13T20:11:33.782 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.774+0000 7f2368a40640 10 monclient: get_auth_request con 0x7f233403faa0 auth_method 0 2026-02-13T20:11:33.782 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.776+0000 7f2351ffb640 1 -- 10.20.193.110:0/1824534034 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f2354017100 con 0x7f2364057780 2026-02-13T20:11:33.782 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.776+0000 7f2351ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:33.782 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.776+0000 7f2351ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:11:33.881 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.879+0000 7f236b4cc640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-13T20:11:33.881 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.879+0000 7f236b4cc640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-13T20:11:33.881 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.879+0000 7f236b4cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:33.881 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.879+0000 7f236b4cc640 1 -- 10.20.193.110:0/1824534034 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f236408e700 con 0x7f2364057780 2026-02-13T20:11:33.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.880+0000 7f2351ffb640 1 -- 10.20.193.110:0/1824534034 <== mon.2 v1:10.20.193.110:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+10990 (unknown 3413328019 0 4152019052) 0x7f2354015090 con 0x7f2364057780 2026-02-13T20:11:33.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.880+0000 7f2351ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-13T20:11:33.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.880+0000 7f2351ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:11:33.882 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:33.882 INFO:teuthology.orchestra.run.trial110.stdout:{"epoch":20,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","created":"2026-02-13T20:11:18.047609+0000","modified":"2026-02-13T20:11:32.817344+0000","last_up_change":"2026-02-13T20:11:22.252754+0000","last_in_change":"2026-02-13T20:11:19.250528+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T20:11:24.136325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-13T20:11:27.043171+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88457b09-7bbe-4ebe-8a8b-4c980153af2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6808","nonce":2638069221}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6809","nonce":2638069221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6811","nonce":2638069221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6810","nonce":2638069221}]},"public_addr":"10.20.193.110:6808/2638069221","cluster_addr":"10.20.193.110:6809/2638069221","heartbeat_back_addr":"10.20.193.110:6811/2638069221","heartbeat_front_addr":"10.20.193.110:6810/2638069221","state":["exists","up"]},{"osd":1,"uuid":"efb2f419-77ef-44b0-ae26-4c448073556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6800","nonce":3182322764}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6801","nonce":3182322764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6803","nonce":3182322764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6802","nonce":3182322764}]},"public_addr":"10.20.193.110:6800/3182322764","cluster_addr":"10.20.193.110:6801/3182322764","heartbeat_back_addr":"10.20.193.110:6803/3182322764","heartbeat_front_addr":"10.20.193.110:6802/3182322764","state":["exists","up"]},{"osd":2,"uuid":"c5a08402-8e10-4d4d-87fe-6236a6766128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6804","nonce":2437753968}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6805","nonce":2437753968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6807","nonce":2437753968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6806","nonce":2437753968}]},"public_addr":"10.20.193.110:6804/2437753968","cluster_addr":"10.20.193.110:6805/2437753968","heartbeat_back_addr":"10.20.193.110:6807/2437753968","heartbeat_front_addr":"10.20.193.110:6806/2437753968","state":["exists","up"]},{"osd":3,"uuid":"3062e357-c62b-4a5d-a4b2-9715c16cfd37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6800","nonce":3648478668}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6801","nonce":3648478668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6803","nonce":3648478668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6802","nonce":3648478668}]},"public_addr":"10.20.193.188:6800/3648478668","cluster_addr":"10.20.193.188:6801/3648478668","heartbeat_back_addr":"10.20.193.188:6803/3648478668","heartbeat_front_addr":"10.20.193.188:6802/3648478668","state":["exists","up"]},{"osd":4,"uuid":"718e9755-3c16-47c8-9df8-c08e4193063d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6804","nonce":1615982170}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6806","nonce":1615982170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6810","nonce":1615982170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6808","nonce":1615982170}]},"public_addr":"10.20.193.188:6804/1615982170","cluster_addr":"10.20.193.188:6806/1615982170","heartbeat_back_addr":"10.20.193.188:6810/1615982170","heartbeat_front_addr":"10.20.193.188:6808/1615982170","state":["exists","up"]},{"osd":5,"uuid":"1508f970-10c7-486a-96d1-76881e826af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6805","nonce":4130810301}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6807","nonce":4130810301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6811","nonce":4130810301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6809","nonce":4130810301}]},"public_addr":"10.20.193.188:6805/4130810301","cluster_addr":"10.20.193.188:6807/4130810301","heartbeat_back_addr":"10.20.193.188:6811/4130810301","heartbeat_front_addr":"10.20.193.188:6809/4130810301","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T20:11:20.798845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T20:11:20.817774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T20:11:20.860524+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T20:11:20.994431+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T20:11:20.970325+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T20:11:21.011291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T20:11:33.883 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.881+0000 7f236b4cc640 1 -- 10.20.193.110:0/1824534034 >> v1:10.20.193.188:6812/1623052694 conn(0x7f233403faa0 legacy=0x7f233405ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:33.883 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.881+0000 7f236b4cc640 10 monclient: shutdown 2026-02-13T20:11:33.883 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.881+0000 7f236b4cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:33.883 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.881+0000 7f236b4cc640 1 -- 10.20.193.110:0/1824534034 >> v1:10.20.193.110:6790/0 conn(0x7f2364057780 legacy=0x7f236412ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:33.883 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.881+0000 7f236b4cc640 1 -- 10.20.193.110:0/1824534034 shutdown_connections 2026-02-13T20:11:33.883 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.881+0000 7f236b4cc640 1 -- 10.20.193.110:0/1824534034 >> 10.20.193.110:0/1824534034 conn(0x7f2364054330 msgr2=0x7f23640910e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:33.883 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.881+0000 7f236b4cc640 1 -- 10.20.193.110:0/1824534034 shutdown_connections 2026-02-13T20:11:33.883 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.881+0000 7f236b4cc640 1 -- 10.20.193.110:0/1824534034 wait complete. 2026-02-13T20:11:33.891 INFO:tasks.mon_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-02-13T20:11:24.136325+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.059999942779541, 'score_stable': 6.059999942779541, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2026-02-13T20:11:27.043171+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 19, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2026-02-13T20:11:33.891 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2026-02-13T20:11:33.959 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.957+0000 7f745579d640 10 monclient: get_monmap_and_config 2026-02-13T20:11:33.959 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.957+0000 7f745579d640 10 monclient: build_initial_monmap 2026-02-13T20:11:33.959 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.957+0000 7f745579d640 10 monclient: monmap: 2026-02-13T20:11:33.959 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:33.959 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:33.959 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:33.958741+0000 2026-02-13T20:11:33.959 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:33.958741+0000 2026-02-13T20:11:33.959 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:33.959 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:33.959 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:33.959 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:33.959 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:33.959 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:33.961 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.957+0000 7f745579d640 1 Processor -- start 2026-02-13T20:11:33.961 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.957+0000 7f745579d640 1 -- start start 2026-02-13T20:11:33.961 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.957+0000 7f745579d640 10 monclient: init 2026-02-13T20:11:33.961 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.958+0000 7f745579d640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:33.961 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.958+0000 7f745579d640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:11:33.961 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.958+0000 7f745579d640 10 monclient(hunting): picked mon.noname-a con 0x7f7450057be0 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:33.961 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.958+0000 7f745579d640 10 monclient(hunting): picked mon.noname-c con 0x7f74500577a0 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:33.961 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.958+0000 7f745579d640 10 monclient(hunting): picked mon.noname-b con 0x7f7450089900 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:33.961 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.958+0000 7f745579d640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f745008aa20 con 0x7f7450057be0 2026-02-13T20:11:33.961 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.958+0000 7f745579d640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f745008a0f0 con 0x7f74500577a0 2026-02-13T20:11:33.961 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.958+0000 7f745579d640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f745008a3d0 con 0x7f7450089900 2026-02-13T20:11:33.961 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.958+0000 7f745579d640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:33.961 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.958+0000 7f745579d640 10 monclient(hunting): authenticate will time out at 655.649384s 2026-02-13T20:11:33.961 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.958+0000 7f744effd640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f7450057be0 0x7f7450057fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:60230/0 (socket says 10.20.193.110:60230) 2026-02-13T20:11:33.961 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.958+0000 7f744effd640 1 -- 10.20.193.110:0/1085906167 learned_addr learned my addr 10.20.193.110:0/1085906167 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:33.961 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.958+0000 7f744f7fe640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f7450089900 0x7f74501a4be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:39930/0 (socket says 10.20.193.110:39930) 2026-02-13T20:11:33.961 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.958+0000 7f744dffb640 1 -- 10.20.193.110:0/1085906167 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3379153516 0 0) 0x7f745008aa20 con 0x7f7450057be0 2026-02-13T20:11:33.961 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.958+0000 7f744dffb640 10 monclient(hunting): _negotiate 2026-02-13T20:11:33.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.958+0000 7f744dffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:33.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.958+0000 7f744dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:33.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.958+0000 7f744dffb640 10 monclient(hunting): my global_id is 4377 2026-02-13T20:11:33.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.958+0000 7f744dffb640 1 -- 10.20.193.110:0/1085906167 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f743c0035e0 con 0x7f7450057be0 2026-02-13T20:11:33.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.958+0000 7f744dffb640 1 -- 10.20.193.110:0/1085906167 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 873535828 0 0) 0x7f745008a3d0 con 0x7f7450089900 2026-02-13T20:11:33.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.958+0000 7f744dffb640 10 monclient(hunting): _negotiate 2026-02-13T20:11:33.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.958+0000 7f744dffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:33.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.958+0000 7f744dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:33.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.958+0000 7f744dffb640 10 monclient(hunting): my global_id is 4382 2026-02-13T20:11:33.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.958+0000 7f744dffb640 1 -- 10.20.193.110:0/1085906167 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f745008aa20 con 0x7f7450089900 2026-02-13T20:11:33.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.958+0000 7f744dffb640 1 -- 10.20.193.110:0/1085906167 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 747849868 0 0) 0x7f745008aa20 con 0x7f7450089900 2026-02-13T20:11:33.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.958+0000 7f744dffb640 1 -- 10.20.193.110:0/1085906167 >> v1:10.20.193.188:6789/0 conn(0x7f74500577a0 legacy=0x7f74501834b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:33.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.958+0000 7f744dffb640 1 -- 10.20.193.110:0/1085906167 >> v1:10.20.193.110:6789/0 conn(0x7f7450057be0 legacy=0x7f7450057fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:33.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.958+0000 7f744dffb640 10 monclient: _finish_hunting 0 2026-02-13T20:11:33.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.958+0000 7f744dffb640 1 monclient: found mon.noname-b 2026-02-13T20:11:33.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.958+0000 7f744dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:33.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.958+0000 7f744dffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:11:33.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.958+0000 7f744dffb640 1 -- 10.20.193.110:0/1085906167 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f745008a6b0 con 0x7f7450089900 2026-02-13T20:11:33.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.958+0000 7f744dffb640 10 monclient: _finish_auth 0 2026-02-13T20:11:33.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.958+0000 7f744dffb640 10 monclient: _check_auth_tickets 2026-02-13T20:11:33.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.958+0000 7f744dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:33.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.958+0000 7f744dffb640 1 -- 10.20.193.110:0/1085906167 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f7440003eb0 con 0x7f7450089900 2026-02-13T20:11:33.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.958+0000 7f744dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:33.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.958+0000 7f744dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:11:33.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.958+0000 7f744dffb640 10 monclient: dump: 2026-02-13T20:11:33.962 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:33.963 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:33.963 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:33.963 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:33.963 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:33.963 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:33.963 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:33.963 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:33.963 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:33.963 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:33.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.958+0000 7f745579d640 5 monclient: authenticate success, global_id 4382 2026-02-13T20:11:33.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.958+0000 7f745579d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:33.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.959+0000 7f744dffb640 1 -- 10.20.193.110:0/1085906167 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7440004040 con 0x7f7450089900 2026-02-13T20:11:33.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.959+0000 7f744dffb640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:33.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.959+0000 7f744dffb640 1 -- 10.20.193.110:0/1085906167 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f7440004450 con 0x7f7450089900 2026-02-13T20:11:33.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.959+0000 7f745579d640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:33.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.959+0000 7f745579d640 4 set_mon_vals no callback set 2026-02-13T20:11:33.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.959+0000 7f744dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:33.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.959+0000 7f744dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:33.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.959+0000 7f744dffb640 10 monclient: dump: 2026-02-13T20:11:33.963 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:33.963 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:33.963 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:33.963 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:33.963 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:33.963 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:33.963 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:33.963 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:33.963 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:33.963 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:33.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.959+0000 7f745579d640 10 monclient: shutdown 2026-02-13T20:11:33.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.959+0000 7f745579d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:33.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.959+0000 7f745579d640 1 -- 10.20.193.110:0/1085906167 >> v1:10.20.193.110:6790/0 conn(0x7f7450089900 legacy=0x7f74501a4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:33.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.959+0000 7f745579d640 1 -- 10.20.193.110:0/1085906167 shutdown_connections 2026-02-13T20:11:33.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.959+0000 7f745579d640 1 -- 10.20.193.110:0/1085906167 >> 10.20.193.110:0/1085906167 conn(0x7f7450054330 msgr2=0x7f7450054730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:33.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.959+0000 7f745579d640 1 -- 10.20.193.110:0/1085906167 shutdown_connections 2026-02-13T20:11:33.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.959+0000 7f745579d640 1 -- 10.20.193.110:0/1085906167 wait complete. 2026-02-13T20:11:33.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.959+0000 7f745579d640 10 monclient: build_initial_monmap 2026-02-13T20:11:33.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.959+0000 7f745579d640 10 monclient: monmap: 2026-02-13T20:11:33.965 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:33.966 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:33.966 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:11:33.966 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:11:33.966 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:33.966 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:11:33.966 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:33.966 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:33.966 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:33.966 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:33.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.959+0000 7f745579d640 1 Processor -- start 2026-02-13T20:11:33.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.959+0000 7f745579d640 1 -- start start 2026-02-13T20:11:33.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.959+0000 7f745579d640 10 monclient: init 2026-02-13T20:11:33.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f745579d640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:33.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f745579d640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:11:33.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f745579d640 10 monclient(hunting): picked mon.noname-c con 0x7f74500577a0 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:33.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f745579d640 10 monclient(hunting): picked mon.noname-b con 0x7f7450057be0 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:33.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f745579d640 10 monclient(hunting): picked mon.noname-a con 0x7f7450089900 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:33.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f745579d640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f745014c900 con 0x7f7450089900 2026-02-13T20:11:33.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f745579d640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7450062290 con 0x7f7450057be0 2026-02-13T20:11:33.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f745579d640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7450132ce0 con 0x7f74500577a0 2026-02-13T20:11:33.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f745579d640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:33.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f745579d640 10 monclient(hunting): authenticate will time out at 655.651196s 2026-02-13T20:11:33.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f744effd640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f74500577a0 0x7f745014c1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:39944/0 (socket says 10.20.193.110:39944) 2026-02-13T20:11:33.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f744effd640 1 -- 10.20.193.110:0/932014862 learned_addr learned my addr 10.20.193.110:0/932014862 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:33.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f742f7fe640 1 -- 10.20.193.110:0/932014862 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2970550184 0 0) 0x7f745014c900 con 0x7f7450089900 2026-02-13T20:11:33.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f742f7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:11:33.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f742f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:33.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f742f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:33.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f742f7fe640 10 monclient(hunting): my global_id is 4380 2026-02-13T20:11:33.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f742f7fe640 1 -- 10.20.193.110:0/932014862 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f741c0035e0 con 0x7f7450089900 2026-02-13T20:11:33.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f742f7fe640 1 -- 10.20.193.110:0/932014862 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 892050294 0 0) 0x7f7450132ce0 con 0x7f74500577a0 2026-02-13T20:11:33.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f742f7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:11:33.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f742f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:33.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f742f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:33.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f742f7fe640 10 monclient(hunting): my global_id is 4385 2026-02-13T20:11:33.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f742f7fe640 1 -- 10.20.193.110:0/932014862 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f745014c900 con 0x7f74500577a0 2026-02-13T20:11:33.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f742f7fe640 1 -- 10.20.193.110:0/932014862 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1257169037 0 0) 0x7f741c0035e0 con 0x7f7450089900 2026-02-13T20:11:33.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f742f7fe640 1 -- 10.20.193.110:0/932014862 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7450132ce0 con 0x7f7450089900 2026-02-13T20:11:33.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f742f7fe640 1 -- 10.20.193.110:0/932014862 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f7440003970 con 0x7f7450089900 2026-02-13T20:11:33.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f742f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:33.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f742f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:11:33.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f742f7fe640 10 monclient(hunting): dump: 2026-02-13T20:11:33.967 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:33.967 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:33.967 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:33.967 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:33.967 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:33.967 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:33.967 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:33.967 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:33.967 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:33.967 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:33.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f742f7fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:33.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f742f7fe640 1 -- 10.20.193.110:0/932014862 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1668328371 0 0) 0x7f745014c900 con 0x7f74500577a0 2026-02-13T20:11:33.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f742f7fe640 1 -- 10.20.193.110:0/932014862 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f741c0035e0 con 0x7f74500577a0 2026-02-13T20:11:33.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f742f7fe640 1 -- 10.20.193.110:0/932014862 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f74440031f0 con 0x7f74500577a0 2026-02-13T20:11:33.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f742f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:33.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f742f7fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:33.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f742f7fe640 10 monclient(hunting): dump: 2026-02-13T20:11:33.967 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:33.968 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:33.968 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:33.968 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:33.968 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:33.968 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:33.968 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:33.968 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:33.968 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:33.968 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:33.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f742f7fe640 1 -- 10.20.193.110:0/932014862 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3090155009 0 0) 0x7f7450062290 con 0x7f7450057be0 2026-02-13T20:11:33.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f742f7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:11:33.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f742f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:33.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f742f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:33.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f742f7fe640 10 monclient(hunting): my global_id is 4369 2026-02-13T20:11:33.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f742f7fe640 1 -- 10.20.193.110:0/932014862 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f745014c900 con 0x7f7450057be0 2026-02-13T20:11:33.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f742f7fe640 1 -- 10.20.193.110:0/932014862 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3438236082 0 0) 0x7f7450132ce0 con 0x7f7450089900 2026-02-13T20:11:33.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f742f7fe640 1 -- 10.20.193.110:0/932014862 >> v1:10.20.193.110:6790/0 conn(0x7f74500577a0 legacy=0x7f745014c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:33.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f742f7fe640 1 -- 10.20.193.110:0/932014862 >> v1:10.20.193.188:6789/0 conn(0x7f7450057be0 legacy=0x7f74501935b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:33.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f742f7fe640 10 monclient: _finish_hunting 0 2026-02-13T20:11:33.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f742f7fe640 1 monclient: found mon.a 2026-02-13T20:11:33.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f742f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:33.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f742f7fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:33.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f742f7fe640 1 -- 10.20.193.110:0/932014862 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74501317f0 con 0x7f7450089900 2026-02-13T20:11:33.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f742f7fe640 10 monclient: _finish_auth 0 2026-02-13T20:11:33.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f742f7fe640 10 monclient: _check_auth_tickets 2026-02-13T20:11:33.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f742f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:33.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f745579d640 5 monclient: authenticate success, global_id 4380 2026-02-13T20:11:33.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f745579d640 10 monclient: _renew_subs 2026-02-13T20:11:33.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f745579d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:33.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f745579d640 1 -- 10.20.193.110:0/932014862 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7450133b50 con 0x7f7450089900 2026-02-13T20:11:33.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f745579d640 10 monclient: _renew_subs 2026-02-13T20:11:33.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f745579d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:33.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f745579d640 1 -- 10.20.193.110:0/932014862 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7450132350 con 0x7f7450089900 2026-02-13T20:11:33.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f742f7fe640 1 -- 10.20.193.110:0/932014862 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f74400043a0 con 0x7f7450089900 2026-02-13T20:11:33.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f742f7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:33.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f742f7fe640 1 -- 10.20.193.110:0/932014862 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f7440005de0 con 0x7f7450089900 2026-02-13T20:11:33.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f742f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:33.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f742f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:33.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f744d7fa640 4 set_mon_vals no callback set 2026-02-13T20:11:33.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.960+0000 7f742f7fe640 10 monclient: dump: 2026-02-13T20:11:33.969 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:33.969 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:33.969 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:33.969 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:33.969 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:33.969 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:33.969 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:33.969 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:33.969 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:33.969 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:33.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.961+0000 7f745579d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:33.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.961+0000 7f745579d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:33.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.961+0000 7f745579d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:33.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.961+0000 7f745579d640 1 -- 10.20.193.110:0/932014862 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74500008d0 con 0x7f7450089900 2026-02-13T20:11:33.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.961+0000 7f742f7fe640 1 -- 10.20.193.110:0/932014862 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f7440012a50 con 0x7f7450089900 2026-02-13T20:11:33.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.961+0000 7f742f7fe640 1 -- 10.20.193.110:0/932014862 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 3531+0+0 (unknown 315507976 0 0) 0x7f744004f8a0 con 0x7f7450089900 2026-02-13T20:11:33.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.961+0000 7f744effd640 10 monclient: get_auth_request con 0x7f741c03fcc0 auth_method 0 2026-02-13T20:11:33.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.963+0000 7f742f7fe640 1 -- 10.20.193.110:0/932014862 <== mon.0 v1:10.20.193.110:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f7440018230 con 0x7f7450089900 2026-02-13T20:11:33.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.963+0000 7f742f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:33.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:33.963+0000 7f742f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:11:34.068 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.066+0000 7f745579d640 10 start_mon_command cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2026-02-13T20:11:34.068 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.066+0000 7f745579d640 10 monclient: _send_command 2 [{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2026-02-13T20:11:34.068 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.066+0000 7f745579d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:34.068 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.066+0000 7f745579d640 1 -- 10.20.193.110:0/932014862 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7450132650 con 0x7f7450089900 2026-02-13T20:11:34.068 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.066+0000 7f742f7fe640 1 -- 10.20.193.110:0/932014862 <== mon.0 v1:10.20.193.110:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (unknown 3471955896 0 2170607528) 0x7f74400179e0 con 0x7f7450089900 2026-02-13T20:11:34.068 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.066+0000 7f742f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2026-02-13T20:11:34.068 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.066+0000 7f742f7fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:11:34.068 INFO:teuthology.orchestra.run.trial110.stdout:pg_num: 1 2026-02-13T20:11:34.069 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.067+0000 7f745579d640 1 -- 10.20.193.110:0/932014862 >> v1:10.20.193.188:6812/1623052694 conn(0x7f741c03fcc0 legacy=0x7f741c060170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:34.069 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.067+0000 7f745579d640 10 monclient: shutdown 2026-02-13T20:11:34.069 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.067+0000 7f745579d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:34.069 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.067+0000 7f745579d640 1 -- 10.20.193.110:0/932014862 >> v1:10.20.193.110:6789/0 conn(0x7f7450089900 legacy=0x7f7450194cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:34.069 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.067+0000 7f745579d640 1 -- 10.20.193.110:0/932014862 shutdown_connections 2026-02-13T20:11:34.069 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.067+0000 7f745579d640 1 -- 10.20.193.110:0/932014862 >> 10.20.193.110:0/932014862 conn(0x7f7450054330 msgr2=0x7f745008c550 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:34.069 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.067+0000 7f745579d640 1 -- 10.20.193.110:0/932014862 shutdown_connections 2026-02-13T20:11:34.069 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.067+0000 7f745579d640 1 -- 10.20.193.110:0/932014862 wait complete. 2026-02-13T20:11:34.076 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2026-02-13T20:11:34.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.140+0000 7f2b44cc3640 10 monclient: get_monmap_and_config 2026-02-13T20:11:34.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.140+0000 7f2b44cc3640 10 monclient: build_initial_monmap 2026-02-13T20:11:34.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.140+0000 7f2b44cc3640 10 monclient: monmap: 2026-02-13T20:11:34.142 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:34.142 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:34.142 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:34.142119+0000 2026-02-13T20:11:34.143 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:34.142119+0000 2026-02-13T20:11:34.143 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:34.143 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:34.143 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:34.143 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:34.143 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:34.143 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:34.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.141+0000 7f2b44cc3640 1 Processor -- start 2026-02-13T20:11:34.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.141+0000 7f2b44cc3640 1 -- start start 2026-02-13T20:11:34.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.141+0000 7f2b44cc3640 10 monclient: init 2026-02-13T20:11:34.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.141+0000 7f2b44cc3640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:34.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.141+0000 7f2b44cc3640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:11:34.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.141+0000 7f2b44cc3640 10 monclient(hunting): picked mon.noname-b con 0x7f2b401401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:34.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.141+0000 7f2b44cc3640 10 monclient(hunting): picked mon.noname-c con 0x7f2b40092020 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:34.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.141+0000 7f2b44cc3640 10 monclient(hunting): picked mon.noname-a con 0x7f2b40091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:34.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.141+0000 7f2b44cc3640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b4008b730 con 0x7f2b40091950 2026-02-13T20:11:34.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.141+0000 7f2b44cc3640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b4005c5b0 con 0x7f2b40092020 2026-02-13T20:11:34.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.141+0000 7f2b44cc3640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b4008bcf0 con 0x7f2b401401c0 2026-02-13T20:11:34.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.141+0000 7f2b44cc3640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:34.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.141+0000 7f2b44cc3640 10 monclient(hunting): authenticate will time out at 655.832456s 2026-02-13T20:11:34.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.141+0000 7f2b3e575640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f2b401401c0 0x7f2b40091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:39952/0 (socket says 10.20.193.110:39952) 2026-02-13T20:11:34.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.141+0000 7f2b3e575640 1 -- 10.20.193.110:0/3195594141 learned_addr learned my addr 10.20.193.110:0/3195594141 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:34.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.141+0000 7f2b3d573640 1 -- 10.20.193.110:0/3195594141 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3371085984 0 0) 0x7f2b4008bcf0 con 0x7f2b401401c0 2026-02-13T20:11:34.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.141+0000 7f2b3d573640 10 monclient(hunting): _negotiate 2026-02-13T20:11:34.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.141+0000 7f2b3d573640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:34.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.141+0000 7f2b3d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:34.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.141+0000 7f2b3d573640 10 monclient(hunting): my global_id is 4388 2026-02-13T20:11:34.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.141+0000 7f2b3d573640 1 -- 10.20.193.110:0/3195594141 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b2c0035e0 con 0x7f2b401401c0 2026-02-13T20:11:34.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.141+0000 7f2b3d573640 1 -- 10.20.193.110:0/3195594141 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1759127353 0 0) 0x7f2b4008b730 con 0x7f2b40091950 2026-02-13T20:11:34.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.141+0000 7f2b3d573640 10 monclient(hunting): _negotiate 2026-02-13T20:11:34.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.141+0000 7f2b3d573640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:34.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.141+0000 7f2b3d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:34.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.141+0000 7f2b3d573640 10 monclient(hunting): my global_id is 4383 2026-02-13T20:11:34.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.141+0000 7f2b3d573640 1 -- 10.20.193.110:0/3195594141 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b4008bcf0 con 0x7f2b40091950 2026-02-13T20:11:34.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.141+0000 7f2b3d573640 1 -- 10.20.193.110:0/3195594141 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2840064777 0 0) 0x7f2b2c0035e0 con 0x7f2b401401c0 2026-02-13T20:11:34.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.141+0000 7f2b3d573640 1 -- 10.20.193.110:0/3195594141 >> v1:10.20.193.188:6789/0 conn(0x7f2b40092020 legacy=0x7f2b401812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:34.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.141+0000 7f2b3d573640 1 -- 10.20.193.110:0/3195594141 >> v1:10.20.193.110:6789/0 conn(0x7f2b40091950 legacy=0x7f2b401a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:34.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.141+0000 7f2b3d573640 10 monclient: _finish_hunting 0 2026-02-13T20:11:34.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.141+0000 7f2b3d573640 1 monclient: found mon.noname-b 2026-02-13T20:11:34.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.141+0000 7f2b3d573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:34.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.141+0000 7f2b3d573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:11:34.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.141+0000 7f2b3d573640 1 -- 10.20.193.110:0/3195594141 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b40140590 con 0x7f2b401401c0 2026-02-13T20:11:34.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.141+0000 7f2b3d573640 10 monclient: _finish_auth 0 2026-02-13T20:11:34.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.141+0000 7f2b3d573640 10 monclient: _check_auth_tickets 2026-02-13T20:11:34.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.141+0000 7f2b3d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:34.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.141+0000 7f2b3d573640 1 -- 10.20.193.110:0/3195594141 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f2b34002dd0 con 0x7f2b401401c0 2026-02-13T20:11:34.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.141+0000 7f2b44cc3640 5 monclient: authenticate success, global_id 4388 2026-02-13T20:11:34.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.141+0000 7f2b44cc3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:34.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.141+0000 7f2b3d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:34.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.141+0000 7f2b3d573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:11:34.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.141+0000 7f2b3d573640 10 monclient: dump: 2026-02-13T20:11:34.147 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:34.147 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:34.147 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.147 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.147 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:34.147 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:34.148 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:34.148 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:34.148 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:34.148 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:34.148 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.141+0000 7f2b44cc3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:34.148 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.142+0000 7f2b3d573640 1 -- 10.20.193.110:0/3195594141 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2b34002fe0 con 0x7f2b401401c0 2026-02-13T20:11:34.148 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.142+0000 7f2b3d573640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:34.148 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.142+0000 7f2b44cc3640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:34.148 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.142+0000 7f2b44cc3640 4 set_mon_vals no callback set 2026-02-13T20:11:34.148 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.142+0000 7f2b3d573640 1 -- 10.20.193.110:0/3195594141 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f2b340033f0 con 0x7f2b401401c0 2026-02-13T20:11:34.148 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.142+0000 7f2b3d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:34.148 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.142+0000 7f2b3d573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:34.148 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.142+0000 7f2b3d573640 10 monclient: dump: 2026-02-13T20:11:34.148 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:34.148 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:34.148 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.148 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.148 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:34.148 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:34.148 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:34.148 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:34.148 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:34.148 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:34.148 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.142+0000 7f2b44cc3640 10 monclient: shutdown 2026-02-13T20:11:34.148 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.142+0000 7f2b44cc3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:34.148 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.142+0000 7f2b44cc3640 1 -- 10.20.193.110:0/3195594141 >> v1:10.20.193.110:6790/0 conn(0x7f2b401401c0 legacy=0x7f2b40091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:34.148 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.142+0000 7f2b44cc3640 1 -- 10.20.193.110:0/3195594141 shutdown_connections 2026-02-13T20:11:34.148 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.142+0000 7f2b44cc3640 1 -- 10.20.193.110:0/3195594141 >> 10.20.193.110:0/3195594141 conn(0x7f2b40054e90 msgr2=0x7f2b40058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:34.148 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.142+0000 7f2b44cc3640 1 -- 10.20.193.110:0/3195594141 shutdown_connections 2026-02-13T20:11:34.148 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.142+0000 7f2b44cc3640 1 -- 10.20.193.110:0/3195594141 wait complete. 2026-02-13T20:11:34.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.142+0000 7f2b44cc3640 10 monclient: build_initial_monmap 2026-02-13T20:11:34.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.142+0000 7f2b44cc3640 10 monclient: monmap: 2026-02-13T20:11:34.149 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:34.149 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:34.149 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:11:34.149 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:11:34.149 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:34.149 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:11:34.149 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:34.149 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:34.149 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:34.149 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:34.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.142+0000 7f2b44cc3640 1 Processor -- start 2026-02-13T20:11:34.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.142+0000 7f2b44cc3640 1 -- start start 2026-02-13T20:11:34.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.142+0000 7f2b44cc3640 10 monclient: init 2026-02-13T20:11:34.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b44cc3640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:34.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b44cc3640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:11:34.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b44cc3640 10 monclient(hunting): picked mon.noname-c con 0x7f2b40091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:34.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b44cc3640 10 monclient(hunting): picked mon.noname-b con 0x7f2b401401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:34.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b44cc3640 10 monclient(hunting): picked mon.noname-a con 0x7f2b4012de90 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:34.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b44cc3640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b4008ae90 con 0x7f2b4012de90 2026-02-13T20:11:34.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b44cc3640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b4005d320 con 0x7f2b401401c0 2026-02-13T20:11:34.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b44cc3640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b4013e060 con 0x7f2b40091950 2026-02-13T20:11:34.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b44cc3640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:34.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b44cc3640 10 monclient(hunting): authenticate will time out at 655.834165s 2026-02-13T20:11:34.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b3e575640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f2b40091950 0x7f2b4012bac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:39960/0 (socket says 10.20.193.110:39960) 2026-02-13T20:11:34.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b3e575640 1 -- 10.20.193.110:0/2010884210 learned_addr learned my addr 10.20.193.110:0/2010884210 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:34.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b26ffd640 1 -- 10.20.193.110:0/2010884210 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1698022078 0 0) 0x7f2b4013e060 con 0x7f2b40091950 2026-02-13T20:11:34.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b26ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:11:34.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b26ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:34.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b26ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:34.150 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b26ffd640 10 monclient(hunting): my global_id is 4391 2026-02-13T20:11:34.150 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b26ffd640 1 -- 10.20.193.110:0/2010884210 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b0c0035e0 con 0x7f2b40091950 2026-02-13T20:11:34.150 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b26ffd640 1 -- 10.20.193.110:0/2010884210 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2848549669 0 0) 0x7f2b4008ae90 con 0x7f2b4012de90 2026-02-13T20:11:34.150 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b26ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:11:34.150 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b26ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:34.150 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b26ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:34.150 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b26ffd640 10 monclient(hunting): my global_id is 4386 2026-02-13T20:11:34.150 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b26ffd640 1 -- 10.20.193.110:0/2010884210 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b4013e060 con 0x7f2b4012de90 2026-02-13T20:11:34.150 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b26ffd640 1 -- 10.20.193.110:0/2010884210 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2212466591 0 0) 0x7f2b0c0035e0 con 0x7f2b40091950 2026-02-13T20:11:34.150 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b26ffd640 1 -- 10.20.193.110:0/2010884210 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2b4008ae90 con 0x7f2b40091950 2026-02-13T20:11:34.150 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b26ffd640 1 -- 10.20.193.110:0/2010884210 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f2b340033c0 con 0x7f2b40091950 2026-02-13T20:11:34.150 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b26ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:34.150 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b26ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:11:34.150 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b26ffd640 10 monclient(hunting): dump: 2026-02-13T20:11:34.150 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:34.150 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:34.150 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.150 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.150 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:34.150 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:34.150 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:34.150 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:34.150 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:34.150 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:34.150 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b26ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:34.150 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b26ffd640 1 -- 10.20.193.110:0/2010884210 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1968322820 0 0) 0x7f2b4013e060 con 0x7f2b4012de90 2026-02-13T20:11:34.150 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b26ffd640 1 -- 10.20.193.110:0/2010884210 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2b0c0035e0 con 0x7f2b4012de90 2026-02-13T20:11:34.150 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b26ffd640 1 -- 10.20.193.110:0/2010884210 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f2b300040a0 con 0x7f2b4012de90 2026-02-13T20:11:34.150 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b26ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:34.150 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b26ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:34.150 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b26ffd640 10 monclient(hunting): dump: 2026-02-13T20:11:34.151 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:34.151 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:34.151 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.151 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.151 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:34.151 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:34.151 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:34.151 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:34.151 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:34.151 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:34.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b26ffd640 1 -- 10.20.193.110:0/2010884210 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1222114165 0 0) 0x7f2b4008ae90 con 0x7f2b40091950 2026-02-13T20:11:34.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b26ffd640 1 -- 10.20.193.110:0/2010884210 >> v1:10.20.193.188:6789/0 conn(0x7f2b401401c0 legacy=0x7f2b4012c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:34.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b26ffd640 1 -- 10.20.193.110:0/2010884210 >> v1:10.20.193.110:6789/0 conn(0x7f2b4012de90 legacy=0x7f2b401a2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:34.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b26ffd640 10 monclient: _finish_hunting 0 2026-02-13T20:11:34.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b26ffd640 1 monclient: found mon.c 2026-02-13T20:11:34.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b26ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:34.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b26ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:34.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b26ffd640 1 -- 10.20.193.110:0/2010884210 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b4012f0d0 con 0x7f2b40091950 2026-02-13T20:11:34.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b26ffd640 10 monclient: _finish_auth 0 2026-02-13T20:11:34.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b26ffd640 10 monclient: _check_auth_tickets 2026-02-13T20:11:34.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b26ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:34.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b44cc3640 5 monclient: authenticate success, global_id 4391 2026-02-13T20:11:34.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b44cc3640 10 monclient: _renew_subs 2026-02-13T20:11:34.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b44cc3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:34.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b44cc3640 1 -- 10.20.193.110:0/2010884210 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2b4012f3b0 con 0x7f2b40091950 2026-02-13T20:11:34.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b44cc3640 10 monclient: _renew_subs 2026-02-13T20:11:34.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b44cc3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:34.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b44cc3640 1 -- 10.20.193.110:0/2010884210 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f2b4012d330 con 0x7f2b40091950 2026-02-13T20:11:34.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b26ffd640 1 -- 10.20.193.110:0/2010884210 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2b34002990 con 0x7f2b40091950 2026-02-13T20:11:34.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b26ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:34.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b26ffd640 1 -- 10.20.193.110:0/2010884210 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f2b34004d80 con 0x7f2b40091950 2026-02-13T20:11:34.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b26ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:34.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b26ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:34.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b3cd72640 4 set_mon_vals no callback set 2026-02-13T20:11:34.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.143+0000 7f2b26ffd640 10 monclient: dump: 2026-02-13T20:11:34.152 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:34.152 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:34.152 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.152 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.152 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:34.152 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:34.152 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:34.152 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:34.152 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:34.152 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:34.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.144+0000 7f2b44cc3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:34.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.144+0000 7f2b44cc3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:34.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.144+0000 7f2b44cc3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:34.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.144+0000 7f2b44cc3640 1 -- 10.20.193.110:0/2010884210 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b4012f750 con 0x7f2b40091950 2026-02-13T20:11:34.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.144+0000 7f2b26ffd640 1 -- 10.20.193.110:0/2010884210 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f2b34004ee0 con 0x7f2b40091950 2026-02-13T20:11:34.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.144+0000 7f2b26ffd640 1 -- 10.20.193.110:0/2010884210 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 3531+0+0 (unknown 315507976 0 0) 0x7f2b3404e8d0 con 0x7f2b40091950 2026-02-13T20:11:34.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.144+0000 7f2b3dd74640 10 monclient: get_auth_request con 0x7f2b0c03fa70 auth_method 0 2026-02-13T20:11:34.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.146+0000 7f2b26ffd640 1 -- 10.20.193.110:0/2010884210 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f2b340066c0 con 0x7f2b40091950 2026-02-13T20:11:34.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.147+0000 7f2b26ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:34.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.147+0000 7f2b26ffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:11:34.257 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.255+0000 7f2b44cc3640 10 start_mon_command cmd=[{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2026-02-13T20:11:34.257 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.255+0000 7f2b44cc3640 10 monclient: _send_command 2 [{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2026-02-13T20:11:34.257 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.255+0000 7f2b44cc3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:34.257 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.255+0000 7f2b44cc3640 1 -- 10.20.193.110:0/2010884210 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) -- 0x7f2b4013e530 con 0x7f2b40091950 2026-02-13T20:11:34.257 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.255+0000 7f2b26ffd640 1 -- 10.20.193.110:0/2010884210 <== mon.2 v1:10.20.193.110:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) ==== 92+0+10 (unknown 3412311620 0 265718887) 0x7f2b34016a70 con 0x7f2b40091950 2026-02-13T20:11:34.257 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.255+0000 7f2b26ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2026-02-13T20:11:34.257 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.255+0000 7f2b26ffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:11:34.257 INFO:teuthology.orchestra.run.trial110.stdout:pg_num: 8 2026-02-13T20:11:34.258 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.256+0000 7f2b44cc3640 1 -- 10.20.193.110:0/2010884210 >> v1:10.20.193.188:6812/1623052694 conn(0x7f2b0c03fa70 legacy=0x7f2b0c05ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:34.258 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.256+0000 7f2b44cc3640 10 monclient: shutdown 2026-02-13T20:11:34.258 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.256+0000 7f2b44cc3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:34.258 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.256+0000 7f2b44cc3640 1 -- 10.20.193.110:0/2010884210 >> v1:10.20.193.110:6790/0 conn(0x7f2b40091950 legacy=0x7f2b4012bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:34.258 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.256+0000 7f2b44cc3640 1 -- 10.20.193.110:0/2010884210 shutdown_connections 2026-02-13T20:11:34.258 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.256+0000 7f2b44cc3640 1 -- 10.20.193.110:0/2010884210 >> 10.20.193.110:0/2010884210 conn(0x7f2b40054e90 msgr2=0x7f2b4013f010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:34.258 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.256+0000 7f2b44cc3640 1 -- 10.20.193.110:0/2010884210 shutdown_connections 2026-02-13T20:11:34.258 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.256+0000 7f2b44cc3640 1 -- 10.20.193.110:0/2010884210 wait complete. 2026-02-13T20:11:34.265 INFO:tasks.mon_thrash.ceph_manager:waiting for clean 2026-02-13T20:11:34.266 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-13T20:11:34.329 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.327+0000 7f1a6405b640 10 monclient: get_monmap_and_config 2026-02-13T20:11:34.330 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.327+0000 7f1a6405b640 10 monclient: build_initial_monmap 2026-02-13T20:11:34.330 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.327+0000 7f1a6405b640 10 monclient: monmap: 2026-02-13T20:11:34.330 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:34.330 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:34.330 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:34.329342+0000 2026-02-13T20:11:34.330 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:34.329342+0000 2026-02-13T20:11:34.330 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:34.330 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:34.330 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:34.330 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:34.330 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:34.330 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:34.331 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.328+0000 7f1a6405b640 1 Processor -- start 2026-02-13T20:11:34.331 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.328+0000 7f1a6405b640 1 -- start start 2026-02-13T20:11:34.331 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.328+0000 7f1a6405b640 10 monclient: init 2026-02-13T20:11:34.331 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.328+0000 7f1a6405b640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:34.332 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.328+0000 7f1a6405b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:11:34.332 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.328+0000 7f1a6405b640 10 monclient(hunting): picked mon.noname-b con 0x7f1a5c1401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:34.332 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.328+0000 7f1a6405b640 10 monclient(hunting): picked mon.noname-a con 0x7f1a5c092020 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:34.332 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.328+0000 7f1a6405b640 10 monclient(hunting): picked mon.noname-c con 0x7f1a5c091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:34.332 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.328+0000 7f1a6405b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a5c08b730 con 0x7f1a5c092020 2026-02-13T20:11:34.332 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.328+0000 7f1a6405b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a5c05c5b0 con 0x7f1a5c091950 2026-02-13T20:11:34.332 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.328+0000 7f1a6405b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a5c08bcf0 con 0x7f1a5c1401c0 2026-02-13T20:11:34.332 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.328+0000 7f1a6405b640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:34.332 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.328+0000 7f1a6405b640 10 monclient(hunting): authenticate will time out at 656.019685s 2026-02-13T20:11:34.332 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.328+0000 7f1a61dd0640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f1a5c1401c0 0x7f1a5c091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:39970/0 (socket says 10.20.193.110:39970) 2026-02-13T20:11:34.332 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.328+0000 7f1a61dd0640 1 -- 10.20.193.110:0/2118507088 learned_addr learned my addr 10.20.193.110:0/2118507088 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:34.332 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.328+0000 7f1a60dce640 1 -- 10.20.193.110:0/2118507088 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2717134879 0 0) 0x7f1a5c08bcf0 con 0x7f1a5c1401c0 2026-02-13T20:11:34.332 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.328+0000 7f1a60dce640 10 monclient(hunting): _negotiate 2026-02-13T20:11:34.332 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.328+0000 7f1a60dce640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:34.332 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.328+0000 7f1a60dce640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:34.332 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.328+0000 7f1a60dce640 10 monclient(hunting): my global_id is 4394 2026-02-13T20:11:34.332 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.328+0000 7f1a60dce640 1 -- 10.20.193.110:0/2118507088 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a440035e0 con 0x7f1a5c1401c0 2026-02-13T20:11:34.332 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.328+0000 7f1a60dce640 1 -- 10.20.193.110:0/2118507088 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2536534190 0 0) 0x7f1a5c08b730 con 0x7f1a5c092020 2026-02-13T20:11:34.332 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.329+0000 7f1a60dce640 10 monclient(hunting): _negotiate 2026-02-13T20:11:34.332 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.329+0000 7f1a60dce640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:34.332 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.329+0000 7f1a60dce640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:34.332 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.329+0000 7f1a60dce640 10 monclient(hunting): my global_id is 4389 2026-02-13T20:11:34.332 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.329+0000 7f1a60dce640 1 -- 10.20.193.110:0/2118507088 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a5c08bcf0 con 0x7f1a5c092020 2026-02-13T20:11:34.332 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.329+0000 7f1a60dce640 1 -- 10.20.193.110:0/2118507088 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4061326427 0 0) 0x7f1a440035e0 con 0x7f1a5c1401c0 2026-02-13T20:11:34.332 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.329+0000 7f1a60dce640 1 -- 10.20.193.110:0/2118507088 >> v1:10.20.193.188:6789/0 conn(0x7f1a5c091950 legacy=0x7f1a5c1a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T20:11:34.332 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.329+0000 7f1a60dce640 1 -- 10.20.193.110:0/2118507088 >> v1:10.20.193.110:6789/0 conn(0x7f1a5c092020 legacy=0x7f1a5c1812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:34.332 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.329+0000 7f1a60dce640 10 monclient: _finish_hunting 0 2026-02-13T20:11:34.332 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.329+0000 7f1a60dce640 1 monclient: found mon.noname-b 2026-02-13T20:11:34.333 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.329+0000 7f1a60dce640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:34.333 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.329+0000 7f1a60dce640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:11:34.333 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.329+0000 7f1a60dce640 1 -- 10.20.193.110:0/2118507088 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a5c140590 con 0x7f1a5c1401c0 2026-02-13T20:11:34.333 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.329+0000 7f1a60dce640 10 monclient: _finish_auth 0 2026-02-13T20:11:34.333 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.329+0000 7f1a60dce640 10 monclient: _check_auth_tickets 2026-02-13T20:11:34.333 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.329+0000 7f1a60dce640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:34.333 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.329+0000 7f1a60dce640 1 -- 10.20.193.110:0/2118507088 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f1a4c002dd0 con 0x7f1a5c1401c0 2026-02-13T20:11:34.333 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.329+0000 7f1a60dce640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:34.333 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.329+0000 7f1a60dce640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:11:34.333 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.329+0000 7f1a60dce640 10 monclient: dump: 2026-02-13T20:11:34.333 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:34.333 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:34.333 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.333 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.333 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:34.333 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:34.333 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:34.333 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:34.333 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:34.333 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:34.333 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.329+0000 7f1a6405b640 5 monclient: authenticate success, global_id 4394 2026-02-13T20:11:34.333 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.329+0000 7f1a6405b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:34.333 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.329+0000 7f1a60dce640 1 -- 10.20.193.110:0/2118507088 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1a4c002f60 con 0x7f1a5c1401c0 2026-02-13T20:11:34.333 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.329+0000 7f1a60dce640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:34.333 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.329+0000 7f1a60dce640 1 -- 10.20.193.110:0/2118507088 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f1a4c003370 con 0x7f1a5c1401c0 2026-02-13T20:11:34.333 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.329+0000 7f1a60dce640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:34.333 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.329+0000 7f1a60dce640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:34.333 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.329+0000 7f1a60dce640 10 monclient: dump: 2026-02-13T20:11:34.333 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:34.333 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:34.333 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.333 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.333 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:34.333 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:34.334 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:34.334 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:34.334 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:34.334 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:34.334 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.329+0000 7f1a6405b640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:34.334 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.329+0000 7f1a6405b640 4 set_mon_vals no callback set 2026-02-13T20:11:34.334 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.329+0000 7f1a6405b640 10 monclient: shutdown 2026-02-13T20:11:34.334 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.329+0000 7f1a6405b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:34.334 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.329+0000 7f1a6405b640 1 -- 10.20.193.110:0/2118507088 >> v1:10.20.193.110:6790/0 conn(0x7f1a5c1401c0 legacy=0x7f1a5c091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:34.334 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.329+0000 7f1a6405b640 1 -- 10.20.193.110:0/2118507088 shutdown_connections 2026-02-13T20:11:34.334 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.329+0000 7f1a6405b640 1 -- 10.20.193.110:0/2118507088 >> 10.20.193.110:0/2118507088 conn(0x7f1a5c054e90 msgr2=0x7f1a5c058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:34.334 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.329+0000 7f1a6405b640 1 -- 10.20.193.110:0/2118507088 shutdown_connections 2026-02-13T20:11:34.334 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.329+0000 7f1a6405b640 1 -- 10.20.193.110:0/2118507088 wait complete. 2026-02-13T20:11:34.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.330+0000 7f1a6405b640 10 monclient: build_initial_monmap 2026-02-13T20:11:34.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.330+0000 7f1a6405b640 10 monclient: monmap: 2026-02-13T20:11:34.337 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:34.337 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:34.337 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:11:34.337 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:11:34.337 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:34.337 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:11:34.337 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:34.337 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:34.337 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:34.337 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:34.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.330+0000 7f1a6405b640 1 Processor -- start 2026-02-13T20:11:34.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.330+0000 7f1a6405b640 1 -- start start 2026-02-13T20:11:34.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.330+0000 7f1a6405b640 10 monclient: init 2026-02-13T20:11:34.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.330+0000 7f1a6405b640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:34.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.330+0000 7f1a6405b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:11:34.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.330+0000 7f1a6405b640 10 monclient(hunting): picked mon.noname-c con 0x7f1a5c091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:34.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.330+0000 7f1a6405b640 10 monclient(hunting): picked mon.noname-a con 0x7f1a5c1401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:34.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.330+0000 7f1a6405b640 10 monclient(hunting): picked mon.noname-b con 0x7f1a5c194850 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:34.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.330+0000 7f1a6405b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a5c13fa80 con 0x7f1a5c1401c0 2026-02-13T20:11:34.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.330+0000 7f1a6405b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a5c1322c0 con 0x7f1a5c194850 2026-02-13T20:11:34.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.330+0000 7f1a6405b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a5c05d320 con 0x7f1a5c091950 2026-02-13T20:11:34.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.330+0000 7f1a6405b640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:34.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.330+0000 7f1a6405b640 10 monclient(hunting): authenticate will time out at 656.021705s 2026-02-13T20:11:34.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.330+0000 7f1a61dd0640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f1a5c091950 0x7f1a5c1526f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:39986/0 (socket says 10.20.193.110:39986) 2026-02-13T20:11:34.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.330+0000 7f1a61dd0640 1 -- 10.20.193.110:0/2391346650 learned_addr learned my addr 10.20.193.110:0/2391346650 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:34.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.330+0000 7f1a4a7fc640 1 -- 10.20.193.110:0/2391346650 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3229525869 0 0) 0x7f1a5c05d320 con 0x7f1a5c091950 2026-02-13T20:11:34.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.330+0000 7f1a4a7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:11:34.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.330+0000 7f1a4a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:34.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.330+0000 7f1a4a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:34.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.330+0000 7f1a4a7fc640 10 monclient(hunting): my global_id is 4397 2026-02-13T20:11:34.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.330+0000 7f1a4a7fc640 1 -- 10.20.193.110:0/2391346650 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a2c0035e0 con 0x7f1a5c091950 2026-02-13T20:11:34.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.330+0000 7f1a4a7fc640 1 -- 10.20.193.110:0/2391346650 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 550738099 0 0) 0x7f1a5c13fa80 con 0x7f1a5c1401c0 2026-02-13T20:11:34.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.330+0000 7f1a4a7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:11:34.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.330+0000 7f1a4a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:34.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.330+0000 7f1a4a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:34.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.330+0000 7f1a4a7fc640 10 monclient(hunting): my global_id is 4392 2026-02-13T20:11:34.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.330+0000 7f1a4a7fc640 1 -- 10.20.193.110:0/2391346650 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a5c05d320 con 0x7f1a5c1401c0 2026-02-13T20:11:34.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.331+0000 7f1a4a7fc640 1 -- 10.20.193.110:0/2391346650 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2961087159 0 0) 0x7f1a2c0035e0 con 0x7f1a5c091950 2026-02-13T20:11:34.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.331+0000 7f1a4a7fc640 1 -- 10.20.193.110:0/2391346650 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1a5c13fa80 con 0x7f1a5c091950 2026-02-13T20:11:34.339 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.331+0000 7f1a4a7fc640 1 -- 10.20.193.110:0/2391346650 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f1a4c003280 con 0x7f1a5c091950 2026-02-13T20:11:34.339 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.331+0000 7f1a4a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:34.339 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.331+0000 7f1a4a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:11:34.339 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.331+0000 7f1a4a7fc640 10 monclient(hunting): dump: 2026-02-13T20:11:34.339 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:34.339 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:34.339 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.339 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.339 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:34.339 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:34.339 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:34.339 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:34.339 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:34.339 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:34.339 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.331+0000 7f1a4a7fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:34.339 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.331+0000 7f1a4a7fc640 1 -- 10.20.193.110:0/2391346650 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 373801687 0 0) 0x7f1a5c05d320 con 0x7f1a5c1401c0 2026-02-13T20:11:34.339 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.331+0000 7f1a4a7fc640 1 -- 10.20.193.110:0/2391346650 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1a2c0035e0 con 0x7f1a5c1401c0 2026-02-13T20:11:34.339 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.331+0000 7f1a4a7fc640 1 -- 10.20.193.110:0/2391346650 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f1a50003170 con 0x7f1a5c1401c0 2026-02-13T20:11:34.339 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.331+0000 7f1a4a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:34.339 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.331+0000 7f1a4a7fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:34.339 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.331+0000 7f1a4a7fc640 10 monclient(hunting): dump: 2026-02-13T20:11:34.339 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:34.339 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:34.339 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.339 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.340 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:34.340 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:34.340 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:34.340 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:34.340 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:34.340 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:34.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.331+0000 7f1a4a7fc640 1 -- 10.20.193.110:0/2391346650 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1107600165 0 0) 0x7f1a5c1322c0 con 0x7f1a5c194850 2026-02-13T20:11:34.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.331+0000 7f1a4a7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:11:34.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.331+0000 7f1a4a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:34.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.331+0000 7f1a4a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:34.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.331+0000 7f1a4a7fc640 10 monclient(hunting): my global_id is 4378 2026-02-13T20:11:34.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.331+0000 7f1a4a7fc640 1 -- 10.20.193.110:0/2391346650 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a5c05d320 con 0x7f1a5c194850 2026-02-13T20:11:34.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.331+0000 7f1a4a7fc640 1 -- 10.20.193.110:0/2391346650 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3507607273 0 0) 0x7f1a5c13fa80 con 0x7f1a5c091950 2026-02-13T20:11:34.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.331+0000 7f1a4a7fc640 1 -- 10.20.193.110:0/2391346650 >> v1:10.20.193.188:6789/0 conn(0x7f1a5c194850 legacy=0x7f1a5c194ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:34.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.331+0000 7f1a4a7fc640 1 -- 10.20.193.110:0/2391346650 >> v1:10.20.193.110:6789/0 conn(0x7f1a5c1401c0 legacy=0x7f1a5c152e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:34.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.331+0000 7f1a4a7fc640 10 monclient: _finish_hunting 0 2026-02-13T20:11:34.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.331+0000 7f1a4a7fc640 1 monclient: found mon.c 2026-02-13T20:11:34.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.331+0000 7f1a4a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:34.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.331+0000 7f1a4a7fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:34.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.331+0000 7f1a4a7fc640 1 -- 10.20.193.110:0/2391346650 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a5c131fe0 con 0x7f1a5c091950 2026-02-13T20:11:34.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.331+0000 7f1a4a7fc640 10 monclient: _finish_auth 0 2026-02-13T20:11:34.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.331+0000 7f1a4a7fc640 10 monclient: _check_auth_tickets 2026-02-13T20:11:34.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.331+0000 7f1a4a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:34.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.331+0000 7f1a6405b640 5 monclient: authenticate success, global_id 4397 2026-02-13T20:11:34.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.331+0000 7f1a6405b640 10 monclient: _renew_subs 2026-02-13T20:11:34.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.331+0000 7f1a6405b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:34.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.331+0000 7f1a6405b640 1 -- 10.20.193.110:0/2391346650 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1a5c13f230 con 0x7f1a5c091950 2026-02-13T20:11:34.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.331+0000 7f1a6405b640 10 monclient: _renew_subs 2026-02-13T20:11:34.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.331+0000 7f1a6405b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:34.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.331+0000 7f1a6405b640 1 -- 10.20.193.110:0/2391346650 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f1a5c1963c0 con 0x7f1a5c091950 2026-02-13T20:11:34.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.331+0000 7f1a4a7fc640 1 -- 10.20.193.110:0/2391346650 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1a4c004b50 con 0x7f1a5c091950 2026-02-13T20:11:34.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.331+0000 7f1a4a7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:34.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.331+0000 7f1a4a7fc640 1 -- 10.20.193.110:0/2391346650 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f1a4c004f30 con 0x7f1a5c091950 2026-02-13T20:11:34.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.331+0000 7f1a4a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:34.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.331+0000 7f1a4a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:34.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.331+0000 7f1a4a7fc640 10 monclient: dump: 2026-02-13T20:11:34.341 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:34.341 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:34.341 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.341 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.341 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:34.341 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:34.341 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:34.341 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:34.341 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:34.341 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:34.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.331+0000 7f1a4bfff640 4 set_mon_vals no callback set 2026-02-13T20:11:34.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.331+0000 7f1a6405b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:34.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.331+0000 7f1a6405b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:34.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.331+0000 7f1a6405b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:34.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.331+0000 7f1a6405b640 1 -- 10.20.193.110:0/2391346650 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a5c0008d0 con 0x7f1a5c091950 2026-02-13T20:11:34.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.331+0000 7f1a4a7fc640 1 -- 10.20.193.110:0/2391346650 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f1a4c005090 con 0x7f1a5c091950 2026-02-13T20:11:34.342 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.332+0000 7f1a4a7fc640 1 -- 10.20.193.110:0/2391346650 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 3531+0+0 (unknown 315507976 0 0) 0x7f1a4c04e870 con 0x7f1a5c091950 2026-02-13T20:11:34.342 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.332+0000 7f1a615cf640 10 monclient: get_auth_request con 0x7f1a2c03fc70 auth_method 0 2026-02-13T20:11:34.342 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.334+0000 7f1a4a7fc640 1 -- 10.20.193.110:0/2391346650 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f1a4c017200 con 0x7f1a5c091950 2026-02-13T20:11:34.342 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.334+0000 7f1a4a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:34.342 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.334+0000 7f1a4a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:11:34.445 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.443+0000 7f1a6405b640 1 -- 10.20.193.110:0/2391346650 --> v1:10.20.193.188:6812/1623052694 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1a5c08a830 con 0x7f1a2c03fc70 2026-02-13T20:11:34.446 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.443+0000 7f1a4a7fc640 1 -- 10.20.193.110:0/2391346650 <== mgr.4105 v1:10.20.193.188:6812/1623052694 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34138 (unknown 2965378022 0 2959529845) 0x7f1a5c08a830 con 0x7f1a2c03fc70 2026-02-13T20:11:34.446 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:34.447 INFO:teuthology.orchestra.run.trial110.stderr:dumped all 2026-02-13T20:11:34.447 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.444+0000 7f1a6405b640 1 -- 10.20.193.110:0/2391346650 >> v1:10.20.193.188:6812/1623052694 conn(0x7f1a2c03fc70 legacy=0x7f1a2c060120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:34.447 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.444+0000 7f1a6405b640 10 monclient: shutdown 2026-02-13T20:11:34.447 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.444+0000 7f1a6405b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:34.447 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.444+0000 7f1a6405b640 1 -- 10.20.193.110:0/2391346650 >> v1:10.20.193.110:6790/0 conn(0x7f1a5c091950 legacy=0x7f1a5c1526f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:34.447 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.445+0000 7f1a6405b640 1 -- 10.20.193.110:0/2391346650 shutdown_connections 2026-02-13T20:11:34.447 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.445+0000 7f1a6405b640 1 -- 10.20.193.110:0/2391346650 >> 10.20.193.110:0/2391346650 conn(0x7f1a5c054e90 msgr2=0x7f1a5c08dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:34.447 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.445+0000 7f1a6405b640 1 -- 10.20.193.110:0/2391346650 shutdown_connections 2026-02-13T20:11:34.447 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.445+0000 7f1a6405b640 1 -- 10.20.193.110:0/2391346650 wait complete. 2026-02-13T20:11:34.454 INFO:teuthology.orchestra.run.trial110.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2026-02-13T20:11:34.122733+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":162840,"kb_used_data":1080,"kb_used_omap":52,"kb_used_meta":161611,"kb_avail":566068200,"statfs":{"total":579820584960,"available":579653836800,"internally_reserved":0,"allocated":1105920,"data_stored":1497169,"data_compressed":16424,"data_compressed_allocated":98304,"data_compressed_original":1179648,"omap_allocated":54015,"internal_metadata":165489921},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.566822"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-13T20:11:30.561334+0000","last_change":"2026-02-13T20:11:30.561334+0000","last_active":"2026-02-13T20:11:30.561334+0000","last_peered":"2026-02-13T20:11:30.561334+0000","last_clean":"2026-02-13T20:11:30.561334+0000","last_became_active":"2026-02-13T20:11:29.018116+0000","last_became_peered":"2026-02-13T20:11:29.018116+0000","last_unstale":"2026-02-13T20:11:30.561334+0000","last_undegraded":"2026-02-13T20:11:30.561334+0000","last_fullsized":"2026-02-13T20:11:30.561334+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T03:21:19.857098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000335309,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-13T20:11:30.561637+0000","last_change":"2026-02-13T20:11:30.561637+0000","last_active":"2026-02-13T20:11:30.561637+0000","last_peered":"2026-02-13T20:11:30.561637+0000","last_clean":"2026-02-13T20:11:30.561637+0000","last_became_active":"2026-02-13T20:11:28.559585+0000","last_became_peered":"2026-02-13T20:11:28.559585+0000","last_unstale":"2026-02-13T20:11:30.561637+0000","last_undegraded":"2026-02-13T20:11:30.561637+0000","last_fullsized":"2026-02-13T20:11:30.561637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T23:13:24.610860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00021035100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-13T20:11:30.561240+0000","last_change":"2026-02-13T20:11:30.561240+0000","last_active":"2026-02-13T20:11:30.561240+0000","last_peered":"2026-02-13T20:11:30.561240+0000","last_clean":"2026-02-13T20:11:30.561240+0000","last_became_active":"2026-02-13T20:11:28.559005+0000","last_became_peered":"2026-02-13T20:11:28.559005+0000","last_unstale":"2026-02-13T20:11:30.561240+0000","last_undegraded":"2026-02-13T20:11:30.561240+0000","last_fullsized":"2026-02-13T20:11:30.561240+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T02:48:59.423627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027156000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-13T20:11:30.561668+0000","last_change":"2026-02-13T20:11:30.561668+0000","last_active":"2026-02-13T20:11:30.561668+0000","last_peered":"2026-02-13T20:11:30.561668+0000","last_clean":"2026-02-13T20:11:30.561668+0000","last_became_active":"2026-02-13T20:11:28.558441+0000","last_became_peered":"2026-02-13T20:11:28.558441+0000","last_unstale":"2026-02-13T20:11:30.561668+0000","last_undegraded":"2026-02-13T20:11:30.561668+0000","last_fullsized":"2026-02-13T20:11:30.561668+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T22:32:58.917639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000231139,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"19'2","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-13T20:11:30.563311+0000","last_change":"2026-02-13T20:11:30.563087+0000","last_active":"2026-02-13T20:11:30.563311+0000","last_peered":"2026-02-13T20:11:30.563311+0000","last_clean":"2026-02-13T20:11:30.563311+0000","last_became_active":"2026-02-13T20:11:28.557848+0000","last_became_peered":"2026-02-13T20:11:28.557848+0000","last_unstale":"2026-02-13T20:11:30.563311+0000","last_undegraded":"2026-02-13T20:11:30.563311+0000","last_fullsized":"2026-02-13T20:11:30.563311+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T21:44:09.052237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064918699999999996,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-13T20:11:32.872910+0000","last_change":"2026-02-13T20:11:30.823369+0000","last_active":"2026-02-13T20:11:32.872910+0000","last_peered":"2026-02-13T20:11:32.872910+0000","last_clean":"2026-02-13T20:11:32.872910+0000","last_became_active":"2026-02-13T20:11:28.559802+0000","last_became_peered":"2026-02-13T20:11:28.559802+0000","last_unstale":"2026-02-13T20:11:32.872910+0000","last_undegraded":"2026-02-13T20:11:32.872910+0000","last_fullsized":"2026-02-13T20:11:32.872910+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T05:27:34.220283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000230979,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-13T20:11:30.561332+0000","last_change":"2026-02-13T20:11:30.561332+0000","last_active":"2026-02-13T20:11:30.561332+0000","last_peered":"2026-02-13T20:11:30.561332+0000","last_clean":"2026-02-13T20:11:30.561332+0000","last_became_active":"2026-02-13T20:11:28.559211+0000","last_became_peered":"2026-02-13T20:11:28.559211+0000","last_unstale":"2026-02-13T20:11:30.561332+0000","last_undegraded":"2026-02-13T20:11:30.561332+0000","last_fullsized":"2026-02-13T20:11:30.561332+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T22:32:44.601301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029208800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"17'1","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-13T20:11:30.562730+0000","last_change":"2026-02-13T20:11:30.562730+0000","last_active":"2026-02-13T20:11:30.562730+0000","last_peered":"2026-02-13T20:11:30.562730+0000","last_clean":"2026-02-13T20:11:30.562730+0000","last_became_active":"2026-02-13T20:11:28.558943+0000","last_became_peered":"2026-02-13T20:11:28.558943+0000","last_unstale":"2026-02-13T20:11:30.562730+0000","last_undegraded":"2026-02-13T20:11:30.562730+0000","last_fullsized":"2026-02-13T20:11:30.562730+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T21:39:10.290168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032435800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"14'112","reported_seq":157,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-13T20:11:30.561154+0000","last_change":"2026-02-13T20:11:25.262882+0000","last_active":"2026-02-13T20:11:30.561154+0000","last_peered":"2026-02-13T20:11:30.561154+0000","last_clean":"2026-02-13T20:11:30.561154+0000","last_became_active":"2026-02-13T20:11:25.262766+0000","last_became_peered":"2026-02-13T20:11:25.262766+0000","last_unstale":"2026-02-13T20:11:30.561154+0000","last_undegraded":"2026-02-13T20:11:30.561154+0000","last_fullsized":"2026-02-13T20:11:30.561154+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:24.258524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:24.258524+0000","last_clean_scrub_stamp":"2026-02-13T20:11:24.258524+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T22:58:36.956434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1180736,"data_compressed":16424,"data_compressed_allocated":98304,"data_compressed_original":1179648,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27124,"kb_used_data":164,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344716,"statfs":{"total":96636764160,"available":96608989184,"internally_reserved":0,"allocated":167936,"data_stored":52125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8123,"internal_metadata":27582533},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640260,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27120,"kb_used_data":160,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344720,"statfs":{"total":96636764160,"available":96608993280,"internally_reserved":0,"allocated":163840,"data_stored":52106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640260,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":212,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":217088,"data_stored":642474,"data_compressed":8212,"data_compressed_allocated":49152,"data_compressed_original":589824,"omap_allocated":9421,"internal_metadata":27581235},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27120,"kb_used_data":160,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344720,"statfs":{"total":96636764160,"available":96608993280,"internally_reserved":0,"allocated":163840,"data_stored":52106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8773,"internal_metadata":27581883},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27124,"kb_used_data":164,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344716,"statfs":{"total":96636764160,"available":96608989184,"internally_reserved":0,"allocated":167936,"data_stored":52125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8773,"internal_metadata":27581883},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640261,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":220,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":225280,"data_stored":646233,"data_compressed":8212,"data_compressed_allocated":49152,"data_compressed_original":589824,"omap_allocated":10150,"internal_metadata":27580506},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":590368,"data_compressed":8212,"data_compressed_allocated":49152,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":590368,"data_compressed":8212,"data_compressed_allocated":49152,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T20:11:34.456 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-13T20:11:34.523 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.521+0000 7fb2c3994640 10 monclient: get_monmap_and_config 2026-02-13T20:11:34.523 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.521+0000 7fb2c3994640 10 monclient: build_initial_monmap 2026-02-13T20:11:34.523 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.521+0000 7fb2c3994640 10 monclient: monmap: 2026-02-13T20:11:34.523 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:34.523 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:34.523 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:34.522988+0000 2026-02-13T20:11:34.523 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:34.522988+0000 2026-02-13T20:11:34.523 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:34.523 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:34.523 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:34.523 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:34.523 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:34.523 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:34.524 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.521+0000 7fb2c3994640 1 Processor -- start 2026-02-13T20:11:34.524 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2c3994640 1 -- start start 2026-02-13T20:11:34.524 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2c3994640 10 monclient: init 2026-02-13T20:11:34.524 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2c3994640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:34.524 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2c3994640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:11:34.524 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2c3994640 10 monclient(hunting): picked mon.noname-a con 0x7fb2bc1401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:34.524 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2c3994640 10 monclient(hunting): picked mon.noname-b con 0x7fb2bc092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:34.524 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2c3994640 10 monclient(hunting): picked mon.noname-c con 0x7fb2bc091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:34.524 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2c3994640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2bc08b730 con 0x7fb2bc1401c0 2026-02-13T20:11:34.524 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2c3994640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2bc05c5b0 con 0x7fb2bc091950 2026-02-13T20:11:34.524 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2c3994640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2bc08bcf0 con 0x7fb2bc092020 2026-02-13T20:11:34.524 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2c3994640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:34.524 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2c3994640 10 monclient(hunting): authenticate will time out at 656.213390s 2026-02-13T20:11:34.524 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2c1709640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fb2bc1401c0 0x7fb2bc091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:60286/0 (socket says 10.20.193.110:60286) 2026-02-13T20:11:34.524 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2c1709640 1 -- 10.20.193.110:0/1914403485 learned_addr learned my addr 10.20.193.110:0/1914403485 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:34.525 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2abfff640 1 -- 10.20.193.110:0/1914403485 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3174761450 0 0) 0x7fb2bc08b730 con 0x7fb2bc1401c0 2026-02-13T20:11:34.525 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2abfff640 10 monclient(hunting): _negotiate 2026-02-13T20:11:34.525 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2abfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:34.525 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2abfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:34.525 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2abfff640 10 monclient(hunting): my global_id is 4395 2026-02-13T20:11:34.525 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2abfff640 1 -- 10.20.193.110:0/1914403485 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2a40035e0 con 0x7fb2bc1401c0 2026-02-13T20:11:34.525 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2abfff640 1 -- 10.20.193.110:0/1914403485 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2434058750 0 0) 0x7fb2bc08bcf0 con 0x7fb2bc092020 2026-02-13T20:11:34.525 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2abfff640 10 monclient(hunting): _negotiate 2026-02-13T20:11:34.525 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2abfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:34.525 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2abfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:34.525 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2abfff640 10 monclient(hunting): my global_id is 4400 2026-02-13T20:11:34.525 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2abfff640 1 -- 10.20.193.110:0/1914403485 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2bc08b730 con 0x7fb2bc092020 2026-02-13T20:11:34.525 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2abfff640 1 -- 10.20.193.110:0/1914403485 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2307631418 0 0) 0x7fb2a40035e0 con 0x7fb2bc1401c0 2026-02-13T20:11:34.525 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2abfff640 1 -- 10.20.193.110:0/1914403485 >> v1:10.20.193.110:6790/0 conn(0x7fb2bc092020 legacy=0x7fb2bc1812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:34.525 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2abfff640 1 -- 10.20.193.110:0/1914403485 >> v1:10.20.193.188:6789/0 conn(0x7fb2bc091950 legacy=0x7fb2bc1a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:34.525 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2abfff640 10 monclient: _finish_hunting 0 2026-02-13T20:11:34.525 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2abfff640 1 monclient: found mon.noname-a 2026-02-13T20:11:34.525 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2abfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:34.525 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2abfff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:11:34.525 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2abfff640 1 -- 10.20.193.110:0/1914403485 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2bc140590 con 0x7fb2bc1401c0 2026-02-13T20:11:34.526 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2abfff640 10 monclient: _finish_auth 0 2026-02-13T20:11:34.526 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2abfff640 10 monclient: _check_auth_tickets 2026-02-13T20:11:34.526 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2abfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:34.526 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2abfff640 1 -- 10.20.193.110:0/1914403485 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb2ac002dd0 con 0x7fb2bc1401c0 2026-02-13T20:11:34.526 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2c3994640 5 monclient: authenticate success, global_id 4395 2026-02-13T20:11:34.526 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2abfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:34.526 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2abfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:11:34.526 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2abfff640 10 monclient: dump: 2026-02-13T20:11:34.526 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:34.526 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:34.526 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.526 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.526 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:34.526 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:34.526 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:34.526 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:34.526 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:34.526 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:34.526 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2c3994640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:34.526 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2abfff640 1 -- 10.20.193.110:0/1914403485 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb2ac002fa0 con 0x7fb2bc1401c0 2026-02-13T20:11:34.526 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2abfff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:34.526 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2abfff640 1 -- 10.20.193.110:0/1914403485 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb2ac0033b0 con 0x7fb2bc1401c0 2026-02-13T20:11:34.526 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2c3994640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:34.526 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2c3994640 4 set_mon_vals no callback set 2026-02-13T20:11:34.526 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2abfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:34.526 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2abfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:34.526 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.522+0000 7fb2abfff640 10 monclient: dump: 2026-02-13T20:11:34.526 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:34.526 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:34.526 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.526 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.526 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:34.526 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:34.526 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:34.526 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:34.526 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:34.526 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:34.526 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.523+0000 7fb2c3994640 10 monclient: shutdown 2026-02-13T20:11:34.526 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.523+0000 7fb2c3994640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:34.526 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.523+0000 7fb2c3994640 1 -- 10.20.193.110:0/1914403485 >> v1:10.20.193.110:6789/0 conn(0x7fb2bc1401c0 legacy=0x7fb2bc091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:34.527 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.523+0000 7fb2c3994640 1 -- 10.20.193.110:0/1914403485 shutdown_connections 2026-02-13T20:11:34.527 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.523+0000 7fb2c3994640 1 -- 10.20.193.110:0/1914403485 >> 10.20.193.110:0/1914403485 conn(0x7fb2bc054e90 msgr2=0x7fb2bc058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:34.527 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.523+0000 7fb2c3994640 1 -- 10.20.193.110:0/1914403485 shutdown_connections 2026-02-13T20:11:34.527 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.523+0000 7fb2c3994640 1 -- 10.20.193.110:0/1914403485 wait complete. 2026-02-13T20:11:34.527 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.523+0000 7fb2c3994640 10 monclient: build_initial_monmap 2026-02-13T20:11:34.527 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.523+0000 7fb2c3994640 10 monclient: monmap: 2026-02-13T20:11:34.527 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:34.527 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:34.527 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:11:34.527 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:11:34.527 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:34.527 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:11:34.527 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:34.527 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:34.527 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:34.527 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:34.528 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.523+0000 7fb2c3994640 1 Processor -- start 2026-02-13T20:11:34.528 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.523+0000 7fb2c3994640 1 -- start start 2026-02-13T20:11:34.528 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.523+0000 7fb2c3994640 10 monclient: init 2026-02-13T20:11:34.528 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2c3994640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:34.528 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2c3994640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:11:34.528 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2c3994640 10 monclient(hunting): picked mon.noname-c con 0x7fb2bc091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:34.528 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2c3994640 10 monclient(hunting): picked mon.noname-a con 0x7fb2bc1401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:34.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2c3994640 10 monclient(hunting): picked mon.noname-b con 0x7fb2bc12bbe0 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:34.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2c3994640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2bc08c550 con 0x7fb2bc1401c0 2026-02-13T20:11:34.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2c3994640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2bc05d320 con 0x7fb2bc12bbe0 2026-02-13T20:11:34.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2c3994640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2bc12b080 con 0x7fb2bc091950 2026-02-13T20:11:34.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2c3994640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:34.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2c3994640 10 monclient(hunting): authenticate will time out at 656.215128s 2026-02-13T20:11:34.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2c0f08640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fb2bc1401c0 0x7fb2bc114a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:60292/0 (socket says 10.20.193.110:60292) 2026-02-13T20:11:34.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2c0f08640 1 -- 10.20.193.110:0/1633461162 learned_addr learned my addr 10.20.193.110:0/1633461162 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:34.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2c1709640 1 --1- 10.20.193.110:0/1633461162 >> v1:10.20.193.110:6790/0 conn(0x7fb2bc091950 0x7fb2bc114350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:40004/0 (socket says 10.20.193.110:40004) 2026-02-13T20:11:34.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2a9ffb640 1 -- 10.20.193.110:0/1633461162 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 809104670 0 0) 0x7fb2bc08c550 con 0x7fb2bc1401c0 2026-02-13T20:11:34.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2a9ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:11:34.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2a9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:34.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2a9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:34.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2a9ffb640 10 monclient(hunting): my global_id is 4398 2026-02-13T20:11:34.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2a9ffb640 1 -- 10.20.193.110:0/1633461162 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb28c0035e0 con 0x7fb2bc1401c0 2026-02-13T20:11:34.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2a9ffb640 1 -- 10.20.193.110:0/1633461162 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4127022239 0 0) 0x7fb2bc12b080 con 0x7fb2bc091950 2026-02-13T20:11:34.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2a9ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:11:34.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2a9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:34.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2a9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:34.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2a9ffb640 10 monclient(hunting): my global_id is 4403 2026-02-13T20:11:34.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2a9ffb640 1 -- 10.20.193.110:0/1633461162 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2bc08c550 con 0x7fb2bc091950 2026-02-13T20:11:34.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2a9ffb640 1 -- 10.20.193.110:0/1633461162 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1350970885 0 0) 0x7fb28c0035e0 con 0x7fb2bc1401c0 2026-02-13T20:11:34.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2a9ffb640 1 -- 10.20.193.110:0/1633461162 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb2bc12b080 con 0x7fb2bc1401c0 2026-02-13T20:11:34.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2a9ffb640 1 -- 10.20.193.110:0/1633461162 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb2b0003150 con 0x7fb2bc1401c0 2026-02-13T20:11:34.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2a9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:34.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2a9ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:11:34.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2a9ffb640 10 monclient(hunting): dump: 2026-02-13T20:11:34.529 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:34.529 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:34.529 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.529 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.529 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:34.529 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:34.529 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:34.529 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:34.529 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:34.529 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:34.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2a9ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:34.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2a9ffb640 1 -- 10.20.193.110:0/1633461162 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3164665829 0 0) 0x7fb2bc08c550 con 0x7fb2bc091950 2026-02-13T20:11:34.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2a9ffb640 1 -- 10.20.193.110:0/1633461162 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb28c0035e0 con 0x7fb2bc091950 2026-02-13T20:11:34.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2a9ffb640 1 -- 10.20.193.110:0/1633461162 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb2ac0032c0 con 0x7fb2bc091950 2026-02-13T20:11:34.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2a9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:34.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2a9ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:34.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2a9ffb640 10 monclient(hunting): dump: 2026-02-13T20:11:34.530 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:34.530 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:34.530 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.530 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.530 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:34.530 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:34.530 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:34.530 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:34.530 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:34.530 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:34.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2a9ffb640 1 -- 10.20.193.110:0/1633461162 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4274515106 0 0) 0x7fb2bc12b080 con 0x7fb2bc1401c0 2026-02-13T20:11:34.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2a9ffb640 1 -- 10.20.193.110:0/1633461162 >> v1:10.20.193.110:6790/0 conn(0x7fb2bc091950 legacy=0x7fb2bc114350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:34.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2a9ffb640 1 -- 10.20.193.110:0/1633461162 >> v1:10.20.193.188:6789/0 conn(0x7fb2bc12bbe0 legacy=0x7fb2bc1a2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:34.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2a9ffb640 10 monclient: _finish_hunting 0 2026-02-13T20:11:34.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2a9ffb640 1 monclient: found mon.a 2026-02-13T20:11:34.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2a9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:34.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2a9ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:34.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2a9ffb640 1 -- 10.20.193.110:0/1633461162 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2bc12d3e0 con 0x7fb2bc1401c0 2026-02-13T20:11:34.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2a9ffb640 10 monclient: _finish_auth 0 2026-02-13T20:11:34.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2a9ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:11:34.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2a9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:34.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2c3994640 5 monclient: authenticate success, global_id 4398 2026-02-13T20:11:34.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2c3994640 10 monclient: _renew_subs 2026-02-13T20:11:34.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2c3994640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:34.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2c3994640 1 -- 10.20.193.110:0/1633461162 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb2bc12cb40 con 0x7fb2bc1401c0 2026-02-13T20:11:34.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2c3994640 10 monclient: _renew_subs 2026-02-13T20:11:34.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2c3994640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:34.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2c3994640 1 -- 10.20.193.110:0/1633461162 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb2bc1a3970 con 0x7fb2bc1401c0 2026-02-13T20:11:34.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2a9ffb640 1 -- 10.20.193.110:0/1633461162 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb2b00034c0 con 0x7fb2bc1401c0 2026-02-13T20:11:34.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2a9ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:34.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2a9ffb640 1 -- 10.20.193.110:0/1633461162 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb2b0003b30 con 0x7fb2bc1401c0 2026-02-13T20:11:34.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2a9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:34.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2a9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:34.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2ab7fe640 4 set_mon_vals no callback set 2026-02-13T20:11:34.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.524+0000 7fb2a9ffb640 10 monclient: dump: 2026-02-13T20:11:34.531 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:34.531 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:34.531 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.531 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.531 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:34.531 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:34.531 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:34.531 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:34.531 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:34.531 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:34.531 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.525+0000 7fb2c3994640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:34.531 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.525+0000 7fb2c3994640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:34.531 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.525+0000 7fb2c3994640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:34.531 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.525+0000 7fb2c3994640 1 -- 10.20.193.110:0/1633461162 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2bc0008d0 con 0x7fb2bc1401c0 2026-02-13T20:11:34.531 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.525+0000 7fb2a9ffb640 1 -- 10.20.193.110:0/1633461162 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fb2b0003c90 con 0x7fb2bc1401c0 2026-02-13T20:11:34.531 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.525+0000 7fb2a9ffb640 1 -- 10.20.193.110:0/1633461162 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 3531+0+0 (unknown 315507976 0 0) 0x7fb2b004e7d0 con 0x7fb2bc1401c0 2026-02-13T20:11:34.531 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.525+0000 7fb2c1709640 10 monclient: get_auth_request con 0x7fb28c03fae0 auth_method 0 2026-02-13T20:11:34.531 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.527+0000 7fb2a9ffb640 1 -- 10.20.193.110:0/1633461162 <== mon.0 v1:10.20.193.110:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fb2b0017100 con 0x7fb2bc1401c0 2026-02-13T20:11:34.531 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.527+0000 7fb2a9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:34.531 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.527+0000 7fb2a9ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:11:34.632 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.630+0000 7fb2c3994640 1 -- 10.20.193.110:0/1633461162 --> v1:10.20.193.188:6812/1623052694 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb2bc08b450 con 0x7fb28c03fae0 2026-02-13T20:11:34.632 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.630+0000 7fb2a9ffb640 1 -- 10.20.193.110:0/1633461162 <== mgr.4105 v1:10.20.193.188:6812/1623052694 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34138 (unknown 2965378022 0 2959529845) 0x7fb2ac0078d0 con 0x7fb28c03fae0 2026-02-13T20:11:34.633 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:11:34.634 INFO:teuthology.orchestra.run.trial110.stderr:dumped all 2026-02-13T20:11:34.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.631+0000 7fb2c3994640 1 -- 10.20.193.110:0/1633461162 >> v1:10.20.193.188:6812/1623052694 conn(0x7fb28c03fae0 legacy=0x7fb28c05ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:34.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.631+0000 7fb2c3994640 10 monclient: shutdown 2026-02-13T20:11:34.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.631+0000 7fb2c3994640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:34.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.631+0000 7fb2c3994640 1 -- 10.20.193.110:0/1633461162 >> v1:10.20.193.110:6789/0 conn(0x7fb2bc1401c0 legacy=0x7fb2bc114a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:34.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.631+0000 7fb2c3994640 1 -- 10.20.193.110:0/1633461162 shutdown_connections 2026-02-13T20:11:34.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.631+0000 7fb2c3994640 1 -- 10.20.193.110:0/1633461162 >> 10.20.193.110:0/1633461162 conn(0x7fb2bc054e90 msgr2=0x7fb2bc08de20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:34.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.631+0000 7fb2c3994640 1 -- 10.20.193.110:0/1633461162 shutdown_connections 2026-02-13T20:11:34.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.631+0000 7fb2c3994640 1 -- 10.20.193.110:0/1633461162 wait complete. 2026-02-13T20:11:34.641 INFO:teuthology.orchestra.run.trial110.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2026-02-13T20:11:34.122733+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":162840,"kb_used_data":1080,"kb_used_omap":52,"kb_used_meta":161611,"kb_avail":566068200,"statfs":{"total":579820584960,"available":579653836800,"internally_reserved":0,"allocated":1105920,"data_stored":1497169,"data_compressed":16424,"data_compressed_allocated":98304,"data_compressed_original":1179648,"omap_allocated":54015,"internal_metadata":165489921},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.566822"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-13T20:11:30.561334+0000","last_change":"2026-02-13T20:11:30.561334+0000","last_active":"2026-02-13T20:11:30.561334+0000","last_peered":"2026-02-13T20:11:30.561334+0000","last_clean":"2026-02-13T20:11:30.561334+0000","last_became_active":"2026-02-13T20:11:29.018116+0000","last_became_peered":"2026-02-13T20:11:29.018116+0000","last_unstale":"2026-02-13T20:11:30.561334+0000","last_undegraded":"2026-02-13T20:11:30.561334+0000","last_fullsized":"2026-02-13T20:11:30.561334+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T03:21:19.857098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000335309,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-13T20:11:30.561637+0000","last_change":"2026-02-13T20:11:30.561637+0000","last_active":"2026-02-13T20:11:30.561637+0000","last_peered":"2026-02-13T20:11:30.561637+0000","last_clean":"2026-02-13T20:11:30.561637+0000","last_became_active":"2026-02-13T20:11:28.559585+0000","last_became_peered":"2026-02-13T20:11:28.559585+0000","last_unstale":"2026-02-13T20:11:30.561637+0000","last_undegraded":"2026-02-13T20:11:30.561637+0000","last_fullsized":"2026-02-13T20:11:30.561637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T23:13:24.610860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00021035100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-13T20:11:30.561240+0000","last_change":"2026-02-13T20:11:30.561240+0000","last_active":"2026-02-13T20:11:30.561240+0000","last_peered":"2026-02-13T20:11:30.561240+0000","last_clean":"2026-02-13T20:11:30.561240+0000","last_became_active":"2026-02-13T20:11:28.559005+0000","last_became_peered":"2026-02-13T20:11:28.559005+0000","last_unstale":"2026-02-13T20:11:30.561240+0000","last_undegraded":"2026-02-13T20:11:30.561240+0000","last_fullsized":"2026-02-13T20:11:30.561240+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T02:48:59.423627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027156000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-13T20:11:30.561668+0000","last_change":"2026-02-13T20:11:30.561668+0000","last_active":"2026-02-13T20:11:30.561668+0000","last_peered":"2026-02-13T20:11:30.561668+0000","last_clean":"2026-02-13T20:11:30.561668+0000","last_became_active":"2026-02-13T20:11:28.558441+0000","last_became_peered":"2026-02-13T20:11:28.558441+0000","last_unstale":"2026-02-13T20:11:30.561668+0000","last_undegraded":"2026-02-13T20:11:30.561668+0000","last_fullsized":"2026-02-13T20:11:30.561668+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T22:32:58.917639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000231139,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"19'2","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-13T20:11:30.563311+0000","last_change":"2026-02-13T20:11:30.563087+0000","last_active":"2026-02-13T20:11:30.563311+0000","last_peered":"2026-02-13T20:11:30.563311+0000","last_clean":"2026-02-13T20:11:30.563311+0000","last_became_active":"2026-02-13T20:11:28.557848+0000","last_became_peered":"2026-02-13T20:11:28.557848+0000","last_unstale":"2026-02-13T20:11:30.563311+0000","last_undegraded":"2026-02-13T20:11:30.563311+0000","last_fullsized":"2026-02-13T20:11:30.563311+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T21:44:09.052237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064918699999999996,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-13T20:11:32.872910+0000","last_change":"2026-02-13T20:11:30.823369+0000","last_active":"2026-02-13T20:11:32.872910+0000","last_peered":"2026-02-13T20:11:32.872910+0000","last_clean":"2026-02-13T20:11:32.872910+0000","last_became_active":"2026-02-13T20:11:28.559802+0000","last_became_peered":"2026-02-13T20:11:28.559802+0000","last_unstale":"2026-02-13T20:11:32.872910+0000","last_undegraded":"2026-02-13T20:11:32.872910+0000","last_fullsized":"2026-02-13T20:11:32.872910+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T05:27:34.220283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000230979,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-13T20:11:30.561332+0000","last_change":"2026-02-13T20:11:30.561332+0000","last_active":"2026-02-13T20:11:30.561332+0000","last_peered":"2026-02-13T20:11:30.561332+0000","last_clean":"2026-02-13T20:11:30.561332+0000","last_became_active":"2026-02-13T20:11:28.559211+0000","last_became_peered":"2026-02-13T20:11:28.559211+0000","last_unstale":"2026-02-13T20:11:30.561332+0000","last_undegraded":"2026-02-13T20:11:30.561332+0000","last_fullsized":"2026-02-13T20:11:30.561332+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T22:32:44.601301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029208800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"17'1","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-13T20:11:30.562730+0000","last_change":"2026-02-13T20:11:30.562730+0000","last_active":"2026-02-13T20:11:30.562730+0000","last_peered":"2026-02-13T20:11:30.562730+0000","last_clean":"2026-02-13T20:11:30.562730+0000","last_became_active":"2026-02-13T20:11:28.558943+0000","last_became_peered":"2026-02-13T20:11:28.558943+0000","last_unstale":"2026-02-13T20:11:30.562730+0000","last_undegraded":"2026-02-13T20:11:30.562730+0000","last_fullsized":"2026-02-13T20:11:30.562730+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T21:39:10.290168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032435800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"14'112","reported_seq":157,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-13T20:11:30.561154+0000","last_change":"2026-02-13T20:11:25.262882+0000","last_active":"2026-02-13T20:11:30.561154+0000","last_peered":"2026-02-13T20:11:30.561154+0000","last_clean":"2026-02-13T20:11:30.561154+0000","last_became_active":"2026-02-13T20:11:25.262766+0000","last_became_peered":"2026-02-13T20:11:25.262766+0000","last_unstale":"2026-02-13T20:11:30.561154+0000","last_undegraded":"2026-02-13T20:11:30.561154+0000","last_fullsized":"2026-02-13T20:11:30.561154+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:24.258524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:24.258524+0000","last_clean_scrub_stamp":"2026-02-13T20:11:24.258524+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T22:58:36.956434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1180736,"data_compressed":16424,"data_compressed_allocated":98304,"data_compressed_original":1179648,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27124,"kb_used_data":164,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344716,"statfs":{"total":96636764160,"available":96608989184,"internally_reserved":0,"allocated":167936,"data_stored":52125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8123,"internal_metadata":27582533},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640260,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27120,"kb_used_data":160,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344720,"statfs":{"total":96636764160,"available":96608993280,"internally_reserved":0,"allocated":163840,"data_stored":52106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640260,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":212,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":217088,"data_stored":642474,"data_compressed":8212,"data_compressed_allocated":49152,"data_compressed_original":589824,"omap_allocated":9421,"internal_metadata":27581235},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27120,"kb_used_data":160,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344720,"statfs":{"total":96636764160,"available":96608993280,"internally_reserved":0,"allocated":163840,"data_stored":52106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8773,"internal_metadata":27581883},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27124,"kb_used_data":164,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344716,"statfs":{"total":96636764160,"available":96608989184,"internally_reserved":0,"allocated":167936,"data_stored":52125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8773,"internal_metadata":27581883},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640261,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":220,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":225280,"data_stored":646233,"data_compressed":8212,"data_compressed_allocated":49152,"data_compressed_original":589824,"omap_allocated":10150,"internal_metadata":27580506},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":590368,"data_compressed":8212,"data_compressed_allocated":49152,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":590368,"data_compressed":8212,"data_compressed_allocated":49152,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T20:11:34.643 INFO:tasks.mon_thrash.ceph_manager:clean! 2026-02-13T20:11:34.643 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_netsplit_grace_period 30 2026-02-13T20:11:34.710 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.708+0000 7f16206cc640 10 monclient: get_monmap_and_config 2026-02-13T20:11:34.710 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.708+0000 7f16206cc640 10 monclient: build_initial_monmap 2026-02-13T20:11:34.710 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.708+0000 7f16206cc640 10 monclient: monmap: 2026-02-13T20:11:34.710 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:34.710 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:34.710 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:34.709980+0000 2026-02-13T20:11:34.710 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:34.709980+0000 2026-02-13T20:11:34.711 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:34.711 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:34.711 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:34.711 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:34.711 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:34.711 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:34.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.708+0000 7f16206cc640 1 Processor -- start 2026-02-13T20:11:34.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.709+0000 7f16206cc640 1 -- start start 2026-02-13T20:11:34.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.709+0000 7f16206cc640 10 monclient: init 2026-02-13T20:11:34.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.709+0000 7f16206cc640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:34.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.709+0000 7f16206cc640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:11:34.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.709+0000 7f16206cc640 10 monclient(hunting): picked mon.noname-c con 0x7f16181401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:34.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.709+0000 7f16206cc640 10 monclient(hunting): picked mon.noname-a con 0x7f1618092020 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:34.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.709+0000 7f16206cc640 10 monclient(hunting): picked mon.noname-b con 0x7f1618091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:34.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.709+0000 7f16206cc640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f161808b730 con 0x7f1618092020 2026-02-13T20:11:34.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.709+0000 7f16206cc640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f161805c5b0 con 0x7f16181401c0 2026-02-13T20:11:34.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.709+0000 7f16206cc640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f161808bcf0 con 0x7f1618091950 2026-02-13T20:11:34.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.709+0000 7f16206cc640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:34.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.709+0000 7f16206cc640 10 monclient(hunting): authenticate will time out at 656.400598s 2026-02-13T20:11:34.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.709+0000 7f161ec42640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f1618091950 0x7f16181a2a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:40020/0 (socket says 10.20.193.110:40020) 2026-02-13T20:11:34.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.709+0000 7f161dc40640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f1618092020 0x7f16181812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:60294/0 (socket says 10.20.193.110:60294) 2026-02-13T20:11:34.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.709+0000 7f161ec42640 1 -- 10.20.193.110:0/2294390404 learned_addr learned my addr 10.20.193.110:0/2294390404 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:34.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.709+0000 7f161d43f640 1 -- 10.20.193.110:0/2294390404 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1722573802 0 0) 0x7f161808b730 con 0x7f1618092020 2026-02-13T20:11:34.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.709+0000 7f161d43f640 10 monclient(hunting): _negotiate 2026-02-13T20:11:34.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.709+0000 7f161d43f640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:34.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.709+0000 7f161d43f640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:34.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.709+0000 7f161d43f640 10 monclient(hunting): my global_id is 4401 2026-02-13T20:11:34.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.709+0000 7f161d43f640 1 -- 10.20.193.110:0/2294390404 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16000035e0 con 0x7f1618092020 2026-02-13T20:11:34.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.709+0000 7f161d43f640 1 -- 10.20.193.110:0/2294390404 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 119921832 0 0) 0x7f161808bcf0 con 0x7f1618091950 2026-02-13T20:11:34.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.709+0000 7f161d43f640 10 monclient(hunting): _negotiate 2026-02-13T20:11:34.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.709+0000 7f161d43f640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:34.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.709+0000 7f161d43f640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:34.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.709+0000 7f161d43f640 10 monclient(hunting): my global_id is 4406 2026-02-13T20:11:34.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.709+0000 7f161d43f640 1 -- 10.20.193.110:0/2294390404 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f161808b730 con 0x7f1618091950 2026-02-13T20:11:34.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.710+0000 7f161d43f640 1 -- 10.20.193.110:0/2294390404 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 14508012 0 0) 0x7f16000035e0 con 0x7f1618092020 2026-02-13T20:11:34.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.710+0000 7f161d43f640 1 -- 10.20.193.110:0/2294390404 >> v1:10.20.193.110:6790/0 conn(0x7f1618091950 legacy=0x7f16181a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:34.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.710+0000 7f161d43f640 1 -- 10.20.193.110:0/2294390404 >> v1:10.20.193.188:6789/0 conn(0x7f16181401c0 legacy=0x7f1618091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:34.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.710+0000 7f161d43f640 10 monclient: _finish_hunting 0 2026-02-13T20:11:34.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.710+0000 7f161d43f640 1 monclient: found mon.noname-a 2026-02-13T20:11:34.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.710+0000 7f161d43f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:34.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.710+0000 7f161d43f640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:11:34.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.710+0000 7f161d43f640 1 -- 10.20.193.110:0/2294390404 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1618140590 con 0x7f1618092020 2026-02-13T20:11:34.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.710+0000 7f161d43f640 10 monclient: _finish_auth 0 2026-02-13T20:11:34.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.710+0000 7f161d43f640 10 monclient: _check_auth_tickets 2026-02-13T20:11:34.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.710+0000 7f161d43f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:34.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.710+0000 7f161d43f640 1 -- 10.20.193.110:0/2294390404 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f160c002dd0 con 0x7f1618092020 2026-02-13T20:11:34.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.710+0000 7f161d43f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:34.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.710+0000 7f161d43f640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:11:34.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.710+0000 7f161d43f640 10 monclient: dump: 2026-02-13T20:11:34.714 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:34.714 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:34.714 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.714 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.714 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:34.714 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:34.714 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:34.714 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:34.714 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:34.714 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:34.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.710+0000 7f16206cc640 5 monclient: authenticate success, global_id 4401 2026-02-13T20:11:34.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.710+0000 7f16206cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:34.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.710+0000 7f161d43f640 1 -- 10.20.193.110:0/2294390404 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f160c002fa0 con 0x7f1618092020 2026-02-13T20:11:34.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.710+0000 7f161d43f640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:34.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.710+0000 7f161d43f640 1 -- 10.20.193.110:0/2294390404 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f160c0033b0 con 0x7f1618092020 2026-02-13T20:11:34.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.710+0000 7f161d43f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:34.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.710+0000 7f161d43f640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:34.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.710+0000 7f161d43f640 10 monclient: dump: 2026-02-13T20:11:34.715 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:34.715 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:34.715 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.715 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.715 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:34.715 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:34.715 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:34.715 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:34.715 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:34.715 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:34.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.710+0000 7f16206cc640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:34.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.710+0000 7f16206cc640 4 set_mon_vals no callback set 2026-02-13T20:11:34.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.710+0000 7f16206cc640 10 monclient: shutdown 2026-02-13T20:11:34.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.710+0000 7f16206cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:34.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.710+0000 7f16206cc640 1 -- 10.20.193.110:0/2294390404 >> v1:10.20.193.110:6789/0 conn(0x7f1618092020 legacy=0x7f16181812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:34.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.710+0000 7f16206cc640 1 -- 10.20.193.110:0/2294390404 shutdown_connections 2026-02-13T20:11:34.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.710+0000 7f16206cc640 1 -- 10.20.193.110:0/2294390404 >> 10.20.193.110:0/2294390404 conn(0x7f1618054e90 msgr2=0x7f1618058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:34.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.710+0000 7f16206cc640 1 -- 10.20.193.110:0/2294390404 shutdown_connections 2026-02-13T20:11:34.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.710+0000 7f16206cc640 1 -- 10.20.193.110:0/2294390404 wait complete. 2026-02-13T20:11:34.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.710+0000 7f16206cc640 10 monclient: build_initial_monmap 2026-02-13T20:11:34.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.710+0000 7f16206cc640 10 monclient: monmap: 2026-02-13T20:11:34.715 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:34.715 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:34.715 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:11:34.715 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:11:34.715 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:34.715 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:11:34.715 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:34.715 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:34.715 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:34.715 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:34.717 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f16206cc640 1 Processor -- start 2026-02-13T20:11:34.717 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f16206cc640 1 -- start start 2026-02-13T20:11:34.717 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f16206cc640 10 monclient: init 2026-02-13T20:11:34.717 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f16206cc640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:34.717 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f16206cc640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:11:34.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f16206cc640 10 monclient(hunting): picked mon.noname-c con 0x7f1618091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:34.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f16206cc640 10 monclient(hunting): picked mon.noname-a con 0x7f16181401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:34.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f16206cc640 10 monclient(hunting): picked mon.noname-b con 0x7f1618089e40 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:34.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f16206cc640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f161813e8f0 con 0x7f16181401c0 2026-02-13T20:11:34.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f16206cc640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f161808c3f0 con 0x7f1618089e40 2026-02-13T20:11:34.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f16206cc640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f161805d320 con 0x7f1618091950 2026-02-13T20:11:34.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f16206cc640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:34.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f16206cc640 10 monclient(hunting): authenticate will time out at 656.402383s 2026-02-13T20:11:34.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f161e441640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f1618091950 0x7f1618116e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:40026/0 (socket says 10.20.193.110:40026) 2026-02-13T20:11:34.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f161dc40640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f16181401c0 0x7f16181a1040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:60308/0 (socket says 10.20.193.110:60308) 2026-02-13T20:11:34.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f161e441640 1 -- 10.20.193.110:0/1624353374 learned_addr learned my addr 10.20.193.110:0/1624353374 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:34.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f15feffd640 1 -- 10.20.193.110:0/1624353374 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2197199300 0 0) 0x7f161813e8f0 con 0x7f16181401c0 2026-02-13T20:11:34.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f15feffd640 10 monclient(hunting): _negotiate 2026-02-13T20:11:34.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f15feffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:34.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f15feffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:34.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f15feffd640 10 monclient(hunting): my global_id is 4404 2026-02-13T20:11:34.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f15feffd640 1 -- 10.20.193.110:0/1624353374 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15e80035e0 con 0x7f16181401c0 2026-02-13T20:11:34.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f15feffd640 1 -- 10.20.193.110:0/1624353374 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4050735635 0 0) 0x7f161805d320 con 0x7f1618091950 2026-02-13T20:11:34.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f15feffd640 10 monclient(hunting): _negotiate 2026-02-13T20:11:34.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f15feffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:34.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f15feffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:34.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f15feffd640 10 monclient(hunting): my global_id is 4409 2026-02-13T20:11:34.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f15feffd640 1 -- 10.20.193.110:0/1624353374 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f161813e8f0 con 0x7f1618091950 2026-02-13T20:11:34.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f15feffd640 1 -- 10.20.193.110:0/1624353374 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1340807111 0 0) 0x7f161808c3f0 con 0x7f1618089e40 2026-02-13T20:11:34.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f15feffd640 10 monclient(hunting): _negotiate 2026-02-13T20:11:34.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f15feffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:34.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f15feffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:34.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f15feffd640 10 monclient(hunting): my global_id is 4390 2026-02-13T20:11:34.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f15feffd640 1 -- 10.20.193.110:0/1624353374 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f161805d320 con 0x7f1618089e40 2026-02-13T20:11:34.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f15feffd640 1 -- 10.20.193.110:0/1624353374 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2030748811 0 0) 0x7f15e80035e0 con 0x7f16181401c0 2026-02-13T20:11:34.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f15feffd640 1 -- 10.20.193.110:0/1624353374 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f161808c3f0 con 0x7f16181401c0 2026-02-13T20:11:34.719 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f15feffd640 1 -- 10.20.193.110:0/1624353374 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f160c002ce0 con 0x7f16181401c0 2026-02-13T20:11:34.719 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f15feffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:34.719 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f15feffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:11:34.719 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f15feffd640 10 monclient(hunting): dump: 2026-02-13T20:11:34.719 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:34.719 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:34.719 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.719 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.719 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:34.719 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:34.719 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:34.719 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:34.719 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:34.719 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:34.719 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f15feffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:34.719 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f15feffd640 1 -- 10.20.193.110:0/1624353374 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 785349118 0 0) 0x7f161813e8f0 con 0x7f1618091950 2026-02-13T20:11:34.719 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f15feffd640 1 -- 10.20.193.110:0/1624353374 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f15e80035e0 con 0x7f1618091950 2026-02-13T20:11:34.719 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f15feffd640 1 -- 10.20.193.110:0/1624353374 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f1608003170 con 0x7f1618091950 2026-02-13T20:11:34.719 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f15feffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:34.719 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f15feffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:34.719 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f15feffd640 10 monclient(hunting): dump: 2026-02-13T20:11:34.719 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:34.719 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:34.719 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.719 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.719 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:34.719 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:34.719 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:34.719 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:34.719 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:34.719 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:34.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f15feffd640 1 -- 10.20.193.110:0/1624353374 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 851374432 0 0) 0x7f161805d320 con 0x7f1618089e40 2026-02-13T20:11:34.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f15feffd640 1 -- 10.20.193.110:0/1624353374 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f161813e8f0 con 0x7f1618089e40 2026-02-13T20:11:34.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f15feffd640 1 -- 10.20.193.110:0/1624353374 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f1614004170 con 0x7f1618089e40 2026-02-13T20:11:34.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f15feffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:34.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f15feffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-13T20:11:34.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f15feffd640 10 monclient(hunting): dump: 2026-02-13T20:11:34.720 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:34.720 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:34.720 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.720 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.720 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:34.720 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:34.720 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:34.720 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:34.720 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:34.720 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:34.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f15feffd640 1 -- 10.20.193.110:0/1624353374 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 693978783 0 0) 0x7f161808c3f0 con 0x7f16181401c0 2026-02-13T20:11:34.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f15feffd640 1 -- 10.20.193.110:0/1624353374 >> v1:10.20.193.110:6790/0 conn(0x7f1618091950 legacy=0x7f1618116e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:34.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f15feffd640 1 -- 10.20.193.110:0/1624353374 >> v1:10.20.193.188:6789/0 conn(0x7f1618089e40 legacy=0x7f16181a2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:34.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f15feffd640 10 monclient: _finish_hunting 0 2026-02-13T20:11:34.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f15feffd640 1 monclient: found mon.a 2026-02-13T20:11:34.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f15feffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:34.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f15feffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:34.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f15feffd640 1 -- 10.20.193.110:0/1624353374 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f161808a880 con 0x7f16181401c0 2026-02-13T20:11:34.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f15feffd640 10 monclient: _finish_auth 0 2026-02-13T20:11:34.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f15feffd640 10 monclient: _check_auth_tickets 2026-02-13T20:11:34.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f15feffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:34.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f16206cc640 5 monclient: authenticate success, global_id 4404 2026-02-13T20:11:34.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f16206cc640 10 monclient: _renew_subs 2026-02-13T20:11:34.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f16206cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:34.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.711+0000 7f16206cc640 1 -- 10.20.193.110:0/1624353374 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f161812fba0 con 0x7f16181401c0 2026-02-13T20:11:34.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.712+0000 7f16206cc640 10 monclient: _renew_subs 2026-02-13T20:11:34.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.712+0000 7f16206cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:34.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.712+0000 7f16206cc640 1 -- 10.20.193.110:0/1624353374 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f161813f4c0 con 0x7f16181401c0 2026-02-13T20:11:34.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.712+0000 7f15feffd640 1 -- 10.20.193.110:0/1624353374 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f160c0028b0 con 0x7f16181401c0 2026-02-13T20:11:34.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.712+0000 7f15feffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:34.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.712+0000 7f15feffd640 1 -- 10.20.193.110:0/1624353374 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f160c004d00 con 0x7f16181401c0 2026-02-13T20:11:34.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.712+0000 7f15feffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:34.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.712+0000 7f15feffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:34.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.712+0000 7f15feffd640 10 monclient: dump: 2026-02-13T20:11:34.721 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:34.721 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:34.721 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.721 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.721 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:34.721 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:34.721 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:34.721 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:34.721 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:34.721 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:34.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.712+0000 7f161cc3e640 4 set_mon_vals no callback set 2026-02-13T20:11:34.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.712+0000 7f16206cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:34.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.712+0000 7f16206cc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:34.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.712+0000 7f16206cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:34.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.712+0000 7f16206cc640 1 -- 10.20.193.110:0/1624353374 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f161812f3e0 con 0x7f16181401c0 2026-02-13T20:11:34.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.712+0000 7f15feffd640 1 -- 10.20.193.110:0/1624353374 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f160c011970 con 0x7f16181401c0 2026-02-13T20:11:34.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.712+0000 7f15feffd640 1 -- 10.20.193.110:0/1624353374 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 3531+0+0 (unknown 315507976 0 0) 0x7f160c04e6c0 con 0x7f16181401c0 2026-02-13T20:11:34.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.713+0000 7f161e441640 10 monclient: get_auth_request con 0x7f15e803fea0 auth_method 0 2026-02-13T20:11:34.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.714+0000 7f15feffd640 1 -- 10.20.193.110:0/1624353374 <== mon.0 v1:10.20.193.110:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f160c013280 con 0x7f16181401c0 2026-02-13T20:11:34.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.714+0000 7f15feffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:34.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.714+0000 7f15feffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:11:34.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.818+0000 7f16206cc640 10 start_mon_command cmd=[{"prefix": "config set", "who": "mon", "name": "mon_netsplit_grace_period", "value": "30"}] 2026-02-13T20:11:34.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.818+0000 7f16206cc640 10 monclient: _send_command 2 [{"prefix": "config set", "who": "mon", "name": "mon_netsplit_grace_period", "value": "30"}] 2026-02-13T20:11:34.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.818+0000 7f16206cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:34.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.818+0000 7f16206cc640 1 -- 10.20.193.110:0/1624353374 --> v1:10.20.193.110:6789/0 -- mon_command([{prefix=config set, name=mon_netsplit_grace_period}] v 0) -- 0x7f1618055bb0 con 0x7f16181401c0 2026-02-13T20:11:34.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.823+0000 7f15feffd640 1 -- 10.20.193.110:0/1624353374 <== mon.0 v1:10.20.193.110:6789/0 10 ==== mon_command_ack([{prefix=config set, name=mon_netsplit_grace_period}]=0 v2)=0 v2) ==== 124+0+0 (unknown 948039188 0 0) 0x7f160c0167c0 con 0x7f16181401c0 2026-02-13T20:11:34.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.823+0000 7f15feffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config set", "who": "mon", "name": "mon_netsplit_grace_period", "value": "30"}] 2026-02-13T20:11:34.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.823+0000 7f15feffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:11:34.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.824+0000 7f16206cc640 1 -- 10.20.193.110:0/1624353374 >> v1:10.20.193.188:6812/1623052694 conn(0x7f15e803fea0 legacy=0x7f15e8060350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:34.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.824+0000 7f16206cc640 10 monclient: shutdown 2026-02-13T20:11:34.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.824+0000 7f16206cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:34.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.824+0000 7f16206cc640 1 -- 10.20.193.110:0/1624353374 >> v1:10.20.193.110:6789/0 conn(0x7f16181401c0 legacy=0x7f16181a1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:34.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.824+0000 7f16206cc640 1 -- 10.20.193.110:0/1624353374 shutdown_connections 2026-02-13T20:11:34.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.824+0000 7f16206cc640 1 -- 10.20.193.110:0/1624353374 >> 10.20.193.110:0/1624353374 conn(0x7f1618054e90 msgr2=0x7f161808de20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:34.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.824+0000 7f16206cc640 1 -- 10.20.193.110:0/1624353374 shutdown_connections 2026-02-13T20:11:34.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.824+0000 7f16206cc640 1 -- 10.20.193.110:0/1624353374 wait complete. 2026-02-13T20:11:34.835 DEBUG:tasks.mon_thrash:Yielding 2026-02-13T20:11:34.836 INFO:teuthology.run_tasks:Running task rados... 2026-02-13T20:11:34.851 INFO:tasks.rados:Beginning rados... 2026-02-13T20:11:34.851 INFO:tasks.rados:config is {'clients': ['client.0'], 'objects': 50, 'op_weights': {'copy_from': 50, 'delete': 50, 'read': 100, 'rollback': 50, 'snap_create': 50, 'snap_remove': 50, 'write': 100}, 'ops': 4000} 2026-02-13T20:11:34.851 INFO:tasks.rados:overrides is {'admin_socket': {'branch': 'wip-yuri4-testing-2026-02-11-2126'}, 'ceph': {'conf': {'client': {'debug monc': 20, 'debug ms': 1}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 30, 'debug ms': 20, 'debug paxos': 20, 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos service trim min': 5}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zlib', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore onode segment size': '256K', 'bluestore write v2': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd op num shards': 1, 'osd op num threads per shard': 2, 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd_mclock_skip_benchmark': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'ScrubResult', 'scrub mismatch', 'overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_AVAILABILITY\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(OSD_SLOW_PING_TIME', '\\(MON_NETSPLIT)', 'overall HEALTH_', '\\(MON_DOWN\\)', '\\(TOO_FEW_PGS\\)', '\\(POOL_APP_NOT_ENABLED\\)'], 'mon_bind_msgr2': False, 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri4-testing-2026-02-11-2126', 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6'}} 2026-02-13T20:11:34.852 INFO:tasks.rados:config is {'clients': ['client.0'], 'objects': 50, 'op_weights': {'copy_from': 50, 'delete': 50, 'read': 100, 'rollback': 50, 'snap_create': 50, 'snap_remove': 50, 'write': 100}, 'ops': 4000} 2026-02-13T20:11:34.852 DEBUG:teuthology.run_tasks:Unwinding manager rados 2026-02-13T20:11:34.862 INFO:tasks.rados:joining rados 2026-02-13T20:11:34.862 INFO:tasks.mon_thrash.mon_thrasher:start thrashing 2026-02-13T20:11:34.863 INFO:tasks.mon_thrash.mon_thrasher:seed: 1771013494, revive delay: 90.0, thrash delay: 1.0 thrash many: True, maintain quorum: True store thrash: True, probability: 50 freeze mon: prob 10.0 duration 15.0 2026-02-13T20:11:34.863 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-13T20:11:34.863 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T20:11:34.863 INFO:tasks.rados:clients are ['client.0'] 2026-02-13T20:11:34.863 INFO:tasks.rados:starting run 0 out of 1 2026-02-13T20:11:34.863 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2026-02-13T20:11:34.863 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 16 2026-02-13T20:11:34.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.927+0000 7f3354e36640 10 monclient: get_monmap_and_config 2026-02-13T20:11:34.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.927+0000 7f3354e36640 10 monclient: build_initial_monmap 2026-02-13T20:11:34.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.927+0000 7f3354e36640 10 monclient: monmap: 2026-02-13T20:11:34.930 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:34.930 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:34.930 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:34.928587+0000 2026-02-13T20:11:34.930 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:34.928587+0000 2026-02-13T20:11:34.930 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:34.930 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:34.930 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:34.931 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:34.931 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:34.931 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:34.931 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.927+0000 7f3354e36640 1 Processor -- start 2026-02-13T20:11:34.931 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.927+0000 7f3354e36640 1 -- start start 2026-02-13T20:11:34.931 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.927+0000 7f3354e36640 10 monclient: init 2026-02-13T20:11:34.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.927+0000 7f3354e36640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:34.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f3354e36640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:11:34.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f3354e36640 10 monclient(hunting): picked mon.noname-b con 0x7f3350089250 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:34.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f3354e36640 10 monclient(hunting): picked mon.noname-a con 0x7f3350057780 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:34.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f3354e36640 10 monclient(hunting): picked mon.noname-c con 0x7f3350184b60 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:34.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f3354e36640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f335008a950 con 0x7f3350057780 2026-02-13T20:11:34.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f3354e36640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3350089620 con 0x7f3350184b60 2026-02-13T20:11:34.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f3354e36640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3350057c60 con 0x7f3350089250 2026-02-13T20:11:34.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f3354e36640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:34.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f3354e36640 10 monclient(hunting): authenticate will time out at 656.619066s 2026-02-13T20:11:34.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f334e575640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f3350089250 0x7f33500580b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:40028/0 (socket says 10.20.193.110:40028) 2026-02-13T20:11:34.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f334e575640 1 -- 10.20.193.110:0/258097690 learned_addr learned my addr 10.20.193.110:0/258097690 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:34.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f334d573640 1 -- 10.20.193.110:0/258097690 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 332996455 0 0) 0x7f3350057c60 con 0x7f3350089250 2026-02-13T20:11:34.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f334d573640 10 monclient(hunting): _negotiate 2026-02-13T20:11:34.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f334d573640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:34.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f334d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:34.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f334d573640 10 monclient(hunting): my global_id is 4412 2026-02-13T20:11:34.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f334d573640 1 -- 10.20.193.110:0/258097690 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f333c0035e0 con 0x7f3350089250 2026-02-13T20:11:34.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f334d573640 1 -- 10.20.193.110:0/258097690 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 999037628 0 0) 0x7f335008a950 con 0x7f3350057780 2026-02-13T20:11:34.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f334d573640 10 monclient(hunting): _negotiate 2026-02-13T20:11:34.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f334d573640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:34.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f334d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:34.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f334d573640 10 monclient(hunting): my global_id is 4407 2026-02-13T20:11:34.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f334d573640 1 -- 10.20.193.110:0/258097690 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3350057c60 con 0x7f3350057780 2026-02-13T20:11:34.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f334d573640 1 -- 10.20.193.110:0/258097690 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1532075194 0 0) 0x7f3350057c60 con 0x7f3350057780 2026-02-13T20:11:34.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f334d573640 1 -- 10.20.193.110:0/258097690 >> v1:10.20.193.110:6790/0 conn(0x7f3350089250 legacy=0x7f33500580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:34.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f334d573640 1 -- 10.20.193.110:0/258097690 >> v1:10.20.193.188:6789/0 conn(0x7f3350184b60 legacy=0x7f33501a4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:34.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f334d573640 10 monclient: _finish_hunting 0 2026-02-13T20:11:34.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f334d573640 1 monclient: found mon.noname-a 2026-02-13T20:11:34.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f334d573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:34.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f334d573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:11:34.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f334d573640 1 -- 10.20.193.110:0/258097690 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3350089a50 con 0x7f3350057780 2026-02-13T20:11:34.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f334d573640 10 monclient: _finish_auth 0 2026-02-13T20:11:34.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f334d573640 10 monclient: _check_auth_tickets 2026-02-13T20:11:34.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f334d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:34.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f334d573640 1 -- 10.20.193.110:0/258097690 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f3338002d50 con 0x7f3350057780 2026-02-13T20:11:34.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f3354e36640 5 monclient: authenticate success, global_id 4407 2026-02-13T20:11:34.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f3354e36640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:34.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f334d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:34.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f334d573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:11:34.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f334d573640 10 monclient: dump: 2026-02-13T20:11:34.939 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:34.939 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:34.939 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.939 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.939 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:34.939 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:34.939 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:34.939 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:34.939 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:34.940 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:34.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f3354e36640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:34.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f334d573640 1 -- 10.20.193.110:0/258097690 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3338003010 con 0x7f3350057780 2026-02-13T20:11:34.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f334d573640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:34.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f3354e36640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:34.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f3354e36640 4 set_mon_vals no callback set 2026-02-13T20:11:34.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f334d573640 1 -- 10.20.193.110:0/258097690 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f33380033e0 con 0x7f3350057780 2026-02-13T20:11:34.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f334d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:34.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f334d573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:34.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f334d573640 10 monclient: dump: 2026-02-13T20:11:34.940 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:34.941 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:34.941 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.941 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.941 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:34.941 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:34.941 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:34.941 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:34.941 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:34.941 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:34.941 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f3354e36640 10 monclient: shutdown 2026-02-13T20:11:34.941 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f3354e36640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:34.942 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f3354e36640 1 -- 10.20.193.110:0/258097690 >> v1:10.20.193.110:6789/0 conn(0x7f3350057780 legacy=0x7f3350183440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:34.942 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f3354e36640 1 -- 10.20.193.110:0/258097690 shutdown_connections 2026-02-13T20:11:34.942 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f3354e36640 1 -- 10.20.193.110:0/258097690 >> 10.20.193.110:0/258097690 conn(0x7f3350054330 msgr2=0x7f3350054730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:34.942 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f3354e36640 1 -- 10.20.193.110:0/258097690 shutdown_connections 2026-02-13T20:11:34.942 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.928+0000 7f3354e36640 1 -- 10.20.193.110:0/258097690 wait complete. 2026-02-13T20:11:34.942 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.929+0000 7f36f4c78640 10 monclient: get_monmap_and_config 2026-02-13T20:11:34.943 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.929+0000 7f36f4c78640 10 monclient: build_initial_monmap 2026-02-13T20:11:34.943 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.929+0000 7f36f4c78640 10 monclient: monmap: 2026-02-13T20:11:34.943 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:34.943 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:34.943 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:34.930439+0000 2026-02-13T20:11:34.943 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:34.930439+0000 2026-02-13T20:11:34.943 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:34.943 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:34.943 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:34.943 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:34.944 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:34.944 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:34.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.929+0000 7f3354e36640 10 monclient: build_initial_monmap 2026-02-13T20:11:34.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.929+0000 7f3354e36640 10 monclient: monmap: 2026-02-13T20:11:34.944 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:34.944 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:34.944 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:11:34.945 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:11:34.945 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:34.945 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:11:34.945 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:34.945 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:34.945 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:34.945 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:34.946 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.929+0000 7f36f4c78640 1 Processor -- start 2026-02-13T20:11:34.946 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.929+0000 7f36f4c78640 1 -- start start 2026-02-13T20:11:34.946 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.929+0000 7f36f4c78640 10 monclient: init 2026-02-13T20:11:34.947 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.929+0000 7f3354e36640 1 Processor -- start 2026-02-13T20:11:34.947 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.929+0000 7f3354e36640 1 -- start start 2026-02-13T20:11:34.947 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.929+0000 7f3354e36640 10 monclient: init 2026-02-13T20:11:34.948 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.929+0000 7f36f4c78640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:34.948 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.929+0000 7f36f4c78640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:11:34.948 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.929+0000 7f36f4c78640 10 monclient(hunting): picked mon.noname-c con 0x7f36f013f280 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:34.948 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.929+0000 7f36f4c78640 10 monclient(hunting): picked mon.noname-b con 0x7f36f013ee70 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:34.948 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.929+0000 7f36f4c78640 10 monclient(hunting): picked mon.noname-a con 0x7f36f0089a90 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:34.948 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.929+0000 7f36f4c78640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36f008a310 con 0x7f36f0089a90 2026-02-13T20:11:34.948 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.929+0000 7f36f4c78640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36f008a5f0 con 0x7f36f013f280 2026-02-13T20:11:34.948 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.929+0000 7f36f4c78640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36f008a8d0 con 0x7f36f013ee70 2026-02-13T20:11:34.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.929+0000 7f36f4c78640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:34.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.929+0000 7f36f4c78640 10 monclient(hunting): authenticate will time out at 656.620783s 2026-02-13T20:11:34.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.929+0000 7f3354e36640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:34.950 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.929+0000 7f3354e36640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:11:34.950 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.929+0000 7f3354e36640 10 monclient(hunting): picked mon.noname-b con 0x7f3350057780 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:34.950 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.929+0000 7f3354e36640 10 monclient(hunting): picked mon.noname-c con 0x7f3350089250 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:34.950 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.929+0000 7f3354e36640 10 monclient(hunting): picked mon.noname-a con 0x7f3350184b60 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:34.950 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.929+0000 7f3354e36640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3350111ce0 con 0x7f3350184b60 2026-02-13T20:11:34.950 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.929+0000 7f36edd74640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f36f013ee70 0x7f36f0180190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:40038/0 (socket says 10.20.193.110:40038) 2026-02-13T20:11:34.951 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.929+0000 7f36edd74640 1 -- 10.20.193.110:0/184018996 learned_addr learned my addr 10.20.193.110:0/184018996 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:34.951 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.929+0000 7f3354e36640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f335012b050 con 0x7f3350057780 2026-02-13T20:11:34.951 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.929+0000 7f3354e36640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33501122a0 con 0x7f3350089250 2026-02-13T20:11:34.951 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.929+0000 7f3354e36640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:34.951 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.929+0000 7f3354e36640 10 monclient(hunting): authenticate will time out at 656.620885s 2026-02-13T20:11:34.952 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.929+0000 7f334ed76640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f3350184b60 0x7f3350173420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:60342/0 (socket says 10.20.193.110:60342) 2026-02-13T20:11:34.952 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.929+0000 7f334ed76640 1 -- 10.20.193.110:0/2794840997 learned_addr learned my addr 10.20.193.110:0/2794840997 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:34.952 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f36ed573640 1 -- 10.20.193.110:0/184018996 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1926527773 0 0) 0x7f36f008a310 con 0x7f36f0089a90 2026-02-13T20:11:34.952 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f36ed573640 10 monclient(hunting): _negotiate 2026-02-13T20:11:34.953 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f36ed573640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:34.953 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f36ed573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:34.953 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f36ed573640 10 monclient(hunting): my global_id is 4410 2026-02-13T20:11:34.953 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f36ed573640 1 -- 10.20.193.110:0/184018996 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36dc0035e0 con 0x7f36f0089a90 2026-02-13T20:11:34.953 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f36ed573640 1 -- 10.20.193.110:0/184018996 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 886836456 0 0) 0x7f36f008a8d0 con 0x7f36f013ee70 2026-02-13T20:11:34.953 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f36ed573640 10 monclient(hunting): _negotiate 2026-02-13T20:11:34.953 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f36ed573640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:34.953 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f36ed573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:34.953 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f36ed573640 10 monclient(hunting): my global_id is 4415 2026-02-13T20:11:34.953 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f36ed573640 1 -- 10.20.193.110:0/184018996 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36f008a310 con 0x7f36f013ee70 2026-02-13T20:11:34.954 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 1 -- 10.20.193.110:0/2794840997 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3558732716 0 0) 0x7f3350111ce0 con 0x7f3350184b60 2026-02-13T20:11:34.954 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:11:34.954 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:34.954 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:34.954 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 10 monclient(hunting): my global_id is 4413 2026-02-13T20:11:34.955 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 1 -- 10.20.193.110:0/2794840997 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f331c0035e0 con 0x7f3350184b60 2026-02-13T20:11:34.956 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f36ed573640 1 -- 10.20.193.110:0/184018996 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2361808648 0 0) 0x7f36dc0035e0 con 0x7f36f0089a90 2026-02-13T20:11:34.956 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f36ed573640 1 -- 10.20.193.110:0/184018996 >> v1:10.20.193.110:6790/0 conn(0x7f36f013ee70 legacy=0x7f36f0180190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:34.956 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f36ed573640 1 -- 10.20.193.110:0/184018996 >> v1:10.20.193.188:6789/0 conn(0x7f36f013f280 legacy=0x7f36f013f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T20:11:34.956 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f36ed573640 10 monclient: _finish_hunting 0 2026-02-13T20:11:34.956 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f36ed573640 1 monclient: found mon.noname-a 2026-02-13T20:11:34.956 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f36ed573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:34.956 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f36ed573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:11:34.956 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f36ed573640 1 -- 10.20.193.110:0/184018996 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36f008abb0 con 0x7f36f0089a90 2026-02-13T20:11:34.956 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f36ed573640 10 monclient: _finish_auth 0 2026-02-13T20:11:34.956 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f36ed573640 10 monclient: _check_auth_tickets 2026-02-13T20:11:34.956 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f36ed573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:34.957 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f36ed573640 1 -- 10.20.193.110:0/184018996 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f36e0003eb0 con 0x7f36f0089a90 2026-02-13T20:11:34.957 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f36f4c78640 5 monclient: authenticate success, global_id 4410 2026-02-13T20:11:34.957 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f36f4c78640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:34.957 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f36ed573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:34.957 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f36ed573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:11:34.957 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f36ed573640 10 monclient: dump: 2026-02-13T20:11:34.957 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:34.957 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:34.957 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.957 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.957 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:34.957 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:34.958 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:34.958 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:34.958 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:34.958 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:34.958 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f36f4c78640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:34.959 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 1 -- 10.20.193.110:0/2794840997 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1945688753 0 0) 0x7f33501122a0 con 0x7f3350089250 2026-02-13T20:11:34.959 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:11:34.959 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:34.959 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:34.959 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 10 monclient(hunting): my global_id is 4418 2026-02-13T20:11:34.959 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 1 -- 10.20.193.110:0/2794840997 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3350111ce0 con 0x7f3350089250 2026-02-13T20:11:34.959 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 1 -- 10.20.193.110:0/2794840997 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3352629358 0 0) 0x7f335012b050 con 0x7f3350057780 2026-02-13T20:11:34.960 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:11:34.960 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:34.960 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:34.960 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 10 monclient(hunting): my global_id is 4396 2026-02-13T20:11:34.960 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 1 -- 10.20.193.110:0/2794840997 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33501122a0 con 0x7f3350057780 2026-02-13T20:11:34.960 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f36ed573640 1 -- 10.20.193.110:0/184018996 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f36e00040f0 con 0x7f36f0089a90 2026-02-13T20:11:34.960 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f36ed573640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:34.960 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f36ed573640 1 -- 10.20.193.110:0/184018996 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f36e0004500 con 0x7f36f0089a90 2026-02-13T20:11:34.961 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f36ed573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:34.961 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 1 -- 10.20.193.110:0/2794840997 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 961663019 0 0) 0x7f331c0035e0 con 0x7f3350184b60 2026-02-13T20:11:34.961 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f36ed573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:34.961 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f36ed573640 10 monclient: dump: 2026-02-13T20:11:34.961 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:34.962 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:34.962 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.962 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.962 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:34.962 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:34.962 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:34.962 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:34.962 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:34.962 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:34.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f36f4c78640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:34.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f36f4c78640 4 set_mon_vals no callback set 2026-02-13T20:11:34.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 1 -- 10.20.193.110:0/2794840997 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f335012b050 con 0x7f3350184b60 2026-02-13T20:11:34.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 1 -- 10.20.193.110:0/2794840997 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f3340004140 con 0x7f3350184b60 2026-02-13T20:11:34.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:34.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:11:34.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 10 monclient(hunting): dump: 2026-02-13T20:11:34.965 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:34.965 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:34.965 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.965 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.965 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:34.965 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:34.965 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:34.965 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:34.965 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:34.965 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:34.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:34.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 1 -- 10.20.193.110:0/2794840997 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 151503444 0 0) 0x7f3350111ce0 con 0x7f3350089250 2026-02-13T20:11:34.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 1 -- 10.20.193.110:0/2794840997 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f331c0035e0 con 0x7f3350089250 2026-02-13T20:11:34.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 1 -- 10.20.193.110:0/2794840997 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f3338003330 con 0x7f3350089250 2026-02-13T20:11:34.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:34.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:34.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 10 monclient(hunting): dump: 2026-02-13T20:11:34.966 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:34.966 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:34.966 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.966 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.966 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:34.966 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:34.966 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:34.966 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:34.966 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:34.966 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:34.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 1 -- 10.20.193.110:0/2794840997 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 608735312 0 0) 0x7f33501122a0 con 0x7f3350057780 2026-02-13T20:11:34.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 1 -- 10.20.193.110:0/2794840997 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3350111ce0 con 0x7f3350057780 2026-02-13T20:11:34.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 1 -- 10.20.193.110:0/2794840997 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f3344003090 con 0x7f3350057780 2026-02-13T20:11:34.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:34.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-13T20:11:34.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 10 monclient(hunting): dump: 2026-02-13T20:11:34.967 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:34.967 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:34.967 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.967 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.967 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:34.967 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:34.967 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:34.968 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:34.968 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:34.968 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:34.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 1 -- 10.20.193.110:0/2794840997 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 527032142 0 0) 0x7f335012b050 con 0x7f3350184b60 2026-02-13T20:11:34.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 1 -- 10.20.193.110:0/2794840997 >> v1:10.20.193.110:6790/0 conn(0x7f3350089250 legacy=0x7f3350171d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:34.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 1 -- 10.20.193.110:0/2794840997 >> v1:10.20.193.188:6789/0 conn(0x7f3350057780 legacy=0x7f335012a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:34.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 10 monclient: _finish_hunting 0 2026-02-13T20:11:34.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 1 monclient: found mon.a 2026-02-13T20:11:34.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:34.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:34.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 1 -- 10.20.193.110:0/2794840997 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3350111430 con 0x7f3350184b60 2026-02-13T20:11:34.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 10 monclient: _finish_auth 0 2026-02-13T20:11:34.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 10 monclient: _check_auth_tickets 2026-02-13T20:11:34.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:34.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3354e36640 5 monclient: authenticate success, global_id 4413 2026-02-13T20:11:34.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3354e36640 10 monclient: _renew_subs 2026-02-13T20:11:34.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3354e36640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:34.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3354e36640 1 -- 10.20.193.110:0/2794840997 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f335010ffa0 con 0x7f3350184b60 2026-02-13T20:11:34.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3354e36640 10 monclient: _renew_subs 2026-02-13T20:11:34.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3354e36640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:34.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3354e36640 1 -- 10.20.193.110:0/2794840997 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3350110aa0 con 0x7f3350184b60 2026-02-13T20:11:34.970 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f36f4c78640 10 monclient: shutdown 2026-02-13T20:11:34.970 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f36f4c78640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:34.970 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f36f4c78640 1 -- 10.20.193.110:0/184018996 >> v1:10.20.193.110:6789/0 conn(0x7f36f0089a90 legacy=0x7f36f01a18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:34.970 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f36f4c78640 1 -- 10.20.193.110:0/184018996 shutdown_connections 2026-02-13T20:11:34.970 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f36f4c78640 1 -- 10.20.193.110:0/184018996 >> 10.20.193.110:0/184018996 conn(0x7f36f0054e90 msgr2=0x7f36f0058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:34.970 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f36f4c78640 1 -- 10.20.193.110:0/184018996 shutdown_connections 2026-02-13T20:11:34.970 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 1 -- 10.20.193.110:0/2794840997 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f33400042a0 con 0x7f3350184b60 2026-02-13T20:11:34.970 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:34.971 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 1 -- 10.20.193.110:0/2794840997 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f3340004a20 con 0x7f3350184b60 2026-02-13T20:11:34.971 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:34.971 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:34.971 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f36f4c78640 1 -- 10.20.193.110:0/184018996 wait complete. 2026-02-13T20:11:34.971 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f3336ffd640 10 monclient: dump: 2026-02-13T20:11:34.971 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:34.972 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:34.972 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.972 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.972 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:34.972 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:34.972 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:34.972 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:34.972 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:34.972 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:34.972 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.930+0000 7f334cd72640 4 set_mon_vals no callback set 2026-02-13T20:11:34.972 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.931+0000 7f3354e36640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:34.972 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.931+0000 7f3354e36640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:34.972 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.931+0000 7f3354e36640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:34.972 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.931+0000 7f3354e36640 1 -- 10.20.193.110:0/2794840997 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3350089030 con 0x7f3350184b60 2026-02-13T20:11:34.972 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.931+0000 7f36f4c78640 10 monclient: build_initial_monmap 2026-02-13T20:11:34.973 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.931+0000 7f36f4c78640 10 monclient: monmap: 2026-02-13T20:11:34.973 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:34.973 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:34.973 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:11:34.973 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:11:34.973 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:34.973 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:11:34.973 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:34.973 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:34.973 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:34.973 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:34.973 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.931+0000 7f3336ffd640 1 -- 10.20.193.110:0/2794840997 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f3340004b80 con 0x7f3350184b60 2026-02-13T20:11:34.974 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.931+0000 7f36f4c78640 1 Processor -- start 2026-02-13T20:11:34.974 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.931+0000 7f36f4c78640 1 -- start start 2026-02-13T20:11:34.974 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.931+0000 7f36f4c78640 10 monclient: init 2026-02-13T20:11:34.974 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.931+0000 7f3336ffd640 1 -- 10.20.193.110:0/2794840997 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 3531+0+0 (unknown 315507976 0 0) 0x7f334004f7d0 con 0x7f3350184b60 2026-02-13T20:11:34.975 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.931+0000 7f36f4c78640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:34.975 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.931+0000 7f36f4c78640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:11:34.975 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.931+0000 7f36f4c78640 10 monclient(hunting): picked mon.noname-a con 0x7f36f0089a90 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:34.975 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.931+0000 7f36f4c78640 10 monclient(hunting): picked mon.noname-b con 0x7f36f013ee70 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:34.975 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.931+0000 7f36f4c78640 10 monclient(hunting): picked mon.noname-c con 0x7f36f013f280 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:34.975 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.931+0000 7f36f4c78640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36f012df40 con 0x7f36f0089a90 2026-02-13T20:11:34.975 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.931+0000 7f36f4c78640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36f012e500 con 0x7f36f013ee70 2026-02-13T20:11:34.975 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.931+0000 7f36f4c78640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36f012e7e0 con 0x7f36f013f280 2026-02-13T20:11:34.975 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.931+0000 7f36f4c78640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:34.975 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.931+0000 7f36f4c78640 10 monclient(hunting): authenticate will time out at 656.622766s 2026-02-13T20:11:34.976 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.931+0000 7f334e575640 10 monclient: get_auth_request con 0x7f331c03ff80 auth_method 0 2026-02-13T20:11:34.978 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.931+0000 7f36ee575640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f36f0089a90 0x7f36f012a9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:60352/0 (socket says 10.20.193.110:60352) 2026-02-13T20:11:34.978 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.931+0000 7f36eed76640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f36f013f280 0x7f36f0119370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:40044/0 (socket says 10.20.193.110:40044) 2026-02-13T20:11:34.978 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.931+0000 7f36ee575640 1 -- 10.20.193.110:0/2162475689 learned_addr learned my addr 10.20.193.110:0/2162475689 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:34.978 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.932+0000 7f36d6ffd640 1 -- 10.20.193.110:0/2162475689 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2144591377 0 0) 0x7f36f012e7e0 con 0x7f36f013f280 2026-02-13T20:11:34.978 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.932+0000 7f36d6ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:11:34.978 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.932+0000 7f36d6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:34.978 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.932+0000 7f36d6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:34.978 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.932+0000 7f36d6ffd640 10 monclient(hunting): my global_id is 4421 2026-02-13T20:11:34.978 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.932+0000 7f36d6ffd640 1 -- 10.20.193.110:0/2162475689 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36bc0035e0 con 0x7f36f013f280 2026-02-13T20:11:34.978 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.932+0000 7f36d6ffd640 1 -- 10.20.193.110:0/2162475689 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 776035139 0 0) 0x7f36bc0035e0 con 0x7f36f013f280 2026-02-13T20:11:34.978 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.932+0000 7f36d6ffd640 1 -- 10.20.193.110:0/2162475689 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f36f012e7e0 con 0x7f36f013f280 2026-02-13T20:11:34.978 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.932+0000 7f36d6ffd640 1 -- 10.20.193.110:0/2162475689 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f36e0003dc0 con 0x7f36f013f280 2026-02-13T20:11:34.978 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.932+0000 7f36d6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:34.978 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.932+0000 7f36d6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:11:34.978 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.932+0000 7f36d6ffd640 10 monclient(hunting): dump: 2026-02-13T20:11:34.979 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:34.979 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:34.979 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.979 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.979 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:34.979 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:34.979 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:34.979 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:34.979 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:34.979 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:34.979 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.932+0000 7f36d6ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:34.979 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.932+0000 7f36d6ffd640 1 -- 10.20.193.110:0/2162475689 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3116625366 0 0) 0x7f36f012e500 con 0x7f36f013ee70 2026-02-13T20:11:34.979 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.932+0000 7f36d6ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:11:34.979 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.932+0000 7f36d6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:34.979 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.932+0000 7f36d6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:34.979 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.932+0000 7f36d6ffd640 10 monclient(hunting): my global_id is 4399 2026-02-13T20:11:34.979 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.932+0000 7f36d6ffd640 1 -- 10.20.193.110:0/2162475689 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36bc0035e0 con 0x7f36f013ee70 2026-02-13T20:11:34.979 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.932+0000 7f36d6ffd640 1 -- 10.20.193.110:0/2162475689 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3723810259 0 0) 0x7f36f012e7e0 con 0x7f36f013f280 2026-02-13T20:11:34.979 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.932+0000 7f36d6ffd640 1 -- 10.20.193.110:0/2162475689 >> v1:10.20.193.188:6789/0 conn(0x7f36f013ee70 legacy=0x7f36f012b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:34.979 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.932+0000 7f36d6ffd640 1 -- 10.20.193.110:0/2162475689 >> v1:10.20.193.110:6789/0 conn(0x7f36f0089a90 legacy=0x7f36f012a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:34.980 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.932+0000 7f36d6ffd640 10 monclient: _finish_hunting 0 2026-02-13T20:11:34.980 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.932+0000 7f36d6ffd640 1 monclient: found mon.c 2026-02-13T20:11:34.980 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.932+0000 7f36d6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:34.980 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.932+0000 7f36d6ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:34.980 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.932+0000 7f36d6ffd640 1 -- 10.20.193.110:0/2162475689 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36f005d320 con 0x7f36f013f280 2026-02-13T20:11:34.980 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.932+0000 7f36d6ffd640 10 monclient: _finish_auth 0 2026-02-13T20:11:34.980 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.932+0000 7f36d6ffd640 10 monclient: _check_auth_tickets 2026-02-13T20:11:34.980 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.932+0000 7f36d6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:34.980 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.932+0000 7f36f4c78640 5 monclient: authenticate success, global_id 4421 2026-02-13T20:11:34.980 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.932+0000 7f36f4c78640 10 monclient: _renew_subs 2026-02-13T20:11:34.980 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.932+0000 7f36f4c78640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:34.980 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.932+0000 7f36f4c78640 1 -- 10.20.193.110:0/2162475689 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f36f012d970 con 0x7f36f013f280 2026-02-13T20:11:34.980 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.932+0000 7f36f4c78640 10 monclient: _renew_subs 2026-02-13T20:11:34.980 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.932+0000 7f36f4c78640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:34.980 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.932+0000 7f36f4c78640 1 -- 10.20.193.110:0/2162475689 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f36f012d180 con 0x7f36f013f280 2026-02-13T20:11:34.980 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.932+0000 7f36d6ffd640 1 -- 10.20.193.110:0/2162475689 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f36e0004a60 con 0x7f36f013f280 2026-02-13T20:11:34.980 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.932+0000 7f36d6ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:34.980 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.932+0000 7f36d6ffd640 1 -- 10.20.193.110:0/2162475689 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f36e0004dc0 con 0x7f36f013f280 2026-02-13T20:11:34.980 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.932+0000 7f36d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:34.980 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.932+0000 7f36ecd72640 4 set_mon_vals no callback set 2026-02-13T20:11:34.980 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.932+0000 7f36d6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:34.981 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.932+0000 7f36d6ffd640 10 monclient: dump: 2026-02-13T20:11:34.981 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:34.981 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:34.981 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.981 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:34.981 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:34.981 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:34.981 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:34.981 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:34.981 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:34.981 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:34.981 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.932+0000 7f36f4c78640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:34.981 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.932+0000 7f36f4c78640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:34.981 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.932+0000 7f36f4c78640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:34.981 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.932+0000 7f36f4c78640 1 -- 10.20.193.110:0/2162475689 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36f012d430 con 0x7f36f013f280 2026-02-13T20:11:34.981 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.933+0000 7f36d6ffd640 1 -- 10.20.193.110:0/2162475689 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f36e0004f20 con 0x7f36f013f280 2026-02-13T20:11:34.981 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.933+0000 7f36d6ffd640 1 -- 10.20.193.110:0/2162475689 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 3531+0+0 (unknown 315507976 0 0) 0x7f36e004f720 con 0x7f36f013f280 2026-02-13T20:11:34.981 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.933+0000 7f36ee575640 10 monclient: get_auth_request con 0x7f36bc03f7e0 auth_method 0 2026-02-13T20:11:34.982 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.933+0000 7f3336ffd640 1 -- 10.20.193.110:0/2794840997 <== mon.0 v1:10.20.193.110:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f3340005220 con 0x7f3350184b60 2026-02-13T20:11:34.982 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.933+0000 7f3336ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:34.982 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.933+0000 7f3336ffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:11:34.982 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.935+0000 7f36d6ffd640 1 -- 10.20.193.110:0/2162475689 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f36e0018160 con 0x7f36f013f280 2026-02-13T20:11:34.982 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.935+0000 7f36d6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:34.982 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:34.935+0000 7f36d6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:11:35.042 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.039+0000 7f36f4c78640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}] 2026-02-13T20:11:35.042 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.039+0000 7f36f4c78640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}] 2026-02-13T20:11:35.042 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.039+0000 7f36f4c78640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:35.042 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.039+0000 7f36f4c78640 1 -- 10.20.193.110:0/2162475689 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16} v 0) -- 0x7f36f012e0f0 con 0x7f36f013f280 2026-02-13T20:11:35.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.087+0000 7f3354e36640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T20:11:35.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.087+0000 7f3354e36640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T20:11:35.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.087+0000 7f3354e36640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:35.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.087+0000 7f3354e36640 1 -- 10.20.193.110:0/2794840997 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3350055bb0 con 0x7f3350184b60 2026-02-13T20:11:35.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.087+0000 7f3336ffd640 1 -- 10.20.193.110:0/2794840997 <== mon.0 v1:10.20.193.110:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 2565314728) 0x7f3340017850 con 0x7f3350184b60 2026-02-13T20:11:35.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.087+0000 7f3336ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T20:11:35.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.087+0000 7f3336ffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:11:35.090 INFO:teuthology.orchestra.run.trial110.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","modified":"2026-02-13T20:11:07.161192Z","created":"2026-02-13T20:11:07.161192Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6789","nonce":0}]},"addr":"10.20.193.110:6789/0","public_addr":"10.20.193.110:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161241+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6789","nonce":0}]},"addr":"10.20.193.188:6789/0","public_addr":"10.20.193.188:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161242+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6790","nonce":0}]},"addr":"10.20.193.110:6790/0","public_addr":"10.20.193.110:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161243+0000","crush_location":[]}]}} 2026-02-13T20:11:35.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.089+0000 7f3354e36640 1 -- 10.20.193.110:0/2794840997 >> v1:10.20.193.188:6812/1623052694 conn(0x7f331c03ff80 legacy=0x7f331c060430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:35.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.089+0000 7f3354e36640 10 monclient: shutdown 2026-02-13T20:11:35.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.089+0000 7f3354e36640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:35.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.089+0000 7f3354e36640 1 -- 10.20.193.110:0/2794840997 >> v1:10.20.193.110:6789/0 conn(0x7f3350184b60 legacy=0x7f3350173420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:35.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.089+0000 7f3354e36640 1 -- 10.20.193.110:0/2794840997 shutdown_connections 2026-02-13T20:11:35.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.089+0000 7f3354e36640 1 -- 10.20.193.110:0/2794840997 >> 10.20.193.110:0/2794840997 conn(0x7f3350054330 msgr2=0x7f3350090c20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:35.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.089+0000 7f3354e36640 1 -- 10.20.193.110:0/2794840997 shutdown_connections 2026-02-13T20:11:35.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.089+0000 7f3354e36640 1 -- 10.20.193.110:0/2794840997 wait complete. 2026-02-13T20:11:35.100 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-13T20:11:35.100 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-13T20:11:35.100 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-13T20:11:35.100 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T20:11:35.208 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.206+0000 7f6981c5b640 10 monclient: get_monmap_and_config 2026-02-13T20:11:35.208 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.206+0000 7f6981c5b640 10 monclient: build_initial_monmap 2026-02-13T20:11:35.208 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.206+0000 7f6981c5b640 10 monclient: monmap: 2026-02-13T20:11:35.208 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:35.209 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:35.209 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:35.207732+0000 2026-02-13T20:11:35.209 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:35.207732+0000 2026-02-13T20:11:35.209 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:35.209 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:35.209 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:35.209 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:35.209 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:35.209 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:35.218 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.206+0000 7f6981c5b640 1 Processor -- start 2026-02-13T20:11:35.219 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.206+0000 7f6981c5b640 1 -- start start 2026-02-13T20:11:35.219 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.206+0000 7f6981c5b640 10 monclient: init 2026-02-13T20:11:35.219 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.207+0000 7f6981c5b640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:35.219 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.207+0000 7f6981c5b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:11:35.219 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.207+0000 7f6981c5b640 10 monclient(hunting): picked mon.noname-a con 0x7f697c1401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:35.219 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.207+0000 7f6981c5b640 10 monclient(hunting): picked mon.noname-c con 0x7f697c092020 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:35.219 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.207+0000 7f6981c5b640 10 monclient(hunting): picked mon.noname-b con 0x7f697c091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:35.219 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.207+0000 7f6981c5b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f697c08b730 con 0x7f697c1401c0 2026-02-13T20:11:35.219 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.207+0000 7f6981c5b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f697c05c5b0 con 0x7f697c092020 2026-02-13T20:11:35.219 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.207+0000 7f6981c5b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f697c08bcf0 con 0x7f697c091950 2026-02-13T20:11:35.219 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.207+0000 7f6981c5b640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:35.220 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.207+0000 7f6981c5b640 10 monclient(hunting): authenticate will time out at 656.898114s 2026-02-13T20:11:35.220 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.207+0000 7f697b7fe640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f697c1401c0 0x7f697c091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:60360/0 (socket says 10.20.193.110:60360) 2026-02-13T20:11:35.220 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.207+0000 7f697b7fe640 1 -- 10.20.193.110:0/2235270328 learned_addr learned my addr 10.20.193.110:0/2235270328 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:35.220 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.207+0000 7f697a7fc640 1 -- 10.20.193.110:0/2235270328 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1213109752 0 0) 0x7f697c08b730 con 0x7f697c1401c0 2026-02-13T20:11:35.220 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.207+0000 7f697a7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:11:35.220 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.207+0000 7f697a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:35.220 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.207+0000 7f697a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:35.220 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.207+0000 7f697a7fc640 10 monclient(hunting): my global_id is 4416 2026-02-13T20:11:35.220 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.207+0000 7f697a7fc640 1 -- 10.20.193.110:0/2235270328 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69600035e0 con 0x7f697c1401c0 2026-02-13T20:11:35.220 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.207+0000 7f697a7fc640 1 -- 10.20.193.110:0/2235270328 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3370279412 0 0) 0x7f697c08bcf0 con 0x7f697c091950 2026-02-13T20:11:35.220 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.207+0000 7f697a7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:11:35.221 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.207+0000 7f697a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:35.221 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.207+0000 7f697a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:35.221 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.207+0000 7f697a7fc640 10 monclient(hunting): my global_id is 4424 2026-02-13T20:11:35.221 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.207+0000 7f697a7fc640 1 -- 10.20.193.110:0/2235270328 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f697c08b730 con 0x7f697c091950 2026-02-13T20:11:35.221 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.207+0000 7f697a7fc640 1 -- 10.20.193.110:0/2235270328 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 912754870 0 0) 0x7f69600035e0 con 0x7f697c1401c0 2026-02-13T20:11:35.221 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.207+0000 7f697a7fc640 1 -- 10.20.193.110:0/2235270328 >> v1:10.20.193.110:6790/0 conn(0x7f697c091950 legacy=0x7f697c1a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:35.221 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.207+0000 7f697a7fc640 1 -- 10.20.193.110:0/2235270328 >> v1:10.20.193.188:6789/0 conn(0x7f697c092020 legacy=0x7f697c1812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T20:11:35.221 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.207+0000 7f697a7fc640 10 monclient: _finish_hunting 0 2026-02-13T20:11:35.221 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.207+0000 7f697a7fc640 1 monclient: found mon.noname-a 2026-02-13T20:11:35.221 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.207+0000 7f697a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:35.221 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.207+0000 7f697a7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:11:35.221 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.207+0000 7f697a7fc640 1 -- 10.20.193.110:0/2235270328 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f697c140590 con 0x7f697c1401c0 2026-02-13T20:11:35.222 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.207+0000 7f697a7fc640 10 monclient: _finish_auth 0 2026-02-13T20:11:35.222 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.207+0000 7f697a7fc640 10 monclient: _check_auth_tickets 2026-02-13T20:11:35.222 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.207+0000 7f697a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:35.222 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.207+0000 7f697a7fc640 1 -- 10.20.193.110:0/2235270328 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f6968002dd0 con 0x7f697c1401c0 2026-02-13T20:11:35.222 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.207+0000 7f697a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:35.222 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.207+0000 7f697a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:11:35.222 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.207+0000 7f697a7fc640 10 monclient: dump: 2026-02-13T20:11:35.222 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:35.222 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:35.222 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:35.222 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:35.222 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:35.222 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:35.223 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:35.223 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:35.223 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:35.223 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:35.223 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.207+0000 7f6981c5b640 5 monclient: authenticate success, global_id 4416 2026-02-13T20:11:35.223 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.207+0000 7f6981c5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:35.223 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.207+0000 7f697a7fc640 1 -- 10.20.193.110:0/2235270328 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6968002fa0 con 0x7f697c1401c0 2026-02-13T20:11:35.223 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.207+0000 7f697a7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:35.223 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.207+0000 7f697a7fc640 1 -- 10.20.193.110:0/2235270328 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f69680033b0 con 0x7f697c1401c0 2026-02-13T20:11:35.223 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.207+0000 7f6981c5b640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:35.223 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.207+0000 7f6981c5b640 4 set_mon_vals no callback set 2026-02-13T20:11:35.223 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.207+0000 7f697a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:35.224 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.207+0000 7f697a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:35.224 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.207+0000 7f697a7fc640 10 monclient: dump: 2026-02-13T20:11:35.224 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:35.224 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:35.224 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:35.224 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:35.224 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:35.224 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:35.224 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:35.224 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:35.224 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:35.224 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:35.224 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.208+0000 7f6981c5b640 10 monclient: shutdown 2026-02-13T20:11:35.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.208+0000 7f6981c5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:35.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.208+0000 7f6981c5b640 1 -- 10.20.193.110:0/2235270328 >> v1:10.20.193.110:6789/0 conn(0x7f697c1401c0 legacy=0x7f697c091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:35.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.208+0000 7f6981c5b640 1 -- 10.20.193.110:0/2235270328 shutdown_connections 2026-02-13T20:11:35.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.208+0000 7f6981c5b640 1 -- 10.20.193.110:0/2235270328 >> 10.20.193.110:0/2235270328 conn(0x7f697c054e90 msgr2=0x7f697c058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:35.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.208+0000 7f6981c5b640 1 -- 10.20.193.110:0/2235270328 shutdown_connections 2026-02-13T20:11:35.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.208+0000 7f6981c5b640 1 -- 10.20.193.110:0/2235270328 wait complete. 2026-02-13T20:11:35.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.208+0000 7f6981c5b640 10 monclient: build_initial_monmap 2026-02-13T20:11:35.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.208+0000 7f6981c5b640 10 monclient: monmap: 2026-02-13T20:11:35.225 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:35.225 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:35.225 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:11:35.225 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:11:35.225 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:35.226 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:11:35.226 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:35.226 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:35.226 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:35.226 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:35.226 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.208+0000 7f6981c5b640 1 Processor -- start 2026-02-13T20:11:35.226 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.208+0000 7f6981c5b640 1 -- start start 2026-02-13T20:11:35.226 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.208+0000 7f6981c5b640 10 monclient: init 2026-02-13T20:11:35.226 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6981c5b640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:35.226 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6981c5b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:11:35.226 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6981c5b640 10 monclient(hunting): picked mon.noname-a con 0x7f697c091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:35.226 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6981c5b640 10 monclient(hunting): picked mon.noname-c con 0x7f697c1401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:35.227 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6981c5b640 10 monclient(hunting): picked mon.noname-b con 0x7f697c130f50 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:35.227 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6981c5b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f697c08c410 con 0x7f697c091950 2026-02-13T20:11:35.227 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6981c5b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f697c132750 con 0x7f697c130f50 2026-02-13T20:11:35.227 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6981c5b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f697c12f7f0 con 0x7f697c1401c0 2026-02-13T20:11:35.227 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6981c5b640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:35.227 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6981c5b640 10 monclient(hunting): authenticate will time out at 656.900184s 2026-02-13T20:11:35.227 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f697b7fe640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f697c091950 0x7f697c12e9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:60374/0 (socket says 10.20.193.110:60374) 2026-02-13T20:11:35.227 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f697b7fe640 1 -- 10.20.193.110:0/1820648811 learned_addr learned my addr 10.20.193.110:0/1820648811 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:35.227 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f697affd640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f697c1401c0 0x7f697c12f0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:40060/0 (socket says 10.20.193.110:40060) 2026-02-13T20:11:35.227 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6957fff640 1 -- 10.20.193.110:0/1820648811 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2299470056 0 0) 0x7f697c12f7f0 con 0x7f697c1401c0 2026-02-13T20:11:35.227 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6957fff640 10 monclient(hunting): _negotiate 2026-02-13T20:11:35.227 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6957fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:35.227 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6957fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:35.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6957fff640 10 monclient(hunting): my global_id is 4427 2026-02-13T20:11:35.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6957fff640 1 -- 10.20.193.110:0/1820648811 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f694c0035e0 con 0x7f697c1401c0 2026-02-13T20:11:35.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6957fff640 1 -- 10.20.193.110:0/1820648811 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2966197828 0 0) 0x7f697c08c410 con 0x7f697c091950 2026-02-13T20:11:35.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6957fff640 10 monclient(hunting): _negotiate 2026-02-13T20:11:35.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6957fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:35.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6957fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:35.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6957fff640 10 monclient(hunting): my global_id is 4419 2026-02-13T20:11:35.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6957fff640 1 -- 10.20.193.110:0/1820648811 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f697c12f7f0 con 0x7f697c091950 2026-02-13T20:11:35.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6957fff640 1 -- 10.20.193.110:0/1820648811 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1578058112 0 0) 0x7f694c0035e0 con 0x7f697c1401c0 2026-02-13T20:11:35.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6957fff640 1 -- 10.20.193.110:0/1820648811 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f697c08c410 con 0x7f697c1401c0 2026-02-13T20:11:35.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6957fff640 1 -- 10.20.193.110:0/1820648811 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f696c003ff0 con 0x7f697c1401c0 2026-02-13T20:11:35.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6957fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:35.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6957fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:11:35.229 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6957fff640 10 monclient(hunting): dump: 2026-02-13T20:11:35.229 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:35.229 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:35.229 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:35.229 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:35.229 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:35.229 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:35.229 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:35.229 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:35.229 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:35.229 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:35.229 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6957fff640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:35.229 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6957fff640 1 -- 10.20.193.110:0/1820648811 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2454219324 0 0) 0x7f697c12f7f0 con 0x7f697c091950 2026-02-13T20:11:35.230 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6957fff640 1 -- 10.20.193.110:0/1820648811 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f694c0035e0 con 0x7f697c091950 2026-02-13T20:11:35.230 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6957fff640 1 -- 10.20.193.110:0/1820648811 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f69680032c0 con 0x7f697c091950 2026-02-13T20:11:35.230 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6957fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:35.230 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6957fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:35.230 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6957fff640 10 monclient(hunting): dump: 2026-02-13T20:11:35.230 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:35.230 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:35.230 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:35.230 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:35.230 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:35.230 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:35.230 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:35.230 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:35.231 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:35.231 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:35.231 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6957fff640 1 -- 10.20.193.110:0/1820648811 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1499386250 0 0) 0x7f697c08c410 con 0x7f697c1401c0 2026-02-13T20:11:35.231 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6957fff640 1 -- 10.20.193.110:0/1820648811 >> v1:10.20.193.188:6789/0 conn(0x7f697c130f50 legacy=0x7f697c195170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:35.231 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6957fff640 1 -- 10.20.193.110:0/1820648811 >> v1:10.20.193.110:6789/0 conn(0x7f697c091950 legacy=0x7f697c12e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:35.231 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6957fff640 10 monclient: _finish_hunting 0 2026-02-13T20:11:35.231 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6957fff640 1 monclient: found mon.c 2026-02-13T20:11:35.231 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6957fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:35.231 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6957fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:35.231 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6957fff640 1 -- 10.20.193.110:0/1820648811 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f697c05d320 con 0x7f697c1401c0 2026-02-13T20:11:35.231 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6957fff640 10 monclient: _finish_auth 0 2026-02-13T20:11:35.231 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6957fff640 10 monclient: _check_auth_tickets 2026-02-13T20:11:35.232 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6957fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:35.232 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6981c5b640 5 monclient: authenticate success, global_id 4427 2026-02-13T20:11:35.232 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6981c5b640 10 monclient: _renew_subs 2026-02-13T20:11:35.232 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6981c5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:35.232 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6981c5b640 1 -- 10.20.193.110:0/1820648811 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f697c1318e0 con 0x7f697c1401c0 2026-02-13T20:11:35.232 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6981c5b640 10 monclient: _renew_subs 2026-02-13T20:11:35.232 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6981c5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:35.232 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6981c5b640 1 -- 10.20.193.110:0/1820648811 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f697c13f060 con 0x7f697c1401c0 2026-02-13T20:11:35.232 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6957fff640 1 -- 10.20.193.110:0/1820648811 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f696c0041c0 con 0x7f697c1401c0 2026-02-13T20:11:35.232 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6957fff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:35.232 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6957fff640 1 -- 10.20.193.110:0/1820648811 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f696c0028d0 con 0x7f697c1401c0 2026-02-13T20:11:35.232 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6957fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:35.232 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6957fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:35.233 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6957fff640 10 monclient: dump: 2026-02-13T20:11:35.233 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:35.233 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:35.233 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:35.233 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:35.233 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:35.233 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:35.233 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:35.233 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:35.233 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:35.233 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:35.233 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.209+0000 7f6979ffb640 4 set_mon_vals no callback set 2026-02-13T20:11:35.234 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.210+0000 7f6981c5b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:35.234 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.210+0000 7f6981c5b640 1 -- 10.20.193.110:0/1820648811 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f697c08d090 con 0x7f697c092020 2026-02-13T20:11:35.234 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.210+0000 7f6957fff640 1 -- 10.20.193.110:0/1820648811 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 235507057 0 0) 0x7f697c08d090 con 0x7f697c092020 2026-02-13T20:11:35.234 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.210+0000 7f6957fff640 10 monclient(hunting): _negotiate 2026-02-13T20:11:35.234 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.210+0000 7f6957fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:35.234 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.210+0000 7f6957fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:35.234 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.210+0000 7f6957fff640 10 monclient(hunting): my global_id is 4422 2026-02-13T20:11:35.234 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.210+0000 7f6957fff640 1 -- 10.20.193.110:0/1820648811 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f697c08c410 con 0x7f697c092020 2026-02-13T20:11:35.234 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.210+0000 7f6957fff640 1 -- 10.20.193.110:0/1820648811 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f696c002a30 con 0x7f697c1401c0 2026-02-13T20:11:35.234 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.210+0000 7f6957fff640 1 -- 10.20.193.110:0/1820648811 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 3531+0+0 (unknown 315507976 0 0) 0x7f696c04e5e0 con 0x7f697c1401c0 2026-02-13T20:11:35.234 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.210+0000 7f6957fff640 1 -- 10.20.193.110:0/1820648811 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 915863763 0 0) 0x7f697c08c410 con 0x7f697c092020 2026-02-13T20:11:35.234 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.210+0000 7f6957fff640 1 -- 10.20.193.110:0/1820648811 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f697c08d090 con 0x7f697c092020 2026-02-13T20:11:35.234 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.210+0000 7f6957fff640 1 -- 10.20.193.110:0/1820648811 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f6968004a90 con 0x7f697c092020 2026-02-13T20:11:35.235 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.210+0000 7f6957fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:35.235 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.210+0000 7f6957fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:35.235 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.210+0000 7f6957fff640 10 monclient: dump: 2026-02-13T20:11:35.235 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:35.235 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:35.235 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:35.235 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:35.235 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:35.235 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:35.235 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:35.235 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:35.235 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:35.236 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:35.236 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.210+0000 7f6957fff640 1 -- 10.20.193.110:0/1820648811 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4035706022 0 0) 0x7f697c08d090 con 0x7f697c092020 2026-02-13T20:11:35.236 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.210+0000 7f6957fff640 1 -- 10.20.193.110:0/1820648811 --> v1:10.20.193.110:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f697c1304a0 con 0x7f697c092020 2026-02-13T20:11:35.236 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.210+0000 7f697bfff640 10 monclient: get_auth_request con 0x7f694c03fb00 auth_method 0 2026-02-13T20:11:35.236 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.211+0000 7f6957fff640 1 -- 10.20.193.110:0/1820648811 <== mon.0 v1:10.20.193.110:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f6968004e60 con 0x7f697c092020 2026-02-13T20:11:35.236 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.211+0000 7f6957fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:35.236 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.211+0000 7f6957fff640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:11:35.236 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.211+0000 7f6957fff640 1 -- 10.20.193.110:0/1820648811 >> v1:10.20.193.110:6789/0 conn(0x7f697c092020 legacy=0x7f697c08ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:35.236 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.211+0000 7f6957fff640 1 -- 10.20.193.110:0/1820648811 >> v1:10.20.193.110:6789/0 conn(0x7f697c092020 legacy=0x7f697c08ef00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:11:35.236 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.214+0000 7f6981c5b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:11:35.236 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.214+0000 7f6981c5b640 1 -- 10.20.193.110:0/1820648811 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f697c055bb0 con 0x7f697c04d1c0 2026-02-13T20:11:35.236 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.215+0000 7f6957fff640 1 -- 10.20.193.110:0/1820648811 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2744354336 0 0) 0x7f697c055bb0 con 0x7f697c04d1c0 2026-02-13T20:11:35.236 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.215+0000 7f6957fff640 10 monclient(hunting): _negotiate 2026-02-13T20:11:35.237 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.215+0000 7f6957fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:35.237 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.215+0000 7f6957fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:35.237 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.215+0000 7f6957fff640 10 monclient(hunting): my global_id is 4425 2026-02-13T20:11:35.237 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.215+0000 7f6957fff640 1 -- 10.20.193.110:0/1820648811 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f697c08d090 con 0x7f697c04d1c0 2026-02-13T20:11:35.237 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.215+0000 7f6957fff640 1 -- 10.20.193.110:0/1820648811 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3595422220 0 0) 0x7f697c08d090 con 0x7f697c04d1c0 2026-02-13T20:11:35.237 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.215+0000 7f6957fff640 1 -- 10.20.193.110:0/1820648811 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f697c055bb0 con 0x7f697c04d1c0 2026-02-13T20:11:35.237 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.215+0000 7f6957fff640 1 -- 10.20.193.110:0/1820648811 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f6968006560 con 0x7f697c04d1c0 2026-02-13T20:11:35.237 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.215+0000 7f6957fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:35.237 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.215+0000 7f6957fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:35.237 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.215+0000 7f6957fff640 10 monclient: dump: 2026-02-13T20:11:35.237 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:35.237 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:35.237 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:35.238 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:35.238 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:35.238 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:35.238 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:35.238 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:35.238 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:35.238 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:35.238 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.215+0000 7f6957fff640 1 -- 10.20.193.110:0/1820648811 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1995472542 0 0) 0x7f697c055bb0 con 0x7f697c04d1c0 2026-02-13T20:11:35.238 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.215+0000 7f6957fff640 1 -- 10.20.193.110:0/1820648811 --> v1:10.20.193.110:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f697c08b450 con 0x7f697c04d1c0 2026-02-13T20:11:35.238 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.215+0000 7f6957fff640 1 -- 10.20.193.110:0/1820648811 <== mon.0 v1:10.20.193.110:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4515 (unknown 0 0 2091462660) 0x7f6968006a00 con 0x7f697c04d1c0 2026-02-13T20:11:35.238 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.215+0000 7f6957fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:11:35.238 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.215+0000 7f6957fff640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:11:35.239 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.215+0000 7f6957fff640 1 -- 10.20.193.110:0/1820648811 >> v1:10.20.193.110:6789/0 conn(0x7f697c04d1c0 legacy=0x7f697c1978a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:35.239 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.215+0000 7f6957fff640 1 -- 10.20.193.110:0/1820648811 >> v1:10.20.193.110:6789/0 conn(0x7f697c04d1c0 legacy=0x7f697c1978a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:11:35.239 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:11:35.239 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:11:35.239 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:11:35.239 INFO:teuthology.orchestra.run.trial110.stdout: "state": "leader", 2026-02-13T20:11:35.239 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 4, 2026-02-13T20:11:35.240 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 17401, 2026-02-13T20:11:35.240 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:11:35.240 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:11:35.240 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:11:35.240 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:11:35.240 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:11:35.240 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 17, 2026-02-13T20:11:35.240 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:11:35.240 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:11:35.240 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:11:35.240 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:11:35.241 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:11:35.241 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:11:35.241 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:11:35.241 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:11:35.241 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:11:35.241 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:11:35.241 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:11:35.241 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:11:35.241 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:11:35.241 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:11:35.241 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:11:35.241 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:11:35.242 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:11:35.242 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:11:35.242 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:11:35.242 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:11:35.242 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:11:35.242 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:11:35.242 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:11:35.242 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:11:35.242 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:11:35.242 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:11:35.242 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:11:35.242 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:11:35.242 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:11:35.243 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:11:35.243 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:11:35.243 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:11:35.243 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:11:35.243 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:11:35.243 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:11:35.243 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:11:35.243 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:11:35.243 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:11:35.243 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:11:35.243 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:11:35.243 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:11:35.243 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:11:35.243 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:11:35.244 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:11:35.244 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:11:35.244 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:11:35.244 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:11:35.244 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:11:35.244 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:11:35.244 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:11:35.244 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:11:35.244 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:11:35.244 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:11:35.244 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:11:35.244 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:11:35.244 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:11:35.245 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:11:35.245 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:11:35.245 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:11:35.245 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:11:35.245 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:11:35.245 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:11:35.245 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:11:35.245 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:11:35.245 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:11:35.245 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:11:35.245 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:11:35.245 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:11:35.245 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:11:35.245 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:11:35.246 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:11:35.246 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:11:35.246 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:11:35.246 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:11:35.246 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:11:35.246 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:11:35.246 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:11:35.246 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:11:35.246 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:11:35.246 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:11:35.246 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:11:35.246 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:11:35.246 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:11:35.246 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:11:35.246 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:11:35.247 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:11:35.247 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:11:35.247 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:11:35.247 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:11:35.247 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:11:35.247 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:11:35.247 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:11:35.247 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:11:35.247 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:11:35.247 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:11:35.247 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:11:35.247 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:11:35.247 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:11:35.247 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:11:35.247 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:11:35.247 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:11:35.248 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:11:35.248 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:11:35.248 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:11:35.248 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:11:35.248 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:11:35.248 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:11:35.248 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:11:35.248 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:11:35.248 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:11:35.248 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:11:35.248 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:11:35.248 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:11:35.248 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:11:35.248 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:11:35.248 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:11:35.248 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:11:35.249 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:11:35.249 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:11:35.249 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:11:35.249 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:11:35.249 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:11:35.249 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:11:35.249 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:11:35.249 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:11:35.249 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:11:35.249 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:11:35.249 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:11:35.249 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:11:35.249 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:11:35.249 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:11:35.249 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:11:35.249 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:11:35.250 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:11:35.250 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:11:35.250 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:11:35.250 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:11:35.250 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:11:35.250 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:11:35.250 INFO:teuthology.orchestra.run.trial110.stdout: "num": 2 2026-02-13T20:11:35.250 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:11:35.250 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:11:35.250 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:11:35.250 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:11:35.250 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:11:35.250 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:11:35.250 INFO:teuthology.orchestra.run.trial110.stdout: "num": 2 2026-02-13T20:11:35.250 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:11:35.250 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:11:35.250 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:11:35.250 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:11:35.251 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:11:35.252 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.215+0000 7f6981c5b640 1 -- 10.20.193.110:0/1820648811 >> v1:10.20.193.188:6812/1623052694 conn(0x7f694c03fb00 legacy=0x7f694c05ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:35.252 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.215+0000 7f6981c5b640 10 monclient: shutdown 2026-02-13T20:11:35.252 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.215+0000 7f6981c5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:35.252 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.215+0000 7f6981c5b640 1 -- 10.20.193.110:0/1820648811 >> v1:10.20.193.110:6790/0 conn(0x7f697c1401c0 legacy=0x7f697c12f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:35.252 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.215+0000 7f697bfff640 1 -- 10.20.193.110:0/1820648811 reap_dead start 2026-02-13T20:11:35.252 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.215+0000 7f697bfff640 1 -- 10.20.193.110:0/1820648811 reap_dead start 2026-02-13T20:11:35.252 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.215+0000 7f6981c5b640 1 -- 10.20.193.110:0/1820648811 shutdown_connections 2026-02-13T20:11:35.252 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.215+0000 7f6981c5b640 1 -- 10.20.193.110:0/1820648811 >> 10.20.193.110:0/1820648811 conn(0x7f697c054e90 msgr2=0x7f697c088e30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:35.252 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.215+0000 7f6981c5b640 1 -- 10.20.193.110:0/1820648811 shutdown_connections 2026-02-13T20:11:35.252 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.215+0000 7f6981c5b640 1 -- 10.20.193.110:0/1820648811 wait complete. 2026-02-13T20:11:35.253 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:11:35.253 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-13T20:11:35.253 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T20:11:35.319 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.317+0000 7f8ab7de5640 10 monclient: get_monmap_and_config 2026-02-13T20:11:35.319 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.317+0000 7f8ab7de5640 10 monclient: build_initial_monmap 2026-02-13T20:11:35.320 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.317+0000 7f8ab7de5640 10 monclient: monmap: 2026-02-13T20:11:35.320 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:35.320 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:35.320 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:35.318524+0000 2026-02-13T20:11:35.320 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:35.318524+0000 2026-02-13T20:11:35.320 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:35.320 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:35.320 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:35.320 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:35.320 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:35.320 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:35.320 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.317+0000 7f8ab7de5640 1 Processor -- start 2026-02-13T20:11:35.320 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.317+0000 7f8ab7de5640 1 -- start start 2026-02-13T20:11:35.321 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.317+0000 7f8ab7de5640 10 monclient: init 2026-02-13T20:11:35.328 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.317+0000 7f8ab7de5640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:35.329 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.317+0000 7f8ab7de5640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:11:35.329 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.317+0000 7f8ab7de5640 10 monclient(hunting): picked mon.noname-c con 0x7f8ab013f280 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:35.329 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.317+0000 7f8ab7de5640 10 monclient(hunting): picked mon.noname-b con 0x7f8ab013ee70 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:35.329 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.317+0000 7f8ab7de5640 10 monclient(hunting): picked mon.noname-a con 0x7f8ab0089a90 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:35.329 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.317+0000 7f8ab7de5640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ab008a310 con 0x7f8ab0089a90 2026-02-13T20:11:35.329 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.317+0000 7f8ab7de5640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ab008a5f0 con 0x7f8ab013f280 2026-02-13T20:11:35.329 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.317+0000 7f8ab7de5640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ab008a8d0 con 0x7f8ab013ee70 2026-02-13T20:11:35.329 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.317+0000 7f8ab7de5640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:35.329 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.317+0000 7f8ab7de5640 10 monclient(hunting): authenticate will time out at 657.008966s 2026-02-13T20:11:35.329 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab635b640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f8ab0089a90 0x7f8ab01a18c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:60392/0 (socket says 10.20.193.110:60392) 2026-02-13T20:11:35.329 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab5359640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f8ab013ee70 0x7f8ab0180190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:40074/0 (socket says 10.20.193.110:40074) 2026-02-13T20:11:35.330 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab635b640 1 -- 10.20.193.110:0/2196294286 learned_addr learned my addr 10.20.193.110:0/2196294286 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:35.330 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab4b58640 1 -- 10.20.193.110:0/2196294286 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4155445074 0 0) 0x7f8ab008a310 con 0x7f8ab0089a90 2026-02-13T20:11:35.330 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab4b58640 10 monclient(hunting): _negotiate 2026-02-13T20:11:35.330 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab4b58640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:35.330 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab4b58640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:35.330 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab4b58640 10 monclient(hunting): my global_id is 4428 2026-02-13T20:11:35.330 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab4b58640 1 -- 10.20.193.110:0/2196294286 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a980035e0 con 0x7f8ab0089a90 2026-02-13T20:11:35.330 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab4b58640 1 -- 10.20.193.110:0/2196294286 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2708765608 0 0) 0x7f8ab008a8d0 con 0x7f8ab013ee70 2026-02-13T20:11:35.330 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab4b58640 10 monclient(hunting): _negotiate 2026-02-13T20:11:35.330 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab4b58640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:35.330 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab4b58640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:35.330 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab4b58640 10 monclient(hunting): my global_id is 4430 2026-02-13T20:11:35.330 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab4b58640 1 -- 10.20.193.110:0/2196294286 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ab008a310 con 0x7f8ab013ee70 2026-02-13T20:11:35.331 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab4b58640 1 -- 10.20.193.110:0/2196294286 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 958549160 0 0) 0x7f8ab008a5f0 con 0x7f8ab013f280 2026-02-13T20:11:35.331 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab4b58640 10 monclient(hunting): _negotiate 2026-02-13T20:11:35.331 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab4b58640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:35.331 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab4b58640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:35.331 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab4b58640 10 monclient(hunting): my global_id is 4405 2026-02-13T20:11:35.331 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab4b58640 1 -- 10.20.193.110:0/2196294286 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ab008a8d0 con 0x7f8ab013f280 2026-02-13T20:11:35.331 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab4b58640 1 -- 10.20.193.110:0/2196294286 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3573092779 0 0) 0x7f8ab008a310 con 0x7f8ab013ee70 2026-02-13T20:11:35.331 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab4b58640 1 -- 10.20.193.110:0/2196294286 >> v1:10.20.193.188:6789/0 conn(0x7f8ab013f280 legacy=0x7f8ab013f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:35.331 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab4b58640 1 -- 10.20.193.110:0/2196294286 >> v1:10.20.193.110:6789/0 conn(0x7f8ab0089a90 legacy=0x7f8ab01a18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:35.331 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab4b58640 10 monclient: _finish_hunting 0 2026-02-13T20:11:35.331 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab4b58640 1 monclient: found mon.noname-b 2026-02-13T20:11:35.331 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab4b58640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:35.331 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab4b58640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:11:35.331 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab4b58640 1 -- 10.20.193.110:0/2196294286 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab008abb0 con 0x7f8ab013ee70 2026-02-13T20:11:35.332 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab4b58640 10 monclient: _finish_auth 0 2026-02-13T20:11:35.332 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab4b58640 10 monclient: _check_auth_tickets 2026-02-13T20:11:35.332 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab4b58640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:35.332 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab4b58640 1 -- 10.20.193.110:0/2196294286 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f8aa4002d50 con 0x7f8ab013ee70 2026-02-13T20:11:35.332 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab4b58640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:35.332 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab4b58640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:11:35.332 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab4b58640 10 monclient: dump: 2026-02-13T20:11:35.332 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:35.332 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:35.332 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:35.332 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:35.332 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:35.332 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:35.333 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:35.333 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:35.333 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:35.333 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:35.333 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab7de5640 5 monclient: authenticate success, global_id 4430 2026-02-13T20:11:35.333 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab7de5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:35.333 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab4b58640 1 -- 10.20.193.110:0/2196294286 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8aa4002f50 con 0x7f8ab013ee70 2026-02-13T20:11:35.333 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab4b58640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:35.333 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab4b58640 1 -- 10.20.193.110:0/2196294286 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f8aa4003360 con 0x7f8ab013ee70 2026-02-13T20:11:35.333 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab7de5640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:35.333 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab4b58640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:35.333 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab7de5640 4 set_mon_vals no callback set 2026-02-13T20:11:35.333 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab4b58640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:35.334 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab4b58640 10 monclient: dump: 2026-02-13T20:11:35.334 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:35.334 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:35.334 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:35.334 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:35.334 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:35.334 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:35.334 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:35.334 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:35.334 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:35.334 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:35.334 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab7de5640 10 monclient: shutdown 2026-02-13T20:11:35.334 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab7de5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:35.334 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab7de5640 1 -- 10.20.193.110:0/2196294286 >> v1:10.20.193.110:6790/0 conn(0x7f8ab013ee70 legacy=0x7f8ab0180190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:35.335 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab7de5640 1 -- 10.20.193.110:0/2196294286 shutdown_connections 2026-02-13T20:11:35.335 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab7de5640 1 -- 10.20.193.110:0/2196294286 >> 10.20.193.110:0/2196294286 conn(0x7f8ab0054e90 msgr2=0x7f8ab0058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:35.335 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab7de5640 1 -- 10.20.193.110:0/2196294286 shutdown_connections 2026-02-13T20:11:35.335 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.318+0000 7f8ab7de5640 1 -- 10.20.193.110:0/2196294286 wait complete. 2026-02-13T20:11:35.335 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.319+0000 7f8ab7de5640 10 monclient: build_initial_monmap 2026-02-13T20:11:35.335 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.319+0000 7f8ab7de5640 10 monclient: monmap: 2026-02-13T20:11:35.335 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:35.335 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:35.335 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:11:35.335 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:11:35.335 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:35.335 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:11:35.336 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:35.336 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:35.336 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:35.336 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:35.336 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.319+0000 7f8ab7de5640 1 Processor -- start 2026-02-13T20:11:35.336 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.319+0000 7f8ab7de5640 1 -- start start 2026-02-13T20:11:35.336 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.319+0000 7f8ab7de5640 10 monclient: init 2026-02-13T20:11:35.336 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.319+0000 7f8ab7de5640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:35.336 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.319+0000 7f8ab7de5640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:11:35.336 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.319+0000 7f8ab7de5640 10 monclient(hunting): picked mon.noname-a con 0x7f8ab0089a90 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:35.336 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.319+0000 7f8ab7de5640 10 monclient(hunting): picked mon.noname-b con 0x7f8ab013ee70 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:35.336 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.319+0000 7f8ab7de5640 10 monclient(hunting): picked mon.noname-c con 0x7f8ab013f280 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:35.336 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.319+0000 7f8ab7de5640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ab008d810 con 0x7f8ab0089a90 2026-02-13T20:11:35.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.319+0000 7f8ab7de5640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ab0130a10 con 0x7f8ab013ee70 2026-02-13T20:11:35.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.319+0000 7f8ab7de5640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ab0130cf0 con 0x7f8ab013f280 2026-02-13T20:11:35.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.319+0000 7f8ab7de5640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:35.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.319+0000 7f8ab7de5640 10 monclient(hunting): authenticate will time out at 657.010681s 2026-02-13T20:11:35.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.319+0000 7f8ab5b5a640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f8ab0089a90 0x7f8ab0150520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:60400/0 (socket says 10.20.193.110:60400) 2026-02-13T20:11:35.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.319+0000 7f8ab5b5a640 1 -- 10.20.193.110:0/2880472410 learned_addr learned my addr 10.20.193.110:0/2880472410 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:35.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.319+0000 7f8a9e7fc640 1 -- 10.20.193.110:0/2880472410 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1197692039 0 0) 0x7f8ab008a8d0 con 0x7f8ab0089a90 2026-02-13T20:11:35.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.319+0000 7f8a9e7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:11:35.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.319+0000 7f8a9e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:35.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.319+0000 7f8a9e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:35.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.319+0000 7f8a9e7fc640 10 monclient(hunting): my global_id is 4431 2026-02-13T20:11:35.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.319+0000 7f8a9e7fc640 1 -- 10.20.193.110:0/2880472410 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a800035e0 con 0x7f8ab0089a90 2026-02-13T20:11:35.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.319+0000 7f8a9e7fc640 1 -- 10.20.193.110:0/2880472410 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2166001423 0 0) 0x7f8ab0130cf0 con 0x7f8ab013f280 2026-02-13T20:11:35.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.319+0000 7f8a9e7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:11:35.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.319+0000 7f8a9e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:35.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.319+0000 7f8a9e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:35.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.319+0000 7f8a9e7fc640 10 monclient(hunting): my global_id is 4433 2026-02-13T20:11:35.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.319+0000 7f8a9e7fc640 1 -- 10.20.193.110:0/2880472410 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ab008a8d0 con 0x7f8ab013f280 2026-02-13T20:11:35.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.320+0000 7f8a9e7fc640 1 -- 10.20.193.110:0/2880472410 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3482627920 0 0) 0x7f8a800035e0 con 0x7f8ab0089a90 2026-02-13T20:11:35.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.320+0000 7f8a9e7fc640 1 -- 10.20.193.110:0/2880472410 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8ab0130cf0 con 0x7f8ab0089a90 2026-02-13T20:11:35.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.320+0000 7f8a9e7fc640 1 -- 10.20.193.110:0/2880472410 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f8aa0003150 con 0x7f8ab0089a90 2026-02-13T20:11:35.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.320+0000 7f8a9e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:35.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.320+0000 7f8a9e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:11:35.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.320+0000 7f8a9e7fc640 10 monclient(hunting): dump: 2026-02-13T20:11:35.338 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:35.338 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:35.339 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:35.339 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:35.339 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:35.339 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:35.339 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:35.339 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:35.339 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:35.339 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:35.339 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.320+0000 7f8a9e7fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:35.339 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.320+0000 7f8a9e7fc640 1 -- 10.20.193.110:0/2880472410 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2815868168 0 0) 0x7f8ab008a8d0 con 0x7f8ab013f280 2026-02-13T20:11:35.339 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.320+0000 7f8a9e7fc640 1 -- 10.20.193.110:0/2880472410 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8a800035e0 con 0x7f8ab013f280 2026-02-13T20:11:35.339 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.320+0000 7f8a9e7fc640 1 -- 10.20.193.110:0/2880472410 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f8aac0040a0 con 0x7f8ab013f280 2026-02-13T20:11:35.339 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.320+0000 7f8a9e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:35.339 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.320+0000 7f8a9e7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:35.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.320+0000 7f8a9e7fc640 10 monclient(hunting): dump: 2026-02-13T20:11:35.340 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:35.340 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:35.340 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:35.340 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:35.340 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:35.340 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:35.340 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:35.340 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:35.340 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:35.340 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:35.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.320+0000 7f8a9e7fc640 1 -- 10.20.193.110:0/2880472410 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3834077500 0 0) 0x7f8ab0130cf0 con 0x7f8ab0089a90 2026-02-13T20:11:35.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.320+0000 7f8a9e7fc640 1 -- 10.20.193.110:0/2880472410 >> v1:10.20.193.110:6790/0 conn(0x7f8ab013f280 legacy=0x7f8ab0192890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:35.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.320+0000 7f8a9e7fc640 1 -- 10.20.193.110:0/2880472410 >> v1:10.20.193.188:6789/0 conn(0x7f8ab013ee70 legacy=0x7f8ab013e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:35.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.320+0000 7f8a9e7fc640 10 monclient: _finish_hunting 0 2026-02-13T20:11:35.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.320+0000 7f8a9e7fc640 1 monclient: found mon.a 2026-02-13T20:11:35.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.320+0000 7f8a9e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:35.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.320+0000 7f8a9e7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:35.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.320+0000 7f8a9e7fc640 1 -- 10.20.193.110:0/2880472410 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab012f4f0 con 0x7f8ab0089a90 2026-02-13T20:11:35.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.320+0000 7f8a9e7fc640 10 monclient: _finish_auth 0 2026-02-13T20:11:35.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.320+0000 7f8a9e7fc640 10 monclient: _check_auth_tickets 2026-02-13T20:11:35.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.320+0000 7f8a9e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:35.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.320+0000 7f8ab7de5640 5 monclient: authenticate success, global_id 4431 2026-02-13T20:11:35.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.320+0000 7f8ab7de5640 10 monclient: _renew_subs 2026-02-13T20:11:35.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.320+0000 7f8ab7de5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:35.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.320+0000 7f8ab7de5640 1 -- 10.20.193.110:0/2880472410 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8ab005d320 con 0x7f8ab0089a90 2026-02-13T20:11:35.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.320+0000 7f8ab7de5640 10 monclient: _renew_subs 2026-02-13T20:11:35.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.320+0000 7f8ab7de5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:35.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.320+0000 7f8ab7de5640 1 -- 10.20.193.110:0/2880472410 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8ab013e9f0 con 0x7f8ab0089a90 2026-02-13T20:11:35.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.320+0000 7f8a9e7fc640 1 -- 10.20.193.110:0/2880472410 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8aa0003320 con 0x7f8ab0089a90 2026-02-13T20:11:35.342 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.320+0000 7f8a9e7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:35.342 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.320+0000 7f8a9e7fc640 1 -- 10.20.193.110:0/2880472410 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f8aa0003b30 con 0x7f8ab0089a90 2026-02-13T20:11:35.342 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.320+0000 7f8a9e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:35.342 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.320+0000 7f8a9e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:35.342 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.320+0000 7f8a9e7fc640 10 monclient: dump: 2026-02-13T20:11:35.342 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:35.342 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:35.342 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:35.342 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:35.342 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:35.342 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:35.342 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:35.342 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:35.342 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:35.343 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:35.343 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.320+0000 7f8a9ffff640 4 set_mon_vals no callback set 2026-02-13T20:11:35.343 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.320+0000 7f8ab7de5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:35.343 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.320+0000 7f8ab7de5640 1 -- 10.20.193.110:0/2880472410 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8ab013eca0 con 0x7f8ab0128ca0 2026-02-13T20:11:35.343 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.320+0000 7f8a9e7fc640 1 -- 10.20.193.110:0/2880472410 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1085105523 0 0) 0x7f8ab013eca0 con 0x7f8ab0128ca0 2026-02-13T20:11:35.343 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.320+0000 7f8a9e7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:11:35.343 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.320+0000 7f8a9e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:35.343 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.320+0000 7f8a9e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:35.343 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.320+0000 7f8a9e7fc640 10 monclient(hunting): my global_id is 4436 2026-02-13T20:11:35.343 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.320+0000 7f8a9e7fc640 1 -- 10.20.193.110:0/2880472410 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ab0130cf0 con 0x7f8ab0128ca0 2026-02-13T20:11:35.343 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.320+0000 7f8a9e7fc640 1 -- 10.20.193.110:0/2880472410 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f8aa0003c90 con 0x7f8ab0089a90 2026-02-13T20:11:35.343 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.321+0000 7f8a9e7fc640 1 -- 10.20.193.110:0/2880472410 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 3531+0+0 (unknown 315507976 0 0) 0x7f8aa004e6a0 con 0x7f8ab0089a90 2026-02-13T20:11:35.343 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.321+0000 7f8a9e7fc640 1 -- 10.20.193.110:0/2880472410 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 811632529 0 0) 0x7f8ab0130cf0 con 0x7f8ab0128ca0 2026-02-13T20:11:35.343 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.321+0000 7f8a9e7fc640 1 -- 10.20.193.110:0/2880472410 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8ab013eca0 con 0x7f8ab0128ca0 2026-02-13T20:11:35.343 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.321+0000 7f8a9e7fc640 1 -- 10.20.193.110:0/2880472410 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f8aa40027d0 con 0x7f8ab0128ca0 2026-02-13T20:11:35.343 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.321+0000 7f8a9e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:35.344 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.321+0000 7f8a9e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:35.344 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.321+0000 7f8a9e7fc640 10 monclient: dump: 2026-02-13T20:11:35.344 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:35.344 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:35.344 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:35.344 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:35.344 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:35.344 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:35.344 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:35.344 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:35.344 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:35.344 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:35.344 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.321+0000 7f8a9e7fc640 1 -- 10.20.193.110:0/2880472410 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2994497311 0 0) 0x7f8ab013eca0 con 0x7f8ab0128ca0 2026-02-13T20:11:35.344 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.321+0000 7f8a9e7fc640 1 -- 10.20.193.110:0/2880472410 --> v1:10.20.193.110:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8ab0130630 con 0x7f8ab0128ca0 2026-02-13T20:11:35.344 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.321+0000 7f8ab635b640 10 monclient: get_auth_request con 0x7f8a8003fb00 auth_method 0 2026-02-13T20:11:35.345 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.321+0000 7f8a9e7fc640 1 -- 10.20.193.110:0/2880472410 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f8aa4002b80 con 0x7f8ab0128ca0 2026-02-13T20:11:35.345 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.321+0000 7f8a9e7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:35.345 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.321+0000 7f8a9e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:11:35.345 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.321+0000 7f8a9e7fc640 1 -- 10.20.193.110:0/2880472410 >> v1:10.20.193.110:6790/0 conn(0x7f8ab0128ca0 legacy=0x7f8ab004d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:35.345 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.321+0000 7f8a9e7fc640 1 -- 10.20.193.110:0/2880472410 >> v1:10.20.193.110:6790/0 conn(0x7f8ab0128ca0 legacy=0x7f8ab004d1c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:11:35.345 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.324+0000 7f8ab7de5640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:11:35.345 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.324+0000 7f8ab7de5640 1 -- 10.20.193.110:0/2880472410 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8ab008d810 con 0x7f8ab0129070 2026-02-13T20:11:35.345 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.325+0000 7f8a9e7fc640 1 -- 10.20.193.110:0/2880472410 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2952084149 0 0) 0x7f8ab008abb0 con 0x7f8ab0129070 2026-02-13T20:11:35.345 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.325+0000 7f8a9e7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:11:35.345 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.325+0000 7f8a9e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:35.345 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.325+0000 7f8a9e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:35.345 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.325+0000 7f8a9e7fc640 10 monclient(hunting): my global_id is 4439 2026-02-13T20:11:35.345 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.325+0000 7f8a9e7fc640 1 -- 10.20.193.110:0/2880472410 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ab013eca0 con 0x7f8ab0129070 2026-02-13T20:11:35.345 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.325+0000 7f8a9e7fc640 1 -- 10.20.193.110:0/2880472410 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 760475221 0 0) 0x7f8ab013eca0 con 0x7f8ab0129070 2026-02-13T20:11:35.345 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.325+0000 7f8a9e7fc640 1 -- 10.20.193.110:0/2880472410 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8ab008abb0 con 0x7f8ab0129070 2026-02-13T20:11:35.345 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.325+0000 7f8a9e7fc640 1 -- 10.20.193.110:0/2880472410 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f8aa4004c40 con 0x7f8ab0129070 2026-02-13T20:11:35.345 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.325+0000 7f8a9e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:35.345 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.325+0000 7f8a9e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:35.346 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.325+0000 7f8a9e7fc640 10 monclient: dump: 2026-02-13T20:11:35.346 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:35.346 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:35.346 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:35.346 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:35.346 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:35.346 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:35.346 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:35.346 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:35.346 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:35.346 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:35.346 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.325+0000 7f8a9e7fc640 1 -- 10.20.193.110:0/2880472410 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2067428792 0 0) 0x7f8ab008abb0 con 0x7f8ab0129070 2026-02-13T20:11:35.346 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.325+0000 7f8a9e7fc640 1 -- 10.20.193.110:0/2880472410 --> v1:10.20.193.110:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8ab0055bb0 con 0x7f8ab0129070 2026-02-13T20:11:35.346 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.325+0000 7f8a9e7fc640 1 -- 10.20.193.110:0/2880472410 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4513 (unknown 0 0 717665319) 0x7f8aa40061b0 con 0x7f8ab0129070 2026-02-13T20:11:35.346 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.325+0000 7f8a9e7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:11:35.346 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.325+0000 7f8a9e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:11:35.346 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.325+0000 7f8a9e7fc640 1 -- 10.20.193.110:0/2880472410 >> v1:10.20.193.110:6790/0 conn(0x7f8ab0129070 legacy=0x7f8ab0194fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:35.346 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.325+0000 7f8a9e7fc640 1 -- 10.20.193.110:0/2880472410 >> v1:10.20.193.110:6790/0 conn(0x7f8ab0129070 legacy=0x7f8ab0194fc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:11:35.347 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:11:35.347 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:11:35.347 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:11:35.347 INFO:teuthology.orchestra.run.trial110.stdout: "state": "peon", 2026-02-13T20:11:35.347 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 4, 2026-02-13T20:11:35.347 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 17508, 2026-02-13T20:11:35.347 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:11:35.347 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:11:35.347 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:11:35.347 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:11:35.347 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:11:35.347 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 17, 2026-02-13T20:11:35.348 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:11:35.348 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:11:35.348 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:11:35.348 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:11:35.348 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:11:35.348 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:11:35.348 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:11:35.348 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:11:35.348 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:11:35.348 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:11:35.348 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:11:35.348 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:11:35.348 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:11:35.348 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:11:35.348 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:11:35.348 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:11:35.348 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:11:35.349 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:11:35.349 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:11:35.349 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:11:35.349 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:11:35.349 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:11:35.349 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:11:35.349 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:11:35.349 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:11:35.349 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:11:35.349 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:11:35.349 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:11:35.349 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:11:35.349 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:11:35.349 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:11:35.349 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:11:35.349 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:11:35.349 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:11:35.349 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:11:35.349 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:11:35.349 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:11:35.349 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:11:35.350 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:11:35.350 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:11:35.350 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:11:35.350 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:11:35.350 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:11:35.350 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:11:35.350 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:11:35.350 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:11:35.350 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:11:35.350 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:11:35.350 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:11:35.350 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:11:35.350 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:11:35.350 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:11:35.350 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:11:35.350 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:11:35.350 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:11:35.350 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:11:35.350 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:11:35.350 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:11:35.351 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:11:35.351 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:11:35.351 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:11:35.351 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:11:35.351 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:11:35.351 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:11:35.351 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:11:35.351 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:11:35.351 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:11:35.351 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:11:35.351 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:11:35.351 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:11:35.351 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:11:35.351 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:11:35.351 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:11:35.351 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:11:35.351 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:11:35.351 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:11:35.351 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:11:35.351 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:11:35.352 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:11:35.352 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:11:35.352 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:11:35.352 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:11:35.352 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:11:35.352 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:11:35.352 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:11:35.352 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:11:35.352 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:11:35.352 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:11:35.352 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:11:35.352 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:11:35.352 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:11:35.352 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:11:35.352 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:11:35.352 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:11:35.352 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:11:35.352 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:11:35.352 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:11:35.352 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:11:35.353 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:11:35.353 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:11:35.353 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:11:35.353 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:11:35.353 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:11:35.353 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:11:35.353 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:11:35.353 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:11:35.353 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:11:35.353 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:11:35.353 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:11:35.353 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:11:35.353 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:11:35.353 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:11:35.353 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:11:35.353 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:11:35.353 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:11:35.353 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:11:35.353 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:11:35.353 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:11:35.354 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:11:35.354 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:11:35.354 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:11:35.354 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:11:35.354 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:11:35.354 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:11:35.354 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:11:35.354 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:11:35.354 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:11:35.354 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:11:35.354 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:11:35.354 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:11:35.354 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:11:35.354 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:11:35.354 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:11:35.354 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:11:35.354 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:11:35.354 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:11:35.354 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:11:35.354 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:11:35.354 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:11:35.354 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:11:35.355 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:11:35.355 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:11:35.355 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:11:35.355 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:11:35.355 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:11:35.355 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:11:35.355 INFO:teuthology.orchestra.run.trial110.stdout: "num": 2 2026-02-13T20:11:35.355 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:11:35.355 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:11:35.355 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:11:35.355 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:11:35.355 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:11:35.356 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.325+0000 7f8ab7de5640 1 -- 10.20.193.110:0/2880472410 >> v1:10.20.193.188:6812/1623052694 conn(0x7f8a8003fb00 legacy=0x7f8a8005ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:35.356 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.325+0000 7f8ab7de5640 10 monclient: shutdown 2026-02-13T20:11:35.356 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.325+0000 7f8ab7de5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:35.356 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.325+0000 7f8ab7de5640 1 -- 10.20.193.110:0/2880472410 >> v1:10.20.193.110:6789/0 conn(0x7f8ab0089a90 legacy=0x7f8ab0150520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:35.356 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.325+0000 7f8ab635b640 1 -- 10.20.193.110:0/2880472410 reap_dead start 2026-02-13T20:11:35.356 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.325+0000 7f8ab635b640 1 -- 10.20.193.110:0/2880472410 reap_dead start 2026-02-13T20:11:35.356 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.325+0000 7f8ab7de5640 1 -- 10.20.193.110:0/2880472410 shutdown_connections 2026-02-13T20:11:35.356 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.325+0000 7f8ab7de5640 1 -- 10.20.193.110:0/2880472410 >> 10.20.193.110:0/2880472410 conn(0x7f8ab0054e90 msgr2=0x7f8ab005b480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:35.356 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.325+0000 7f8ab7de5640 1 -- 10.20.193.110:0/2880472410 shutdown_connections 2026-02-13T20:11:35.356 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.325+0000 7f8ab7de5640 1 -- 10.20.193.110:0/2880472410 wait complete. 2026-02-13T20:11:35.357 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:11:35.357 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-13T20:11:35.357 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T20:11:35.430 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.420+0000 7ff2af54c640 10 monclient: get_monmap_and_config 2026-02-13T20:11:35.430 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.420+0000 7ff2af54c640 10 monclient: build_initial_monmap 2026-02-13T20:11:35.430 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.420+0000 7ff2af54c640 10 monclient: monmap: 2026-02-13T20:11:35.430 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:35.430 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:35.430 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:35.422065+0000 2026-02-13T20:11:35.430 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:35.422065+0000 2026-02-13T20:11:35.430 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:35.430 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:35.431 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:35.431 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:35.431 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:35.431 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:35.431 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff2af54c640 1 Processor -- start 2026-02-13T20:11:35.431 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff2af54c640 1 -- start start 2026-02-13T20:11:35.431 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff2af54c640 10 monclient: init 2026-02-13T20:11:35.431 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff2af54c640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:35.431 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff2af54c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:11:35.431 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff2af54c640 10 monclient(hunting): picked mon.noname-b con 0x7ff2a81401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:35.431 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff2af54c640 10 monclient(hunting): picked mon.noname-a con 0x7ff2a8092020 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:35.431 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff2af54c640 10 monclient(hunting): picked mon.noname-c con 0x7ff2a8091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:35.432 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff2af54c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2a808b730 con 0x7ff2a8092020 2026-02-13T20:11:35.432 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff2af54c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2a805c5b0 con 0x7ff2a8091950 2026-02-13T20:11:35.432 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff2af54c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2a808bcf0 con 0x7ff2a81401c0 2026-02-13T20:11:35.432 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff2af54c640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:35.432 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff2af54c640 10 monclient(hunting): authenticate will time out at 657.112398s 2026-02-13T20:11:35.432 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff2ad2c1640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7ff2a81401c0 0x7ff2a8091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:40102/0 (socket says 10.20.193.110:40102) 2026-02-13T20:11:35.432 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff2ad2c1640 1 -- 10.20.193.110:0/237200720 learned_addr learned my addr 10.20.193.110:0/237200720 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:35.432 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff297fff640 1 -- 10.20.193.110:0/237200720 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1404019893 0 0) 0x7ff2a808bcf0 con 0x7ff2a81401c0 2026-02-13T20:11:35.432 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff297fff640 10 monclient(hunting): _negotiate 2026-02-13T20:11:35.432 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff297fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:35.432 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff297fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:35.432 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff297fff640 10 monclient(hunting): my global_id is 4442 2026-02-13T20:11:35.432 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff297fff640 1 -- 10.20.193.110:0/237200720 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2900035e0 con 0x7ff2a81401c0 2026-02-13T20:11:35.433 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff297fff640 1 -- 10.20.193.110:0/237200720 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2354119124 0 0) 0x7ff2a808b730 con 0x7ff2a8092020 2026-02-13T20:11:35.433 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff297fff640 10 monclient(hunting): _negotiate 2026-02-13T20:11:35.433 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff297fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:35.433 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff297fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:35.433 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff297fff640 10 monclient(hunting): my global_id is 4434 2026-02-13T20:11:35.433 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff297fff640 1 -- 10.20.193.110:0/237200720 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2a808bcf0 con 0x7ff2a8092020 2026-02-13T20:11:35.433 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff297fff640 1 -- 10.20.193.110:0/237200720 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3839889735 0 0) 0x7ff2a808bcf0 con 0x7ff2a8092020 2026-02-13T20:11:35.433 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff297fff640 1 -- 10.20.193.110:0/237200720 >> v1:10.20.193.110:6790/0 conn(0x7ff2a81401c0 legacy=0x7ff2a8091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:35.433 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff297fff640 1 -- 10.20.193.110:0/237200720 >> v1:10.20.193.188:6789/0 conn(0x7ff2a8091950 legacy=0x7ff2a81a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:35.433 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff297fff640 10 monclient: _finish_hunting 0 2026-02-13T20:11:35.433 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff297fff640 1 monclient: found mon.noname-a 2026-02-13T20:11:35.433 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff297fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:35.433 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff297fff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:11:35.434 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff297fff640 1 -- 10.20.193.110:0/237200720 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2a8140590 con 0x7ff2a8092020 2026-02-13T20:11:35.434 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff297fff640 10 monclient: _finish_auth 0 2026-02-13T20:11:35.434 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff297fff640 10 monclient: _check_auth_tickets 2026-02-13T20:11:35.434 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff297fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:35.434 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff297fff640 1 -- 10.20.193.110:0/237200720 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff29c002dd0 con 0x7ff2a8092020 2026-02-13T20:11:35.434 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff297fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:35.434 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff297fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:11:35.434 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff297fff640 10 monclient: dump: 2026-02-13T20:11:35.434 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:35.434 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:35.434 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:35.434 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:35.434 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:35.434 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:35.435 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:35.435 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:35.435 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:35.435 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:35.435 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff2af54c640 5 monclient: authenticate success, global_id 4434 2026-02-13T20:11:35.435 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff2af54c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:35.435 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff297fff640 1 -- 10.20.193.110:0/237200720 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff29c002f60 con 0x7ff2a8092020 2026-02-13T20:11:35.435 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff297fff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:35.435 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff2af54c640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:35.435 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff2af54c640 4 set_mon_vals no callback set 2026-02-13T20:11:35.435 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff297fff640 1 -- 10.20.193.110:0/237200720 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff29c003370 con 0x7ff2a8092020 2026-02-13T20:11:35.435 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff297fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:35.435 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff297fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:35.435 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.421+0000 7ff297fff640 10 monclient: dump: 2026-02-13T20:11:35.436 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:35.436 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:35.436 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:35.436 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:35.436 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:35.436 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:35.436 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:35.436 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:35.436 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:35.436 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:35.436 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.422+0000 7ff2af54c640 10 monclient: shutdown 2026-02-13T20:11:35.436 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.422+0000 7ff2af54c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:35.436 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.422+0000 7ff2af54c640 1 -- 10.20.193.110:0/237200720 >> v1:10.20.193.110:6789/0 conn(0x7ff2a8092020 legacy=0x7ff2a81812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:35.436 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.422+0000 7ff2af54c640 1 -- 10.20.193.110:0/237200720 shutdown_connections 2026-02-13T20:11:35.437 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.422+0000 7ff2af54c640 1 -- 10.20.193.110:0/237200720 >> 10.20.193.110:0/237200720 conn(0x7ff2a8054e90 msgr2=0x7ff2a8058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:35.437 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.422+0000 7ff2af54c640 1 -- 10.20.193.110:0/237200720 shutdown_connections 2026-02-13T20:11:35.437 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.422+0000 7ff2af54c640 1 -- 10.20.193.110:0/237200720 wait complete. 2026-02-13T20:11:35.437 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.422+0000 7ff2af54c640 10 monclient: build_initial_monmap 2026-02-13T20:11:35.437 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.422+0000 7ff2af54c640 10 monclient: monmap: 2026-02-13T20:11:35.437 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:35.437 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:35.437 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:11:35.437 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:11:35.437 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:35.437 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:11:35.437 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:35.437 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:35.438 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:35.438 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:35.438 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.422+0000 7ff2af54c640 1 Processor -- start 2026-02-13T20:11:35.438 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.422+0000 7ff2af54c640 1 -- start start 2026-02-13T20:11:35.438 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.422+0000 7ff2af54c640 10 monclient: init 2026-02-13T20:11:35.438 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff2af54c640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:35.438 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff2af54c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:11:35.438 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff2af54c640 10 monclient(hunting): picked mon.noname-c con 0x7ff2a8091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:35.438 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff2af54c640 10 monclient(hunting): picked mon.noname-b con 0x7ff2a81401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:35.438 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff2af54c640 10 monclient(hunting): picked mon.noname-a con 0x7ff2a813eea0 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:35.438 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff2af54c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2a8090f50 con 0x7ff2a813eea0 2026-02-13T20:11:35.438 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff2af54c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2a808c430 con 0x7ff2a81401c0 2026-02-13T20:11:35.438 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff2af54c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2a805d320 con 0x7ff2a8091950 2026-02-13T20:11:35.438 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff2af54c640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:35.439 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff2af54c640 10 monclient(hunting): authenticate will time out at 657.114299s 2026-02-13T20:11:35.439 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff2adac2640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7ff2a813eea0 0x7ff2a81950f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:60428/0 (socket says 10.20.193.110:60428) 2026-02-13T20:11:35.439 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff2ad2c1640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7ff2a8091950 0x7ff2a813e790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:40104/0 (socket says 10.20.193.110:40104) 2026-02-13T20:11:35.439 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff2adac2640 1 -- 10.20.193.110:0/2102182712 learned_addr learned my addr 10.20.193.110:0/2102182712 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:35.439 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff295ffb640 1 -- 10.20.193.110:0/2102182712 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4095592021 0 0) 0x7ff2a8090f50 con 0x7ff2a813eea0 2026-02-13T20:11:35.439 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff295ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:11:35.439 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff295ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:35.439 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff295ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:35.439 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff295ffb640 10 monclient(hunting): my global_id is 4437 2026-02-13T20:11:35.439 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff295ffb640 1 -- 10.20.193.110:0/2102182712 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2780035e0 con 0x7ff2a813eea0 2026-02-13T20:11:35.439 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff295ffb640 1 -- 10.20.193.110:0/2102182712 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 400227663 0 0) 0x7ff2a805d320 con 0x7ff2a8091950 2026-02-13T20:11:35.439 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff295ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:11:35.439 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff295ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:35.439 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff295ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:35.440 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff295ffb640 10 monclient(hunting): my global_id is 4445 2026-02-13T20:11:35.440 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff295ffb640 1 -- 10.20.193.110:0/2102182712 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2a8090f50 con 0x7ff2a8091950 2026-02-13T20:11:35.440 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff295ffb640 1 -- 10.20.193.110:0/2102182712 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4294478879 0 0) 0x7ff2780035e0 con 0x7ff2a813eea0 2026-02-13T20:11:35.440 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff295ffb640 1 -- 10.20.193.110:0/2102182712 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff2a805d320 con 0x7ff2a813eea0 2026-02-13T20:11:35.440 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff295ffb640 1 -- 10.20.193.110:0/2102182712 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff2a40041d0 con 0x7ff2a813eea0 2026-02-13T20:11:35.440 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff295ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:35.440 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff295ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:11:35.440 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff295ffb640 10 monclient(hunting): dump: 2026-02-13T20:11:35.440 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:35.440 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:35.440 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:35.440 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:35.440 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:35.440 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:35.441 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:35.441 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:35.441 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:35.441 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:35.441 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff295ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:35.441 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff295ffb640 1 -- 10.20.193.110:0/2102182712 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1455432010 0 0) 0x7ff2a808c430 con 0x7ff2a81401c0 2026-02-13T20:11:35.441 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff295ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:11:35.441 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff295ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:35.441 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff295ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:35.441 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff295ffb640 10 monclient(hunting): my global_id is 4411 2026-02-13T20:11:35.441 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff295ffb640 1 -- 10.20.193.110:0/2102182712 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2780035e0 con 0x7ff2a81401c0 2026-02-13T20:11:35.441 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff295ffb640 1 -- 10.20.193.110:0/2102182712 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 87608739 0 0) 0x7ff2a8090f50 con 0x7ff2a8091950 2026-02-13T20:11:35.441 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff295ffb640 1 -- 10.20.193.110:0/2102182712 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff2a808c430 con 0x7ff2a8091950 2026-02-13T20:11:35.441 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff295ffb640 1 -- 10.20.193.110:0/2102182712 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1175492804 0 0) 0x7ff2a805d320 con 0x7ff2a813eea0 2026-02-13T20:11:35.442 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff295ffb640 1 -- 10.20.193.110:0/2102182712 >> v1:10.20.193.110:6790/0 conn(0x7ff2a8091950 legacy=0x7ff2a813e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:35.442 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff295ffb640 1 -- 10.20.193.110:0/2102182712 >> v1:10.20.193.188:6789/0 conn(0x7ff2a81401c0 legacy=0x7ff2a81939d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:35.442 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff295ffb640 10 monclient: _finish_hunting 0 2026-02-13T20:11:35.442 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff295ffb640 1 monclient: found mon.a 2026-02-13T20:11:35.442 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff295ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:35.442 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff295ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:35.442 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff295ffb640 1 -- 10.20.193.110:0/2102182712 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2a808a8d0 con 0x7ff2a813eea0 2026-02-13T20:11:35.442 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff295ffb640 10 monclient: _finish_auth 0 2026-02-13T20:11:35.442 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff295ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:11:35.442 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff295ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:35.442 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff2af54c640 5 monclient: authenticate success, global_id 4437 2026-02-13T20:11:35.442 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff2af54c640 10 monclient: _renew_subs 2026-02-13T20:11:35.442 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff2af54c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:35.443 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff2af54c640 1 -- 10.20.193.110:0/2102182712 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff2a8131ed0 con 0x7ff2a813eea0 2026-02-13T20:11:35.443 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff2af54c640 10 monclient: _renew_subs 2026-02-13T20:11:35.443 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff2af54c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:11:35.443 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff2af54c640 1 -- 10.20.193.110:0/2102182712 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff2a8152670 con 0x7ff2a813eea0 2026-02-13T20:11:35.443 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff295ffb640 1 -- 10.20.193.110:0/2102182712 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff2a4004330 con 0x7ff2a813eea0 2026-02-13T20:11:35.443 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff295ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:35.443 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff295ffb640 1 -- 10.20.193.110:0/2102182712 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff2a4004a60 con 0x7ff2a813eea0 2026-02-13T20:11:35.443 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff295ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:35.443 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff295ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:11:35.443 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff295ffb640 10 monclient: dump: 2026-02-13T20:11:35.443 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:35.443 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:35.443 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:35.443 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:35.444 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:35.444 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:35.444 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:35.444 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:35.444 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:35.444 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:35.444 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.423+0000 7ff2977fe640 4 set_mon_vals no callback set 2026-02-13T20:11:35.444 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.424+0000 7ff2af54c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:35.444 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.424+0000 7ff2af54c640 1 -- 10.20.193.110:0/2102182712 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff2a81320c0 con 0x7ff2a8092020 2026-02-13T20:11:35.444 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.424+0000 7ff295ffb640 1 -- 10.20.193.110:0/2102182712 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7ff2a4004bc0 con 0x7ff2a813eea0 2026-02-13T20:11:35.444 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.424+0000 7ff295ffb640 1 -- 10.20.193.110:0/2102182712 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 3531+0+0 (unknown 315507976 0 0) 0x7ff2a404f740 con 0x7ff2a813eea0 2026-02-13T20:11:35.444 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.424+0000 7ff295ffb640 1 -- 10.20.193.110:0/2102182712 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3346538516 0 0) 0x7ff2a81320c0 con 0x7ff2a8092020 2026-02-13T20:11:35.444 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.424+0000 7ff295ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:11:35.444 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.424+0000 7ff295ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:35.445 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.424+0000 7ff295ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:35.445 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.424+0000 7ff295ffb640 10 monclient(hunting): my global_id is 4414 2026-02-13T20:11:35.445 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.424+0000 7ff295ffb640 1 -- 10.20.193.110:0/2102182712 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2a805d320 con 0x7ff2a8092020 2026-02-13T20:11:35.445 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.424+0000 7ff2acac0640 10 monclient: get_auth_request con 0x7ff27803fc30 auth_method 0 2026-02-13T20:11:35.445 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.424+0000 7ff295ffb640 1 -- 10.20.193.110:0/2102182712 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2549055795 0 0) 0x7ff2a805d320 con 0x7ff2a8092020 2026-02-13T20:11:35.445 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.424+0000 7ff295ffb640 1 -- 10.20.193.110:0/2102182712 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff2a81320c0 con 0x7ff2a8092020 2026-02-13T20:11:35.445 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.424+0000 7ff295ffb640 1 -- 10.20.193.110:0/2102182712 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff2980048a0 con 0x7ff2a8092020 2026-02-13T20:11:35.445 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.425+0000 7ff295ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:35.445 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.425+0000 7ff295ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:11:35.445 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.425+0000 7ff295ffb640 10 monclient: dump: 2026-02-13T20:11:35.445 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:35.445 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:35.445 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:35.445 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:35.445 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:35.446 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:35.446 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:35.446 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:35.446 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:35.446 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:35.446 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.425+0000 7ff295ffb640 1 -- 10.20.193.110:0/2102182712 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1131635241 0 0) 0x7ff2a81320c0 con 0x7ff2a8092020 2026-02-13T20:11:35.446 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.425+0000 7ff295ffb640 1 -- 10.20.193.110:0/2102182712 --> v1:10.20.193.188:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff2a808b450 con 0x7ff2a8092020 2026-02-13T20:11:35.446 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.425+0000 7ff295ffb640 1 -- 10.20.193.110:0/2102182712 <== mon.1 v1:10.20.193.188:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7ff298006ae0 con 0x7ff2a8092020 2026-02-13T20:11:35.446 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.425+0000 7ff295ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:35.446 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.425+0000 7ff295ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:11:35.446 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.425+0000 7ff295ffb640 1 -- 10.20.193.110:0/2102182712 >> v1:10.20.193.188:6789/0 conn(0x7ff2a8092020 legacy=0x7ff2a8127b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:35.446 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.425+0000 7ff295ffb640 1 -- 10.20.193.110:0/2102182712 >> v1:10.20.193.188:6789/0 conn(0x7ff2a8092020 legacy=0x7ff2a8127b20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:11:35.448 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.428+0000 7ff2af54c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:11:35.448 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.428+0000 7ff2af54c640 1 -- 10.20.193.110:0/2102182712 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff2a81322c0 con 0x7ff2a8152970 2026-02-13T20:11:35.448 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.429+0000 7ff295ffb640 1 -- 10.20.193.110:0/2102182712 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 451768727 0 0) 0x7ff2a81322c0 con 0x7ff2a8152970 2026-02-13T20:11:35.448 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.429+0000 7ff295ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:11:35.448 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.429+0000 7ff295ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:35.448 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.429+0000 7ff295ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:35.448 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.429+0000 7ff295ffb640 10 monclient(hunting): my global_id is 4417 2026-02-13T20:11:35.448 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.429+0000 7ff295ffb640 1 -- 10.20.193.110:0/2102182712 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2a81320c0 con 0x7ff2a8152970 2026-02-13T20:11:35.448 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.429+0000 7ff295ffb640 1 -- 10.20.193.110:0/2102182712 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2755145213 0 0) 0x7ff2a81320c0 con 0x7ff2a8152970 2026-02-13T20:11:35.448 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.429+0000 7ff295ffb640 1 -- 10.20.193.110:0/2102182712 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff2a81322c0 con 0x7ff2a8152970 2026-02-13T20:11:35.448 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.429+0000 7ff295ffb640 1 -- 10.20.193.110:0/2102182712 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff2980050c0 con 0x7ff2a8152970 2026-02-13T20:11:35.449 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.429+0000 7ff295ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:35.449 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.429+0000 7ff295ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:11:35.449 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.429+0000 7ff295ffb640 10 monclient: dump: 2026-02-13T20:11:35.449 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:35.449 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:35.449 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:35.449 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:35.449 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:35.449 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:35.449 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:35.449 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:35.449 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:35.449 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:35.449 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.429+0000 7ff295ffb640 1 -- 10.20.193.110:0/2102182712 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 120295763 0 0) 0x7ff2a81322c0 con 0x7ff2a8152970 2026-02-13T20:11:35.450 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.429+0000 7ff295ffb640 1 -- 10.20.193.110:0/2102182712 --> v1:10.20.193.188:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff2a8055bb0 con 0x7ff2a8152970 2026-02-13T20:11:35.450 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.430+0000 7ff295ffb640 1 -- 10.20.193.110:0/2102182712 <== mon.1 v1:10.20.193.188:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4680 (unknown 0 0 1598086922) 0x7ff2980065e0 con 0x7ff2a8152970 2026-02-13T20:11:35.450 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.430+0000 7ff295ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:11:35.450 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.430+0000 7ff295ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:11:35.450 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.430+0000 7ff295ffb640 1 -- 10.20.193.110:0/2102182712 >> v1:10.20.193.188:6789/0 conn(0x7ff2a8152970 legacy=0x7ff2a8128230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:35.450 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.430+0000 7ff295ffb640 1 -- 10.20.193.110:0/2102182712 >> v1:10.20.193.188:6789/0 conn(0x7ff2a8152970 legacy=0x7ff2a8128230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:11:35.450 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:11:35.450 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:11:35.450 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:11:35.451 INFO:teuthology.orchestra.run.trial110.stdout: "state": "peon", 2026-02-13T20:11:35.451 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 4, 2026-02-13T20:11:35.451 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 17577, 2026-02-13T20:11:35.451 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:11:35.451 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:11:35.451 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:11:35.451 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:11:35.451 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:11:35.451 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 17, 2026-02-13T20:11:35.451 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:11:35.451 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:11:35.451 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:11:35.451 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:11:35.451 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:11:35.452 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:11:35.452 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:11:35.452 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:11:35.452 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:11:35.452 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:11:35.452 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:11:35.452 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:11:35.452 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:11:35.452 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:11:35.452 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:11:35.452 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:11:35.452 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:11:35.452 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:11:35.452 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:11:35.452 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:11:35.452 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:11:35.453 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:11:35.453 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:11:35.453 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:11:35.453 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:11:35.453 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:11:35.453 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:11:35.453 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:11:35.453 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:11:35.453 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:11:35.453 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:11:35.453 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:11:35.453 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:11:35.453 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:11:35.453 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:11:35.453 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:11:35.453 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:11:35.454 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:11:35.454 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:11:35.454 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:11:35.454 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:11:35.454 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:11:35.454 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:11:35.454 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:11:35.454 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:11:35.454 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:11:35.454 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:11:35.454 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:11:35.454 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:11:35.454 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:11:35.454 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:11:35.454 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:11:35.454 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:11:35.455 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:11:35.455 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:11:35.455 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:11:35.455 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:11:35.455 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:11:35.455 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:11:35.455 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:11:35.455 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:11:35.455 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:11:35.455 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:11:35.455 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:11:35.455 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:11:35.455 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:11:35.455 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:11:35.455 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:11:35.455 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:11:35.455 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:11:35.456 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:11:35.456 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:11:35.456 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:11:35.456 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:11:35.456 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:11:35.456 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:11:35.456 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:11:35.456 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:11:35.456 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:11:35.456 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:11:35.456 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:11:35.456 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:11:35.456 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:11:35.456 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:11:35.456 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:11:35.457 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:11:35.457 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:11:35.457 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:11:35.457 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:11:35.457 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:11:35.457 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:11:35.457 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:11:35.457 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:11:35.457 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:11:35.457 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:11:35.457 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:11:35.457 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:11:35.457 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:11:35.457 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:11:35.457 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:11:35.457 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:11:35.457 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:11:35.457 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:11:35.457 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:11:35.458 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:11:35.458 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:11:35.458 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:11:35.458 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:11:35.458 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:11:35.458 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:11:35.458 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:11:35.458 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:11:35.458 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:11:35.458 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:11:35.458 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:11:35.458 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:11:35.458 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:11:35.458 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:11:35.458 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:11:35.458 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:11:35.458 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:11:35.458 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:11:35.459 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:11:35.459 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:11:35.459 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:11:35.459 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:11:35.459 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:11:35.459 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:11:35.459 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:11:35.459 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:11:35.459 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:11:35.459 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:11:35.459 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:11:35.459 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:11:35.459 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:11:35.459 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:11:35.459 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:11:35.459 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:11:35.459 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:11:35.459 INFO:teuthology.orchestra.run.trial110.stdout: "num": 3 2026-02-13T20:11:35.459 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:11:35.459 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:11:35.460 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:11:35.460 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:11:35.460 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:11:35.460 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:11:35.460 INFO:teuthology.orchestra.run.trial110.stdout: "num": 4 2026-02-13T20:11:35.460 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:11:35.460 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:11:35.460 INFO:teuthology.orchestra.run.trial110.stdout: "mgr": [ 2026-02-13T20:11:35.460 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:11:35.460 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:11:35.460 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:11:35.460 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:11:35.460 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:11:35.460 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:11:35.460 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:11:35.460 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:11:35.460 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:11:35.461 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.430+0000 7ff2af54c640 1 -- 10.20.193.110:0/2102182712 >> v1:10.20.193.188:6812/1623052694 conn(0x7ff27803fc30 legacy=0x7ff2780600e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:35.461 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.430+0000 7ff2af54c640 10 monclient: shutdown 2026-02-13T20:11:35.461 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.430+0000 7ff2af54c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:35.462 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.430+0000 7ff2af54c640 1 -- 10.20.193.110:0/2102182712 >> v1:10.20.193.110:6789/0 conn(0x7ff2a813eea0 legacy=0x7ff2a81950f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:35.462 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.430+0000 7ff2adac2640 1 -- 10.20.193.110:0/2102182712 reap_dead start 2026-02-13T20:11:35.462 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.430+0000 7ff2adac2640 1 -- 10.20.193.110:0/2102182712 reap_dead start 2026-02-13T20:11:35.462 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.430+0000 7ff2af54c640 1 -- 10.20.193.110:0/2102182712 shutdown_connections 2026-02-13T20:11:35.462 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.430+0000 7ff2af54c640 1 -- 10.20.193.110:0/2102182712 >> 10.20.193.110:0/2102182712 conn(0x7ff2a8054e90 msgr2=0x7ff2a808dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:35.462 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.430+0000 7ff2af54c640 1 -- 10.20.193.110:0/2102182712 shutdown_connections 2026-02-13T20:11:35.462 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:35.430+0000 7ff2af54c640 1 -- 10.20.193.110:0/2102182712 wait complete. 2026-02-13T20:11:35.462 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:11:35.463 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2026-02-13T20:11:35.463 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['c'] 2026-02-13T20:11:35.463 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2026-02-13T20:11:35.463 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2026-02-13T20:11:35.464 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-13T20:11:35.464 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T20:11:35.472 INFO:tasks.ceph.mon.a:Stopped 2026-02-13T20:11:35.472 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.c 2026-02-13T20:11:35.472 INFO:tasks.mon_thrash:Sending STOP to mon c 2026-02-13T20:11:35.472 INFO:tasks.ceph.mon.c:Sent signal 19 2026-02-13T20:11:35.472 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-13T20:11:37.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:37.932+0000 7f36d5ffb640 10 monclient: tick 2026-02-13T20:11:37.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:37.932+0000 7f36d5ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:11:37.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:37.932+0000 7f36d5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:37.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:37.932+0000 7f36d5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:38.933 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:38.932+0000 7f36d5ffb640 10 monclient: tick 2026-02-13T20:11:38.933 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:38.932+0000 7f36d5ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:11:38.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:38.932+0000 7f36d5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:39.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:39.931+0000 7f36d5ffb640 10 monclient: tick 2026-02-13T20:11:39.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:39.931+0000 7f36d5ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:11:39.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:39.931+0000 7f36d5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:40.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:40.932+0000 7f36d5ffb640 10 monclient: tick 2026-02-13T20:11:40.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:40.932+0000 7f36d5ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:11:40.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:40.932+0000 7f36d5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:41.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:41.932+0000 7f36d5ffb640 10 monclient: tick 2026-02-13T20:11:41.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:41.932+0000 7f36d5ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:11:41.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:41.932+0000 7f36d5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:42.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:42.932+0000 7f36d5ffb640 10 monclient: tick 2026-02-13T20:11:42.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:42.932+0000 7f36d5ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:11:42.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:42.932+0000 7f36d5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:43.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:43.932+0000 7f36d5ffb640 10 monclient: tick 2026-02-13T20:11:43.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:43.932+0000 7f36d5ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:11:43.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:43.932+0000 7f36d5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:44.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:44.932+0000 7f36d5ffb640 10 monclient: tick 2026-02-13T20:11:44.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:44.932+0000 7f36d5ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:11:44.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:44.932+0000 7f36d5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:44.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:44.934+0000 7f36d77fe640 10 monclient: _renew_subs 2026-02-13T20:11:44.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:44.934+0000 7f36d77fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:44.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:44.934+0000 7f36d77fe640 1 -- 10.20.193.110:0/2162475689 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=21}) -- 0x7f36c8003560 con 0x7f36f013f280 2026-02-13T20:11:45.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:45.933+0000 7f36d5ffb640 10 monclient: tick 2026-02-13T20:11:45.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:45.933+0000 7f36d5ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:11:45.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:45.933+0000 7f36d5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:46.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:46.933+0000 7f36d5ffb640 10 monclient: tick 2026-02-13T20:11:46.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:46.933+0000 7f36d5ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:11:46.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:46.933+0000 7f36d5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:47.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:47.932+0000 7f36d5ffb640 10 monclient: tick 2026-02-13T20:11:47.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:47.932+0000 7f36d5ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:11:47.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:47.932+0000 7f36d5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:47.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:47.932+0000 7f36d5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:48.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:48.932+0000 7f36d5ffb640 10 monclient: tick 2026-02-13T20:11:48.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:48.932+0000 7f36d5ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:11:48.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:48.932+0000 7f36d5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:49.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:49.932+0000 7f36d5ffb640 10 monclient: tick 2026-02-13T20:11:49.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:49.932+0000 7f36d5ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:11:49.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:49.932+0000 7f36d5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:50.473 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.c 2026-02-13T20:11:50.473 INFO:tasks.mon_thrash:Sending CONT to mon c 2026-02-13T20:11:50.473 INFO:tasks.ceph.mon.c:Sent signal 18 2026-02-13T20:11:50.473 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-13T20:11:50.474 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T20:11:50.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:50.539+0000 7f14a390c640 10 monclient: get_monmap_and_config 2026-02-13T20:11:50.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:50.539+0000 7f14a390c640 10 monclient: build_initial_monmap 2026-02-13T20:11:50.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:50.539+0000 7f14a390c640 10 monclient: monmap: 2026-02-13T20:11:50.543 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:50.543 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:50.543 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:50.540657+0000 2026-02-13T20:11:50.544 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:50.540657+0000 2026-02-13T20:11:50.544 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:50.544 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:50.544 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:50.544 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:50.544 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:50.544 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:50.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:50.539+0000 7f14a390c640 1 Processor -- start 2026-02-13T20:11:50.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:50.539+0000 7f14a390c640 1 -- start start 2026-02-13T20:11:50.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:50.539+0000 7f14a390c640 10 monclient: init 2026-02-13T20:11:50.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:50.539+0000 7f14a390c640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:50.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:50.539+0000 7f14a390c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:11:50.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:50.539+0000 7f14a390c640 10 monclient(hunting): picked mon.noname-a con 0x7f149c1401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:50.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:50.539+0000 7f14a390c640 10 monclient(hunting): picked mon.noname-b con 0x7f149c092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:50.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:50.539+0000 7f14a390c640 10 monclient(hunting): picked mon.noname-c con 0x7f149c091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:50.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:50.539+0000 7f14a390c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f149c08b730 con 0x7f149c1401c0 2026-02-13T20:11:50.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:50.540+0000 7f14a390c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f149c05c5b0 con 0x7f149c091950 2026-02-13T20:11:50.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:50.540+0000 7f14a390c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f149c08bcf0 con 0x7f149c092020 2026-02-13T20:11:50.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:50.540+0000 7f14a390c640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:50.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:50.540+0000 7f14a390c640 10 monclient(hunting): authenticate will time out at 672.231017s 2026-02-13T20:11:50.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:50.540+0000 7f14a1681640 1 -- >> v1:10.20.193.110:6789/0 conn(0x7f149c1401c0 legacy=0x7f149c091240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:11:50.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:50.540+0000 7f14a0e80640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f149c092020 0x7f149c1812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:53126/0 (socket says 10.20.193.110:53126) 2026-02-13T20:11:50.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:50.540+0000 7f14a0e80640 1 -- 10.20.193.110:0/2022132204 learned_addr learned my addr 10.20.193.110:0/2022132204 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:50.743 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:50.741+0000 7f14a1681640 1 -- 10.20.193.110:0/2022132204 >> v1:10.20.193.110:6789/0 conn(0x7f149c1401c0 legacy=0x7f149c091240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:11:50.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:50.933+0000 7f36d5ffb640 10 monclient: tick 2026-02-13T20:11:50.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:50.933+0000 7f36d5ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:11:50.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:50.933+0000 7f36d5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:51.143 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:51.142+0000 7f14a1681640 1 -- 10.20.193.110:0/2022132204 >> v1:10.20.193.110:6789/0 conn(0x7f149c1401c0 legacy=0x7f149c091240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:11:51.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:51.933+0000 7f36d5ffb640 10 monclient: tick 2026-02-13T20:11:51.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:51.933+0000 7f36d5ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:11:51.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:51.933+0000 7f36d5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:51.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:51.943+0000 7f14a1681640 1 -- 10.20.193.110:0/2022132204 >> v1:10.20.193.110:6789/0 conn(0x7f149c1401c0 legacy=0x7f149c091240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:11:52.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:52.932+0000 7f36d5ffb640 10 monclient: tick 2026-02-13T20:11:52.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:52.932+0000 7f36d5ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:11:52.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:52.932+0000 7f36d5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:53.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:53.541+0000 7f148affd640 10 monclient(hunting): tick 2026-02-13T20:11:53.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:53.541+0000 7f148affd640 10 monclient(hunting): _check_auth_tickets 2026-02-13T20:11:53.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:53.541+0000 7f148affd640 1 monclient(hunting): continuing hunt 2026-02-13T20:11:53.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:53.541+0000 7f148affd640 10 monclient(hunting): _reopen_session rank -1 2026-02-13T20:11:53.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:53.541+0000 7f148affd640 1 -- 10.20.193.110:0/2022132204 >> v1:10.20.193.110:6790/0 conn(0x7f149c092020 legacy=0x7f149c1812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:53.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:53.541+0000 7f148affd640 1 -- 10.20.193.110:0/2022132204 >> v1:10.20.193.188:6789/0 conn(0x7f149c091950 legacy=0x7f149c1a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:53.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:53.541+0000 7f148affd640 1 -- 10.20.193.110:0/2022132204 >> v1:10.20.193.110:6789/0 conn(0x7f149c1401c0 legacy=0x7f149c091240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:11:53.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:53.541+0000 7f148affd640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:11:53.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:53.541+0000 7f148affd640 10 monclient(hunting): picked mon.noname-c con 0x7f149c091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:53.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:53.541+0000 7f148affd640 10 monclient(hunting): picked mon.noname-b con 0x7f1480024ed0 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:53.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:53.541+0000 7f148affd640 10 monclient(hunting): picked mon.noname-a con 0x7f149c1401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:53.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:53.541+0000 7f148affd640 1 -- 10.20.193.110:0/2022132204 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f149c140590 con 0x7f149c1401c0 2026-02-13T20:11:53.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:53.541+0000 7f148affd640 1 -- 10.20.193.110:0/2022132204 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f149c08b730 con 0x7f149c091950 2026-02-13T20:11:53.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:53.541+0000 7f148affd640 1 -- 10.20.193.110:0/2022132204 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f148006a380 con 0x7f1480024ed0 2026-02-13T20:11:53.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:53.541+0000 7f148affd640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:53.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:53.541+0000 7f14a1e82640 1 -- 10.20.193.110:0/2022132204 >> v1:10.20.193.110:6789/0 conn(0x7f149c1401c0 legacy=0x7f1480066b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:11:53.743 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:53.742+0000 7f14a1e82640 1 -- 10.20.193.110:0/2022132204 >> v1:10.20.193.110:6789/0 conn(0x7f149c1401c0 legacy=0x7f1480066b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:11:53.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:53.933+0000 7f36d5ffb640 10 monclient: tick 2026-02-13T20:11:53.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:53.933+0000 7f36d5ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:11:53.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:53.933+0000 7f36d5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:54.145 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:54.143+0000 7f14a1e82640 1 -- 10.20.193.110:0/2022132204 >> v1:10.20.193.110:6789/0 conn(0x7f149c1401c0 legacy=0x7f1480066b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:11:54.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:54.933+0000 7f36d5ffb640 10 monclient: tick 2026-02-13T20:11:54.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:54.933+0000 7f36d5ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:11:54.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:54.933+0000 7f36d5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:54.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:54.944+0000 7f14a1e82640 1 -- 10.20.193.110:0/2022132204 >> v1:10.20.193.110:6789/0 conn(0x7f149c1401c0 legacy=0x7f1480066b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:11:55.486 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.479+0000 7f148bfff640 1 -- 10.20.193.110:0/2022132204 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4294755522 0 0) 0x7f149c08b730 con 0x7f149c091950 2026-02-13T20:11:55.486 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.479+0000 7f148bfff640 10 monclient(hunting): _negotiate 2026-02-13T20:11:55.486 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.479+0000 7f148bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:55.487 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.479+0000 7f148bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:55.487 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.479+0000 7f148bfff640 10 monclient(hunting): my global_id is 4420 2026-02-13T20:11:55.487 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.479+0000 7f148bfff640 1 -- 10.20.193.110:0/2022132204 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14840035e0 con 0x7f149c091950 2026-02-13T20:11:55.487 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.479+0000 7f148bfff640 1 -- 10.20.193.110:0/2022132204 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2678933248 0 0) 0x7f14840035e0 con 0x7f149c091950 2026-02-13T20:11:55.487 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.479+0000 7f148bfff640 1 -- 10.20.193.110:0/2022132204 >> v1:10.20.193.110:6790/0 conn(0x7f1480024ed0 legacy=0x7f1480045330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:55.487 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.479+0000 7f148bfff640 1 -- 10.20.193.110:0/2022132204 >> v1:10.20.193.110:6789/0 conn(0x7f149c1401c0 legacy=0x7f1480066b60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:11:55.487 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.479+0000 7f148bfff640 10 monclient: _finish_hunting 0 2026-02-13T20:11:55.487 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.479+0000 7f148bfff640 1 monclient: found mon.noname-c 2026-02-13T20:11:55.487 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.479+0000 7f148bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:55.487 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.479+0000 7f148bfff640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.188:6789/0 2026-02-13T20:11:55.488 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.479+0000 7f148bfff640 1 -- 10.20.193.110:0/2022132204 --> v1:10.20.193.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f148006b640 con 0x7f149c091950 2026-02-13T20:11:55.488 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.479+0000 7f148bfff640 10 monclient: _finish_auth 0 2026-02-13T20:11:55.488 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.479+0000 7f148bfff640 10 monclient: _check_auth_tickets 2026-02-13T20:11:55.488 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.479+0000 7f148bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:55.488 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.479+0000 7f148bfff640 1 -- 10.20.193.110:0/2022132204 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f148c004270 con 0x7f149c091950 2026-02-13T20:11:55.488 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.479+0000 7f148bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:55.488 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.479+0000 7f148bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:11:55.488 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.479+0000 7f148bfff640 10 monclient: dump: 2026-02-13T20:11:55.488 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:55.488 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:55.488 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:55.489 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:55.489 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:55.489 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:55.489 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:55.489 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:55.489 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:55.489 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:55.489 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.479+0000 7f14a390c640 5 monclient: authenticate success, global_id 4420 2026-02-13T20:11:55.489 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.479+0000 7f14a390c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:55.489 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.479+0000 7f148bfff640 1 -- 10.20.193.110:0/2022132204 <== mon.1 v1:10.20.193.188:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f148c004470 con 0x7f149c091950 2026-02-13T20:11:55.489 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.479+0000 7f148bfff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:55.490 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.479+0000 7f148bfff640 1 -- 10.20.193.110:0/2022132204 <== mon.1 v1:10.20.193.188:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f148c004850 con 0x7f149c091950 2026-02-13T20:11:55.490 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.479+0000 7f148bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:55.490 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.479+0000 7f148bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:11:55.490 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.479+0000 7f148bfff640 10 monclient: dump: 2026-02-13T20:11:55.490 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:55.490 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:55.490 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:55.490 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:55.490 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:55.490 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:55.490 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:55.491 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:55.491 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:55.491 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:55.491 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.479+0000 7f14a390c640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:55.491 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.479+0000 7f14a390c640 4 set_mon_vals no callback set 2026-02-13T20:11:55.491 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.479+0000 7f14a390c640 10 monclient: shutdown 2026-02-13T20:11:55.491 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.479+0000 7f14a390c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:55.491 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.479+0000 7f14a390c640 1 -- 10.20.193.110:0/2022132204 >> v1:10.20.193.188:6789/0 conn(0x7f149c091950 legacy=0x7f1480023790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:55.491 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.479+0000 7f14a390c640 1 -- 10.20.193.110:0/2022132204 shutdown_connections 2026-02-13T20:11:55.491 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.479+0000 7f14a390c640 1 -- 10.20.193.110:0/2022132204 >> 10.20.193.110:0/2022132204 conn(0x7f149c054e90 msgr2=0x7f149c058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:55.491 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.480+0000 7f14a390c640 1 -- 10.20.193.110:0/2022132204 shutdown_connections 2026-02-13T20:11:55.492 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.480+0000 7f14a390c640 1 -- 10.20.193.110:0/2022132204 wait complete. 2026-02-13T20:11:55.492 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.480+0000 7f14a390c640 10 monclient: build_initial_monmap 2026-02-13T20:11:55.492 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.480+0000 7f14a390c640 10 monclient: monmap: 2026-02-13T20:11:55.492 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:55.492 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:55.492 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:11:55.492 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:11:55.492 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:55.492 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:11:55.492 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:55.492 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:55.492 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:55.493 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:55.493 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.480+0000 7f14a390c640 1 Processor -- start 2026-02-13T20:11:55.493 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.480+0000 7f14a390c640 1 -- start start 2026-02-13T20:11:55.493 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.480+0000 7f14a390c640 10 monclient: init 2026-02-13T20:11:55.493 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.481+0000 7f14a390c640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:55.493 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.481+0000 7f14a390c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:11:55.493 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.481+0000 7f14a390c640 10 monclient(hunting): picked mon.noname-c con 0x7f1480024ed0 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:55.493 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.481+0000 7f14a390c640 10 monclient(hunting): picked mon.noname-b con 0x7f149c091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:55.493 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.481+0000 7f14a390c640 10 monclient(hunting): picked mon.noname-a con 0x7f149c1401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:55.493 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.481+0000 7f14a390c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f149c10b080 con 0x7f149c1401c0 2026-02-13T20:11:55.493 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.481+0000 7f14a390c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f149c10b5b0 con 0x7f149c091950 2026-02-13T20:11:55.494 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.481+0000 7f14a390c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f149c109250 con 0x7f1480024ed0 2026-02-13T20:11:55.494 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.481+0000 7f14a390c640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:55.494 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.481+0000 7f14a390c640 10 monclient(hunting): authenticate will time out at 677.171107s 2026-02-13T20:11:55.494 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.481+0000 7f14a1e82640 1 -- >> v1:10.20.193.110:6789/0 conn(0x7f149c1401c0 legacy=0x7f149c111ad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:11:55.494 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.481+0000 7f14a0e80640 1 --1- >> v1:10.20.193.188:6789/0 conn(0x7f149c091950 0x7f149c1103b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.188:6789/0 says I am v1:10.20.193.110:52250/0 (socket says 10.20.193.110:52250) 2026-02-13T20:11:55.494 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.481+0000 7f14a0e80640 1 -- 10.20.193.110:0/2175748865 learned_addr learned my addr 10.20.193.110:0/2175748865 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:55.494 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.481+0000 7f1489ffb640 1 -- 10.20.193.110:0/2175748865 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1369141533 0 0) 0x7f149c10b5b0 con 0x7f149c091950 2026-02-13T20:11:55.494 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.481+0000 7f1489ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:11:55.494 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.481+0000 7f1489ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:55.494 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.481+0000 7f1489ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:55.494 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.481+0000 7f1489ffb640 10 monclient(hunting): my global_id is 4423 2026-02-13T20:11:55.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.481+0000 7f1489ffb640 1 -- 10.20.193.110:0/2175748865 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f146c0035e0 con 0x7f149c091950 2026-02-13T20:11:55.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.482+0000 7f1489ffb640 1 -- 10.20.193.110:0/2175748865 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4184950955 0 0) 0x7f146c0035e0 con 0x7f149c091950 2026-02-13T20:11:55.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.482+0000 7f1489ffb640 1 -- 10.20.193.110:0/2175748865 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f149c10b5b0 con 0x7f149c091950 2026-02-13T20:11:55.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.482+0000 7f1489ffb640 1 -- 10.20.193.110:0/2175748865 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f1490002f80 con 0x7f149c091950 2026-02-13T20:11:55.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.482+0000 7f1489ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:55.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.482+0000 7f1489ffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:11:55.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.482+0000 7f1489ffb640 10 monclient(hunting): dump: 2026-02-13T20:11:55.495 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:55.495 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:55.495 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:55.495 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:55.496 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:55.496 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:55.496 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:55.496 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:55.496 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:55.496 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:55.496 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.482+0000 7f1489ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:55.496 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.482+0000 7f1489ffb640 1 -- 10.20.193.110:0/2175748865 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2906312824 0 0) 0x7f149c10b5b0 con 0x7f149c091950 2026-02-13T20:11:55.496 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.482+0000 7f1489ffb640 1 -- 10.20.193.110:0/2175748865 >> v1:10.20.193.110:6790/0 conn(0x7f1480024ed0 legacy=0x7f149c10f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:55.496 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.482+0000 7f1489ffb640 1 -- 10.20.193.110:0/2175748865 >> v1:10.20.193.110:6789/0 conn(0x7f149c1401c0 legacy=0x7f149c111ad0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T20:11:55.496 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.482+0000 7f1489ffb640 10 monclient: _finish_hunting 0 2026-02-13T20:11:55.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.482+0000 7f1489ffb640 1 monclient: found mon.b 2026-02-13T20:11:55.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.482+0000 7f1489ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:55.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.482+0000 7f1489ffb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:11:55.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.482+0000 7f1489ffb640 1 -- 10.20.193.110:0/2175748865 --> v1:10.20.193.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f149c10ad10 con 0x7f149c091950 2026-02-13T20:11:55.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.482+0000 7f1489ffb640 10 monclient: _finish_auth 0 2026-02-13T20:11:55.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.482+0000 7f1489ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:11:55.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.482+0000 7f1489ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:55.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.482+0000 7f14a390c640 5 monclient: authenticate success, global_id 4423 2026-02-13T20:11:55.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.482+0000 7f14a390c640 10 monclient: _renew_subs 2026-02-13T20:11:55.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.482+0000 7f14a390c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:11:55.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.482+0000 7f14a390c640 1 -- 10.20.193.110:0/2175748865 --> v1:10.20.193.188:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f149c11fa10 con 0x7f149c091950 2026-02-13T20:11:55.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.482+0000 7f14a390c640 10 monclient: _renew_subs 2026-02-13T20:11:55.498 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.482+0000 7f14a390c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:11:55.498 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.482+0000 7f14a390c640 1 -- 10.20.193.110:0/2175748865 --> v1:10.20.193.188:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f149c10a060 con 0x7f149c091950 2026-02-13T20:11:55.498 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.482+0000 7f1489ffb640 1 -- 10.20.193.110:0/2175748865 <== mon.1 v1:10.20.193.188:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f14900048a0 con 0x7f149c091950 2026-02-13T20:11:55.498 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.482+0000 7f1489ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:55.498 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.482+0000 7f1489ffb640 1 -- 10.20.193.110:0/2175748865 <== mon.1 v1:10.20.193.188:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f1490003150 con 0x7f149c091950 2026-02-13T20:11:55.498 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.482+0000 7f1489ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:55.498 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.482+0000 7f1489ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:11:55.498 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.482+0000 7f1489ffb640 10 monclient: dump: 2026-02-13T20:11:55.498 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:55.498 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:55.498 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:55.498 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:55.499 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:55.499 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:55.499 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:55.499 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:55.499 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:55.499 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:55.499 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.482+0000 7f148b7fe640 4 set_mon_vals no callback set 2026-02-13T20:11:55.499 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.482+0000 7f14a390c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:55.499 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.482+0000 7f14a390c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:55.499 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.482+0000 7f14a390c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:11:55.499 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.482+0000 7f14a390c640 1 -- 10.20.193.110:0/2175748865 --> v1:10.20.193.188:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f149c05ab70 con 0x7f149c091950 2026-02-13T20:11:55.500 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.483+0000 7f1489ffb640 1 -- 10.20.193.110:0/2175748865 <== mon.1 v1:10.20.193.188:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f1490004c80 con 0x7f149c091950 2026-02-13T20:11:55.500 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.483+0000 7f1489ffb640 1 -- 10.20.193.110:0/2175748865 <== mon.1 v1:10.20.193.188:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 3531+0+0 (unknown 315507976 0 0) 0x7f149004e6f0 con 0x7f149c091950 2026-02-13T20:11:55.500 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.483+0000 7f14a1681640 10 monclient: get_auth_request con 0x7f146c03f630 auth_method 0 2026-02-13T20:11:55.501 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.486+0000 7f1489ffb640 1 -- 10.20.193.110:0/2175748865 <== mon.1 v1:10.20.193.188:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f1490016950 con 0x7f149c091950 2026-02-13T20:11:55.501 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.486+0000 7f1489ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:55.501 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.486+0000 7f1489ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:11:55.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.534+0000 7f36d6ffd640 1 -- 10.20.193.110:0/2162475689 <== mon.2 v1:10.20.193.110:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}]=0 pool 'unique_pool_0' created v21) ==== 130+0+0 (unknown 1951460030 0 0) 0x7f36f012e0f0 con 0x7f36f013f280 2026-02-13T20:11:55.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.534+0000 7f36d6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}] 2026-02-13T20:11:55.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.534+0000 7f36d6ffd640 10 monclient: _finish_command 2 = system:0 pool 'unique_pool_0' created 2026-02-13T20:11:55.536 INFO:teuthology.orchestra.run.trial110.stderr:pool 'unique_pool_0' created 2026-02-13T20:11:55.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.534+0000 7f36d6ffd640 1 -- 10.20.193.110:0/2162475689 <== mon.2 v1:10.20.193.110:6790/0 11 ==== osd_map(21..21 src has 1..21) ==== 643+0+0 (unknown 1235297697 0 0) 0x7f36e0018390 con 0x7f36f013f280 2026-02-13T20:11:55.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.537+0000 7f36f4c78640 1 -- 10.20.193.110:0/2162475689 >> v1:10.20.193.188:6812/1623052694 conn(0x7f36bc03f7e0 legacy=0x7f36bc05fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:55.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.537+0000 7f36f4c78640 10 monclient: shutdown 2026-02-13T20:11:55.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.537+0000 7f36f4c78640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:55.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.537+0000 7f36f4c78640 1 -- 10.20.193.110:0/2162475689 >> v1:10.20.193.110:6790/0 conn(0x7f36f013f280 legacy=0x7f36f0119370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:55.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.537+0000 7f36f4c78640 1 -- 10.20.193.110:0/2162475689 shutdown_connections 2026-02-13T20:11:55.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.537+0000 7f36f4c78640 1 -- 10.20.193.110:0/2162475689 >> 10.20.193.110:0/2162475689 conn(0x7f36f0054e90 msgr2=0x7f36f01269e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:55.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.537+0000 7f36f4c78640 1 -- 10.20.193.110:0/2162475689 shutdown_connections 2026-02-13T20:11:55.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.537+0000 7f36f4c78640 1 -- 10.20.193.110:0/2162475689 wait complete. 2026-02-13T20:11:55.548 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2026-02-13T20:11:55.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.615+0000 7fa5e46cc640 10 monclient: get_monmap_and_config 2026-02-13T20:11:55.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.615+0000 7fa5e46cc640 10 monclient: build_initial_monmap 2026-02-13T20:11:55.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.615+0000 7fa5e46cc640 10 monclient: monmap: 2026-02-13T20:11:55.624 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:55.624 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:55.624 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:55.615528+0000 2026-02-13T20:11:55.624 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:55.615528+0000 2026-02-13T20:11:55.624 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:55.624 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:55.624 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:55.624 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:55.624 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:55.624 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:55.625 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.615+0000 7fa5e46cc640 1 Processor -- start 2026-02-13T20:11:55.625 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.615+0000 7fa5e46cc640 1 -- start start 2026-02-13T20:11:55.625 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.615+0000 7fa5e46cc640 10 monclient: init 2026-02-13T20:11:55.625 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.615+0000 7fa5e46cc640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:55.625 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.615+0000 7fa5e46cc640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:11:55.625 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.615+0000 7fa5e46cc640 10 monclient(hunting): picked mon.noname-b con 0x7fa5dc1401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:55.625 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.615+0000 7fa5e46cc640 10 monclient(hunting): picked mon.noname-c con 0x7fa5dc092020 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:55.625 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.615+0000 7fa5e46cc640 10 monclient(hunting): picked mon.noname-a con 0x7fa5dc091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:55.625 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.615+0000 7fa5e46cc640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5dc08b730 con 0x7fa5dc091950 2026-02-13T20:11:55.625 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.615+0000 7fa5e46cc640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5dc05c5b0 con 0x7fa5dc092020 2026-02-13T20:11:55.625 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.615+0000 7fa5e46cc640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5dc08bcf0 con 0x7fa5dc1401c0 2026-02-13T20:11:55.626 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.615+0000 7fa5e46cc640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:55.626 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.615+0000 7fa5e46cc640 10 monclient(hunting): authenticate will time out at 677.305877s 2026-02-13T20:11:55.626 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.615+0000 7fa5e2c42640 1 -- >> v1:10.20.193.110:6789/0 conn(0x7fa5dc091950 legacy=0x7fa5dc1a2a20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:11:55.626 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.615+0000 7fa5e2441640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fa5dc1401c0 0x7fa5dc091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:38798/0 (socket says 10.20.193.110:38798) 2026-02-13T20:11:55.626 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.615+0000 7fa5e2441640 1 -- 10.20.193.110:0/1958436039 learned_addr learned my addr 10.20.193.110:0/1958436039 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:55.626 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.616+0000 7fa5e143f640 1 -- 10.20.193.110:0/1958436039 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1488444378 0 0) 0x7fa5dc08bcf0 con 0x7fa5dc1401c0 2026-02-13T20:11:55.626 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.616+0000 7fa5e143f640 10 monclient(hunting): _negotiate 2026-02-13T20:11:55.626 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.616+0000 7fa5e143f640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:55.626 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.616+0000 7fa5e143f640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:55.626 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.616+0000 7fa5e143f640 10 monclient(hunting): my global_id is 4451 2026-02-13T20:11:55.626 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.616+0000 7fa5e143f640 1 -- 10.20.193.110:0/1958436039 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5c40035e0 con 0x7fa5dc1401c0 2026-02-13T20:11:55.626 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.616+0000 7fa5e143f640 1 -- 10.20.193.110:0/1958436039 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1570360079 0 0) 0x7fa5c40035e0 con 0x7fa5dc1401c0 2026-02-13T20:11:55.627 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.616+0000 7fa5e143f640 1 -- 10.20.193.110:0/1958436039 >> v1:10.20.193.188:6789/0 conn(0x7fa5dc092020 legacy=0x7fa5dc1812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T20:11:55.627 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.616+0000 7fa5e143f640 1 -- 10.20.193.110:0/1958436039 >> v1:10.20.193.110:6789/0 conn(0x7fa5dc091950 legacy=0x7fa5dc1a2a20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:11:55.627 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.616+0000 7fa5e143f640 10 monclient: _finish_hunting 0 2026-02-13T20:11:55.627 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.616+0000 7fa5e143f640 1 monclient: found mon.noname-b 2026-02-13T20:11:55.627 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.616+0000 7fa5e143f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:55.627 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.616+0000 7fa5e143f640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:11:55.627 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.616+0000 7fa5e143f640 1 -- 10.20.193.110:0/1958436039 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5dc140590 con 0x7fa5dc1401c0 2026-02-13T20:11:55.627 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.616+0000 7fa5e143f640 10 monclient: _finish_auth 0 2026-02-13T20:11:55.627 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.616+0000 7fa5e143f640 10 monclient: _check_auth_tickets 2026-02-13T20:11:55.627 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.616+0000 7fa5e143f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:55.627 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.616+0000 7fa5e143f640 1 -- 10.20.193.110:0/1958436039 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa5cc002dd0 con 0x7fa5dc1401c0 2026-02-13T20:11:55.628 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.616+0000 7fa5e143f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:55.628 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.616+0000 7fa5e143f640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:11:55.628 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.616+0000 7fa5e143f640 10 monclient: dump: 2026-02-13T20:11:55.628 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:55.628 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:55.628 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:55.628 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:55.628 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:55.628 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:55.628 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:55.628 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:55.628 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:55.629 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:55.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.616+0000 7fa5e46cc640 5 monclient: authenticate success, global_id 4451 2026-02-13T20:11:55.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.616+0000 7fa5e46cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:55.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.616+0000 7fa5e143f640 1 -- 10.20.193.110:0/1958436039 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa5cc003020 con 0x7fa5dc1401c0 2026-02-13T20:11:55.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.616+0000 7fa5e143f640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:55.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.616+0000 7fa5e143f640 1 -- 10.20.193.110:0/1958436039 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa5cc003430 con 0x7fa5dc1401c0 2026-02-13T20:11:55.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.616+0000 7fa5e143f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:55.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.616+0000 7fa5e143f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:55.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.616+0000 7fa5e143f640 10 monclient: dump: 2026-02-13T20:11:55.629 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:55.629 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:55.630 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:55.630 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:55.630 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:55.630 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:55.630 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:55.630 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:55.630 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:55.630 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:55.630 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.616+0000 7fa5e46cc640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:55.630 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.616+0000 7fa5e46cc640 4 set_mon_vals no callback set 2026-02-13T20:11:55.630 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.616+0000 7fa5e46cc640 10 monclient: shutdown 2026-02-13T20:11:55.630 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.616+0000 7fa5e46cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:55.631 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.616+0000 7fa5e46cc640 1 -- 10.20.193.110:0/1958436039 >> v1:10.20.193.110:6790/0 conn(0x7fa5dc1401c0 legacy=0x7fa5dc091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:55.631 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.616+0000 7fa5e46cc640 1 -- 10.20.193.110:0/1958436039 shutdown_connections 2026-02-13T20:11:55.631 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.616+0000 7fa5e46cc640 1 -- 10.20.193.110:0/1958436039 >> 10.20.193.110:0/1958436039 conn(0x7fa5dc054e90 msgr2=0x7fa5dc058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:55.631 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.616+0000 7fa5e46cc640 1 -- 10.20.193.110:0/1958436039 shutdown_connections 2026-02-13T20:11:55.631 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.616+0000 7fa5e46cc640 1 -- 10.20.193.110:0/1958436039 wait complete. 2026-02-13T20:11:55.631 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.617+0000 7fa5e46cc640 10 monclient: build_initial_monmap 2026-02-13T20:11:55.631 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.617+0000 7fa5e46cc640 10 monclient: monmap: 2026-02-13T20:11:55.631 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:55.631 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:55.631 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:11:55.631 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:11:55.632 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:55.632 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:11:55.632 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:55.632 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:55.632 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:55.632 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:55.632 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.617+0000 7fa5e46cc640 1 Processor -- start 2026-02-13T20:11:55.632 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.617+0000 7fa5e46cc640 1 -- start start 2026-02-13T20:11:55.632 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.617+0000 7fa5e46cc640 10 monclient: init 2026-02-13T20:11:55.632 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.617+0000 7fa5e46cc640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:55.632 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.617+0000 7fa5e46cc640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:11:55.633 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.617+0000 7fa5e46cc640 10 monclient(hunting): picked mon.noname-a con 0x7fa5dc091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:55.633 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.617+0000 7fa5e46cc640 10 monclient(hunting): picked mon.noname-b con 0x7fa5dc1401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:55.633 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.617+0000 7fa5e46cc640 10 monclient(hunting): picked mon.noname-c con 0x7fa5dc1947c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:55.633 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.617+0000 7fa5e46cc640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5dc05d320 con 0x7fa5dc091950 2026-02-13T20:11:55.633 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.617+0000 7fa5e46cc640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5dc13fb40 con 0x7fa5dc1401c0 2026-02-13T20:11:55.633 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.617+0000 7fa5e2441640 1 -- >> v1:10.20.193.110:6789/0 conn(0x7fa5dc091950 legacy=0x7fa5dc088e30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:11:55.633 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.617+0000 7fa5e46cc640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5dc131f60 con 0x7fa5dc1947c0 2026-02-13T20:11:55.633 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.617+0000 7fa5e46cc640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:55.633 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.617+0000 7fa5e46cc640 10 monclient(hunting): authenticate will time out at 677.307877s 2026-02-13T20:11:55.633 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.617+0000 7fa5e2c42640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fa5dc1947c0 0x7fa5dc194c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:38800/0 (socket says 10.20.193.110:38800) 2026-02-13T20:11:55.633 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.617+0000 7fa5e2c42640 1 -- 10.20.193.110:0/3631193930 learned_addr learned my addr 10.20.193.110:0/3631193930 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:55.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.618+0000 7fa5c2ffd640 1 -- 10.20.193.110:0/3631193930 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 159285704 0 0) 0x7fa5dc131f60 con 0x7fa5dc1947c0 2026-02-13T20:11:55.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.618+0000 7fa5c2ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:11:55.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.618+0000 7fa5c2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:55.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.618+0000 7fa5c2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:55.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.618+0000 7fa5c2ffd640 10 monclient(hunting): my global_id is 4454 2026-02-13T20:11:55.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.618+0000 7fa5c2ffd640 1 -- 10.20.193.110:0/3631193930 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5ac0035e0 con 0x7fa5dc1947c0 2026-02-13T20:11:55.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.618+0000 7fa5c2ffd640 1 -- 10.20.193.110:0/3631193930 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 842857027 0 0) 0x7fa5ac0035e0 con 0x7fa5dc1947c0 2026-02-13T20:11:55.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.618+0000 7fa5c2ffd640 1 -- 10.20.193.110:0/3631193930 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa5dc131f60 con 0x7fa5dc1947c0 2026-02-13T20:11:55.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.618+0000 7fa5c2ffd640 1 -- 10.20.193.110:0/3631193930 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa5d8005270 con 0x7fa5dc1947c0 2026-02-13T20:11:55.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.618+0000 7fa5c2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:55.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.618+0000 7fa5c2ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:11:55.635 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.618+0000 7fa5c2ffd640 10 monclient(hunting): dump: 2026-02-13T20:11:55.635 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:55.635 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:55.635 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:55.635 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:55.635 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:55.635 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:55.635 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:55.635 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:55.635 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:55.635 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:55.635 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.618+0000 7fa5c2ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:55.636 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.618+0000 7fa5c2ffd640 1 -- 10.20.193.110:0/3631193930 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2072770218 0 0) 0x7fa5dc131f60 con 0x7fa5dc1947c0 2026-02-13T20:11:55.636 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.618+0000 7fa5c2ffd640 1 -- 10.20.193.110:0/3631193930 >> v1:10.20.193.188:6789/0 conn(0x7fa5dc1401c0 legacy=0x7fa5dc089540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:55.636 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.618+0000 7fa5c2ffd640 1 -- 10.20.193.110:0/3631193930 >> v1:10.20.193.110:6789/0 conn(0x7fa5dc091950 legacy=0x7fa5dc088e30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T20:11:55.636 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.618+0000 7fa5c2ffd640 10 monclient: _finish_hunting 0 2026-02-13T20:11:55.636 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.618+0000 7fa5c2ffd640 1 monclient: found mon.c 2026-02-13T20:11:55.636 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.618+0000 7fa5c2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:55.636 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.618+0000 7fa5c2ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:55.636 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.618+0000 7fa5c2ffd640 1 -- 10.20.193.110:0/3631193930 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5dc089c50 con 0x7fa5dc1947c0 2026-02-13T20:11:55.636 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.618+0000 7fa5c2ffd640 10 monclient: _finish_auth 0 2026-02-13T20:11:55.636 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.618+0000 7fa5c2ffd640 10 monclient: _check_auth_tickets 2026-02-13T20:11:55.636 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.618+0000 7fa5c2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:55.636 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.618+0000 7fa5e46cc640 5 monclient: authenticate success, global_id 4454 2026-02-13T20:11:55.637 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.618+0000 7fa5e46cc640 10 monclient: _renew_subs 2026-02-13T20:11:55.637 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.618+0000 7fa5e46cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:55.637 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.618+0000 7fa5e46cc640 1 -- 10.20.193.110:0/3631193930 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa5dc08a880 con 0x7fa5dc1947c0 2026-02-13T20:11:55.637 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.618+0000 7fa5e46cc640 10 monclient: _renew_subs 2026-02-13T20:11:55.637 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.618+0000 7fa5e46cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:55.637 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.618+0000 7fa5e46cc640 1 -- 10.20.193.110:0/3631193930 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fa5dc130440 con 0x7fa5dc1947c0 2026-02-13T20:11:55.637 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.618+0000 7fa5c2ffd640 1 -- 10.20.193.110:0/3631193930 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa5d8005440 con 0x7fa5dc1947c0 2026-02-13T20:11:55.637 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.618+0000 7fa5c2ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:55.637 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.618+0000 7fa5c2ffd640 1 -- 10.20.193.110:0/3631193930 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa5d8005820 con 0x7fa5dc1947c0 2026-02-13T20:11:55.637 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.618+0000 7fa5c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:55.638 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.618+0000 7fa5c2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:55.638 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.618+0000 7fa5c2ffd640 10 monclient: dump: 2026-02-13T20:11:55.638 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:55.638 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:55.638 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:55.638 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:55.638 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:55.638 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:55.638 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:55.638 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:55.638 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:55.638 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:55.639 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.618+0000 7fa5e0c3e640 4 set_mon_vals no callback set 2026-02-13T20:11:55.639 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.619+0000 7fa5e46cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:55.639 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.619+0000 7fa5e46cc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:55.639 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.619+0000 7fa5e46cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:55.639 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.619+0000 7fa5e46cc640 1 -- 10.20.193.110:0/3631193930 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5dc0008d0 con 0x7fa5dc1947c0 2026-02-13T20:11:55.639 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.619+0000 7fa5c2ffd640 1 -- 10.20.193.110:0/3631193930 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fa5d8005980 con 0x7fa5dc1947c0 2026-02-13T20:11:55.639 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.619+0000 7fa5c2ffd640 1 -- 10.20.193.110:0/3631193930 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(21..21 src has 1..21) ==== 3858+0+0 (unknown 4102285502 0 0) 0x7fa5d804f850 con 0x7fa5dc1947c0 2026-02-13T20:11:55.639 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.619+0000 7fa5e2441640 10 monclient: get_auth_request con 0x7fa5ac03f5f0 auth_method 0 2026-02-13T20:11:55.639 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.621+0000 7fa5c2ffd640 1 -- 10.20.193.110:0/3631193930 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fa5d8018080 con 0x7fa5dc1947c0 2026-02-13T20:11:55.639 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.621+0000 7fa5c2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:55.640 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.621+0000 7fa5c2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:11:55.641 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.634+0000 7f14a390c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T20:11:55.641 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.634+0000 7f14a390c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T20:11:55.641 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.634+0000 7f14a390c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:11:55.641 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.634+0000 7f14a390c640 1 -- 10.20.193.110:0/2175748865 --> v1:10.20.193.188:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f149c10b230 con 0x7f149c091950 2026-02-13T20:11:55.641 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.634+0000 7f1489ffb640 1 -- 10.20.193.110:0/2175748865 <== mon.1 v1:10.20.193.188:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1603 (unknown 254746657 0 2386225339) 0x7f149c10b230 con 0x7f149c091950 2026-02-13T20:11:55.641 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.634+0000 7f1489ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T20:11:55.641 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.634+0000 7f1489ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:11:55.642 INFO:teuthology.orchestra.run.trial110.stdout:{"election_epoch":6,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"c","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","modified":"2026-02-13T20:11:07.161192Z","created":"2026-02-13T20:11:07.161192Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6789","nonce":0}]},"addr":"10.20.193.110:6789/0","public_addr":"10.20.193.110:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161241+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6789","nonce":0}]},"addr":"10.20.193.188:6789/0","public_addr":"10.20.193.188:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161242+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6790","nonce":0}]},"addr":"10.20.193.110:6790/0","public_addr":"10.20.193.110:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161243+0000","crush_location":[]}]}} 2026-02-13T20:11:55.643 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.636+0000 7f14a390c640 1 -- 10.20.193.110:0/2175748865 >> v1:10.20.193.188:6812/1623052694 conn(0x7f146c03f630 legacy=0x7f146c05fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:55.643 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.636+0000 7f14a390c640 10 monclient: shutdown 2026-02-13T20:11:55.643 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.636+0000 7f14a390c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:55.643 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.636+0000 7f14a390c640 1 -- 10.20.193.110:0/2175748865 >> v1:10.20.193.188:6789/0 conn(0x7f149c091950 legacy=0x7f149c1103b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:55.643 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.636+0000 7f14a390c640 1 -- 10.20.193.110:0/2175748865 shutdown_connections 2026-02-13T20:11:55.643 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.636+0000 7f14a390c640 1 -- 10.20.193.110:0/2175748865 >> 10.20.193.110:0/2175748865 conn(0x7f149c054e90 msgr2=0x7f149c123310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:55.643 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.636+0000 7f14a390c640 1 -- 10.20.193.110:0/2175748865 shutdown_connections 2026-02-13T20:11:55.643 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.636+0000 7f14a390c640 1 -- 10.20.193.110:0/2175748865 wait complete. 2026-02-13T20:11:55.647 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-13T20:11:55.647 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-13T20:11:55.647 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T20:11:55.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.712+0000 7f7d7a8b8640 10 monclient: get_monmap_and_config 2026-02-13T20:11:55.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.712+0000 7f7d7a8b8640 10 monclient: build_initial_monmap 2026-02-13T20:11:55.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.712+0000 7f7d7a8b8640 10 monclient: monmap: 2026-02-13T20:11:55.714 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:55.714 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:55.714 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:55.713251+0000 2026-02-13T20:11:55.714 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:55.713251+0000 2026-02-13T20:11:55.715 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:55.715 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:55.715 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:55.715 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:55.715 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:55.715 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:55.725 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.713+0000 7f7d7a8b8640 1 Processor -- start 2026-02-13T20:11:55.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.713+0000 7f7d7a8b8640 1 -- start start 2026-02-13T20:11:55.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.713+0000 7f7d7a8b8640 10 monclient: init 2026-02-13T20:11:55.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.713+0000 7f7d7a8b8640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:55.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.713+0000 7f7d7a8b8640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:11:55.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.713+0000 7f7d7a8b8640 10 monclient(hunting): picked mon.noname-a con 0x7f7d74089250 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:55.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.713+0000 7f7d7a8b8640 10 monclient(hunting): picked mon.noname-c con 0x7f7d74057780 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:55.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.713+0000 7f7d7a8b8640 10 monclient(hunting): picked mon.noname-b con 0x7f7d74184b60 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:55.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.713+0000 7f7d7a8b8640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d7408a950 con 0x7f7d74089250 2026-02-13T20:11:55.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.713+0000 7f7d7a8b8640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d74089620 con 0x7f7d74057780 2026-02-13T20:11:55.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.713+0000 7f7d7a8b8640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d74057c60 con 0x7f7d74184b60 2026-02-13T20:11:55.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.713+0000 7f7d7a8b8640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:55.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.713+0000 7f7d7a8b8640 10 monclient(hunting): authenticate will time out at 677.403767s 2026-02-13T20:11:55.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.713+0000 7f7d73fff640 1 -- >> v1:10.20.193.110:6789/0 conn(0x7f7d74089250 legacy=0x7f7d740580b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:11:55.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.713+0000 7f7d78e2e640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f7d74184b60 0x7f7d741a4f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:38810/0 (socket says 10.20.193.110:38810) 2026-02-13T20:11:55.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.713+0000 7f7d78e2e640 1 -- 10.20.193.110:0/439783452 learned_addr learned my addr 10.20.193.110:0/439783452 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:55.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.714+0000 7f7d72ffd640 1 -- 10.20.193.110:0/439783452 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1498429342 0 0) 0x7f7d74057c60 con 0x7f7d74184b60 2026-02-13T20:11:55.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.714+0000 7f7d72ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:11:55.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.714+0000 7f7d72ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:55.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.714+0000 7f7d72ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:55.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.714+0000 7f7d72ffd640 10 monclient(hunting): my global_id is 4457 2026-02-13T20:11:55.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.714+0000 7f7d72ffd640 1 -- 10.20.193.110:0/439783452 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d580035e0 con 0x7f7d74184b60 2026-02-13T20:11:55.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.714+0000 7f7d72ffd640 1 -- 10.20.193.110:0/439783452 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 623104739 0 0) 0x7f7d580035e0 con 0x7f7d74184b60 2026-02-13T20:11:55.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.714+0000 7f7d72ffd640 1 -- 10.20.193.110:0/439783452 >> v1:10.20.193.188:6789/0 conn(0x7f7d74057780 legacy=0x7f7d74183440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:55.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.714+0000 7f7d72ffd640 1 -- 10.20.193.110:0/439783452 >> v1:10.20.193.110:6789/0 conn(0x7f7d74089250 legacy=0x7f7d740580b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:11:55.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.714+0000 7f7d72ffd640 10 monclient: _finish_hunting 0 2026-02-13T20:11:55.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.714+0000 7f7d72ffd640 1 monclient: found mon.noname-b 2026-02-13T20:11:55.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.714+0000 7f7d72ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:55.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.714+0000 7f7d72ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:11:55.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.714+0000 7f7d72ffd640 1 -- 10.20.193.110:0/439783452 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d74089a50 con 0x7f7d74184b60 2026-02-13T20:11:55.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.714+0000 7f7d72ffd640 10 monclient: _finish_auth 0 2026-02-13T20:11:55.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.714+0000 7f7d72ffd640 10 monclient: _check_auth_tickets 2026-02-13T20:11:55.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.714+0000 7f7d72ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:55.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.714+0000 7f7d72ffd640 1 -- 10.20.193.110:0/439783452 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f7d68003eb0 con 0x7f7d74184b60 2026-02-13T20:11:55.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.714+0000 7f7d72ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:55.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.714+0000 7f7d72ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:11:55.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.714+0000 7f7d72ffd640 10 monclient: dump: 2026-02-13T20:11:55.729 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:55.729 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:55.729 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:55.729 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:55.729 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:55.729 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:55.730 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:55.730 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:55.730 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:55.730 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:55.730 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.714+0000 7f7d7a8b8640 5 monclient: authenticate success, global_id 4457 2026-02-13T20:11:55.730 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.714+0000 7f7d7a8b8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:55.730 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.714+0000 7f7d72ffd640 1 -- 10.20.193.110:0/439783452 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7d680040f0 con 0x7f7d74184b60 2026-02-13T20:11:55.730 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.714+0000 7f7d72ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:55.730 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.714+0000 7f7d72ffd640 1 -- 10.20.193.110:0/439783452 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f7d68004500 con 0x7f7d74184b60 2026-02-13T20:11:55.730 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.714+0000 7f7d72ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:55.730 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.714+0000 7f7d72ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:55.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.714+0000 7f7d72ffd640 10 monclient: dump: 2026-02-13T20:11:55.731 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:55.731 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:55.731 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:55.731 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:55.731 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:55.731 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:55.731 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:55.731 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:55.731 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:55.731 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:55.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.714+0000 7f7d7a8b8640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:55.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.714+0000 7f7d7a8b8640 4 set_mon_vals no callback set 2026-02-13T20:11:55.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.714+0000 7f7d7a8b8640 10 monclient: shutdown 2026-02-13T20:11:55.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.714+0000 7f7d7a8b8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:55.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.714+0000 7f7d7a8b8640 1 -- 10.20.193.110:0/439783452 >> v1:10.20.193.110:6790/0 conn(0x7f7d74184b60 legacy=0x7f7d741a4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:55.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.714+0000 7f7d7a8b8640 1 -- 10.20.193.110:0/439783452 shutdown_connections 2026-02-13T20:11:55.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.714+0000 7f7d7a8b8640 1 -- 10.20.193.110:0/439783452 >> 10.20.193.110:0/439783452 conn(0x7f7d74054330 msgr2=0x7f7d74054730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:55.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.714+0000 7f7d7a8b8640 1 -- 10.20.193.110:0/439783452 shutdown_connections 2026-02-13T20:11:55.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.714+0000 7f7d7a8b8640 1 -- 10.20.193.110:0/439783452 wait complete. 2026-02-13T20:11:55.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.715+0000 7f7d7a8b8640 10 monclient: build_initial_monmap 2026-02-13T20:11:55.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.715+0000 7f7d7a8b8640 10 monclient: monmap: 2026-02-13T20:11:55.733 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:55.733 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:55.733 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:11:55.733 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:11:55.733 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:55.733 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:11:55.733 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:55.733 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:55.733 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:55.733 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:55.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.715+0000 7f7d7a8b8640 1 Processor -- start 2026-02-13T20:11:55.734 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.715+0000 7f7d7a8b8640 1 -- start start 2026-02-13T20:11:55.734 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.715+0000 7f7d7a8b8640 10 monclient: init 2026-02-13T20:11:55.734 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.715+0000 7f7d7a8b8640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:55.734 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.715+0000 7f7d7a8b8640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:11:55.734 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.715+0000 7f7d7a8b8640 10 monclient(hunting): picked mon.noname-b con 0x7f7d74057780 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:55.734 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.715+0000 7f7d7a8b8640 10 monclient(hunting): picked mon.noname-a con 0x7f7d74089250 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:55.734 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.715+0000 7f7d7a8b8640 10 monclient(hunting): picked mon.noname-c con 0x7f7d74184b60 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:55.734 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.715+0000 7f7d7a8b8640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d7410fc00 con 0x7f7d74089250 2026-02-13T20:11:55.734 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.715+0000 7f7d7a8b8640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d7412b280 con 0x7f7d74057780 2026-02-13T20:11:55.734 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.715+0000 7f7d7a8b8640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d74062290 con 0x7f7d74184b60 2026-02-13T20:11:55.735 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.715+0000 7f7d7a8b8640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:55.735 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.715+0000 7f7d7a8b8640 10 monclient(hunting): authenticate will time out at 677.405574s 2026-02-13T20:11:55.735 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.715+0000 7f7d737fe640 1 -- >> v1:10.20.193.110:6789/0 conn(0x7f7d74089250 legacy=0x7f7d74171f30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:11:55.735 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.715+0000 7f7d78e2e640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f7d74184b60 0x7f7d74173650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:38816/0 (socket says 10.20.193.110:38816) 2026-02-13T20:11:55.735 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.715+0000 7f7d78e2e640 1 -- 10.20.193.110:0/2504990978 learned_addr learned my addr 10.20.193.110:0/2504990978 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:55.735 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.715+0000 7f7d70ff9640 1 -- 10.20.193.110:0/2504990978 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 468633529 0 0) 0x7f7d74062290 con 0x7f7d74184b60 2026-02-13T20:11:55.735 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.715+0000 7f7d70ff9640 10 monclient(hunting): _negotiate 2026-02-13T20:11:55.735 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.715+0000 7f7d70ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:55.735 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.715+0000 7f7d70ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:55.735 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.715+0000 7f7d70ff9640 10 monclient(hunting): my global_id is 4460 2026-02-13T20:11:55.735 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.715+0000 7f7d70ff9640 1 -- 10.20.193.110:0/2504990978 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d440035e0 con 0x7f7d74184b60 2026-02-13T20:11:55.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.715+0000 7f7d70ff9640 1 -- 10.20.193.110:0/2504990978 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3496535184 0 0) 0x7f7d7412b280 con 0x7f7d74057780 2026-02-13T20:11:55.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.715+0000 7f7d70ff9640 10 monclient(hunting): _negotiate 2026-02-13T20:11:55.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.715+0000 7f7d70ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:55.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.715+0000 7f7d70ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:55.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.715+0000 7f7d70ff9640 10 monclient(hunting): my global_id is 4429 2026-02-13T20:11:55.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.715+0000 7f7d70ff9640 1 -- 10.20.193.110:0/2504990978 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d74062290 con 0x7f7d74057780 2026-02-13T20:11:55.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.715+0000 7f7d70ff9640 1 -- 10.20.193.110:0/2504990978 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 563845415 0 0) 0x7f7d440035e0 con 0x7f7d74184b60 2026-02-13T20:11:55.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.715+0000 7f7d70ff9640 1 -- 10.20.193.110:0/2504990978 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7d7412b280 con 0x7f7d74184b60 2026-02-13T20:11:55.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.715+0000 7f7d70ff9640 1 -- 10.20.193.110:0/2504990978 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f7d68003dc0 con 0x7f7d74184b60 2026-02-13T20:11:55.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.715+0000 7f7d70ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:55.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.715+0000 7f7d70ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:11:55.737 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.715+0000 7f7d70ff9640 10 monclient(hunting): dump: 2026-02-13T20:11:55.737 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:55.737 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:55.737 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:55.737 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:55.737 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:55.737 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:55.737 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:55.737 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:55.737 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:55.737 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:55.738 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.715+0000 7f7d70ff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:55.738 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.716+0000 7f7d70ff9640 1 -- 10.20.193.110:0/2504990978 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2265717689 0 0) 0x7f7d7412b280 con 0x7f7d74184b60 2026-02-13T20:11:55.738 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.716+0000 7f7d70ff9640 1 -- 10.20.193.110:0/2504990978 >> v1:10.20.193.188:6789/0 conn(0x7f7d74057780 legacy=0x7f7d7412ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:55.738 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.716+0000 7f7d70ff9640 1 -- 10.20.193.110:0/2504990978 >> v1:10.20.193.110:6789/0 conn(0x7f7d74089250 legacy=0x7f7d74171f30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T20:11:55.738 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.716+0000 7f7d70ff9640 10 monclient: _finish_hunting 0 2026-02-13T20:11:55.738 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.716+0000 7f7d70ff9640 1 monclient: found mon.c 2026-02-13T20:11:55.738 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.716+0000 7f7d70ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:55.738 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.716+0000 7f7d70ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:55.738 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.716+0000 7f7d70ff9640 1 -- 10.20.193.110:0/2504990978 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d74111660 con 0x7f7d74184b60 2026-02-13T20:11:55.738 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.716+0000 7f7d70ff9640 10 monclient: _finish_auth 0 2026-02-13T20:11:55.738 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.716+0000 7f7d70ff9640 10 monclient: _check_auth_tickets 2026-02-13T20:11:55.738 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.716+0000 7f7d70ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:55.739 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.716+0000 7f7d7a8b8640 5 monclient: authenticate success, global_id 4460 2026-02-13T20:11:55.739 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.716+0000 7f7d7a8b8640 10 monclient: _renew_subs 2026-02-13T20:11:55.739 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.716+0000 7f7d7a8b8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:55.739 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.716+0000 7f7d7a8b8640 1 -- 10.20.193.110:0/2504990978 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7d74110170 con 0x7f7d74184b60 2026-02-13T20:11:55.739 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.716+0000 7f7d7a8b8640 10 monclient: _renew_subs 2026-02-13T20:11:55.739 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.716+0000 7f7d7a8b8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:55.739 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.716+0000 7f7d7a8b8640 1 -- 10.20.193.110:0/2504990978 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f7d74110cd0 con 0x7f7d74184b60 2026-02-13T20:11:55.739 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.716+0000 7f7d70ff9640 1 -- 10.20.193.110:0/2504990978 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7d68005c30 con 0x7f7d74184b60 2026-02-13T20:11:55.739 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.716+0000 7f7d70ff9640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:55.739 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.716+0000 7f7d70ff9640 1 -- 10.20.193.110:0/2504990978 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f7d68005f50 con 0x7f7d74184b60 2026-02-13T20:11:55.739 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.716+0000 7f7d70ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:55.740 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.716+0000 7f7d70ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:55.740 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.716+0000 7f7d727fc640 4 set_mon_vals no callback set 2026-02-13T20:11:55.740 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.716+0000 7f7d70ff9640 10 monclient: dump: 2026-02-13T20:11:55.740 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:55.740 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:55.740 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:55.740 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:55.740 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:55.740 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:55.740 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:55.740 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:55.741 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:55.741 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:55.741 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.716+0000 7f7d7a8b8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:55.741 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.716+0000 7f7d7a8b8640 1 -- 10.20.193.110:0/2504990978 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7d7412df00 con 0x7f7d7412db30 2026-02-13T20:11:55.741 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.716+0000 7f7d70ff9640 1 -- 10.20.193.110:0/2504990978 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 900237399 0 0) 0x7f7d7412df00 con 0x7f7d7412db30 2026-02-13T20:11:55.741 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.716+0000 7f7d70ff9640 10 monclient(hunting): _negotiate 2026-02-13T20:11:55.741 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.716+0000 7f7d70ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:55.741 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.716+0000 7f7d70ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:55.741 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.716+0000 7f7d70ff9640 10 monclient(hunting): my global_id is 4463 2026-02-13T20:11:55.741 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.716+0000 7f7d70ff9640 1 -- 10.20.193.110:0/2504990978 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d7412b280 con 0x7f7d7412db30 2026-02-13T20:11:55.741 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.716+0000 7f7d70ff9640 1 -- 10.20.193.110:0/2504990978 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f7d68012bc0 con 0x7f7d74184b60 2026-02-13T20:11:55.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.717+0000 7f7d70ff9640 1 -- 10.20.193.110:0/2504990978 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(21..21 src has 1..21) ==== 3858+0+0 (unknown 4102285502 0 0) 0x7f7d6804f940 con 0x7f7d74184b60 2026-02-13T20:11:55.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.717+0000 7f7d70ff9640 1 -- 10.20.193.110:0/2504990978 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1362818707 0 0) 0x7f7d7412b280 con 0x7f7d7412db30 2026-02-13T20:11:55.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.717+0000 7f7d70ff9640 1 -- 10.20.193.110:0/2504990978 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7d7412df00 con 0x7f7d7412db30 2026-02-13T20:11:55.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.717+0000 7f7d70ff9640 1 -- 10.20.193.110:0/2504990978 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f7d60004060 con 0x7f7d7412db30 2026-02-13T20:11:55.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.717+0000 7f7d70ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:55.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.717+0000 7f7d70ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:55.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.717+0000 7f7d70ff9640 10 monclient: dump: 2026-02-13T20:11:55.742 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:55.742 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:55.742 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:55.742 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:55.742 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:55.743 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:55.743 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:55.743 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:55.743 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:55.743 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:55.743 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.717+0000 7f7d70ff9640 1 -- 10.20.193.110:0/2504990978 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1600132159 0 0) 0x7f7d7412df00 con 0x7f7d7412db30 2026-02-13T20:11:55.743 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.717+0000 7f7d70ff9640 1 -- 10.20.193.110:0/2504990978 --> v1:10.20.193.110:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7d7408a670 con 0x7f7d7412db30 2026-02-13T20:11:55.743 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.717+0000 7f7d737fe640 10 monclient: get_auth_request con 0x7f7d4403f600 auth_method 0 2026-02-13T20:11:55.743 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.717+0000 7f7d70ff9640 1 -- 10.20.193.110:0/2504990978 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f7d60004600 con 0x7f7d7412db30 2026-02-13T20:11:55.743 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.717+0000 7f7d70ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:55.743 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.717+0000 7f7d70ff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:11:55.743 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.717+0000 7f7d70ff9640 1 -- 10.20.193.110:0/2504990978 >> v1:10.20.193.110:6790/0 conn(0x7f7d7412db30 legacy=0x7f7d7408ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:55.744 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.717+0000 7f7d70ff9640 1 -- 10.20.193.110:0/2504990978 >> v1:10.20.193.110:6790/0 conn(0x7f7d7412db30 legacy=0x7f7d7408ef40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:11:55.744 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.720+0000 7f7d7a8b8640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:11:55.744 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.720+0000 7f7d7a8b8640 1 -- 10.20.193.110:0/2504990978 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7d74112130 con 0x7f7d74093830 2026-02-13T20:11:55.744 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.721+0000 7f7d70ff9640 1 -- 10.20.193.110:0/2504990978 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2074561708 0 0) 0x7f7d74112130 con 0x7f7d74093830 2026-02-13T20:11:55.744 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.721+0000 7f7d70ff9640 10 monclient(hunting): _negotiate 2026-02-13T20:11:55.744 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.721+0000 7f7d70ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:55.744 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.721+0000 7f7d70ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:55.744 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.721+0000 7f7d70ff9640 10 monclient(hunting): my global_id is 4466 2026-02-13T20:11:55.744 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.721+0000 7f7d70ff9640 1 -- 10.20.193.110:0/2504990978 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d7412df00 con 0x7f7d74093830 2026-02-13T20:11:55.744 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.721+0000 7f7d70ff9640 1 -- 10.20.193.110:0/2504990978 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 483557091 0 0) 0x7f7d7412df00 con 0x7f7d74093830 2026-02-13T20:11:55.744 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.721+0000 7f7d70ff9640 1 -- 10.20.193.110:0/2504990978 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7d74112130 con 0x7f7d74093830 2026-02-13T20:11:55.744 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.721+0000 7f7d70ff9640 1 -- 10.20.193.110:0/2504990978 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f7d60004bc0 con 0x7f7d74093830 2026-02-13T20:11:55.744 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.721+0000 7f7d70ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:55.745 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.721+0000 7f7d70ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:55.745 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.721+0000 7f7d70ff9640 10 monclient: dump: 2026-02-13T20:11:55.745 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:55.745 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:55.745 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:55.745 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:55.745 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:55.745 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:55.745 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:55.745 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:55.745 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:55.745 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:55.746 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.721+0000 7f7d70ff9640 1 -- 10.20.193.110:0/2504990978 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3042158904 0 0) 0x7f7d74112130 con 0x7f7d74093830 2026-02-13T20:11:55.746 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.721+0000 7f7d70ff9640 1 -- 10.20.193.110:0/2504990978 --> v1:10.20.193.110:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7d74089030 con 0x7f7d74093830 2026-02-13T20:11:55.746 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.721+0000 7f7d70ff9640 1 -- 10.20.193.110:0/2504990978 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4503 (unknown 0 0 1415499592) 0x7f7d60004fd0 con 0x7f7d74093830 2026-02-13T20:11:55.746 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.721+0000 7f7d70ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:11:55.746 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.721+0000 7f7d70ff9640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:11:55.746 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.721+0000 7f7d70ff9640 1 -- 10.20.193.110:0/2504990978 >> v1:10.20.193.110:6790/0 conn(0x7f7d74093830 legacy=0x7f7d7408f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:55.746 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.721+0000 7f7d70ff9640 1 -- 10.20.193.110:0/2504990978 >> v1:10.20.193.110:6790/0 conn(0x7f7d74093830 legacy=0x7f7d7408f650 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:11:55.747 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:11:55.747 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:11:55.747 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:11:55.747 INFO:teuthology.orchestra.run.trial110.stdout: "state": "leader", 2026-02-13T20:11:55.747 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 6, 2026-02-13T20:11:55.747 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 37904, 2026-02-13T20:11:55.747 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:11:55.747 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:11:55.747 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:11:55.747 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:11:55.747 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 0, 2026-02-13T20:11:55.747 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:11:55.747 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:11:55.747 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:11:55.747 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:11:55.747 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:11:55.747 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:11:55.747 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:11:55.747 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:11:55.747 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:11:55.747 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:11:55.747 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:11:55.747 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:11:55.747 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:11:55.747 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:11:55.747 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:11:55.747 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:11:55.747 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:11:55.747 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:11:55.747 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:11:55.747 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:11:55.747 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:11:55.747 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:11:55.747 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:11:55.748 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:11:55.748 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:11:55.748 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:11:55.748 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:11:55.748 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:11:55.748 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:11:55.748 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:11:55.748 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:11:55.748 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:11:55.748 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:11:55.748 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:11:55.748 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:11:55.748 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:11:55.748 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:11:55.748 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:11:55.748 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:11:55.748 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:11:55.748 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:11:55.748 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:11:55.748 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:11:55.748 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:11:55.748 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:11:55.748 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:11:55.748 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:11:55.748 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:11:55.748 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:11:55.748 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:11:55.748 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:11:55.748 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:11:55.748 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:11:55.748 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:11:55.748 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:11:55.748 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:11:55.748 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:11:55.748 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:11:55.748 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:11:55.748 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:11:55.748 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:11:55.748 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:11:55.748 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:11:55.748 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:11:55.748 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:11:55.748 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:11:55.748 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:11:55.749 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:11:55.749 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:11:55.749 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:11:55.749 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:11:55.749 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:11:55.749 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:11:55.749 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:11:55.749 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:11:55.749 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:11:55.749 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:11:55.749 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:11:55.749 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:11:55.749 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:11:55.749 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:11:55.749 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:11:55.749 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:11:55.749 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:11:55.749 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:11:55.749 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:11:55.749 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:11:55.749 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:11:55.749 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:11:55.749 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:11:55.749 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:11:55.749 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:11:55.749 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:11:55.749 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:11:55.749 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:11:55.749 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:11:55.749 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:11:55.749 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:11:55.749 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:11:55.749 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:11:55.749 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:11:55.749 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:11:55.749 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:11:55.749 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:11:55.749 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:11:55.749 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:11:55.749 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:11:55.749 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:11:55.749 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:11:55.749 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:11:55.749 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:11:55.749 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:11:55.750 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:11:55.750 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:11:55.750 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:11:55.750 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:11:55.750 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:11:55.750 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:11:55.750 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:11:55.750 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:11:55.750 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:11:55.750 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:11:55.750 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:11:55.750 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:11:55.750 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:11:55.750 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:11:55.750 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:11:55.750 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:11:55.750 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:11:55.750 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:11:55.750 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:11:55.750 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:11:55.750 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:11:55.750 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:11:55.750 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:11:55.750 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:11:55.750 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:11:55.750 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:11:55.750 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:11:55.750 INFO:teuthology.orchestra.run.trial110.stdout: "num": 3 2026-02-13T20:11:55.750 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:11:55.750 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:11:55.750 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:11:55.750 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:11:55.750 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:11:55.750 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:11:55.750 INFO:teuthology.orchestra.run.trial110.stdout: "num": 3 2026-02-13T20:11:55.750 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:11:55.750 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:11:55.750 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:11:55.750 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:11:55.750 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:11:55.751 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.721+0000 7f7d7a8b8640 1 -- 10.20.193.110:0/2504990978 >> v1:10.20.193.188:6812/1623052694 conn(0x7f7d4403f600 legacy=0x7f7d4405fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:55.751 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.721+0000 7f7d7a8b8640 10 monclient: shutdown 2026-02-13T20:11:55.751 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.721+0000 7f7d7a8b8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:55.751 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.721+0000 7f7d7a8b8640 1 -- 10.20.193.110:0/2504990978 >> v1:10.20.193.110:6790/0 conn(0x7f7d74184b60 legacy=0x7f7d74173650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:55.751 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.721+0000 7f7d78e2e640 1 -- 10.20.193.110:0/2504990978 reap_dead start 2026-02-13T20:11:55.751 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.721+0000 7f7d78e2e640 1 -- 10.20.193.110:0/2504990978 reap_dead start 2026-02-13T20:11:55.751 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.721+0000 7f7d7a8b8640 1 -- 10.20.193.110:0/2504990978 shutdown_connections 2026-02-13T20:11:55.751 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.721+0000 7f7d7a8b8640 1 -- 10.20.193.110:0/2504990978 >> 10.20.193.110:0/2504990978 conn(0x7f7d74054330 msgr2=0x7f7d7408c480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:55.751 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.721+0000 7f7d7a8b8640 1 -- 10.20.193.110:0/2504990978 shutdown_connections 2026-02-13T20:11:55.751 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.721+0000 7f7d7a8b8640 1 -- 10.20.193.110:0/2504990978 wait complete. 2026-02-13T20:11:55.751 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-13T20:11:55.751 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-13T20:11:55.751 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T20:11:55.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.728+0000 7fa5e46cc640 10 start_mon_command cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}] 2026-02-13T20:11:55.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.728+0000 7fa5e46cc640 10 monclient: _send_command 2 [{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}] 2026-02-13T20:11:55.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.728+0000 7fa5e46cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:55.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.728+0000 7fa5e46cc640 1 -- 10.20.193.110:0/3631193930 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true} v 0) -- 0x7fa5dc058410 con 0x7fa5dc1947c0 2026-02-13T20:11:55.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.818+0000 7f23f2caf640 10 monclient: get_monmap_and_config 2026-02-13T20:11:55.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.818+0000 7f23f2caf640 10 monclient: build_initial_monmap 2026-02-13T20:11:55.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.818+0000 7f23f2caf640 10 monclient: monmap: 2026-02-13T20:11:55.819 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:55.819 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:55.819 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:55.818723+0000 2026-02-13T20:11:55.819 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:55.818723+0000 2026-02-13T20:11:55.819 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:55.819 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:55.819 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:55.819 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:11:55.819 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:11:55.819 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:55.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.818+0000 7f23f2caf640 1 Processor -- start 2026-02-13T20:11:55.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.818+0000 7f23f2caf640 1 -- start start 2026-02-13T20:11:55.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.818+0000 7f23f2caf640 10 monclient: init 2026-02-13T20:11:55.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.819+0000 7f23f2caf640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:55.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.819+0000 7f23f2caf640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:11:55.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.819+0000 7f23f2caf640 10 monclient(hunting): picked mon.noname-a con 0x7f23ec1401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:55.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.819+0000 7f23f2caf640 10 monclient(hunting): picked mon.noname-c con 0x7f23ec092020 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:55.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.819+0000 7f23f2caf640 10 monclient(hunting): picked mon.noname-b con 0x7f23ec091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:55.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.819+0000 7f23f2caf640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23ec08b730 con 0x7f23ec1401c0 2026-02-13T20:11:55.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.819+0000 7f23f2caf640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23ec05c5b0 con 0x7f23ec092020 2026-02-13T20:11:55.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.819+0000 7f23f2caf640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23ec08bcf0 con 0x7f23ec091950 2026-02-13T20:11:55.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.819+0000 7f23f2caf640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:55.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.819+0000 7f23f2caf640 10 monclient(hunting): authenticate will time out at 677.509124s 2026-02-13T20:11:55.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.819+0000 7f23f0a24640 1 -- >> v1:10.20.193.110:6789/0 conn(0x7f23ec1401c0 legacy=0x7f23ec091240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:11:55.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.819+0000 7f23f1225640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f23ec091950 0x7f23ec1a2a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:38828/0 (socket says 10.20.193.110:38828) 2026-02-13T20:11:55.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.819+0000 7f23f1225640 1 -- 10.20.193.110:0/90275324 learned_addr learned my addr 10.20.193.110:0/90275324 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:55.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.819+0000 7f23e37fe640 1 -- 10.20.193.110:0/90275324 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1943925246 0 0) 0x7f23ec08bcf0 con 0x7f23ec091950 2026-02-13T20:11:55.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.819+0000 7f23e37fe640 10 monclient(hunting): _negotiate 2026-02-13T20:11:55.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.819+0000 7f23e37fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:55.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.819+0000 7f23e37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:55.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.819+0000 7f23e37fe640 10 monclient(hunting): my global_id is 4469 2026-02-13T20:11:55.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.819+0000 7f23e37fe640 1 -- 10.20.193.110:0/90275324 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23d80035e0 con 0x7f23ec091950 2026-02-13T20:11:55.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.819+0000 7f23e37fe640 1 -- 10.20.193.110:0/90275324 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 817140023 0 0) 0x7f23d80035e0 con 0x7f23ec091950 2026-02-13T20:11:55.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.819+0000 7f23e37fe640 1 -- 10.20.193.110:0/90275324 >> v1:10.20.193.188:6789/0 conn(0x7f23ec092020 legacy=0x7f23ec1812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:55.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.819+0000 7f23e37fe640 1 -- 10.20.193.110:0/90275324 >> v1:10.20.193.110:6789/0 conn(0x7f23ec1401c0 legacy=0x7f23ec091240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:11:55.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.819+0000 7f23e37fe640 10 monclient: _finish_hunting 0 2026-02-13T20:11:55.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.819+0000 7f23e37fe640 1 monclient: found mon.noname-b 2026-02-13T20:11:55.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.819+0000 7f23e37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:55.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.819+0000 7f23e37fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:11:55.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.819+0000 7f23e37fe640 1 -- 10.20.193.110:0/90275324 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23ec140590 con 0x7f23ec091950 2026-02-13T20:11:55.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.819+0000 7f23e37fe640 10 monclient: _finish_auth 0 2026-02-13T20:11:55.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.819+0000 7f23e37fe640 10 monclient: _check_auth_tickets 2026-02-13T20:11:55.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.819+0000 7f23e37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:55.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.819+0000 7f23e37fe640 1 -- 10.20.193.110:0/90275324 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f23e8003eb0 con 0x7f23ec091950 2026-02-13T20:11:55.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.819+0000 7f23e37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:55.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.819+0000 7f23e37fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:11:55.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.819+0000 7f23e37fe640 10 monclient: dump: 2026-02-13T20:11:55.821 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:55.821 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:55.821 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:55.821 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:55.821 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:55.821 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:55.821 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:55.821 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:55.821 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:55.821 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:55.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.819+0000 7f23f2caf640 5 monclient: authenticate success, global_id 4469 2026-02-13T20:11:55.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.819+0000 7f23f2caf640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:11:55.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.819+0000 7f23e37fe640 1 -- 10.20.193.110:0/90275324 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f23e8004080 con 0x7f23ec091950 2026-02-13T20:11:55.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.819+0000 7f23e37fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:55.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.819+0000 7f23e37fe640 1 -- 10.20.193.110:0/90275324 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f23e8004490 con 0x7f23ec091950 2026-02-13T20:11:55.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.819+0000 7f23f2caf640 10 monclient: get_monmap_and_config success 2026-02-13T20:11:55.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.819+0000 7f23e37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:55.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.819+0000 7f23f2caf640 4 set_mon_vals no callback set 2026-02-13T20:11:55.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.819+0000 7f23e37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:55.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.819+0000 7f23e37fe640 10 monclient: dump: 2026-02-13T20:11:55.821 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:55.822 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:55.822 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:55.822 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:55.822 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:55.822 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:55.822 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:55.822 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:55.822 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:55.822 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:55.823 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.820+0000 7f23f2caf640 10 monclient: shutdown 2026-02-13T20:11:55.823 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.820+0000 7f23f2caf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:55.823 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.820+0000 7f23f2caf640 1 -- 10.20.193.110:0/90275324 >> v1:10.20.193.110:6790/0 conn(0x7f23ec091950 legacy=0x7f23ec1a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:55.823 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.820+0000 7f23f2caf640 1 -- 10.20.193.110:0/90275324 shutdown_connections 2026-02-13T20:11:55.823 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.820+0000 7f23f2caf640 1 -- 10.20.193.110:0/90275324 >> 10.20.193.110:0/90275324 conn(0x7f23ec054e90 msgr2=0x7f23ec058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:55.823 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.820+0000 7f23f2caf640 1 -- 10.20.193.110:0/90275324 shutdown_connections 2026-02-13T20:11:55.823 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.820+0000 7f23f2caf640 1 -- 10.20.193.110:0/90275324 wait complete. 2026-02-13T20:11:55.823 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.820+0000 7f23f2caf640 10 monclient: build_initial_monmap 2026-02-13T20:11:55.823 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.820+0000 7f23f2caf640 10 monclient: monmap: 2026-02-13T20:11:55.823 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:11:55.823 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:11:55.823 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:11:55.823 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:11:55.823 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:11:55.823 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:11:55.823 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:11:55.823 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:11:55.823 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:11:55.823 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:55.823 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.820+0000 7f23f2caf640 1 Processor -- start 2026-02-13T20:11:55.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.820+0000 7f23f2caf640 1 -- start start 2026-02-13T20:11:55.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.820+0000 7f23f2caf640 10 monclient: init 2026-02-13T20:11:55.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23f2caf640 10 monclient: _reopen_session rank -1 2026-02-13T20:11:55.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23f2caf640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:11:55.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23f2caf640 10 monclient(hunting): picked mon.noname-c con 0x7f23ec091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:11:55.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23f2caf640 10 monclient(hunting): picked mon.noname-a con 0x7f23ec1401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:11:55.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23f2caf640 10 monclient(hunting): picked mon.noname-b con 0x7f23ec130e30 addr v1:10.20.193.188:6789/0 2026-02-13T20:11:55.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23f2caf640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23ec132630 con 0x7f23ec1401c0 2026-02-13T20:11:55.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23f2caf640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23ec12f720 con 0x7f23ec130e30 2026-02-13T20:11:55.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23f2caf640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23ec08c410 con 0x7f23ec091950 2026-02-13T20:11:55.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23f2caf640 10 monclient(hunting): _renew_subs 2026-02-13T20:11:55.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23f2caf640 10 monclient(hunting): authenticate will time out at 677.511102s 2026-02-13T20:11:55.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23e3fff640 1 -- >> v1:10.20.193.110:6789/0 conn(0x7f23ec1401c0 legacy=0x7f23ec12f010 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:11:55.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23f0a24640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f23ec091950 0x7f23ec12e900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:38840/0 (socket says 10.20.193.110:38840) 2026-02-13T20:11:55.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23f0a24640 1 -- 10.20.193.110:0/3648159193 learned_addr learned my addr 10.20.193.110:0/3648159193 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:11:55.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23e17fa640 1 -- 10.20.193.110:0/3648159193 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 165123599 0 0) 0x7f23ec08c410 con 0x7f23ec091950 2026-02-13T20:11:55.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23e17fa640 10 monclient(hunting): _negotiate 2026-02-13T20:11:55.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23e17fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:55.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23e17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:55.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23e17fa640 10 monclient(hunting): my global_id is 4472 2026-02-13T20:11:55.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23e17fa640 1 -- 10.20.193.110:0/3648159193 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23bc0035e0 con 0x7f23ec091950 2026-02-13T20:11:55.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23e17fa640 1 -- 10.20.193.110:0/3648159193 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 295060921 0 0) 0x7f23bc0035e0 con 0x7f23ec091950 2026-02-13T20:11:55.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23e17fa640 1 -- 10.20.193.110:0/3648159193 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f23ec08c410 con 0x7f23ec091950 2026-02-13T20:11:55.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23e17fa640 1 -- 10.20.193.110:0/3648159193 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f23dc004210 con 0x7f23ec091950 2026-02-13T20:11:55.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23e17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:11:55.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23e17fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:11:55.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23e17fa640 10 monclient(hunting): dump: 2026-02-13T20:11:55.824 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:55.824 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:55.824 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:55.824 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:55.824 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:55.824 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:55.824 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:55.824 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:55.824 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:55.824 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:55.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23e17fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:11:55.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23e17fa640 1 -- 10.20.193.110:0/3648159193 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1347571711 0 0) 0x7f23ec08c410 con 0x7f23ec091950 2026-02-13T20:11:55.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23e17fa640 1 -- 10.20.193.110:0/3648159193 >> v1:10.20.193.188:6789/0 conn(0x7f23ec130e30 legacy=0x7f23ec195170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:55.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23e17fa640 1 -- 10.20.193.110:0/3648159193 >> v1:10.20.193.110:6789/0 conn(0x7f23ec1401c0 legacy=0x7f23ec12f010 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T20:11:55.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23e17fa640 10 monclient: _finish_hunting 0 2026-02-13T20:11:55.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23e17fa640 1 monclient: found mon.c 2026-02-13T20:11:55.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23e17fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:11:55.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23e17fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:55.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23e17fa640 1 -- 10.20.193.110:0/3648159193 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23ec05d320 con 0x7f23ec091950 2026-02-13T20:11:55.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23e17fa640 10 monclient: _finish_auth 0 2026-02-13T20:11:55.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23e17fa640 10 monclient: _check_auth_tickets 2026-02-13T20:11:55.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23e17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:11:55.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23f2caf640 5 monclient: authenticate success, global_id 4472 2026-02-13T20:11:55.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23f2caf640 10 monclient: _renew_subs 2026-02-13T20:11:55.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23f2caf640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:55.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23f2caf640 1 -- 10.20.193.110:0/3648159193 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f23ec1317c0 con 0x7f23ec091950 2026-02-13T20:11:55.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23f2caf640 10 monclient: _renew_subs 2026-02-13T20:11:55.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23f2caf640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:11:55.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23f2caf640 1 -- 10.20.193.110:0/3648159193 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f23ec13ef40 con 0x7f23ec091950 2026-02-13T20:11:55.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23e17fa640 1 -- 10.20.193.110:0/3648159193 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f23dc0044d0 con 0x7f23ec091950 2026-02-13T20:11:55.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23e17fa640 10 monclient: handle_config config(0 keys) 2026-02-13T20:11:55.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23e17fa640 1 -- 10.20.193.110:0/3648159193 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f23dc0048b0 con 0x7f23ec091950 2026-02-13T20:11:55.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23e17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:55.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23e17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:11:55.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23e17fa640 10 monclient: dump: 2026-02-13T20:11:55.825 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:55.825 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:55.825 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:55.825 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:55.825 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:55.825 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:55.825 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:55.825 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:55.825 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:55.825 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:55.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23e2ffd640 4 set_mon_vals no callback set 2026-02-13T20:11:55.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.821+0000 7f23f2caf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:55.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.822+0000 7f23f2caf640 1 -- 10.20.193.110:0/3648159193 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f23ec131230 con 0x7f23ec092020 2026-02-13T20:11:55.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.822+0000 7f23e17fa640 1 -- 10.20.193.110:0/3648159193 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f23dc004a10 con 0x7f23ec091950 2026-02-13T20:11:55.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.822+0000 7f23e17fa640 1 -- 10.20.193.110:0/3648159193 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(21..21 src has 1..21) ==== 3858+0+0 (unknown 4102285502 0 0) 0x7f23dc04e900 con 0x7f23ec091950 2026-02-13T20:11:55.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.822+0000 7f23e17fa640 1 -- 10.20.193.110:0/3648159193 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 814491090 0 0) 0x7f23ec05c5b0 con 0x7f23ec092020 2026-02-13T20:11:55.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.822+0000 7f23e17fa640 10 monclient(hunting): _negotiate 2026-02-13T20:11:55.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.822+0000 7f23e17fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:55.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.822+0000 7f23e17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:55.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.822+0000 7f23e17fa640 10 monclient(hunting): my global_id is 4438 2026-02-13T20:11:55.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.822+0000 7f23e17fa640 1 -- 10.20.193.110:0/3648159193 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23ec08c410 con 0x7f23ec092020 2026-02-13T20:11:55.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.822+0000 7f23f1225640 10 monclient: get_auth_request con 0x7f23bc03f610 auth_method 0 2026-02-13T20:11:55.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.822+0000 7f23e17fa640 1 -- 10.20.193.110:0/3648159193 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2908086638 0 0) 0x7f23ec08c410 con 0x7f23ec092020 2026-02-13T20:11:55.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.822+0000 7f23e17fa640 1 -- 10.20.193.110:0/3648159193 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f23ec05c5b0 con 0x7f23ec092020 2026-02-13T20:11:55.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.822+0000 7f23e17fa640 1 -- 10.20.193.110:0/3648159193 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f23d4004020 con 0x7f23ec092020 2026-02-13T20:11:55.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.822+0000 7f23e17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:55.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.822+0000 7f23e17fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:11:55.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.822+0000 7f23e17fa640 10 monclient: dump: 2026-02-13T20:11:55.826 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:55.826 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:55.826 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:55.826 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:55.826 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:55.826 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:55.826 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:55.826 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:55.826 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:55.826 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:55.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.822+0000 7f23e17fa640 1 -- 10.20.193.110:0/3648159193 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 563664926 0 0) 0x7f23ec05c5b0 con 0x7f23ec092020 2026-02-13T20:11:55.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.822+0000 7f23e17fa640 1 -- 10.20.193.110:0/3648159193 --> v1:10.20.193.188:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f23ec08b450 con 0x7f23ec092020 2026-02-13T20:11:55.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.823+0000 7f23e17fa640 1 -- 10.20.193.110:0/3648159193 <== mon.1 v1:10.20.193.188:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f23d40044a0 con 0x7f23ec092020 2026-02-13T20:11:55.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.823+0000 7f23e17fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:11:55.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.823+0000 7f23e17fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:11:55.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.823+0000 7f23e17fa640 1 -- 10.20.193.110:0/3648159193 >> v1:10.20.193.188:6789/0 conn(0x7f23ec092020 legacy=0x7f23ec08ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:55.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.823+0000 7f23e17fa640 1 -- 10.20.193.110:0/3648159193 >> v1:10.20.193.188:6789/0 conn(0x7f23ec092020 legacy=0x7f23ec08ef00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:11:55.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.826+0000 7f23f2caf640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:11:55.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.826+0000 7f23f2caf640 1 -- 10.20.193.110:0/3648159193 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f23ec08d090 con 0x7f23ec04d1c0 2026-02-13T20:11:55.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.827+0000 7f23e17fa640 1 -- 10.20.193.110:0/3648159193 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 444711983 0 0) 0x7f23ec08d090 con 0x7f23ec04d1c0 2026-02-13T20:11:55.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.827+0000 7f23e17fa640 10 monclient(hunting): _negotiate 2026-02-13T20:11:55.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.827+0000 7f23e17fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:11:55.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.827+0000 7f23e17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:11:55.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.827+0000 7f23e17fa640 10 monclient(hunting): my global_id is 4441 2026-02-13T20:11:55.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.827+0000 7f23e17fa640 1 -- 10.20.193.110:0/3648159193 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23ec05c5b0 con 0x7f23ec04d1c0 2026-02-13T20:11:55.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.827+0000 7f23e17fa640 1 -- 10.20.193.110:0/3648159193 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 730710579 0 0) 0x7f23ec05c5b0 con 0x7f23ec04d1c0 2026-02-13T20:11:55.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.827+0000 7f23e17fa640 1 -- 10.20.193.110:0/3648159193 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f23ec08d090 con 0x7f23ec04d1c0 2026-02-13T20:11:55.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.827+0000 7f23e17fa640 1 -- 10.20.193.110:0/3648159193 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f23d40030b0 con 0x7f23ec04d1c0 2026-02-13T20:11:55.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.827+0000 7f23e17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:11:55.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.827+0000 7f23e17fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:11:55.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.827+0000 7f23e17fa640 10 monclient: dump: 2026-02-13T20:11:55.828 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:11:55.828 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:11:55.828 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:55.828 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:11:55.828 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:11:55.828 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:11:55.828 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:11:55.828 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:11:55.828 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:11:55.828 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:11:55.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.827+0000 7f23e17fa640 1 -- 10.20.193.110:0/3648159193 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2964641907 0 0) 0x7f23ec08d090 con 0x7f23ec04d1c0 2026-02-13T20:11:55.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.827+0000 7f23e17fa640 1 -- 10.20.193.110:0/3648159193 --> v1:10.20.193.188:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f23ec055bb0 con 0x7f23ec04d1c0 2026-02-13T20:11:55.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.827+0000 7f23e17fa640 1 -- 10.20.193.110:0/3648159193 <== mon.1 v1:10.20.193.188:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4668 (unknown 0 0 572277574) 0x7f23d4005880 con 0x7f23ec04d1c0 2026-02-13T20:11:55.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.827+0000 7f23e17fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:11:55.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.827+0000 7f23e17fa640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:11:55.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.827+0000 7f23e17fa640 1 -- 10.20.193.110:0/3648159193 >> v1:10.20.193.188:6789/0 conn(0x7f23ec04d1c0 legacy=0x7f23ec1978a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:55.829 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.827+0000 7f23e17fa640 1 -- 10.20.193.110:0/3648159193 >> v1:10.20.193.188:6789/0 conn(0x7f23ec04d1c0 legacy=0x7f23ec1978a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:11:55.829 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:11:55.829 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:11:55.829 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:11:55.829 INFO:teuthology.orchestra.run.trial110.stdout: "state": "peon", 2026-02-13T20:11:55.829 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 6, 2026-02-13T20:11:55.829 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 37973, 2026-02-13T20:11:55.829 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:11:55.829 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:11:55.829 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:11:55.829 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:11:55.829 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 0, 2026-02-13T20:11:55.829 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:11:55.829 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:11:55.829 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:11:55.829 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:11:55.829 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:11:55.829 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:11:55.829 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:11:55.829 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:11:55.829 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:11:55.829 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:11:55.829 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:11:55.829 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:11:55.829 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:11:55.829 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:11:55.829 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:11:55.829 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:11:55.829 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:11:55.829 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:11:55.829 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:11:55.829 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:11:55.829 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:11:55.829 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:11:55.829 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:11:55.829 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:11:55.829 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:11:55.829 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:11:55.830 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:11:55.830 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:11:55.830 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:11:55.830 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:11:55.830 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:11:55.830 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:11:55.830 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:11:55.830 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:11:55.830 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:11:55.830 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:11:55.830 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:11:55.830 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:11:55.830 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:11:55.830 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:11:55.830 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:11:55.830 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:11:55.830 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:11:55.830 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:11:55.830 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:11:55.830 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:11:55.830 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:11:55.830 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:11:55.830 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:11:55.830 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:11:55.830 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:11:55.830 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:11:55.830 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:11:55.830 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:11:55.830 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:11:55.830 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:11:55.830 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:11:55.830 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:11:55.830 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:11:55.830 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:11:55.830 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:11:55.830 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:11:55.830 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:11:55.830 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:11:55.830 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:11:55.830 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:11:55.830 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:11:55.830 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:11:55.830 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:11:55.830 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:11:55.830 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:11:55.831 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:11:55.831 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:11:55.831 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:11:55.831 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:11:55.831 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:11:55.831 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:11:55.831 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:11:55.831 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:11:55.831 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:11:55.831 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:11:55.831 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:11:55.831 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:11:55.831 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:11:55.831 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:11:55.831 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:11:55.831 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:11:55.831 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:11:55.831 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:11:55.831 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:11:55.831 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:11:55.831 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:11:55.831 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:11:55.831 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:11:55.831 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:11:55.831 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:11:55.831 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:11:55.831 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:11:55.831 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:11:55.831 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:11:55.831 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:11:55.831 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:11:55.831 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:11:55.831 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:11:55.831 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:11:55.831 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:11:55.831 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:11:55.831 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:11:55.831 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:11:55.831 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:11:55.831 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:11:55.831 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:11:55.831 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:11:55.831 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:11:55.831 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:11:55.831 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:11:55.831 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:11:55.832 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:11:55.832 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:11:55.832 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:11:55.832 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:11:55.832 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:11:55.832 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:11:55.832 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:11:55.832 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:11:55.832 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:11:55.832 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:11:55.832 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:11:55.832 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:11:55.832 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:11:55.832 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:11:55.832 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:11:55.832 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:11:55.832 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:11:55.832 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:11:55.832 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:11:55.832 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:11:55.832 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:11:55.832 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:11:55.832 INFO:teuthology.orchestra.run.trial110.stdout: "num": 3 2026-02-13T20:11:55.832 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:11:55.832 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:11:55.832 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:11:55.832 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:11:55.832 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:11:55.832 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:11:55.832 INFO:teuthology.orchestra.run.trial110.stdout: "num": 5 2026-02-13T20:11:55.832 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:11:55.832 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:11:55.832 INFO:teuthology.orchestra.run.trial110.stdout: "mgr": [ 2026-02-13T20:11:55.832 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:11:55.832 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:11:55.832 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:11:55.832 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:11:55.832 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:11:55.832 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:11:55.832 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:11:55.832 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:11:55.832 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:11:55.833 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.828+0000 7f23f2caf640 1 -- 10.20.193.110:0/3648159193 >> v1:10.20.193.188:6812/1623052694 conn(0x7f23bc03f610 legacy=0x7f23bc05fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:55.833 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.828+0000 7f23f2caf640 10 monclient: shutdown 2026-02-13T20:11:55.833 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.828+0000 7f23f2caf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:55.833 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.828+0000 7f23f1225640 1 -- 10.20.193.110:0/3648159193 reap_dead start 2026-02-13T20:11:55.833 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.828+0000 7f23f2caf640 1 -- 10.20.193.110:0/3648159193 >> v1:10.20.193.110:6790/0 conn(0x7f23ec091950 legacy=0x7f23ec12e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:55.833 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.828+0000 7f23f2caf640 1 -- 10.20.193.110:0/3648159193 shutdown_connections 2026-02-13T20:11:55.833 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.828+0000 7f23f2caf640 1 -- 10.20.193.110:0/3648159193 >> 10.20.193.110:0/3648159193 conn(0x7f23ec054e90 msgr2=0x7f23ec088e30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:55.833 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.828+0000 7f23f2caf640 1 -- 10.20.193.110:0/3648159193 shutdown_connections 2026-02-13T20:11:55.833 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:55.828+0000 7f23f2caf640 1 -- 10.20.193.110:0/3648159193 wait complete. 2026-02-13T20:11:55.833 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-13T20:11:55.834 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-13T20:11:56.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:56.540+0000 7fa5c2ffd640 1 -- 10.20.193.110:0/3631193930 <== mon.2 v1:10.20.193.110:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]=0 enabled application 'rados' on pool 'unique_pool_0' v22) ==== 197+0+0 (unknown 392332727 0 0) 0x7fa5d8017830 con 0x7fa5dc1947c0 2026-02-13T20:11:56.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:56.540+0000 7fa5c2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}] 2026-02-13T20:11:56.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:56.540+0000 7fa5c2ffd640 10 monclient: _finish_command 2 = system:0 enabled application 'rados' on pool 'unique_pool_0' 2026-02-13T20:11:56.542 INFO:teuthology.orchestra.run.trial110.stderr:enabled application 'rados' on pool 'unique_pool_0' 2026-02-13T20:11:56.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:56.544+0000 7fa5e46cc640 1 -- 10.20.193.110:0/3631193930 >> v1:10.20.193.188:6812/1623052694 conn(0x7fa5ac03f5f0 legacy=0x7fa5ac05faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:56.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:56.544+0000 7fa5e46cc640 10 monclient: shutdown 2026-02-13T20:11:56.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:56.544+0000 7fa5e46cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:11:56.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:56.544+0000 7fa5e46cc640 1 -- 10.20.193.110:0/3631193930 >> v1:10.20.193.110:6790/0 conn(0x7fa5dc1947c0 legacy=0x7fa5dc194c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:11:56.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:56.544+0000 7fa5e46cc640 1 -- 10.20.193.110:0/3631193930 shutdown_connections 2026-02-13T20:11:56.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:56.544+0000 7fa5e46cc640 1 -- 10.20.193.110:0/3631193930 >> 10.20.193.110:0/3631193930 conn(0x7fa5dc054e90 msgr2=0x7fa5dc08eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:11:56.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:56.544+0000 7fa5e46cc640 1 -- 10.20.193.110:0/3631193930 shutdown_connections 2026-02-13T20:11:56.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:11:56.544+0000 7fa5e46cc640 1 -- 10.20.193.110:0/3631193930 wait complete. 2026-02-13T20:11:57.555 DEBUG:teuthology.orchestra.run.trial188:> CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph_test_rados --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 50 --op delete 50 --op snap_create 50 --op snap_remove 50 --op rollback 50 --op copy_from 50 --op write_excl 50 --pool unique_pool_0 2026-02-13T20:11:57.596 INFO:tasks.rados.rados.0.trial188.stdout:adding op weight read -> 100 2026-02-13T20:11:57.596 INFO:tasks.rados.rados.0.trial188.stdout:adding op weight write -> 50 2026-02-13T20:11:57.596 INFO:tasks.rados.rados.0.trial188.stdout:adding op weight delete -> 50 2026-02-13T20:11:57.596 INFO:tasks.rados.rados.0.trial188.stdout:adding op weight snap_create -> 50 2026-02-13T20:11:57.596 INFO:tasks.rados.rados.0.trial188.stdout:adding op weight snap_remove -> 50 2026-02-13T20:11:57.596 INFO:tasks.rados.rados.0.trial188.stdout:adding op weight rollback -> 50 2026-02-13T20:11:57.596 INFO:tasks.rados.rados.0.trial188.stdout:adding op weight copy_from -> 50 2026-02-13T20:11:57.596 INFO:tasks.rados.rados.0.trial188.stdout:adding op weight write_excl -> 50 2026-02-13T20:11:57.596 INFO:tasks.rados.rados.0.trial188.stdout:ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - RelWithDebInfo) 2026-02-13T20:11:57.596 INFO:tasks.rados.rados.0.trial188.stdout:Configuration: 2026-02-13T20:11:57.596 INFO:tasks.rados.rados.0.trial188.stdout: Number of operations: 4000 2026-02-13T20:11:57.596 INFO:tasks.rados.rados.0.trial188.stdout: Number of objects: 50 2026-02-13T20:11:57.596 INFO:tasks.rados.rados.0.trial188.stdout: Max in flight operations: 16 2026-02-13T20:11:57.596 INFO:tasks.rados.rados.0.trial188.stdout: Object size (in bytes): 4000000 2026-02-13T20:11:57.596 INFO:tasks.rados.rados.0.trial188.stdout: Write stride min: 400000 2026-02-13T20:11:57.596 INFO:tasks.rados.rados.0.trial188.stdout: Write stride max: 800000 2026-02-13T20:11:58.549 INFO:tasks.rados.rados.0.trial188.stdout:1: write initial oid 1 2026-02-13T20:11:58.549 INFO:tasks.rados.rados.0.trial188.stdout:1: seq_num 0 ranges {416807=475249,1542129=474678} 2026-02-13T20:11:58.552 INFO:tasks.rados.rados.0.trial188.stdout:1: writing trial18843701-1 from 416807 to 892056 tid 1 2026-02-13T20:11:58.556 INFO:tasks.rados.rados.0.trial188.stdout:1: writing trial18843701-1 from 1542129 to 2016807 tid 2 2026-02-13T20:11:58.557 INFO:tasks.rados.rados.0.trial188.stdout:2: write initial oid 2 2026-02-13T20:11:58.557 INFO:tasks.rados.rados.0.trial188.stdout:2: seq_num 1 ranges {416807=475249,1542129=474678} 2026-02-13T20:11:58.560 INFO:tasks.rados.rados.0.trial188.stdout:2: writing trial18843701-2 from 416807 to 892056 tid 1 2026-02-13T20:11:58.565 INFO:tasks.rados.rados.0.trial188.stdout:2: writing trial18843701-2 from 1542129 to 2016807 tid 2 2026-02-13T20:11:58.565 INFO:tasks.rados.rados.0.trial188.stdout:3: write initial oid 3 2026-02-13T20:11:58.565 INFO:tasks.rados.rados.0.trial188.stdout:3: seq_num 2 ranges {433614=550498,1600611=433003} 2026-02-13T20:11:58.568 INFO:tasks.rados.rados.0.trial188.stdout:3: writing trial18843701-3 from 433614 to 984112 tid 1 2026-02-13T20:11:58.572 INFO:tasks.rados.rados.0.trial188.stdout:3: writing trial18843701-3 from 1600611 to 2033614 tid 2 2026-02-13T20:11:58.572 INFO:tasks.rados.rados.0.trial188.stdout:4: write initial oid 4 2026-02-13T20:11:58.572 INFO:tasks.rados.rados.0.trial188.stdout:4: seq_num 3 ranges {450421=625747,1659093=391328} 2026-02-13T20:11:58.576 INFO:tasks.rados.rados.0.trial188.stdout:4: writing trial18843701-4 from 450421 to 1076168 tid 1 2026-02-13T20:11:58.580 INFO:tasks.rados.rados.0.trial188.stdout:4: writing trial18843701-4 from 1659093 to 2050421 tid 2 2026-02-13T20:11:58.580 INFO:tasks.rados.rados.0.trial188.stdout:5: write initial oid 5 2026-02-13T20:11:58.580 INFO:tasks.rados.rados.0.trial188.stdout:5: seq_num 4 ranges {467228=700996,1717575=349653} 2026-02-13T20:11:58.584 INFO:tasks.rados.rados.0.trial188.stdout:5: writing trial18843701-5 from 467228 to 1168224 tid 1 2026-02-13T20:11:58.588 INFO:tasks.rados.rados.0.trial188.stdout:5: writing trial18843701-5 from 1717575 to 2067228 tid 2 2026-02-13T20:11:58.588 INFO:tasks.rados.rados.0.trial188.stdout:6: write initial oid 6 2026-02-13T20:11:58.588 INFO:tasks.rados.rados.0.trial188.stdout:6: seq_num 5 ranges {484035=776245,2059704=24331} 2026-02-13T20:11:58.593 INFO:tasks.rados.rados.0.trial188.stdout:6: writing trial18843701-6 from 484035 to 1260280 tid 1 2026-02-13T20:11:58.596 INFO:tasks.rados.rados.0.trial188.stdout:6: writing trial18843701-6 from 2059704 to 2084035 tid 2 2026-02-13T20:11:58.596 INFO:tasks.rados.rados.0.trial188.stdout:7: write initial oid 7 2026-02-13T20:11:58.596 INFO:tasks.rados.rados.0.trial188.stdout:7: seq_num 6 ranges {500842=451494,1718186=382656} 2026-02-13T20:11:58.599 INFO:tasks.rados.rados.0.trial188.stdout:7: writing trial18843701-7 from 500842 to 952336 tid 1 2026-02-13T20:11:58.604 INFO:tasks.rados.rados.0.trial188.stdout:7: writing trial18843701-7 from 1718186 to 2100842 tid 2 2026-02-13T20:11:58.604 INFO:tasks.rados.rados.0.trial188.stdout:8: write initial oid 8 2026-02-13T20:11:58.604 INFO:tasks.rados.rados.0.trial188.stdout:8: seq_num 7 ranges {517649=526743,1776668=340981} 2026-02-13T20:11:58.608 INFO:tasks.rados.rados.0.trial188.stdout:8: writing trial18843701-8 from 517649 to 1044392 tid 1 2026-02-13T20:11:58.612 INFO:tasks.rados.rados.0.trial188.stdout:8: writing trial18843701-8 from 1776668 to 2117649 tid 2 2026-02-13T20:11:58.612 INFO:tasks.rados.rados.0.trial188.stdout:9: write initial oid 9 2026-02-13T20:11:58.612 INFO:tasks.rados.rados.0.trial188.stdout:9: seq_num 8 ranges {534456=718345,1951503=182953} 2026-02-13T20:11:58.616 INFO:tasks.rados.rados.0.trial188.stdout:9: writing trial18843701-9 from 534456 to 1252801 tid 1 2026-02-13T20:11:58.620 INFO:tasks.rados.rados.0.trial188.stdout:9: writing trial18843701-9 from 1951503 to 2134456 tid 2 2026-02-13T20:11:58.620 INFO:tasks.rados.rados.0.trial188.stdout:10: write initial oid 10 2026-02-13T20:11:58.621 INFO:tasks.rados.rados.0.trial188.stdout:1: finishing write tid 1 to trial18843701-1 2026-02-13T20:11:58.621 INFO:tasks.rados.rados.0.trial188.stdout:1: finishing write tid 2 to trial18843701-1 2026-02-13T20:11:58.621 INFO:tasks.rados.rados.0.trial188.stdout:1: finishing write tid 3 to trial18843701-1 2026-02-13T20:11:58.621 INFO:tasks.rados.rados.0.trial188.stdout:2: finishing write tid 1 to trial18843701-2 2026-02-13T20:11:58.621 INFO:tasks.rados.rados.0.trial188.stdout:1: finishing write tid 4 to trial18843701-1 2026-02-13T20:11:58.621 INFO:tasks.rados.rados.0.trial188.stdout:1: oid 1 updating version 0 to 1 2026-02-13T20:11:58.621 INFO:tasks.rados.rados.0.trial188.stdout:1: oid 1 updating version 1 to 3 2026-02-13T20:11:58.621 INFO:tasks.rados.rados.0.trial188.stdout:1: oid 1 version 3 is already newer than 2 2026-02-13T20:11:58.621 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 1 v 3 (ObjNum 0 snap 0 seq_num 0) dirty exists 2026-02-13T20:11:58.621 INFO:tasks.rados.rados.0.trial188.stdout:1: left oid 1 (ObjNum 0 snap 0 seq_num 0) 2026-02-13T20:11:58.621 INFO:tasks.rados.rados.0.trial188.stdout:3: finishing write tid 1 to trial18843701-3 2026-02-13T20:11:58.622 INFO:tasks.rados.rados.0.trial188.stdout:10: seq_num 9 ranges {551263=793594,1893632=257631} 2026-02-13T20:11:58.625 INFO:tasks.rados.rados.0.trial188.stdout:10: writing trial18843701-10 from 551263 to 1344857 tid 1 2026-02-13T20:11:58.628 INFO:tasks.rados.rados.0.trial188.stdout:10: writing trial18843701-10 from 1893632 to 2151263 tid 2 2026-02-13T20:11:58.628 INFO:tasks.rados.rados.0.trial188.stdout:1: done (9 left) 2026-02-13T20:11:58.628 INFO:tasks.rados.rados.0.trial188.stdout:11: write initial oid 11 2026-02-13T20:11:58.628 INFO:tasks.rados.rados.0.trial188.stdout:11: seq_num 10 ranges {568070=468843,1552114=615956} 2026-02-13T20:11:58.632 INFO:tasks.rados.rados.0.trial188.stdout:11: writing trial18843701-11 from 568070 to 1036913 tid 1 2026-02-13T20:11:58.636 INFO:tasks.rados.rados.0.trial188.stdout:11: writing trial18843701-11 from 1552114 to 2168070 tid 2 2026-02-13T20:11:58.636 INFO:tasks.rados.rados.0.trial188.stdout:12: write initial oid 12 2026-02-13T20:11:58.636 INFO:tasks.rados.rados.0.trial188.stdout:12: seq_num 11 ranges {584877=544092,1610596=562003} 2026-02-13T20:11:58.640 INFO:tasks.rados.rados.0.trial188.stdout:12: writing trial18843701-12 from 584877 to 1128969 tid 1 2026-02-13T20:11:58.644 INFO:tasks.rados.rados.0.trial188.stdout:12: writing trial18843701-12 from 1610596 to 2172599 tid 2 2026-02-13T20:11:58.644 INFO:tasks.rados.rados.0.trial188.stdout:13: write initial oid 13 2026-02-13T20:11:58.645 INFO:tasks.rados.rados.0.trial188.stdout:13: seq_num 12 ranges {601684=619341,1669078=532606} 2026-02-13T20:11:58.649 INFO:tasks.rados.rados.0.trial188.stdout:13: writing trial18843701-13 from 601684 to 1221025 tid 1 2026-02-13T20:11:58.653 INFO:tasks.rados.rados.0.trial188.stdout:13: writing trial18843701-13 from 1669078 to 2201684 tid 2 2026-02-13T20:11:58.653 INFO:tasks.rados.rados.0.trial188.stdout:14: write initial oid 14 2026-02-13T20:11:58.653 INFO:tasks.rados.rados.0.trial188.stdout:14: seq_num 13 ranges {618491=694590,2011207=207284} 2026-02-13T20:11:58.658 INFO:tasks.rados.rados.0.trial188.stdout:14: writing trial18843701-14 from 618491 to 1313081 tid 1 2026-02-13T20:11:58.661 INFO:tasks.rados.rados.0.trial188.stdout:14: writing trial18843701-14 from 2011207 to 2218491 tid 2 2026-02-13T20:11:58.661 INFO:tasks.rados.rados.0.trial188.stdout:15: write initial oid 15 2026-02-13T20:11:58.661 INFO:tasks.rados.rados.0.trial188.stdout:15: seq_num 14 ranges {635298=769839,2069689=165609} 2026-02-13T20:11:58.666 INFO:tasks.rados.rados.0.trial188.stdout:15: writing trial18843701-15 from 635298 to 1405137 tid 1 2026-02-13T20:11:58.670 INFO:tasks.rados.rados.0.trial188.stdout:15: writing trial18843701-15 from 2069689 to 2235298 tid 2 2026-02-13T20:11:58.670 INFO:tasks.rados.rados.0.trial188.stdout:16: write initial oid 16 2026-02-13T20:11:58.670 INFO:tasks.rados.rados.0.trial188.stdout:16: seq_num 15 ranges {652105=445088,1728171=452988} 2026-02-13T20:11:58.674 INFO:tasks.rados.rados.0.trial188.stdout:16: writing trial18843701-16 from 652105 to 1097193 tid 1 2026-02-13T20:11:58.678 INFO:tasks.rados.rados.0.trial188.stdout:16: writing trial18843701-16 from 1728171 to 2181159 tid 2 2026-02-13T20:11:58.678 INFO:tasks.rados.rados.0.trial188.stdout:17: write initial oid 17 2026-02-13T20:11:58.678 INFO:tasks.rados.rados.0.trial188.stdout:17: seq_num 16 ranges {668912=636690,1903006=365906} 2026-02-13T20:11:58.683 INFO:tasks.rados.rados.0.trial188.stdout:17: writing trial18843701-17 from 668912 to 1305602 tid 1 2026-02-13T20:11:58.687 INFO:tasks.rados.rados.0.trial188.stdout:17: writing trial18843701-17 from 1903006 to 2268912 tid 2 2026-02-13T20:11:58.687 INFO:tasks.rados.rados.0.trial188.stdout: waiting on 16 2026-02-13T20:11:58.687 INFO:tasks.rados.rados.0.trial188.stdout:3: finishing write tid 2 to trial18843701-3 2026-02-13T20:11:58.687 INFO:tasks.rados.rados.0.trial188.stdout:3: finishing write tid 3 to trial18843701-3 2026-02-13T20:11:58.687 INFO:tasks.rados.rados.0.trial188.stdout:3: finishing write tid 4 to trial18843701-3 2026-02-13T20:11:58.687 INFO:tasks.rados.rados.0.trial188.stdout:3: oid 3 updating version 0 to 1 2026-02-13T20:11:58.688 INFO:tasks.rados.rados.0.trial188.stdout:3: oid 3 updating version 1 to 2 2026-02-13T20:11:58.688 INFO:tasks.rados.rados.0.trial188.stdout:3: oid 3 updating version 2 to 3 2026-02-13T20:11:58.688 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 3 v 3 (ObjNum 2 snap 0 seq_num 2) dirty exists 2026-02-13T20:11:58.688 INFO:tasks.rados.rados.0.trial188.stdout:3: left oid 3 (ObjNum 2 snap 0 seq_num 2) 2026-02-13T20:11:58.688 INFO:tasks.rados.rados.0.trial188.stdout:4: finishing write tid 1 to trial18843701-4 2026-02-13T20:11:58.688 INFO:tasks.rados.rados.0.trial188.stdout:4: finishing write tid 2 to trial18843701-4 2026-02-13T20:11:58.688 INFO:tasks.rados.rados.0.trial188.stdout:3: done (15 left) 2026-02-13T20:11:58.688 INFO:tasks.rados.rados.0.trial188.stdout:18: write initial oid 18 2026-02-13T20:11:58.688 INFO:tasks.rados.rados.0.trial188.stdout:18: seq_num 17 ranges {685719=711939,1845135=440584} 2026-02-13T20:11:58.692 INFO:tasks.rados.rados.0.trial188.stdout:18: writing trial18843701-18 from 685719 to 1397658 tid 1 2026-02-13T20:11:58.696 INFO:tasks.rados.rados.0.trial188.stdout:18: writing trial18843701-18 from 1845135 to 2285719 tid 2 2026-02-13T20:11:58.696 INFO:tasks.rados.rados.0.trial188.stdout: waiting on 16 2026-02-13T20:11:58.696 INFO:tasks.rados.rados.0.trial188.stdout:4: finishing write tid 3 to trial18843701-4 2026-02-13T20:11:58.697 INFO:tasks.rados.rados.0.trial188.stdout:4: finishing write tid 4 to trial18843701-4 2026-02-13T20:11:58.697 INFO:tasks.rados.rados.0.trial188.stdout:4: oid 4 updating version 0 to 2 2026-02-13T20:11:58.697 INFO:tasks.rados.rados.0.trial188.stdout:4: oid 4 version 2 is already newer than 1 2026-02-13T20:11:58.697 INFO:tasks.rados.rados.0.trial188.stdout:4: oid 4 updating version 2 to 3 2026-02-13T20:11:58.697 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 4 v 3 (ObjNum 3 snap 0 seq_num 3) dirty exists 2026-02-13T20:11:58.697 INFO:tasks.rados.rados.0.trial188.stdout:4: left oid 4 (ObjNum 3 snap 0 seq_num 3) 2026-02-13T20:11:58.697 INFO:tasks.rados.rados.0.trial188.stdout:2: finishing write tid 2 to trial18843701-2 2026-02-13T20:11:58.697 INFO:tasks.rados.rados.0.trial188.stdout:2: finishing write tid 3 to trial18843701-2 2026-02-13T20:11:58.697 INFO:tasks.rados.rados.0.trial188.stdout:2: finishing write tid 4 to trial18843701-2 2026-02-13T20:11:58.697 INFO:tasks.rados.rados.0.trial188.stdout:2: oid 2 updating version 0 to 4 2026-02-13T20:11:58.697 INFO:tasks.rados.rados.0.trial188.stdout:2: oid 2 updating version 4 to 6 2026-02-13T20:11:58.697 INFO:tasks.rados.rados.0.trial188.stdout:2: oid 2 version 6 is already newer than 5 2026-02-13T20:11:58.698 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 2 v 6 (ObjNum 1 snap 0 seq_num 1) dirty exists 2026-02-13T20:11:58.698 INFO:tasks.rados.rados.0.trial188.stdout:2: left oid 2 (ObjNum 1 snap 0 seq_num 1) 2026-02-13T20:11:58.698 INFO:tasks.rados.rados.0.trial188.stdout:5: finishing write tid 1 to trial18843701-5 2026-02-13T20:11:58.698 INFO:tasks.rados.rados.0.trial188.stdout:5: finishing write tid 2 to trial18843701-5 2026-02-13T20:11:58.698 INFO:tasks.rados.rados.0.trial188.stdout:5: finishing write tid 3 to trial18843701-5 2026-02-13T20:11:58.698 INFO:tasks.rados.rados.0.trial188.stdout:5: finishing write tid 4 to trial18843701-5 2026-02-13T20:11:58.698 INFO:tasks.rados.rados.0.trial188.stdout:5: oid 5 updating version 0 to 7 2026-02-13T20:11:58.698 INFO:tasks.rados.rados.0.trial188.stdout:5: oid 5 updating version 7 to 9 2026-02-13T20:11:58.698 INFO:tasks.rados.rados.0.trial188.stdout:5: oid 5 version 9 is already newer than 8 2026-02-13T20:11:58.698 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 5 v 9 (ObjNum 4 snap 0 seq_num 4) dirty exists 2026-02-13T20:11:58.698 INFO:tasks.rados.rados.0.trial188.stdout:5: left oid 5 (ObjNum 4 snap 0 seq_num 4) 2026-02-13T20:11:58.698 INFO:tasks.rados.rados.0.trial188.stdout:7: finishing write tid 1 to trial18843701-7 2026-02-13T20:11:58.698 INFO:tasks.rados.rados.0.trial188.stdout:6: finishing write tid 1 to trial18843701-6 2026-02-13T20:11:58.699 INFO:tasks.rados.rados.0.trial188.stdout:6: finishing write tid 2 to trial18843701-6 2026-02-13T20:11:58.699 INFO:tasks.rados.rados.0.trial188.stdout:2: done (15 left) 2026-02-13T20:11:58.699 INFO:tasks.rados.rados.0.trial188.stdout:4: done (14 left) 2026-02-13T20:11:58.699 INFO:tasks.rados.rados.0.trial188.stdout:5: done (13 left) 2026-02-13T20:11:58.699 INFO:tasks.rados.rados.0.trial188.stdout:19: write initial oid 19 2026-02-13T20:11:58.699 INFO:tasks.rados.rados.0.trial188.stdout:19: seq_num 18 ranges {702526=787188,1903617=398909} 2026-02-13T20:11:58.701 INFO:tasks.rados.rados.0.trial188.stdout:19: writing trial18843701-19 from 702526 to 1489714 tid 1 2026-02-13T20:11:58.704 INFO:tasks.rados.rados.0.trial188.stdout:19: writing trial18843701-19 from 1903617 to 2302526 tid 2 2026-02-13T20:11:58.704 INFO:tasks.rados.rados.0.trial188.stdout:20: write initial oid 20 2026-02-13T20:11:58.705 INFO:tasks.rados.rados.0.trial188.stdout:20: seq_num 19 ranges {719333=462437,1962099=357234} 2026-02-13T20:11:58.708 INFO:tasks.rados.rados.0.trial188.stdout:20: writing trial18843701-20 from 719333 to 1181770 tid 1 2026-02-13T20:11:58.713 INFO:tasks.rados.rados.0.trial188.stdout:20: writing trial18843701-20 from 1962099 to 2319333 tid 2 2026-02-13T20:11:58.713 INFO:tasks.rados.rados.0.trial188.stdout:21: write initial oid 21 2026-02-13T20:11:58.713 INFO:tasks.rados.rados.0.trial188.stdout:21: seq_num 20 ranges {736140=537686,2020581=315559} 2026-02-13T20:11:58.718 INFO:tasks.rados.rados.0.trial188.stdout:21: writing trial18843701-21 from 736140 to 1273826 tid 1 2026-02-13T20:11:58.722 INFO:tasks.rados.rados.0.trial188.stdout:21: writing trial18843701-21 from 2020581 to 2336140 tid 2 2026-02-13T20:11:58.722 INFO:tasks.rados.rados.0.trial188.stdout: waiting on 16 2026-02-13T20:11:58.723 INFO:tasks.rados.rados.0.trial188.stdout:6: finishing write tid 3 to trial18843701-6 2026-02-13T20:11:58.723 INFO:tasks.rados.rados.0.trial188.stdout:7: finishing write tid 2 to trial18843701-7 2026-02-13T20:11:58.723 INFO:tasks.rados.rados.0.trial188.stdout:6: finishing write tid 4 to trial18843701-6 2026-02-13T20:11:58.723 INFO:tasks.rados.rados.0.trial188.stdout:6: oid 6 updating version 0 to 3 2026-02-13T20:11:58.723 INFO:tasks.rados.rados.0.trial188.stdout:6: oid 6 version 3 is already newer than 1 2026-02-13T20:11:58.723 INFO:tasks.rados.rados.0.trial188.stdout:6: oid 6 version 3 is already newer than 2 2026-02-13T20:11:58.723 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 6 v 3 (ObjNum 5 snap 0 seq_num 5) dirty exists 2026-02-13T20:11:58.723 INFO:tasks.rados.rados.0.trial188.stdout:6: left oid 6 (ObjNum 5 snap 0 seq_num 5) 2026-02-13T20:11:58.723 INFO:tasks.rados.rados.0.trial188.stdout:9: finishing write tid 1 to trial18843701-9 2026-02-13T20:11:58.723 INFO:tasks.rados.rados.0.trial188.stdout:8: finishing write tid 1 to trial18843701-8 2026-02-13T20:11:58.724 INFO:tasks.rados.rados.0.trial188.stdout:8: finishing write tid 2 to trial18843701-8 2026-02-13T20:11:58.724 INFO:tasks.rados.rados.0.trial188.stdout:6: done (15 left) 2026-02-13T20:11:58.724 INFO:tasks.rados.rados.0.trial188.stdout:22: write initial oid 22 2026-02-13T20:11:58.724 INFO:tasks.rados.rados.0.trial188.stdout:22: seq_num 21 ranges {752947=612935,1962710=390237} 2026-02-13T20:11:58.727 INFO:tasks.rados.rados.0.trial188.stdout:22: writing trial18843701-22 from 752947 to 1365882 tid 1 2026-02-13T20:11:58.731 INFO:tasks.rados.rados.0.trial188.stdout:22: writing trial18843701-22 from 1962710 to 2352947 tid 2 2026-02-13T20:11:58.732 INFO:tasks.rados.rados.0.trial188.stdout: waiting on 16 2026-02-13T20:11:58.732 INFO:tasks.rados.rados.0.trial188.stdout:8: finishing write tid 3 to trial18843701-8 2026-02-13T20:11:58.732 INFO:tasks.rados.rados.0.trial188.stdout:9: finishing write tid 2 to trial18843701-9 2026-02-13T20:11:58.732 INFO:tasks.rados.rados.0.trial188.stdout:9: finishing write tid 3 to trial18843701-9 2026-02-13T20:11:58.732 INFO:tasks.rados.rados.0.trial188.stdout:8: finishing write tid 4 to trial18843701-8 2026-02-13T20:11:58.732 INFO:tasks.rados.rados.0.trial188.stdout:8: oid 8 updating version 0 to 2 2026-02-13T20:11:58.732 INFO:tasks.rados.rados.0.trial188.stdout:8: oid 8 version 2 is already newer than 1 2026-02-13T20:11:58.732 INFO:tasks.rados.rados.0.trial188.stdout:8: oid 8 updating version 2 to 3 2026-02-13T20:11:58.732 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 8 v 3 (ObjNum 7 snap 0 seq_num 7) dirty exists 2026-02-13T20:11:58.732 INFO:tasks.rados.rados.0.trial188.stdout:8: left oid 8 (ObjNum 7 snap 0 seq_num 7) 2026-02-13T20:11:58.732 INFO:tasks.rados.rados.0.trial188.stdout:9: finishing write tid 4 to trial18843701-9 2026-02-13T20:11:58.733 INFO:tasks.rados.rados.0.trial188.stdout:9: oid 9 updating version 0 to 2 2026-02-13T20:11:58.733 INFO:tasks.rados.rados.0.trial188.stdout:9: oid 9 version 2 is already newer than 1 2026-02-13T20:11:58.733 INFO:tasks.rados.rados.0.trial188.stdout:9: oid 9 updating version 2 to 3 2026-02-13T20:11:58.733 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 9 v 3 (ObjNum 8 snap 0 seq_num 8) dirty exists 2026-02-13T20:11:58.733 INFO:tasks.rados.rados.0.trial188.stdout:9: left oid 9 (ObjNum 8 snap 0 seq_num 8) 2026-02-13T20:11:58.733 INFO:tasks.rados.rados.0.trial188.stdout:7: finishing write tid 3 to trial18843701-7 2026-02-13T20:11:58.733 INFO:tasks.rados.rados.0.trial188.stdout:7: finishing write tid 4 to trial18843701-7 2026-02-13T20:11:58.733 INFO:tasks.rados.rados.0.trial188.stdout:7: oid 7 updating version 0 to 3 2026-02-13T20:11:58.733 INFO:tasks.rados.rados.0.trial188.stdout:7: oid 7 version 3 is already newer than 1 2026-02-13T20:11:58.733 INFO:tasks.rados.rados.0.trial188.stdout:7: oid 7 version 3 is already newer than 2 2026-02-13T20:11:58.733 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 7 v 3 (ObjNum 6 snap 0 seq_num 6) dirty exists 2026-02-13T20:11:58.733 INFO:tasks.rados.rados.0.trial188.stdout:7: left oid 7 (ObjNum 6 snap 0 seq_num 6) 2026-02-13T20:11:58.733 INFO:tasks.rados.rados.0.trial188.stdout:10: finishing write tid 1 to trial18843701-10 2026-02-13T20:11:58.734 INFO:tasks.rados.rados.0.trial188.stdout:7: done (15 left) 2026-02-13T20:11:58.734 INFO:tasks.rados.rados.0.trial188.stdout:8: done (14 left) 2026-02-13T20:11:58.734 INFO:tasks.rados.rados.0.trial188.stdout:9: done (13 left) 2026-02-13T20:11:58.734 INFO:tasks.rados.rados.0.trial188.stdout:23: write initial oid 23 2026-02-13T20:11:58.734 INFO:tasks.rados.rados.0.trial188.stdout:23: seq_num 22 ranges {769754=688184,2021192=348562} 2026-02-13T20:11:58.736 INFO:tasks.rados.rados.0.trial188.stdout:23: writing trial18843701-23 from 769754 to 1457938 tid 1 2026-02-13T20:11:58.740 INFO:tasks.rados.rados.0.trial188.stdout:23: writing trial18843701-23 from 2021192 to 2369754 tid 2 2026-02-13T20:11:58.740 INFO:tasks.rados.rados.0.trial188.stdout:24: write initial oid 24 2026-02-13T20:11:58.740 INFO:tasks.rados.rados.0.trial188.stdout:24: seq_num 23 ranges {786561=479786,1796027=467664} 2026-02-13T20:11:58.744 INFO:tasks.rados.rados.0.trial188.stdout:24: writing trial18843701-24 from 786561 to 1266347 tid 1 2026-02-13T20:11:58.748 INFO:tasks.rados.rados.0.trial188.stdout:24: writing trial18843701-24 from 1796027 to 2263691 tid 2 2026-02-13T20:11:58.749 INFO:tasks.rados.rados.0.trial188.stdout:25: write initial oid 25 2026-02-13T20:11:58.749 INFO:tasks.rados.rados.0.trial188.stdout:25: seq_num 24 ranges {403368=555035,1454509=727675} 2026-02-13T20:11:58.752 INFO:tasks.rados.rados.0.trial188.stdout:25: writing trial18843701-25 from 403368 to 958403 tid 1 2026-02-13T20:11:58.757 INFO:tasks.rados.rados.0.trial188.stdout:25: writing trial18843701-25 from 1454509 to 2182184 tid 2 2026-02-13T20:11:58.757 INFO:tasks.rados.rados.0.trial188.stdout: waiting on 16 2026-02-13T20:11:58.757 INFO:tasks.rados.rados.0.trial188.stdout:10: finishing write tid 2 to trial18843701-10 2026-02-13T20:11:58.757 INFO:tasks.rados.rados.0.trial188.stdout:10: finishing write tid 3 to trial18843701-10 2026-02-13T20:11:58.758 INFO:tasks.rados.rados.0.trial188.stdout:10: finishing write tid 4 to trial18843701-10 2026-02-13T20:11:58.758 INFO:tasks.rados.rados.0.trial188.stdout:10: oid 10 updating version 0 to 4 2026-02-13T20:11:58.758 INFO:tasks.rados.rados.0.trial188.stdout:10: oid 10 updating version 4 to 6 2026-02-13T20:11:58.758 INFO:tasks.rados.rados.0.trial188.stdout:10: oid 10 version 6 is already newer than 5 2026-02-13T20:11:58.758 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 10 v 6 (ObjNum 9 snap 0 seq_num 9) dirty exists 2026-02-13T20:11:58.758 INFO:tasks.rados.rados.0.trial188.stdout:10: left oid 10 (ObjNum 9 snap 0 seq_num 9) 2026-02-13T20:11:58.758 INFO:tasks.rados.rados.0.trial188.stdout:11: finishing write tid 1 to trial18843701-11 2026-02-13T20:11:58.758 INFO:tasks.rados.rados.0.trial188.stdout:11: finishing write tid 2 to trial18843701-11 2026-02-13T20:11:58.758 INFO:tasks.rados.rados.0.trial188.stdout:13: finishing write tid 1 to trial18843701-13 2026-02-13T20:11:58.758 INFO:tasks.rados.rados.0.trial188.stdout:10: done (15 left) 2026-02-13T20:11:58.758 INFO:tasks.rados.rados.0.trial188.stdout:26: write initial oid 26 2026-02-13T20:11:58.758 INFO:tasks.rados.rados.0.trial188.stdout:26: seq_num 25 ranges {420175=630284,1796638=471333} 2026-02-13T20:11:58.761 INFO:tasks.rados.rados.0.trial188.stdout:26: writing trial18843701-26 from 420175 to 1050459 tid 1 2026-02-13T20:11:58.766 INFO:tasks.rados.rados.0.trial188.stdout:26: writing trial18843701-26 from 1796638 to 2267971 tid 2 2026-02-13T20:11:58.766 INFO:tasks.rados.rados.0.trial188.stdout: waiting on 16 2026-02-13T20:11:58.766 INFO:tasks.rados.rados.0.trial188.stdout:11: finishing write tid 3 to trial18843701-11 2026-02-13T20:11:58.766 INFO:tasks.rados.rados.0.trial188.stdout:11: finishing write tid 4 to trial18843701-11 2026-02-13T20:11:58.766 INFO:tasks.rados.rados.0.trial188.stdout:11: oid 11 updating version 0 to 9 2026-02-13T20:11:58.766 INFO:tasks.rados.rados.0.trial188.stdout:11: oid 11 version 9 is already newer than 7 2026-02-13T20:11:58.766 INFO:tasks.rados.rados.0.trial188.stdout:11: oid 11 version 9 is already newer than 8 2026-02-13T20:11:58.766 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 11 v 9 (ObjNum 10 snap 0 seq_num 10) dirty exists 2026-02-13T20:11:58.767 INFO:tasks.rados.rados.0.trial188.stdout:11: left oid 11 (ObjNum 10 snap 0 seq_num 10) 2026-02-13T20:11:58.767 INFO:tasks.rados.rados.0.trial188.stdout:12: finishing write tid 1 to trial18843701-12 2026-02-13T20:11:58.767 INFO:tasks.rados.rados.0.trial188.stdout:13: finishing write tid 2 to trial18843701-13 2026-02-13T20:11:58.767 INFO:tasks.rados.rados.0.trial188.stdout:11: done (15 left) 2026-02-13T20:11:58.767 INFO:tasks.rados.rados.0.trial188.stdout:27: write initial oid 27 2026-02-13T20:11:58.767 INFO:tasks.rados.rados.0.trial188.stdout:27: seq_num 26 ranges {436982=705533,1855120=581862} 2026-02-13T20:11:58.770 INFO:tasks.rados.rados.0.trial188.stdout:27: writing trial18843701-27 from 436982 to 1142515 tid 1 2026-02-13T20:11:58.775 INFO:tasks.rados.rados.0.trial188.stdout:27: writing trial18843701-27 from 1855120 to 2436982 tid 2 2026-02-13T20:11:58.775 INFO:tasks.rados.rados.0.trial188.stdout: waiting on 16 2026-02-13T20:11:58.775 INFO:tasks.rados.rados.0.trial188.stdout:13: finishing write tid 3 to trial18843701-13 2026-02-13T20:11:58.775 INFO:tasks.rados.rados.0.trial188.stdout:13: finishing write tid 4 to trial18843701-13 2026-02-13T20:11:58.775 INFO:tasks.rados.rados.0.trial188.stdout:13: oid 13 updating version 0 to 11 2026-02-13T20:11:58.775 INFO:tasks.rados.rados.0.trial188.stdout:13: oid 13 updating version 11 to 12 2026-02-13T20:11:58.776 INFO:tasks.rados.rados.0.trial188.stdout:13: oid 13 version 12 is already newer than 10 2026-02-13T20:11:58.776 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 13 v 12 (ObjNum 12 snap 0 seq_num 12) dirty exists 2026-02-13T20:11:58.776 INFO:tasks.rados.rados.0.trial188.stdout:13: left oid 13 (ObjNum 12 snap 0 seq_num 12) 2026-02-13T20:11:58.776 INFO:tasks.rados.rados.0.trial188.stdout:12: finishing write tid 2 to trial18843701-12 2026-02-13T20:11:58.776 INFO:tasks.rados.rados.0.trial188.stdout:12: finishing write tid 3 to trial18843701-12 2026-02-13T20:11:58.776 INFO:tasks.rados.rados.0.trial188.stdout:13: done (15 left) 2026-02-13T20:11:58.776 INFO:tasks.rados.rados.0.trial188.stdout:28: write initial oid 28 2026-02-13T20:11:58.776 INFO:tasks.rados.rados.0.trial188.stdout:28: seq_num 27 ranges {453789=780782,1913602=475002} 2026-02-13T20:11:58.779 INFO:tasks.rados.rados.0.trial188.stdout:28: writing trial18843701-28 from 453789 to 1234571 tid 1 2026-02-13T20:11:58.784 INFO:tasks.rados.rados.0.trial188.stdout:28: writing trial18843701-28 from 1913602 to 2388604 tid 2 2026-02-13T20:11:58.784 INFO:tasks.rados.rados.0.trial188.stdout: waiting on 16 2026-02-13T20:11:58.784 INFO:tasks.rados.rados.0.trial188.stdout:12: finishing write tid 4 to trial18843701-12 2026-02-13T20:11:58.784 INFO:tasks.rados.rados.0.trial188.stdout:12: oid 12 updating version 0 to 3 2026-02-13T20:11:58.784 INFO:tasks.rados.rados.0.trial188.stdout:12: oid 12 version 3 is already newer than 1 2026-02-13T20:11:58.784 INFO:tasks.rados.rados.0.trial188.stdout:12: oid 12 version 3 is already newer than 2 2026-02-13T20:11:58.784 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 12 v 3 (ObjNum 11 snap 0 seq_num 11) dirty exists 2026-02-13T20:11:58.785 INFO:tasks.rados.rados.0.trial188.stdout:12: left oid 12 (ObjNum 11 snap 0 seq_num 11) 2026-02-13T20:11:58.785 INFO:tasks.rados.rados.0.trial188.stdout:14: finishing write tid 1 to trial18843701-14 2026-02-13T20:11:58.785 INFO:tasks.rados.rados.0.trial188.stdout:14: finishing write tid 2 to trial18843701-14 2026-02-13T20:11:58.785 INFO:tasks.rados.rados.0.trial188.stdout:14: finishing write tid 3 to trial18843701-14 2026-02-13T20:11:58.785 INFO:tasks.rados.rados.0.trial188.stdout:12: done (15 left) 2026-02-13T20:11:58.785 INFO:tasks.rados.rados.0.trial188.stdout:29: write initial oid 29 2026-02-13T20:11:58.785 INFO:tasks.rados.rados.0.trial188.stdout:29: seq_num 28 ranges {470596=456031,1572084=618660} 2026-02-13T20:11:58.787 INFO:tasks.rados.rados.0.trial188.stdout:29: writing trial18843701-29 from 470596 to 926627 tid 1 2026-02-13T20:11:58.792 INFO:tasks.rados.rados.0.trial188.stdout:29: writing trial18843701-29 from 1572084 to 2190744 tid 2 2026-02-13T20:11:58.792 INFO:tasks.rados.rados.0.trial188.stdout: waiting on 16 2026-02-13T20:11:58.792 INFO:tasks.rados.rados.0.trial188.stdout:15: finishing write tid 1 to trial18843701-15 2026-02-13T20:11:58.793 INFO:tasks.rados.rados.0.trial188.stdout:14: finishing write tid 4 to trial18843701-14 2026-02-13T20:11:58.793 INFO:tasks.rados.rados.0.trial188.stdout:14: oid 14 updating version 0 to 4 2026-02-13T20:11:58.793 INFO:tasks.rados.rados.0.trial188.stdout:14: oid 14 updating version 4 to 5 2026-02-13T20:11:58.793 INFO:tasks.rados.rados.0.trial188.stdout:14: oid 14 updating version 5 to 6 2026-02-13T20:11:58.793 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 14 v 6 (ObjNum 13 snap 0 seq_num 13) dirty exists 2026-02-13T20:11:58.793 INFO:tasks.rados.rados.0.trial188.stdout:14: left oid 14 (ObjNum 13 snap 0 seq_num 13) 2026-02-13T20:11:58.793 INFO:tasks.rados.rados.0.trial188.stdout:15: finishing write tid 2 to trial18843701-15 2026-02-13T20:11:58.793 INFO:tasks.rados.rados.0.trial188.stdout:14: done (15 left) 2026-02-13T20:11:58.793 INFO:tasks.rados.rados.0.trial188.stdout:30: write initial oid 30 2026-02-13T20:11:58.793 INFO:tasks.rados.rados.0.trial188.stdout:30: seq_num 29 ranges {487403=531280,1514213=478671} 2026-02-13T20:11:58.795 INFO:tasks.rados.rados.0.trial188.stdout:30: writing trial18843701-30 from 487403 to 1018683 tid 1 2026-02-13T20:11:58.799 INFO:tasks.rados.rados.0.trial188.stdout:30: writing trial18843701-30 from 1514213 to 1992884 tid 2 2026-02-13T20:11:58.800 INFO:tasks.rados.rados.0.trial188.stdout: waiting on 16 2026-02-13T20:11:58.800 INFO:tasks.rados.rados.0.trial188.stdout:16: finishing write tid 1 to trial18843701-16 2026-02-13T20:11:58.800 INFO:tasks.rados.rados.0.trial188.stdout:15: finishing write tid 3 to trial18843701-15 2026-02-13T20:11:58.800 INFO:tasks.rados.rados.0.trial188.stdout:15: finishing write tid 4 to trial18843701-15 2026-02-13T20:11:58.800 INFO:tasks.rados.rados.0.trial188.stdout:15: oid 15 updating version 0 to 8 2026-02-13T20:11:58.800 INFO:tasks.rados.rados.0.trial188.stdout:15: oid 15 version 8 is already newer than 7 2026-02-13T20:11:58.800 INFO:tasks.rados.rados.0.trial188.stdout:15: oid 15 updating version 8 to 9 2026-02-13T20:11:58.800 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 15 v 9 (ObjNum 14 snap 0 seq_num 14) dirty exists 2026-02-13T20:11:58.800 INFO:tasks.rados.rados.0.trial188.stdout:15: left oid 15 (ObjNum 14 snap 0 seq_num 14) 2026-02-13T20:11:58.800 INFO:tasks.rados.rados.0.trial188.stdout:16: finishing write tid 2 to trial18843701-16 2026-02-13T20:11:58.801 INFO:tasks.rados.rados.0.trial188.stdout:16: finishing write tid 3 to trial18843701-16 2026-02-13T20:11:58.801 INFO:tasks.rados.rados.0.trial188.stdout:16: finishing write tid 4 to trial18843701-16 2026-02-13T20:11:58.801 INFO:tasks.rados.rados.0.trial188.stdout:16: oid 16 updating version 0 to 6 2026-02-13T20:11:58.801 INFO:tasks.rados.rados.0.trial188.stdout:16: oid 16 version 6 is already newer than 4 2026-02-13T20:11:58.801 INFO:tasks.rados.rados.0.trial188.stdout:16: oid 16 version 6 is already newer than 5 2026-02-13T20:11:58.801 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 16 v 6 (ObjNum 15 snap 0 seq_num 15) dirty exists 2026-02-13T20:11:58.801 INFO:tasks.rados.rados.0.trial188.stdout:16: left oid 16 (ObjNum 15 snap 0 seq_num 15) 2026-02-13T20:11:58.801 INFO:tasks.rados.rados.0.trial188.stdout:17: finishing write tid 1 to trial18843701-17 2026-02-13T20:11:58.801 INFO:tasks.rados.rados.0.trial188.stdout:15: done (15 left) 2026-02-13T20:11:58.801 INFO:tasks.rados.rados.0.trial188.stdout:16: done (14 left) 2026-02-13T20:11:58.801 INFO:tasks.rados.rados.0.trial188.stdout:31: write initial oid 31 2026-02-13T20:11:58.801 INFO:tasks.rados.rados.0.trial188.stdout:31: seq_num 30 ranges {504210=606529,1572695=622329} 2026-02-13T20:11:58.803 INFO:tasks.rados.rados.0.trial188.stdout:31: writing trial18843701-31 from 504210 to 1110739 tid 1 2026-02-13T20:11:58.807 INFO:tasks.rados.rados.0.trial188.stdout:31: writing trial18843701-31 from 1572695 to 2195024 tid 2 2026-02-13T20:11:58.807 INFO:tasks.rados.rados.0.trial188.stdout:32: write initial oid 32 2026-02-13T20:11:58.808 INFO:tasks.rados.rados.0.trial188.stdout:32: seq_num 31 ranges {521017=798131,1747530=482340} 2026-02-13T20:11:58.812 INFO:tasks.rados.rados.0.trial188.stdout:32: writing trial18843701-32 from 521017 to 1319148 tid 1 2026-02-13T20:11:58.817 INFO:tasks.rados.rados.0.trial188.stdout:32: writing trial18843701-32 from 1747530 to 2229870 tid 2 2026-02-13T20:11:58.817 INFO:tasks.rados.rados.0.trial188.stdout: waiting on 16 2026-02-13T20:11:58.817 INFO:tasks.rados.rados.0.trial188.stdout:17: finishing write tid 2 to trial18843701-17 2026-02-13T20:11:58.817 INFO:tasks.rados.rados.0.trial188.stdout:17: finishing write tid 3 to trial18843701-17 2026-02-13T20:11:58.817 INFO:tasks.rados.rados.0.trial188.stdout:17: finishing write tid 4 to trial18843701-17 2026-02-13T20:11:58.817 INFO:tasks.rados.rados.0.trial188.stdout:17: oid 17 updating version 0 to 5 2026-02-13T20:11:58.817 INFO:tasks.rados.rados.0.trial188.stdout:17: oid 17 version 5 is already newer than 4 2026-02-13T20:11:58.817 INFO:tasks.rados.rados.0.trial188.stdout:17: oid 17 updating version 5 to 6 2026-02-13T20:11:58.817 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 17 v 6 (ObjNum 16 snap 0 seq_num 16) dirty exists 2026-02-13T20:11:58.817 INFO:tasks.rados.rados.0.trial188.stdout:17: left oid 17 (ObjNum 16 snap 0 seq_num 16) 2026-02-13T20:11:58.818 INFO:tasks.rados.rados.0.trial188.stdout:20: finishing write tid 1 to trial18843701-20 2026-02-13T20:11:58.818 INFO:tasks.rados.rados.0.trial188.stdout:20: finishing write tid 2 to trial18843701-20 2026-02-13T20:11:58.818 INFO:tasks.rados.rados.0.trial188.stdout:20: finishing write tid 3 to trial18843701-20 2026-02-13T20:11:58.818 INFO:tasks.rados.rados.0.trial188.stdout:20: finishing write tid 4 to trial18843701-20 2026-02-13T20:11:58.818 INFO:tasks.rados.rados.0.trial188.stdout:20: oid 20 updating version 0 to 2 2026-02-13T20:11:58.818 INFO:tasks.rados.rados.0.trial188.stdout:20: oid 20 version 2 is already newer than 1 2026-02-13T20:11:58.818 INFO:tasks.rados.rados.0.trial188.stdout:20: oid 20 updating version 2 to 3 2026-02-13T20:11:58.818 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 20 v 3 (ObjNum 19 snap 0 seq_num 19) dirty exists 2026-02-13T20:11:58.818 INFO:tasks.rados.rados.0.trial188.stdout:20: left oid 20 (ObjNum 19 snap 0 seq_num 19) 2026-02-13T20:11:58.818 INFO:tasks.rados.rados.0.trial188.stdout:18: finishing write tid 1 to trial18843701-18 2026-02-13T20:11:58.818 INFO:tasks.rados.rados.0.trial188.stdout:18: finishing write tid 2 to trial18843701-18 2026-02-13T20:11:58.818 INFO:tasks.rados.rados.0.trial188.stdout:18: finishing write tid 3 to trial18843701-18 2026-02-13T20:11:58.818 INFO:tasks.rados.rados.0.trial188.stdout:17: done (15 left) 2026-02-13T20:11:58.819 INFO:tasks.rados.rados.0.trial188.stdout:20: done (14 left) 2026-02-13T20:11:58.819 INFO:tasks.rados.rados.0.trial188.stdout:33: write initial oid 33 2026-02-13T20:11:58.819 INFO:tasks.rados.rados.0.trial188.stdout:33: seq_num 32 ranges {537824=473380,1806012=625998} 2026-02-13T20:11:58.820 INFO:tasks.rados.rados.0.trial188.stdout:33: writing trial18843701-33 from 537824 to 1011204 tid 1 2026-02-13T20:11:58.825 INFO:tasks.rados.rados.0.trial188.stdout:33: writing trial18843701-33 from 1806012 to 2432010 tid 2 2026-02-13T20:11:58.825 INFO:tasks.rados.rados.0.trial188.stdout:34: write initial oid 34 2026-02-13T20:11:58.825 INFO:tasks.rados.rados.0.trial188.stdout:34: seq_num 33 ranges {554631=548629,1748141=486009} 2026-02-13T20:11:58.829 INFO:tasks.rados.rados.0.trial188.stdout:34: writing trial18843701-34 from 554631 to 1103260 tid 1 2026-02-13T20:11:58.834 INFO:tasks.rados.rados.0.trial188.stdout:34: writing trial18843701-34 from 1748141 to 2234150 tid 2 2026-02-13T20:11:58.834 INFO:tasks.rados.rados.0.trial188.stdout: waiting on 16 2026-02-13T20:11:58.834 INFO:tasks.rados.rados.0.trial188.stdout:18: finishing write tid 4 to trial18843701-18 2026-02-13T20:11:58.835 INFO:tasks.rados.rados.0.trial188.stdout:18: oid 18 updating version 0 to 8 2026-02-13T20:11:58.835 INFO:tasks.rados.rados.0.trial188.stdout:18: oid 18 updating version 8 to 9 2026-02-13T20:11:58.835 INFO:tasks.rados.rados.0.trial188.stdout:18: oid 18 version 9 is already newer than 7 2026-02-13T20:11:58.835 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 18 v 9 (ObjNum 17 snap 0 seq_num 17) dirty exists 2026-02-13T20:11:58.835 INFO:tasks.rados.rados.0.trial188.stdout:18: left oid 18 (ObjNum 17 snap 0 seq_num 17) 2026-02-13T20:11:58.835 INFO:tasks.rados.rados.0.trial188.stdout:19: finishing write tid 1 to trial18843701-19 2026-02-13T20:11:58.835 INFO:tasks.rados.rados.0.trial188.stdout:19: finishing write tid 2 to trial18843701-19 2026-02-13T20:11:58.835 INFO:tasks.rados.rados.0.trial188.stdout:21: finishing write tid 1 to trial18843701-21 2026-02-13T20:11:58.835 INFO:tasks.rados.rados.0.trial188.stdout:21: finishing write tid 2 to trial18843701-21 2026-02-13T20:11:58.835 INFO:tasks.rados.rados.0.trial188.stdout:21: finishing write tid 3 to trial18843701-21 2026-02-13T20:11:58.835 INFO:tasks.rados.rados.0.trial188.stdout:21: finishing write tid 4 to trial18843701-21 2026-02-13T20:11:58.835 INFO:tasks.rados.rados.0.trial188.stdout:21: oid 21 updating version 0 to 3 2026-02-13T20:11:58.836 INFO:tasks.rados.rados.0.trial188.stdout:21: oid 21 version 3 is already newer than 1 2026-02-13T20:11:58.836 INFO:tasks.rados.rados.0.trial188.stdout:21: oid 21 version 3 is already newer than 2 2026-02-13T20:11:58.836 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 21 v 3 (ObjNum 20 snap 0 seq_num 20) dirty exists 2026-02-13T20:11:58.836 INFO:tasks.rados.rados.0.trial188.stdout:21: left oid 21 (ObjNum 20 snap 0 seq_num 20) 2026-02-13T20:11:58.836 INFO:tasks.rados.rados.0.trial188.stdout:22: finishing write tid 1 to trial18843701-22 2026-02-13T20:11:58.836 INFO:tasks.rados.rados.0.trial188.stdout:18: done (15 left) 2026-02-13T20:11:58.836 INFO:tasks.rados.rados.0.trial188.stdout:21: done (14 left) 2026-02-13T20:11:58.836 INFO:tasks.rados.rados.0.trial188.stdout:35: write initial oid 35 2026-02-13T20:11:58.836 INFO:tasks.rados.rados.0.trial188.stdout:35: seq_num 34 ranges {571438=623878,1806623=629667} 2026-02-13T20:11:58.838 INFO:tasks.rados.rados.0.trial188.stdout:35: writing trial18843701-35 from 571438 to 1195316 tid 1 2026-02-13T20:11:58.843 INFO:tasks.rados.rados.0.trial188.stdout:35: writing trial18843701-35 from 1806623 to 2436290 tid 2 2026-02-13T20:11:58.843 INFO:tasks.rados.rados.0.trial188.stdout:36: write initial oid 36 2026-02-13T20:11:58.843 INFO:tasks.rados.rados.0.trial188.stdout:36: seq_num 35 ranges {588245=699127,1865105=489678} 2026-02-13T20:11:58.847 INFO:tasks.rados.rados.0.trial188.stdout:36: writing trial18843701-36 from 588245 to 1287372 tid 1 2026-02-13T20:11:58.852 INFO:tasks.rados.rados.0.trial188.stdout:36: writing trial18843701-36 from 1865105 to 2354783 tid 2 2026-02-13T20:11:58.852 INFO:tasks.rados.rados.0.trial188.stdout: waiting on 16 2026-02-13T20:11:58.852 INFO:tasks.rados.rados.0.trial188.stdout:22: finishing write tid 2 to trial18843701-22 2026-02-13T20:11:58.853 INFO:tasks.rados.rados.0.trial188.stdout:22: finishing write tid 3 to trial18843701-22 2026-02-13T20:11:58.853 INFO:tasks.rados.rados.0.trial188.stdout:22: finishing write tid 4 to trial18843701-22 2026-02-13T20:11:58.853 INFO:tasks.rados.rados.0.trial188.stdout:22: oid 22 updating version 0 to 3 2026-02-13T20:11:58.853 INFO:tasks.rados.rados.0.trial188.stdout:22: oid 22 version 3 is already newer than 1 2026-02-13T20:11:58.853 INFO:tasks.rados.rados.0.trial188.stdout:22: oid 22 version 3 is already newer than 2 2026-02-13T20:11:58.853 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 22 v 3 (ObjNum 21 snap 0 seq_num 21) dirty exists 2026-02-13T20:11:58.853 INFO:tasks.rados.rados.0.trial188.stdout:22: left oid 22 (ObjNum 21 snap 0 seq_num 21) 2026-02-13T20:11:58.853 INFO:tasks.rados.rados.0.trial188.stdout:19: finishing write tid 3 to trial18843701-19 2026-02-13T20:11:58.853 INFO:tasks.rados.rados.0.trial188.stdout:23: finishing write tid 1 to trial18843701-23 2026-02-13T20:11:58.853 INFO:tasks.rados.rados.0.trial188.stdout:19: finishing write tid 4 to trial18843701-19 2026-02-13T20:11:58.853 INFO:tasks.rados.rados.0.trial188.stdout:19: oid 19 updating version 0 to 4 2026-02-13T20:11:58.853 INFO:tasks.rados.rados.0.trial188.stdout:19: oid 19 updating version 4 to 5 2026-02-13T20:11:58.853 INFO:tasks.rados.rados.0.trial188.stdout:19: oid 19 updating version 5 to 6 2026-02-13T20:11:58.854 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 19 v 6 (ObjNum 18 snap 0 seq_num 18) dirty exists 2026-02-13T20:11:58.854 INFO:tasks.rados.rados.0.trial188.stdout:19: left oid 19 (ObjNum 18 snap 0 seq_num 18) 2026-02-13T20:11:58.854 INFO:tasks.rados.rados.0.trial188.stdout:23: finishing write tid 2 to trial18843701-23 2026-02-13T20:11:58.854 INFO:tasks.rados.rados.0.trial188.stdout:19: done (15 left) 2026-02-13T20:11:58.854 INFO:tasks.rados.rados.0.trial188.stdout:22: done (14 left) 2026-02-13T20:11:58.854 INFO:tasks.rados.rados.0.trial188.stdout:37: write initial oid 37 2026-02-13T20:11:58.854 INFO:tasks.rados.rados.0.trial188.stdout:37: seq_num 36 ranges {605052=774376,1923587=633336} 2026-02-13T20:11:58.857 INFO:tasks.rados.rados.0.trial188.stdout:37: writing trial18843701-37 from 605052 to 1379428 tid 1 2026-02-13T20:11:58.861 INFO:tasks.rados.rados.0.trial188.stdout:37: writing trial18843701-37 from 1923587 to 2556923 tid 2 2026-02-13T20:11:58.861 INFO:tasks.rados.rados.0.trial188.stdout:38: write initial oid 38 2026-02-13T20:11:58.861 INFO:tasks.rados.rados.0.trial188.stdout:38: seq_num 37 ranges {621859=449625,1865716=756143} 2026-02-13T20:11:58.865 INFO:tasks.rados.rados.0.trial188.stdout:38: writing trial18843701-38 from 621859 to 1071484 tid 1 2026-02-13T20:11:58.872 INFO:tasks.rados.rados.0.trial188.stdout:38: writing trial18843701-38 from 1865716 to 2621859 tid 2 2026-02-13T20:11:58.872 INFO:tasks.rados.rados.0.trial188.stdout: waiting on 16 2026-02-13T20:11:58.872 INFO:tasks.rados.rados.0.trial188.stdout:23: finishing write tid 3 to trial18843701-23 2026-02-13T20:11:58.872 INFO:tasks.rados.rados.0.trial188.stdout:23: finishing write tid 4 to trial18843701-23 2026-02-13T20:11:58.872 INFO:tasks.rados.rados.0.trial188.stdout:23: oid 23 updating version 0 to 8 2026-02-13T20:11:58.872 INFO:tasks.rados.rados.0.trial188.stdout:23: oid 23 updating version 8 to 9 2026-02-13T20:11:58.872 INFO:tasks.rados.rados.0.trial188.stdout:23: oid 23 version 9 is already newer than 7 2026-02-13T20:11:58.872 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 23 v 9 (ObjNum 22 snap 0 seq_num 22) dirty exists 2026-02-13T20:11:58.872 INFO:tasks.rados.rados.0.trial188.stdout:23: left oid 23 (ObjNum 22 snap 0 seq_num 22) 2026-02-13T20:11:58.873 INFO:tasks.rados.rados.0.trial188.stdout:24: finishing write tid 1 to trial18843701-24 2026-02-13T20:11:58.873 INFO:tasks.rados.rados.0.trial188.stdout:25: finishing write tid 1 to trial18843701-25 2026-02-13T20:11:58.873 INFO:tasks.rados.rados.0.trial188.stdout:25: finishing write tid 2 to trial18843701-25 2026-02-13T20:11:58.873 INFO:tasks.rados.rados.0.trial188.stdout:23: done (15 left) 2026-02-13T20:11:58.873 INFO:tasks.rados.rados.0.trial188.stdout:39: write initial oid 39 2026-02-13T20:11:58.873 INFO:tasks.rados.rados.0.trial188.stdout:39: seq_num 38 ranges {638666=524874,1924198=637005} 2026-02-13T20:11:58.875 INFO:tasks.rados.rados.0.trial188.stdout:39: writing trial18843701-39 from 638666 to 1163540 tid 1 2026-02-13T20:11:58.881 INFO:tasks.rados.rados.0.trial188.stdout:39: writing trial18843701-39 from 1924198 to 2561203 tid 2 2026-02-13T20:11:58.881 INFO:tasks.rados.rados.0.trial188.stdout: waiting on 16 2026-02-13T20:11:58.882 INFO:tasks.rados.rados.0.trial188.stdout:25: finishing write tid 3 to trial18843701-25 2026-02-13T20:11:58.882 INFO:tasks.rados.rados.0.trial188.stdout:25: finishing write tid 4 to trial18843701-25 2026-02-13T20:11:58.882 INFO:tasks.rados.rados.0.trial188.stdout:25: oid 25 updating version 0 to 2 2026-02-13T20:11:58.882 INFO:tasks.rados.rados.0.trial188.stdout:25: oid 25 version 2 is already newer than 1 2026-02-13T20:11:58.882 INFO:tasks.rados.rados.0.trial188.stdout:25: oid 25 updating version 2 to 3 2026-02-13T20:11:58.882 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 25 v 3 (ObjNum 24 snap 0 seq_num 24) dirty exists 2026-02-13T20:11:58.882 INFO:tasks.rados.rados.0.trial188.stdout:25: left oid 25 (ObjNum 24 snap 0 seq_num 24) 2026-02-13T20:11:58.882 INFO:tasks.rados.rados.0.trial188.stdout:25: done (15 left) 2026-02-13T20:11:58.882 INFO:tasks.rados.rados.0.trial188.stdout:40: write initial oid 40 2026-02-13T20:11:58.882 INFO:tasks.rados.rados.0.trial188.stdout:40: seq_num 39 ranges {655473=716476,2099033=556440} 2026-02-13T20:11:58.886 INFO:tasks.rados.rados.0.trial188.stdout:40: writing trial18843701-40 from 655473 to 1371949 tid 1 2026-02-13T20:11:58.891 INFO:tasks.rados.rados.0.trial188.stdout:40: writing trial18843701-40 from 2099033 to 2655473 tid 2 2026-02-13T20:11:58.892 INFO:tasks.rados.rados.0.trial188.stdout: waiting on 16 2026-02-13T20:11:58.892 INFO:tasks.rados.rados.0.trial188.stdout:24: finishing write tid 2 to trial18843701-24 2026-02-13T20:11:58.892 INFO:tasks.rados.rados.0.trial188.stdout:24: finishing write tid 3 to trial18843701-24 2026-02-13T20:11:58.892 INFO:tasks.rados.rados.0.trial188.stdout:24: finishing write tid 4 to trial18843701-24 2026-02-13T20:11:58.892 INFO:tasks.rados.rados.0.trial188.stdout:24: oid 24 updating version 0 to 11 2026-02-13T20:11:58.892 INFO:tasks.rados.rados.0.trial188.stdout:24: oid 24 updating version 11 to 12 2026-02-13T20:11:58.892 INFO:tasks.rados.rados.0.trial188.stdout:24: oid 24 version 12 is already newer than 10 2026-02-13T20:11:58.892 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 24 v 12 (ObjNum 23 snap 0 seq_num 23) dirty exists 2026-02-13T20:11:58.892 INFO:tasks.rados.rados.0.trial188.stdout:24: left oid 24 (ObjNum 23 snap 0 seq_num 23) 2026-02-13T20:11:58.892 INFO:tasks.rados.rados.0.trial188.stdout:26: finishing write tid 1 to trial18843701-26 2026-02-13T20:11:58.892 INFO:tasks.rados.rados.0.trial188.stdout:26: finishing write tid 2 to trial18843701-26 2026-02-13T20:11:58.892 INFO:tasks.rados.rados.0.trial188.stdout:26: finishing write tid 3 to trial18843701-26 2026-02-13T20:11:58.893 INFO:tasks.rados.rados.0.trial188.stdout:26: finishing write tid 4 to trial18843701-26 2026-02-13T20:11:58.893 INFO:tasks.rados.rados.0.trial188.stdout:26: oid 26 updating version 0 to 11 2026-02-13T20:11:58.893 INFO:tasks.rados.rados.0.trial188.stdout:26: oid 26 updating version 11 to 12 2026-02-13T20:11:58.893 INFO:tasks.rados.rados.0.trial188.stdout:26: oid 26 version 12 is already newer than 10 2026-02-13T20:11:58.893 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 26 v 12 (ObjNum 25 snap 0 seq_num 25) dirty exists 2026-02-13T20:11:58.893 INFO:tasks.rados.rados.0.trial188.stdout:26: left oid 26 (ObjNum 25 snap 0 seq_num 25) 2026-02-13T20:11:58.893 INFO:tasks.rados.rados.0.trial188.stdout:27: finishing write tid 1 to trial18843701-27 2026-02-13T20:11:58.893 INFO:tasks.rados.rados.0.trial188.stdout:24: done (15 left) 2026-02-13T20:11:58.893 INFO:tasks.rados.rados.0.trial188.stdout:26: done (14 left) 2026-02-13T20:11:58.893 INFO:tasks.rados.rados.0.trial188.stdout:41: write initial oid 41 2026-02-13T20:11:58.893 INFO:tasks.rados.rados.0.trial188.stdout:41: seq_num 40 ranges {672280=791725,2157515=514765} 2026-02-13T20:11:58.896 INFO:tasks.rados.rados.0.trial188.stdout:41: writing trial18843701-41 from 672280 to 1464005 tid 1 2026-02-13T20:11:58.901 INFO:tasks.rados.rados.0.trial188.stdout:41: writing trial18843701-41 from 2157515 to 2672280 tid 2 2026-02-13T20:11:58.901 INFO:tasks.rados.rados.0.trial188.stdout:42: write initial oid 42 2026-02-13T20:11:58.901 INFO:tasks.rados.rados.0.trial188.stdout:42: seq_num 41 ranges {689087=466974,1699644=784332} 2026-02-13T20:11:58.905 INFO:tasks.rados.rados.0.trial188.stdout:42: writing trial18843701-42 from 689087 to 1156061 tid 1 2026-02-13T20:11:58.911 INFO:tasks.rados.rados.0.trial188.stdout:42: writing trial18843701-42 from 1699644 to 2483976 tid 2 2026-02-13T20:11:58.911 INFO:tasks.rados.rados.0.trial188.stdout: waiting on 16 2026-02-13T20:11:58.911 INFO:tasks.rados.rados.0.trial188.stdout:29: finishing write tid 1 to trial18843701-29 2026-02-13T20:11:58.911 INFO:tasks.rados.rados.0.trial188.stdout:29: finishing write tid 2 to trial18843701-29 2026-02-13T20:11:58.911 INFO:tasks.rados.rados.0.trial188.stdout:29: finishing write tid 3 to trial18843701-29 2026-02-13T20:11:58.911 INFO:tasks.rados.rados.0.trial188.stdout:29: finishing write tid 4 to trial18843701-29 2026-02-13T20:11:58.911 INFO:tasks.rados.rados.0.trial188.stdout:29: oid 29 updating version 0 to 9 2026-02-13T20:11:58.911 INFO:tasks.rados.rados.0.trial188.stdout:29: oid 29 version 9 is already newer than 8 2026-02-13T20:11:58.911 INFO:tasks.rados.rados.0.trial188.stdout:29: oid 29 version 9 is already newer than 7 2026-02-13T20:11:58.911 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 29 v 9 (ObjNum 28 snap 0 seq_num 28) dirty exists 2026-02-13T20:11:58.911 INFO:tasks.rados.rados.0.trial188.stdout:29: left oid 29 (ObjNum 28 snap 0 seq_num 28) 2026-02-13T20:11:58.912 INFO:tasks.rados.rados.0.trial188.stdout:28: finishing write tid 1 to trial18843701-28 2026-02-13T20:11:58.912 INFO:tasks.rados.rados.0.trial188.stdout:27: finishing write tid 2 to trial18843701-27 2026-02-13T20:11:58.912 INFO:tasks.rados.rados.0.trial188.stdout:28: finishing write tid 2 to trial18843701-28 2026-02-13T20:11:58.912 INFO:tasks.rados.rados.0.trial188.stdout:29: done (15 left) 2026-02-13T20:11:58.912 INFO:tasks.rados.rados.0.trial188.stdout:43: write initial oid 43 2026-02-13T20:11:58.912 INFO:tasks.rados.rados.0.trial188.stdout:43: seq_num 42 ranges {705894=542223,1758126=644343} 2026-02-13T20:11:58.915 INFO:tasks.rados.rados.0.trial188.stdout:43: writing trial18843701-43 from 705894 to 1248117 tid 1 2026-02-13T20:11:58.920 INFO:tasks.rados.rados.0.trial188.stdout:43: writing trial18843701-43 from 1758126 to 2402469 tid 2 2026-02-13T20:11:58.920 INFO:tasks.rados.rados.0.trial188.stdout: waiting on 16 2026-02-13T20:11:58.920 INFO:tasks.rados.rados.0.trial188.stdout:28: finishing write tid 3 to trial18843701-28 2026-02-13T20:11:58.920 INFO:tasks.rados.rados.0.trial188.stdout:28: finishing write tid 4 to trial18843701-28 2026-02-13T20:11:58.921 INFO:tasks.rados.rados.0.trial188.stdout:28: oid 28 updating version 0 to 6 2026-02-13T20:11:58.921 INFO:tasks.rados.rados.0.trial188.stdout:28: oid 28 version 6 is already newer than 5 2026-02-13T20:11:58.921 INFO:tasks.rados.rados.0.trial188.stdout:28: oid 28 version 6 is already newer than 4 2026-02-13T20:11:58.921 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 28 v 6 (ObjNum 27 snap 0 seq_num 27) dirty exists 2026-02-13T20:11:58.921 INFO:tasks.rados.rados.0.trial188.stdout:28: left oid 28 (ObjNum 27 snap 0 seq_num 27) 2026-02-13T20:11:58.921 INFO:tasks.rados.rados.0.trial188.stdout:27: finishing write tid 3 to trial18843701-27 2026-02-13T20:11:58.921 INFO:tasks.rados.rados.0.trial188.stdout:27: finishing write tid 4 to trial18843701-27 2026-02-13T20:11:58.921 INFO:tasks.rados.rados.0.trial188.stdout:27: oid 27 updating version 0 to 5 2026-02-13T20:11:58.921 INFO:tasks.rados.rados.0.trial188.stdout:27: oid 27 updating version 5 to 6 2026-02-13T20:11:58.921 INFO:tasks.rados.rados.0.trial188.stdout:27: oid 27 version 6 is already newer than 4 2026-02-13T20:11:58.921 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 27 v 6 (ObjNum 26 snap 0 seq_num 26) dirty exists 2026-02-13T20:11:58.921 INFO:tasks.rados.rados.0.trial188.stdout:27: left oid 27 (ObjNum 26 snap 0 seq_num 26) 2026-02-13T20:11:58.921 INFO:tasks.rados.rados.0.trial188.stdout:30: finishing write tid 1 to trial18843701-30 2026-02-13T20:11:58.922 INFO:tasks.rados.rados.0.trial188.stdout:30: finishing write tid 2 to trial18843701-30 2026-02-13T20:11:58.922 INFO:tasks.rados.rados.0.trial188.stdout:30: finishing write tid 3 to trial18843701-30 2026-02-13T20:11:58.922 INFO:tasks.rados.rados.0.trial188.stdout:30: finishing write tid 4 to trial18843701-30 2026-02-13T20:11:58.922 INFO:tasks.rados.rados.0.trial188.stdout:30: oid 30 updating version 0 to 7 2026-02-13T20:11:58.922 INFO:tasks.rados.rados.0.trial188.stdout:30: oid 30 updating version 7 to 8 2026-02-13T20:11:58.922 INFO:tasks.rados.rados.0.trial188.stdout:30: oid 30 updating version 8 to 9 2026-02-13T20:11:58.922 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 30 v 9 (ObjNum 29 snap 0 seq_num 29) dirty exists 2026-02-13T20:11:58.922 INFO:tasks.rados.rados.0.trial188.stdout:30: left oid 30 (ObjNum 29 snap 0 seq_num 29) 2026-02-13T20:11:58.922 INFO:tasks.rados.rados.0.trial188.stdout:31: finishing write tid 1 to trial18843701-31 2026-02-13T20:11:58.922 INFO:tasks.rados.rados.0.trial188.stdout:31: finishing write tid 2 to trial18843701-31 2026-02-13T20:11:58.922 INFO:tasks.rados.rados.0.trial188.stdout:31: finishing write tid 3 to trial18843701-31 2026-02-13T20:11:58.922 INFO:tasks.rados.rados.0.trial188.stdout:31: finishing write tid 4 to trial18843701-31 2026-02-13T20:11:58.922 INFO:tasks.rados.rados.0.trial188.stdout:31: oid 31 updating version 0 to 2 2026-02-13T20:11:58.923 INFO:tasks.rados.rados.0.trial188.stdout:31: oid 31 updating version 2 to 3 2026-02-13T20:11:58.923 INFO:tasks.rados.rados.0.trial188.stdout:31: oid 31 version 3 is already newer than 1 2026-02-13T20:11:58.923 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 31 v 3 (ObjNum 30 snap 0 seq_num 30) dirty exists 2026-02-13T20:11:58.923 INFO:tasks.rados.rados.0.trial188.stdout:31: left oid 31 (ObjNum 30 snap 0 seq_num 30) 2026-02-13T20:11:58.923 INFO:tasks.rados.rados.0.trial188.stdout:32: finishing write tid 1 to trial18843701-32 2026-02-13T20:11:58.923 INFO:tasks.rados.rados.0.trial188.stdout:33: finishing write tid 1 to trial18843701-33 2026-02-13T20:11:58.923 INFO:tasks.rados.rados.0.trial188.stdout:32: finishing write tid 2 to trial18843701-32 2026-02-13T20:11:58.923 INFO:tasks.rados.rados.0.trial188.stdout:27: done (15 left) 2026-02-13T20:11:58.923 INFO:tasks.rados.rados.0.trial188.stdout:28: done (14 left) 2026-02-13T20:11:58.923 INFO:tasks.rados.rados.0.trial188.stdout:30: done (13 left) 2026-02-13T20:11:58.923 INFO:tasks.rados.rados.0.trial188.stdout:31: done (12 left) 2026-02-13T20:11:58.923 INFO:tasks.rados.rados.0.trial188.stdout:44: write initial oid 44 2026-02-13T20:11:58.923 INFO:tasks.rados.rados.0.trial188.stdout:44: seq_num 43 ranges {722701=617472,1816608=788001} 2026-02-13T20:11:58.924 INFO:tasks.rados.rados.0.trial188.stdout:44: writing trial18843701-44 from 722701 to 1340173 tid 1 2026-02-13T20:11:58.929 INFO:tasks.rados.rados.0.trial188.stdout:44: writing trial18843701-44 from 1816608 to 2604609 tid 2 2026-02-13T20:11:58.929 INFO:tasks.rados.rados.0.trial188.stdout:45: write initial oid 45 2026-02-13T20:11:58.929 INFO:tasks.rados.rados.0.trial188.stdout:45: seq_num 44 ranges {739508=692721,1875090=648012} 2026-02-13T20:11:58.934 INFO:tasks.rados.rados.0.trial188.stdout:45: writing trial18843701-45 from 739508 to 1432229 tid 1 2026-02-13T20:11:58.939 INFO:tasks.rados.rados.0.trial188.stdout:45: writing trial18843701-45 from 1875090 to 2523102 tid 2 2026-02-13T20:11:58.939 INFO:tasks.rados.rados.0.trial188.stdout:46: write initial oid 46 2026-02-13T20:11:58.939 INFO:tasks.rados.rados.0.trial188.stdout:32: finishing write tid 3 to trial18843701-32 2026-02-13T20:11:58.939 INFO:tasks.rados.rados.0.trial188.stdout:32: finishing write tid 4 to trial18843701-32 2026-02-13T20:11:58.939 INFO:tasks.rados.rados.0.trial188.stdout:32: oid 32 updating version 0 to 1 2026-02-13T20:11:58.939 INFO:tasks.rados.rados.0.trial188.stdout:32: oid 32 updating version 1 to 3 2026-02-13T20:11:58.939 INFO:tasks.rados.rados.0.trial188.stdout:32: oid 32 version 3 is already newer than 2 2026-02-13T20:11:58.939 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 32 v 3 (ObjNum 31 snap 0 seq_num 31) dirty exists 2026-02-13T20:11:58.940 INFO:tasks.rados.rados.0.trial188.stdout:32: left oid 32 (ObjNum 31 snap 0 seq_num 31) 2026-02-13T20:11:58.940 INFO:tasks.rados.rados.0.trial188.stdout:33: finishing write tid 2 to trial18843701-33 2026-02-13T20:11:58.940 INFO:tasks.rados.rados.0.trial188.stdout:33: finishing write tid 3 to trial18843701-33 2026-02-13T20:11:58.940 INFO:tasks.rados.rados.0.trial188.stdout:33: finishing write tid 4 to trial18843701-33 2026-02-13T20:11:58.940 INFO:tasks.rados.rados.0.trial188.stdout:33: oid 33 updating version 0 to 3 2026-02-13T20:11:58.940 INFO:tasks.rados.rados.0.trial188.stdout:33: oid 33 version 3 is already newer than 1 2026-02-13T20:11:58.940 INFO:tasks.rados.rados.0.trial188.stdout:33: oid 33 version 3 is already newer than 2 2026-02-13T20:11:58.940 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 33 v 3 (ObjNum 32 snap 0 seq_num 32) dirty exists 2026-02-13T20:11:58.940 INFO:tasks.rados.rados.0.trial188.stdout:33: left oid 33 (ObjNum 32 snap 0 seq_num 32) 2026-02-13T20:11:58.940 INFO:tasks.rados.rados.0.trial188.stdout:34: finishing write tid 1 to trial18843701-34 2026-02-13T20:11:58.940 INFO:tasks.rados.rados.0.trial188.stdout:46: seq_num 45 ranges {756315=767970,1933572=791670} 2026-02-13T20:11:58.944 INFO:tasks.rados.rados.0.trial188.stdout:46: writing trial18843701-46 from 756315 to 1524285 tid 1 2026-02-13T20:11:58.949 INFO:tasks.rados.rados.0.trial188.stdout:46: writing trial18843701-46 from 1933572 to 2725242 tid 2 2026-02-13T20:11:58.949 INFO:tasks.rados.rados.0.trial188.stdout:32: done (14 left) 2026-02-13T20:11:58.949 INFO:tasks.rados.rados.0.trial188.stdout:33: done (13 left) 2026-02-13T20:11:58.950 INFO:tasks.rados.rados.0.trial188.stdout:47: write initial oid 47 2026-02-13T20:11:58.950 INFO:tasks.rados.rados.0.trial188.stdout:47: seq_num 46 ranges {773122=559572,1992054=651681} 2026-02-13T20:11:58.954 INFO:tasks.rados.rados.0.trial188.stdout:47: writing trial18843701-47 from 773122 to 1332694 tid 1 2026-02-13T20:11:58.959 INFO:tasks.rados.rados.0.trial188.stdout:47: writing trial18843701-47 from 1992054 to 2643735 tid 2 2026-02-13T20:11:58.959 INFO:tasks.rados.rados.0.trial188.stdout:48: write initial oid 48 2026-02-13T20:11:58.959 INFO:tasks.rados.rados.0.trial188.stdout:48: seq_num 47 ranges {789929=634821,2050536=739393} 2026-02-13T20:11:58.964 INFO:tasks.rados.rados.0.trial188.stdout:48: writing trial18843701-48 from 789929 to 1424750 tid 1 2026-02-13T20:11:58.969 INFO:tasks.rados.rados.0.trial188.stdout:48: writing trial18843701-48 from 2050536 to 2789929 tid 2 2026-02-13T20:11:58.969 INFO:tasks.rados.rados.0.trial188.stdout:49: write initial oid 49 2026-02-13T20:11:58.969 INFO:tasks.rados.rados.0.trial188.stdout:49: seq_num 48 ranges {406736=710070,1709018=655350} 2026-02-13T20:11:58.973 INFO:tasks.rados.rados.0.trial188.stdout:49: writing trial18843701-49 from 406736 to 1116806 tid 1 2026-02-13T20:11:58.979 INFO:tasks.rados.rados.0.trial188.stdout:49: writing trial18843701-49 from 1709018 to 2364368 tid 2 2026-02-13T20:11:58.979 INFO:tasks.rados.rados.0.trial188.stdout: waiting on 16 2026-02-13T20:11:58.979 INFO:tasks.rados.rados.0.trial188.stdout:34: finishing write tid 2 to trial18843701-34 2026-02-13T20:11:58.979 INFO:tasks.rados.rados.0.trial188.stdout:34: finishing write tid 3 to trial18843701-34 2026-02-13T20:11:58.979 INFO:tasks.rados.rados.0.trial188.stdout:34: finishing write tid 4 to trial18843701-34 2026-02-13T20:11:58.979 INFO:tasks.rados.rados.0.trial188.stdout:34: oid 34 updating version 0 to 9 2026-02-13T20:11:58.979 INFO:tasks.rados.rados.0.trial188.stdout:34: oid 34 version 9 is already newer than 8 2026-02-13T20:11:58.979 INFO:tasks.rados.rados.0.trial188.stdout:34: oid 34 version 9 is already newer than 7 2026-02-13T20:11:58.979 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 34 v 9 (ObjNum 33 snap 0 seq_num 33) dirty exists 2026-02-13T20:11:58.979 INFO:tasks.rados.rados.0.trial188.stdout:34: left oid 34 (ObjNum 33 snap 0 seq_num 33) 2026-02-13T20:11:58.979 INFO:tasks.rados.rados.0.trial188.stdout:35: finishing write tid 1 to trial18843701-35 2026-02-13T20:11:58.980 INFO:tasks.rados.rados.0.trial188.stdout:34: done (15 left) 2026-02-13T20:11:58.980 INFO:tasks.rados.rados.0.trial188.stdout:50: write initial oid 50 2026-02-13T20:11:58.980 INFO:tasks.rados.rados.0.trial188.stdout:50: seq_num 49 ranges {423543=785319,1767500=799008} 2026-02-13T20:11:58.983 INFO:tasks.rados.rados.0.trial188.stdout:50: writing trial18843701-50 from 423543 to 1208862 tid 1 2026-02-13T20:11:58.991 INFO:tasks.rados.rados.0.trial188.stdout:50: writing trial18843701-50 from 1767500 to 2566508 tid 2 2026-02-13T20:11:58.992 INFO:tasks.rados.rados.0.trial188.stdout: waiting on 16 2026-02-13T20:11:58.992 INFO:tasks.rados.rados.0.trial188.stdout:36: finishing write tid 1 to trial18843701-36 2026-02-13T20:11:58.992 INFO:tasks.rados.rados.0.trial188.stdout:36: finishing write tid 2 to trial18843701-36 2026-02-13T20:11:58.992 INFO:tasks.rados.rados.0.trial188.stdout:36: finishing write tid 3 to trial18843701-36 2026-02-13T20:11:58.992 INFO:tasks.rados.rados.0.trial188.stdout:36: finishing write tid 4 to trial18843701-36 2026-02-13T20:11:58.992 INFO:tasks.rados.rados.0.trial188.stdout:36: oid 36 updating version 0 to 14 2026-02-13T20:11:58.992 INFO:tasks.rados.rados.0.trial188.stdout:36: oid 36 version 14 is already newer than 13 2026-02-13T20:11:58.992 INFO:tasks.rados.rados.0.trial188.stdout:36: oid 36 updating version 14 to 15 2026-02-13T20:11:58.992 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 36 v 15 (ObjNum 35 snap 0 seq_num 35) dirty exists 2026-02-13T20:11:58.992 INFO:tasks.rados.rados.0.trial188.stdout:36: left oid 36 (ObjNum 35 snap 0 seq_num 35) 2026-02-13T20:11:58.993 INFO:tasks.rados.rados.0.trial188.stdout:37: finishing write tid 1 to trial18843701-37 2026-02-13T20:11:58.993 INFO:tasks.rados.rados.0.trial188.stdout:35: finishing write tid 2 to trial18843701-35 2026-02-13T20:11:58.993 INFO:tasks.rados.rados.0.trial188.stdout:35: finishing write tid 3 to trial18843701-35 2026-02-13T20:11:58.993 INFO:tasks.rados.rados.0.trial188.stdout:35: finishing write tid 4 to trial18843701-35 2026-02-13T20:11:58.993 INFO:tasks.rados.rados.0.trial188.stdout:35: oid 35 updating version 0 to 5 2026-02-13T20:11:58.993 INFO:tasks.rados.rados.0.trial188.stdout:35: oid 35 updating version 5 to 6 2026-02-13T20:11:58.993 INFO:tasks.rados.rados.0.trial188.stdout:35: oid 35 version 6 is already newer than 4 2026-02-13T20:11:58.993 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 35 v 6 (ObjNum 34 snap 0 seq_num 34) dirty exists 2026-02-13T20:11:58.993 INFO:tasks.rados.rados.0.trial188.stdout:35: left oid 35 (ObjNum 34 snap 0 seq_num 34) 2026-02-13T20:11:58.993 INFO:tasks.rados.rados.0.trial188.stdout:37: finishing write tid 2 to trial18843701-37 2026-02-13T20:11:58.993 INFO:tasks.rados.rados.0.trial188.stdout:35: done (15 left) 2026-02-13T20:11:58.993 INFO:tasks.rados.rados.0.trial188.stdout:36: done (14 left) 2026-02-13T20:11:58.994 INFO:tasks.rados.rados.0.trial188.stdout:51: copy_from oid 35 from oid 6 current snap is 0 2026-02-13T20:11:58.994 INFO:tasks.rados.rados.0.trial188.stdout:38: finishing write tid 1 to trial18843701-38 2026-02-13T20:11:58.994 INFO:tasks.rados.rados.0.trial188.stdout:37: finishing write tid 3 to trial18843701-37 2026-02-13T20:11:58.994 INFO:tasks.rados.rados.0.trial188.stdout:37: finishing write tid 4 to trial18843701-37 2026-02-13T20:11:58.994 INFO:tasks.rados.rados.0.trial188.stdout:37: oid 37 updating version 0 to 11 2026-02-13T20:11:58.994 INFO:tasks.rados.rados.0.trial188.stdout:37: oid 37 updating version 11 to 12 2026-02-13T20:11:58.994 INFO:tasks.rados.rados.0.trial188.stdout:37: oid 37 version 12 is already newer than 10 2026-02-13T20:11:58.994 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 37 v 12 (ObjNum 36 snap 0 seq_num 36) dirty exists 2026-02-13T20:11:58.994 INFO:tasks.rados.rados.0.trial188.stdout:37: left oid 37 (ObjNum 36 snap 0 seq_num 36) 2026-02-13T20:11:58.994 INFO:tasks.rados.rados.0.trial188.stdout:38: finishing write tid 2 to trial18843701-38 2026-02-13T20:11:58.994 INFO:tasks.rados.rados.0.trial188.stdout:37: done (14 left) 2026-02-13T20:11:58.994 INFO:tasks.rados.rados.0.trial188.stdout:52: snap_create 2026-02-13T20:11:58.995 INFO:tasks.rados.rados.0.trial188.stdout:38: finishing write tid 3 to trial18843701-38 2026-02-13T20:11:58.995 INFO:tasks.rados.rados.0.trial188.stdout:38: finishing write tid 4 to trial18843701-38 2026-02-13T20:11:58.995 INFO:tasks.rados.rados.0.trial188.stdout:38: oid 38 updating version 0 to 10 2026-02-13T20:11:58.995 INFO:tasks.rados.rados.0.trial188.stdout:38: oid 38 updating version 10 to 11 2026-02-13T20:11:58.995 INFO:tasks.rados.rados.0.trial188.stdout:38: oid 38 updating version 11 to 12 2026-02-13T20:11:58.995 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 38 v 12 (ObjNum 37 snap 0 seq_num 37) dirty exists 2026-02-13T20:11:58.995 INFO:tasks.rados.rados.0.trial188.stdout:38: left oid 38 (ObjNum 37 snap 0 seq_num 37) 2026-02-13T20:11:58.995 INFO:tasks.rados.rados.0.trial188.stdout:39: finishing write tid 1 to trial18843701-39 2026-02-13T20:11:58.995 INFO:tasks.rados.rados.0.trial188.stdout:39: finishing write tid 2 to trial18843701-39 2026-02-13T20:11:58.995 INFO:tasks.rados.rados.0.trial188.stdout:39: finishing write tid 3 to trial18843701-39 2026-02-13T20:11:58.995 INFO:tasks.rados.rados.0.trial188.stdout:39: finishing write tid 4 to trial18843701-39 2026-02-13T20:11:58.995 INFO:tasks.rados.rados.0.trial188.stdout:39: oid 39 updating version 0 to 11 2026-02-13T20:11:58.995 INFO:tasks.rados.rados.0.trial188.stdout:39: oid 39 updating version 11 to 12 2026-02-13T20:11:58.996 INFO:tasks.rados.rados.0.trial188.stdout:39: oid 39 version 12 is already newer than 10 2026-02-13T20:11:58.996 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 39 v 12 (ObjNum 38 snap 0 seq_num 38) dirty exists 2026-02-13T20:11:58.996 INFO:tasks.rados.rados.0.trial188.stdout:39: left oid 39 (ObjNum 38 snap 0 seq_num 38) 2026-02-13T20:11:58.996 INFO:tasks.rados.rados.0.trial188.stdout:40: finishing write tid 1 to trial18843701-40 2026-02-13T20:11:58.996 INFO:tasks.rados.rados.0.trial188.stdout:42: finishing write tid 1 to trial18843701-42 2026-02-13T20:11:58.996 INFO:tasks.rados.rados.0.trial188.stdout:42: finishing write tid 2 to trial18843701-42 2026-02-13T20:11:58.996 INFO:tasks.rados.rados.0.trial188.stdout:42: finishing write tid 3 to trial18843701-42 2026-02-13T20:11:58.996 INFO:tasks.rados.rados.0.trial188.stdout:42: finishing write tid 4 to trial18843701-42 2026-02-13T20:11:58.996 INFO:tasks.rados.rados.0.trial188.stdout:42: oid 42 updating version 0 to 7 2026-02-13T20:11:58.996 INFO:tasks.rados.rados.0.trial188.stdout:42: oid 42 updating version 7 to 8 2026-02-13T20:11:58.996 INFO:tasks.rados.rados.0.trial188.stdout:42: oid 42 updating version 8 to 9 2026-02-13T20:11:58.996 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 42 v 9 (ObjNum 41 snap 0 seq_num 41) dirty exists 2026-02-13T20:11:58.997 INFO:tasks.rados.rados.0.trial188.stdout:42: left oid 42 (ObjNum 41 snap 0 seq_num 41) 2026-02-13T20:11:58.997 INFO:tasks.rados.rados.0.trial188.stdout:40: finishing write tid 2 to trial18843701-40 2026-02-13T20:11:58.997 INFO:tasks.rados.rados.0.trial188.stdout:40: finishing write tid 3 to trial18843701-40 2026-02-13T20:11:58.997 INFO:tasks.rados.rados.0.trial188.stdout:40: finishing write tid 4 to trial18843701-40 2026-02-13T20:11:58.997 INFO:tasks.rados.rados.0.trial188.stdout:40: oid 40 updating version 0 to 6 2026-02-13T20:11:58.997 INFO:tasks.rados.rados.0.trial188.stdout:40: oid 40 version 6 is already newer than 4 2026-02-13T20:11:58.997 INFO:tasks.rados.rados.0.trial188.stdout:40: oid 40 version 6 is already newer than 5 2026-02-13T20:11:58.997 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 40 v 6 (ObjNum 39 snap 0 seq_num 39) dirty exists 2026-02-13T20:11:58.997 INFO:tasks.rados.rados.0.trial188.stdout:40: left oid 40 (ObjNum 39 snap 0 seq_num 39) 2026-02-13T20:11:58.997 INFO:tasks.rados.rados.0.trial188.stdout:41: finishing write tid 1 to trial18843701-41 2026-02-13T20:11:58.997 INFO:tasks.rados.rados.0.trial188.stdout:41: finishing write tid 2 to trial18843701-41 2026-02-13T20:11:58.997 INFO:tasks.rados.rados.0.trial188.stdout:41: finishing write tid 3 to trial18843701-41 2026-02-13T20:11:58.997 INFO:tasks.rados.rados.0.trial188.stdout:41: finishing write tid 4 to trial18843701-41 2026-02-13T20:11:58.998 INFO:tasks.rados.rados.0.trial188.stdout:41: oid 41 updating version 0 to 9 2026-02-13T20:11:58.998 INFO:tasks.rados.rados.0.trial188.stdout:41: oid 41 version 9 is already newer than 8 2026-02-13T20:11:58.998 INFO:tasks.rados.rados.0.trial188.stdout:41: oid 41 version 9 is already newer than 7 2026-02-13T20:11:58.998 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 41 v 9 (ObjNum 40 snap 0 seq_num 40) dirty exists 2026-02-13T20:11:58.998 INFO:tasks.rados.rados.0.trial188.stdout:41: left oid 41 (ObjNum 40 snap 0 seq_num 40) 2026-02-13T20:11:58.998 INFO:tasks.rados.rados.0.trial188.stdout:43: finishing write tid 1 to trial18843701-43 2026-02-13T20:11:58.998 INFO:tasks.rados.rados.0.trial188.stdout:43: finishing write tid 2 to trial18843701-43 2026-02-13T20:11:58.998 INFO:tasks.rados.rados.0.trial188.stdout:43: finishing write tid 3 to trial18843701-43 2026-02-13T20:11:58.998 INFO:tasks.rados.rados.0.trial188.stdout:43: finishing write tid 4 to trial18843701-43 2026-02-13T20:11:58.998 INFO:tasks.rados.rados.0.trial188.stdout:43: oid 43 updating version 0 to 6 2026-02-13T20:11:58.998 INFO:tasks.rados.rados.0.trial188.stdout:43: oid 43 version 6 is already newer than 5 2026-02-13T20:11:58.998 INFO:tasks.rados.rados.0.trial188.stdout:43: oid 43 version 6 is already newer than 4 2026-02-13T20:11:58.998 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 43 v 6 (ObjNum 42 snap 0 seq_num 42) dirty exists 2026-02-13T20:11:58.999 INFO:tasks.rados.rados.0.trial188.stdout:43: left oid 43 (ObjNum 42 snap 0 seq_num 42) 2026-02-13T20:11:58.999 INFO:tasks.rados.rados.0.trial188.stdout:44: finishing write tid 1 to trial18843701-44 2026-02-13T20:11:58.999 INFO:tasks.rados.rados.0.trial188.stdout:45: finishing write tid 1 to trial18843701-45 2026-02-13T20:11:58.999 INFO:tasks.rados.rados.0.trial188.stdout:45: finishing write tid 2 to trial18843701-45 2026-02-13T20:11:58.999 INFO:tasks.rados.rados.0.trial188.stdout:45: finishing write tid 3 to trial18843701-45 2026-02-13T20:11:58.999 INFO:tasks.rados.rados.0.trial188.stdout:45: finishing write tid 4 to trial18843701-45 2026-02-13T20:11:58.999 INFO:tasks.rados.rados.0.trial188.stdout:45: oid 45 updating version 0 to 14 2026-02-13T20:11:58.999 INFO:tasks.rados.rados.0.trial188.stdout:45: oid 45 version 14 is already newer than 13 2026-02-13T20:11:58.999 INFO:tasks.rados.rados.0.trial188.stdout:45: oid 45 updating version 14 to 15 2026-02-13T20:11:58.999 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 45 v 15 (ObjNum 44 snap 0 seq_num 44) dirty exists 2026-02-13T20:11:58.999 INFO:tasks.rados.rados.0.trial188.stdout:45: left oid 45 (ObjNum 44 snap 0 seq_num 44) 2026-02-13T20:11:58.999 INFO:tasks.rados.rados.0.trial188.stdout:44: finishing write tid 2 to trial18843701-44 2026-02-13T20:11:58.999 INFO:tasks.rados.rados.0.trial188.stdout:44: finishing write tid 3 to trial18843701-44 2026-02-13T20:11:59.000 INFO:tasks.rados.rados.0.trial188.stdout:44: finishing write tid 4 to trial18843701-44 2026-02-13T20:11:59.000 INFO:tasks.rados.rados.0.trial188.stdout:44: oid 44 updating version 0 to 14 2026-02-13T20:11:59.000 INFO:tasks.rados.rados.0.trial188.stdout:44: oid 44 updating version 14 to 15 2026-02-13T20:11:59.000 INFO:tasks.rados.rados.0.trial188.stdout:44: oid 44 version 15 is already newer than 13 2026-02-13T20:11:59.000 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 44 v 15 (ObjNum 43 snap 0 seq_num 43) dirty exists 2026-02-13T20:11:59.000 INFO:tasks.rados.rados.0.trial188.stdout:44: left oid 44 (ObjNum 43 snap 0 seq_num 43) 2026-02-13T20:11:59.000 INFO:tasks.rados.rados.0.trial188.stdout:47: finishing write tid 1 to trial18843701-47 2026-02-13T20:11:59.000 INFO:tasks.rados.rados.0.trial188.stdout:47: finishing write tid 2 to trial18843701-47 2026-02-13T20:11:59.000 INFO:tasks.rados.rados.0.trial188.stdout:47: finishing write tid 3 to trial18843701-47 2026-02-13T20:11:59.000 INFO:tasks.rados.rados.0.trial188.stdout:47: finishing write tid 4 to trial18843701-47 2026-02-13T20:11:59.000 INFO:tasks.rados.rados.0.trial188.stdout:47: oid 47 updating version 0 to 6 2026-02-13T20:11:59.000 INFO:tasks.rados.rados.0.trial188.stdout:47: oid 47 version 6 is already newer than 4 2026-02-13T20:11:59.000 INFO:tasks.rados.rados.0.trial188.stdout:47: oid 47 version 6 is already newer than 5 2026-02-13T20:11:59.001 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 47 v 6 (ObjNum 46 snap 0 seq_num 46) dirty exists 2026-02-13T20:11:59.001 INFO:tasks.rados.rados.0.trial188.stdout:47: left oid 47 (ObjNum 46 snap 0 seq_num 46) 2026-02-13T20:11:59.001 INFO:tasks.rados.rados.0.trial188.stdout:46: finishing write tid 1 to trial18843701-46 2026-02-13T20:11:59.001 INFO:tasks.rados.rados.0.trial188.stdout:46: finishing write tid 2 to trial18843701-46 2026-02-13T20:11:59.001 INFO:tasks.rados.rados.0.trial188.stdout:46: finishing write tid 3 to trial18843701-46 2026-02-13T20:11:59.001 INFO:tasks.rados.rados.0.trial188.stdout:46: finishing write tid 4 to trial18843701-46 2026-02-13T20:11:59.001 INFO:tasks.rados.rados.0.trial188.stdout:46: oid 46 updating version 0 to 10 2026-02-13T20:11:59.001 INFO:tasks.rados.rados.0.trial188.stdout:46: oid 46 updating version 10 to 11 2026-02-13T20:11:59.001 INFO:tasks.rados.rados.0.trial188.stdout:46: oid 46 updating version 11 to 12 2026-02-13T20:11:59.001 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 46 v 12 (ObjNum 45 snap 0 seq_num 45) dirty exists 2026-02-13T20:11:59.001 INFO:tasks.rados.rados.0.trial188.stdout:46: left oid 46 (ObjNum 45 snap 0 seq_num 45) 2026-02-13T20:11:59.001 INFO:tasks.rados.rados.0.trial188.stdout:48: finishing write tid 1 to trial18843701-48 2026-02-13T20:11:59.001 INFO:tasks.rados.rados.0.trial188.stdout:48: finishing write tid 2 to trial18843701-48 2026-02-13T20:11:59.001 INFO:tasks.rados.rados.0.trial188.stdout:48: finishing write tid 3 to trial18843701-48 2026-02-13T20:11:59.002 INFO:tasks.rados.rados.0.trial188.stdout:48: finishing write tid 4 to trial18843701-48 2026-02-13T20:11:59.002 INFO:tasks.rados.rados.0.trial188.stdout:48: oid 48 updating version 0 to 5 2026-02-13T20:11:59.002 INFO:tasks.rados.rados.0.trial188.stdout:48: oid 48 updating version 5 to 6 2026-02-13T20:11:59.002 INFO:tasks.rados.rados.0.trial188.stdout:48: oid 48 version 6 is already newer than 4 2026-02-13T20:11:59.002 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 48 v 6 (ObjNum 47 snap 0 seq_num 47) dirty exists 2026-02-13T20:11:59.002 INFO:tasks.rados.rados.0.trial188.stdout:48: left oid 48 (ObjNum 47 snap 0 seq_num 47) 2026-02-13T20:11:59.003 INFO:tasks.rados.rados.0.trial188.stdout:49: finishing write tid 1 to trial18843701-49 2026-02-13T20:11:59.003 INFO:tasks.rados.rados.0.trial188.stdout:49: finishing write tid 2 to trial18843701-49 2026-02-13T20:11:59.003 INFO:tasks.rados.rados.0.trial188.stdout:49: finishing write tid 3 to trial18843701-49 2026-02-13T20:11:59.003 INFO:tasks.rados.rados.0.trial188.stdout:49: finishing write tid 4 to trial18843701-49 2026-02-13T20:11:59.003 INFO:tasks.rados.rados.0.trial188.stdout:49: oid 49 updating version 0 to 14 2026-02-13T20:11:59.003 INFO:tasks.rados.rados.0.trial188.stdout:49: oid 49 updating version 14 to 15 2026-02-13T20:11:59.003 INFO:tasks.rados.rados.0.trial188.stdout:49: oid 49 version 15 is already newer than 13 2026-02-13T20:11:59.004 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 49 v 15 (ObjNum 48 snap 0 seq_num 48) dirty exists 2026-02-13T20:11:59.004 INFO:tasks.rados.rados.0.trial188.stdout:49: left oid 49 (ObjNum 48 snap 0 seq_num 48) 2026-02-13T20:11:59.004 INFO:tasks.rados.rados.0.trial188.stdout:50: finishing write tid 1 to trial18843701-50 2026-02-13T20:11:59.005 INFO:tasks.rados.rados.0.trial188.stdout:50: finishing write tid 2 to trial18843701-50 2026-02-13T20:11:59.005 INFO:tasks.rados.rados.0.trial188.stdout:50: finishing write tid 3 to trial18843701-50 2026-02-13T20:11:59.005 INFO:tasks.rados.rados.0.trial188.stdout:50: finishing write tid 4 to trial18843701-50 2026-02-13T20:11:59.005 INFO:tasks.rados.rados.0.trial188.stdout:50: oid 50 updating version 0 to 18 2026-02-13T20:11:59.005 INFO:tasks.rados.rados.0.trial188.stdout:50: oid 50 version 18 is already newer than 16 2026-02-13T20:11:59.005 INFO:tasks.rados.rados.0.trial188.stdout:50: oid 50 version 18 is already newer than 17 2026-02-13T20:11:59.005 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 50 v 18 (ObjNum 49 snap 0 seq_num 49) dirty exists 2026-02-13T20:11:59.005 INFO:tasks.rados.rados.0.trial188.stdout:50: left oid 50 (ObjNum 49 snap 0 seq_num 49) 2026-02-13T20:11:59.018 INFO:tasks.rados.rados.0.trial188.stdout:51: finishing copy_from racing read to trial18843701-35 2026-02-13T20:11:59.020 INFO:tasks.rados.rados.0.trial188.stdout:51: finishing copy_from to trial18843701-35 2026-02-13T20:11:59.020 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 35 v 3 (ObjNum 5 snap 0 seq_num 5) dirty exists 2026-02-13T20:11:59.552 INFO:tasks.rados.rados.0.trial188.stdout:38: done (14 left) 2026-02-13T20:11:59.552 INFO:tasks.rados.rados.0.trial188.stdout:39: done (13 left) 2026-02-13T20:11:59.552 INFO:tasks.rados.rados.0.trial188.stdout:40: done (12 left) 2026-02-13T20:11:59.552 INFO:tasks.rados.rados.0.trial188.stdout:41: done (11 left) 2026-02-13T20:11:59.552 INFO:tasks.rados.rados.0.trial188.stdout:42: done (10 left) 2026-02-13T20:11:59.552 INFO:tasks.rados.rados.0.trial188.stdout:43: done (9 left) 2026-02-13T20:11:59.552 INFO:tasks.rados.rados.0.trial188.stdout:44: done (8 left) 2026-02-13T20:11:59.552 INFO:tasks.rados.rados.0.trial188.stdout:45: done (7 left) 2026-02-13T20:11:59.552 INFO:tasks.rados.rados.0.trial188.stdout:46: done (6 left) 2026-02-13T20:11:59.552 INFO:tasks.rados.rados.0.trial188.stdout:47: done (5 left) 2026-02-13T20:11:59.552 INFO:tasks.rados.rados.0.trial188.stdout:48: done (4 left) 2026-02-13T20:11:59.552 INFO:tasks.rados.rados.0.trial188.stdout:49: done (3 left) 2026-02-13T20:11:59.553 INFO:tasks.rados.rados.0.trial188.stdout:50: done (2 left) 2026-02-13T20:11:59.553 INFO:tasks.rados.rados.0.trial188.stdout:51: done (1 left) 2026-02-13T20:11:59.553 INFO:tasks.rados.rados.0.trial188.stdout:52: done (0 left) 2026-02-13T20:11:59.553 INFO:tasks.rados.rados.0.trial188.stdout:53: delete oid 48 current snap is 1 2026-02-13T20:11:59.554 INFO:tasks.rados.rados.0.trial188.stdout:53: done (0 left) 2026-02-13T20:11:59.554 INFO:tasks.rados.rados.0.trial188.stdout:54: read oid 4 snap 0 2026-02-13T20:11:59.554 INFO:tasks.rados.rados.0.trial188.stdout:54: expect (ObjNum 3 snap 0 seq_num 3) 2026-02-13T20:11:59.554 INFO:tasks.rados.rados.0.trial188.stdout:55: write oid 3 current snap is 1 2026-02-13T20:11:59.554 INFO:tasks.rados.rados.0.trial188.stdout:55: seq_num 51 ranges {457157=535817,1768111=402677} 2026-02-13T20:11:59.558 INFO:tasks.rados.rados.0.trial188.stdout:55: writing trial18843701-3 from 457157 to 992974 tid 1 2026-02-13T20:11:59.563 INFO:tasks.rados.rados.0.trial188.stdout:55: writing trial18843701-3 from 1768111 to 2170788 tid 2 2026-02-13T20:11:59.563 INFO:tasks.rados.rados.0.trial188.stdout:56: write oid 13 current snap is 1 2026-02-13T20:11:59.563 INFO:tasks.rados.rados.0.trial188.stdout:56: seq_num 52 ranges {473964=611066,1826593=546335,2778819=95145} 2026-02-13T20:11:59.567 INFO:tasks.rados.rados.0.trial188.stdout:56: writing trial18843701-13 from 473964 to 1085030 tid 1 2026-02-13T20:11:59.572 INFO:tasks.rados.rados.0.trial188.stdout:56: writing trial18843701-13 from 1826593 to 2372928 tid 2 2026-02-13T20:11:59.574 INFO:tasks.rados.rados.0.trial188.stdout:56: writing trial18843701-13 from 2778819 to 2873964 tid 3 2026-02-13T20:11:59.574 INFO:tasks.rados.rados.0.trial188.stdout:57: write oid 17 current snap is 1 2026-02-13T20:11:59.574 INFO:tasks.rados.rados.0.trial188.stdout:57: seq_num 53 ranges {490771=686315,1885075=406346} 2026-02-13T20:11:59.578 INFO:tasks.rados.rados.0.trial188.stdout:57: writing trial18843701-17 from 490771 to 1177086 tid 1 2026-02-13T20:11:59.582 INFO:tasks.rados.rados.0.trial188.stdout:57: writing trial18843701-17 from 1885075 to 2291421 tid 2 2026-02-13T20:11:59.582 INFO:tasks.rados.rados.0.trial188.stdout:58: read oid 22 snap -1 2026-02-13T20:11:59.582 INFO:tasks.rados.rados.0.trial188.stdout:58: expect (ObjNum 21 snap 0 seq_num 21) 2026-02-13T20:11:59.582 INFO:tasks.rados.rados.0.trial188.stdout:59: read oid 14 snap -1 2026-02-13T20:11:59.582 INFO:tasks.rados.rados.0.trial188.stdout:59: expect (ObjNum 13 snap 0 seq_num 13) 2026-02-13T20:11:59.582 INFO:tasks.rados.rados.0.trial188.stdout:60: write oid 19 current snap is 1 2026-02-13T20:11:59.582 INFO:tasks.rados.rados.0.trial188.stdout:60: seq_num 54 ranges {507578=477917,1543557=550004,2833665=73913} 2026-02-13T20:11:59.585 INFO:tasks.rados.rados.0.trial188.stdout:60: writing trial18843701-19 from 507578 to 985495 tid 1 2026-02-13T20:11:59.590 INFO:tasks.rados.rados.0.trial188.stdout:60: writing trial18843701-19 from 1543557 to 2093561 tid 2 2026-02-13T20:11:59.593 INFO:tasks.rados.rados.0.trial188.stdout:60: writing trial18843701-19 from 2833665 to 2907578 tid 3 2026-02-13T20:11:59.593 INFO:tasks.rados.rados.0.trial188.stdout:61: rollback oid 20 current snap is 1 2026-02-13T20:11:59.593 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 20 to 0 2026-02-13T20:11:59.593 INFO:tasks.rados.rados.0.trial188.stdout:54: expect (ObjNum 3 snap 0 seq_num 3) 2026-02-13T20:11:59.624 INFO:tasks.rados.rados.0.trial188.stdout:55: finishing write tid 1 to trial18843701-3 2026-02-13T20:11:59.624 INFO:tasks.rados.rados.0.trial188.stdout:55: finishing write tid 2 to trial18843701-3 2026-02-13T20:11:59.624 INFO:tasks.rados.rados.0.trial188.stdout:55: finishing write tid 3 to trial18843701-3 2026-02-13T20:11:59.624 INFO:tasks.rados.rados.0.trial188.stdout:55: finishing write tid 4 to trial18843701-3 2026-02-13T20:11:59.624 INFO:tasks.rados.rados.0.trial188.stdout:55: oid 3 updating version 0 to 14 2026-02-13T20:11:59.624 INFO:tasks.rados.rados.0.trial188.stdout:55: oid 3 updating version 14 to 16 2026-02-13T20:11:59.624 INFO:tasks.rados.rados.0.trial188.stdout:55: oid 3 version 16 is already newer than 15 2026-02-13T20:11:59.624 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 3 v 16 (ObjNum 51 snap 1 seq_num 51) dirty exists 2026-02-13T20:11:59.625 INFO:tasks.rados.rados.0.trial188.stdout:55: left oid 3 (ObjNum 51 snap 1 seq_num 51) 2026-02-13T20:11:59.625 INFO:tasks.rados.rados.0.trial188.stdout:58: expect (ObjNum 21 snap 0 seq_num 21) 2026-02-13T20:11:59.625 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:11:59.661 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:11:59.679 INFO:tasks.rados.rados.0.trial188.stdout:56: finishing write tid 1 to trial18843701-13 2026-02-13T20:11:59.679 INFO:tasks.rados.rados.0.trial188.stdout:56: finishing write tid 2 to trial18843701-13 2026-02-13T20:11:59.679 INFO:tasks.rados.rados.0.trial188.stdout:56: finishing write tid 3 to trial18843701-13 2026-02-13T20:11:59.679 INFO:tasks.rados.rados.0.trial188.stdout:56: finishing write tid 4 to trial18843701-13 2026-02-13T20:11:59.679 INFO:tasks.rados.rados.0.trial188.stdout:56: finishing write tid 5 to trial18843701-13 2026-02-13T20:11:59.680 INFO:tasks.rados.rados.0.trial188.stdout:56: oid 13 updating version 0 to 17 2026-02-13T20:11:59.680 INFO:tasks.rados.rados.0.trial188.stdout:56: oid 13 updating version 17 to 20 2026-02-13T20:11:59.680 INFO:tasks.rados.rados.0.trial188.stdout:56: oid 13 version 20 is already newer than 18 2026-02-13T20:11:59.680 INFO:tasks.rados.rados.0.trial188.stdout:56: oid 13 version 20 is already newer than 19 2026-02-13T20:11:59.680 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 13 v 20 (ObjNum 52 snap 1 seq_num 52) dirty exists 2026-02-13T20:11:59.680 INFO:tasks.rados.rados.0.trial188.stdout:56: left oid 13 (ObjNum 52 snap 1 seq_num 52) 2026-02-13T20:11:59.680 INFO:tasks.rados.rados.0.trial188.stdout:59: expect (ObjNum 13 snap 0 seq_num 13) 2026-02-13T20:11:59.682 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 896394 2026-02-13T20:11:59.700 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:11:59.718 INFO:tasks.rados.rados.0.trial188.stdout:61: finishing rollback tid 0 to trial18843701-20 2026-02-13T20:11:59.718 INFO:tasks.rados.rados.0.trial188.stdout:61: finishing rollback tid 1 to trial18843701-20 2026-02-13T20:11:59.718 INFO:tasks.rados.rados.0.trial188.stdout:61: finishing rollback tid 2 to trial18843701-20 2026-02-13T20:11:59.718 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 20 v 7 (ObjNum 19 snap 0 seq_num 19) dirty exists 2026-02-13T20:11:59.718 INFO:tasks.rados.rados.0.trial188.stdout:57: finishing write tid 1 to trial18843701-17 2026-02-13T20:11:59.718 INFO:tasks.rados.rados.0.trial188.stdout:57: finishing write tid 2 to trial18843701-17 2026-02-13T20:11:59.718 INFO:tasks.rados.rados.0.trial188.stdout:54: done (7 left) 2026-02-13T20:11:59.719 INFO:tasks.rados.rados.0.trial188.stdout:55: done (6 left) 2026-02-13T20:11:59.719 INFO:tasks.rados.rados.0.trial188.stdout:56: done (5 left) 2026-02-13T20:11:59.719 INFO:tasks.rados.rados.0.trial188.stdout:58: done (4 left) 2026-02-13T20:11:59.719 INFO:tasks.rados.rados.0.trial188.stdout:59: done (3 left) 2026-02-13T20:11:59.719 INFO:tasks.rados.rados.0.trial188.stdout:61: done (2 left) 2026-02-13T20:11:59.719 INFO:tasks.rados.rados.0.trial188.stdout:62: copy_from oid 9 from oid 39 current snap is 1 2026-02-13T20:11:59.719 INFO:tasks.rados.rados.0.trial188.stdout:57: finishing write tid 3 to trial18843701-17 2026-02-13T20:11:59.719 INFO:tasks.rados.rados.0.trial188.stdout:60: finishing write tid 1 to trial18843701-19 2026-02-13T20:11:59.719 INFO:tasks.rados.rados.0.trial188.stdout:60: finishing write tid 2 to trial18843701-19 2026-02-13T20:11:59.719 INFO:tasks.rados.rados.0.trial188.stdout:57: finishing write tid 4 to trial18843701-17 2026-02-13T20:11:59.719 INFO:tasks.rados.rados.0.trial188.stdout:57: oid 17 updating version 0 to 12 2026-02-13T20:11:59.719 INFO:tasks.rados.rados.0.trial188.stdout:57: oid 17 updating version 12 to 13 2026-02-13T20:11:59.719 INFO:tasks.rados.rados.0.trial188.stdout:57: oid 17 version 13 is already newer than 11 2026-02-13T20:11:59.720 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 17 v 13 (ObjNum 53 snap 1 seq_num 53) dirty exists 2026-02-13T20:11:59.720 INFO:tasks.rados.rados.0.trial188.stdout:57: left oid 17 (ObjNum 53 snap 1 seq_num 53) 2026-02-13T20:11:59.720 INFO:tasks.rados.rados.0.trial188.stdout:60: finishing write tid 3 to trial18843701-19 2026-02-13T20:11:59.720 INFO:tasks.rados.rados.0.trial188.stdout:60: finishing write tid 4 to trial18843701-19 2026-02-13T20:11:59.720 INFO:tasks.rados.rados.0.trial188.stdout:60: finishing write tid 5 to trial18843701-19 2026-02-13T20:11:59.720 INFO:tasks.rados.rados.0.trial188.stdout:60: oid 19 updating version 0 to 14 2026-02-13T20:11:59.720 INFO:tasks.rados.rados.0.trial188.stdout:60: oid 19 updating version 14 to 15 2026-02-13T20:11:59.720 INFO:tasks.rados.rados.0.trial188.stdout:60: oid 19 updating version 15 to 16 2026-02-13T20:11:59.720 INFO:tasks.rados.rados.0.trial188.stdout:60: oid 19 updating version 16 to 17 2026-02-13T20:11:59.720 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 19 v 17 (ObjNum 54 snap 1 seq_num 54) dirty exists 2026-02-13T20:11:59.720 INFO:tasks.rados.rados.0.trial188.stdout:60: left oid 19 (ObjNum 54 snap 1 seq_num 54) 2026-02-13T20:11:59.721 INFO:tasks.rados.rados.0.trial188.stdout:57: done (2 left) 2026-02-13T20:11:59.721 INFO:tasks.rados.rados.0.trial188.stdout:60: done (1 left) 2026-02-13T20:11:59.721 INFO:tasks.rados.rados.0.trial188.stdout:63: write oid 36 current snap is 1 2026-02-13T20:11:59.721 INFO:tasks.rados.rados.0.trial188.stdout:63: seq_num 55 ranges {524385=553166,1602039=410015,2577441=346944} 2026-02-13T20:11:59.722 INFO:tasks.rados.rados.0.trial188.stdout:63: writing trial18843701-36 from 524385 to 1077551 tid 1 2026-02-13T20:11:59.725 INFO:tasks.rados.rados.0.trial188.stdout:63: writing trial18843701-36 from 1602039 to 2012054 tid 2 2026-02-13T20:11:59.729 INFO:tasks.rados.rados.0.trial188.stdout:63: writing trial18843701-36 from 2577441 to 2924385 tid 3 2026-02-13T20:11:59.729 INFO:tasks.rados.rados.0.trial188.stdout:64: read oid 42 snap -1 2026-02-13T20:11:59.729 INFO:tasks.rados.rados.0.trial188.stdout:64: expect (ObjNum 41 snap 0 seq_num 41) 2026-02-13T20:11:59.729 INFO:tasks.rados.rados.0.trial188.stdout:65: rollback oid 33 current snap is 1 2026-02-13T20:11:59.729 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 33 to 0 2026-02-13T20:11:59.729 INFO:tasks.rados.rados.0.trial188.stdout:66: snap_create 2026-02-13T20:11:59.741 INFO:tasks.rados.rados.0.trial188.stdout:62: finishing copy_from racing read to trial18843701-9 2026-02-13T20:11:59.743 INFO:tasks.rados.rados.0.trial188.stdout:63: finishing write tid 1 to trial18843701-36 2026-02-13T20:11:59.743 INFO:tasks.rados.rados.0.trial188.stdout:63: finishing write tid 2 to trial18843701-36 2026-02-13T20:11:59.743 INFO:tasks.rados.rados.0.trial188.stdout:63: finishing write tid 3 to trial18843701-36 2026-02-13T20:11:59.743 INFO:tasks.rados.rados.0.trial188.stdout:63: finishing write tid 4 to trial18843701-36 2026-02-13T20:11:59.744 INFO:tasks.rados.rados.0.trial188.stdout:64: expect (ObjNum 41 snap 0 seq_num 41) 2026-02-13T20:11:59.744 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:11:59.790 INFO:tasks.rados.rados.0.trial188.stdout:62: finishing copy_from to trial18843701-9 2026-02-13T20:11:59.790 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 9 v 12 (ObjNum 38 snap 0 seq_num 38) dirty exists 2026-02-13T20:11:59.790 INFO:tasks.rados.rados.0.trial188.stdout:63: finishing write tid 5 to trial18843701-36 2026-02-13T20:11:59.791 INFO:tasks.rados.rados.0.trial188.stdout:63: oid 36 updating version 0 to 22 2026-02-13T20:11:59.791 INFO:tasks.rados.rados.0.trial188.stdout:63: oid 36 version 22 is already newer than 21 2026-02-13T20:11:59.791 INFO:tasks.rados.rados.0.trial188.stdout:63: oid 36 updating version 22 to 23 2026-02-13T20:11:59.791 INFO:tasks.rados.rados.0.trial188.stdout:63: oid 36 version 23 is already newer than 20 2026-02-13T20:11:59.791 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 36 v 23 (ObjNum 55 snap 1 seq_num 55) dirty exists 2026-02-13T20:11:59.791 INFO:tasks.rados.rados.0.trial188.stdout:63: left oid 36 (ObjNum 55 snap 1 seq_num 55) 2026-02-13T20:11:59.791 INFO:tasks.rados.rados.0.trial188.stdout:65: finishing rollback tid 0 to trial18843701-33 2026-02-13T20:11:59.791 INFO:tasks.rados.rados.0.trial188.stdout:65: finishing rollback tid 1 to trial18843701-33 2026-02-13T20:11:59.791 INFO:tasks.rados.rados.0.trial188.stdout:65: finishing rollback tid 2 to trial18843701-33 2026-02-13T20:11:59.791 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 33 v 10 (ObjNum 32 snap 0 seq_num 32) dirty exists 2026-02-13T20:12:00.555 INFO:tasks.rados.rados.0.trial188.stdout:62: done (4 left) 2026-02-13T20:12:00.555 INFO:tasks.rados.rados.0.trial188.stdout:63: done (3 left) 2026-02-13T20:12:00.555 INFO:tasks.rados.rados.0.trial188.stdout:64: done (2 left) 2026-02-13T20:12:00.555 INFO:tasks.rados.rados.0.trial188.stdout:65: done (1 left) 2026-02-13T20:12:00.555 INFO:tasks.rados.rados.0.trial188.stdout:66: done (0 left) 2026-02-13T20:12:00.555 INFO:tasks.rados.rados.0.trial188.stdout:67: write oid 48 current snap is 2 2026-02-13T20:12:00.555 INFO:tasks.rados.rados.0.trial188.stdout:67: seq_num 56 ranges {541192=628415,1660521=553673,2888511=52681} 2026-02-13T20:12:00.560 INFO:tasks.rados.rados.0.trial188.stdout:67: writing trial18843701-48 from 541192 to 1169607 tid 1 2026-02-13T20:12:00.563 INFO:tasks.rados.rados.0.trial188.stdout:67: writing trial18843701-48 from 1660521 to 2214194 tid 2 2026-02-13T20:12:00.566 INFO:tasks.rados.rados.0.trial188.stdout:67: writing trial18843701-48 from 2888511 to 2941192 tid 3 2026-02-13T20:12:00.566 INFO:tasks.rados.rados.0.trial188.stdout:68: snap_remove snap 0 2026-02-13T20:12:01.557 INFO:tasks.rados.rados.0.trial188.stdout:68: done (1 left) 2026-02-13T20:12:01.557 INFO:tasks.rados.rados.0.trial188.stdout:69: read oid 12 snap -1 2026-02-13T20:12:01.558 INFO:tasks.rados.rados.0.trial188.stdout:69: expect (ObjNum 11 snap 0 seq_num 11) 2026-02-13T20:12:01.558 INFO:tasks.rados.rados.0.trial188.stdout:70: rollback oid 22 current snap is 2 2026-02-13T20:12:01.558 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 22 to 1 2026-02-13T20:12:01.558 INFO:tasks.rados.rados.0.trial188.stdout:67: finishing write tid 1 to trial18843701-48 2026-02-13T20:12:01.558 INFO:tasks.rados.rados.0.trial188.stdout:67: finishing write tid 2 to trial18843701-48 2026-02-13T20:12:01.558 INFO:tasks.rados.rados.0.trial188.stdout:67: finishing write tid 3 to trial18843701-48 2026-02-13T20:12:01.558 INFO:tasks.rados.rados.0.trial188.stdout:67: finishing write tid 4 to trial18843701-48 2026-02-13T20:12:01.558 INFO:tasks.rados.rados.0.trial188.stdout:67: finishing write tid 5 to trial18843701-48 2026-02-13T20:12:01.558 INFO:tasks.rados.rados.0.trial188.stdout:67: oid 48 updating version 0 to 11 2026-02-13T20:12:01.558 INFO:tasks.rados.rados.0.trial188.stdout:67: oid 48 version 11 is already newer than 9 2026-02-13T20:12:01.558 INFO:tasks.rados.rados.0.trial188.stdout:67: oid 48 updating version 11 to 12 2026-02-13T20:12:01.558 INFO:tasks.rados.rados.0.trial188.stdout:67: oid 48 version 12 is already newer than 10 2026-02-13T20:12:01.558 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 48 v 12 (ObjNum 56 snap 2 seq_num 56) dirty exists 2026-02-13T20:12:01.558 INFO:tasks.rados.rados.0.trial188.stdout:67: left oid 48 (ObjNum 56 snap 2 seq_num 56) 2026-02-13T20:12:01.558 INFO:tasks.rados.rados.0.trial188.stdout:67: done (2 left) 2026-02-13T20:12:01.558 INFO:tasks.rados.rados.0.trial188.stdout:71: write oid 10 current snap is 2 2026-02-13T20:12:01.558 INFO:tasks.rados.rados.0.trial188.stdout:71: seq_num 57 ranges {557999=703664,1719003=413684,2632287=325712} 2026-02-13T20:12:01.562 INFO:tasks.rados.rados.0.trial188.stdout:71: writing trial18843701-10 from 557999 to 1261663 tid 1 2026-02-13T20:12:01.565 INFO:tasks.rados.rados.0.trial188.stdout:71: writing trial18843701-10 from 1719003 to 2132687 tid 2 2026-02-13T20:12:01.569 INFO:tasks.rados.rados.0.trial188.stdout:71: writing trial18843701-10 from 2632287 to 2957999 tid 3 2026-02-13T20:12:01.569 INFO:tasks.rados.rados.0.trial188.stdout:72: snap_create 2026-02-13T20:12:01.569 INFO:tasks.rados.rados.0.trial188.stdout:70: finishing rollback tid 0 to trial18843701-22 2026-02-13T20:12:01.569 INFO:tasks.rados.rados.0.trial188.stdout:70: finishing rollback tid 1 to trial18843701-22 2026-02-13T20:12:01.569 INFO:tasks.rados.rados.0.trial188.stdout:70: finishing rollback tid 2 to trial18843701-22 2026-02-13T20:12:01.569 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 22 v 10 (ObjNum 21 snap 0 seq_num 21) dirty exists 2026-02-13T20:12:01.569 INFO:tasks.rados.rados.0.trial188.stdout:69: expect (ObjNum 11 snap 0 seq_num 11) 2026-02-13T20:12:01.569 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 449511 2026-02-13T20:12:01.584 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1138844 2026-02-13T20:12:01.593 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 322740 2026-02-13T20:12:01.607 INFO:tasks.rados.rados.0.trial188.stdout:71: finishing write tid 1 to trial18843701-10 2026-02-13T20:12:01.607 INFO:tasks.rados.rados.0.trial188.stdout:71: finishing write tid 2 to trial18843701-10 2026-02-13T20:12:01.607 INFO:tasks.rados.rados.0.trial188.stdout:71: finishing write tid 3 to trial18843701-10 2026-02-13T20:12:01.607 INFO:tasks.rados.rados.0.trial188.stdout:71: finishing write tid 4 to trial18843701-10 2026-02-13T20:12:01.607 INFO:tasks.rados.rados.0.trial188.stdout:71: finishing write tid 5 to trial18843701-10 2026-02-13T20:12:01.607 INFO:tasks.rados.rados.0.trial188.stdout:71: oid 10 updating version 0 to 12 2026-02-13T20:12:01.607 INFO:tasks.rados.rados.0.trial188.stdout:71: oid 10 updating version 12 to 14 2026-02-13T20:12:01.607 INFO:tasks.rados.rados.0.trial188.stdout:71: oid 10 version 14 is already newer than 13 2026-02-13T20:12:01.607 INFO:tasks.rados.rados.0.trial188.stdout:71: oid 10 version 14 is already newer than 11 2026-02-13T20:12:01.607 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 10 v 14 (ObjNum 57 snap 2 seq_num 57) dirty exists 2026-02-13T20:12:01.607 INFO:tasks.rados.rados.0.trial188.stdout:71: left oid 10 (ObjNum 57 snap 2 seq_num 57) 2026-02-13T20:12:02.562 INFO:tasks.rados.rados.0.trial188.stdout:69: done (3 left) 2026-02-13T20:12:02.562 INFO:tasks.rados.rados.0.trial188.stdout:70: done (2 left) 2026-02-13T20:12:02.562 INFO:tasks.rados.rados.0.trial188.stdout:71: done (1 left) 2026-02-13T20:12:02.562 INFO:tasks.rados.rados.0.trial188.stdout:72: done (0 left) 2026-02-13T20:12:02.562 INFO:tasks.rados.rados.0.trial188.stdout:73: copy_from oid 42 from oid 33 current snap is 3 2026-02-13T20:12:02.563 INFO:tasks.rados.rados.0.trial188.stdout:74: snap_create 2026-02-13T20:12:02.582 INFO:tasks.rados.rados.0.trial188.stdout:73: finishing copy_from racing read to trial18843701-42 2026-02-13T20:12:02.584 INFO:tasks.rados.rados.0.trial188.stdout:73: finishing copy_from to trial18843701-42 2026-02-13T20:12:02.584 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 42 v 10 (ObjNum 32 snap 0 seq_num 32) dirty exists 2026-02-13T20:12:03.562 INFO:tasks.rados.rados.0.trial188.stdout:73: done (1 left) 2026-02-13T20:12:03.562 INFO:tasks.rados.rados.0.trial188.stdout:74: done (0 left) 2026-02-13T20:12:03.562 INFO:tasks.rados.rados.0.trial188.stdout:75: read oid 16 snap 2 2026-02-13T20:12:03.563 INFO:tasks.rados.rados.0.trial188.stdout:75: expect (ObjNum 15 snap 0 seq_num 15) 2026-02-13T20:12:03.563 INFO:tasks.rados.rados.0.trial188.stdout:76: snap_remove snap 3 2026-02-13T20:12:04.566 INFO:tasks.rados.rados.0.trial188.stdout:76: done (1 left) 2026-02-13T20:12:04.566 INFO:tasks.rados.rados.0.trial188.stdout:77: write (excl) oid 11 current snap is 4 2026-02-13T20:12:04.567 INFO:tasks.rados.rados.0.trial188.stdout:77: seq_num 58 ranges {574806=778913,2061132=557342} 2026-02-13T20:12:04.571 INFO:tasks.rados.rados.0.trial188.stdout:77: writing trial18843701-11 from 574806 to 1353719 tid 1 2026-02-13T20:12:04.576 INFO:tasks.rados.rados.0.trial188.stdout:77: writing trial18843701-11 from 2061132 to 2618474 tid 2 2026-02-13T20:12:04.576 INFO:tasks.rados.rados.0.trial188.stdout:78: write (excl) oid 24 current snap is 4 2026-02-13T20:12:04.576 INFO:tasks.rados.rados.0.trial188.stdout:78: seq_num 59 ranges {591613=454162,1719614=417353,2570780=420833} 2026-02-13T20:12:04.580 INFO:tasks.rados.rados.0.trial188.stdout:78: writing trial18843701-24 from 591613 to 1045775 tid 1 2026-02-13T20:12:04.584 INFO:tasks.rados.rados.0.trial188.stdout:78: writing trial18843701-24 from 1719614 to 2136967 tid 2 2026-02-13T20:12:04.587 INFO:tasks.rados.rados.0.trial188.stdout:78: writing trial18843701-24 from 2570780 to 2991613 tid 3 2026-02-13T20:12:04.587 INFO:tasks.rados.rados.0.trial188.stdout:79: write oid 44 current snap is 4 2026-02-13T20:12:04.587 INFO:tasks.rados.rados.0.trial188.stdout:79: seq_num 60 ranges {608420=529411,1778096=561011,2881850=126570} 2026-02-13T20:12:04.591 INFO:tasks.rados.rados.0.trial188.stdout:79: writing trial18843701-44 from 608420 to 1137831 tid 1 2026-02-13T20:12:04.596 INFO:tasks.rados.rados.0.trial188.stdout:79: writing trial18843701-44 from 1778096 to 2339107 tid 2 2026-02-13T20:12:04.599 INFO:tasks.rados.rados.0.trial188.stdout:79: writing trial18843701-44 from 2881850 to 3008420 tid 3 2026-02-13T20:12:04.599 INFO:tasks.rados.rados.0.trial188.stdout:80: copy_from oid 30 from oid 7 current snap is 4 2026-02-13T20:12:04.599 INFO:tasks.rados.rados.0.trial188.stdout:75: expect (ObjNum 15 snap 0 seq_num 15) 2026-02-13T20:12:04.600 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 197707 2026-02-13T20:12:04.649 INFO:tasks.rados.rados.0.trial188.stdout:77: finishing write tid 1 to trial18843701-11 2026-02-13T20:12:04.649 INFO:tasks.rados.rados.0.trial188.stdout:77: finishing write tid 2 to trial18843701-11 2026-02-13T20:12:04.649 INFO:tasks.rados.rados.0.trial188.stdout:77: finishing write tid 3 to trial18843701-11 2026-02-13T20:12:04.649 INFO:tasks.rados.rados.0.trial188.stdout:77: finishing write tid 4 to trial18843701-11 2026-02-13T20:12:04.649 INFO:tasks.rados.rados.0.trial188.stdout:77: oid 11 updating version 0 to 17 2026-02-13T20:12:04.650 INFO:tasks.rados.rados.0.trial188.stdout:77: oid 11 version 17 is already newer than 16 2026-02-13T20:12:04.650 INFO:tasks.rados.rados.0.trial188.stdout:77: oid 11 updating version 17 to 18 2026-02-13T20:12:04.650 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 11 v 18 (ObjNum 58 snap 4 seq_num 58) dirty exists 2026-02-13T20:12:04.650 INFO:tasks.rados.rados.0.trial188.stdout:77: left oid 11 (ObjNum 58 snap 4 seq_num 58) 2026-02-13T20:12:04.650 INFO:tasks.rados.rados.0.trial188.stdout:78: finishing write tid 1 to trial18843701-24 2026-02-13T20:12:04.650 INFO:tasks.rados.rados.0.trial188.stdout:78: finishing write tid 2 to trial18843701-24 2026-02-13T20:12:04.650 INFO:tasks.rados.rados.0.trial188.stdout:78: finishing write tid 3 to trial18843701-24 2026-02-13T20:12:04.650 INFO:tasks.rados.rados.0.trial188.stdout:78: finishing write tid 4 to trial18843701-24 2026-02-13T20:12:04.650 INFO:tasks.rados.rados.0.trial188.stdout:78: finishing write tid 5 to trial18843701-24 2026-02-13T20:12:04.650 INFO:tasks.rados.rados.0.trial188.stdout:78: oid 24 updating version 0 to 27 2026-02-13T20:12:04.650 INFO:tasks.rados.rados.0.trial188.stdout:78: oid 24 updating version 27 to 29 2026-02-13T20:12:04.650 INFO:tasks.rados.rados.0.trial188.stdout:78: oid 24 version 29 is already newer than 28 2026-02-13T20:12:04.651 INFO:tasks.rados.rados.0.trial188.stdout:78: oid 24 updating version 29 to 30 2026-02-13T20:12:04.651 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 24 v 30 (ObjNum 59 snap 4 seq_num 59) dirty exists 2026-02-13T20:12:04.651 INFO:tasks.rados.rados.0.trial188.stdout:78: left oid 24 (ObjNum 59 snap 4 seq_num 59) 2026-02-13T20:12:04.651 INFO:tasks.rados.rados.0.trial188.stdout:79: finishing write tid 1 to trial18843701-44 2026-02-13T20:12:04.651 INFO:tasks.rados.rados.0.trial188.stdout:79: finishing write tid 2 to trial18843701-44 2026-02-13T20:12:04.651 INFO:tasks.rados.rados.0.trial188.stdout:75: done (4 left) 2026-02-13T20:12:04.651 INFO:tasks.rados.rados.0.trial188.stdout:77: done (3 left) 2026-02-13T20:12:04.651 INFO:tasks.rados.rados.0.trial188.stdout:78: done (2 left) 2026-02-13T20:12:04.651 INFO:tasks.rados.rados.0.trial188.stdout:81: snap_remove snap 2 2026-02-13T20:12:05.480 INFO:tasks.rados.rados.0.trial188.stdout:81: done (2 left) 2026-02-13T20:12:05.480 INFO:tasks.rados.rados.0.trial188.stdout:82: delete oid 21 current snap is 4 2026-02-13T20:12:05.480 INFO:tasks.rados.rados.0.trial188.stdout:79: finishing write tid 3 to trial18843701-44 2026-02-13T20:12:05.480 INFO:tasks.rados.rados.0.trial188.stdout:79: finishing write tid 4 to trial18843701-44 2026-02-13T20:12:05.480 INFO:tasks.rados.rados.0.trial188.stdout:79: finishing write tid 5 to trial18843701-44 2026-02-13T20:12:05.480 INFO:tasks.rados.rados.0.trial188.stdout:79: oid 44 updating version 0 to 24 2026-02-13T20:12:05.481 INFO:tasks.rados.rados.0.trial188.stdout:79: oid 44 updating version 24 to 25 2026-02-13T20:12:05.481 INFO:tasks.rados.rados.0.trial188.stdout:79: oid 44 updating version 25 to 27 2026-02-13T20:12:05.481 INFO:tasks.rados.rados.0.trial188.stdout:79: oid 44 version 27 is already newer than 26 2026-02-13T20:12:05.481 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 44 v 27 (ObjNum 60 snap 4 seq_num 60) dirty exists 2026-02-13T20:12:05.481 INFO:tasks.rados.rados.0.trial188.stdout:79: left oid 44 (ObjNum 60 snap 4 seq_num 60) 2026-02-13T20:12:05.481 INFO:tasks.rados.rados.0.trial188.stdout:80: finishing copy_from racing read to trial18843701-30 2026-02-13T20:12:05.481 INFO:tasks.rados.rados.0.trial188.stdout:80: finishing copy_from to trial18843701-30 2026-02-13T20:12:05.481 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 30 v 3 (ObjNum 6 snap 0 seq_num 6) dirty exists 2026-02-13T20:12:05.483 INFO:tasks.rados.rados.0.trial188.stdout:79: done (2 left) 2026-02-13T20:12:05.483 INFO:tasks.rados.rados.0.trial188.stdout:80: done (1 left) 2026-02-13T20:12:05.483 INFO:tasks.rados.rados.0.trial188.stdout:82: done (0 left) 2026-02-13T20:12:05.483 INFO:tasks.rados.rados.0.trial188.stdout:83: write (excl) oid 5 current snap is 4 2026-02-13T20:12:05.483 INFO:tasks.rados.rados.0.trial188.stdout:83: seq_num 62 ranges {642034=796262,1895060=564680} 2026-02-13T20:12:05.489 INFO:tasks.rados.rados.0.trial188.stdout:83: writing trial18843701-5 from 642034 to 1438296 tid 1 2026-02-13T20:12:05.494 INFO:tasks.rados.rados.0.trial188.stdout:83: writing trial18843701-5 from 1895060 to 2459740 tid 2 2026-02-13T20:12:05.494 INFO:tasks.rados.rados.0.trial188.stdout:84: write (excl) oid 47 current snap is 4 2026-02-13T20:12:05.494 INFO:tasks.rados.rados.0.trial188.stdout:84: seq_num 63 ranges {658841=471511,1553542=708338,2964119=94722} 2026-02-13T20:12:05.498 INFO:tasks.rados.rados.0.trial188.stdout:84: writing trial18843701-47 from 658841 to 1130352 tid 1 2026-02-13T20:12:05.502 INFO:tasks.rados.rados.0.trial188.stdout:84: writing trial18843701-47 from 1553542 to 2261880 tid 2 2026-02-13T20:12:05.506 INFO:tasks.rados.rados.0.trial188.stdout:84: writing trial18843701-47 from 2964119 to 3058841 tid 3 2026-02-13T20:12:05.506 INFO:tasks.rados.rados.0.trial188.stdout:85: write oid 44 current snap is 4 2026-02-13T20:12:05.506 INFO:tasks.rados.rados.0.trial188.stdout:85: seq_num 64 ranges {675648=546760,2012024=568349} 2026-02-13T20:12:05.510 INFO:tasks.rados.rados.0.trial188.stdout:85: writing trial18843701-44 from 675648 to 1222408 tid 1 2026-02-13T20:12:05.516 INFO:tasks.rados.rados.0.trial188.stdout:85: writing trial18843701-44 from 2012024 to 2580373 tid 2 2026-02-13T20:12:05.516 INFO:tasks.rados.rados.0.trial188.stdout:86: copy_from oid 9 from oid 6 current snap is 4 2026-02-13T20:12:05.516 INFO:tasks.rados.rados.0.trial188.stdout:87: rollback oid 26 current snap is 4 2026-02-13T20:12:05.516 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 26 to 1 2026-02-13T20:12:05.516 INFO:tasks.rados.rados.0.trial188.stdout:88: copy_from oid 7 from oid 35 current snap is 4 2026-02-13T20:12:05.516 INFO:tasks.rados.rados.0.trial188.stdout:89: rollback oid 18 current snap is 4 2026-02-13T20:12:05.516 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 18 to 1 2026-02-13T20:12:05.517 INFO:tasks.rados.rados.0.trial188.stdout:90: snap_create 2026-02-13T20:12:05.518 INFO:tasks.rados.rados.0.trial188.stdout:89: finishing rollback tid 0 to trial18843701-18 2026-02-13T20:12:05.518 INFO:tasks.rados.rados.0.trial188.stdout:89: finishing rollback tid 1 to trial18843701-18 2026-02-13T20:12:05.518 INFO:tasks.rados.rados.0.trial188.stdout:89: finishing rollback tid 2 to trial18843701-18 2026-02-13T20:12:05.518 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 18 v 19 (ObjNum 17 snap 0 seq_num 17) dirty exists 2026-02-13T20:12:05.519 INFO:tasks.rados.rados.0.trial188.stdout:83: finishing write tid 1 to trial18843701-5 2026-02-13T20:12:05.521 INFO:tasks.rados.rados.0.trial188.stdout:83: finishing write tid 2 to trial18843701-5 2026-02-13T20:12:05.522 INFO:tasks.rados.rados.0.trial188.stdout:83: finishing write tid 3 to trial18843701-5 2026-02-13T20:12:05.522 INFO:tasks.rados.rados.0.trial188.stdout:84: finishing write tid 1 to trial18843701-47 2026-02-13T20:12:05.522 INFO:tasks.rados.rados.0.trial188.stdout:83: finishing write tid 4 to trial18843701-5 2026-02-13T20:12:05.522 INFO:tasks.rados.rados.0.trial188.stdout:83: oid 5 updating version 0 to 29 2026-02-13T20:12:05.522 INFO:tasks.rados.rados.0.trial188.stdout:83: oid 5 updating version 29 to 31 2026-02-13T20:12:05.522 INFO:tasks.rados.rados.0.trial188.stdout:83: oid 5 version 31 is already newer than 30 2026-02-13T20:12:05.522 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 5 v 31 (ObjNum 62 snap 4 seq_num 62) dirty exists 2026-02-13T20:12:05.522 INFO:tasks.rados.rados.0.trial188.stdout:83: left oid 5 (ObjNum 62 snap 4 seq_num 62) 2026-02-13T20:12:05.522 INFO:tasks.rados.rados.0.trial188.stdout:84: finishing write tid 2 to trial18843701-47 2026-02-13T20:12:05.523 INFO:tasks.rados.rados.0.trial188.stdout:87: finishing rollback tid 0 to trial18843701-26 2026-02-13T20:12:05.523 INFO:tasks.rados.rados.0.trial188.stdout:87: finishing rollback tid 1 to trial18843701-26 2026-02-13T20:12:05.523 INFO:tasks.rados.rados.0.trial188.stdout:87: finishing rollback tid 2 to trial18843701-26 2026-02-13T20:12:05.523 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 26 v 22 (ObjNum 25 snap 0 seq_num 25) dirty exists 2026-02-13T20:12:05.532 INFO:tasks.rados.rados.0.trial188.stdout:85: finishing write tid 1 to trial18843701-44 2026-02-13T20:12:05.532 INFO:tasks.rados.rados.0.trial188.stdout:84: finishing write tid 3 to trial18843701-47 2026-02-13T20:12:05.532 INFO:tasks.rados.rados.0.trial188.stdout:84: finishing write tid 4 to trial18843701-47 2026-02-13T20:12:05.532 INFO:tasks.rados.rados.0.trial188.stdout:84: finishing write tid 5 to trial18843701-47 2026-02-13T20:12:05.532 INFO:tasks.rados.rados.0.trial188.stdout:84: oid 47 updating version 0 to 14 2026-02-13T20:12:05.532 INFO:tasks.rados.rados.0.trial188.stdout:84: oid 47 updating version 14 to 17 2026-02-13T20:12:05.532 INFO:tasks.rados.rados.0.trial188.stdout:84: oid 47 version 17 is already newer than 15 2026-02-13T20:12:05.532 INFO:tasks.rados.rados.0.trial188.stdout:84: oid 47 version 17 is already newer than 16 2026-02-13T20:12:05.532 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 47 v 17 (ObjNum 63 snap 4 seq_num 63) dirty exists 2026-02-13T20:12:05.533 INFO:tasks.rados.rados.0.trial188.stdout:84: left oid 47 (ObjNum 63 snap 4 seq_num 63) 2026-02-13T20:12:05.536 INFO:tasks.rados.rados.0.trial188.stdout:86: finishing copy_from racing read to trial18843701-9 2026-02-13T20:12:05.537 INFO:tasks.rados.rados.0.trial188.stdout:85: finishing write tid 2 to trial18843701-44 2026-02-13T20:12:05.538 INFO:tasks.rados.rados.0.trial188.stdout:88: finishing copy_from racing read to trial18843701-7 2026-02-13T20:12:05.538 INFO:tasks.rados.rados.0.trial188.stdout:85: finishing write tid 3 to trial18843701-44 2026-02-13T20:12:05.538 INFO:tasks.rados.rados.0.trial188.stdout:85: finishing write tid 4 to trial18843701-44 2026-02-13T20:12:05.538 INFO:tasks.rados.rados.0.trial188.stdout:85: oid 44 updating version 0 to 36 2026-02-13T20:12:05.538 INFO:tasks.rados.rados.0.trial188.stdout:85: oid 44 version 36 is already newer than 34 2026-02-13T20:12:05.538 INFO:tasks.rados.rados.0.trial188.stdout:85: oid 44 version 36 is already newer than 35 2026-02-13T20:12:05.538 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 44 v 36 (ObjNum 64 snap 4 seq_num 64) dirty exists 2026-02-13T20:12:05.538 INFO:tasks.rados.rados.0.trial188.stdout:85: left oid 44 (ObjNum 64 snap 4 seq_num 64) 2026-02-13T20:12:05.538 INFO:tasks.rados.rados.0.trial188.stdout:88: finishing copy_from to trial18843701-7 2026-02-13T20:12:05.539 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 7 v 3 (ObjNum 5 snap 0 seq_num 5) dirty exists 2026-02-13T20:12:05.544 INFO:tasks.rados.rados.0.trial188.stdout:86: finishing copy_from to trial18843701-9 2026-02-13T20:12:05.544 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 9 v 3 (ObjNum 5 snap 0 seq_num 5) dirty exists 2026-02-13T20:12:06.480 INFO:tasks.rados.rados.0.trial188.stdout:83: done (7 left) 2026-02-13T20:12:06.481 INFO:tasks.rados.rados.0.trial188.stdout:84: done (6 left) 2026-02-13T20:12:06.481 INFO:tasks.rados.rados.0.trial188.stdout:85: done (5 left) 2026-02-13T20:12:06.481 INFO:tasks.rados.rados.0.trial188.stdout:86: done (4 left) 2026-02-13T20:12:06.481 INFO:tasks.rados.rados.0.trial188.stdout:87: done (3 left) 2026-02-13T20:12:06.481 INFO:tasks.rados.rados.0.trial188.stdout:88: done (2 left) 2026-02-13T20:12:06.481 INFO:tasks.rados.rados.0.trial188.stdout:89: done (1 left) 2026-02-13T20:12:06.481 INFO:tasks.rados.rados.0.trial188.stdout:90: done (0 left) 2026-02-13T20:12:06.481 INFO:tasks.rados.rados.0.trial188.stdout:91: delete oid 39 current snap is 5 2026-02-13T20:12:06.482 INFO:tasks.rados.rados.0.trial188.stdout:91: done (0 left) 2026-02-13T20:12:06.482 INFO:tasks.rados.rados.0.trial188.stdout:92: copy_from oid 37 from oid 47 current snap is 5 2026-02-13T20:12:06.482 INFO:tasks.rados.rados.0.trial188.stdout:93: snap_remove snap 1 2026-02-13T20:12:07.481 INFO:tasks.rados.rados.0.trial188.stdout:93: done (1 left) 2026-02-13T20:12:07.481 INFO:tasks.rados.rados.0.trial188.stdout:94: write (excl) oid 10 current snap is 5 2026-02-13T20:12:07.481 INFO:tasks.rados.rados.0.trial188.stdout:94: seq_num 66 ranges {709262=697258,2012635=572018,3046388=62874} 2026-02-13T20:12:07.486 INFO:tasks.rados.rados.0.trial188.stdout:94: writing trial18843701-10 from 709262 to 1406520 tid 1 2026-02-13T20:12:07.491 INFO:tasks.rados.rados.0.trial188.stdout:94: writing trial18843701-10 from 2012635 to 2584653 tid 2 2026-02-13T20:12:07.493 INFO:tasks.rados.rados.0.trial188.stdout:94: writing trial18843701-10 from 3046388 to 3109262 tid 3 2026-02-13T20:12:07.493 INFO:tasks.rados.rados.0.trial188.stdout:95: read oid 8 snap -1 2026-02-13T20:12:07.493 INFO:tasks.rados.rados.0.trial188.stdout:95: expect (ObjNum 7 snap 0 seq_num 7) 2026-02-13T20:12:07.493 INFO:tasks.rados.rados.0.trial188.stdout:96: delete oid 42 current snap is 5 2026-02-13T20:12:07.493 INFO:tasks.rados.rados.0.trial188.stdout:92: finishing copy_from racing read to trial18843701-37 2026-02-13T20:12:07.493 INFO:tasks.rados.rados.0.trial188.stdout:92: finishing copy_from to trial18843701-37 2026-02-13T20:12:07.493 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 37 v 17 (ObjNum 63 snap 4 seq_num 63) dirty exists 2026-02-13T20:12:07.496 INFO:tasks.rados.rados.0.trial188.stdout:95: expect (ObjNum 7 snap 0 seq_num 7) 2026-02-13T20:12:07.496 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 194257 2026-02-13T20:12:07.511 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:07.540 INFO:tasks.rados.rados.0.trial188.stdout:94: finishing write tid 1 to trial18843701-10 2026-02-13T20:12:07.541 INFO:tasks.rados.rados.0.trial188.stdout:94: finishing write tid 2 to trial18843701-10 2026-02-13T20:12:07.541 INFO:tasks.rados.rados.0.trial188.stdout:94: finishing write tid 3 to trial18843701-10 2026-02-13T20:12:07.541 INFO:tasks.rados.rados.0.trial188.stdout:92: done (3 left) 2026-02-13T20:12:07.541 INFO:tasks.rados.rados.0.trial188.stdout:95: done (2 left) 2026-02-13T20:12:07.541 INFO:tasks.rados.rados.0.trial188.stdout:96: done (1 left) 2026-02-13T20:12:07.541 INFO:tasks.rados.rados.0.trial188.stdout:97: copy_from oid 47 from oid 11 current snap is 5 2026-02-13T20:12:07.541 INFO:tasks.rados.rados.0.trial188.stdout:94: finishing write tid 4 to trial18843701-10 2026-02-13T20:12:07.541 INFO:tasks.rados.rados.0.trial188.stdout:94: finishing write tid 5 to trial18843701-10 2026-02-13T20:12:07.541 INFO:tasks.rados.rados.0.trial188.stdout:94: oid 10 updating version 0 to 26 2026-02-13T20:12:07.542 INFO:tasks.rados.rados.0.trial188.stdout:94: oid 10 updating version 26 to 28 2026-02-13T20:12:07.542 INFO:tasks.rados.rados.0.trial188.stdout:94: oid 10 version 28 is already newer than 27 2026-02-13T20:12:07.542 INFO:tasks.rados.rados.0.trial188.stdout:94: oid 10 updating version 28 to 29 2026-02-13T20:12:07.542 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 10 v 29 (ObjNum 66 snap 5 seq_num 66) dirty exists 2026-02-13T20:12:07.542 INFO:tasks.rados.rados.0.trial188.stdout:94: left oid 10 (ObjNum 66 snap 5 seq_num 66) 2026-02-13T20:12:07.542 INFO:tasks.rados.rados.0.trial188.stdout:94: done (1 left) 2026-02-13T20:12:07.542 INFO:tasks.rados.rados.0.trial188.stdout:98: rollback oid 2 current snap is 5 2026-02-13T20:12:07.542 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 2 to 4 2026-02-13T20:12:07.542 INFO:tasks.rados.rados.0.trial188.stdout:99: rollback oid 36 current snap is 5 2026-02-13T20:12:07.542 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 36 to 4 2026-02-13T20:12:07.542 INFO:tasks.rados.rados.0.trial188.stdout:100: read oid 33 snap -1 2026-02-13T20:12:07.542 INFO:tasks.rados.rados.0.trial188.stdout:100: expect (ObjNum 32 snap 0 seq_num 32) 2026-02-13T20:12:07.542 INFO:tasks.rados.rados.0.trial188.stdout:101: read oid 32 snap -1 2026-02-13T20:12:07.543 INFO:tasks.rados.rados.0.trial188.stdout:101: expect (ObjNum 31 snap 0 seq_num 31) 2026-02-13T20:12:07.543 INFO:tasks.rados.rados.0.trial188.stdout:102: rollback oid 4 current snap is 5 2026-02-13T20:12:07.543 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 4 to 4 2026-02-13T20:12:07.543 INFO:tasks.rados.rados.0.trial188.stdout:103: write (excl) oid 10 current snap is 5 2026-02-13T20:12:07.543 INFO:tasks.rados.rados.0.trial188.stdout:103: seq_num 68 ranges {742876=447756,1729599=575687,3101234=41642} 2026-02-13T20:12:07.544 INFO:tasks.rados.rados.0.trial188.stdout:103: writing trial18843701-10 from 742876 to 1190632 tid 1 2026-02-13T20:12:07.548 INFO:tasks.rados.rados.0.trial188.stdout:103: writing trial18843701-10 from 1729599 to 2305286 tid 2 2026-02-13T20:12:07.552 INFO:tasks.rados.rados.0.trial188.stdout:103: writing trial18843701-10 from 3101234 to 3142876 tid 3 2026-02-13T20:12:07.552 INFO:tasks.rados.rados.0.trial188.stdout:104: delete oid 15 current snap is 5 2026-02-13T20:12:07.552 INFO:tasks.rados.rados.0.trial188.stdout:98: finishing rollback tid 0 to trial18843701-2 2026-02-13T20:12:07.552 INFO:tasks.rados.rados.0.trial188.stdout:98: finishing rollback tid 1 to trial18843701-2 2026-02-13T20:12:07.552 INFO:tasks.rados.rados.0.trial188.stdout:98: finishing rollback tid 2 to trial18843701-2 2026-02-13T20:12:07.553 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 2 v 44 (ObjNum 1 snap 0 seq_num 1) dirty exists 2026-02-13T20:12:07.553 INFO:tasks.rados.rados.0.trial188.stdout:100: expect (ObjNum 32 snap 0 seq_num 32) 2026-02-13T20:12:07.553 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:07.572 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:07.606 INFO:tasks.rados.rados.0.trial188.stdout:99: finishing rollback tid 0 to trial18843701-36 2026-02-13T20:12:07.606 INFO:tasks.rados.rados.0.trial188.stdout:102: finishing rollback tid 0 to trial18843701-4 2026-02-13T20:12:07.606 INFO:tasks.rados.rados.0.trial188.stdout:99: finishing rollback tid 1 to trial18843701-36 2026-02-13T20:12:07.606 INFO:tasks.rados.rados.0.trial188.stdout:99: finishing rollback tid 2 to trial18843701-36 2026-02-13T20:12:07.606 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 36 v 38 (ObjNum 55 snap 1 seq_num 55) dirty exists 2026-02-13T20:12:07.606 INFO:tasks.rados.rados.0.trial188.stdout:102: finishing rollback tid 1 to trial18843701-4 2026-02-13T20:12:07.606 INFO:tasks.rados.rados.0.trial188.stdout:102: finishing rollback tid 2 to trial18843701-4 2026-02-13T20:12:07.606 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 4 v 33 (ObjNum 3 snap 0 seq_num 3) dirty exists 2026-02-13T20:12:07.607 INFO:tasks.rados.rados.0.trial188.stdout:101: expect (ObjNum 31 snap 0 seq_num 31) 2026-02-13T20:12:07.641 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 799482 2026-02-13T20:12:07.653 INFO:tasks.rados.rados.0.trial188.stdout:103: finishing write tid 1 to trial18843701-10 2026-02-13T20:12:07.654 INFO:tasks.rados.rados.0.trial188.stdout:103: finishing write tid 2 to trial18843701-10 2026-02-13T20:12:07.654 INFO:tasks.rados.rados.0.trial188.stdout:103: finishing write tid 3 to trial18843701-10 2026-02-13T20:12:07.654 INFO:tasks.rados.rados.0.trial188.stdout:98: done (7 left) 2026-02-13T20:12:07.654 INFO:tasks.rados.rados.0.trial188.stdout:99: done (6 left) 2026-02-13T20:12:07.654 INFO:tasks.rados.rados.0.trial188.stdout:100: done (5 left) 2026-02-13T20:12:07.654 INFO:tasks.rados.rados.0.trial188.stdout:101: done (4 left) 2026-02-13T20:12:07.654 INFO:tasks.rados.rados.0.trial188.stdout:102: done (3 left) 2026-02-13T20:12:07.654 INFO:tasks.rados.rados.0.trial188.stdout:104: done (2 left) 2026-02-13T20:12:07.654 INFO:tasks.rados.rados.0.trial188.stdout:105: rollback oid 45 current snap is 5 2026-02-13T20:12:07.654 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 45 to 4 2026-02-13T20:12:07.655 INFO:tasks.rados.rados.0.trial188.stdout:103: finishing write tid 4 to trial18843701-10 2026-02-13T20:12:07.655 INFO:tasks.rados.rados.0.trial188.stdout:103: finishing write tid 5 to trial18843701-10 2026-02-13T20:12:07.655 INFO:tasks.rados.rados.0.trial188.stdout:103: oid 10 updating version 0 to 37 2026-02-13T20:12:07.655 INFO:tasks.rados.rados.0.trial188.stdout:103: oid 10 version 37 is already newer than 36 2026-02-13T20:12:07.655 INFO:tasks.rados.rados.0.trial188.stdout:103: oid 10 version 37 is already newer than 35 2026-02-13T20:12:07.655 INFO:tasks.rados.rados.0.trial188.stdout:103: oid 10 version 37 is already newer than 34 2026-02-13T20:12:07.655 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 10 v 37 (ObjNum 68 snap 5 seq_num 68) dirty exists 2026-02-13T20:12:07.655 INFO:tasks.rados.rados.0.trial188.stdout:103: left oid 10 (ObjNum 68 snap 5 seq_num 68) 2026-02-13T20:12:07.655 INFO:tasks.rados.rados.0.trial188.stdout:97: finishing copy_from racing read to trial18843701-47 2026-02-13T20:12:07.655 INFO:tasks.rados.rados.0.trial188.stdout:97: finishing copy_from to trial18843701-47 2026-02-13T20:12:07.656 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 47 v 18 (ObjNum 58 snap 4 seq_num 58) dirty exists 2026-02-13T20:12:07.656 INFO:tasks.rados.rados.0.trial188.stdout:97: done (2 left) 2026-02-13T20:12:07.656 INFO:tasks.rados.rados.0.trial188.stdout:103: done (1 left) 2026-02-13T20:12:07.656 INFO:tasks.rados.rados.0.trial188.stdout:106: copy_from oid 28 from oid 22 current snap is 5 2026-02-13T20:12:07.656 INFO:tasks.rados.rados.0.trial188.stdout:107: write oid 4 current snap is 5 2026-02-13T20:12:07.656 INFO:tasks.rados.rados.0.trial188.stdout:107: seq_num 70 ranges {776490=714607,2246563=579356} 2026-02-13T20:12:07.659 INFO:tasks.rados.rados.0.trial188.stdout:107: writing trial18843701-4 from 776490 to 1491097 tid 1 2026-02-13T20:12:07.664 INFO:tasks.rados.rados.0.trial188.stdout:107: writing trial18843701-4 from 2246563 to 2825919 tid 2 2026-02-13T20:12:07.664 INFO:tasks.rados.rados.0.trial188.stdout:108: snap_create 2026-02-13T20:12:07.664 INFO:tasks.rados.rados.0.trial188.stdout:105: finishing rollback tid 0 to trial18843701-45 2026-02-13T20:12:07.664 INFO:tasks.rados.rados.0.trial188.stdout:105: finishing rollback tid 1 to trial18843701-45 2026-02-13T20:12:07.664 INFO:tasks.rados.rados.0.trial188.stdout:105: finishing rollback tid 2 to trial18843701-45 2026-02-13T20:12:07.665 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 45 v 23 (ObjNum 44 snap 0 seq_num 44) dirty exists 2026-02-13T20:12:07.672 INFO:tasks.rados.rados.0.trial188.stdout:106: finishing copy_from racing read to trial18843701-28 2026-02-13T20:12:07.673 INFO:tasks.rados.rados.0.trial188.stdout:106: finishing copy_from to trial18843701-28 2026-02-13T20:12:07.673 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 28 v 10 (ObjNum 21 snap 0 seq_num 21) dirty exists 2026-02-13T20:12:07.676 INFO:tasks.rados.rados.0.trial188.stdout:107: finishing write tid 1 to trial18843701-4 2026-02-13T20:12:07.677 INFO:tasks.rados.rados.0.trial188.stdout:107: finishing write tid 2 to trial18843701-4 2026-02-13T20:12:07.678 INFO:tasks.rados.rados.0.trial188.stdout:107: finishing write tid 3 to trial18843701-4 2026-02-13T20:12:07.678 INFO:tasks.rados.rados.0.trial188.stdout:107: finishing write tid 4 to trial18843701-4 2026-02-13T20:12:07.678 INFO:tasks.rados.rados.0.trial188.stdout:107: oid 4 updating version 0 to 38 2026-02-13T20:12:07.678 INFO:tasks.rados.rados.0.trial188.stdout:107: oid 4 updating version 38 to 39 2026-02-13T20:12:07.678 INFO:tasks.rados.rados.0.trial188.stdout:107: oid 4 updating version 39 to 40 2026-02-13T20:12:07.678 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 4 v 40 (ObjNum 70 snap 5 seq_num 70) dirty exists 2026-02-13T20:12:07.678 INFO:tasks.rados.rados.0.trial188.stdout:107: left oid 4 (ObjNum 70 snap 5 seq_num 70) 2026-02-13T20:12:08.485 INFO:tasks.rados.rados.0.trial188.stdout:105: done (3 left) 2026-02-13T20:12:08.485 INFO:tasks.rados.rados.0.trial188.stdout:106: done (2 left) 2026-02-13T20:12:08.486 INFO:tasks.rados.rados.0.trial188.stdout:107: done (1 left) 2026-02-13T20:12:08.486 INFO:tasks.rados.rados.0.trial188.stdout:108: done (0 left) 2026-02-13T20:12:08.486 INFO:tasks.rados.rados.0.trial188.stdout:109: write oid 6 current snap is 6 2026-02-13T20:12:08.486 INFO:tasks.rados.rados.0.trial188.stdout:109: seq_num 71 ranges {793297=789856,2305045=723014} 2026-02-13T20:12:08.491 INFO:tasks.rados.rados.0.trial188.stdout:109: writing trial18843701-6 from 793297 to 1583153 tid 1 2026-02-13T20:12:08.497 INFO:tasks.rados.rados.0.trial188.stdout:109: writing trial18843701-6 from 2305045 to 3028059 tid 2 2026-02-13T20:12:08.497 INFO:tasks.rados.rados.0.trial188.stdout:110: snap_create 2026-02-13T20:12:08.514 INFO:tasks.rados.rados.0.trial188.stdout:109: finishing write tid 1 to trial18843701-6 2026-02-13T20:12:08.514 INFO:tasks.rados.rados.0.trial188.stdout:109: finishing write tid 2 to trial18843701-6 2026-02-13T20:12:08.515 INFO:tasks.rados.rados.0.trial188.stdout:109: finishing write tid 3 to trial18843701-6 2026-02-13T20:12:08.515 INFO:tasks.rados.rados.0.trial188.stdout:109: finishing write tid 4 to trial18843701-6 2026-02-13T20:12:08.515 INFO:tasks.rados.rados.0.trial188.stdout:109: oid 6 updating version 0 to 40 2026-02-13T20:12:08.515 INFO:tasks.rados.rados.0.trial188.stdout:109: oid 6 updating version 40 to 42 2026-02-13T20:12:08.515 INFO:tasks.rados.rados.0.trial188.stdout:109: oid 6 version 42 is already newer than 41 2026-02-13T20:12:08.515 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 6 v 42 (ObjNum 71 snap 6 seq_num 71) dirty exists 2026-02-13T20:12:08.515 INFO:tasks.rados.rados.0.trial188.stdout:109: left oid 6 (ObjNum 71 snap 6 seq_num 71) 2026-02-13T20:12:09.488 INFO:tasks.rados.rados.0.trial188.stdout:109: done (1 left) 2026-02-13T20:12:09.488 INFO:tasks.rados.rados.0.trial188.stdout:110: done (0 left) 2026-02-13T20:12:09.488 INFO:tasks.rados.rados.0.trial188.stdout:111: delete oid 16 current snap is 7 2026-02-13T20:12:09.489 INFO:tasks.rados.rados.0.trial188.stdout:111: done (0 left) 2026-02-13T20:12:09.489 INFO:tasks.rados.rados.0.trial188.stdout:112: delete oid 7 current snap is 7 2026-02-13T20:12:09.490 INFO:tasks.rados.rados.0.trial188.stdout:112: done (0 left) 2026-02-13T20:12:09.490 INFO:tasks.rados.rados.0.trial188.stdout:113: snap_remove snap 6 2026-02-13T20:12:10.490 INFO:tasks.rados.rados.0.trial188.stdout:113: done (0 left) 2026-02-13T20:12:10.491 INFO:tasks.rados.rados.0.trial188.stdout:114: write oid 31 current snap is 7 2026-02-13T20:12:10.491 INFO:tasks.rados.rados.0.trial188.stdout:114: seq_num 74 ranges {443718=615603,1564138=470341,2633066=610652} 2026-02-13T20:12:10.494 INFO:tasks.rados.rados.0.trial188.stdout:114: writing trial18843701-31 from 443718 to 1059321 tid 1 2026-02-13T20:12:10.498 INFO:tasks.rados.rados.0.trial188.stdout:114: writing trial18843701-31 from 1564138 to 2034479 tid 2 2026-02-13T20:12:10.503 INFO:tasks.rados.rados.0.trial188.stdout:114: writing trial18843701-31 from 2633066 to 3243718 tid 3 2026-02-13T20:12:10.503 INFO:tasks.rados.rados.0.trial188.stdout:115: snap_remove snap 4 2026-02-13T20:12:11.493 INFO:tasks.rados.rados.0.trial188.stdout:115: done (1 left) 2026-02-13T20:12:11.493 INFO:tasks.rados.rados.0.trial188.stdout:116: write oid 22 current snap is 7 2026-02-13T20:12:11.493 INFO:tasks.rados.rados.0.trial188.stdout:116: seq_num 75 ranges {460525=690852,1622620=730352,3060489=200036} 2026-02-13T20:12:11.497 INFO:tasks.rados.rados.0.trial188.stdout:116: writing trial18843701-22 from 460525 to 1151377 tid 1 2026-02-13T20:12:11.502 INFO:tasks.rados.rados.0.trial188.stdout:116: writing trial18843701-22 from 1622620 to 2352972 tid 2 2026-02-13T20:12:11.506 INFO:tasks.rados.rados.0.trial188.stdout:116: writing trial18843701-22 from 3060489 to 3260525 tid 3 2026-02-13T20:12:11.506 INFO:tasks.rados.rados.0.trial188.stdout:117: snap_create 2026-02-13T20:12:11.506 INFO:tasks.rados.rados.0.trial188.stdout:114: finishing write tid 1 to trial18843701-31 2026-02-13T20:12:11.506 INFO:tasks.rados.rados.0.trial188.stdout:114: finishing write tid 2 to trial18843701-31 2026-02-13T20:12:11.506 INFO:tasks.rados.rados.0.trial188.stdout:114: finishing write tid 3 to trial18843701-31 2026-02-13T20:12:11.506 INFO:tasks.rados.rados.0.trial188.stdout:114: finishing write tid 4 to trial18843701-31 2026-02-13T20:12:11.506 INFO:tasks.rados.rados.0.trial188.stdout:114: finishing write tid 5 to trial18843701-31 2026-02-13T20:12:11.507 INFO:tasks.rados.rados.0.trial188.stdout:114: oid 31 updating version 0 to 5 2026-02-13T20:12:11.507 INFO:tasks.rados.rados.0.trial188.stdout:114: oid 31 updating version 5 to 6 2026-02-13T20:12:11.507 INFO:tasks.rados.rados.0.trial188.stdout:114: oid 31 updating version 6 to 8 2026-02-13T20:12:11.507 INFO:tasks.rados.rados.0.trial188.stdout:114: oid 31 version 8 is already newer than 7 2026-02-13T20:12:11.507 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 31 v 8 (ObjNum 74 snap 7 seq_num 74) dirty exists 2026-02-13T20:12:11.507 INFO:tasks.rados.rados.0.trial188.stdout:114: left oid 31 (ObjNum 74 snap 7 seq_num 74) 2026-02-13T20:12:11.520 INFO:tasks.rados.rados.0.trial188.stdout:116: finishing write tid 1 to trial18843701-22 2026-02-13T20:12:11.521 INFO:tasks.rados.rados.0.trial188.stdout:116: finishing write tid 2 to trial18843701-22 2026-02-13T20:12:11.521 INFO:tasks.rados.rados.0.trial188.stdout:116: finishing write tid 3 to trial18843701-22 2026-02-13T20:12:11.521 INFO:tasks.rados.rados.0.trial188.stdout:116: finishing write tid 4 to trial18843701-22 2026-02-13T20:12:11.521 INFO:tasks.rados.rados.0.trial188.stdout:116: finishing write tid 5 to trial18843701-22 2026-02-13T20:12:11.521 INFO:tasks.rados.rados.0.trial188.stdout:116: oid 22 updating version 0 to 15 2026-02-13T20:12:11.522 INFO:tasks.rados.rados.0.trial188.stdout:116: oid 22 updating version 15 to 16 2026-02-13T20:12:11.522 INFO:tasks.rados.rados.0.trial188.stdout:116: oid 22 updating version 16 to 17 2026-02-13T20:12:11.522 INFO:tasks.rados.rados.0.trial188.stdout:116: oid 22 version 17 is already newer than 14 2026-02-13T20:12:11.522 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 22 v 17 (ObjNum 75 snap 7 seq_num 75) dirty exists 2026-02-13T20:12:11.522 INFO:tasks.rados.rados.0.trial188.stdout:116: left oid 22 (ObjNum 75 snap 7 seq_num 75) 2026-02-13T20:12:12.495 INFO:tasks.rados.rados.0.trial188.stdout:114: done (2 left) 2026-02-13T20:12:12.495 INFO:tasks.rados.rados.0.trial188.stdout:116: done (1 left) 2026-02-13T20:12:12.495 INFO:tasks.rados.rados.0.trial188.stdout:117: done (0 left) 2026-02-13T20:12:12.495 INFO:tasks.rados.rados.0.trial188.stdout:118: read oid 45 snap -1 2026-02-13T20:12:12.495 INFO:tasks.rados.rados.0.trial188.stdout:118: expect (ObjNum 44 snap 0 seq_num 44) 2026-02-13T20:12:12.495 INFO:tasks.rados.rados.0.trial188.stdout:119: delete oid 41 current snap is 8 2026-02-13T20:12:12.498 INFO:tasks.rados.rados.0.trial188.stdout:119: done (1 left) 2026-02-13T20:12:12.498 INFO:tasks.rados.rados.0.trial188.stdout:120: read oid 4 snap 5 2026-02-13T20:12:12.498 INFO:tasks.rados.rados.0.trial188.stdout:120: expect (ObjNum 70 snap 5 seq_num 70) 2026-02-13T20:12:12.498 INFO:tasks.rados.rados.0.trial188.stdout:121: snap_create 2026-02-13T20:12:12.498 INFO:tasks.rados.rados.0.trial188.stdout:118: expect (ObjNum 44 snap 0 seq_num 44) 2026-02-13T20:12:12.501 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1695992 2026-02-13T20:12:12.539 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2104333 2026-02-13T20:12:12.543 INFO:tasks.rados.rados.0.trial188.stdout:120: expect (ObjNum 70 snap 5 seq_num 70) 2026-02-13T20:12:12.543 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:12.591 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2444300 2026-02-13T20:12:13.498 INFO:tasks.rados.rados.0.trial188.stdout:118: done (2 left) 2026-02-13T20:12:13.499 INFO:tasks.rados.rados.0.trial188.stdout:120: done (1 left) 2026-02-13T20:12:13.499 INFO:tasks.rados.rados.0.trial188.stdout:121: done (0 left) 2026-02-13T20:12:13.499 INFO:tasks.rados.rados.0.trial188.stdout:122: read oid 17 snap -1 2026-02-13T20:12:13.499 INFO:tasks.rados.rados.0.trial188.stdout:122: expect (ObjNum 53 snap 1 seq_num 53) 2026-02-13T20:12:13.499 INFO:tasks.rados.rados.0.trial188.stdout:123: copy_from oid 32 from oid 26 current snap is 9 2026-02-13T20:12:13.499 INFO:tasks.rados.rados.0.trial188.stdout:124: copy_from oid 30 from oid 45 current snap is 9 2026-02-13T20:12:13.499 INFO:tasks.rados.rados.0.trial188.stdout:125: read oid 43 snap -1 2026-02-13T20:12:13.499 INFO:tasks.rados.rados.0.trial188.stdout:125: expect (ObjNum 42 snap 0 seq_num 42) 2026-02-13T20:12:13.500 INFO:tasks.rados.rados.0.trial188.stdout:126: write (excl) oid 1 current snap is 9 2026-02-13T20:12:13.500 INFO:tasks.rados.rados.0.trial188.stdout:126: seq_num 77 ranges {494139=557703,1455937=734021,2948041=346098} 2026-02-13T20:12:13.502 INFO:tasks.rados.rados.0.trial188.stdout:126: writing trial18843701-1 from 494139 to 1051842 tid 1 2026-02-13T20:12:13.507 INFO:tasks.rados.rados.0.trial188.stdout:126: writing trial18843701-1 from 1455937 to 2189958 tid 2 2026-02-13T20:12:13.511 INFO:tasks.rados.rados.0.trial188.stdout:126: writing trial18843701-1 from 2948041 to 3294139 tid 3 2026-02-13T20:12:13.511 INFO:tasks.rados.rados.0.trial188.stdout:127: delete oid 37 current snap is 9 2026-02-13T20:12:13.511 INFO:tasks.rados.rados.0.trial188.stdout:122: expect (ObjNum 53 snap 1 seq_num 53) 2026-02-13T20:12:13.586 INFO:tasks.rados.rados.0.trial188.stdout:125: expect (ObjNum 42 snap 0 seq_num 42) 2026-02-13T20:12:13.586 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:13.645 INFO:tasks.rados.rados.0.trial188.stdout:126: finishing write tid 1 to trial18843701-1 2026-02-13T20:12:13.645 INFO:tasks.rados.rados.0.trial188.stdout:123: finishing copy_from racing read to trial18843701-32 2026-02-13T20:12:13.645 INFO:tasks.rados.rados.0.trial188.stdout:124: finishing copy_from racing read to trial18843701-30 2026-02-13T20:12:13.645 INFO:tasks.rados.rados.0.trial188.stdout:124: finishing copy_from to trial18843701-30 2026-02-13T20:12:13.645 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 30 v 23 (ObjNum 44 snap 0 seq_num 44) dirty exists 2026-02-13T20:12:13.645 INFO:tasks.rados.rados.0.trial188.stdout:126: finishing write tid 2 to trial18843701-1 2026-02-13T20:12:13.646 INFO:tasks.rados.rados.0.trial188.stdout:122: done (5 left) 2026-02-13T20:12:13.646 INFO:tasks.rados.rados.0.trial188.stdout:124: done (4 left) 2026-02-13T20:12:13.646 INFO:tasks.rados.rados.0.trial188.stdout:125: done (3 left) 2026-02-13T20:12:13.646 INFO:tasks.rados.rados.0.trial188.stdout:127: done (2 left) 2026-02-13T20:12:13.646 INFO:tasks.rados.rados.0.trial188.stdout:128: read oid 19 snap -1 2026-02-13T20:12:13.646 INFO:tasks.rados.rados.0.trial188.stdout:128: expect (ObjNum 54 snap 1 seq_num 54) 2026-02-13T20:12:13.646 INFO:tasks.rados.rados.0.trial188.stdout:129: read oid 30 snap -1 2026-02-13T20:12:13.646 INFO:tasks.rados.rados.0.trial188.stdout:129: expect (ObjNum 44 snap 0 seq_num 44) 2026-02-13T20:12:13.646 INFO:tasks.rados.rados.0.trial188.stdout:130: write (excl) oid 43 current snap is 9 2026-02-13T20:12:13.646 INFO:tasks.rados.rados.0.trial188.stdout:123: finishing copy_from to trial18843701-32 2026-02-13T20:12:13.646 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 32 v 22 (ObjNum 25 snap 0 seq_num 25) dirty exists 2026-02-13T20:12:13.646 INFO:tasks.rados.rados.0.trial188.stdout:126: finishing write tid 3 to trial18843701-1 2026-02-13T20:12:13.647 INFO:tasks.rados.rados.0.trial188.stdout:130: seq_num 79 ranges {527753=708201,1856548=737690,3286534=41219} 2026-02-13T20:12:13.648 INFO:tasks.rados.rados.0.trial188.stdout:130: writing trial18843701-43 from 527753 to 1235954 tid 1 2026-02-13T20:12:13.653 INFO:tasks.rados.rados.0.trial188.stdout:130: writing trial18843701-43 from 1856548 to 2594238 tid 2 2026-02-13T20:12:13.656 INFO:tasks.rados.rados.0.trial188.stdout:130: writing trial18843701-43 from 3286534 to 3327753 tid 3 2026-02-13T20:12:13.656 INFO:tasks.rados.rados.0.trial188.stdout:123: done (4 left) 2026-02-13T20:12:13.657 INFO:tasks.rados.rados.0.trial188.stdout:131: snap_remove snap 7 2026-02-13T20:12:14.503 INFO:tasks.rados.rados.0.trial188.stdout:131: done (4 left) 2026-02-13T20:12:14.504 INFO:tasks.rados.rados.0.trial188.stdout:132: delete oid 10 current snap is 9 2026-02-13T20:12:14.504 INFO:tasks.rados.rados.0.trial188.stdout:126: finishing write tid 4 to trial18843701-1 2026-02-13T20:12:14.504 INFO:tasks.rados.rados.0.trial188.stdout:126: finishing write tid 5 to trial18843701-1 2026-02-13T20:12:14.504 INFO:tasks.rados.rados.0.trial188.stdout:126: oid 1 updating version 0 to 49 2026-02-13T20:12:14.504 INFO:tasks.rados.rados.0.trial188.stdout:126: oid 1 updating version 49 to 50 2026-02-13T20:12:14.504 INFO:tasks.rados.rados.0.trial188.stdout:126: oid 1 version 50 is already newer than 48 2026-02-13T20:12:14.504 INFO:tasks.rados.rados.0.trial188.stdout:126: oid 1 updating version 50 to 51 2026-02-13T20:12:14.504 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 1 v 51 (ObjNum 77 snap 9 seq_num 77) dirty exists 2026-02-13T20:12:14.504 INFO:tasks.rados.rados.0.trial188.stdout:126: left oid 1 (ObjNum 77 snap 9 seq_num 77) 2026-02-13T20:12:14.504 INFO:tasks.rados.rados.0.trial188.stdout:128: expect (ObjNum 54 snap 1 seq_num 54) 2026-02-13T20:12:14.505 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 296340 2026-02-13T20:12:14.535 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1092413 2026-02-13T20:12:14.559 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1180823 2026-02-13T20:12:14.577 INFO:tasks.rados.rados.0.trial188.stdout:129: expect (ObjNum 44 snap 0 seq_num 44) 2026-02-13T20:12:14.577 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:14.596 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:14.635 INFO:tasks.rados.rados.0.trial188.stdout:130: finishing write tid 1 to trial18843701-43 2026-02-13T20:12:14.635 INFO:tasks.rados.rados.0.trial188.stdout:126: done (4 left) 2026-02-13T20:12:14.635 INFO:tasks.rados.rados.0.trial188.stdout:128: done (3 left) 2026-02-13T20:12:14.635 INFO:tasks.rados.rados.0.trial188.stdout:129: done (2 left) 2026-02-13T20:12:14.636 INFO:tasks.rados.rados.0.trial188.stdout:132: done (1 left) 2026-02-13T20:12:14.636 INFO:tasks.rados.rados.0.trial188.stdout:133: snap_remove snap 8 2026-02-13T20:12:15.480 INFO:tasks.rados.rados.0.trial188.stdout:133: done (1 left) 2026-02-13T20:12:15.480 INFO:tasks.rados.rados.0.trial188.stdout:134: rollback oid 11 current snap is 9 2026-02-13T20:12:15.480 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 11 to 5 2026-02-13T20:12:15.480 INFO:tasks.rados.rados.0.trial188.stdout:130: finishing write tid 2 to trial18843701-43 2026-02-13T20:12:15.480 INFO:tasks.rados.rados.0.trial188.stdout:130: finishing write tid 3 to trial18843701-43 2026-02-13T20:12:15.480 INFO:tasks.rados.rados.0.trial188.stdout:130: finishing write tid 4 to trial18843701-43 2026-02-13T20:12:15.480 INFO:tasks.rados.rados.0.trial188.stdout:130: finishing write tid 5 to trial18843701-43 2026-02-13T20:12:15.480 INFO:tasks.rados.rados.0.trial188.stdout:130: oid 43 updating version 0 to 21 2026-02-13T20:12:15.480 INFO:tasks.rados.rados.0.trial188.stdout:130: oid 43 updating version 21 to 22 2026-02-13T20:12:15.481 INFO:tasks.rados.rados.0.trial188.stdout:130: oid 43 version 22 is already newer than 20 2026-02-13T20:12:15.481 INFO:tasks.rados.rados.0.trial188.stdout:130: oid 43 version 22 is already newer than 19 2026-02-13T20:12:15.481 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 43 v 22 (ObjNum 79 snap 9 seq_num 79) dirty exists 2026-02-13T20:12:15.481 INFO:tasks.rados.rados.0.trial188.stdout:130: left oid 43 (ObjNum 79 snap 9 seq_num 79) 2026-02-13T20:12:15.481 INFO:tasks.rados.rados.0.trial188.stdout:130: done (1 left) 2026-02-13T20:12:15.481 INFO:tasks.rados.rados.0.trial188.stdout:135: rollback oid 27 current snap is 9 2026-02-13T20:12:15.481 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 27 to 5 2026-02-13T20:12:15.481 INFO:tasks.rados.rados.0.trial188.stdout:136: write (excl) oid 41 current snap is 9 2026-02-13T20:12:15.481 INFO:tasks.rados.rados.0.trial188.stdout:136: seq_num 81 ranges {561367=458699,1573512=741359,2941380=419987} 2026-02-13T20:12:15.484 INFO:tasks.rados.rados.0.trial188.stdout:136: writing trial18843701-41 from 561367 to 1020066 tid 1 2026-02-13T20:12:15.489 INFO:tasks.rados.rados.0.trial188.stdout:136: writing trial18843701-41 from 1573512 to 2314871 tid 2 2026-02-13T20:12:15.493 INFO:tasks.rados.rados.0.trial188.stdout:136: writing trial18843701-41 from 2941380 to 3361367 tid 3 2026-02-13T20:12:15.493 INFO:tasks.rados.rados.0.trial188.stdout:137: write (excl) oid 8 current snap is 9 2026-02-13T20:12:15.493 INFO:tasks.rados.rados.0.trial188.stdout:134: finishing rollback tid 0 to trial18843701-11 2026-02-13T20:12:15.494 INFO:tasks.rados.rados.0.trial188.stdout:135: finishing rollback tid 0 to trial18843701-27 2026-02-13T20:12:15.494 INFO:tasks.rados.rados.0.trial188.stdout:134: finishing rollback tid 1 to trial18843701-11 2026-02-13T20:12:15.494 INFO:tasks.rados.rados.0.trial188.stdout:137: seq_num 82 ranges {578174=533948,1515641=485017,2736097=502305} 2026-02-13T20:12:15.497 INFO:tasks.rados.rados.0.trial188.stdout:137: writing trial18843701-8 from 578174 to 1112122 tid 1 2026-02-13T20:12:15.501 INFO:tasks.rados.rados.0.trial188.stdout:137: writing trial18843701-8 from 1515641 to 2000658 tid 2 2026-02-13T20:12:15.505 INFO:tasks.rados.rados.0.trial188.stdout:137: writing trial18843701-8 from 2736097 to 3238402 tid 3 2026-02-13T20:12:15.506 INFO:tasks.rados.rados.0.trial188.stdout:138: delete oid 2 current snap is 9 2026-02-13T20:12:15.506 INFO:tasks.rados.rados.0.trial188.stdout:135: finishing rollback tid 1 to trial18843701-27 2026-02-13T20:12:15.506 INFO:tasks.rados.rados.0.trial188.stdout:135: finishing rollback tid 2 to trial18843701-27 2026-02-13T20:12:15.506 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 27 v 29 (ObjNum 26 snap 0 seq_num 26) dirty exists 2026-02-13T20:12:15.506 INFO:tasks.rados.rados.0.trial188.stdout:134: finishing rollback tid 2 to trial18843701-11 2026-02-13T20:12:15.506 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 11 v 52 (ObjNum 58 snap 4 seq_num 58) dirty exists 2026-02-13T20:12:15.506 INFO:tasks.rados.rados.0.trial188.stdout:136: finishing write tid 1 to trial18843701-41 2026-02-13T20:12:15.508 INFO:tasks.rados.rados.0.trial188.stdout:136: finishing write tid 2 to trial18843701-41 2026-02-13T20:12:15.509 INFO:tasks.rados.rados.0.trial188.stdout:136: finishing write tid 3 to trial18843701-41 2026-02-13T20:12:15.509 INFO:tasks.rados.rados.0.trial188.stdout:136: finishing write tid 4 to trial18843701-41 2026-02-13T20:12:15.509 INFO:tasks.rados.rados.0.trial188.stdout:136: finishing write tid 5 to trial18843701-41 2026-02-13T20:12:15.510 INFO:tasks.rados.rados.0.trial188.stdout:136: oid 41 updating version 0 to 26 2026-02-13T20:12:15.510 INFO:tasks.rados.rados.0.trial188.stdout:136: oid 41 version 26 is already newer than 25 2026-02-13T20:12:15.510 INFO:tasks.rados.rados.0.trial188.stdout:136: oid 41 version 26 is already newer than 23 2026-02-13T20:12:15.510 INFO:tasks.rados.rados.0.trial188.stdout:136: oid 41 version 26 is already newer than 24 2026-02-13T20:12:15.510 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 41 v 26 (ObjNum 81 snap 9 seq_num 81) dirty exists 2026-02-13T20:12:15.510 INFO:tasks.rados.rados.0.trial188.stdout:136: left oid 41 (ObjNum 81 snap 9 seq_num 81) 2026-02-13T20:12:15.514 INFO:tasks.rados.rados.0.trial188.stdout:134: done (4 left) 2026-02-13T20:12:15.514 INFO:tasks.rados.rados.0.trial188.stdout:135: done (3 left) 2026-02-13T20:12:15.514 INFO:tasks.rados.rados.0.trial188.stdout:136: done (2 left) 2026-02-13T20:12:15.514 INFO:tasks.rados.rados.0.trial188.stdout:138: done (1 left) 2026-02-13T20:12:15.514 INFO:tasks.rados.rados.0.trial188.stdout:139: rollback oid 3 current snap is 9 2026-02-13T20:12:15.514 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 3 to 5 2026-02-13T20:12:15.514 INFO:tasks.rados.rados.0.trial188.stdout:140: rollback oid 42 current snap is 9 2026-02-13T20:12:15.514 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 42 to 5 2026-02-13T20:12:15.514 INFO:tasks.rados.rados.0.trial188.stdout:141: write (excl) oid 43 current snap is 9 2026-02-13T20:12:15.514 INFO:tasks.rados.rados.0.trial188.stdout:141: seq_num 84 ranges {611788=400799,1748958=488686,2907296=504492} 2026-02-13T20:12:15.517 INFO:tasks.rados.rados.0.trial188.stdout:141: writing trial18843701-43 from 611788 to 1012587 tid 1 2026-02-13T20:12:15.522 INFO:tasks.rados.rados.0.trial188.stdout:141: writing trial18843701-43 from 1748958 to 2237644 tid 2 2026-02-13T20:12:15.527 INFO:tasks.rados.rados.0.trial188.stdout:141: writing trial18843701-43 from 2907296 to 3411788 tid 3 2026-02-13T20:12:15.527 INFO:tasks.rados.rados.0.trial188.stdout:142: rollback oid 26 current snap is 9 2026-02-13T20:12:15.527 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 26 to 5 2026-02-13T20:12:15.527 INFO:tasks.rados.rados.0.trial188.stdout:140: finishing rollback tid 1 to trial18843701-42 2026-02-13T20:12:15.527 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 42 v 0 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-13T20:12:15.527 INFO:tasks.rados.rados.0.trial188.stdout:137: finishing write tid 1 to trial18843701-8 2026-02-13T20:12:15.527 INFO:tasks.rados.rados.0.trial188.stdout:137: finishing write tid 2 to trial18843701-8 2026-02-13T20:12:15.527 INFO:tasks.rados.rados.0.trial188.stdout:139: finishing rollback tid 0 to trial18843701-3 2026-02-13T20:12:15.527 INFO:tasks.rados.rados.0.trial188.stdout:140: done (4 left) 2026-02-13T20:12:15.527 INFO:tasks.rados.rados.0.trial188.stdout:143: write oid 29 current snap is 9 2026-02-13T20:12:15.527 INFO:tasks.rados.rados.0.trial188.stdout:143: seq_num 85 ranges {628595=476048,1807440=632344,2934719=452474} 2026-02-13T20:12:15.531 INFO:tasks.rados.rados.0.trial188.stdout:143: writing trial18843701-29 from 628595 to 1104643 tid 1 2026-02-13T20:12:15.536 INFO:tasks.rados.rados.0.trial188.stdout:143: writing trial18843701-29 from 1807440 to 2439784 tid 2 2026-02-13T20:12:15.540 INFO:tasks.rados.rados.0.trial188.stdout:143: writing trial18843701-29 from 2934719 to 3387193 tid 3 2026-02-13T20:12:15.540 INFO:tasks.rados.rados.0.trial188.stdout:144: write oid 18 current snap is 9 2026-02-13T20:12:15.540 INFO:tasks.rados.rados.0.trial188.stdout:144: seq_num 86 ranges {645402=551297,1749569=492355,2845789=599613} 2026-02-13T20:12:15.544 INFO:tasks.rados.rados.0.trial188.stdout:144: writing trial18843701-18 from 645402 to 1196699 tid 1 2026-02-13T20:12:15.548 INFO:tasks.rados.rados.0.trial188.stdout:144: writing trial18843701-18 from 1749569 to 2241924 tid 2 2026-02-13T20:12:15.553 INFO:tasks.rados.rados.0.trial188.stdout:144: writing trial18843701-18 from 2845789 to 3445402 tid 3 2026-02-13T20:12:15.553 INFO:tasks.rados.rados.0.trial188.stdout:145: snap_create 2026-02-13T20:12:15.553 INFO:tasks.rados.rados.0.trial188.stdout:137: finishing write tid 3 to trial18843701-8 2026-02-13T20:12:15.553 INFO:tasks.rados.rados.0.trial188.stdout:137: finishing write tid 4 to trial18843701-8 2026-02-13T20:12:15.553 INFO:tasks.rados.rados.0.trial188.stdout:139: finishing rollback tid 1 to trial18843701-3 2026-02-13T20:12:15.553 INFO:tasks.rados.rados.0.trial188.stdout:139: finishing rollback tid 2 to trial18843701-3 2026-02-13T20:12:15.553 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 3 v 32 (ObjNum 51 snap 1 seq_num 51) dirty exists 2026-02-13T20:12:15.553 INFO:tasks.rados.rados.0.trial188.stdout:137: finishing write tid 5 to trial18843701-8 2026-02-13T20:12:15.553 INFO:tasks.rados.rados.0.trial188.stdout:137: oid 8 updating version 0 to 42 2026-02-13T20:12:15.553 INFO:tasks.rados.rados.0.trial188.stdout:137: oid 8 version 42 is already newer than 40 2026-02-13T20:12:15.553 INFO:tasks.rados.rados.0.trial188.stdout:137: oid 8 version 42 is already newer than 39 2026-02-13T20:12:15.553 INFO:tasks.rados.rados.0.trial188.stdout:137: oid 8 version 42 is already newer than 41 2026-02-13T20:12:15.553 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 8 v 42 (ObjNum 82 snap 9 seq_num 82) dirty exists 2026-02-13T20:12:15.553 INFO:tasks.rados.rados.0.trial188.stdout:137: left oid 8 (ObjNum 82 snap 9 seq_num 82) 2026-02-13T20:12:15.553 INFO:tasks.rados.rados.0.trial188.stdout:142: finishing rollback tid 0 to trial18843701-26 2026-02-13T20:12:15.554 INFO:tasks.rados.rados.0.trial188.stdout:142: finishing rollback tid 1 to trial18843701-26 2026-02-13T20:12:15.554 INFO:tasks.rados.rados.0.trial188.stdout:142: finishing rollback tid 2 to trial18843701-26 2026-02-13T20:12:15.554 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 26 v 36 (ObjNum 25 snap 0 seq_num 25) dirty exists 2026-02-13T20:12:15.554 INFO:tasks.rados.rados.0.trial188.stdout:141: finishing write tid 1 to trial18843701-43 2026-02-13T20:12:15.554 INFO:tasks.rados.rados.0.trial188.stdout:141: finishing write tid 2 to trial18843701-43 2026-02-13T20:12:15.554 INFO:tasks.rados.rados.0.trial188.stdout:141: finishing write tid 3 to trial18843701-43 2026-02-13T20:12:15.554 INFO:tasks.rados.rados.0.trial188.stdout:141: finishing write tid 4 to trial18843701-43 2026-02-13T20:12:15.554 INFO:tasks.rados.rados.0.trial188.stdout:141: finishing write tid 5 to trial18843701-43 2026-02-13T20:12:15.554 INFO:tasks.rados.rados.0.trial188.stdout:141: oid 43 updating version 0 to 30 2026-02-13T20:12:15.554 INFO:tasks.rados.rados.0.trial188.stdout:141: oid 43 version 30 is already newer than 27 2026-02-13T20:12:15.554 INFO:tasks.rados.rados.0.trial188.stdout:141: oid 43 version 30 is already newer than 28 2026-02-13T20:12:15.554 INFO:tasks.rados.rados.0.trial188.stdout:141: oid 43 version 30 is already newer than 29 2026-02-13T20:12:15.554 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 43 v 30 (ObjNum 84 snap 9 seq_num 84) dirty exists 2026-02-13T20:12:15.554 INFO:tasks.rados.rados.0.trial188.stdout:141: left oid 43 (ObjNum 84 snap 9 seq_num 84) 2026-02-13T20:12:15.554 INFO:tasks.rados.rados.0.trial188.stdout:143: finishing write tid 1 to trial18843701-29 2026-02-13T20:12:15.560 INFO:tasks.rados.rados.0.trial188.stdout:143: finishing write tid 2 to trial18843701-29 2026-02-13T20:12:15.560 INFO:tasks.rados.rados.0.trial188.stdout:143: finishing write tid 3 to trial18843701-29 2026-02-13T20:12:15.560 INFO:tasks.rados.rados.0.trial188.stdout:143: finishing write tid 4 to trial18843701-29 2026-02-13T20:12:15.560 INFO:tasks.rados.rados.0.trial188.stdout:143: finishing write tid 5 to trial18843701-29 2026-02-13T20:12:15.560 INFO:tasks.rados.rados.0.trial188.stdout:143: oid 29 updating version 0 to 37 2026-02-13T20:12:15.560 INFO:tasks.rados.rados.0.trial188.stdout:143: oid 29 updating version 37 to 38 2026-02-13T20:12:15.560 INFO:tasks.rados.rados.0.trial188.stdout:143: oid 29 updating version 38 to 39 2026-02-13T20:12:15.560 INFO:tasks.rados.rados.0.trial188.stdout:143: oid 29 updating version 39 to 40 2026-02-13T20:12:15.560 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 29 v 40 (ObjNum 85 snap 9 seq_num 85) dirty exists 2026-02-13T20:12:15.560 INFO:tasks.rados.rados.0.trial188.stdout:143: left oid 29 (ObjNum 85 snap 9 seq_num 85) 2026-02-13T20:12:15.566 INFO:tasks.rados.rados.0.trial188.stdout:144: finishing write tid 1 to trial18843701-18 2026-02-13T20:12:15.574 INFO:tasks.rados.rados.0.trial188.stdout:144: finishing write tid 2 to trial18843701-18 2026-02-13T20:12:15.574 INFO:tasks.rados.rados.0.trial188.stdout:144: finishing write tid 3 to trial18843701-18 2026-02-13T20:12:15.574 INFO:tasks.rados.rados.0.trial188.stdout:144: finishing write tid 4 to trial18843701-18 2026-02-13T20:12:15.574 INFO:tasks.rados.rados.0.trial188.stdout:144: finishing write tid 5 to trial18843701-18 2026-02-13T20:12:15.574 INFO:tasks.rados.rados.0.trial188.stdout:144: oid 18 updating version 0 to 24 2026-02-13T20:12:15.574 INFO:tasks.rados.rados.0.trial188.stdout:144: oid 18 version 24 is already newer than 23 2026-02-13T20:12:15.574 INFO:tasks.rados.rados.0.trial188.stdout:144: oid 18 updating version 24 to 25 2026-02-13T20:12:15.574 INFO:tasks.rados.rados.0.trial188.stdout:144: oid 18 updating version 25 to 26 2026-02-13T20:12:15.574 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 18 v 26 (ObjNum 86 snap 9 seq_num 86) dirty exists 2026-02-13T20:12:15.574 INFO:tasks.rados.rados.0.trial188.stdout:144: left oid 18 (ObjNum 86 snap 9 seq_num 86) 2026-02-13T20:12:16.506 INFO:tasks.rados.rados.0.trial188.stdout:137: done (6 left) 2026-02-13T20:12:16.507 INFO:tasks.rados.rados.0.trial188.stdout:139: done (5 left) 2026-02-13T20:12:16.507 INFO:tasks.rados.rados.0.trial188.stdout:141: done (4 left) 2026-02-13T20:12:16.507 INFO:tasks.rados.rados.0.trial188.stdout:142: done (3 left) 2026-02-13T20:12:16.507 INFO:tasks.rados.rados.0.trial188.stdout:143: done (2 left) 2026-02-13T20:12:16.507 INFO:tasks.rados.rados.0.trial188.stdout:144: done (1 left) 2026-02-13T20:12:16.507 INFO:tasks.rados.rados.0.trial188.stdout:145: done (0 left) 2026-02-13T20:12:16.507 INFO:tasks.rados.rados.0.trial188.stdout:146: copy_from oid 44 from oid 37 current snap is 10 2026-02-13T20:12:16.508 INFO:tasks.rados.rados.0.trial188.stdout:147: snap_create 2026-02-13T20:12:16.508 INFO:tasks.rados.rados.0.trial188.stdout:146: finishing copy_from to trial18843701-44 2026-02-13T20:12:16.508 INFO:tasks.rados.rados.0.trial188.stdout:146: got expected ENOENT (src dne) 2026-02-13T20:12:16.508 INFO:tasks.rados.rados.0.trial188.stdout:146: finishing copy_from racing read to trial18843701-44 2026-02-13T20:12:17.507 INFO:tasks.rados.rados.0.trial188.stdout:146: done (1 left) 2026-02-13T20:12:17.507 INFO:tasks.rados.rados.0.trial188.stdout:147: done (0 left) 2026-02-13T20:12:17.507 INFO:tasks.rados.rados.0.trial188.stdout:148: read oid 12 snap -1 2026-02-13T20:12:17.507 INFO:tasks.rados.rados.0.trial188.stdout:148: expect (ObjNum 11 snap 0 seq_num 11) 2026-02-13T20:12:17.507 INFO:tasks.rados.rados.0.trial188.stdout:149: read oid 37 snap -1 2026-02-13T20:12:17.507 INFO:tasks.rados.rados.0.trial188.stdout:149: expect deleted 2026-02-13T20:12:17.508 INFO:tasks.rados.rados.0.trial188.stdout:150: snap_remove snap 5 2026-02-13T20:12:18.510 INFO:tasks.rados.rados.0.trial188.stdout:150: done (2 left) 2026-02-13T20:12:18.510 INFO:tasks.rados.rados.0.trial188.stdout:151: read oid 2 snap -1 2026-02-13T20:12:18.511 INFO:tasks.rados.rados.0.trial188.stdout:151: expect deleted 2026-02-13T20:12:18.511 INFO:tasks.rados.rados.0.trial188.stdout:152: read oid 19 snap 9 2026-02-13T20:12:18.511 INFO:tasks.rados.rados.0.trial188.stdout:152: expect (ObjNum 54 snap 1 seq_num 54) 2026-02-13T20:12:18.511 INFO:tasks.rados.rados.0.trial188.stdout:153: snap_create 2026-02-13T20:12:18.511 INFO:tasks.rados.rados.0.trial188.stdout:148: expect (ObjNum 11 snap 0 seq_num 11) 2026-02-13T20:12:18.511 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:18.525 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:18.540 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:18.556 INFO:tasks.rados.rados.0.trial188.stdout:152: expect (ObjNum 54 snap 1 seq_num 54) 2026-02-13T20:12:18.556 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:18.583 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:19.513 INFO:tasks.rados.rados.0.trial188.stdout:148: done (4 left) 2026-02-13T20:12:19.513 INFO:tasks.rados.rados.0.trial188.stdout:149: done (3 left) 2026-02-13T20:12:19.513 INFO:tasks.rados.rados.0.trial188.stdout:151: done (2 left) 2026-02-13T20:12:19.513 INFO:tasks.rados.rados.0.trial188.stdout:152: done (1 left) 2026-02-13T20:12:19.513 INFO:tasks.rados.rados.0.trial188.stdout:153: done (0 left) 2026-02-13T20:12:19.513 INFO:tasks.rados.rados.0.trial188.stdout:154: write (excl) oid 32 current snap is 12 2026-02-13T20:12:19.513 INFO:tasks.rados.rados.0.trial188.stdout:154: seq_num 87 ranges {662209=626546,1808051=636013,2873212=588997} 2026-02-13T20:12:19.517 INFO:tasks.rados.rados.0.trial188.stdout:154: writing trial18843701-32 from 662209 to 1288755 tid 1 2026-02-13T20:12:19.523 INFO:tasks.rados.rados.0.trial188.stdout:154: writing trial18843701-32 from 1808051 to 2444064 tid 2 2026-02-13T20:12:19.527 INFO:tasks.rados.rados.0.trial188.stdout:154: writing trial18843701-32 from 2873212 to 3462209 tid 3 2026-02-13T20:12:19.527 INFO:tasks.rados.rados.0.trial188.stdout:155: write (excl) oid 20 current snap is 12 2026-02-13T20:12:19.527 INFO:tasks.rados.rados.0.trial188.stdout:155: seq_num 88 ranges {679016=701795,1866533=496024,2900635=402643} 2026-02-13T20:12:19.532 INFO:tasks.rados.rados.0.trial188.stdout:155: writing trial18843701-20 from 679016 to 1380811 tid 1 2026-02-13T20:12:19.535 INFO:tasks.rados.rados.0.trial188.stdout:155: writing trial18843701-20 from 1866533 to 2362557 tid 2 2026-02-13T20:12:19.539 INFO:tasks.rados.rados.0.trial188.stdout:155: writing trial18843701-20 from 2900635 to 3303278 tid 3 2026-02-13T20:12:19.539 INFO:tasks.rados.rados.0.trial188.stdout:156: snap_remove snap 11 2026-02-13T20:12:20.481 INFO:tasks.rados.rados.0.trial188.stdout:156: done (2 left) 2026-02-13T20:12:20.482 INFO:tasks.rados.rados.0.trial188.stdout:157: read oid 50 snap -1 2026-02-13T20:12:20.482 INFO:tasks.rados.rados.0.trial188.stdout:157: expect (ObjNum 49 snap 0 seq_num 49) 2026-02-13T20:12:20.482 INFO:tasks.rados.rados.0.trial188.stdout:158: snap_create 2026-02-13T20:12:20.482 INFO:tasks.rados.rados.0.trial188.stdout:154: finishing write tid 1 to trial18843701-32 2026-02-13T20:12:20.482 INFO:tasks.rados.rados.0.trial188.stdout:154: finishing write tid 2 to trial18843701-32 2026-02-13T20:12:20.482 INFO:tasks.rados.rados.0.trial188.stdout:154: finishing write tid 3 to trial18843701-32 2026-02-13T20:12:20.482 INFO:tasks.rados.rados.0.trial188.stdout:154: finishing write tid 4 to trial18843701-32 2026-02-13T20:12:20.482 INFO:tasks.rados.rados.0.trial188.stdout:154: finishing write tid 5 to trial18843701-32 2026-02-13T20:12:20.482 INFO:tasks.rados.rados.0.trial188.stdout:154: oid 32 updating version 0 to 33 2026-02-13T20:12:20.482 INFO:tasks.rados.rados.0.trial188.stdout:154: oid 32 version 33 is already newer than 32 2026-02-13T20:12:20.482 INFO:tasks.rados.rados.0.trial188.stdout:154: oid 32 updating version 33 to 35 2026-02-13T20:12:20.482 INFO:tasks.rados.rados.0.trial188.stdout:154: oid 32 version 35 is already newer than 34 2026-02-13T20:12:20.483 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 32 v 35 (ObjNum 87 snap 12 seq_num 87) dirty exists 2026-02-13T20:12:20.483 INFO:tasks.rados.rados.0.trial188.stdout:154: left oid 32 (ObjNum 87 snap 12 seq_num 87) 2026-02-13T20:12:20.483 INFO:tasks.rados.rados.0.trial188.stdout:155: finishing write tid 1 to trial18843701-20 2026-02-13T20:12:20.483 INFO:tasks.rados.rados.0.trial188.stdout:155: finishing write tid 2 to trial18843701-20 2026-02-13T20:12:20.483 INFO:tasks.rados.rados.0.trial188.stdout:155: finishing write tid 3 to trial18843701-20 2026-02-13T20:12:20.483 INFO:tasks.rados.rados.0.trial188.stdout:155: finishing write tid 4 to trial18843701-20 2026-02-13T20:12:20.483 INFO:tasks.rados.rados.0.trial188.stdout:155: finishing write tid 5 to trial18843701-20 2026-02-13T20:12:20.483 INFO:tasks.rados.rados.0.trial188.stdout:155: oid 20 updating version 0 to 13 2026-02-13T20:12:20.483 INFO:tasks.rados.rados.0.trial188.stdout:155: oid 20 version 13 is already newer than 12 2026-02-13T20:12:20.483 INFO:tasks.rados.rados.0.trial188.stdout:155: oid 20 version 13 is already newer than 11 2026-02-13T20:12:20.483 INFO:tasks.rados.rados.0.trial188.stdout:155: oid 20 updating version 13 to 14 2026-02-13T20:12:20.483 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 20 v 14 (ObjNum 88 snap 12 seq_num 88) dirty exists 2026-02-13T20:12:20.483 INFO:tasks.rados.rados.0.trial188.stdout:155: left oid 20 (ObjNum 88 snap 12 seq_num 88) 2026-02-13T20:12:20.489 INFO:tasks.rados.rados.0.trial188.stdout:157: expect (ObjNum 49 snap 0 seq_num 49) 2026-02-13T20:12:20.490 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1364056 2026-02-13T20:12:20.505 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:20.524 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 209667 2026-02-13T20:12:21.484 INFO:tasks.rados.rados.0.trial188.stdout:154: done (3 left) 2026-02-13T20:12:21.484 INFO:tasks.rados.rados.0.trial188.stdout:155: done (2 left) 2026-02-13T20:12:21.484 INFO:tasks.rados.rados.0.trial188.stdout:157: done (1 left) 2026-02-13T20:12:21.484 INFO:tasks.rados.rados.0.trial188.stdout:158: done (0 left) 2026-02-13T20:12:21.485 INFO:tasks.rados.rados.0.trial188.stdout:159: read oid 24 snap -1 2026-02-13T20:12:21.485 INFO:tasks.rados.rados.0.trial188.stdout:159: expect (ObjNum 59 snap 4 seq_num 59) 2026-02-13T20:12:21.485 INFO:tasks.rados.rados.0.trial188.stdout:160: read oid 21 snap -1 2026-02-13T20:12:21.485 INFO:tasks.rados.rados.0.trial188.stdout:160: expect deleted 2026-02-13T20:12:21.485 INFO:tasks.rados.rados.0.trial188.stdout:161: rollback oid 5 current snap is 13 2026-02-13T20:12:21.485 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 5 to 12 2026-02-13T20:12:21.485 INFO:tasks.rados.rados.0.trial188.stdout:162: write (excl) oid 9 current snap is 13 2026-02-13T20:12:21.485 INFO:tasks.rados.rados.0.trial188.stdout:162: seq_num 89 ranges {695823=777044,1925015=639682,3328058=167765} 2026-02-13T20:12:21.490 INFO:tasks.rados.rados.0.trial188.stdout:162: writing trial18843701-9 from 695823 to 1472867 tid 1 2026-02-13T20:12:21.494 INFO:tasks.rados.rados.0.trial188.stdout:162: writing trial18843701-9 from 1925015 to 2564697 tid 2 2026-02-13T20:12:21.498 INFO:tasks.rados.rados.0.trial188.stdout:162: writing trial18843701-9 from 3328058 to 3495823 tid 3 2026-02-13T20:12:21.498 INFO:tasks.rados.rados.0.trial188.stdout:163: write oid 19 current snap is 13 2026-02-13T20:12:21.498 INFO:tasks.rados.rados.0.trial188.stdout:163: seq_num 90 ranges {712630=452293,1583497=499693,2555481=425187} 2026-02-13T20:12:21.502 INFO:tasks.rados.rados.0.trial188.stdout:163: writing trial18843701-19 from 712630 to 1164923 tid 1 2026-02-13T20:12:21.506 INFO:tasks.rados.rados.0.trial188.stdout:163: writing trial18843701-19 from 1583497 to 2083190 tid 2 2026-02-13T20:12:21.510 INFO:tasks.rados.rados.0.trial188.stdout:163: writing trial18843701-19 from 2555481 to 2980668 tid 3 2026-02-13T20:12:21.511 INFO:tasks.rados.rados.0.trial188.stdout:164: write oid 38 current snap is 13 2026-02-13T20:12:21.511 INFO:tasks.rados.rados.0.trial188.stdout:164: seq_num 91 ranges {729437=527542,1925626=643351,3266551=262886} 2026-02-13T20:12:21.515 INFO:tasks.rados.rados.0.trial188.stdout:164: writing trial18843701-38 from 729437 to 1256979 tid 1 2026-02-13T20:12:21.520 INFO:tasks.rados.rados.0.trial188.stdout:164: writing trial18843701-38 from 1925626 to 2568977 tid 2 2026-02-13T20:12:21.524 INFO:tasks.rados.rados.0.trial188.stdout:164: writing trial18843701-38 from 3266551 to 3529437 tid 3 2026-02-13T20:12:21.525 INFO:tasks.rados.rados.0.trial188.stdout:165: delete oid 43 current snap is 13 2026-02-13T20:12:21.525 INFO:tasks.rados.rados.0.trial188.stdout:161: finishing rollback tid 0 to trial18843701-5 2026-02-13T20:12:21.525 INFO:tasks.rados.rados.0.trial188.stdout:161: finishing rollback tid 1 to trial18843701-5 2026-02-13T20:12:21.525 INFO:tasks.rados.rados.0.trial188.stdout:161: finishing rollback tid 2 to trial18843701-5 2026-02-13T20:12:21.525 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 5 v 65 (ObjNum 62 snap 4 seq_num 62) dirty exists 2026-02-13T20:12:21.525 INFO:tasks.rados.rados.0.trial188.stdout:159: expect (ObjNum 59 snap 4 seq_num 59) 2026-02-13T20:12:21.525 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:21.585 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 875470 2026-02-13T20:12:21.608 INFO:tasks.rados.rados.0.trial188.stdout:162: finishing write tid 1 to trial18843701-9 2026-02-13T20:12:21.608 INFO:tasks.rados.rados.0.trial188.stdout:162: finishing write tid 2 to trial18843701-9 2026-02-13T20:12:21.609 INFO:tasks.rados.rados.0.trial188.stdout:163: finishing write tid 1 to trial18843701-19 2026-02-13T20:12:21.609 INFO:tasks.rados.rados.0.trial188.stdout:163: finishing write tid 2 to trial18843701-19 2026-02-13T20:12:21.609 INFO:tasks.rados.rados.0.trial188.stdout:163: finishing write tid 3 to trial18843701-19 2026-02-13T20:12:21.609 INFO:tasks.rados.rados.0.trial188.stdout:163: finishing write tid 4 to trial18843701-19 2026-02-13T20:12:21.609 INFO:tasks.rados.rados.0.trial188.stdout:163: finishing write tid 5 to trial18843701-19 2026-02-13T20:12:21.609 INFO:tasks.rados.rados.0.trial188.stdout:163: oid 19 updating version 0 to 49 2026-02-13T20:12:21.609 INFO:tasks.rados.rados.0.trial188.stdout:163: oid 19 version 49 is already newer than 46 2026-02-13T20:12:21.609 INFO:tasks.rados.rados.0.trial188.stdout:163: oid 19 version 49 is already newer than 47 2026-02-13T20:12:21.609 INFO:tasks.rados.rados.0.trial188.stdout:163: oid 19 version 49 is already newer than 48 2026-02-13T20:12:21.609 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 19 v 49 (ObjNum 90 snap 13 seq_num 90) dirty exists 2026-02-13T20:12:21.609 INFO:tasks.rados.rados.0.trial188.stdout:163: left oid 19 (ObjNum 90 snap 13 seq_num 90) 2026-02-13T20:12:21.609 INFO:tasks.rados.rados.0.trial188.stdout:162: finishing write tid 3 to trial18843701-9 2026-02-13T20:12:21.610 INFO:tasks.rados.rados.0.trial188.stdout:162: finishing write tid 4 to trial18843701-9 2026-02-13T20:12:21.610 INFO:tasks.rados.rados.0.trial188.stdout:164: finishing write tid 1 to trial18843701-38 2026-02-13T20:12:21.610 INFO:tasks.rados.rados.0.trial188.stdout:162: finishing write tid 5 to trial18843701-9 2026-02-13T20:12:21.610 INFO:tasks.rados.rados.0.trial188.stdout:162: oid 9 updating version 0 to 32 2026-02-13T20:12:21.610 INFO:tasks.rados.rados.0.trial188.stdout:162: oid 9 version 32 is already newer than 31 2026-02-13T20:12:21.610 INFO:tasks.rados.rados.0.trial188.stdout:162: oid 9 version 32 is already newer than 30 2026-02-13T20:12:21.610 INFO:tasks.rados.rados.0.trial188.stdout:162: oid 9 updating version 32 to 33 2026-02-13T20:12:21.610 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 9 v 33 (ObjNum 89 snap 13 seq_num 89) dirty exists 2026-02-13T20:12:21.610 INFO:tasks.rados.rados.0.trial188.stdout:162: left oid 9 (ObjNum 89 snap 13 seq_num 89) 2026-02-13T20:12:21.610 INFO:tasks.rados.rados.0.trial188.stdout:164: finishing write tid 2 to trial18843701-38 2026-02-13T20:12:21.610 INFO:tasks.rados.rados.0.trial188.stdout:164: finishing write tid 3 to trial18843701-38 2026-02-13T20:12:21.610 INFO:tasks.rados.rados.0.trial188.stdout:164: finishing write tid 4 to trial18843701-38 2026-02-13T20:12:21.611 INFO:tasks.rados.rados.0.trial188.stdout:164: finishing write tid 5 to trial18843701-38 2026-02-13T20:12:21.611 INFO:tasks.rados.rados.0.trial188.stdout:164: oid 38 updating version 0 to 39 2026-02-13T20:12:21.611 INFO:tasks.rados.rados.0.trial188.stdout:164: oid 38 updating version 39 to 40 2026-02-13T20:12:21.611 INFO:tasks.rados.rados.0.trial188.stdout:164: oid 38 version 40 is already newer than 38 2026-02-13T20:12:21.611 INFO:tasks.rados.rados.0.trial188.stdout:164: oid 38 version 40 is already newer than 37 2026-02-13T20:12:21.611 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 38 v 40 (ObjNum 91 snap 13 seq_num 91) dirty exists 2026-02-13T20:12:21.611 INFO:tasks.rados.rados.0.trial188.stdout:164: left oid 38 (ObjNum 91 snap 13 seq_num 91) 2026-02-13T20:12:21.611 INFO:tasks.rados.rados.0.trial188.stdout:159: done (6 left) 2026-02-13T20:12:21.611 INFO:tasks.rados.rados.0.trial188.stdout:160: done (5 left) 2026-02-13T20:12:21.611 INFO:tasks.rados.rados.0.trial188.stdout:161: done (4 left) 2026-02-13T20:12:21.611 INFO:tasks.rados.rados.0.trial188.stdout:162: done (3 left) 2026-02-13T20:12:21.611 INFO:tasks.rados.rados.0.trial188.stdout:163: done (2 left) 2026-02-13T20:12:21.611 INFO:tasks.rados.rados.0.trial188.stdout:164: done (1 left) 2026-02-13T20:12:21.612 INFO:tasks.rados.rados.0.trial188.stdout:165: done (0 left) 2026-02-13T20:12:21.612 INFO:tasks.rados.rados.0.trial188.stdout:166: write (excl) oid 5 current snap is 13 2026-02-13T20:12:21.612 INFO:tasks.rados.rados.0.trial188.stdout:166: seq_num 93 ranges {763051=794393,2158943=647020,3437750=125301} 2026-02-13T20:12:21.614 INFO:tasks.rados.rados.0.trial188.stdout:166: writing trial18843701-5 from 763051 to 1557444 tid 1 2026-02-13T20:12:21.618 INFO:tasks.rados.rados.0.trial188.stdout:166: writing trial18843701-5 from 2158943 to 2805963 tid 2 2026-02-13T20:12:21.622 INFO:tasks.rados.rados.0.trial188.stdout:166: writing trial18843701-5 from 3437750 to 3563051 tid 3 2026-02-13T20:12:21.622 INFO:tasks.rados.rados.0.trial188.stdout:167: rollback oid 23 current snap is 13 2026-02-13T20:12:21.622 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 23 to 10 2026-02-13T20:12:21.622 INFO:tasks.rados.rados.0.trial188.stdout:168: copy_from oid 37 from oid 19 current snap is 13 2026-02-13T20:12:21.622 INFO:tasks.rados.rados.0.trial188.stdout:169: read oid 33 snap -1 2026-02-13T20:12:21.622 INFO:tasks.rados.rados.0.trial188.stdout:169: expect (ObjNum 32 snap 0 seq_num 32) 2026-02-13T20:12:21.622 INFO:tasks.rados.rados.0.trial188.stdout:170: snap_create 2026-02-13T20:12:21.623 INFO:tasks.rados.rados.0.trial188.stdout:169: expect (ObjNum 32 snap 0 seq_num 32) 2026-02-13T20:12:21.623 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:21.675 INFO:tasks.rados.rados.0.trial188.stdout:167: finishing rollback tid 0 to trial18843701-23 2026-02-13T20:12:21.675 INFO:tasks.rados.rados.0.trial188.stdout:167: finishing rollback tid 1 to trial18843701-23 2026-02-13T20:12:21.676 INFO:tasks.rados.rados.0.trial188.stdout:167: finishing rollback tid 2 to trial18843701-23 2026-02-13T20:12:21.676 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 23 v 60 (ObjNum 22 snap 0 seq_num 22) dirty exists 2026-02-13T20:12:21.676 INFO:tasks.rados.rados.0.trial188.stdout:166: finishing write tid 1 to trial18843701-5 2026-02-13T20:12:21.676 INFO:tasks.rados.rados.0.trial188.stdout:166: finishing write tid 2 to trial18843701-5 2026-02-13T20:12:21.676 INFO:tasks.rados.rados.0.trial188.stdout:166: finishing write tid 3 to trial18843701-5 2026-02-13T20:12:21.676 INFO:tasks.rados.rados.0.trial188.stdout:166: finishing write tid 4 to trial18843701-5 2026-02-13T20:12:21.676 INFO:tasks.rados.rados.0.trial188.stdout:166: finishing write tid 5 to trial18843701-5 2026-02-13T20:12:21.676 INFO:tasks.rados.rados.0.trial188.stdout:166: oid 5 updating version 0 to 69 2026-02-13T20:12:21.676 INFO:tasks.rados.rados.0.trial188.stdout:166: oid 5 version 69 is already newer than 67 2026-02-13T20:12:21.676 INFO:tasks.rados.rados.0.trial188.stdout:166: oid 5 version 69 is already newer than 68 2026-02-13T20:12:21.676 INFO:tasks.rados.rados.0.trial188.stdout:166: oid 5 version 69 is already newer than 66 2026-02-13T20:12:21.676 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 5 v 69 (ObjNum 93 snap 13 seq_num 93) dirty exists 2026-02-13T20:12:21.677 INFO:tasks.rados.rados.0.trial188.stdout:166: left oid 5 (ObjNum 93 snap 13 seq_num 93) 2026-02-13T20:12:21.677 INFO:tasks.rados.rados.0.trial188.stdout:168: finishing copy_from racing read to trial18843701-37 2026-02-13T20:12:21.677 INFO:tasks.rados.rados.0.trial188.stdout:168: finishing copy_from to trial18843701-37 2026-02-13T20:12:21.677 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 37 v 49 (ObjNum 90 snap 13 seq_num 90) dirty exists 2026-02-13T20:12:22.522 INFO:tasks.rados.rados.0.trial188.stdout:166: done (4 left) 2026-02-13T20:12:22.522 INFO:tasks.rados.rados.0.trial188.stdout:167: done (3 left) 2026-02-13T20:12:22.522 INFO:tasks.rados.rados.0.trial188.stdout:168: done (2 left) 2026-02-13T20:12:22.522 INFO:tasks.rados.rados.0.trial188.stdout:169: done (1 left) 2026-02-13T20:12:22.522 INFO:tasks.rados.rados.0.trial188.stdout:170: done (0 left) 2026-02-13T20:12:22.522 INFO:tasks.rados.rados.0.trial188.stdout:171: rollback oid 37 current snap is 14 2026-02-13T20:12:22.522 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 37 to 10 2026-02-13T20:12:22.522 INFO:tasks.rados.rados.0.trial188.stdout:172: snap_remove snap 9 2026-02-13T20:12:23.522 INFO:tasks.rados.rados.0.trial188.stdout:172: done (1 left) 2026-02-13T20:12:23.523 INFO:tasks.rados.rados.0.trial188.stdout:173: delete oid 3 current snap is 14 2026-02-13T20:12:23.523 INFO:tasks.rados.rados.0.trial188.stdout:171: finishing rollback tid 0 to trial18843701-37 2026-02-13T20:12:23.523 INFO:tasks.rados.rados.0.trial188.stdout:171: finishing rollback tid 1 to trial18843701-37 2026-02-13T20:12:23.523 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 37 v 51 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-13T20:12:23.524 INFO:tasks.rados.rados.0.trial188.stdout:171: done (1 left) 2026-02-13T20:12:23.525 INFO:tasks.rados.rados.0.trial188.stdout:173: done (0 left) 2026-02-13T20:12:23.525 INFO:tasks.rados.rados.0.trial188.stdout:174: write oid 13 current snap is 14 2026-02-13T20:12:23.525 INFO:tasks.rados.rados.0.trial188.stdout:174: seq_num 95 ranges {796665=544891,1759554=650689,2976243=620422} 2026-02-13T20:12:23.530 INFO:tasks.rados.rados.0.trial188.stdout:174: writing trial18843701-13 from 796665 to 1341556 tid 1 2026-02-13T20:12:23.534 INFO:tasks.rados.rados.0.trial188.stdout:174: writing trial18843701-13 from 1759554 to 2410243 tid 2 2026-02-13T20:12:23.539 INFO:tasks.rados.rados.0.trial188.stdout:174: writing trial18843701-13 from 2976243 to 3596665 tid 3 2026-02-13T20:12:23.539 INFO:tasks.rados.rados.0.trial188.stdout:175: copy_from oid 26 from oid 20 current snap is 14 2026-02-13T20:12:23.539 INFO:tasks.rados.rados.0.trial188.stdout:176: read oid 29 snap -1 2026-02-13T20:12:23.539 INFO:tasks.rados.rados.0.trial188.stdout:176: expect (ObjNum 85 snap 9 seq_num 85) 2026-02-13T20:12:23.539 INFO:tasks.rados.rados.0.trial188.stdout:177: read oid 11 snap -1 2026-02-13T20:12:23.539 INFO:tasks.rados.rados.0.trial188.stdout:177: expect (ObjNum 58 snap 4 seq_num 58) 2026-02-13T20:12:23.539 INFO:tasks.rados.rados.0.trial188.stdout:178: write oid 2 current snap is 14 2026-02-13T20:12:23.539 INFO:tasks.rados.rados.0.trial188.stdout:178: seq_num 96 ranges {413472=620140,1818036=510700,3120019=493453} 2026-02-13T20:12:23.542 INFO:tasks.rados.rados.0.trial188.stdout:178: writing trial18843701-2 from 413472 to 1033612 tid 1 2026-02-13T20:12:23.547 INFO:tasks.rados.rados.0.trial188.stdout:178: writing trial18843701-2 from 1818036 to 2328736 tid 2 2026-02-13T20:12:23.552 INFO:tasks.rados.rados.0.trial188.stdout:178: writing trial18843701-2 from 3120019 to 3613472 tid 3 2026-02-13T20:12:23.552 INFO:tasks.rados.rados.0.trial188.stdout:179: snap_create 2026-02-13T20:12:23.552 INFO:tasks.rados.rados.0.trial188.stdout:174: finishing write tid 1 to trial18843701-13 2026-02-13T20:12:23.552 INFO:tasks.rados.rados.0.trial188.stdout:176: expect (ObjNum 85 snap 9 seq_num 85) 2026-02-13T20:12:23.553 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:23.588 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 170596 2026-02-13T20:12:23.622 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:23.658 INFO:tasks.rados.rados.0.trial188.stdout:177: expect (ObjNum 58 snap 4 seq_num 58) 2026-02-13T20:12:23.659 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:23.687 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:23.746 INFO:tasks.rados.rados.0.trial188.stdout:174: finishing write tid 2 to trial18843701-13 2026-02-13T20:12:23.746 INFO:tasks.rados.rados.0.trial188.stdout:174: finishing write tid 3 to trial18843701-13 2026-02-13T20:12:23.746 INFO:tasks.rados.rados.0.trial188.stdout:174: finishing write tid 4 to trial18843701-13 2026-02-13T20:12:23.746 INFO:tasks.rados.rados.0.trial188.stdout:174: finishing write tid 5 to trial18843701-13 2026-02-13T20:12:23.747 INFO:tasks.rados.rados.0.trial188.stdout:174: oid 13 updating version 0 to 73 2026-02-13T20:12:23.747 INFO:tasks.rados.rados.0.trial188.stdout:174: oid 13 updating version 73 to 74 2026-02-13T20:12:23.747 INFO:tasks.rados.rados.0.trial188.stdout:174: oid 13 updating version 74 to 76 2026-02-13T20:12:23.747 INFO:tasks.rados.rados.0.trial188.stdout:174: oid 13 version 76 is already newer than 75 2026-02-13T20:12:23.747 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 13 v 76 (ObjNum 95 snap 14 seq_num 95) dirty exists 2026-02-13T20:12:23.747 INFO:tasks.rados.rados.0.trial188.stdout:174: left oid 13 (ObjNum 95 snap 14 seq_num 95) 2026-02-13T20:12:23.747 INFO:tasks.rados.rados.0.trial188.stdout:175: finishing copy_from racing read to trial18843701-26 2026-02-13T20:12:23.747 INFO:tasks.rados.rados.0.trial188.stdout:178: finishing write tid 1 to trial18843701-2 2026-02-13T20:12:23.747 INFO:tasks.rados.rados.0.trial188.stdout:175: finishing copy_from to trial18843701-26 2026-02-13T20:12:23.747 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 26 v 14 (ObjNum 88 snap 12 seq_num 88) dirty exists 2026-02-13T20:12:23.747 INFO:tasks.rados.rados.0.trial188.stdout:178: finishing write tid 2 to trial18843701-2 2026-02-13T20:12:23.747 INFO:tasks.rados.rados.0.trial188.stdout:178: finishing write tid 3 to trial18843701-2 2026-02-13T20:12:23.748 INFO:tasks.rados.rados.0.trial188.stdout:178: finishing write tid 4 to trial18843701-2 2026-02-13T20:12:23.748 INFO:tasks.rados.rados.0.trial188.stdout:178: finishing write tid 5 to trial18843701-2 2026-02-13T20:12:23.748 INFO:tasks.rados.rados.0.trial188.stdout:178: oid 2 updating version 0 to 78 2026-02-13T20:12:23.748 INFO:tasks.rados.rados.0.trial188.stdout:178: oid 2 version 78 is already newer than 77 2026-02-13T20:12:23.748 INFO:tasks.rados.rados.0.trial188.stdout:178: oid 2 updating version 78 to 79 2026-02-13T20:12:23.748 INFO:tasks.rados.rados.0.trial188.stdout:178: oid 2 updating version 79 to 80 2026-02-13T20:12:23.748 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 2 v 80 (ObjNum 96 snap 14 seq_num 96) dirty exists 2026-02-13T20:12:23.748 INFO:tasks.rados.rados.0.trial188.stdout:178: left oid 2 (ObjNum 96 snap 14 seq_num 96) 2026-02-13T20:12:24.530 INFO:tasks.rados.rados.0.trial188.stdout:174: done (5 left) 2026-02-13T20:12:24.530 INFO:tasks.rados.rados.0.trial188.stdout:175: done (4 left) 2026-02-13T20:12:24.530 INFO:tasks.rados.rados.0.trial188.stdout:176: done (3 left) 2026-02-13T20:12:24.530 INFO:tasks.rados.rados.0.trial188.stdout:177: done (2 left) 2026-02-13T20:12:24.530 INFO:tasks.rados.rados.0.trial188.stdout:178: done (1 left) 2026-02-13T20:12:24.531 INFO:tasks.rados.rados.0.trial188.stdout:179: done (0 left) 2026-02-13T20:12:24.531 INFO:tasks.rados.rados.0.trial188.stdout:180: write (excl) oid 19 current snap is 15 2026-02-13T20:12:24.531 INFO:tasks.rados.rados.0.trial188.stdout:180: seq_num 97 ranges {430279=695389,1876518=654358,3031089=536797} 2026-02-13T20:12:24.534 INFO:tasks.rados.rados.0.trial188.stdout:180: writing trial18843701-19 from 430279 to 1125668 tid 1 2026-02-13T20:12:24.539 INFO:tasks.rados.rados.0.trial188.stdout:180: writing trial18843701-19 from 1876518 to 2530876 tid 2 2026-02-13T20:12:24.543 INFO:tasks.rados.rados.0.trial188.stdout:180: writing trial18843701-19 from 3031089 to 3567886 tid 3 2026-02-13T20:12:24.543 INFO:tasks.rados.rados.0.trial188.stdout:181: snap_remove snap 13 2026-02-13T20:12:25.482 INFO:tasks.rados.rados.0.trial188.stdout:181: done (1 left) 2026-02-13T20:12:25.483 INFO:tasks.rados.rados.0.trial188.stdout:182: read oid 50 snap -1 2026-02-13T20:12:25.483 INFO:tasks.rados.rados.0.trial188.stdout:182: expect (ObjNum 49 snap 0 seq_num 49) 2026-02-13T20:12:25.483 INFO:tasks.rados.rados.0.trial188.stdout:183: write oid 42 current snap is 15 2026-02-13T20:12:25.483 INFO:tasks.rados.rados.0.trial188.stdout:183: seq_num 98 ranges {447086=770638,1935000=798016,3458512=188574} 2026-02-13T20:12:25.486 INFO:tasks.rados.rados.0.trial188.stdout:183: writing trial18843701-42 from 447086 to 1217724 tid 1 2026-02-13T20:12:25.492 INFO:tasks.rados.rados.0.trial188.stdout:183: writing trial18843701-42 from 1935000 to 2733016 tid 2 2026-02-13T20:12:25.496 INFO:tasks.rados.rados.0.trial188.stdout:183: writing trial18843701-42 from 3458512 to 3647086 tid 3 2026-02-13T20:12:25.496 INFO:tasks.rados.rados.0.trial188.stdout:184: read oid 46 snap -1 2026-02-13T20:12:25.496 INFO:tasks.rados.rados.0.trial188.stdout:184: expect (ObjNum 45 snap 0 seq_num 45) 2026-02-13T20:12:25.496 INFO:tasks.rados.rados.0.trial188.stdout:185: snap_create 2026-02-13T20:12:25.497 INFO:tasks.rados.rados.0.trial188.stdout:180: finishing write tid 1 to trial18843701-19 2026-02-13T20:12:25.497 INFO:tasks.rados.rados.0.trial188.stdout:180: finishing write tid 2 to trial18843701-19 2026-02-13T20:12:25.497 INFO:tasks.rados.rados.0.trial188.stdout:180: finishing write tid 3 to trial18843701-19 2026-02-13T20:12:25.497 INFO:tasks.rados.rados.0.trial188.stdout:180: finishing write tid 4 to trial18843701-19 2026-02-13T20:12:25.497 INFO:tasks.rados.rados.0.trial188.stdout:180: finishing write tid 5 to trial18843701-19 2026-02-13T20:12:25.497 INFO:tasks.rados.rados.0.trial188.stdout:180: oid 19 updating version 0 to 56 2026-02-13T20:12:25.497 INFO:tasks.rados.rados.0.trial188.stdout:180: oid 19 version 56 is already newer than 54 2026-02-13T20:12:25.497 INFO:tasks.rados.rados.0.trial188.stdout:180: oid 19 version 56 is already newer than 55 2026-02-13T20:12:25.497 INFO:tasks.rados.rados.0.trial188.stdout:180: oid 19 version 56 is already newer than 53 2026-02-13T20:12:25.497 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 19 v 56 (ObjNum 97 snap 15 seq_num 97) dirty exists 2026-02-13T20:12:25.497 INFO:tasks.rados.rados.0.trial188.stdout:180: left oid 19 (ObjNum 97 snap 15 seq_num 97) 2026-02-13T20:12:25.497 INFO:tasks.rados.rados.0.trial188.stdout:182: expect (ObjNum 49 snap 0 seq_num 49) 2026-02-13T20:12:25.498 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1743628 2026-02-13T20:12:25.509 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 340597 2026-02-13T20:12:25.545 INFO:tasks.rados.rados.0.trial188.stdout:184: expect (ObjNum 45 snap 0 seq_num 45) 2026-02-13T20:12:25.591 INFO:tasks.rados.rados.0.trial188.stdout:183: finishing write tid 1 to trial18843701-42 2026-02-13T20:12:25.592 INFO:tasks.rados.rados.0.trial188.stdout:183: finishing write tid 2 to trial18843701-42 2026-02-13T20:12:25.592 INFO:tasks.rados.rados.0.trial188.stdout:183: finishing write tid 3 to trial18843701-42 2026-02-13T20:12:25.592 INFO:tasks.rados.rados.0.trial188.stdout:183: finishing write tid 4 to trial18843701-42 2026-02-13T20:12:25.592 INFO:tasks.rados.rados.0.trial188.stdout:183: finishing write tid 5 to trial18843701-42 2026-02-13T20:12:25.592 INFO:tasks.rados.rados.0.trial188.stdout:183: oid 42 updating version 0 to 37 2026-02-13T20:12:25.592 INFO:tasks.rados.rados.0.trial188.stdout:183: oid 42 updating version 37 to 38 2026-02-13T20:12:25.592 INFO:tasks.rados.rados.0.trial188.stdout:183: oid 42 version 38 is already newer than 36 2026-02-13T20:12:25.592 INFO:tasks.rados.rados.0.trial188.stdout:183: oid 42 updating version 38 to 39 2026-02-13T20:12:25.592 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 42 v 39 (ObjNum 98 snap 15 seq_num 98) dirty exists 2026-02-13T20:12:25.592 INFO:tasks.rados.rados.0.trial188.stdout:183: left oid 42 (ObjNum 98 snap 15 seq_num 98) 2026-02-13T20:12:26.481 INFO:tasks.rados.rados.0.trial188.stdout:180: done (4 left) 2026-02-13T20:12:26.482 INFO:tasks.rados.rados.0.trial188.stdout:182: done (3 left) 2026-02-13T20:12:26.482 INFO:tasks.rados.rados.0.trial188.stdout:183: done (2 left) 2026-02-13T20:12:26.482 INFO:tasks.rados.rados.0.trial188.stdout:184: done (1 left) 2026-02-13T20:12:26.482 INFO:tasks.rados.rados.0.trial188.stdout:185: done (0 left) 2026-02-13T20:12:26.482 INFO:tasks.rados.rados.0.trial188.stdout:186: snap_create 2026-02-13T20:12:27.482 INFO:tasks.rados.rados.0.trial188.stdout:186: done (0 left) 2026-02-13T20:12:27.483 INFO:tasks.rados.rados.0.trial188.stdout:187: write (excl) oid 4 current snap is 17 2026-02-13T20:12:27.483 INFO:tasks.rados.rados.0.trial188.stdout:187: seq_num 99 ranges {463893=562240,1593482=658027,2685935=559341} 2026-02-13T20:12:27.486 INFO:tasks.rados.rados.0.trial188.stdout:187: writing trial18843701-4 from 463893 to 1026133 tid 1 2026-02-13T20:12:27.491 INFO:tasks.rados.rados.0.trial188.stdout:187: writing trial18843701-4 from 1593482 to 2251509 tid 2 2026-02-13T20:12:27.494 INFO:tasks.rados.rados.0.trial188.stdout:187: writing trial18843701-4 from 2685935 to 3245276 tid 3 2026-02-13T20:12:27.495 INFO:tasks.rados.rados.0.trial188.stdout:188: delete oid 42 current snap is 17 2026-02-13T20:12:27.496 INFO:tasks.rados.rados.0.trial188.stdout:188: done (1 left) 2026-02-13T20:12:27.497 INFO:tasks.rados.rados.0.trial188.stdout:189: copy_from oid 2 from oid 11 current snap is 17 2026-02-13T20:12:27.497 INFO:tasks.rados.rados.0.trial188.stdout:190: read oid 10 snap -1 2026-02-13T20:12:27.497 INFO:tasks.rados.rados.0.trial188.stdout:190: expect deleted 2026-02-13T20:12:27.497 INFO:tasks.rados.rados.0.trial188.stdout:191: read oid 50 snap 12 2026-02-13T20:12:27.497 INFO:tasks.rados.rados.0.trial188.stdout:191: expect (ObjNum 49 snap 0 seq_num 49) 2026-02-13T20:12:27.497 INFO:tasks.rados.rados.0.trial188.stdout:192: copy_from oid 32 from oid 15 current snap is 17 2026-02-13T20:12:27.497 INFO:tasks.rados.rados.0.trial188.stdout:193: write (excl) oid 29 current snap is 17 2026-02-13T20:12:27.497 INFO:tasks.rados.rados.0.trial188.stdout:193: seq_num 101 ranges {497507=712738,1710446=661696,3140781=556726} 2026-02-13T20:12:27.501 INFO:tasks.rados.rados.0.trial188.stdout:193: writing trial18843701-29 from 497507 to 1210245 tid 1 2026-02-13T20:12:27.505 INFO:tasks.rados.rados.0.trial188.stdout:193: writing trial18843701-29 from 1710446 to 2372142 tid 2 2026-02-13T20:12:27.510 INFO:tasks.rados.rados.0.trial188.stdout:193: writing trial18843701-29 from 3140781 to 3697507 tid 3 2026-02-13T20:12:27.511 INFO:tasks.rados.rados.0.trial188.stdout:194: write oid 14 current snap is 17 2026-02-13T20:12:27.511 INFO:tasks.rados.rados.0.trial188.stdout:192: finishing copy_from to trial18843701-32 2026-02-13T20:12:27.511 INFO:tasks.rados.rados.0.trial188.stdout:192: got expected ENOENT (src dne) 2026-02-13T20:12:27.511 INFO:tasks.rados.rados.0.trial188.stdout:192: finishing copy_from racing read to trial18843701-32 2026-02-13T20:12:27.511 INFO:tasks.rados.rados.0.trial188.stdout:191: expect (ObjNum 49 snap 0 seq_num 49) 2026-02-13T20:12:27.511 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:27.539 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2453738 2026-02-13T20:12:27.542 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:27.561 INFO:tasks.rados.rados.0.trial188.stdout:194: seq_num 102 ranges {514314=787987,1768928=405354,2768204=509510} 2026-02-13T20:12:27.566 INFO:tasks.rados.rados.0.trial188.stdout:194: writing trial18843701-14 from 514314 to 1302301 tid 1 2026-02-13T20:12:27.569 INFO:tasks.rados.rados.0.trial188.stdout:194: writing trial18843701-14 from 1768928 to 2174282 tid 2 2026-02-13T20:12:27.573 INFO:tasks.rados.rados.0.trial188.stdout:194: writing trial18843701-14 from 2768204 to 3277714 tid 3 2026-02-13T20:12:27.574 INFO:tasks.rados.rados.0.trial188.stdout:190: done (6 left) 2026-02-13T20:12:27.574 INFO:tasks.rados.rados.0.trial188.stdout:191: done (5 left) 2026-02-13T20:12:27.574 INFO:tasks.rados.rados.0.trial188.stdout:192: done (4 left) 2026-02-13T20:12:27.574 INFO:tasks.rados.rados.0.trial188.stdout:195: write oid 26 current snap is 17 2026-02-13T20:12:27.574 INFO:tasks.rados.rados.0.trial188.stdout:195: seq_num 103 ranges {531121=463236,1711057=665365,3079274=651847} 2026-02-13T20:12:27.577 INFO:tasks.rados.rados.0.trial188.stdout:195: writing trial18843701-26 from 531121 to 994357 tid 1 2026-02-13T20:12:27.582 INFO:tasks.rados.rados.0.trial188.stdout:195: writing trial18843701-26 from 1711057 to 2376422 tid 2 2026-02-13T20:12:27.587 INFO:tasks.rados.rados.0.trial188.stdout:195: writing trial18843701-26 from 3079274 to 3731121 tid 3 2026-02-13T20:12:27.588 INFO:tasks.rados.rados.0.trial188.stdout:196: snap_create 2026-02-13T20:12:27.588 INFO:tasks.rados.rados.0.trial188.stdout:187: finishing write tid 1 to trial18843701-4 2026-02-13T20:12:27.588 INFO:tasks.rados.rados.0.trial188.stdout:187: finishing write tid 2 to trial18843701-4 2026-02-13T20:12:27.588 INFO:tasks.rados.rados.0.trial188.stdout:187: finishing write tid 3 to trial18843701-4 2026-02-13T20:12:27.588 INFO:tasks.rados.rados.0.trial188.stdout:187: finishing write tid 4 to trial18843701-4 2026-02-13T20:12:27.588 INFO:tasks.rados.rados.0.trial188.stdout:187: finishing write tid 5 to trial18843701-4 2026-02-13T20:12:27.588 INFO:tasks.rados.rados.0.trial188.stdout:187: oid 4 updating version 0 to 60 2026-02-13T20:12:27.588 INFO:tasks.rados.rados.0.trial188.stdout:187: oid 4 version 60 is already newer than 59 2026-02-13T20:12:27.588 INFO:tasks.rados.rados.0.trial188.stdout:187: oid 4 updating version 60 to 61 2026-02-13T20:12:27.588 INFO:tasks.rados.rados.0.trial188.stdout:187: oid 4 version 61 is already newer than 58 2026-02-13T20:12:27.588 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 4 v 61 (ObjNum 99 snap 17 seq_num 99) dirty exists 2026-02-13T20:12:27.588 INFO:tasks.rados.rados.0.trial188.stdout:187: left oid 4 (ObjNum 99 snap 17 seq_num 99) 2026-02-13T20:12:27.588 INFO:tasks.rados.rados.0.trial188.stdout:193: finishing write tid 1 to trial18843701-29 2026-02-13T20:12:27.588 INFO:tasks.rados.rados.0.trial188.stdout:193: finishing write tid 2 to trial18843701-29 2026-02-13T20:12:27.588 INFO:tasks.rados.rados.0.trial188.stdout:193: finishing write tid 3 to trial18843701-29 2026-02-13T20:12:27.588 INFO:tasks.rados.rados.0.trial188.stdout:193: finishing write tid 4 to trial18843701-29 2026-02-13T20:12:27.588 INFO:tasks.rados.rados.0.trial188.stdout:193: finishing write tid 5 to trial18843701-29 2026-02-13T20:12:27.588 INFO:tasks.rados.rados.0.trial188.stdout:193: oid 29 updating version 0 to 62 2026-02-13T20:12:27.588 INFO:tasks.rados.rados.0.trial188.stdout:193: oid 29 version 62 is already newer than 60 2026-02-13T20:12:27.589 INFO:tasks.rados.rados.0.trial188.stdout:193: oid 29 updating version 62 to 63 2026-02-13T20:12:27.589 INFO:tasks.rados.rados.0.trial188.stdout:193: oid 29 version 63 is already newer than 61 2026-02-13T20:12:27.589 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 29 v 63 (ObjNum 101 snap 17 seq_num 101) dirty exists 2026-02-13T20:12:27.589 INFO:tasks.rados.rados.0.trial188.stdout:193: left oid 29 (ObjNum 101 snap 17 seq_num 101) 2026-02-13T20:12:27.589 INFO:tasks.rados.rados.0.trial188.stdout:189: finishing copy_from racing read to trial18843701-2 2026-02-13T20:12:27.589 INFO:tasks.rados.rados.0.trial188.stdout:189: finishing copy_from to trial18843701-2 2026-02-13T20:12:27.589 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 2 v 52 (ObjNum 58 snap 4 seq_num 58) dirty exists 2026-02-13T20:12:27.590 INFO:tasks.rados.rados.0.trial188.stdout:194: finishing write tid 1 to trial18843701-14 2026-02-13T20:12:27.590 INFO:tasks.rados.rados.0.trial188.stdout:194: finishing write tid 2 to trial18843701-14 2026-02-13T20:12:27.605 INFO:tasks.rados.rados.0.trial188.stdout:194: finishing write tid 3 to trial18843701-14 2026-02-13T20:12:27.606 INFO:tasks.rados.rados.0.trial188.stdout:194: finishing write tid 4 to trial18843701-14 2026-02-13T20:12:27.606 INFO:tasks.rados.rados.0.trial188.stdout:194: finishing write tid 5 to trial18843701-14 2026-02-13T20:12:27.606 INFO:tasks.rados.rados.0.trial188.stdout:194: oid 14 updating version 0 to 52 2026-02-13T20:12:27.606 INFO:tasks.rados.rados.0.trial188.stdout:194: oid 14 version 52 is already newer than 51 2026-02-13T20:12:27.606 INFO:tasks.rados.rados.0.trial188.stdout:194: oid 14 version 52 is already newer than 50 2026-02-13T20:12:27.606 INFO:tasks.rados.rados.0.trial188.stdout:194: oid 14 updating version 52 to 53 2026-02-13T20:12:27.606 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 14 v 53 (ObjNum 102 snap 17 seq_num 102) dirty exists 2026-02-13T20:12:27.606 INFO:tasks.rados.rados.0.trial188.stdout:194: left oid 14 (ObjNum 102 snap 17 seq_num 102) 2026-02-13T20:12:27.606 INFO:tasks.rados.rados.0.trial188.stdout:195: finishing write tid 1 to trial18843701-26 2026-02-13T20:12:27.614 INFO:tasks.rados.rados.0.trial188.stdout:195: finishing write tid 2 to trial18843701-26 2026-02-13T20:12:27.615 INFO:tasks.rados.rados.0.trial188.stdout:195: finishing write tid 3 to trial18843701-26 2026-02-13T20:12:27.615 INFO:tasks.rados.rados.0.trial188.stdout:195: finishing write tid 4 to trial18843701-26 2026-02-13T20:12:27.615 INFO:tasks.rados.rados.0.trial188.stdout:195: finishing write tid 5 to trial18843701-26 2026-02-13T20:12:27.615 INFO:tasks.rados.rados.0.trial188.stdout:195: oid 26 updating version 0 to 56 2026-02-13T20:12:27.615 INFO:tasks.rados.rados.0.trial188.stdout:195: oid 26 updating version 56 to 58 2026-02-13T20:12:27.615 INFO:tasks.rados.rados.0.trial188.stdout:195: oid 26 version 58 is already newer than 55 2026-02-13T20:12:27.616 INFO:tasks.rados.rados.0.trial188.stdout:195: oid 26 version 58 is already newer than 57 2026-02-13T20:12:27.616 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 26 v 58 (ObjNum 103 snap 17 seq_num 103) dirty exists 2026-02-13T20:12:27.616 INFO:tasks.rados.rados.0.trial188.stdout:195: left oid 26 (ObjNum 103 snap 17 seq_num 103) 2026-02-13T20:12:28.488 INFO:tasks.rados.rados.0.trial188.stdout:187: done (5 left) 2026-02-13T20:12:28.488 INFO:tasks.rados.rados.0.trial188.stdout:189: done (4 left) 2026-02-13T20:12:28.488 INFO:tasks.rados.rados.0.trial188.stdout:193: done (3 left) 2026-02-13T20:12:28.488 INFO:tasks.rados.rados.0.trial188.stdout:194: done (2 left) 2026-02-13T20:12:28.488 INFO:tasks.rados.rados.0.trial188.stdout:195: done (1 left) 2026-02-13T20:12:28.489 INFO:tasks.rados.rados.0.trial188.stdout:196: done (0 left) 2026-02-13T20:12:28.489 INFO:tasks.rados.rados.0.trial188.stdout:197: snap_remove snap 17 2026-02-13T20:12:29.490 INFO:tasks.rados.rados.0.trial188.stdout:197: done (0 left) 2026-02-13T20:12:29.490 INFO:tasks.rados.rados.0.trial188.stdout:198: copy_from oid 44 from oid 15 current snap is 18 2026-02-13T20:12:29.490 INFO:tasks.rados.rados.0.trial188.stdout:199: read oid 13 snap -1 2026-02-13T20:12:29.490 INFO:tasks.rados.rados.0.trial188.stdout:199: expect (ObjNum 95 snap 14 seq_num 95) 2026-02-13T20:12:29.490 INFO:tasks.rados.rados.0.trial188.stdout:200: rollback oid 35 current snap is 18 2026-02-13T20:12:29.490 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 35 to 12 2026-02-13T20:12:29.490 INFO:tasks.rados.rados.0.trial188.stdout:201: copy_from oid 47 from oid 30 current snap is 18 2026-02-13T20:12:29.490 INFO:tasks.rados.rados.0.trial188.stdout:202: write oid 26 current snap is 18 2026-02-13T20:12:29.490 INFO:tasks.rados.rados.0.trial188.stdout:202: seq_num 104 ranges {547928=538485,1769539=409023,2706697=532054} 2026-02-13T20:12:29.493 INFO:tasks.rados.rados.0.trial188.stdout:202: writing trial18843701-26 from 547928 to 1086413 tid 1 2026-02-13T20:12:29.497 INFO:tasks.rados.rados.0.trial188.stdout:202: writing trial18843701-26 from 1769539 to 2178562 tid 2 2026-02-13T20:12:29.502 INFO:tasks.rados.rados.0.trial188.stdout:202: writing trial18843701-26 from 2706697 to 3238751 tid 3 2026-02-13T20:12:29.502 INFO:tasks.rados.rados.0.trial188.stdout:203: rollback oid 42 current snap is 18 2026-02-13T20:12:29.502 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 42 to 12 2026-02-13T20:12:29.502 INFO:tasks.rados.rados.0.trial188.stdout:204: copy_from oid 24 from oid 28 current snap is 18 2026-02-13T20:12:29.502 INFO:tasks.rados.rados.0.trial188.stdout:205: rollback oid 25 current snap is 18 2026-02-13T20:12:29.503 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 25 to 12 2026-02-13T20:12:29.503 INFO:tasks.rados.rados.0.trial188.stdout:206: delete oid 12 current snap is 18 2026-02-13T20:12:29.503 INFO:tasks.rados.rados.0.trial188.stdout:198: finishing copy_from to trial18843701-44 2026-02-13T20:12:29.503 INFO:tasks.rados.rados.0.trial188.stdout:198: got expected ENOENT (src dne) 2026-02-13T20:12:29.503 INFO:tasks.rados.rados.0.trial188.stdout:198: finishing copy_from racing read to trial18843701-44 2026-02-13T20:12:29.503 INFO:tasks.rados.rados.0.trial188.stdout:200: finishing rollback tid 0 to trial18843701-35 2026-02-13T20:12:29.503 INFO:tasks.rados.rados.0.trial188.stdout:200: finishing rollback tid 1 to trial18843701-35 2026-02-13T20:12:29.503 INFO:tasks.rados.rados.0.trial188.stdout:200: finishing rollback tid 2 to trial18843701-35 2026-02-13T20:12:29.503 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 35 v 45 (ObjNum 5 snap 0 seq_num 5) dirty exists 2026-02-13T20:12:29.503 INFO:tasks.rados.rados.0.trial188.stdout:199: expect (ObjNum 95 snap 14 seq_num 95) 2026-02-13T20:12:29.560 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2741624 2026-02-13T20:12:29.577 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:29.620 INFO:tasks.rados.rados.0.trial188.stdout:205: finishing rollback tid 0 to trial18843701-25 2026-02-13T20:12:29.620 INFO:tasks.rados.rados.0.trial188.stdout:205: finishing rollback tid 1 to trial18843701-25 2026-02-13T20:12:29.620 INFO:tasks.rados.rados.0.trial188.stdout:205: finishing rollback tid 2 to trial18843701-25 2026-02-13T20:12:29.620 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 25 v 46 (ObjNum 24 snap 0 seq_num 24) dirty exists 2026-02-13T20:12:29.620 INFO:tasks.rados.rados.0.trial188.stdout:201: finishing copy_from racing read to trial18843701-47 2026-02-13T20:12:29.620 INFO:tasks.rados.rados.0.trial188.stdout:201: finishing copy_from to trial18843701-47 2026-02-13T20:12:29.620 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 47 v 23 (ObjNum 44 snap 0 seq_num 44) dirty exists 2026-02-13T20:12:29.620 INFO:tasks.rados.rados.0.trial188.stdout:203: finishing rollback tid 1 to trial18843701-42 2026-02-13T20:12:29.620 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 42 v 41 (ObjNum 33 snap 0 seq_num 11836661) dirty dne 2026-02-13T20:12:29.620 INFO:tasks.rados.rados.0.trial188.stdout:202: finishing write tid 1 to trial18843701-26 2026-02-13T20:12:29.620 INFO:tasks.rados.rados.0.trial188.stdout:202: finishing write tid 2 to trial18843701-26 2026-02-13T20:12:29.620 INFO:tasks.rados.rados.0.trial188.stdout:198: done (8 left) 2026-02-13T20:12:29.620 INFO:tasks.rados.rados.0.trial188.stdout:199: done (7 left) 2026-02-13T20:12:29.621 INFO:tasks.rados.rados.0.trial188.stdout:200: done (6 left) 2026-02-13T20:12:29.621 INFO:tasks.rados.rados.0.trial188.stdout:201: done (5 left) 2026-02-13T20:12:29.621 INFO:tasks.rados.rados.0.trial188.stdout:203: done (4 left) 2026-02-13T20:12:29.621 INFO:tasks.rados.rados.0.trial188.stdout:205: done (3 left) 2026-02-13T20:12:29.621 INFO:tasks.rados.rados.0.trial188.stdout:206: done (2 left) 2026-02-13T20:12:29.621 INFO:tasks.rados.rados.0.trial188.stdout:207: rollback oid 16 current snap is 18 2026-02-13T20:12:29.621 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 16 to 14 2026-02-13T20:12:29.621 INFO:tasks.rados.rados.0.trial188.stdout:202: finishing write tid 3 to trial18843701-26 2026-02-13T20:12:29.621 INFO:tasks.rados.rados.0.trial188.stdout:202: finishing write tid 4 to trial18843701-26 2026-02-13T20:12:29.621 INFO:tasks.rados.rados.0.trial188.stdout:202: finishing write tid 5 to trial18843701-26 2026-02-13T20:12:29.621 INFO:tasks.rados.rados.0.trial188.stdout:202: oid 26 updating version 0 to 59 2026-02-13T20:12:29.621 INFO:tasks.rados.rados.0.trial188.stdout:202: oid 26 updating version 59 to 61 2026-02-13T20:12:29.621 INFO:tasks.rados.rados.0.trial188.stdout:202: oid 26 version 61 is already newer than 60 2026-02-13T20:12:29.621 INFO:tasks.rados.rados.0.trial188.stdout:202: oid 26 updating version 61 to 62 2026-02-13T20:12:29.621 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 26 v 62 (ObjNum 104 snap 18 seq_num 104) dirty exists 2026-02-13T20:12:29.621 INFO:tasks.rados.rados.0.trial188.stdout:202: left oid 26 (ObjNum 104 snap 18 seq_num 104) 2026-02-13T20:12:29.621 INFO:tasks.rados.rados.0.trial188.stdout:204: finishing copy_from racing read to trial18843701-24 2026-02-13T20:12:29.621 INFO:tasks.rados.rados.0.trial188.stdout:204: finishing copy_from to trial18843701-24 2026-02-13T20:12:29.621 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 24 v 10 (ObjNum 21 snap 0 seq_num 21) dirty exists 2026-02-13T20:12:29.621 INFO:tasks.rados.rados.0.trial188.stdout:202: done (2 left) 2026-02-13T20:12:29.621 INFO:tasks.rados.rados.0.trial188.stdout:204: done (1 left) 2026-02-13T20:12:29.621 INFO:tasks.rados.rados.0.trial188.stdout:208: delete oid 36 current snap is 18 2026-02-13T20:12:29.621 INFO:tasks.rados.rados.0.trial188.stdout:207: finishing rollback tid 1 to trial18843701-16 2026-02-13T20:12:29.621 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 16 v 0 (ObjNum 81 snap 0 seq_num 11886720) dirty dne 2026-02-13T20:12:29.621 INFO:tasks.rados.rados.0.trial188.stdout:207: done (1 left) 2026-02-13T20:12:29.621 INFO:tasks.rados.rados.0.trial188.stdout:208: done (0 left) 2026-02-13T20:12:29.621 INFO:tasks.rados.rados.0.trial188.stdout:209: write (excl) oid 32 current snap is 18 2026-02-13T20:12:29.621 INFO:tasks.rados.rados.0.trial188.stdout:209: seq_num 107 ranges {598349=480585,1544985=672703,2905319=482223} 2026-02-13T20:12:29.625 INFO:tasks.rados.rados.0.trial188.stdout:209: writing trial18843701-32 from 598349 to 1078934 tid 1 2026-02-13T20:12:29.630 INFO:tasks.rados.rados.0.trial188.stdout:209: writing trial18843701-32 from 1544985 to 2217688 tid 2 2026-02-13T20:12:29.634 INFO:tasks.rados.rados.0.trial188.stdout:209: writing trial18843701-32 from 2905319 to 3387542 tid 3 2026-02-13T20:12:29.635 INFO:tasks.rados.rados.0.trial188.stdout:210: snap_create 2026-02-13T20:12:29.649 INFO:tasks.rados.rados.0.trial188.stdout:209: finishing write tid 1 to trial18843701-32 2026-02-13T20:12:29.651 INFO:tasks.rados.rados.0.trial188.stdout:209: finishing write tid 2 to trial18843701-32 2026-02-13T20:12:29.652 INFO:tasks.rados.rados.0.trial188.stdout:209: finishing write tid 3 to trial18843701-32 2026-02-13T20:12:29.652 INFO:tasks.rados.rados.0.trial188.stdout:209: finishing write tid 4 to trial18843701-32 2026-02-13T20:12:29.652 INFO:tasks.rados.rados.0.trial188.stdout:209: finishing write tid 5 to trial18843701-32 2026-02-13T20:12:29.652 INFO:tasks.rados.rados.0.trial188.stdout:209: oid 32 updating version 0 to 44 2026-02-13T20:12:29.652 INFO:tasks.rados.rados.0.trial188.stdout:209: oid 32 version 44 is already newer than 43 2026-02-13T20:12:29.652 INFO:tasks.rados.rados.0.trial188.stdout:209: oid 32 version 44 is already newer than 42 2026-02-13T20:12:29.652 INFO:tasks.rados.rados.0.trial188.stdout:209: oid 32 version 44 is already newer than 41 2026-02-13T20:12:29.652 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 32 v 44 (ObjNum 107 snap 18 seq_num 107) dirty exists 2026-02-13T20:12:29.653 INFO:tasks.rados.rados.0.trial188.stdout:209: left oid 32 (ObjNum 107 snap 18 seq_num 107) 2026-02-13T20:12:30.493 INFO:tasks.rados.rados.0.trial188.stdout:209: done (1 left) 2026-02-13T20:12:30.493 INFO:tasks.rados.rados.0.trial188.stdout:210: done (0 left) 2026-02-13T20:12:30.493 INFO:tasks.rados.rados.0.trial188.stdout:211: copy_from oid 41 from oid 22 current snap is 19 2026-02-13T20:12:30.493 INFO:tasks.rados.rados.0.trial188.stdout:212: rollback oid 8 current snap is 19 2026-02-13T20:12:30.494 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 8 to 12 2026-02-13T20:12:30.494 INFO:tasks.rados.rados.0.trial188.stdout:213: rollback oid 38 current snap is 19 2026-02-13T20:12:30.494 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 38 to 10 2026-02-13T20:12:30.494 INFO:tasks.rados.rados.0.trial188.stdout:214: write oid 15 current snap is 19 2026-02-13T20:12:30.494 INFO:tasks.rados.rados.0.trial188.stdout:214: seq_num 108 ranges {615156=555834,1603467=416361,2816389=693495} 2026-02-13T20:12:30.497 INFO:tasks.rados.rados.0.trial188.stdout:214: writing trial18843701-15 from 615156 to 1170990 tid 1 2026-02-13T20:12:30.500 INFO:tasks.rados.rados.0.trial188.stdout:214: writing trial18843701-15 from 1603467 to 2019828 tid 2 2026-02-13T20:12:30.506 INFO:tasks.rados.rados.0.trial188.stdout:214: writing trial18843701-15 from 2816389 to 3509884 tid 3 2026-02-13T20:12:30.506 INFO:tasks.rados.rados.0.trial188.stdout:215: rollback oid 33 current snap is 19 2026-02-13T20:12:30.506 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 33 to 12 2026-02-13T20:12:30.506 INFO:tasks.rados.rados.0.trial188.stdout:212: finishing rollback tid 0 to trial18843701-8 2026-02-13T20:12:30.506 INFO:tasks.rados.rados.0.trial188.stdout:212: finishing rollback tid 1 to trial18843701-8 2026-02-13T20:12:30.506 INFO:tasks.rados.rados.0.trial188.stdout:212: finishing rollback tid 2 to trial18843701-8 2026-02-13T20:12:30.506 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 8 v 56 (ObjNum 82 snap 9 seq_num 82) dirty exists 2026-02-13T20:12:30.507 INFO:tasks.rados.rados.0.trial188.stdout:213: finishing rollback tid 0 to trial18843701-38 2026-02-13T20:12:30.507 INFO:tasks.rados.rados.0.trial188.stdout:212: done (4 left) 2026-02-13T20:12:30.507 INFO:tasks.rados.rados.0.trial188.stdout:216: write oid 12 current snap is 19 2026-02-13T20:12:30.507 INFO:tasks.rados.rados.0.trial188.stdout:216: seq_num 109 ranges {631963=631083,2061949=560019,3243812=504767} 2026-02-13T20:12:30.511 INFO:tasks.rados.rados.0.trial188.stdout:216: writing trial18843701-12 from 631963 to 1263046 tid 1 2026-02-13T20:12:30.516 INFO:tasks.rados.rados.0.trial188.stdout:216: writing trial18843701-12 from 2061949 to 2621968 tid 2 2026-02-13T20:12:30.520 INFO:tasks.rados.rados.0.trial188.stdout:216: writing trial18843701-12 from 3243812 to 3748579 tid 3 2026-02-13T20:12:30.520 INFO:tasks.rados.rados.0.trial188.stdout:217: read oid 34 snap -1 2026-02-13T20:12:30.520 INFO:tasks.rados.rados.0.trial188.stdout:217: expect (ObjNum 33 snap 0 seq_num 33) 2026-02-13T20:12:30.520 INFO:tasks.rados.rados.0.trial188.stdout:218: snap_remove snap 14 2026-02-13T20:12:30.520 INFO:tasks.rados.rados.0.trial188.stdout:213: finishing rollback tid 1 to trial18843701-38 2026-02-13T20:12:30.520 INFO:tasks.rados.rados.0.trial188.stdout:213: finishing rollback tid 2 to trial18843701-38 2026-02-13T20:12:30.520 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 38 v 50 (ObjNum 37 snap 0 seq_num 37) dirty exists 2026-02-13T20:12:31.498 INFO:tasks.rados.rados.0.trial188.stdout:213: done (6 left) 2026-02-13T20:12:31.498 INFO:tasks.rados.rados.0.trial188.stdout:218: done (5 left) 2026-02-13T20:12:31.498 INFO:tasks.rados.rados.0.trial188.stdout:219: delete oid 35 current snap is 19 2026-02-13T20:12:31.498 INFO:tasks.rados.rados.0.trial188.stdout:214: finishing write tid 1 to trial18843701-15 2026-02-13T20:12:31.499 INFO:tasks.rados.rados.0.trial188.stdout:214: finishing write tid 2 to trial18843701-15 2026-02-13T20:12:31.499 INFO:tasks.rados.rados.0.trial188.stdout:217: expect (ObjNum 33 snap 0 seq_num 33) 2026-02-13T20:12:31.516 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:31.538 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1326256 2026-02-13T20:12:31.551 INFO:tasks.rados.rados.0.trial188.stdout:211: finishing copy_from racing read to trial18843701-41 2026-02-13T20:12:31.551 INFO:tasks.rados.rados.0.trial188.stdout:216: finishing write tid 1 to trial18843701-12 2026-02-13T20:12:31.551 INFO:tasks.rados.rados.0.trial188.stdout:215: finishing rollback tid 0 to trial18843701-33 2026-02-13T20:12:31.552 INFO:tasks.rados.rados.0.trial188.stdout:217: done (5 left) 2026-02-13T20:12:31.552 INFO:tasks.rados.rados.0.trial188.stdout:219: done (4 left) 2026-02-13T20:12:31.552 INFO:tasks.rados.rados.0.trial188.stdout:220: write (excl) oid 48 current snap is 19 2026-02-13T20:12:31.552 INFO:tasks.rados.rados.0.trial188.stdout:215: finishing rollback tid 1 to trial18843701-33 2026-02-13T20:12:31.552 INFO:tasks.rados.rados.0.trial188.stdout:215: finishing rollback tid 2 to trial18843701-33 2026-02-13T20:12:31.552 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 33 v 29 (ObjNum 32 snap 0 seq_num 32) dirty exists 2026-02-13T20:12:31.552 INFO:tasks.rados.rados.0.trial188.stdout:214: finishing write tid 3 to trial18843701-15 2026-02-13T20:12:31.552 INFO:tasks.rados.rados.0.trial188.stdout:211: finishing copy_from to trial18843701-41 2026-02-13T20:12:31.552 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 41 v 17 (ObjNum 75 snap 7 seq_num 75) dirty exists 2026-02-13T20:12:31.552 INFO:tasks.rados.rados.0.trial188.stdout:216: finishing write tid 2 to trial18843701-12 2026-02-13T20:12:31.552 INFO:tasks.rados.rados.0.trial188.stdout:214: finishing write tid 4 to trial18843701-15 2026-02-13T20:12:31.552 INFO:tasks.rados.rados.0.trial188.stdout:220: seq_num 111 ranges {665577=781581,2062560=563688,3182305=643664} 2026-02-13T20:12:31.556 INFO:tasks.rados.rados.0.trial188.stdout:220: writing trial18843701-48 from 665577 to 1447158 tid 1 2026-02-13T20:12:31.561 INFO:tasks.rados.rados.0.trial188.stdout:220: writing trial18843701-48 from 2062560 to 2626248 tid 2 2026-02-13T20:12:31.565 INFO:tasks.rados.rados.0.trial188.stdout:220: writing trial18843701-48 from 3182305 to 3825969 tid 3 2026-02-13T20:12:31.566 INFO:tasks.rados.rados.0.trial188.stdout:211: done (4 left) 2026-02-13T20:12:31.566 INFO:tasks.rados.rados.0.trial188.stdout:215: done (3 left) 2026-02-13T20:12:31.566 INFO:tasks.rados.rados.0.trial188.stdout:221: snap_remove snap 12 2026-02-13T20:12:32.500 INFO:tasks.rados.rados.0.trial188.stdout:221: done (3 left) 2026-02-13T20:12:32.500 INFO:tasks.rados.rados.0.trial188.stdout:222: read oid 16 snap 15 2026-02-13T20:12:32.500 INFO:tasks.rados.rados.0.trial188.stdout:222: expect deleted 2026-02-13T20:12:32.500 INFO:tasks.rados.rados.0.trial188.stdout:223: read oid 32 snap -1 2026-02-13T20:12:32.500 INFO:tasks.rados.rados.0.trial188.stdout:223: expect (ObjNum 107 snap 18 seq_num 107) 2026-02-13T20:12:32.500 INFO:tasks.rados.rados.0.trial188.stdout:224: write (excl) oid 39 current snap is 19 2026-02-13T20:12:32.500 INFO:tasks.rados.rados.0.trial188.stdout:224: seq_num 112 ranges {682384=456830,1721042=423699,2809728=454936,3731357=151027} 2026-02-13T20:12:32.504 INFO:tasks.rados.rados.0.trial188.stdout:224: writing trial18843701-39 from 682384 to 1139214 tid 1 2026-02-13T20:12:32.507 INFO:tasks.rados.rados.0.trial188.stdout:224: writing trial18843701-39 from 1721042 to 2144741 tid 2 2026-02-13T20:12:32.512 INFO:tasks.rados.rados.0.trial188.stdout:224: writing trial18843701-39 from 2809728 to 3264664 tid 3 2026-02-13T20:12:32.514 INFO:tasks.rados.rados.0.trial188.stdout:224: writing trial18843701-39 from 3731357 to 3882384 tid 4 2026-02-13T20:12:32.514 INFO:tasks.rados.rados.0.trial188.stdout:225: write (excl) oid 14 current snap is 19 2026-02-13T20:12:32.514 INFO:tasks.rados.rados.0.trial188.stdout:214: finishing write tid 5 to trial18843701-15 2026-02-13T20:12:32.514 INFO:tasks.rados.rados.0.trial188.stdout:214: oid 15 updating version 0 to 64 2026-02-13T20:12:32.514 INFO:tasks.rados.rados.0.trial188.stdout:214: oid 15 updating version 64 to 66 2026-02-13T20:12:32.514 INFO:tasks.rados.rados.0.trial188.stdout:214: oid 15 version 66 is already newer than 65 2026-02-13T20:12:32.514 INFO:tasks.rados.rados.0.trial188.stdout:214: oid 15 version 66 is already newer than 63 2026-02-13T20:12:32.514 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 15 v 66 (ObjNum 108 snap 19 seq_num 108) dirty exists 2026-02-13T20:12:32.515 INFO:tasks.rados.rados.0.trial188.stdout:214: left oid 15 (ObjNum 108 snap 19 seq_num 108) 2026-02-13T20:12:32.515 INFO:tasks.rados.rados.0.trial188.stdout:216: finishing write tid 3 to trial18843701-12 2026-02-13T20:12:32.515 INFO:tasks.rados.rados.0.trial188.stdout:216: finishing write tid 4 to trial18843701-12 2026-02-13T20:12:32.515 INFO:tasks.rados.rados.0.trial188.stdout:216: finishing write tid 5 to trial18843701-12 2026-02-13T20:12:32.515 INFO:tasks.rados.rados.0.trial188.stdout:216: oid 12 updating version 0 to 32 2026-02-13T20:12:32.515 INFO:tasks.rados.rados.0.trial188.stdout:216: oid 12 version 32 is already newer than 31 2026-02-13T20:12:32.515 INFO:tasks.rados.rados.0.trial188.stdout:216: oid 12 updating version 32 to 33 2026-02-13T20:12:32.515 INFO:tasks.rados.rados.0.trial188.stdout:216: oid 12 updating version 33 to 34 2026-02-13T20:12:32.515 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 12 v 34 (ObjNum 109 snap 19 seq_num 109) dirty exists 2026-02-13T20:12:32.515 INFO:tasks.rados.rados.0.trial188.stdout:216: left oid 12 (ObjNum 109 snap 19 seq_num 109) 2026-02-13T20:12:32.515 INFO:tasks.rados.rados.0.trial188.stdout:220: finishing write tid 1 to trial18843701-48 2026-02-13T20:12:32.515 INFO:tasks.rados.rados.0.trial188.stdout:220: finishing write tid 2 to trial18843701-48 2026-02-13T20:12:32.515 INFO:tasks.rados.rados.0.trial188.stdout:225: seq_num 113 ranges {699191=532079,1779524=567357,2837151=666208} 2026-02-13T20:12:32.519 INFO:tasks.rados.rados.0.trial188.stdout:225: writing trial18843701-14 from 699191 to 1231270 tid 1 2026-02-13T20:12:32.523 INFO:tasks.rados.rados.0.trial188.stdout:225: writing trial18843701-14 from 1779524 to 2346881 tid 2 2026-02-13T20:12:32.527 INFO:tasks.rados.rados.0.trial188.stdout:225: writing trial18843701-14 from 2837151 to 3503359 tid 3 2026-02-13T20:12:32.527 INFO:tasks.rados.rados.0.trial188.stdout:214: done (6 left) 2026-02-13T20:12:32.527 INFO:tasks.rados.rados.0.trial188.stdout:216: done (5 left) 2026-02-13T20:12:32.527 INFO:tasks.rados.rados.0.trial188.stdout:226: snap_remove snap 16 2026-02-13T20:12:33.503 INFO:tasks.rados.rados.0.trial188.stdout:226: done (5 left) 2026-02-13T20:12:33.503 INFO:tasks.rados.rados.0.trial188.stdout:227: read oid 17 snap -1 2026-02-13T20:12:33.503 INFO:tasks.rados.rados.0.trial188.stdout:227: expect (ObjNum 53 snap 1 seq_num 53) 2026-02-13T20:12:33.503 INFO:tasks.rados.rados.0.trial188.stdout:228: rollback oid 21 current snap is 19 2026-02-13T20:12:33.503 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 21 to 10 2026-02-13T20:12:33.503 INFO:tasks.rados.rados.0.trial188.stdout:220: finishing write tid 3 to trial18843701-48 2026-02-13T20:12:33.503 INFO:tasks.rados.rados.0.trial188.stdout:220: finishing write tid 4 to trial18843701-48 2026-02-13T20:12:33.503 INFO:tasks.rados.rados.0.trial188.stdout:220: finishing write tid 5 to trial18843701-48 2026-02-13T20:12:33.503 INFO:tasks.rados.rados.0.trial188.stdout:220: oid 48 updating version 0 to 23 2026-02-13T20:12:33.504 INFO:tasks.rados.rados.0.trial188.stdout:220: oid 48 version 23 is already newer than 21 2026-02-13T20:12:33.504 INFO:tasks.rados.rados.0.trial188.stdout:220: oid 48 version 23 is already newer than 22 2026-02-13T20:12:33.504 INFO:tasks.rados.rados.0.trial188.stdout:220: oid 48 version 23 is already newer than 20 2026-02-13T20:12:33.504 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 48 v 23 (ObjNum 111 snap 19 seq_num 111) dirty exists 2026-02-13T20:12:33.504 INFO:tasks.rados.rados.0.trial188.stdout:220: left oid 48 (ObjNum 111 snap 19 seq_num 111) 2026-02-13T20:12:33.504 INFO:tasks.rados.rados.0.trial188.stdout:223: expect (ObjNum 107 snap 18 seq_num 107) 2026-02-13T20:12:33.644 INFO:tasks.rados.rados.0.trial188.stdout:224: finishing write tid 1 to trial18843701-39 2026-02-13T20:12:33.644 INFO:tasks.rados.rados.0.trial188.stdout:224: finishing write tid 2 to trial18843701-39 2026-02-13T20:12:33.644 INFO:tasks.rados.rados.0.trial188.stdout:224: finishing write tid 3 to trial18843701-39 2026-02-13T20:12:33.644 INFO:tasks.rados.rados.0.trial188.stdout:225: finishing write tid 1 to trial18843701-14 2026-02-13T20:12:33.644 INFO:tasks.rados.rados.0.trial188.stdout:224: finishing write tid 4 to trial18843701-39 2026-02-13T20:12:33.644 INFO:tasks.rados.rados.0.trial188.stdout:225: finishing write tid 2 to trial18843701-14 2026-02-13T20:12:33.644 INFO:tasks.rados.rados.0.trial188.stdout:220: done (6 left) 2026-02-13T20:12:33.644 INFO:tasks.rados.rados.0.trial188.stdout:222: done (5 left) 2026-02-13T20:12:33.644 INFO:tasks.rados.rados.0.trial188.stdout:223: done (4 left) 2026-02-13T20:12:33.644 INFO:tasks.rados.rados.0.trial188.stdout:229: snap_create 2026-02-13T20:12:33.644 INFO:tasks.rados.rados.0.trial188.stdout:224: finishing write tid 5 to trial18843701-39 2026-02-13T20:12:33.645 INFO:tasks.rados.rados.0.trial188.stdout:224: finishing write tid 6 to trial18843701-39 2026-02-13T20:12:33.645 INFO:tasks.rados.rados.0.trial188.stdout:224: oid 39 updating version 0 to 74 2026-02-13T20:12:33.645 INFO:tasks.rados.rados.0.trial188.stdout:224: oid 39 updating version 74 to 76 2026-02-13T20:12:33.645 INFO:tasks.rados.rados.0.trial188.stdout:224: oid 39 version 76 is already newer than 75 2026-02-13T20:12:33.645 INFO:tasks.rados.rados.0.trial188.stdout:224: oid 39 version 76 is already newer than 72 2026-02-13T20:12:33.645 INFO:tasks.rados.rados.0.trial188.stdout:224: oid 39 version 76 is already newer than 73 2026-02-13T20:12:33.645 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 39 v 76 (ObjNum 112 snap 19 seq_num 112) dirty exists 2026-02-13T20:12:33.645 INFO:tasks.rados.rados.0.trial188.stdout:224: left oid 39 (ObjNum 112 snap 19 seq_num 112) 2026-02-13T20:12:33.645 INFO:tasks.rados.rados.0.trial188.stdout:225: finishing write tid 3 to trial18843701-14 2026-02-13T20:12:33.645 INFO:tasks.rados.rados.0.trial188.stdout:225: finishing write tid 4 to trial18843701-14 2026-02-13T20:12:33.645 INFO:tasks.rados.rados.0.trial188.stdout:225: finishing write tid 5 to trial18843701-14 2026-02-13T20:12:33.645 INFO:tasks.rados.rados.0.trial188.stdout:225: oid 14 updating version 0 to 80 2026-02-13T20:12:33.645 INFO:tasks.rados.rados.0.trial188.stdout:225: oid 14 version 80 is already newer than 78 2026-02-13T20:12:33.645 INFO:tasks.rados.rados.0.trial188.stdout:225: oid 14 version 80 is already newer than 79 2026-02-13T20:12:33.645 INFO:tasks.rados.rados.0.trial188.stdout:225: oid 14 updating version 80 to 81 2026-02-13T20:12:33.645 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 14 v 81 (ObjNum 113 snap 19 seq_num 113) dirty exists 2026-02-13T20:12:33.645 INFO:tasks.rados.rados.0.trial188.stdout:225: left oid 14 (ObjNum 113 snap 19 seq_num 113) 2026-02-13T20:12:33.645 INFO:tasks.rados.rados.0.trial188.stdout:228: finishing rollback tid 1 to trial18843701-21 2026-02-13T20:12:33.645 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 21 v 0 (ObjNum 33 snap 0 seq_num 11871569) dirty dne 2026-02-13T20:12:33.645 INFO:tasks.rados.rados.0.trial188.stdout:227: expect (ObjNum 53 snap 1 seq_num 53) 2026-02-13T20:12:33.666 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:33.695 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:34.506 INFO:tasks.rados.rados.0.trial188.stdout:224: done (4 left) 2026-02-13T20:12:34.507 INFO:tasks.rados.rados.0.trial188.stdout:225: done (3 left) 2026-02-13T20:12:34.507 INFO:tasks.rados.rados.0.trial188.stdout:227: done (2 left) 2026-02-13T20:12:34.507 INFO:tasks.rados.rados.0.trial188.stdout:228: done (1 left) 2026-02-13T20:12:34.507 INFO:tasks.rados.rados.0.trial188.stdout:229: done (0 left) 2026-02-13T20:12:34.507 INFO:tasks.rados.rados.0.trial188.stdout:230: read oid 25 snap 15 2026-02-13T20:12:34.507 INFO:tasks.rados.rados.0.trial188.stdout:230: expect (ObjNum 24 snap 0 seq_num 24) 2026-02-13T20:12:34.507 INFO:tasks.rados.rados.0.trial188.stdout:231: read oid 10 snap -1 2026-02-13T20:12:34.507 INFO:tasks.rados.rados.0.trial188.stdout:231: expect deleted 2026-02-13T20:12:34.507 INFO:tasks.rados.rados.0.trial188.stdout:232: snap_remove snap 18 2026-02-13T20:12:35.482 INFO:tasks.rados.rados.0.trial188.stdout:232: done (2 left) 2026-02-13T20:12:35.482 INFO:tasks.rados.rados.0.trial188.stdout:233: delete oid 30 current snap is 20 2026-02-13T20:12:35.482 INFO:tasks.rados.rados.0.trial188.stdout:230: expect (ObjNum 24 snap 0 seq_num 24) 2026-02-13T20:12:35.533 INFO:tasks.rados.rados.0.trial188.stdout:230: done (2 left) 2026-02-13T20:12:35.533 INFO:tasks.rados.rados.0.trial188.stdout:231: done (1 left) 2026-02-13T20:12:35.533 INFO:tasks.rados.rados.0.trial188.stdout:233: done (0 left) 2026-02-13T20:12:35.533 INFO:tasks.rados.rados.0.trial188.stdout:234: read oid 40 snap 19 2026-02-13T20:12:35.533 INFO:tasks.rados.rados.0.trial188.stdout:234: expect (ObjNum 39 snap 0 seq_num 39) 2026-02-13T20:12:35.533 INFO:tasks.rados.rados.0.trial188.stdout:235: read oid 15 snap 10 2026-02-13T20:12:35.533 INFO:tasks.rados.rados.0.trial188.stdout:235: expect deleted 2026-02-13T20:12:35.533 INFO:tasks.rados.rados.0.trial188.stdout:236: write oid 9 current snap is 20 2026-02-13T20:12:35.533 INFO:tasks.rados.rados.0.trial188.stdout:236: seq_num 115 ranges {732805=798930,2296488=571026,3291997=405105} 2026-02-13T20:12:35.538 INFO:tasks.rados.rados.0.trial188.stdout:236: writing trial18843701-9 from 732805 to 1531735 tid 1 2026-02-13T20:12:35.543 INFO:tasks.rados.rados.0.trial188.stdout:236: writing trial18843701-9 from 2296488 to 2867514 tid 2 2026-02-13T20:12:35.546 INFO:tasks.rados.rados.0.trial188.stdout:236: writing trial18843701-9 from 3291997 to 3697102 tid 3 2026-02-13T20:12:35.546 INFO:tasks.rados.rados.0.trial188.stdout:237: write oid 3 current snap is 20 2026-02-13T20:12:35.546 INFO:tasks.rados.rados.0.trial188.stdout:237: seq_num 116 ranges {749612=474179,1954970=431037,2919420=616377} 2026-02-13T20:12:35.551 INFO:tasks.rados.rados.0.trial188.stdout:237: writing trial18843701-3 from 749612 to 1223791 tid 1 2026-02-13T20:12:35.555 INFO:tasks.rados.rados.0.trial188.stdout:237: writing trial18843701-3 from 1954970 to 2386007 tid 2 2026-02-13T20:12:35.560 INFO:tasks.rados.rados.0.trial188.stdout:237: writing trial18843701-3 from 2919420 to 3535797 tid 3 2026-02-13T20:12:35.560 INFO:tasks.rados.rados.0.trial188.stdout:238: write (excl) oid 45 current snap is 20 2026-02-13T20:12:35.560 INFO:tasks.rados.rados.0.trial188.stdout:238: seq_num 117 ranges {766419=549428,2013452=574695,3346843=427649} 2026-02-13T20:12:35.564 INFO:tasks.rados.rados.0.trial188.stdout:238: writing trial18843701-45 from 766419 to 1315847 tid 1 2026-02-13T20:12:35.569 INFO:tasks.rados.rados.0.trial188.stdout:238: writing trial18843701-45 from 2013452 to 2588147 tid 2 2026-02-13T20:12:35.574 INFO:tasks.rados.rados.0.trial188.stdout:238: writing trial18843701-45 from 3346843 to 3774492 tid 3 2026-02-13T20:12:35.574 INFO:tasks.rados.rados.0.trial188.stdout:239: read oid 19 snap -1 2026-02-13T20:12:35.574 INFO:tasks.rados.rados.0.trial188.stdout:239: expect (ObjNum 97 snap 15 seq_num 97) 2026-02-13T20:12:35.574 INFO:tasks.rados.rados.0.trial188.stdout:240: snap_remove snap 15 2026-02-13T20:12:36.511 INFO:tasks.rados.rados.0.trial188.stdout:240: done (6 left) 2026-02-13T20:12:36.511 INFO:tasks.rados.rados.0.trial188.stdout:241: read oid 4 snap 10 2026-02-13T20:12:36.511 INFO:tasks.rados.rados.0.trial188.stdout:241: expect (ObjNum 70 snap 5 seq_num 70) 2026-02-13T20:12:36.511 INFO:tasks.rados.rados.0.trial188.stdout:242: rollback oid 6 current snap is 20 2026-02-13T20:12:36.511 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 6 to 19 2026-02-13T20:12:36.511 INFO:tasks.rados.rados.0.trial188.stdout:234: expect (ObjNum 39 snap 0 seq_num 39) 2026-02-13T20:12:36.512 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:36.532 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1433773 2026-02-13T20:12:36.554 INFO:tasks.rados.rados.0.trial188.stdout:236: finishing write tid 1 to trial18843701-9 2026-02-13T20:12:36.554 INFO:tasks.rados.rados.0.trial188.stdout:236: finishing write tid 2 to trial18843701-9 2026-02-13T20:12:36.554 INFO:tasks.rados.rados.0.trial188.stdout:234: done (7 left) 2026-02-13T20:12:36.554 INFO:tasks.rados.rados.0.trial188.stdout:235: done (6 left) 2026-02-13T20:12:36.554 INFO:tasks.rados.rados.0.trial188.stdout:243: read oid 48 snap 19 2026-02-13T20:12:36.554 INFO:tasks.rados.rados.0.trial188.stdout:243: expect (ObjNum 111 snap 19 seq_num 111) 2026-02-13T20:12:36.555 INFO:tasks.rados.rados.0.trial188.stdout:244: delete oid 16 current snap is 20 2026-02-13T20:12:36.555 INFO:tasks.rados.rados.0.trial188.stdout:236: finishing write tid 3 to trial18843701-9 2026-02-13T20:12:36.555 INFO:tasks.rados.rados.0.trial188.stdout:237: finishing write tid 1 to trial18843701-3 2026-02-13T20:12:36.555 INFO:tasks.rados.rados.0.trial188.stdout:236: finishing write tid 4 to trial18843701-9 2026-02-13T20:12:36.555 INFO:tasks.rados.rados.0.trial188.stdout:236: finishing write tid 5 to trial18843701-9 2026-02-13T20:12:36.555 INFO:tasks.rados.rados.0.trial188.stdout:236: oid 9 updating version 0 to 65 2026-02-13T20:12:36.555 INFO:tasks.rados.rados.0.trial188.stdout:236: oid 9 version 65 is already newer than 62 2026-02-13T20:12:36.555 INFO:tasks.rados.rados.0.trial188.stdout:236: oid 9 version 65 is already newer than 63 2026-02-13T20:12:36.555 INFO:tasks.rados.rados.0.trial188.stdout:236: oid 9 version 65 is already newer than 64 2026-02-13T20:12:36.555 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 9 v 65 (ObjNum 115 snap 20 seq_num 115) dirty exists 2026-02-13T20:12:36.555 INFO:tasks.rados.rados.0.trial188.stdout:236: left oid 9 (ObjNum 115 snap 20 seq_num 115) 2026-02-13T20:12:36.555 INFO:tasks.rados.rados.0.trial188.stdout:239: expect (ObjNum 97 snap 15 seq_num 97) 2026-02-13T20:12:36.555 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:36.608 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:36.663 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:36.717 INFO:tasks.rados.rados.0.trial188.stdout:237: finishing write tid 2 to trial18843701-3 2026-02-13T20:12:36.718 INFO:tasks.rados.rados.0.trial188.stdout:236: done (7 left) 2026-02-13T20:12:36.718 INFO:tasks.rados.rados.0.trial188.stdout:239: done (6 left) 2026-02-13T20:12:36.718 INFO:tasks.rados.rados.0.trial188.stdout:244: done (5 left) 2026-02-13T20:12:36.718 INFO:tasks.rados.rados.0.trial188.stdout:245: write oid 23 current snap is 20 2026-02-13T20:12:36.718 INFO:tasks.rados.rados.0.trial188.stdout:238: finishing write tid 1 to trial18843701-45 2026-02-13T20:12:36.718 INFO:tasks.rados.rados.0.trial188.stdout:245: seq_num 119 ranges {400033=699926,1614063=385970} 2026-02-13T20:12:36.721 INFO:tasks.rados.rados.0.trial188.stdout:245: writing trial18843701-23 from 400033 to 1099959 tid 1 2026-02-13T20:12:36.725 INFO:tasks.rados.rados.0.trial188.stdout:245: writing trial18843701-23 from 1614063 to 2000033 tid 2 2026-02-13T20:12:36.725 INFO:tasks.rados.rados.0.trial188.stdout:246: read oid 39 snap -1 2026-02-13T20:12:36.725 INFO:tasks.rados.rados.0.trial188.stdout:246: expect (ObjNum 112 snap 19 seq_num 112) 2026-02-13T20:12:36.725 INFO:tasks.rados.rados.0.trial188.stdout:247: read oid 20 snap -1 2026-02-13T20:12:36.725 INFO:tasks.rados.rados.0.trial188.stdout:247: expect (ObjNum 88 snap 12 seq_num 88) 2026-02-13T20:12:36.725 INFO:tasks.rados.rados.0.trial188.stdout:248: copy_from oid 15 from oid 47 current snap is 20 2026-02-13T20:12:36.725 INFO:tasks.rados.rados.0.trial188.stdout:238: finishing write tid 2 to trial18843701-45 2026-02-13T20:12:36.725 INFO:tasks.rados.rados.0.trial188.stdout:237: finishing write tid 3 to trial18843701-3 2026-02-13T20:12:36.725 INFO:tasks.rados.rados.0.trial188.stdout:237: finishing write tid 4 to trial18843701-3 2026-02-13T20:12:36.725 INFO:tasks.rados.rados.0.trial188.stdout:237: finishing write tid 5 to trial18843701-3 2026-02-13T20:12:36.725 INFO:tasks.rados.rados.0.trial188.stdout:237: oid 3 updating version 0 to 89 2026-02-13T20:12:36.725 INFO:tasks.rados.rados.0.trial188.stdout:237: oid 3 updating version 89 to 90 2026-02-13T20:12:36.725 INFO:tasks.rados.rados.0.trial188.stdout:237: oid 3 updating version 90 to 91 2026-02-13T20:12:36.725 INFO:tasks.rados.rados.0.trial188.stdout:237: oid 3 version 91 is already newer than 88 2026-02-13T20:12:36.725 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 3 v 91 (ObjNum 116 snap 20 seq_num 116) dirty exists 2026-02-13T20:12:36.725 INFO:tasks.rados.rados.0.trial188.stdout:237: left oid 3 (ObjNum 116 snap 20 seq_num 116) 2026-02-13T20:12:36.725 INFO:tasks.rados.rados.0.trial188.stdout:238: finishing write tid 3 to trial18843701-45 2026-02-13T20:12:36.725 INFO:tasks.rados.rados.0.trial188.stdout:237: done (8 left) 2026-02-13T20:12:36.725 INFO:tasks.rados.rados.0.trial188.stdout:249: write oid 34 current snap is 20 2026-02-13T20:12:36.725 INFO:tasks.rados.rados.0.trial188.stdout:249: seq_num 120 ranges {416840=775175,1672545=344295} 2026-02-13T20:12:36.729 INFO:tasks.rados.rados.0.trial188.stdout:249: writing trial18843701-34 from 416840 to 1192015 tid 1 2026-02-13T20:12:36.733 INFO:tasks.rados.rados.0.trial188.stdout:249: writing trial18843701-34 from 1672545 to 2016840 tid 2 2026-02-13T20:12:36.733 INFO:tasks.rados.rados.0.trial188.stdout:250: delete oid 50 current snap is 20 2026-02-13T20:12:36.733 INFO:tasks.rados.rados.0.trial188.stdout:238: finishing write tid 4 to trial18843701-45 2026-02-13T20:12:36.733 INFO:tasks.rados.rados.0.trial188.stdout:238: finishing write tid 5 to trial18843701-45 2026-02-13T20:12:36.733 INFO:tasks.rados.rados.0.trial188.stdout:238: oid 45 updating version 0 to 66 2026-02-13T20:12:36.733 INFO:tasks.rados.rados.0.trial188.stdout:238: oid 45 updating version 66 to 68 2026-02-13T20:12:36.733 INFO:tasks.rados.rados.0.trial188.stdout:238: oid 45 version 68 is already newer than 67 2026-02-13T20:12:36.733 INFO:tasks.rados.rados.0.trial188.stdout:238: oid 45 updating version 68 to 69 2026-02-13T20:12:36.733 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 45 v 69 (ObjNum 117 snap 20 seq_num 117) dirty exists 2026-02-13T20:12:36.733 INFO:tasks.rados.rados.0.trial188.stdout:238: left oid 45 (ObjNum 117 snap 20 seq_num 117) 2026-02-13T20:12:36.733 INFO:tasks.rados.rados.0.trial188.stdout:241: expect (ObjNum 70 snap 5 seq_num 70) 2026-02-13T20:12:36.811 INFO:tasks.rados.rados.0.trial188.stdout:242: finishing rollback tid 0 to trial18843701-6 2026-02-13T20:12:36.812 INFO:tasks.rados.rados.0.trial188.stdout:242: finishing rollback tid 1 to trial18843701-6 2026-02-13T20:12:36.812 INFO:tasks.rados.rados.0.trial188.stdout:238: done (9 left) 2026-02-13T20:12:36.812 INFO:tasks.rados.rados.0.trial188.stdout:241: done (8 left) 2026-02-13T20:12:36.812 INFO:tasks.rados.rados.0.trial188.stdout:250: done (7 left) 2026-02-13T20:12:36.812 INFO:tasks.rados.rados.0.trial188.stdout:251: copy_from oid 13 from oid 28 current snap is 20 2026-02-13T20:12:36.812 INFO:tasks.rados.rados.0.trial188.stdout:242: finishing rollback tid 2 to trial18843701-6 2026-02-13T20:12:36.812 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 6 v 88 (ObjNum 71 snap 6 seq_num 71) dirty exists 2026-02-13T20:12:36.812 INFO:tasks.rados.rados.0.trial188.stdout:243: expect (ObjNum 111 snap 19 seq_num 111) 2026-02-13T20:12:36.885 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:36.924 INFO:tasks.rados.rados.0.trial188.stdout:247: expect (ObjNum 88 snap 12 seq_num 88) 2026-02-13T20:12:36.993 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:37.030 INFO:tasks.rados.rados.0.trial188.stdout:246: expect (ObjNum 112 snap 19 seq_num 112) 2026-02-13T20:12:37.030 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 486109 2026-02-13T20:12:37.056 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:37.112 INFO:tasks.rados.rados.0.trial188.stdout:245: finishing write tid 1 to trial18843701-23 2026-02-13T20:12:37.112 INFO:tasks.rados.rados.0.trial188.stdout:245: finishing write tid 2 to trial18843701-23 2026-02-13T20:12:37.112 INFO:tasks.rados.rados.0.trial188.stdout:245: finishing write tid 3 to trial18843701-23 2026-02-13T20:12:37.112 INFO:tasks.rados.rados.0.trial188.stdout:242: done (7 left) 2026-02-13T20:12:37.112 INFO:tasks.rados.rados.0.trial188.stdout:243: done (6 left) 2026-02-13T20:12:37.113 INFO:tasks.rados.rados.0.trial188.stdout:246: done (5 left) 2026-02-13T20:12:37.113 INFO:tasks.rados.rados.0.trial188.stdout:247: done (4 left) 2026-02-13T20:12:37.113 INFO:tasks.rados.rados.0.trial188.stdout:252: read oid 45 snap -1 2026-02-13T20:12:37.113 INFO:tasks.rados.rados.0.trial188.stdout:252: expect (ObjNum 117 snap 20 seq_num 117) 2026-02-13T20:12:37.113 INFO:tasks.rados.rados.0.trial188.stdout:253: write oid 11 current snap is 20 2026-02-13T20:12:37.113 INFO:tasks.rados.rados.0.trial188.stdout:245: finishing write tid 4 to trial18843701-23 2026-02-13T20:12:37.113 INFO:tasks.rados.rados.0.trial188.stdout:245: oid 23 updating version 0 to 92 2026-02-13T20:12:37.113 INFO:tasks.rados.rados.0.trial188.stdout:245: oid 23 updating version 92 to 93 2026-02-13T20:12:37.113 INFO:tasks.rados.rados.0.trial188.stdout:245: oid 23 version 93 is already newer than 91 2026-02-13T20:12:37.113 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 23 v 93 (ObjNum 119 snap 20 seq_num 119) dirty exists 2026-02-13T20:12:37.113 INFO:tasks.rados.rados.0.trial188.stdout:245: left oid 23 (ObjNum 119 snap 20 seq_num 119) 2026-02-13T20:12:37.113 INFO:tasks.rados.rados.0.trial188.stdout:249: finishing write tid 1 to trial18843701-34 2026-02-13T20:12:37.114 INFO:tasks.rados.rados.0.trial188.stdout:249: finishing write tid 2 to trial18843701-34 2026-02-13T20:12:37.114 INFO:tasks.rados.rados.0.trial188.stdout:249: finishing write tid 3 to trial18843701-34 2026-02-13T20:12:37.114 INFO:tasks.rados.rados.0.trial188.stdout:253: seq_num 122 ranges {450454=642026,1505862=544592} 2026-02-13T20:12:37.116 INFO:tasks.rados.rados.0.trial188.stdout:253: writing trial18843701-11 from 450454 to 1092480 tid 1 2026-02-13T20:12:37.120 INFO:tasks.rados.rados.0.trial188.stdout:253: writing trial18843701-11 from 1505862 to 2050454 tid 2 2026-02-13T20:12:37.120 INFO:tasks.rados.rados.0.trial188.stdout:245: done (5 left) 2026-02-13T20:12:37.120 INFO:tasks.rados.rados.0.trial188.stdout:254: read oid 22 snap 10 2026-02-13T20:12:37.120 INFO:tasks.rados.rados.0.trial188.stdout:254: expect (ObjNum 75 snap 7 seq_num 75) 2026-02-13T20:12:37.120 INFO:tasks.rados.rados.0.trial188.stdout:255: read oid 48 snap -1 2026-02-13T20:12:37.120 INFO:tasks.rados.rados.0.trial188.stdout:255: expect (ObjNum 111 snap 19 seq_num 111) 2026-02-13T20:12:37.120 INFO:tasks.rados.rados.0.trial188.stdout:256: copy_from oid 35 from oid 25 current snap is 20 2026-02-13T20:12:37.120 INFO:tasks.rados.rados.0.trial188.stdout:249: finishing write tid 4 to trial18843701-34 2026-02-13T20:12:37.120 INFO:tasks.rados.rados.0.trial188.stdout:249: oid 34 updating version 0 to 77 2026-02-13T20:12:37.120 INFO:tasks.rados.rados.0.trial188.stdout:249: oid 34 version 77 is already newer than 76 2026-02-13T20:12:37.120 INFO:tasks.rados.rados.0.trial188.stdout:249: oid 34 version 77 is already newer than 75 2026-02-13T20:12:37.120 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 34 v 77 (ObjNum 120 snap 20 seq_num 120) dirty exists 2026-02-13T20:12:37.120 INFO:tasks.rados.rados.0.trial188.stdout:249: left oid 34 (ObjNum 120 snap 20 seq_num 120) 2026-02-13T20:12:37.120 INFO:tasks.rados.rados.0.trial188.stdout:249: done (7 left) 2026-02-13T20:12:37.120 INFO:tasks.rados.rados.0.trial188.stdout:257: delete oid 43 current snap is 20 2026-02-13T20:12:37.120 INFO:tasks.rados.rados.0.trial188.stdout:248: finishing copy_from racing read to trial18843701-15 2026-02-13T20:12:37.120 INFO:tasks.rados.rados.0.trial188.stdout:248: finishing copy_from to trial18843701-15 2026-02-13T20:12:37.120 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 15 v 23 (ObjNum 44 snap 0 seq_num 44) dirty exists 2026-02-13T20:12:37.121 INFO:tasks.rados.rados.0.trial188.stdout:251: finishing copy_from racing read to trial18843701-13 2026-02-13T20:12:37.121 INFO:tasks.rados.rados.0.trial188.stdout:251: finishing copy_from to trial18843701-13 2026-02-13T20:12:37.121 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 13 v 10 (ObjNum 21 snap 0 seq_num 21) dirty exists 2026-02-13T20:12:37.121 INFO:tasks.rados.rados.0.trial188.stdout:252: expect (ObjNum 117 snap 20 seq_num 117) 2026-02-13T20:12:37.154 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 749832 2026-02-13T20:12:37.189 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:37.232 INFO:tasks.rados.rados.0.trial188.stdout:255: expect (ObjNum 111 snap 19 seq_num 111) 2026-02-13T20:12:37.236 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1516952 2026-02-13T20:12:37.343 INFO:tasks.rados.rados.0.trial188.stdout:254: expect (ObjNum 75 snap 7 seq_num 75) 2026-02-13T20:12:37.344 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:37.374 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:37.411 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1593782 2026-02-13T20:12:37.431 INFO:tasks.rados.rados.0.trial188.stdout:253: finishing write tid 1 to trial18843701-11 2026-02-13T20:12:37.431 INFO:tasks.rados.rados.0.trial188.stdout:248: done (7 left) 2026-02-13T20:12:37.432 INFO:tasks.rados.rados.0.trial188.stdout:251: done (6 left) 2026-02-13T20:12:37.432 INFO:tasks.rados.rados.0.trial188.stdout:252: done (5 left) 2026-02-13T20:12:37.432 INFO:tasks.rados.rados.0.trial188.stdout:254: done (4 left) 2026-02-13T20:12:37.432 INFO:tasks.rados.rados.0.trial188.stdout:255: done (3 left) 2026-02-13T20:12:37.432 INFO:tasks.rados.rados.0.trial188.stdout:257: done (2 left) 2026-02-13T20:12:37.432 INFO:tasks.rados.rados.0.trial188.stdout:258: copy_from oid 10 from oid 13 current snap is 20 2026-02-13T20:12:37.432 INFO:tasks.rados.rados.0.trial188.stdout:253: finishing write tid 2 to trial18843701-11 2026-02-13T20:12:37.432 INFO:tasks.rados.rados.0.trial188.stdout:253: finishing write tid 3 to trial18843701-11 2026-02-13T20:12:37.432 INFO:tasks.rados.rados.0.trial188.stdout:253: finishing write tid 4 to trial18843701-11 2026-02-13T20:12:37.432 INFO:tasks.rados.rados.0.trial188.stdout:253: oid 11 updating version 0 to 72 2026-02-13T20:12:37.432 INFO:tasks.rados.rados.0.trial188.stdout:253: oid 11 version 72 is already newer than 71 2026-02-13T20:12:37.433 INFO:tasks.rados.rados.0.trial188.stdout:253: oid 11 updating version 72 to 73 2026-02-13T20:12:37.433 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 11 v 73 (ObjNum 122 snap 20 seq_num 122) dirty exists 2026-02-13T20:12:37.433 INFO:tasks.rados.rados.0.trial188.stdout:253: left oid 11 (ObjNum 122 snap 20 seq_num 122) 2026-02-13T20:12:37.433 INFO:tasks.rados.rados.0.trial188.stdout:256: finishing copy_from racing read to trial18843701-35 2026-02-13T20:12:37.433 INFO:tasks.rados.rados.0.trial188.stdout:256: finishing copy_from to trial18843701-35 2026-02-13T20:12:37.433 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 35 v 46 (ObjNum 24 snap 0 seq_num 24) dirty exists 2026-02-13T20:12:37.433 INFO:tasks.rados.rados.0.trial188.stdout:253: done (2 left) 2026-02-13T20:12:37.433 INFO:tasks.rados.rados.0.trial188.stdout:256: done (1 left) 2026-02-13T20:12:37.433 INFO:tasks.rados.rados.0.trial188.stdout:259: snap_remove snap 10 2026-02-13T20:12:37.514 INFO:tasks.rados.rados.0.trial188.stdout:259: done (1 left) 2026-02-13T20:12:37.514 INFO:tasks.rados.rados.0.trial188.stdout:260: copy_from oid 18 from oid 32 current snap is 20 2026-02-13T20:12:37.514 INFO:tasks.rados.rados.0.trial188.stdout:258: finishing copy_from racing read to trial18843701-10 2026-02-13T20:12:37.514 INFO:tasks.rados.rados.0.trial188.stdout:258: finishing copy_from to trial18843701-10 2026-02-13T20:12:37.514 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 10 v 10 (ObjNum 21 snap 0 seq_num 21) dirty exists 2026-02-13T20:12:37.514 INFO:tasks.rados.rados.0.trial188.stdout:258: done (1 left) 2026-02-13T20:12:37.515 INFO:tasks.rados.rados.0.trial188.stdout:261: read oid 39 snap -1 2026-02-13T20:12:37.515 INFO:tasks.rados.rados.0.trial188.stdout:261: expect (ObjNum 112 snap 19 seq_num 112) 2026-02-13T20:12:37.515 INFO:tasks.rados.rados.0.trial188.stdout:262: write (excl) oid 6 current snap is 20 2026-02-13T20:12:37.515 INFO:tasks.rados.rados.0.trial188.stdout:262: seq_num 124 ranges {484068=792524,1906473=177595} 2026-02-13T20:12:37.518 INFO:tasks.rados.rados.0.trial188.stdout:262: writing trial18843701-6 from 484068 to 1276592 tid 1 2026-02-13T20:12:37.521 INFO:tasks.rados.rados.0.trial188.stdout:262: writing trial18843701-6 from 1906473 to 2084068 tid 2 2026-02-13T20:12:37.521 INFO:tasks.rados.rados.0.trial188.stdout:263: write (excl) oid 7 current snap is 20 2026-02-13T20:12:37.521 INFO:tasks.rados.rados.0.trial188.stdout:263: seq_num 125 ranges {500875=467773,1564955=535920} 2026-02-13T20:12:37.524 INFO:tasks.rados.rados.0.trial188.stdout:263: writing trial18843701-7 from 500875 to 968648 tid 1 2026-02-13T20:12:37.529 INFO:tasks.rados.rados.0.trial188.stdout:263: writing trial18843701-7 from 1564955 to 2100875 tid 2 2026-02-13T20:12:37.529 INFO:tasks.rados.rados.0.trial188.stdout:264: rollback oid 35 current snap is 20 2026-02-13T20:12:37.529 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 35 to 19 2026-02-13T20:12:37.529 INFO:tasks.rados.rados.0.trial188.stdout:261: expect (ObjNum 112 snap 19 seq_num 112) 2026-02-13T20:12:37.530 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 618812 2026-02-13T20:12:37.606 INFO:tasks.rados.rados.0.trial188.stdout:262: finishing write tid 1 to trial18843701-6 2026-02-13T20:12:37.606 INFO:tasks.rados.rados.0.trial188.stdout:264: finishing rollback tid 0 to trial18843701-35 2026-02-13T20:12:37.606 INFO:tasks.rados.rados.0.trial188.stdout:264: finishing rollback tid 1 to trial18843701-35 2026-02-13T20:12:37.606 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 35 v 78 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-13T20:12:37.606 INFO:tasks.rados.rados.0.trial188.stdout:263: finishing write tid 1 to trial18843701-7 2026-02-13T20:12:37.606 INFO:tasks.rados.rados.0.trial188.stdout:262: finishing write tid 2 to trial18843701-6 2026-02-13T20:12:37.606 INFO:tasks.rados.rados.0.trial188.stdout:262: finishing write tid 3 to trial18843701-6 2026-02-13T20:12:37.607 INFO:tasks.rados.rados.0.trial188.stdout:262: finishing write tid 4 to trial18843701-6 2026-02-13T20:12:37.607 INFO:tasks.rados.rados.0.trial188.stdout:262: oid 6 updating version 0 to 107 2026-02-13T20:12:37.607 INFO:tasks.rados.rados.0.trial188.stdout:262: oid 6 updating version 107 to 108 2026-02-13T20:12:37.607 INFO:tasks.rados.rados.0.trial188.stdout:262: oid 6 version 108 is already newer than 106 2026-02-13T20:12:37.607 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 6 v 108 (ObjNum 124 snap 20 seq_num 124) dirty exists 2026-02-13T20:12:37.607 INFO:tasks.rados.rados.0.trial188.stdout:262: left oid 6 (ObjNum 124 snap 20 seq_num 124) 2026-02-13T20:12:37.607 INFO:tasks.rados.rados.0.trial188.stdout:263: finishing write tid 2 to trial18843701-7 2026-02-13T20:12:37.607 INFO:tasks.rados.rados.0.trial188.stdout:263: finishing write tid 3 to trial18843701-7 2026-02-13T20:12:37.607 INFO:tasks.rados.rados.0.trial188.stdout:263: finishing write tid 4 to trial18843701-7 2026-02-13T20:12:37.607 INFO:tasks.rados.rados.0.trial188.stdout:263: oid 7 updating version 0 to 85 2026-02-13T20:12:37.607 INFO:tasks.rados.rados.0.trial188.stdout:263: oid 7 updating version 85 to 87 2026-02-13T20:12:37.607 INFO:tasks.rados.rados.0.trial188.stdout:263: oid 7 version 87 is already newer than 86 2026-02-13T20:12:37.608 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 7 v 87 (ObjNum 125 snap 20 seq_num 125) dirty exists 2026-02-13T20:12:37.608 INFO:tasks.rados.rados.0.trial188.stdout:263: left oid 7 (ObjNum 125 snap 20 seq_num 125) 2026-02-13T20:12:37.608 INFO:tasks.rados.rados.0.trial188.stdout:260: finishing copy_from racing read to trial18843701-18 2026-02-13T20:12:37.608 INFO:tasks.rados.rados.0.trial188.stdout:260: finishing copy_from to trial18843701-18 2026-02-13T20:12:37.608 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 18 v 44 (ObjNum 107 snap 18 seq_num 107) dirty exists 2026-02-13T20:12:37.608 INFO:tasks.rados.rados.0.trial188.stdout:260: done (4 left) 2026-02-13T20:12:37.608 INFO:tasks.rados.rados.0.trial188.stdout:261: done (3 left) 2026-02-13T20:12:37.608 INFO:tasks.rados.rados.0.trial188.stdout:262: done (2 left) 2026-02-13T20:12:37.608 INFO:tasks.rados.rados.0.trial188.stdout:263: done (1 left) 2026-02-13T20:12:37.608 INFO:tasks.rados.rados.0.trial188.stdout:264: done (0 left) 2026-02-13T20:12:37.608 INFO:tasks.rados.rados.0.trial188.stdout:265: read oid 33 snap -1 2026-02-13T20:12:37.608 INFO:tasks.rados.rados.0.trial188.stdout:265: expect (ObjNum 32 snap 0 seq_num 32) 2026-02-13T20:12:37.609 INFO:tasks.rados.rados.0.trial188.stdout:266: read oid 45 snap -1 2026-02-13T20:12:37.609 INFO:tasks.rados.rados.0.trial188.stdout:266: expect (ObjNum 117 snap 20 seq_num 117) 2026-02-13T20:12:37.609 INFO:tasks.rados.rados.0.trial188.stdout:267: snap_remove snap 19 2026-02-13T20:12:38.517 INFO:tasks.rados.rados.0.trial188.stdout:267: done (2 left) 2026-02-13T20:12:38.518 INFO:tasks.rados.rados.0.trial188.stdout:268: write oid 24 current snap is 20 2026-02-13T20:12:38.518 INFO:tasks.rados.rados.0.trial188.stdout:268: seq_num 126 ranges {517682=543022,1623437=494245} 2026-02-13T20:12:38.521 INFO:tasks.rados.rados.0.trial188.stdout:268: writing trial18843701-24 from 517682 to 1060704 tid 1 2026-02-13T20:12:38.525 INFO:tasks.rados.rados.0.trial188.stdout:268: writing trial18843701-24 from 1623437 to 2117682 tid 2 2026-02-13T20:12:38.526 INFO:tasks.rados.rados.0.trial188.stdout:269: snap_create 2026-02-13T20:12:38.526 INFO:tasks.rados.rados.0.trial188.stdout:266: expect (ObjNum 117 snap 20 seq_num 117) 2026-02-13T20:12:38.567 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:38.652 INFO:tasks.rados.rados.0.trial188.stdout:265: expect (ObjNum 32 snap 0 seq_num 32) 2026-02-13T20:12:38.652 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:38.677 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2483842 2026-02-13T20:12:38.680 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:38.698 INFO:tasks.rados.rados.0.trial188.stdout:268: finishing write tid 1 to trial18843701-24 2026-02-13T20:12:38.699 INFO:tasks.rados.rados.0.trial188.stdout:268: finishing write tid 2 to trial18843701-24 2026-02-13T20:12:38.699 INFO:tasks.rados.rados.0.trial188.stdout:268: finishing write tid 3 to trial18843701-24 2026-02-13T20:12:38.699 INFO:tasks.rados.rados.0.trial188.stdout:268: finishing write tid 4 to trial18843701-24 2026-02-13T20:12:38.699 INFO:tasks.rados.rados.0.trial188.stdout:268: oid 24 updating version 0 to 117 2026-02-13T20:12:38.699 INFO:tasks.rados.rados.0.trial188.stdout:268: oid 24 version 117 is already newer than 116 2026-02-13T20:12:38.699 INFO:tasks.rados.rados.0.trial188.stdout:268: oid 24 version 117 is already newer than 115 2026-02-13T20:12:38.699 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 24 v 117 (ObjNum 126 snap 20 seq_num 126) dirty exists 2026-02-13T20:12:38.699 INFO:tasks.rados.rados.0.trial188.stdout:268: left oid 24 (ObjNum 126 snap 20 seq_num 126) 2026-02-13T20:12:39.519 INFO:tasks.rados.rados.0.trial188.stdout:265: done (3 left) 2026-02-13T20:12:39.519 INFO:tasks.rados.rados.0.trial188.stdout:266: done (2 left) 2026-02-13T20:12:39.519 INFO:tasks.rados.rados.0.trial188.stdout:268: done (1 left) 2026-02-13T20:12:39.520 INFO:tasks.rados.rados.0.trial188.stdout:269: done (0 left) 2026-02-13T20:12:39.520 INFO:tasks.rados.rados.0.trial188.stdout:270: rollback oid 50 current snap is 21 2026-02-13T20:12:39.520 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 50 to 20 2026-02-13T20:12:39.520 INFO:tasks.rados.rados.0.trial188.stdout:271: snap_create 2026-02-13T20:12:39.521 INFO:tasks.rados.rados.0.trial188.stdout:270: finishing rollback tid 1 to trial18843701-50 2026-02-13T20:12:39.521 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 50 v 0 (ObjNum 4177 snap 0 seq_num 11860320) dirty dne 2026-02-13T20:12:40.483 INFO:tasks.rados.rados.0.trial188.stdout:270: done (1 left) 2026-02-13T20:12:40.483 INFO:tasks.rados.rados.0.trial188.stdout:271: done (0 left) 2026-02-13T20:12:40.483 INFO:tasks.rados.rados.0.trial188.stdout:272: write (excl) oid 42 current snap is 22 2026-02-13T20:12:40.483 INFO:tasks.rados.rados.0.trial188.stdout:272: seq_num 127 ranges {534489=618271,1565566=568923} 2026-02-13T20:12:40.487 INFO:tasks.rados.rados.0.trial188.stdout:272: writing trial18843701-42 from 534489 to 1152760 tid 1 2026-02-13T20:12:40.491 INFO:tasks.rados.rados.0.trial188.stdout:272: writing trial18843701-42 from 1565566 to 2134489 tid 2 2026-02-13T20:12:40.491 INFO:tasks.rados.rados.0.trial188.stdout:273: delete oid 7 current snap is 22 2026-02-13T20:12:40.504 INFO:tasks.rados.rados.0.trial188.stdout:273: done (1 left) 2026-02-13T20:12:40.504 INFO:tasks.rados.rados.0.trial188.stdout:274: write (excl) oid 49 current snap is 22 2026-02-13T20:12:40.504 INFO:tasks.rados.rados.0.trial188.stdout:272: finishing write tid 1 to trial18843701-42 2026-02-13T20:12:40.504 INFO:tasks.rados.rados.0.trial188.stdout:274: seq_num 129 ranges {568103=768769,2082530=85573} 2026-02-13T20:12:40.509 INFO:tasks.rados.rados.0.trial188.stdout:274: writing trial18843701-49 from 568103 to 1336872 tid 1 2026-02-13T20:12:40.513 INFO:tasks.rados.rados.0.trial188.stdout:274: writing trial18843701-49 from 2082530 to 2168103 tid 2 2026-02-13T20:12:40.513 INFO:tasks.rados.rados.0.trial188.stdout:275: read oid 48 snap 20 2026-02-13T20:12:40.513 INFO:tasks.rados.rados.0.trial188.stdout:275: expect (ObjNum 111 snap 19 seq_num 111) 2026-02-13T20:12:40.513 INFO:tasks.rados.rados.0.trial188.stdout:276: write oid 3 current snap is 22 2026-02-13T20:12:40.513 INFO:tasks.rados.rados.0.trial188.stdout:272: finishing write tid 2 to trial18843701-42 2026-02-13T20:12:40.513 INFO:tasks.rados.rados.0.trial188.stdout:272: finishing write tid 3 to trial18843701-42 2026-02-13T20:12:40.513 INFO:tasks.rados.rados.0.trial188.stdout:272: finishing write tid 4 to trial18843701-42 2026-02-13T20:12:40.513 INFO:tasks.rados.rados.0.trial188.stdout:272: oid 42 updating version 0 to 81 2026-02-13T20:12:40.513 INFO:tasks.rados.rados.0.trial188.stdout:272: oid 42 updating version 81 to 83 2026-02-13T20:12:40.514 INFO:tasks.rados.rados.0.trial188.stdout:272: oid 42 version 83 is already newer than 82 2026-02-13T20:12:40.514 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 42 v 83 (ObjNum 127 snap 22 seq_num 127) dirty exists 2026-02-13T20:12:40.514 INFO:tasks.rados.rados.0.trial188.stdout:272: left oid 42 (ObjNum 127 snap 22 seq_num 127) 2026-02-13T20:12:40.514 INFO:tasks.rados.rados.0.trial188.stdout:276: seq_num 130 ranges {584910=560371,1857365=327545} 2026-02-13T20:12:40.517 INFO:tasks.rados.rados.0.trial188.stdout:276: writing trial18843701-3 from 584910 to 1145281 tid 1 2026-02-13T20:12:40.521 INFO:tasks.rados.rados.0.trial188.stdout:276: writing trial18843701-3 from 1857365 to 2184910 tid 2 2026-02-13T20:12:40.521 INFO:tasks.rados.rados.0.trial188.stdout:272: done (3 left) 2026-02-13T20:12:40.521 INFO:tasks.rados.rados.0.trial188.stdout:277: snap_create 2026-02-13T20:12:40.521 INFO:tasks.rados.rados.0.trial188.stdout:275: expect (ObjNum 111 snap 19 seq_num 111) 2026-02-13T20:12:40.521 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:40.595 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:40.634 INFO:tasks.rados.rados.0.trial188.stdout:274: finishing write tid 1 to trial18843701-49 2026-02-13T20:12:40.634 INFO:tasks.rados.rados.0.trial188.stdout:274: finishing write tid 2 to trial18843701-49 2026-02-13T20:12:40.634 INFO:tasks.rados.rados.0.trial188.stdout:274: finishing write tid 3 to trial18843701-49 2026-02-13T20:12:40.634 INFO:tasks.rados.rados.0.trial188.stdout:274: finishing write tid 4 to trial18843701-49 2026-02-13T20:12:40.634 INFO:tasks.rados.rados.0.trial188.stdout:274: oid 49 updating version 0 to 82 2026-02-13T20:12:40.634 INFO:tasks.rados.rados.0.trial188.stdout:274: oid 49 updating version 82 to 83 2026-02-13T20:12:40.634 INFO:tasks.rados.rados.0.trial188.stdout:274: oid 49 updating version 83 to 84 2026-02-13T20:12:40.635 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 49 v 84 (ObjNum 129 snap 22 seq_num 129) dirty exists 2026-02-13T20:12:40.635 INFO:tasks.rados.rados.0.trial188.stdout:274: left oid 49 (ObjNum 129 snap 22 seq_num 129) 2026-02-13T20:12:40.635 INFO:tasks.rados.rados.0.trial188.stdout:276: finishing write tid 1 to trial18843701-3 2026-02-13T20:12:40.635 INFO:tasks.rados.rados.0.trial188.stdout:276: finishing write tid 2 to trial18843701-3 2026-02-13T20:12:40.635 INFO:tasks.rados.rados.0.trial188.stdout:276: finishing write tid 3 to trial18843701-3 2026-02-13T20:12:40.635 INFO:tasks.rados.rados.0.trial188.stdout:276: finishing write tid 4 to trial18843701-3 2026-02-13T20:12:40.635 INFO:tasks.rados.rados.0.trial188.stdout:276: oid 3 updating version 0 to 108 2026-02-13T20:12:40.635 INFO:tasks.rados.rados.0.trial188.stdout:276: oid 3 updating version 108 to 109 2026-02-13T20:12:40.635 INFO:tasks.rados.rados.0.trial188.stdout:276: oid 3 version 109 is already newer than 107 2026-02-13T20:12:40.635 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 3 v 109 (ObjNum 130 snap 22 seq_num 130) dirty exists 2026-02-13T20:12:40.635 INFO:tasks.rados.rados.0.trial188.stdout:276: left oid 3 (ObjNum 130 snap 22 seq_num 130) 2026-02-13T20:12:41.525 INFO:tasks.rados.rados.0.trial188.stdout:274: done (3 left) 2026-02-13T20:12:41.526 INFO:tasks.rados.rados.0.trial188.stdout:275: done (2 left) 2026-02-13T20:12:41.526 INFO:tasks.rados.rados.0.trial188.stdout:276: done (1 left) 2026-02-13T20:12:41.526 INFO:tasks.rados.rados.0.trial188.stdout:277: done (0 left) 2026-02-13T20:12:41.526 INFO:tasks.rados.rados.0.trial188.stdout:278: snap_remove snap 22 2026-02-13T20:12:42.528 INFO:tasks.rados.rados.0.trial188.stdout:278: done (0 left) 2026-02-13T20:12:42.529 INFO:tasks.rados.rados.0.trial188.stdout:279: rollback oid 26 current snap is 23 2026-02-13T20:12:42.529 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 26 to 20 2026-02-13T20:12:42.529 INFO:tasks.rados.rados.0.trial188.stdout:280: read oid 19 snap -1 2026-02-13T20:12:42.529 INFO:tasks.rados.rados.0.trial188.stdout:280: expect (ObjNum 97 snap 15 seq_num 97) 2026-02-13T20:12:42.529 INFO:tasks.rados.rados.0.trial188.stdout:281: copy_from oid 17 from oid 40 current snap is 23 2026-02-13T20:12:42.529 INFO:tasks.rados.rados.0.trial188.stdout:282: write (excl) oid 12 current snap is 23 2026-02-13T20:12:42.529 INFO:tasks.rados.rados.0.trial188.stdout:282: seq_num 131 ranges {601717=635620,1799494=402223} 2026-02-13T20:12:42.533 INFO:tasks.rados.rados.0.trial188.stdout:282: writing trial18843701-12 from 601717 to 1237337 tid 1 2026-02-13T20:12:42.537 INFO:tasks.rados.rados.0.trial188.stdout:282: writing trial18843701-12 from 1799494 to 2201717 tid 2 2026-02-13T20:12:42.537 INFO:tasks.rados.rados.0.trial188.stdout:283: rollback oid 11 current snap is 23 2026-02-13T20:12:42.537 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 11 to 20 2026-02-13T20:12:42.537 INFO:tasks.rados.rados.0.trial188.stdout:279: finishing rollback tid 0 to trial18843701-26 2026-02-13T20:12:42.537 INFO:tasks.rados.rados.0.trial188.stdout:279: finishing rollback tid 1 to trial18843701-26 2026-02-13T20:12:42.537 INFO:tasks.rados.rados.0.trial188.stdout:279: finishing rollback tid 2 to trial18843701-26 2026-02-13T20:12:42.537 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 26 v 113 (ObjNum 104 snap 18 seq_num 104) dirty exists 2026-02-13T20:12:42.537 INFO:tasks.rados.rados.0.trial188.stdout:280: expect (ObjNum 97 snap 15 seq_num 97) 2026-02-13T20:12:42.537 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:42.689 INFO:tasks.rados.rados.0.trial188.stdout:281: finishing copy_from racing read to trial18843701-17 2026-02-13T20:12:42.690 INFO:tasks.rados.rados.0.trial188.stdout:282: finishing write tid 1 to trial18843701-12 2026-02-13T20:12:42.690 INFO:tasks.rados.rados.0.trial188.stdout:282: finishing write tid 2 to trial18843701-12 2026-02-13T20:12:42.690 INFO:tasks.rados.rados.0.trial188.stdout:279: done (4 left) 2026-02-13T20:12:42.690 INFO:tasks.rados.rados.0.trial188.stdout:280: done (3 left) 2026-02-13T20:12:42.690 INFO:tasks.rados.rados.0.trial188.stdout:284: snap_remove snap 21 2026-02-13T20:12:43.533 INFO:tasks.rados.rados.0.trial188.stdout:284: done (3 left) 2026-02-13T20:12:43.533 INFO:tasks.rados.rados.0.trial188.stdout:285: read oid 13 snap 20 2026-02-13T20:12:43.533 INFO:tasks.rados.rados.0.trial188.stdout:285: expect (ObjNum 21 snap 0 seq_num 21) 2026-02-13T20:12:43.533 INFO:tasks.rados.rados.0.trial188.stdout:286: write (excl) oid 10 current snap is 23 2026-02-13T20:12:43.533 INFO:tasks.rados.rados.0.trial188.stdout:281: finishing copy_from to trial18843701-17 2026-02-13T20:12:43.533 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 17 v 6 (ObjNum 39 snap 0 seq_num 39) dirty exists 2026-02-13T20:12:43.533 INFO:tasks.rados.rados.0.trial188.stdout:283: finishing rollback tid 0 to trial18843701-11 2026-02-13T20:12:43.533 INFO:tasks.rados.rados.0.trial188.stdout:286: seq_num 132 ranges {618524=710869,1857976=360548} 2026-02-13T20:12:43.538 INFO:tasks.rados.rados.0.trial188.stdout:286: writing trial18843701-10 from 618524 to 1329393 tid 1 2026-02-13T20:12:43.541 INFO:tasks.rados.rados.0.trial188.stdout:286: writing trial18843701-10 from 1857976 to 2218524 tid 2 2026-02-13T20:12:43.541 INFO:tasks.rados.rados.0.trial188.stdout:281: done (4 left) 2026-02-13T20:12:43.542 INFO:tasks.rados.rados.0.trial188.stdout:287: rollback oid 6 current snap is 23 2026-02-13T20:12:43.542 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 6 to 20 2026-02-13T20:12:43.542 INFO:tasks.rados.rados.0.trial188.stdout:282: finishing write tid 3 to trial18843701-12 2026-02-13T20:12:43.542 INFO:tasks.rados.rados.0.trial188.stdout:282: finishing write tid 4 to trial18843701-12 2026-02-13T20:12:43.542 INFO:tasks.rados.rados.0.trial188.stdout:282: oid 12 updating version 0 to 51 2026-02-13T20:12:43.542 INFO:tasks.rados.rados.0.trial188.stdout:282: oid 12 version 51 is already newer than 50 2026-02-13T20:12:43.542 INFO:tasks.rados.rados.0.trial188.stdout:282: oid 12 updating version 51 to 54 2026-02-13T20:12:43.542 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 12 v 54 (ObjNum 131 snap 23 seq_num 131) dirty exists 2026-02-13T20:12:43.542 INFO:tasks.rados.rados.0.trial188.stdout:282: left oid 12 (ObjNum 131 snap 23 seq_num 131) 2026-02-13T20:12:43.542 INFO:tasks.rados.rados.0.trial188.stdout:283: finishing rollback tid 1 to trial18843701-11 2026-02-13T20:12:43.542 INFO:tasks.rados.rados.0.trial188.stdout:282: done (4 left) 2026-02-13T20:12:43.542 INFO:tasks.rados.rados.0.trial188.stdout:288: read oid 17 snap 20 2026-02-13T20:12:43.542 INFO:tasks.rados.rados.0.trial188.stdout:288: expect (ObjNum 53 snap 1 seq_num 53) 2026-02-13T20:12:43.542 INFO:tasks.rados.rados.0.trial188.stdout:289: delete oid 34 current snap is 23 2026-02-13T20:12:43.542 INFO:tasks.rados.rados.0.trial188.stdout:283: finishing rollback tid 2 to trial18843701-11 2026-02-13T20:12:43.542 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 11 v 84 (ObjNum 122 snap 20 seq_num 122) dirty exists 2026-02-13T20:12:43.542 INFO:tasks.rados.rados.0.trial188.stdout:285: expect (ObjNum 21 snap 0 seq_num 21) 2026-02-13T20:12:43.562 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 760339 2026-02-13T20:12:43.572 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:43.589 INFO:tasks.rados.rados.0.trial188.stdout:287: finishing rollback tid 0 to trial18843701-6 2026-02-13T20:12:43.589 INFO:tasks.rados.rados.0.trial188.stdout:286: finishing write tid 1 to trial18843701-10 2026-02-13T20:12:43.590 INFO:tasks.rados.rados.0.trial188.stdout:283: done (5 left) 2026-02-13T20:12:43.590 INFO:tasks.rados.rados.0.trial188.stdout:285: done (4 left) 2026-02-13T20:12:43.590 INFO:tasks.rados.rados.0.trial188.stdout:289: done (3 left) 2026-02-13T20:12:43.590 INFO:tasks.rados.rados.0.trial188.stdout:290: delete oid 5 current snap is 23 2026-02-13T20:12:43.590 INFO:tasks.rados.rados.0.trial188.stdout:287: finishing rollback tid 1 to trial18843701-6 2026-02-13T20:12:43.590 INFO:tasks.rados.rados.0.trial188.stdout:287: finishing rollback tid 2 to trial18843701-6 2026-02-13T20:12:43.590 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 6 v 121 (ObjNum 124 snap 20 seq_num 124) dirty exists 2026-02-13T20:12:43.590 INFO:tasks.rados.rados.0.trial188.stdout:286: finishing write tid 2 to trial18843701-10 2026-02-13T20:12:43.590 INFO:tasks.rados.rados.0.trial188.stdout:286: finishing write tid 3 to trial18843701-10 2026-02-13T20:12:43.590 INFO:tasks.rados.rados.0.trial188.stdout:288: expect (ObjNum 53 snap 1 seq_num 53) 2026-02-13T20:12:43.590 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:43.677 INFO:tasks.rados.rados.0.trial188.stdout:286: finishing write tid 4 to trial18843701-10 2026-02-13T20:12:43.678 INFO:tasks.rados.rados.0.trial188.stdout:286: oid 10 updating version 0 to 90 2026-02-13T20:12:43.678 INFO:tasks.rados.rados.0.trial188.stdout:286: oid 10 version 90 is already newer than 88 2026-02-13T20:12:43.678 INFO:tasks.rados.rados.0.trial188.stdout:286: oid 10 version 90 is already newer than 89 2026-02-13T20:12:43.678 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 10 v 90 (ObjNum 132 snap 23 seq_num 132) dirty exists 2026-02-13T20:12:43.678 INFO:tasks.rados.rados.0.trial188.stdout:286: left oid 10 (ObjNum 132 snap 23 seq_num 132) 2026-02-13T20:12:43.678 INFO:tasks.rados.rados.0.trial188.stdout:286: done (3 left) 2026-02-13T20:12:43.678 INFO:tasks.rados.rados.0.trial188.stdout:287: done (2 left) 2026-02-13T20:12:43.678 INFO:tasks.rados.rados.0.trial188.stdout:288: done (1 left) 2026-02-13T20:12:43.678 INFO:tasks.rados.rados.0.trial188.stdout:290: done (0 left) 2026-02-13T20:12:43.678 INFO:tasks.rados.rados.0.trial188.stdout:291: read oid 46 snap 20 2026-02-13T20:12:43.678 INFO:tasks.rados.rados.0.trial188.stdout:291: expect (ObjNum 45 snap 0 seq_num 45) 2026-02-13T20:12:43.678 INFO:tasks.rados.rados.0.trial188.stdout:292: write oid 1 current snap is 23 2026-02-13T20:12:43.678 INFO:tasks.rados.rados.0.trial188.stdout:292: seq_num 135 ranges {668945=536616,1633422=491363} 2026-02-13T20:12:43.681 INFO:tasks.rados.rados.0.trial188.stdout:292: writing trial18843701-1 from 668945 to 1205561 tid 1 2026-02-13T20:12:43.685 INFO:tasks.rados.rados.0.trial188.stdout:292: writing trial18843701-1 from 1633422 to 2124785 tid 2 2026-02-13T20:12:43.685 INFO:tasks.rados.rados.0.trial188.stdout:293: rollback oid 26 current snap is 23 2026-02-13T20:12:43.685 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 26 to 20 2026-02-13T20:12:43.685 INFO:tasks.rados.rados.0.trial188.stdout:291: expect (ObjNum 45 snap 0 seq_num 45) 2026-02-13T20:12:43.685 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:43.704 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:43.737 INFO:tasks.rados.rados.0.trial188.stdout:293: finishing rollback tid 0 to trial18843701-26 2026-02-13T20:12:43.737 INFO:tasks.rados.rados.0.trial188.stdout:293: finishing rollback tid 1 to trial18843701-26 2026-02-13T20:12:43.737 INFO:tasks.rados.rados.0.trial188.stdout:291: done (2 left) 2026-02-13T20:12:43.737 INFO:tasks.rados.rados.0.trial188.stdout:294: read oid 37 snap -1 2026-02-13T20:12:43.737 INFO:tasks.rados.rados.0.trial188.stdout:294: expect deleted 2026-02-13T20:12:43.737 INFO:tasks.rados.rados.0.trial188.stdout:295: read oid 12 snap -1 2026-02-13T20:12:43.737 INFO:tasks.rados.rados.0.trial188.stdout:295: expect (ObjNum 131 snap 23 seq_num 131) 2026-02-13T20:12:43.737 INFO:tasks.rados.rados.0.trial188.stdout:296: read oid 30 snap -1 2026-02-13T20:12:43.737 INFO:tasks.rados.rados.0.trial188.stdout:296: expect deleted 2026-02-13T20:12:43.737 INFO:tasks.rados.rados.0.trial188.stdout:297: write oid 27 current snap is 23 2026-02-13T20:12:43.737 INFO:tasks.rados.rados.0.trial188.stdout:293: finishing rollback tid 2 to trial18843701-26 2026-02-13T20:12:43.737 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 26 v 120 (ObjNum 104 snap 18 seq_num 104) dirty exists 2026-02-13T20:12:43.738 INFO:tasks.rados.rados.0.trial188.stdout:292: finishing write tid 1 to trial18843701-1 2026-02-13T20:12:43.738 INFO:tasks.rados.rados.0.trial188.stdout:292: finishing write tid 2 to trial18843701-1 2026-02-13T20:12:43.738 INFO:tasks.rados.rados.0.trial188.stdout:297: seq_num 136 ranges {685752=611865,1975551=310201} 2026-02-13T20:12:43.742 INFO:tasks.rados.rados.0.trial188.stdout:297: writing trial18843701-27 from 685752 to 1297617 tid 1 2026-02-13T20:12:43.746 INFO:tasks.rados.rados.0.trial188.stdout:297: writing trial18843701-27 from 1975551 to 2285752 tid 2 2026-02-13T20:12:43.746 INFO:tasks.rados.rados.0.trial188.stdout:293: done (5 left) 2026-02-13T20:12:43.746 INFO:tasks.rados.rados.0.trial188.stdout:298: delete oid 35 current snap is 23 2026-02-13T20:12:43.746 INFO:tasks.rados.rados.0.trial188.stdout:292: finishing write tid 3 to trial18843701-1 2026-02-13T20:12:43.746 INFO:tasks.rados.rados.0.trial188.stdout:292: finishing write tid 4 to trial18843701-1 2026-02-13T20:12:43.746 INFO:tasks.rados.rados.0.trial188.stdout:292: oid 1 updating version 0 to 107 2026-02-13T20:12:43.746 INFO:tasks.rados.rados.0.trial188.stdout:292: oid 1 updating version 107 to 108 2026-02-13T20:12:43.746 INFO:tasks.rados.rados.0.trial188.stdout:292: oid 1 version 108 is already newer than 106 2026-02-13T20:12:43.746 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 1 v 108 (ObjNum 135 snap 23 seq_num 135) dirty exists 2026-02-13T20:12:43.746 INFO:tasks.rados.rados.0.trial188.stdout:292: left oid 1 (ObjNum 135 snap 23 seq_num 135) 2026-02-13T20:12:43.746 INFO:tasks.rados.rados.0.trial188.stdout:295: expect (ObjNum 131 snap 23 seq_num 131) 2026-02-13T20:12:43.746 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:43.767 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:43.806 INFO:tasks.rados.rados.0.trial188.stdout:297: finishing write tid 1 to trial18843701-27 2026-02-13T20:12:43.806 INFO:tasks.rados.rados.0.trial188.stdout:297: finishing write tid 2 to trial18843701-27 2026-02-13T20:12:43.807 INFO:tasks.rados.rados.0.trial188.stdout:292: done (5 left) 2026-02-13T20:12:43.807 INFO:tasks.rados.rados.0.trial188.stdout:294: done (4 left) 2026-02-13T20:12:43.807 INFO:tasks.rados.rados.0.trial188.stdout:295: done (3 left) 2026-02-13T20:12:43.807 INFO:tasks.rados.rados.0.trial188.stdout:296: done (2 left) 2026-02-13T20:12:43.807 INFO:tasks.rados.rados.0.trial188.stdout:298: done (1 left) 2026-02-13T20:12:43.807 INFO:tasks.rados.rados.0.trial188.stdout:299: write oid 25 current snap is 23 2026-02-13T20:12:43.807 INFO:tasks.rados.rados.0.trial188.stdout:297: finishing write tid 3 to trial18843701-27 2026-02-13T20:12:43.807 INFO:tasks.rados.rados.0.trial188.stdout:297: finishing write tid 4 to trial18843701-27 2026-02-13T20:12:43.807 INFO:tasks.rados.rados.0.trial188.stdout:297: oid 27 updating version 0 to 90 2026-02-13T20:12:43.807 INFO:tasks.rados.rados.0.trial188.stdout:297: oid 27 version 90 is already newer than 88 2026-02-13T20:12:43.807 INFO:tasks.rados.rados.0.trial188.stdout:297: oid 27 version 90 is already newer than 89 2026-02-13T20:12:43.807 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 27 v 90 (ObjNum 136 snap 23 seq_num 136) dirty exists 2026-02-13T20:12:43.807 INFO:tasks.rados.rados.0.trial188.stdout:297: left oid 27 (ObjNum 136 snap 23 seq_num 136) 2026-02-13T20:12:43.807 INFO:tasks.rados.rados.0.trial188.stdout:299: seq_num 138 ranges {719366=478716,1808868=510498} 2026-02-13T20:12:43.811 INFO:tasks.rados.rados.0.trial188.stdout:299: writing trial18843701-25 from 719366 to 1198082 tid 1 2026-02-13T20:12:43.815 INFO:tasks.rados.rados.0.trial188.stdout:299: writing trial18843701-25 from 1808868 to 2319366 tid 2 2026-02-13T20:12:43.815 INFO:tasks.rados.rados.0.trial188.stdout:297: done (1 left) 2026-02-13T20:12:43.815 INFO:tasks.rados.rados.0.trial188.stdout:300: rollback oid 5 current snap is 23 2026-02-13T20:12:43.816 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 5 to 20 2026-02-13T20:12:43.816 INFO:tasks.rados.rados.0.trial188.stdout:301: write oid 18 current snap is 23 2026-02-13T20:12:43.816 INFO:tasks.rados.rados.0.trial188.stdout:301: seq_num 139 ranges {736173=553965,1867350=468823} 2026-02-13T20:12:43.820 INFO:tasks.rados.rados.0.trial188.stdout:301: writing trial18843701-18 from 736173 to 1290138 tid 1 2026-02-13T20:12:43.825 INFO:tasks.rados.rados.0.trial188.stdout:301: writing trial18843701-18 from 1867350 to 2336173 tid 2 2026-02-13T20:12:43.825 INFO:tasks.rados.rados.0.trial188.stdout:302: write (excl) oid 4 current snap is 23 2026-02-13T20:12:43.825 INFO:tasks.rados.rados.0.trial188.stdout:300: finishing rollback tid 1 to trial18843701-5 2026-02-13T20:12:43.825 INFO:tasks.rados.rados.0.trial188.stdout:302: seq_num 140 ranges {752980=629214,1809479=543501} 2026-02-13T20:12:43.830 INFO:tasks.rados.rados.0.trial188.stdout:302: writing trial18843701-4 from 752980 to 1382194 tid 1 2026-02-13T20:12:43.834 INFO:tasks.rados.rados.0.trial188.stdout:302: writing trial18843701-4 from 1809479 to 2352980 tid 2 2026-02-13T20:12:43.834 INFO:tasks.rados.rados.0.trial188.stdout:303: rollback oid 38 current snap is 23 2026-02-13T20:12:43.834 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 38 to 20 2026-02-13T20:12:43.834 INFO:tasks.rados.rados.0.trial188.stdout:300: finishing rollback tid 2 to trial18843701-5 2026-02-13T20:12:43.834 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 5 v 110 (ObjNum 93 snap 13 seq_num 93) dirty exists 2026-02-13T20:12:43.834 INFO:tasks.rados.rados.0.trial188.stdout:299: finishing write tid 1 to trial18843701-25 2026-02-13T20:12:43.834 INFO:tasks.rados.rados.0.trial188.stdout:299: finishing write tid 2 to trial18843701-25 2026-02-13T20:12:43.834 INFO:tasks.rados.rados.0.trial188.stdout:299: finishing write tid 3 to trial18843701-25 2026-02-13T20:12:43.834 INFO:tasks.rados.rados.0.trial188.stdout:299: finishing write tid 4 to trial18843701-25 2026-02-13T20:12:43.834 INFO:tasks.rados.rados.0.trial188.stdout:299: oid 25 updating version 0 to 93 2026-02-13T20:12:43.834 INFO:tasks.rados.rados.0.trial188.stdout:299: oid 25 version 93 is already newer than 92 2026-02-13T20:12:43.834 INFO:tasks.rados.rados.0.trial188.stdout:299: oid 25 updating version 93 to 94 2026-02-13T20:12:43.834 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 25 v 94 (ObjNum 138 snap 23 seq_num 138) dirty exists 2026-02-13T20:12:43.834 INFO:tasks.rados.rados.0.trial188.stdout:299: left oid 25 (ObjNum 138 snap 23 seq_num 138) 2026-02-13T20:12:43.834 INFO:tasks.rados.rados.0.trial188.stdout:299: done (4 left) 2026-02-13T20:12:43.834 INFO:tasks.rados.rados.0.trial188.stdout:300: done (3 left) 2026-02-13T20:12:43.834 INFO:tasks.rados.rados.0.trial188.stdout:304: read oid 1 snap 20 2026-02-13T20:12:43.834 INFO:tasks.rados.rados.0.trial188.stdout:304: expect (ObjNum 77 snap 9 seq_num 77) 2026-02-13T20:12:43.834 INFO:tasks.rados.rados.0.trial188.stdout:305: copy_from oid 45 from oid 36 current snap is 23 2026-02-13T20:12:43.834 INFO:tasks.rados.rados.0.trial188.stdout:306: delete oid 16 current snap is 23 2026-02-13T20:12:43.835 INFO:tasks.rados.rados.0.trial188.stdout:305: finishing copy_from to trial18843701-45 2026-02-13T20:12:43.835 INFO:tasks.rados.rados.0.trial188.stdout:305: got expected ENOENT (src dne) 2026-02-13T20:12:43.835 INFO:tasks.rados.rados.0.trial188.stdout:305: finishing copy_from racing read to trial18843701-45 2026-02-13T20:12:43.835 INFO:tasks.rados.rados.0.trial188.stdout:303: finishing rollback tid 0 to trial18843701-38 2026-02-13T20:12:43.835 INFO:tasks.rados.rados.0.trial188.stdout:303: finishing rollback tid 1 to trial18843701-38 2026-02-13T20:12:43.835 INFO:tasks.rados.rados.0.trial188.stdout:303: finishing rollback tid 2 to trial18843701-38 2026-02-13T20:12:43.835 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 38 v 98 (ObjNum 37 snap 0 seq_num 37) dirty exists 2026-02-13T20:12:43.836 INFO:tasks.rados.rados.0.trial188.stdout:301: finishing write tid 1 to trial18843701-18 2026-02-13T20:12:43.837 INFO:tasks.rados.rados.0.trial188.stdout:304: expect (ObjNum 77 snap 9 seq_num 77) 2026-02-13T20:12:43.837 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:43.920 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2856992 2026-02-13T20:12:43.929 INFO:tasks.rados.rados.0.trial188.stdout:301: finishing write tid 2 to trial18843701-18 2026-02-13T20:12:43.929 INFO:tasks.rados.rados.0.trial188.stdout:301: finishing write tid 3 to trial18843701-18 2026-02-13T20:12:43.929 INFO:tasks.rados.rados.0.trial188.stdout:301: finishing write tid 4 to trial18843701-18 2026-02-13T20:12:43.929 INFO:tasks.rados.rados.0.trial188.stdout:301: oid 18 updating version 0 to 60 2026-02-13T20:12:43.929 INFO:tasks.rados.rados.0.trial188.stdout:301: oid 18 updating version 60 to 62 2026-02-13T20:12:43.929 INFO:tasks.rados.rados.0.trial188.stdout:301: oid 18 version 62 is already newer than 61 2026-02-13T20:12:43.929 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 18 v 62 (ObjNum 139 snap 23 seq_num 139) dirty exists 2026-02-13T20:12:43.929 INFO:tasks.rados.rados.0.trial188.stdout:301: left oid 18 (ObjNum 139 snap 23 seq_num 139) 2026-02-13T20:12:43.929 INFO:tasks.rados.rados.0.trial188.stdout:302: finishing write tid 1 to trial18843701-4 2026-02-13T20:12:43.929 INFO:tasks.rados.rados.0.trial188.stdout:302: finishing write tid 2 to trial18843701-4 2026-02-13T20:12:43.929 INFO:tasks.rados.rados.0.trial188.stdout:301: done (5 left) 2026-02-13T20:12:43.929 INFO:tasks.rados.rados.0.trial188.stdout:303: done (4 left) 2026-02-13T20:12:43.929 INFO:tasks.rados.rados.0.trial188.stdout:304: done (3 left) 2026-02-13T20:12:43.929 INFO:tasks.rados.rados.0.trial188.stdout:305: done (2 left) 2026-02-13T20:12:43.929 INFO:tasks.rados.rados.0.trial188.stdout:306: done (1 left) 2026-02-13T20:12:43.929 INFO:tasks.rados.rados.0.trial188.stdout:307: read oid 13 snap 20 2026-02-13T20:12:43.929 INFO:tasks.rados.rados.0.trial188.stdout:307: expect (ObjNum 21 snap 0 seq_num 21) 2026-02-13T20:12:43.929 INFO:tasks.rados.rados.0.trial188.stdout:308: read oid 8 snap 20 2026-02-13T20:12:43.929 INFO:tasks.rados.rados.0.trial188.stdout:308: expect (ObjNum 82 snap 9 seq_num 82) 2026-02-13T20:12:43.929 INFO:tasks.rados.rados.0.trial188.stdout:309: write oid 44 current snap is 23 2026-02-13T20:12:43.929 INFO:tasks.rados.rados.0.trial188.stdout:302: finishing write tid 3 to trial18843701-4 2026-02-13T20:12:43.929 INFO:tasks.rados.rados.0.trial188.stdout:302: finishing write tid 4 to trial18843701-4 2026-02-13T20:12:43.929 INFO:tasks.rados.rados.0.trial188.stdout:302: oid 4 updating version 0 to 92 2026-02-13T20:12:43.929 INFO:tasks.rados.rados.0.trial188.stdout:302: oid 4 updating version 92 to 93 2026-02-13T20:12:43.930 INFO:tasks.rados.rados.0.trial188.stdout:302: oid 4 updating version 93 to 94 2026-02-13T20:12:43.930 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 4 v 94 (ObjNum 140 snap 23 seq_num 140) dirty exists 2026-02-13T20:12:43.930 INFO:tasks.rados.rados.0.trial188.stdout:302: left oid 4 (ObjNum 140 snap 23 seq_num 140) 2026-02-13T20:12:43.930 INFO:tasks.rados.rados.0.trial188.stdout:309: seq_num 142 ranges {786594=779712,2326443=60151} 2026-02-13T20:12:43.934 INFO:tasks.rados.rados.0.trial188.stdout:309: writing trial18843701-44 from 786594 to 1566306 tid 1 2026-02-13T20:12:43.937 INFO:tasks.rados.rados.0.trial188.stdout:309: writing trial18843701-44 from 2326443 to 2386594 tid 2 2026-02-13T20:12:43.937 INFO:tasks.rados.rados.0.trial188.stdout:302: done (3 left) 2026-02-13T20:12:43.937 INFO:tasks.rados.rados.0.trial188.stdout:310: delete oid 11 current snap is 23 2026-02-13T20:12:43.938 INFO:tasks.rados.rados.0.trial188.stdout:308: expect (ObjNum 82 snap 9 seq_num 82) 2026-02-13T20:12:44.007 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1786418 2026-02-13T20:12:44.028 INFO:tasks.rados.rados.0.trial188.stdout:307: expect (ObjNum 21 snap 0 seq_num 21) 2026-02-13T20:12:44.028 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 578355 2026-02-13T20:12:44.046 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 962830 2026-02-13T20:12:44.055 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 47037 2026-02-13T20:12:44.072 INFO:tasks.rados.rados.0.trial188.stdout:309: finishing write tid 1 to trial18843701-44 2026-02-13T20:12:44.072 INFO:tasks.rados.rados.0.trial188.stdout:309: finishing write tid 2 to trial18843701-44 2026-02-13T20:12:44.073 INFO:tasks.rados.rados.0.trial188.stdout:307: done (3 left) 2026-02-13T20:12:44.073 INFO:tasks.rados.rados.0.trial188.stdout:308: done (2 left) 2026-02-13T20:12:44.073 INFO:tasks.rados.rados.0.trial188.stdout:310: done (1 left) 2026-02-13T20:12:44.073 INFO:tasks.rados.rados.0.trial188.stdout:311: snap_create 2026-02-13T20:12:44.073 INFO:tasks.rados.rados.0.trial188.stdout:309: finishing write tid 3 to trial18843701-44 2026-02-13T20:12:44.073 INFO:tasks.rados.rados.0.trial188.stdout:309: finishing write tid 4 to trial18843701-44 2026-02-13T20:12:44.073 INFO:tasks.rados.rados.0.trial188.stdout:309: oid 44 updating version 0 to 114 2026-02-13T20:12:44.073 INFO:tasks.rados.rados.0.trial188.stdout:309: oid 44 version 114 is already newer than 113 2026-02-13T20:12:44.073 INFO:tasks.rados.rados.0.trial188.stdout:309: oid 44 version 114 is already newer than 112 2026-02-13T20:12:44.073 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 44 v 114 (ObjNum 142 snap 23 seq_num 142) dirty exists 2026-02-13T20:12:44.073 INFO:tasks.rados.rados.0.trial188.stdout:309: left oid 44 (ObjNum 142 snap 23 seq_num 142) 2026-02-13T20:12:44.538 INFO:tasks.rados.rados.0.trial188.stdout:309: done (1 left) 2026-02-13T20:12:44.538 INFO:tasks.rados.rados.0.trial188.stdout:311: done (0 left) 2026-02-13T20:12:44.538 INFO:tasks.rados.rados.0.trial188.stdout:312: read oid 48 snap -1 2026-02-13T20:12:44.538 INFO:tasks.rados.rados.0.trial188.stdout:312: expect (ObjNum 111 snap 19 seq_num 111) 2026-02-13T20:12:44.538 INFO:tasks.rados.rados.0.trial188.stdout:313: snap_create 2026-02-13T20:12:44.540 INFO:tasks.rados.rados.0.trial188.stdout:312: expect (ObjNum 111 snap 19 seq_num 111) 2026-02-13T20:12:44.564 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 3366082 2026-02-13T20:12:44.624 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2221064 2026-02-13T20:12:45.485 INFO:tasks.rados.rados.0.trial188.stdout:312: done (1 left) 2026-02-13T20:12:45.485 INFO:tasks.rados.rados.0.trial188.stdout:313: done (0 left) 2026-02-13T20:12:45.485 INFO:tasks.rados.rados.0.trial188.stdout:314: read oid 11 snap 20 2026-02-13T20:12:45.485 INFO:tasks.rados.rados.0.trial188.stdout:314: expect (ObjNum 122 snap 20 seq_num 122) 2026-02-13T20:12:45.485 INFO:tasks.rados.rados.0.trial188.stdout:315: copy_from oid 15 from oid 17 current snap is 25 2026-02-13T20:12:45.485 INFO:tasks.rados.rados.0.trial188.stdout:316: read oid 5 snap -1 2026-02-13T20:12:45.485 INFO:tasks.rados.rados.0.trial188.stdout:316: expect (ObjNum 93 snap 13 seq_num 93) 2026-02-13T20:12:45.486 INFO:tasks.rados.rados.0.trial188.stdout:317: snap_remove snap 24 2026-02-13T20:12:46.485 INFO:tasks.rados.rados.0.trial188.stdout:317: done (3 left) 2026-02-13T20:12:46.485 INFO:tasks.rados.rados.0.trial188.stdout:318: rollback oid 34 current snap is 25 2026-02-13T20:12:46.485 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 34 to 20 2026-02-13T20:12:46.485 INFO:tasks.rados.rados.0.trial188.stdout:314: expect (ObjNum 122 snap 20 seq_num 122) 2026-02-13T20:12:46.486 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:46.506 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 687640 2026-02-13T20:12:46.519 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:46.537 INFO:tasks.rados.rados.0.trial188.stdout:316: expect (ObjNum 93 snap 13 seq_num 93) 2026-02-13T20:12:46.600 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2645101 2026-02-13T20:12:46.661 INFO:tasks.rados.rados.0.trial188.stdout:315: finishing copy_from racing read to trial18843701-15 2026-02-13T20:12:46.662 INFO:tasks.rados.rados.0.trial188.stdout:315: finishing copy_from to trial18843701-15 2026-02-13T20:12:46.662 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 15 v 6 (ObjNum 39 snap 0 seq_num 39) dirty exists 2026-02-13T20:12:46.662 INFO:tasks.rados.rados.0.trial188.stdout:318: finishing rollback tid 1 to trial18843701-34 2026-02-13T20:12:46.662 INFO:tasks.rados.rados.0.trial188.stdout:318: finishing rollback tid 2 to trial18843701-34 2026-02-13T20:12:46.662 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 34 v 91 (ObjNum 120 snap 20 seq_num 120) dirty exists 2026-02-13T20:12:46.662 INFO:tasks.rados.rados.0.trial188.stdout:314: done (3 left) 2026-02-13T20:12:46.662 INFO:tasks.rados.rados.0.trial188.stdout:315: done (2 left) 2026-02-13T20:12:46.662 INFO:tasks.rados.rados.0.trial188.stdout:316: done (1 left) 2026-02-13T20:12:46.662 INFO:tasks.rados.rados.0.trial188.stdout:318: done (0 left) 2026-02-13T20:12:46.663 INFO:tasks.rados.rados.0.trial188.stdout:319: snap_create 2026-02-13T20:12:47.539 INFO:tasks.rados.rados.0.trial188.stdout:319: done (0 left) 2026-02-13T20:12:47.540 INFO:tasks.rados.rados.0.trial188.stdout:320: snap_create 2026-02-13T20:12:48.540 INFO:tasks.rados.rados.0.trial188.stdout:320: done (0 left) 2026-02-13T20:12:48.540 INFO:tasks.rados.rados.0.trial188.stdout:321: write (excl) oid 23 current snap is 27 2026-02-13T20:12:48.540 INFO:tasks.rados.rados.0.trial188.stdout:321: seq_num 144 ranges {420208=530210,1527054=766050} 2026-02-13T20:12:48.544 INFO:tasks.rados.rados.0.trial188.stdout:321: writing trial18843701-23 from 420208 to 950418 tid 1 2026-02-13T20:12:48.550 INFO:tasks.rados.rados.0.trial188.stdout:321: writing trial18843701-23 from 1527054 to 2293104 tid 2 2026-02-13T20:12:48.550 INFO:tasks.rados.rados.0.trial188.stdout:322: read oid 7 snap 23 2026-02-13T20:12:48.550 INFO:tasks.rados.rados.0.trial188.stdout:322: expect deleted 2026-02-13T20:12:48.550 INFO:tasks.rados.rados.0.trial188.stdout:323: read oid 5 snap -1 2026-02-13T20:12:48.550 INFO:tasks.rados.rados.0.trial188.stdout:323: expect (ObjNum 93 snap 13 seq_num 93) 2026-02-13T20:12:48.550 INFO:tasks.rados.rados.0.trial188.stdout:324: read oid 3 snap -1 2026-02-13T20:12:48.550 INFO:tasks.rados.rados.0.trial188.stdout:324: expect (ObjNum 130 snap 22 seq_num 130) 2026-02-13T20:12:48.550 INFO:tasks.rados.rados.0.trial188.stdout:325: read oid 37 snap -1 2026-02-13T20:12:48.550 INFO:tasks.rados.rados.0.trial188.stdout:325: expect deleted 2026-02-13T20:12:48.550 INFO:tasks.rados.rados.0.trial188.stdout:326: write oid 20 current snap is 27 2026-02-13T20:12:48.550 INFO:tasks.rados.rados.0.trial188.stdout:326: seq_num 145 ranges {437015=721812,1701889=509708} 2026-02-13T20:12:48.554 INFO:tasks.rados.rados.0.trial188.stdout:326: writing trial18843701-20 from 437015 to 1158827 tid 1 2026-02-13T20:12:48.558 INFO:tasks.rados.rados.0.trial188.stdout:326: writing trial18843701-20 from 1701889 to 2211597 tid 2 2026-02-13T20:12:48.558 INFO:tasks.rados.rados.0.trial188.stdout:327: snap_remove snap 20 2026-02-13T20:12:49.544 INFO:tasks.rados.rados.0.trial188.stdout:327: done (6 left) 2026-02-13T20:12:49.544 INFO:tasks.rados.rados.0.trial188.stdout:328: write (excl) oid 16 current snap is 27 2026-02-13T20:12:49.545 INFO:tasks.rados.rados.0.trial188.stdout:328: seq_num 146 ranges {453822=797061,1760371=653366} 2026-02-13T20:12:49.549 INFO:tasks.rados.rados.0.trial188.stdout:328: writing trial18843701-16 from 453822 to 1250883 tid 1 2026-02-13T20:12:49.553 INFO:tasks.rados.rados.0.trial188.stdout:328: writing trial18843701-16 from 1760371 to 2413737 tid 2 2026-02-13T20:12:49.553 INFO:tasks.rados.rados.0.trial188.stdout:329: write (excl) oid 25 current snap is 27 2026-02-13T20:12:49.553 INFO:tasks.rados.rados.0.trial188.stdout:329: seq_num 147 ranges {470629=472310,1418853=513377} 2026-02-13T20:12:49.556 INFO:tasks.rados.rados.0.trial188.stdout:329: writing trial18843701-25 from 470629 to 942939 tid 1 2026-02-13T20:12:49.560 INFO:tasks.rados.rados.0.trial188.stdout:329: writing trial18843701-25 from 1418853 to 1932230 tid 2 2026-02-13T20:12:49.560 INFO:tasks.rados.rados.0.trial188.stdout:330: copy_from oid 21 from oid 15 current snap is 27 2026-02-13T20:12:49.561 INFO:tasks.rados.rados.0.trial188.stdout:323: expect (ObjNum 93 snap 13 seq_num 93) 2026-02-13T20:12:49.607 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:49.652 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:49.697 INFO:tasks.rados.rados.0.trial188.stdout:321: finishing write tid 1 to trial18843701-23 2026-02-13T20:12:49.697 INFO:tasks.rados.rados.0.trial188.stdout:321: finishing write tid 2 to trial18843701-23 2026-02-13T20:12:49.697 INFO:tasks.rados.rados.0.trial188.stdout:321: finishing write tid 3 to trial18843701-23 2026-02-13T20:12:49.697 INFO:tasks.rados.rados.0.trial188.stdout:322: done (8 left) 2026-02-13T20:12:49.697 INFO:tasks.rados.rados.0.trial188.stdout:323: done (7 left) 2026-02-13T20:12:49.697 INFO:tasks.rados.rados.0.trial188.stdout:325: done (6 left) 2026-02-13T20:12:49.697 INFO:tasks.rados.rados.0.trial188.stdout:331: copy_from oid 2 from oid 4 current snap is 27 2026-02-13T20:12:49.697 INFO:tasks.rados.rados.0.trial188.stdout:324: expect (ObjNum 130 snap 22 seq_num 130) 2026-02-13T20:12:49.697 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:49.717 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:49.749 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2036819 2026-02-13T20:12:49.750 INFO:tasks.rados.rados.0.trial188.stdout:321: finishing write tid 4 to trial18843701-23 2026-02-13T20:12:49.750 INFO:tasks.rados.rados.0.trial188.stdout:321: oid 23 updating version 0 to 124 2026-02-13T20:12:49.750 INFO:tasks.rados.rados.0.trial188.stdout:321: oid 23 updating version 124 to 125 2026-02-13T20:12:49.750 INFO:tasks.rados.rados.0.trial188.stdout:321: oid 23 updating version 125 to 126 2026-02-13T20:12:49.750 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 23 v 126 (ObjNum 144 snap 27 seq_num 144) dirty exists 2026-02-13T20:12:49.750 INFO:tasks.rados.rados.0.trial188.stdout:321: left oid 23 (ObjNum 144 snap 27 seq_num 144) 2026-02-13T20:12:49.750 INFO:tasks.rados.rados.0.trial188.stdout:326: finishing write tid 1 to trial18843701-20 2026-02-13T20:12:49.750 INFO:tasks.rados.rados.0.trial188.stdout:321: done (6 left) 2026-02-13T20:12:49.750 INFO:tasks.rados.rados.0.trial188.stdout:324: done (5 left) 2026-02-13T20:12:49.750 INFO:tasks.rados.rados.0.trial188.stdout:332: snap_remove snap 26 2026-02-13T20:12:50.486 INFO:tasks.rados.rados.0.trial188.stdout:332: done (5 left) 2026-02-13T20:12:50.486 INFO:tasks.rados.rados.0.trial188.stdout:333: snap_create 2026-02-13T20:12:50.486 INFO:tasks.rados.rados.0.trial188.stdout:326: finishing write tid 2 to trial18843701-20 2026-02-13T20:12:50.486 INFO:tasks.rados.rados.0.trial188.stdout:326: finishing write tid 3 to trial18843701-20 2026-02-13T20:12:50.486 INFO:tasks.rados.rados.0.trial188.stdout:326: finishing write tid 4 to trial18843701-20 2026-02-13T20:12:50.486 INFO:tasks.rados.rados.0.trial188.stdout:326: oid 20 updating version 0 to 24 2026-02-13T20:12:50.486 INFO:tasks.rados.rados.0.trial188.stdout:326: oid 20 version 24 is already newer than 23 2026-02-13T20:12:50.486 INFO:tasks.rados.rados.0.trial188.stdout:326: oid 20 version 24 is already newer than 22 2026-02-13T20:12:50.486 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 20 v 24 (ObjNum 145 snap 27 seq_num 145) dirty exists 2026-02-13T20:12:50.487 INFO:tasks.rados.rados.0.trial188.stdout:326: left oid 20 (ObjNum 145 snap 27 seq_num 145) 2026-02-13T20:12:50.487 INFO:tasks.rados.rados.0.trial188.stdout:329: finishing write tid 1 to trial18843701-25 2026-02-13T20:12:50.487 INFO:tasks.rados.rados.0.trial188.stdout:329: finishing write tid 2 to trial18843701-25 2026-02-13T20:12:50.487 INFO:tasks.rados.rados.0.trial188.stdout:329: finishing write tid 3 to trial18843701-25 2026-02-13T20:12:50.487 INFO:tasks.rados.rados.0.trial188.stdout:329: finishing write tid 4 to trial18843701-25 2026-02-13T20:12:50.487 INFO:tasks.rados.rados.0.trial188.stdout:329: oid 25 updating version 0 to 109 2026-02-13T20:12:50.487 INFO:tasks.rados.rados.0.trial188.stdout:329: oid 25 updating version 109 to 110 2026-02-13T20:12:50.487 INFO:tasks.rados.rados.0.trial188.stdout:329: oid 25 version 110 is already newer than 108 2026-02-13T20:12:50.487 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 25 v 110 (ObjNum 147 snap 27 seq_num 147) dirty exists 2026-02-13T20:12:50.487 INFO:tasks.rados.rados.0.trial188.stdout:329: left oid 25 (ObjNum 147 snap 27 seq_num 147) 2026-02-13T20:12:50.487 INFO:tasks.rados.rados.0.trial188.stdout:328: finishing write tid 1 to trial18843701-16 2026-02-13T20:12:50.487 INFO:tasks.rados.rados.0.trial188.stdout:328: finishing write tid 2 to trial18843701-16 2026-02-13T20:12:50.487 INFO:tasks.rados.rados.0.trial188.stdout:328: finishing write tid 3 to trial18843701-16 2026-02-13T20:12:50.487 INFO:tasks.rados.rados.0.trial188.stdout:328: finishing write tid 4 to trial18843701-16 2026-02-13T20:12:50.487 INFO:tasks.rados.rados.0.trial188.stdout:328: oid 16 updating version 0 to 132 2026-02-13T20:12:50.487 INFO:tasks.rados.rados.0.trial188.stdout:328: oid 16 version 132 is already newer than 131 2026-02-13T20:12:50.487 INFO:tasks.rados.rados.0.trial188.stdout:328: oid 16 updating version 132 to 133 2026-02-13T20:12:50.487 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 16 v 133 (ObjNum 146 snap 27 seq_num 146) dirty exists 2026-02-13T20:12:50.487 INFO:tasks.rados.rados.0.trial188.stdout:328: left oid 16 (ObjNum 146 snap 27 seq_num 146) 2026-02-13T20:12:50.487 INFO:tasks.rados.rados.0.trial188.stdout:330: finishing copy_from racing read to trial18843701-21 2026-02-13T20:12:50.487 INFO:tasks.rados.rados.0.trial188.stdout:330: finishing copy_from to trial18843701-21 2026-02-13T20:12:50.487 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 21 v 6 (ObjNum 39 snap 0 seq_num 39) dirty exists 2026-02-13T20:12:50.487 INFO:tasks.rados.rados.0.trial188.stdout:331: finishing copy_from racing read to trial18843701-2 2026-02-13T20:12:50.487 INFO:tasks.rados.rados.0.trial188.stdout:331: finishing copy_from to trial18843701-2 2026-02-13T20:12:50.487 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 2 v 94 (ObjNum 140 snap 23 seq_num 140) dirty exists 2026-02-13T20:12:51.489 INFO:tasks.rados.rados.0.trial188.stdout:326: done (5 left) 2026-02-13T20:12:51.489 INFO:tasks.rados.rados.0.trial188.stdout:328: done (4 left) 2026-02-13T20:12:51.489 INFO:tasks.rados.rados.0.trial188.stdout:329: done (3 left) 2026-02-13T20:12:51.490 INFO:tasks.rados.rados.0.trial188.stdout:330: done (2 left) 2026-02-13T20:12:51.490 INFO:tasks.rados.rados.0.trial188.stdout:331: done (1 left) 2026-02-13T20:12:51.490 INFO:tasks.rados.rados.0.trial188.stdout:333: done (0 left) 2026-02-13T20:12:51.490 INFO:tasks.rados.rados.0.trial188.stdout:334: copy_from oid 28 from oid 17 current snap is 28 2026-02-13T20:12:51.490 INFO:tasks.rados.rados.0.trial188.stdout:335: copy_from oid 29 from oid 15 current snap is 28 2026-02-13T20:12:51.490 INFO:tasks.rados.rados.0.trial188.stdout:336: delete oid 16 current snap is 28 2026-02-13T20:12:51.492 INFO:tasks.rados.rados.0.trial188.stdout:336: done (2 left) 2026-02-13T20:12:51.492 INFO:tasks.rados.rados.0.trial188.stdout:337: rollback oid 19 current snap is 28 2026-02-13T20:12:51.492 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 19 to 25 2026-02-13T20:12:51.492 INFO:tasks.rados.rados.0.trial188.stdout:338: read oid 18 snap -1 2026-02-13T20:12:51.492 INFO:tasks.rados.rados.0.trial188.stdout:338: expect (ObjNum 139 snap 23 seq_num 139) 2026-02-13T20:12:51.492 INFO:tasks.rados.rados.0.trial188.stdout:339: snap_remove snap 23 2026-02-13T20:12:52.490 INFO:tasks.rados.rados.0.trial188.stdout:339: done (4 left) 2026-02-13T20:12:52.490 INFO:tasks.rados.rados.0.trial188.stdout:340: snap_create 2026-02-13T20:12:52.490 INFO:tasks.rados.rados.0.trial188.stdout:334: finishing copy_from racing read to trial18843701-28 2026-02-13T20:12:52.490 INFO:tasks.rados.rados.0.trial188.stdout:335: finishing copy_from racing read to trial18843701-29 2026-02-13T20:12:52.490 INFO:tasks.rados.rados.0.trial188.stdout:337: finishing rollback tid 0 to trial18843701-19 2026-02-13T20:12:52.490 INFO:tasks.rados.rados.0.trial188.stdout:337: finishing rollback tid 1 to trial18843701-19 2026-02-13T20:12:52.490 INFO:tasks.rados.rados.0.trial188.stdout:334: finishing copy_from to trial18843701-28 2026-02-13T20:12:52.490 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 28 v 6 (ObjNum 39 snap 0 seq_num 39) dirty exists 2026-02-13T20:12:52.490 INFO:tasks.rados.rados.0.trial188.stdout:338: expect (ObjNum 139 snap 23 seq_num 139) 2026-02-13T20:12:52.490 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 282174 2026-02-13T20:12:52.521 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1199339 2026-02-13T20:12:52.556 INFO:tasks.rados.rados.0.trial188.stdout:335: finishing copy_from to trial18843701-29 2026-02-13T20:12:52.556 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 29 v 6 (ObjNum 39 snap 0 seq_num 39) dirty exists 2026-02-13T20:12:52.556 INFO:tasks.rados.rados.0.trial188.stdout:337: finishing rollback tid 2 to trial18843701-19 2026-02-13T20:12:52.556 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 19 v 99 (ObjNum 97 snap 15 seq_num 97) dirty exists 2026-02-13T20:12:53.491 INFO:tasks.rados.rados.0.trial188.stdout:334: done (4 left) 2026-02-13T20:12:53.491 INFO:tasks.rados.rados.0.trial188.stdout:335: done (3 left) 2026-02-13T20:12:53.492 INFO:tasks.rados.rados.0.trial188.stdout:337: done (2 left) 2026-02-13T20:12:53.492 INFO:tasks.rados.rados.0.trial188.stdout:338: done (1 left) 2026-02-13T20:12:53.492 INFO:tasks.rados.rados.0.trial188.stdout:340: done (0 left) 2026-02-13T20:12:53.492 INFO:tasks.rados.rados.0.trial188.stdout:341: delete oid 17 current snap is 29 2026-02-13T20:12:53.493 INFO:tasks.rados.rados.0.trial188.stdout:341: done (0 left) 2026-02-13T20:12:53.493 INFO:tasks.rados.rados.0.trial188.stdout:342: write (excl) oid 17 current snap is 29 2026-02-13T20:12:53.493 INFO:tasks.rados.rados.0.trial188.stdout:342: seq_num 150 ranges {521050=698057,1877946=643104} 2026-02-13T20:12:53.498 INFO:tasks.rados.rados.0.trial188.stdout:342: writing trial18843701-17 from 521050 to 1219107 tid 1 2026-02-13T20:12:53.503 INFO:tasks.rados.rados.0.trial188.stdout:342: writing trial18843701-17 from 1877946 to 2521050 tid 2 2026-02-13T20:12:53.503 INFO:tasks.rados.rados.0.trial188.stdout:343: read oid 45 snap -1 2026-02-13T20:12:53.503 INFO:tasks.rados.rados.0.trial188.stdout:343: expect (ObjNum 117 snap 20 seq_num 117) 2026-02-13T20:12:53.503 INFO:tasks.rados.rados.0.trial188.stdout:344: read oid 47 snap 25 2026-02-13T20:12:53.503 INFO:tasks.rados.rados.0.trial188.stdout:344: expect (ObjNum 44 snap 0 seq_num 44) 2026-02-13T20:12:53.503 INFO:tasks.rados.rados.0.trial188.stdout:345: delete oid 27 current snap is 29 2026-02-13T20:12:53.508 INFO:tasks.rados.rados.0.trial188.stdout:343: expect (ObjNum 117 snap 20 seq_num 117) 2026-02-13T20:12:53.552 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1327480 2026-02-13T20:12:53.582 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:53.624 INFO:tasks.rados.rados.0.trial188.stdout:344: expect (ObjNum 44 snap 0 seq_num 44) 2026-02-13T20:12:53.625 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:53.666 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2619791 2026-02-13T20:12:53.671 INFO:tasks.rados.rados.0.trial188.stdout:342: finishing write tid 1 to trial18843701-17 2026-02-13T20:12:53.671 INFO:tasks.rados.rados.0.trial188.stdout:343: done (3 left) 2026-02-13T20:12:53.671 INFO:tasks.rados.rados.0.trial188.stdout:344: done (2 left) 2026-02-13T20:12:53.671 INFO:tasks.rados.rados.0.trial188.stdout:345: done (1 left) 2026-02-13T20:12:53.671 INFO:tasks.rados.rados.0.trial188.stdout:346: read oid 49 snap 28 2026-02-13T20:12:53.671 INFO:tasks.rados.rados.0.trial188.stdout:346: expect (ObjNum 129 snap 22 seq_num 129) 2026-02-13T20:12:53.671 INFO:tasks.rados.rados.0.trial188.stdout:347: copy_from oid 11 from oid 10 current snap is 29 2026-02-13T20:12:53.671 INFO:tasks.rados.rados.0.trial188.stdout:342: finishing write tid 2 to trial18843701-17 2026-02-13T20:12:53.671 INFO:tasks.rados.rados.0.trial188.stdout:342: finishing write tid 3 to trial18843701-17 2026-02-13T20:12:53.671 INFO:tasks.rados.rados.0.trial188.stdout:342: finishing write tid 4 to trial18843701-17 2026-02-13T20:12:53.672 INFO:tasks.rados.rados.0.trial188.stdout:342: oid 17 updating version 0 to 71 2026-02-13T20:12:53.672 INFO:tasks.rados.rados.0.trial188.stdout:342: oid 17 updating version 71 to 72 2026-02-13T20:12:53.672 INFO:tasks.rados.rados.0.trial188.stdout:342: oid 17 updating version 72 to 73 2026-02-13T20:12:53.672 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 17 v 73 (ObjNum 150 snap 29 seq_num 150) dirty exists 2026-02-13T20:12:53.672 INFO:tasks.rados.rados.0.trial188.stdout:342: left oid 17 (ObjNum 150 snap 29 seq_num 150) 2026-02-13T20:12:53.672 INFO:tasks.rados.rados.0.trial188.stdout:342: done (2 left) 2026-02-13T20:12:53.672 INFO:tasks.rados.rados.0.trial188.stdout:348: copy_from oid 30 from oid 36 current snap is 29 2026-02-13T20:12:53.672 INFO:tasks.rados.rados.0.trial188.stdout:349: snap_remove snap 25 2026-02-13T20:12:54.496 INFO:tasks.rados.rados.0.trial188.stdout:349: done (3 left) 2026-02-13T20:12:54.496 INFO:tasks.rados.rados.0.trial188.stdout:350: rollback oid 17 current snap is 29 2026-02-13T20:12:54.496 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 17 to 27 2026-02-13T20:12:54.496 INFO:tasks.rados.rados.0.trial188.stdout:346: expect (ObjNum 129 snap 22 seq_num 129) 2026-02-13T20:12:54.536 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:54.559 INFO:tasks.rados.rados.0.trial188.stdout:348: finishing copy_from to trial18843701-30 2026-02-13T20:12:54.559 INFO:tasks.rados.rados.0.trial188.stdout:348: got expected ENOENT (src dne) 2026-02-13T20:12:54.559 INFO:tasks.rados.rados.0.trial188.stdout:348: finishing copy_from racing read to trial18843701-30 2026-02-13T20:12:54.559 INFO:tasks.rados.rados.0.trial188.stdout:347: finishing copy_from racing read to trial18843701-11 2026-02-13T20:12:54.559 INFO:tasks.rados.rados.0.trial188.stdout:346: done (3 left) 2026-02-13T20:12:54.559 INFO:tasks.rados.rados.0.trial188.stdout:348: done (2 left) 2026-02-13T20:12:54.560 INFO:tasks.rados.rados.0.trial188.stdout:351: rollback oid 16 current snap is 29 2026-02-13T20:12:54.560 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 16 to 28 2026-02-13T20:12:54.560 INFO:tasks.rados.rados.0.trial188.stdout:347: finishing copy_from to trial18843701-11 2026-02-13T20:12:54.560 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 11 v 90 (ObjNum 132 snap 23 seq_num 132) dirty exists 2026-02-13T20:12:54.560 INFO:tasks.rados.rados.0.trial188.stdout:350: finishing rollback tid 0 to trial18843701-17 2026-02-13T20:12:54.560 INFO:tasks.rados.rados.0.trial188.stdout:350: finishing rollback tid 1 to trial18843701-17 2026-02-13T20:12:54.560 INFO:tasks.rados.rados.0.trial188.stdout:350: finishing rollback tid 2 to trial18843701-17 2026-02-13T20:12:54.560 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 17 v 76 (ObjNum 39 snap 0 seq_num 39) dirty exists 2026-02-13T20:12:54.560 INFO:tasks.rados.rados.0.trial188.stdout:347: done (2 left) 2026-02-13T20:12:54.560 INFO:tasks.rados.rados.0.trial188.stdout:350: done (1 left) 2026-02-13T20:12:54.560 INFO:tasks.rados.rados.0.trial188.stdout:352: read oid 28 snap -1 2026-02-13T20:12:54.561 INFO:tasks.rados.rados.0.trial188.stdout:352: expect (ObjNum 39 snap 0 seq_num 39) 2026-02-13T20:12:54.561 INFO:tasks.rados.rados.0.trial188.stdout:353: delete oid 8 current snap is 29 2026-02-13T20:12:54.561 INFO:tasks.rados.rados.0.trial188.stdout:351: finishing rollback tid 1 to trial18843701-16 2026-02-13T20:12:54.561 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 16 v 137 (ObjNum 529 snap 0 seq_num 4129271552) dirty dne 2026-02-13T20:12:54.566 INFO:tasks.rados.rados.0.trial188.stdout:352: expect (ObjNum 39 snap 0 seq_num 39) 2026-02-13T20:12:54.570 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 892613 2026-02-13T20:12:54.616 INFO:tasks.rados.rados.0.trial188.stdout:351: done (2 left) 2026-02-13T20:12:54.616 INFO:tasks.rados.rados.0.trial188.stdout:352: done (1 left) 2026-02-13T20:12:54.616 INFO:tasks.rados.rados.0.trial188.stdout:353: done (0 left) 2026-02-13T20:12:54.616 INFO:tasks.rados.rados.0.trial188.stdout:354: delete oid 26 current snap is 29 2026-02-13T20:12:54.617 INFO:tasks.rados.rados.0.trial188.stdout:354: done (0 left) 2026-02-13T20:12:54.617 INFO:tasks.rados.rados.0.trial188.stdout:355: delete oid 38 current snap is 29 2026-02-13T20:12:54.618 INFO:tasks.rados.rados.0.trial188.stdout:355: done (0 left) 2026-02-13T20:12:54.618 INFO:tasks.rados.rados.0.trial188.stdout:356: delete oid 45 current snap is 29 2026-02-13T20:12:54.619 INFO:tasks.rados.rados.0.trial188.stdout:356: done (0 left) 2026-02-13T20:12:54.619 INFO:tasks.rados.rados.0.trial188.stdout:357: delete oid 20 current snap is 29 2026-02-13T20:12:54.620 INFO:tasks.rados.rados.0.trial188.stdout:357: done (0 left) 2026-02-13T20:12:54.620 INFO:tasks.rados.rados.0.trial188.stdout:358: read oid 42 snap -1 2026-02-13T20:12:54.620 INFO:tasks.rados.rados.0.trial188.stdout:358: expect (ObjNum 127 snap 22 seq_num 127) 2026-02-13T20:12:54.620 INFO:tasks.rados.rados.0.trial188.stdout:359: delete oid 27 current snap is 29 2026-02-13T20:12:54.622 INFO:tasks.rados.rados.0.trial188.stdout:358: expect (ObjNum 127 snap 22 seq_num 127) 2026-02-13T20:12:54.630 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2043161 2026-02-13T20:12:54.659 INFO:tasks.rados.rados.0.trial188.stdout:358: done (1 left) 2026-02-13T20:12:54.660 INFO:tasks.rados.rados.0.trial188.stdout:359: done (0 left) 2026-02-13T20:12:54.660 INFO:tasks.rados.rados.0.trial188.stdout:360: snap_create 2026-02-13T20:12:55.485 INFO:tasks.rados.rados.0.trial188.stdout:360: done (0 left) 2026-02-13T20:12:55.486 INFO:tasks.rados.rados.0.trial188.stdout:361: snap_create 2026-02-13T20:12:56.486 INFO:tasks.rados.rados.0.trial188.stdout:361: done (0 left) 2026-02-13T20:12:56.487 INFO:tasks.rados.rados.0.trial188.stdout:362: snap_remove snap 29 2026-02-13T20:12:57.486 INFO:tasks.rados.rados.0.trial188.stdout:362: done (0 left) 2026-02-13T20:12:57.487 INFO:tasks.rados.rados.0.trial188.stdout:363: delete oid 12 current snap is 31 2026-02-13T20:12:57.489 INFO:tasks.rados.rados.0.trial188.stdout:363: done (0 left) 2026-02-13T20:12:57.490 INFO:tasks.rados.rados.0.trial188.stdout:364: read oid 46 snap 27 2026-02-13T20:12:57.490 INFO:tasks.rados.rados.0.trial188.stdout:364: expect (ObjNum 45 snap 0 seq_num 45) 2026-02-13T20:12:57.490 INFO:tasks.rados.rados.0.trial188.stdout:365: copy_from oid 42 from oid 19 current snap is 31 2026-02-13T20:12:57.490 INFO:tasks.rados.rados.0.trial188.stdout:366: snap_create 2026-02-13T20:12:57.492 INFO:tasks.rados.rados.0.trial188.stdout:364: expect (ObjNum 45 snap 0 seq_num 45) 2026-02-13T20:12:57.511 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 583304 2026-02-13T20:12:57.529 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1547761 2026-02-13T20:12:57.540 INFO:tasks.rados.rados.0.trial188.stdout:365: finishing copy_from racing read to trial18843701-42 2026-02-13T20:12:57.540 INFO:tasks.rados.rados.0.trial188.stdout:365: finishing copy_from to trial18843701-42 2026-02-13T20:12:57.540 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 42 v 99 (ObjNum 97 snap 15 seq_num 97) dirty exists 2026-02-13T20:12:58.493 INFO:tasks.rados.rados.0.trial188.stdout:364: done (2 left) 2026-02-13T20:12:58.493 INFO:tasks.rados.rados.0.trial188.stdout:365: done (1 left) 2026-02-13T20:12:58.493 INFO:tasks.rados.rados.0.trial188.stdout:366: done (0 left) 2026-02-13T20:12:58.493 INFO:tasks.rados.rados.0.trial188.stdout:367: read oid 49 snap 30 2026-02-13T20:12:58.494 INFO:tasks.rados.rados.0.trial188.stdout:367: expect (ObjNum 129 snap 22 seq_num 129) 2026-02-13T20:12:58.494 INFO:tasks.rados.rados.0.trial188.stdout:368: copy_from oid 13 from oid 35 current snap is 32 2026-02-13T20:12:58.494 INFO:tasks.rados.rados.0.trial188.stdout:369: copy_from oid 14 from oid 23 current snap is 32 2026-02-13T20:12:58.494 INFO:tasks.rados.rados.0.trial188.stdout:370: read oid 34 snap -1 2026-02-13T20:12:58.494 INFO:tasks.rados.rados.0.trial188.stdout:370: expect (ObjNum 120 snap 20 seq_num 120) 2026-02-13T20:12:58.494 INFO:tasks.rados.rados.0.trial188.stdout:371: delete oid 16 current snap is 32 2026-02-13T20:12:58.495 INFO:tasks.rados.rados.0.trial188.stdout:368: finishing copy_from to trial18843701-13 2026-02-13T20:12:58.495 INFO:tasks.rados.rados.0.trial188.stdout:368: got expected ENOENT (src dne) 2026-02-13T20:12:58.495 INFO:tasks.rados.rados.0.trial188.stdout:368: finishing copy_from racing read to trial18843701-13 2026-02-13T20:12:58.495 INFO:tasks.rados.rados.0.trial188.stdout:367: expect (ObjNum 129 snap 22 seq_num 129) 2026-02-13T20:12:58.518 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 776568 2026-02-13T20:12:58.554 INFO:tasks.rados.rados.0.trial188.stdout:370: expect (ObjNum 120 snap 20 seq_num 120) 2026-02-13T20:12:58.579 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:12:58.593 INFO:tasks.rados.rados.0.trial188.stdout:369: finishing copy_from racing read to trial18843701-14 2026-02-13T20:12:58.593 INFO:tasks.rados.rados.0.trial188.stdout:369: finishing copy_from to trial18843701-14 2026-02-13T20:12:58.593 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 14 v 126 (ObjNum 144 snap 27 seq_num 144) dirty exists 2026-02-13T20:12:58.594 INFO:tasks.rados.rados.0.trial188.stdout:367: done (4 left) 2026-02-13T20:12:58.594 INFO:tasks.rados.rados.0.trial188.stdout:368: done (3 left) 2026-02-13T20:12:58.594 INFO:tasks.rados.rados.0.trial188.stdout:369: done (2 left) 2026-02-13T20:12:58.594 INFO:tasks.rados.rados.0.trial188.stdout:370: done (1 left) 2026-02-13T20:12:58.594 INFO:tasks.rados.rados.0.trial188.stdout:371: done (0 left) 2026-02-13T20:12:58.594 INFO:tasks.rados.rados.0.trial188.stdout:372: write oid 1 current snap is 32 2026-02-13T20:12:58.594 INFO:tasks.rados.rados.0.trial188.stdout:372: seq_num 160 ranges {689120=483253,1946413=679049} 2026-02-13T20:12:58.597 INFO:tasks.rados.rados.0.trial188.stdout:372: writing trial18843701-1 from 689120 to 1172373 tid 1 2026-02-13T20:12:58.603 INFO:tasks.rados.rados.0.trial188.stdout:372: writing trial18843701-1 from 1946413 to 2625462 tid 2 2026-02-13T20:12:58.603 INFO:tasks.rados.rados.0.trial188.stdout:373: write (excl) oid 4 current snap is 32 2026-02-13T20:12:58.603 INFO:tasks.rados.rados.0.trial188.stdout:373: seq_num 161 ranges {705927=558502,2004895=422707} 2026-02-13T20:12:58.607 INFO:tasks.rados.rados.0.trial188.stdout:373: writing trial18843701-4 from 705927 to 1264429 tid 1 2026-02-13T20:12:58.612 INFO:tasks.rados.rados.0.trial188.stdout:373: writing trial18843701-4 from 2004895 to 2427602 tid 2 2026-02-13T20:12:58.612 INFO:tasks.rados.rados.0.trial188.stdout:374: read oid 39 snap -1 2026-02-13T20:12:58.612 INFO:tasks.rados.rados.0.trial188.stdout:374: expect (ObjNum 112 snap 19 seq_num 112) 2026-02-13T20:12:58.613 INFO:tasks.rados.rados.0.trial188.stdout:375: rollback oid 10 current snap is 32 2026-02-13T20:12:58.613 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 10 to 27 2026-02-13T20:12:58.613 INFO:tasks.rados.rados.0.trial188.stdout:376: read oid 29 snap -1 2026-02-13T20:12:58.613 INFO:tasks.rados.rados.0.trial188.stdout:376: expect (ObjNum 39 snap 0 seq_num 39) 2026-02-13T20:12:58.613 INFO:tasks.rados.rados.0.trial188.stdout:377: write oid 30 current snap is 32 2026-02-13T20:12:58.613 INFO:tasks.rados.rados.0.trial188.stdout:377: seq_num 162 ranges {722734=633751,2063377=659357} 2026-02-13T20:12:58.617 INFO:tasks.rados.rados.0.trial188.stdout:377: writing trial18843701-30 from 722734 to 1356485 tid 1 2026-02-13T20:12:58.623 INFO:tasks.rados.rados.0.trial188.stdout:377: writing trial18843701-30 from 2063377 to 2722734 tid 2 2026-02-13T20:12:58.623 INFO:tasks.rados.rados.0.trial188.stdout:378: delete oid 12 current snap is 32 2026-02-13T20:12:58.623 INFO:tasks.rados.rados.0.trial188.stdout:372: finishing write tid 1 to trial18843701-1 2026-02-13T20:12:58.623 INFO:tasks.rados.rados.0.trial188.stdout:372: finishing write tid 2 to trial18843701-1 2026-02-13T20:12:58.623 INFO:tasks.rados.rados.0.trial188.stdout:372: finishing write tid 3 to trial18843701-1 2026-02-13T20:12:58.623 INFO:tasks.rados.rados.0.trial188.stdout:372: finishing write tid 4 to trial18843701-1 2026-02-13T20:12:58.623 INFO:tasks.rados.rados.0.trial188.stdout:372: oid 1 updating version 0 to 132 2026-02-13T20:12:58.623 INFO:tasks.rados.rados.0.trial188.stdout:372: oid 1 version 132 is already newer than 130 2026-02-13T20:12:58.623 INFO:tasks.rados.rados.0.trial188.stdout:372: oid 1 version 132 is already newer than 131 2026-02-13T20:12:58.623 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 1 v 132 (ObjNum 160 snap 32 seq_num 160) dirty exists 2026-02-13T20:12:58.623 INFO:tasks.rados.rados.0.trial188.stdout:372: left oid 1 (ObjNum 160 snap 32 seq_num 160) 2026-02-13T20:12:58.624 INFO:tasks.rados.rados.0.trial188.stdout:373: finishing write tid 1 to trial18843701-4 2026-02-13T20:12:58.625 INFO:tasks.rados.rados.0.trial188.stdout:374: expect (ObjNum 112 snap 19 seq_num 112) 2026-02-13T20:12:58.658 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 3675764 2026-02-13T20:12:58.669 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2235274 2026-02-13T20:12:58.683 INFO:tasks.rados.rados.0.trial188.stdout:376: expect (ObjNum 39 snap 0 seq_num 39) 2026-02-13T20:12:58.705 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 857177 2026-02-13T20:12:58.725 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2262768 2026-02-13T20:12:58.728 INFO:tasks.rados.rados.0.trial188.stdout:373: finishing write tid 2 to trial18843701-4 2026-02-13T20:12:58.728 INFO:tasks.rados.rados.0.trial188.stdout:377: finishing write tid 1 to trial18843701-30 2026-02-13T20:12:58.729 INFO:tasks.rados.rados.0.trial188.stdout:377: finishing write tid 2 to trial18843701-30 2026-02-13T20:12:58.729 INFO:tasks.rados.rados.0.trial188.stdout:373: finishing write tid 3 to trial18843701-4 2026-02-13T20:12:58.729 INFO:tasks.rados.rados.0.trial188.stdout:373: finishing write tid 4 to trial18843701-4 2026-02-13T20:12:58.729 INFO:tasks.rados.rados.0.trial188.stdout:373: oid 4 updating version 0 to 104 2026-02-13T20:12:58.729 INFO:tasks.rados.rados.0.trial188.stdout:373: oid 4 updating version 104 to 106 2026-02-13T20:12:58.729 INFO:tasks.rados.rados.0.trial188.stdout:373: oid 4 version 106 is already newer than 105 2026-02-13T20:12:58.729 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 4 v 106 (ObjNum 161 snap 32 seq_num 161) dirty exists 2026-02-13T20:12:58.729 INFO:tasks.rados.rados.0.trial188.stdout:373: left oid 4 (ObjNum 161 snap 32 seq_num 161) 2026-02-13T20:12:58.729 INFO:tasks.rados.rados.0.trial188.stdout:377: finishing write tid 3 to trial18843701-30 2026-02-13T20:12:58.730 INFO:tasks.rados.rados.0.trial188.stdout:375: finishing rollback tid 0 to trial18843701-10 2026-02-13T20:12:58.730 INFO:tasks.rados.rados.0.trial188.stdout:377: finishing write tid 4 to trial18843701-30 2026-02-13T20:12:58.730 INFO:tasks.rados.rados.0.trial188.stdout:377: oid 30 updating version 0 to 124 2026-02-13T20:12:58.730 INFO:tasks.rados.rados.0.trial188.stdout:377: oid 30 updating version 124 to 126 2026-02-13T20:12:58.730 INFO:tasks.rados.rados.0.trial188.stdout:377: oid 30 version 126 is already newer than 125 2026-02-13T20:12:58.730 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 30 v 126 (ObjNum 162 snap 32 seq_num 162) dirty exists 2026-02-13T20:12:58.730 INFO:tasks.rados.rados.0.trial188.stdout:377: left oid 30 (ObjNum 162 snap 32 seq_num 162) 2026-02-13T20:12:58.730 INFO:tasks.rados.rados.0.trial188.stdout:375: finishing rollback tid 1 to trial18843701-10 2026-02-13T20:12:58.730 INFO:tasks.rados.rados.0.trial188.stdout:375: finishing rollback tid 2 to trial18843701-10 2026-02-13T20:12:58.730 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 10 v 110 (ObjNum 132 snap 23 seq_num 132) dirty exists 2026-02-13T20:12:58.731 INFO:tasks.rados.rados.0.trial188.stdout:372: done (6 left) 2026-02-13T20:12:58.731 INFO:tasks.rados.rados.0.trial188.stdout:373: done (5 left) 2026-02-13T20:12:58.731 INFO:tasks.rados.rados.0.trial188.stdout:374: done (4 left) 2026-02-13T20:12:58.731 INFO:tasks.rados.rados.0.trial188.stdout:375: done (3 left) 2026-02-13T20:12:58.731 INFO:tasks.rados.rados.0.trial188.stdout:376: done (2 left) 2026-02-13T20:12:58.731 INFO:tasks.rados.rados.0.trial188.stdout:377: done (1 left) 2026-02-13T20:12:58.731 INFO:tasks.rados.rados.0.trial188.stdout:378: done (0 left) 2026-02-13T20:12:58.731 INFO:tasks.rados.rados.0.trial188.stdout:379: snap_remove snap 27 2026-02-13T20:12:59.496 INFO:tasks.rados.rados.0.trial188.stdout:379: done (0 left) 2026-02-13T20:12:59.497 INFO:tasks.rados.rados.0.trial188.stdout:380: copy_from oid 47 from oid 34 current snap is 32 2026-02-13T20:12:59.497 INFO:tasks.rados.rados.0.trial188.stdout:381: snap_create 2026-02-13T20:12:59.517 INFO:tasks.rados.rados.0.trial188.stdout:380: finishing copy_from racing read to trial18843701-47 2026-02-13T20:12:59.518 INFO:tasks.rados.rados.0.trial188.stdout:380: finishing copy_from to trial18843701-47 2026-02-13T20:12:59.518 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 47 v 91 (ObjNum 120 snap 20 seq_num 120) dirty exists 2026-02-13T20:13:00.486 INFO:tasks.rados.rados.0.trial188.stdout:380: done (1 left) 2026-02-13T20:13:00.486 INFO:tasks.rados.rados.0.trial188.stdout:381: done (0 left) 2026-02-13T20:13:00.486 INFO:tasks.rados.rados.0.trial188.stdout:382: snap_create 2026-02-13T20:13:01.489 INFO:tasks.rados.rados.0.trial188.stdout:382: done (0 left) 2026-02-13T20:13:01.489 INFO:tasks.rados.rados.0.trial188.stdout:383: delete oid 49 current snap is 34 2026-02-13T20:13:01.491 INFO:tasks.rados.rados.0.trial188.stdout:383: done (0 left) 2026-02-13T20:13:01.491 INFO:tasks.rados.rados.0.trial188.stdout:384: read oid 22 snap -1 2026-02-13T20:13:01.492 INFO:tasks.rados.rados.0.trial188.stdout:384: expect (ObjNum 75 snap 7 seq_num 75) 2026-02-13T20:13:01.492 INFO:tasks.rados.rados.0.trial188.stdout:385: delete oid 41 current snap is 34 2026-02-13T20:13:01.494 INFO:tasks.rados.rados.0.trial188.stdout:384: expect (ObjNum 75 snap 7 seq_num 75) 2026-02-13T20:13:01.494 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:13:01.583 INFO:tasks.rados.rados.0.trial188.stdout:384: done (1 left) 2026-02-13T20:13:01.583 INFO:tasks.rados.rados.0.trial188.stdout:385: done (0 left) 2026-02-13T20:13:01.583 INFO:tasks.rados.rados.0.trial188.stdout:386: write (excl) oid 48 current snap is 34 2026-02-13T20:13:01.583 INFO:tasks.rados.rados.0.trial188.stdout:386: seq_num 166 ranges {789962=534747,1780952=690056} 2026-02-13T20:13:01.588 INFO:tasks.rados.rados.0.trial188.stdout:386: writing trial18843701-48 from 789962 to 1324709 tid 1 2026-02-13T20:13:01.592 INFO:tasks.rados.rados.0.trial188.stdout:386: writing trial18843701-48 from 1780952 to 2471008 tid 2 2026-02-13T20:13:01.592 INFO:tasks.rados.rados.0.trial188.stdout:387: read oid 23 snap -1 2026-02-13T20:13:01.593 INFO:tasks.rados.rados.0.trial188.stdout:387: expect (ObjNum 144 snap 27 seq_num 144) 2026-02-13T20:13:01.593 INFO:tasks.rados.rados.0.trial188.stdout:388: snap_remove snap 33 2026-02-13T20:13:02.501 INFO:tasks.rados.rados.0.trial188.stdout:388: done (2 left) 2026-02-13T20:13:02.501 INFO:tasks.rados.rados.0.trial188.stdout:389: copy_from oid 27 from oid 37 current snap is 34 2026-02-13T20:13:02.501 INFO:tasks.rados.rados.0.trial188.stdout:387: expect (ObjNum 144 snap 27 seq_num 144) 2026-02-13T20:13:02.517 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2001389 2026-02-13T20:13:02.580 INFO:tasks.rados.rados.0.trial188.stdout:386: finishing write tid 1 to trial18843701-48 2026-02-13T20:13:02.580 INFO:tasks.rados.rados.0.trial188.stdout:386: finishing write tid 2 to trial18843701-48 2026-02-13T20:13:02.580 INFO:tasks.rados.rados.0.trial188.stdout:386: finishing write tid 3 to trial18843701-48 2026-02-13T20:13:02.581 INFO:tasks.rados.rados.0.trial188.stdout:386: finishing write tid 4 to trial18843701-48 2026-02-13T20:13:02.581 INFO:tasks.rados.rados.0.trial188.stdout:386: oid 48 updating version 0 to 36 2026-02-13T20:13:02.581 INFO:tasks.rados.rados.0.trial188.stdout:386: oid 48 updating version 36 to 38 2026-02-13T20:13:02.581 INFO:tasks.rados.rados.0.trial188.stdout:386: oid 48 version 38 is already newer than 37 2026-02-13T20:13:02.581 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 48 v 38 (ObjNum 166 snap 34 seq_num 166) dirty exists 2026-02-13T20:13:02.581 INFO:tasks.rados.rados.0.trial188.stdout:386: left oid 48 (ObjNum 166 snap 34 seq_num 166) 2026-02-13T20:13:02.581 INFO:tasks.rados.rados.0.trial188.stdout:389: finishing copy_from to trial18843701-27 2026-02-13T20:13:02.581 INFO:tasks.rados.rados.0.trial188.stdout:389: got expected ENOENT (src dne) 2026-02-13T20:13:02.581 INFO:tasks.rados.rados.0.trial188.stdout:386: done (2 left) 2026-02-13T20:13:02.581 INFO:tasks.rados.rados.0.trial188.stdout:387: done (1 left) 2026-02-13T20:13:02.581 INFO:tasks.rados.rados.0.trial188.stdout:390: snap_create 2026-02-13T20:13:02.581 INFO:tasks.rados.rados.0.trial188.stdout:389: finishing copy_from racing read to trial18843701-27 2026-02-13T20:13:03.503 INFO:tasks.rados.rados.0.trial188.stdout:389: done (1 left) 2026-02-13T20:13:03.503 INFO:tasks.rados.rados.0.trial188.stdout:390: done (0 left) 2026-02-13T20:13:03.503 INFO:tasks.rados.rados.0.trial188.stdout:391: write (excl) oid 41 current snap is 35 2026-02-13T20:13:03.503 INFO:tasks.rados.rados.0.trial188.stdout:391: seq_num 167 ranges {406769=609996,1439434=433714,2303522=503247} 2026-02-13T20:13:03.507 INFO:tasks.rados.rados.0.trial188.stdout:391: writing trial18843701-41 from 406769 to 1016765 tid 1 2026-02-13T20:13:03.511 INFO:tasks.rados.rados.0.trial188.stdout:391: writing trial18843701-41 from 1439434 to 1873148 tid 2 2026-02-13T20:13:03.515 INFO:tasks.rados.rados.0.trial188.stdout:391: writing trial18843701-41 from 2303522 to 2806769 tid 3 2026-02-13T20:13:03.515 INFO:tasks.rados.rados.0.trial188.stdout:392: read oid 28 snap -1 2026-02-13T20:13:03.515 INFO:tasks.rados.rados.0.trial188.stdout:392: expect (ObjNum 39 snap 0 seq_num 39) 2026-02-13T20:13:03.515 INFO:tasks.rados.rados.0.trial188.stdout:393: delete oid 6 current snap is 35 2026-02-13T20:13:03.516 INFO:tasks.rados.rados.0.trial188.stdout:393: done (2 left) 2026-02-13T20:13:03.516 INFO:tasks.rados.rados.0.trial188.stdout:394: write oid 24 current snap is 35 2026-02-13T20:13:03.517 INFO:tasks.rados.rados.0.trial188.stdout:394: seq_num 169 ranges {440383=476847,1556398=437383,2474721=365662} 2026-02-13T20:13:03.520 INFO:tasks.rados.rados.0.trial188.stdout:394: writing trial18843701-24 from 440383 to 917230 tid 1 2026-02-13T20:13:03.524 INFO:tasks.rados.rados.0.trial188.stdout:394: writing trial18843701-24 from 1556398 to 1993781 tid 2 2026-02-13T20:13:03.527 INFO:tasks.rados.rados.0.trial188.stdout:394: writing trial18843701-24 from 2474721 to 2840383 tid 3 2026-02-13T20:13:03.528 INFO:tasks.rados.rados.0.trial188.stdout:395: write (excl) oid 25 current snap is 35 2026-02-13T20:13:03.528 INFO:tasks.rados.rados.0.trial188.stdout:395: seq_num 170 ranges {457190=552096,1614880=581041,2785791=71399} 2026-02-13T20:13:03.531 INFO:tasks.rados.rados.0.trial188.stdout:395: writing trial18843701-25 from 457190 to 1009286 tid 1 2026-02-13T20:13:03.536 INFO:tasks.rados.rados.0.trial188.stdout:395: writing trial18843701-25 from 1614880 to 2195921 tid 2 2026-02-13T20:13:03.538 INFO:tasks.rados.rados.0.trial188.stdout:395: writing trial18843701-25 from 2785791 to 2857190 tid 3 2026-02-13T20:13:03.539 INFO:tasks.rados.rados.0.trial188.stdout:396: read oid 5 snap -1 2026-02-13T20:13:03.539 INFO:tasks.rados.rados.0.trial188.stdout:396: expect (ObjNum 93 snap 13 seq_num 93) 2026-02-13T20:13:03.539 INFO:tasks.rados.rados.0.trial188.stdout:397: write oid 44 current snap is 35 2026-02-13T20:13:03.539 INFO:tasks.rados.rados.0.trial188.stdout:397: seq_num 171 ranges {473997=627345,1673362=441052,2529567=344430} 2026-02-13T20:13:03.542 INFO:tasks.rados.rados.0.trial188.stdout:397: writing trial18843701-44 from 473997 to 1101342 tid 1 2026-02-13T20:13:03.546 INFO:tasks.rados.rados.0.trial188.stdout:397: writing trial18843701-44 from 1673362 to 2114414 tid 2 2026-02-13T20:13:03.550 INFO:tasks.rados.rados.0.trial188.stdout:397: writing trial18843701-44 from 2529567 to 2873997 tid 3 2026-02-13T20:13:03.550 INFO:tasks.rados.rados.0.trial188.stdout:398: snap_create 2026-02-13T20:13:03.550 INFO:tasks.rados.rados.0.trial188.stdout:392: expect (ObjNum 39 snap 0 seq_num 39) 2026-02-13T20:13:03.566 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:13:03.584 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:13:03.603 INFO:tasks.rados.rados.0.trial188.stdout:391: finishing write tid 1 to trial18843701-41 2026-02-13T20:13:03.603 INFO:tasks.rados.rados.0.trial188.stdout:391: finishing write tid 2 to trial18843701-41 2026-02-13T20:13:03.604 INFO:tasks.rados.rados.0.trial188.stdout:391: finishing write tid 3 to trial18843701-41 2026-02-13T20:13:03.604 INFO:tasks.rados.rados.0.trial188.stdout:391: finishing write tid 4 to trial18843701-41 2026-02-13T20:13:03.604 INFO:tasks.rados.rados.0.trial188.stdout:391: finishing write tid 5 to trial18843701-41 2026-02-13T20:13:03.604 INFO:tasks.rados.rados.0.trial188.stdout:391: oid 41 updating version 0 to 73 2026-02-13T20:13:03.604 INFO:tasks.rados.rados.0.trial188.stdout:391: oid 41 updating version 73 to 74 2026-02-13T20:13:03.604 INFO:tasks.rados.rados.0.trial188.stdout:391: oid 41 updating version 74 to 76 2026-02-13T20:13:03.604 INFO:tasks.rados.rados.0.trial188.stdout:391: oid 41 version 76 is already newer than 75 2026-02-13T20:13:03.604 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 41 v 76 (ObjNum 167 snap 35 seq_num 167) dirty exists 2026-02-13T20:13:03.604 INFO:tasks.rados.rados.0.trial188.stdout:391: left oid 41 (ObjNum 167 snap 35 seq_num 167) 2026-02-13T20:13:03.604 INFO:tasks.rados.rados.0.trial188.stdout:394: finishing write tid 1 to trial18843701-24 2026-02-13T20:13:03.604 INFO:tasks.rados.rados.0.trial188.stdout:394: finishing write tid 2 to trial18843701-24 2026-02-13T20:13:03.605 INFO:tasks.rados.rados.0.trial188.stdout:394: finishing write tid 3 to trial18843701-24 2026-02-13T20:13:03.605 INFO:tasks.rados.rados.0.trial188.stdout:394: finishing write tid 4 to trial18843701-24 2026-02-13T20:13:03.605 INFO:tasks.rados.rados.0.trial188.stdout:396: expect (ObjNum 93 snap 13 seq_num 93) 2026-02-13T20:13:03.736 INFO:tasks.rados.rados.0.trial188.stdout:394: finishing write tid 5 to trial18843701-24 2026-02-13T20:13:03.737 INFO:tasks.rados.rados.0.trial188.stdout:394: oid 24 updating version 0 to 150 2026-02-13T20:13:03.737 INFO:tasks.rados.rados.0.trial188.stdout:394: oid 24 updating version 150 to 152 2026-02-13T20:13:03.737 INFO:tasks.rados.rados.0.trial188.stdout:394: oid 24 version 152 is already newer than 151 2026-02-13T20:13:03.737 INFO:tasks.rados.rados.0.trial188.stdout:394: oid 24 version 152 is already newer than 149 2026-02-13T20:13:03.737 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 24 v 152 (ObjNum 169 snap 35 seq_num 169) dirty exists 2026-02-13T20:13:03.737 INFO:tasks.rados.rados.0.trial188.stdout:394: left oid 24 (ObjNum 169 snap 35 seq_num 169) 2026-02-13T20:13:03.738 INFO:tasks.rados.rados.0.trial188.stdout:395: finishing write tid 1 to trial18843701-25 2026-02-13T20:13:03.738 INFO:tasks.rados.rados.0.trial188.stdout:395: finishing write tid 2 to trial18843701-25 2026-02-13T20:13:03.738 INFO:tasks.rados.rados.0.trial188.stdout:395: finishing write tid 3 to trial18843701-25 2026-02-13T20:13:03.738 INFO:tasks.rados.rados.0.trial188.stdout:395: finishing write tid 4 to trial18843701-25 2026-02-13T20:13:03.738 INFO:tasks.rados.rados.0.trial188.stdout:395: finishing write tid 5 to trial18843701-25 2026-02-13T20:13:03.738 INFO:tasks.rados.rados.0.trial188.stdout:395: oid 25 updating version 0 to 139 2026-02-13T20:13:03.739 INFO:tasks.rados.rados.0.trial188.stdout:395: oid 25 version 139 is already newer than 138 2026-02-13T20:13:03.739 INFO:tasks.rados.rados.0.trial188.stdout:395: oid 25 version 139 is already newer than 136 2026-02-13T20:13:03.739 INFO:tasks.rados.rados.0.trial188.stdout:395: oid 25 version 139 is already newer than 137 2026-02-13T20:13:03.739 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 25 v 139 (ObjNum 170 snap 35 seq_num 170) dirty exists 2026-02-13T20:13:03.739 INFO:tasks.rados.rados.0.trial188.stdout:395: left oid 25 (ObjNum 170 snap 35 seq_num 170) 2026-02-13T20:13:03.739 INFO:tasks.rados.rados.0.trial188.stdout:397: finishing write tid 1 to trial18843701-44 2026-02-13T20:13:03.739 INFO:tasks.rados.rados.0.trial188.stdout:397: finishing write tid 2 to trial18843701-44 2026-02-13T20:13:03.739 INFO:tasks.rados.rados.0.trial188.stdout:397: finishing write tid 3 to trial18843701-44 2026-02-13T20:13:03.739 INFO:tasks.rados.rados.0.trial188.stdout:397: finishing write tid 4 to trial18843701-44 2026-02-13T20:13:03.739 INFO:tasks.rados.rados.0.trial188.stdout:397: finishing write tid 5 to trial18843701-44 2026-02-13T20:13:03.740 INFO:tasks.rados.rados.0.trial188.stdout:397: oid 44 updating version 0 to 136 2026-02-13T20:13:03.740 INFO:tasks.rados.rados.0.trial188.stdout:397: oid 44 updating version 136 to 138 2026-02-13T20:13:03.740 INFO:tasks.rados.rados.0.trial188.stdout:397: oid 44 version 138 is already newer than 137 2026-02-13T20:13:03.740 INFO:tasks.rados.rados.0.trial188.stdout:397: oid 44 updating version 138 to 139 2026-02-13T20:13:03.740 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 44 v 139 (ObjNum 171 snap 35 seq_num 171) dirty exists 2026-02-13T20:13:03.740 INFO:tasks.rados.rados.0.trial188.stdout:397: left oid 44 (ObjNum 171 snap 35 seq_num 171) 2026-02-13T20:13:04.507 INFO:tasks.rados.rados.0.trial188.stdout:391: done (6 left) 2026-02-13T20:13:04.507 INFO:tasks.rados.rados.0.trial188.stdout:392: done (5 left) 2026-02-13T20:13:04.507 INFO:tasks.rados.rados.0.trial188.stdout:394: done (4 left) 2026-02-13T20:13:04.507 INFO:tasks.rados.rados.0.trial188.stdout:395: done (3 left) 2026-02-13T20:13:04.507 INFO:tasks.rados.rados.0.trial188.stdout:396: done (2 left) 2026-02-13T20:13:04.507 INFO:tasks.rados.rados.0.trial188.stdout:397: done (1 left) 2026-02-13T20:13:04.507 INFO:tasks.rados.rados.0.trial188.stdout:398: done (0 left) 2026-02-13T20:13:04.507 INFO:tasks.rados.rados.0.trial188.stdout:399: snap_create 2026-02-13T20:13:05.487 INFO:tasks.rados.rados.0.trial188.stdout:399: done (0 left) 2026-02-13T20:13:05.487 INFO:tasks.rados.rados.0.trial188.stdout:400: write (excl) oid 30 current snap is 37 2026-02-13T20:13:05.488 INFO:tasks.rados.rados.0.trial188.stdout:400: seq_num 172 ranges {490804=702594,1615491=584710,2724284=166520} 2026-02-13T20:13:05.492 INFO:tasks.rados.rados.0.trial188.stdout:400: writing trial18843701-30 from 490804 to 1193398 tid 1 2026-02-13T20:13:05.495 INFO:tasks.rados.rados.0.trial188.stdout:400: writing trial18843701-30 from 1615491 to 2200201 tid 2 2026-02-13T20:13:05.498 INFO:tasks.rados.rados.0.trial188.stdout:400: writing trial18843701-30 from 2724284 to 2890804 tid 3 2026-02-13T20:13:05.498 INFO:tasks.rados.rados.0.trial188.stdout:401: rollback oid 32 current snap is 37 2026-02-13T20:13:05.499 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 32 to 34 2026-02-13T20:13:05.499 INFO:tasks.rados.rados.0.trial188.stdout:402: rollback oid 22 current snap is 37 2026-02-13T20:13:05.499 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 22 to 36 2026-02-13T20:13:05.499 INFO:tasks.rados.rados.0.trial188.stdout:403: snap_create 2026-02-13T20:13:05.500 INFO:tasks.rados.rados.0.trial188.stdout:402: finishing rollback tid 0 to trial18843701-22 2026-02-13T20:13:05.501 INFO:tasks.rados.rados.0.trial188.stdout:401: finishing rollback tid 0 to trial18843701-32 2026-02-13T20:13:05.502 INFO:tasks.rados.rados.0.trial188.stdout:402: finishing rollback tid 1 to trial18843701-22 2026-02-13T20:13:05.502 INFO:tasks.rados.rados.0.trial188.stdout:402: finishing rollback tid 2 to trial18843701-22 2026-02-13T20:13:05.502 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 22 v 47 (ObjNum 75 snap 7 seq_num 75) dirty exists 2026-02-13T20:13:05.502 INFO:tasks.rados.rados.0.trial188.stdout:401: finishing rollback tid 1 to trial18843701-32 2026-02-13T20:13:05.502 INFO:tasks.rados.rados.0.trial188.stdout:401: finishing rollback tid 2 to trial18843701-32 2026-02-13T20:13:05.502 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 32 v 80 (ObjNum 107 snap 18 seq_num 107) dirty exists 2026-02-13T20:13:05.516 INFO:tasks.rados.rados.0.trial188.stdout:400: finishing write tid 1 to trial18843701-30 2026-02-13T20:13:05.516 INFO:tasks.rados.rados.0.trial188.stdout:400: finishing write tid 2 to trial18843701-30 2026-02-13T20:13:05.516 INFO:tasks.rados.rados.0.trial188.stdout:400: finishing write tid 3 to trial18843701-30 2026-02-13T20:13:05.516 INFO:tasks.rados.rados.0.trial188.stdout:400: finishing write tid 4 to trial18843701-30 2026-02-13T20:13:05.516 INFO:tasks.rados.rados.0.trial188.stdout:400: finishing write tid 5 to trial18843701-30 2026-02-13T20:13:05.516 INFO:tasks.rados.rados.0.trial188.stdout:400: oid 30 updating version 0 to 142 2026-02-13T20:13:05.516 INFO:tasks.rados.rados.0.trial188.stdout:400: oid 30 updating version 142 to 143 2026-02-13T20:13:05.516 INFO:tasks.rados.rados.0.trial188.stdout:400: oid 30 version 143 is already newer than 141 2026-02-13T20:13:05.516 INFO:tasks.rados.rados.0.trial188.stdout:400: oid 30 updating version 143 to 144 2026-02-13T20:13:05.517 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 30 v 144 (ObjNum 172 snap 37 seq_num 172) dirty exists 2026-02-13T20:13:05.517 INFO:tasks.rados.rados.0.trial188.stdout:400: left oid 30 (ObjNum 172 snap 37 seq_num 172) 2026-02-13T20:13:06.488 INFO:tasks.rados.rados.0.trial188.stdout:400: done (3 left) 2026-02-13T20:13:06.488 INFO:tasks.rados.rados.0.trial188.stdout:401: done (2 left) 2026-02-13T20:13:06.488 INFO:tasks.rados.rados.0.trial188.stdout:402: done (1 left) 2026-02-13T20:13:06.488 INFO:tasks.rados.rados.0.trial188.stdout:403: done (0 left) 2026-02-13T20:13:06.488 INFO:tasks.rados.rados.0.trial188.stdout:404: snap_remove snap 30 2026-02-13T20:13:07.488 INFO:tasks.rados.rados.0.trial188.stdout:404: done (0 left) 2026-02-13T20:13:07.488 INFO:tasks.rados.rados.0.trial188.stdout:405: snap_create 2026-02-13T20:13:08.492 INFO:tasks.rados.rados.0.trial188.stdout:405: done (0 left) 2026-02-13T20:13:08.493 INFO:tasks.rados.rados.0.trial188.stdout:406: copy_from oid 27 from oid 44 current snap is 39 2026-02-13T20:13:08.493 INFO:tasks.rados.rados.0.trial188.stdout:407: snap_create 2026-02-13T20:13:08.527 INFO:tasks.rados.rados.0.trial188.stdout:406: finishing copy_from racing read to trial18843701-27 2026-02-13T20:13:08.529 INFO:tasks.rados.rados.0.trial188.stdout:406: finishing copy_from to trial18843701-27 2026-02-13T20:13:08.529 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 27 v 139 (ObjNum 171 snap 35 seq_num 171) dirty exists 2026-02-13T20:13:09.494 INFO:tasks.rados.rados.0.trial188.stdout:406: done (1 left) 2026-02-13T20:13:09.494 INFO:tasks.rados.rados.0.trial188.stdout:407: done (0 left) 2026-02-13T20:13:09.494 INFO:tasks.rados.rados.0.trial188.stdout:408: snap_remove snap 37 2026-02-13T20:13:10.487 INFO:tasks.rados.rados.0.trial188.stdout:408: done (0 left) 2026-02-13T20:13:10.487 INFO:tasks.rados.rados.0.trial188.stdout:409: read oid 37 snap -1 2026-02-13T20:13:10.487 INFO:tasks.rados.rados.0.trial188.stdout:409: expect deleted 2026-02-13T20:13:10.487 INFO:tasks.rados.rados.0.trial188.stdout:410: rollback oid 1 current snap is 40 2026-02-13T20:13:10.488 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 1 to 39 2026-02-13T20:13:10.488 INFO:tasks.rados.rados.0.trial188.stdout:411: copy_from oid 39 from oid 15 current snap is 40 2026-02-13T20:13:10.488 INFO:tasks.rados.rados.0.trial188.stdout:412: snap_create 2026-02-13T20:13:10.491 INFO:tasks.rados.rados.0.trial188.stdout:410: finishing rollback tid 0 to trial18843701-1 2026-02-13T20:13:10.492 INFO:tasks.rados.rados.0.trial188.stdout:410: finishing rollback tid 1 to trial18843701-1 2026-02-13T20:13:10.492 INFO:tasks.rados.rados.0.trial188.stdout:410: finishing rollback tid 2 to trial18843701-1 2026-02-13T20:13:10.492 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 1 v 147 (ObjNum 160 snap 32 seq_num 160) dirty exists 2026-02-13T20:13:10.513 INFO:tasks.rados.rados.0.trial188.stdout:411: finishing copy_from racing read to trial18843701-39 2026-02-13T20:13:10.513 INFO:tasks.rados.rados.0.trial188.stdout:411: finishing copy_from to trial18843701-39 2026-02-13T20:13:10.513 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 39 v 6 (ObjNum 39 snap 0 seq_num 39) dirty exists 2026-02-13T20:13:11.489 INFO:tasks.rados.rados.0.trial188.stdout:409: done (3 left) 2026-02-13T20:13:11.490 INFO:tasks.rados.rados.0.trial188.stdout:410: done (2 left) 2026-02-13T20:13:11.490 INFO:tasks.rados.rados.0.trial188.stdout:411: done (1 left) 2026-02-13T20:13:11.490 INFO:tasks.rados.rados.0.trial188.stdout:412: done (0 left) 2026-02-13T20:13:11.490 INFO:tasks.rados.rados.0.trial188.stdout:413: delete oid 2 current snap is 41 2026-02-13T20:13:11.491 INFO:tasks.rados.rados.0.trial188.stdout:413: done (0 left) 2026-02-13T20:13:11.491 INFO:tasks.rados.rados.0.trial188.stdout:414: write oid 17 current snap is 41 2026-02-13T20:13:11.491 INFO:tasks.rados.rados.0.trial188.stdout:414: seq_num 174 ranges {524418=453092,1732455=588379,2779130=145288} 2026-02-13T20:13:11.495 INFO:tasks.rados.rados.0.trial188.stdout:414: writing trial18843701-17 from 524418 to 977510 tid 1 2026-02-13T20:13:11.500 INFO:tasks.rados.rados.0.trial188.stdout:414: writing trial18843701-17 from 1732455 to 2320834 tid 2 2026-02-13T20:13:11.503 INFO:tasks.rados.rados.0.trial188.stdout:414: writing trial18843701-17 from 2779130 to 2924418 tid 3 2026-02-13T20:13:11.503 INFO:tasks.rados.rados.0.trial188.stdout:415: read oid 39 snap 31 2026-02-13T20:13:11.503 INFO:tasks.rados.rados.0.trial188.stdout:415: expect (ObjNum 112 snap 19 seq_num 112) 2026-02-13T20:13:11.503 INFO:tasks.rados.rados.0.trial188.stdout:416: write oid 14 current snap is 41 2026-02-13T20:13:11.503 INFO:tasks.rados.rados.0.trial188.stdout:416: seq_num 175 ranges {541225=644694,1907290=448390} 2026-02-13T20:13:11.507 INFO:tasks.rados.rados.0.trial188.stdout:416: writing trial18843701-14 from 541225 to 1185919 tid 1 2026-02-13T20:13:11.511 INFO:tasks.rados.rados.0.trial188.stdout:416: writing trial18843701-14 from 1907290 to 2355680 tid 2 2026-02-13T20:13:11.511 INFO:tasks.rados.rados.0.trial188.stdout:417: read oid 20 snap -1 2026-02-13T20:13:11.511 INFO:tasks.rados.rados.0.trial188.stdout:417: expect deleted 2026-02-13T20:13:11.511 INFO:tasks.rados.rados.0.trial188.stdout:418: write oid 31 current snap is 41 2026-02-13T20:13:11.512 INFO:tasks.rados.rados.0.trial188.stdout:418: seq_num 176 ranges {558032=719943,1849419=592048} 2026-02-13T20:13:11.517 INFO:tasks.rados.rados.0.trial188.stdout:418: writing trial18843701-31 from 558032 to 1277975 tid 1 2026-02-13T20:13:11.521 INFO:tasks.rados.rados.0.trial188.stdout:418: writing trial18843701-31 from 1849419 to 2441467 tid 2 2026-02-13T20:13:11.521 INFO:tasks.rados.rados.0.trial188.stdout:419: delete oid 27 current snap is 41 2026-02-13T20:13:11.521 INFO:tasks.rados.rados.0.trial188.stdout:415: expect (ObjNum 112 snap 19 seq_num 112) 2026-02-13T20:13:11.550 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1451894 2026-02-13T20:13:11.597 INFO:tasks.rados.rados.0.trial188.stdout:414: finishing write tid 1 to trial18843701-17 2026-02-13T20:13:11.597 INFO:tasks.rados.rados.0.trial188.stdout:414: finishing write tid 2 to trial18843701-17 2026-02-13T20:13:11.597 INFO:tasks.rados.rados.0.trial188.stdout:414: finishing write tid 3 to trial18843701-17 2026-02-13T20:13:11.597 INFO:tasks.rados.rados.0.trial188.stdout:414: finishing write tid 4 to trial18843701-17 2026-02-13T20:13:11.597 INFO:tasks.rados.rados.0.trial188.stdout:414: finishing write tid 5 to trial18843701-17 2026-02-13T20:13:11.597 INFO:tasks.rados.rados.0.trial188.stdout:414: oid 17 updating version 0 to 92 2026-02-13T20:13:11.597 INFO:tasks.rados.rados.0.trial188.stdout:414: oid 17 version 92 is already newer than 91 2026-02-13T20:13:11.597 INFO:tasks.rados.rados.0.trial188.stdout:414: oid 17 version 92 is already newer than 89 2026-02-13T20:13:11.597 INFO:tasks.rados.rados.0.trial188.stdout:414: oid 17 version 92 is already newer than 90 2026-02-13T20:13:11.598 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 17 v 92 (ObjNum 174 snap 41 seq_num 174) dirty exists 2026-02-13T20:13:11.598 INFO:tasks.rados.rados.0.trial188.stdout:414: left oid 17 (ObjNum 174 snap 41 seq_num 174) 2026-02-13T20:13:11.598 INFO:tasks.rados.rados.0.trial188.stdout:416: finishing write tid 1 to trial18843701-14 2026-02-13T20:13:11.598 INFO:tasks.rados.rados.0.trial188.stdout:416: finishing write tid 2 to trial18843701-14 2026-02-13T20:13:11.598 INFO:tasks.rados.rados.0.trial188.stdout:416: finishing write tid 3 to trial18843701-14 2026-02-13T20:13:11.598 INFO:tasks.rados.rados.0.trial188.stdout:418: finishing write tid 1 to trial18843701-31 2026-02-13T20:13:11.598 INFO:tasks.rados.rados.0.trial188.stdout:416: finishing write tid 4 to trial18843701-14 2026-02-13T20:13:11.598 INFO:tasks.rados.rados.0.trial188.stdout:416: oid 14 updating version 0 to 144 2026-02-13T20:13:11.598 INFO:tasks.rados.rados.0.trial188.stdout:416: oid 14 updating version 144 to 145 2026-02-13T20:13:11.598 INFO:tasks.rados.rados.0.trial188.stdout:416: oid 14 updating version 145 to 146 2026-02-13T20:13:11.598 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 14 v 146 (ObjNum 175 snap 41 seq_num 175) dirty exists 2026-02-13T20:13:11.598 INFO:tasks.rados.rados.0.trial188.stdout:416: left oid 14 (ObjNum 175 snap 41 seq_num 175) 2026-02-13T20:13:11.598 INFO:tasks.rados.rados.0.trial188.stdout:418: finishing write tid 2 to trial18843701-31 2026-02-13T20:13:11.598 INFO:tasks.rados.rados.0.trial188.stdout:418: finishing write tid 3 to trial18843701-31 2026-02-13T20:13:11.598 INFO:tasks.rados.rados.0.trial188.stdout:418: finishing write tid 4 to trial18843701-31 2026-02-13T20:13:11.598 INFO:tasks.rados.rados.0.trial188.stdout:418: oid 31 updating version 0 to 16 2026-02-13T20:13:11.598 INFO:tasks.rados.rados.0.trial188.stdout:418: oid 31 version 16 is already newer than 15 2026-02-13T20:13:11.598 INFO:tasks.rados.rados.0.trial188.stdout:418: oid 31 version 16 is already newer than 14 2026-02-13T20:13:11.598 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 31 v 16 (ObjNum 176 snap 41 seq_num 176) dirty exists 2026-02-13T20:13:11.598 INFO:tasks.rados.rados.0.trial188.stdout:418: left oid 31 (ObjNum 176 snap 41 seq_num 176) 2026-02-13T20:13:11.598 INFO:tasks.rados.rados.0.trial188.stdout:414: done (5 left) 2026-02-13T20:13:11.598 INFO:tasks.rados.rados.0.trial188.stdout:415: done (4 left) 2026-02-13T20:13:11.598 INFO:tasks.rados.rados.0.trial188.stdout:416: done (3 left) 2026-02-13T20:13:11.598 INFO:tasks.rados.rados.0.trial188.stdout:417: done (2 left) 2026-02-13T20:13:11.599 INFO:tasks.rados.rados.0.trial188.stdout:418: done (1 left) 2026-02-13T20:13:11.599 INFO:tasks.rados.rados.0.trial188.stdout:419: done (0 left) 2026-02-13T20:13:11.599 INFO:tasks.rados.rados.0.trial188.stdout:420: delete oid 14 current snap is 41 2026-02-13T20:13:11.599 INFO:tasks.rados.rados.0.trial188.stdout:420: done (0 left) 2026-02-13T20:13:11.599 INFO:tasks.rados.rados.0.trial188.stdout:421: snap_remove snap 31 2026-02-13T20:13:12.501 INFO:tasks.rados.rados.0.trial188.stdout:421: done (0 left) 2026-02-13T20:13:12.501 INFO:tasks.rados.rados.0.trial188.stdout:422: write oid 49 current snap is 41 2026-02-13T20:13:12.501 INFO:tasks.rados.rados.0.trial188.stdout:422: seq_num 179 ranges {608453=545690,1624865=455728,2632598=375855} 2026-02-13T20:13:12.506 INFO:tasks.rados.rados.0.trial188.stdout:422: writing trial18843701-49 from 608453 to 1154143 tid 1 2026-02-13T20:13:12.509 INFO:tasks.rados.rados.0.trial188.stdout:422: writing trial18843701-49 from 1624865 to 2080593 tid 2 2026-02-13T20:13:12.513 INFO:tasks.rados.rados.0.trial188.stdout:422: writing trial18843701-49 from 2632598 to 3008453 tid 3 2026-02-13T20:13:12.513 INFO:tasks.rados.rados.0.trial188.stdout:423: snap_remove snap 34 2026-02-13T20:13:13.504 INFO:tasks.rados.rados.0.trial188.stdout:423: done (1 left) 2026-02-13T20:13:13.504 INFO:tasks.rados.rados.0.trial188.stdout:424: write (excl) oid 10 current snap is 41 2026-02-13T20:13:13.504 INFO:tasks.rados.rados.0.trial188.stdout:424: seq_num 180 ranges {625260=620939,1683347=599386,2943668=81592} 2026-02-13T20:13:13.509 INFO:tasks.rados.rados.0.trial188.stdout:424: writing trial18843701-10 from 625260 to 1246199 tid 1 2026-02-13T20:13:13.513 INFO:tasks.rados.rados.0.trial188.stdout:424: writing trial18843701-10 from 1683347 to 2282733 tid 2 2026-02-13T20:13:13.516 INFO:tasks.rados.rados.0.trial188.stdout:424: writing trial18843701-10 from 2943668 to 3025260 tid 3 2026-02-13T20:13:13.516 INFO:tasks.rados.rados.0.trial188.stdout:425: rollback oid 37 current snap is 41 2026-02-13T20:13:13.516 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 37 to 28 2026-02-13T20:13:13.516 INFO:tasks.rados.rados.0.trial188.stdout:422: finishing write tid 1 to trial18843701-49 2026-02-13T20:13:13.516 INFO:tasks.rados.rados.0.trial188.stdout:422: finishing write tid 2 to trial18843701-49 2026-02-13T20:13:13.516 INFO:tasks.rados.rados.0.trial188.stdout:422: finishing write tid 3 to trial18843701-49 2026-02-13T20:13:13.516 INFO:tasks.rados.rados.0.trial188.stdout:422: finishing write tid 4 to trial18843701-49 2026-02-13T20:13:13.516 INFO:tasks.rados.rados.0.trial188.stdout:422: finishing write tid 5 to trial18843701-49 2026-02-13T20:13:13.516 INFO:tasks.rados.rados.0.trial188.stdout:422: oid 49 updating version 0 to 156 2026-02-13T20:13:13.516 INFO:tasks.rados.rados.0.trial188.stdout:422: oid 49 updating version 156 to 158 2026-02-13T20:13:13.516 INFO:tasks.rados.rados.0.trial188.stdout:422: oid 49 updating version 158 to 159 2026-02-13T20:13:13.516 INFO:tasks.rados.rados.0.trial188.stdout:422: oid 49 version 159 is already newer than 157 2026-02-13T20:13:13.516 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 49 v 159 (ObjNum 179 snap 41 seq_num 179) dirty exists 2026-02-13T20:13:13.517 INFO:tasks.rados.rados.0.trial188.stdout:422: left oid 49 (ObjNum 179 snap 41 seq_num 179) 2026-02-13T20:13:13.517 INFO:tasks.rados.rados.0.trial188.stdout:422: done (2 left) 2026-02-13T20:13:13.517 INFO:tasks.rados.rados.0.trial188.stdout:426: snap_create 2026-02-13T20:13:13.517 INFO:tasks.rados.rados.0.trial188.stdout:425: finishing rollback tid 1 to trial18843701-37 2026-02-13T20:13:13.517 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 37 v 0 (ObjNum 129 snap 0 seq_num 15147312) dirty dne 2026-02-13T20:13:13.529 INFO:tasks.rados.rados.0.trial188.stdout:424: finishing write tid 1 to trial18843701-10 2026-02-13T20:13:13.529 INFO:tasks.rados.rados.0.trial188.stdout:424: finishing write tid 2 to trial18843701-10 2026-02-13T20:13:13.530 INFO:tasks.rados.rados.0.trial188.stdout:424: finishing write tid 3 to trial18843701-10 2026-02-13T20:13:13.530 INFO:tasks.rados.rados.0.trial188.stdout:424: finishing write tid 4 to trial18843701-10 2026-02-13T20:13:13.530 INFO:tasks.rados.rados.0.trial188.stdout:424: finishing write tid 5 to trial18843701-10 2026-02-13T20:13:13.530 INFO:tasks.rados.rados.0.trial188.stdout:424: oid 10 updating version 0 to 127 2026-02-13T20:13:13.530 INFO:tasks.rados.rados.0.trial188.stdout:424: oid 10 version 127 is already newer than 125 2026-02-13T20:13:13.530 INFO:tasks.rados.rados.0.trial188.stdout:424: oid 10 version 127 is already newer than 124 2026-02-13T20:13:13.530 INFO:tasks.rados.rados.0.trial188.stdout:424: oid 10 version 127 is already newer than 126 2026-02-13T20:13:13.530 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 10 v 127 (ObjNum 180 snap 41 seq_num 180) dirty exists 2026-02-13T20:13:13.530 INFO:tasks.rados.rados.0.trial188.stdout:424: left oid 10 (ObjNum 180 snap 41 seq_num 180) 2026-02-13T20:13:14.506 INFO:tasks.rados.rados.0.trial188.stdout:424: done (2 left) 2026-02-13T20:13:14.506 INFO:tasks.rados.rados.0.trial188.stdout:425: done (1 left) 2026-02-13T20:13:14.506 INFO:tasks.rados.rados.0.trial188.stdout:426: done (0 left) 2026-02-13T20:13:14.506 INFO:tasks.rados.rados.0.trial188.stdout:427: snap_create 2026-02-13T20:13:15.488 INFO:tasks.rados.rados.0.trial188.stdout:427: done (0 left) 2026-02-13T20:13:15.488 INFO:tasks.rados.rados.0.trial188.stdout:428: read oid 41 snap -1 2026-02-13T20:13:15.488 INFO:tasks.rados.rados.0.trial188.stdout:428: expect (ObjNum 167 snap 35 seq_num 167) 2026-02-13T20:13:15.488 INFO:tasks.rados.rados.0.trial188.stdout:429: copy_from oid 44 from oid 11 current snap is 43 2026-02-13T20:13:15.488 INFO:tasks.rados.rados.0.trial188.stdout:430: snap_remove snap 38 2026-02-13T20:13:16.490 INFO:tasks.rados.rados.0.trial188.stdout:430: done (2 left) 2026-02-13T20:13:16.490 INFO:tasks.rados.rados.0.trial188.stdout:431: write (excl) oid 50 current snap is 43 2026-02-13T20:13:16.490 INFO:tasks.rados.rados.0.trial188.stdout:428: expect (ObjNum 167 snap 35 seq_num 167) 2026-02-13T20:13:16.493 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 964977 2026-02-13T20:13:16.526 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:13:16.545 INFO:tasks.rados.rados.0.trial188.stdout:429: finishing copy_from racing read to trial18843701-44 2026-02-13T20:13:16.545 INFO:tasks.rados.rados.0.trial188.stdout:429: finishing copy_from to trial18843701-44 2026-02-13T20:13:16.545 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 44 v 90 (ObjNum 132 snap 23 seq_num 132) dirty exists 2026-02-13T20:13:16.546 INFO:tasks.rados.rados.0.trial188.stdout:431: seq_num 181 ranges {642067=696188,2025476=459397,2971091=70976} 2026-02-13T20:13:16.550 INFO:tasks.rados.rados.0.trial188.stdout:431: writing trial18843701-50 from 642067 to 1338255 tid 1 2026-02-13T20:13:16.554 INFO:tasks.rados.rados.0.trial188.stdout:431: writing trial18843701-50 from 2025476 to 2484873 tid 2 2026-02-13T20:13:16.557 INFO:tasks.rados.rados.0.trial188.stdout:431: writing trial18843701-50 from 2971091 to 3042067 tid 3 2026-02-13T20:13:16.557 INFO:tasks.rados.rados.0.trial188.stdout:428: done (2 left) 2026-02-13T20:13:16.557 INFO:tasks.rados.rados.0.trial188.stdout:429: done (1 left) 2026-02-13T20:13:16.557 INFO:tasks.rados.rados.0.trial188.stdout:432: read oid 3 snap -1 2026-02-13T20:13:16.557 INFO:tasks.rados.rados.0.trial188.stdout:432: expect (ObjNum 130 snap 22 seq_num 130) 2026-02-13T20:13:16.557 INFO:tasks.rados.rados.0.trial188.stdout:433: write oid 32 current snap is 43 2026-02-13T20:13:16.557 INFO:tasks.rados.rados.0.trial188.stdout:433: seq_num 182 ranges {658874=771437,2083958=603055} 2026-02-13T20:13:16.562 INFO:tasks.rados.rados.0.trial188.stdout:433: writing trial18843701-32 from 658874 to 1430311 tid 1 2026-02-13T20:13:16.567 INFO:tasks.rados.rados.0.trial188.stdout:433: writing trial18843701-32 from 2083958 to 2687013 tid 2 2026-02-13T20:13:16.567 INFO:tasks.rados.rados.0.trial188.stdout:434: copy_from oid 29 from oid 46 current snap is 43 2026-02-13T20:13:16.567 INFO:tasks.rados.rados.0.trial188.stdout:435: copy_from oid 42 from oid 35 current snap is 43 2026-02-13T20:13:16.567 INFO:tasks.rados.rados.0.trial188.stdout:436: delete oid 28 current snap is 43 2026-02-13T20:13:16.567 INFO:tasks.rados.rados.0.trial188.stdout:435: finishing copy_from to trial18843701-42 2026-02-13T20:13:16.567 INFO:tasks.rados.rados.0.trial188.stdout:435: got expected ENOENT (src dne) 2026-02-13T20:13:16.568 INFO:tasks.rados.rados.0.trial188.stdout:435: finishing copy_from racing read to trial18843701-42 2026-02-13T20:13:16.568 INFO:tasks.rados.rados.0.trial188.stdout:431: finishing write tid 1 to trial18843701-50 2026-02-13T20:13:16.569 INFO:tasks.rados.rados.0.trial188.stdout:431: finishing write tid 2 to trial18843701-50 2026-02-13T20:13:16.569 INFO:tasks.rados.rados.0.trial188.stdout:431: finishing write tid 3 to trial18843701-50 2026-02-13T20:13:16.569 INFO:tasks.rados.rados.0.trial188.stdout:431: finishing write tid 4 to trial18843701-50 2026-02-13T20:13:16.569 INFO:tasks.rados.rados.0.trial188.stdout:431: finishing write tid 5 to trial18843701-50 2026-02-13T20:13:16.570 INFO:tasks.rados.rados.0.trial188.stdout:431: oid 50 updating version 0 to 166 2026-02-13T20:13:16.570 INFO:tasks.rados.rados.0.trial188.stdout:431: oid 50 updating version 166 to 168 2026-02-13T20:13:16.570 INFO:tasks.rados.rados.0.trial188.stdout:431: oid 50 version 168 is already newer than 167 2026-02-13T20:13:16.570 INFO:tasks.rados.rados.0.trial188.stdout:431: oid 50 version 168 is already newer than 165 2026-02-13T20:13:16.570 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 50 v 168 (ObjNum 181 snap 43 seq_num 181) dirty exists 2026-02-13T20:13:16.570 INFO:tasks.rados.rados.0.trial188.stdout:431: left oid 50 (ObjNum 181 snap 43 seq_num 181) 2026-02-13T20:13:16.571 INFO:tasks.rados.rados.0.trial188.stdout:431: done (5 left) 2026-02-13T20:13:16.571 INFO:tasks.rados.rados.0.trial188.stdout:435: done (4 left) 2026-02-13T20:13:16.571 INFO:tasks.rados.rados.0.trial188.stdout:436: done (3 left) 2026-02-13T20:13:16.571 INFO:tasks.rados.rados.0.trial188.stdout:437: rollback oid 47 current snap is 43 2026-02-13T20:13:16.571 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 47 to 32 2026-02-13T20:13:16.571 INFO:tasks.rados.rados.0.trial188.stdout:438: write (excl) oid 1 current snap is 43 2026-02-13T20:13:16.572 INFO:tasks.rados.rados.0.trial188.stdout:438: seq_num 184 ranges {692488=638288,1917275=606724} 2026-02-13T20:13:16.576 INFO:tasks.rados.rados.0.trial188.stdout:438: writing trial18843701-1 from 692488 to 1330776 tid 1 2026-02-13T20:13:16.581 INFO:tasks.rados.rados.0.trial188.stdout:438: writing trial18843701-1 from 1917275 to 2523999 tid 2 2026-02-13T20:13:16.581 INFO:tasks.rados.rados.0.trial188.stdout:439: snap_create 2026-02-13T20:13:16.581 INFO:tasks.rados.rados.0.trial188.stdout:432: expect (ObjNum 130 snap 22 seq_num 130) 2026-02-13T20:13:16.638 INFO:tasks.rados.rados.0.trial188.stdout:437: finishing rollback tid 0 to trial18843701-47 2026-02-13T20:13:16.638 INFO:tasks.rados.rados.0.trial188.stdout:437: finishing rollback tid 1 to trial18843701-47 2026-02-13T20:13:16.639 INFO:tasks.rados.rados.0.trial188.stdout:437: finishing rollback tid 2 to trial18843701-47 2026-02-13T20:13:16.639 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 47 v 94 (ObjNum 120 snap 20 seq_num 120) dirty exists 2026-02-13T20:13:16.639 INFO:tasks.rados.rados.0.trial188.stdout:433: finishing write tid 1 to trial18843701-32 2026-02-13T20:13:16.639 INFO:tasks.rados.rados.0.trial188.stdout:433: finishing write tid 2 to trial18843701-32 2026-02-13T20:13:16.639 INFO:tasks.rados.rados.0.trial188.stdout:433: finishing write tid 3 to trial18843701-32 2026-02-13T20:13:16.639 INFO:tasks.rados.rados.0.trial188.stdout:433: finishing write tid 4 to trial18843701-32 2026-02-13T20:13:16.639 INFO:tasks.rados.rados.0.trial188.stdout:433: oid 32 updating version 0 to 92 2026-02-13T20:13:16.639 INFO:tasks.rados.rados.0.trial188.stdout:433: oid 32 updating version 92 to 93 2026-02-13T20:13:16.639 INFO:tasks.rados.rados.0.trial188.stdout:433: oid 32 updating version 93 to 94 2026-02-13T20:13:16.639 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 32 v 94 (ObjNum 182 snap 43 seq_num 182) dirty exists 2026-02-13T20:13:16.639 INFO:tasks.rados.rados.0.trial188.stdout:433: left oid 32 (ObjNum 182 snap 43 seq_num 182) 2026-02-13T20:13:16.640 INFO:tasks.rados.rados.0.trial188.stdout:438: finishing write tid 1 to trial18843701-1 2026-02-13T20:13:16.640 INFO:tasks.rados.rados.0.trial188.stdout:438: finishing write tid 2 to trial18843701-1 2026-02-13T20:13:16.640 INFO:tasks.rados.rados.0.trial188.stdout:438: finishing write tid 3 to trial18843701-1 2026-02-13T20:13:16.640 INFO:tasks.rados.rados.0.trial188.stdout:438: finishing write tid 4 to trial18843701-1 2026-02-13T20:13:16.640 INFO:tasks.rados.rados.0.trial188.stdout:438: oid 1 updating version 0 to 171 2026-02-13T20:13:16.640 INFO:tasks.rados.rados.0.trial188.stdout:438: oid 1 updating version 171 to 172 2026-02-13T20:13:16.640 INFO:tasks.rados.rados.0.trial188.stdout:438: oid 1 updating version 172 to 173 2026-02-13T20:13:16.640 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 1 v 173 (ObjNum 184 snap 43 seq_num 184) dirty exists 2026-02-13T20:13:16.640 INFO:tasks.rados.rados.0.trial188.stdout:438: left oid 1 (ObjNum 184 snap 43 seq_num 184) 2026-02-13T20:13:16.640 INFO:tasks.rados.rados.0.trial188.stdout:434: finishing copy_from racing read to trial18843701-29 2026-02-13T20:13:16.640 INFO:tasks.rados.rados.0.trial188.stdout:434: finishing copy_from to trial18843701-29 2026-02-13T20:13:16.641 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 29 v 12 (ObjNum 45 snap 0 seq_num 45) dirty exists 2026-02-13T20:13:17.509 INFO:tasks.rados.rados.0.trial188.stdout:432: done (5 left) 2026-02-13T20:13:17.509 INFO:tasks.rados.rados.0.trial188.stdout:433: done (4 left) 2026-02-13T20:13:17.509 INFO:tasks.rados.rados.0.trial188.stdout:434: done (3 left) 2026-02-13T20:13:17.510 INFO:tasks.rados.rados.0.trial188.stdout:437: done (2 left) 2026-02-13T20:13:17.510 INFO:tasks.rados.rados.0.trial188.stdout:438: done (1 left) 2026-02-13T20:13:17.510 INFO:tasks.rados.rados.0.trial188.stdout:439: done (0 left) 2026-02-13T20:13:17.510 INFO:tasks.rados.rados.0.trial188.stdout:440: copy_from oid 16 from oid 10 current snap is 44 2026-02-13T20:13:17.510 INFO:tasks.rados.rados.0.trial188.stdout:441: copy_from oid 43 from oid 28 current snap is 44 2026-02-13T20:13:17.510 INFO:tasks.rados.rados.0.trial188.stdout:442: snap_remove snap 41 2026-02-13T20:13:18.510 INFO:tasks.rados.rados.0.trial188.stdout:442: done (2 left) 2026-02-13T20:13:18.511 INFO:tasks.rados.rados.0.trial188.stdout:443: snap_create 2026-02-13T20:13:18.511 INFO:tasks.rados.rados.0.trial188.stdout:441: finishing copy_from to trial18843701-43 2026-02-13T20:13:18.511 INFO:tasks.rados.rados.0.trial188.stdout:441: got expected ENOENT (src dne) 2026-02-13T20:13:18.511 INFO:tasks.rados.rados.0.trial188.stdout:441: finishing copy_from racing read to trial18843701-43 2026-02-13T20:13:18.511 INFO:tasks.rados.rados.0.trial188.stdout:440: finishing copy_from racing read to trial18843701-16 2026-02-13T20:13:18.511 INFO:tasks.rados.rados.0.trial188.stdout:440: finishing copy_from to trial18843701-16 2026-02-13T20:13:18.511 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 16 v 127 (ObjNum 180 snap 41 seq_num 180) dirty exists 2026-02-13T20:13:19.511 INFO:tasks.rados.rados.0.trial188.stdout:440: done (2 left) 2026-02-13T20:13:19.511 INFO:tasks.rados.rados.0.trial188.stdout:441: done (1 left) 2026-02-13T20:13:19.511 INFO:tasks.rados.rados.0.trial188.stdout:443: done (0 left) 2026-02-13T20:13:19.511 INFO:tasks.rados.rados.0.trial188.stdout:444: write (excl) oid 32 current snap is 45 2026-02-13T20:13:19.512 INFO:tasks.rados.rados.0.trial188.stdout:444: seq_num 185 ranges {709295=713537,1859404=750382} 2026-02-13T20:13:19.516 INFO:tasks.rados.rados.0.trial188.stdout:444: writing trial18843701-32 from 709295 to 1422832 tid 1 2026-02-13T20:13:19.521 INFO:tasks.rados.rados.0.trial188.stdout:444: writing trial18843701-32 from 1859404 to 2609786 tid 2 2026-02-13T20:13:19.522 INFO:tasks.rados.rados.0.trial188.stdout:445: rollback oid 35 current snap is 45 2026-02-13T20:13:19.522 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 35 to 36 2026-02-13T20:13:19.522 INFO:tasks.rados.rados.0.trial188.stdout:446: read oid 42 snap -1 2026-02-13T20:13:19.522 INFO:tasks.rados.rados.0.trial188.stdout:446: expect (ObjNum 97 snap 15 seq_num 97) 2026-02-13T20:13:19.522 INFO:tasks.rados.rados.0.trial188.stdout:447: snap_create 2026-02-13T20:13:19.530 INFO:tasks.rados.rados.0.trial188.stdout:445: finishing rollback tid 1 to trial18843701-35 2026-02-13T20:13:19.530 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 35 v 0 (ObjNum 705 snap 0 seq_num 16337815) dirty dne 2026-02-13T20:13:19.533 INFO:tasks.rados.rados.0.trial188.stdout:446: expect (ObjNum 97 snap 15 seq_num 97) 2026-02-13T20:13:19.567 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2734196 2026-02-13T20:13:19.584 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 245912 2026-02-13T20:13:19.637 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:13:19.692 INFO:tasks.rados.rados.0.trial188.stdout:444: finishing write tid 1 to trial18843701-32 2026-02-13T20:13:19.692 INFO:tasks.rados.rados.0.trial188.stdout:444: finishing write tid 2 to trial18843701-32 2026-02-13T20:13:19.692 INFO:tasks.rados.rados.0.trial188.stdout:444: finishing write tid 3 to trial18843701-32 2026-02-13T20:13:19.692 INFO:tasks.rados.rados.0.trial188.stdout:444: finishing write tid 4 to trial18843701-32 2026-02-13T20:13:19.692 INFO:tasks.rados.rados.0.trial188.stdout:444: oid 32 updating version 0 to 100 2026-02-13T20:13:19.692 INFO:tasks.rados.rados.0.trial188.stdout:444: oid 32 version 100 is already newer than 98 2026-02-13T20:13:19.693 INFO:tasks.rados.rados.0.trial188.stdout:444: oid 32 version 100 is already newer than 99 2026-02-13T20:13:19.693 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 32 v 100 (ObjNum 185 snap 45 seq_num 185) dirty exists 2026-02-13T20:13:19.693 INFO:tasks.rados.rados.0.trial188.stdout:444: left oid 32 (ObjNum 185 snap 45 seq_num 185) 2026-02-13T20:13:20.490 INFO:tasks.rados.rados.0.trial188.stdout:444: done (3 left) 2026-02-13T20:13:20.491 INFO:tasks.rados.rados.0.trial188.stdout:445: done (2 left) 2026-02-13T20:13:20.491 INFO:tasks.rados.rados.0.trial188.stdout:446: done (1 left) 2026-02-13T20:13:20.491 INFO:tasks.rados.rados.0.trial188.stdout:447: done (0 left) 2026-02-13T20:13:20.491 INFO:tasks.rados.rados.0.trial188.stdout:448: write oid 3 current snap is 46 2026-02-13T20:13:20.491 INFO:tasks.rados.rados.0.trial188.stdout:448: seq_num 186 ranges {726102=788786,1917886=610393,3108206=17896} 2026-02-13T20:13:20.496 INFO:tasks.rados.rados.0.trial188.stdout:448: writing trial18843701-3 from 726102 to 1514888 tid 1 2026-02-13T20:13:20.500 INFO:tasks.rados.rados.0.trial188.stdout:448: writing trial18843701-3 from 1917886 to 2528279 tid 2 2026-02-13T20:13:20.502 INFO:tasks.rados.rados.0.trial188.stdout:448: writing trial18843701-3 from 3108206 to 3126102 tid 3 2026-02-13T20:13:20.502 INFO:tasks.rados.rados.0.trial188.stdout:449: snap_remove snap 40 2026-02-13T20:13:21.492 INFO:tasks.rados.rados.0.trial188.stdout:449: done (1 left) 2026-02-13T20:13:21.493 INFO:tasks.rados.rados.0.trial188.stdout:450: copy_from oid 31 from oid 6 current snap is 46 2026-02-13T20:13:21.493 INFO:tasks.rados.rados.0.trial188.stdout:448: finishing write tid 1 to trial18843701-3 2026-02-13T20:13:21.493 INFO:tasks.rados.rados.0.trial188.stdout:448: finishing write tid 2 to trial18843701-3 2026-02-13T20:13:21.493 INFO:tasks.rados.rados.0.trial188.stdout:448: finishing write tid 3 to trial18843701-3 2026-02-13T20:13:21.493 INFO:tasks.rados.rados.0.trial188.stdout:448: finishing write tid 4 to trial18843701-3 2026-02-13T20:13:21.493 INFO:tasks.rados.rados.0.trial188.stdout:448: finishing write tid 5 to trial18843701-3 2026-02-13T20:13:21.493 INFO:tasks.rados.rados.0.trial188.stdout:448: oid 3 updating version 0 to 157 2026-02-13T20:13:21.493 INFO:tasks.rados.rados.0.trial188.stdout:448: oid 3 updating version 157 to 158 2026-02-13T20:13:21.493 INFO:tasks.rados.rados.0.trial188.stdout:448: oid 3 version 158 is already newer than 156 2026-02-13T20:13:21.494 INFO:tasks.rados.rados.0.trial188.stdout:448: oid 3 version 158 is already newer than 155 2026-02-13T20:13:21.494 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 3 v 158 (ObjNum 186 snap 46 seq_num 186) dirty exists 2026-02-13T20:13:21.494 INFO:tasks.rados.rados.0.trial188.stdout:448: left oid 3 (ObjNum 186 snap 46 seq_num 186) 2026-02-13T20:13:21.494 INFO:tasks.rados.rados.0.trial188.stdout:448: done (1 left) 2026-02-13T20:13:21.494 INFO:tasks.rados.rados.0.trial188.stdout:451: snap_create 2026-02-13T20:13:21.495 INFO:tasks.rados.rados.0.trial188.stdout:450: finishing copy_from to trial18843701-31 2026-02-13T20:13:21.495 INFO:tasks.rados.rados.0.trial188.stdout:450: got expected ENOENT (src dne) 2026-02-13T20:13:21.495 INFO:tasks.rados.rados.0.trial188.stdout:450: finishing copy_from racing read to trial18843701-31 2026-02-13T20:13:22.494 INFO:tasks.rados.rados.0.trial188.stdout:450: done (1 left) 2026-02-13T20:13:22.495 INFO:tasks.rados.rados.0.trial188.stdout:451: done (0 left) 2026-02-13T20:13:22.495 INFO:tasks.rados.rados.0.trial188.stdout:452: write (excl) oid 33 current snap is 47 2026-02-13T20:13:22.495 INFO:tasks.rados.rados.0.trial188.stdout:452: seq_num 187 ranges {742909=464035,1976368=754051} 2026-02-13T20:13:22.499 INFO:tasks.rados.rados.0.trial188.stdout:452: writing trial18843701-33 from 742909 to 1206944 tid 1 2026-02-13T20:13:22.504 INFO:tasks.rados.rados.0.trial188.stdout:452: writing trial18843701-33 from 1976368 to 2730419 tid 2 2026-02-13T20:13:22.505 INFO:tasks.rados.rados.0.trial188.stdout:453: write oid 8 current snap is 47 2026-02-13T20:13:22.505 INFO:tasks.rados.rados.0.trial188.stdout:453: seq_num 188 ranges {759716=539284,2034850=614062} 2026-02-13T20:13:22.509 INFO:tasks.rados.rados.0.trial188.stdout:453: writing trial18843701-8 from 759716 to 1299000 tid 1 2026-02-13T20:13:22.515 INFO:tasks.rados.rados.0.trial188.stdout:453: writing trial18843701-8 from 2034850 to 2648912 tid 2 2026-02-13T20:13:22.515 INFO:tasks.rados.rados.0.trial188.stdout:454: write oid 21 current snap is 47 2026-02-13T20:13:22.515 INFO:tasks.rados.rados.0.trial188.stdout:454: seq_num 189 ranges {776523=614533,1976979=757720} 2026-02-13T20:13:22.520 INFO:tasks.rados.rados.0.trial188.stdout:454: writing trial18843701-21 from 776523 to 1391056 tid 1 2026-02-13T20:13:22.528 INFO:tasks.rados.rados.0.trial188.stdout:454: writing trial18843701-21 from 1976979 to 2734699 tid 2 2026-02-13T20:13:22.529 INFO:tasks.rados.rados.0.trial188.stdout:455: delete oid 48 current snap is 47 2026-02-13T20:13:22.529 INFO:tasks.rados.rados.0.trial188.stdout:452: finishing write tid 1 to trial18843701-33 2026-02-13T20:13:22.529 INFO:tasks.rados.rados.0.trial188.stdout:452: finishing write tid 2 to trial18843701-33 2026-02-13T20:13:22.529 INFO:tasks.rados.rados.0.trial188.stdout:452: finishing write tid 3 to trial18843701-33 2026-02-13T20:13:22.529 INFO:tasks.rados.rados.0.trial188.stdout:452: finishing write tid 4 to trial18843701-33 2026-02-13T20:13:22.529 INFO:tasks.rados.rados.0.trial188.stdout:452: oid 33 updating version 0 to 96 2026-02-13T20:13:22.529 INFO:tasks.rados.rados.0.trial188.stdout:452: oid 33 version 96 is already newer than 95 2026-02-13T20:13:22.530 INFO:tasks.rados.rados.0.trial188.stdout:452: oid 33 updating version 96 to 97 2026-02-13T20:13:22.530 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 33 v 97 (ObjNum 187 snap 47 seq_num 187) dirty exists 2026-02-13T20:13:22.530 INFO:tasks.rados.rados.0.trial188.stdout:452: left oid 33 (ObjNum 187 snap 47 seq_num 187) 2026-02-13T20:13:22.530 INFO:tasks.rados.rados.0.trial188.stdout:453: finishing write tid 1 to trial18843701-8 2026-02-13T20:13:22.530 INFO:tasks.rados.rados.0.trial188.stdout:453: finishing write tid 2 to trial18843701-8 2026-02-13T20:13:22.530 INFO:tasks.rados.rados.0.trial188.stdout:453: finishing write tid 3 to trial18843701-8 2026-02-13T20:13:22.530 INFO:tasks.rados.rados.0.trial188.stdout:453: finishing write tid 4 to trial18843701-8 2026-02-13T20:13:22.530 INFO:tasks.rados.rados.0.trial188.stdout:453: oid 8 updating version 0 to 117 2026-02-13T20:13:22.530 INFO:tasks.rados.rados.0.trial188.stdout:453: oid 8 version 117 is already newer than 116 2026-02-13T20:13:22.530 INFO:tasks.rados.rados.0.trial188.stdout:453: oid 8 updating version 117 to 118 2026-02-13T20:13:22.530 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 8 v 118 (ObjNum 188 snap 47 seq_num 188) dirty exists 2026-02-13T20:13:22.530 INFO:tasks.rados.rados.0.trial188.stdout:453: left oid 8 (ObjNum 188 snap 47 seq_num 188) 2026-02-13T20:13:22.545 INFO:tasks.rados.rados.0.trial188.stdout:454: finishing write tid 1 to trial18843701-21 2026-02-13T20:13:22.545 INFO:tasks.rados.rados.0.trial188.stdout:454: finishing write tid 2 to trial18843701-21 2026-02-13T20:13:22.546 INFO:tasks.rados.rados.0.trial188.stdout:454: finishing write tid 3 to trial18843701-21 2026-02-13T20:13:22.546 INFO:tasks.rados.rados.0.trial188.stdout:454: finishing write tid 4 to trial18843701-21 2026-02-13T20:13:22.546 INFO:tasks.rados.rados.0.trial188.stdout:454: oid 21 updating version 0 to 47 2026-02-13T20:13:22.546 INFO:tasks.rados.rados.0.trial188.stdout:454: oid 21 version 47 is already newer than 46 2026-02-13T20:13:22.546 INFO:tasks.rados.rados.0.trial188.stdout:454: oid 21 updating version 47 to 48 2026-02-13T20:13:22.546 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 21 v 48 (ObjNum 189 snap 47 seq_num 189) dirty exists 2026-02-13T20:13:22.546 INFO:tasks.rados.rados.0.trial188.stdout:454: left oid 21 (ObjNum 189 snap 47 seq_num 189) 2026-02-13T20:13:22.546 INFO:tasks.rados.rados.0.trial188.stdout:452: done (3 left) 2026-02-13T20:13:22.546 INFO:tasks.rados.rados.0.trial188.stdout:453: done (2 left) 2026-02-13T20:13:22.546 INFO:tasks.rados.rados.0.trial188.stdout:454: done (1 left) 2026-02-13T20:13:22.546 INFO:tasks.rados.rados.0.trial188.stdout:455: done (0 left) 2026-02-13T20:13:22.547 INFO:tasks.rados.rados.0.trial188.stdout:456: copy_from oid 13 from oid 33 current snap is 47 2026-02-13T20:13:22.547 INFO:tasks.rados.rados.0.trial188.stdout:457: read oid 32 snap -1 2026-02-13T20:13:22.547 INFO:tasks.rados.rados.0.trial188.stdout:457: expect (ObjNum 185 snap 45 seq_num 185) 2026-02-13T20:13:22.547 INFO:tasks.rados.rados.0.trial188.stdout:458: snap_remove snap 36 2026-02-13T20:13:23.499 INFO:tasks.rados.rados.0.trial188.stdout:458: done (2 left) 2026-02-13T20:13:23.499 INFO:tasks.rados.rados.0.trial188.stdout:459: rollback oid 9 current snap is 47 2026-02-13T20:13:23.499 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 9 to 42 2026-02-13T20:13:23.499 INFO:tasks.rados.rados.0.trial188.stdout:457: expect (ObjNum 185 snap 45 seq_num 185) 2026-02-13T20:13:23.642 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2607351 2026-02-13T20:13:23.676 INFO:tasks.rados.rados.0.trial188.stdout:456: finishing copy_from racing read to trial18843701-13 2026-02-13T20:13:23.676 INFO:tasks.rados.rados.0.trial188.stdout:456: finishing copy_from to trial18843701-13 2026-02-13T20:13:23.676 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 13 v 97 (ObjNum 187 snap 47 seq_num 187) dirty exists 2026-02-13T20:13:23.676 INFO:tasks.rados.rados.0.trial188.stdout:459: finishing rollback tid 0 to trial18843701-9 2026-02-13T20:13:23.676 INFO:tasks.rados.rados.0.trial188.stdout:459: finishing rollback tid 1 to trial18843701-9 2026-02-13T20:13:23.677 INFO:tasks.rados.rados.0.trial188.stdout:459: finishing rollback tid 2 to trial18843701-9 2026-02-13T20:13:23.677 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 9 v 102 (ObjNum 115 snap 20 seq_num 115) dirty exists 2026-02-13T20:13:23.677 INFO:tasks.rados.rados.0.trial188.stdout:456: done (2 left) 2026-02-13T20:13:23.677 INFO:tasks.rados.rados.0.trial188.stdout:457: done (1 left) 2026-02-13T20:13:23.677 INFO:tasks.rados.rados.0.trial188.stdout:459: done (0 left) 2026-02-13T20:13:23.677 INFO:tasks.rados.rados.0.trial188.stdout:460: snap_remove snap 28 2026-02-13T20:13:24.500 INFO:tasks.rados.rados.0.trial188.stdout:460: done (0 left) 2026-02-13T20:13:24.500 INFO:tasks.rados.rados.0.trial188.stdout:461: delete oid 15 current snap is 47 2026-02-13T20:13:24.504 INFO:tasks.rados.rados.0.trial188.stdout:461: done (0 left) 2026-02-13T20:13:24.504 INFO:tasks.rados.rados.0.trial188.stdout:462: write oid 1 current snap is 47 2026-02-13T20:13:24.504 INFO:tasks.rados.rados.0.trial188.stdout:462: seq_num 192 ranges {426944=556633,1468778=621400,2872744=354200} 2026-02-13T20:13:24.508 INFO:tasks.rados.rados.0.trial188.stdout:462: writing trial18843701-1 from 426944 to 983577 tid 1 2026-02-13T20:13:24.512 INFO:tasks.rados.rados.0.trial188.stdout:462: writing trial18843701-1 from 1468778 to 2090178 tid 2 2026-02-13T20:13:24.516 INFO:tasks.rados.rados.0.trial188.stdout:462: writing trial18843701-1 from 2872744 to 3226944 tid 3 2026-02-13T20:13:24.516 INFO:tasks.rados.rados.0.trial188.stdout:463: write oid 15 current snap is 47 2026-02-13T20:13:24.516 INFO:tasks.rados.rados.0.trial188.stdout:463: seq_num 193 ranges {443751=631882,1810907=765058,3067461=176290} 2026-02-13T20:13:24.520 INFO:tasks.rados.rados.0.trial188.stdout:463: writing trial18843701-15 from 443751 to 1075633 tid 1 2026-02-13T20:13:24.526 INFO:tasks.rados.rados.0.trial188.stdout:463: writing trial18843701-15 from 1810907 to 2575965 tid 2 2026-02-13T20:13:24.528 INFO:tasks.rados.rados.0.trial188.stdout:463: writing trial18843701-15 from 3067461 to 3243751 tid 3 2026-02-13T20:13:24.529 INFO:tasks.rados.rados.0.trial188.stdout:464: snap_create 2026-02-13T20:13:24.530 INFO:tasks.rados.rados.0.trial188.stdout:462: finishing write tid 1 to trial18843701-1 2026-02-13T20:13:24.530 INFO:tasks.rados.rados.0.trial188.stdout:462: finishing write tid 2 to trial18843701-1 2026-02-13T20:13:24.547 INFO:tasks.rados.rados.0.trial188.stdout:462: finishing write tid 3 to trial18843701-1 2026-02-13T20:13:24.547 INFO:tasks.rados.rados.0.trial188.stdout:463: finishing write tid 1 to trial18843701-15 2026-02-13T20:13:24.547 INFO:tasks.rados.rados.0.trial188.stdout:463: finishing write tid 2 to trial18843701-15 2026-02-13T20:13:24.547 INFO:tasks.rados.rados.0.trial188.stdout:462: finishing write tid 4 to trial18843701-1 2026-02-13T20:13:24.547 INFO:tasks.rados.rados.0.trial188.stdout:462: finishing write tid 5 to trial18843701-1 2026-02-13T20:13:24.547 INFO:tasks.rados.rados.0.trial188.stdout:462: oid 1 updating version 0 to 204 2026-02-13T20:13:24.547 INFO:tasks.rados.rados.0.trial188.stdout:462: oid 1 version 204 is already newer than 203 2026-02-13T20:13:24.547 INFO:tasks.rados.rados.0.trial188.stdout:462: oid 1 updating version 204 to 206 2026-02-13T20:13:24.548 INFO:tasks.rados.rados.0.trial188.stdout:462: oid 1 version 206 is already newer than 205 2026-02-13T20:13:24.548 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 1 v 206 (ObjNum 192 snap 47 seq_num 192) dirty exists 2026-02-13T20:13:24.548 INFO:tasks.rados.rados.0.trial188.stdout:462: left oid 1 (ObjNum 192 snap 47 seq_num 192) 2026-02-13T20:13:24.548 INFO:tasks.rados.rados.0.trial188.stdout:463: finishing write tid 3 to trial18843701-15 2026-02-13T20:13:24.548 INFO:tasks.rados.rados.0.trial188.stdout:463: finishing write tid 4 to trial18843701-15 2026-02-13T20:13:24.548 INFO:tasks.rados.rados.0.trial188.stdout:463: finishing write tid 5 to trial18843701-15 2026-02-13T20:13:24.548 INFO:tasks.rados.rados.0.trial188.stdout:463: oid 15 updating version 0 to 175 2026-02-13T20:13:24.548 INFO:tasks.rados.rados.0.trial188.stdout:463: oid 15 updating version 175 to 176 2026-02-13T20:13:24.548 INFO:tasks.rados.rados.0.trial188.stdout:463: oid 15 updating version 176 to 178 2026-02-13T20:13:24.548 INFO:tasks.rados.rados.0.trial188.stdout:463: oid 15 version 178 is already newer than 177 2026-02-13T20:13:24.548 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 15 v 178 (ObjNum 193 snap 47 seq_num 193) dirty exists 2026-02-13T20:13:24.548 INFO:tasks.rados.rados.0.trial188.stdout:463: left oid 15 (ObjNum 193 snap 47 seq_num 193) 2026-02-13T20:13:25.490 INFO:tasks.rados.rados.0.trial188.stdout:462: done (2 left) 2026-02-13T20:13:25.490 INFO:tasks.rados.rados.0.trial188.stdout:463: done (1 left) 2026-02-13T20:13:25.490 INFO:tasks.rados.rados.0.trial188.stdout:464: done (0 left) 2026-02-13T20:13:25.490 INFO:tasks.rados.rados.0.trial188.stdout:465: read oid 29 snap -1 2026-02-13T20:13:25.490 INFO:tasks.rados.rados.0.trial188.stdout:465: expect (ObjNum 45 snap 0 seq_num 45) 2026-02-13T20:13:25.490 INFO:tasks.rados.rados.0.trial188.stdout:466: snap_create 2026-02-13T20:13:25.499 INFO:tasks.rados.rados.0.trial188.stdout:465: expect (ObjNum 45 snap 0 seq_num 45) 2026-02-13T20:13:25.526 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1954283 2026-02-13T20:13:25.835 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-13T20:13:25.835 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-13T20:13:25.835 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-13T20:13:25.835 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-13T20:13:25.849 INFO:tasks.ceph.mon.a:Started 2026-02-13T20:13:25.849 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.c 2026-02-13T20:13:25.849 INFO:tasks.mon_thrash:Sending STOP to mon c 2026-02-13T20:13:25.849 INFO:tasks.ceph.mon.c:Sent signal 19 2026-02-13T20:13:25.849 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-13T20:13:40.562 INFO:tasks.rados.rados.0.trial188.stdout:465: done (1 left) 2026-02-13T20:13:40.562 INFO:tasks.rados.rados.0.trial188.stdout:466: done (0 left) 2026-02-13T20:13:40.562 INFO:tasks.rados.rados.0.trial188.stdout:467: copy_from oid 47 from oid 49 current snap is 49 2026-02-13T20:13:40.562 INFO:tasks.rados.rados.0.trial188.stdout:468: write (excl) oid 39 current snap is 49 2026-02-13T20:13:40.562 INFO:tasks.rados.rados.0.trial188.stdout:468: seq_num 194 ranges {460558=707131,1869389=508716,3094884=165674} 2026-02-13T20:13:40.566 INFO:tasks.rados.rados.0.trial188.stdout:468: writing trial18843701-39 from 460558 to 1167689 tid 1 2026-02-13T20:13:40.571 INFO:tasks.rados.rados.0.trial188.stdout:468: writing trial18843701-39 from 1869389 to 2378105 tid 2 2026-02-13T20:13:40.574 INFO:tasks.rados.rados.0.trial188.stdout:468: writing trial18843701-39 from 3094884 to 3260558 tid 3 2026-02-13T20:13:40.574 INFO:tasks.rados.rados.0.trial188.stdout:469: read oid 30 snap -1 2026-02-13T20:13:40.574 INFO:tasks.rados.rados.0.trial188.stdout:469: expect (ObjNum 172 snap 37 seq_num 172) 2026-02-13T20:13:40.574 INFO:tasks.rados.rados.0.trial188.stdout:470: snap_create 2026-02-13T20:13:40.578 INFO:tasks.rados.rados.0.trial188.stdout:469: expect (ObjNum 172 snap 37 seq_num 172) 2026-02-13T20:13:40.578 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:13:40.658 INFO:tasks.rados.rados.0.trial188.stdout:467: finishing copy_from racing read to trial18843701-47 2026-02-13T20:13:40.658 INFO:tasks.rados.rados.0.trial188.stdout:467: finishing copy_from to trial18843701-47 2026-02-13T20:13:40.659 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 47 v 159 (ObjNum 179 snap 41 seq_num 179) dirty exists 2026-02-13T20:13:40.850 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.c 2026-02-13T20:13:40.850 INFO:tasks.mon_thrash:Sending CONT to mon c 2026-02-13T20:13:40.850 INFO:tasks.ceph.mon.c:Sent signal 18 2026-02-13T20:13:40.851 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-13T20:13:40.851 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T20:13:40.879 INFO:tasks.rados.rados.0.trial188.stdout:468: finishing write tid 1 to trial18843701-39 2026-02-13T20:13:40.879 INFO:tasks.rados.rados.0.trial188.stdout:468: finishing write tid 2 to trial18843701-39 2026-02-13T20:13:40.879 INFO:tasks.rados.rados.0.trial188.stdout:468: finishing write tid 3 to trial18843701-39 2026-02-13T20:13:40.879 INFO:tasks.rados.rados.0.trial188.stdout:468: finishing write tid 4 to trial18843701-39 2026-02-13T20:13:40.879 INFO:tasks.rados.rados.0.trial188.stdout:468: finishing write tid 5 to trial18843701-39 2026-02-13T20:13:40.879 INFO:tasks.rados.rados.0.trial188.stdout:468: oid 39 updating version 0 to 135 2026-02-13T20:13:40.879 INFO:tasks.rados.rados.0.trial188.stdout:468: oid 39 updating version 135 to 136 2026-02-13T20:13:40.879 INFO:tasks.rados.rados.0.trial188.stdout:468: oid 39 updating version 136 to 137 2026-02-13T20:13:40.879 INFO:tasks.rados.rados.0.trial188.stdout:468: oid 39 updating version 137 to 138 2026-02-13T20:13:40.879 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 39 v 138 (ObjNum 194 snap 49 seq_num 194) dirty exists 2026-02-13T20:13:40.880 INFO:tasks.rados.rados.0.trial188.stdout:468: left oid 39 (ObjNum 194 snap 49 seq_num 194) 2026-02-13T20:13:40.915 INFO:tasks.rados.rados.0.trial188.stdout:467: done (3 left) 2026-02-13T20:13:40.915 INFO:tasks.rados.rados.0.trial188.stdout:468: done (2 left) 2026-02-13T20:13:40.915 INFO:tasks.rados.rados.0.trial188.stdout:469: done (1 left) 2026-02-13T20:13:40.916 INFO:tasks.rados.rados.0.trial188.stdout:470: done (0 left) 2026-02-13T20:13:40.916 INFO:tasks.rados.rados.0.trial188.stdout:471: write (excl) oid 21 current snap is 50 2026-02-13T20:13:40.916 INFO:tasks.rados.rados.0.trial188.stdout:471: seq_num 195 ranges {477365=782380,1927871=768727,3122307=155058} 2026-02-13T20:13:40.920 INFO:tasks.rados.rados.0.trial188.stdout:471: writing trial18843701-21 from 477365 to 1259745 tid 1 2026-02-13T20:13:40.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.919+0000 7f694d10c640 10 monclient: get_monmap_and_config 2026-02-13T20:13:40.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.919+0000 7f694d10c640 10 monclient: build_initial_monmap 2026-02-13T20:13:40.921 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.919+0000 7f694d10c640 10 monclient: monmap: 2026-02-13T20:13:40.921 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:13:40.921 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:40.921 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:13:40.920224+0000 2026-02-13T20:13:40.921 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:13:40.920224+0000 2026-02-13T20:13:40.921 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:13:40.921 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:40.921 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:13:40.921 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:13:40.921 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:13:40.921 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:40.928 INFO:tasks.rados.rados.0.trial188.stdout:471: writing trial18843701-21 from 1927871 to 2696598 tid 2 2026-02-13T20:13:40.928 INFO:tasks.rados.rados.0.trial188.stdout:471: writing trial18843701-21 from 3122307 to 3277365 tid 3 2026-02-13T20:13:40.928 INFO:tasks.rados.rados.0.trial188.stdout:472: snap_remove snap 46 2026-02-13T20:13:40.931 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.920+0000 7f694d10c640 1 Processor -- start 2026-02-13T20:13:40.931 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.920+0000 7f694d10c640 1 -- start start 2026-02-13T20:13:40.931 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.920+0000 7f694d10c640 10 monclient: init 2026-02-13T20:13:40.931 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.920+0000 7f694d10c640 10 monclient: _reopen_session rank -1 2026-02-13T20:13:40.931 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.920+0000 7f694d10c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:13:40.931 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.920+0000 7f694d10c640 10 monclient(hunting): picked mon.noname-b con 0x7f69481401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:13:40.931 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.920+0000 7f694d10c640 10 monclient(hunting): picked mon.noname-a con 0x7f6948092020 addr v1:10.20.193.110:6789/0 2026-02-13T20:13:40.932 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.920+0000 7f694d10c640 10 monclient(hunting): picked mon.noname-c con 0x7f6948091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:13:40.932 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.920+0000 7f694d10c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f694808b730 con 0x7f6948092020 2026-02-13T20:13:40.932 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.920+0000 7f694d10c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f694805c5b0 con 0x7f6948091950 2026-02-13T20:13:40.932 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.920+0000 7f694d10c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f694808bcf0 con 0x7f69481401c0 2026-02-13T20:13:40.932 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.920+0000 7f694d10c640 10 monclient(hunting): _renew_subs 2026-02-13T20:13:40.932 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.920+0000 7f694d10c640 10 monclient(hunting): authenticate will time out at 782.610603s 2026-02-13T20:13:40.932 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.920+0000 7f6946575640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f6948092020 0x7f69481812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:59094/0 (socket says 10.20.193.110:59094) 2026-02-13T20:13:40.932 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.920+0000 7f6946d76640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f69481401c0 0x7f6948091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:38684/0 (socket says 10.20.193.110:38684) 2026-02-13T20:13:40.932 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.920+0000 7f6946575640 1 -- 10.20.193.110:0/4139962918 learned_addr learned my addr 10.20.193.110:0/4139962918 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:13:40.932 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.920+0000 7f6945d74640 1 -- 10.20.193.110:0/4139962918 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 770498493 0 0) 0x7f694808bcf0 con 0x7f69481401c0 2026-02-13T20:13:40.932 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.920+0000 7f6945d74640 10 monclient(hunting): _negotiate 2026-02-13T20:13:40.933 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.920+0000 7f6945d74640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:40.933 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.920+0000 7f6945d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:40.933 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.920+0000 7f6945d74640 10 monclient(hunting): my global_id is 4475 2026-02-13T20:13:40.933 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.920+0000 7f6945d74640 1 -- 10.20.193.110:0/4139962918 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69340035e0 con 0x7f69481401c0 2026-02-13T20:13:40.933 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.920+0000 7f6945d74640 1 -- 10.20.193.110:0/4139962918 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3224285623 0 0) 0x7f694808b730 con 0x7f6948092020 2026-02-13T20:13:40.933 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.920+0000 7f6945d74640 10 monclient(hunting): _negotiate 2026-02-13T20:13:40.933 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.920+0000 7f6945d74640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:40.933 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.920+0000 7f6945d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:40.933 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.920+0000 7f6945d74640 10 monclient(hunting): my global_id is 84099 2026-02-13T20:13:40.933 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.920+0000 7f6945d74640 1 -- 10.20.193.110:0/4139962918 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f694808bcf0 con 0x7f6948092020 2026-02-13T20:13:40.933 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.921+0000 7f6945d74640 1 -- 10.20.193.110:0/4139962918 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1730755854 0 0) 0x7f69340035e0 con 0x7f69481401c0 2026-02-13T20:13:40.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.921+0000 7f6945d74640 1 -- 10.20.193.110:0/4139962918 >> v1:10.20.193.188:6789/0 conn(0x7f6948091950 legacy=0x7f69481a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:40.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.921+0000 7f6945d74640 1 -- 10.20.193.110:0/4139962918 >> v1:10.20.193.110:6789/0 conn(0x7f6948092020 legacy=0x7f69481812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:40.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.921+0000 7f6945d74640 10 monclient: _finish_hunting 0 2026-02-13T20:13:40.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.921+0000 7f6945d74640 1 monclient: found mon.noname-b 2026-02-13T20:13:40.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.921+0000 7f6945d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:13:40.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.921+0000 7f6945d74640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:13:40.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.921+0000 7f6945d74640 1 -- 10.20.193.110:0/4139962918 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6948140590 con 0x7f69481401c0 2026-02-13T20:13:40.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.921+0000 7f6945d74640 10 monclient: _finish_auth 0 2026-02-13T20:13:40.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.921+0000 7f6945d74640 10 monclient: _check_auth_tickets 2026-02-13T20:13:40.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.921+0000 7f6945d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:13:40.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.921+0000 7f694d10c640 5 monclient: authenticate success, global_id 4475 2026-02-13T20:13:40.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.921+0000 7f6945d74640 1 -- 10.20.193.110:0/4139962918 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f693c002dd0 con 0x7f69481401c0 2026-02-13T20:13:40.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.921+0000 7f694d10c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:13:40.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.921+0000 7f6945d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:40.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.921+0000 7f6945d74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:13:40.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.921+0000 7f6945d74640 10 monclient: dump: 2026-02-13T20:13:40.935 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:40.935 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:40.935 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:40.935 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:40.935 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:40.935 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:40.935 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:40.935 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:40.935 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:40.936 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:40.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.921+0000 7f694d10c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:13:40.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.921+0000 7f6945d74640 1 -- 10.20.193.110:0/4139962918 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f693c002f30 con 0x7f69481401c0 2026-02-13T20:13:40.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.921+0000 7f6945d74640 10 monclient: handle_config config(0 keys) 2026-02-13T20:13:40.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.921+0000 7f694d10c640 10 monclient: get_monmap_and_config success 2026-02-13T20:13:40.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.921+0000 7f694d10c640 4 set_mon_vals no callback set 2026-02-13T20:13:40.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.921+0000 7f6945d74640 1 -- 10.20.193.110:0/4139962918 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f693c003340 con 0x7f69481401c0 2026-02-13T20:13:40.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.921+0000 7f6945d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:40.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.921+0000 7f6945d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:13:40.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.921+0000 7f6945d74640 10 monclient: dump: 2026-02-13T20:13:40.936 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:40.936 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:40.937 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:40.937 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:40.937 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:40.937 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:40.937 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:40.937 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:40.937 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:40.937 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:40.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.921+0000 7f694d10c640 10 monclient: shutdown 2026-02-13T20:13:40.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.921+0000 7f694d10c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:13:40.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.921+0000 7f694d10c640 1 -- 10.20.193.110:0/4139962918 >> v1:10.20.193.110:6790/0 conn(0x7f69481401c0 legacy=0x7f6948091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:40.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.921+0000 7f694d10c640 1 -- 10.20.193.110:0/4139962918 shutdown_connections 2026-02-13T20:13:40.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.921+0000 7f694d10c640 1 -- 10.20.193.110:0/4139962918 >> 10.20.193.110:0/4139962918 conn(0x7f6948054e90 msgr2=0x7f6948058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:13:40.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.921+0000 7f694d10c640 1 -- 10.20.193.110:0/4139962918 shutdown_connections 2026-02-13T20:13:40.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.921+0000 7f694d10c640 1 -- 10.20.193.110:0/4139962918 wait complete. 2026-02-13T20:13:40.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.921+0000 7f694d10c640 10 monclient: build_initial_monmap 2026-02-13T20:13:40.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.921+0000 7f694d10c640 10 monclient: monmap: 2026-02-13T20:13:40.938 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:13:40.938 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:13:40.938 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:13:40.938 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:13:40.938 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:13:40.938 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:13:40.938 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:13:40.939 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:13:40.939 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:13:40.939 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:40.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.922+0000 7f694d10c640 1 Processor -- start 2026-02-13T20:13:40.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.922+0000 7f694d10c640 1 -- start start 2026-02-13T20:13:40.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.922+0000 7f694d10c640 10 monclient: init 2026-02-13T20:13:40.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.922+0000 7f694d10c640 10 monclient: _reopen_session rank -1 2026-02-13T20:13:40.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.922+0000 7f694d10c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:13:40.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.922+0000 7f694d10c640 10 monclient(hunting): picked mon.noname-c con 0x7f6948091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:13:40.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.922+0000 7f694d10c640 10 monclient(hunting): picked mon.noname-a con 0x7f69481401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:13:40.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.922+0000 7f694d10c640 10 monclient(hunting): picked mon.noname-b con 0x7f69481308b0 addr v1:10.20.193.188:6789/0 2026-02-13T20:13:40.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.922+0000 7f694d10c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f694805d320 con 0x7f69481401c0 2026-02-13T20:13:40.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.922+0000 7f694d10c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6948131000 con 0x7f69481308b0 2026-02-13T20:13:40.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.922+0000 7f694d10c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6948131810 con 0x7f6948091950 2026-02-13T20:13:40.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.922+0000 7f694d10c640 10 monclient(hunting): _renew_subs 2026-02-13T20:13:40.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.922+0000 7f694d10c640 10 monclient(hunting): authenticate will time out at 782.612515s 2026-02-13T20:13:40.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.922+0000 7f6946d76640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f6948091950 0x7f694813e670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:38694/0 (socket says 10.20.193.110:38694) 2026-02-13T20:13:40.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.922+0000 7f6946d76640 1 -- 10.20.193.110:0/3191240913 learned_addr learned my addr 10.20.193.110:0/3191240913 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:13:40.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.922+0000 7f69277fe640 1 -- 10.20.193.110:0/3191240913 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4016333303 0 0) 0x7f6948131810 con 0x7f6948091950 2026-02-13T20:13:40.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.922+0000 7f69277fe640 10 monclient(hunting): _negotiate 2026-02-13T20:13:40.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.922+0000 7f69277fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:40.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.922+0000 7f69277fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:40.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.922+0000 7f69277fe640 10 monclient(hunting): my global_id is 4478 2026-02-13T20:13:40.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.922+0000 7f69277fe640 1 -- 10.20.193.110:0/3191240913 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69140035e0 con 0x7f6948091950 2026-02-13T20:13:40.941 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.922+0000 7f69277fe640 1 -- 10.20.193.110:0/3191240913 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1616210817 0 0) 0x7f694805d320 con 0x7f69481401c0 2026-02-13T20:13:40.941 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.922+0000 7f69277fe640 10 monclient(hunting): _negotiate 2026-02-13T20:13:40.941 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.922+0000 7f69277fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:40.941 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.922+0000 7f69277fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:40.941 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.922+0000 7f69277fe640 10 monclient(hunting): my global_id is 84102 2026-02-13T20:13:40.941 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.922+0000 7f69277fe640 1 -- 10.20.193.110:0/3191240913 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6948131810 con 0x7f69481401c0 2026-02-13T20:13:40.941 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.922+0000 7f69277fe640 1 -- 10.20.193.110:0/3191240913 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1196989261 0 0) 0x7f69140035e0 con 0x7f6948091950 2026-02-13T20:13:40.941 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.922+0000 7f69277fe640 1 -- 10.20.193.110:0/3191240913 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f694805d320 con 0x7f6948091950 2026-02-13T20:13:40.941 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.922+0000 7f69277fe640 1 -- 10.20.193.110:0/3191240913 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f693c003250 con 0x7f6948091950 2026-02-13T20:13:40.941 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.922+0000 7f69277fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:13:40.941 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.922+0000 7f69277fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:13:40.941 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.922+0000 7f69277fe640 10 monclient(hunting): dump: 2026-02-13T20:13:40.941 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:40.942 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:40.942 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:40.942 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:40.942 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:40.942 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:40.942 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:40.942 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:40.942 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:40.942 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:40.942 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.922+0000 7f69277fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:13:40.942 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.922+0000 7f69277fe640 1 -- 10.20.193.110:0/3191240913 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4170356726 0 0) 0x7f6948131810 con 0x7f69481401c0 2026-02-13T20:13:40.942 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.922+0000 7f69277fe640 1 -- 10.20.193.110:0/3191240913 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f69140035e0 con 0x7f69481401c0 2026-02-13T20:13:40.943 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.922+0000 7f69277fe640 1 -- 10.20.193.110:0/3191240913 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f6930003170 con 0x7f69481401c0 2026-02-13T20:13:40.943 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.922+0000 7f69277fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:13:40.943 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.922+0000 7f69277fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:13:40.943 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.922+0000 7f69277fe640 10 monclient(hunting): dump: 2026-02-13T20:13:40.943 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:40.943 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:40.943 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:40.943 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:40.943 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:40.943 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:40.943 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:40.943 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:40.944 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:40.944 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:40.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.923+0000 7f69277fe640 1 -- 10.20.193.110:0/3191240913 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3468110604 0 0) 0x7f694805d320 con 0x7f6948091950 2026-02-13T20:13:40.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.923+0000 7f69277fe640 1 -- 10.20.193.110:0/3191240913 >> v1:10.20.193.188:6789/0 conn(0x7f69481308b0 legacy=0x7f6948195080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:40.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.923+0000 7f69277fe640 1 -- 10.20.193.110:0/3191240913 >> v1:10.20.193.110:6789/0 conn(0x7f69481401c0 legacy=0x7f6948193960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:40.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.923+0000 7f69277fe640 10 monclient: _finish_hunting 0 2026-02-13T20:13:40.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.923+0000 7f69277fe640 1 monclient: found mon.c 2026-02-13T20:13:40.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.923+0000 7f69277fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:13:40.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.923+0000 7f69277fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:13:40.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.923+0000 7f69277fe640 1 -- 10.20.193.110:0/3191240913 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f694812fd50 con 0x7f6948091950 2026-02-13T20:13:40.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.923+0000 7f69277fe640 10 monclient: _finish_auth 0 2026-02-13T20:13:40.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.923+0000 7f69277fe640 10 monclient: _check_auth_tickets 2026-02-13T20:13:40.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.923+0000 7f69277fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:13:40.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.923+0000 7f694d10c640 5 monclient: authenticate success, global_id 4478 2026-02-13T20:13:40.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.923+0000 7f694d10c640 10 monclient: _renew_subs 2026-02-13T20:13:40.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.923+0000 7f694d10c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:13:40.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.923+0000 7f694d10c640 1 -- 10.20.193.110:0/3191240913 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f69481320b0 con 0x7f6948091950 2026-02-13T20:13:40.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.923+0000 7f694d10c640 10 monclient: _renew_subs 2026-02-13T20:13:40.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.923+0000 7f694d10c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:13:40.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.923+0000 7f694d10c640 1 -- 10.20.193.110:0/3191240913 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f69481529b0 con 0x7f6948091950 2026-02-13T20:13:40.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.923+0000 7f69277fe640 1 -- 10.20.193.110:0/3191240913 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f693c004b50 con 0x7f6948091950 2026-02-13T20:13:40.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.923+0000 7f69277fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:13:40.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.923+0000 7f69277fe640 1 -- 10.20.193.110:0/3191240913 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f693c004ef0 con 0x7f6948091950 2026-02-13T20:13:40.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.923+0000 7f69277fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:40.946 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.923+0000 7f69277fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:13:40.946 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.923+0000 7f69277fe640 10 monclient: dump: 2026-02-13T20:13:40.946 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:40.946 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:40.946 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:40.946 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:40.946 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:40.946 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:40.946 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:40.946 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:40.946 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:40.946 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:40.947 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.923+0000 7f6945573640 4 set_mon_vals no callback set 2026-02-13T20:13:40.947 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.923+0000 7f694d10c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:13:40.947 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.923+0000 7f694d10c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:13:40.947 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.923+0000 7f694d10c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:13:40.947 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.923+0000 7f69277fe640 1 -- 10.20.193.110:0/3191240913 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f693c005050 con 0x7f6948091950 2026-02-13T20:13:40.947 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.923+0000 7f694d10c640 1 -- 10.20.193.110:0/3191240913 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69480008d0 con 0x7f6948091950 2026-02-13T20:13:40.947 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.923+0000 7f69277fe640 1 -- 10.20.193.110:0/3191240913 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(113..113 src has 1..113) ==== 3915+0+0 (unknown 1040174270 0 0) 0x7f693c04ea60 con 0x7f6948091950 2026-02-13T20:13:40.947 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.924+0000 7f6946575640 10 monclient: get_auth_request con 0x7f691403faa0 auth_method 0 2026-02-13T20:13:40.947 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.926+0000 7f69277fe640 1 -- 10.20.193.110:0/3191240913 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f693c017270 con 0x7f6948091950 2026-02-13T20:13:40.947 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.926+0000 7f69277fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:13:40.947 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:40.926+0000 7f69277fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:13:41.073 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.072+0000 7f694d10c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T20:13:41.073 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.072+0000 7f694d10c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T20:13:41.074 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.072+0000 7f694d10c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:13:41.074 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.072+0000 7f694d10c640 1 -- 10.20.193.110:0/3191240913 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6948058410 con 0x7f6948091950 2026-02-13T20:13:41.074 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.072+0000 7f69277fe640 1 -- 10.20.193.110:0/3191240913 <== mon.2 v1:10.20.193.110:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 2271090943) 0x7f693c016a20 con 0x7f6948091950 2026-02-13T20:13:41.074 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.072+0000 7f69277fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T20:13:41.074 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.072+0000 7f69277fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:13:41.074 INFO:teuthology.orchestra.run.trial110.stdout:{"election_epoch":12,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","modified":"2026-02-13T20:11:07.161192Z","created":"2026-02-13T20:11:07.161192Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6789","nonce":0}]},"addr":"10.20.193.110:6789/0","public_addr":"10.20.193.110:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161241+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6789","nonce":0}]},"addr":"10.20.193.188:6789/0","public_addr":"10.20.193.188:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161242+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6790","nonce":0}]},"addr":"10.20.193.110:6790/0","public_addr":"10.20.193.110:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161243+0000","crush_location":[]}]}} 2026-02-13T20:13:41.075 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.073+0000 7f694d10c640 1 -- 10.20.193.110:0/3191240913 >> v1:10.20.193.188:6812/1623052694 conn(0x7f691403faa0 legacy=0x7f691405ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:41.075 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.073+0000 7f694d10c640 10 monclient: shutdown 2026-02-13T20:13:41.075 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.073+0000 7f694d10c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:13:41.076 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.073+0000 7f694d10c640 1 -- 10.20.193.110:0/3191240913 >> v1:10.20.193.110:6790/0 conn(0x7f6948091950 legacy=0x7f694813e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:41.076 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.073+0000 7f694d10c640 1 -- 10.20.193.110:0/3191240913 shutdown_connections 2026-02-13T20:13:41.076 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.073+0000 7f694d10c640 1 -- 10.20.193.110:0/3191240913 >> 10.20.193.110:0/3191240913 conn(0x7f6948054e90 msgr2=0x7f6948088e30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:13:41.076 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.073+0000 7f694d10c640 1 -- 10.20.193.110:0/3191240913 shutdown_connections 2026-02-13T20:13:41.076 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.073+0000 7f694d10c640 1 -- 10.20.193.110:0/3191240913 wait complete. 2026-02-13T20:13:41.082 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-13T20:13:41.083 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-13T20:13:41.083 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T20:13:41.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.147+0000 7f91f3eb8640 10 monclient: get_monmap_and_config 2026-02-13T20:13:41.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.147+0000 7f91f3eb8640 10 monclient: build_initial_monmap 2026-02-13T20:13:41.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.147+0000 7f91f3eb8640 10 monclient: monmap: 2026-02-13T20:13:41.149 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:13:41.149 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:41.149 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:13:41.148386+0000 2026-02-13T20:13:41.149 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:13:41.148386+0000 2026-02-13T20:13:41.149 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:13:41.149 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:41.150 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:13:41.150 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:13:41.150 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:13:41.150 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:41.161 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.148+0000 7f91f3eb8640 1 Processor -- start 2026-02-13T20:13:41.161 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.148+0000 7f91f3eb8640 1 -- start start 2026-02-13T20:13:41.161 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.148+0000 7f91f3eb8640 10 monclient: init 2026-02-13T20:13:41.161 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.148+0000 7f91f3eb8640 10 monclient: _reopen_session rank -1 2026-02-13T20:13:41.162 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.148+0000 7f91f3eb8640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:13:41.162 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.148+0000 7f91f3eb8640 10 monclient(hunting): picked mon.noname-c con 0x7f91ec1401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:13:41.162 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.148+0000 7f91f3eb8640 10 monclient(hunting): picked mon.noname-a con 0x7f91ec092020 addr v1:10.20.193.110:6789/0 2026-02-13T20:13:41.162 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.148+0000 7f91f3eb8640 10 monclient(hunting): picked mon.noname-b con 0x7f91ec091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:13:41.162 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.148+0000 7f91f3eb8640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91ec08b730 con 0x7f91ec092020 2026-02-13T20:13:41.162 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.148+0000 7f91f3eb8640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91ec05c5b0 con 0x7f91ec1401c0 2026-02-13T20:13:41.162 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.148+0000 7f91f3eb8640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91ec08bcf0 con 0x7f91ec091950 2026-02-13T20:13:41.162 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.148+0000 7f91f3eb8640 10 monclient(hunting): _renew_subs 2026-02-13T20:13:41.162 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.148+0000 7f91f3eb8640 10 monclient(hunting): authenticate will time out at 782.838776s 2026-02-13T20:13:41.162 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.148+0000 7f91f242e640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f91ec091950 0x7f91ec1a2a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:56036/0 (socket says 10.20.193.110:56036) 2026-02-13T20:13:41.162 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.148+0000 7f91f242e640 1 -- 10.20.193.110:0/1492316758 learned_addr learned my addr 10.20.193.110:0/1492316758 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:13:41.163 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.149+0000 7f91f0c2b640 1 -- 10.20.193.110:0/1492316758 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1421622802 0 0) 0x7f91ec08b730 con 0x7f91ec092020 2026-02-13T20:13:41.163 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.149+0000 7f91f0c2b640 10 monclient(hunting): _negotiate 2026-02-13T20:13:41.163 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.149+0000 7f91f0c2b640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:41.163 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.149+0000 7f91f0c2b640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:41.163 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.149+0000 7f91f0c2b640 10 monclient(hunting): my global_id is 84105 2026-02-13T20:13:41.163 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.149+0000 7f91f0c2b640 1 -- 10.20.193.110:0/1492316758 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91d40035e0 con 0x7f91ec092020 2026-02-13T20:13:41.163 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.149+0000 7f91f0c2b640 1 -- 10.20.193.110:0/1492316758 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2895412518 0 0) 0x7f91ec08bcf0 con 0x7f91ec091950 2026-02-13T20:13:41.163 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.149+0000 7f91f0c2b640 10 monclient(hunting): _negotiate 2026-02-13T20:13:41.163 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.149+0000 7f91f0c2b640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:41.163 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.149+0000 7f91f0c2b640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:41.163 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.149+0000 7f91f0c2b640 10 monclient(hunting): my global_id is 4481 2026-02-13T20:13:41.163 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.149+0000 7f91f0c2b640 1 -- 10.20.193.110:0/1492316758 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91ec08b730 con 0x7f91ec091950 2026-02-13T20:13:41.164 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.149+0000 7f91f0c2b640 1 -- 10.20.193.110:0/1492316758 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2225011804 0 0) 0x7f91d40035e0 con 0x7f91ec092020 2026-02-13T20:13:41.164 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.149+0000 7f91f0c2b640 1 -- 10.20.193.110:0/1492316758 >> v1:10.20.193.110:6790/0 conn(0x7f91ec091950 legacy=0x7f91ec1a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:41.164 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.149+0000 7f91f0c2b640 1 -- 10.20.193.110:0/1492316758 >> v1:10.20.193.188:6789/0 conn(0x7f91ec1401c0 legacy=0x7f91ec091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:41.164 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.149+0000 7f91f0c2b640 10 monclient: _finish_hunting 0 2026-02-13T20:13:41.164 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.149+0000 7f91f0c2b640 1 monclient: found mon.noname-a 2026-02-13T20:13:41.164 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.149+0000 7f91f0c2b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:13:41.164 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.149+0000 7f91f0c2b640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:13:41.164 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.149+0000 7f91f0c2b640 1 -- 10.20.193.110:0/1492316758 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91ec140590 con 0x7f91ec092020 2026-02-13T20:13:41.164 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.149+0000 7f91f0c2b640 10 monclient: _finish_auth 0 2026-02-13T20:13:41.164 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.149+0000 7f91f0c2b640 10 monclient: _check_auth_tickets 2026-02-13T20:13:41.164 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.149+0000 7f91f0c2b640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:13:41.164 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.149+0000 7f91f0c2b640 1 -- 10.20.193.110:0/1492316758 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f91e0002dd0 con 0x7f91ec092020 2026-02-13T20:13:41.165 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.149+0000 7f91f3eb8640 5 monclient: authenticate success, global_id 84105 2026-02-13T20:13:41.165 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.149+0000 7f91f3eb8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:13:41.165 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.149+0000 7f91f0c2b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:41.165 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.149+0000 7f91f0c2b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:13:41.165 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.149+0000 7f91f0c2b640 10 monclient: dump: 2026-02-13T20:13:41.165 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:41.165 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:41.165 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.165 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.165 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:41.165 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:41.165 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:41.166 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:41.166 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:41.166 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:41.166 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.149+0000 7f91f3eb8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:13:41.166 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.149+0000 7f91f0c2b640 1 -- 10.20.193.110:0/1492316758 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f91e0003020 con 0x7f91ec092020 2026-02-13T20:13:41.166 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.149+0000 7f91f0c2b640 10 monclient: handle_config config(0 keys) 2026-02-13T20:13:41.166 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.149+0000 7f91f0c2b640 1 -- 10.20.193.110:0/1492316758 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f91e0003430 con 0x7f91ec092020 2026-02-13T20:13:41.166 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.149+0000 7f91f3eb8640 10 monclient: get_monmap_and_config success 2026-02-13T20:13:41.166 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.149+0000 7f91f3eb8640 4 set_mon_vals no callback set 2026-02-13T20:13:41.166 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.149+0000 7f91f0c2b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:41.166 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.149+0000 7f91f0c2b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:13:41.166 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.149+0000 7f91f0c2b640 10 monclient: dump: 2026-02-13T20:13:41.167 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:41.167 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:41.167 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.167 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.167 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:41.167 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:41.167 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:41.167 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:41.167 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:41.167 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:41.167 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.149+0000 7f91f3eb8640 10 monclient: shutdown 2026-02-13T20:13:41.167 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.149+0000 7f91f3eb8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:13:41.168 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.149+0000 7f91f3eb8640 1 -- 10.20.193.110:0/1492316758 >> v1:10.20.193.110:6789/0 conn(0x7f91ec092020 legacy=0x7f91ec1812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:41.168 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.149+0000 7f91f3eb8640 1 -- 10.20.193.110:0/1492316758 shutdown_connections 2026-02-13T20:13:41.168 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.149+0000 7f91f3eb8640 1 -- 10.20.193.110:0/1492316758 >> 10.20.193.110:0/1492316758 conn(0x7f91ec054e90 msgr2=0x7f91ec058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:13:41.168 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.149+0000 7f91f3eb8640 1 -- 10.20.193.110:0/1492316758 shutdown_connections 2026-02-13T20:13:41.168 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.149+0000 7f91f3eb8640 1 -- 10.20.193.110:0/1492316758 wait complete. 2026-02-13T20:13:41.168 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.149+0000 7f91f3eb8640 10 monclient: build_initial_monmap 2026-02-13T20:13:41.168 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.149+0000 7f91f3eb8640 10 monclient: monmap: 2026-02-13T20:13:41.168 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:13:41.168 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:13:41.168 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:13:41.168 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:13:41.168 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:13:41.168 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:13:41.169 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:13:41.169 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:13:41.169 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:13:41.169 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:41.169 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91f3eb8640 1 Processor -- start 2026-02-13T20:13:41.169 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91f3eb8640 1 -- start start 2026-02-13T20:13:41.169 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91f3eb8640 10 monclient: init 2026-02-13T20:13:41.169 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91f3eb8640 10 monclient: _reopen_session rank -1 2026-02-13T20:13:41.169 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91f3eb8640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:13:41.169 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91f3eb8640 10 monclient(hunting): picked mon.noname-c con 0x7f91ec091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:13:41.169 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91f3eb8640 10 monclient(hunting): picked mon.noname-b con 0x7f91ec1401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:13:41.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91f3eb8640 10 monclient(hunting): picked mon.noname-a con 0x7f91ec089c80 addr v1:10.20.193.110:6789/0 2026-02-13T20:13:41.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91f3eb8640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91ec130820 con 0x7f91ec089c80 2026-02-13T20:13:41.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91f3eb8640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91ec091020 con 0x7f91ec1401c0 2026-02-13T20:13:41.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91f3eb8640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91ec131d40 con 0x7f91ec091950 2026-02-13T20:13:41.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91f3eb8640 10 monclient(hunting): _renew_subs 2026-02-13T20:13:41.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91f3eb8640 10 monclient(hunting): authenticate will time out at 782.840457s 2026-02-13T20:13:41.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91f1c2d640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f91ec091950 0x7f91ec088e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:56038/0 (socket says 10.20.193.110:56038) 2026-02-13T20:13:41.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91f1c2d640 1 -- 10.20.193.110:0/1521791836 learned_addr learned my addr 10.20.193.110:0/1521791836 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:13:41.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2811284513 0 0) 0x7f91ec130820 con 0x7f91ec089c80 2026-02-13T20:13:41.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91da7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:13:41.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91da7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:41.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91da7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:41.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91da7fc640 10 monclient(hunting): my global_id is 84108 2026-02-13T20:13:41.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91bc0035e0 con 0x7f91ec089c80 2026-02-13T20:13:41.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1064187223 0 0) 0x7f91ec131d40 con 0x7f91ec091950 2026-02-13T20:13:41.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91da7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:13:41.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91da7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:41.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91da7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:41.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91da7fc640 10 monclient(hunting): my global_id is 4484 2026-02-13T20:13:41.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91ec130820 con 0x7f91ec091950 2026-02-13T20:13:41.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4198363881 0 0) 0x7f91bc0035e0 con 0x7f91ec089c80 2026-02-13T20:13:41.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f91ec131d40 con 0x7f91ec089c80 2026-02-13T20:13:41.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f91e80040f0 con 0x7f91ec089c80 2026-02-13T20:13:41.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91da7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:13:41.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91da7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:13:41.172 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91da7fc640 10 monclient(hunting): dump: 2026-02-13T20:13:41.172 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:41.172 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:41.172 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.172 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.172 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:41.172 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:41.172 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:41.172 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:41.172 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:41.172 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:41.172 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91da7fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:13:41.173 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3722642278 0 0) 0x7f91ec130820 con 0x7f91ec091950 2026-02-13T20:13:41.173 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f91bc0035e0 con 0x7f91ec091950 2026-02-13T20:13:41.173 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f91dc003060 con 0x7f91ec091950 2026-02-13T20:13:41.173 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91da7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:13:41.173 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91da7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:13:41.173 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91da7fc640 10 monclient(hunting): dump: 2026-02-13T20:13:41.173 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:41.173 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:41.173 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.173 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.173 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:41.173 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:41.173 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:41.174 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:41.174 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:41.174 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:41.174 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3457547133 0 0) 0x7f91ec131d40 con 0x7f91ec089c80 2026-02-13T20:13:41.174 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 >> v1:10.20.193.110:6790/0 conn(0x7f91ec091950 legacy=0x7f91ec088e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:41.174 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 >> v1:10.20.193.188:6789/0 conn(0x7f91ec1401c0 legacy=0x7f91ec089570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:41.174 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91da7fc640 10 monclient: _finish_hunting 0 2026-02-13T20:13:41.174 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91da7fc640 1 monclient: found mon.a 2026-02-13T20:13:41.174 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91da7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:13:41.174 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91da7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:13:41.174 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91ec132020 con 0x7f91ec089c80 2026-02-13T20:13:41.174 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91da7fc640 10 monclient: _finish_auth 0 2026-02-13T20:13:41.174 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91da7fc640 10 monclient: _check_auth_tickets 2026-02-13T20:13:41.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91da7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:13:41.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91f3eb8640 5 monclient: authenticate success, global_id 84108 2026-02-13T20:13:41.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91f3eb8640 10 monclient: _renew_subs 2026-02-13T20:13:41.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91f3eb8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:13:41.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91f3eb8640 1 -- 10.20.193.110:0/1521791836 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f91ec08c4c0 con 0x7f91ec089c80 2026-02-13T20:13:41.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91f3eb8640 10 monclient: _renew_subs 2026-02-13T20:13:41.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91f3eb8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:13:41.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91f3eb8640 1 -- 10.20.193.110:0/1521791836 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f91ec130570 con 0x7f91ec089c80 2026-02-13T20:13:41.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f91e8004610 con 0x7f91ec089c80 2026-02-13T20:13:41.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91da7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:13:41.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f91e8005b30 con 0x7f91ec089c80 2026-02-13T20:13:41.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91da7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:41.176 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91da7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:13:41.176 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91da7fc640 10 monclient: dump: 2026-02-13T20:13:41.176 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:41.176 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:41.176 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.176 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.176 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:41.176 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:41.176 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:41.176 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:41.176 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:41.176 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:41.177 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.150+0000 7f91dbfff640 4 set_mon_vals no callback set 2026-02-13T20:13:41.177 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91f242e640 1 -- 10.20.193.110:0/1521791836 >> v1:10.20.193.110:6789/0 conn(0x7f91ec089c80 legacy=0x7f91ec195170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2026-02-13T20:13:41.177 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91f242e640 1 -- 10.20.193.110:0/1521791836 >> v1:10.20.193.110:6789/0 conn(0x7f91ec089c80 legacy=0x7f91ec195170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T20:13:41.177 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91f242e640 1 --1- 10.20.193.110:0/1521791836 >> v1:10.20.193.110:6789/0 conn(0x7f91ec089c80 0x7f91ec195170 :-1 s=OPENED pgs=31 gs=3 cs=1 l=1).handle_message read tag failed 2026-02-13T20:13:41.177 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91f242e640 1 --1- 10.20.193.110:0/1521791836 >> v1:10.20.193.110:6789/0 conn(0x7f91ec089c80 0x7f91ec195170 :-1 s=OPENED pgs=31 gs=3 cs=1 l=1).fault on lossy channel, failing 2026-02-13T20:13:41.177 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 10 monclient: ms_handle_reset current mon v1:10.20.193.110:6789/0 2026-02-13T20:13:41.177 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 10 monclient: _reopen_session rank -1 2026-02-13T20:13:41.177 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 >> v1:10.20.193.110:6789/0 conn(0x7f91ec089c80 legacy=0x7f91ec195170 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:13:41.177 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91f3eb8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:13:41.177 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:13:41.177 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 10 monclient(hunting): picked mon.a con 0x7f91bc003c00 addr v1:10.20.193.110:6789/0 2026-02-13T20:13:41.177 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 10 monclient(hunting): picked mon.c con 0x7f91ec091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:13:41.178 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 10 monclient(hunting): picked mon.b con 0x7f91ec1401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:13:41.178 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f91ec131d40 con 0x7f91bc003c00 2026-02-13T20:13:41.178 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f91ec091020 con 0x7f91ec1401c0 2026-02-13T20:13:41.178 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f91ec130820 con 0x7f91ec091950 2026-02-13T20:13:41.178 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 10 monclient(hunting): _renew_subs 2026-02-13T20:13:41.178 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91f3eb8640 1 -- 10.20.193.110:0/1521791836 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f91ec0008d0 con 0x7f91ec092020 2026-02-13T20:13:41.178 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4136805603 0 0) 0x7f91ec0008d0 con 0x7f91bc003c00 2026-02-13T20:13:41.178 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:13:41.178 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:41.178 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-13T20:13:41.178 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 --> v1:10.20.193.110:6789/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7f91bc06c3a0 con 0x7f91bc003c00 2026-02-13T20:13:41.178 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1228045988 0 0) 0x7f91ec130820 con 0x7f91ec091950 2026-02-13T20:13:41.178 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:13:41.179 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:41.179 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-13T20:13:41.179 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 --> v1:10.20.193.110:6790/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7f91ec0008d0 con 0x7f91ec091950 2026-02-13T20:13:41.179 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3090675236 0 0) 0x7f91bc06c3a0 con 0x7f91ec092020 2026-02-13T20:13:41.179 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:13:41.179 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:41.179 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:41.179 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 10 monclient(hunting): my global_id is 84111 2026-02-13T20:13:41.179 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91ec130820 con 0x7f91ec092020 2026-02-13T20:13:41.179 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (unknown 1373687356 0 0) 0x7f91ec130820 con 0x7f91bc003c00 2026-02-13T20:13:41.179 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 >> v1:10.20.193.110:6790/0 conn(0x7f91ec091950 legacy=0x7f91bc046b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:41.179 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 >> v1:10.20.193.188:6789/0 conn(0x7f91ec1401c0 legacy=0x7f91bc068790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:41.180 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 10 monclient: _finish_hunting 0 2026-02-13T20:13:41.180 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 1 monclient: found mon.a 2026-02-13T20:13:41.180 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:13:41.180 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:13:41.180 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+,osdmap=0}) -- 0x7f91bc06d5f0 con 0x7f91bc003c00 2026-02-13T20:13:41.180 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 10 monclient: _finish_auth 0 2026-02-13T20:13:41.180 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 10 monclient: _check_auth_tickets 2026-02-13T20:13:41.180 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:13:41.180 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f91dc003880 con 0x7f91bc003c00 2026-02-13T20:13:41.180 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:41.180 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:13:41.180 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 10 monclient: dump: 2026-02-13T20:13:41.181 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:41.181 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:41.181 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.181 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.181 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:41.181 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:41.181 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:41.181 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:41.181 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:41.181 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:41.181 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3668398393 0 0) 0x7f91bc06d5f0 con 0x7f91ec092020 2026-02-13T20:13:41.181 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f91ec130820 con 0x7f91ec092020 2026-02-13T20:13:41.181 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f91dc003e70 con 0x7f91ec092020 2026-02-13T20:13:41.181 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:41.182 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:13:41.182 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 10 monclient: dump: 2026-02-13T20:13:41.182 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:41.182 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:41.182 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.182 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.182 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:41.182 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:41.182 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:41.182 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:41.182 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:41.182 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:41.182 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f91dc004090 con 0x7f91bc003c00 2026-02-13T20:13:41.182 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:13:41.183 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91db7fe640 4 set_mon_vals no callback set 2026-02-13T20:13:41.183 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2618654808 0 0) 0x7f91ec130820 con 0x7f91ec092020 2026-02-13T20:13:41.183 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.151+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 --> v1:10.20.193.110:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f91ec128b30 con 0x7f91ec092020 2026-02-13T20:13:41.183 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.152+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f91dc012390 con 0x7f91bc003c00 2026-02-13T20:13:41.183 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.152+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 <== mon.0 v1:10.20.193.110:6789/0 6 ==== osd_map(113..113 src has 1..113) ==== 3915+0+0 (unknown 1040174270 0 0) 0x7f91dc04ef00 con 0x7f91bc003c00 2026-02-13T20:13:41.183 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.152+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 <== mon.0 v1:10.20.193.110:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f91dc04f300 con 0x7f91ec092020 2026-02-13T20:13:41.183 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.152+0000 7f91da7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:13:41.183 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.152+0000 7f91da7fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:13:41.183 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.152+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 >> v1:10.20.193.110:6789/0 conn(0x7f91ec092020 legacy=0x7f91ec088e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:41.183 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.152+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 >> v1:10.20.193.110:6789/0 conn(0x7f91ec092020 legacy=0x7f91ec088e30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:13:41.183 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.152+0000 7f91f142c640 10 monclient: get_auth_request con 0x7f91ec089c80 auth_method 0 2026-02-13T20:13:41.183 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.155+0000 7f91f3eb8640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:13:41.183 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.155+0000 7f91f3eb8640 1 -- 10.20.193.110:0/1521791836 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f91ec08a120 con 0x7f91ec089540 2026-02-13T20:13:41.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.155+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 986068165 0 0) 0x7f91ec08a120 con 0x7f91ec089540 2026-02-13T20:13:41.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.155+0000 7f91da7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:13:41.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.155+0000 7f91da7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:41.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.155+0000 7f91da7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:41.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.155+0000 7f91da7fc640 10 monclient(hunting): my global_id is 84114 2026-02-13T20:13:41.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.155+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91ec130820 con 0x7f91ec089540 2026-02-13T20:13:41.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.155+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 61279337 0 0) 0x7f91ec130820 con 0x7f91ec089540 2026-02-13T20:13:41.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.155+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f91ec08a120 con 0x7f91ec089540 2026-02-13T20:13:41.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.155+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f91e8006330 con 0x7f91ec089540 2026-02-13T20:13:41.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.155+0000 7f91da7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:41.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.155+0000 7f91da7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:13:41.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.155+0000 7f91da7fc640 10 monclient: dump: 2026-02-13T20:13:41.184 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:41.184 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:41.184 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.185 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.185 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:41.185 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:41.185 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:41.185 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:41.185 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:41.185 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:41.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.156+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3605744400 0 0) 0x7f91ec08a120 con 0x7f91ec089540 2026-02-13T20:13:41.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.156+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 --> v1:10.20.193.110:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f91ec08b450 con 0x7f91ec089540 2026-02-13T20:13:41.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.156+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 <== mon.0 v1:10.20.193.110:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4346 (unknown 0 0 1092884153) 0x7f91e8006820 con 0x7f91ec089540 2026-02-13T20:13:41.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.156+0000 7f91da7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:13:41.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.156+0000 7f91da7fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:13:41.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.156+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 >> v1:10.20.193.110:6789/0 conn(0x7f91ec089540 legacy=0x7f91ec173140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:41.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.156+0000 7f91da7fc640 1 -- 10.20.193.110:0/1521791836 >> v1:10.20.193.110:6789/0 conn(0x7f91ec089540 legacy=0x7f91ec173140 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:13:41.186 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:13:41.186 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:13:41.186 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:13:41.186 INFO:teuthology.orchestra.run.trial110.stdout: "state": "peon", 2026-02-13T20:13:41.186 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 12, 2026-02-13T20:13:41.186 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 15246, 2026-02-13T20:13:41.186 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:13:41.186 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:13:41.186 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:13:41.186 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:13:41.187 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:13:41.187 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 0, 2026-02-13T20:13:41.187 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:13:41.187 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:13:41.187 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:13:41.187 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:13:41.187 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:13:41.187 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:13:41.187 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:13:41.187 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:13:41.187 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:13:41.187 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:13:41.187 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:13:41.187 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:13:41.187 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:13:41.188 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:13:41.188 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:13:41.188 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:13:41.188 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:13:41.188 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:13:41.188 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:13:41.188 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:13:41.188 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:13:41.188 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:13:41.188 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:13:41.188 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:13:41.188 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:13:41.188 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:13:41.188 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:13:41.188 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:13:41.189 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:13:41.189 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:13:41.189 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:13:41.189 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:13:41.189 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:13:41.189 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:41.189 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:13:41.189 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:13:41.189 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:13:41.189 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:13:41.189 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:13:41.189 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:13:41.189 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:13:41.189 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:13:41.189 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:13:41.190 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:13:41.190 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:13:41.190 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:13:41.190 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:13:41.190 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:13:41.190 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:13:41.190 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:13:41.190 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:13:41.190 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:13:41.190 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:13:41.190 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:13:41.190 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:13:41.190 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:13:41.190 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:13:41.190 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:13:41.190 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:13:41.191 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:13:41.191 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:13:41.191 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:13:41.191 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:13:41.191 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:13:41.191 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:13:41.191 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:13:41.191 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:41.191 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:13:41.191 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:41.191 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:13:41.191 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:13:41.191 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:13:41.191 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:13:41.191 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:41.191 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:13:41.191 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:13:41.192 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:13:41.192 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:41.192 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:13:41.192 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:41.192 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:13:41.192 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:13:41.192 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:13:41.192 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:13:41.192 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:13:41.192 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:13:41.192 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:41.192 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:41.192 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:13:41.192 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:13:41.192 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:13:41.192 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:13:41.192 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:41.193 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:13:41.193 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:13:41.193 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:13:41.193 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:41.193 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:13:41.193 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:41.193 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:13:41.193 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:13:41.193 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:13:41.193 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:13:41.193 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:13:41.193 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:13:41.193 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:41.193 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:41.193 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:13:41.193 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:13:41.193 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:13:41.194 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:13:41.194 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:41.194 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:13:41.194 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:13:41.194 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:13:41.194 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:41.194 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:13:41.194 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:41.194 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:13:41.194 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:13:41.194 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:13:41.194 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:13:41.194 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:13:41.194 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:13:41.194 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:41.194 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:13:41.194 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:41.194 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:13:41.195 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:13:41.195 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:41.195 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:13:41.195 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:13:41.195 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:13:41.195 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:41.195 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:13:41.195 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:13:41.195 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:41.195 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:13:41.195 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:13:41.195 INFO:teuthology.orchestra.run.trial110.stdout: "num": 2 2026-02-13T20:13:41.195 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:41.195 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:13:41.195 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:41.195 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:13:41.195 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:13:41.196 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.156+0000 7f91f3eb8640 1 -- 10.20.193.110:0/1521791836 >> v1:10.20.193.188:6812/1623052694 conn(0x7f91ec089c80 legacy=0x7f91bc0c5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:41.197 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.156+0000 7f91f3eb8640 10 monclient: shutdown 2026-02-13T20:13:41.197 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.156+0000 7f91f3eb8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:13:41.197 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.156+0000 7f91f3eb8640 1 -- 10.20.193.110:0/1521791836 >> v1:10.20.193.110:6789/0 conn(0x7f91bc003c00 legacy=0x7f91bc003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:41.197 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.156+0000 7f91f242e640 1 -- 10.20.193.110:0/1521791836 reap_dead start 2026-02-13T20:13:41.197 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.156+0000 7f91f242e640 1 -- 10.20.193.110:0/1521791836 reap_dead start 2026-02-13T20:13:41.197 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.156+0000 7f91f3eb8640 1 -- 10.20.193.110:0/1521791836 shutdown_connections 2026-02-13T20:13:41.197 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.156+0000 7f91f3eb8640 1 -- 10.20.193.110:0/1521791836 >> 10.20.193.110:0/1521791836 conn(0x7f91ec054e90 msgr2=0x7f91ec08de30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:13:41.197 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.156+0000 7f91f3eb8640 1 -- 10.20.193.110:0/1521791836 shutdown_connections 2026-02-13T20:13:41.197 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.156+0000 7f91f3eb8640 1 -- 10.20.193.110:0/1521791836 wait complete. 2026-02-13T20:13:41.197 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:13:41.197 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-13T20:13:41.198 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T20:13:41.263 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.262+0000 7fa7ff74c640 10 monclient: get_monmap_and_config 2026-02-13T20:13:41.263 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.262+0000 7fa7ff74c640 10 monclient: build_initial_monmap 2026-02-13T20:13:41.263 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.262+0000 7fa7ff74c640 10 monclient: monmap: 2026-02-13T20:13:41.263 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:13:41.263 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:41.263 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:13:41.262884+0000 2026-02-13T20:13:41.264 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:13:41.262884+0000 2026-02-13T20:13:41.264 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:13:41.264 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:41.264 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:13:41.264 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:13:41.264 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:13:41.264 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:41.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.262+0000 7fa7ff74c640 1 Processor -- start 2026-02-13T20:13:41.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.262+0000 7fa7ff74c640 1 -- start start 2026-02-13T20:13:41.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.262+0000 7fa7ff74c640 10 monclient: init 2026-02-13T20:13:41.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7ff74c640 10 monclient: _reopen_session rank -1 2026-02-13T20:13:41.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7ff74c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:13:41.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7ff74c640 10 monclient(hunting): picked mon.noname-a con 0x7fa7f81401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:13:41.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7ff74c640 10 monclient(hunting): picked mon.noname-b con 0x7fa7f8092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:13:41.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7ff74c640 10 monclient(hunting): picked mon.noname-c con 0x7fa7f8091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:13:41.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7ff74c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7f808b730 con 0x7fa7f81401c0 2026-02-13T20:13:41.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7ff74c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7f805c5b0 con 0x7fa7f8091950 2026-02-13T20:13:41.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7ff74c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7f808bcf0 con 0x7fa7f8092020 2026-02-13T20:13:41.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7ff74c640 10 monclient(hunting): _renew_subs 2026-02-13T20:13:41.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7ff74c640 10 monclient(hunting): authenticate will time out at 782.953224s 2026-02-13T20:13:41.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7fd4c1640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fa7f81401c0 0x7fa7f8091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:34914/0 (socket says 10.20.193.110:34914) 2026-02-13T20:13:41.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7fd4c1640 1 -- 10.20.193.110:0/1727478800 learned_addr learned my addr 10.20.193.110:0/1727478800 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:13:41.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7fccc0640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fa7f8092020 0x7fa7f81812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:56056/0 (socket says 10.20.193.110:56056) 2026-02-13T20:13:41.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7e7fff640 1 -- 10.20.193.110:0/1727478800 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2980339213 0 0) 0x7fa7f808b730 con 0x7fa7f81401c0 2026-02-13T20:13:41.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7e7fff640 10 monclient(hunting): _negotiate 2026-02-13T20:13:41.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7e7fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:41.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7e7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:41.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7e7fff640 10 monclient(hunting): my global_id is 84117 2026-02-13T20:13:41.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7e7fff640 1 -- 10.20.193.110:0/1727478800 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7e00035e0 con 0x7fa7f81401c0 2026-02-13T20:13:41.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7e7fff640 1 -- 10.20.193.110:0/1727478800 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1208404211 0 0) 0x7fa7f808bcf0 con 0x7fa7f8092020 2026-02-13T20:13:41.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7e7fff640 10 monclient(hunting): _negotiate 2026-02-13T20:13:41.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7e7fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:41.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7e7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:41.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7e7fff640 10 monclient(hunting): my global_id is 4487 2026-02-13T20:13:41.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7e7fff640 1 -- 10.20.193.110:0/1727478800 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7f808b730 con 0x7fa7f8092020 2026-02-13T20:13:41.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7e7fff640 1 -- 10.20.193.110:0/1727478800 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2185249013 0 0) 0x7fa7f805c5b0 con 0x7fa7f8091950 2026-02-13T20:13:41.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7e7fff640 10 monclient(hunting): _negotiate 2026-02-13T20:13:41.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7e7fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:41.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7e7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:41.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7e7fff640 10 monclient(hunting): my global_id is 4459 2026-02-13T20:13:41.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7e7fff640 1 -- 10.20.193.110:0/1727478800 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7f808bcf0 con 0x7fa7f8091950 2026-02-13T20:13:41.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7e7fff640 1 -- 10.20.193.110:0/1727478800 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 235869055 0 0) 0x7fa7f808b730 con 0x7fa7f8092020 2026-02-13T20:13:41.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7e7fff640 1 -- 10.20.193.110:0/1727478800 >> v1:10.20.193.188:6789/0 conn(0x7fa7f8091950 legacy=0x7fa7f81a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:41.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7e7fff640 1 -- 10.20.193.110:0/1727478800 >> v1:10.20.193.110:6789/0 conn(0x7fa7f81401c0 legacy=0x7fa7f8091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:41.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7e7fff640 10 monclient: _finish_hunting 0 2026-02-13T20:13:41.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7e7fff640 1 monclient: found mon.noname-b 2026-02-13T20:13:41.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7e7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:13:41.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7e7fff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:13:41.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7e7fff640 1 -- 10.20.193.110:0/1727478800 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7f8140590 con 0x7fa7f8092020 2026-02-13T20:13:41.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7e7fff640 10 monclient: _finish_auth 0 2026-02-13T20:13:41.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7e7fff640 10 monclient: _check_auth_tickets 2026-02-13T20:13:41.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7e7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:13:41.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7e7fff640 1 -- 10.20.193.110:0/1727478800 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa7ec002dd0 con 0x7fa7f8092020 2026-02-13T20:13:41.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7ff74c640 5 monclient: authenticate success, global_id 4487 2026-02-13T20:13:41.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7ff74c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:13:41.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7e7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:41.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7e7fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:13:41.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7e7fff640 10 monclient: dump: 2026-02-13T20:13:41.277 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:41.277 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:41.277 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.278 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.278 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:41.278 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:41.278 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:41.278 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:41.278 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:41.278 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:41.278 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7ff74c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:13:41.278 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7e7fff640 1 -- 10.20.193.110:0/1727478800 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa7ec002fe0 con 0x7fa7f8092020 2026-02-13T20:13:41.278 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7e7fff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:13:41.278 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7e7fff640 1 -- 10.20.193.110:0/1727478800 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa7ec0033c0 con 0x7fa7f8092020 2026-02-13T20:13:41.278 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7ff74c640 10 monclient: get_monmap_and_config success 2026-02-13T20:13:41.279 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7ff74c640 4 set_mon_vals no callback set 2026-02-13T20:13:41.279 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7e7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:41.279 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7e7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:13:41.279 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.263+0000 7fa7e7fff640 10 monclient: dump: 2026-02-13T20:13:41.279 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:41.279 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:41.279 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.279 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.279 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:41.279 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:41.279 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:41.279 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:41.279 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:41.280 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:41.280 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.264+0000 7fa7ff74c640 10 monclient: shutdown 2026-02-13T20:13:41.280 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.264+0000 7fa7ff74c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:13:41.280 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.264+0000 7fa7ff74c640 1 -- 10.20.193.110:0/1727478800 >> v1:10.20.193.110:6790/0 conn(0x7fa7f8092020 legacy=0x7fa7f81812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:41.280 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.264+0000 7fa7ff74c640 1 -- 10.20.193.110:0/1727478800 shutdown_connections 2026-02-13T20:13:41.280 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.264+0000 7fa7ff74c640 1 -- 10.20.193.110:0/1727478800 >> 10.20.193.110:0/1727478800 conn(0x7fa7f8054e90 msgr2=0x7fa7f8058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:13:41.280 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.264+0000 7fa7ff74c640 1 -- 10.20.193.110:0/1727478800 shutdown_connections 2026-02-13T20:13:41.280 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.264+0000 7fa7ff74c640 1 -- 10.20.193.110:0/1727478800 wait complete. 2026-02-13T20:13:41.280 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.264+0000 7fa7ff74c640 10 monclient: build_initial_monmap 2026-02-13T20:13:41.280 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.264+0000 7fa7ff74c640 10 monclient: monmap: 2026-02-13T20:13:41.280 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:13:41.280 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:13:41.281 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:13:41.281 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:13:41.281 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:13:41.281 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:13:41.281 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:13:41.281 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:13:41.281 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:13:41.281 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:41.281 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.264+0000 7fa7ff74c640 1 Processor -- start 2026-02-13T20:13:41.281 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.264+0000 7fa7ff74c640 1 -- start start 2026-02-13T20:13:41.281 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.264+0000 7fa7ff74c640 10 monclient: init 2026-02-13T20:13:41.281 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.264+0000 7fa7ff74c640 10 monclient: _reopen_session rank -1 2026-02-13T20:13:41.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.264+0000 7fa7ff74c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:13:41.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.264+0000 7fa7ff74c640 10 monclient(hunting): picked mon.noname-c con 0x7fa7f8091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:13:41.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.264+0000 7fa7ff74c640 10 monclient(hunting): picked mon.noname-a con 0x7fa7f81401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:13:41.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.264+0000 7fa7ff74c640 10 monclient(hunting): picked mon.noname-b con 0x7fa7f8130970 addr v1:10.20.193.188:6789/0 2026-02-13T20:13:41.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7ff74c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7f813fb40 con 0x7fa7f81401c0 2026-02-13T20:13:41.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7ff74c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7f805d320 con 0x7fa7f8130970 2026-02-13T20:13:41.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7ff74c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7f808a850 con 0x7fa7f8091950 2026-02-13T20:13:41.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7ff74c640 10 monclient(hunting): _renew_subs 2026-02-13T20:13:41.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7ff74c640 10 monclient(hunting): authenticate will time out at 782.955019s 2026-02-13T20:13:41.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7fd4c1640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fa7f8091950 0x7fa7f8152670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:56072/0 (socket says 10.20.193.110:56072) 2026-02-13T20:13:41.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7fd4c1640 1 -- 10.20.193.110:0/1557907975 learned_addr learned my addr 10.20.193.110:0/1557907975 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:13:41.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7fccc0640 1 --1- 10.20.193.110:0/1557907975 >> v1:10.20.193.110:6789/0 conn(0x7fa7f81401c0 0x7fa7f813e750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:34924/0 (socket says 10.20.193.110:34924) 2026-02-13T20:13:41.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7fccc0640 1 -- 10.20.193.110:0/1557907975 >> v1:10.20.193.110:6789/0 conn(0x7fa7f81401c0 legacy=0x7fa7f813e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-13T20:13:41.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7fccc0640 1 -- 10.20.193.110:0/1557907975 >> v1:10.20.193.110:6789/0 conn(0x7fa7f81401c0 legacy=0x7fa7f813e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T20:13:41.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7fccc0640 1 --1- 10.20.193.110:0/1557907975 >> v1:10.20.193.110:6789/0 conn(0x7fa7f81401c0 0x7fa7f813e750 :-1 s=OPENED pgs=36 gs=2 cs=1 l=1).handle_message read tag failed 2026-02-13T20:13:41.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7fccc0640 1 --1- 10.20.193.110:0/1557907975 >> v1:10.20.193.110:6789/0 conn(0x7fa7f81401c0 0x7fa7f813e750 :-1 s=OPENED pgs=36 gs=2 cs=1 l=1).fault on lossy channel, failing 2026-02-13T20:13:41.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7e5ffb640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.110:6789/0 2026-02-13T20:13:41.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7e5ffb640 1 -- 10.20.193.110:0/1557907975 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 428983232 0 0) 0x7fa7f808a850 con 0x7fa7f8091950 2026-02-13T20:13:41.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7e5ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:13:41.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7e5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:41.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7e5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:41.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7e5ffb640 10 monclient(hunting): my global_id is 4490 2026-02-13T20:13:41.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7e5ffb640 1 -- 10.20.193.110:0/1557907975 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7c80035e0 con 0x7fa7f8091950 2026-02-13T20:13:41.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7e5ffb640 1 -- 10.20.193.110:0/1557907975 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3487682141 0 0) 0x7fa7f805d320 con 0x7fa7f8130970 2026-02-13T20:13:41.284 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7e5ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:13:41.284 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7e5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:41.284 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7e5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:41.284 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7e5ffb640 10 monclient(hunting): my global_id is 4462 2026-02-13T20:13:41.284 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7e5ffb640 1 -- 10.20.193.110:0/1557907975 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7f808a850 con 0x7fa7f8130970 2026-02-13T20:13:41.284 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7e5ffb640 1 -- 10.20.193.110:0/1557907975 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2263071276 0 0) 0x7fa7c80035e0 con 0x7fa7f8091950 2026-02-13T20:13:41.284 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7e5ffb640 1 -- 10.20.193.110:0/1557907975 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa7f805d320 con 0x7fa7f8091950 2026-02-13T20:13:41.284 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7e5ffb640 1 -- 10.20.193.110:0/1557907975 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa7e8003170 con 0x7fa7f8091950 2026-02-13T20:13:41.284 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7e5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:13:41.284 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7e5ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:13:41.284 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7e5ffb640 10 monclient(hunting): dump: 2026-02-13T20:13:41.284 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:41.284 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:41.285 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.285 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.285 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:41.285 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:41.285 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:41.285 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:41.285 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:41.285 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:41.285 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7e5ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:13:41.285 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7e5ffb640 1 -- 10.20.193.110:0/1557907975 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1247612269 0 0) 0x7fa7f805d320 con 0x7fa7f8091950 2026-02-13T20:13:41.285 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7e5ffb640 1 -- 10.20.193.110:0/1557907975 >> v1:10.20.193.188:6789/0 conn(0x7fa7f8130970 legacy=0x7fa7f81949e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:41.285 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7e5ffb640 1 -- 10.20.193.110:0/1557907975 >> v1:10.20.193.110:6789/0 conn(0x7fa7f81401c0 legacy=0x7fa7f813e750 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:13:41.286 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7e5ffb640 10 monclient: _finish_hunting 0 2026-02-13T20:13:41.286 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7e5ffb640 1 monclient: found mon.c 2026-02-13T20:13:41.286 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7e5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:13:41.286 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7e5ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:13:41.286 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7e5ffb640 1 -- 10.20.193.110:0/1557907975 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7f8132170 con 0x7fa7f8091950 2026-02-13T20:13:41.286 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7e5ffb640 10 monclient: _finish_auth 0 2026-02-13T20:13:41.286 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7e5ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:13:41.286 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7e5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:13:41.286 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7ff74c640 5 monclient: authenticate success, global_id 4490 2026-02-13T20:13:41.286 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7ff74c640 10 monclient: _renew_subs 2026-02-13T20:13:41.286 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7ff74c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:13:41.286 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7ff74c640 1 -- 10.20.193.110:0/1557907975 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa7f813ee60 con 0x7fa7f8091950 2026-02-13T20:13:41.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7ff74c640 10 monclient: _renew_subs 2026-02-13T20:13:41.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7ff74c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:13:41.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7ff74c640 1 -- 10.20.193.110:0/1557907975 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fa7f81962a0 con 0x7fa7f8091950 2026-02-13T20:13:41.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7e5ffb640 1 -- 10.20.193.110:0/1557907975 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa7e80048a0 con 0x7fa7f8091950 2026-02-13T20:13:41.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7e5ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T20:13:41.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7e5ffb640 1 -- 10.20.193.110:0/1557907975 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa7e8004bc0 con 0x7fa7f8091950 2026-02-13T20:13:41.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7e5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:41.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7e5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:13:41.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7e5ffb640 10 monclient: dump: 2026-02-13T20:13:41.287 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:41.287 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:41.287 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.288 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.288 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:41.288 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:41.288 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:41.288 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:41.288 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:41.288 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:41.288 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7e77fe640 4 set_mon_vals no callback set 2026-02-13T20:13:41.288 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7ff74c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:13:41.288 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.265+0000 7fa7ff74c640 1 -- 10.20.193.110:0/1557907975 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa7f80008d0 con 0x7fa7f8092020 2026-02-13T20:13:41.288 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.266+0000 7fa7e5ffb640 1 -- 10.20.193.110:0/1557907975 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fa7e8011830 con 0x7fa7f8091950 2026-02-13T20:13:41.288 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.266+0000 7fa7e5ffb640 1 -- 10.20.193.110:0/1557907975 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(113..113 src has 1..113) ==== 3915+0+0 (unknown 1040174270 0 0) 0x7fa7e804e8b0 con 0x7fa7f8091950 2026-02-13T20:13:41.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.266+0000 7fa7e5ffb640 1 -- 10.20.193.110:0/1557907975 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3620996971 0 0) 0x7fa7f80008d0 con 0x7fa7f8092020 2026-02-13T20:13:41.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.266+0000 7fa7e5ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:13:41.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.266+0000 7fa7e5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:41.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.266+0000 7fa7e5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:41.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.266+0000 7fa7e5ffb640 10 monclient(hunting): my global_id is 4493 2026-02-13T20:13:41.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.266+0000 7fa7e5ffb640 1 -- 10.20.193.110:0/1557907975 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7f805d320 con 0x7fa7f8092020 2026-02-13T20:13:41.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.266+0000 7fa7fdcc2640 10 monclient: get_auth_request con 0x7fa7c803f6c0 auth_method 0 2026-02-13T20:13:41.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.266+0000 7fa7e5ffb640 1 -- 10.20.193.110:0/1557907975 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1484871879 0 0) 0x7fa7f805d320 con 0x7fa7f8092020 2026-02-13T20:13:41.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.266+0000 7fa7e5ffb640 1 -- 10.20.193.110:0/1557907975 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa7f80008d0 con 0x7fa7f8092020 2026-02-13T20:13:41.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.266+0000 7fa7e5ffb640 1 -- 10.20.193.110:0/1557907975 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa7ec002d90 con 0x7fa7f8092020 2026-02-13T20:13:41.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.266+0000 7fa7e5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:41.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.266+0000 7fa7e5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:13:41.290 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.266+0000 7fa7e5ffb640 10 monclient: dump: 2026-02-13T20:13:41.290 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:41.290 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:41.290 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.290 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.290 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:41.290 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:41.290 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:41.290 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:41.290 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:41.290 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:41.290 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.266+0000 7fa7e5ffb640 1 -- 10.20.193.110:0/1557907975 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3142453055 0 0) 0x7fa7f80008d0 con 0x7fa7f8092020 2026-02-13T20:13:41.290 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.266+0000 7fa7e5ffb640 1 -- 10.20.193.110:0/1557907975 --> v1:10.20.193.110:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa7f808b450 con 0x7fa7f8092020 2026-02-13T20:13:41.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.266+0000 7fa7e5ffb640 1 -- 10.20.193.110:0/1557907975 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fa7ec0058d0 con 0x7fa7f8092020 2026-02-13T20:13:41.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.266+0000 7fa7e5ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:13:41.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.266+0000 7fa7e5ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:13:41.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.266+0000 7fa7e5ffb640 1 -- 10.20.193.110:0/1557907975 >> v1:10.20.193.110:6790/0 conn(0x7fa7f8092020 legacy=0x7fa7f8127b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:41.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.266+0000 7fa7e5ffb640 1 -- 10.20.193.110:0/1557907975 >> v1:10.20.193.110:6790/0 conn(0x7fa7f8092020 legacy=0x7fa7f8127b20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:13:41.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.270+0000 7fa7ff74c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:13:41.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.270+0000 7fa7ff74c640 1 -- 10.20.193.110:0/1557907975 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa7f8058410 con 0x7fa7f8128230 2026-02-13T20:13:41.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.270+0000 7fa7e5ffb640 1 -- 10.20.193.110:0/1557907975 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4291003835 0 0) 0x7fa7f8058410 con 0x7fa7f8128230 2026-02-13T20:13:41.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.270+0000 7fa7e5ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:13:41.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.270+0000 7fa7e5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:41.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.270+0000 7fa7e5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:41.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.270+0000 7fa7e5ffb640 10 monclient(hunting): my global_id is 4496 2026-02-13T20:13:41.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.270+0000 7fa7e5ffb640 1 -- 10.20.193.110:0/1557907975 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7f80008d0 con 0x7fa7f8128230 2026-02-13T20:13:41.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.270+0000 7fa7e5ffb640 1 -- 10.20.193.110:0/1557907975 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1299227935 0 0) 0x7fa7f80008d0 con 0x7fa7f8128230 2026-02-13T20:13:41.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.270+0000 7fa7e5ffb640 1 -- 10.20.193.110:0/1557907975 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa7f8058410 con 0x7fa7f8128230 2026-02-13T20:13:41.292 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.270+0000 7fa7e5ffb640 1 -- 10.20.193.110:0/1557907975 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa7ec004cf0 con 0x7fa7f8128230 2026-02-13T20:13:41.292 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.270+0000 7fa7e5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:41.292 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.270+0000 7fa7e5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:13:41.292 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.270+0000 7fa7e5ffb640 10 monclient: dump: 2026-02-13T20:13:41.292 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:41.292 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:41.292 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.292 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.292 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:41.292 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:41.292 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:41.292 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:41.292 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:41.292 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:41.293 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.270+0000 7fa7e5ffb640 1 -- 10.20.193.110:0/1557907975 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 342977640 0 0) 0x7fa7f8058410 con 0x7fa7f8128230 2026-02-13T20:13:41.293 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.270+0000 7fa7e5ffb640 1 -- 10.20.193.110:0/1557907975 --> v1:10.20.193.110:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa7f80561b0 con 0x7fa7f8128230 2026-02-13T20:13:41.293 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.271+0000 7fa7e5ffb640 1 -- 10.20.193.110:0/1557907975 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4516 (unknown 0 0 1282230169) 0x7fa7ec005a40 con 0x7fa7f8128230 2026-02-13T20:13:41.293 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.271+0000 7fa7e5ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:13:41.293 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.271+0000 7fa7e5ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:13:41.293 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.271+0000 7fa7e5ffb640 1 -- 10.20.193.110:0/1557907975 >> v1:10.20.193.110:6790/0 conn(0x7fa7f8128230 legacy=0x7fa7f8197560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:41.293 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.271+0000 7fa7e5ffb640 1 -- 10.20.193.110:0/1557907975 >> v1:10.20.193.110:6790/0 conn(0x7fa7f8128230 legacy=0x7fa7f8197560 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:13:41.293 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:13:41.294 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:13:41.294 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:13:41.294 INFO:teuthology.orchestra.run.trial110.stdout: "state": "leader", 2026-02-13T20:13:41.294 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 12, 2026-02-13T20:13:41.294 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 143452, 2026-02-13T20:13:41.294 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:13:41.294 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:13:41.294 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:13:41.294 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:13:41.294 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:13:41.294 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 0, 2026-02-13T20:13:41.294 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:13:41.294 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:13:41.295 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:13:41.295 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:13:41.295 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:13:41.295 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:13:41.295 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:13:41.295 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:13:41.295 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:13:41.295 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:13:41.295 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:13:41.295 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:13:41.295 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:13:41.295 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:13:41.295 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:13:41.296 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:13:41.296 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:13:41.296 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:13:41.296 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:13:41.296 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:13:41.296 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:13:41.296 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:13:41.296 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:13:41.296 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:13:41.296 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:13:41.296 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:13:41.297 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:13:41.297 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:13:41.297 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:13:41.297 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:13:41.297 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:13:41.297 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:13:41.297 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:13:41.297 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:41.297 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:13:41.297 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:13:41.297 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:13:41.297 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:13:41.298 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:13:41.298 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:13:41.298 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:13:41.298 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:13:41.298 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:13:41.298 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:13:41.298 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:13:41.298 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:13:41.298 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:13:41.298 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:13:41.298 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:13:41.298 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:13:41.298 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:13:41.299 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:13:41.299 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:13:41.299 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:13:41.299 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:13:41.299 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:13:41.299 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:13:41.299 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:13:41.299 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:13:41.299 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:13:41.299 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:13:41.299 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:13:41.299 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:13:41.299 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:13:41.299 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:13:41.299 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:13:41.299 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:41.300 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:13:41.300 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:41.300 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:13:41.300 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:13:41.300 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:13:41.300 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:13:41.300 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:41.300 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:13:41.300 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:13:41.300 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:13:41.300 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:41.300 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:13:41.300 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:41.300 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:13:41.300 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:13:41.300 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:13:41.301 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:13:41.301 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:13:41.301 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:13:41.301 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:41.301 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:41.301 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:13:41.301 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:13:41.301 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:13:41.301 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:13:41.301 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:41.301 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:13:41.301 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:13:41.301 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:13:41.301 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:41.301 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:13:41.301 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:41.302 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:13:41.302 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:13:41.302 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:13:41.302 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:13:41.302 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:13:41.302 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:13:41.302 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:41.302 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:41.302 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:13:41.302 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:13:41.302 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:13:41.302 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:13:41.302 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:41.302 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:13:41.302 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:13:41.302 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:13:41.302 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:41.303 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:13:41.303 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:41.303 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:13:41.303 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:13:41.303 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:13:41.303 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:13:41.303 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:13:41.303 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:13:41.303 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:41.303 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:13:41.303 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:41.303 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:13:41.303 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:13:41.303 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:41.303 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:13:41.303 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:13:41.303 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:13:41.304 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:41.304 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:13:41.304 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:13:41.304 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:41.304 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:13:41.304 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:13:41.304 INFO:teuthology.orchestra.run.trial110.stdout: "num": 3 2026-02-13T20:13:41.304 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:41.304 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:13:41.304 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:13:41.304 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:41.304 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:13:41.304 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:13:41.304 INFO:teuthology.orchestra.run.trial110.stdout: "num": 2 2026-02-13T20:13:41.304 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:41.304 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:13:41.304 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:41.304 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:13:41.305 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:13:41.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.271+0000 7fa7ff74c640 1 -- 10.20.193.110:0/1557907975 >> v1:10.20.193.188:6812/1623052694 conn(0x7fa7c803f6c0 legacy=0x7fa7c805fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:41.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.271+0000 7fa7ff74c640 10 monclient: shutdown 2026-02-13T20:13:41.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.271+0000 7fa7ff74c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:13:41.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.271+0000 7fa7ff74c640 1 -- 10.20.193.110:0/1557907975 >> v1:10.20.193.110:6790/0 conn(0x7fa7f8091950 legacy=0x7fa7f8152670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:41.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.271+0000 7fa7fdcc2640 1 -- 10.20.193.110:0/1557907975 reap_dead start 2026-02-13T20:13:41.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.271+0000 7fa7fdcc2640 1 -- 10.20.193.110:0/1557907975 reap_dead start 2026-02-13T20:13:41.307 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.271+0000 7fa7ff74c640 1 -- 10.20.193.110:0/1557907975 shutdown_connections 2026-02-13T20:13:41.307 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.271+0000 7fa7ff74c640 1 -- 10.20.193.110:0/1557907975 >> 10.20.193.110:0/1557907975 conn(0x7fa7f8054e90 msgr2=0x7fa7f808dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:13:41.307 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.271+0000 7fa7ff74c640 1 -- 10.20.193.110:0/1557907975 shutdown_connections 2026-02-13T20:13:41.307 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.271+0000 7fa7ff74c640 1 -- 10.20.193.110:0/1557907975 wait complete. 2026-02-13T20:13:41.307 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:13:41.307 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-13T20:13:41.308 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T20:13:41.374 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.373+0000 7f1f4efd4640 10 monclient: get_monmap_and_config 2026-02-13T20:13:41.374 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.373+0000 7f1f4efd4640 10 monclient: build_initial_monmap 2026-02-13T20:13:41.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.373+0000 7f1f4efd4640 10 monclient: monmap: 2026-02-13T20:13:41.375 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:13:41.375 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:41.375 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:13:41.374288+0000 2026-02-13T20:13:41.375 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:13:41.374288+0000 2026-02-13T20:13:41.375 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:13:41.375 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:41.375 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:13:41.375 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:13:41.375 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:13:41.375 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:41.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.374+0000 7f1f4efd4640 1 Processor -- start 2026-02-13T20:13:41.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.374+0000 7f1f4efd4640 1 -- start start 2026-02-13T20:13:41.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.374+0000 7f1f4efd4640 10 monclient: init 2026-02-13T20:13:41.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.374+0000 7f1f4efd4640 10 monclient: _reopen_session rank -1 2026-02-13T20:13:41.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.374+0000 7f1f4efd4640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:13:41.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.374+0000 7f1f4efd4640 10 monclient(hunting): picked mon.noname-c con 0x7f1f481401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:13:41.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.374+0000 7f1f4efd4640 10 monclient(hunting): picked mon.noname-b con 0x7f1f48092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:13:41.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.374+0000 7f1f4efd4640 10 monclient(hunting): picked mon.noname-a con 0x7f1f48091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:13:41.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.374+0000 7f1f4efd4640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f4808b730 con 0x7f1f48091950 2026-02-13T20:13:41.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.374+0000 7f1f4efd4640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f4805c5b0 con 0x7f1f481401c0 2026-02-13T20:13:41.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.374+0000 7f1f4efd4640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f4808bcf0 con 0x7f1f48092020 2026-02-13T20:13:41.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.374+0000 7f1f4efd4640 10 monclient(hunting): _renew_subs 2026-02-13T20:13:41.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.374+0000 7f1f4efd4640 10 monclient(hunting): authenticate will time out at 783.064682s 2026-02-13T20:13:41.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.374+0000 7f1f3ffff640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f1f48092020 0x7f1f481812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:56102/0 (socket says 10.20.193.110:56102) 2026-02-13T20:13:41.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.374+0000 7f1f3ffff640 1 -- 10.20.193.110:0/637410416 learned_addr learned my addr 10.20.193.110:0/637410416 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:13:41.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.375+0000 7f1f3f7fe640 1 -- 10.20.193.110:0/637410416 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2564723830 0 0) 0x7f1f4808b730 con 0x7f1f48091950 2026-02-13T20:13:41.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.375+0000 7f1f3f7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:13:41.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.375+0000 7f1f3f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:41.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.375+0000 7f1f3f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:41.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.375+0000 7f1f3f7fe640 10 monclient(hunting): my global_id is 84123 2026-02-13T20:13:41.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.375+0000 7f1f3f7fe640 1 -- 10.20.193.110:0/637410416 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f340035e0 con 0x7f1f48091950 2026-02-13T20:13:41.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.375+0000 7f1f3f7fe640 1 -- 10.20.193.110:0/637410416 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2890081043 0 0) 0x7f1f4808bcf0 con 0x7f1f48092020 2026-02-13T20:13:41.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.375+0000 7f1f3f7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:13:41.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.375+0000 7f1f3f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:41.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.375+0000 7f1f3f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:41.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.375+0000 7f1f3f7fe640 10 monclient(hunting): my global_id is 4499 2026-02-13T20:13:41.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.375+0000 7f1f3f7fe640 1 -- 10.20.193.110:0/637410416 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f4808b730 con 0x7f1f48092020 2026-02-13T20:13:41.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.375+0000 7f1f3f7fe640 1 -- 10.20.193.110:0/637410416 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4268202931 0 0) 0x7f1f4808b730 con 0x7f1f48092020 2026-02-13T20:13:41.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.375+0000 7f1f3f7fe640 1 -- 10.20.193.110:0/637410416 >> v1:10.20.193.188:6789/0 conn(0x7f1f481401c0 legacy=0x7f1f48091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:41.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.375+0000 7f1f3f7fe640 1 -- 10.20.193.110:0/637410416 >> v1:10.20.193.110:6789/0 conn(0x7f1f48091950 legacy=0x7f1f481a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:41.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.375+0000 7f1f3f7fe640 10 monclient: _finish_hunting 0 2026-02-13T20:13:41.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.375+0000 7f1f3f7fe640 1 monclient: found mon.noname-b 2026-02-13T20:13:41.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.375+0000 7f1f3f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:13:41.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.375+0000 7f1f3f7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:13:41.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.375+0000 7f1f3f7fe640 1 -- 10.20.193.110:0/637410416 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f48140590 con 0x7f1f48092020 2026-02-13T20:13:41.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.375+0000 7f1f3f7fe640 10 monclient: _finish_auth 0 2026-02-13T20:13:41.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.375+0000 7f1f3f7fe640 10 monclient: _check_auth_tickets 2026-02-13T20:13:41.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.375+0000 7f1f3f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:13:41.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.375+0000 7f1f3f7fe640 1 -- 10.20.193.110:0/637410416 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f1f30002dd0 con 0x7f1f48092020 2026-02-13T20:13:41.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.375+0000 7f1f3f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:41.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.375+0000 7f1f3f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:13:41.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.375+0000 7f1f3f7fe640 10 monclient: dump: 2026-02-13T20:13:41.388 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:41.388 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:41.388 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.388 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.388 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:41.388 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:41.389 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:41.389 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:41.389 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:41.389 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:41.389 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.375+0000 7f1f4efd4640 5 monclient: authenticate success, global_id 4499 2026-02-13T20:13:41.389 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.375+0000 7f1f4efd4640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:13:41.389 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.375+0000 7f1f3f7fe640 1 -- 10.20.193.110:0/637410416 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1f30002fe0 con 0x7f1f48092020 2026-02-13T20:13:41.389 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.375+0000 7f1f3f7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:13:41.389 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.375+0000 7f1f3f7fe640 1 -- 10.20.193.110:0/637410416 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f1f30003370 con 0x7f1f48092020 2026-02-13T20:13:41.389 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.375+0000 7f1f3f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:41.389 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.375+0000 7f1f3f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:13:41.389 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.375+0000 7f1f3f7fe640 10 monclient: dump: 2026-02-13T20:13:41.389 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:41.390 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:41.390 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.390 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.390 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:41.390 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:41.390 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:41.390 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:41.390 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:41.390 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:41.390 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.375+0000 7f1f4efd4640 10 monclient: get_monmap_and_config success 2026-02-13T20:13:41.390 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.375+0000 7f1f4efd4640 4 set_mon_vals no callback set 2026-02-13T20:13:41.390 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.375+0000 7f1f4efd4640 10 monclient: shutdown 2026-02-13T20:13:41.390 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.375+0000 7f1f4efd4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:13:41.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.375+0000 7f1f4efd4640 1 -- 10.20.193.110:0/637410416 >> v1:10.20.193.110:6790/0 conn(0x7f1f48092020 legacy=0x7f1f481812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:41.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.375+0000 7f1f4efd4640 1 -- 10.20.193.110:0/637410416 shutdown_connections 2026-02-13T20:13:41.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.375+0000 7f1f4efd4640 1 -- 10.20.193.110:0/637410416 >> 10.20.193.110:0/637410416 conn(0x7f1f48054e90 msgr2=0x7f1f48058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:13:41.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.375+0000 7f1f4efd4640 1 -- 10.20.193.110:0/637410416 shutdown_connections 2026-02-13T20:13:41.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.375+0000 7f1f4efd4640 1 -- 10.20.193.110:0/637410416 wait complete. 2026-02-13T20:13:41.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.376+0000 7f1f4efd4640 10 monclient: build_initial_monmap 2026-02-13T20:13:41.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.376+0000 7f1f4efd4640 10 monclient: monmap: 2026-02-13T20:13:41.391 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:13:41.391 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:13:41.391 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:13:41.391 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:13:41.391 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:13:41.391 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:13:41.391 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:13:41.392 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:13:41.392 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:13:41.392 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:41.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.376+0000 7f1f4efd4640 1 Processor -- start 2026-02-13T20:13:41.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.376+0000 7f1f4efd4640 1 -- start start 2026-02-13T20:13:41.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.376+0000 7f1f4efd4640 10 monclient: init 2026-02-13T20:13:41.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.376+0000 7f1f4efd4640 10 monclient: _reopen_session rank -1 2026-02-13T20:13:41.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.376+0000 7f1f4efd4640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:13:41.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.376+0000 7f1f4efd4640 10 monclient(hunting): picked mon.noname-a con 0x7f1f48091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:13:41.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.376+0000 7f1f4efd4640 10 monclient(hunting): picked mon.noname-b con 0x7f1f481401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:13:41.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.376+0000 7f1f4efd4640 10 monclient(hunting): picked mon.noname-c con 0x7f1f4812db00 addr v1:10.20.193.110:6790/0 2026-02-13T20:13:41.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.376+0000 7f1f4efd4640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f4808aeb0 con 0x7f1f48091950 2026-02-13T20:13:41.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.376+0000 7f1f4efd4640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f4805d320 con 0x7f1f481401c0 2026-02-13T20:13:41.393 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.376+0000 7f1f4efd4640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f4812ed40 con 0x7f1f4812db00 2026-02-13T20:13:41.393 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.376+0000 7f1f4efd4640 10 monclient(hunting): _renew_subs 2026-02-13T20:13:41.393 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.376+0000 7f1f4efd4640 10 monclient(hunting): authenticate will time out at 783.066639s 2026-02-13T20:13:41.393 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.376+0000 7f1f4cd49640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f1f48091950 0x7f1f4812b710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:34930/0 (socket says 10.20.193.110:34930) 2026-02-13T20:13:41.393 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.376+0000 7f1f4cd49640 1 -- 10.20.193.110:0/2664897324 learned_addr learned my addr 10.20.193.110:0/2664897324 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:13:41.393 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.376+0000 7f1f3d7fa640 1 -- 10.20.193.110:0/2664897324 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3671179960 0 0) 0x7f1f4808aeb0 con 0x7f1f48091950 2026-02-13T20:13:41.393 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.376+0000 7f1f3d7fa640 10 monclient(hunting): _negotiate 2026-02-13T20:13:41.393 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.376+0000 7f1f3d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:41.393 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.376+0000 7f1f3d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:41.393 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.376+0000 7f1f3d7fa640 10 monclient(hunting): my global_id is 84126 2026-02-13T20:13:41.393 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.376+0000 7f1f3d7fa640 1 -- 10.20.193.110:0/2664897324 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f180035e0 con 0x7f1f48091950 2026-02-13T20:13:41.393 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.376+0000 7f1f3d7fa640 1 -- 10.20.193.110:0/2664897324 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3475273001 0 0) 0x7f1f4812ed40 con 0x7f1f4812db00 2026-02-13T20:13:41.393 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.376+0000 7f1f3d7fa640 10 monclient(hunting): _negotiate 2026-02-13T20:13:41.393 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.376+0000 7f1f3d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:41.394 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.376+0000 7f1f3d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:41.394 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.376+0000 7f1f3d7fa640 10 monclient(hunting): my global_id is 4502 2026-02-13T20:13:41.394 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.376+0000 7f1f3d7fa640 1 -- 10.20.193.110:0/2664897324 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f4808aeb0 con 0x7f1f4812db00 2026-02-13T20:13:41.394 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.376+0000 7f1f3d7fa640 1 -- 10.20.193.110:0/2664897324 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 320831687 0 0) 0x7f1f4805d320 con 0x7f1f481401c0 2026-02-13T20:13:41.394 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.376+0000 7f1f3d7fa640 10 monclient(hunting): _negotiate 2026-02-13T20:13:41.394 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.376+0000 7f1f3d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:41.394 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.376+0000 7f1f3d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:41.394 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.376+0000 7f1f3d7fa640 10 monclient(hunting): my global_id is 4468 2026-02-13T20:13:41.394 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.377+0000 7f1f3d7fa640 1 -- 10.20.193.110:0/2664897324 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f4812ed40 con 0x7f1f481401c0 2026-02-13T20:13:41.394 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.377+0000 7f1f3d7fa640 1 -- 10.20.193.110:0/2664897324 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2876537750 0 0) 0x7f1f180035e0 con 0x7f1f48091950 2026-02-13T20:13:41.394 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.377+0000 7f1f3d7fa640 1 -- 10.20.193.110:0/2664897324 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1f4805d320 con 0x7f1f48091950 2026-02-13T20:13:41.394 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.377+0000 7f1f3d7fa640 1 -- 10.20.193.110:0/2664897324 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f1f380030e0 con 0x7f1f48091950 2026-02-13T20:13:41.394 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.377+0000 7f1f3d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:13:41.394 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.377+0000 7f1f3d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:13:41.395 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.377+0000 7f1f3d7fa640 10 monclient(hunting): dump: 2026-02-13T20:13:41.395 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:41.395 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:41.395 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.395 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.395 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:41.395 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:41.395 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:41.395 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:41.395 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:41.395 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:41.395 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.377+0000 7f1f3d7fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:13:41.395 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.377+0000 7f1f3d7fa640 1 -- 10.20.193.110:0/2664897324 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 136846027 0 0) 0x7f1f4808aeb0 con 0x7f1f4812db00 2026-02-13T20:13:41.395 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.377+0000 7f1f3d7fa640 1 -- 10.20.193.110:0/2664897324 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1f180035e0 con 0x7f1f4812db00 2026-02-13T20:13:41.396 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.377+0000 7f1f3d7fa640 1 -- 10.20.193.110:0/2664897324 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f1f440040a0 con 0x7f1f4812db00 2026-02-13T20:13:41.396 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.377+0000 7f1f3d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:13:41.396 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.377+0000 7f1f3d7fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:13:41.396 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.377+0000 7f1f3d7fa640 10 monclient(hunting): dump: 2026-02-13T20:13:41.396 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:41.396 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:41.396 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.396 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.396 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:41.396 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:41.396 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:41.396 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:41.396 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:41.396 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:41.397 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.377+0000 7f1f3d7fa640 1 -- 10.20.193.110:0/2664897324 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1997780340 0 0) 0x7f1f4812ed40 con 0x7f1f481401c0 2026-02-13T20:13:41.397 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.377+0000 7f1f3d7fa640 1 -- 10.20.193.110:0/2664897324 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1f4808aeb0 con 0x7f1f481401c0 2026-02-13T20:13:41.397 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.377+0000 7f1f3d7fa640 1 -- 10.20.193.110:0/2664897324 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f1f30002d90 con 0x7f1f481401c0 2026-02-13T20:13:41.397 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.377+0000 7f1f3d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:13:41.397 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.377+0000 7f1f3d7fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-13T20:13:41.397 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.377+0000 7f1f3d7fa640 10 monclient(hunting): dump: 2026-02-13T20:13:41.397 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:41.397 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:41.397 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.397 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.397 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:41.397 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:41.397 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:41.397 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:41.398 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:41.398 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:41.398 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.377+0000 7f1f3d7fa640 1 -- 10.20.193.110:0/2664897324 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1125980216 0 0) 0x7f1f4805d320 con 0x7f1f48091950 2026-02-13T20:13:41.398 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.377+0000 7f1f3d7fa640 1 -- 10.20.193.110:0/2664897324 >> v1:10.20.193.110:6790/0 conn(0x7f1f4812db00 legacy=0x7f1f481a2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:41.398 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.377+0000 7f1f3d7fa640 1 -- 10.20.193.110:0/2664897324 >> v1:10.20.193.188:6789/0 conn(0x7f1f481401c0 legacy=0x7f1f4812be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:41.398 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.377+0000 7f1f3d7fa640 10 monclient: _finish_hunting 0 2026-02-13T20:13:41.398 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.377+0000 7f1f3d7fa640 1 monclient: found mon.a 2026-02-13T20:13:41.398 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.377+0000 7f1f3d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:13:41.398 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.377+0000 7f1f3d7fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:13:41.398 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.377+0000 7f1f3d7fa640 1 -- 10.20.193.110:0/2664897324 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f4812f020 con 0x7f1f48091950 2026-02-13T20:13:41.398 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.377+0000 7f1f3d7fa640 10 monclient: _finish_auth 0 2026-02-13T20:13:41.398 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.377+0000 7f1f3d7fa640 10 monclient: _check_auth_tickets 2026-02-13T20:13:41.398 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.377+0000 7f1f3d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:13:41.399 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.377+0000 7f1f4efd4640 5 monclient: authenticate success, global_id 84126 2026-02-13T20:13:41.399 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.377+0000 7f1f4efd4640 10 monclient: _renew_subs 2026-02-13T20:13:41.399 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.377+0000 7f1f4efd4640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:13:41.399 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.377+0000 7f1f4efd4640 1 -- 10.20.193.110:0/2664897324 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1f4812c530 con 0x7f1f48091950 2026-02-13T20:13:41.399 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.377+0000 7f1f4efd4640 10 monclient: _renew_subs 2026-02-13T20:13:41.399 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.377+0000 7f1f4efd4640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:13:41.399 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.377+0000 7f1f4efd4640 1 -- 10.20.193.110:0/2664897324 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1f4812cfa0 con 0x7f1f48091950 2026-02-13T20:13:41.399 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.377+0000 7f1f3d7fa640 1 -- 10.20.193.110:0/2664897324 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1f38003410 con 0x7f1f48091950 2026-02-13T20:13:41.399 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.377+0000 7f1f3d7fa640 10 monclient: handle_config config(0 keys) 2026-02-13T20:13:41.399 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.377+0000 7f1f3d7fa640 1 -- 10.20.193.110:0/2664897324 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f1f38003b30 con 0x7f1f48091950 2026-02-13T20:13:41.399 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.377+0000 7f1f3d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:41.399 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.377+0000 7f1f3d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:13:41.399 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.377+0000 7f1f3effd640 4 set_mon_vals no callback set 2026-02-13T20:13:41.399 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.377+0000 7f1f3d7fa640 10 monclient: dump: 2026-02-13T20:13:41.400 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:41.400 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:41.400 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.400 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.400 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:41.400 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:41.400 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:41.400 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:41.400 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:41.400 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:41.400 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.377+0000 7f1f4efd4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:13:41.400 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.377+0000 7f1f4efd4640 1 -- 10.20.193.110:0/2664897324 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1f48127620 con 0x7f1f48092020 2026-02-13T20:13:41.400 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.377+0000 7f1f3d7fa640 1 -- 10.20.193.110:0/2664897324 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f1f38003c90 con 0x7f1f48091950 2026-02-13T20:13:41.400 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.378+0000 7f1f3d7fa640 1 -- 10.20.193.110:0/2664897324 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(113..113 src has 1..113) ==== 3915+0+0 (unknown 1040174270 0 0) 0x7f1f3804e920 con 0x7f1f48091950 2026-02-13T20:13:41.401 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.378+0000 7f1f3d7fa640 1 -- 10.20.193.110:0/2664897324 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 118875925 0 0) 0x7f1f48127620 con 0x7f1f48092020 2026-02-13T20:13:41.401 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.378+0000 7f1f3d7fa640 10 monclient(hunting): _negotiate 2026-02-13T20:13:41.401 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.378+0000 7f1f3d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:41.401 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.378+0000 7f1f3d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:41.401 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.378+0000 7f1f3d7fa640 10 monclient(hunting): my global_id is 4471 2026-02-13T20:13:41.401 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.378+0000 7f1f3d7fa640 1 -- 10.20.193.110:0/2664897324 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f4805d320 con 0x7f1f48092020 2026-02-13T20:13:41.401 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.378+0000 7f1f4d54a640 10 monclient: get_auth_request con 0x7f1f1803ffd0 auth_method 0 2026-02-13T20:13:41.401 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.378+0000 7f1f3d7fa640 1 -- 10.20.193.110:0/2664897324 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 562820544 0 0) 0x7f1f4805d320 con 0x7f1f48092020 2026-02-13T20:13:41.401 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.378+0000 7f1f3d7fa640 1 -- 10.20.193.110:0/2664897324 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1f48127620 con 0x7f1f48092020 2026-02-13T20:13:41.401 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.378+0000 7f1f3d7fa640 1 -- 10.20.193.110:0/2664897324 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f1f30004c40 con 0x7f1f48092020 2026-02-13T20:13:41.401 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.378+0000 7f1f3d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:41.401 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.378+0000 7f1f3d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:13:41.401 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.378+0000 7f1f3d7fa640 10 monclient: dump: 2026-02-13T20:13:41.401 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:41.402 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:41.402 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.402 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.402 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:41.402 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:41.402 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:41.402 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:41.402 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:41.402 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:41.402 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.378+0000 7f1f3d7fa640 1 -- 10.20.193.110:0/2664897324 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1324511444 0 0) 0x7f1f48127620 con 0x7f1f48092020 2026-02-13T20:13:41.402 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.378+0000 7f1f3d7fa640 1 -- 10.20.193.110:0/2664897324 --> v1:10.20.193.188:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1f4808b450 con 0x7f1f48092020 2026-02-13T20:13:41.402 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.378+0000 7f1f3d7fa640 1 -- 10.20.193.110:0/2664897324 <== mon.1 v1:10.20.193.188:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f1f30005080 con 0x7f1f48092020 2026-02-13T20:13:41.402 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.378+0000 7f1f3d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:13:41.402 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.378+0000 7f1f3d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:13:41.403 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.378+0000 7f1f3d7fa640 1 -- 10.20.193.110:0/2664897324 >> v1:10.20.193.188:6789/0 conn(0x7f1f48092020 legacy=0x7f1f48125f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:41.403 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.378+0000 7f1f3d7fa640 1 -- 10.20.193.110:0/2664897324 >> v1:10.20.193.188:6789/0 conn(0x7f1f48092020 legacy=0x7f1f48125f00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:13:41.403 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.381+0000 7f1f4efd4640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:13:41.403 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.381+0000 7f1f4efd4640 1 -- 10.20.193.110:0/2664897324 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1f4813dc30 con 0x7f1f481a3f30 2026-02-13T20:13:41.403 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.382+0000 7f1f3d7fa640 1 -- 10.20.193.110:0/2664897324 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 580099216 0 0) 0x7f1f4813dc30 con 0x7f1f481a3f30 2026-02-13T20:13:41.403 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.382+0000 7f1f3d7fa640 10 monclient(hunting): _negotiate 2026-02-13T20:13:41.403 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.382+0000 7f1f3d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:41.403 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.382+0000 7f1f3d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:41.403 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.382+0000 7f1f3d7fa640 10 monclient(hunting): my global_id is 4474 2026-02-13T20:13:41.403 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.382+0000 7f1f3d7fa640 1 -- 10.20.193.110:0/2664897324 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f48127620 con 0x7f1f481a3f30 2026-02-13T20:13:41.403 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.382+0000 7f1f3d7fa640 1 -- 10.20.193.110:0/2664897324 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3635924438 0 0) 0x7f1f48127620 con 0x7f1f481a3f30 2026-02-13T20:13:41.403 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.382+0000 7f1f3d7fa640 1 -- 10.20.193.110:0/2664897324 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1f4813dc30 con 0x7f1f481a3f30 2026-02-13T20:13:41.403 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.382+0000 7f1f3d7fa640 1 -- 10.20.193.110:0/2664897324 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f1f300056a0 con 0x7f1f481a3f30 2026-02-13T20:13:41.404 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.382+0000 7f1f3d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:41.404 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.382+0000 7f1f3d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:13:41.404 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.382+0000 7f1f3d7fa640 10 monclient: dump: 2026-02-13T20:13:41.404 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:41.404 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:41.404 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.404 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.404 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:41.404 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:41.404 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:41.404 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:41.404 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:41.404 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:41.404 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.382+0000 7f1f3d7fa640 1 -- 10.20.193.110:0/2664897324 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3261703152 0 0) 0x7f1f4813dc30 con 0x7f1f481a3f30 2026-02-13T20:13:41.405 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.382+0000 7f1f3d7fa640 1 -- 10.20.193.110:0/2664897324 --> v1:10.20.193.188:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1f48055bb0 con 0x7f1f481a3f30 2026-02-13T20:13:41.405 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.382+0000 7f1f3d7fa640 1 -- 10.20.193.110:0/2664897324 <== mon.1 v1:10.20.193.188:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4681 (unknown 0 0 318863056) 0x7f1f30006a30 con 0x7f1f481a3f30 2026-02-13T20:13:41.405 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.383+0000 7f1f3d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:13:41.405 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.383+0000 7f1f3d7fa640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:13:41.405 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.383+0000 7f1f3d7fa640 1 -- 10.20.193.110:0/2664897324 >> v1:10.20.193.188:6789/0 conn(0x7f1f481a3f30 legacy=0x7f1f48118c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:41.405 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:13:41.405 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:13:41.405 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:13:41.406 INFO:teuthology.orchestra.run.trial110.stdout: "state": "peon", 2026-02-13T20:13:41.406 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 12, 2026-02-13T20:13:41.406 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 143528, 2026-02-13T20:13:41.406 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:13:41.406 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:13:41.406 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:13:41.406 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:13:41.406 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:13:41.406 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 0, 2026-02-13T20:13:41.406 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:13:41.406 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:13:41.406 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:13:41.406 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:13:41.406 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:13:41.406 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:13:41.407 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:13:41.407 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:13:41.407 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:13:41.407 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:13:41.407 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:13:41.407 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:13:41.407 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:13:41.407 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:13:41.407 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:13:41.407 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:13:41.407 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:13:41.407 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:13:41.407 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:13:41.407 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:13:41.408 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:13:41.408 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:13:41.408 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:13:41.408 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:13:41.408 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:13:41.408 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:13:41.408 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:13:41.408 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:13:41.408 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:13:41.408 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:13:41.408 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:13:41.408 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:13:41.408 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:13:41.408 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:41.408 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:13:41.408 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:13:41.409 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:13:41.409 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:13:41.409 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:13:41.409 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:13:41.409 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:13:41.409 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:13:41.409 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:13:41.409 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:13:41.409 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:13:41.409 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:13:41.409 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:13:41.409 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:13:41.409 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:13:41.409 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:13:41.409 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:13:41.409 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:13:41.410 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:13:41.410 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:13:41.410 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:13:41.410 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:13:41.410 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:13:41.410 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:13:41.410 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:13:41.410 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:13:41.410 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:13:41.410 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:13:41.410 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:13:41.410 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:13:41.410 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:13:41.410 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:13:41.410 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:41.410 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:13:41.410 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:41.411 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:13:41.411 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:13:41.411 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:13:41.411 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:13:41.411 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:41.411 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:13:41.411 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:13:41.411 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:13:41.411 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:41.411 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:13:41.411 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:41.411 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:13:41.411 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:13:41.411 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:13:41.411 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:13:41.411 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:13:41.411 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:13:41.411 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:41.412 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:41.412 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:13:41.412 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:13:41.412 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:13:41.412 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:13:41.412 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:41.412 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:13:41.412 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:13:41.412 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:13:41.412 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:41.412 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:13:41.412 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:41.412 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:13:41.412 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:13:41.412 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:13:41.412 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:13:41.412 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:13:41.412 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:13:41.412 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:41.413 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:41.413 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:13:41.413 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:13:41.413 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:13:41.413 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:13:41.413 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:41.413 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:13:41.413 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:13:41.413 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:13:41.413 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:41.413 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:13:41.413 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:41.413 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:13:41.413 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:13:41.413 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:13:41.413 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:13:41.413 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:13:41.413 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:13:41.414 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:41.414 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:13:41.414 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:41.414 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:13:41.414 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:13:41.414 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:41.414 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:13:41.414 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:13:41.414 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:13:41.414 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:41.414 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:13:41.414 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:13:41.414 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:41.414 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:13:41.414 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:13:41.414 INFO:teuthology.orchestra.run.trial110.stdout: "num": 3 2026-02-13T20:13:41.414 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:41.414 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:13:41.414 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:13:41.414 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:41.415 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:13:41.415 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:13:41.415 INFO:teuthology.orchestra.run.trial110.stdout: "num": 6 2026-02-13T20:13:41.415 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:41.415 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:13:41.415 INFO:teuthology.orchestra.run.trial110.stdout: "mgr": [ 2026-02-13T20:13:41.415 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:41.415 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:13:41.415 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:13:41.415 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:13:41.415 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:41.415 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:13:41.415 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:41.415 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:13:41.415 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:13:41.416 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.383+0000 7f1f3d7fa640 1 -- 10.20.193.110:0/2664897324 >> v1:10.20.193.188:6789/0 conn(0x7f1f481a3f30 legacy=0x7f1f48118c20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:13:41.416 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.383+0000 7f1f4efd4640 1 -- 10.20.193.110:0/2664897324 >> v1:10.20.193.188:6812/1623052694 conn(0x7f1f1803ffd0 legacy=0x7f1f18060480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:41.417 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.383+0000 7f1f4efd4640 10 monclient: shutdown 2026-02-13T20:13:41.417 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.383+0000 7f1f4efd4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:13:41.417 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.383+0000 7f1f4efd4640 1 -- 10.20.193.110:0/2664897324 >> v1:10.20.193.110:6789/0 conn(0x7f1f48091950 legacy=0x7f1f4812b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:41.417 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.383+0000 7f1f4d54a640 1 -- 10.20.193.110:0/2664897324 reap_dead start 2026-02-13T20:13:41.417 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.383+0000 7f1f4d54a640 1 -- 10.20.193.110:0/2664897324 reap_dead start 2026-02-13T20:13:41.417 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.383+0000 7f1f4efd4640 1 -- 10.20.193.110:0/2664897324 shutdown_connections 2026-02-13T20:13:41.417 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.383+0000 7f1f4efd4640 1 -- 10.20.193.110:0/2664897324 >> 10.20.193.110:0/2664897324 conn(0x7f1f48054e90 msgr2=0x7f1f48090620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:13:41.417 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.383+0000 7f1f4efd4640 1 -- 10.20.193.110:0/2664897324 shutdown_connections 2026-02-13T20:13:41.417 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.383+0000 7f1f4efd4640 1 -- 10.20.193.110:0/2664897324 wait complete. 2026-02-13T20:13:41.417 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:13:41.417 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-13T20:13:41.417 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-13T20:13:41.491 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.484+0000 7f9098ec3640 10 monclient: get_monmap_and_config 2026-02-13T20:13:41.491 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.484+0000 7f9098ec3640 10 monclient: build_initial_monmap 2026-02-13T20:13:41.491 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.484+0000 7f9098ec3640 10 monclient: monmap: 2026-02-13T20:13:41.491 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:13:41.491 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:41.491 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:13:41.485115+0000 2026-02-13T20:13:41.491 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:13:41.485115+0000 2026-02-13T20:13:41.491 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:13:41.491 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:41.492 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:13:41.492 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:13:41.492 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:13:41.492 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:41.492 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.485+0000 7f9098ec3640 1 Processor -- start 2026-02-13T20:13:41.492 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.485+0000 7f9098ec3640 1 -- start start 2026-02-13T20:13:41.492 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.485+0000 7f9098ec3640 10 monclient: init 2026-02-13T20:13:41.492 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.485+0000 7f9098ec3640 10 monclient: _reopen_session rank -1 2026-02-13T20:13:41.492 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.485+0000 7f9098ec3640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:13:41.492 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.485+0000 7f9098ec3640 10 monclient(hunting): picked mon.noname-c con 0x7f90941401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:13:41.492 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.485+0000 7f9098ec3640 10 monclient(hunting): picked mon.noname-b con 0x7f9094092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:13:41.492 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.485+0000 7f9098ec3640 10 monclient(hunting): picked mon.noname-a con 0x7f9094091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:13:41.492 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.485+0000 7f9098ec3640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f909408b730 con 0x7f9094091950 2026-02-13T20:13:41.492 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.485+0000 7f9098ec3640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f909405c5b0 con 0x7f90941401c0 2026-02-13T20:13:41.493 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.485+0000 7f9098ec3640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f909408bcf0 con 0x7f9094092020 2026-02-13T20:13:41.493 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.485+0000 7f9098ec3640 10 monclient(hunting): _renew_subs 2026-02-13T20:13:41.493 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.485+0000 7f9098ec3640 10 monclient(hunting): authenticate will time out at 783.175461s 2026-02-13T20:13:41.493 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.485+0000 7f9091d74640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f9094092020 0x7f90941812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:56128/0 (socket says 10.20.193.110:56128) 2026-02-13T20:13:41.493 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.485+0000 7f9091d74640 1 -- 10.20.193.110:0/264881216 learned_addr learned my addr 10.20.193.110:0/264881216 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:13:41.493 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.485+0000 7f9092d76640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f9094091950 0x7f90941a2a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:34946/0 (socket says 10.20.193.110:34946) 2026-02-13T20:13:41.493 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.485+0000 7f9091573640 1 -- 10.20.193.110:0/264881216 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3264805973 0 0) 0x7f909408b730 con 0x7f9094091950 2026-02-13T20:13:41.493 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.485+0000 7f9091573640 10 monclient(hunting): _negotiate 2026-02-13T20:13:41.493 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.485+0000 7f9091573640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:41.493 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.485+0000 7f9091573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:41.493 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.485+0000 7f9091573640 10 monclient(hunting): my global_id is 84129 2026-02-13T20:13:41.493 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.485+0000 7f9091573640 1 -- 10.20.193.110:0/264881216 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90800035e0 con 0x7f9094091950 2026-02-13T20:13:41.493 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.485+0000 7f9091573640 1 -- 10.20.193.110:0/264881216 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2921297882 0 0) 0x7f909408bcf0 con 0x7f9094092020 2026-02-13T20:13:41.493 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.485+0000 7f9091573640 10 monclient(hunting): _negotiate 2026-02-13T20:13:41.493 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.485+0000 7f9091573640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:41.494 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.485+0000 7f9091573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:41.494 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.485+0000 7f9091573640 10 monclient(hunting): my global_id is 4505 2026-02-13T20:13:41.494 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.485+0000 7f9091573640 1 -- 10.20.193.110:0/264881216 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f909408b730 con 0x7f9094092020 2026-02-13T20:13:41.494 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.485+0000 7f9091573640 1 -- 10.20.193.110:0/264881216 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 213914492 0 0) 0x7f90800035e0 con 0x7f9094091950 2026-02-13T20:13:41.494 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.485+0000 7f9091573640 1 -- 10.20.193.110:0/264881216 >> v1:10.20.193.110:6790/0 conn(0x7f9094092020 legacy=0x7f90941812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:41.494 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.485+0000 7f9091573640 1 -- 10.20.193.110:0/264881216 >> v1:10.20.193.188:6789/0 conn(0x7f90941401c0 legacy=0x7f9094091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:41.494 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.485+0000 7f9091573640 10 monclient: _finish_hunting 0 2026-02-13T20:13:41.494 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.485+0000 7f9091573640 1 monclient: found mon.noname-a 2026-02-13T20:13:41.494 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.485+0000 7f9091573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:13:41.494 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.485+0000 7f9091573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:13:41.494 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.485+0000 7f9091573640 1 -- 10.20.193.110:0/264881216 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9094140590 con 0x7f9094091950 2026-02-13T20:13:41.494 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.485+0000 7f9091573640 10 monclient: _finish_auth 0 2026-02-13T20:13:41.494 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.485+0000 7f9091573640 10 monclient: _check_auth_tickets 2026-02-13T20:13:41.494 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.485+0000 7f9091573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:13:41.494 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.485+0000 7f9091573640 1 -- 10.20.193.110:0/264881216 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f9084003eb0 con 0x7f9094091950 2026-02-13T20:13:41.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.485+0000 7f9091573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:41.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.485+0000 7f9091573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:13:41.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.485+0000 7f9091573640 10 monclient: dump: 2026-02-13T20:13:41.495 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:41.495 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:41.495 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.495 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.495 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:41.495 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:41.495 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:41.495 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:41.495 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:41.495 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:41.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.486+0000 7f9098ec3640 5 monclient: authenticate success, global_id 84129 2026-02-13T20:13:41.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.486+0000 7f9098ec3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:13:41.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.486+0000 7f9091573640 1 -- 10.20.193.110:0/264881216 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9084004080 con 0x7f9094091950 2026-02-13T20:13:41.496 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.486+0000 7f9091573640 10 monclient: handle_config config(0 keys) 2026-02-13T20:13:41.496 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.486+0000 7f9098ec3640 10 monclient: get_monmap_and_config success 2026-02-13T20:13:41.496 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.486+0000 7f9098ec3640 4 set_mon_vals no callback set 2026-02-13T20:13:41.496 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.486+0000 7f9091573640 1 -- 10.20.193.110:0/264881216 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f9084004490 con 0x7f9094091950 2026-02-13T20:13:41.496 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.486+0000 7f9091573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:41.496 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.486+0000 7f9091573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:13:41.496 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.486+0000 7f9091573640 10 monclient: dump: 2026-02-13T20:13:41.496 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:41.496 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:41.496 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.496 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.496 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:41.496 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:41.496 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:41.496 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:41.496 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:41.497 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:41.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.486+0000 7f9098ec3640 10 monclient: shutdown 2026-02-13T20:13:41.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.486+0000 7f9098ec3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:13:41.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.486+0000 7f9098ec3640 1 -- 10.20.193.110:0/264881216 >> v1:10.20.193.110:6789/0 conn(0x7f9094091950 legacy=0x7f90941a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:41.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.486+0000 7f9098ec3640 1 -- 10.20.193.110:0/264881216 shutdown_connections 2026-02-13T20:13:41.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.486+0000 7f9098ec3640 1 -- 10.20.193.110:0/264881216 >> 10.20.193.110:0/264881216 conn(0x7f9094054e90 msgr2=0x7f9094058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:13:41.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.486+0000 7f9098ec3640 1 -- 10.20.193.110:0/264881216 shutdown_connections 2026-02-13T20:13:41.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.486+0000 7f9098ec3640 1 -- 10.20.193.110:0/264881216 wait complete. 2026-02-13T20:13:41.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.486+0000 7f9098ec3640 10 monclient: build_initial_monmap 2026-02-13T20:13:41.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.486+0000 7f9098ec3640 10 monclient: monmap: 2026-02-13T20:13:41.497 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:13:41.497 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:13:41.497 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:13:41.497 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:13:41.498 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:13:41.498 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:13:41.498 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:13:41.498 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:13:41.498 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:13:41.498 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:41.498 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.486+0000 7f9098ec3640 1 Processor -- start 2026-02-13T20:13:41.498 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.486+0000 7f9098ec3640 1 -- start start 2026-02-13T20:13:41.498 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.486+0000 7f9098ec3640 10 monclient: init 2026-02-13T20:13:41.498 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f9098ec3640 10 monclient: _reopen_session rank -1 2026-02-13T20:13:41.498 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f9098ec3640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:13:41.498 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f9098ec3640 10 monclient(hunting): picked mon.noname-c con 0x7f9094091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:13:41.498 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f9098ec3640 10 monclient(hunting): picked mon.noname-a con 0x7f90941401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:13:41.498 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f9098ec3640 10 monclient(hunting): picked mon.noname-b con 0x7f909412ae70 addr v1:10.20.193.188:6789/0 2026-02-13T20:13:41.498 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f9098ec3640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f909408c380 con 0x7f90941401c0 2026-02-13T20:13:41.498 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f9098ec3640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f909412a310 con 0x7f909412ae70 2026-02-13T20:13:41.499 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f9098ec3640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90941140a0 con 0x7f9094091950 2026-02-13T20:13:41.499 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f9098ec3640 10 monclient(hunting): _renew_subs 2026-02-13T20:13:41.499 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f9098ec3640 10 monclient(hunting): authenticate will time out at 783.177152s 2026-02-13T20:13:41.499 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f9091d74640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f90941401c0 0x7f9094113990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:34954/0 (socket says 10.20.193.110:34954) 2026-02-13T20:13:41.499 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f9091d74640 1 -- 10.20.193.110:0/531359710 learned_addr learned my addr 10.20.193.110:0/531359710 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:13:41.499 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f9092575640 1 --1- 10.20.193.110:0/531359710 >> v1:10.20.193.110:6790/0 conn(0x7f9094091950 0x7f9094113280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:56130/0 (socket says 10.20.193.110:56130) 2026-02-13T20:13:41.499 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f907affd640 1 -- 10.20.193.110:0/531359710 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 338095013 0 0) 0x7f909408c380 con 0x7f90941401c0 2026-02-13T20:13:41.499 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f907affd640 10 monclient(hunting): _negotiate 2026-02-13T20:13:41.499 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f907affd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:41.499 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f907affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:41.499 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f907affd640 10 monclient(hunting): my global_id is 84132 2026-02-13T20:13:41.499 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f907affd640 1 -- 10.20.193.110:0/531359710 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90600035e0 con 0x7f90941401c0 2026-02-13T20:13:41.499 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f907affd640 1 -- 10.20.193.110:0/531359710 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1428663255 0 0) 0x7f90941140a0 con 0x7f9094091950 2026-02-13T20:13:41.499 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f907affd640 10 monclient(hunting): _negotiate 2026-02-13T20:13:41.499 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f907affd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:41.499 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f907affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:41.500 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f907affd640 10 monclient(hunting): my global_id is 4508 2026-02-13T20:13:41.500 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f907affd640 1 -- 10.20.193.110:0/531359710 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f909408c380 con 0x7f9094091950 2026-02-13T20:13:41.500 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f907affd640 1 -- 10.20.193.110:0/531359710 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4203646339 0 0) 0x7f90600035e0 con 0x7f90941401c0 2026-02-13T20:13:41.500 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f907affd640 1 -- 10.20.193.110:0/531359710 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f90941140a0 con 0x7f90941401c0 2026-02-13T20:13:41.500 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f907affd640 1 -- 10.20.193.110:0/531359710 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f907c002fe0 con 0x7f90941401c0 2026-02-13T20:13:41.500 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f907affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:13:41.500 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f907affd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:13:41.500 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f907affd640 10 monclient(hunting): dump: 2026-02-13T20:13:41.500 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:41.500 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:41.500 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.500 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.500 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:41.501 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:41.501 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:41.501 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:41.501 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:41.501 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:41.501 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f907affd640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:13:41.501 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f907affd640 1 -- 10.20.193.110:0/531359710 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3432837050 0 0) 0x7f909412a310 con 0x7f909412ae70 2026-02-13T20:13:41.501 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f907affd640 10 monclient(hunting): _negotiate 2026-02-13T20:13:41.501 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f907affd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:41.501 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f907affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:41.501 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f907affd640 10 monclient(hunting): my global_id is 4480 2026-02-13T20:13:41.501 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f907affd640 1 -- 10.20.193.110:0/531359710 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90600035e0 con 0x7f909412ae70 2026-02-13T20:13:41.501 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f907affd640 1 -- 10.20.193.110:0/531359710 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 982009864 0 0) 0x7f90941140a0 con 0x7f90941401c0 2026-02-13T20:13:41.501 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f907affd640 1 -- 10.20.193.110:0/531359710 >> v1:10.20.193.110:6790/0 conn(0x7f9094091950 legacy=0x7f9094113280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:41.501 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f907affd640 1 -- 10.20.193.110:0/531359710 >> v1:10.20.193.188:6789/0 conn(0x7f909412ae70 legacy=0x7f90941a2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:41.502 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f907affd640 10 monclient: _finish_hunting 0 2026-02-13T20:13:41.502 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f907affd640 1 monclient: found mon.a 2026-02-13T20:13:41.502 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f907affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:13:41.502 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f907affd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:13:41.502 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f907affd640 1 -- 10.20.193.110:0/531359710 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f909405d320 con 0x7f90941401c0 2026-02-13T20:13:41.502 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f907affd640 10 monclient: _finish_auth 0 2026-02-13T20:13:41.502 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f907affd640 10 monclient: _check_auth_tickets 2026-02-13T20:13:41.502 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f907affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:13:41.502 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f9098ec3640 5 monclient: authenticate success, global_id 84132 2026-02-13T20:13:41.502 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f9098ec3640 10 monclient: _renew_subs 2026-02-13T20:13:41.502 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f9098ec3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:13:41.502 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f9098ec3640 1 -- 10.20.193.110:0/531359710 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9094110be0 con 0x7f90941401c0 2026-02-13T20:13:41.502 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f9098ec3640 10 monclient: _renew_subs 2026-02-13T20:13:41.502 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f9098ec3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:13:41.502 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f9098ec3640 1 -- 10.20.193.110:0/531359710 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f909412bdd0 con 0x7f90941401c0 2026-02-13T20:13:41.502 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f907affd640 1 -- 10.20.193.110:0/531359710 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f907c0031f0 con 0x7f90941401c0 2026-02-13T20:13:41.503 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f907affd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:13:41.503 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f907affd640 1 -- 10.20.193.110:0/531359710 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f907c004b10 con 0x7f90941401c0 2026-02-13T20:13:41.503 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f907affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:41.503 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f907affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:13:41.503 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f907affd640 10 monclient: dump: 2026-02-13T20:13:41.503 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:41.503 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:41.503 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.503 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:41.503 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:41.503 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:41.503 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:41.503 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:41.503 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:41.503 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:41.504 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.487+0000 7f9090d72640 4 set_mon_vals no callback set 2026-02-13T20:13:41.504 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.488+0000 7f907affd640 1 -- 10.20.193.110:0/531359710 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f907c004c70 con 0x7f90941401c0 2026-02-13T20:13:41.504 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.488+0000 7f9098ec3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:13:41.504 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.488+0000 7f9098ec3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:13:41.504 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.488+0000 7f9098ec3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:13:41.504 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.488+0000 7f9098ec3640 1 -- 10.20.193.110:0/531359710 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90940008d0 con 0x7f90941401c0 2026-02-13T20:13:41.504 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.488+0000 7f907affd640 1 -- 10.20.193.110:0/531359710 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(113..113 src has 1..113) ==== 3915+0+0 (unknown 1040174270 0 0) 0x7f907c04e860 con 0x7f90941401c0 2026-02-13T20:13:41.504 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.488+0000 7f9092575640 10 monclient: get_auth_request con 0x7f906003f8e0 auth_method 0 2026-02-13T20:13:41.504 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.490+0000 7f907affd640 1 -- 10.20.193.110:0/531359710 <== mon.0 v1:10.20.193.110:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f907c017090 con 0x7f90941401c0 2026-02-13T20:13:41.505 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.490+0000 7f907affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:13:41.505 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.490+0000 7f907affd640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:13:41.639 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.637+0000 7f9098ec3640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-13T20:13:41.639 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.637+0000 7f9098ec3640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-13T20:13:41.639 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.637+0000 7f9098ec3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:13:41.639 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.637+0000 7f9098ec3640 1 -- 10.20.193.110:0/531359710 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f9094058410 con 0x7f90941401c0 2026-02-13T20:13:41.640 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:13:41.639+0000 7f76c5bf1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:13:41.640 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:13:41.639+0000 7f76c5bf1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=13,config=2,health=13,kv=11,logm=61} crc {auth=3766296099,config=1618278320,health=2358046931,kv=1564860261,logm=1322652864}) 2026-02-13T20:13:41.640 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.639+0000 7f907affd640 1 -- 10.20.193.110:0/531359710 <== mon.0 v1:10.20.193.110:6789/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7f907c016840 con 0x7f90941401c0 2026-02-13T20:13:41.641 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.639+0000 7f907affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-13T20:13:41.641 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.639+0000 7f907affd640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:13:41.642 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:13:41.639+0000 7f76c5bf1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=14,config=2,health=12,kv=10,logm=62} crc {auth=4023338095,config=1618278320,health=2437654043,kv=2847523468,logm=834519022}) 2026-02-13T20:13:41.642 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:13:41.639+0000 7f76c5bf1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:13:41.643 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:13:41.639+0000 7f76c5bf1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=13,config=2,health=13,kv=11,logm=61} crc {auth=3766296099,config=1618278320,health=2358046931,kv=1564860261,logm=1322652864}) 2026-02-13T20:13:41.643 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:13:41.639+0000 7f76c5bf1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=15,config=2,health=12,kv=8,logm=63} crc {auth=870602015,config=1618278320,health=3286817296,kv=389525496,logm=815463006}) 2026-02-13T20:13:41.643 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:13:41.639+0000 7f76c5bf1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:13:41.643 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:13:41.639+0000 7f76c5bf1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=249808751}) 2026-02-13T20:13:41.643 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:13:41.639+0000 7f76c5bf1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1848888170}) 2026-02-13T20:13:41.643 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:13:41.639+0000 7f76c5bf1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:13:41.643 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:13:41.639+0000 7f76c5bf1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=249808751}) 2026-02-13T20:13:41.643 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:13:41.639+0000 7f76c5bf1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=23803556}) 2026-02-13T20:13:41.643 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:13:41.640+0000 7f76c5bf1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:13:41.643 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:13:41.640+0000 7f76c5bf1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=890429916}) 2026-02-13T20:13:41.643 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:13:41.640+0000 7f76c5bf1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2707955206}) 2026-02-13T20:13:41.644 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:13:41.640+0000 7f76c5bf1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:13:41.644 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:13:41.640+0000 7f76c5bf1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=890429916}) 2026-02-13T20:13:41.644 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.640+0000 7f9098ec3640 1 -- 10.20.193.110:0/531359710 >> v1:10.20.193.188:6812/1623052694 conn(0x7f906003f8e0 legacy=0x7f906005fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:41.644 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.640+0000 7f9098ec3640 10 monclient: shutdown 2026-02-13T20:13:41.644 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.640+0000 7f9098ec3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:13:41.644 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.640+0000 7f9098ec3640 1 -- 10.20.193.110:0/531359710 >> v1:10.20.193.110:6789/0 conn(0x7f90941401c0 legacy=0x7f9094113990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:41.645 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:13:41.640+0000 7f76c5bf1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=910258054}) 2026-02-13T20:13:41.645 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.640+0000 7f9098ec3640 1 -- 10.20.193.110:0/531359710 shutdown_connections 2026-02-13T20:13:41.646 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.640+0000 7f9098ec3640 1 -- 10.20.193.110:0/531359710 >> 10.20.193.110:0/531359710 conn(0x7f9094054e90 msgr2=0x7f9094123d40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:13:41.646 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.640+0000 7f9098ec3640 1 -- 10.20.193.110:0/531359710 shutdown_connections 2026-02-13T20:13:41.646 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:41.640+0000 7f9098ec3640 1 -- 10.20.193.110:0/531359710 wait complete. 2026-02-13T20:13:41.649 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:13:41.640+0000 7f76c5bf1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:13:41.649 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:13:41.640+0000 7f76c5bf1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1358095503}) 2026-02-13T20:13:41.649 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:13:41.640+0000 7f76c5bf1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3505966439}) 2026-02-13T20:13:41.649 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:13:41.640+0000 7f76c5bf1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:13:41.649 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:13:41.640+0000 7f76c5bf1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1358095503}) 2026-02-13T20:13:41.649 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:13:41.640+0000 7f76c5bf1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=209051698}) 2026-02-13T20:13:41.649 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:13:41.641+0000 7f76c5bf1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:13:41.649 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:13:41.641+0000 7f76c5bf1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1162463306}) 2026-02-13T20:13:41.649 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:13:41.641+0000 7f76c5bf1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3678453443}) 2026-02-13T20:13:41.649 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:13:41.641+0000 7f76c5bf1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:13:41.650 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:13:41.641+0000 7f76c5bf1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1162463306}) 2026-02-13T20:13:41.650 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:13:41.641+0000 7f76c5bf1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1101285035}) 2026-02-13T20:13:41.650 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:13:41.642+0000 7f76c5bf1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:13:41.650 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:13:41.642+0000 7f76c5bf1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=54,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=8,monmap=2,nvmeofgw=3,osd_metadata=6,osd_snap=4} crc {logm=3099014920,mdsmap=3740562891,mgr=2881591710,mgr_command_descs=714296370,mgr_metadata=2819730505,mgrstat=1554049147,mon_config_key=926700118,monmap=2677135861,nvmeofgw=3360707892,osd_metadata=91123727,osd_snap=2552460543}) 2026-02-13T20:13:41.650 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:13:41.642+0000 7f76c5bf1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=57,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=9,monmap=3,nvmeofgw=2,osd_metadata=5} crc {logm=3476194308,mdsmap=3740562891,mgr=2881591710,mgr_command_descs=714296370,mgr_metadata=2819730505,mgrstat=2607260212,mon_config_key=1058644330,monmap=207866894,nvmeofgw=3140514009,osd_metadata=3112185304}) 2026-02-13T20:13:41.650 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:13:41.642+0000 7f76c5bf1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:13:41.650 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:13:41.642+0000 7f76c5bf1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=54,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=8,monmap=2,nvmeofgw=3,osd_metadata=6,osd_snap=4} crc {logm=3099014920,mdsmap=3740562891,mgr=2881591710,mgr_command_descs=714296370,mgr_metadata=2819730505,mgrstat=1554049147,mon_config_key=926700118,monmap=2677135861,nvmeofgw=3360707892,osd_metadata=91123727,osd_snap=2552460543}) 2026-02-13T20:13:41.650 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:13:41.642+0000 7f76c5bf1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=57,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=3,nvmeofgw=2,osd_metadata=5} crc {logm=2143010572,mdsmap=3740562891,mgr=2881591710,mgr_command_descs=714296370,mgr_metadata=2819730505,mgrstat=2712799000,mon_config_key=3557484700,monmap=207866894,nvmeofgw=3140514009,osd_metadata=3112185304}) 2026-02-13T20:13:41.650 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:13:41.642+0000 7f76c5bf1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:13:41.650 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:13:41.642+0000 7f76c5bf1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=16,osdmap=84} crc {osd_snap=1946106590,osdmap=2750969044}) 2026-02-13T20:13:41.650 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:13:41.642+0000 7f76c5bf1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=16,osdmap=84} crc {osd_snap=2413027998,osdmap=1001882809}) 2026-02-13T20:13:41.651 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:13:41.642+0000 7f76c5bf1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:13:41.651 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:13:41.642+0000 7f76c5bf1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=16,osdmap=84} crc {osd_snap=1946106590,osdmap=2750969044}) 2026-02-13T20:13:41.651 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:13:41.642+0000 7f76c5bf1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=17,osdmap=83} crc {osd_snap=2744841206,osdmap=82376678}) 2026-02-13T20:13:41.651 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:13:41.644+0000 7f76c5bf1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:13:41.651 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:13:41.644+0000 7f76c5bf1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=86} crc {osdmap=3164452719}) 2026-02-13T20:13:41.651 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:13:41.644+0000 7f76c5bf1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=92} crc {osdmap=2633448381}) 2026-02-13T20:13:41.651 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:13:41.644+0000 7f76c5bf1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:13:41.651 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:13:41.644+0000 7f76c5bf1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=86} crc {osdmap=3164452719}) 2026-02-13T20:13:41.651 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:13:41.644+0000 7f76c5bf1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=89} crc {osdmap=4024383333}) 2026-02-13T20:13:41.652 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-13T20:13:41.920 INFO:tasks.rados.rados.0.trial188.stdout:472: done (1 left) 2026-02-13T20:13:41.920 INFO:tasks.rados.rados.0.trial188.stdout:473: read oid 28 snap -1 2026-02-13T20:13:41.921 INFO:tasks.rados.rados.0.trial188.stdout:473: expect deleted 2026-02-13T20:13:41.921 INFO:tasks.rados.rados.0.trial188.stdout:474: write oid 34 current snap is 50 2026-02-13T20:13:41.921 INFO:tasks.rados.rados.0.trial188.stdout:474: seq_num 196 ranges {494172=457629,1586353=512385,2749730=544442} 2026-02-13T20:13:41.923 INFO:tasks.rados.rados.0.trial188.stdout:474: writing trial18843701-34 from 494172 to 951801 tid 1 2026-02-13T20:13:41.927 INFO:tasks.rados.rados.0.trial188.stdout:474: writing trial18843701-34 from 1586353 to 2098738 tid 2 2026-02-13T20:13:41.932 INFO:tasks.rados.rados.0.trial188.stdout:474: writing trial18843701-34 from 2749730 to 3294172 tid 3 2026-02-13T20:13:41.932 INFO:tasks.rados.rados.0.trial188.stdout:475: rollback oid 44 current snap is 50 2026-02-13T20:13:41.932 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 44 to 44 2026-02-13T20:13:41.932 INFO:tasks.rados.rados.0.trial188.stdout:471: finishing write tid 1 to trial18843701-21 2026-02-13T20:13:41.932 INFO:tasks.rados.rados.0.trial188.stdout:476: snap_remove snap 42 2026-02-13T20:13:42.653 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-13T20:13:42.653 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T20:13:42.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.719+0000 7fe7bccb8640 10 monclient: get_monmap_and_config 2026-02-13T20:13:42.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.719+0000 7fe7bccb8640 10 monclient: build_initial_monmap 2026-02-13T20:13:42.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.719+0000 7fe7bccb8640 10 monclient: monmap: 2026-02-13T20:13:42.720 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:13:42.720 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:42.720 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:13:42.720192+0000 2026-02-13T20:13:42.720 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:13:42.720192+0000 2026-02-13T20:13:42.720 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:13:42.721 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:42.721 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:13:42.721 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:13:42.721 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:13:42.721 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:42.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.720+0000 7fe7bccb8640 1 Processor -- start 2026-02-13T20:13:42.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.720+0000 7fe7bccb8640 1 -- start start 2026-02-13T20:13:42.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.720+0000 7fe7bccb8640 10 monclient: init 2026-02-13T20:13:42.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.720+0000 7fe7bccb8640 10 monclient: _reopen_session rank -1 2026-02-13T20:13:42.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.720+0000 7fe7bccb8640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:13:42.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.720+0000 7fe7bccb8640 10 monclient(hunting): picked mon.noname-c con 0x7fe7b8089250 addr v1:10.20.193.188:6789/0 2026-02-13T20:13:42.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.720+0000 7fe7bccb8640 10 monclient(hunting): picked mon.noname-b con 0x7fe7b8057780 addr v1:10.20.193.110:6790/0 2026-02-13T20:13:42.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.720+0000 7fe7bccb8640 10 monclient(hunting): picked mon.noname-a con 0x7fe7b8184b60 addr v1:10.20.193.110:6789/0 2026-02-13T20:13:42.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.720+0000 7fe7bccb8640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7b808a950 con 0x7fe7b8184b60 2026-02-13T20:13:42.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.720+0000 7fe7bccb8640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7b8089620 con 0x7fe7b8089250 2026-02-13T20:13:42.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.720+0000 7fe7bccb8640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7b8057c60 con 0x7fe7b8057780 2026-02-13T20:13:42.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.720+0000 7fe7bccb8640 10 monclient(hunting): _renew_subs 2026-02-13T20:13:42.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.720+0000 7fe7bccb8640 10 monclient(hunting): authenticate will time out at 784.410580s 2026-02-13T20:13:42.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.720+0000 7fe7b5d74640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fe7b8057780 0x7fe7b8183440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:56138/0 (socket says 10.20.193.110:56138) 2026-02-13T20:13:42.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.720+0000 7fe7b5d74640 1 -- 10.20.193.110:0/3679457205 learned_addr learned my addr 10.20.193.110:0/3679457205 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:13:42.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.720+0000 7fe7b6d76640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fe7b8184b60 0x7fe7b81a4f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:34962/0 (socket says 10.20.193.110:34962) 2026-02-13T20:13:42.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.720+0000 7fe7b5573640 1 -- 10.20.193.110:0/3679457205 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3519520819 0 0) 0x7fe7b808a950 con 0x7fe7b8184b60 2026-02-13T20:13:42.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.720+0000 7fe7b5573640 10 monclient(hunting): _negotiate 2026-02-13T20:13:42.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.720+0000 7fe7b5573640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:42.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.720+0000 7fe7b5573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:42.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.720+0000 7fe7b5573640 10 monclient(hunting): my global_id is 84135 2026-02-13T20:13:42.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.720+0000 7fe7b5573640 1 -- 10.20.193.110:0/3679457205 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7a40035e0 con 0x7fe7b8184b60 2026-02-13T20:13:42.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.720+0000 7fe7b5573640 1 -- 10.20.193.110:0/3679457205 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4262200137 0 0) 0x7fe7b8057c60 con 0x7fe7b8057780 2026-02-13T20:13:42.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.720+0000 7fe7b5573640 10 monclient(hunting): _negotiate 2026-02-13T20:13:42.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.720+0000 7fe7b5573640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:42.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.720+0000 7fe7b5573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:42.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.720+0000 7fe7b5573640 10 monclient(hunting): my global_id is 4511 2026-02-13T20:13:42.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.720+0000 7fe7b5573640 1 -- 10.20.193.110:0/3679457205 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7b808a950 con 0x7fe7b8057780 2026-02-13T20:13:42.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.721+0000 7fe7b5573640 1 -- 10.20.193.110:0/3679457205 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2390496244 0 0) 0x7fe7a40035e0 con 0x7fe7b8184b60 2026-02-13T20:13:42.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.721+0000 7fe7b5573640 1 -- 10.20.193.110:0/3679457205 >> v1:10.20.193.110:6790/0 conn(0x7fe7b8057780 legacy=0x7fe7b8183440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:42.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.721+0000 7fe7b5573640 1 -- 10.20.193.110:0/3679457205 >> v1:10.20.193.188:6789/0 conn(0x7fe7b8089250 legacy=0x7fe7b80580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:42.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.721+0000 7fe7b5573640 10 monclient: _finish_hunting 0 2026-02-13T20:13:42.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.721+0000 7fe7b5573640 1 monclient: found mon.noname-a 2026-02-13T20:13:42.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.721+0000 7fe7b5573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:13:42.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.721+0000 7fe7b5573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:13:42.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.721+0000 7fe7b5573640 1 -- 10.20.193.110:0/3679457205 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7b8089a50 con 0x7fe7b8184b60 2026-02-13T20:13:42.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.721+0000 7fe7b5573640 10 monclient: _finish_auth 0 2026-02-13T20:13:42.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.721+0000 7fe7b5573640 10 monclient: _check_auth_tickets 2026-02-13T20:13:42.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.721+0000 7fe7b5573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:13:42.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.721+0000 7fe7b5573640 1 -- 10.20.193.110:0/3679457205 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe7a8003eb0 con 0x7fe7b8184b60 2026-02-13T20:13:42.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.721+0000 7fe7bccb8640 5 monclient: authenticate success, global_id 84135 2026-02-13T20:13:42.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.721+0000 7fe7bccb8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:13:42.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.721+0000 7fe7b5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:42.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.721+0000 7fe7b5573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:13:42.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.721+0000 7fe7b5573640 10 monclient: dump: 2026-02-13T20:13:42.723 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:42.723 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:42.723 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:42.723 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:42.723 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:42.723 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:42.723 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:42.723 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:42.723 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:42.723 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:42.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.721+0000 7fe7bccb8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:13:42.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.721+0000 7fe7b5573640 1 -- 10.20.193.110:0/3679457205 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe7a8004170 con 0x7fe7b8184b60 2026-02-13T20:13:42.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.721+0000 7fe7b5573640 10 monclient: handle_config config(0 keys) 2026-02-13T20:13:42.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.721+0000 7fe7b5573640 1 -- 10.20.193.110:0/3679457205 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe7a8004580 con 0x7fe7b8184b60 2026-02-13T20:13:42.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.721+0000 7fe7bccb8640 10 monclient: get_monmap_and_config success 2026-02-13T20:13:42.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.721+0000 7fe7b5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:42.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.721+0000 7fe7bccb8640 4 set_mon_vals no callback set 2026-02-13T20:13:42.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.721+0000 7fe7b5573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:13:42.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.721+0000 7fe7b5573640 10 monclient: dump: 2026-02-13T20:13:42.723 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:42.723 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:42.723 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:42.723 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:42.723 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:42.723 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:42.723 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:42.724 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:42.724 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:42.724 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:42.725 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.721+0000 7fe7bccb8640 10 monclient: shutdown 2026-02-13T20:13:42.725 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.721+0000 7fe7bccb8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:13:42.725 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.721+0000 7fe7bccb8640 1 -- 10.20.193.110:0/3679457205 >> v1:10.20.193.110:6789/0 conn(0x7fe7b8184b60 legacy=0x7fe7b81a4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:42.725 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.721+0000 7fe7bccb8640 1 -- 10.20.193.110:0/3679457205 shutdown_connections 2026-02-13T20:13:42.725 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.721+0000 7fe7bccb8640 1 -- 10.20.193.110:0/3679457205 >> 10.20.193.110:0/3679457205 conn(0x7fe7b8054330 msgr2=0x7fe7b8054730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:13:42.725 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.721+0000 7fe7bccb8640 1 -- 10.20.193.110:0/3679457205 shutdown_connections 2026-02-13T20:13:42.725 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.721+0000 7fe7bccb8640 1 -- 10.20.193.110:0/3679457205 wait complete. 2026-02-13T20:13:42.725 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.722+0000 7fe7bccb8640 10 monclient: build_initial_monmap 2026-02-13T20:13:42.725 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.722+0000 7fe7bccb8640 10 monclient: monmap: 2026-02-13T20:13:42.725 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:13:42.725 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:13:42.725 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:13:42.725 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:13:42.725 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:13:42.725 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:13:42.725 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:13:42.726 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:13:42.726 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:13:42.726 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:42.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.722+0000 7fe7bccb8640 1 Processor -- start 2026-02-13T20:13:42.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.722+0000 7fe7bccb8640 1 -- start start 2026-02-13T20:13:42.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.722+0000 7fe7bccb8640 10 monclient: init 2026-02-13T20:13:42.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.722+0000 7fe7bccb8640 10 monclient: _reopen_session rank -1 2026-02-13T20:13:42.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.722+0000 7fe7bccb8640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:13:42.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.722+0000 7fe7bccb8640 10 monclient(hunting): picked mon.noname-a con 0x7fe7b8057780 addr v1:10.20.193.110:6789/0 2026-02-13T20:13:42.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.722+0000 7fe7bccb8640 10 monclient(hunting): picked mon.noname-c con 0x7fe7b8089250 addr v1:10.20.193.110:6790/0 2026-02-13T20:13:42.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.722+0000 7fe7bccb8640 10 monclient(hunting): picked mon.noname-b con 0x7fe7b8184b60 addr v1:10.20.193.188:6789/0 2026-02-13T20:13:42.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.722+0000 7fe7bccb8640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7b8062300 con 0x7fe7b8057780 2026-02-13T20:13:42.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.722+0000 7fe7bccb8640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7b812b700 con 0x7fe7b8184b60 2026-02-13T20:13:42.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.722+0000 7fe7bccb8640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7b8111ae0 con 0x7fe7b8089250 2026-02-13T20:13:42.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.722+0000 7fe7bccb8640 10 monclient(hunting): _renew_subs 2026-02-13T20:13:42.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.722+0000 7fe7bccb8640 10 monclient(hunting): authenticate will time out at 784.412590s 2026-02-13T20:13:42.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.722+0000 7fe7b6575640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fe7b8057780 0x7fe7b812aff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:34964/0 (socket says 10.20.193.110:34964) 2026-02-13T20:13:42.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.722+0000 7fe7b6575640 1 -- 10.20.193.110:0/328742476 learned_addr learned my addr 10.20.193.110:0/328742476 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:13:42.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.722+0000 7fe79effd640 1 -- 10.20.193.110:0/328742476 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3028887135 0 0) 0x7fe7b8089620 con 0x7fe7b8057780 2026-02-13T20:13:42.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.722+0000 7fe79effd640 10 monclient(hunting): _negotiate 2026-02-13T20:13:42.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.722+0000 7fe79effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:42.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.722+0000 7fe79effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:42.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.722+0000 7fe79effd640 10 monclient(hunting): my global_id is 84138 2026-02-13T20:13:42.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.722+0000 7fe79effd640 1 -- 10.20.193.110:0/328742476 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7840035e0 con 0x7fe7b8057780 2026-02-13T20:13:42.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.722+0000 7fe79effd640 1 -- 10.20.193.110:0/328742476 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 810073142 0 0) 0x7fe7b8111ae0 con 0x7fe7b8089250 2026-02-13T20:13:42.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.722+0000 7fe79effd640 10 monclient(hunting): _negotiate 2026-02-13T20:13:42.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.722+0000 7fe79effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:42.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.722+0000 7fe79effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:42.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.722+0000 7fe79effd640 10 monclient(hunting): my global_id is 4514 2026-02-13T20:13:42.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.722+0000 7fe79effd640 1 -- 10.20.193.110:0/328742476 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7b8089620 con 0x7fe7b8089250 2026-02-13T20:13:42.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.722+0000 7fe79effd640 1 -- 10.20.193.110:0/328742476 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1870712174 0 0) 0x7fe7840035e0 con 0x7fe7b8057780 2026-02-13T20:13:42.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.722+0000 7fe79effd640 1 -- 10.20.193.110:0/328742476 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe7b8111ae0 con 0x7fe7b8057780 2026-02-13T20:13:42.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.722+0000 7fe79effd640 1 -- 10.20.193.110:0/328742476 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe7ac003170 con 0x7fe7b8057780 2026-02-13T20:13:42.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.722+0000 7fe79effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:13:42.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.722+0000 7fe79effd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:13:42.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.722+0000 7fe79effd640 10 monclient(hunting): dump: 2026-02-13T20:13:42.726 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:42.726 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:42.727 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:42.727 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:42.727 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:42.727 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:42.727 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:42.727 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:42.727 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:42.727 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:42.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.722+0000 7fe79effd640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:13:42.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.723+0000 7fe79effd640 1 -- 10.20.193.110:0/328742476 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2358510092 0 0) 0x7fe7b8089620 con 0x7fe7b8089250 2026-02-13T20:13:42.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.723+0000 7fe79effd640 1 -- 10.20.193.110:0/328742476 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe7840035e0 con 0x7fe7b8089250 2026-02-13T20:13:42.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.723+0000 7fe79effd640 1 -- 10.20.193.110:0/328742476 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe7a0002eb0 con 0x7fe7b8089250 2026-02-13T20:13:42.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.723+0000 7fe79effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:13:42.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.723+0000 7fe79effd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:13:42.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.723+0000 7fe79effd640 10 monclient(hunting): dump: 2026-02-13T20:13:42.727 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:42.727 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:42.727 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:42.727 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:42.727 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:42.727 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:42.727 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:42.727 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:42.727 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:42.727 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:42.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.723+0000 7fe79effd640 1 -- 10.20.193.110:0/328742476 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 941174959 0 0) 0x7fe7b8111ae0 con 0x7fe7b8057780 2026-02-13T20:13:42.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.723+0000 7fe79effd640 1 -- 10.20.193.110:0/328742476 >> v1:10.20.193.110:6790/0 conn(0x7fe7b8089250 legacy=0x7fe7b81723b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:42.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.723+0000 7fe79effd640 1 -- 10.20.193.110:0/328742476 >> v1:10.20.193.188:6789/0 conn(0x7fe7b8184b60 legacy=0x7fe7b8173ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:42.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.723+0000 7fe79effd640 10 monclient: _finish_hunting 0 2026-02-13T20:13:42.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.723+0000 7fe79effd640 1 monclient: found mon.a 2026-02-13T20:13:42.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.723+0000 7fe79effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:13:42.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.723+0000 7fe79effd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:13:42.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.723+0000 7fe79effd640 1 -- 10.20.193.110:0/328742476 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7b81105f0 con 0x7fe7b8057780 2026-02-13T20:13:42.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.723+0000 7fe79effd640 10 monclient: _finish_auth 0 2026-02-13T20:13:42.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.723+0000 7fe79effd640 10 monclient: _check_auth_tickets 2026-02-13T20:13:42.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.723+0000 7fe79effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:13:42.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.723+0000 7fe7bccb8640 5 monclient: authenticate success, global_id 84138 2026-02-13T20:13:42.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.723+0000 7fe7bccb8640 10 monclient: _renew_subs 2026-02-13T20:13:42.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.723+0000 7fe7bccb8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:13:42.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.723+0000 7fe7bccb8640 1 -- 10.20.193.110:0/328742476 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe7b81129b0 con 0x7fe7b8057780 2026-02-13T20:13:42.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.723+0000 7fe7bccb8640 10 monclient: _renew_subs 2026-02-13T20:13:42.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.723+0000 7fe7bccb8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:13:42.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.723+0000 7fe7bccb8640 1 -- 10.20.193.110:0/328742476 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe7b81112f0 con 0x7fe7b8057780 2026-02-13T20:13:42.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.723+0000 7fe79effd640 1 -- 10.20.193.110:0/328742476 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe7ac003340 con 0x7fe7b8057780 2026-02-13T20:13:42.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.723+0000 7fe79effd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:13:42.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.723+0000 7fe79effd640 1 -- 10.20.193.110:0/328742476 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe7ac003b30 con 0x7fe7b8057780 2026-02-13T20:13:42.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.723+0000 7fe79effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:42.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.723+0000 7fe79effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:13:42.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.723+0000 7fe79effd640 10 monclient: dump: 2026-02-13T20:13:42.728 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:42.728 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:42.728 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:42.728 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:42.728 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:42.728 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:42.728 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:42.728 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:42.728 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:42.728 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:42.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.723+0000 7fe7b4d72640 4 set_mon_vals no callback set 2026-02-13T20:13:42.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.723+0000 7fe7bccb8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:13:42.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.723+0000 7fe7bccb8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:13:42.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.723+0000 7fe7bccb8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:13:42.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.723+0000 7fe7bccb8640 1 -- 10.20.193.110:0/328742476 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7b8112480 con 0x7fe7b8057780 2026-02-13T20:13:42.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.723+0000 7fe79effd640 1 -- 10.20.193.110:0/328742476 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fe7ac003c90 con 0x7fe7b8057780 2026-02-13T20:13:42.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.723+0000 7fe79effd640 1 -- 10.20.193.110:0/328742476 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(114..114 src has 1..114) ==== 3959+0+0 (unknown 2221012703 0 0) 0x7fe7ac04e860 con 0x7fe7b8057780 2026-02-13T20:13:42.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.724+0000 7fe7b5d74640 10 monclient: get_auth_request con 0x7fe78403fae0 auth_method 0 2026-02-13T20:13:42.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.726+0000 7fe79effd640 1 -- 10.20.193.110:0/328742476 <== mon.0 v1:10.20.193.110:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fe7ac016f80 con 0x7fe7b8057780 2026-02-13T20:13:42.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.726+0000 7fe79effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:13:42.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.726+0000 7fe79effd640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:13:42.879 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.878+0000 7fe7bccb8640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T20:13:42.879 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.878+0000 7fe7bccb8640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T20:13:42.879 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.878+0000 7fe7bccb8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:13:42.880 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.878+0000 7fe7bccb8640 1 -- 10.20.193.110:0/328742476 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe7b8062300 con 0x7fe7b8057780 2026-02-13T20:13:42.880 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.878+0000 7fe79effd640 1 -- 10.20.193.110:0/328742476 <== mon.0 v1:10.20.193.110:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 2820335679) 0x7fe7b8062300 con 0x7fe7b8057780 2026-02-13T20:13:42.880 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.878+0000 7fe79effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T20:13:42.880 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.878+0000 7fe79effd640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:13:42.880 INFO:teuthology.orchestra.run.trial110.stdout:{"election_epoch":12,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","modified":"2026-02-13T20:11:07.161192Z","created":"2026-02-13T20:11:07.161192Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6789","nonce":0}]},"addr":"10.20.193.110:6789/0","public_addr":"10.20.193.110:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161241+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6789","nonce":0}]},"addr":"10.20.193.188:6789/0","public_addr":"10.20.193.188:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161242+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6790","nonce":0}]},"addr":"10.20.193.110:6790/0","public_addr":"10.20.193.110:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161243+0000","crush_location":[]}]}} 2026-02-13T20:13:42.881 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.879+0000 7fe7bccb8640 1 -- 10.20.193.110:0/328742476 >> v1:10.20.193.188:6812/1623052694 conn(0x7fe78403fae0 legacy=0x7fe78405ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:42.881 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.879+0000 7fe7bccb8640 10 monclient: shutdown 2026-02-13T20:13:42.881 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.879+0000 7fe7bccb8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:13:42.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.879+0000 7fe7bccb8640 1 -- 10.20.193.110:0/328742476 >> v1:10.20.193.110:6789/0 conn(0x7fe7b8057780 legacy=0x7fe7b812aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:42.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.879+0000 7fe7bccb8640 1 -- 10.20.193.110:0/328742476 shutdown_connections 2026-02-13T20:13:42.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.879+0000 7fe7bccb8640 1 -- 10.20.193.110:0/328742476 >> 10.20.193.110:0/328742476 conn(0x7fe7b8054330 msgr2=0x7fe7b808b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:13:42.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.879+0000 7fe7bccb8640 1 -- 10.20.193.110:0/328742476 shutdown_connections 2026-02-13T20:13:42.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.879+0000 7fe7bccb8640 1 -- 10.20.193.110:0/328742476 wait complete. 2026-02-13T20:13:42.888 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-13T20:13:42.888 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-13T20:13:42.888 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-13T20:13:42.888 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T20:13:42.923 INFO:tasks.rados.rados.0.trial188.stdout:476: done (4 left) 2026-02-13T20:13:42.923 INFO:tasks.rados.rados.0.trial188.stdout:477: delete oid 10 current snap is 50 2026-02-13T20:13:42.923 INFO:tasks.rados.rados.0.trial188.stdout:471: finishing write tid 2 to trial18843701-21 2026-02-13T20:13:42.923 INFO:tasks.rados.rados.0.trial188.stdout:471: finishing write tid 3 to trial18843701-21 2026-02-13T20:13:42.923 INFO:tasks.rados.rados.0.trial188.stdout:471: finishing write tid 4 to trial18843701-21 2026-02-13T20:13:42.923 INFO:tasks.rados.rados.0.trial188.stdout:471: finishing write tid 5 to trial18843701-21 2026-02-13T20:13:42.924 INFO:tasks.rados.rados.0.trial188.stdout:471: oid 21 updating version 0 to 63 2026-02-13T20:13:42.924 INFO:tasks.rados.rados.0.trial188.stdout:471: oid 21 version 63 is already newer than 62 2026-02-13T20:13:42.924 INFO:tasks.rados.rados.0.trial188.stdout:471: oid 21 version 63 is already newer than 60 2026-02-13T20:13:42.924 INFO:tasks.rados.rados.0.trial188.stdout:471: oid 21 version 63 is already newer than 61 2026-02-13T20:13:42.924 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 21 v 63 (ObjNum 195 snap 50 seq_num 195) dirty exists 2026-02-13T20:13:42.924 INFO:tasks.rados.rados.0.trial188.stdout:471: left oid 21 (ObjNum 195 snap 50 seq_num 195) 2026-02-13T20:13:42.924 INFO:tasks.rados.rados.0.trial188.stdout:475: finishing rollback tid 0 to trial18843701-44 2026-02-13T20:13:42.924 INFO:tasks.rados.rados.0.trial188.stdout:475: finishing rollback tid 1 to trial18843701-44 2026-02-13T20:13:42.924 INFO:tasks.rados.rados.0.trial188.stdout:475: finishing rollback tid 2 to trial18843701-44 2026-02-13T20:13:42.924 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 44 v 214 (ObjNum 132 snap 23 seq_num 132) dirty exists 2026-02-13T20:13:42.924 INFO:tasks.rados.rados.0.trial188.stdout:474: finishing write tid 1 to trial18843701-34 2026-02-13T20:13:42.924 INFO:tasks.rados.rados.0.trial188.stdout:474: finishing write tid 2 to trial18843701-34 2026-02-13T20:13:42.925 INFO:tasks.rados.rados.0.trial188.stdout:474: finishing write tid 3 to trial18843701-34 2026-02-13T20:13:42.925 INFO:tasks.rados.rados.0.trial188.stdout:474: finishing write tid 4 to trial18843701-34 2026-02-13T20:13:42.925 INFO:tasks.rados.rados.0.trial188.stdout:474: finishing write tid 5 to trial18843701-34 2026-02-13T20:13:42.925 INFO:tasks.rados.rados.0.trial188.stdout:474: oid 34 updating version 0 to 128 2026-02-13T20:13:42.925 INFO:tasks.rados.rados.0.trial188.stdout:474: oid 34 updating version 128 to 130 2026-02-13T20:13:42.925 INFO:tasks.rados.rados.0.trial188.stdout:474: oid 34 updating version 130 to 131 2026-02-13T20:13:42.925 INFO:tasks.rados.rados.0.trial188.stdout:474: oid 34 version 131 is already newer than 129 2026-02-13T20:13:42.925 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 34 v 131 (ObjNum 196 snap 50 seq_num 196) dirty exists 2026-02-13T20:13:42.925 INFO:tasks.rados.rados.0.trial188.stdout:474: left oid 34 (ObjNum 196 snap 50 seq_num 196) 2026-02-13T20:13:42.926 INFO:tasks.rados.rados.0.trial188.stdout:471: done (4 left) 2026-02-13T20:13:42.926 INFO:tasks.rados.rados.0.trial188.stdout:473: done (3 left) 2026-02-13T20:13:42.926 INFO:tasks.rados.rados.0.trial188.stdout:474: done (2 left) 2026-02-13T20:13:42.926 INFO:tasks.rados.rados.0.trial188.stdout:475: done (1 left) 2026-02-13T20:13:42.926 INFO:tasks.rados.rados.0.trial188.stdout:477: done (0 left) 2026-02-13T20:13:42.926 INFO:tasks.rados.rados.0.trial188.stdout:478: delete oid 18 current snap is 50 2026-02-13T20:13:42.927 INFO:tasks.rados.rados.0.trial188.stdout:478: done (0 left) 2026-02-13T20:13:42.927 INFO:tasks.rados.rados.0.trial188.stdout:479: snap_remove snap 48 2026-02-13T20:13:42.955 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.953+0000 7fe4f27a5640 10 monclient: get_monmap_and_config 2026-02-13T20:13:42.955 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.953+0000 7fe4f27a5640 10 monclient: build_initial_monmap 2026-02-13T20:13:42.955 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.953+0000 7fe4f27a5640 10 monclient: monmap: 2026-02-13T20:13:42.955 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:13:42.955 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:42.956 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:13:42.954803+0000 2026-02-13T20:13:42.956 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:13:42.954803+0000 2026-02-13T20:13:42.956 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:13:42.956 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:42.956 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:13:42.956 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:13:42.956 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:13:42.956 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:42.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.953+0000 7fe4f27a5640 1 Processor -- start 2026-02-13T20:13:42.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.953+0000 7fe4f27a5640 1 -- start start 2026-02-13T20:13:42.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.953+0000 7fe4f27a5640 10 monclient: init 2026-02-13T20:13:42.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.954+0000 7fe4f27a5640 10 monclient: _reopen_session rank -1 2026-02-13T20:13:42.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.954+0000 7fe4f27a5640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:13:42.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.954+0000 7fe4f27a5640 10 monclient(hunting): picked mon.noname-b con 0x7fe4ec1401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:13:42.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.954+0000 7fe4f27a5640 10 monclient(hunting): picked mon.noname-c con 0x7fe4ec092020 addr v1:10.20.193.188:6789/0 2026-02-13T20:13:42.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.954+0000 7fe4f27a5640 10 monclient(hunting): picked mon.noname-a con 0x7fe4ec091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:13:42.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.954+0000 7fe4f27a5640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4ec08b730 con 0x7fe4ec091950 2026-02-13T20:13:42.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.954+0000 7fe4f27a5640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4ec05c5b0 con 0x7fe4ec092020 2026-02-13T20:13:42.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.954+0000 7fe4f27a5640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4ec08bcf0 con 0x7fe4ec1401c0 2026-02-13T20:13:42.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.954+0000 7fe4f27a5640 10 monclient(hunting): _renew_subs 2026-02-13T20:13:42.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.954+0000 7fe4f27a5640 10 monclient(hunting): authenticate will time out at 784.645354s 2026-02-13T20:13:42.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.954+0000 7fe4ebfff640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fe4ec1401c0 0x7fe4ec091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:56148/0 (socket says 10.20.193.110:56148) 2026-02-13T20:13:42.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.954+0000 7fe4ebfff640 1 -- 10.20.193.110:0/539717291 learned_addr learned my addr 10.20.193.110:0/539717291 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:13:42.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.954+0000 7fe4eaffd640 1 -- 10.20.193.110:0/539717291 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 489349236 0 0) 0x7fe4ec08bcf0 con 0x7fe4ec1401c0 2026-02-13T20:13:42.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.954+0000 7fe4eaffd640 10 monclient(hunting): _negotiate 2026-02-13T20:13:42.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.954+0000 7fe4eaffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:42.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.954+0000 7fe4eaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:42.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.954+0000 7fe4eaffd640 10 monclient(hunting): my global_id is 4517 2026-02-13T20:13:42.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.954+0000 7fe4eaffd640 1 -- 10.20.193.110:0/539717291 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4d00035e0 con 0x7fe4ec1401c0 2026-02-13T20:13:42.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.954+0000 7fe4eaffd640 1 -- 10.20.193.110:0/539717291 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2909003921 0 0) 0x7fe4ec08b730 con 0x7fe4ec091950 2026-02-13T20:13:42.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.954+0000 7fe4eaffd640 10 monclient(hunting): _negotiate 2026-02-13T20:13:42.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.954+0000 7fe4eaffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:42.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.954+0000 7fe4eaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:42.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.954+0000 7fe4eaffd640 10 monclient(hunting): my global_id is 84141 2026-02-13T20:13:42.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.954+0000 7fe4eaffd640 1 -- 10.20.193.110:0/539717291 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4ec08bcf0 con 0x7fe4ec091950 2026-02-13T20:13:42.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.954+0000 7fe4eaffd640 1 -- 10.20.193.110:0/539717291 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4218702818 0 0) 0x7fe4d00035e0 con 0x7fe4ec1401c0 2026-02-13T20:13:42.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.954+0000 7fe4eaffd640 1 -- 10.20.193.110:0/539717291 >> v1:10.20.193.188:6789/0 conn(0x7fe4ec092020 legacy=0x7fe4ec1812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:42.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.954+0000 7fe4eaffd640 1 -- 10.20.193.110:0/539717291 >> v1:10.20.193.110:6789/0 conn(0x7fe4ec091950 legacy=0x7fe4ec1a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:42.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.954+0000 7fe4eaffd640 10 monclient: _finish_hunting 0 2026-02-13T20:13:42.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.954+0000 7fe4eaffd640 1 monclient: found mon.noname-b 2026-02-13T20:13:42.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.954+0000 7fe4eaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:13:42.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.954+0000 7fe4eaffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:13:42.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.954+0000 7fe4eaffd640 1 -- 10.20.193.110:0/539717291 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4ec140590 con 0x7fe4ec1401c0 2026-02-13T20:13:42.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.954+0000 7fe4eaffd640 10 monclient: _finish_auth 0 2026-02-13T20:13:42.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.954+0000 7fe4eaffd640 10 monclient: _check_auth_tickets 2026-02-13T20:13:42.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.954+0000 7fe4eaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:13:42.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.954+0000 7fe4eaffd640 1 -- 10.20.193.110:0/539717291 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe4d8002dd0 con 0x7fe4ec1401c0 2026-02-13T20:13:42.970 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.954+0000 7fe4f27a5640 5 monclient: authenticate success, global_id 4517 2026-02-13T20:13:42.970 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.954+0000 7fe4f27a5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:13:42.970 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.954+0000 7fe4eaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:42.970 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.954+0000 7fe4eaffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:13:42.970 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.954+0000 7fe4eaffd640 10 monclient: dump: 2026-02-13T20:13:42.970 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:42.970 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:42.970 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:42.970 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:42.970 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:42.970 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:42.970 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:42.971 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:42.971 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:42.971 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:42.971 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.954+0000 7fe4f27a5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:13:42.971 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.954+0000 7fe4eaffd640 1 -- 10.20.193.110:0/539717291 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe4d8002fe0 con 0x7fe4ec1401c0 2026-02-13T20:13:42.971 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.954+0000 7fe4eaffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:13:42.971 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.954+0000 7fe4eaffd640 1 -- 10.20.193.110:0/539717291 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe4d80033f0 con 0x7fe4ec1401c0 2026-02-13T20:13:42.971 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.954+0000 7fe4f27a5640 10 monclient: get_monmap_and_config success 2026-02-13T20:13:42.971 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.954+0000 7fe4f27a5640 4 set_mon_vals no callback set 2026-02-13T20:13:42.971 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.954+0000 7fe4eaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:42.971 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.954+0000 7fe4eaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:13:42.971 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.954+0000 7fe4eaffd640 10 monclient: dump: 2026-02-13T20:13:42.971 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:42.972 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:42.972 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:42.972 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:42.972 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:42.972 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:42.972 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:42.972 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:42.972 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:42.972 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:42.972 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.955+0000 7fe4f27a5640 10 monclient: shutdown 2026-02-13T20:13:42.972 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.955+0000 7fe4f27a5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:13:42.972 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.955+0000 7fe4f27a5640 1 -- 10.20.193.110:0/539717291 >> v1:10.20.193.110:6790/0 conn(0x7fe4ec1401c0 legacy=0x7fe4ec091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:42.973 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.955+0000 7fe4f27a5640 1 -- 10.20.193.110:0/539717291 shutdown_connections 2026-02-13T20:13:42.973 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.955+0000 7fe4f27a5640 1 -- 10.20.193.110:0/539717291 >> 10.20.193.110:0/539717291 conn(0x7fe4ec054e90 msgr2=0x7fe4ec058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:13:42.973 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.955+0000 7fe4f27a5640 1 -- 10.20.193.110:0/539717291 shutdown_connections 2026-02-13T20:13:42.973 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.955+0000 7fe4f27a5640 1 -- 10.20.193.110:0/539717291 wait complete. 2026-02-13T20:13:42.973 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.955+0000 7fe4f27a5640 10 monclient: build_initial_monmap 2026-02-13T20:13:42.973 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.955+0000 7fe4f27a5640 10 monclient: monmap: 2026-02-13T20:13:42.973 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:13:42.973 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:13:42.973 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:13:42.973 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:13:42.974 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:13:42.974 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:13:42.974 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:13:42.974 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:13:42.974 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:13:42.974 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:42.974 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.955+0000 7fe4f27a5640 1 Processor -- start 2026-02-13T20:13:42.974 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.955+0000 7fe4f27a5640 1 -- start start 2026-02-13T20:13:42.974 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.955+0000 7fe4f27a5640 10 monclient: init 2026-02-13T20:13:42.974 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4f27a5640 10 monclient: _reopen_session rank -1 2026-02-13T20:13:42.974 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4f27a5640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:13:42.974 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4f27a5640 10 monclient(hunting): picked mon.noname-c con 0x7fe4ec091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:13:42.975 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4f27a5640 10 monclient(hunting): picked mon.noname-a con 0x7fe4ec1401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:13:42.975 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4f27a5640 10 monclient(hunting): picked mon.noname-b con 0x7fe4ec13ee70 addr v1:10.20.193.188:6789/0 2026-02-13T20:13:42.975 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4f27a5640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4ec05d320 con 0x7fe4ec1401c0 2026-02-13T20:13:42.975 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4f27a5640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4ec08c310 con 0x7fe4ec13ee70 2026-02-13T20:13:42.975 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4f27a5640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4ec090ef0 con 0x7fe4ec091950 2026-02-13T20:13:42.975 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4f27a5640 10 monclient(hunting): _renew_subs 2026-02-13T20:13:42.975 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4f27a5640 10 monclient(hunting): authenticate will time out at 784.647103s 2026-02-13T20:13:42.975 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4ebfff640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fe4ec091950 0x7fe4ec088e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:56158/0 (socket says 10.20.193.110:56158) 2026-02-13T20:13:42.975 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4ebfff640 1 -- 10.20.193.110:0/3875521196 learned_addr learned my addr 10.20.193.110:0/3875521196 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:13:42.975 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4e8ff9640 1 -- 10.20.193.110:0/3875521196 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 542664183 0 0) 0x7fe4ec05d320 con 0x7fe4ec1401c0 2026-02-13T20:13:42.975 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4e8ff9640 10 monclient(hunting): _negotiate 2026-02-13T20:13:42.975 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4e8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:42.976 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4e8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:42.976 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4e8ff9640 10 monclient(hunting): my global_id is 84144 2026-02-13T20:13:42.976 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4e8ff9640 1 -- 10.20.193.110:0/3875521196 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4bc0035e0 con 0x7fe4ec1401c0 2026-02-13T20:13:42.976 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4e8ff9640 1 -- 10.20.193.110:0/3875521196 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3837266066 0 0) 0x7fe4ec090ef0 con 0x7fe4ec091950 2026-02-13T20:13:42.976 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4e8ff9640 10 monclient(hunting): _negotiate 2026-02-13T20:13:42.976 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4e8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:42.976 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4e8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:42.976 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4e8ff9640 10 monclient(hunting): my global_id is 4520 2026-02-13T20:13:42.976 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4e8ff9640 1 -- 10.20.193.110:0/3875521196 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4ec05d320 con 0x7fe4ec091950 2026-02-13T20:13:42.976 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4e8ff9640 1 -- 10.20.193.110:0/3875521196 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4280585489 0 0) 0x7fe4bc0035e0 con 0x7fe4ec1401c0 2026-02-13T20:13:42.976 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4e8ff9640 1 -- 10.20.193.110:0/3875521196 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe4ec090ef0 con 0x7fe4ec1401c0 2026-02-13T20:13:42.976 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4e8ff9640 1 -- 10.20.193.110:0/3875521196 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe4dc003070 con 0x7fe4ec1401c0 2026-02-13T20:13:42.976 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4e8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:13:42.977 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4e8ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:13:42.977 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4e8ff9640 10 monclient(hunting): dump: 2026-02-13T20:13:42.977 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:42.977 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:42.977 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:42.977 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:42.977 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:42.977 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:42.977 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:42.977 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:42.977 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:42.977 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:42.978 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4e8ff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:13:42.978 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4e8ff9640 1 -- 10.20.193.110:0/3875521196 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 598294843 0 0) 0x7fe4ec05d320 con 0x7fe4ec091950 2026-02-13T20:13:42.978 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4e8ff9640 1 -- 10.20.193.110:0/3875521196 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe4bc0035e0 con 0x7fe4ec091950 2026-02-13T20:13:42.978 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4e8ff9640 1 -- 10.20.193.110:0/3875521196 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe4d8003300 con 0x7fe4ec091950 2026-02-13T20:13:42.978 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4e8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:13:42.978 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4e8ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:13:42.978 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4e8ff9640 10 monclient(hunting): dump: 2026-02-13T20:13:42.978 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:42.978 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:42.978 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:42.978 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:42.978 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:42.978 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:42.979 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:42.979 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:42.979 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:42.979 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:42.979 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4e8ff9640 1 -- 10.20.193.110:0/3875521196 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4015800919 0 0) 0x7fe4ec090ef0 con 0x7fe4ec1401c0 2026-02-13T20:13:42.979 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4e8ff9640 1 -- 10.20.193.110:0/3875521196 >> v1:10.20.193.110:6790/0 conn(0x7fe4ec091950 legacy=0x7fe4ec088e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:42.979 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4e8ff9640 1 -- 10.20.193.110:0/3875521196 >> v1:10.20.193.188:6789/0 conn(0x7fe4ec13ee70 legacy=0x7fe4ec1a2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:42.979 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4e8ff9640 10 monclient: _finish_hunting 0 2026-02-13T20:13:42.979 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4e8ff9640 1 monclient: found mon.a 2026-02-13T20:13:42.979 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4e8ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:13:42.979 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4e8ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:13:42.979 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4e8ff9640 1 -- 10.20.193.110:0/3875521196 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4ec12f550 con 0x7fe4ec1401c0 2026-02-13T20:13:42.980 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4e8ff9640 10 monclient: _finish_auth 0 2026-02-13T20:13:42.980 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4e8ff9640 10 monclient: _check_auth_tickets 2026-02-13T20:13:42.980 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4e8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:13:42.980 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4f27a5640 5 monclient: authenticate success, global_id 84144 2026-02-13T20:13:42.980 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4f27a5640 10 monclient: _renew_subs 2026-02-13T20:13:42.980 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4f27a5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:13:42.980 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4f27a5640 1 -- 10.20.193.110:0/3875521196 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe4ec089c50 con 0x7fe4ec1401c0 2026-02-13T20:13:42.980 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4f27a5640 10 monclient: _renew_subs 2026-02-13T20:13:42.980 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4f27a5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:13:42.980 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4f27a5640 1 -- 10.20.193.110:0/3875521196 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe4ec12f270 con 0x7fe4ec1401c0 2026-02-13T20:13:42.980 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4e8ff9640 1 -- 10.20.193.110:0/3875521196 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe4dc003240 con 0x7fe4ec1401c0 2026-02-13T20:13:42.980 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4e8ff9640 10 monclient: handle_config config(0 keys) 2026-02-13T20:13:42.981 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4e8ff9640 1 -- 10.20.193.110:0/3875521196 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe4dc003900 con 0x7fe4ec1401c0 2026-02-13T20:13:42.981 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4e8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:42.981 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4e8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:13:42.981 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4e8ff9640 10 monclient: dump: 2026-02-13T20:13:42.981 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:42.981 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:42.981 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:42.981 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:42.981 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:42.981 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:42.981 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:42.981 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:42.981 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:42.982 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:42.982 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4ea7fc640 4 set_mon_vals no callback set 2026-02-13T20:13:42.982 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.956+0000 7fe4f27a5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:13:42.982 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.957+0000 7fe4f27a5640 1 -- 10.20.193.110:0/3875521196 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe4ec12f070 con 0x7fe4ec092020 2026-02-13T20:13:42.982 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.957+0000 7fe4e8ff9640 1 -- 10.20.193.110:0/3875521196 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fe4dc003a60 con 0x7fe4ec1401c0 2026-02-13T20:13:42.982 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.957+0000 7fe4e8ff9640 1 -- 10.20.193.110:0/3875521196 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3152389215 0 0) 0x7fe4ec12f070 con 0x7fe4ec092020 2026-02-13T20:13:42.982 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.957+0000 7fe4e8ff9640 10 monclient(hunting): _negotiate 2026-02-13T20:13:42.982 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.957+0000 7fe4e8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:42.982 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.957+0000 7fe4e8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:42.982 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.957+0000 7fe4e8ff9640 10 monclient(hunting): my global_id is 84147 2026-02-13T20:13:42.982 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.957+0000 7fe4e8ff9640 1 -- 10.20.193.110:0/3875521196 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4ec090ef0 con 0x7fe4ec092020 2026-02-13T20:13:42.982 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.957+0000 7fe4e8ff9640 1 -- 10.20.193.110:0/3875521196 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(115..115 src has 1..115) ==== 3975+0+0 (unknown 2473386841 0 0) 0x7fe4dc04d7a0 con 0x7fe4ec1401c0 2026-02-13T20:13:42.982 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.957+0000 7fe4f0d1b640 10 monclient: get_auth_request con 0x7fe4bc03fa70 auth_method 0 2026-02-13T20:13:42.983 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.957+0000 7fe4e8ff9640 1 -- 10.20.193.110:0/3875521196 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1108429689 0 0) 0x7fe4ec090ef0 con 0x7fe4ec092020 2026-02-13T20:13:42.983 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.957+0000 7fe4e8ff9640 1 -- 10.20.193.110:0/3875521196 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe4ec12f070 con 0x7fe4ec092020 2026-02-13T20:13:42.983 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.957+0000 7fe4e8ff9640 1 -- 10.20.193.110:0/3875521196 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe4d8004a90 con 0x7fe4ec092020 2026-02-13T20:13:42.983 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.957+0000 7fe4e8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:42.983 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.957+0000 7fe4e8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:13:42.983 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.957+0000 7fe4e8ff9640 10 monclient: dump: 2026-02-13T20:13:42.983 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:42.983 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:42.983 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:42.983 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:42.983 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:42.984 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:42.984 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:42.984 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:42.984 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:42.984 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:42.984 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.957+0000 7fe4e8ff9640 1 -- 10.20.193.110:0/3875521196 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2128473942 0 0) 0x7fe4ec12f070 con 0x7fe4ec092020 2026-02-13T20:13:42.984 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.957+0000 7fe4e8ff9640 1 -- 10.20.193.110:0/3875521196 --> v1:10.20.193.110:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe4ec125f00 con 0x7fe4ec092020 2026-02-13T20:13:42.984 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.957+0000 7fe4e8ff9640 1 -- 10.20.193.110:0/3875521196 <== mon.0 v1:10.20.193.110:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fe4d8004e60 con 0x7fe4ec092020 2026-02-13T20:13:42.984 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.957+0000 7fe4e8ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:13:42.984 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.957+0000 7fe4e8ff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:13:42.984 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.957+0000 7fe4e8ff9640 1 -- 10.20.193.110:0/3875521196 >> v1:10.20.193.110:6789/0 conn(0x7fe4ec092020 legacy=0x7fe4ec1a3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:42.985 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.957+0000 7fe4e8ff9640 1 -- 10.20.193.110:0/3875521196 >> v1:10.20.193.110:6789/0 conn(0x7fe4ec092020 legacy=0x7fe4ec1a3770 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:13:42.985 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.961+0000 7fe4f27a5640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:13:42.985 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.961+0000 7fe4f27a5640 1 -- 10.20.193.110:0/3875521196 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe4ec1a4250 con 0x7fe4ec1a3e80 2026-02-13T20:13:42.985 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.961+0000 7fe4e8ff9640 1 -- 10.20.193.110:0/3875521196 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2876192949 0 0) 0x7fe4ec1a4250 con 0x7fe4ec1a3e80 2026-02-13T20:13:42.985 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.961+0000 7fe4e8ff9640 10 monclient(hunting): _negotiate 2026-02-13T20:13:42.985 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.961+0000 7fe4e8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:42.985 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.961+0000 7fe4e8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:42.985 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.961+0000 7fe4e8ff9640 10 monclient(hunting): my global_id is 84150 2026-02-13T20:13:42.985 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.961+0000 7fe4e8ff9640 1 -- 10.20.193.110:0/3875521196 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4ec12f070 con 0x7fe4ec1a3e80 2026-02-13T20:13:42.985 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.961+0000 7fe4e8ff9640 1 -- 10.20.193.110:0/3875521196 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 880425232 0 0) 0x7fe4ec12f070 con 0x7fe4ec1a3e80 2026-02-13T20:13:42.985 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.961+0000 7fe4e8ff9640 1 -- 10.20.193.110:0/3875521196 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe4ec1a4250 con 0x7fe4ec1a3e80 2026-02-13T20:13:42.985 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.961+0000 7fe4e8ff9640 1 -- 10.20.193.110:0/3875521196 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe4d80055c0 con 0x7fe4ec1a3e80 2026-02-13T20:13:42.985 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.961+0000 7fe4e8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:42.985 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.961+0000 7fe4e8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:13:42.986 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.961+0000 7fe4e8ff9640 10 monclient: dump: 2026-02-13T20:13:42.986 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:42.986 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:42.986 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:42.986 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:42.986 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:42.986 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:42.986 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:42.986 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:42.986 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:42.986 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:42.986 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.961+0000 7fe4e8ff9640 1 -- 10.20.193.110:0/3875521196 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3375797023 0 0) 0x7fe4ec1a4250 con 0x7fe4ec1a3e80 2026-02-13T20:13:42.986 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.961+0000 7fe4e8ff9640 1 -- 10.20.193.110:0/3875521196 --> v1:10.20.193.110:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe4ec08b450 con 0x7fe4ec1a3e80 2026-02-13T20:13:42.986 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.962+0000 7fe4e8ff9640 1 -- 10.20.193.110:0/3875521196 <== mon.0 v1:10.20.193.110:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4346 (unknown 0 0 1110653639) 0x7fe4d8006b00 con 0x7fe4ec1a3e80 2026-02-13T20:13:42.987 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.962+0000 7fe4e8ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:13:42.987 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.962+0000 7fe4e8ff9640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:13:42.987 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.962+0000 7fe4e8ff9640 1 -- 10.20.193.110:0/3875521196 >> v1:10.20.193.110:6789/0 conn(0x7fe4ec1a3e80 legacy=0x7fe4ec117c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:42.987 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.962+0000 7fe4e8ff9640 1 -- 10.20.193.110:0/3875521196 >> v1:10.20.193.110:6789/0 conn(0x7fe4ec1a3e80 legacy=0x7fe4ec117c10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:13:42.987 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:13:42.987 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:13:42.987 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:13:42.987 INFO:teuthology.orchestra.run.trial110.stdout: "state": "peon", 2026-02-13T20:13:42.988 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 12, 2026-02-13T20:13:42.988 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 17052, 2026-02-13T20:13:42.988 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:13:42.988 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:13:42.988 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:13:42.988 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:13:42.988 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:13:42.988 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 2, 2026-02-13T20:13:42.988 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:13:42.988 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:13:42.988 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:13:42.988 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:13:42.989 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:13:42.989 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:13:42.989 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:13:42.989 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:13:42.989 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:13:42.989 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:13:42.989 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:13:42.989 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:13:42.989 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:13:42.989 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:13:42.989 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:13:42.989 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:13:42.989 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:13:42.989 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:13:42.990 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:13:42.990 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:13:42.990 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:13:42.990 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:13:42.990 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:13:42.990 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:13:42.990 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:13:42.990 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:13:42.991 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:13:42.991 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:13:42.991 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:13:42.991 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:13:42.991 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:13:42.991 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:13:42.991 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:13:42.991 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:42.992 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:13:42.992 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:13:42.992 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:13:42.992 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:13:42.992 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:13:42.992 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:13:42.992 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:13:42.992 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:13:42.992 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:13:42.993 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:13:42.993 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:13:42.993 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:13:42.993 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:13:42.993 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:13:42.993 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:13:42.993 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:13:42.993 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:13:42.993 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:13:42.993 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:13:42.993 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:13:42.993 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:13:42.993 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:13:42.993 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:13:42.993 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:13:42.994 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:13:42.994 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:13:42.994 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:13:42.994 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:13:42.994 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:13:42.994 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:13:42.994 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:13:42.994 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:13:42.994 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:42.994 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:13:42.994 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:42.994 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:13:42.995 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:13:42.995 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:13:42.995 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:13:42.995 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:42.995 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:13:42.995 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:13:42.995 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:13:42.995 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:42.995 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:13:42.995 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:42.995 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:13:42.995 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:13:42.995 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:13:42.995 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:13:42.995 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:13:42.995 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:13:42.996 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:42.996 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:42.996 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:13:42.996 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:13:42.996 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:13:42.996 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:13:42.996 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:42.996 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:13:42.996 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:13:42.996 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:13:42.996 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:42.996 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:13:42.996 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:42.996 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:13:42.996 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:13:42.996 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:13:42.996 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:13:42.997 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:13:42.997 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:13:42.997 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:42.997 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:42.997 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:13:42.997 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:13:42.997 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:13:42.997 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:13:42.997 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:42.997 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:13:42.997 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:13:42.997 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:13:42.997 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:42.997 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:13:42.997 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:42.997 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:13:42.997 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:13:42.998 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:13:42.998 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:13:42.998 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:13:42.998 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:13:42.998 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:42.998 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:13:42.998 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:42.998 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:13:42.998 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:13:42.998 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:42.998 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:13:42.998 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:13:42.998 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:13:42.998 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:42.998 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:13:42.998 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:13:42.998 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:42.998 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:13:42.999 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:13:42.999 INFO:teuthology.orchestra.run.trial110.stdout: "num": 2 2026-02-13T20:13:42.999 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:42.999 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:13:42.999 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:42.999 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:13:42.999 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:13:43.000 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.962+0000 7fe4f27a5640 1 -- 10.20.193.110:0/3875521196 >> v1:10.20.193.188:6812/1623052694 conn(0x7fe4bc03fa70 legacy=0x7fe4bc05ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:43.000 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.962+0000 7fe4f27a5640 10 monclient: shutdown 2026-02-13T20:13:43.000 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.962+0000 7fe4f27a5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:13:43.000 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.962+0000 7fe4f27a5640 1 -- 10.20.193.110:0/3875521196 >> v1:10.20.193.110:6789/0 conn(0x7fe4ec1401c0 legacy=0x7fe4ec089540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:43.000 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.962+0000 7fe4f0d1b640 1 -- 10.20.193.110:0/3875521196 reap_dead start 2026-02-13T20:13:43.000 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.962+0000 7fe4f0d1b640 1 -- 10.20.193.110:0/3875521196 reap_dead start 2026-02-13T20:13:43.000 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.962+0000 7fe4f27a5640 1 -- 10.20.193.110:0/3875521196 shutdown_connections 2026-02-13T20:13:43.001 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.962+0000 7fe4f27a5640 1 -- 10.20.193.110:0/3875521196 >> 10.20.193.110:0/3875521196 conn(0x7fe4ec054e90 msgr2=0x7fe4ec08dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:13:43.001 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.962+0000 7fe4f27a5640 1 -- 10.20.193.110:0/3875521196 shutdown_connections 2026-02-13T20:13:43.001 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:42.962+0000 7fe4f27a5640 1 -- 10.20.193.110:0/3875521196 wait complete. 2026-02-13T20:13:43.001 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:13:43.001 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-13T20:13:43.001 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T20:13:43.067 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.065+0000 7f443ada5640 10 monclient: get_monmap_and_config 2026-02-13T20:13:43.067 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.065+0000 7f443ada5640 10 monclient: build_initial_monmap 2026-02-13T20:13:43.067 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.065+0000 7f443ada5640 10 monclient: monmap: 2026-02-13T20:13:43.067 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:13:43.067 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:43.067 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:13:43.066629+0000 2026-02-13T20:13:43.067 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:13:43.066629+0000 2026-02-13T20:13:43.067 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:13:43.068 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:43.068 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:13:43.068 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:13:43.068 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:13:43.068 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:43.076 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.065+0000 7f443ada5640 1 Processor -- start 2026-02-13T20:13:43.076 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.065+0000 7f443ada5640 1 -- start start 2026-02-13T20:13:43.076 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.065+0000 7f443ada5640 10 monclient: init 2026-02-13T20:13:43.076 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.065+0000 7f443ada5640 10 monclient: _reopen_session rank -1 2026-02-13T20:13:43.076 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.065+0000 7f443ada5640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:13:43.077 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.065+0000 7f443ada5640 10 monclient(hunting): picked mon.noname-b con 0x7f44341401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:13:43.077 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.065+0000 7f443ada5640 10 monclient(hunting): picked mon.noname-c con 0x7f4434092020 addr v1:10.20.193.188:6789/0 2026-02-13T20:13:43.077 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.065+0000 7f443ada5640 10 monclient(hunting): picked mon.noname-a con 0x7f4434091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:13:43.077 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.065+0000 7f443ada5640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f443408b730 con 0x7f4434091950 2026-02-13T20:13:43.077 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.065+0000 7f443ada5640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f443405c5b0 con 0x7f4434092020 2026-02-13T20:13:43.077 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.065+0000 7f443ada5640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f443408bcf0 con 0x7f44341401c0 2026-02-13T20:13:43.077 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.065+0000 7f443ada5640 10 monclient(hunting): _renew_subs 2026-02-13T20:13:43.077 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.065+0000 7f443ada5640 10 monclient(hunting): authenticate will time out at 784.756972s 2026-02-13T20:13:43.077 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.066+0000 7f4438b1a640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f44341401c0 0x7f4434091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:56160/0 (socket says 10.20.193.110:56160) 2026-02-13T20:13:43.077 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.066+0000 7f4438b1a640 1 -- 10.20.193.110:0/4041941016 learned_addr learned my addr 10.20.193.110:0/4041941016 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:13:43.077 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.066+0000 7f442b7fe640 1 -- 10.20.193.110:0/4041941016 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1172719959 0 0) 0x7f443408bcf0 con 0x7f44341401c0 2026-02-13T20:13:43.077 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.066+0000 7f442b7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:13:43.077 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.066+0000 7f442b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:43.077 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.066+0000 7f442b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:43.078 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.066+0000 7f442b7fe640 10 monclient(hunting): my global_id is 4523 2026-02-13T20:13:43.078 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.066+0000 7f442b7fe640 1 -- 10.20.193.110:0/4041941016 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44200035e0 con 0x7f44341401c0 2026-02-13T20:13:43.078 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.066+0000 7f442b7fe640 1 -- 10.20.193.110:0/4041941016 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2415722170 0 0) 0x7f443408b730 con 0x7f4434091950 2026-02-13T20:13:43.078 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.066+0000 7f442b7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:13:43.078 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.066+0000 7f442b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:43.078 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.066+0000 7f442b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:43.078 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.066+0000 7f442b7fe640 10 monclient(hunting): my global_id is 84153 2026-02-13T20:13:43.078 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.066+0000 7f442b7fe640 1 -- 10.20.193.110:0/4041941016 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f443408bcf0 con 0x7f4434091950 2026-02-13T20:13:43.078 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.066+0000 7f442b7fe640 1 -- 10.20.193.110:0/4041941016 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3964959264 0 0) 0x7f44200035e0 con 0x7f44341401c0 2026-02-13T20:13:43.078 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.066+0000 7f442b7fe640 1 -- 10.20.193.110:0/4041941016 >> v1:10.20.193.188:6789/0 conn(0x7f4434092020 legacy=0x7f44341812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:43.078 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.066+0000 7f442b7fe640 1 -- 10.20.193.110:0/4041941016 >> v1:10.20.193.110:6789/0 conn(0x7f4434091950 legacy=0x7f44341a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:43.078 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.066+0000 7f442b7fe640 10 monclient: _finish_hunting 0 2026-02-13T20:13:43.078 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.066+0000 7f442b7fe640 1 monclient: found mon.noname-b 2026-02-13T20:13:43.079 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.066+0000 7f442b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:13:43.079 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.066+0000 7f442b7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:13:43.079 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.066+0000 7f442b7fe640 1 -- 10.20.193.110:0/4041941016 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4434140590 con 0x7f44341401c0 2026-02-13T20:13:43.079 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.066+0000 7f442b7fe640 10 monclient: _finish_auth 0 2026-02-13T20:13:43.079 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.066+0000 7f442b7fe640 10 monclient: _check_auth_tickets 2026-02-13T20:13:43.079 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.066+0000 7f442b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:13:43.079 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.066+0000 7f442b7fe640 1 -- 10.20.193.110:0/4041941016 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f4424002dd0 con 0x7f44341401c0 2026-02-13T20:13:43.079 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.066+0000 7f443ada5640 5 monclient: authenticate success, global_id 4523 2026-02-13T20:13:43.079 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.066+0000 7f442b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:43.079 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.066+0000 7f442b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:13:43.079 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.066+0000 7f442b7fe640 10 monclient: dump: 2026-02-13T20:13:43.079 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:43.079 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:43.080 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:43.080 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:43.080 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:43.080 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:43.080 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:43.080 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:43.080 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:43.080 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:43.080 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.066+0000 7f443ada5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:13:43.080 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.066+0000 7f442b7fe640 1 -- 10.20.193.110:0/4041941016 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4424002f60 con 0x7f44341401c0 2026-02-13T20:13:43.080 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.066+0000 7f442b7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:13:43.080 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.066+0000 7f443ada5640 10 monclient: get_monmap_and_config success 2026-02-13T20:13:43.080 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.066+0000 7f442b7fe640 1 -- 10.20.193.110:0/4041941016 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f4424003370 con 0x7f44341401c0 2026-02-13T20:13:43.080 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.066+0000 7f443ada5640 4 set_mon_vals no callback set 2026-02-13T20:13:43.081 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.066+0000 7f442b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:43.081 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.066+0000 7f442b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:13:43.081 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.066+0000 7f442b7fe640 10 monclient: dump: 2026-02-13T20:13:43.081 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:43.081 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:43.081 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:43.081 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:43.081 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:43.081 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:43.081 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:43.081 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:43.081 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:43.081 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:43.082 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.066+0000 7f443ada5640 10 monclient: shutdown 2026-02-13T20:13:43.082 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.066+0000 7f443ada5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:13:43.082 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.066+0000 7f443ada5640 1 -- 10.20.193.110:0/4041941016 >> v1:10.20.193.110:6790/0 conn(0x7f44341401c0 legacy=0x7f4434091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:43.082 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.066+0000 7f443ada5640 1 -- 10.20.193.110:0/4041941016 shutdown_connections 2026-02-13T20:13:43.082 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.066+0000 7f443ada5640 1 -- 10.20.193.110:0/4041941016 >> 10.20.193.110:0/4041941016 conn(0x7f4434054e90 msgr2=0x7f4434058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:13:43.082 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.066+0000 7f443ada5640 1 -- 10.20.193.110:0/4041941016 shutdown_connections 2026-02-13T20:13:43.082 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.066+0000 7f443ada5640 1 -- 10.20.193.110:0/4041941016 wait complete. 2026-02-13T20:13:43.082 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.067+0000 7f443ada5640 10 monclient: build_initial_monmap 2026-02-13T20:13:43.082 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.067+0000 7f443ada5640 10 monclient: monmap: 2026-02-13T20:13:43.082 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:13:43.082 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:13:43.082 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:13:43.082 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:13:43.082 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:13:43.083 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:13:43.083 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:13:43.083 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:13:43.083 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:13:43.083 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:43.083 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.067+0000 7f443ada5640 1 Processor -- start 2026-02-13T20:13:43.083 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.067+0000 7f443ada5640 1 -- start start 2026-02-13T20:13:43.083 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.067+0000 7f443ada5640 10 monclient: init 2026-02-13T20:13:43.083 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.067+0000 7f443ada5640 10 monclient: _reopen_session rank -1 2026-02-13T20:13:43.083 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.067+0000 7f443ada5640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:13:43.083 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.067+0000 7f443ada5640 10 monclient(hunting): picked mon.noname-c con 0x7f4434091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:13:43.083 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.067+0000 7f443ada5640 10 monclient(hunting): picked mon.noname-a con 0x7f44341401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:13:43.083 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.067+0000 7f443ada5640 10 monclient(hunting): picked mon.noname-b con 0x7f4434089eb0 addr v1:10.20.193.188:6789/0 2026-02-13T20:13:43.083 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.067+0000 7f443ada5640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f443412dc70 con 0x7f44341401c0 2026-02-13T20:13:43.084 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.067+0000 7f443ada5640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4434090f50 con 0x7f4434089eb0 2026-02-13T20:13:43.084 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.067+0000 7f443ada5640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f443412f190 con 0x7f4434091950 2026-02-13T20:13:43.084 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.067+0000 7f443ada5640 10 monclient(hunting): _renew_subs 2026-02-13T20:13:43.084 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.067+0000 7f443ada5640 10 monclient(hunting): authenticate will time out at 784.758759s 2026-02-13T20:13:43.084 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.067+0000 7f4438b1a640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f4434091950 0x7f4434089090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:56164/0 (socket says 10.20.193.110:56164) 2026-02-13T20:13:43.084 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.067+0000 7f442bfff640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f44341401c0 0x7f44340897a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:34986/0 (socket says 10.20.193.110:34986) 2026-02-13T20:13:43.084 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.067+0000 7f4438b1a640 1 -- 10.20.193.110:0/3528653607 learned_addr learned my addr 10.20.193.110:0/3528653607 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:13:43.084 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.067+0000 7f44297fa640 1 -- 10.20.193.110:0/3528653607 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2020981785 0 0) 0x7f443412f190 con 0x7f4434091950 2026-02-13T20:13:43.084 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.067+0000 7f44297fa640 10 monclient(hunting): _negotiate 2026-02-13T20:13:43.084 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.067+0000 7f44297fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:43.084 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.067+0000 7f44297fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:43.084 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.067+0000 7f44297fa640 10 monclient(hunting): my global_id is 4526 2026-02-13T20:13:43.084 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.067+0000 7f44297fa640 1 -- 10.20.193.110:0/3528653607 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44040035e0 con 0x7f4434091950 2026-02-13T20:13:43.084 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.068+0000 7f44297fa640 1 -- 10.20.193.110:0/3528653607 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 573880440 0 0) 0x7f443412dc70 con 0x7f44341401c0 2026-02-13T20:13:43.085 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.068+0000 7f44297fa640 10 monclient(hunting): _negotiate 2026-02-13T20:13:43.085 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.068+0000 7f44297fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:43.085 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.068+0000 7f44297fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:43.085 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.068+0000 7f44297fa640 10 monclient(hunting): my global_id is 84156 2026-02-13T20:13:43.085 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.068+0000 7f44297fa640 1 -- 10.20.193.110:0/3528653607 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f443412f190 con 0x7f44341401c0 2026-02-13T20:13:43.085 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.068+0000 7f44297fa640 1 -- 10.20.193.110:0/3528653607 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 350952462 0 0) 0x7f44040035e0 con 0x7f4434091950 2026-02-13T20:13:43.085 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.068+0000 7f44297fa640 1 -- 10.20.193.110:0/3528653607 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f443412dc70 con 0x7f4434091950 2026-02-13T20:13:43.085 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.068+0000 7f44297fa640 1 -- 10.20.193.110:0/3528653607 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f4424003280 con 0x7f4434091950 2026-02-13T20:13:43.085 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.068+0000 7f44297fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:13:43.085 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.068+0000 7f44297fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:13:43.085 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.068+0000 7f44297fa640 10 monclient(hunting): dump: 2026-02-13T20:13:43.086 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:43.086 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:43.086 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:43.086 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:43.086 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:43.086 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:43.086 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:43.086 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:43.086 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:43.086 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:43.086 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.068+0000 7f44297fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:13:43.086 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.068+0000 7f44297fa640 1 -- 10.20.193.110:0/3528653607 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 386598319 0 0) 0x7f443412f190 con 0x7f44341401c0 2026-02-13T20:13:43.086 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.068+0000 7f44297fa640 1 -- 10.20.193.110:0/3528653607 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f44040035e0 con 0x7f44341401c0 2026-02-13T20:13:43.086 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.068+0000 7f44297fa640 1 -- 10.20.193.110:0/3528653607 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f441c003030 con 0x7f44341401c0 2026-02-13T20:13:43.087 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.068+0000 7f44297fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:13:43.087 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.068+0000 7f44297fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:13:43.087 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.068+0000 7f44297fa640 10 monclient(hunting): dump: 2026-02-13T20:13:43.087 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:43.087 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:43.087 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:43.087 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:43.087 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:43.087 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:43.087 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:43.087 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:43.087 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:43.087 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:43.087 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.068+0000 7f44297fa640 1 -- 10.20.193.110:0/3528653607 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1819227764 0 0) 0x7f443412dc70 con 0x7f4434091950 2026-02-13T20:13:43.088 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.068+0000 7f44297fa640 1 -- 10.20.193.110:0/3528653607 >> v1:10.20.193.188:6789/0 conn(0x7f4434089eb0 legacy=0x7f44341a2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:43.088 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.068+0000 7f44297fa640 1 -- 10.20.193.110:0/3528653607 >> v1:10.20.193.110:6789/0 conn(0x7f44341401c0 legacy=0x7f44340897a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:43.088 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.068+0000 7f44297fa640 10 monclient: _finish_hunting 0 2026-02-13T20:13:43.088 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.068+0000 7f44297fa640 1 monclient: found mon.c 2026-02-13T20:13:43.088 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.068+0000 7f44297fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:13:43.088 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.068+0000 7f44297fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:13:43.088 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.068+0000 7f44297fa640 1 -- 10.20.193.110:0/3528653607 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f443412f470 con 0x7f4434091950 2026-02-13T20:13:43.088 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.068+0000 7f44297fa640 10 monclient: _finish_auth 0 2026-02-13T20:13:43.088 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.068+0000 7f44297fa640 10 monclient: _check_auth_tickets 2026-02-13T20:13:43.088 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.068+0000 7f44297fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:13:43.088 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.068+0000 7f443ada5640 5 monclient: authenticate success, global_id 4526 2026-02-13T20:13:43.088 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.068+0000 7f443ada5640 10 monclient: _renew_subs 2026-02-13T20:13:43.088 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.068+0000 7f443ada5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:13:43.088 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.068+0000 7f443ada5640 1 -- 10.20.193.110:0/3528653607 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f443408c310 con 0x7f4434091950 2026-02-13T20:13:43.088 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.068+0000 7f443ada5640 10 monclient: _renew_subs 2026-02-13T20:13:43.089 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.068+0000 7f443ada5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:13:43.089 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.068+0000 7f443ada5640 1 -- 10.20.193.110:0/3528653607 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f443412eeb0 con 0x7f4434091950 2026-02-13T20:13:43.089 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.068+0000 7f44297fa640 1 -- 10.20.193.110:0/3528653607 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4424002930 con 0x7f4434091950 2026-02-13T20:13:43.089 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.068+0000 7f44297fa640 10 monclient: handle_config config(0 keys) 2026-02-13T20:13:43.089 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.068+0000 7f44297fa640 1 -- 10.20.193.110:0/3528653607 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f4424004d00 con 0x7f4434091950 2026-02-13T20:13:43.089 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.068+0000 7f44297fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:43.089 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.068+0000 7f44297fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:13:43.089 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.068+0000 7f442affd640 4 set_mon_vals no callback set 2026-02-13T20:13:43.089 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.068+0000 7f44297fa640 10 monclient: dump: 2026-02-13T20:13:43.089 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:43.089 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:43.089 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:43.089 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:43.090 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:43.090 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:43.090 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:43.090 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:43.090 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:43.090 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:43.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.068+0000 7f443ada5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:13:43.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.068+0000 7f443ada5640 1 -- 10.20.193.110:0/3528653607 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f443412d9c0 con 0x7f4434092020 2026-02-13T20:13:43.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.069+0000 7f44297fa640 1 -- 10.20.193.110:0/3528653607 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f4424011970 con 0x7f4434091950 2026-02-13T20:13:43.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.069+0000 7f44297fa640 1 -- 10.20.193.110:0/3528653607 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(115..115 src has 1..115) ==== 3975+0+0 (unknown 2473386841 0 0) 0x7f442404e950 con 0x7f4434091950 2026-02-13T20:13:43.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.069+0000 7f44297fa640 1 -- 10.20.193.110:0/3528653607 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1647681136 0 0) 0x7f443412d9c0 con 0x7f4434092020 2026-02-13T20:13:43.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.069+0000 7f44297fa640 10 monclient(hunting): _negotiate 2026-02-13T20:13:43.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.069+0000 7f44297fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:43.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.069+0000 7f44297fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:43.091 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.069+0000 7f44297fa640 10 monclient(hunting): my global_id is 4529 2026-02-13T20:13:43.091 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.069+0000 7f44297fa640 1 -- 10.20.193.110:0/3528653607 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f443412dc70 con 0x7f4434092020 2026-02-13T20:13:43.091 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.069+0000 7f44297fa640 1 -- 10.20.193.110:0/3528653607 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2599443752 0 0) 0x7f443412dc70 con 0x7f4434092020 2026-02-13T20:13:43.091 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.069+0000 7f44297fa640 1 -- 10.20.193.110:0/3528653607 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f443412d9c0 con 0x7f4434092020 2026-02-13T20:13:43.091 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.069+0000 7f44297fa640 1 -- 10.20.193.110:0/3528653607 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f441c003a60 con 0x7f4434092020 2026-02-13T20:13:43.091 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.069+0000 7f44297fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:43.091 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.069+0000 7f44297fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:13:43.091 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.069+0000 7f44297fa640 10 monclient: dump: 2026-02-13T20:13:43.091 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:43.091 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:43.091 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:43.091 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:43.091 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:43.092 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:43.092 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:43.092 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:43.092 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:43.092 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:43.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.069+0000 7f443931b640 10 monclient: get_auth_request con 0x7f440403fa20 auth_method 0 2026-02-13T20:13:43.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.069+0000 7f44297fa640 1 -- 10.20.193.110:0/3528653607 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 466443855 0 0) 0x7f443412d9c0 con 0x7f4434092020 2026-02-13T20:13:43.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.069+0000 7f44297fa640 1 -- 10.20.193.110:0/3528653607 --> v1:10.20.193.110:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4434125f00 con 0x7f4434092020 2026-02-13T20:13:43.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.069+0000 7f44297fa640 1 -- 10.20.193.110:0/3528653607 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f441c005880 con 0x7f4434092020 2026-02-13T20:13:43.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.069+0000 7f44297fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:13:43.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.069+0000 7f44297fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:13:43.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.069+0000 7f44297fa640 1 -- 10.20.193.110:0/3528653607 >> v1:10.20.193.110:6790/0 conn(0x7f4434092020 legacy=0x7f44341a3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:43.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.069+0000 7f44297fa640 1 -- 10.20.193.110:0/3528653607 >> v1:10.20.193.110:6790/0 conn(0x7f4434092020 legacy=0x7f44341a3770 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:13:43.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.073+0000 7f443ada5640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:13:43.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.073+0000 7f443ada5640 1 -- 10.20.193.110:0/3528653607 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f44341a4250 con 0x7f44341a3e80 2026-02-13T20:13:43.093 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.073+0000 7f44297fa640 1 -- 10.20.193.110:0/3528653607 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3105581221 0 0) 0x7f44341a4250 con 0x7f44341a3e80 2026-02-13T20:13:43.093 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.073+0000 7f44297fa640 10 monclient(hunting): _negotiate 2026-02-13T20:13:43.093 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.073+0000 7f44297fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:43.093 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.073+0000 7f44297fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:43.093 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.073+0000 7f44297fa640 10 monclient(hunting): my global_id is 4532 2026-02-13T20:13:43.093 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.073+0000 7f44297fa640 1 -- 10.20.193.110:0/3528653607 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f443412d9c0 con 0x7f44341a3e80 2026-02-13T20:13:43.093 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.073+0000 7f44297fa640 1 -- 10.20.193.110:0/3528653607 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3957187789 0 0) 0x7f443412d9c0 con 0x7f44341a3e80 2026-02-13T20:13:43.093 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.073+0000 7f44297fa640 1 -- 10.20.193.110:0/3528653607 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f44341a4250 con 0x7f44341a3e80 2026-02-13T20:13:43.093 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.073+0000 7f44297fa640 1 -- 10.20.193.110:0/3528653607 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f441c004210 con 0x7f44341a3e80 2026-02-13T20:13:43.093 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.073+0000 7f44297fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:43.093 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.073+0000 7f44297fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:13:43.093 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.073+0000 7f44297fa640 10 monclient: dump: 2026-02-13T20:13:43.093 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:43.093 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:43.094 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:43.094 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:43.094 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:43.094 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:43.094 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:43.094 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:43.094 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:43.094 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:43.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.073+0000 7f44297fa640 1 -- 10.20.193.110:0/3528653607 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2128594418 0 0) 0x7f44341a4250 con 0x7f44341a3e80 2026-02-13T20:13:43.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.073+0000 7f44297fa640 1 -- 10.20.193.110:0/3528653607 --> v1:10.20.193.110:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f443408b450 con 0x7f44341a3e80 2026-02-13T20:13:43.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.073+0000 7f44297fa640 1 -- 10.20.193.110:0/3528653607 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4516 (unknown 0 0 1091840394) 0x7f441c005aa0 con 0x7f44341a3e80 2026-02-13T20:13:43.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.073+0000 7f44297fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:13:43.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.073+0000 7f44297fa640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:13:43.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.073+0000 7f44297fa640 1 -- 10.20.193.110:0/3528653607 >> v1:10.20.193.110:6790/0 conn(0x7f44341a3e80 legacy=0x7f4434117c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:43.095 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.073+0000 7f44297fa640 1 -- 10.20.193.110:0/3528653607 >> v1:10.20.193.110:6790/0 conn(0x7f44341a3e80 legacy=0x7f4434117c10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:13:43.095 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:13:43.095 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:13:43.095 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:13:43.095 INFO:teuthology.orchestra.run.trial110.stdout: "state": "leader", 2026-02-13T20:13:43.095 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 12, 2026-02-13T20:13:43.095 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 145256, 2026-02-13T20:13:43.096 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:13:43.096 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:13:43.096 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:13:43.096 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:13:43.096 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:13:43.096 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 2, 2026-02-13T20:13:43.096 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:13:43.096 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:13:43.096 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:13:43.096 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:13:43.096 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:13:43.096 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:13:43.097 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:13:43.097 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:13:43.097 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:13:43.097 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:13:43.097 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:13:43.097 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:13:43.097 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:13:43.097 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:13:43.097 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:13:43.097 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:13:43.097 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:13:43.097 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:13:43.097 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:13:43.098 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:13:43.098 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:13:43.098 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:13:43.098 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:13:43.098 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:13:43.098 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:13:43.098 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:13:43.098 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:13:43.098 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:13:43.098 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:13:43.098 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:13:43.098 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:13:43.098 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:13:43.098 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:13:43.098 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:43.099 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:13:43.099 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:13:43.099 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:13:43.099 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:13:43.099 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:13:43.099 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:13:43.099 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:13:43.099 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:13:43.099 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:13:43.099 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:13:43.099 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:13:43.099 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:13:43.099 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:13:43.099 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:13:43.099 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:13:43.100 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:13:43.100 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:13:43.100 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:13:43.100 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:13:43.100 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:13:43.100 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:13:43.100 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:13:43.100 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:13:43.100 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:13:43.100 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:13:43.100 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:13:43.100 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:13:43.100 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:13:43.100 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:13:43.100 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:13:43.100 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:13:43.101 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:13:43.101 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:43.101 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:13:43.101 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:43.101 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:13:43.101 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:13:43.101 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:13:43.101 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:13:43.101 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:43.101 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:13:43.101 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:13:43.101 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:13:43.101 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:43.101 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:13:43.101 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:43.101 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:13:43.102 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:13:43.102 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:13:43.102 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:13:43.102 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:13:43.102 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:13:43.102 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:43.102 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:43.102 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:13:43.102 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:13:43.102 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:13:43.102 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:13:43.102 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:43.102 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:13:43.102 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:13:43.102 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:13:43.102 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:43.102 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:13:43.102 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:43.103 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:13:43.103 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:13:43.103 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:13:43.103 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:13:43.103 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:13:43.103 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:13:43.103 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:43.103 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:43.103 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:13:43.103 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:13:43.103 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:13:43.103 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:13:43.103 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:43.103 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:13:43.103 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:13:43.103 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:13:43.103 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:43.103 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:13:43.104 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:43.104 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:13:43.104 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:13:43.104 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:13:43.104 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:13:43.104 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:13:43.104 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:13:43.104 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:43.104 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:13:43.104 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:43.104 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:13:43.104 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:13:43.104 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:43.104 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:13:43.104 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:13:43.104 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:13:43.104 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:43.104 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:13:43.104 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:13:43.105 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:43.105 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:13:43.105 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:13:43.105 INFO:teuthology.orchestra.run.trial110.stdout: "num": 3 2026-02-13T20:13:43.105 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:43.105 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:13:43.105 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:13:43.105 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:43.105 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:13:43.105 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:13:43.105 INFO:teuthology.orchestra.run.trial110.stdout: "num": 2 2026-02-13T20:13:43.105 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:43.105 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:13:43.105 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:43.105 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:13:43.105 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:13:43.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.074+0000 7f443ada5640 1 -- 10.20.193.110:0/3528653607 >> v1:10.20.193.188:6812/1623052694 conn(0x7f440403fa20 legacy=0x7f440405fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:43.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.074+0000 7f443ada5640 10 monclient: shutdown 2026-02-13T20:13:43.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.074+0000 7f443ada5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:13:43.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.074+0000 7f443ada5640 1 -- 10.20.193.110:0/3528653607 >> v1:10.20.193.110:6790/0 conn(0x7f4434091950 legacy=0x7f4434089090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:43.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.074+0000 7f443931b640 1 -- 10.20.193.110:0/3528653607 reap_dead start 2026-02-13T20:13:43.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.074+0000 7f443931b640 1 -- 10.20.193.110:0/3528653607 reap_dead start 2026-02-13T20:13:43.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.074+0000 7f443ada5640 1 -- 10.20.193.110:0/3528653607 shutdown_connections 2026-02-13T20:13:43.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.074+0000 7f443ada5640 1 -- 10.20.193.110:0/3528653607 >> 10.20.193.110:0/3528653607 conn(0x7f4434054e90 msgr2=0x7f443408dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:13:43.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.074+0000 7f443ada5640 1 -- 10.20.193.110:0/3528653607 shutdown_connections 2026-02-13T20:13:43.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.074+0000 7f443ada5640 1 -- 10.20.193.110:0/3528653607 wait complete. 2026-02-13T20:13:43.107 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:13:43.108 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-13T20:13:43.108 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T20:13:43.183 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.171+0000 7fc36f0b8640 10 monclient: get_monmap_and_config 2026-02-13T20:13:43.183 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.171+0000 7fc36f0b8640 10 monclient: build_initial_monmap 2026-02-13T20:13:43.183 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.171+0000 7fc36f0b8640 10 monclient: monmap: 2026-02-13T20:13:43.183 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:13:43.183 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:43.184 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:13:43.172572+0000 2026-02-13T20:13:43.184 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:13:43.172572+0000 2026-02-13T20:13:43.184 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:13:43.184 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:43.184 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:13:43.184 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:13:43.184 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:13:43.184 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:43.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.171+0000 7fc36f0b8640 1 Processor -- start 2026-02-13T20:13:43.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.171+0000 7fc36f0b8640 1 -- start start 2026-02-13T20:13:43.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.171+0000 7fc36f0b8640 10 monclient: init 2026-02-13T20:13:43.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.171+0000 7fc36f0b8640 10 monclient: _reopen_session rank -1 2026-02-13T20:13:43.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.171+0000 7fc36f0b8640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:13:43.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.171+0000 7fc36f0b8640 10 monclient(hunting): picked mon.noname-a con 0x7fc368091380 addr v1:10.20.193.110:6789/0 2026-02-13T20:13:43.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.171+0000 7fc36f0b8640 10 monclient(hunting): picked mon.noname-c con 0x7fc368092060 addr v1:10.20.193.188:6789/0 2026-02-13T20:13:43.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.171+0000 7fc36f0b8640 10 monclient(hunting): picked mon.noname-b con 0x7fc368184bc0 addr v1:10.20.193.110:6790/0 2026-02-13T20:13:43.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.171+0000 7fc36f0b8640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc36805b5a0 con 0x7fc368091380 2026-02-13T20:13:43.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.171+0000 7fc36f0b8640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc36805c5b0 con 0x7fc368092060 2026-02-13T20:13:43.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.171+0000 7fc36f0b8640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc368091e60 con 0x7fc368184bc0 2026-02-13T20:13:43.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.171+0000 7fc36f0b8640 10 monclient(hunting): _renew_subs 2026-02-13T20:13:43.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.171+0000 7fc36f0b8640 10 monclient(hunting): authenticate will time out at 784.862917s 2026-02-13T20:13:43.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc36ce2d640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fc368091380 0x7fc368091750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:34998/0 (socket says 10.20.193.110:34998) 2026-02-13T20:13:43.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc36ce2d640 1 -- 10.20.193.110:0/885881342 learned_addr learned my addr 10.20.193.110:0/885881342 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:13:43.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc36d62e640 1 --1- 10.20.193.110:0/885881342 >> v1:10.20.193.110:6790/0 conn(0x7fc368184bc0 0x7fc3681a4fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:56192/0 (socket says 10.20.193.110:56192) 2026-02-13T20:13:43.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc35f7fe640 1 -- 10.20.193.110:0/885881342 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3590463790 0 0) 0x7fc368091e60 con 0x7fc368184bc0 2026-02-13T20:13:43.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc35f7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:13:43.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc35f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:43.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc35f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:43.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc35f7fe640 10 monclient(hunting): my global_id is 4535 2026-02-13T20:13:43.186 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc35f7fe640 1 -- 10.20.193.110:0/885881342 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3540035e0 con 0x7fc368184bc0 2026-02-13T20:13:43.186 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc35f7fe640 1 -- 10.20.193.110:0/885881342 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2895595268 0 0) 0x7fc36805b5a0 con 0x7fc368091380 2026-02-13T20:13:43.186 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc35f7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:13:43.186 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc35f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:43.186 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc35f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:43.186 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc35f7fe640 10 monclient(hunting): my global_id is 84159 2026-02-13T20:13:43.186 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc35f7fe640 1 -- 10.20.193.110:0/885881342 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc368091e60 con 0x7fc368091380 2026-02-13T20:13:43.186 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc35f7fe640 1 -- 10.20.193.110:0/885881342 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 22802010 0 0) 0x7fc36805c5b0 con 0x7fc368092060 2026-02-13T20:13:43.186 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc35f7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:13:43.186 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc35f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:43.186 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc35f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:43.186 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc35f7fe640 10 monclient(hunting): my global_id is 4501 2026-02-13T20:13:43.186 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc35f7fe640 1 -- 10.20.193.110:0/885881342 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc36805b5a0 con 0x7fc368092060 2026-02-13T20:13:43.186 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc35f7fe640 1 -- 10.20.193.110:0/885881342 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4182072163 0 0) 0x7fc3540035e0 con 0x7fc368184bc0 2026-02-13T20:13:43.186 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc35f7fe640 1 -- 10.20.193.110:0/885881342 >> v1:10.20.193.188:6789/0 conn(0x7fc368092060 legacy=0x7fc3681834a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:43.186 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc35f7fe640 1 -- 10.20.193.110:0/885881342 >> v1:10.20.193.110:6789/0 conn(0x7fc368091380 legacy=0x7fc368091750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:43.187 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc35f7fe640 10 monclient: _finish_hunting 0 2026-02-13T20:13:43.187 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc35f7fe640 1 monclient: found mon.noname-b 2026-02-13T20:13:43.187 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc35f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:13:43.187 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc35f7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:13:43.187 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc35f7fe640 1 -- 10.20.193.110:0/885881342 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc36805c890 con 0x7fc368184bc0 2026-02-13T20:13:43.187 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc35f7fe640 10 monclient: _finish_auth 0 2026-02-13T20:13:43.187 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc35f7fe640 10 monclient: _check_auth_tickets 2026-02-13T20:13:43.187 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc35f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:13:43.187 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc35f7fe640 1 -- 10.20.193.110:0/885881342 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc364003eb0 con 0x7fc368184bc0 2026-02-13T20:13:43.187 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc36f0b8640 5 monclient: authenticate success, global_id 4535 2026-02-13T20:13:43.187 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc36f0b8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:13:43.187 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc35f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:43.187 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc35f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:13:43.187 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc35f7fe640 10 monclient: dump: 2026-02-13T20:13:43.187 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:43.188 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:43.188 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:43.188 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:43.188 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:43.188 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:43.188 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:43.188 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:43.188 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:43.188 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:43.188 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc36f0b8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:13:43.188 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc35f7fe640 1 -- 10.20.193.110:0/885881342 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc3640040b0 con 0x7fc368184bc0 2026-02-13T20:13:43.188 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc35f7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:13:43.188 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc35f7fe640 1 -- 10.20.193.110:0/885881342 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc3640044c0 con 0x7fc368184bc0 2026-02-13T20:13:43.188 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc36f0b8640 10 monclient: get_monmap_and_config success 2026-02-13T20:13:43.188 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc36f0b8640 4 set_mon_vals no callback set 2026-02-13T20:13:43.188 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc35f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:43.189 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc35f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:13:43.189 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc35f7fe640 10 monclient: dump: 2026-02-13T20:13:43.189 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:43.189 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:43.189 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:43.189 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:43.189 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:43.189 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:43.189 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:43.189 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:43.189 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:43.189 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:43.189 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc36f0b8640 10 monclient: shutdown 2026-02-13T20:13:43.189 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc36f0b8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:13:43.190 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc36f0b8640 1 -- 10.20.193.110:0/885881342 >> v1:10.20.193.110:6790/0 conn(0x7fc368184bc0 legacy=0x7fc3681a4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:43.190 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc36f0b8640 1 -- 10.20.193.110:0/885881342 shutdown_connections 2026-02-13T20:13:43.190 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc36f0b8640 1 -- 10.20.193.110:0/885881342 >> 10.20.193.110:0/885881342 conn(0x7fc368092ea0 msgr2=0x7fc368058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:13:43.190 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc36f0b8640 1 -- 10.20.193.110:0/885881342 shutdown_connections 2026-02-13T20:13:43.190 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.172+0000 7fc36f0b8640 1 -- 10.20.193.110:0/885881342 wait complete. 2026-02-13T20:13:43.190 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.173+0000 7fc36f0b8640 10 monclient: build_initial_monmap 2026-02-13T20:13:43.190 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.173+0000 7fc36f0b8640 10 monclient: monmap: 2026-02-13T20:13:43.190 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:13:43.190 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:13:43.190 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:13:43.190 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:13:43.190 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:13:43.190 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:13:43.190 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:13:43.190 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:13:43.190 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:13:43.191 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:43.191 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.173+0000 7fc36f0b8640 1 Processor -- start 2026-02-13T20:13:43.191 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.173+0000 7fc36f0b8640 1 -- start start 2026-02-13T20:13:43.191 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.173+0000 7fc36f0b8640 10 monclient: init 2026-02-13T20:13:43.191 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.173+0000 7fc36f0b8640 10 monclient: _reopen_session rank -1 2026-02-13T20:13:43.191 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.173+0000 7fc36f0b8640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:13:43.191 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.173+0000 7fc36f0b8640 10 monclient(hunting): picked mon.noname-b con 0x7fc368091380 addr v1:10.20.193.188:6789/0 2026-02-13T20:13:43.191 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.173+0000 7fc36f0b8640 10 monclient(hunting): picked mon.noname-c con 0x7fc368092060 addr v1:10.20.193.110:6790/0 2026-02-13T20:13:43.191 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.173+0000 7fc36f0b8640 10 monclient(hunting): picked mon.noname-a con 0x7fc368184bc0 addr v1:10.20.193.110:6789/0 2026-02-13T20:13:43.191 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.173+0000 7fc36f0b8640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc36812e920 con 0x7fc368184bc0 2026-02-13T20:13:43.191 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.173+0000 7fc36f0b8640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc36805d440 con 0x7fc368091380 2026-02-13T20:13:43.191 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.173+0000 7fc36f0b8640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc36810e590 con 0x7fc368092060 2026-02-13T20:13:43.191 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.173+0000 7fc36f0b8640 10 monclient(hunting): _renew_subs 2026-02-13T20:13:43.191 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.173+0000 7fc36f0b8640 10 monclient(hunting): authenticate will time out at 784.864631s 2026-02-13T20:13:43.191 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.173+0000 7fc35ffff640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fc368092060 0x7fc36812e210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:56198/0 (socket says 10.20.193.110:56198) 2026-02-13T20:13:43.191 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.173+0000 7fc36d62e640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fc368184bc0 0x7fc3681841f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:35008/0 (socket says 10.20.193.110:35008) 2026-02-13T20:13:43.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.173+0000 7fc35ffff640 1 -- 10.20.193.110:0/2250628408 learned_addr learned my addr 10.20.193.110:0/2250628408 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:13:43.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.173+0000 7fc35d7fa640 1 -- 10.20.193.110:0/2250628408 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 533691731 0 0) 0x7fc36812e920 con 0x7fc368184bc0 2026-02-13T20:13:43.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.173+0000 7fc35d7fa640 10 monclient(hunting): _negotiate 2026-02-13T20:13:43.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.173+0000 7fc35d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:43.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.173+0000 7fc35d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:43.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.173+0000 7fc35d7fa640 10 monclient(hunting): my global_id is 84162 2026-02-13T20:13:43.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.173+0000 7fc35d7fa640 1 -- 10.20.193.110:0/2250628408 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3380035e0 con 0x7fc368184bc0 2026-02-13T20:13:43.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.173+0000 7fc35d7fa640 1 -- 10.20.193.110:0/2250628408 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3663414985 0 0) 0x7fc36810e590 con 0x7fc368092060 2026-02-13T20:13:43.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.173+0000 7fc35d7fa640 10 monclient(hunting): _negotiate 2026-02-13T20:13:43.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.173+0000 7fc35d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:43.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.173+0000 7fc35d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:43.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.173+0000 7fc35d7fa640 10 monclient(hunting): my global_id is 4538 2026-02-13T20:13:43.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.173+0000 7fc35d7fa640 1 -- 10.20.193.110:0/2250628408 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc36812e920 con 0x7fc368092060 2026-02-13T20:13:43.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.174+0000 7fc35d7fa640 1 -- 10.20.193.110:0/2250628408 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4057724757 0 0) 0x7fc36805d440 con 0x7fc368091380 2026-02-13T20:13:43.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.174+0000 7fc35d7fa640 10 monclient(hunting): _negotiate 2026-02-13T20:13:43.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.174+0000 7fc35d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:43.193 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.174+0000 7fc35d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:43.193 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.174+0000 7fc35d7fa640 10 monclient(hunting): my global_id is 4504 2026-02-13T20:13:43.193 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.174+0000 7fc35d7fa640 1 -- 10.20.193.110:0/2250628408 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc36810e590 con 0x7fc368091380 2026-02-13T20:13:43.193 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.174+0000 7fc35d7fa640 1 -- 10.20.193.110:0/2250628408 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2936247063 0 0) 0x7fc3380035e0 con 0x7fc368184bc0 2026-02-13T20:13:43.193 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.174+0000 7fc35d7fa640 1 -- 10.20.193.110:0/2250628408 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc36805d440 con 0x7fc368184bc0 2026-02-13T20:13:43.193 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.174+0000 7fc35d7fa640 1 -- 10.20.193.110:0/2250628408 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc364003c10 con 0x7fc368184bc0 2026-02-13T20:13:43.193 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.174+0000 7fc35d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:13:43.193 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.174+0000 7fc35d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:13:43.193 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.174+0000 7fc35d7fa640 10 monclient(hunting): dump: 2026-02-13T20:13:43.193 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:43.193 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:43.193 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:43.193 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:43.193 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:43.193 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:43.193 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:43.194 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:43.194 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:43.194 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:43.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.174+0000 7fc35d7fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:13:43.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.174+0000 7fc35d7fa640 1 -- 10.20.193.110:0/2250628408 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3647716649 0 0) 0x7fc36812e920 con 0x7fc368092060 2026-02-13T20:13:43.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.174+0000 7fc35d7fa640 1 -- 10.20.193.110:0/2250628408 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc3380035e0 con 0x7fc368092060 2026-02-13T20:13:43.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.174+0000 7fc35d7fa640 1 -- 10.20.193.110:0/2250628408 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc3500030f0 con 0x7fc368092060 2026-02-13T20:13:43.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.174+0000 7fc35d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:13:43.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.174+0000 7fc35d7fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:13:43.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.174+0000 7fc35d7fa640 10 monclient(hunting): dump: 2026-02-13T20:13:43.194 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:43.194 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:43.194 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:43.194 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:43.194 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:43.195 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:43.195 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:43.195 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:43.195 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:43.195 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:43.195 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.174+0000 7fc35d7fa640 1 -- 10.20.193.110:0/2250628408 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 118086741 0 0) 0x7fc36805d440 con 0x7fc368184bc0 2026-02-13T20:13:43.195 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.174+0000 7fc35d7fa640 1 -- 10.20.193.110:0/2250628408 >> v1:10.20.193.110:6790/0 conn(0x7fc368092060 legacy=0x7fc36812e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:43.195 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.174+0000 7fc35d7fa640 1 -- 10.20.193.110:0/2250628408 >> v1:10.20.193.188:6789/0 conn(0x7fc368091380 legacy=0x7fc36812db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:43.195 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.174+0000 7fc35d7fa640 10 monclient: _finish_hunting 0 2026-02-13T20:13:43.195 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.174+0000 7fc35d7fa640 1 monclient: found mon.a 2026-02-13T20:13:43.195 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.174+0000 7fc35d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:13:43.195 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.174+0000 7fc35d7fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:13:43.195 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.174+0000 7fc35d7fa640 1 -- 10.20.193.110:0/2250628408 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc36810d0a0 con 0x7fc368184bc0 2026-02-13T20:13:43.195 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.174+0000 7fc35d7fa640 10 monclient: _finish_auth 0 2026-02-13T20:13:43.195 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.174+0000 7fc35d7fa640 10 monclient: _check_auth_tickets 2026-02-13T20:13:43.195 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.174+0000 7fc35d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:13:43.196 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.174+0000 7fc36f0b8640 5 monclient: authenticate success, global_id 84162 2026-02-13T20:13:43.196 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.174+0000 7fc36f0b8640 10 monclient: _renew_subs 2026-02-13T20:13:43.196 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.174+0000 7fc36f0b8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:13:43.196 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.174+0000 7fc36f0b8640 1 -- 10.20.193.110:0/2250628408 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc36810f400 con 0x7fc368184bc0 2026-02-13T20:13:43.196 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.174+0000 7fc36f0b8640 10 monclient: _renew_subs 2026-02-13T20:13:43.196 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.174+0000 7fc36f0b8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:13:43.196 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.174+0000 7fc36f0b8640 1 -- 10.20.193.110:0/2250628408 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc368184900 con 0x7fc368184bc0 2026-02-13T20:13:43.196 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.174+0000 7fc35d7fa640 1 -- 10.20.193.110:0/2250628408 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc364003e80 con 0x7fc368184bc0 2026-02-13T20:13:43.196 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.174+0000 7fc35d7fa640 10 monclient: handle_config config(0 keys) 2026-02-13T20:13:43.196 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.174+0000 7fc35d7fa640 1 -- 10.20.193.110:0/2250628408 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc364005de0 con 0x7fc368184bc0 2026-02-13T20:13:43.196 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.174+0000 7fc35d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:43.196 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.174+0000 7fc35d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:13:43.196 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.174+0000 7fc35d7fa640 10 monclient: dump: 2026-02-13T20:13:43.196 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:43.196 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:43.196 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:43.197 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:43.197 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:43.197 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:43.197 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:43.197 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:43.197 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:43.197 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:43.197 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.174+0000 7fc35effd640 4 set_mon_vals no callback set 2026-02-13T20:13:43.197 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.174+0000 7fc36f0b8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:13:43.197 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.174+0000 7fc36f0b8640 1 -- 10.20.193.110:0/2250628408 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc36810dfd0 con 0x7fc36810dc00 2026-02-13T20:13:43.197 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.174+0000 7fc35d7fa640 1 -- 10.20.193.110:0/2250628408 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fc364012a50 con 0x7fc368184bc0 2026-02-13T20:13:43.197 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.175+0000 7fc35d7fa640 1 -- 10.20.193.110:0/2250628408 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(115..115 src has 1..115) ==== 3975+0+0 (unknown 2473386841 0 0) 0x7fc36404f8d0 con 0x7fc368184bc0 2026-02-13T20:13:43.197 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.175+0000 7fc35ffff640 10 monclient: get_auth_request con 0x7fc33803fc90 auth_method 0 2026-02-13T20:13:43.197 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.175+0000 7fc35d7fa640 1 -- 10.20.193.110:0/2250628408 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3728365100 0 0) 0x7fc36810dfd0 con 0x7fc36810dc00 2026-02-13T20:13:43.197 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.175+0000 7fc35d7fa640 10 monclient(hunting): _negotiate 2026-02-13T20:13:43.198 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.175+0000 7fc35d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:43.198 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.175+0000 7fc35d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:43.198 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.175+0000 7fc35d7fa640 10 monclient(hunting): my global_id is 4507 2026-02-13T20:13:43.198 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.175+0000 7fc35d7fa640 1 -- 10.20.193.110:0/2250628408 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc36805d440 con 0x7fc36810dc00 2026-02-13T20:13:43.198 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.175+0000 7fc35d7fa640 1 -- 10.20.193.110:0/2250628408 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1182416789 0 0) 0x7fc36805d440 con 0x7fc36810dc00 2026-02-13T20:13:43.198 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.175+0000 7fc35d7fa640 1 -- 10.20.193.110:0/2250628408 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc36810dfd0 con 0x7fc36810dc00 2026-02-13T20:13:43.198 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.175+0000 7fc35d7fa640 1 -- 10.20.193.110:0/2250628408 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc358003080 con 0x7fc36810dc00 2026-02-13T20:13:43.198 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.175+0000 7fc35d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:43.198 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.175+0000 7fc35d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:13:43.198 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.175+0000 7fc35d7fa640 10 monclient: dump: 2026-02-13T20:13:43.198 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:43.198 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:43.198 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:43.198 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:43.198 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:43.198 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:43.198 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:43.199 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:43.199 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:43.199 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:43.199 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.175+0000 7fc35d7fa640 1 -- 10.20.193.110:0/2250628408 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1272688032 0 0) 0x7fc36810dfd0 con 0x7fc36810dc00 2026-02-13T20:13:43.199 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.175+0000 7fc35d7fa640 1 -- 10.20.193.110:0/2250628408 --> v1:10.20.193.188:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc3681a66c0 con 0x7fc36810dc00 2026-02-13T20:13:43.199 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.176+0000 7fc35d7fa640 1 -- 10.20.193.110:0/2250628408 <== mon.1 v1:10.20.193.188:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fc3580048a0 con 0x7fc36810dc00 2026-02-13T20:13:43.199 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.176+0000 7fc35d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:13:43.199 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.176+0000 7fc35d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:13:43.199 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.176+0000 7fc35d7fa640 1 -- 10.20.193.110:0/2250628408 >> v1:10.20.193.188:6789/0 conn(0x7fc36810dc00 legacy=0x7fc36808f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:43.199 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.176+0000 7fc35d7fa640 1 -- 10.20.193.110:0/2250628408 >> v1:10.20.193.188:6789/0 conn(0x7fc36810dc00 legacy=0x7fc36808f2a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:13:43.199 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.179+0000 7fc36f0b8640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:13:43.199 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.179+0000 7fc36f0b8640 1 -- 10.20.193.110:0/2250628408 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc36812ae30 con 0x7fc36812aa60 2026-02-13T20:13:43.199 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.179+0000 7fc35d7fa640 1 -- 10.20.193.110:0/2250628408 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1176201405 0 0) 0x7fc36812ae30 con 0x7fc36812aa60 2026-02-13T20:13:43.199 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.179+0000 7fc35d7fa640 10 monclient(hunting): _negotiate 2026-02-13T20:13:43.199 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.179+0000 7fc35d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:43.200 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.179+0000 7fc35d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:43.200 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.179+0000 7fc35d7fa640 10 monclient(hunting): my global_id is 4510 2026-02-13T20:13:43.200 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.179+0000 7fc35d7fa640 1 -- 10.20.193.110:0/2250628408 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc36810dfd0 con 0x7fc36812aa60 2026-02-13T20:13:43.200 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.180+0000 7fc35d7fa640 1 -- 10.20.193.110:0/2250628408 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1964332968 0 0) 0x7fc36810dfd0 con 0x7fc36812aa60 2026-02-13T20:13:43.200 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.180+0000 7fc35d7fa640 1 -- 10.20.193.110:0/2250628408 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc36812ae30 con 0x7fc36812aa60 2026-02-13T20:13:43.200 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.180+0000 7fc35d7fa640 1 -- 10.20.193.110:0/2250628408 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc358004db0 con 0x7fc36812aa60 2026-02-13T20:13:43.200 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.180+0000 7fc35d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:43.200 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.180+0000 7fc35d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:13:43.200 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.180+0000 7fc35d7fa640 10 monclient: dump: 2026-02-13T20:13:43.200 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:43.200 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:43.200 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:43.200 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:43.200 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:43.200 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:43.200 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:43.201 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:43.201 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:43.201 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:43.201 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.180+0000 7fc35d7fa640 1 -- 10.20.193.110:0/2250628408 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1601298678 0 0) 0x7fc36812ae30 con 0x7fc36812aa60 2026-02-13T20:13:43.201 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.180+0000 7fc35d7fa640 1 -- 10.20.193.110:0/2250628408 --> v1:10.20.193.188:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc368052010 con 0x7fc36812aa60 2026-02-13T20:13:43.201 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.180+0000 7fc35d7fa640 1 -- 10.20.193.110:0/2250628408 <== mon.1 v1:10.20.193.188:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4681 (unknown 0 0 1336278445) 0x7fc3580051c0 con 0x7fc36812aa60 2026-02-13T20:13:43.201 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.180+0000 7fc35d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:13:43.201 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.180+0000 7fc35d7fa640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:13:43.201 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.180+0000 7fc35d7fa640 1 -- 10.20.193.110:0/2250628408 >> v1:10.20.193.188:6789/0 conn(0x7fc36812aa60 legacy=0x7fc36804d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:43.201 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.180+0000 7fc35d7fa640 1 -- 10.20.193.110:0/2250628408 >> v1:10.20.193.188:6789/0 conn(0x7fc36812aa60 legacy=0x7fc36804d1c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:13:43.201 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:13:43.202 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:13:43.202 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:13:43.202 INFO:teuthology.orchestra.run.trial110.stdout: "state": "peon", 2026-02-13T20:13:43.202 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 12, 2026-02-13T20:13:43.202 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 145327, 2026-02-13T20:13:43.202 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:13:43.202 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:13:43.202 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:13:43.202 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:13:43.202 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:13:43.202 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 2, 2026-02-13T20:13:43.202 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:13:43.202 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:13:43.203 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:13:43.203 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:13:43.203 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:13:43.203 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:13:43.203 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:13:43.203 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:13:43.203 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:13:43.203 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:13:43.203 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:13:43.203 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:13:43.203 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:13:43.203 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:13:43.203 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:13:43.203 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:13:43.203 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:13:43.204 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:13:43.204 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:13:43.204 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:13:43.204 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:13:43.204 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:13:43.204 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:13:43.204 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:13:43.204 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:13:43.204 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:13:43.204 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:13:43.204 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:13:43.204 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:13:43.204 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:13:43.204 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:13:43.204 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:13:43.204 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:13:43.204 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:43.205 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:13:43.205 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:13:43.205 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:13:43.205 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:13:43.205 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:13:43.205 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:13:43.205 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:13:43.205 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:13:43.205 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:13:43.205 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:13:43.205 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:13:43.205 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:13:43.205 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:13:43.205 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:13:43.205 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:13:43.205 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:13:43.205 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:13:43.206 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:13:43.206 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:13:43.206 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:13:43.206 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:13:43.206 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:13:43.206 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:13:43.206 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:13:43.206 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:13:43.206 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:13:43.206 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:13:43.206 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:13:43.206 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:13:43.206 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:13:43.206 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:13:43.206 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:13:43.206 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:43.206 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:13:43.207 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:43.207 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:13:43.207 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:13:43.207 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:13:43.207 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:13:43.207 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:43.207 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:13:43.207 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:13:43.207 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:13:43.207 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:43.207 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:13:43.207 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:43.207 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:13:43.207 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:13:43.207 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:13:43.207 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:13:43.207 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:13:43.207 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:13:43.208 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:43.208 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:43.208 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:13:43.208 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:13:43.208 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:13:43.208 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:13:43.208 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:43.208 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:13:43.208 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:13:43.208 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:13:43.208 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:43.208 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:13:43.208 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:43.208 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:13:43.208 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:13:43.208 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:13:43.208 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:13:43.208 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:13:43.208 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:13:43.209 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:43.209 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:43.209 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:13:43.209 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:13:43.209 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:13:43.209 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:13:43.209 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:43.209 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:13:43.209 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:13:43.209 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:13:43.209 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:43.209 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:13:43.209 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:43.209 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:13:43.209 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:13:43.209 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:13:43.209 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:13:43.209 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:13:43.210 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:13:43.210 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:43.210 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:13:43.210 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:43.210 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:13:43.210 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:13:43.210 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:43.210 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:13:43.210 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:13:43.210 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:13:43.210 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:43.210 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:13:43.210 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:13:43.210 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:43.210 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:13:43.210 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:13:43.210 INFO:teuthology.orchestra.run.trial110.stdout: "num": 3 2026-02-13T20:13:43.210 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:43.210 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:13:43.210 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:13:43.211 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:43.211 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:13:43.211 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:13:43.211 INFO:teuthology.orchestra.run.trial110.stdout: "num": 6 2026-02-13T20:13:43.211 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:43.211 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:13:43.211 INFO:teuthology.orchestra.run.trial110.stdout: "mgr": [ 2026-02-13T20:13:43.211 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:43.211 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:13:43.211 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:13:43.211 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:13:43.211 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:43.211 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:13:43.211 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:43.211 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:13:43.211 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:13:43.212 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.180+0000 7fc36f0b8640 1 -- 10.20.193.110:0/2250628408 >> v1:10.20.193.188:6812/1623052694 conn(0x7fc33803fc90 legacy=0x7fc338060140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:43.212 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.180+0000 7fc36f0b8640 10 monclient: shutdown 2026-02-13T20:13:43.212 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.180+0000 7fc36f0b8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:13:43.212 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.180+0000 7fc36f0b8640 1 -- 10.20.193.110:0/2250628408 >> v1:10.20.193.110:6789/0 conn(0x7fc368184bc0 legacy=0x7fc3681841f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:43.212 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.180+0000 7fc36d62e640 1 -- 10.20.193.110:0/2250628408 reap_dead start 2026-02-13T20:13:43.213 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.180+0000 7fc36d62e640 1 -- 10.20.193.110:0/2250628408 reap_dead start 2026-02-13T20:13:43.213 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.180+0000 7fc36f0b8640 1 -- 10.20.193.110:0/2250628408 shutdown_connections 2026-02-13T20:13:43.213 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.180+0000 7fc36f0b8640 1 -- 10.20.193.110:0/2250628408 >> 10.20.193.110:0/2250628408 conn(0x7fc368092ea0 msgr2=0x7fc3681a4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:13:43.213 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.180+0000 7fc36f0b8640 1 -- 10.20.193.110:0/2250628408 shutdown_connections 2026-02-13T20:13:43.213 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.180+0000 7fc36f0b8640 1 -- 10.20.193.110:0/2250628408 wait complete. 2026-02-13T20:13:43.213 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:13:43.213 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2026-02-13T20:13:43.213 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-13T20:13:43.213 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2026-02-13T20:13:43.213 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c store 2026-02-13T20:13:43.213 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c sync_force --yes-i-really-mean-it 2026-02-13T20:13:43.280 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.278+0000 7fe1bcecc640 10 monclient: get_monmap_and_config 2026-02-13T20:13:43.280 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.278+0000 7fe1bcecc640 10 monclient: build_initial_monmap 2026-02-13T20:13:43.280 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.278+0000 7fe1bcecc640 10 monclient: monmap: 2026-02-13T20:13:43.280 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:13:43.280 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:43.281 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:13:43.279944+0000 2026-02-13T20:13:43.281 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:13:43.279944+0000 2026-02-13T20:13:43.281 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:13:43.281 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:43.281 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:13:43.281 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:13:43.281 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:13:43.281 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:43.290 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.279+0000 7fe1bcecc640 1 Processor -- start 2026-02-13T20:13:43.290 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.279+0000 7fe1bcecc640 1 -- start start 2026-02-13T20:13:43.290 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.279+0000 7fe1bcecc640 10 monclient: init 2026-02-13T20:13:43.290 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.279+0000 7fe1bcecc640 10 monclient: _reopen_session rank -1 2026-02-13T20:13:43.290 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.279+0000 7fe1bcecc640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:13:43.290 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.279+0000 7fe1bcecc640 10 monclient(hunting): picked mon.noname-b con 0x7fe1b805c540 addr v1:10.20.193.110:6790/0 2026-02-13T20:13:43.290 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.279+0000 7fe1bcecc640 10 monclient(hunting): picked mon.noname-c con 0x7fe1b805d050 addr v1:10.20.193.188:6789/0 2026-02-13T20:13:43.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.279+0000 7fe1bcecc640 10 monclient(hunting): picked mon.noname-a con 0x7fe1b8142430 addr v1:10.20.193.110:6789/0 2026-02-13T20:13:43.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.279+0000 7fe1bcecc640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1b808f370 con 0x7fe1b8142430 2026-02-13T20:13:43.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.279+0000 7fe1bcecc640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1b808f540 con 0x7fe1b805d050 2026-02-13T20:13:43.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.279+0000 7fe1bcecc640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1b80905e0 con 0x7fe1b805c540 2026-02-13T20:13:43.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.279+0000 7fe1bcecc640 10 monclient(hunting): _renew_subs 2026-02-13T20:13:43.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.279+0000 7fe1bcecc640 10 monclient(hunting): authenticate will time out at 784.970401s 2026-02-13T20:13:43.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.279+0000 7fe1b6575640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fe1b805c540 0x7fe1b805c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:56202/0 (socket says 10.20.193.110:56202) 2026-02-13T20:13:43.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.279+0000 7fe1b6575640 1 -- 10.20.193.110:0/1216993924 learned_addr learned my addr 10.20.193.110:0/1216993924 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:13:43.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.279+0000 7fe1b6d76640 1 --1- 10.20.193.110:0/1216993924 >> v1:10.20.193.110:6789/0 conn(0x7fe1b8142430 0x7fe1b81a4c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:35010/0 (socket says 10.20.193.110:35010) 2026-02-13T20:13:43.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.279+0000 7fe1b5573640 1 -- 10.20.193.110:0/1216993924 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3225647456 0 0) 0x7fe1b80905e0 con 0x7fe1b805c540 2026-02-13T20:13:43.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.279+0000 7fe1b5573640 10 monclient(hunting): _negotiate 2026-02-13T20:13:43.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.279+0000 7fe1b5573640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:43.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.279+0000 7fe1b5573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:43.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.279+0000 7fe1b5573640 10 monclient(hunting): my global_id is 4541 2026-02-13T20:13:43.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.279+0000 7fe1b5573640 1 -- 10.20.193.110:0/1216993924 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1a40035e0 con 0x7fe1b805c540 2026-02-13T20:13:43.292 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.279+0000 7fe1b5573640 1 -- 10.20.193.110:0/1216993924 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2110648547 0 0) 0x7fe1b808f370 con 0x7fe1b8142430 2026-02-13T20:13:43.292 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.279+0000 7fe1b5573640 10 monclient(hunting): _negotiate 2026-02-13T20:13:43.292 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.279+0000 7fe1b5573640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:43.292 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.279+0000 7fe1b5573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:43.292 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.279+0000 7fe1b5573640 10 monclient(hunting): my global_id is 84165 2026-02-13T20:13:43.292 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.279+0000 7fe1b5573640 1 -- 10.20.193.110:0/1216993924 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1b80905e0 con 0x7fe1b8142430 2026-02-13T20:13:43.292 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.279+0000 7fe1b5573640 1 -- 10.20.193.110:0/1216993924 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1022180826 0 0) 0x7fe1a40035e0 con 0x7fe1b805c540 2026-02-13T20:13:43.292 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.279+0000 7fe1b5573640 1 -- 10.20.193.110:0/1216993924 >> v1:10.20.193.188:6789/0 conn(0x7fe1b805d050 legacy=0x7fe1b8183540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:43.292 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.279+0000 7fe1b5573640 1 -- 10.20.193.110:0/1216993924 >> v1:10.20.193.110:6789/0 conn(0x7fe1b8142430 legacy=0x7fe1b81a4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:43.292 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.279+0000 7fe1b5573640 10 monclient: _finish_hunting 0 2026-02-13T20:13:43.292 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.279+0000 7fe1b5573640 1 monclient: found mon.noname-b 2026-02-13T20:13:43.292 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.279+0000 7fe1b5573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:13:43.292 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.279+0000 7fe1b5573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:13:43.292 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.279+0000 7fe1b5573640 1 -- 10.20.193.110:0/1216993924 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1b8142850 con 0x7fe1b805c540 2026-02-13T20:13:43.293 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.279+0000 7fe1b5573640 10 monclient: _finish_auth 0 2026-02-13T20:13:43.293 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.279+0000 7fe1b5573640 10 monclient: _check_auth_tickets 2026-02-13T20:13:43.293 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.279+0000 7fe1b5573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:13:43.293 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.279+0000 7fe1b5573640 1 -- 10.20.193.110:0/1216993924 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe1ac002dd0 con 0x7fe1b805c540 2026-02-13T20:13:43.293 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.279+0000 7fe1bcecc640 5 monclient: authenticate success, global_id 4541 2026-02-13T20:13:43.293 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.279+0000 7fe1bcecc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:13:43.293 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.279+0000 7fe1b5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:43.293 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.279+0000 7fe1b5573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:13:43.293 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.279+0000 7fe1b5573640 10 monclient: dump: 2026-02-13T20:13:43.293 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:43.293 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:43.293 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:43.293 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:43.293 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:43.293 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:43.293 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:43.294 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:43.294 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:43.294 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:43.294 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.279+0000 7fe1bcecc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:13:43.294 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.280+0000 7fe1b5573640 1 -- 10.20.193.110:0/1216993924 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe1ac002f60 con 0x7fe1b805c540 2026-02-13T20:13:43.294 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.280+0000 7fe1b5573640 10 monclient: handle_config config(0 keys) 2026-02-13T20:13:43.294 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.280+0000 7fe1b5573640 1 -- 10.20.193.110:0/1216993924 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe1ac003370 con 0x7fe1b805c540 2026-02-13T20:13:43.294 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.280+0000 7fe1b5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:43.294 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.280+0000 7fe1b5573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:13:43.294 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.280+0000 7fe1b5573640 10 monclient: dump: 2026-02-13T20:13:43.294 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:43.294 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:43.294 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:43.294 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:43.294 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:43.294 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:43.295 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:43.295 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:43.295 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:43.295 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:43.295 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.280+0000 7fe1bcecc640 10 monclient: get_monmap_and_config success 2026-02-13T20:13:43.295 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.280+0000 7fe1bcecc640 4 set_mon_vals no callback set 2026-02-13T20:13:43.295 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.280+0000 7fe1bcecc640 10 monclient: shutdown 2026-02-13T20:13:43.295 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.280+0000 7fe1bcecc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:13:43.295 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.280+0000 7fe1bcecc640 1 -- 10.20.193.110:0/1216993924 >> v1:10.20.193.110:6790/0 conn(0x7fe1b805c540 legacy=0x7fe1b805c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:43.295 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.280+0000 7fe1bcecc640 1 -- 10.20.193.110:0/1216993924 shutdown_connections 2026-02-13T20:13:43.295 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.280+0000 7fe1bcecc640 1 -- 10.20.193.110:0/1216993924 >> 10.20.193.110:0/1216993924 conn(0x7fe1b8093270 msgr2=0x7fe1b8054330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:13:43.295 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.280+0000 7fe1bcecc640 1 -- 10.20.193.110:0/1216993924 shutdown_connections 2026-02-13T20:13:43.295 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.280+0000 7fe1bcecc640 1 -- 10.20.193.110:0/1216993924 wait complete. 2026-02-13T20:13:43.295 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.280+0000 7fe1bcecc640 10 monclient: build_initial_monmap 2026-02-13T20:13:43.296 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.280+0000 7fe1bcecc640 10 monclient: monmap: 2026-02-13T20:13:43.296 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:13:43.296 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:13:43.296 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:13:43.296 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:13:43.296 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:13:43.296 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:13:43.296 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:13:43.296 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:13:43.296 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:13:43.297 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:43.297 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.280+0000 7fe1bcecc640 1 Processor -- start 2026-02-13T20:13:43.297 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.280+0000 7fe1bcecc640 1 -- start start 2026-02-13T20:13:43.297 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.280+0000 7fe1bcecc640 10 monclient: init 2026-02-13T20:13:43.297 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe1bcecc640 10 monclient: _reopen_session rank -1 2026-02-13T20:13:43.297 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe1bcecc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:13:43.297 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe1bcecc640 10 monclient(hunting): picked mon.noname-a con 0x7fe1b805c540 addr v1:10.20.193.110:6789/0 2026-02-13T20:13:43.297 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe1bcecc640 10 monclient(hunting): picked mon.noname-c con 0x7fe1b805d050 addr v1:10.20.193.110:6790/0 2026-02-13T20:13:43.298 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe1bcecc640 10 monclient(hunting): picked mon.noname-b con 0x7fe1b8142430 addr v1:10.20.193.188:6789/0 2026-02-13T20:13:43.298 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe1bcecc640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1b810c750 con 0x7fe1b805c540 2026-02-13T20:13:43.298 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe1bcecc640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1b810aba0 con 0x7fe1b8142430 2026-02-13T20:13:43.298 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe1bcecc640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1b805b770 con 0x7fe1b805d050 2026-02-13T20:13:43.298 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe1bcecc640 10 monclient(hunting): _renew_subs 2026-02-13T20:13:43.298 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe1bcecc640 10 monclient(hunting): authenticate will time out at 784.972137s 2026-02-13T20:13:43.298 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe1b6575640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fe1b805c540 0x7fe1b8109d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:35024/0 (socket says 10.20.193.110:35024) 2026-02-13T20:13:43.298 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe1b6575640 1 -- 10.20.193.110:0/543248683 learned_addr learned my addr 10.20.193.110:0/543248683 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:13:43.298 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe19effd640 1 -- 10.20.193.110:0/543248683 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2040210983 0 0) 0x7fe1b805b770 con 0x7fe1b805d050 2026-02-13T20:13:43.298 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe19effd640 10 monclient(hunting): _negotiate 2026-02-13T20:13:43.298 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe19effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:43.298 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe19effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:43.298 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe19effd640 10 monclient(hunting): my global_id is 4544 2026-02-13T20:13:43.299 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe19effd640 1 -- 10.20.193.110:0/543248683 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1840035e0 con 0x7fe1b805d050 2026-02-13T20:13:43.299 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe19effd640 1 -- 10.20.193.110:0/543248683 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2949044803 0 0) 0x7fe1b810c750 con 0x7fe1b805c540 2026-02-13T20:13:43.299 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe19effd640 10 monclient(hunting): _negotiate 2026-02-13T20:13:43.299 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe19effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:43.299 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe19effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:43.299 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe19effd640 10 monclient(hunting): my global_id is 84168 2026-02-13T20:13:43.299 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe19effd640 1 -- 10.20.193.110:0/543248683 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1b805b770 con 0x7fe1b805c540 2026-02-13T20:13:43.299 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe19effd640 1 -- 10.20.193.110:0/543248683 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1091275628 0 0) 0x7fe1840035e0 con 0x7fe1b805d050 2026-02-13T20:13:43.299 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe19effd640 1 -- 10.20.193.110:0/543248683 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe1b810c750 con 0x7fe1b805d050 2026-02-13T20:13:43.299 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe19effd640 1 -- 10.20.193.110:0/543248683 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe1a0002ff0 con 0x7fe1b805d050 2026-02-13T20:13:43.299 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe19effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:13:43.299 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe19effd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:13:43.299 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe19effd640 10 monclient(hunting): dump: 2026-02-13T20:13:43.299 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:43.299 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:43.300 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:43.300 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:43.300 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:43.300 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:43.300 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:43.300 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:43.300 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:43.300 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:43.300 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe19effd640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:13:43.300 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe19effd640 1 -- 10.20.193.110:0/543248683 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3643784949 0 0) 0x7fe1b805b770 con 0x7fe1b805c540 2026-02-13T20:13:43.300 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe19effd640 1 -- 10.20.193.110:0/543248683 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe1840035e0 con 0x7fe1b805c540 2026-02-13T20:13:43.300 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe19effd640 1 -- 10.20.193.110:0/543248683 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe1ac003280 con 0x7fe1b805c540 2026-02-13T20:13:43.300 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe19effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:13:43.300 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe19effd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:13:43.300 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe19effd640 10 monclient(hunting): dump: 2026-02-13T20:13:43.300 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:43.301 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:43.301 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:43.301 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:43.301 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:43.301 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:43.301 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:43.301 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:43.301 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:43.301 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:43.301 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe19effd640 1 -- 10.20.193.110:0/543248683 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2231469119 0 0) 0x7fe1b810c750 con 0x7fe1b805d050 2026-02-13T20:13:43.301 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe19effd640 1 -- 10.20.193.110:0/543248683 >> v1:10.20.193.188:6789/0 conn(0x7fe1b8142430 legacy=0x7fe1b81a41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:43.301 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe19effd640 1 -- 10.20.193.110:0/543248683 >> v1:10.20.193.110:6789/0 conn(0x7fe1b805c540 legacy=0x7fe1b8109d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:43.301 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe19effd640 10 monclient: _finish_hunting 0 2026-02-13T20:13:43.301 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe19effd640 1 monclient: found mon.c 2026-02-13T20:13:43.301 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe19effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:13:43.302 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe19effd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:13:43.302 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe19effd640 1 -- 10.20.193.110:0/543248683 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1b8141be0 con 0x7fe1b805d050 2026-02-13T20:13:43.302 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe19effd640 10 monclient: _finish_auth 0 2026-02-13T20:13:43.302 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe19effd640 10 monclient: _check_auth_tickets 2026-02-13T20:13:43.302 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe19effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:13:43.302 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe1bcecc640 5 monclient: authenticate success, global_id 4544 2026-02-13T20:13:43.302 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe1bcecc640 10 monclient: _renew_subs 2026-02-13T20:13:43.302 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe1bcecc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:13:43.302 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe1bcecc640 1 -- 10.20.193.110:0/543248683 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe1b805d5f0 con 0x7fe1b805d050 2026-02-13T20:13:43.302 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe1bcecc640 10 monclient: _renew_subs 2026-02-13T20:13:43.302 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe1bcecc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:13:43.302 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe1bcecc640 1 -- 10.20.193.110:0/543248683 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fe1b810bff0 con 0x7fe1b805d050 2026-02-13T20:13:43.302 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe19effd640 1 -- 10.20.193.110:0/543248683 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe1a00031c0 con 0x7fe1b805d050 2026-02-13T20:13:43.302 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe19effd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:13:43.302 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe19effd640 1 -- 10.20.193.110:0/543248683 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe1a0003880 con 0x7fe1b805d050 2026-02-13T20:13:43.303 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe19effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:43.303 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe19effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:13:43.303 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe19effd640 10 monclient: dump: 2026-02-13T20:13:43.303 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:43.303 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:43.303 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:43.303 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:43.303 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:43.303 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:43.303 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:43.303 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:43.303 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:43.303 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:43.303 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.281+0000 7fe1b4d72640 4 set_mon_vals no callback set 2026-02-13T20:13:43.303 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.282+0000 7fe1bcecc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:13:43.303 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.282+0000 7fe1bcecc640 1 -- 10.20.193.110:0/543248683 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe1b8091630 con 0x7fe1b81a65a0 2026-02-13T20:13:43.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.282+0000 7fe19effd640 1 -- 10.20.193.110:0/543248683 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fe1a00039e0 con 0x7fe1b805d050 2026-02-13T20:13:43.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.282+0000 7fe19effd640 1 -- 10.20.193.110:0/543248683 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(115..115 src has 1..115) ==== 3975+0+0 (unknown 2473386841 0 0) 0x7fe1a004d750 con 0x7fe1b805d050 2026-02-13T20:13:43.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.282+0000 7fe19effd640 1 -- 10.20.193.110:0/543248683 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2327596873 0 0) 0x7fe1b8091630 con 0x7fe1b81a65a0 2026-02-13T20:13:43.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.282+0000 7fe19effd640 10 monclient(hunting): _negotiate 2026-02-13T20:13:43.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.282+0000 7fe19effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:43.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.282+0000 7fe19effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:43.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.282+0000 7fe19effd640 10 monclient(hunting): my global_id is 4547 2026-02-13T20:13:43.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.282+0000 7fe19effd640 1 -- 10.20.193.110:0/543248683 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1b810c750 con 0x7fe1b81a65a0 2026-02-13T20:13:43.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.282+0000 7fe1b6d76640 10 monclient: get_auth_request con 0x7fe18403fae0 auth_method 0 2026-02-13T20:13:43.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.282+0000 7fe19effd640 1 -- 10.20.193.110:0/543248683 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1221653665 0 0) 0x7fe1b810c750 con 0x7fe1b81a65a0 2026-02-13T20:13:43.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.282+0000 7fe19effd640 1 -- 10.20.193.110:0/543248683 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe1b8091630 con 0x7fe1b81a65a0 2026-02-13T20:13:43.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.282+0000 7fe19effd640 1 -- 10.20.193.110:0/543248683 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe1ac004c40 con 0x7fe1b81a65a0 2026-02-13T20:13:43.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.282+0000 7fe19effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:43.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.282+0000 7fe19effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:13:43.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.282+0000 7fe19effd640 10 monclient: dump: 2026-02-13T20:13:43.304 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:43.305 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:43.305 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:43.305 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:43.305 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:43.305 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:43.305 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:43.305 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:43.305 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:43.305 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:43.305 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.282+0000 7fe19effd640 1 -- 10.20.193.110:0/543248683 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4267656126 0 0) 0x7fe1b8091630 con 0x7fe1b81a65a0 2026-02-13T20:13:43.305 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.282+0000 7fe19effd640 1 -- 10.20.193.110:0/543248683 --> v1:10.20.193.110:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe1b81244a0 con 0x7fe1b81a65a0 2026-02-13T20:13:43.305 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.283+0000 7fe19effd640 1 -- 10.20.193.110:0/543248683 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fe1ac007a20 con 0x7fe1b81a65a0 2026-02-13T20:13:43.305 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.283+0000 7fe19effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:13:43.305 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.283+0000 7fe19effd640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:13:43.305 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.283+0000 7fe19effd640 1 -- 10.20.193.110:0/543248683 >> v1:10.20.193.110:6790/0 conn(0x7fe1b81a65a0 legacy=0x7fe1b81a58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:43.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.283+0000 7fe19effd640 1 -- 10.20.193.110:0/543248683 >> v1:10.20.193.110:6790/0 conn(0x7fe1b81a65a0 legacy=0x7fe1b81a58f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:13:43.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.286+0000 7fe1bcecc640 10 start_mon_command cmd=[{"prefix": "sync_force", "yes_i_really_mean_it": true}] 2026-02-13T20:13:43.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.286+0000 7fe1bcecc640 1 -- 10.20.193.110:0/543248683 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe1b810d390 con 0x7fe1b810d9e0 2026-02-13T20:13:43.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.287+0000 7fe19effd640 1 -- 10.20.193.110:0/543248683 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4221383867 0 0) 0x7fe1b810d390 con 0x7fe1b810d9e0 2026-02-13T20:13:43.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.287+0000 7fe19effd640 10 monclient(hunting): _negotiate 2026-02-13T20:13:43.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.287+0000 7fe19effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:43.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.287+0000 7fe19effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:43.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.287+0000 7fe19effd640 10 monclient(hunting): my global_id is 4550 2026-02-13T20:13:43.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.287+0000 7fe19effd640 1 -- 10.20.193.110:0/543248683 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1b8091630 con 0x7fe1b810d9e0 2026-02-13T20:13:43.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.287+0000 7fe19effd640 1 -- 10.20.193.110:0/543248683 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2047078608 0 0) 0x7fe1b8091630 con 0x7fe1b810d9e0 2026-02-13T20:13:43.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.287+0000 7fe19effd640 1 -- 10.20.193.110:0/543248683 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe1b810d390 con 0x7fe1b810d9e0 2026-02-13T20:13:43.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.287+0000 7fe19effd640 1 -- 10.20.193.110:0/543248683 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe1ac0054e0 con 0x7fe1b810d9e0 2026-02-13T20:13:43.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.287+0000 7fe19effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:43.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.287+0000 7fe19effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:13:43.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.287+0000 7fe19effd640 10 monclient: dump: 2026-02-13T20:13:43.306 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:43.307 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:43.307 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:43.307 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:43.307 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:43.307 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:43.307 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:43.307 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:43.307 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:43.307 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:43.307 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.287+0000 7fe19effd640 1 -- 10.20.193.110:0/543248683 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3215697253 0 0) 0x7fe1b810d390 con 0x7fe1b810d9e0 2026-02-13T20:13:43.307 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.287+0000 7fe19effd640 1 -- 10.20.193.110:0/543248683 --> v1:10.20.193.110:6790/0 -- command(tid 2: {"prefix": "sync_force", "yes_i_really_mean_it": true}) -- 0x7fe1b810cf60 con 0x7fe1b810d9e0 2026-02-13T20:13:43.307 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.287+0000 7fe19effd640 1 -- 10.20.193.110:0/543248683 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+83 (unknown 0 0 2946029456) 0x7fe1ac005640 con 0x7fe1b810d9e0 2026-02-13T20:13:43.307 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.287+0000 7fe19effd640 10 monclient: handle_command_reply 2 [{"prefix": "sync_force", "yes_i_really_mean_it": true}] 2026-02-13T20:13:43.307 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.287+0000 7fe19effd640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:13:43.307 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.287+0000 7fe19effd640 1 -- 10.20.193.110:0/543248683 >> v1:10.20.193.110:6790/0 conn(0x7fe1b810d9e0 legacy=0x7fe1b8131cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:43.308 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.287+0000 7fe19effd640 1 -- 10.20.193.110:0/543248683 >> v1:10.20.193.110:6790/0 conn(0x7fe1b810d9e0 legacy=0x7fe1b8131cd0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:13:43.308 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:13:43.308 INFO:teuthology.orchestra.run.trial110.stdout: "ret": 0, 2026-02-13T20:13:43.308 INFO:teuthology.orchestra.run.trial110.stdout: "msg": "forcing store sync the next time the monitor starts" 2026-02-13T20:13:43.308 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:13:43.309 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.288+0000 7fe1bcecc640 1 -- 10.20.193.110:0/543248683 >> v1:10.20.193.188:6812/1623052694 conn(0x7fe18403fae0 legacy=0x7fe18405ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:43.310 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.288+0000 7fe1bcecc640 10 monclient: shutdown 2026-02-13T20:13:43.310 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.288+0000 7fe1bcecc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:13:43.310 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.288+0000 7fe1bcecc640 1 -- 10.20.193.110:0/543248683 >> v1:10.20.193.110:6790/0 conn(0x7fe1b805d050 legacy=0x7fe1b810a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:43.310 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.288+0000 7fe1b6d76640 1 -- 10.20.193.110:0/543248683 reap_dead start 2026-02-13T20:13:43.310 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.288+0000 7fe1b6d76640 1 -- 10.20.193.110:0/543248683 reap_dead start 2026-02-13T20:13:43.310 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.288+0000 7fe1bcecc640 1 -- 10.20.193.110:0/543248683 shutdown_connections 2026-02-13T20:13:43.310 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.288+0000 7fe1bcecc640 1 -- 10.20.193.110:0/543248683 >> 10.20.193.110:0/543248683 conn(0x7fe1b8093270 msgr2=0x7fe1b8125590 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:13:43.310 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.288+0000 7fe1bcecc640 1 -- 10.20.193.110:0/543248683 shutdown_connections 2026-02-13T20:13:43.310 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.288+0000 7fe1bcecc640 1 -- 10.20.193.110:0/543248683 wait complete. 2026-02-13T20:13:43.310 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-13T20:13:43.311 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-13T20:13:43.311 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T20:13:43.320 INFO:tasks.ceph.mon.c:Stopped 2026-02-13T20:13:43.321 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-13T20:13:43.321 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T20:13:43.432 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.423+0000 7fa394436640 10 monclient: get_monmap_and_config 2026-02-13T20:13:43.432 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.423+0000 7fa394436640 10 monclient: build_initial_monmap 2026-02-13T20:13:43.433 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.423+0000 7fa394436640 10 monclient: monmap: 2026-02-13T20:13:43.433 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:13:43.433 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:43.433 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:13:43.424609+0000 2026-02-13T20:13:43.433 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:13:43.424609+0000 2026-02-13T20:13:43.433 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:13:43.433 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:43.433 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:13:43.433 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:13:43.433 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:13:43.433 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:43.434 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.423+0000 7fa394436640 1 Processor -- start 2026-02-13T20:13:43.434 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.423+0000 7fa394436640 1 -- start start 2026-02-13T20:13:43.434 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.423+0000 7fa394436640 10 monclient: init 2026-02-13T20:13:43.434 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.423+0000 7fa394436640 10 monclient: _reopen_session rank -1 2026-02-13T20:13:43.434 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.423+0000 7fa394436640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:13:43.434 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.423+0000 7fa394436640 10 monclient(hunting): picked mon.noname-a con 0x7fa38c1401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:13:43.434 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.423+0000 7fa394436640 10 monclient(hunting): picked mon.noname-c con 0x7fa38c092020 addr v1:10.20.193.188:6789/0 2026-02-13T20:13:43.434 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.423+0000 7fa394436640 10 monclient(hunting): picked mon.noname-b con 0x7fa38c091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:13:43.434 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.423+0000 7fa394436640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa38c08b730 con 0x7fa38c1401c0 2026-02-13T20:13:43.434 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.423+0000 7fa394436640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa38c05c5b0 con 0x7fa38c092020 2026-02-13T20:13:43.434 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.423+0000 7fa394436640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa38c08bcf0 con 0x7fa38c091950 2026-02-13T20:13:43.434 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.423+0000 7fa394436640 10 monclient(hunting): _renew_subs 2026-02-13T20:13:43.435 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.423+0000 7fa394436640 10 monclient(hunting): authenticate will time out at 785.114920s 2026-02-13T20:13:43.435 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.423+0000 7fa3929ac640 1 -- >> v1:10.20.193.110:6790/0 conn(0x7fa38c091950 legacy=0x7fa38c1a2a20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6790/0 2026-02-13T20:13:43.435 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.424+0000 7fa3921ab640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fa38c1401c0 0x7fa38c091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:35054/0 (socket says 10.20.193.110:35054) 2026-02-13T20:13:43.435 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.424+0000 7fa3921ab640 1 -- 10.20.193.110:0/2843863530 learned_addr learned my addr 10.20.193.110:0/2843863530 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:13:43.435 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.424+0000 7fa3911a9640 1 -- 10.20.193.110:0/2843863530 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1501043444 0 0) 0x7fa38c08b730 con 0x7fa38c1401c0 2026-02-13T20:13:43.435 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.424+0000 7fa3911a9640 10 monclient(hunting): _negotiate 2026-02-13T20:13:43.435 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.424+0000 7fa3911a9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:43.435 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.424+0000 7fa3911a9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:43.435 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.424+0000 7fa3911a9640 10 monclient(hunting): my global_id is 84171 2026-02-13T20:13:43.435 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.424+0000 7fa3911a9640 1 -- 10.20.193.110:0/2843863530 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3740035e0 con 0x7fa38c1401c0 2026-02-13T20:13:43.435 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.424+0000 7fa3911a9640 1 -- 10.20.193.110:0/2843863530 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2756891446 0 0) 0x7fa3740035e0 con 0x7fa38c1401c0 2026-02-13T20:13:43.435 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.424+0000 7fa3911a9640 1 -- 10.20.193.110:0/2843863530 >> v1:10.20.193.110:6790/0 conn(0x7fa38c091950 legacy=0x7fa38c1a2a20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:13:43.436 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.424+0000 7fa3911a9640 1 -- 10.20.193.110:0/2843863530 >> v1:10.20.193.188:6789/0 conn(0x7fa38c092020 legacy=0x7fa38c1812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:43.436 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.424+0000 7fa3911a9640 10 monclient: _finish_hunting 0 2026-02-13T20:13:43.436 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.424+0000 7fa3911a9640 1 monclient: found mon.noname-a 2026-02-13T20:13:43.436 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.424+0000 7fa3911a9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:13:43.436 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.424+0000 7fa3911a9640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:13:43.436 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.424+0000 7fa3911a9640 1 -- 10.20.193.110:0/2843863530 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa38c140590 con 0x7fa38c1401c0 2026-02-13T20:13:43.436 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.424+0000 7fa3911a9640 10 monclient: _finish_auth 0 2026-02-13T20:13:43.436 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.424+0000 7fa3911a9640 10 monclient: _check_auth_tickets 2026-02-13T20:13:43.436 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.424+0000 7fa3911a9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:13:43.436 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.424+0000 7fa3911a9640 1 -- 10.20.193.110:0/2843863530 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa37c002dd0 con 0x7fa38c1401c0 2026-02-13T20:13:43.436 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.424+0000 7fa3911a9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:43.436 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.424+0000 7fa3911a9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:13:43.437 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.424+0000 7fa3911a9640 10 monclient: dump: 2026-02-13T20:13:43.437 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:43.437 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:43.437 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:43.437 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:43.437 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:43.437 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:43.437 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:43.437 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:43.437 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:43.437 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:43.437 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.424+0000 7fa394436640 5 monclient: authenticate success, global_id 84171 2026-02-13T20:13:43.437 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.424+0000 7fa394436640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:13:43.438 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.424+0000 7fa3911a9640 1 -- 10.20.193.110:0/2843863530 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa37c002fa0 con 0x7fa38c1401c0 2026-02-13T20:13:43.438 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.424+0000 7fa3911a9640 10 monclient: handle_config config(0 keys) 2026-02-13T20:13:43.438 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.424+0000 7fa394436640 10 monclient: get_monmap_and_config success 2026-02-13T20:13:43.438 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.424+0000 7fa394436640 4 set_mon_vals no callback set 2026-02-13T20:13:43.438 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.424+0000 7fa3911a9640 1 -- 10.20.193.110:0/2843863530 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa37c0033b0 con 0x7fa38c1401c0 2026-02-13T20:13:43.438 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.424+0000 7fa3911a9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:43.438 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.424+0000 7fa3911a9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:13:43.438 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.424+0000 7fa3911a9640 10 monclient: dump: 2026-02-13T20:13:43.438 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:43.438 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:43.438 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:43.438 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:43.439 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:43.439 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:43.439 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:43.439 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:43.439 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:43.439 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:43.439 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.424+0000 7fa394436640 10 monclient: shutdown 2026-02-13T20:13:43.439 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.424+0000 7fa394436640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:13:43.439 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.424+0000 7fa394436640 1 -- 10.20.193.110:0/2843863530 >> v1:10.20.193.110:6789/0 conn(0x7fa38c1401c0 legacy=0x7fa38c091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:43.439 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.424+0000 7fa394436640 1 -- 10.20.193.110:0/2843863530 shutdown_connections 2026-02-13T20:13:43.439 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.424+0000 7fa394436640 1 -- 10.20.193.110:0/2843863530 >> 10.20.193.110:0/2843863530 conn(0x7fa38c054e90 msgr2=0x7fa38c058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:13:43.439 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.424+0000 7fa394436640 1 -- 10.20.193.110:0/2843863530 shutdown_connections 2026-02-13T20:13:43.440 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.424+0000 7fa394436640 1 -- 10.20.193.110:0/2843863530 wait complete. 2026-02-13T20:13:43.440 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.425+0000 7fa394436640 10 monclient: build_initial_monmap 2026-02-13T20:13:43.440 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.425+0000 7fa394436640 10 monclient: monmap: 2026-02-13T20:13:43.440 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:13:43.440 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:13:43.440 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:13:43.440 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:13:43.440 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:13:43.440 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:13:43.440 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:13:43.440 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:13:43.440 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:13:43.441 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:43.441 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.425+0000 7fa394436640 1 Processor -- start 2026-02-13T20:13:43.441 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.425+0000 7fa394436640 1 -- start start 2026-02-13T20:13:43.441 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.425+0000 7fa394436640 10 monclient: init 2026-02-13T20:13:43.441 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.425+0000 7fa394436640 10 monclient: _reopen_session rank -1 2026-02-13T20:13:43.441 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.425+0000 7fa394436640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:13:43.441 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.425+0000 7fa394436640 10 monclient(hunting): picked mon.noname-c con 0x7fa38c091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:13:43.441 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.425+0000 7fa394436640 10 monclient(hunting): picked mon.noname-b con 0x7fa38c1401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:13:43.441 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.425+0000 7fa394436640 10 monclient(hunting): picked mon.noname-a con 0x7fa38c13dc40 addr v1:10.20.193.110:6789/0 2026-02-13T20:13:43.441 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.425+0000 7fa394436640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa38c05d320 con 0x7fa38c13dc40 2026-02-13T20:13:43.441 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.425+0000 7fa394436640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa38c130f50 con 0x7fa38c1401c0 2026-02-13T20:13:43.441 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.425+0000 7fa394436640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa38c12ebf0 con 0x7fa38c091950 2026-02-13T20:13:43.442 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.425+0000 7fa394436640 10 monclient(hunting): _renew_subs 2026-02-13T20:13:43.442 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.425+0000 7fa3921ab640 1 -- >> v1:10.20.193.110:6790/0 conn(0x7fa38c091950 legacy=0x7fa38c13d530 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.110:6790/0 2026-02-13T20:13:43.442 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.425+0000 7fa394436640 10 monclient(hunting): authenticate will time out at 785.116666s 2026-02-13T20:13:43.442 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.425+0000 7fa3929ac640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fa38c13dc40 0x7fa38c1950f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:35064/0 (socket says 10.20.193.110:35064) 2026-02-13T20:13:43.442 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.425+0000 7fa3929ac640 1 -- 10.20.193.110:0/1663589845 learned_addr learned my addr 10.20.193.110:0/1663589845 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:13:43.442 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.425+0000 7fa372ffd640 1 -- 10.20.193.110:0/1663589845 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2624345847 0 0) 0x7fa38c05d320 con 0x7fa38c13dc40 2026-02-13T20:13:43.442 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.425+0000 7fa372ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:13:43.442 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.425+0000 7fa372ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:43.442 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.425+0000 7fa372ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:43.442 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.425+0000 7fa372ffd640 10 monclient(hunting): my global_id is 84174 2026-02-13T20:13:43.442 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.425+0000 7fa372ffd640 1 -- 10.20.193.110:0/1663589845 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa35c0035e0 con 0x7fa38c13dc40 2026-02-13T20:13:43.442 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.426+0000 7fa372ffd640 1 -- 10.20.193.110:0/1663589845 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2593610279 0 0) 0x7fa38c130f50 con 0x7fa38c1401c0 2026-02-13T20:13:43.443 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.426+0000 7fa372ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:13:43.443 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.426+0000 7fa372ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:43.443 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.426+0000 7fa372ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:43.443 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.426+0000 7fa372ffd640 10 monclient(hunting): my global_id is 4522 2026-02-13T20:13:43.443 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.426+0000 7fa372ffd640 1 -- 10.20.193.110:0/1663589845 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa38c05d320 con 0x7fa38c1401c0 2026-02-13T20:13:43.443 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.426+0000 7fa372ffd640 1 -- 10.20.193.110:0/1663589845 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2240892019 0 0) 0x7fa35c0035e0 con 0x7fa38c13dc40 2026-02-13T20:13:43.443 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.426+0000 7fa372ffd640 1 -- 10.20.193.110:0/1663589845 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa38c130f50 con 0x7fa38c13dc40 2026-02-13T20:13:43.443 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.426+0000 7fa372ffd640 1 -- 10.20.193.110:0/1663589845 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa3880052e0 con 0x7fa38c13dc40 2026-02-13T20:13:43.443 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.426+0000 7fa372ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:13:43.443 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.426+0000 7fa372ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:13:43.443 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.426+0000 7fa372ffd640 10 monclient(hunting): dump: 2026-02-13T20:13:43.443 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:43.444 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:43.444 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:43.444 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:43.444 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:43.444 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:43.444 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:43.444 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:43.444 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:43.444 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:43.444 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.426+0000 7fa372ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:13:43.444 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.426+0000 7fa372ffd640 1 -- 10.20.193.110:0/1663589845 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3389090441 0 0) 0x7fa38c130f50 con 0x7fa38c13dc40 2026-02-13T20:13:43.444 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.426+0000 7fa372ffd640 1 -- 10.20.193.110:0/1663589845 >> v1:10.20.193.110:6790/0 conn(0x7fa38c091950 legacy=0x7fa38c13d530 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T20:13:43.445 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.426+0000 7fa372ffd640 1 -- 10.20.193.110:0/1663589845 >> v1:10.20.193.188:6789/0 conn(0x7fa38c1401c0 legacy=0x7fa38c1939d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:43.445 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.426+0000 7fa372ffd640 10 monclient: _finish_hunting 0 2026-02-13T20:13:43.445 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.426+0000 7fa372ffd640 1 monclient: found mon.a 2026-02-13T20:13:43.445 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.426+0000 7fa372ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:13:43.445 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.426+0000 7fa372ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:13:43.445 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.426+0000 7fa372ffd640 1 -- 10.20.193.110:0/1663589845 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa38c1306b0 con 0x7fa38c13dc40 2026-02-13T20:13:43.445 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.426+0000 7fa372ffd640 10 monclient: _finish_auth 0 2026-02-13T20:13:43.445 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.426+0000 7fa372ffd640 10 monclient: _check_auth_tickets 2026-02-13T20:13:43.445 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.426+0000 7fa372ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:13:43.445 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.426+0000 7fa394436640 5 monclient: authenticate success, global_id 84174 2026-02-13T20:13:43.445 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.426+0000 7fa394436640 10 monclient: _renew_subs 2026-02-13T20:13:43.445 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.426+0000 7fa394436640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:13:43.446 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.426+0000 7fa394436640 1 -- 10.20.193.110:0/1663589845 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa38c12fe50 con 0x7fa38c13dc40 2026-02-13T20:13:43.446 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.426+0000 7fa394436640 10 monclient: _renew_subs 2026-02-13T20:13:43.446 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.426+0000 7fa394436640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:13:43.446 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.426+0000 7fa394436640 1 -- 10.20.193.110:0/1663589845 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa38c12f8f0 con 0x7fa38c13dc40 2026-02-13T20:13:43.446 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.426+0000 7fa372ffd640 1 -- 10.20.193.110:0/1663589845 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa388005520 con 0x7fa38c13dc40 2026-02-13T20:13:43.446 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.426+0000 7fa372ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:13:43.446 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.426+0000 7fa372ffd640 1 -- 10.20.193.110:0/1663589845 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa388005900 con 0x7fa38c13dc40 2026-02-13T20:13:43.446 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.426+0000 7fa372ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:43.446 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.426+0000 7fa372ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:13:43.446 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.426+0000 7fa372ffd640 10 monclient: dump: 2026-02-13T20:13:43.446 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:43.447 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:43.447 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:43.447 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:43.447 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:43.447 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:43.447 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:43.447 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:43.447 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:43.447 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:43.448 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.426+0000 7fa3909a8640 4 set_mon_vals no callback set 2026-02-13T20:13:43.448 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.426+0000 7fa394436640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:13:43.448 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.426+0000 7fa394436640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:13:43.448 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.426+0000 7fa394436640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:13:43.448 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.426+0000 7fa394436640 1 -- 10.20.193.110:0/1663589845 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa38c0008d0 con 0x7fa38c13dc40 2026-02-13T20:13:43.448 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.426+0000 7fa372ffd640 1 -- 10.20.193.110:0/1663589845 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fa388005a60 con 0x7fa38c13dc40 2026-02-13T20:13:43.448 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.427+0000 7fa372ffd640 1 -- 10.20.193.110:0/1663589845 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(115..115 src has 1..115) ==== 3975+0+0 (unknown 2473386841 0 0) 0x7fa38804f970 con 0x7fa38c13dc40 2026-02-13T20:13:43.448 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.427+0000 7fa3921ab640 10 monclient: get_auth_request con 0x7fa35c03f710 auth_method 0 2026-02-13T20:13:43.448 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.429+0000 7fa372ffd640 1 -- 10.20.193.110:0/1663589845 <== mon.0 v1:10.20.193.110:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fa388018130 con 0x7fa38c13dc40 2026-02-13T20:13:43.448 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.429+0000 7fa372ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:13:43.448 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.429+0000 7fa372ffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:13:43.586 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.583+0000 7fa394436640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T20:13:43.586 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.583+0000 7fa394436640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T20:13:43.586 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.583+0000 7fa394436640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:13:43.586 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.583+0000 7fa394436640 1 -- 10.20.193.110:0/1663589845 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa38c058410 con 0x7fa38c13dc40 2026-02-13T20:13:43.586 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.583+0000 7fa372ffd640 1 -- 10.20.193.110:0/1663589845 <== mon.0 v1:10.20.193.110:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 2820335679) 0x7fa3880160c0 con 0x7fa38c13dc40 2026-02-13T20:13:43.587 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.583+0000 7fa372ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T20:13:43.587 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.583+0000 7fa372ffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:13:43.587 INFO:teuthology.orchestra.run.trial110.stdout:{"election_epoch":12,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","modified":"2026-02-13T20:11:07.161192Z","created":"2026-02-13T20:11:07.161192Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6789","nonce":0}]},"addr":"10.20.193.110:6789/0","public_addr":"10.20.193.110:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161241+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6789","nonce":0}]},"addr":"10.20.193.188:6789/0","public_addr":"10.20.193.188:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161242+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6790","nonce":0}]},"addr":"10.20.193.110:6790/0","public_addr":"10.20.193.110:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161243+0000","crush_location":[]}]}} 2026-02-13T20:13:43.588 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.584+0000 7fa394436640 1 -- 10.20.193.110:0/1663589845 >> v1:10.20.193.188:6812/1623052694 conn(0x7fa35c03f710 legacy=0x7fa35c05fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:43.588 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.584+0000 7fa394436640 10 monclient: shutdown 2026-02-13T20:13:43.588 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.584+0000 7fa394436640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:13:43.588 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.584+0000 7fa394436640 1 -- 10.20.193.110:0/1663589845 >> v1:10.20.193.110:6789/0 conn(0x7fa38c13dc40 legacy=0x7fa38c1950f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:43.588 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.584+0000 7fa394436640 1 -- 10.20.193.110:0/1663589845 shutdown_connections 2026-02-13T20:13:43.588 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.584+0000 7fa394436640 1 -- 10.20.193.110:0/1663589845 >> 10.20.193.110:0/1663589845 conn(0x7fa38c054e90 msgr2=0x7fa38c13f010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:13:43.589 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.585+0000 7fa394436640 1 -- 10.20.193.110:0/1663589845 shutdown_connections 2026-02-13T20:13:43.589 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:43.585+0000 7fa394436640 1 -- 10.20.193.110:0/1663589845 wait complete. 2026-02-13T20:13:46.595 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T20:13:46.661 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.659+0000 7fc682de5640 10 monclient: get_monmap_and_config 2026-02-13T20:13:46.661 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.659+0000 7fc682de5640 10 monclient: build_initial_monmap 2026-02-13T20:13:46.661 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.659+0000 7fc682de5640 10 monclient: monmap: 2026-02-13T20:13:46.661 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:13:46.661 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:46.661 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:13:46.661110+0000 2026-02-13T20:13:46.662 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:13:46.661110+0000 2026-02-13T20:13:46.662 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:13:46.662 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:46.662 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:13:46.662 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:13:46.662 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:13:46.662 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:46.665 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.660+0000 7fc682de5640 1 Processor -- start 2026-02-13T20:13:46.665 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.660+0000 7fc682de5640 1 -- start start 2026-02-13T20:13:46.665 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.660+0000 7fc682de5640 10 monclient: init 2026-02-13T20:13:46.665 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.660+0000 7fc682de5640 10 monclient: _reopen_session rank -1 2026-02-13T20:13:46.665 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.660+0000 7fc682de5640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:13:46.665 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.660+0000 7fc682de5640 10 monclient(hunting): picked mon.noname-c con 0x7fc67c1401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:13:46.665 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.660+0000 7fc682de5640 10 monclient(hunting): picked mon.noname-b con 0x7fc67c092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:13:46.665 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.660+0000 7fc682de5640 10 monclient(hunting): picked mon.noname-a con 0x7fc67c091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:13:46.665 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.660+0000 7fc682de5640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc67c08b730 con 0x7fc67c091950 2026-02-13T20:13:46.665 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.660+0000 7fc682de5640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc67c05c5b0 con 0x7fc67c1401c0 2026-02-13T20:13:46.665 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.660+0000 7fc682de5640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc67c08bcf0 con 0x7fc67c092020 2026-02-13T20:13:46.665 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.660+0000 7fc682de5640 10 monclient(hunting): _renew_subs 2026-02-13T20:13:46.666 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.660+0000 7fc682de5640 10 monclient(hunting): authenticate will time out at 788.351461s 2026-02-13T20:13:46.666 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.660+0000 7fc673fff640 1 -- >> v1:10.20.193.110:6790/0 conn(0x7fc67c092020 legacy=0x7fc67c1812f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6790/0 2026-02-13T20:13:46.666 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.660+0000 7fc68135b640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fc67c091950 0x7fc67c1a2a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:35078/0 (socket says 10.20.193.110:35078) 2026-02-13T20:13:46.666 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.660+0000 7fc68135b640 1 -- 10.20.193.110:0/3692465970 learned_addr learned my addr 10.20.193.110:0/3692465970 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:13:46.666 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.660+0000 7fc6737fe640 1 -- 10.20.193.110:0/3692465970 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3507189022 0 0) 0x7fc67c08b730 con 0x7fc67c091950 2026-02-13T20:13:46.666 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.660+0000 7fc6737fe640 10 monclient(hunting): _negotiate 2026-02-13T20:13:46.666 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.660+0000 7fc6737fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:46.666 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.660+0000 7fc6737fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:46.666 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.660+0000 7fc6737fe640 10 monclient(hunting): my global_id is 84177 2026-02-13T20:13:46.666 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.660+0000 7fc6737fe640 1 -- 10.20.193.110:0/3692465970 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6680035e0 con 0x7fc67c091950 2026-02-13T20:13:46.666 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.660+0000 7fc6737fe640 1 -- 10.20.193.110:0/3692465970 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 738974230 0 0) 0x7fc6680035e0 con 0x7fc67c091950 2026-02-13T20:13:46.666 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.660+0000 7fc6737fe640 1 -- 10.20.193.110:0/3692465970 >> v1:10.20.193.110:6790/0 conn(0x7fc67c092020 legacy=0x7fc67c1812f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:13:46.666 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.661+0000 7fc6737fe640 1 -- 10.20.193.110:0/3692465970 >> v1:10.20.193.188:6789/0 conn(0x7fc67c1401c0 legacy=0x7fc67c091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:46.666 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.661+0000 7fc6737fe640 10 monclient: _finish_hunting 0 2026-02-13T20:13:46.666 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.661+0000 7fc6737fe640 1 monclient: found mon.noname-a 2026-02-13T20:13:46.666 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.661+0000 7fc6737fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:13:46.666 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.661+0000 7fc6737fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:13:46.666 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.661+0000 7fc6737fe640 1 -- 10.20.193.110:0/3692465970 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc67c140590 con 0x7fc67c091950 2026-02-13T20:13:46.666 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.661+0000 7fc6737fe640 10 monclient: _finish_auth 0 2026-02-13T20:13:46.666 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.661+0000 7fc6737fe640 10 monclient: _check_auth_tickets 2026-02-13T20:13:46.666 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.661+0000 7fc6737fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:13:46.666 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.661+0000 7fc6737fe640 1 -- 10.20.193.110:0/3692465970 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc678003eb0 con 0x7fc67c091950 2026-02-13T20:13:46.666 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.661+0000 7fc682de5640 5 monclient: authenticate success, global_id 84177 2026-02-13T20:13:46.666 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.661+0000 7fc682de5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:13:46.666 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.661+0000 7fc6737fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:46.666 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.661+0000 7fc6737fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:13:46.667 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.661+0000 7fc6737fe640 10 monclient: dump: 2026-02-13T20:13:46.667 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:46.667 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:46.667 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:46.667 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:46.667 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:46.667 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:46.667 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:46.667 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:46.667 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:46.667 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:46.667 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.661+0000 7fc682de5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:13:46.667 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.661+0000 7fc6737fe640 1 -- 10.20.193.110:0/3692465970 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc678004080 con 0x7fc67c091950 2026-02-13T20:13:46.667 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.661+0000 7fc6737fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:13:46.667 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.661+0000 7fc682de5640 10 monclient: get_monmap_and_config success 2026-02-13T20:13:46.667 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.661+0000 7fc6737fe640 1 -- 10.20.193.110:0/3692465970 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc678004490 con 0x7fc67c091950 2026-02-13T20:13:46.667 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.661+0000 7fc682de5640 4 set_mon_vals no callback set 2026-02-13T20:13:46.667 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.661+0000 7fc6737fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:46.667 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.661+0000 7fc6737fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:13:46.667 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.661+0000 7fc6737fe640 10 monclient: dump: 2026-02-13T20:13:46.667 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:46.667 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:46.667 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:46.667 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:46.667 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:46.667 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:46.667 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:46.667 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:46.668 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:46.668 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:46.668 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.661+0000 7fc682de5640 10 monclient: shutdown 2026-02-13T20:13:46.668 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.661+0000 7fc682de5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:13:46.668 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.661+0000 7fc682de5640 1 -- 10.20.193.110:0/3692465970 >> v1:10.20.193.110:6789/0 conn(0x7fc67c091950 legacy=0x7fc67c1a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:46.668 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.661+0000 7fc682de5640 1 -- 10.20.193.110:0/3692465970 shutdown_connections 2026-02-13T20:13:46.668 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.661+0000 7fc682de5640 1 -- 10.20.193.110:0/3692465970 >> 10.20.193.110:0/3692465970 conn(0x7fc67c054e90 msgr2=0x7fc67c058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:13:46.668 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.661+0000 7fc682de5640 1 -- 10.20.193.110:0/3692465970 shutdown_connections 2026-02-13T20:13:46.668 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.661+0000 7fc682de5640 1 -- 10.20.193.110:0/3692465970 wait complete. 2026-02-13T20:13:46.668 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.661+0000 7fc682de5640 10 monclient: build_initial_monmap 2026-02-13T20:13:46.668 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.661+0000 7fc682de5640 10 monclient: monmap: 2026-02-13T20:13:46.668 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:13:46.668 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:13:46.668 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:13:46.668 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:13:46.668 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:13:46.668 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:13:46.668 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:13:46.668 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:13:46.668 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:13:46.668 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:46.668 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.661+0000 7fc682de5640 1 Processor -- start 2026-02-13T20:13:46.668 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc682de5640 1 -- start start 2026-02-13T20:13:46.668 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc682de5640 10 monclient: init 2026-02-13T20:13:46.668 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc682de5640 10 monclient: _reopen_session rank -1 2026-02-13T20:13:46.668 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc682de5640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:13:46.668 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc682de5640 10 monclient(hunting): picked mon.noname-b con 0x7fc67c091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:13:46.669 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc682de5640 10 monclient(hunting): picked mon.noname-a con 0x7fc67c1401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:13:46.669 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc682de5640 10 monclient(hunting): picked mon.noname-c con 0x7fc67c1162e0 addr v1:10.20.193.110:6790/0 2026-02-13T20:13:46.669 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc682de5640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc67c12df20 con 0x7fc67c1401c0 2026-02-13T20:13:46.669 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc682de5640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc67c08c2f0 con 0x7fc67c091950 2026-02-13T20:13:46.669 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc682de5640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc67c12ee80 con 0x7fc67c1162e0 2026-02-13T20:13:46.669 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc682de5640 10 monclient(hunting): _renew_subs 2026-02-13T20:13:46.669 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc682de5640 10 monclient(hunting): authenticate will time out at 788.353222s 2026-02-13T20:13:46.669 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc68135b640 1 -- >> v1:10.20.193.110:6790/0 conn(0x7fc67c1162e0 legacy=0x7fc67c1a2050 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.110:6790/0 2026-02-13T20:13:46.669 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc673fff640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fc67c1401c0 0x7fc67c1134b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:35090/0 (socket says 10.20.193.110:35090) 2026-02-13T20:13:46.669 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc673fff640 1 -- 10.20.193.110:0/1335661952 learned_addr learned my addr 10.20.193.110:0/1335661952 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:13:46.669 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc6717fa640 1 -- 10.20.193.110:0/1335661952 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 258628592 0 0) 0x7fc67c12df20 con 0x7fc67c1401c0 2026-02-13T20:13:46.669 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc6717fa640 10 monclient(hunting): _negotiate 2026-02-13T20:13:46.669 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc6717fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:46.669 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc6717fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:46.669 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc6717fa640 10 monclient(hunting): my global_id is 84180 2026-02-13T20:13:46.669 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc6717fa640 1 -- 10.20.193.110:0/1335661952 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc64c0035e0 con 0x7fc67c1401c0 2026-02-13T20:13:46.669 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc6717fa640 1 -- 10.20.193.110:0/1335661952 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 580158048 0 0) 0x7fc64c0035e0 con 0x7fc67c1401c0 2026-02-13T20:13:46.669 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc6717fa640 1 -- 10.20.193.110:0/1335661952 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc67c12df20 con 0x7fc67c1401c0 2026-02-13T20:13:46.669 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc6717fa640 1 -- 10.20.193.110:0/1335661952 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc664004280 con 0x7fc67c1401c0 2026-02-13T20:13:46.669 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc6717fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:13:46.669 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc6717fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:13:46.669 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc6717fa640 10 monclient(hunting): dump: 2026-02-13T20:13:46.669 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:46.669 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:46.669 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:46.669 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:46.669 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:46.670 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:46.670 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:46.670 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:46.670 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:46.670 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:46.670 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc6717fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:13:46.670 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc6717fa640 1 -- 10.20.193.110:0/1335661952 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 529404705 0 0) 0x7fc67c12df20 con 0x7fc67c1401c0 2026-02-13T20:13:46.670 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc6717fa640 1 -- 10.20.193.110:0/1335661952 >> v1:10.20.193.110:6790/0 conn(0x7fc67c1162e0 legacy=0x7fc67c1a2050 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T20:13:46.670 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc6717fa640 1 -- 10.20.193.110:0/1335661952 >> v1:10.20.193.188:6789/0 conn(0x7fc67c091950 legacy=0x7fc67c112da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:46.670 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc6717fa640 10 monclient: _finish_hunting 0 2026-02-13T20:13:46.670 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc6717fa640 1 monclient: found mon.a 2026-02-13T20:13:46.670 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc6717fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:13:46.670 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc6717fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:13:46.670 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc6717fa640 1 -- 10.20.193.110:0/1335661952 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc67c12f440 con 0x7fc67c1401c0 2026-02-13T20:13:46.670 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc6717fa640 10 monclient: _finish_auth 0 2026-02-13T20:13:46.670 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc6717fa640 10 monclient: _check_auth_tickets 2026-02-13T20:13:46.670 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc6717fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:13:46.670 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc682de5640 5 monclient: authenticate success, global_id 84180 2026-02-13T20:13:46.670 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc682de5640 10 monclient: _renew_subs 2026-02-13T20:13:46.670 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc682de5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:13:46.670 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc682de5640 1 -- 10.20.193.110:0/1335661952 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc67c12f720 con 0x7fc67c1401c0 2026-02-13T20:13:46.670 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc682de5640 10 monclient: _renew_subs 2026-02-13T20:13:46.670 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc682de5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:13:46.670 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc682de5640 1 -- 10.20.193.110:0/1335661952 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc67c05d320 con 0x7fc67c1401c0 2026-02-13T20:13:46.670 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc6717fa640 1 -- 10.20.193.110:0/1335661952 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc6640044c0 con 0x7fc67c1401c0 2026-02-13T20:13:46.670 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc6717fa640 10 monclient: handle_config config(0 keys) 2026-02-13T20:13:46.670 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc6717fa640 1 -- 10.20.193.110:0/1335661952 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc6640048a0 con 0x7fc67c1401c0 2026-02-13T20:13:46.670 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc6717fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:46.671 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc6717fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:13:46.671 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc672ffd640 4 set_mon_vals no callback set 2026-02-13T20:13:46.671 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.662+0000 7fc6717fa640 10 monclient: dump: 2026-02-13T20:13:46.671 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:46.671 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:46.671 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:46.671 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:46.671 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:46.671 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:46.671 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:46.671 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:46.671 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:46.671 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:46.671 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.663+0000 7fc682de5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:13:46.671 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.663+0000 7fc682de5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:13:46.671 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.663+0000 7fc682de5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:13:46.671 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.663+0000 7fc682de5640 1 -- 10.20.193.110:0/1335661952 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc67c12f030 con 0x7fc67c1401c0 2026-02-13T20:13:46.671 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.663+0000 7fc6717fa640 1 -- 10.20.193.110:0/1335661952 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fc664004a00 con 0x7fc67c1401c0 2026-02-13T20:13:46.671 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.663+0000 7fc6717fa640 1 -- 10.20.193.110:0/1335661952 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(115..115 src has 1..115) ==== 3975+0+0 (unknown 2473386841 0 0) 0x7fc66404e9a0 con 0x7fc67c1401c0 2026-02-13T20:13:46.671 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.663+0000 7fc680b5a640 10 monclient: get_auth_request con 0x7fc64c03f630 auth_method 0 2026-02-13T20:13:46.671 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.665+0000 7fc6717fa640 1 -- 10.20.193.110:0/1335661952 <== mon.0 v1:10.20.193.110:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fc67c12f030 con 0x7fc67c1401c0 2026-02-13T20:13:46.672 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.665+0000 7fc6717fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:13:46.672 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.665+0000 7fc6717fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:13:46.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.814+0000 7fc682de5640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T20:13:46.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.814+0000 7fc682de5640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T20:13:46.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.814+0000 7fc682de5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:13:46.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.814+0000 7fc682de5640 1 -- 10.20.193.110:0/1335661952 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc67c12f030 con 0x7fc67c1401c0 2026-02-13T20:13:46.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.815+0000 7fc6717fa640 1 -- 10.20.193.110:0/1335661952 <== mon.0 v1:10.20.193.110:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 3463807263) 0x7fc67c12f030 con 0x7fc67c1401c0 2026-02-13T20:13:46.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.815+0000 7fc6717fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T20:13:46.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.815+0000 7fc6717fa640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:13:46.818 INFO:teuthology.orchestra.run.trial110.stdout:{"election_epoch":12,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":5,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","modified":"2026-02-13T20:11:07.161192Z","created":"2026-02-13T20:11:07.161192Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6789","nonce":0}]},"addr":"10.20.193.110:6789/0","public_addr":"10.20.193.110:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161241+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6789","nonce":0}]},"addr":"10.20.193.188:6789/0","public_addr":"10.20.193.188:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161242+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6790","nonce":0}]},"addr":"10.20.193.110:6790/0","public_addr":"10.20.193.110:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161243+0000","crush_location":[]}]}} 2026-02-13T20:13:46.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.816+0000 7fc682de5640 1 -- 10.20.193.110:0/1335661952 >> v1:10.20.193.188:6812/1623052694 conn(0x7fc64c03f630 legacy=0x7fc64c05fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:46.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.816+0000 7fc682de5640 10 monclient: shutdown 2026-02-13T20:13:46.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.816+0000 7fc682de5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:13:46.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.816+0000 7fc682de5640 1 -- 10.20.193.110:0/1335661952 >> v1:10.20.193.110:6789/0 conn(0x7fc67c1401c0 legacy=0x7fc67c1134b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:46.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.816+0000 7fc682de5640 1 -- 10.20.193.110:0/1335661952 shutdown_connections 2026-02-13T20:13:46.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.816+0000 7fc682de5640 1 -- 10.20.193.110:0/1335661952 >> 10.20.193.110:0/1335661952 conn(0x7fc67c054e90 msgr2=0x7fc67c08dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:13:46.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.816+0000 7fc682de5640 1 -- 10.20.193.110:0/1335661952 shutdown_connections 2026-02-13T20:13:46.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:46.816+0000 7fc682de5640 1 -- 10.20.193.110:0/1335661952 wait complete. 2026-02-13T20:13:49.826 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T20:13:49.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:49.892+0000 7f9f8c45b640 10 monclient: get_monmap_and_config 2026-02-13T20:13:49.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:49.892+0000 7f9f8c45b640 10 monclient: build_initial_monmap 2026-02-13T20:13:49.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:49.892+0000 7f9f8c45b640 10 monclient: monmap: 2026-02-13T20:13:49.896 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:13:49.896 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:49.896 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:13:49.894328+0000 2026-02-13T20:13:49.897 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:13:49.894328+0000 2026-02-13T20:13:49.897 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:13:49.897 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:49.897 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:13:49.897 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:13:49.897 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:13:49.897 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:49.897 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:49.893+0000 7f9f8c45b640 1 Processor -- start 2026-02-13T20:13:49.897 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:49.893+0000 7f9f8c45b640 1 -- start start 2026-02-13T20:13:49.897 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:49.893+0000 7f9f8c45b640 10 monclient: init 2026-02-13T20:13:49.898 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:49.893+0000 7f9f8c45b640 10 monclient: _reopen_session rank -1 2026-02-13T20:13:49.898 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:49.893+0000 7f9f8c45b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:13:49.898 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:49.893+0000 7f9f8c45b640 10 monclient(hunting): picked mon.noname-a con 0x7f9f841401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:13:49.898 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:49.893+0000 7f9f8c45b640 10 monclient(hunting): picked mon.noname-b con 0x7f9f84092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:13:49.898 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:49.893+0000 7f9f8c45b640 10 monclient(hunting): picked mon.noname-c con 0x7f9f84091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:13:49.898 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:49.893+0000 7f9f8c45b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f8408b730 con 0x7f9f841401c0 2026-02-13T20:13:49.898 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:49.893+0000 7f9f8c45b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f8405c5b0 con 0x7f9f84091950 2026-02-13T20:13:49.898 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:49.893+0000 7f9f8c45b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f8408bcf0 con 0x7f9f84092020 2026-02-13T20:13:49.898 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:49.893+0000 7f9f8c45b640 10 monclient(hunting): _renew_subs 2026-02-13T20:13:49.898 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:49.893+0000 7f9f8c45b640 10 monclient(hunting): authenticate will time out at 791.584685s 2026-02-13T20:13:49.898 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:49.893+0000 7f9f899cf640 1 -- >> v1:10.20.193.110:6790/0 conn(0x7f9f84092020 legacy=0x7f9f841812f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6790/0 2026-02-13T20:13:49.899 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:49.893+0000 7f9f8a1d0640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f9f841401c0 0x7f9f84091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:35102/0 (socket says 10.20.193.110:35102) 2026-02-13T20:13:49.899 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:49.893+0000 7f9f8a1d0640 1 -- 10.20.193.110:0/3320016823 learned_addr learned my addr 10.20.193.110:0/3320016823 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:13:50.097 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:50.094+0000 7f9f899cf640 1 -- 10.20.193.110:0/3320016823 >> v1:10.20.193.110:6790/0 conn(0x7f9f84092020 legacy=0x7f9f841812f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6790/0 2026-02-13T20:13:50.498 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:50.497+0000 7f9f899cf640 1 -- 10.20.193.110:0/3320016823 >> v1:10.20.193.110:6790/0 conn(0x7f9f84092020 legacy=0x7f9f841812f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6790/0 2026-02-13T20:13:51.300 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:51.298+0000 7f9f899cf640 1 -- 10.20.193.110:0/3320016823 >> v1:10.20.193.110:6790/0 conn(0x7f9f84092020 legacy=0x7f9f841812f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6790/0 2026-02-13T20:13:52.895 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:52.894+0000 7f9f6bfff640 10 monclient(hunting): tick 2026-02-13T20:13:52.895 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:52.894+0000 7f9f6bfff640 10 monclient(hunting): _check_auth_tickets 2026-02-13T20:13:52.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:52.894+0000 7f9f6bfff640 1 monclient(hunting): continuing hunt 2026-02-13T20:13:52.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:52.894+0000 7f9f6bfff640 10 monclient(hunting): _reopen_session rank -1 2026-02-13T20:13:52.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:52.894+0000 7f9f6bfff640 1 -- 10.20.193.110:0/3320016823 >> v1:10.20.193.110:6790/0 conn(0x7f9f84092020 legacy=0x7f9f841812f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:13:52.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:52.894+0000 7f9f6bfff640 1 -- 10.20.193.110:0/3320016823 >> v1:10.20.193.188:6789/0 conn(0x7f9f84091950 legacy=0x7f9f841a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:52.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:52.894+0000 7f9f6bfff640 1 -- 10.20.193.110:0/3320016823 >> v1:10.20.193.110:6789/0 conn(0x7f9f841401c0 legacy=0x7f9f84091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:52.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:52.894+0000 7f9f6bfff640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:13:52.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:52.894+0000 7f9f6bfff640 10 monclient(hunting): picked mon.noname-c con 0x7f9f84091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:13:52.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:52.894+0000 7f9f6bfff640 10 monclient(hunting): picked mon.noname-a con 0x7f9f841401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:13:52.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:52.894+0000 7f9f6bfff640 10 monclient(hunting): picked mon.noname-b con 0x7f9f640466a0 addr v1:10.20.193.110:6790/0 2026-02-13T20:13:52.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:52.894+0000 7f9f6bfff640 1 -- 10.20.193.110:0/3320016823 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f84140590 con 0x7f9f841401c0 2026-02-13T20:13:52.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:52.894+0000 7f9f6bfff640 1 -- 10.20.193.110:0/3320016823 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f8408bcf0 con 0x7f9f84091950 2026-02-13T20:13:52.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:52.894+0000 7f9f6bfff640 1 -- 10.20.193.110:0/3320016823 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f6406a3a0 con 0x7f9f640466a0 2026-02-13T20:13:52.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:52.894+0000 7f9f6bfff640 10 monclient(hunting): _renew_subs 2026-02-13T20:13:52.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:52.894+0000 7f9f8a9d1640 1 -- 10.20.193.110:0/3320016823 >> v1:10.20.193.110:6790/0 conn(0x7f9f640466a0 legacy=0x7f9f64066b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6790/0 2026-02-13T20:13:53.097 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:53.095+0000 7f9f8a9d1640 1 -- 10.20.193.110:0/3320016823 >> v1:10.20.193.110:6790/0 conn(0x7f9f640466a0 legacy=0x7f9f64066b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6790/0 2026-02-13T20:13:53.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:53.496+0000 7f9f8a9d1640 1 -- 10.20.193.110:0/3320016823 >> v1:10.20.193.110:6790/0 conn(0x7f9f640466a0 legacy=0x7f9f64066b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6790/0 2026-02-13T20:13:54.298 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:54.297+0000 7f9f8a9d1640 1 -- 10.20.193.110:0/3320016823 >> v1:10.20.193.110:6790/0 conn(0x7f9f640466a0 legacy=0x7f9f64066b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6790/0 2026-02-13T20:13:55.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:55.894+0000 7f9f6bfff640 10 monclient(hunting): tick 2026-02-13T20:13:55.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:55.894+0000 7f9f6bfff640 10 monclient(hunting): _check_auth_tickets 2026-02-13T20:13:55.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:55.894+0000 7f9f6bfff640 1 monclient(hunting): continuing hunt 2026-02-13T20:13:55.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:55.894+0000 7f9f6bfff640 10 monclient(hunting): _reopen_session rank -1 2026-02-13T20:13:55.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:55.894+0000 7f9f6bfff640 1 -- 10.20.193.110:0/3320016823 >> v1:10.20.193.110:6790/0 conn(0x7f9f640466a0 legacy=0x7f9f64066b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:13:55.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:55.894+0000 7f9f6bfff640 1 -- 10.20.193.110:0/3320016823 >> v1:10.20.193.188:6789/0 conn(0x7f9f84091950 legacy=0x7f9f640237b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:55.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:55.894+0000 7f9f6bfff640 1 -- 10.20.193.110:0/3320016823 >> v1:10.20.193.110:6789/0 conn(0x7f9f841401c0 legacy=0x7f9f64044f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:55.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:55.894+0000 7f9f6bfff640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:13:55.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:55.894+0000 7f9f6bfff640 10 monclient(hunting): picked mon.noname-b con 0x7f9f640466a0 addr v1:10.20.193.110:6790/0 2026-02-13T20:13:55.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:55.894+0000 7f9f6bfff640 10 monclient(hunting): picked mon.noname-a con 0x7f9f841401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:13:55.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:55.894+0000 7f9f6bfff640 10 monclient(hunting): picked mon.noname-c con 0x7f9f84091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:13:55.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:55.894+0000 7f9f6bfff640 1 -- 10.20.193.110:0/3320016823 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f6406b600 con 0x7f9f841401c0 2026-02-13T20:13:55.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:55.894+0000 7f9f6bfff640 1 -- 10.20.193.110:0/3320016823 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f6406a3a0 con 0x7f9f84091950 2026-02-13T20:13:55.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:55.894+0000 7f9f6bfff640 1 -- 10.20.193.110:0/3320016823 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f64024880 con 0x7f9f640466a0 2026-02-13T20:13:55.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:55.894+0000 7f9f6bfff640 10 monclient(hunting): _renew_subs 2026-02-13T20:13:55.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:55.894+0000 7f9f8a1d0640 1 -- 10.20.193.110:0/3320016823 >> v1:10.20.193.110:6790/0 conn(0x7f9f640466a0 legacy=0x7f9f64066b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6790/0 2026-02-13T20:13:56.097 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:56.095+0000 7f9f8a1d0640 1 -- 10.20.193.110:0/3320016823 >> v1:10.20.193.110:6790/0 conn(0x7f9f640466a0 legacy=0x7f9f64066b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6790/0 2026-02-13T20:13:56.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:56.496+0000 7f9f8a1d0640 1 -- 10.20.193.110:0/3320016823 >> v1:10.20.193.110:6790/0 conn(0x7f9f640466a0 legacy=0x7f9f64066b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6790/0 2026-02-13T20:13:57.298 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.297+0000 7f9f8a1d0640 1 -- 10.20.193.110:0/3320016823 >> v1:10.20.193.110:6790/0 conn(0x7f9f640466a0 legacy=0x7f9f64066b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6790/0 2026-02-13T20:13:57.925 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.923+0000 7f9f891ce640 1 -- 10.20.193.110:0/3320016823 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 970180701 0 0) 0x7f9f6406b600 con 0x7f9f841401c0 2026-02-13T20:13:57.925 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.923+0000 7f9f891ce640 10 monclient(hunting): _negotiate 2026-02-13T20:13:57.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.923+0000 7f9f891ce640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:57.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.923+0000 7f9f891ce640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:57.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.923+0000 7f9f891ce640 10 monclient(hunting): my global_id is 84183 2026-02-13T20:13:57.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.923+0000 7f9f891ce640 1 -- 10.20.193.110:0/3320016823 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f6c0035e0 con 0x7f9f841401c0 2026-02-13T20:13:57.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.923+0000 7f9f891ce640 1 -- 10.20.193.110:0/3320016823 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3063001928 0 0) 0x7f9f6c0035e0 con 0x7f9f841401c0 2026-02-13T20:13:57.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.923+0000 7f9f891ce640 1 -- 10.20.193.110:0/3320016823 >> v1:10.20.193.110:6790/0 conn(0x7f9f640466a0 legacy=0x7f9f64066b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:13:57.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.923+0000 7f9f891ce640 1 -- 10.20.193.110:0/3320016823 >> v1:10.20.193.188:6789/0 conn(0x7f9f84091950 legacy=0x7f9f64069400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:57.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.923+0000 7f9f891ce640 10 monclient: _finish_hunting 0 2026-02-13T20:13:57.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.923+0000 7f9f891ce640 1 monclient: found mon.noname-a 2026-02-13T20:13:57.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.923+0000 7f9f891ce640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:13:57.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.923+0000 7f9f891ce640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:13:57.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.923+0000 7f9f891ce640 1 -- 10.20.193.110:0/3320016823 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f64024ad0 con 0x7f9f841401c0 2026-02-13T20:13:57.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.923+0000 7f9f891ce640 10 monclient: _finish_auth 0 2026-02-13T20:13:57.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.923+0000 7f9f891ce640 10 monclient: _check_auth_tickets 2026-02-13T20:13:57.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.923+0000 7f9f891ce640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:13:57.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.923+0000 7f9f891ce640 1 -- 10.20.193.110:0/3320016823 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f9f780041e0 con 0x7f9f841401c0 2026-02-13T20:13:57.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.923+0000 7f9f891ce640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:57.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.923+0000 7f9f891ce640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:13:57.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.923+0000 7f9f891ce640 10 monclient: dump: 2026-02-13T20:13:57.926 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:57.926 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:57.926 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:57.926 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:57.926 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:57.926 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:57.926 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:57.926 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:57.926 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:57.926 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:57.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.923+0000 7f9f8c45b640 5 monclient: authenticate success, global_id 84183 2026-02-13T20:13:57.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.923+0000 7f9f8c45b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:13:57.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.923+0000 7f9f891ce640 1 -- 10.20.193.110:0/3320016823 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9f780043e0 con 0x7f9f841401c0 2026-02-13T20:13:57.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.923+0000 7f9f891ce640 10 monclient: handle_config config(0 keys) 2026-02-13T20:13:57.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.923+0000 7f9f891ce640 1 -- 10.20.193.110:0/3320016823 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f9f780047f0 con 0x7f9f841401c0 2026-02-13T20:13:57.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.923+0000 7f9f8c45b640 10 monclient: get_monmap_and_config success 2026-02-13T20:13:57.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.923+0000 7f9f8c45b640 4 set_mon_vals no callback set 2026-02-13T20:13:57.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.923+0000 7f9f891ce640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:57.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.923+0000 7f9f891ce640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:13:57.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.923+0000 7f9f891ce640 10 monclient: dump: 2026-02-13T20:13:57.928 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:57.928 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:57.928 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:57.928 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:57.928 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:57.928 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:57.928 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:57.928 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:57.928 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:57.928 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:57.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.924+0000 7f9f8c45b640 10 monclient: shutdown 2026-02-13T20:13:57.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.924+0000 7f9f8c45b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:13:57.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.924+0000 7f9f8c45b640 1 -- 10.20.193.110:0/3320016823 >> v1:10.20.193.110:6789/0 conn(0x7f9f841401c0 legacy=0x7f9f64044ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:57.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.924+0000 7f9f8c45b640 1 -- 10.20.193.110:0/3320016823 shutdown_connections 2026-02-13T20:13:57.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.924+0000 7f9f8c45b640 1 -- 10.20.193.110:0/3320016823 >> 10.20.193.110:0/3320016823 conn(0x7f9f84054e90 msgr2=0x7f9f84058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:13:57.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.924+0000 7f9f8c45b640 1 -- 10.20.193.110:0/3320016823 shutdown_connections 2026-02-13T20:13:57.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.924+0000 7f9f8c45b640 1 -- 10.20.193.110:0/3320016823 wait complete. 2026-02-13T20:13:57.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.925+0000 7f9f8c45b640 10 monclient: build_initial_monmap 2026-02-13T20:13:57.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.925+0000 7f9f8c45b640 10 monclient: monmap: 2026-02-13T20:13:57.928 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:13:57.928 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:13:57.928 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:13:57.928 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:13:57.928 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:13:57.928 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:13:57.929 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:13:57.929 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:13:57.929 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:13:57.929 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:57.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.925+0000 7f9f8c45b640 1 Processor -- start 2026-02-13T20:13:57.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.925+0000 7f9f8c45b640 1 -- start start 2026-02-13T20:13:57.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.925+0000 7f9f8c45b640 10 monclient: init 2026-02-13T20:13:57.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.925+0000 7f9f8c45b640 10 monclient: _reopen_session rank -1 2026-02-13T20:13:57.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.925+0000 7f9f8c45b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:13:57.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.925+0000 7f9f8c45b640 10 monclient(hunting): picked mon.noname-c con 0x7f9f640466a0 addr v1:10.20.193.110:6790/0 2026-02-13T20:13:57.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.925+0000 7f9f8c45b640 10 monclient(hunting): picked mon.noname-a con 0x7f9f84091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:13:57.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.925+0000 7f9f8a1d0640 1 -- >> v1:10.20.193.110:6790/0 conn(0x7f9f640466a0 legacy=0x7f9f8413db00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.110:6790/0 2026-02-13T20:13:57.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.925+0000 7f9f8c45b640 10 monclient(hunting): picked mon.noname-b con 0x7f9f841401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:13:57.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.925+0000 7f9f8c45b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f8405d350 con 0x7f9f84091950 2026-02-13T20:13:57.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.925+0000 7f9f8c45b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f841307b0 con 0x7f9f841401c0 2026-02-13T20:13:57.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.925+0000 7f9f8c45b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f8412f2c0 con 0x7f9f640466a0 2026-02-13T20:13:57.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.925+0000 7f9f8c45b640 10 monclient(hunting): _renew_subs 2026-02-13T20:13:57.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.925+0000 7f9f8c45b640 10 monclient(hunting): authenticate will time out at 799.616669s 2026-02-13T20:13:57.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.925+0000 7f9f899cf640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f9f84091950 0x7f9f8421a7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:41734/0 (socket says 10.20.193.110:41734) 2026-02-13T20:13:57.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.925+0000 7f9f899cf640 1 -- 10.20.193.110:0/2080975308 learned_addr learned my addr 10.20.193.110:0/2080975308 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:13:57.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.925+0000 7f9f6affd640 1 -- 10.20.193.110:0/2080975308 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1699577171 0 0) 0x7f9f8405d350 con 0x7f9f84091950 2026-02-13T20:13:57.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.925+0000 7f9f6affd640 10 monclient(hunting): _negotiate 2026-02-13T20:13:57.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.925+0000 7f9f6affd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:57.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.925+0000 7f9f6affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:57.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.925+0000 7f9f6affd640 10 monclient(hunting): my global_id is 84186 2026-02-13T20:13:57.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.925+0000 7f9f6affd640 1 -- 10.20.193.110:0/2080975308 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f540035e0 con 0x7f9f84091950 2026-02-13T20:13:57.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.926+0000 7f9f6affd640 1 -- 10.20.193.110:0/2080975308 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3205838865 0 0) 0x7f9f540035e0 con 0x7f9f84091950 2026-02-13T20:13:57.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.926+0000 7f9f6affd640 1 -- 10.20.193.110:0/2080975308 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9f8405d350 con 0x7f9f84091950 2026-02-13T20:13:57.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.926+0000 7f9f6affd640 1 -- 10.20.193.110:0/2080975308 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f9f78004700 con 0x7f9f84091950 2026-02-13T20:13:57.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.926+0000 7f9f6affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:13:57.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.926+0000 7f9f6affd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:13:57.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.926+0000 7f9f6affd640 10 monclient(hunting): dump: 2026-02-13T20:13:57.929 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:57.929 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:57.929 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:57.929 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:57.929 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:57.929 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:57.929 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:57.929 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:57.929 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:57.929 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:57.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.926+0000 7f9f6affd640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:13:57.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.926+0000 7f9f6affd640 1 -- 10.20.193.110:0/2080975308 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3580228935 0 0) 0x7f9f8405d350 con 0x7f9f84091950 2026-02-13T20:13:57.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.926+0000 7f9f6affd640 1 -- 10.20.193.110:0/2080975308 >> v1:10.20.193.110:6790/0 conn(0x7f9f640466a0 legacy=0x7f9f8413db00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T20:13:57.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.926+0000 7f9f6affd640 1 -- 10.20.193.110:0/2080975308 >> v1:10.20.193.188:6789/0 conn(0x7f9f841401c0 legacy=0x7f9f8423bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:57.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.926+0000 7f9f6affd640 10 monclient: _finish_hunting 0 2026-02-13T20:13:57.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.926+0000 7f9f6affd640 1 monclient: found mon.a 2026-02-13T20:13:57.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.926+0000 7f9f6affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:13:57.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.926+0000 7f9f6affd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:13:57.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.926+0000 7f9f6affd640 1 -- 10.20.193.110:0/2080975308 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f84131620 con 0x7f9f84091950 2026-02-13T20:13:57.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.926+0000 7f9f6affd640 10 monclient: _finish_auth 0 2026-02-13T20:13:57.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.926+0000 7f9f6affd640 10 monclient: _check_auth_tickets 2026-02-13T20:13:57.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.926+0000 7f9f6affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:13:57.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.926+0000 7f9f8c45b640 5 monclient: authenticate success, global_id 84186 2026-02-13T20:13:57.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.926+0000 7f9f8c45b640 10 monclient: _renew_subs 2026-02-13T20:13:57.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.926+0000 7f9f8c45b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:13:57.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.926+0000 7f9f8c45b640 1 -- 10.20.193.110:0/2080975308 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9f84130de0 con 0x7f9f84091950 2026-02-13T20:13:57.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.926+0000 7f9f8c45b640 10 monclient: _renew_subs 2026-02-13T20:13:57.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.926+0000 7f9f8c45b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:13:57.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.926+0000 7f9f8c45b640 1 -- 10.20.193.110:0/2080975308 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9f8412fe20 con 0x7f9f84091950 2026-02-13T20:13:57.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.926+0000 7f9f6affd640 1 -- 10.20.193.110:0/2080975308 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9f78004b50 con 0x7f9f84091950 2026-02-13T20:13:57.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.926+0000 7f9f6affd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:13:57.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.926+0000 7f9f6affd640 1 -- 10.20.193.110:0/2080975308 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f9f78004f60 con 0x7f9f84091950 2026-02-13T20:13:57.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.926+0000 7f9f6affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:57.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.926+0000 7f9f6affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:13:57.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.926+0000 7f9f889cd640 4 set_mon_vals no callback set 2026-02-13T20:13:57.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.926+0000 7f9f6affd640 10 monclient: dump: 2026-02-13T20:13:57.930 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:57.930 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:57.930 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:57.930 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:57.930 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:57.930 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:57.930 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:57.930 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:57.930 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:57.930 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:57.931 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.926+0000 7f9f8c45b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:13:57.931 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.927+0000 7f9f6affd640 1 -- 10.20.193.110:0/2080975308 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f9f780050c0 con 0x7f9f84091950 2026-02-13T20:13:57.931 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.927+0000 7f9f8c45b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:13:57.931 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.927+0000 7f9f8c45b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:13:57.931 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.927+0000 7f9f8c45b640 1 -- 10.20.193.110:0/2080975308 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f8413fcb0 con 0x7f9f84091950 2026-02-13T20:13:57.931 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.927+0000 7f9f6affd640 1 -- 10.20.193.110:0/2080975308 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(115..115 src has 1..115) ==== 3975+0+0 (unknown 2473386841 0 0) 0x7f9f7804eb30 con 0x7f9f84091950 2026-02-13T20:13:57.931 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.927+0000 7f9f8a1d0640 10 monclient: get_auth_request con 0x7f9f5403f650 auth_method 0 2026-02-13T20:13:57.932 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.931+0000 7f9f6affd640 1 -- 10.20.193.110:0/2080975308 <== mon.0 v1:10.20.193.110:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f9f78017300 con 0x7f9f84091950 2026-02-13T20:13:57.932 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.931+0000 7f9f6affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:13:57.932 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:57.931+0000 7f9f6affd640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:13:57.981 INFO:tasks.rados.rados.0.trial188.stdout:479: done (0 left) 2026-02-13T20:13:57.981 INFO:tasks.rados.rados.0.trial188.stdout:480: read oid 38 snap -1 2026-02-13T20:13:57.981 INFO:tasks.rados.rados.0.trial188.stdout:480: expect deleted 2026-02-13T20:13:57.981 INFO:tasks.rados.rados.0.trial188.stdout:481: snap_create 2026-02-13T20:13:58.076 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.074+0000 7f9f8c45b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T20:13:58.076 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.074+0000 7f9f8c45b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T20:13:58.076 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.074+0000 7f9f8c45b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:13:58.076 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.074+0000 7f9f8c45b640 1 -- 10.20.193.110:0/2080975308 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9f84055bb0 con 0x7f9f84091950 2026-02-13T20:13:58.076 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.074+0000 7f9f6affd640 1 -- 10.20.193.110:0/2080975308 <== mon.0 v1:10.20.193.110:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 1389413657) 0x7f9f78016ab0 con 0x7f9f84091950 2026-02-13T20:13:58.076 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.074+0000 7f9f6affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T20:13:58.076 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.074+0000 7f9f6affd640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:13:58.076 INFO:teuthology.orchestra.run.trial110.stdout:{"election_epoch":14,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","modified":"2026-02-13T20:11:07.161192Z","created":"2026-02-13T20:11:07.161192Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6789","nonce":0}]},"addr":"10.20.193.110:6789/0","public_addr":"10.20.193.110:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161241+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6789","nonce":0}]},"addr":"10.20.193.188:6789/0","public_addr":"10.20.193.188:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161242+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6790","nonce":0}]},"addr":"10.20.193.110:6790/0","public_addr":"10.20.193.110:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161243+0000","crush_location":[]}]}} 2026-02-13T20:13:58.077 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.076+0000 7f9f8c45b640 1 -- 10.20.193.110:0/2080975308 >> v1:10.20.193.188:6812/1623052694 conn(0x7f9f5403f650 legacy=0x7f9f5405fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:58.077 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.076+0000 7f9f8c45b640 10 monclient: shutdown 2026-02-13T20:13:58.077 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.076+0000 7f9f8c45b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:13:58.077 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.076+0000 7f9f8c45b640 1 -- 10.20.193.110:0/2080975308 >> v1:10.20.193.110:6789/0 conn(0x7f9f84091950 legacy=0x7f9f8421a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:58.077 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.076+0000 7f9f8c45b640 1 -- 10.20.193.110:0/2080975308 shutdown_connections 2026-02-13T20:13:58.077 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.076+0000 7f9f8c45b640 1 -- 10.20.193.110:0/2080975308 >> 10.20.193.110:0/2080975308 conn(0x7f9f84054e90 msgr2=0x7f9f84089860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:13:58.078 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.076+0000 7f9f8c45b640 1 -- 10.20.193.110:0/2080975308 shutdown_connections 2026-02-13T20:13:58.078 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.076+0000 7f9f8c45b640 1 -- 10.20.193.110:0/2080975308 wait complete. 2026-02-13T20:13:58.085 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-13T20:13:58.085 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-13T20:13:58.086 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T20:13:58.162 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.151+0000 7f3fe905b640 10 monclient: get_monmap_and_config 2026-02-13T20:13:58.162 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.151+0000 7f3fe905b640 10 monclient: build_initial_monmap 2026-02-13T20:13:58.162 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.151+0000 7f3fe905b640 10 monclient: monmap: 2026-02-13T20:13:58.162 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:13:58.162 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:58.163 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:13:58.152699+0000 2026-02-13T20:13:58.163 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:13:58.152699+0000 2026-02-13T20:13:58.163 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:13:58.163 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:58.163 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:13:58.163 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:13:58.163 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:13:58.163 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:58.163 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.151+0000 7f3fe905b640 1 Processor -- start 2026-02-13T20:13:58.163 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.151+0000 7f3fe905b640 1 -- start start 2026-02-13T20:13:58.163 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.151+0000 7f3fe905b640 10 monclient: init 2026-02-13T20:13:58.163 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.151+0000 7f3fe905b640 10 monclient: _reopen_session rank -1 2026-02-13T20:13:58.164 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.151+0000 7f3fe905b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:13:58.164 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.152+0000 7f3fe905b640 10 monclient(hunting): picked mon.noname-b con 0x7f3fe41401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:13:58.164 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.152+0000 7f3fe905b640 10 monclient(hunting): picked mon.noname-a con 0x7f3fe4092020 addr v1:10.20.193.110:6789/0 2026-02-13T20:13:58.164 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.152+0000 7f3fe905b640 10 monclient(hunting): picked mon.noname-c con 0x7f3fe4091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:13:58.164 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.152+0000 7f3fe905b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fe408b730 con 0x7f3fe4092020 2026-02-13T20:13:58.164 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.152+0000 7f3fe905b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fe405c5b0 con 0x7f3fe4091950 2026-02-13T20:13:58.164 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.152+0000 7f3fe905b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fe408bcf0 con 0x7f3fe41401c0 2026-02-13T20:13:58.164 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.152+0000 7f3fe905b640 10 monclient(hunting): _renew_subs 2026-02-13T20:13:58.164 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.152+0000 7f3fe905b640 10 monclient(hunting): authenticate will time out at 799.843051s 2026-02-13T20:13:58.164 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.152+0000 7f3fe2d76640 1 -- >> v1:10.20.193.110:6790/0 conn(0x7f3fe41401c0 legacy=0x7f3fe4091240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6790/0 2026-02-13T20:13:58.164 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.152+0000 7f3fe2575640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f3fe4092020 0x7f3fe41812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:41744/0 (socket says 10.20.193.110:41744) 2026-02-13T20:13:58.164 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.152+0000 7f3fe2575640 1 -- 10.20.193.110:0/2145995801 learned_addr learned my addr 10.20.193.110:0/2145995801 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:13:58.165 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.152+0000 7f3fe1d74640 1 -- 10.20.193.110:0/2145995801 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3796941546 0 0) 0x7f3fe408b730 con 0x7f3fe4092020 2026-02-13T20:13:58.165 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.152+0000 7f3fe1d74640 10 monclient(hunting): _negotiate 2026-02-13T20:13:58.165 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.152+0000 7f3fe1d74640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:58.165 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.152+0000 7f3fe1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:58.165 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.152+0000 7f3fe1d74640 10 monclient(hunting): my global_id is 84189 2026-02-13T20:13:58.165 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.152+0000 7f3fe1d74640 1 -- 10.20.193.110:0/2145995801 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fd00035e0 con 0x7f3fe4092020 2026-02-13T20:13:58.165 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.152+0000 7f3fe1d74640 1 -- 10.20.193.110:0/2145995801 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2318072160 0 0) 0x7f3fd00035e0 con 0x7f3fe4092020 2026-02-13T20:13:58.165 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.152+0000 7f3fe1d74640 1 -- 10.20.193.110:0/2145995801 >> v1:10.20.193.110:6790/0 conn(0x7f3fe41401c0 legacy=0x7f3fe4091240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:13:58.165 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.152+0000 7f3fe1d74640 1 -- 10.20.193.110:0/2145995801 >> v1:10.20.193.188:6789/0 conn(0x7f3fe4091950 legacy=0x7f3fe41a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:58.165 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.152+0000 7f3fe1d74640 10 monclient: _finish_hunting 0 2026-02-13T20:13:58.165 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.152+0000 7f3fe1d74640 1 monclient: found mon.noname-a 2026-02-13T20:13:58.165 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.152+0000 7f3fe1d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:13:58.166 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.152+0000 7f3fe1d74640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:13:58.166 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.152+0000 7f3fe1d74640 1 -- 10.20.193.110:0/2145995801 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fe4140590 con 0x7f3fe4092020 2026-02-13T20:13:58.166 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.152+0000 7f3fe1d74640 10 monclient: _finish_auth 0 2026-02-13T20:13:58.166 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.152+0000 7f3fe1d74640 10 monclient: _check_auth_tickets 2026-02-13T20:13:58.166 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.152+0000 7f3fe1d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:13:58.166 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.152+0000 7f3fe1d74640 1 -- 10.20.193.110:0/2145995801 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f3fcc002dd0 con 0x7f3fe4092020 2026-02-13T20:13:58.166 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.152+0000 7f3fe905b640 5 monclient: authenticate success, global_id 84189 2026-02-13T20:13:58.166 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.152+0000 7f3fe905b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:13:58.166 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.152+0000 7f3fe1d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:58.166 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.152+0000 7f3fe1d74640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:13:58.166 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.152+0000 7f3fe1d74640 10 monclient: dump: 2026-02-13T20:13:58.166 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:58.167 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:58.167 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:58.167 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:58.167 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:58.167 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:58.167 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:58.167 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:58.167 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:58.167 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:58.167 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.152+0000 7f3fe905b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:13:58.167 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.152+0000 7f3fe1d74640 1 -- 10.20.193.110:0/2145995801 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3fcc003020 con 0x7f3fe4092020 2026-02-13T20:13:58.167 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.152+0000 7f3fe1d74640 10 monclient: handle_config config(0 keys) 2026-02-13T20:13:58.168 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.152+0000 7f3fe905b640 10 monclient: get_monmap_and_config success 2026-02-13T20:13:58.168 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.152+0000 7f3fe905b640 4 set_mon_vals no callback set 2026-02-13T20:13:58.168 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.152+0000 7f3fe1d74640 1 -- 10.20.193.110:0/2145995801 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f3fcc003430 con 0x7f3fe4092020 2026-02-13T20:13:58.168 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.152+0000 7f3fe1d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:58.168 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.152+0000 7f3fe1d74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:13:58.168 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.152+0000 7f3fe1d74640 10 monclient: dump: 2026-02-13T20:13:58.168 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:58.168 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:58.168 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:58.168 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:58.168 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:58.168 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:58.168 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:58.169 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:58.169 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:58.169 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:58.169 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.152+0000 7f3fe905b640 10 monclient: shutdown 2026-02-13T20:13:58.169 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.152+0000 7f3fe905b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:13:58.169 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.152+0000 7f3fe905b640 1 -- 10.20.193.110:0/2145995801 >> v1:10.20.193.110:6789/0 conn(0x7f3fe4092020 legacy=0x7f3fe41812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:58.169 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.152+0000 7f3fe905b640 1 -- 10.20.193.110:0/2145995801 shutdown_connections 2026-02-13T20:13:58.169 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.152+0000 7f3fe905b640 1 -- 10.20.193.110:0/2145995801 >> 10.20.193.110:0/2145995801 conn(0x7f3fe4054e90 msgr2=0x7f3fe4058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:13:58.169 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.152+0000 7f3fe905b640 1 -- 10.20.193.110:0/2145995801 shutdown_connections 2026-02-13T20:13:58.169 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.152+0000 7f3fe905b640 1 -- 10.20.193.110:0/2145995801 wait complete. 2026-02-13T20:13:58.169 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.153+0000 7f3fe905b640 10 monclient: build_initial_monmap 2026-02-13T20:13:58.169 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.153+0000 7f3fe905b640 10 monclient: monmap: 2026-02-13T20:13:58.170 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:13:58.170 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:13:58.170 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:13:58.170 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:13:58.170 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:13:58.170 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:13:58.170 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:13:58.170 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:13:58.170 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:13:58.170 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:58.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.153+0000 7f3fe905b640 1 Processor -- start 2026-02-13T20:13:58.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.153+0000 7f3fe905b640 1 -- start start 2026-02-13T20:13:58.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.153+0000 7f3fe905b640 10 monclient: init 2026-02-13T20:13:58.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.153+0000 7f3fe905b640 10 monclient: _reopen_session rank -1 2026-02-13T20:13:58.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.153+0000 7f3fe905b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:13:58.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.153+0000 7f3fe905b640 10 monclient(hunting): picked mon.noname-b con 0x7f3fe4091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:13:58.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.153+0000 7f3fe905b640 10 monclient(hunting): picked mon.noname-c con 0x7f3fe41401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:13:58.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.153+0000 7f3fe905b640 10 monclient(hunting): picked mon.noname-a con 0x7f3fe4150430 addr v1:10.20.193.110:6789/0 2026-02-13T20:13:58.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.153+0000 7f3fe905b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fe4090f40 con 0x7f3fe4150430 2026-02-13T20:13:58.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.153+0000 7f3fe905b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fe412d9d0 con 0x7f3fe4091950 2026-02-13T20:13:58.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.153+0000 7f3fe905b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fe408c310 con 0x7f3fe41401c0 2026-02-13T20:13:58.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.153+0000 7f3fe2575640 1 -- >> v1:10.20.193.110:6790/0 conn(0x7f3fe41401c0 legacy=0x7f3fe4191560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.110:6790/0 2026-02-13T20:13:58.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.153+0000 7f3fe905b640 10 monclient(hunting): _renew_subs 2026-02-13T20:13:58.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.154+0000 7f3fe905b640 10 monclient(hunting): authenticate will time out at 799.845004s 2026-02-13T20:13:58.172 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.154+0000 7f3fe3577640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f3fe4150430 0x7f3fe4192c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:41754/0 (socket says 10.20.193.110:41754) 2026-02-13T20:13:58.172 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.154+0000 7f3fe3577640 1 -- 10.20.193.110:0/2287754927 learned_addr learned my addr 10.20.193.110:0/2287754927 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:13:58.172 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.154+0000 7f3fc37fe640 1 -- 10.20.193.110:0/2287754927 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3915257664 0 0) 0x7f3fe405c5b0 con 0x7f3fe4150430 2026-02-13T20:13:58.172 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.154+0000 7f3fc37fe640 10 monclient(hunting): _negotiate 2026-02-13T20:13:58.172 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.154+0000 7f3fc37fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:58.172 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.154+0000 7f3fc37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:58.172 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.154+0000 7f3fc37fe640 10 monclient(hunting): my global_id is 84192 2026-02-13T20:13:58.172 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.154+0000 7f3fc37fe640 1 -- 10.20.193.110:0/2287754927 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fb00035e0 con 0x7f3fe4150430 2026-02-13T20:13:58.172 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.154+0000 7f3fc37fe640 1 -- 10.20.193.110:0/2287754927 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3034715800 0 0) 0x7f3fb00035e0 con 0x7f3fe4150430 2026-02-13T20:13:58.172 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.154+0000 7f3fc37fe640 1 -- 10.20.193.110:0/2287754927 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3fe405c5b0 con 0x7f3fe4150430 2026-02-13T20:13:58.172 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.154+0000 7f3fc37fe640 1 -- 10.20.193.110:0/2287754927 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f3fd40041d0 con 0x7f3fe4150430 2026-02-13T20:13:58.172 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.154+0000 7f3fc37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:13:58.173 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.154+0000 7f3fc37fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:13:58.173 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.154+0000 7f3fc37fe640 10 monclient(hunting): dump: 2026-02-13T20:13:58.173 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:58.173 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:58.173 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:58.173 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:58.173 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:58.173 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:58.173 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:58.173 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:58.173 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:58.173 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:58.173 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.154+0000 7f3fc37fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:13:58.174 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.154+0000 7f3fc37fe640 1 -- 10.20.193.110:0/2287754927 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 338752081 0 0) 0x7f3fe405c5b0 con 0x7f3fe4150430 2026-02-13T20:13:58.174 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.154+0000 7f3fc37fe640 1 -- 10.20.193.110:0/2287754927 >> v1:10.20.193.110:6790/0 conn(0x7f3fe41401c0 legacy=0x7f3fe4191560 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T20:13:58.174 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.154+0000 7f3fc37fe640 1 -- 10.20.193.110:0/2287754927 >> v1:10.20.193.188:6789/0 conn(0x7f3fe4091950 legacy=0x7f3fe413e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:58.174 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.154+0000 7f3fc37fe640 10 monclient: _finish_hunting 0 2026-02-13T20:13:58.174 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.154+0000 7f3fc37fe640 1 monclient: found mon.a 2026-02-13T20:13:58.174 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.154+0000 7f3fc37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:13:58.174 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.154+0000 7f3fc37fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:13:58.174 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.154+0000 7f3fc37fe640 1 -- 10.20.193.110:0/2287754927 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fe405d320 con 0x7f3fe4150430 2026-02-13T20:13:58.174 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.154+0000 7f3fc37fe640 10 monclient: _finish_auth 0 2026-02-13T20:13:58.174 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.154+0000 7f3fc37fe640 10 monclient: _check_auth_tickets 2026-02-13T20:13:58.174 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.154+0000 7f3fc37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:13:58.174 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.154+0000 7f3fe905b640 5 monclient: authenticate success, global_id 84192 2026-02-13T20:13:58.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.154+0000 7f3fe905b640 10 monclient: _renew_subs 2026-02-13T20:13:58.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.154+0000 7f3fe905b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:13:58.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.154+0000 7f3fe905b640 1 -- 10.20.193.110:0/2287754927 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3fe412fd30 con 0x7f3fe4150430 2026-02-13T20:13:58.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.154+0000 7f3fe905b640 10 monclient: _renew_subs 2026-02-13T20:13:58.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.154+0000 7f3fe905b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:13:58.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.154+0000 7f3fe905b640 1 -- 10.20.193.110:0/2287754927 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3fe4150870 con 0x7f3fe4150430 2026-02-13T20:13:58.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.154+0000 7f3fc37fe640 1 -- 10.20.193.110:0/2287754927 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3fd40043a0 con 0x7f3fe4150430 2026-02-13T20:13:58.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.154+0000 7f3fc37fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:13:58.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.154+0000 7f3fc37fe640 1 -- 10.20.193.110:0/2287754927 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f3fd4004aa0 con 0x7f3fe4150430 2026-02-13T20:13:58.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.154+0000 7f3fc37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:58.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.154+0000 7f3fc37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:13:58.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.154+0000 7f3fe1573640 4 set_mon_vals no callback set 2026-02-13T20:13:58.176 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.154+0000 7f3fc37fe640 10 monclient: dump: 2026-02-13T20:13:58.176 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:58.176 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:58.176 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:58.176 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:58.176 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:58.176 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:58.176 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:58.176 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:58.176 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:58.176 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:58.176 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.154+0000 7f3fe905b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:13:58.177 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.154+0000 7f3fe905b640 1 -- 10.20.193.110:0/2287754927 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3fe412f900 con 0x7f3fe4092020 2026-02-13T20:13:58.177 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.155+0000 7f3fc37fe640 1 -- 10.20.193.110:0/2287754927 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f3fd4004c00 con 0x7f3fe4150430 2026-02-13T20:13:58.177 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.155+0000 7f3fc37fe640 1 -- 10.20.193.110:0/2287754927 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(116..116 src has 1..116) ==== 3991+0+0 (unknown 660005066 0 0) 0x7f3fd404f860 con 0x7f3fe4150430 2026-02-13T20:13:58.177 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.155+0000 7f3fc37fe640 1 -- 10.20.193.110:0/2287754927 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 331951453 0 0) 0x7f3fe412f900 con 0x7f3fe4092020 2026-02-13T20:13:58.177 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.155+0000 7f3fc37fe640 10 monclient(hunting): _negotiate 2026-02-13T20:13:58.177 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.155+0000 7f3fc37fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:58.177 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.155+0000 7f3fc37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:58.177 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.155+0000 7f3fc37fe640 10 monclient(hunting): my global_id is 84195 2026-02-13T20:13:58.177 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.155+0000 7f3fc37fe640 1 -- 10.20.193.110:0/2287754927 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fe405c5b0 con 0x7f3fe4092020 2026-02-13T20:13:58.177 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.155+0000 7f3fc37fe640 1 -- 10.20.193.110:0/2287754927 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1035253181 0 0) 0x7f3fe405c5b0 con 0x7f3fe4092020 2026-02-13T20:13:58.177 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.155+0000 7f3fc37fe640 1 -- 10.20.193.110:0/2287754927 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3fe412f900 con 0x7f3fe4092020 2026-02-13T20:13:58.177 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.155+0000 7f3fc37fe640 1 -- 10.20.193.110:0/2287754927 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f3fd8003f60 con 0x7f3fe4092020 2026-02-13T20:13:58.178 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.155+0000 7f3fe2575640 10 monclient: get_auth_request con 0x7f3fb003f590 auth_method 0 2026-02-13T20:13:58.178 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.155+0000 7f3fc37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:58.178 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.155+0000 7f3fc37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:13:58.178 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.155+0000 7f3fc37fe640 10 monclient: dump: 2026-02-13T20:13:58.178 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:58.178 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:58.178 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:58.178 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:58.178 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:58.178 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:58.178 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:58.178 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:58.178 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:58.179 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:58.179 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.155+0000 7f3fc37fe640 1 -- 10.20.193.110:0/2287754927 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3253348549 0 0) 0x7f3fe412f900 con 0x7f3fe4092020 2026-02-13T20:13:58.179 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.155+0000 7f3fc37fe640 1 -- 10.20.193.110:0/2287754927 --> v1:10.20.193.110:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3fe412f490 con 0x7f3fe4092020 2026-02-13T20:13:58.179 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.155+0000 7f3fc37fe640 1 -- 10.20.193.110:0/2287754927 <== mon.0 v1:10.20.193.110:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f3fd8006250 con 0x7f3fe4092020 2026-02-13T20:13:58.179 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.155+0000 7f3fc37fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:13:58.179 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.155+0000 7f3fc37fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:13:58.179 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.155+0000 7f3fc37fe640 1 -- 10.20.193.110:0/2287754927 >> v1:10.20.193.110:6789/0 conn(0x7f3fe4092020 legacy=0x7f3fe4127b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:58.179 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.155+0000 7f3fc37fe640 1 -- 10.20.193.110:0/2287754927 >> v1:10.20.193.110:6789/0 conn(0x7f3fe4092020 legacy=0x7f3fe4127b20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:13:58.179 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.159+0000 7f3fe905b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:13:58.179 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.159+0000 7f3fe905b640 1 -- 10.20.193.110:0/2287754927 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3fe4090f40 con 0x7f3fe4128230 2026-02-13T20:13:58.180 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.159+0000 7f3fc37fe640 1 -- 10.20.193.110:0/2287754927 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 268052068 0 0) 0x7f3fe412d9d0 con 0x7f3fe4128230 2026-02-13T20:13:58.180 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.159+0000 7f3fc37fe640 10 monclient(hunting): _negotiate 2026-02-13T20:13:58.180 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.159+0000 7f3fc37fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:58.180 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.159+0000 7f3fc37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:58.180 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.159+0000 7f3fc37fe640 10 monclient(hunting): my global_id is 84198 2026-02-13T20:13:58.180 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.159+0000 7f3fc37fe640 1 -- 10.20.193.110:0/2287754927 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fe412f900 con 0x7f3fe4128230 2026-02-13T20:13:58.180 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.159+0000 7f3fc37fe640 1 -- 10.20.193.110:0/2287754927 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 551700561 0 0) 0x7f3fe412f900 con 0x7f3fe4128230 2026-02-13T20:13:58.180 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.159+0000 7f3fc37fe640 1 -- 10.20.193.110:0/2287754927 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3fe412d9d0 con 0x7f3fe4128230 2026-02-13T20:13:58.180 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.159+0000 7f3fc37fe640 1 -- 10.20.193.110:0/2287754927 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f3fd8004900 con 0x7f3fe4128230 2026-02-13T20:13:58.180 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.159+0000 7f3fc37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:58.180 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.159+0000 7f3fc37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:13:58.180 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.159+0000 7f3fc37fe640 10 monclient: dump: 2026-02-13T20:13:58.180 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:58.181 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:58.181 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:58.181 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:58.181 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:58.181 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:58.181 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:58.181 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:58.181 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:58.181 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:58.181 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.159+0000 7f3fc37fe640 1 -- 10.20.193.110:0/2287754927 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2492224961 0 0) 0x7f3fe412d9d0 con 0x7f3fe4128230 2026-02-13T20:13:58.181 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.159+0000 7f3fc37fe640 1 -- 10.20.193.110:0/2287754927 --> v1:10.20.193.110:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3fe408b450 con 0x7f3fe4128230 2026-02-13T20:13:58.181 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.159+0000 7f3fc37fe640 1 -- 10.20.193.110:0/2287754927 <== mon.0 v1:10.20.193.110:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4502 (unknown 0 0 1032927555) 0x7f3fd8005ea0 con 0x7f3fe4128230 2026-02-13T20:13:58.182 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.159+0000 7f3fc37fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:13:58.182 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.159+0000 7f3fc37fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:13:58.182 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.159+0000 7f3fc37fe640 1 -- 10.20.193.110:0/2287754927 >> v1:10.20.193.110:6789/0 conn(0x7f3fe4128230 legacy=0x7f3fe41953b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:58.182 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.159+0000 7f3fc37fe640 1 -- 10.20.193.110:0/2287754927 >> v1:10.20.193.110:6789/0 conn(0x7f3fe4128230 legacy=0x7f3fe41953b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:13:58.182 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:13:58.182 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:13:58.183 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:13:58.183 INFO:teuthology.orchestra.run.trial110.stdout: "state": "peon", 2026-02-13T20:13:58.183 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 14, 2026-02-13T20:13:58.183 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 32250, 2026-02-13T20:13:58.183 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:13:58.183 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:13:58.183 INFO:teuthology.orchestra.run.trial110.stdout: 1 2026-02-13T20:13:58.183 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:13:58.183 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 0, 2026-02-13T20:13:58.183 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:13:58.183 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:13:58.184 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:13:58.184 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:13:58.184 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:13:58.184 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:13:58.184 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:13:58.184 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:13:58.184 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:13:58.184 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:13:58.184 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:13:58.184 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:13:58.184 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:13:58.185 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:13:58.185 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:13:58.185 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:13:58.185 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:13:58.185 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:13:58.185 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:13:58.185 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:13:58.185 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:13:58.185 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:13:58.185 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:13:58.185 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:13:58.186 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:13:58.186 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:13:58.186 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:13:58.186 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:13:58.186 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:13:58.186 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:13:58.186 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:13:58.186 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:13:58.186 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:13:58.186 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:58.186 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:13:58.186 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:13:58.187 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:13:58.187 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:13:58.187 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:13:58.187 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:13:58.187 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:13:58.187 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:13:58.187 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:13:58.187 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:13:58.187 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:13:58.187 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:13:58.187 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:13:58.187 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:13:58.188 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:13:58.188 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:13:58.188 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:13:58.188 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:13:58.188 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:13:58.188 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:13:58.188 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:13:58.188 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:13:58.188 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:13:58.188 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:13:58.188 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:13:58.188 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:13:58.188 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:13:58.189 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:13:58.189 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:13:58.189 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:13:58.189 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:13:58.189 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:13:58.189 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:58.189 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:13:58.189 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:58.189 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:13:58.189 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:13:58.189 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:13:58.189 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:13:58.189 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:58.190 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:13:58.190 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:13:58.190 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:13:58.190 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:58.190 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:13:58.190 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:58.190 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:13:58.190 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:13:58.190 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:13:58.190 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:13:58.190 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:13:58.190 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:13:58.190 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:58.190 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:58.191 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:13:58.191 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:13:58.191 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:13:58.191 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:13:58.191 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:58.191 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:13:58.191 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:13:58.191 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:13:58.191 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:58.191 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:13:58.191 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:58.191 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:13:58.191 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:13:58.191 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:13:58.192 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:13:58.192 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:13:58.192 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:13:58.192 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:58.192 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:58.192 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:13:58.192 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:13:58.192 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:13:58.192 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:13:58.192 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:58.192 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:13:58.192 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:13:58.192 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:13:58.192 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:58.192 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:13:58.193 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:58.193 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:13:58.193 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:13:58.193 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:13:58.193 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:13:58.193 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:13:58.193 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:13:58.193 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:58.193 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:13:58.193 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:58.193 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:13:58.193 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:13:58.193 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:58.193 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:13:58.193 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:13:58.194 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:13:58.194 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:58.194 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:13:58.194 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:13:58.194 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:58.194 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:13:58.194 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:13:58.194 INFO:teuthology.orchestra.run.trial110.stdout: "num": 2 2026-02-13T20:13:58.194 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:58.194 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:13:58.194 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:13:58.194 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:58.194 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:13:58.194 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:13:58.194 INFO:teuthology.orchestra.run.trial110.stdout: "num": 2 2026-02-13T20:13:58.194 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:58.195 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:13:58.195 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:58.195 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:13:58.195 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:13:58.196 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.160+0000 7f3fe905b640 1 -- 10.20.193.110:0/2287754927 >> v1:10.20.193.188:6812/1623052694 conn(0x7f3fb003f590 legacy=0x7f3fb005fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:58.196 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.160+0000 7f3fe905b640 10 monclient: shutdown 2026-02-13T20:13:58.196 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.160+0000 7f3fe905b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:13:58.196 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.160+0000 7f3fe905b640 1 -- 10.20.193.110:0/2287754927 >> v1:10.20.193.110:6789/0 conn(0x7f3fe4150430 legacy=0x7f3fe4192c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:58.196 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.160+0000 7f3fe3577640 1 -- 10.20.193.110:0/2287754927 reap_dead start 2026-02-13T20:13:58.196 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.160+0000 7f3fe3577640 1 -- 10.20.193.110:0/2287754927 reap_dead start 2026-02-13T20:13:58.196 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.160+0000 7f3fe905b640 1 -- 10.20.193.110:0/2287754927 shutdown_connections 2026-02-13T20:13:58.196 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.160+0000 7f3fe905b640 1 -- 10.20.193.110:0/2287754927 >> 10.20.193.110:0/2287754927 conn(0x7f3fe4054e90 msgr2=0x7f3fe408dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:13:58.197 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.160+0000 7f3fe905b640 1 -- 10.20.193.110:0/2287754927 shutdown_connections 2026-02-13T20:13:58.197 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.160+0000 7f3fe905b640 1 -- 10.20.193.110:0/2287754927 wait complete. 2026-02-13T20:13:58.197 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-13T20:13:58.197 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-13T20:13:58.197 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T20:13:58.271 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.262+0000 7fba464cc640 10 monclient: get_monmap_and_config 2026-02-13T20:13:58.272 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.262+0000 7fba464cc640 10 monclient: build_initial_monmap 2026-02-13T20:13:58.272 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.262+0000 7fba464cc640 10 monclient: monmap: 2026-02-13T20:13:58.272 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:13:58.272 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:58.272 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:13:58.263884+0000 2026-02-13T20:13:58.272 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:13:58.263884+0000 2026-02-13T20:13:58.272 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:13:58.272 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:58.272 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:13:58.272 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:13:58.272 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:13:58.272 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:58.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.262+0000 7fba464cc640 1 Processor -- start 2026-02-13T20:13:58.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.262+0000 7fba464cc640 1 -- start start 2026-02-13T20:13:58.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.262+0000 7fba464cc640 10 monclient: init 2026-02-13T20:13:58.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.263+0000 7fba464cc640 10 monclient: _reopen_session rank -1 2026-02-13T20:13:58.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.263+0000 7fba464cc640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:13:58.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.263+0000 7fba464cc640 10 monclient(hunting): picked mon.noname-b con 0x7fba401401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:13:58.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.263+0000 7fba464cc640 10 monclient(hunting): picked mon.noname-a con 0x7fba40092020 addr v1:10.20.193.110:6789/0 2026-02-13T20:13:58.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.263+0000 7fba464cc640 10 monclient(hunting): picked mon.noname-c con 0x7fba40091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:13:58.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.263+0000 7fba464cc640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba4008b730 con 0x7fba40092020 2026-02-13T20:13:58.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.263+0000 7fba464cc640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba4005c5b0 con 0x7fba40091950 2026-02-13T20:13:58.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.263+0000 7fba464cc640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba4008bcf0 con 0x7fba401401c0 2026-02-13T20:13:58.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.263+0000 7fba464cc640 10 monclient(hunting): _renew_subs 2026-02-13T20:13:58.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.263+0000 7fba464cc640 10 monclient(hunting): authenticate will time out at 799.954242s 2026-02-13T20:13:58.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.263+0000 7fba3ffff640 1 -- >> v1:10.20.193.110:6790/0 conn(0x7fba401401c0 legacy=0x7fba40091240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6790/0 2026-02-13T20:13:58.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.263+0000 7fba3f7fe640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fba40092020 0x7fba401812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:41770/0 (socket says 10.20.193.110:41770) 2026-02-13T20:13:58.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.263+0000 7fba3f7fe640 1 -- 10.20.193.110:0/1007616308 learned_addr learned my addr 10.20.193.110:0/1007616308 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:13:58.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.263+0000 7fba3effd640 1 -- 10.20.193.110:0/1007616308 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2142048401 0 0) 0x7fba4008b730 con 0x7fba40092020 2026-02-13T20:13:58.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.263+0000 7fba3effd640 10 monclient(hunting): _negotiate 2026-02-13T20:13:58.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.263+0000 7fba3effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:58.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.263+0000 7fba3effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:58.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.263+0000 7fba3effd640 10 monclient(hunting): my global_id is 84201 2026-02-13T20:13:58.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.263+0000 7fba3effd640 1 -- 10.20.193.110:0/1007616308 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba240035e0 con 0x7fba40092020 2026-02-13T20:13:58.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.263+0000 7fba3effd640 1 -- 10.20.193.110:0/1007616308 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2192593093 0 0) 0x7fba240035e0 con 0x7fba40092020 2026-02-13T20:13:58.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.263+0000 7fba3effd640 1 -- 10.20.193.110:0/1007616308 >> v1:10.20.193.110:6790/0 conn(0x7fba401401c0 legacy=0x7fba40091240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:13:58.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.263+0000 7fba3effd640 1 -- 10.20.193.110:0/1007616308 >> v1:10.20.193.188:6789/0 conn(0x7fba40091950 legacy=0x7fba401a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T20:13:58.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.263+0000 7fba3effd640 10 monclient: _finish_hunting 0 2026-02-13T20:13:58.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.263+0000 7fba3effd640 1 monclient: found mon.noname-a 2026-02-13T20:13:58.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.263+0000 7fba3effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:13:58.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.263+0000 7fba3effd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:13:58.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.263+0000 7fba3effd640 1 -- 10.20.193.110:0/1007616308 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba40140590 con 0x7fba40092020 2026-02-13T20:13:58.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.263+0000 7fba3effd640 10 monclient: _finish_auth 0 2026-02-13T20:13:58.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.263+0000 7fba3effd640 10 monclient: _check_auth_tickets 2026-02-13T20:13:58.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.263+0000 7fba3effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:13:58.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.263+0000 7fba464cc640 5 monclient: authenticate success, global_id 84201 2026-02-13T20:13:58.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.263+0000 7fba3effd640 1 -- 10.20.193.110:0/1007616308 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fba30002dd0 con 0x7fba40092020 2026-02-13T20:13:58.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.263+0000 7fba464cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:13:58.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.263+0000 7fba3effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:58.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.263+0000 7fba3effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:13:58.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.263+0000 7fba3effd640 10 monclient: dump: 2026-02-13T20:13:58.276 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:58.276 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:58.276 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:58.276 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:58.276 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:58.276 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:58.276 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:58.276 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:58.276 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:58.276 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:58.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.263+0000 7fba464cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:13:58.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.263+0000 7fba3effd640 1 -- 10.20.193.110:0/1007616308 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fba30002fa0 con 0x7fba40092020 2026-02-13T20:13:58.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.263+0000 7fba3effd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:13:58.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.263+0000 7fba464cc640 10 monclient: get_monmap_and_config success 2026-02-13T20:13:58.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.263+0000 7fba3effd640 1 -- 10.20.193.110:0/1007616308 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fba300033b0 con 0x7fba40092020 2026-02-13T20:13:58.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.263+0000 7fba464cc640 4 set_mon_vals no callback set 2026-02-13T20:13:58.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.263+0000 7fba3effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:58.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.263+0000 7fba3effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:13:58.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.263+0000 7fba3effd640 10 monclient: dump: 2026-02-13T20:13:58.277 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:58.277 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:58.277 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:58.277 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:58.277 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:58.277 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:58.277 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:58.277 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:58.278 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:58.278 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:58.278 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.263+0000 7fba464cc640 10 monclient: shutdown 2026-02-13T20:13:58.278 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.263+0000 7fba464cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:13:58.278 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.263+0000 7fba464cc640 1 -- 10.20.193.110:0/1007616308 >> v1:10.20.193.110:6789/0 conn(0x7fba40092020 legacy=0x7fba401812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:58.278 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.264+0000 7fba464cc640 1 -- 10.20.193.110:0/1007616308 shutdown_connections 2026-02-13T20:13:58.278 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.264+0000 7fba464cc640 1 -- 10.20.193.110:0/1007616308 >> 10.20.193.110:0/1007616308 conn(0x7fba40054e90 msgr2=0x7fba40058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:13:58.278 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.264+0000 7fba464cc640 1 -- 10.20.193.110:0/1007616308 shutdown_connections 2026-02-13T20:13:58.278 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.264+0000 7fba464cc640 1 -- 10.20.193.110:0/1007616308 wait complete. 2026-02-13T20:13:58.278 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.264+0000 7fba464cc640 10 monclient: build_initial_monmap 2026-02-13T20:13:58.278 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.264+0000 7fba464cc640 10 monclient: monmap: 2026-02-13T20:13:58.278 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:13:58.278 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:13:58.278 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:13:58.279 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:13:58.279 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:13:58.279 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:13:58.279 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:13:58.279 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:13:58.279 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:13:58.279 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:58.279 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.264+0000 7fba464cc640 1 Processor -- start 2026-02-13T20:13:58.279 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.264+0000 7fba464cc640 1 -- start start 2026-02-13T20:13:58.279 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.264+0000 7fba464cc640 10 monclient: init 2026-02-13T20:13:58.279 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.264+0000 7fba464cc640 10 monclient: _reopen_session rank -1 2026-02-13T20:13:58.279 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.264+0000 7fba464cc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:13:58.279 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.264+0000 7fba464cc640 10 monclient(hunting): picked mon.noname-a con 0x7fba40091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:13:58.280 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.264+0000 7fba464cc640 10 monclient(hunting): picked mon.noname-c con 0x7fba401401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:13:58.280 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.264+0000 7fba464cc640 10 monclient(hunting): picked mon.noname-b con 0x7fba401947c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:13:58.280 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.264+0000 7fba464cc640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba40090cf0 con 0x7fba40091950 2026-02-13T20:13:58.280 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.264+0000 7fba464cc640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba4005d320 con 0x7fba401947c0 2026-02-13T20:13:58.280 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.264+0000 7fba464cc640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba401318c0 con 0x7fba401401c0 2026-02-13T20:13:58.280 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.264+0000 7fba464cc640 10 monclient(hunting): _renew_subs 2026-02-13T20:13:58.280 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.264+0000 7fba464cc640 10 monclient(hunting): authenticate will time out at 799.955905s 2026-02-13T20:13:58.280 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.264+0000 7fba3f7fe640 1 -- >> v1:10.20.193.110:6790/0 conn(0x7fba401401c0 legacy=0x7fba40089540 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.110:6790/0 2026-02-13T20:13:58.280 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.264+0000 7fba3ffff640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fba40091950 0x7fba40088e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:41774/0 (socket says 10.20.193.110:41774) 2026-02-13T20:13:58.280 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.264+0000 7fba3ffff640 1 -- 10.20.193.110:0/1168444119 learned_addr learned my addr 10.20.193.110:0/1168444119 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:13:58.280 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.265+0000 7fba3cff9640 1 -- 10.20.193.110:0/1168444119 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2753760265 0 0) 0x7fba40090cf0 con 0x7fba40091950 2026-02-13T20:13:58.280 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.265+0000 7fba3cff9640 10 monclient(hunting): _negotiate 2026-02-13T20:13:58.280 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.265+0000 7fba3cff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:58.280 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.265+0000 7fba3cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:58.281 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.265+0000 7fba3cff9640 10 monclient(hunting): my global_id is 84204 2026-02-13T20:13:58.281 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.265+0000 7fba3cff9640 1 -- 10.20.193.110:0/1168444119 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba100035e0 con 0x7fba40091950 2026-02-13T20:13:58.281 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.265+0000 7fba3cff9640 1 -- 10.20.193.110:0/1168444119 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 897467310 0 0) 0x7fba100035e0 con 0x7fba40091950 2026-02-13T20:13:58.281 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.265+0000 7fba3cff9640 1 -- 10.20.193.110:0/1168444119 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fba40090cf0 con 0x7fba40091950 2026-02-13T20:13:58.281 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.265+0000 7fba3cff9640 1 -- 10.20.193.110:0/1168444119 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fba2c004280 con 0x7fba40091950 2026-02-13T20:13:58.281 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.265+0000 7fba3cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:13:58.281 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.265+0000 7fba3cff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:13:58.281 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.265+0000 7fba3cff9640 10 monclient(hunting): dump: 2026-02-13T20:13:58.281 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:58.281 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:58.281 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:58.281 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:58.281 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:58.282 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:58.282 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:58.282 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:58.282 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:58.282 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:58.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.265+0000 7fba3cff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:13:58.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.265+0000 7fba3cff9640 1 -- 10.20.193.110:0/1168444119 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 866889536 0 0) 0x7fba40090cf0 con 0x7fba40091950 2026-02-13T20:13:58.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.265+0000 7fba3cff9640 1 -- 10.20.193.110:0/1168444119 >> v1:10.20.193.110:6790/0 conn(0x7fba401401c0 legacy=0x7fba40089540 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T20:13:58.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.265+0000 7fba3cff9640 1 -- 10.20.193.110:0/1168444119 >> v1:10.20.193.188:6789/0 conn(0x7fba401947c0 legacy=0x7fba40194c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:58.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.265+0000 7fba3cff9640 10 monclient: _finish_hunting 0 2026-02-13T20:13:58.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.265+0000 7fba3cff9640 1 monclient: found mon.a 2026-02-13T20:13:58.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.265+0000 7fba3cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:13:58.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.265+0000 7fba3cff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:13:58.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.265+0000 7fba3cff9640 1 -- 10.20.193.110:0/1168444119 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba40131e80 con 0x7fba40091950 2026-02-13T20:13:58.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.265+0000 7fba3cff9640 10 monclient: _finish_auth 0 2026-02-13T20:13:58.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.265+0000 7fba3cff9640 10 monclient: _check_auth_tickets 2026-02-13T20:13:58.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.265+0000 7fba3cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:13:58.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.265+0000 7fba464cc640 5 monclient: authenticate success, global_id 84204 2026-02-13T20:13:58.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.265+0000 7fba464cc640 10 monclient: _renew_subs 2026-02-13T20:13:58.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.265+0000 7fba464cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:13:58.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.265+0000 7fba464cc640 1 -- 10.20.193.110:0/1168444119 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fba40132160 con 0x7fba40091950 2026-02-13T20:13:58.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.265+0000 7fba464cc640 10 monclient: _renew_subs 2026-02-13T20:13:58.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.265+0000 7fba464cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:13:58.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.265+0000 7fba464cc640 1 -- 10.20.193.110:0/1168444119 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fba4008a800 con 0x7fba40091950 2026-02-13T20:13:58.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.265+0000 7fba3cff9640 1 -- 10.20.193.110:0/1168444119 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fba2c0044c0 con 0x7fba40091950 2026-02-13T20:13:58.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.265+0000 7fba3cff9640 10 monclient: handle_config config(0 keys) 2026-02-13T20:13:58.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.265+0000 7fba3cff9640 1 -- 10.20.193.110:0/1168444119 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fba2c0048a0 con 0x7fba40091950 2026-02-13T20:13:58.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.265+0000 7fba3cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:58.284 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.265+0000 7fba3cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:13:58.284 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.265+0000 7fba3cff9640 10 monclient: dump: 2026-02-13T20:13:58.284 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:58.284 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:58.284 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:58.284 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:58.284 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:58.284 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:58.284 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:58.284 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:58.284 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:58.284 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:58.284 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.265+0000 7fba3e7fc640 4 set_mon_vals no callback set 2026-02-13T20:13:58.285 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.265+0000 7fba464cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:13:58.285 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.266+0000 7fba464cc640 1 -- 10.20.193.110:0/1168444119 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fba4013f120 con 0x7fba40092020 2026-02-13T20:13:58.285 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.266+0000 7fba3cff9640 1 -- 10.20.193.110:0/1168444119 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fba2c004a00 con 0x7fba40091950 2026-02-13T20:13:58.285 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.266+0000 7fba3cff9640 1 -- 10.20.193.110:0/1168444119 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(116..116 src has 1..116) ==== 3991+0+0 (unknown 660005066 0 0) 0x7fba2c04e9b0 con 0x7fba40091950 2026-02-13T20:13:58.285 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.266+0000 7fba44a42640 10 monclient: get_auth_request con 0x7fba1003f630 auth_method 0 2026-02-13T20:13:58.285 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.266+0000 7fba3cff9640 1 -- 10.20.193.110:0/1168444119 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2023921006 0 0) 0x7fba4013f120 con 0x7fba40092020 2026-02-13T20:13:58.285 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.266+0000 7fba3cff9640 10 monclient(hunting): _negotiate 2026-02-13T20:13:58.285 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.266+0000 7fba3cff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:58.285 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.266+0000 7fba3cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:58.285 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.266+0000 7fba3cff9640 10 monclient(hunting): my global_id is 4537 2026-02-13T20:13:58.285 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.266+0000 7fba3cff9640 1 -- 10.20.193.110:0/1168444119 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba40090cf0 con 0x7fba40092020 2026-02-13T20:13:58.285 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.266+0000 7fba3cff9640 1 -- 10.20.193.110:0/1168444119 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1297092700 0 0) 0x7fba40090cf0 con 0x7fba40092020 2026-02-13T20:13:58.285 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.266+0000 7fba3cff9640 1 -- 10.20.193.110:0/1168444119 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fba4013f120 con 0x7fba40092020 2026-02-13T20:13:58.285 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.266+0000 7fba3cff9640 1 -- 10.20.193.110:0/1168444119 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fba30002dd0 con 0x7fba40092020 2026-02-13T20:13:58.286 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.266+0000 7fba3cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:58.286 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.266+0000 7fba3cff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:13:58.286 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.266+0000 7fba3cff9640 10 monclient: dump: 2026-02-13T20:13:58.286 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:58.286 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:58.286 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:58.286 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:58.286 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:58.286 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:58.286 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:58.286 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:58.286 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:58.286 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:58.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.267+0000 7fba3cff9640 1 -- 10.20.193.110:0/1168444119 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3021619495 0 0) 0x7fba4013f120 con 0x7fba40092020 2026-02-13T20:13:58.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.267+0000 7fba3cff9640 1 -- 10.20.193.110:0/1168444119 --> v1:10.20.193.188:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fba4008b450 con 0x7fba40092020 2026-02-13T20:13:58.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.267+0000 7fba3cff9640 1 -- 10.20.193.110:0/1168444119 <== mon.1 v1:10.20.193.188:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fba300048a0 con 0x7fba40092020 2026-02-13T20:13:58.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.267+0000 7fba3cff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:13:58.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.267+0000 7fba3cff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:13:58.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.267+0000 7fba3cff9640 1 -- 10.20.193.110:0/1168444119 >> v1:10.20.193.188:6789/0 conn(0x7fba40092020 legacy=0x7fba40127b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:58.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.267+0000 7fba3cff9640 1 -- 10.20.193.110:0/1168444119 >> v1:10.20.193.188:6789/0 conn(0x7fba40092020 legacy=0x7fba40127b20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:13:58.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.270+0000 7fba464cc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:13:58.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.270+0000 7fba464cc640 1 -- 10.20.193.110:0/1168444119 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fba40131a70 con 0x7fba40128230 2026-02-13T20:13:58.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.271+0000 7fba3cff9640 1 -- 10.20.193.110:0/1168444119 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3547671103 0 0) 0x7fba40131a70 con 0x7fba40128230 2026-02-13T20:13:58.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.271+0000 7fba3cff9640 10 monclient(hunting): _negotiate 2026-02-13T20:13:58.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.271+0000 7fba3cff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:13:58.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.271+0000 7fba3cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:13:58.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.271+0000 7fba3cff9640 10 monclient(hunting): my global_id is 4540 2026-02-13T20:13:58.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.271+0000 7fba3cff9640 1 -- 10.20.193.110:0/1168444119 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba4013f120 con 0x7fba40128230 2026-02-13T20:13:58.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.271+0000 7fba3cff9640 1 -- 10.20.193.110:0/1168444119 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3253342189 0 0) 0x7fba4013f120 con 0x7fba40128230 2026-02-13T20:13:58.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.271+0000 7fba3cff9640 1 -- 10.20.193.110:0/1168444119 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fba40131a70 con 0x7fba40128230 2026-02-13T20:13:58.290 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.271+0000 7fba3cff9640 1 -- 10.20.193.110:0/1168444119 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fba30004db0 con 0x7fba40128230 2026-02-13T20:13:58.290 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.271+0000 7fba3cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:13:58.290 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.271+0000 7fba3cff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:13:58.290 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.271+0000 7fba3cff9640 10 monclient: dump: 2026-02-13T20:13:58.290 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:13:58.290 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:13:58.290 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:58.290 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:13:58.290 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:13:58.290 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:13:58.290 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:13:58.290 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:13:58.290 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:13:58.291 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:13:58.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.271+0000 7fba3cff9640 1 -- 10.20.193.110:0/1168444119 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 41495440 0 0) 0x7fba40131a70 con 0x7fba40128230 2026-02-13T20:13:58.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.271+0000 7fba3cff9640 1 -- 10.20.193.110:0/1168444119 --> v1:10.20.193.188:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fba40055bb0 con 0x7fba40128230 2026-02-13T20:13:58.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.272+0000 7fba3cff9640 1 -- 10.20.193.110:0/1168444119 <== mon.1 v1:10.20.193.188:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4672 (unknown 0 0 2331605182) 0x7fba30005160 con 0x7fba40128230 2026-02-13T20:13:58.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.272+0000 7fba3cff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:13:58.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.272+0000 7fba3cff9640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:13:58.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.272+0000 7fba3cff9640 1 -- 10.20.193.110:0/1168444119 >> v1:10.20.193.188:6789/0 conn(0x7fba40128230 legacy=0x7fba40197390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:58.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.272+0000 7fba3cff9640 1 -- 10.20.193.110:0/1168444119 >> v1:10.20.193.188:6789/0 conn(0x7fba40128230 legacy=0x7fba40197390 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:13:58.291 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:13:58.292 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:13:58.292 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:13:58.292 INFO:teuthology.orchestra.run.trial110.stdout: "state": "leader", 2026-02-13T20:13:58.292 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 14, 2026-02-13T20:13:58.292 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 160418, 2026-02-13T20:13:58.292 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:13:58.292 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:13:58.292 INFO:teuthology.orchestra.run.trial110.stdout: 1 2026-02-13T20:13:58.292 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:13:58.292 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 0, 2026-02-13T20:13:58.292 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:13:58.292 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:13:58.292 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:13:58.293 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:13:58.293 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:13:58.293 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:13:58.293 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:13:58.293 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:13:58.293 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:13:58.293 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:13:58.293 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:13:58.293 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:13:58.293 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:13:58.293 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:13:58.293 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:13:58.293 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:13:58.294 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:13:58.294 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:13:58.294 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:13:58.294 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:13:58.294 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:13:58.294 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:13:58.294 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:13:58.294 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:13:58.294 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:13:58.294 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:13:58.294 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:13:58.294 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:13:58.294 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:13:58.295 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:13:58.295 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:13:58.295 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:13:58.295 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:13:58.295 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:58.295 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:13:58.295 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:13:58.295 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:13:58.295 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:13:58.295 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:13:58.295 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:13:58.295 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:13:58.295 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:13:58.295 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:13:58.296 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:13:58.296 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:13:58.296 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:13:58.296 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:13:58.296 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:13:58.296 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:13:58.296 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:13:58.296 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:13:58.296 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:13:58.296 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:13:58.296 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:13:58.296 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:13:58.296 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:13:58.296 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:13:58.296 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:13:58.297 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:13:58.297 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:13:58.297 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:13:58.297 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:13:58.297 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:13:58.297 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:13:58.297 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:13:58.297 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:13:58.297 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:58.297 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:13:58.297 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:58.297 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:13:58.297 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:13:58.297 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:13:58.297 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:13:58.298 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:58.298 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:13:58.298 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:13:58.298 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:13:58.298 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:58.298 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:13:58.298 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:58.298 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:13:58.298 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:13:58.298 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:13:58.298 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:13:58.298 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:13:58.298 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:13:58.298 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:58.298 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:58.299 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:13:58.299 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:13:58.299 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:13:58.299 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:13:58.299 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:58.299 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:13:58.299 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:13:58.299 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:13:58.299 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:58.299 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:13:58.299 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:58.299 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:13:58.299 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:13:58.299 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:13:58.299 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:13:58.299 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:13:58.300 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:13:58.300 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:58.300 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:58.300 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:13:58.300 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:13:58.300 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:13:58.300 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:13:58.300 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:58.300 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:13:58.300 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:13:58.300 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:13:58.300 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:58.300 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:13:58.300 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:58.300 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:13:58.301 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:13:58.301 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:13:58.301 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:13:58.301 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:13:58.301 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:13:58.301 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:58.301 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:13:58.301 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:58.301 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:13:58.301 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:13:58.301 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:58.301 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:13:58.301 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:13:58.301 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:13:58.301 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:58.301 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:13:58.302 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:13:58.302 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:58.302 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:13:58.302 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:13:58.302 INFO:teuthology.orchestra.run.trial110.stdout: "num": 4 2026-02-13T20:13:58.302 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:58.302 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:13:58.302 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:13:58.302 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:58.302 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:13:58.302 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:13:58.302 INFO:teuthology.orchestra.run.trial110.stdout: "num": 6 2026-02-13T20:13:58.302 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:58.302 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:13:58.302 INFO:teuthology.orchestra.run.trial110.stdout: "mgr": [ 2026-02-13T20:13:58.302 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:13:58.302 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:13:58.303 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:13:58.303 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:13:58.303 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:13:58.303 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:13:58.303 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:13:58.303 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:13:58.303 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:13:58.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.272+0000 7fba464cc640 1 -- 10.20.193.110:0/1168444119 >> v1:10.20.193.188:6812/1623052694 conn(0x7fba1003f630 legacy=0x7fba1005fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:58.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.272+0000 7fba464cc640 10 monclient: shutdown 2026-02-13T20:13:58.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.272+0000 7fba464cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:13:58.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.272+0000 7fba464cc640 1 -- 10.20.193.110:0/1168444119 >> v1:10.20.193.110:6789/0 conn(0x7fba40091950 legacy=0x7fba40088e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:13:58.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.272+0000 7fba44a42640 1 -- 10.20.193.110:0/1168444119 reap_dead start 2026-02-13T20:13:58.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.272+0000 7fba44a42640 1 -- 10.20.193.110:0/1168444119 reap_dead start 2026-02-13T20:13:58.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.272+0000 7fba464cc640 1 -- 10.20.193.110:0/1168444119 shutdown_connections 2026-02-13T20:13:58.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.272+0000 7fba464cc640 1 -- 10.20.193.110:0/1168444119 >> 10.20.193.110:0/1168444119 conn(0x7fba40054e90 msgr2=0x7fba4008d390 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:13:58.305 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.272+0000 7fba464cc640 1 -- 10.20.193.110:0/1168444119 shutdown_connections 2026-02-13T20:13:58.305 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:13:58.272+0000 7fba464cc640 1 -- 10.20.193.110:0/1168444119 wait complete. 2026-02-13T20:13:58.305 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-13T20:13:58.305 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-13T20:13:58.982 INFO:tasks.rados.rados.0.trial188.stdout:480: done (1 left) 2026-02-13T20:13:58.982 INFO:tasks.rados.rados.0.trial188.stdout:481: done (0 left) 2026-02-13T20:13:58.982 INFO:tasks.rados.rados.0.trial188.stdout:482: read oid 28 snap -1 2026-02-13T20:13:58.982 INFO:tasks.rados.rados.0.trial188.stdout:482: expect deleted 2026-02-13T20:13:58.982 INFO:tasks.rados.rados.0.trial188.stdout:483: write oid 24 current snap is 51 2026-02-13T20:13:58.982 INFO:tasks.rados.rados.0.trial188.stdout:483: seq_num 199 ranges {544593=799729,1761799=776065,2948352=396241} 2026-02-13T20:13:58.987 INFO:tasks.rados.rados.0.trial188.stdout:483: writing trial18843701-24 from 544593 to 1344322 tid 1 2026-02-13T20:13:58.991 INFO:tasks.rados.rados.0.trial188.stdout:483: writing trial18843701-24 from 1761799 to 2537864 tid 2 2026-02-13T20:13:58.995 INFO:tasks.rados.rados.0.trial188.stdout:483: writing trial18843701-24 from 2948352 to 3344593 tid 3 2026-02-13T20:13:58.995 INFO:tasks.rados.rados.0.trial188.stdout:484: snap_create 2026-02-13T20:13:59.016 INFO:tasks.rados.rados.0.trial188.stdout:483: finishing write tid 1 to trial18843701-24 2026-02-13T20:13:59.016 INFO:tasks.rados.rados.0.trial188.stdout:483: finishing write tid 2 to trial18843701-24 2026-02-13T20:13:59.016 INFO:tasks.rados.rados.0.trial188.stdout:483: finishing write tid 3 to trial18843701-24 2026-02-13T20:13:59.016 INFO:tasks.rados.rados.0.trial188.stdout:483: finishing write tid 4 to trial18843701-24 2026-02-13T20:13:59.016 INFO:tasks.rados.rados.0.trial188.stdout:483: finishing write tid 5 to trial18843701-24 2026-02-13T20:13:59.016 INFO:tasks.rados.rados.0.trial188.stdout:483: oid 24 updating version 0 to 175 2026-02-13T20:13:59.016 INFO:tasks.rados.rados.0.trial188.stdout:483: oid 24 updating version 175 to 176 2026-02-13T20:13:59.016 INFO:tasks.rados.rados.0.trial188.stdout:483: oid 24 updating version 176 to 177 2026-02-13T20:13:59.017 INFO:tasks.rados.rados.0.trial188.stdout:483: oid 24 updating version 177 to 178 2026-02-13T20:13:59.017 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 24 v 178 (ObjNum 199 snap 51 seq_num 199) dirty exists 2026-02-13T20:13:59.017 INFO:tasks.rados.rados.0.trial188.stdout:483: left oid 24 (ObjNum 199 snap 51 seq_num 199) 2026-02-13T20:13:59.988 INFO:tasks.rados.rados.0.trial188.stdout:482: done (2 left) 2026-02-13T20:13:59.988 INFO:tasks.rados.rados.0.trial188.stdout:483: done (1 left) 2026-02-13T20:13:59.988 INFO:tasks.rados.rados.0.trial188.stdout:484: done (0 left) 2026-02-13T20:13:59.988 INFO:tasks.rados.rados.0.trial188.stdout:485: write (excl) oid 40 current snap is 52 2026-02-13T20:13:59.988 INFO:tasks.rados.rados.0.trial188.stdout:485: seq_num 200 ranges {561400=474978,1820281=519723,2859422=457579} 2026-02-13T20:13:59.991 INFO:tasks.rados.rados.0.trial188.stdout:485: writing trial18843701-40 from 561400 to 1036378 tid 1 2026-02-13T20:13:59.996 INFO:tasks.rados.rados.0.trial188.stdout:485: writing trial18843701-40 from 1820281 to 2340004 tid 2 2026-02-13T20:14:00.000 INFO:tasks.rados.rados.0.trial188.stdout:485: writing trial18843701-40 from 2859422 to 3317001 tid 3 2026-02-13T20:14:00.000 INFO:tasks.rados.rados.0.trial188.stdout:486: copy_from oid 23 from oid 14 current snap is 52 2026-02-13T20:14:00.000 INFO:tasks.rados.rados.0.trial188.stdout:487: write (excl) oid 42 current snap is 52 2026-02-13T20:14:00.000 INFO:tasks.rados.rados.0.trial188.stdout:487: seq_num 201 ranges {578207=550227,1762410=779734,3286845=91362} 2026-02-13T20:14:00.004 INFO:tasks.rados.rados.0.trial188.stdout:487: writing trial18843701-42 from 578207 to 1128434 tid 1 2026-02-13T20:14:00.009 INFO:tasks.rados.rados.0.trial188.stdout:487: writing trial18843701-42 from 1762410 to 2542144 tid 2 2026-02-13T20:14:00.012 INFO:tasks.rados.rados.0.trial188.stdout:487: writing trial18843701-42 from 3286845 to 3378207 tid 3 2026-02-13T20:14:00.012 INFO:tasks.rados.rados.0.trial188.stdout:488: write (excl) oid 38 current snap is 52 2026-02-13T20:14:00.012 INFO:tasks.rados.rados.0.trial188.stdout:488: seq_num 202 ranges {595014=625476,1820892=523392,2797915=596476} 2026-02-13T20:14:00.017 INFO:tasks.rados.rados.0.trial188.stdout:488: writing trial18843701-38 from 595014 to 1220490 tid 1 2026-02-13T20:14:00.021 INFO:tasks.rados.rados.0.trial188.stdout:488: writing trial18843701-38 from 1820892 to 2344284 tid 2 2026-02-13T20:14:00.025 INFO:tasks.rados.rados.0.trial188.stdout:488: writing trial18843701-38 from 2797915 to 3394391 tid 3 2026-02-13T20:14:00.025 INFO:tasks.rados.rados.0.trial188.stdout:489: snap_create 2026-02-13T20:14:00.025 INFO:tasks.rados.rados.0.trial188.stdout:486: finishing copy_from to trial18843701-23 2026-02-13T20:14:00.026 INFO:tasks.rados.rados.0.trial188.stdout:486: got expected ENOENT (src dne) 2026-02-13T20:14:00.026 INFO:tasks.rados.rados.0.trial188.stdout:486: finishing copy_from racing read to trial18843701-23 2026-02-13T20:14:00.026 INFO:tasks.rados.rados.0.trial188.stdout:485: finishing write tid 1 to trial18843701-40 2026-02-13T20:14:00.026 INFO:tasks.rados.rados.0.trial188.stdout:485: finishing write tid 2 to trial18843701-40 2026-02-13T20:14:00.026 INFO:tasks.rados.rados.0.trial188.stdout:485: finishing write tid 3 to trial18843701-40 2026-02-13T20:14:00.026 INFO:tasks.rados.rados.0.trial188.stdout:485: finishing write tid 4 to trial18843701-40 2026-02-13T20:14:00.026 INFO:tasks.rados.rados.0.trial188.stdout:485: finishing write tid 5 to trial18843701-40 2026-02-13T20:14:00.026 INFO:tasks.rados.rados.0.trial188.stdout:485: oid 40 updating version 0 to 114 2026-02-13T20:14:00.026 INFO:tasks.rados.rados.0.trial188.stdout:485: oid 40 version 114 is already newer than 113 2026-02-13T20:14:00.026 INFO:tasks.rados.rados.0.trial188.stdout:485: oid 40 updating version 114 to 115 2026-02-13T20:14:00.026 INFO:tasks.rados.rados.0.trial188.stdout:485: oid 40 version 115 is already newer than 112 2026-02-13T20:14:00.026 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 40 v 115 (ObjNum 200 snap 52 seq_num 200) dirty exists 2026-02-13T20:14:00.027 INFO:tasks.rados.rados.0.trial188.stdout:485: left oid 40 (ObjNum 200 snap 52 seq_num 200) 2026-02-13T20:14:00.028 INFO:tasks.rados.rados.0.trial188.stdout:487: finishing write tid 1 to trial18843701-42 2026-02-13T20:14:00.028 INFO:tasks.rados.rados.0.trial188.stdout:487: finishing write tid 2 to trial18843701-42 2026-02-13T20:14:00.037 INFO:tasks.rados.rados.0.trial188.stdout:487: finishing write tid 3 to trial18843701-42 2026-02-13T20:14:00.037 INFO:tasks.rados.rados.0.trial188.stdout:487: finishing write tid 4 to trial18843701-42 2026-02-13T20:14:00.037 INFO:tasks.rados.rados.0.trial188.stdout:487: finishing write tid 5 to trial18843701-42 2026-02-13T20:14:00.037 INFO:tasks.rados.rados.0.trial188.stdout:487: oid 42 updating version 0 to 106 2026-02-13T20:14:00.037 INFO:tasks.rados.rados.0.trial188.stdout:487: oid 42 updating version 106 to 107 2026-02-13T20:14:00.037 INFO:tasks.rados.rados.0.trial188.stdout:487: oid 42 updating version 107 to 108 2026-02-13T20:14:00.037 INFO:tasks.rados.rados.0.trial188.stdout:487: oid 42 version 108 is already newer than 105 2026-02-13T20:14:00.037 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 42 v 108 (ObjNum 201 snap 52 seq_num 201) dirty exists 2026-02-13T20:14:00.037 INFO:tasks.rados.rados.0.trial188.stdout:487: left oid 42 (ObjNum 201 snap 52 seq_num 201) 2026-02-13T20:14:00.051 INFO:tasks.rados.rados.0.trial188.stdout:488: finishing write tid 1 to trial18843701-38 2026-02-13T20:14:00.052 INFO:tasks.rados.rados.0.trial188.stdout:488: finishing write tid 2 to trial18843701-38 2026-02-13T20:14:00.052 INFO:tasks.rados.rados.0.trial188.stdout:488: finishing write tid 3 to trial18843701-38 2026-02-13T20:14:00.052 INFO:tasks.rados.rados.0.trial188.stdout:488: finishing write tid 4 to trial18843701-38 2026-02-13T20:14:00.052 INFO:tasks.rados.rados.0.trial188.stdout:488: finishing write tid 5 to trial18843701-38 2026-02-13T20:14:00.052 INFO:tasks.rados.rados.0.trial188.stdout:488: oid 38 updating version 0 to 178 2026-02-13T20:14:00.052 INFO:tasks.rados.rados.0.trial188.stdout:488: oid 38 version 178 is already newer than 176 2026-02-13T20:14:00.052 INFO:tasks.rados.rados.0.trial188.stdout:488: oid 38 version 178 is already newer than 177 2026-02-13T20:14:00.052 INFO:tasks.rados.rados.0.trial188.stdout:488: oid 38 updating version 178 to 179 2026-02-13T20:14:00.052 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 38 v 179 (ObjNum 202 snap 52 seq_num 202) dirty exists 2026-02-13T20:14:00.052 INFO:tasks.rados.rados.0.trial188.stdout:488: left oid 38 (ObjNum 202 snap 52 seq_num 202) 2026-02-13T20:14:00.992 INFO:tasks.rados.rados.0.trial188.stdout:485: done (4 left) 2026-02-13T20:14:00.992 INFO:tasks.rados.rados.0.trial188.stdout:486: done (3 left) 2026-02-13T20:14:00.992 INFO:tasks.rados.rados.0.trial188.stdout:487: done (2 left) 2026-02-13T20:14:00.992 INFO:tasks.rados.rados.0.trial188.stdout:488: done (1 left) 2026-02-13T20:14:00.992 INFO:tasks.rados.rados.0.trial188.stdout:489: done (0 left) 2026-02-13T20:14:00.992 INFO:tasks.rados.rados.0.trial188.stdout:490: rollback oid 18 current snap is 53 2026-02-13T20:14:00.992 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 18 to 39 2026-02-13T20:14:00.992 INFO:tasks.rados.rados.0.trial188.stdout:491: read oid 14 snap 52 2026-02-13T20:14:00.992 INFO:tasks.rados.rados.0.trial188.stdout:491: expect deleted 2026-02-13T20:14:00.992 INFO:tasks.rados.rados.0.trial188.stdout:492: snap_create 2026-02-13T20:14:00.993 INFO:tasks.rados.rados.0.trial188.stdout:490: finishing rollback tid 1 to trial18843701-18 2026-02-13T20:14:00.993 INFO:tasks.rados.rados.0.trial188.stdout:490: finishing rollback tid 2 to trial18843701-18 2026-02-13T20:14:00.993 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 18 v 112 (ObjNum 139 snap 23 seq_num 139) dirty exists 2026-02-13T20:14:01.991 INFO:tasks.rados.rados.0.trial188.stdout:490: done (2 left) 2026-02-13T20:14:01.992 INFO:tasks.rados.rados.0.trial188.stdout:491: done (1 left) 2026-02-13T20:14:01.992 INFO:tasks.rados.rados.0.trial188.stdout:492: done (0 left) 2026-02-13T20:14:01.992 INFO:tasks.rados.rados.0.trial188.stdout:493: write (excl) oid 18 current snap is 54 2026-02-13T20:14:01.992 INFO:tasks.rados.rados.0.trial188.stdout:493: seq_num 203 ranges {611821=700725,1879374=783403,3341691=70130} 2026-02-13T20:14:01.996 INFO:tasks.rados.rados.0.trial188.stdout:493: writing trial18843701-18 from 611821 to 1312546 tid 1 2026-02-13T20:14:02.001 INFO:tasks.rados.rados.0.trial188.stdout:493: writing trial18843701-18 from 1879374 to 2662777 tid 2 2026-02-13T20:14:02.004 INFO:tasks.rados.rados.0.trial188.stdout:493: writing trial18843701-18 from 3341691 to 3411821 tid 3 2026-02-13T20:14:02.004 INFO:tasks.rados.rados.0.trial188.stdout:494: snap_remove snap 51 2026-02-13T20:14:02.867 INFO:tasks.rados.rados.0.trial188.stdout:494: done (1 left) 2026-02-13T20:14:02.868 INFO:tasks.rados.rados.0.trial188.stdout:495: write (excl) oid 31 current snap is 54 2026-02-13T20:14:02.868 INFO:tasks.rados.rados.0.trial188.stdout:495: seq_num 204 ranges {628628=775974,1937856=527061,3252761=175867} 2026-02-13T20:14:02.873 INFO:tasks.rados.rados.0.trial188.stdout:495: writing trial18843701-31 from 628628 to 1404602 tid 1 2026-02-13T20:14:02.877 INFO:tasks.rados.rados.0.trial188.stdout:495: writing trial18843701-31 from 1937856 to 2464917 tid 2 2026-02-13T20:14:02.883 INFO:tasks.rados.rados.0.trial188.stdout:495: writing trial18843701-31 from 3252761 to 3428628 tid 3 2026-02-13T20:14:02.883 INFO:tasks.rados.rados.0.trial188.stdout:496: copy_from oid 14 from oid 34 current snap is 54 2026-02-13T20:14:02.883 INFO:tasks.rados.rados.0.trial188.stdout:493: finishing write tid 1 to trial18843701-18 2026-02-13T20:14:02.883 INFO:tasks.rados.rados.0.trial188.stdout:493: finishing write tid 2 to trial18843701-18 2026-02-13T20:14:02.883 INFO:tasks.rados.rados.0.trial188.stdout:493: finishing write tid 3 to trial18843701-18 2026-02-13T20:14:02.883 INFO:tasks.rados.rados.0.trial188.stdout:493: finishing write tid 4 to trial18843701-18 2026-02-13T20:14:02.883 INFO:tasks.rados.rados.0.trial188.stdout:493: finishing write tid 5 to trial18843701-18 2026-02-13T20:14:02.883 INFO:tasks.rados.rados.0.trial188.stdout:493: oid 18 updating version 0 to 115 2026-02-13T20:14:02.883 INFO:tasks.rados.rados.0.trial188.stdout:493: oid 18 version 115 is already newer than 114 2026-02-13T20:14:02.884 INFO:tasks.rados.rados.0.trial188.stdout:493: oid 18 updating version 115 to 116 2026-02-13T20:14:02.884 INFO:tasks.rados.rados.0.trial188.stdout:493: oid 18 updating version 116 to 117 2026-02-13T20:14:02.884 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 18 v 117 (ObjNum 203 snap 54 seq_num 203) dirty exists 2026-02-13T20:14:02.884 INFO:tasks.rados.rados.0.trial188.stdout:493: left oid 18 (ObjNum 203 snap 54 seq_num 203) 2026-02-13T20:14:02.884 INFO:tasks.rados.rados.0.trial188.stdout:493: done (2 left) 2026-02-13T20:14:02.884 INFO:tasks.rados.rados.0.trial188.stdout:497: read oid 28 snap -1 2026-02-13T20:14:02.884 INFO:tasks.rados.rados.0.trial188.stdout:497: expect deleted 2026-02-13T20:14:02.884 INFO:tasks.rados.rados.0.trial188.stdout:498: copy_from oid 32 from oid 6 current snap is 54 2026-02-13T20:14:02.884 INFO:tasks.rados.rados.0.trial188.stdout:499: read oid 48 snap -1 2026-02-13T20:14:02.884 INFO:tasks.rados.rados.0.trial188.stdout:499: expect deleted 2026-02-13T20:14:02.884 INFO:tasks.rados.rados.0.trial188.stdout:500: write (excl) oid 7 current snap is 54 2026-02-13T20:14:02.884 INFO:tasks.rados.rados.0.trial188.stdout:500: seq_num 205 ranges {645435=451223,1879985=787072,3280184=165251} 2026-02-13T20:14:02.885 INFO:tasks.rados.rados.0.trial188.stdout:500: writing trial18843701-7 from 645435 to 1096658 tid 1 2026-02-13T20:14:02.891 INFO:tasks.rados.rados.0.trial188.stdout:500: writing trial18843701-7 from 1879985 to 2667057 tid 2 2026-02-13T20:14:02.894 INFO:tasks.rados.rados.0.trial188.stdout:500: writing trial18843701-7 from 3280184 to 3445435 tid 3 2026-02-13T20:14:02.894 INFO:tasks.rados.rados.0.trial188.stdout:501: copy_from oid 3 from oid 25 current snap is 54 2026-02-13T20:14:02.895 INFO:tasks.rados.rados.0.trial188.stdout:498: finishing copy_from to trial18843701-32 2026-02-13T20:14:02.895 INFO:tasks.rados.rados.0.trial188.stdout:498: got expected ENOENT (src dne) 2026-02-13T20:14:02.895 INFO:tasks.rados.rados.0.trial188.stdout:498: finishing copy_from racing read to trial18843701-32 2026-02-13T20:14:02.895 INFO:tasks.rados.rados.0.trial188.stdout:497: done (6 left) 2026-02-13T20:14:02.895 INFO:tasks.rados.rados.0.trial188.stdout:498: done (5 left) 2026-02-13T20:14:02.895 INFO:tasks.rados.rados.0.trial188.stdout:499: done (4 left) 2026-02-13T20:14:02.895 INFO:tasks.rados.rados.0.trial188.stdout:502: write oid 46 current snap is 54 2026-02-13T20:14:02.895 INFO:tasks.rados.rados.0.trial188.stdout:502: seq_num 206 ranges {662242=642825,2054820=530730,3307607=154635} 2026-02-13T20:14:02.899 INFO:tasks.rados.rados.0.trial188.stdout:502: writing trial18843701-46 from 662242 to 1305067 tid 1 2026-02-13T20:14:02.904 INFO:tasks.rados.rados.0.trial188.stdout:502: writing trial18843701-46 from 2054820 to 2585550 tid 2 2026-02-13T20:14:02.907 INFO:tasks.rados.rados.0.trial188.stdout:502: writing trial18843701-46 from 3307607 to 3462242 tid 3 2026-02-13T20:14:02.907 INFO:tasks.rados.rados.0.trial188.stdout:503: read oid 49 snap -1 2026-02-13T20:14:02.907 INFO:tasks.rados.rados.0.trial188.stdout:503: expect (ObjNum 179 snap 41 seq_num 179) 2026-02-13T20:14:02.907 INFO:tasks.rados.rados.0.trial188.stdout:504: snap_remove snap 43 2026-02-13T20:14:03.870 INFO:tasks.rados.rados.0.trial188.stdout:504: done (6 left) 2026-02-13T20:14:03.871 INFO:tasks.rados.rados.0.trial188.stdout:505: read oid 6 snap -1 2026-02-13T20:14:03.871 INFO:tasks.rados.rados.0.trial188.stdout:505: expect deleted 2026-02-13T20:14:03.871 INFO:tasks.rados.rados.0.trial188.stdout:506: copy_from oid 35 from oid 33 current snap is 54 2026-02-13T20:14:03.871 INFO:tasks.rados.rados.0.trial188.stdout:503: expect (ObjNum 179 snap 41 seq_num 179) 2026-02-13T20:14:03.871 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:14:03.898 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2278126 2026-02-13T20:14:03.912 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1683371 2026-02-13T20:14:03.921 INFO:tasks.rados.rados.0.trial188.stdout:502: finishing write tid 1 to trial18843701-46 2026-02-13T20:14:03.921 INFO:tasks.rados.rados.0.trial188.stdout:502: finishing write tid 2 to trial18843701-46 2026-02-13T20:14:03.921 INFO:tasks.rados.rados.0.trial188.stdout:503: done (7 left) 2026-02-13T20:14:03.921 INFO:tasks.rados.rados.0.trial188.stdout:507: snap_create 2026-02-13T20:14:03.921 INFO:tasks.rados.rados.0.trial188.stdout:496: finishing copy_from racing read to trial18843701-14 2026-02-13T20:14:03.922 INFO:tasks.rados.rados.0.trial188.stdout:495: finishing write tid 1 to trial18843701-31 2026-02-13T20:14:03.922 INFO:tasks.rados.rados.0.trial188.stdout:502: finishing write tid 3 to trial18843701-46 2026-02-13T20:14:03.922 INFO:tasks.rados.rados.0.trial188.stdout:495: finishing write tid 2 to trial18843701-31 2026-02-13T20:14:03.922 INFO:tasks.rados.rados.0.trial188.stdout:495: finishing write tid 3 to trial18843701-31 2026-02-13T20:14:03.922 INFO:tasks.rados.rados.0.trial188.stdout:495: finishing write tid 4 to trial18843701-31 2026-02-13T20:14:03.922 INFO:tasks.rados.rados.0.trial188.stdout:500: finishing write tid 1 to trial18843701-7 2026-02-13T20:14:03.922 INFO:tasks.rados.rados.0.trial188.stdout:502: finishing write tid 4 to trial18843701-46 2026-02-13T20:14:03.922 INFO:tasks.rados.rados.0.trial188.stdout:502: finishing write tid 5 to trial18843701-46 2026-02-13T20:14:03.922 INFO:tasks.rados.rados.0.trial188.stdout:502: oid 46 updating version 0 to 120 2026-02-13T20:14:03.922 INFO:tasks.rados.rados.0.trial188.stdout:502: oid 46 updating version 120 to 121 2026-02-13T20:14:03.922 INFO:tasks.rados.rados.0.trial188.stdout:502: oid 46 updating version 121 to 122 2026-02-13T20:14:03.922 INFO:tasks.rados.rados.0.trial188.stdout:502: oid 46 version 122 is already newer than 119 2026-02-13T20:14:03.922 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 46 v 122 (ObjNum 206 snap 54 seq_num 206) dirty exists 2026-02-13T20:14:03.922 INFO:tasks.rados.rados.0.trial188.stdout:502: left oid 46 (ObjNum 206 snap 54 seq_num 206) 2026-02-13T20:14:03.922 INFO:tasks.rados.rados.0.trial188.stdout:495: finishing write tid 5 to trial18843701-31 2026-02-13T20:14:03.922 INFO:tasks.rados.rados.0.trial188.stdout:495: oid 31 updating version 0 to 31 2026-02-13T20:14:03.922 INFO:tasks.rados.rados.0.trial188.stdout:495: oid 31 updating version 31 to 32 2026-02-13T20:14:03.922 INFO:tasks.rados.rados.0.trial188.stdout:495: oid 31 updating version 32 to 33 2026-02-13T20:14:03.922 INFO:tasks.rados.rados.0.trial188.stdout:495: oid 31 version 33 is already newer than 30 2026-02-13T20:14:03.922 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 31 v 33 (ObjNum 204 snap 54 seq_num 204) dirty exists 2026-02-13T20:14:03.922 INFO:tasks.rados.rados.0.trial188.stdout:495: left oid 31 (ObjNum 204 snap 54 seq_num 204) 2026-02-13T20:14:03.923 INFO:tasks.rados.rados.0.trial188.stdout:500: finishing write tid 2 to trial18843701-7 2026-02-13T20:14:03.923 INFO:tasks.rados.rados.0.trial188.stdout:496: finishing copy_from to trial18843701-14 2026-02-13T20:14:03.923 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 14 v 131 (ObjNum 196 snap 50 seq_num 196) dirty exists 2026-02-13T20:14:03.923 INFO:tasks.rados.rados.0.trial188.stdout:500: finishing write tid 3 to trial18843701-7 2026-02-13T20:14:03.923 INFO:tasks.rados.rados.0.trial188.stdout:500: finishing write tid 4 to trial18843701-7 2026-02-13T20:14:03.923 INFO:tasks.rados.rados.0.trial188.stdout:500: finishing write tid 5 to trial18843701-7 2026-02-13T20:14:03.923 INFO:tasks.rados.rados.0.trial188.stdout:500: oid 7 updating version 0 to 147 2026-02-13T20:14:03.923 INFO:tasks.rados.rados.0.trial188.stdout:500: oid 7 updating version 147 to 148 2026-02-13T20:14:03.923 INFO:tasks.rados.rados.0.trial188.stdout:500: oid 7 updating version 148 to 149 2026-02-13T20:14:03.923 INFO:tasks.rados.rados.0.trial188.stdout:500: oid 7 updating version 149 to 150 2026-02-13T20:14:03.923 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 7 v 150 (ObjNum 205 snap 54 seq_num 205) dirty exists 2026-02-13T20:14:03.923 INFO:tasks.rados.rados.0.trial188.stdout:500: left oid 7 (ObjNum 205 snap 54 seq_num 205) 2026-02-13T20:14:03.923 INFO:tasks.rados.rados.0.trial188.stdout:501: finishing copy_from racing read to trial18843701-3 2026-02-13T20:14:03.923 INFO:tasks.rados.rados.0.trial188.stdout:501: finishing copy_from to trial18843701-3 2026-02-13T20:14:03.923 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 3 v 139 (ObjNum 170 snap 35 seq_num 170) dirty exists 2026-02-13T20:14:03.923 INFO:tasks.rados.rados.0.trial188.stdout:506: finishing copy_from racing read to trial18843701-35 2026-02-13T20:14:03.923 INFO:tasks.rados.rados.0.trial188.stdout:506: finishing copy_from to trial18843701-35 2026-02-13T20:14:03.923 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 35 v 97 (ObjNum 187 snap 47 seq_num 187) dirty exists 2026-02-13T20:14:04.871 INFO:tasks.rados.rados.0.trial188.stdout:495: done (7 left) 2026-02-13T20:14:04.872 INFO:tasks.rados.rados.0.trial188.stdout:496: done (6 left) 2026-02-13T20:14:04.872 INFO:tasks.rados.rados.0.trial188.stdout:500: done (5 left) 2026-02-13T20:14:04.872 INFO:tasks.rados.rados.0.trial188.stdout:501: done (4 left) 2026-02-13T20:14:04.872 INFO:tasks.rados.rados.0.trial188.stdout:502: done (3 left) 2026-02-13T20:14:04.872 INFO:tasks.rados.rados.0.trial188.stdout:505: done (2 left) 2026-02-13T20:14:04.872 INFO:tasks.rados.rados.0.trial188.stdout:506: done (1 left) 2026-02-13T20:14:04.872 INFO:tasks.rados.rados.0.trial188.stdout:507: done (0 left) 2026-02-13T20:14:04.872 INFO:tasks.rados.rados.0.trial188.stdout:508: read oid 25 snap -1 2026-02-13T20:14:04.872 INFO:tasks.rados.rados.0.trial188.stdout:508: expect (ObjNum 170 snap 35 seq_num 170) 2026-02-13T20:14:04.872 INFO:tasks.rados.rados.0.trial188.stdout:509: write (excl) oid 19 current snap is 55 2026-02-13T20:14:04.873 INFO:tasks.rados.rados.0.trial188.stdout:509: seq_num 207 ranges {679049=718074,2113302=674388,3335030=144019} 2026-02-13T20:14:04.877 INFO:tasks.rados.rados.0.trial188.stdout:509: writing trial18843701-19 from 679049 to 1397123 tid 1 2026-02-13T20:14:04.882 INFO:tasks.rados.rados.0.trial188.stdout:509: writing trial18843701-19 from 2113302 to 2787690 tid 2 2026-02-13T20:14:04.885 INFO:tasks.rados.rados.0.trial188.stdout:509: writing trial18843701-19 from 3335030 to 3479049 tid 3 2026-02-13T20:14:04.885 INFO:tasks.rados.rados.0.trial188.stdout:510: copy_from oid 29 from oid 23 current snap is 55 2026-02-13T20:14:04.885 INFO:tasks.rados.rados.0.trial188.stdout:508: expect (ObjNum 170 snap 35 seq_num 170) 2026-02-13T20:14:04.916 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:14:04.955 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:14:04.993 INFO:tasks.rados.rados.0.trial188.stdout:509: finishing write tid 1 to trial18843701-19 2026-02-13T20:14:04.994 INFO:tasks.rados.rados.0.trial188.stdout:509: finishing write tid 2 to trial18843701-19 2026-02-13T20:14:04.994 INFO:tasks.rados.rados.0.trial188.stdout:509: finishing write tid 3 to trial18843701-19 2026-02-13T20:14:04.994 INFO:tasks.rados.rados.0.trial188.stdout:509: finishing write tid 4 to trial18843701-19 2026-02-13T20:14:04.994 INFO:tasks.rados.rados.0.trial188.stdout:509: finishing write tid 5 to trial18843701-19 2026-02-13T20:14:04.994 INFO:tasks.rados.rados.0.trial188.stdout:509: oid 19 updating version 0 to 154 2026-02-13T20:14:04.994 INFO:tasks.rados.rados.0.trial188.stdout:509: oid 19 updating version 154 to 156 2026-02-13T20:14:04.994 INFO:tasks.rados.rados.0.trial188.stdout:509: oid 19 updating version 156 to 157 2026-02-13T20:14:04.994 INFO:tasks.rados.rados.0.trial188.stdout:509: oid 19 version 157 is already newer than 155 2026-02-13T20:14:04.994 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 19 v 157 (ObjNum 207 snap 55 seq_num 207) dirty exists 2026-02-13T20:14:04.995 INFO:tasks.rados.rados.0.trial188.stdout:509: left oid 19 (ObjNum 207 snap 55 seq_num 207) 2026-02-13T20:14:04.995 INFO:tasks.rados.rados.0.trial188.stdout:510: finishing copy_from racing read to trial18843701-29 2026-02-13T20:14:04.995 INFO:tasks.rados.rados.0.trial188.stdout:510: finishing copy_from to trial18843701-29 2026-02-13T20:14:04.995 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 29 v 126 (ObjNum 144 snap 27 seq_num 144) dirty exists 2026-02-13T20:14:04.995 INFO:tasks.rados.rados.0.trial188.stdout:508: done (2 left) 2026-02-13T20:14:04.995 INFO:tasks.rados.rados.0.trial188.stdout:509: done (1 left) 2026-02-13T20:14:04.995 INFO:tasks.rados.rados.0.trial188.stdout:510: done (0 left) 2026-02-13T20:14:04.995 INFO:tasks.rados.rados.0.trial188.stdout:511: read oid 28 snap -1 2026-02-13T20:14:04.995 INFO:tasks.rados.rados.0.trial188.stdout:511: expect deleted 2026-02-13T20:14:04.995 INFO:tasks.rados.rados.0.trial188.stdout:512: snap_create 2026-02-13T20:14:05.874 INFO:tasks.rados.rados.0.trial188.stdout:511: done (1 left) 2026-02-13T20:14:05.874 INFO:tasks.rados.rados.0.trial188.stdout:512: done (0 left) 2026-02-13T20:14:05.874 INFO:tasks.rados.rados.0.trial188.stdout:513: read oid 50 snap -1 2026-02-13T20:14:05.874 INFO:tasks.rados.rados.0.trial188.stdout:513: expect (ObjNum 181 snap 43 seq_num 181) 2026-02-13T20:14:05.874 INFO:tasks.rados.rados.0.trial188.stdout:514: snap_remove snap 35 2026-02-13T20:14:06.875 INFO:tasks.rados.rados.0.trial188.stdout:514: done (1 left) 2026-02-13T20:14:06.875 INFO:tasks.rados.rados.0.trial188.stdout:515: read oid 15 snap 50 2026-02-13T20:14:06.875 INFO:tasks.rados.rados.0.trial188.stdout:515: expect (ObjNum 193 snap 47 seq_num 193) 2026-02-13T20:14:06.875 INFO:tasks.rados.rados.0.trial188.stdout:516: read oid 28 snap -1 2026-02-13T20:14:06.875 INFO:tasks.rados.rados.0.trial188.stdout:516: expect deleted 2026-02-13T20:14:06.875 INFO:tasks.rados.rados.0.trial188.stdout:517: delete oid 17 current snap is 56 2026-02-13T20:14:06.876 INFO:tasks.rados.rados.0.trial188.stdout:513: expect (ObjNum 181 snap 43 seq_num 181) 2026-02-13T20:14:06.883 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2108751 2026-02-13T20:14:06.893 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 849631 2026-02-13T20:14:06.931 INFO:tasks.rados.rados.0.trial188.stdout:513: done (3 left) 2026-02-13T20:14:06.931 INFO:tasks.rados.rados.0.trial188.stdout:517: done (2 left) 2026-02-13T20:14:06.932 INFO:tasks.rados.rados.0.trial188.stdout:518: read oid 24 snap 52 2026-02-13T20:14:06.932 INFO:tasks.rados.rados.0.trial188.stdout:518: expect (ObjNum 199 snap 51 seq_num 199) 2026-02-13T20:14:06.932 INFO:tasks.rados.rados.0.trial188.stdout:519: snap_remove snap 53 2026-02-13T20:14:06.932 INFO:tasks.rados.rados.0.trial188.stdout:515: expect (ObjNum 193 snap 47 seq_num 193) 2026-02-13T20:14:06.991 INFO:tasks.rados.rados.0.trial188.stdout:518: expect (ObjNum 199 snap 51 seq_num 199) 2026-02-13T20:14:07.078 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2643407 2026-02-13T20:14:07.868 INFO:tasks.rados.rados.0.trial188.stdout:515: done (3 left) 2026-02-13T20:14:07.868 INFO:tasks.rados.rados.0.trial188.stdout:516: done (2 left) 2026-02-13T20:14:07.868 INFO:tasks.rados.rados.0.trial188.stdout:518: done (1 left) 2026-02-13T20:14:07.868 INFO:tasks.rados.rados.0.trial188.stdout:519: done (0 left) 2026-02-13T20:14:07.868 INFO:tasks.rados.rados.0.trial188.stdout:520: rollback oid 14 current snap is 56 2026-02-13T20:14:07.868 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 14 to 32 2026-02-13T20:14:07.868 INFO:tasks.rados.rados.0.trial188.stdout:521: rollback oid 39 current snap is 56 2026-02-13T20:14:07.868 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 39 to 54 2026-02-13T20:14:07.868 INFO:tasks.rados.rados.0.trial188.stdout:522: rollback oid 50 current snap is 56 2026-02-13T20:14:07.868 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 50 to 32 2026-02-13T20:14:07.868 INFO:tasks.rados.rados.0.trial188.stdout:523: read oid 6 snap -1 2026-02-13T20:14:07.868 INFO:tasks.rados.rados.0.trial188.stdout:523: expect deleted 2026-02-13T20:14:07.868 INFO:tasks.rados.rados.0.trial188.stdout:524: read oid 29 snap -1 2026-02-13T20:14:07.868 INFO:tasks.rados.rados.0.trial188.stdout:524: expect (ObjNum 144 snap 27 seq_num 144) 2026-02-13T20:14:07.868 INFO:tasks.rados.rados.0.trial188.stdout:525: write oid 28 current snap is 56 2026-02-13T20:14:07.868 INFO:tasks.rados.rados.0.trial188.stdout:525: seq_num 209 ranges {712663=468572,1713913=678057,2873523=591733} 2026-02-13T20:14:07.872 INFO:tasks.rados.rados.0.trial188.stdout:525: writing trial18843701-28 from 712663 to 1181235 tid 1 2026-02-13T20:14:07.877 INFO:tasks.rados.rados.0.trial188.stdout:525: writing trial18843701-28 from 1713913 to 2391970 tid 2 2026-02-13T20:14:07.881 INFO:tasks.rados.rados.0.trial188.stdout:525: writing trial18843701-28 from 2873523 to 3465256 tid 3 2026-02-13T20:14:07.881 INFO:tasks.rados.rados.0.trial188.stdout:526: write (excl) oid 19 current snap is 56 2026-02-13T20:14:07.881 INFO:tasks.rados.rados.0.trial188.stdout:526: seq_num 210 ranges {729470=543821,1772395=538068,2900946=403005} 2026-02-13T20:14:07.886 INFO:tasks.rados.rados.0.trial188.stdout:526: writing trial18843701-19 from 729470 to 1273291 tid 1 2026-02-13T20:14:07.889 INFO:tasks.rados.rados.0.trial188.stdout:526: writing trial18843701-19 from 1772395 to 2310463 tid 2 2026-02-13T20:14:07.894 INFO:tasks.rados.rados.0.trial188.stdout:526: writing trial18843701-19 from 2900946 to 3303951 tid 3 2026-02-13T20:14:07.894 INFO:tasks.rados.rados.0.trial188.stdout:527: rollback oid 25 current snap is 56 2026-02-13T20:14:07.894 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 25 to 49 2026-02-13T20:14:07.894 INFO:tasks.rados.rados.0.trial188.stdout:520: finishing rollback tid 0 to trial18843701-14 2026-02-13T20:14:07.894 INFO:tasks.rados.rados.0.trial188.stdout:520: finishing rollback tid 1 to trial18843701-14 2026-02-13T20:14:07.894 INFO:tasks.rados.rados.0.trial188.stdout:520: finishing rollback tid 2 to trial18843701-14 2026-02-13T20:14:07.894 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 14 v 201 (ObjNum 144 snap 27 seq_num 144) dirty exists 2026-02-13T20:14:07.895 INFO:tasks.rados.rados.0.trial188.stdout:522: finishing rollback tid 0 to trial18843701-50 2026-02-13T20:14:07.895 INFO:tasks.rados.rados.0.trial188.stdout:521: finishing rollback tid 0 to trial18843701-39 2026-02-13T20:14:07.895 INFO:tasks.rados.rados.0.trial188.stdout:522: finishing rollback tid 1 to trial18843701-50 2026-02-13T20:14:07.895 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 50 v 185 (ObjNum 129 snap 0 seq_num 12600240) dirty dne 2026-02-13T20:14:07.895 INFO:tasks.rados.rados.0.trial188.stdout:521: finishing rollback tid 1 to trial18843701-39 2026-02-13T20:14:07.895 INFO:tasks.rados.rados.0.trial188.stdout:524: expect (ObjNum 144 snap 27 seq_num 144) 2026-02-13T20:14:07.895 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:14:07.976 INFO:tasks.rados.rados.0.trial188.stdout:521: finishing rollback tid 2 to trial18843701-39 2026-02-13T20:14:07.977 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 39 v 169 (ObjNum 194 snap 49 seq_num 194) dirty exists 2026-02-13T20:14:07.977 INFO:tasks.rados.rados.0.trial188.stdout:525: finishing write tid 1 to trial18843701-28 2026-02-13T20:14:07.977 INFO:tasks.rados.rados.0.trial188.stdout:525: finishing write tid 2 to trial18843701-28 2026-02-13T20:14:07.977 INFO:tasks.rados.rados.0.trial188.stdout:527: finishing rollback tid 0 to trial18843701-25 2026-02-13T20:14:07.977 INFO:tasks.rados.rados.0.trial188.stdout:527: finishing rollback tid 1 to trial18843701-25 2026-02-13T20:14:07.977 INFO:tasks.rados.rados.0.trial188.stdout:527: finishing rollback tid 2 to trial18843701-25 2026-02-13T20:14:07.977 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 25 v 185 (ObjNum 170 snap 35 seq_num 170) dirty exists 2026-02-13T20:14:07.978 INFO:tasks.rados.rados.0.trial188.stdout:525: finishing write tid 3 to trial18843701-28 2026-02-13T20:14:07.978 INFO:tasks.rados.rados.0.trial188.stdout:525: finishing write tid 4 to trial18843701-28 2026-02-13T20:14:07.978 INFO:tasks.rados.rados.0.trial188.stdout:520: done (7 left) 2026-02-13T20:14:07.978 INFO:tasks.rados.rados.0.trial188.stdout:521: done (6 left) 2026-02-13T20:14:07.978 INFO:tasks.rados.rados.0.trial188.stdout:522: done (5 left) 2026-02-13T20:14:07.978 INFO:tasks.rados.rados.0.trial188.stdout:523: done (4 left) 2026-02-13T20:14:07.979 INFO:tasks.rados.rados.0.trial188.stdout:524: done (3 left) 2026-02-13T20:14:07.979 INFO:tasks.rados.rados.0.trial188.stdout:527: done (2 left) 2026-02-13T20:14:07.979 INFO:tasks.rados.rados.0.trial188.stdout:528: snap_remove snap 32 2026-02-13T20:14:08.880 INFO:tasks.rados.rados.0.trial188.stdout:528: done (2 left) 2026-02-13T20:14:08.880 INFO:tasks.rados.rados.0.trial188.stdout:529: read oid 40 snap -1 2026-02-13T20:14:08.880 INFO:tasks.rados.rados.0.trial188.stdout:529: expect (ObjNum 200 snap 52 seq_num 200) 2026-02-13T20:14:08.880 INFO:tasks.rados.rados.0.trial188.stdout:530: rollback oid 16 current snap is 56 2026-02-13T20:14:08.880 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 16 to 55 2026-02-13T20:14:08.880 INFO:tasks.rados.rados.0.trial188.stdout:525: finishing write tid 5 to trial18843701-28 2026-02-13T20:14:08.880 INFO:tasks.rados.rados.0.trial188.stdout:525: oid 28 updating version 0 to 145 2026-02-13T20:14:08.880 INFO:tasks.rados.rados.0.trial188.stdout:525: oid 28 version 145 is already newer than 144 2026-02-13T20:14:08.880 INFO:tasks.rados.rados.0.trial188.stdout:525: oid 28 updating version 145 to 146 2026-02-13T20:14:08.880 INFO:tasks.rados.rados.0.trial188.stdout:525: oid 28 updating version 146 to 147 2026-02-13T20:14:08.881 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 28 v 147 (ObjNum 209 snap 56 seq_num 209) dirty exists 2026-02-13T20:14:08.881 INFO:tasks.rados.rados.0.trial188.stdout:525: left oid 28 (ObjNum 209 snap 56 seq_num 209) 2026-02-13T20:14:08.881 INFO:tasks.rados.rados.0.trial188.stdout:526: finishing write tid 1 to trial18843701-19 2026-02-13T20:14:08.881 INFO:tasks.rados.rados.0.trial188.stdout:526: finishing write tid 2 to trial18843701-19 2026-02-13T20:14:08.881 INFO:tasks.rados.rados.0.trial188.stdout:526: finishing write tid 3 to trial18843701-19 2026-02-13T20:14:08.881 INFO:tasks.rados.rados.0.trial188.stdout:526: finishing write tid 4 to trial18843701-19 2026-02-13T20:14:08.881 INFO:tasks.rados.rados.0.trial188.stdout:526: finishing write tid 5 to trial18843701-19 2026-02-13T20:14:08.881 INFO:tasks.rados.rados.0.trial188.stdout:526: oid 19 updating version 0 to 175 2026-02-13T20:14:08.881 INFO:tasks.rados.rados.0.trial188.stdout:526: oid 19 updating version 175 to 176 2026-02-13T20:14:08.881 INFO:tasks.rados.rados.0.trial188.stdout:526: oid 19 updating version 176 to 178 2026-02-13T20:14:08.881 INFO:tasks.rados.rados.0.trial188.stdout:526: oid 19 version 178 is already newer than 177 2026-02-13T20:14:08.881 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 19 v 178 (ObjNum 210 snap 56 seq_num 210) dirty exists 2026-02-13T20:14:08.881 INFO:tasks.rados.rados.0.trial188.stdout:526: left oid 19 (ObjNum 210 snap 56 seq_num 210) 2026-02-13T20:14:08.881 INFO:tasks.rados.rados.0.trial188.stdout:525: done (3 left) 2026-02-13T20:14:08.881 INFO:tasks.rados.rados.0.trial188.stdout:526: done (2 left) 2026-02-13T20:14:08.881 INFO:tasks.rados.rados.0.trial188.stdout:531: copy_from oid 38 from oid 33 current snap is 56 2026-02-13T20:14:08.881 INFO:tasks.rados.rados.0.trial188.stdout:532: delete oid 32 current snap is 56 2026-02-13T20:14:08.884 INFO:tasks.rados.rados.0.trial188.stdout:530: finishing rollback tid 0 to trial18843701-16 2026-02-13T20:14:08.884 INFO:tasks.rados.rados.0.trial188.stdout:530: finishing rollback tid 1 to trial18843701-16 2026-02-13T20:14:08.885 INFO:tasks.rados.rados.0.trial188.stdout:530: finishing rollback tid 2 to trial18843701-16 2026-02-13T20:14:08.885 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 16 v 189 (ObjNum 180 snap 41 seq_num 180) dirty exists 2026-02-13T20:14:08.887 INFO:tasks.rados.rados.0.trial188.stdout:529: expect (ObjNum 200 snap 52 seq_num 200) 2026-02-13T20:14:08.922 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:14:08.987 INFO:tasks.rados.rados.0.trial188.stdout:531: finishing copy_from racing read to trial18843701-38 2026-02-13T20:14:08.987 INFO:tasks.rados.rados.0.trial188.stdout:531: finishing copy_from to trial18843701-38 2026-02-13T20:14:08.987 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 38 v 97 (ObjNum 187 snap 47 seq_num 187) dirty exists 2026-02-13T20:14:08.988 INFO:tasks.rados.rados.0.trial188.stdout:529: done (3 left) 2026-02-13T20:14:08.988 INFO:tasks.rados.rados.0.trial188.stdout:530: done (2 left) 2026-02-13T20:14:08.988 INFO:tasks.rados.rados.0.trial188.stdout:531: done (1 left) 2026-02-13T20:14:08.988 INFO:tasks.rados.rados.0.trial188.stdout:532: done (0 left) 2026-02-13T20:14:08.988 INFO:tasks.rados.rados.0.trial188.stdout:533: read oid 49 snap -1 2026-02-13T20:14:08.988 INFO:tasks.rados.rados.0.trial188.stdout:533: expect (ObjNum 179 snap 41 seq_num 179) 2026-02-13T20:14:08.988 INFO:tasks.rados.rados.0.trial188.stdout:534: snap_create 2026-02-13T20:14:08.989 INFO:tasks.rados.rados.0.trial188.stdout:533: expect (ObjNum 179 snap 41 seq_num 179) 2026-02-13T20:14:09.883 INFO:tasks.rados.rados.0.trial188.stdout:533: done (1 left) 2026-02-13T20:14:09.883 INFO:tasks.rados.rados.0.trial188.stdout:534: done (0 left) 2026-02-13T20:14:09.883 INFO:tasks.rados.rados.0.trial188.stdout:535: read oid 25 snap 49 2026-02-13T20:14:09.883 INFO:tasks.rados.rados.0.trial188.stdout:535: expect (ObjNum 170 snap 35 seq_num 170) 2026-02-13T20:14:09.884 INFO:tasks.rados.rados.0.trial188.stdout:536: read oid 7 snap 52 2026-02-13T20:14:09.884 INFO:tasks.rados.rados.0.trial188.stdout:536: expect deleted 2026-02-13T20:14:09.884 INFO:tasks.rados.rados.0.trial188.stdout:537: delete oid 28 current snap is 57 2026-02-13T20:14:09.887 INFO:tasks.rados.rados.0.trial188.stdout:536: done (2 left) 2026-02-13T20:14:09.887 INFO:tasks.rados.rados.0.trial188.stdout:537: done (1 left) 2026-02-13T20:14:09.887 INFO:tasks.rados.rados.0.trial188.stdout:538: rollback oid 22 current snap is 57 2026-02-13T20:14:09.887 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 22 to 44 2026-02-13T20:14:09.887 INFO:tasks.rados.rados.0.trial188.stdout:539: write oid 26 current snap is 57 2026-02-13T20:14:09.888 INFO:tasks.rados.rados.0.trial188.stdout:539: seq_num 213 ranges {779891=485921,1947841=685395,3383215=196676} 2026-02-13T20:14:09.892 INFO:tasks.rados.rados.0.trial188.stdout:539: writing trial18843701-26 from 779891 to 1265812 tid 1 2026-02-13T20:14:09.897 INFO:tasks.rados.rados.0.trial188.stdout:539: writing trial18843701-26 from 1947841 to 2633236 tid 2 2026-02-13T20:14:09.901 INFO:tasks.rados.rados.0.trial188.stdout:539: writing trial18843701-26 from 3383215 to 3579891 tid 3 2026-02-13T20:14:09.901 INFO:tasks.rados.rados.0.trial188.stdout:540: snap_create 2026-02-13T20:14:09.901 INFO:tasks.rados.rados.0.trial188.stdout:535: expect (ObjNum 170 snap 35 seq_num 170) 2026-02-13T20:14:09.942 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 967404 2026-02-13T20:14:10.012 INFO:tasks.rados.rados.0.trial188.stdout:538: finishing rollback tid 0 to trial18843701-22 2026-02-13T20:14:10.012 INFO:tasks.rados.rados.0.trial188.stdout:538: finishing rollback tid 1 to trial18843701-22 2026-02-13T20:14:10.013 INFO:tasks.rados.rados.0.trial188.stdout:538: finishing rollback tid 2 to trial18843701-22 2026-02-13T20:14:10.013 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 22 v 65 (ObjNum 75 snap 7 seq_num 75) dirty exists 2026-02-13T20:14:10.013 INFO:tasks.rados.rados.0.trial188.stdout:539: finishing write tid 1 to trial18843701-26 2026-02-13T20:14:10.013 INFO:tasks.rados.rados.0.trial188.stdout:539: finishing write tid 2 to trial18843701-26 2026-02-13T20:14:10.013 INFO:tasks.rados.rados.0.trial188.stdout:539: finishing write tid 3 to trial18843701-26 2026-02-13T20:14:10.013 INFO:tasks.rados.rados.0.trial188.stdout:539: finishing write tid 4 to trial18843701-26 2026-02-13T20:14:10.013 INFO:tasks.rados.rados.0.trial188.stdout:539: finishing write tid 5 to trial18843701-26 2026-02-13T20:14:10.013 INFO:tasks.rados.rados.0.trial188.stdout:539: oid 26 updating version 0 to 212 2026-02-13T20:14:10.013 INFO:tasks.rados.rados.0.trial188.stdout:539: oid 26 version 212 is already newer than 210 2026-02-13T20:14:10.013 INFO:tasks.rados.rados.0.trial188.stdout:539: oid 26 version 212 is already newer than 211 2026-02-13T20:14:10.013 INFO:tasks.rados.rados.0.trial188.stdout:539: oid 26 updating version 212 to 213 2026-02-13T20:14:10.014 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 26 v 213 (ObjNum 213 snap 57 seq_num 213) dirty exists 2026-02-13T20:14:10.014 INFO:tasks.rados.rados.0.trial188.stdout:539: left oid 26 (ObjNum 213 snap 57 seq_num 213) 2026-02-13T20:14:10.887 INFO:tasks.rados.rados.0.trial188.stdout:535: done (3 left) 2026-02-13T20:14:10.887 INFO:tasks.rados.rados.0.trial188.stdout:538: done (2 left) 2026-02-13T20:14:10.888 INFO:tasks.rados.rados.0.trial188.stdout:539: done (1 left) 2026-02-13T20:14:10.888 INFO:tasks.rados.rados.0.trial188.stdout:540: done (0 left) 2026-02-13T20:14:10.888 INFO:tasks.rados.rados.0.trial188.stdout:541: write oid 45 current snap is 58 2026-02-13T20:14:10.888 INFO:tasks.rados.rados.0.trial188.stdout:541: seq_num 214 ranges {796698=561170,2006323=545406,3126991=469707} 2026-02-13T20:14:10.892 INFO:tasks.rados.rados.0.trial188.stdout:541: writing trial18843701-45 from 796698 to 1357868 tid 1 2026-02-13T20:14:10.897 INFO:tasks.rados.rados.0.trial188.stdout:541: writing trial18843701-45 from 2006323 to 2551729 tid 2 2026-02-13T20:14:10.901 INFO:tasks.rados.rados.0.trial188.stdout:541: writing trial18843701-45 from 3126991 to 3596698 tid 3 2026-02-13T20:14:10.901 INFO:tasks.rados.rados.0.trial188.stdout:542: snap_remove snap 44 2026-02-13T20:14:11.888 INFO:tasks.rados.rados.0.trial188.stdout:542: done (1 left) 2026-02-13T20:14:11.889 INFO:tasks.rados.rados.0.trial188.stdout:543: write (excl) oid 30 current snap is 58 2026-02-13T20:14:11.889 INFO:tasks.rados.rados.0.trial188.stdout:543: seq_num 215 ranges {413505=636419,1664805=689064,3038061=492071} 2026-02-13T20:14:11.893 INFO:tasks.rados.rados.0.trial188.stdout:543: writing trial18843701-30 from 413505 to 1049924 tid 1 2026-02-13T20:14:11.898 INFO:tasks.rados.rados.0.trial188.stdout:543: writing trial18843701-30 from 1664805 to 2353869 tid 2 2026-02-13T20:14:11.903 INFO:tasks.rados.rados.0.trial188.stdout:543: writing trial18843701-30 from 3038061 to 3530132 tid 3 2026-02-13T20:14:11.903 INFO:tasks.rados.rados.0.trial188.stdout:544: rollback oid 16 current snap is 58 2026-02-13T20:14:11.903 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 16 to 52 2026-02-13T20:14:11.904 INFO:tasks.rados.rados.0.trial188.stdout:541: finishing write tid 1 to trial18843701-45 2026-02-13T20:14:11.904 INFO:tasks.rados.rados.0.trial188.stdout:541: finishing write tid 2 to trial18843701-45 2026-02-13T20:14:11.904 INFO:tasks.rados.rados.0.trial188.stdout:541: finishing write tid 3 to trial18843701-45 2026-02-13T20:14:11.904 INFO:tasks.rados.rados.0.trial188.stdout:541: finishing write tid 4 to trial18843701-45 2026-02-13T20:14:11.904 INFO:tasks.rados.rados.0.trial188.stdout:541: finishing write tid 5 to trial18843701-45 2026-02-13T20:14:11.904 INFO:tasks.rados.rados.0.trial188.stdout:541: oid 45 updating version 0 to 155 2026-02-13T20:14:11.904 INFO:tasks.rados.rados.0.trial188.stdout:541: oid 45 version 155 is already newer than 154 2026-02-13T20:14:11.904 INFO:tasks.rados.rados.0.trial188.stdout:541: oid 45 updating version 155 to 157 2026-02-13T20:14:11.904 INFO:tasks.rados.rados.0.trial188.stdout:541: oid 45 version 157 is already newer than 156 2026-02-13T20:14:11.904 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 45 v 157 (ObjNum 214 snap 58 seq_num 214) dirty exists 2026-02-13T20:14:11.904 INFO:tasks.rados.rados.0.trial188.stdout:541: left oid 45 (ObjNum 214 snap 58 seq_num 214) 2026-02-13T20:14:11.904 INFO:tasks.rados.rados.0.trial188.stdout:541: done (2 left) 2026-02-13T20:14:11.904 INFO:tasks.rados.rados.0.trial188.stdout:545: write oid 37 current snap is 58 2026-02-13T20:14:11.904 INFO:tasks.rados.rados.0.trial188.stdout:545: seq_num 216 ranges {430312=711668,1723287=549075,2781837=703343} 2026-02-13T20:14:11.906 INFO:tasks.rados.rados.0.trial188.stdout:545: writing trial18843701-37 from 430312 to 1141980 tid 1 2026-02-13T20:14:11.911 INFO:tasks.rados.rados.0.trial188.stdout:545: writing trial18843701-37 from 1723287 to 2272362 tid 2 2026-02-13T20:14:11.916 INFO:tasks.rados.rados.0.trial188.stdout:545: writing trial18843701-37 from 2781837 to 3485180 tid 3 2026-02-13T20:14:11.916 INFO:tasks.rados.rados.0.trial188.stdout:546: rollback oid 32 current snap is 58 2026-02-13T20:14:11.916 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 32 to 56 2026-02-13T20:14:11.916 INFO:tasks.rados.rados.0.trial188.stdout:544: finishing rollback tid 0 to trial18843701-16 2026-02-13T20:14:11.916 INFO:tasks.rados.rados.0.trial188.stdout:544: finishing rollback tid 1 to trial18843701-16 2026-02-13T20:14:11.916 INFO:tasks.rados.rados.0.trial188.stdout:544: finishing rollback tid 2 to trial18843701-16 2026-02-13T20:14:11.916 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 16 v 203 (ObjNum 180 snap 41 seq_num 180) dirty exists 2026-02-13T20:14:11.916 INFO:tasks.rados.rados.0.trial188.stdout:544: done (3 left) 2026-02-13T20:14:11.916 INFO:tasks.rados.rados.0.trial188.stdout:547: write oid 10 current snap is 58 2026-02-13T20:14:11.916 INFO:tasks.rados.rados.0.trial188.stdout:547: seq_num 217 ranges {447119=786917,1665416=692733,2976554=514615} 2026-02-13T20:14:11.920 INFO:tasks.rados.rados.0.trial188.stdout:547: writing trial18843701-10 from 447119 to 1234036 tid 1 2026-02-13T20:14:11.925 INFO:tasks.rados.rados.0.trial188.stdout:547: writing trial18843701-10 from 1665416 to 2358149 tid 2 2026-02-13T20:14:11.929 INFO:tasks.rados.rados.0.trial188.stdout:547: writing trial18843701-10 from 2976554 to 3491169 tid 3 2026-02-13T20:14:11.929 INFO:tasks.rados.rados.0.trial188.stdout:548: write oid 31 current snap is 58 2026-02-13T20:14:11.929 INFO:tasks.rados.rados.0.trial188.stdout:548: seq_num 218 ranges {463926=462166,1723898=436391,2603977=725887} 2026-02-13T20:14:11.933 INFO:tasks.rados.rados.0.trial188.stdout:548: writing trial18843701-31 from 463926 to 926092 tid 1 2026-02-13T20:14:11.938 INFO:tasks.rados.rados.0.trial188.stdout:548: writing trial18843701-31 from 1723898 to 2160289 tid 2 2026-02-13T20:14:11.943 INFO:tasks.rados.rados.0.trial188.stdout:548: writing trial18843701-31 from 2603977 to 3329864 tid 3 2026-02-13T20:14:11.943 INFO:tasks.rados.rados.0.trial188.stdout:549: snap_create 2026-02-13T20:14:11.943 INFO:tasks.rados.rados.0.trial188.stdout:546: finishing rollback tid 1 to trial18843701-32 2026-02-13T20:14:11.943 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 32 v 138 (ObjNum 129 snap 0 seq_num 15123133) dirty dne 2026-02-13T20:14:11.943 INFO:tasks.rados.rados.0.trial188.stdout:543: finishing write tid 1 to trial18843701-30 2026-02-13T20:14:11.943 INFO:tasks.rados.rados.0.trial188.stdout:545: finishing write tid 1 to trial18843701-37 2026-02-13T20:14:11.944 INFO:tasks.rados.rados.0.trial188.stdout:543: finishing write tid 2 to trial18843701-30 2026-02-13T20:14:11.944 INFO:tasks.rados.rados.0.trial188.stdout:543: finishing write tid 3 to trial18843701-30 2026-02-13T20:14:11.944 INFO:tasks.rados.rados.0.trial188.stdout:543: finishing write tid 4 to trial18843701-30 2026-02-13T20:14:11.944 INFO:tasks.rados.rados.0.trial188.stdout:543: finishing write tid 5 to trial18843701-30 2026-02-13T20:14:11.944 INFO:tasks.rados.rados.0.trial188.stdout:543: oid 30 updating version 0 to 198 2026-02-13T20:14:11.944 INFO:tasks.rados.rados.0.trial188.stdout:543: oid 30 version 198 is already newer than 197 2026-02-13T20:14:11.944 INFO:tasks.rados.rados.0.trial188.stdout:543: oid 30 updating version 198 to 199 2026-02-13T20:14:11.944 INFO:tasks.rados.rados.0.trial188.stdout:543: oid 30 updating version 199 to 200 2026-02-13T20:14:11.944 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 30 v 200 (ObjNum 215 snap 58 seq_num 215) dirty exists 2026-02-13T20:14:11.944 INFO:tasks.rados.rados.0.trial188.stdout:543: left oid 30 (ObjNum 215 snap 58 seq_num 215) 2026-02-13T20:14:11.944 INFO:tasks.rados.rados.0.trial188.stdout:545: finishing write tid 2 to trial18843701-37 2026-02-13T20:14:11.944 INFO:tasks.rados.rados.0.trial188.stdout:545: finishing write tid 3 to trial18843701-37 2026-02-13T20:14:11.945 INFO:tasks.rados.rados.0.trial188.stdout:545: finishing write tid 4 to trial18843701-37 2026-02-13T20:14:11.945 INFO:tasks.rados.rados.0.trial188.stdout:545: finishing write tid 5 to trial18843701-37 2026-02-13T20:14:11.945 INFO:tasks.rados.rados.0.trial188.stdout:545: oid 37 updating version 0 to 161 2026-02-13T20:14:11.945 INFO:tasks.rados.rados.0.trial188.stdout:545: oid 37 version 161 is already newer than 160 2026-02-13T20:14:11.945 INFO:tasks.rados.rados.0.trial188.stdout:545: oid 37 updating version 161 to 163 2026-02-13T20:14:11.945 INFO:tasks.rados.rados.0.trial188.stdout:545: oid 37 version 163 is already newer than 162 2026-02-13T20:14:11.945 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 37 v 163 (ObjNum 216 snap 58 seq_num 216) dirty exists 2026-02-13T20:14:11.945 INFO:tasks.rados.rados.0.trial188.stdout:545: left oid 37 (ObjNum 216 snap 58 seq_num 216) 2026-02-13T20:14:11.950 INFO:tasks.rados.rados.0.trial188.stdout:547: finishing write tid 1 to trial18843701-10 2026-02-13T20:14:11.950 INFO:tasks.rados.rados.0.trial188.stdout:547: finishing write tid 2 to trial18843701-10 2026-02-13T20:14:11.957 INFO:tasks.rados.rados.0.trial188.stdout:547: finishing write tid 3 to trial18843701-10 2026-02-13T20:14:11.957 INFO:tasks.rados.rados.0.trial188.stdout:547: finishing write tid 4 to trial18843701-10 2026-02-13T20:14:11.957 INFO:tasks.rados.rados.0.trial188.stdout:547: finishing write tid 5 to trial18843701-10 2026-02-13T20:14:11.957 INFO:tasks.rados.rados.0.trial188.stdout:547: oid 10 updating version 0 to 152 2026-02-13T20:14:11.957 INFO:tasks.rados.rados.0.trial188.stdout:547: oid 10 version 152 is already newer than 151 2026-02-13T20:14:11.958 INFO:tasks.rados.rados.0.trial188.stdout:547: oid 10 updating version 152 to 153 2026-02-13T20:14:11.958 INFO:tasks.rados.rados.0.trial188.stdout:547: oid 10 version 153 is already newer than 150 2026-02-13T20:14:11.958 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 10 v 153 (ObjNum 217 snap 58 seq_num 217) dirty exists 2026-02-13T20:14:11.958 INFO:tasks.rados.rados.0.trial188.stdout:547: left oid 10 (ObjNum 217 snap 58 seq_num 217) 2026-02-13T20:14:11.973 INFO:tasks.rados.rados.0.trial188.stdout:548: finishing write tid 1 to trial18843701-31 2026-02-13T20:14:11.973 INFO:tasks.rados.rados.0.trial188.stdout:548: finishing write tid 2 to trial18843701-31 2026-02-13T20:14:11.973 INFO:tasks.rados.rados.0.trial188.stdout:548: finishing write tid 3 to trial18843701-31 2026-02-13T20:14:11.973 INFO:tasks.rados.rados.0.trial188.stdout:548: finishing write tid 4 to trial18843701-31 2026-02-13T20:14:11.973 INFO:tasks.rados.rados.0.trial188.stdout:548: finishing write tid 5 to trial18843701-31 2026-02-13T20:14:11.973 INFO:tasks.rados.rados.0.trial188.stdout:548: oid 31 updating version 0 to 47 2026-02-13T20:14:11.973 INFO:tasks.rados.rados.0.trial188.stdout:548: oid 31 version 47 is already newer than 45 2026-02-13T20:14:11.973 INFO:tasks.rados.rados.0.trial188.stdout:548: oid 31 version 47 is already newer than 46 2026-02-13T20:14:11.974 INFO:tasks.rados.rados.0.trial188.stdout:548: oid 31 updating version 47 to 48 2026-02-13T20:14:11.974 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 31 v 48 (ObjNum 218 snap 58 seq_num 218) dirty exists 2026-02-13T20:14:11.974 INFO:tasks.rados.rados.0.trial188.stdout:548: left oid 31 (ObjNum 218 snap 58 seq_num 218) 2026-02-13T20:14:12.870 INFO:tasks.rados.rados.0.trial188.stdout:543: done (5 left) 2026-02-13T20:14:12.870 INFO:tasks.rados.rados.0.trial188.stdout:545: done (4 left) 2026-02-13T20:14:12.870 INFO:tasks.rados.rados.0.trial188.stdout:546: done (3 left) 2026-02-13T20:14:12.870 INFO:tasks.rados.rados.0.trial188.stdout:547: done (2 left) 2026-02-13T20:14:12.870 INFO:tasks.rados.rados.0.trial188.stdout:548: done (1 left) 2026-02-13T20:14:12.870 INFO:tasks.rados.rados.0.trial188.stdout:549: done (0 left) 2026-02-13T20:14:12.870 INFO:tasks.rados.rados.0.trial188.stdout:550: read oid 44 snap -1 2026-02-13T20:14:12.871 INFO:tasks.rados.rados.0.trial188.stdout:550: expect (ObjNum 132 snap 23 seq_num 132) 2026-02-13T20:14:12.871 INFO:tasks.rados.rados.0.trial188.stdout:551: snap_create 2026-02-13T20:14:12.877 INFO:tasks.rados.rados.0.trial188.stdout:550: expect (ObjNum 132 snap 23 seq_num 132) 2026-02-13T20:14:12.897 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:14:12.918 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 476079 2026-02-13T20:14:13.869 INFO:tasks.rados.rados.0.trial188.stdout:550: done (1 left) 2026-02-13T20:14:13.869 INFO:tasks.rados.rados.0.trial188.stdout:551: done (0 left) 2026-02-13T20:14:13.869 INFO:tasks.rados.rados.0.trial188.stdout:552: snap_create 2026-02-13T20:14:14.870 INFO:tasks.rados.rados.0.trial188.stdout:552: done (0 left) 2026-02-13T20:14:14.870 INFO:tasks.rados.rados.0.trial188.stdout:553: copy_from oid 12 from oid 4 current snap is 61 2026-02-13T20:14:14.870 INFO:tasks.rados.rados.0.trial188.stdout:554: read oid 3 snap 49 2026-02-13T20:14:14.870 INFO:tasks.rados.rados.0.trial188.stdout:554: expect (ObjNum 186 snap 46 seq_num 186) 2026-02-13T20:14:14.870 INFO:tasks.rados.rados.0.trial188.stdout:555: delete oid 49 current snap is 61 2026-02-13T20:14:14.872 INFO:tasks.rados.rados.0.trial188.stdout:555: done (2 left) 2026-02-13T20:14:14.872 INFO:tasks.rados.rados.0.trial188.stdout:556: delete oid 43 current snap is 61 2026-02-13T20:14:14.875 INFO:tasks.rados.rados.0.trial188.stdout:556: done (2 left) 2026-02-13T20:14:14.875 INFO:tasks.rados.rados.0.trial188.stdout:557: copy_from oid 9 from oid 18 current snap is 61 2026-02-13T20:14:14.875 INFO:tasks.rados.rados.0.trial188.stdout:558: copy_from oid 22 from oid 41 current snap is 61 2026-02-13T20:14:14.875 INFO:tasks.rados.rados.0.trial188.stdout:559: write (excl) oid 8 current snap is 61 2026-02-13T20:14:14.875 INFO:tasks.rados.rados.0.trial188.stdout:559: seq_num 221 ranges {514347=404266,1499344=700071,2686246=676056} 2026-02-13T20:14:14.878 INFO:tasks.rados.rados.0.trial188.stdout:559: writing trial18843701-8 from 514347 to 918613 tid 1 2026-02-13T20:14:14.884 INFO:tasks.rados.rados.0.trial188.stdout:559: writing trial18843701-8 from 1499344 to 2199415 tid 2 2026-02-13T20:14:14.888 INFO:tasks.rados.rados.0.trial188.stdout:559: writing trial18843701-8 from 2686246 to 3362302 tid 3 2026-02-13T20:14:14.888 INFO:tasks.rados.rados.0.trial188.stdout:560: snap_create 2026-02-13T20:14:14.888 INFO:tasks.rados.rados.0.trial188.stdout:554: expect (ObjNum 186 snap 46 seq_num 186) 2026-02-13T20:14:14.888 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:14:14.938 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2800562 2026-02-13T20:14:14.944 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 113424 2026-02-13T20:14:14.975 INFO:tasks.rados.rados.0.trial188.stdout:553: finishing copy_from racing read to trial18843701-12 2026-02-13T20:14:14.975 INFO:tasks.rados.rados.0.trial188.stdout:558: finishing copy_from racing read to trial18843701-22 2026-02-13T20:14:14.975 INFO:tasks.rados.rados.0.trial188.stdout:558: finishing copy_from to trial18843701-22 2026-02-13T20:14:14.975 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 22 v 76 (ObjNum 167 snap 35 seq_num 167) dirty exists 2026-02-13T20:14:14.975 INFO:tasks.rados.rados.0.trial188.stdout:553: finishing copy_from to trial18843701-12 2026-02-13T20:14:14.975 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 12 v 106 (ObjNum 161 snap 32 seq_num 161) dirty exists 2026-02-13T20:14:14.975 INFO:tasks.rados.rados.0.trial188.stdout:557: finishing copy_from racing read to trial18843701-9 2026-02-13T20:14:14.976 INFO:tasks.rados.rados.0.trial188.stdout:559: finishing write tid 1 to trial18843701-8 2026-02-13T20:14:14.976 INFO:tasks.rados.rados.0.trial188.stdout:559: finishing write tid 2 to trial18843701-8 2026-02-13T20:14:14.976 INFO:tasks.rados.rados.0.trial188.stdout:559: finishing write tid 3 to trial18843701-8 2026-02-13T20:14:14.976 INFO:tasks.rados.rados.0.trial188.stdout:559: finishing write tid 4 to trial18843701-8 2026-02-13T20:14:14.976 INFO:tasks.rados.rados.0.trial188.stdout:559: finishing write tid 5 to trial18843701-8 2026-02-13T20:14:14.976 INFO:tasks.rados.rados.0.trial188.stdout:559: oid 8 updating version 0 to 168 2026-02-13T20:14:14.976 INFO:tasks.rados.rados.0.trial188.stdout:559: oid 8 version 168 is already newer than 165 2026-02-13T20:14:14.976 INFO:tasks.rados.rados.0.trial188.stdout:559: oid 8 version 168 is already newer than 166 2026-02-13T20:14:14.976 INFO:tasks.rados.rados.0.trial188.stdout:559: oid 8 version 168 is already newer than 167 2026-02-13T20:14:14.976 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 8 v 168 (ObjNum 221 snap 61 seq_num 221) dirty exists 2026-02-13T20:14:14.976 INFO:tasks.rados.rados.0.trial188.stdout:559: left oid 8 (ObjNum 221 snap 61 seq_num 221) 2026-02-13T20:14:14.976 INFO:tasks.rados.rados.0.trial188.stdout:557: finishing copy_from to trial18843701-9 2026-02-13T20:14:14.977 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 9 v 117 (ObjNum 203 snap 54 seq_num 203) dirty exists 2026-02-13T20:14:15.873 INFO:tasks.rados.rados.0.trial188.stdout:553: done (5 left) 2026-02-13T20:14:15.873 INFO:tasks.rados.rados.0.trial188.stdout:554: done (4 left) 2026-02-13T20:14:15.873 INFO:tasks.rados.rados.0.trial188.stdout:557: done (3 left) 2026-02-13T20:14:15.873 INFO:tasks.rados.rados.0.trial188.stdout:558: done (2 left) 2026-02-13T20:14:15.873 INFO:tasks.rados.rados.0.trial188.stdout:559: done (1 left) 2026-02-13T20:14:15.873 INFO:tasks.rados.rados.0.trial188.stdout:560: done (0 left) 2026-02-13T20:14:15.873 INFO:tasks.rados.rados.0.trial188.stdout:561: read oid 43 snap -1 2026-02-13T20:14:15.873 INFO:tasks.rados.rados.0.trial188.stdout:561: expect deleted 2026-02-13T20:14:15.873 INFO:tasks.rados.rados.0.trial188.stdout:562: snap_create 2026-02-13T20:14:16.875 INFO:tasks.rados.rados.0.trial188.stdout:561: done (1 left) 2026-02-13T20:14:16.875 INFO:tasks.rados.rados.0.trial188.stdout:562: done (0 left) 2026-02-13T20:14:16.875 INFO:tasks.rados.rados.0.trial188.stdout:563: read oid 21 snap 57 2026-02-13T20:14:16.876 INFO:tasks.rados.rados.0.trial188.stdout:563: expect (ObjNum 195 snap 50 seq_num 195) 2026-02-13T20:14:16.876 INFO:tasks.rados.rados.0.trial188.stdout:564: write (excl) oid 27 current snap is 63 2026-02-13T20:14:16.876 INFO:tasks.rados.rados.0.trial188.stdout:564: seq_num 222 ranges {531154=479515,1557826=443729,2713669=487328,3679295=51859} 2026-02-13T20:14:16.879 INFO:tasks.rados.rados.0.trial188.stdout:564: writing trial18843701-27 from 531154 to 1010669 tid 1 2026-02-13T20:14:16.883 INFO:tasks.rados.rados.0.trial188.stdout:564: writing trial18843701-27 from 1557826 to 2001555 tid 2 2026-02-13T20:14:16.888 INFO:tasks.rados.rados.0.trial188.stdout:564: writing trial18843701-27 from 2713669 to 3200997 tid 3 2026-02-13T20:14:16.890 INFO:tasks.rados.rados.0.trial188.stdout:564: writing trial18843701-27 from 3679295 to 3731154 tid 4 2026-02-13T20:14:16.890 INFO:tasks.rados.rados.0.trial188.stdout:565: write (excl) oid 7 current snap is 63 2026-02-13T20:14:16.890 INFO:tasks.rados.rados.0.trial188.stdout:565: seq_num 223 ranges {547961=554764,1616308=703740,2741092=698600} 2026-02-13T20:14:16.894 INFO:tasks.rados.rados.0.trial188.stdout:565: writing trial18843701-7 from 547961 to 1102725 tid 1 2026-02-13T20:14:16.898 INFO:tasks.rados.rados.0.trial188.stdout:565: writing trial18843701-7 from 1616308 to 2320048 tid 2 2026-02-13T20:14:16.903 INFO:tasks.rados.rados.0.trial188.stdout:565: writing trial18843701-7 from 2741092 to 3439692 tid 3 2026-02-13T20:14:16.903 INFO:tasks.rados.rados.0.trial188.stdout:566: write oid 6 current snap is 63 2026-02-13T20:14:16.903 INFO:tasks.rados.rados.0.trial188.stdout:566: seq_num 224 ranges {564768=630013,1674790=447398,2768515=626225} 2026-02-13T20:14:16.907 INFO:tasks.rados.rados.0.trial188.stdout:566: writing trial18843701-6 from 564768 to 1194781 tid 1 2026-02-13T20:14:16.911 INFO:tasks.rados.rados.0.trial188.stdout:566: writing trial18843701-6 from 1674790 to 2122188 tid 2 2026-02-13T20:14:16.916 INFO:tasks.rados.rados.0.trial188.stdout:566: writing trial18843701-6 from 2768515 to 3394740 tid 3 2026-02-13T20:14:16.916 INFO:tasks.rados.rados.0.trial188.stdout:567: read oid 33 snap -1 2026-02-13T20:14:16.917 INFO:tasks.rados.rados.0.trial188.stdout:567: expect (ObjNum 187 snap 47 seq_num 187) 2026-02-13T20:14:16.917 INFO:tasks.rados.rados.0.trial188.stdout:568: read oid 43 snap -1 2026-02-13T20:14:16.917 INFO:tasks.rados.rados.0.trial188.stdout:568: expect deleted 2026-02-13T20:14:16.917 INFO:tasks.rados.rados.0.trial188.stdout:569: write (excl) oid 29 current snap is 63 2026-02-13T20:14:16.917 INFO:tasks.rados.rados.0.trial188.stdout:563: expect (ObjNum 195 snap 50 seq_num 195) 2026-02-13T20:14:17.036 INFO:tasks.rados.rados.0.trial188.stdout:564: finishing write tid 1 to trial18843701-27 2026-02-13T20:14:17.036 INFO:tasks.rados.rados.0.trial188.stdout:564: finishing write tid 2 to trial18843701-27 2026-02-13T20:14:17.036 INFO:tasks.rados.rados.0.trial188.stdout:569: seq_num 225 ranges {581575=705262,1733272=707409,3195938=437497} 2026-02-13T20:14:17.040 INFO:tasks.rados.rados.0.trial188.stdout:569: writing trial18843701-29 from 581575 to 1286837 tid 1 2026-02-13T20:14:17.045 INFO:tasks.rados.rados.0.trial188.stdout:569: writing trial18843701-29 from 1733272 to 2440681 tid 2 2026-02-13T20:14:17.049 INFO:tasks.rados.rados.0.trial188.stdout:569: writing trial18843701-29 from 3195938 to 3633435 tid 3 2026-02-13T20:14:17.049 INFO:tasks.rados.rados.0.trial188.stdout:563: done (6 left) 2026-02-13T20:14:17.050 INFO:tasks.rados.rados.0.trial188.stdout:570: read oid 36 snap -1 2026-02-13T20:14:17.050 INFO:tasks.rados.rados.0.trial188.stdout:570: expect deleted 2026-02-13T20:14:17.050 INFO:tasks.rados.rados.0.trial188.stdout:571: snap_remove snap 55 2026-02-13T20:14:17.871 INFO:tasks.rados.rados.0.trial188.stdout:571: done (7 left) 2026-02-13T20:14:17.871 INFO:tasks.rados.rados.0.trial188.stdout:572: snap_remove snap 56 2026-02-13T20:14:18.870 INFO:tasks.rados.rados.0.trial188.stdout:572: done (7 left) 2026-02-13T20:14:18.871 INFO:tasks.rados.rados.0.trial188.stdout:573: write (excl) oid 2 current snap is 63 2026-02-13T20:14:18.871 INFO:tasks.rados.rados.0.trial188.stdout:573: seq_num 226 ranges {598382=780511,2075401=451067,3107008=648769} 2026-02-13T20:14:18.876 INFO:tasks.rados.rados.0.trial188.stdout:573: writing trial18843701-2 from 598382 to 1378893 tid 1 2026-02-13T20:14:18.880 INFO:tasks.rados.rados.0.trial188.stdout:573: writing trial18843701-2 from 2075401 to 2526468 tid 2 2026-02-13T20:14:18.886 INFO:tasks.rados.rados.0.trial188.stdout:573: writing trial18843701-2 from 3107008 to 3755777 tid 3 2026-02-13T20:14:18.886 INFO:tasks.rados.rados.0.trial188.stdout:574: read oid 18 snap -1 2026-02-13T20:14:18.886 INFO:tasks.rados.rados.0.trial188.stdout:574: expect (ObjNum 203 snap 54 seq_num 203) 2026-02-13T20:14:18.887 INFO:tasks.rados.rados.0.trial188.stdout:575: copy_from oid 49 from oid 15 current snap is 63 2026-02-13T20:14:18.887 INFO:tasks.rados.rados.0.trial188.stdout:564: finishing write tid 3 to trial18843701-27 2026-02-13T20:14:18.887 INFO:tasks.rados.rados.0.trial188.stdout:564: finishing write tid 4 to trial18843701-27 2026-02-13T20:14:18.887 INFO:tasks.rados.rados.0.trial188.stdout:564: finishing write tid 5 to trial18843701-27 2026-02-13T20:14:18.887 INFO:tasks.rados.rados.0.trial188.stdout:564: finishing write tid 6 to trial18843701-27 2026-02-13T20:14:18.887 INFO:tasks.rados.rados.0.trial188.stdout:564: oid 27 updating version 0 to 204 2026-02-13T20:14:18.887 INFO:tasks.rados.rados.0.trial188.stdout:564: oid 27 version 204 is already newer than 203 2026-02-13T20:14:18.887 INFO:tasks.rados.rados.0.trial188.stdout:564: oid 27 updating version 204 to 206 2026-02-13T20:14:18.887 INFO:tasks.rados.rados.0.trial188.stdout:564: oid 27 updating version 206 to 207 2026-02-13T20:14:18.887 INFO:tasks.rados.rados.0.trial188.stdout:564: oid 27 version 207 is already newer than 205 2026-02-13T20:14:18.887 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 27 v 207 (ObjNum 222 snap 63 seq_num 222) dirty exists 2026-02-13T20:14:18.888 INFO:tasks.rados.rados.0.trial188.stdout:564: left oid 27 (ObjNum 222 snap 63 seq_num 222) 2026-02-13T20:14:18.888 INFO:tasks.rados.rados.0.trial188.stdout:565: finishing write tid 1 to trial18843701-7 2026-02-13T20:14:18.888 INFO:tasks.rados.rados.0.trial188.stdout:564: done (9 left) 2026-02-13T20:14:18.888 INFO:tasks.rados.rados.0.trial188.stdout:576: delete oid 24 current snap is 63 2026-02-13T20:14:18.888 INFO:tasks.rados.rados.0.trial188.stdout:567: expect (ObjNum 187 snap 47 seq_num 187) 2026-02-13T20:14:18.976 INFO:tasks.rados.rados.0.trial188.stdout:566: finishing write tid 1 to trial18843701-6 2026-02-13T20:14:18.977 INFO:tasks.rados.rados.0.trial188.stdout:565: finishing write tid 2 to trial18843701-7 2026-02-13T20:14:18.977 INFO:tasks.rados.rados.0.trial188.stdout:566: finishing write tid 2 to trial18843701-6 2026-02-13T20:14:18.977 INFO:tasks.rados.rados.0.trial188.stdout:567: done (9 left) 2026-02-13T20:14:18.977 INFO:tasks.rados.rados.0.trial188.stdout:568: done (8 left) 2026-02-13T20:14:18.977 INFO:tasks.rados.rados.0.trial188.stdout:576: done (7 left) 2026-02-13T20:14:18.977 INFO:tasks.rados.rados.0.trial188.stdout:577: snap_remove snap 50 2026-02-13T20:14:19.877 INFO:tasks.rados.rados.0.trial188.stdout:577: done (7 left) 2026-02-13T20:14:19.877 INFO:tasks.rados.rados.0.trial188.stdout:578: rollback oid 40 current snap is 63 2026-02-13T20:14:19.877 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 40 to 62 2026-02-13T20:14:19.877 INFO:tasks.rados.rados.0.trial188.stdout:566: finishing write tid 3 to trial18843701-6 2026-02-13T20:14:19.878 INFO:tasks.rados.rados.0.trial188.stdout:565: finishing write tid 3 to trial18843701-7 2026-02-13T20:14:19.878 INFO:tasks.rados.rados.0.trial188.stdout:566: finishing write tid 4 to trial18843701-6 2026-02-13T20:14:19.878 INFO:tasks.rados.rados.0.trial188.stdout:565: finishing write tid 4 to trial18843701-7 2026-02-13T20:14:19.878 INFO:tasks.rados.rados.0.trial188.stdout:566: finishing write tid 5 to trial18843701-6 2026-02-13T20:14:19.878 INFO:tasks.rados.rados.0.trial188.stdout:566: oid 6 updating version 0 to 205 2026-02-13T20:14:19.878 INFO:tasks.rados.rados.0.trial188.stdout:566: oid 6 updating version 205 to 206 2026-02-13T20:14:19.878 INFO:tasks.rados.rados.0.trial188.stdout:566: oid 6 updating version 206 to 207 2026-02-13T20:14:19.878 INFO:tasks.rados.rados.0.trial188.stdout:566: oid 6 version 207 is already newer than 204 2026-02-13T20:14:19.878 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 6 v 207 (ObjNum 224 snap 63 seq_num 224) dirty exists 2026-02-13T20:14:19.878 INFO:tasks.rados.rados.0.trial188.stdout:566: left oid 6 (ObjNum 224 snap 63 seq_num 224) 2026-02-13T20:14:19.878 INFO:tasks.rados.rados.0.trial188.stdout:565: finishing write tid 5 to trial18843701-7 2026-02-13T20:14:19.878 INFO:tasks.rados.rados.0.trial188.stdout:565: oid 7 updating version 0 to 194 2026-02-13T20:14:19.878 INFO:tasks.rados.rados.0.trial188.stdout:565: oid 7 version 194 is already newer than 193 2026-02-13T20:14:19.878 INFO:tasks.rados.rados.0.trial188.stdout:565: oid 7 updating version 194 to 195 2026-02-13T20:14:19.878 INFO:tasks.rados.rados.0.trial188.stdout:565: oid 7 version 195 is already newer than 192 2026-02-13T20:14:19.878 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 7 v 195 (ObjNum 223 snap 63 seq_num 223) dirty exists 2026-02-13T20:14:19.878 INFO:tasks.rados.rados.0.trial188.stdout:565: left oid 7 (ObjNum 223 snap 63 seq_num 223) 2026-02-13T20:14:19.878 INFO:tasks.rados.rados.0.trial188.stdout:569: finishing write tid 1 to trial18843701-29 2026-02-13T20:14:19.878 INFO:tasks.rados.rados.0.trial188.stdout:569: finishing write tid 2 to trial18843701-29 2026-02-13T20:14:19.878 INFO:tasks.rados.rados.0.trial188.stdout:569: finishing write tid 3 to trial18843701-29 2026-02-13T20:14:19.878 INFO:tasks.rados.rados.0.trial188.stdout:569: finishing write tid 4 to trial18843701-29 2026-02-13T20:14:19.878 INFO:tasks.rados.rados.0.trial188.stdout:569: finishing write tid 5 to trial18843701-29 2026-02-13T20:14:19.878 INFO:tasks.rados.rados.0.trial188.stdout:569: oid 29 updating version 0 to 199 2026-02-13T20:14:19.878 INFO:tasks.rados.rados.0.trial188.stdout:569: oid 29 version 199 is already newer than 197 2026-02-13T20:14:19.878 INFO:tasks.rados.rados.0.trial188.stdout:569: oid 29 version 199 is already newer than 198 2026-02-13T20:14:19.878 INFO:tasks.rados.rados.0.trial188.stdout:569: oid 29 updating version 199 to 200 2026-02-13T20:14:19.878 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 29 v 200 (ObjNum 225 snap 63 seq_num 225) dirty exists 2026-02-13T20:14:19.878 INFO:tasks.rados.rados.0.trial188.stdout:569: left oid 29 (ObjNum 225 snap 63 seq_num 225) 2026-02-13T20:14:19.878 INFO:tasks.rados.rados.0.trial188.stdout:574: expect (ObjNum 203 snap 54 seq_num 203) 2026-02-13T20:14:19.975 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1570380 2026-02-13T20:14:20.001 INFO:tasks.rados.rados.0.trial188.stdout:573: finishing write tid 1 to trial18843701-2 2026-02-13T20:14:20.002 INFO:tasks.rados.rados.0.trial188.stdout:565: done (7 left) 2026-02-13T20:14:20.002 INFO:tasks.rados.rados.0.trial188.stdout:566: done (6 left) 2026-02-13T20:14:20.002 INFO:tasks.rados.rados.0.trial188.stdout:569: done (5 left) 2026-02-13T20:14:20.002 INFO:tasks.rados.rados.0.trial188.stdout:570: done (4 left) 2026-02-13T20:14:20.002 INFO:tasks.rados.rados.0.trial188.stdout:574: done (3 left) 2026-02-13T20:14:20.002 INFO:tasks.rados.rados.0.trial188.stdout:579: delete oid 5 current snap is 63 2026-02-13T20:14:20.002 INFO:tasks.rados.rados.0.trial188.stdout:573: finishing write tid 2 to trial18843701-2 2026-02-13T20:14:20.002 INFO:tasks.rados.rados.0.trial188.stdout:573: finishing write tid 3 to trial18843701-2 2026-02-13T20:14:20.002 INFO:tasks.rados.rados.0.trial188.stdout:573: finishing write tid 4 to trial18843701-2 2026-02-13T20:14:20.003 INFO:tasks.rados.rados.0.trial188.stdout:573: finishing write tid 5 to trial18843701-2 2026-02-13T20:14:20.003 INFO:tasks.rados.rados.0.trial188.stdout:573: oid 2 updating version 0 to 251 2026-02-13T20:14:20.003 INFO:tasks.rados.rados.0.trial188.stdout:573: oid 2 updating version 251 to 254 2026-02-13T20:14:20.003 INFO:tasks.rados.rados.0.trial188.stdout:573: oid 2 version 254 is already newer than 253 2026-02-13T20:14:20.003 INFO:tasks.rados.rados.0.trial188.stdout:573: oid 2 version 254 is already newer than 252 2026-02-13T20:14:20.003 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 2 v 254 (ObjNum 226 snap 63 seq_num 226) dirty exists 2026-02-13T20:14:20.003 INFO:tasks.rados.rados.0.trial188.stdout:573: left oid 2 (ObjNum 226 snap 63 seq_num 226) 2026-02-13T20:14:20.003 INFO:tasks.rados.rados.0.trial188.stdout:575: finishing copy_from racing read to trial18843701-49 2026-02-13T20:14:20.003 INFO:tasks.rados.rados.0.trial188.stdout:575: finishing copy_from to trial18843701-49 2026-02-13T20:14:20.003 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 49 v 178 (ObjNum 193 snap 47 seq_num 193) dirty exists 2026-02-13T20:14:20.003 INFO:tasks.rados.rados.0.trial188.stdout:578: finishing rollback tid 0 to trial18843701-40 2026-02-13T20:14:20.003 INFO:tasks.rados.rados.0.trial188.stdout:578: finishing rollback tid 1 to trial18843701-40 2026-02-13T20:14:20.004 INFO:tasks.rados.rados.0.trial188.stdout:578: finishing rollback tid 2 to trial18843701-40 2026-02-13T20:14:20.004 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 40 v 159 (ObjNum 200 snap 52 seq_num 200) dirty exists 2026-02-13T20:14:20.005 INFO:tasks.rados.rados.0.trial188.stdout:573: done (3 left) 2026-02-13T20:14:20.005 INFO:tasks.rados.rados.0.trial188.stdout:575: done (2 left) 2026-02-13T20:14:20.005 INFO:tasks.rados.rados.0.trial188.stdout:578: done (1 left) 2026-02-13T20:14:20.005 INFO:tasks.rados.rados.0.trial188.stdout:579: done (0 left) 2026-02-13T20:14:20.005 INFO:tasks.rados.rados.0.trial188.stdout:580: rollback oid 29 current snap is 63 2026-02-13T20:14:20.005 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 29 to 62 2026-02-13T20:14:20.005 INFO:tasks.rados.rados.0.trial188.stdout:581: delete oid 44 current snap is 63 2026-02-13T20:14:20.005 INFO:tasks.rados.rados.0.trial188.stdout:581: done (1 left) 2026-02-13T20:14:20.005 INFO:tasks.rados.rados.0.trial188.stdout:582: read oid 37 snap -1 2026-02-13T20:14:20.005 INFO:tasks.rados.rados.0.trial188.stdout:582: expect (ObjNum 216 snap 58 seq_num 216) 2026-02-13T20:14:20.006 INFO:tasks.rados.rados.0.trial188.stdout:583: write (excl) oid 8 current snap is 63 2026-02-13T20:14:20.006 INFO:tasks.rados.rados.0.trial188.stdout:583: seq_num 230 ranges {665610=797860,1909329=458405,2816700=410210} 2026-02-13T20:14:20.010 INFO:tasks.rados.rados.0.trial188.stdout:583: writing trial18843701-8 from 665610 to 1463470 tid 1 2026-02-13T20:14:20.013 INFO:tasks.rados.rados.0.trial188.stdout:583: writing trial18843701-8 from 1909329 to 2367734 tid 2 2026-02-13T20:14:20.016 INFO:tasks.rados.rados.0.trial188.stdout:583: writing trial18843701-8 from 2816700 to 3226910 tid 3 2026-02-13T20:14:20.017 INFO:tasks.rados.rados.0.trial188.stdout:584: write oid 28 current snap is 63 2026-02-13T20:14:20.017 INFO:tasks.rados.rados.0.trial188.stdout:580: finishing rollback tid 0 to trial18843701-29 2026-02-13T20:14:20.017 INFO:tasks.rados.rados.0.trial188.stdout:580: finishing rollback tid 1 to trial18843701-29 2026-02-13T20:14:20.017 INFO:tasks.rados.rados.0.trial188.stdout:580: finishing rollback tid 2 to trial18843701-29 2026-02-13T20:14:20.017 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 29 v 221 (ObjNum 144 snap 27 seq_num 144) dirty exists 2026-02-13T20:14:20.017 INFO:tasks.rados.rados.0.trial188.stdout:582: expect (ObjNum 216 snap 58 seq_num 216) 2026-02-13T20:14:20.032 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:14:20.063 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2602771 2026-02-13T20:14:20.072 INFO:tasks.rados.rados.0.trial188.stdout:583: finishing write tid 1 to trial18843701-8 2026-02-13T20:14:20.072 INFO:tasks.rados.rados.0.trial188.stdout:583: finishing write tid 2 to trial18843701-8 2026-02-13T20:14:20.072 INFO:tasks.rados.rados.0.trial188.stdout:584: seq_num 231 ranges {682417=473109,1567811=602063,2844123=621482} 2026-02-13T20:14:20.076 INFO:tasks.rados.rados.0.trial188.stdout:584: writing trial18843701-28 from 682417 to 1155526 tid 1 2026-02-13T20:14:20.080 INFO:tasks.rados.rados.0.trial188.stdout:584: writing trial18843701-28 from 1567811 to 2169874 tid 2 2026-02-13T20:14:20.086 INFO:tasks.rados.rados.0.trial188.stdout:584: writing trial18843701-28 from 2844123 to 3465605 tid 3 2026-02-13T20:14:20.086 INFO:tasks.rados.rados.0.trial188.stdout:580: done (3 left) 2026-02-13T20:14:20.086 INFO:tasks.rados.rados.0.trial188.stdout:582: done (2 left) 2026-02-13T20:14:20.086 INFO:tasks.rados.rados.0.trial188.stdout:585: write (excl) oid 21 current snap is 63 2026-02-13T20:14:20.086 INFO:tasks.rados.rados.0.trial188.stdout:583: finishing write tid 3 to trial18843701-8 2026-02-13T20:14:20.086 INFO:tasks.rados.rados.0.trial188.stdout:583: finishing write tid 4 to trial18843701-8 2026-02-13T20:14:20.086 INFO:tasks.rados.rados.0.trial188.stdout:583: finishing write tid 5 to trial18843701-8 2026-02-13T20:14:20.086 INFO:tasks.rados.rados.0.trial188.stdout:583: oid 8 updating version 0 to 179 2026-02-13T20:14:20.086 INFO:tasks.rados.rados.0.trial188.stdout:583: oid 8 updating version 179 to 181 2026-02-13T20:14:20.086 INFO:tasks.rados.rados.0.trial188.stdout:583: oid 8 version 181 is already newer than 178 2026-02-13T20:14:20.086 INFO:tasks.rados.rados.0.trial188.stdout:583: oid 8 version 181 is already newer than 180 2026-02-13T20:14:20.086 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 8 v 181 (ObjNum 230 snap 63 seq_num 230) dirty exists 2026-02-13T20:14:20.086 INFO:tasks.rados.rados.0.trial188.stdout:583: left oid 8 (ObjNum 230 snap 63 seq_num 230) 2026-02-13T20:14:20.086 INFO:tasks.rados.rados.0.trial188.stdout:585: seq_num 232 ranges {699224=548358,2026293=462074,3271546=432754} 2026-02-13T20:14:20.090 INFO:tasks.rados.rados.0.trial188.stdout:585: writing trial18843701-21 from 699224 to 1247582 tid 1 2026-02-13T20:14:20.095 INFO:tasks.rados.rados.0.trial188.stdout:585: writing trial18843701-21 from 2026293 to 2488367 tid 2 2026-02-13T20:14:20.099 INFO:tasks.rados.rados.0.trial188.stdout:585: writing trial18843701-21 from 3271546 to 3704300 tid 3 2026-02-13T20:14:20.099 INFO:tasks.rados.rados.0.trial188.stdout:583: done (2 left) 2026-02-13T20:14:20.099 INFO:tasks.rados.rados.0.trial188.stdout:586: snap_remove snap 58 2026-02-13T20:14:20.882 INFO:tasks.rados.rados.0.trial188.stdout:586: done (2 left) 2026-02-13T20:14:20.882 INFO:tasks.rados.rados.0.trial188.stdout:587: copy_from oid 43 from oid 12 current snap is 63 2026-02-13T20:14:20.882 INFO:tasks.rados.rados.0.trial188.stdout:584: finishing write tid 1 to trial18843701-28 2026-02-13T20:14:20.882 INFO:tasks.rados.rados.0.trial188.stdout:584: finishing write tid 2 to trial18843701-28 2026-02-13T20:14:20.883 INFO:tasks.rados.rados.0.trial188.stdout:584: finishing write tid 3 to trial18843701-28 2026-02-13T20:14:20.883 INFO:tasks.rados.rados.0.trial188.stdout:584: finishing write tid 4 to trial18843701-28 2026-02-13T20:14:20.883 INFO:tasks.rados.rados.0.trial188.stdout:584: finishing write tid 5 to trial18843701-28 2026-02-13T20:14:20.883 INFO:tasks.rados.rados.0.trial188.stdout:584: oid 28 updating version 0 to 184 2026-02-13T20:14:20.883 INFO:tasks.rados.rados.0.trial188.stdout:584: oid 28 version 184 is already newer than 183 2026-02-13T20:14:20.883 INFO:tasks.rados.rados.0.trial188.stdout:584: oid 28 updating version 184 to 185 2026-02-13T20:14:20.883 INFO:tasks.rados.rados.0.trial188.stdout:584: oid 28 version 185 is already newer than 182 2026-02-13T20:14:20.883 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 28 v 185 (ObjNum 231 snap 63 seq_num 231) dirty exists 2026-02-13T20:14:20.883 INFO:tasks.rados.rados.0.trial188.stdout:584: left oid 28 (ObjNum 231 snap 63 seq_num 231) 2026-02-13T20:14:20.883 INFO:tasks.rados.rados.0.trial188.stdout:585: finishing write tid 1 to trial18843701-21 2026-02-13T20:14:20.883 INFO:tasks.rados.rados.0.trial188.stdout:584: done (2 left) 2026-02-13T20:14:20.883 INFO:tasks.rados.rados.0.trial188.stdout:588: write (excl) oid 22 current snap is 63 2026-02-13T20:14:20.884 INFO:tasks.rados.rados.0.trial188.stdout:588: seq_num 233 ranges {716031=623607,2084775=605732,3298969=617062} 2026-02-13T20:14:20.886 INFO:tasks.rados.rados.0.trial188.stdout:588: writing trial18843701-22 from 716031 to 1339638 tid 1 2026-02-13T20:14:20.891 INFO:tasks.rados.rados.0.trial188.stdout:588: writing trial18843701-22 from 2084775 to 2690507 tid 2 2026-02-13T20:14:20.895 INFO:tasks.rados.rados.0.trial188.stdout:588: writing trial18843701-22 from 3298969 to 3916031 tid 3 2026-02-13T20:14:20.895 INFO:tasks.rados.rados.0.trial188.stdout:589: rollback oid 33 current snap is 63 2026-02-13T20:14:20.895 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 33 to 61 2026-02-13T20:14:20.896 INFO:tasks.rados.rados.0.trial188.stdout:585: finishing write tid 2 to trial18843701-21 2026-02-13T20:14:20.896 INFO:tasks.rados.rados.0.trial188.stdout:585: finishing write tid 3 to trial18843701-21 2026-02-13T20:14:20.896 INFO:tasks.rados.rados.0.trial188.stdout:585: finishing write tid 4 to trial18843701-21 2026-02-13T20:14:20.896 INFO:tasks.rados.rados.0.trial188.stdout:585: finishing write tid 5 to trial18843701-21 2026-02-13T20:14:20.896 INFO:tasks.rados.rados.0.trial188.stdout:585: oid 21 updating version 0 to 94 2026-02-13T20:14:20.896 INFO:tasks.rados.rados.0.trial188.stdout:585: oid 21 version 94 is already newer than 93 2026-02-13T20:14:20.896 INFO:tasks.rados.rados.0.trial188.stdout:585: oid 21 version 94 is already newer than 91 2026-02-13T20:14:20.896 INFO:tasks.rados.rados.0.trial188.stdout:585: oid 21 version 94 is already newer than 92 2026-02-13T20:14:20.896 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 21 v 94 (ObjNum 232 snap 63 seq_num 232) dirty exists 2026-02-13T20:14:20.896 INFO:tasks.rados.rados.0.trial188.stdout:585: left oid 21 (ObjNum 232 snap 63 seq_num 232) 2026-02-13T20:14:20.896 INFO:tasks.rados.rados.0.trial188.stdout:585: done (3 left) 2026-02-13T20:14:20.896 INFO:tasks.rados.rados.0.trial188.stdout:590: snap_remove snap 47 2026-02-13T20:14:21.885 INFO:tasks.rados.rados.0.trial188.stdout:590: done (3 left) 2026-02-13T20:14:21.885 INFO:tasks.rados.rados.0.trial188.stdout:591: delete oid 13 current snap is 63 2026-02-13T20:14:21.885 INFO:tasks.rados.rados.0.trial188.stdout:587: finishing copy_from racing read to trial18843701-43 2026-02-13T20:14:21.885 INFO:tasks.rados.rados.0.trial188.stdout:588: finishing write tid 1 to trial18843701-22 2026-02-13T20:14:21.885 INFO:tasks.rados.rados.0.trial188.stdout:587: finishing copy_from to trial18843701-43 2026-02-13T20:14:21.885 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 43 v 106 (ObjNum 161 snap 32 seq_num 161) dirty exists 2026-02-13T20:14:21.885 INFO:tasks.rados.rados.0.trial188.stdout:588: finishing write tid 2 to trial18843701-22 2026-02-13T20:14:21.885 INFO:tasks.rados.rados.0.trial188.stdout:589: finishing rollback tid 0 to trial18843701-33 2026-02-13T20:14:21.885 INFO:tasks.rados.rados.0.trial188.stdout:589: finishing rollback tid 1 to trial18843701-33 2026-02-13T20:14:21.885 INFO:tasks.rados.rados.0.trial188.stdout:589: finishing rollback tid 2 to trial18843701-33 2026-02-13T20:14:21.885 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 33 v 162 (ObjNum 187 snap 47 seq_num 187) dirty exists 2026-02-13T20:14:21.885 INFO:tasks.rados.rados.0.trial188.stdout:588: finishing write tid 3 to trial18843701-22 2026-02-13T20:14:21.885 INFO:tasks.rados.rados.0.trial188.stdout:588: finishing write tid 4 to trial18843701-22 2026-02-13T20:14:21.885 INFO:tasks.rados.rados.0.trial188.stdout:588: finishing write tid 5 to trial18843701-22 2026-02-13T20:14:21.885 INFO:tasks.rados.rados.0.trial188.stdout:588: oid 22 updating version 0 to 80 2026-02-13T20:14:21.885 INFO:tasks.rados.rados.0.trial188.stdout:588: oid 22 updating version 80 to 107 2026-02-13T20:14:21.885 INFO:tasks.rados.rados.0.trial188.stdout:588: oid 22 updating version 107 to 108 2026-02-13T20:14:21.885 INFO:tasks.rados.rados.0.trial188.stdout:588: oid 22 updating version 108 to 109 2026-02-13T20:14:21.885 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 22 v 109 (ObjNum 233 snap 63 seq_num 233) dirty exists 2026-02-13T20:14:21.885 INFO:tasks.rados.rados.0.trial188.stdout:588: left oid 22 (ObjNum 233 snap 63 seq_num 233) 2026-02-13T20:14:21.888 INFO:tasks.rados.rados.0.trial188.stdout:587: done (3 left) 2026-02-13T20:14:21.888 INFO:tasks.rados.rados.0.trial188.stdout:588: done (2 left) 2026-02-13T20:14:21.888 INFO:tasks.rados.rados.0.trial188.stdout:589: done (1 left) 2026-02-13T20:14:21.888 INFO:tasks.rados.rados.0.trial188.stdout:591: done (0 left) 2026-02-13T20:14:21.888 INFO:tasks.rados.rados.0.trial188.stdout:592: snap_create 2026-02-13T20:14:22.870 INFO:tasks.rados.rados.0.trial188.stdout:592: done (0 left) 2026-02-13T20:14:22.871 INFO:tasks.rados.rados.0.trial188.stdout:593: rollback oid 1 current snap is 64 2026-02-13T20:14:22.871 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 1 to 45 2026-02-13T20:14:22.871 INFO:tasks.rados.rados.0.trial188.stdout:594: copy_from oid 37 from oid 21 current snap is 64 2026-02-13T20:14:22.871 INFO:tasks.rados.rados.0.trial188.stdout:595: write (excl) oid 11 current snap is 64 2026-02-13T20:14:22.871 INFO:tasks.rados.rados.0.trial188.stdout:595: seq_num 235 ranges {749645=774105,2085386=609401,3237462=712183} 2026-02-13T20:14:22.876 INFO:tasks.rados.rados.0.trial188.stdout:595: writing trial18843701-11 from 749645 to 1523750 tid 1 2026-02-13T20:14:22.880 INFO:tasks.rados.rados.0.trial188.stdout:595: writing trial18843701-11 from 2085386 to 2694787 tid 2 2026-02-13T20:14:22.885 INFO:tasks.rados.rados.0.trial188.stdout:595: writing trial18843701-11 from 3237462 to 3949645 tid 3 2026-02-13T20:14:22.886 INFO:tasks.rados.rados.0.trial188.stdout:596: snap_remove snap 54 2026-02-13T20:14:23.887 INFO:tasks.rados.rados.0.trial188.stdout:596: done (3 left) 2026-02-13T20:14:23.887 INFO:tasks.rados.rados.0.trial188.stdout:597: read oid 28 snap 60 2026-02-13T20:14:23.887 INFO:tasks.rados.rados.0.trial188.stdout:597: expect deleted 2026-02-13T20:14:23.887 INFO:tasks.rados.rados.0.trial188.stdout:598: write oid 15 current snap is 64 2026-02-13T20:14:23.887 INFO:tasks.rados.rados.0.trial188.stdout:593: finishing rollback tid 0 to trial18843701-1 2026-02-13T20:14:23.887 INFO:tasks.rados.rados.0.trial188.stdout:598: seq_num 236 ranges {766452=565707,1860221=469412,2981238=594195} 2026-02-13T20:14:23.892 INFO:tasks.rados.rados.0.trial188.stdout:598: writing trial18843701-15 from 766452 to 1332159 tid 1 2026-02-13T20:14:23.896 INFO:tasks.rados.rados.0.trial188.stdout:598: writing trial18843701-15 from 1860221 to 2329633 tid 2 2026-02-13T20:14:23.901 INFO:tasks.rados.rados.0.trial188.stdout:598: writing trial18843701-15 from 2981238 to 3575433 tid 3 2026-02-13T20:14:23.901 INFO:tasks.rados.rados.0.trial188.stdout:599: write (excl) oid 39 current snap is 64 2026-02-13T20:14:23.901 INFO:tasks.rados.rados.0.trial188.stdout:593: finishing rollback tid 1 to trial18843701-1 2026-02-13T20:14:23.901 INFO:tasks.rados.rados.0.trial188.stdout:593: finishing rollback tid 2 to trial18843701-1 2026-02-13T20:14:23.901 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 1 v 272 (ObjNum 184 snap 43 seq_num 184) dirty exists 2026-02-13T20:14:23.901 INFO:tasks.rados.rados.0.trial188.stdout:595: finishing write tid 1 to trial18843701-11 2026-02-13T20:14:23.901 INFO:tasks.rados.rados.0.trial188.stdout:595: finishing write tid 2 to trial18843701-11 2026-02-13T20:14:23.901 INFO:tasks.rados.rados.0.trial188.stdout:599: seq_num 237 ranges {783259=640956,1918703=613070,3008661=405467,3821939=161320} 2026-02-13T20:14:23.906 INFO:tasks.rados.rados.0.trial188.stdout:599: writing trial18843701-39 from 783259 to 1424215 tid 1 2026-02-13T20:14:23.910 INFO:tasks.rados.rados.0.trial188.stdout:599: writing trial18843701-39 from 1918703 to 2531773 tid 2 2026-02-13T20:14:23.913 INFO:tasks.rados.rados.0.trial188.stdout:599: writing trial18843701-39 from 3008661 to 3414128 tid 3 2026-02-13T20:14:23.915 INFO:tasks.rados.rados.0.trial188.stdout:599: writing trial18843701-39 from 3821939 to 3983259 tid 4 2026-02-13T20:14:23.915 INFO:tasks.rados.rados.0.trial188.stdout:593: done (5 left) 2026-02-13T20:14:23.915 INFO:tasks.rados.rados.0.trial188.stdout:600: snap_remove snap 57 2026-02-13T20:14:24.893 INFO:tasks.rados.rados.0.trial188.stdout:600: done (5 left) 2026-02-13T20:14:24.893 INFO:tasks.rados.rados.0.trial188.stdout:601: read oid 31 snap -1 2026-02-13T20:14:24.893 INFO:tasks.rados.rados.0.trial188.stdout:601: expect (ObjNum 218 snap 58 seq_num 218) 2026-02-13T20:14:24.893 INFO:tasks.rados.rados.0.trial188.stdout:602: delete oid 32 current snap is 64 2026-02-13T20:14:24.893 INFO:tasks.rados.rados.0.trial188.stdout:595: finishing write tid 3 to trial18843701-11 2026-02-13T20:14:24.893 INFO:tasks.rados.rados.0.trial188.stdout:595: finishing write tid 4 to trial18843701-11 2026-02-13T20:14:24.893 INFO:tasks.rados.rados.0.trial188.stdout:595: finishing write tid 5 to trial18843701-11 2026-02-13T20:14:24.893 INFO:tasks.rados.rados.0.trial188.stdout:595: oid 11 updating version 0 to 158 2026-02-13T20:14:24.893 INFO:tasks.rados.rados.0.trial188.stdout:595: oid 11 version 158 is already newer than 157 2026-02-13T20:14:24.893 INFO:tasks.rados.rados.0.trial188.stdout:595: oid 11 updating version 158 to 159 2026-02-13T20:14:24.893 INFO:tasks.rados.rados.0.trial188.stdout:595: oid 11 updating version 159 to 160 2026-02-13T20:14:24.893 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 11 v 160 (ObjNum 235 snap 64 seq_num 235) dirty exists 2026-02-13T20:14:24.894 INFO:tasks.rados.rados.0.trial188.stdout:595: left oid 11 (ObjNum 235 snap 64 seq_num 235) 2026-02-13T20:14:24.894 INFO:tasks.rados.rados.0.trial188.stdout:594: finishing copy_from racing read to trial18843701-37 2026-02-13T20:14:24.894 INFO:tasks.rados.rados.0.trial188.stdout:594: finishing copy_from to trial18843701-37 2026-02-13T20:14:24.894 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 37 v 94 (ObjNum 232 snap 63 seq_num 232) dirty exists 2026-02-13T20:14:24.894 INFO:tasks.rados.rados.0.trial188.stdout:598: finishing write tid 1 to trial18843701-15 2026-02-13T20:14:24.894 INFO:tasks.rados.rados.0.trial188.stdout:598: finishing write tid 2 to trial18843701-15 2026-02-13T20:14:24.894 INFO:tasks.rados.rados.0.trial188.stdout:598: finishing write tid 3 to trial18843701-15 2026-02-13T20:14:24.894 INFO:tasks.rados.rados.0.trial188.stdout:598: finishing write tid 4 to trial18843701-15 2026-02-13T20:14:24.894 INFO:tasks.rados.rados.0.trial188.stdout:599: finishing write tid 1 to trial18843701-39 2026-02-13T20:14:24.894 INFO:tasks.rados.rados.0.trial188.stdout:599: finishing write tid 2 to trial18843701-39 2026-02-13T20:14:24.894 INFO:tasks.rados.rados.0.trial188.stdout:598: finishing write tid 5 to trial18843701-15 2026-02-13T20:14:24.894 INFO:tasks.rados.rados.0.trial188.stdout:598: oid 15 updating version 0 to 227 2026-02-13T20:14:24.894 INFO:tasks.rados.rados.0.trial188.stdout:598: oid 15 updating version 227 to 230 2026-02-13T20:14:24.894 INFO:tasks.rados.rados.0.trial188.stdout:598: oid 15 version 230 is already newer than 229 2026-02-13T20:14:24.894 INFO:tasks.rados.rados.0.trial188.stdout:598: oid 15 version 230 is already newer than 228 2026-02-13T20:14:24.894 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 15 v 230 (ObjNum 236 snap 64 seq_num 236) dirty exists 2026-02-13T20:14:24.894 INFO:tasks.rados.rados.0.trial188.stdout:598: left oid 15 (ObjNum 236 snap 64 seq_num 236) 2026-02-13T20:14:24.894 INFO:tasks.rados.rados.0.trial188.stdout:599: finishing write tid 3 to trial18843701-39 2026-02-13T20:14:24.894 INFO:tasks.rados.rados.0.trial188.stdout:599: finishing write tid 4 to trial18843701-39 2026-02-13T20:14:24.894 INFO:tasks.rados.rados.0.trial188.stdout:599: finishing write tid 5 to trial18843701-39 2026-02-13T20:14:24.894 INFO:tasks.rados.rados.0.trial188.stdout:599: finishing write tid 6 to trial18843701-39 2026-02-13T20:14:24.894 INFO:tasks.rados.rados.0.trial188.stdout:599: oid 39 updating version 0 to 241 2026-02-13T20:14:24.894 INFO:tasks.rados.rados.0.trial188.stdout:599: oid 39 updating version 241 to 244 2026-02-13T20:14:24.894 INFO:tasks.rados.rados.0.trial188.stdout:599: oid 39 version 244 is already newer than 242 2026-02-13T20:14:24.894 INFO:tasks.rados.rados.0.trial188.stdout:599: oid 39 version 244 is already newer than 243 2026-02-13T20:14:24.894 INFO:tasks.rados.rados.0.trial188.stdout:599: oid 39 updating version 244 to 245 2026-02-13T20:14:24.895 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 39 v 245 (ObjNum 237 snap 64 seq_num 237) dirty exists 2026-02-13T20:14:24.895 INFO:tasks.rados.rados.0.trial188.stdout:599: left oid 39 (ObjNum 237 snap 64 seq_num 237) 2026-02-13T20:14:24.895 INFO:tasks.rados.rados.0.trial188.stdout:594: done (6 left) 2026-02-13T20:14:24.895 INFO:tasks.rados.rados.0.trial188.stdout:595: done (5 left) 2026-02-13T20:14:24.895 INFO:tasks.rados.rados.0.trial188.stdout:597: done (4 left) 2026-02-13T20:14:24.895 INFO:tasks.rados.rados.0.trial188.stdout:598: done (3 left) 2026-02-13T20:14:24.895 INFO:tasks.rados.rados.0.trial188.stdout:599: done (2 left) 2026-02-13T20:14:24.895 INFO:tasks.rados.rados.0.trial188.stdout:602: done (1 left) 2026-02-13T20:14:24.895 INFO:tasks.rados.rados.0.trial188.stdout:603: copy_from oid 19 from oid 47 current snap is 64 2026-02-13T20:14:24.896 INFO:tasks.rados.rados.0.trial188.stdout:604: read oid 15 snap 63 2026-02-13T20:14:24.896 INFO:tasks.rados.rados.0.trial188.stdout:604: expect (ObjNum 193 snap 47 seq_num 193) 2026-02-13T20:14:24.896 INFO:tasks.rados.rados.0.trial188.stdout:605: delete oid 23 current snap is 64 2026-02-13T20:14:24.901 INFO:tasks.rados.rados.0.trial188.stdout:601: expect (ObjNum 218 snap 58 seq_num 218) 2026-02-13T20:14:24.901 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:14:25.046 INFO:tasks.rados.rados.0.trial188.stdout:604: expect (ObjNum 193 snap 47 seq_num 193) 2026-02-13T20:14:25.047 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1717741 2026-02-13T20:14:25.062 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 362670 2026-02-13T20:14:25.104 INFO:tasks.rados.rados.0.trial188.stdout:603: finishing copy_from racing read to trial18843701-19 2026-02-13T20:14:25.104 INFO:tasks.rados.rados.0.trial188.stdout:603: finishing copy_from to trial18843701-19 2026-02-13T20:14:25.104 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 19 v 159 (ObjNum 179 snap 41 seq_num 179) dirty exists 2026-02-13T20:14:25.104 INFO:tasks.rados.rados.0.trial188.stdout:601: done (3 left) 2026-02-13T20:14:25.104 INFO:tasks.rados.rados.0.trial188.stdout:603: done (2 left) 2026-02-13T20:14:25.104 INFO:tasks.rados.rados.0.trial188.stdout:604: done (1 left) 2026-02-13T20:14:25.104 INFO:tasks.rados.rados.0.trial188.stdout:605: done (0 left) 2026-02-13T20:14:25.104 INFO:tasks.rados.rados.0.trial188.stdout:606: write (excl) oid 3 current snap is 64 2026-02-13T20:14:25.105 INFO:tasks.rados.rados.0.trial188.stdout:606: seq_num 240 ranges {433680=466703,1577796=455884} 2026-02-13T20:14:25.107 INFO:tasks.rados.rados.0.trial188.stdout:606: writing trial18843701-3 from 433680 to 900383 tid 1 2026-02-13T20:14:25.111 INFO:tasks.rados.rados.0.trial188.stdout:606: writing trial18843701-3 from 1577796 to 2033680 tid 2 2026-02-13T20:14:25.111 INFO:tasks.rados.rados.0.trial188.stdout:607: snap_remove snap 63 2026-02-13T20:14:25.896 INFO:tasks.rados.rados.0.trial188.stdout:607: done (1 left) 2026-02-13T20:14:25.896 INFO:tasks.rados.rados.0.trial188.stdout:608: read oid 49 snap 45 2026-02-13T20:14:25.896 INFO:tasks.rados.rados.0.trial188.stdout:608: expect (ObjNum 179 snap 41 seq_num 179) 2026-02-13T20:14:25.896 INFO:tasks.rados.rados.0.trial188.stdout:609: read oid 38 snap -1 2026-02-13T20:14:25.896 INFO:tasks.rados.rados.0.trial188.stdout:609: expect (ObjNum 187 snap 47 seq_num 187) 2026-02-13T20:14:25.896 INFO:tasks.rados.rados.0.trial188.stdout:610: read oid 26 snap -1 2026-02-13T20:14:25.896 INFO:tasks.rados.rados.0.trial188.stdout:610: expect (ObjNum 213 snap 57 seq_num 213) 2026-02-13T20:14:25.896 INFO:tasks.rados.rados.0.trial188.stdout:611: snap_remove snap 60 2026-02-13T20:14:26.900 INFO:tasks.rados.rados.0.trial188.stdout:611: done (4 left) 2026-02-13T20:14:26.900 INFO:tasks.rados.rados.0.trial188.stdout:612: write (excl) oid 34 current snap is 64 2026-02-13T20:14:26.900 INFO:tasks.rados.rados.0.trial188.stdout:606: finishing write tid 1 to trial18843701-3 2026-02-13T20:14:26.900 INFO:tasks.rados.rados.0.trial188.stdout:612: seq_num 241 ranges {450487=541952,1636278=414209} 2026-02-13T20:14:26.904 INFO:tasks.rados.rados.0.trial188.stdout:612: writing trial18843701-34 from 450487 to 992439 tid 1 2026-02-13T20:14:26.908 INFO:tasks.rados.rados.0.trial188.stdout:612: writing trial18843701-34 from 1636278 to 2050487 tid 2 2026-02-13T20:14:26.908 INFO:tasks.rados.rados.0.trial188.stdout:613: copy_from oid 10 from oid 29 current snap is 64 2026-02-13T20:14:26.908 INFO:tasks.rados.rados.0.trial188.stdout:606: finishing write tid 2 to trial18843701-3 2026-02-13T20:14:26.908 INFO:tasks.rados.rados.0.trial188.stdout:606: finishing write tid 3 to trial18843701-3 2026-02-13T20:14:26.908 INFO:tasks.rados.rados.0.trial188.stdout:606: finishing write tid 4 to trial18843701-3 2026-02-13T20:14:26.908 INFO:tasks.rados.rados.0.trial188.stdout:606: oid 3 updating version 0 to 234 2026-02-13T20:14:26.908 INFO:tasks.rados.rados.0.trial188.stdout:606: oid 3 updating version 234 to 235 2026-02-13T20:14:26.908 INFO:tasks.rados.rados.0.trial188.stdout:606: oid 3 updating version 235 to 236 2026-02-13T20:14:26.908 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 3 v 236 (ObjNum 240 snap 64 seq_num 240) dirty exists 2026-02-13T20:14:26.908 INFO:tasks.rados.rados.0.trial188.stdout:606: left oid 3 (ObjNum 240 snap 64 seq_num 240) 2026-02-13T20:14:26.908 INFO:tasks.rados.rados.0.trial188.stdout:606: done (5 left) 2026-02-13T20:14:26.908 INFO:tasks.rados.rados.0.trial188.stdout:614: delete oid 40 current snap is 64 2026-02-13T20:14:26.908 INFO:tasks.rados.rados.0.trial188.stdout:608: expect (ObjNum 179 snap 41 seq_num 179) 2026-02-13T20:14:26.908 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:14:26.969 INFO:tasks.rados.rados.0.trial188.stdout:610: expect (ObjNum 213 snap 57 seq_num 213) 2026-02-13T20:14:26.976 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 3130072 2026-02-13T20:14:26.984 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:14:27.024 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 3480853 2026-02-13T20:14:27.024 INFO:tasks.rados.rados.0.trial188.stdout:609: expect (ObjNum 187 snap 47 seq_num 187) 2026-02-13T20:14:27.030 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 901622 2026-02-13T20:14:27.053 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:14:27.089 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 620809 2026-02-13T20:14:27.117 INFO:tasks.rados.rados.0.trial188.stdout:612: finishing write tid 1 to trial18843701-34 2026-02-13T20:14:27.117 INFO:tasks.rados.rados.0.trial188.stdout:612: finishing write tid 2 to trial18843701-34 2026-02-13T20:14:27.117 INFO:tasks.rados.rados.0.trial188.stdout:612: finishing write tid 3 to trial18843701-34 2026-02-13T20:14:27.117 INFO:tasks.rados.rados.0.trial188.stdout:612: finishing write tid 4 to trial18843701-34 2026-02-13T20:14:27.117 INFO:tasks.rados.rados.0.trial188.stdout:612: oid 34 updating version 0 to 206 2026-02-13T20:14:27.117 INFO:tasks.rados.rados.0.trial188.stdout:612: oid 34 version 206 is already newer than 205 2026-02-13T20:14:27.117 INFO:tasks.rados.rados.0.trial188.stdout:612: oid 34 updating version 206 to 207 2026-02-13T20:14:27.118 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 34 v 207 (ObjNum 241 snap 64 seq_num 241) dirty exists 2026-02-13T20:14:27.118 INFO:tasks.rados.rados.0.trial188.stdout:612: left oid 34 (ObjNum 241 snap 64 seq_num 241) 2026-02-13T20:14:27.118 INFO:tasks.rados.rados.0.trial188.stdout:613: finishing copy_from racing read to trial18843701-10 2026-02-13T20:14:27.118 INFO:tasks.rados.rados.0.trial188.stdout:613: finishing copy_from to trial18843701-10 2026-02-13T20:14:27.118 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 10 v 221 (ObjNum 144 snap 27 seq_num 144) dirty exists 2026-02-13T20:14:27.118 INFO:tasks.rados.rados.0.trial188.stdout:608: done (5 left) 2026-02-13T20:14:27.118 INFO:tasks.rados.rados.0.trial188.stdout:609: done (4 left) 2026-02-13T20:14:27.118 INFO:tasks.rados.rados.0.trial188.stdout:610: done (3 left) 2026-02-13T20:14:27.118 INFO:tasks.rados.rados.0.trial188.stdout:612: done (2 left) 2026-02-13T20:14:27.118 INFO:tasks.rados.rados.0.trial188.stdout:613: done (1 left) 2026-02-13T20:14:27.119 INFO:tasks.rados.rados.0.trial188.stdout:614: done (0 left) 2026-02-13T20:14:27.119 INFO:tasks.rados.rados.0.trial188.stdout:615: read oid 4 snap 52 2026-02-13T20:14:27.119 INFO:tasks.rados.rados.0.trial188.stdout:615: expect (ObjNum 161 snap 32 seq_num 161) 2026-02-13T20:14:27.119 INFO:tasks.rados.rados.0.trial188.stdout:616: write oid 48 current snap is 64 2026-02-13T20:14:27.119 INFO:tasks.rados.rados.0.trial188.stdout:616: seq_num 243 ranges {484101=692450,1636889=447212} 2026-02-13T20:14:27.121 INFO:tasks.rados.rados.0.trial188.stdout:616: writing trial18843701-48 from 484101 to 1176551 tid 1 2026-02-13T20:14:27.125 INFO:tasks.rados.rados.0.trial188.stdout:616: writing trial18843701-48 from 1636889 to 2084101 tid 2 2026-02-13T20:14:27.125 INFO:tasks.rados.rados.0.trial188.stdout:617: write oid 50 current snap is 64 2026-02-13T20:14:27.125 INFO:tasks.rados.rados.0.trial188.stdout:617: seq_num 244 ranges {500908=484052,1411724=689184} 2026-02-13T20:14:27.128 INFO:tasks.rados.rados.0.trial188.stdout:617: writing trial18843701-50 from 500908 to 984960 tid 1 2026-02-13T20:14:27.133 INFO:tasks.rados.rados.0.trial188.stdout:617: writing trial18843701-50 from 1411724 to 2100908 tid 2 2026-02-13T20:14:27.133 INFO:tasks.rados.rados.0.trial188.stdout:618: rollback oid 15 current snap is 64 2026-02-13T20:14:27.133 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 15 to 61 2026-02-13T20:14:27.133 INFO:tasks.rados.rados.0.trial188.stdout:615: expect (ObjNum 161 snap 32 seq_num 161) 2026-02-13T20:14:27.155 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1843522 2026-02-13T20:14:27.243 INFO:tasks.rados.rados.0.trial188.stdout:616: finishing write tid 1 to trial18843701-48 2026-02-13T20:14:27.243 INFO:tasks.rados.rados.0.trial188.stdout:615: done (3 left) 2026-02-13T20:14:27.243 INFO:tasks.rados.rados.0.trial188.stdout:619: copy_from oid 18 from oid 25 current snap is 64 2026-02-13T20:14:27.244 INFO:tasks.rados.rados.0.trial188.stdout:616: finishing write tid 2 to trial18843701-48 2026-02-13T20:14:27.244 INFO:tasks.rados.rados.0.trial188.stdout:616: finishing write tid 3 to trial18843701-48 2026-02-13T20:14:27.244 INFO:tasks.rados.rados.0.trial188.stdout:616: finishing write tid 4 to trial18843701-48 2026-02-13T20:14:27.244 INFO:tasks.rados.rados.0.trial188.stdout:616: oid 48 updating version 0 to 106 2026-02-13T20:14:27.244 INFO:tasks.rados.rados.0.trial188.stdout:616: oid 48 version 106 is already newer than 105 2026-02-13T20:14:27.244 INFO:tasks.rados.rados.0.trial188.stdout:616: oid 48 updating version 106 to 107 2026-02-13T20:14:27.244 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 48 v 107 (ObjNum 243 snap 64 seq_num 243) dirty exists 2026-02-13T20:14:27.244 INFO:tasks.rados.rados.0.trial188.stdout:616: left oid 48 (ObjNum 243 snap 64 seq_num 243) 2026-02-13T20:14:27.244 INFO:tasks.rados.rados.0.trial188.stdout:617: finishing write tid 1 to trial18843701-50 2026-02-13T20:14:27.244 INFO:tasks.rados.rados.0.trial188.stdout:617: finishing write tid 2 to trial18843701-50 2026-02-13T20:14:27.244 INFO:tasks.rados.rados.0.trial188.stdout:617: finishing write tid 3 to trial18843701-50 2026-02-13T20:14:27.244 INFO:tasks.rados.rados.0.trial188.stdout:617: finishing write tid 4 to trial18843701-50 2026-02-13T20:14:27.245 INFO:tasks.rados.rados.0.trial188.stdout:617: oid 50 updating version 0 to 250 2026-02-13T20:14:27.245 INFO:tasks.rados.rados.0.trial188.stdout:617: oid 50 version 250 is already newer than 249 2026-02-13T20:14:27.245 INFO:tasks.rados.rados.0.trial188.stdout:617: oid 50 version 250 is already newer than 248 2026-02-13T20:14:27.245 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 50 v 250 (ObjNum 244 snap 64 seq_num 244) dirty exists 2026-02-13T20:14:27.245 INFO:tasks.rados.rados.0.trial188.stdout:617: left oid 50 (ObjNum 244 snap 64 seq_num 244) 2026-02-13T20:14:27.245 INFO:tasks.rados.rados.0.trial188.stdout:618: finishing rollback tid 0 to trial18843701-15 2026-02-13T20:14:27.245 INFO:tasks.rados.rados.0.trial188.stdout:616: done (3 left) 2026-02-13T20:14:27.245 INFO:tasks.rados.rados.0.trial188.stdout:617: done (2 left) 2026-02-13T20:14:27.245 INFO:tasks.rados.rados.0.trial188.stdout:620: snap_remove snap 49 2026-02-13T20:14:27.873 INFO:tasks.rados.rados.0.trial188.stdout:620: done (2 left) 2026-02-13T20:14:27.873 INFO:tasks.rados.rados.0.trial188.stdout:621: rollback oid 7 current snap is 64 2026-02-13T20:14:27.873 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 7 to 52 2026-02-13T20:14:27.873 INFO:tasks.rados.rados.0.trial188.stdout:618: finishing rollback tid 1 to trial18843701-15 2026-02-13T20:14:27.873 INFO:tasks.rados.rados.0.trial188.stdout:618: finishing rollback tid 2 to trial18843701-15 2026-02-13T20:14:27.873 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 15 v 247 (ObjNum 193 snap 47 seq_num 193) dirty exists 2026-02-13T20:14:27.874 INFO:tasks.rados.rados.0.trial188.stdout:619: finishing copy_from racing read to trial18843701-18 2026-02-13T20:14:27.874 INFO:tasks.rados.rados.0.trial188.stdout:619: finishing copy_from to trial18843701-18 2026-02-13T20:14:27.874 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 18 v 185 (ObjNum 170 snap 35 seq_num 170) dirty exists 2026-02-13T20:14:27.874 INFO:tasks.rados.rados.0.trial188.stdout:618: done (2 left) 2026-02-13T20:14:27.874 INFO:tasks.rados.rados.0.trial188.stdout:619: done (1 left) 2026-02-13T20:14:27.874 INFO:tasks.rados.rados.0.trial188.stdout:622: snap_remove snap 61 2026-02-13T20:14:28.874 INFO:tasks.rados.rados.0.trial188.stdout:622: done (1 left) 2026-02-13T20:14:28.875 INFO:tasks.rados.rados.0.trial188.stdout:623: write (excl) oid 46 current snap is 64 2026-02-13T20:14:28.875 INFO:tasks.rados.rados.0.trial188.stdout:621: finishing rollback tid 0 to trial18843701-7 2026-02-13T20:14:28.875 INFO:tasks.rados.rados.0.trial188.stdout:621: finishing rollback tid 1 to trial18843701-7 2026-02-13T20:14:28.875 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 7 v 267 (ObjNum 129 snap 0 seq_num 16158992) dirty dne 2026-02-13T20:14:28.875 INFO:tasks.rados.rados.0.trial188.stdout:623: seq_num 245 ranges {517715=559301,1870206=247509} 2026-02-13T20:14:28.877 INFO:tasks.rados.rados.0.trial188.stdout:623: writing trial18843701-46 from 517715 to 1077016 tid 1 2026-02-13T20:14:28.881 INFO:tasks.rados.rados.0.trial188.stdout:623: writing trial18843701-46 from 1870206 to 2117715 tid 2 2026-02-13T20:14:28.881 INFO:tasks.rados.rados.0.trial188.stdout:621: done (1 left) 2026-02-13T20:14:28.882 INFO:tasks.rados.rados.0.trial188.stdout:624: snap_create 2026-02-13T20:14:28.891 INFO:tasks.rados.rados.0.trial188.stdout:623: finishing write tid 1 to trial18843701-46 2026-02-13T20:14:28.891 INFO:tasks.rados.rados.0.trial188.stdout:623: finishing write tid 2 to trial18843701-46 2026-02-13T20:14:28.891 INFO:tasks.rados.rados.0.trial188.stdout:623: finishing write tid 3 to trial18843701-46 2026-02-13T20:14:28.892 INFO:tasks.rados.rados.0.trial188.stdout:623: finishing write tid 4 to trial18843701-46 2026-02-13T20:14:28.892 INFO:tasks.rados.rados.0.trial188.stdout:623: oid 46 updating version 0 to 193 2026-02-13T20:14:28.892 INFO:tasks.rados.rados.0.trial188.stdout:623: oid 46 updating version 193 to 194 2026-02-13T20:14:28.892 INFO:tasks.rados.rados.0.trial188.stdout:623: oid 46 updating version 194 to 195 2026-02-13T20:14:28.892 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 46 v 195 (ObjNum 245 snap 64 seq_num 245) dirty exists 2026-02-13T20:14:28.892 INFO:tasks.rados.rados.0.trial188.stdout:623: left oid 46 (ObjNum 245 snap 64 seq_num 245) 2026-02-13T20:14:29.874 INFO:tasks.rados.rados.0.trial188.stdout:623: done (1 left) 2026-02-13T20:14:29.874 INFO:tasks.rados.rados.0.trial188.stdout:624: done (0 left) 2026-02-13T20:14:29.874 INFO:tasks.rados.rados.0.trial188.stdout:625: read oid 18 snap -1 2026-02-13T20:14:29.874 INFO:tasks.rados.rados.0.trial188.stdout:625: expect (ObjNum 170 snap 35 seq_num 170) 2026-02-13T20:14:29.874 INFO:tasks.rados.rados.0.trial188.stdout:626: delete oid 32 current snap is 65 2026-02-13T20:14:29.875 INFO:tasks.rados.rados.0.trial188.stdout:626: done (1 left) 2026-02-13T20:14:29.876 INFO:tasks.rados.rados.0.trial188.stdout:627: snap_remove snap 39 2026-02-13T20:14:30.876 INFO:tasks.rados.rados.0.trial188.stdout:627: done (1 left) 2026-02-13T20:14:30.876 INFO:tasks.rados.rados.0.trial188.stdout:628: snap_remove snap 45 2026-02-13T20:14:31.877 INFO:tasks.rados.rados.0.trial188.stdout:628: done (1 left) 2026-02-13T20:14:31.878 INFO:tasks.rados.rados.0.trial188.stdout:629: copy_from oid 9 from oid 3 current snap is 65 2026-02-13T20:14:31.878 INFO:tasks.rados.rados.0.trial188.stdout:625: expect (ObjNum 170 snap 35 seq_num 170) 2026-02-13T20:14:31.878 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:14:31.993 INFO:tasks.rados.rados.0.trial188.stdout:629: finishing copy_from racing read to trial18843701-9 2026-02-13T20:14:31.993 INFO:tasks.rados.rados.0.trial188.stdout:629: finishing copy_from to trial18843701-9 2026-02-13T20:14:31.993 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 9 v 236 (ObjNum 240 snap 64 seq_num 240) dirty exists 2026-02-13T20:14:31.993 INFO:tasks.rados.rados.0.trial188.stdout:625: done (1 left) 2026-02-13T20:14:31.993 INFO:tasks.rados.rados.0.trial188.stdout:629: done (0 left) 2026-02-13T20:14:31.993 INFO:tasks.rados.rados.0.trial188.stdout:630: copy_from oid 24 from oid 47 current snap is 65 2026-02-13T20:14:31.993 INFO:tasks.rados.rados.0.trial188.stdout:631: rollback oid 36 current snap is 65 2026-02-13T20:14:31.993 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 36 to 59 2026-02-13T20:14:31.993 INFO:tasks.rados.rados.0.trial188.stdout:632: copy_from oid 41 from oid 33 current snap is 65 2026-02-13T20:14:31.993 INFO:tasks.rados.rados.0.trial188.stdout:633: snap_create 2026-02-13T20:14:31.994 INFO:tasks.rados.rados.0.trial188.stdout:631: finishing rollback tid 1 to trial18843701-36 2026-02-13T20:14:31.994 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 36 v 0 (ObjNum 705 snap 0 seq_num 16337815) dirty dne 2026-02-13T20:14:32.016 INFO:tasks.rados.rados.0.trial188.stdout:630: finishing copy_from racing read to trial18843701-24 2026-02-13T20:14:32.019 INFO:tasks.rados.rados.0.trial188.stdout:630: finishing copy_from to trial18843701-24 2026-02-13T20:14:32.019 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 24 v 159 (ObjNum 179 snap 41 seq_num 179) dirty exists 2026-02-13T20:14:32.024 INFO:tasks.rados.rados.0.trial188.stdout:632: finishing copy_from racing read to trial18843701-41 2026-02-13T20:14:32.025 INFO:tasks.rados.rados.0.trial188.stdout:632: finishing copy_from to trial18843701-41 2026-02-13T20:14:32.025 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 41 v 162 (ObjNum 187 snap 47 seq_num 187) dirty exists 2026-02-13T20:14:32.873 INFO:tasks.rados.rados.0.trial188.stdout:630: done (3 left) 2026-02-13T20:14:32.873 INFO:tasks.rados.rados.0.trial188.stdout:631: done (2 left) 2026-02-13T20:14:32.874 INFO:tasks.rados.rados.0.trial188.stdout:632: done (1 left) 2026-02-13T20:14:32.874 INFO:tasks.rados.rados.0.trial188.stdout:633: done (0 left) 2026-02-13T20:14:32.874 INFO:tasks.rados.rados.0.trial188.stdout:634: write oid 50 current snap is 66 2026-02-13T20:14:32.874 INFO:tasks.rados.rados.0.trial188.stdout:634: seq_num 247 ranges {551329=709799,1870817=280512} 2026-02-13T20:14:32.878 INFO:tasks.rados.rados.0.trial188.stdout:634: writing trial18843701-50 from 551329 to 1261128 tid 1 2026-02-13T20:14:32.881 INFO:tasks.rados.rados.0.trial188.stdout:634: writing trial18843701-50 from 1870817 to 2151329 tid 2 2026-02-13T20:14:32.882 INFO:tasks.rados.rados.0.trial188.stdout:635: read oid 26 snap 59 2026-02-13T20:14:32.882 INFO:tasks.rados.rados.0.trial188.stdout:635: expect (ObjNum 213 snap 57 seq_num 213) 2026-02-13T20:14:32.882 INFO:tasks.rados.rados.0.trial188.stdout:636: snap_create 2026-02-13T20:14:32.895 INFO:tasks.rados.rados.0.trial188.stdout:634: finishing write tid 1 to trial18843701-50 2026-02-13T20:14:32.896 INFO:tasks.rados.rados.0.trial188.stdout:634: finishing write tid 2 to trial18843701-50 2026-02-13T20:14:32.896 INFO:tasks.rados.rados.0.trial188.stdout:634: finishing write tid 3 to trial18843701-50 2026-02-13T20:14:32.896 INFO:tasks.rados.rados.0.trial188.stdout:634: finishing write tid 4 to trial18843701-50 2026-02-13T20:14:32.896 INFO:tasks.rados.rados.0.trial188.stdout:634: oid 50 updating version 0 to 279 2026-02-13T20:14:32.896 INFO:tasks.rados.rados.0.trial188.stdout:634: oid 50 version 279 is already newer than 277 2026-02-13T20:14:32.897 INFO:tasks.rados.rados.0.trial188.stdout:634: oid 50 version 279 is already newer than 278 2026-02-13T20:14:32.897 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 50 v 279 (ObjNum 247 snap 66 seq_num 247) dirty exists 2026-02-13T20:14:32.897 INFO:tasks.rados.rados.0.trial188.stdout:634: left oid 50 (ObjNum 247 snap 66 seq_num 247) 2026-02-13T20:14:32.897 INFO:tasks.rados.rados.0.trial188.stdout:635: expect (ObjNum 213 snap 57 seq_num 213) 2026-02-13T20:14:33.876 INFO:tasks.rados.rados.0.trial188.stdout:634: done (2 left) 2026-02-13T20:14:33.876 INFO:tasks.rados.rados.0.trial188.stdout:635: done (1 left) 2026-02-13T20:14:33.876 INFO:tasks.rados.rados.0.trial188.stdout:636: done (0 left) 2026-02-13T20:14:33.876 INFO:tasks.rados.rados.0.trial188.stdout:637: snap_remove snap 59 2026-02-13T20:14:34.876 INFO:tasks.rados.rados.0.trial188.stdout:637: done (0 left) 2026-02-13T20:14:34.876 INFO:tasks.rados.rados.0.trial188.stdout:638: read oid 46 snap -1 2026-02-13T20:14:34.876 INFO:tasks.rados.rados.0.trial188.stdout:638: expect (ObjNum 245 snap 64 seq_num 245) 2026-02-13T20:14:34.876 INFO:tasks.rados.rados.0.trial188.stdout:639: snap_remove snap 66 2026-02-13T20:14:35.877 INFO:tasks.rados.rados.0.trial188.stdout:639: done (1 left) 2026-02-13T20:14:35.877 INFO:tasks.rados.rados.0.trial188.stdout:640: delete oid 39 current snap is 67 2026-02-13T20:14:35.878 INFO:tasks.rados.rados.0.trial188.stdout:638: expect (ObjNum 245 snap 64 seq_num 245) 2026-02-13T20:14:35.921 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:14:35.946 INFO:tasks.rados.rados.0.trial188.stdout:638: done (1 left) 2026-02-13T20:14:35.946 INFO:tasks.rados.rados.0.trial188.stdout:640: done (0 left) 2026-02-13T20:14:35.946 INFO:tasks.rados.rados.0.trial188.stdout:641: read oid 47 snap 62 2026-02-13T20:14:35.947 INFO:tasks.rados.rados.0.trial188.stdout:641: expect (ObjNum 179 snap 41 seq_num 179) 2026-02-13T20:14:35.947 INFO:tasks.rados.rados.0.trial188.stdout:642: write oid 21 current snap is 67 2026-02-13T20:14:35.947 INFO:tasks.rados.rados.0.trial188.stdout:642: seq_num 249 ranges {584943=460297,1587781=597162} 2026-02-13T20:14:35.950 INFO:tasks.rados.rados.0.trial188.stdout:642: writing trial18843701-21 from 584943 to 1045240 tid 1 2026-02-13T20:14:35.955 INFO:tasks.rados.rados.0.trial188.stdout:642: writing trial18843701-21 from 1587781 to 2184943 tid 2 2026-02-13T20:14:35.955 INFO:tasks.rados.rados.0.trial188.stdout:643: delete oid 46 current snap is 67 2026-02-13T20:14:35.956 INFO:tasks.rados.rados.0.trial188.stdout:641: expect (ObjNum 179 snap 41 seq_num 179) 2026-02-13T20:14:35.956 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:14:35.999 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:14:36.021 INFO:tasks.rados.rados.0.trial188.stdout:642: finishing write tid 1 to trial18843701-21 2026-02-13T20:14:36.021 INFO:tasks.rados.rados.0.trial188.stdout:642: finishing write tid 2 to trial18843701-21 2026-02-13T20:14:36.021 INFO:tasks.rados.rados.0.trial188.stdout:641: done (2 left) 2026-02-13T20:14:36.022 INFO:tasks.rados.rados.0.trial188.stdout:643: done (1 left) 2026-02-13T20:14:36.022 INFO:tasks.rados.rados.0.trial188.stdout:644: delete oid 3 current snap is 67 2026-02-13T20:14:36.022 INFO:tasks.rados.rados.0.trial188.stdout:642: finishing write tid 3 to trial18843701-21 2026-02-13T20:14:36.022 INFO:tasks.rados.rados.0.trial188.stdout:642: finishing write tid 4 to trial18843701-21 2026-02-13T20:14:36.022 INFO:tasks.rados.rados.0.trial188.stdout:642: oid 21 updating version 0 to 124 2026-02-13T20:14:36.022 INFO:tasks.rados.rados.0.trial188.stdout:642: oid 21 version 124 is already newer than 123 2026-02-13T20:14:36.022 INFO:tasks.rados.rados.0.trial188.stdout:642: oid 21 updating version 124 to 125 2026-02-13T20:14:36.022 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 21 v 125 (ObjNum 249 snap 67 seq_num 249) dirty exists 2026-02-13T20:14:36.022 INFO:tasks.rados.rados.0.trial188.stdout:642: left oid 21 (ObjNum 249 snap 67 seq_num 249) 2026-02-13T20:14:36.023 INFO:tasks.rados.rados.0.trial188.stdout:642: done (1 left) 2026-02-13T20:14:36.023 INFO:tasks.rados.rados.0.trial188.stdout:644: done (0 left) 2026-02-13T20:14:36.023 INFO:tasks.rados.rados.0.trial188.stdout:645: snap_remove snap 65 2026-02-13T20:14:36.883 INFO:tasks.rados.rados.0.trial188.stdout:645: done (0 left) 2026-02-13T20:14:36.884 INFO:tasks.rados.rados.0.trial188.stdout:646: write (excl) oid 21 current snap is 67 2026-02-13T20:14:36.884 INFO:tasks.rados.rados.0.trial188.stdout:646: seq_num 252 ranges {635364=402397,1763227=472137} 2026-02-13T20:14:36.887 INFO:tasks.rados.rados.0.trial188.stdout:646: writing trial18843701-21 from 635364 to 1037761 tid 1 2026-02-13T20:14:36.892 INFO:tasks.rados.rados.0.trial188.stdout:646: writing trial18843701-21 from 1763227 to 2235364 tid 2 2026-02-13T20:14:36.892 INFO:tasks.rados.rados.0.trial188.stdout:647: read oid 25 snap -1 2026-02-13T20:14:36.893 INFO:tasks.rados.rados.0.trial188.stdout:647: expect (ObjNum 170 snap 35 seq_num 170) 2026-02-13T20:14:36.893 INFO:tasks.rados.rados.0.trial188.stdout:648: copy_from oid 44 from oid 7 current snap is 67 2026-02-13T20:14:36.893 INFO:tasks.rados.rados.0.trial188.stdout:649: snap_create 2026-02-13T20:14:36.893 INFO:tasks.rados.rados.0.trial188.stdout:648: finishing copy_from to trial18843701-44 2026-02-13T20:14:36.893 INFO:tasks.rados.rados.0.trial188.stdout:648: got expected ENOENT (src dne) 2026-02-13T20:14:36.893 INFO:tasks.rados.rados.0.trial188.stdout:648: finishing copy_from racing read to trial18843701-44 2026-02-13T20:14:36.895 INFO:tasks.rados.rados.0.trial188.stdout:647: expect (ObjNum 170 snap 35 seq_num 170) 2026-02-13T20:14:36.952 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1967955 2026-02-13T20:14:37.007 INFO:tasks.rados.rados.0.trial188.stdout:646: finishing write tid 1 to trial18843701-21 2026-02-13T20:14:37.007 INFO:tasks.rados.rados.0.trial188.stdout:646: finishing write tid 2 to trial18843701-21 2026-02-13T20:14:37.007 INFO:tasks.rados.rados.0.trial188.stdout:646: finishing write tid 3 to trial18843701-21 2026-02-13T20:14:37.007 INFO:tasks.rados.rados.0.trial188.stdout:646: finishing write tid 4 to trial18843701-21 2026-02-13T20:14:37.007 INFO:tasks.rados.rados.0.trial188.stdout:646: oid 21 updating version 0 to 130 2026-02-13T20:14:37.007 INFO:tasks.rados.rados.0.trial188.stdout:646: oid 21 version 130 is already newer than 126 2026-02-13T20:14:37.007 INFO:tasks.rados.rados.0.trial188.stdout:646: oid 21 version 130 is already newer than 129 2026-02-13T20:14:37.008 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 21 v 130 (ObjNum 252 snap 67 seq_num 252) dirty exists 2026-02-13T20:14:37.008 INFO:tasks.rados.rados.0.trial188.stdout:646: left oid 21 (ObjNum 252 snap 67 seq_num 252) 2026-02-13T20:14:37.873 INFO:tasks.rados.rados.0.trial188.stdout:646: done (3 left) 2026-02-13T20:14:37.873 INFO:tasks.rados.rados.0.trial188.stdout:647: done (2 left) 2026-02-13T20:14:37.874 INFO:tasks.rados.rados.0.trial188.stdout:648: done (1 left) 2026-02-13T20:14:37.874 INFO:tasks.rados.rados.0.trial188.stdout:649: done (0 left) 2026-02-13T20:14:37.874 INFO:tasks.rados.rados.0.trial188.stdout:650: copy_from oid 35 from oid 36 current snap is 68 2026-02-13T20:14:37.874 INFO:tasks.rados.rados.0.trial188.stdout:651: write (excl) oid 10 current snap is 68 2026-02-13T20:14:37.874 INFO:tasks.rados.rados.0.trial188.stdout:651: seq_num 253 ranges {652171=477646,1821709=430462} 2026-02-13T20:14:37.877 INFO:tasks.rados.rados.0.trial188.stdout:651: writing trial18843701-10 from 652171 to 1129817 tid 1 2026-02-13T20:14:37.881 INFO:tasks.rados.rados.0.trial188.stdout:651: writing trial18843701-10 from 1821709 to 2252171 tid 2 2026-02-13T20:14:37.882 INFO:tasks.rados.rados.0.trial188.stdout:652: snap_remove snap 67 2026-02-13T20:14:38.873 INFO:tasks.rados.rados.0.trial188.stdout:652: done (2 left) 2026-02-13T20:14:38.873 INFO:tasks.rados.rados.0.trial188.stdout:653: write oid 30 current snap is 68 2026-02-13T20:14:38.874 INFO:tasks.rados.rados.0.trial188.stdout:653: seq_num 254 ranges {668978=552895,1763838=505140} 2026-02-13T20:14:38.878 INFO:tasks.rados.rados.0.trial188.stdout:653: writing trial18843701-30 from 668978 to 1221873 tid 1 2026-02-13T20:14:38.882 INFO:tasks.rados.rados.0.trial188.stdout:653: writing trial18843701-30 from 1763838 to 2268978 tid 2 2026-02-13T20:14:38.882 INFO:tasks.rados.rados.0.trial188.stdout:654: write (excl) oid 12 current snap is 68 2026-02-13T20:14:38.882 INFO:tasks.rados.rados.0.trial188.stdout:654: seq_num 255 ranges {685785=628144,1822320=463465} 2026-02-13T20:14:38.887 INFO:tasks.rados.rados.0.trial188.stdout:654: writing trial18843701-12 from 685785 to 1313929 tid 1 2026-02-13T20:14:38.891 INFO:tasks.rados.rados.0.trial188.stdout:654: writing trial18843701-12 from 1822320 to 2285785 tid 2 2026-02-13T20:14:38.891 INFO:tasks.rados.rados.0.trial188.stdout:655: copy_from oid 50 from oid 3 current snap is 68 2026-02-13T20:14:38.891 INFO:tasks.rados.rados.0.trial188.stdout:650: finishing copy_from to trial18843701-35 2026-02-13T20:14:38.891 INFO:tasks.rados.rados.0.trial188.stdout:650: got expected ENOENT (src dne) 2026-02-13T20:14:38.892 INFO:tasks.rados.rados.0.trial188.stdout:650: finishing copy_from racing read to trial18843701-35 2026-02-13T20:14:38.892 INFO:tasks.rados.rados.0.trial188.stdout:651: finishing write tid 1 to trial18843701-10 2026-02-13T20:14:38.892 INFO:tasks.rados.rados.0.trial188.stdout:651: finishing write tid 2 to trial18843701-10 2026-02-13T20:14:38.892 INFO:tasks.rados.rados.0.trial188.stdout:651: finishing write tid 3 to trial18843701-10 2026-02-13T20:14:38.892 INFO:tasks.rados.rados.0.trial188.stdout:651: finishing write tid 4 to trial18843701-10 2026-02-13T20:14:38.892 INFO:tasks.rados.rados.0.trial188.stdout:651: oid 10 updating version 0 to 222 2026-02-13T20:14:38.892 INFO:tasks.rados.rados.0.trial188.stdout:651: oid 10 updating version 222 to 224 2026-02-13T20:14:38.892 INFO:tasks.rados.rados.0.trial188.stdout:651: oid 10 version 224 is already newer than 223 2026-02-13T20:14:38.892 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 10 v 224 (ObjNum 253 snap 68 seq_num 253) dirty exists 2026-02-13T20:14:38.892 INFO:tasks.rados.rados.0.trial188.stdout:651: left oid 10 (ObjNum 253 snap 68 seq_num 253) 2026-02-13T20:14:38.892 INFO:tasks.rados.rados.0.trial188.stdout:650: done (4 left) 2026-02-13T20:14:38.893 INFO:tasks.rados.rados.0.trial188.stdout:651: done (3 left) 2026-02-13T20:14:38.893 INFO:tasks.rados.rados.0.trial188.stdout:656: snap_remove snap 52 2026-02-13T20:14:39.885 INFO:tasks.rados.rados.0.trial188.stdout:656: done (3 left) 2026-02-13T20:14:39.885 INFO:tasks.rados.rados.0.trial188.stdout:657: snap_remove snap 62 2026-02-13T20:14:40.887 INFO:tasks.rados.rados.0.trial188.stdout:657: done (3 left) 2026-02-13T20:14:40.887 INFO:tasks.rados.rados.0.trial188.stdout:658: read oid 15 snap -1 2026-02-13T20:14:40.887 INFO:tasks.rados.rados.0.trial188.stdout:658: expect (ObjNum 193 snap 47 seq_num 193) 2026-02-13T20:14:40.887 INFO:tasks.rados.rados.0.trial188.stdout:659: write (excl) oid 23 current snap is 68 2026-02-13T20:14:40.887 INFO:tasks.rados.rados.0.trial188.stdout:659: seq_num 256 ranges {702592=703393,1880802=421790} 2026-02-13T20:14:40.892 INFO:tasks.rados.rados.0.trial188.stdout:659: writing trial18843701-23 from 702592 to 1405985 tid 1 2026-02-13T20:14:40.896 INFO:tasks.rados.rados.0.trial188.stdout:659: writing trial18843701-23 from 1880802 to 2302592 tid 2 2026-02-13T20:14:40.896 INFO:tasks.rados.rados.0.trial188.stdout:660: read oid 8 snap 64 2026-02-13T20:14:40.896 INFO:tasks.rados.rados.0.trial188.stdout:660: expect (ObjNum 230 snap 63 seq_num 230) 2026-02-13T20:14:40.896 INFO:tasks.rados.rados.0.trial188.stdout:661: copy_from oid 25 from oid 39 current snap is 68 2026-02-13T20:14:40.896 INFO:tasks.rados.rados.0.trial188.stdout:655: finishing copy_from to trial18843701-50 2026-02-13T20:14:40.896 INFO:tasks.rados.rados.0.trial188.stdout:655: got expected ENOENT (src dne) 2026-02-13T20:14:40.896 INFO:tasks.rados.rados.0.trial188.stdout:655: finishing copy_from racing read to trial18843701-50 2026-02-13T20:14:40.896 INFO:tasks.rados.rados.0.trial188.stdout:653: finishing write tid 1 to trial18843701-30 2026-02-13T20:14:40.896 INFO:tasks.rados.rados.0.trial188.stdout:653: finishing write tid 2 to trial18843701-30 2026-02-13T20:14:40.896 INFO:tasks.rados.rados.0.trial188.stdout:653: finishing write tid 3 to trial18843701-30 2026-02-13T20:14:40.896 INFO:tasks.rados.rados.0.trial188.stdout:653: finishing write tid 4 to trial18843701-30 2026-02-13T20:14:40.896 INFO:tasks.rados.rados.0.trial188.stdout:653: oid 30 updating version 0 to 272 2026-02-13T20:14:40.896 INFO:tasks.rados.rados.0.trial188.stdout:653: oid 30 version 272 is already newer than 271 2026-02-13T20:14:40.896 INFO:tasks.rados.rados.0.trial188.stdout:653: oid 30 version 272 is already newer than 270 2026-02-13T20:14:40.896 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 30 v 272 (ObjNum 254 snap 68 seq_num 254) dirty exists 2026-02-13T20:14:40.896 INFO:tasks.rados.rados.0.trial188.stdout:653: left oid 30 (ObjNum 254 snap 68 seq_num 254) 2026-02-13T20:14:40.896 INFO:tasks.rados.rados.0.trial188.stdout:654: finishing write tid 1 to trial18843701-12 2026-02-13T20:14:40.896 INFO:tasks.rados.rados.0.trial188.stdout:654: finishing write tid 2 to trial18843701-12 2026-02-13T20:14:40.896 INFO:tasks.rados.rados.0.trial188.stdout:654: finishing write tid 3 to trial18843701-12 2026-02-13T20:14:40.896 INFO:tasks.rados.rados.0.trial188.stdout:654: finishing write tid 4 to trial18843701-12 2026-02-13T20:14:40.896 INFO:tasks.rados.rados.0.trial188.stdout:654: oid 12 updating version 0 to 188 2026-02-13T20:14:40.896 INFO:tasks.rados.rados.0.trial188.stdout:654: oid 12 version 188 is already newer than 187 2026-02-13T20:14:40.896 INFO:tasks.rados.rados.0.trial188.stdout:654: oid 12 version 188 is already newer than 186 2026-02-13T20:14:40.896 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 12 v 188 (ObjNum 255 snap 68 seq_num 255) dirty exists 2026-02-13T20:14:40.896 INFO:tasks.rados.rados.0.trial188.stdout:654: left oid 12 (ObjNum 255 snap 68 seq_num 255) 2026-02-13T20:14:40.896 INFO:tasks.rados.rados.0.trial188.stdout:658: expect (ObjNum 193 snap 47 seq_num 193) 2026-02-13T20:14:40.910 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:14:40.956 INFO:tasks.rados.rados.0.trial188.stdout:661: finishing copy_from to trial18843701-25 2026-02-13T20:14:40.956 INFO:tasks.rados.rados.0.trial188.stdout:661: got expected ENOENT (src dne) 2026-02-13T20:14:40.956 INFO:tasks.rados.rados.0.trial188.stdout:661: finishing copy_from racing read to trial18843701-25 2026-02-13T20:14:40.957 INFO:tasks.rados.rados.0.trial188.stdout:660: expect (ObjNum 230 snap 63 seq_num 230) 2026-02-13T20:14:41.102 INFO:tasks.rados.rados.0.trial188.stdout:659: finishing write tid 1 to trial18843701-23 2026-02-13T20:14:41.103 INFO:tasks.rados.rados.0.trial188.stdout:653: done (6 left) 2026-02-13T20:14:41.103 INFO:tasks.rados.rados.0.trial188.stdout:654: done (5 left) 2026-02-13T20:14:41.103 INFO:tasks.rados.rados.0.trial188.stdout:655: done (4 left) 2026-02-13T20:14:41.103 INFO:tasks.rados.rados.0.trial188.stdout:658: done (3 left) 2026-02-13T20:14:41.103 INFO:tasks.rados.rados.0.trial188.stdout:660: done (2 left) 2026-02-13T20:14:41.103 INFO:tasks.rados.rados.0.trial188.stdout:661: done (1 left) 2026-02-13T20:14:41.103 INFO:tasks.rados.rados.0.trial188.stdout:662: copy_from oid 25 from oid 1 current snap is 68 2026-02-13T20:14:41.104 INFO:tasks.rados.rados.0.trial188.stdout:659: finishing write tid 2 to trial18843701-23 2026-02-13T20:14:41.104 INFO:tasks.rados.rados.0.trial188.stdout:659: finishing write tid 3 to trial18843701-23 2026-02-13T20:14:41.104 INFO:tasks.rados.rados.0.trial188.stdout:659: finishing write tid 4 to trial18843701-23 2026-02-13T20:14:41.104 INFO:tasks.rados.rados.0.trial188.stdout:659: oid 23 updating version 0 to 294 2026-02-13T20:14:41.104 INFO:tasks.rados.rados.0.trial188.stdout:659: oid 23 updating version 294 to 300 2026-02-13T20:14:41.104 INFO:tasks.rados.rados.0.trial188.stdout:659: oid 23 version 300 is already newer than 299 2026-02-13T20:14:41.104 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 23 v 300 (ObjNum 256 snap 68 seq_num 256) dirty exists 2026-02-13T20:14:41.104 INFO:tasks.rados.rados.0.trial188.stdout:659: left oid 23 (ObjNum 256 snap 68 seq_num 256) 2026-02-13T20:14:41.104 INFO:tasks.rados.rados.0.trial188.stdout:659: done (1 left) 2026-02-13T20:14:41.104 INFO:tasks.rados.rados.0.trial188.stdout:663: read oid 35 snap -1 2026-02-13T20:14:41.104 INFO:tasks.rados.rados.0.trial188.stdout:663: expect (ObjNum 187 snap 47 seq_num 187) 2026-02-13T20:14:41.104 INFO:tasks.rados.rados.0.trial188.stdout:664: copy_from oid 15 from oid 19 current snap is 68 2026-02-13T20:14:41.105 INFO:tasks.rados.rados.0.trial188.stdout:665: write oid 27 current snap is 68 2026-02-13T20:14:41.105 INFO:tasks.rados.rados.0.trial188.stdout:665: seq_num 257 ranges {719399=778642,1939284=380115} 2026-02-13T20:14:41.107 INFO:tasks.rados.rados.0.trial188.stdout:665: writing trial18843701-27 from 719399 to 1498041 tid 1 2026-02-13T20:14:41.110 INFO:tasks.rados.rados.0.trial188.stdout:665: writing trial18843701-27 from 1939284 to 2319399 tid 2 2026-02-13T20:14:41.110 INFO:tasks.rados.rados.0.trial188.stdout:666: write oid 23 current snap is 68 2026-02-13T20:14:41.110 INFO:tasks.rados.rados.0.trial188.stdout:666: seq_num 258 ranges {736206=453891,1881413=454793} 2026-02-13T20:14:41.115 INFO:tasks.rados.rados.0.trial188.stdout:666: writing trial18843701-23 from 736206 to 1190097 tid 1 2026-02-13T20:14:41.119 INFO:tasks.rados.rados.0.trial188.stdout:666: writing trial18843701-23 from 1881413 to 2336206 tid 2 2026-02-13T20:14:41.119 INFO:tasks.rados.rados.0.trial188.stdout:667: write oid 2 current snap is 68 2026-02-13T20:14:41.119 INFO:tasks.rados.rados.0.trial188.stdout:667: seq_num 259 ranges {753013=645493,2056248=296765} 2026-02-13T20:14:41.124 INFO:tasks.rados.rados.0.trial188.stdout:667: writing trial18843701-2 from 753013 to 1398506 tid 1 2026-02-13T20:14:41.128 INFO:tasks.rados.rados.0.trial188.stdout:667: writing trial18843701-2 from 2056248 to 2353013 tid 2 2026-02-13T20:14:41.128 INFO:tasks.rados.rados.0.trial188.stdout:668: write (excl) oid 13 current snap is 68 2026-02-13T20:14:41.129 INFO:tasks.rados.rados.0.trial188.stdout:668: seq_num 260 ranges {769820=720742,2114730=255090} 2026-02-13T20:14:41.133 INFO:tasks.rados.rados.0.trial188.stdout:668: writing trial18843701-13 from 769820 to 1490562 tid 1 2026-02-13T20:14:41.137 INFO:tasks.rados.rados.0.trial188.stdout:668: writing trial18843701-13 from 2114730 to 2369820 tid 2 2026-02-13T20:14:41.137 INFO:tasks.rados.rados.0.trial188.stdout:669: write oid 7 current snap is 68 2026-02-13T20:14:41.138 INFO:tasks.rados.rados.0.trial188.stdout:669: seq_num 261 ranges {786627=795991,2173212=213415} 2026-02-13T20:14:41.143 INFO:tasks.rados.rados.0.trial188.stdout:669: writing trial18843701-7 from 786627 to 1582618 tid 1 2026-02-13T20:14:41.146 INFO:tasks.rados.rados.0.trial188.stdout:669: writing trial18843701-7 from 2173212 to 2386627 tid 2 2026-02-13T20:14:41.146 INFO:tasks.rados.rados.0.trial188.stdout:670: copy_from oid 38 from oid 49 current snap is 68 2026-02-13T20:14:41.146 INFO:tasks.rados.rados.0.trial188.stdout:663: expect (ObjNum 187 snap 47 seq_num 187) 2026-02-13T20:14:41.218 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2539387 2026-02-13T20:14:41.227 INFO:tasks.rados.rados.0.trial188.stdout:664: finishing copy_from racing read to trial18843701-15 2026-02-13T20:14:41.228 INFO:tasks.rados.rados.0.trial188.stdout:662: finishing copy_from racing read to trial18843701-25 2026-02-13T20:14:41.228 INFO:tasks.rados.rados.0.trial188.stdout:666: finishing write tid 1 to trial18843701-23 2026-02-13T20:14:41.228 INFO:tasks.rados.rados.0.trial188.stdout:663: done (8 left) 2026-02-13T20:14:41.228 INFO:tasks.rados.rados.0.trial188.stdout:671: delete oid 44 current snap is 68 2026-02-13T20:14:41.228 INFO:tasks.rados.rados.0.trial188.stdout:666: finishing write tid 2 to trial18843701-23 2026-02-13T20:14:41.228 INFO:tasks.rados.rados.0.trial188.stdout:666: finishing write tid 3 to trial18843701-23 2026-02-13T20:14:41.228 INFO:tasks.rados.rados.0.trial188.stdout:664: finishing copy_from to trial18843701-15 2026-02-13T20:14:41.228 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 15 v 159 (ObjNum 179 snap 41 seq_num 179) dirty exists 2026-02-13T20:14:41.229 INFO:tasks.rados.rados.0.trial188.stdout:666: finishing write tid 4 to trial18843701-23 2026-02-13T20:14:41.229 INFO:tasks.rados.rados.0.trial188.stdout:666: oid 23 updating version 0 to 302 2026-02-13T20:14:41.229 INFO:tasks.rados.rados.0.trial188.stdout:666: oid 23 updating version 302 to 303 2026-02-13T20:14:41.229 INFO:tasks.rados.rados.0.trial188.stdout:666: oid 23 version 303 is already newer than 301 2026-02-13T20:14:41.229 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 23 v 303 (ObjNum 258 snap 68 seq_num 258) dirty exists 2026-02-13T20:14:41.229 INFO:tasks.rados.rados.0.trial188.stdout:666: left oid 23 (ObjNum 258 snap 68 seq_num 258) 2026-02-13T20:14:41.229 INFO:tasks.rados.rados.0.trial188.stdout:667: finishing write tid 1 to trial18843701-2 2026-02-13T20:14:41.229 INFO:tasks.rados.rados.0.trial188.stdout:662: finishing copy_from to trial18843701-25 2026-02-13T20:14:41.229 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 25 v 272 (ObjNum 184 snap 43 seq_num 184) dirty exists 2026-02-13T20:14:41.229 INFO:tasks.rados.rados.0.trial188.stdout:667: finishing write tid 2 to trial18843701-2 2026-02-13T20:14:41.229 INFO:tasks.rados.rados.0.trial188.stdout:667: finishing write tid 3 to trial18843701-2 2026-02-13T20:14:41.229 INFO:tasks.rados.rados.0.trial188.stdout:667: finishing write tid 4 to trial18843701-2 2026-02-13T20:14:41.230 INFO:tasks.rados.rados.0.trial188.stdout:667: oid 2 updating version 0 to 358 2026-02-13T20:14:41.230 INFO:tasks.rados.rados.0.trial188.stdout:667: oid 2 updating version 358 to 360 2026-02-13T20:14:41.230 INFO:tasks.rados.rados.0.trial188.stdout:667: oid 2 version 360 is already newer than 359 2026-02-13T20:14:41.230 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 2 v 360 (ObjNum 259 snap 68 seq_num 259) dirty exists 2026-02-13T20:14:41.230 INFO:tasks.rados.rados.0.trial188.stdout:667: left oid 2 (ObjNum 259 snap 68 seq_num 259) 2026-02-13T20:14:41.230 INFO:tasks.rados.rados.0.trial188.stdout:665: finishing write tid 1 to trial18843701-27 2026-02-13T20:14:41.230 INFO:tasks.rados.rados.0.trial188.stdout:665: finishing write tid 2 to trial18843701-27 2026-02-13T20:14:41.230 INFO:tasks.rados.rados.0.trial188.stdout:665: finishing write tid 3 to trial18843701-27 2026-02-13T20:14:41.230 INFO:tasks.rados.rados.0.trial188.stdout:665: finishing write tid 4 to trial18843701-27 2026-02-13T20:14:41.230 INFO:tasks.rados.rados.0.trial188.stdout:665: oid 27 updating version 0 to 287 2026-02-13T20:14:41.230 INFO:tasks.rados.rados.0.trial188.stdout:665: oid 27 version 287 is already newer than 286 2026-02-13T20:14:41.230 INFO:tasks.rados.rados.0.trial188.stdout:665: oid 27 updating version 287 to 288 2026-02-13T20:14:41.230 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 27 v 288 (ObjNum 257 snap 68 seq_num 257) dirty exists 2026-02-13T20:14:41.231 INFO:tasks.rados.rados.0.trial188.stdout:665: left oid 27 (ObjNum 257 snap 68 seq_num 257) 2026-02-13T20:14:41.231 INFO:tasks.rados.rados.0.trial188.stdout:668: finishing write tid 1 to trial18843701-13 2026-02-13T20:14:41.231 INFO:tasks.rados.rados.0.trial188.stdout:668: finishing write tid 2 to trial18843701-13 2026-02-13T20:14:41.231 INFO:tasks.rados.rados.0.trial188.stdout:668: finishing write tid 3 to trial18843701-13 2026-02-13T20:14:41.231 INFO:tasks.rados.rados.0.trial188.stdout:668: finishing write tid 4 to trial18843701-13 2026-02-13T20:14:41.231 INFO:tasks.rados.rados.0.trial188.stdout:668: oid 13 updating version 0 to 361 2026-02-13T20:14:41.231 INFO:tasks.rados.rados.0.trial188.stdout:668: oid 13 updating version 361 to 362 2026-02-13T20:14:41.231 INFO:tasks.rados.rados.0.trial188.stdout:668: oid 13 updating version 362 to 363 2026-02-13T20:14:41.231 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 13 v 363 (ObjNum 260 snap 68 seq_num 260) dirty exists 2026-02-13T20:14:41.231 INFO:tasks.rados.rados.0.trial188.stdout:668: left oid 13 (ObjNum 260 snap 68 seq_num 260) 2026-02-13T20:14:41.231 INFO:tasks.rados.rados.0.trial188.stdout:669: finishing write tid 1 to trial18843701-7 2026-02-13T20:14:41.231 INFO:tasks.rados.rados.0.trial188.stdout:669: finishing write tid 2 to trial18843701-7 2026-02-13T20:14:41.231 INFO:tasks.rados.rados.0.trial188.stdout:669: finishing write tid 3 to trial18843701-7 2026-02-13T20:14:41.231 INFO:tasks.rados.rados.0.trial188.stdout:669: finishing write tid 4 to trial18843701-7 2026-02-13T20:14:41.232 INFO:tasks.rados.rados.0.trial188.stdout:669: oid 7 updating version 0 to 321 2026-02-13T20:14:41.232 INFO:tasks.rados.rados.0.trial188.stdout:669: oid 7 version 321 is already newer than 320 2026-02-13T20:14:41.232 INFO:tasks.rados.rados.0.trial188.stdout:669: oid 7 updating version 321 to 322 2026-02-13T20:14:41.232 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 7 v 322 (ObjNum 261 snap 68 seq_num 261) dirty exists 2026-02-13T20:14:41.232 INFO:tasks.rados.rados.0.trial188.stdout:669: left oid 7 (ObjNum 261 snap 68 seq_num 261) 2026-02-13T20:14:41.232 INFO:tasks.rados.rados.0.trial188.stdout:670: finishing copy_from racing read to trial18843701-38 2026-02-13T20:14:41.232 INFO:tasks.rados.rados.0.trial188.stdout:670: finishing copy_from to trial18843701-38 2026-02-13T20:14:41.232 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 38 v 178 (ObjNum 193 snap 47 seq_num 193) dirty exists 2026-02-13T20:14:41.232 INFO:tasks.rados.rados.0.trial188.stdout:662: done (8 left) 2026-02-13T20:14:41.232 INFO:tasks.rados.rados.0.trial188.stdout:664: done (7 left) 2026-02-13T20:14:41.232 INFO:tasks.rados.rados.0.trial188.stdout:665: done (6 left) 2026-02-13T20:14:41.232 INFO:tasks.rados.rados.0.trial188.stdout:666: done (5 left) 2026-02-13T20:14:41.233 INFO:tasks.rados.rados.0.trial188.stdout:667: done (4 left) 2026-02-13T20:14:41.233 INFO:tasks.rados.rados.0.trial188.stdout:668: done (3 left) 2026-02-13T20:14:41.233 INFO:tasks.rados.rados.0.trial188.stdout:669: done (2 left) 2026-02-13T20:14:41.233 INFO:tasks.rados.rados.0.trial188.stdout:670: done (1 left) 2026-02-13T20:14:41.233 INFO:tasks.rados.rados.0.trial188.stdout:671: done (0 left) 2026-02-13T20:14:41.233 INFO:tasks.rados.rados.0.trial188.stdout:672: snap_remove snap 64 2026-02-13T20:14:41.892 INFO:tasks.rados.rados.0.trial188.stdout:672: done (0 left) 2026-02-13T20:14:41.892 INFO:tasks.rados.rados.0.trial188.stdout:673: delete oid 47 current snap is 68 2026-02-13T20:14:41.894 INFO:tasks.rados.rados.0.trial188.stdout:673: done (0 left) 2026-02-13T20:14:41.894 INFO:tasks.rados.rados.0.trial188.stdout:674: snap_create 2026-02-13T20:14:42.874 INFO:tasks.rados.rados.0.trial188.stdout:674: done (0 left) 2026-02-13T20:14:42.874 INFO:tasks.rados.rados.0.trial188.stdout:675: snap_remove snap 68 2026-02-13T20:14:43.876 INFO:tasks.rados.rados.0.trial188.stdout:675: done (0 left) 2026-02-13T20:14:43.876 INFO:tasks.rados.rados.0.trial188.stdout:676: delete oid 5 current snap is 69 2026-02-13T20:14:43.877 INFO:tasks.rados.rados.0.trial188.stdout:676: done (0 left) 2026-02-13T20:14:43.877 INFO:tasks.rados.rados.0.trial188.stdout:677: snap_create 2026-02-13T20:14:44.877 INFO:tasks.rados.rados.0.trial188.stdout:677: done (0 left) 2026-02-13T20:14:44.877 INFO:tasks.rados.rados.0.trial188.stdout:678: write oid 49 current snap is 70 2026-02-13T20:14:44.877 INFO:tasks.rados.rados.0.trial188.stdout:678: seq_num 265 ranges {453855=696987,1890787=548083} 2026-02-13T20:14:44.882 INFO:tasks.rados.rados.0.trial188.stdout:678: writing trial18843701-49 from 453855 to 1150842 tid 1 2026-02-13T20:14:44.888 INFO:tasks.rados.rados.0.trial188.stdout:678: writing trial18843701-49 from 1890787 to 2438870 tid 2 2026-02-13T20:14:44.888 INFO:tasks.rados.rados.0.trial188.stdout:679: read oid 35 snap -1 2026-02-13T20:14:44.888 INFO:tasks.rados.rados.0.trial188.stdout:679: expect (ObjNum 187 snap 47 seq_num 187) 2026-02-13T20:14:44.888 INFO:tasks.rados.rados.0.trial188.stdout:680: read oid 19 snap -1 2026-02-13T20:14:44.888 INFO:tasks.rados.rados.0.trial188.stdout:680: expect (ObjNum 179 snap 41 seq_num 179) 2026-02-13T20:14:44.888 INFO:tasks.rados.rados.0.trial188.stdout:681: read oid 42 snap -1 2026-02-13T20:14:44.888 INFO:tasks.rados.rados.0.trial188.stdout:681: expect (ObjNum 201 snap 52 seq_num 201) 2026-02-13T20:14:44.889 INFO:tasks.rados.rados.0.trial188.stdout:682: write (excl) oid 6 current snap is 70 2026-02-13T20:14:44.889 INFO:tasks.rados.rados.0.trial188.stdout:682: seq_num 266 ranges {470662=772236,1832916=408094} 2026-02-13T20:14:44.893 INFO:tasks.rados.rados.0.trial188.stdout:682: writing trial18843701-6 from 470662 to 1242898 tid 1 2026-02-13T20:14:44.897 INFO:tasks.rados.rados.0.trial188.stdout:682: writing trial18843701-6 from 1832916 to 2241010 tid 2 2026-02-13T20:14:44.897 INFO:tasks.rados.rados.0.trial188.stdout:683: write (excl) oid 16 current snap is 70 2026-02-13T20:14:44.898 INFO:tasks.rados.rados.0.trial188.stdout:683: seq_num 267 ranges {487469=563838,1607751=551752} 2026-02-13T20:14:44.901 INFO:tasks.rados.rados.0.trial188.stdout:683: writing trial18843701-16 from 487469 to 1051307 tid 1 2026-02-13T20:14:44.905 INFO:tasks.rados.rados.0.trial188.stdout:683: writing trial18843701-16 from 1607751 to 2159503 tid 2 2026-02-13T20:14:44.906 INFO:tasks.rados.rados.0.trial188.stdout:684: delete oid 45 current snap is 70 2026-02-13T20:14:44.906 INFO:tasks.rados.rados.0.trial188.stdout:680: expect (ObjNum 179 snap 41 seq_num 179) 2026-02-13T20:14:44.926 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:14:44.969 INFO:tasks.rados.rados.0.trial188.stdout:678: finishing write tid 1 to trial18843701-49 2026-02-13T20:14:44.970 INFO:tasks.rados.rados.0.trial188.stdout:678: finishing write tid 2 to trial18843701-49 2026-02-13T20:14:44.970 INFO:tasks.rados.rados.0.trial188.stdout:680: done (6 left) 2026-02-13T20:14:44.970 INFO:tasks.rados.rados.0.trial188.stdout:684: done (5 left) 2026-02-13T20:14:44.970 INFO:tasks.rados.rados.0.trial188.stdout:685: rollback oid 3 current snap is 70 2026-02-13T20:14:44.970 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 3 to 69 2026-02-13T20:14:44.970 INFO:tasks.rados.rados.0.trial188.stdout:678: finishing write tid 3 to trial18843701-49 2026-02-13T20:14:44.970 INFO:tasks.rados.rados.0.trial188.stdout:678: finishing write tid 4 to trial18843701-49 2026-02-13T20:14:44.970 INFO:tasks.rados.rados.0.trial188.stdout:678: oid 49 updating version 0 to 302 2026-02-13T20:14:44.970 INFO:tasks.rados.rados.0.trial188.stdout:678: oid 49 version 302 is already newer than 301 2026-02-13T20:14:44.970 INFO:tasks.rados.rados.0.trial188.stdout:678: oid 49 version 302 is already newer than 300 2026-02-13T20:14:44.970 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 49 v 302 (ObjNum 265 snap 70 seq_num 265) dirty exists 2026-02-13T20:14:44.970 INFO:tasks.rados.rados.0.trial188.stdout:678: left oid 49 (ObjNum 265 snap 70 seq_num 265) 2026-02-13T20:14:44.970 INFO:tasks.rados.rados.0.trial188.stdout:679: expect (ObjNum 187 snap 47 seq_num 187) 2026-02-13T20:14:44.998 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:14:45.030 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:14:45.062 INFO:tasks.rados.rados.0.trial188.stdout:682: finishing write tid 1 to trial18843701-6 2026-02-13T20:14:45.062 INFO:tasks.rados.rados.0.trial188.stdout:678: done (5 left) 2026-02-13T20:14:45.062 INFO:tasks.rados.rados.0.trial188.stdout:679: done (4 left) 2026-02-13T20:14:45.062 INFO:tasks.rados.rados.0.trial188.stdout:686: read oid 22 snap -1 2026-02-13T20:14:45.063 INFO:tasks.rados.rados.0.trial188.stdout:686: expect (ObjNum 233 snap 63 seq_num 233) 2026-02-13T20:14:45.063 INFO:tasks.rados.rados.0.trial188.stdout:687: write (excl) oid 25 current snap is 70 2026-02-13T20:14:45.063 INFO:tasks.rados.rados.0.trial188.stdout:681: expect (ObjNum 201 snap 52 seq_num 201) 2026-02-13T20:14:45.249 INFO:tasks.rados.rados.0.trial188.stdout:682: finishing write tid 2 to trial18843701-6 2026-02-13T20:14:45.250 INFO:tasks.rados.rados.0.trial188.stdout:682: finishing write tid 3 to trial18843701-6 2026-02-13T20:14:45.250 INFO:tasks.rados.rados.0.trial188.stdout:682: finishing write tid 4 to trial18843701-6 2026-02-13T20:14:45.250 INFO:tasks.rados.rados.0.trial188.stdout:682: oid 6 updating version 0 to 309 2026-02-13T20:14:45.250 INFO:tasks.rados.rados.0.trial188.stdout:682: oid 6 version 309 is already newer than 308 2026-02-13T20:14:45.250 INFO:tasks.rados.rados.0.trial188.stdout:682: oid 6 version 309 is already newer than 307 2026-02-13T20:14:45.250 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 6 v 309 (ObjNum 266 snap 70 seq_num 266) dirty exists 2026-02-13T20:14:45.250 INFO:tasks.rados.rados.0.trial188.stdout:682: left oid 6 (ObjNum 266 snap 70 seq_num 266) 2026-02-13T20:14:45.250 INFO:tasks.rados.rados.0.trial188.stdout:683: finishing write tid 1 to trial18843701-16 2026-02-13T20:14:45.250 INFO:tasks.rados.rados.0.trial188.stdout:683: finishing write tid 2 to trial18843701-16 2026-02-13T20:14:45.250 INFO:tasks.rados.rados.0.trial188.stdout:687: seq_num 269 ranges {521083=714336,1724715=555421} 2026-02-13T20:14:45.254 INFO:tasks.rados.rados.0.trial188.stdout:687: writing trial18843701-25 from 521083 to 1235419 tid 1 2026-02-13T20:14:45.258 INFO:tasks.rados.rados.0.trial188.stdout:687: writing trial18843701-25 from 1724715 to 2280136 tid 2 2026-02-13T20:14:45.258 INFO:tasks.rados.rados.0.trial188.stdout:681: done (5 left) 2026-02-13T20:14:45.258 INFO:tasks.rados.rados.0.trial188.stdout:682: done (4 left) 2026-02-13T20:14:45.258 INFO:tasks.rados.rados.0.trial188.stdout:688: rollback oid 43 current snap is 70 2026-02-13T20:14:45.258 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 43 to 69 2026-02-13T20:14:45.258 INFO:tasks.rados.rados.0.trial188.stdout:683: finishing write tid 3 to trial18843701-16 2026-02-13T20:14:45.258 INFO:tasks.rados.rados.0.trial188.stdout:683: finishing write tid 4 to trial18843701-16 2026-02-13T20:14:45.258 INFO:tasks.rados.rados.0.trial188.stdout:683: oid 16 updating version 0 to 312 2026-02-13T20:14:45.258 INFO:tasks.rados.rados.0.trial188.stdout:683: oid 16 version 312 is already newer than 311 2026-02-13T20:14:45.258 INFO:tasks.rados.rados.0.trial188.stdout:683: oid 16 updating version 312 to 313 2026-02-13T20:14:45.259 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 16 v 313 (ObjNum 267 snap 70 seq_num 267) dirty exists 2026-02-13T20:14:45.259 INFO:tasks.rados.rados.0.trial188.stdout:683: left oid 16 (ObjNum 267 snap 70 seq_num 267) 2026-02-13T20:14:45.259 INFO:tasks.rados.rados.0.trial188.stdout:685: finishing rollback tid 1 to trial18843701-3 2026-02-13T20:14:45.259 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 3 v 0 (ObjNum 129 snap 0 seq_num 16195541) dirty dne 2026-02-13T20:14:45.259 INFO:tasks.rados.rados.0.trial188.stdout:686: expect (ObjNum 233 snap 63 seq_num 233) 2026-02-13T20:14:45.296 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:14:45.331 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:14:45.367 INFO:tasks.rados.rados.0.trial188.stdout:688: finishing rollback tid 0 to trial18843701-43 2026-02-13T20:14:45.367 INFO:tasks.rados.rados.0.trial188.stdout:688: finishing rollback tid 1 to trial18843701-43 2026-02-13T20:14:45.367 INFO:tasks.rados.rados.0.trial188.stdout:683: done (4 left) 2026-02-13T20:14:45.367 INFO:tasks.rados.rados.0.trial188.stdout:685: done (3 left) 2026-02-13T20:14:45.367 INFO:tasks.rados.rados.0.trial188.stdout:686: done (2 left) 2026-02-13T20:14:45.368 INFO:tasks.rados.rados.0.trial188.stdout:689: read oid 39 snap -1 2026-02-13T20:14:45.368 INFO:tasks.rados.rados.0.trial188.stdout:689: expect deleted 2026-02-13T20:14:45.368 INFO:tasks.rados.rados.0.trial188.stdout:690: read oid 34 snap 69 2026-02-13T20:14:45.368 INFO:tasks.rados.rados.0.trial188.stdout:690: expect (ObjNum 241 snap 64 seq_num 241) 2026-02-13T20:14:45.368 INFO:tasks.rados.rados.0.trial188.stdout:691: rollback oid 10 current snap is 70 2026-02-13T20:14:45.368 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 10 to 69 2026-02-13T20:14:45.368 INFO:tasks.rados.rados.0.trial188.stdout:688: finishing rollback tid 2 to trial18843701-43 2026-02-13T20:14:45.368 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 43 v 112 (ObjNum 161 snap 32 seq_num 161) dirty exists 2026-02-13T20:14:45.368 INFO:tasks.rados.rados.0.trial188.stdout:687: finishing write tid 1 to trial18843701-25 2026-02-13T20:14:45.368 INFO:tasks.rados.rados.0.trial188.stdout:687: finishing write tid 2 to trial18843701-25 2026-02-13T20:14:45.368 INFO:tasks.rados.rados.0.trial188.stdout:687: finishing write tid 3 to trial18843701-25 2026-02-13T20:14:45.369 INFO:tasks.rados.rados.0.trial188.stdout:687: finishing write tid 4 to trial18843701-25 2026-02-13T20:14:45.369 INFO:tasks.rados.rados.0.trial188.stdout:687: oid 25 updating version 0 to 304 2026-02-13T20:14:45.369 INFO:tasks.rados.rados.0.trial188.stdout:687: oid 25 updating version 304 to 305 2026-02-13T20:14:45.369 INFO:tasks.rados.rados.0.trial188.stdout:687: oid 25 updating version 305 to 306 2026-02-13T20:14:45.369 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 25 v 306 (ObjNum 269 snap 70 seq_num 269) dirty exists 2026-02-13T20:14:45.369 INFO:tasks.rados.rados.0.trial188.stdout:687: left oid 25 (ObjNum 269 snap 70 seq_num 269) 2026-02-13T20:14:45.369 INFO:tasks.rados.rados.0.trial188.stdout:687: done (4 left) 2026-02-13T20:14:45.369 INFO:tasks.rados.rados.0.trial188.stdout:688: done (3 left) 2026-02-13T20:14:45.369 INFO:tasks.rados.rados.0.trial188.stdout:692: delete oid 16 current snap is 70 2026-02-13T20:14:45.371 INFO:tasks.rados.rados.0.trial188.stdout:691: finishing rollback tid 0 to trial18843701-10 2026-02-13T20:14:45.371 INFO:tasks.rados.rados.0.trial188.stdout:689: done (3 left) 2026-02-13T20:14:45.371 INFO:tasks.rados.rados.0.trial188.stdout:692: done (2 left) 2026-02-13T20:14:45.371 INFO:tasks.rados.rados.0.trial188.stdout:693: read oid 7 snap -1 2026-02-13T20:14:45.371 INFO:tasks.rados.rados.0.trial188.stdout:693: expect (ObjNum 261 snap 68 seq_num 261) 2026-02-13T20:14:45.371 INFO:tasks.rados.rados.0.trial188.stdout:694: rollback oid 36 current snap is 70 2026-02-13T20:14:45.371 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 36 to 69 2026-02-13T20:14:45.372 INFO:tasks.rados.rados.0.trial188.stdout:691: finishing rollback tid 1 to trial18843701-10 2026-02-13T20:14:45.372 INFO:tasks.rados.rados.0.trial188.stdout:695: write oid 35 current snap is 70 2026-02-13T20:14:45.372 INFO:tasks.rados.rados.0.trial188.stdout:695: seq_num 271 ranges {554697=464834,1725326=559090} 2026-02-13T20:14:45.372 INFO:tasks.rados.rados.0.trial188.stdout:695: writing trial18843701-35 from 554697 to 1019531 tid 1 2026-02-13T20:14:45.377 INFO:tasks.rados.rados.0.trial188.stdout:695: writing trial18843701-35 from 1725326 to 2284416 tid 2 2026-02-13T20:14:45.377 INFO:tasks.rados.rados.0.trial188.stdout:696: write oid 40 current snap is 70 2026-02-13T20:14:45.377 INFO:tasks.rados.rados.0.trial188.stdout:696: seq_num 272 ranges {571504=540083,1783808=702748} 2026-02-13T20:14:45.381 INFO:tasks.rados.rados.0.trial188.stdout:696: writing trial18843701-40 from 571504 to 1111587 tid 1 2026-02-13T20:14:45.386 INFO:tasks.rados.rados.0.trial188.stdout:696: writing trial18843701-40 from 1783808 to 2486556 tid 2 2026-02-13T20:14:45.386 INFO:tasks.rados.rados.0.trial188.stdout:697: read oid 2 snap 69 2026-02-13T20:14:45.387 INFO:tasks.rados.rados.0.trial188.stdout:697: expect (ObjNum 259 snap 68 seq_num 259) 2026-02-13T20:14:45.387 INFO:tasks.rados.rados.0.trial188.stdout:698: read oid 31 snap -1 2026-02-13T20:14:45.387 INFO:tasks.rados.rados.0.trial188.stdout:698: expect (ObjNum 218 snap 58 seq_num 218) 2026-02-13T20:14:45.387 INFO:tasks.rados.rados.0.trial188.stdout:699: write oid 22 current snap is 70 2026-02-13T20:14:45.387 INFO:tasks.rados.rados.0.trial188.stdout:691: finishing rollback tid 2 to trial18843701-10 2026-02-13T20:14:45.387 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 10 v 227 (ObjNum 253 snap 68 seq_num 253) dirty exists 2026-02-13T20:14:45.387 INFO:tasks.rados.rados.0.trial188.stdout:690: expect (ObjNum 241 snap 64 seq_num 241) 2026-02-13T20:14:45.412 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:14:45.453 INFO:tasks.rados.rados.0.trial188.stdout:694: finishing rollback tid 1 to trial18843701-36 2026-02-13T20:14:45.454 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 36 v 0 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-13T20:14:45.454 INFO:tasks.rados.rados.0.trial188.stdout:693: expect (ObjNum 261 snap 68 seq_num 261) 2026-02-13T20:14:45.491 INFO:tasks.rados.rados.0.trial188.stdout:695: finishing write tid 1 to trial18843701-35 2026-02-13T20:14:45.491 INFO:tasks.rados.rados.0.trial188.stdout:695: finishing write tid 2 to trial18843701-35 2026-02-13T20:14:45.491 INFO:tasks.rados.rados.0.trial188.stdout:697: expect (ObjNum 259 snap 68 seq_num 259) 2026-02-13T20:14:45.493 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 746177 2026-02-13T20:14:45.535 INFO:tasks.rados.rados.0.trial188.stdout:695: finishing write tid 3 to trial18843701-35 2026-02-13T20:14:45.535 INFO:tasks.rados.rados.0.trial188.stdout:699: seq_num 273 ranges {588311=615332,1842290=562759} 2026-02-13T20:14:45.539 INFO:tasks.rados.rados.0.trial188.stdout:699: writing trial18843701-22 from 588311 to 1203643 tid 1 2026-02-13T20:14:45.544 INFO:tasks.rados.rados.0.trial188.stdout:699: writing trial18843701-22 from 1842290 to 2405049 tid 2 2026-02-13T20:14:45.545 INFO:tasks.rados.rados.0.trial188.stdout:690: done (8 left) 2026-02-13T20:14:45.545 INFO:tasks.rados.rados.0.trial188.stdout:691: done (7 left) 2026-02-13T20:14:45.545 INFO:tasks.rados.rados.0.trial188.stdout:693: done (6 left) 2026-02-13T20:14:45.545 INFO:tasks.rados.rados.0.trial188.stdout:694: done (5 left) 2026-02-13T20:14:45.545 INFO:tasks.rados.rados.0.trial188.stdout:697: done (4 left) 2026-02-13T20:14:45.545 INFO:tasks.rados.rados.0.trial188.stdout:700: read oid 48 snap -1 2026-02-13T20:14:45.545 INFO:tasks.rados.rados.0.trial188.stdout:700: expect (ObjNum 243 snap 64 seq_num 243) 2026-02-13T20:14:45.545 INFO:tasks.rados.rados.0.trial188.stdout:701: write (excl) oid 39 current snap is 70 2026-02-13T20:14:45.545 INFO:tasks.rados.rados.0.trial188.stdout:695: finishing write tid 4 to trial18843701-35 2026-02-13T20:14:45.545 INFO:tasks.rados.rados.0.trial188.stdout:695: oid 35 updating version 0 to 239 2026-02-13T20:14:45.546 INFO:tasks.rados.rados.0.trial188.stdout:695: oid 35 version 239 is already newer than 237 2026-02-13T20:14:45.546 INFO:tasks.rados.rados.0.trial188.stdout:695: oid 35 version 239 is already newer than 238 2026-02-13T20:14:45.546 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 35 v 239 (ObjNum 271 snap 70 seq_num 271) dirty exists 2026-02-13T20:14:45.546 INFO:tasks.rados.rados.0.trial188.stdout:695: left oid 35 (ObjNum 271 snap 70 seq_num 271) 2026-02-13T20:14:45.546 INFO:tasks.rados.rados.0.trial188.stdout:698: expect (ObjNum 218 snap 58 seq_num 218) 2026-02-13T20:14:45.602 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 914134 2026-02-13T20:14:45.696 INFO:tasks.rados.rados.0.trial188.stdout:696: finishing write tid 1 to trial18843701-40 2026-02-13T20:14:45.696 INFO:tasks.rados.rados.0.trial188.stdout:696: finishing write tid 2 to trial18843701-40 2026-02-13T20:14:45.696 INFO:tasks.rados.rados.0.trial188.stdout:696: finishing write tid 3 to trial18843701-40 2026-02-13T20:14:45.696 INFO:tasks.rados.rados.0.trial188.stdout:696: finishing write tid 4 to trial18843701-40 2026-02-13T20:14:45.696 INFO:tasks.rados.rados.0.trial188.stdout:696: oid 40 updating version 0 to 240 2026-02-13T20:14:45.696 INFO:tasks.rados.rados.0.trial188.stdout:696: oid 40 updating version 240 to 241 2026-02-13T20:14:45.697 INFO:tasks.rados.rados.0.trial188.stdout:696: oid 40 version 241 is already newer than 239 2026-02-13T20:14:45.697 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 40 v 241 (ObjNum 272 snap 70 seq_num 272) dirty exists 2026-02-13T20:14:45.697 INFO:tasks.rados.rados.0.trial188.stdout:696: left oid 40 (ObjNum 272 snap 70 seq_num 272) 2026-02-13T20:14:45.697 INFO:tasks.rados.rados.0.trial188.stdout:701: seq_num 274 ranges {605118=406934,1617125=706417} 2026-02-13T20:14:45.699 INFO:tasks.rados.rados.0.trial188.stdout:701: writing trial18843701-39 from 605118 to 1012052 tid 1 2026-02-13T20:14:45.705 INFO:tasks.rados.rados.0.trial188.stdout:701: writing trial18843701-39 from 1617125 to 2323542 tid 2 2026-02-13T20:14:45.705 INFO:tasks.rados.rados.0.trial188.stdout:695: done (5 left) 2026-02-13T20:14:45.705 INFO:tasks.rados.rados.0.trial188.stdout:696: done (4 left) 2026-02-13T20:14:45.705 INFO:tasks.rados.rados.0.trial188.stdout:698: done (3 left) 2026-02-13T20:14:45.705 INFO:tasks.rados.rados.0.trial188.stdout:702: write (excl) oid 35 current snap is 70 2026-02-13T20:14:45.705 INFO:tasks.rados.rados.0.trial188.stdout:702: seq_num 275 ranges {621925=482183,1559254=566428} 2026-02-13T20:14:45.708 INFO:tasks.rados.rados.0.trial188.stdout:702: writing trial18843701-35 from 621925 to 1104108 tid 1 2026-02-13T20:14:45.713 INFO:tasks.rados.rados.0.trial188.stdout:702: writing trial18843701-35 from 1559254 to 2125682 tid 2 2026-02-13T20:14:45.713 INFO:tasks.rados.rados.0.trial188.stdout:703: read oid 25 snap -1 2026-02-13T20:14:45.713 INFO:tasks.rados.rados.0.trial188.stdout:703: expect (ObjNum 269 snap 70 seq_num 269) 2026-02-13T20:14:45.713 INFO:tasks.rados.rados.0.trial188.stdout:704: read oid 38 snap -1 2026-02-13T20:14:45.713 INFO:tasks.rados.rados.0.trial188.stdout:704: expect (ObjNum 193 snap 47 seq_num 193) 2026-02-13T20:14:45.713 INFO:tasks.rados.rados.0.trial188.stdout:705: rollback oid 44 current snap is 70 2026-02-13T20:14:45.713 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 44 to 69 2026-02-13T20:14:45.713 INFO:tasks.rados.rados.0.trial188.stdout:700: expect (ObjNum 243 snap 64 seq_num 243) 2026-02-13T20:14:45.714 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 515837 2026-02-13T20:14:45.739 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1884330 2026-02-13T20:14:45.740 INFO:tasks.rados.rados.0.trial188.stdout:699: finishing write tid 1 to trial18843701-22 2026-02-13T20:14:45.740 INFO:tasks.rados.rados.0.trial188.stdout:700: done (6 left) 2026-02-13T20:14:45.740 INFO:tasks.rados.rados.0.trial188.stdout:706: write oid 24 current snap is 70 2026-02-13T20:14:45.740 INFO:tasks.rados.rados.0.trial188.stdout:706: seq_num 276 ranges {638732=557432,1617736=710086} 2026-02-13T20:14:45.744 INFO:tasks.rados.rados.0.trial188.stdout:706: writing trial18843701-24 from 638732 to 1196164 tid 1 2026-02-13T20:14:45.749 INFO:tasks.rados.rados.0.trial188.stdout:706: writing trial18843701-24 from 1617736 to 2327822 tid 2 2026-02-13T20:14:45.749 INFO:tasks.rados.rados.0.trial188.stdout:707: rollback oid 45 current snap is 70 2026-02-13T20:14:45.749 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 45 to 69 2026-02-13T20:14:45.749 INFO:tasks.rados.rados.0.trial188.stdout:699: finishing write tid 2 to trial18843701-22 2026-02-13T20:14:45.749 INFO:tasks.rados.rados.0.trial188.stdout:699: finishing write tid 3 to trial18843701-22 2026-02-13T20:14:45.749 INFO:tasks.rados.rados.0.trial188.stdout:699: finishing write tid 4 to trial18843701-22 2026-02-13T20:14:45.750 INFO:tasks.rados.rados.0.trial188.stdout:699: oid 22 updating version 0 to 115 2026-02-13T20:14:45.750 INFO:tasks.rados.rados.0.trial188.stdout:699: oid 22 version 115 is already newer than 113 2026-02-13T20:14:45.750 INFO:tasks.rados.rados.0.trial188.stdout:699: oid 22 version 115 is already newer than 114 2026-02-13T20:14:45.750 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 22 v 115 (ObjNum 273 snap 70 seq_num 273) dirty exists 2026-02-13T20:14:45.750 INFO:tasks.rados.rados.0.trial188.stdout:699: left oid 22 (ObjNum 273 snap 70 seq_num 273) 2026-02-13T20:14:45.750 INFO:tasks.rados.rados.0.trial188.stdout:705: finishing rollback tid 1 to trial18843701-44 2026-02-13T20:14:45.750 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 44 v 0 (ObjNum 33 snap 0 seq_num 15026576) dirty dne 2026-02-13T20:14:45.750 INFO:tasks.rados.rados.0.trial188.stdout:701: finishing write tid 1 to trial18843701-39 2026-02-13T20:14:45.750 INFO:tasks.rados.rados.0.trial188.stdout:701: finishing write tid 2 to trial18843701-39 2026-02-13T20:14:45.750 INFO:tasks.rados.rados.0.trial188.stdout:701: finishing write tid 3 to trial18843701-39 2026-02-13T20:14:45.750 INFO:tasks.rados.rados.0.trial188.stdout:701: finishing write tid 4 to trial18843701-39 2026-02-13T20:14:45.750 INFO:tasks.rados.rados.0.trial188.stdout:701: oid 39 updating version 0 to 326 2026-02-13T20:14:45.751 INFO:tasks.rados.rados.0.trial188.stdout:701: oid 39 updating version 326 to 327 2026-02-13T20:14:45.751 INFO:tasks.rados.rados.0.trial188.stdout:701: oid 39 version 327 is already newer than 325 2026-02-13T20:14:45.751 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 39 v 327 (ObjNum 274 snap 70 seq_num 274) dirty exists 2026-02-13T20:14:45.751 INFO:tasks.rados.rados.0.trial188.stdout:701: left oid 39 (ObjNum 274 snap 70 seq_num 274) 2026-02-13T20:14:45.751 INFO:tasks.rados.rados.0.trial188.stdout:702: finishing write tid 1 to trial18843701-35 2026-02-13T20:14:45.751 INFO:tasks.rados.rados.0.trial188.stdout:699: done (7 left) 2026-02-13T20:14:45.751 INFO:tasks.rados.rados.0.trial188.stdout:701: done (6 left) 2026-02-13T20:14:45.751 INFO:tasks.rados.rados.0.trial188.stdout:705: done (5 left) 2026-02-13T20:14:45.751 INFO:tasks.rados.rados.0.trial188.stdout:708: write (excl) oid 32 current snap is 70 2026-02-13T20:14:45.751 INFO:tasks.rados.rados.0.trial188.stdout:708: seq_num 277 ranges {655539=632681,2076218=570097} 2026-02-13T20:14:45.753 INFO:tasks.rados.rados.0.trial188.stdout:708: writing trial18843701-32 from 655539 to 1288220 tid 1 2026-02-13T20:14:45.759 INFO:tasks.rados.rados.0.trial188.stdout:708: writing trial18843701-32 from 2076218 to 2646315 tid 2 2026-02-13T20:14:45.759 INFO:tasks.rados.rados.0.trial188.stdout:709: snap_create 2026-02-13T20:14:45.759 INFO:tasks.rados.rados.0.trial188.stdout:702: finishing write tid 2 to trial18843701-35 2026-02-13T20:14:45.759 INFO:tasks.rados.rados.0.trial188.stdout:702: finishing write tid 3 to trial18843701-35 2026-02-13T20:14:45.759 INFO:tasks.rados.rados.0.trial188.stdout:702: finishing write tid 4 to trial18843701-35 2026-02-13T20:14:45.759 INFO:tasks.rados.rados.0.trial188.stdout:702: oid 35 updating version 0 to 240 2026-02-13T20:14:45.759 INFO:tasks.rados.rados.0.trial188.stdout:702: oid 35 updating version 240 to 241 2026-02-13T20:14:45.759 INFO:tasks.rados.rados.0.trial188.stdout:702: oid 35 updating version 241 to 242 2026-02-13T20:14:45.759 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 35 v 242 (ObjNum 275 snap 70 seq_num 275) dirty exists 2026-02-13T20:14:45.759 INFO:tasks.rados.rados.0.trial188.stdout:702: left oid 35 (ObjNum 275 snap 70 seq_num 275) 2026-02-13T20:14:45.759 INFO:tasks.rados.rados.0.trial188.stdout:703: expect (ObjNum 269 snap 70 seq_num 269) 2026-02-13T20:14:45.793 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:14:45.839 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1097033 2026-02-13T20:14:45.867 INFO:tasks.rados.rados.0.trial188.stdout:704: expect (ObjNum 193 snap 47 seq_num 193) 2026-02-13T20:14:45.869 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1417414 2026-02-13T20:14:45.931 INFO:tasks.rados.rados.0.trial188.stdout:707: finishing rollback tid 1 to trial18843701-45 2026-02-13T20:14:45.931 INFO:tasks.rados.rados.0.trial188.stdout:707: finishing rollback tid 2 to trial18843701-45 2026-02-13T20:14:45.931 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 45 v 243 (ObjNum 214 snap 58 seq_num 214) dirty exists 2026-02-13T20:14:45.931 INFO:tasks.rados.rados.0.trial188.stdout:706: finishing write tid 1 to trial18843701-24 2026-02-13T20:14:45.931 INFO:tasks.rados.rados.0.trial188.stdout:706: finishing write tid 2 to trial18843701-24 2026-02-13T20:14:45.932 INFO:tasks.rados.rados.0.trial188.stdout:706: finishing write tid 3 to trial18843701-24 2026-02-13T20:14:45.932 INFO:tasks.rados.rados.0.trial188.stdout:702: done (6 left) 2026-02-13T20:14:45.932 INFO:tasks.rados.rados.0.trial188.stdout:703: done (5 left) 2026-02-13T20:14:45.932 INFO:tasks.rados.rados.0.trial188.stdout:704: done (4 left) 2026-02-13T20:14:45.932 INFO:tasks.rados.rados.0.trial188.stdout:707: done (3 left) 2026-02-13T20:14:45.932 INFO:tasks.rados.rados.0.trial188.stdout:709: done (2 left) 2026-02-13T20:14:45.932 INFO:tasks.rados.rados.0.trial188.stdout:710: copy_from oid 31 from oid 37 current snap is 71 2026-02-13T20:14:45.932 INFO:tasks.rados.rados.0.trial188.stdout:706: finishing write tid 4 to trial18843701-24 2026-02-13T20:14:45.932 INFO:tasks.rados.rados.0.trial188.stdout:706: oid 24 updating version 0 to 318 2026-02-13T20:14:45.932 INFO:tasks.rados.rados.0.trial188.stdout:706: oid 24 updating version 318 to 319 2026-02-13T20:14:45.932 INFO:tasks.rados.rados.0.trial188.stdout:706: oid 24 version 319 is already newer than 317 2026-02-13T20:14:45.932 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 24 v 319 (ObjNum 276 snap 70 seq_num 276) dirty exists 2026-02-13T20:14:45.932 INFO:tasks.rados.rados.0.trial188.stdout:706: left oid 24 (ObjNum 276 snap 70 seq_num 276) 2026-02-13T20:14:45.932 INFO:tasks.rados.rados.0.trial188.stdout:708: finishing write tid 1 to trial18843701-32 2026-02-13T20:14:45.932 INFO:tasks.rados.rados.0.trial188.stdout:708: finishing write tid 2 to trial18843701-32 2026-02-13T20:14:45.932 INFO:tasks.rados.rados.0.trial188.stdout:708: finishing write tid 3 to trial18843701-32 2026-02-13T20:14:45.933 INFO:tasks.rados.rados.0.trial188.stdout:708: finishing write tid 4 to trial18843701-32 2026-02-13T20:14:45.933 INFO:tasks.rados.rados.0.trial188.stdout:708: oid 32 updating version 0 to 243 2026-02-13T20:14:45.933 INFO:tasks.rados.rados.0.trial188.stdout:708: oid 32 updating version 243 to 244 2026-02-13T20:14:45.933 INFO:tasks.rados.rados.0.trial188.stdout:708: oid 32 version 244 is already newer than 242 2026-02-13T20:14:45.933 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 32 v 244 (ObjNum 277 snap 70 seq_num 277) dirty exists 2026-02-13T20:14:45.933 INFO:tasks.rados.rados.0.trial188.stdout:708: left oid 32 (ObjNum 277 snap 70 seq_num 277) 2026-02-13T20:14:45.933 INFO:tasks.rados.rados.0.trial188.stdout:706: done (2 left) 2026-02-13T20:14:45.933 INFO:tasks.rados.rados.0.trial188.stdout:708: done (1 left) 2026-02-13T20:14:45.933 INFO:tasks.rados.rados.0.trial188.stdout:711: write oid 12 current snap is 71 2026-02-13T20:14:45.933 INFO:tasks.rados.rados.0.trial188.stdout:711: seq_num 278 ranges {672346=707930,2134700=537646} 2026-02-13T20:14:45.936 INFO:tasks.rados.rados.0.trial188.stdout:711: writing trial18843701-12 from 672346 to 1380276 tid 1 2026-02-13T20:14:45.941 INFO:tasks.rados.rados.0.trial188.stdout:711: writing trial18843701-12 from 2134700 to 2672346 tid 2 2026-02-13T20:14:45.941 INFO:tasks.rados.rados.0.trial188.stdout:712: write oid 14 current snap is 71 2026-02-13T20:14:45.941 INFO:tasks.rados.rados.0.trial188.stdout:712: seq_num 279 ranges {689153=783179,2076829=457413} 2026-02-13T20:14:45.947 INFO:tasks.rados.rados.0.trial188.stdout:712: writing trial18843701-14 from 689153 to 1472332 tid 1 2026-02-13T20:14:45.951 INFO:tasks.rados.rados.0.trial188.stdout:712: writing trial18843701-14 from 2076829 to 2534242 tid 2 2026-02-13T20:14:45.951 INFO:tasks.rados.rados.0.trial188.stdout:713: read oid 45 snap -1 2026-02-13T20:14:45.952 INFO:tasks.rados.rados.0.trial188.stdout:713: expect (ObjNum 214 snap 58 seq_num 214) 2026-02-13T20:14:45.952 INFO:tasks.rados.rados.0.trial188.stdout:714: rollback oid 40 current snap is 71 2026-02-13T20:14:45.952 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 40 to 69 2026-02-13T20:14:45.952 INFO:tasks.rados.rados.0.trial188.stdout:715: read oid 4 snap -1 2026-02-13T20:14:45.952 INFO:tasks.rados.rados.0.trial188.stdout:715: expect (ObjNum 161 snap 32 seq_num 161) 2026-02-13T20:14:45.952 INFO:tasks.rados.rados.0.trial188.stdout:716: snap_remove snap 70 2026-02-13T20:14:46.899 INFO:tasks.rados.rados.0.trial188.stdout:716: done (6 left) 2026-02-13T20:14:46.900 INFO:tasks.rados.rados.0.trial188.stdout:717: copy_from oid 10 from oid 48 current snap is 71 2026-02-13T20:14:46.900 INFO:tasks.rados.rados.0.trial188.stdout:714: finishing rollback tid 0 to trial18843701-40 2026-02-13T20:14:46.900 INFO:tasks.rados.rados.0.trial188.stdout:713: expect (ObjNum 214 snap 58 seq_num 214) 2026-02-13T20:14:46.949 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1258652 2026-02-13T20:14:46.966 INFO:tasks.rados.rados.0.trial188.stdout:714: finishing rollback tid 1 to trial18843701-40 2026-02-13T20:14:46.966 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 40 v 247 (ObjNum 289 snap 0 seq_num 0) dirty dne 2026-02-13T20:14:46.966 INFO:tasks.rados.rados.0.trial188.stdout:711: finishing write tid 1 to trial18843701-12 2026-02-13T20:14:46.966 INFO:tasks.rados.rados.0.trial188.stdout:711: finishing write tid 2 to trial18843701-12 2026-02-13T20:14:46.966 INFO:tasks.rados.rados.0.trial188.stdout:711: finishing write tid 3 to trial18843701-12 2026-02-13T20:14:46.966 INFO:tasks.rados.rados.0.trial188.stdout:711: finishing write tid 4 to trial18843701-12 2026-02-13T20:14:46.966 INFO:tasks.rados.rados.0.trial188.stdout:711: oid 12 updating version 0 to 190 2026-02-13T20:14:46.966 INFO:tasks.rados.rados.0.trial188.stdout:711: oid 12 updating version 190 to 191 2026-02-13T20:14:46.966 INFO:tasks.rados.rados.0.trial188.stdout:711: oid 12 version 191 is already newer than 189 2026-02-13T20:14:46.966 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 12 v 191 (ObjNum 278 snap 71 seq_num 278) dirty exists 2026-02-13T20:14:46.966 INFO:tasks.rados.rados.0.trial188.stdout:711: left oid 12 (ObjNum 278 snap 71 seq_num 278) 2026-02-13T20:14:46.966 INFO:tasks.rados.rados.0.trial188.stdout:715: expect (ObjNum 161 snap 32 seq_num 161) 2026-02-13T20:14:47.035 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2494849 2026-02-13T20:14:47.039 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:14:47.080 INFO:tasks.rados.rados.0.trial188.stdout:712: finishing write tid 1 to trial18843701-14 2026-02-13T20:14:47.080 INFO:tasks.rados.rados.0.trial188.stdout:712: finishing write tid 2 to trial18843701-14 2026-02-13T20:14:47.080 INFO:tasks.rados.rados.0.trial188.stdout:712: finishing write tid 3 to trial18843701-14 2026-02-13T20:14:47.080 INFO:tasks.rados.rados.0.trial188.stdout:712: finishing write tid 4 to trial18843701-14 2026-02-13T20:14:47.080 INFO:tasks.rados.rados.0.trial188.stdout:712: oid 14 updating version 0 to 289 2026-02-13T20:14:47.080 INFO:tasks.rados.rados.0.trial188.stdout:712: oid 14 updating version 289 to 291 2026-02-13T20:14:47.080 INFO:tasks.rados.rados.0.trial188.stdout:712: oid 14 version 291 is already newer than 290 2026-02-13T20:14:47.080 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 14 v 291 (ObjNum 279 snap 71 seq_num 279) dirty exists 2026-02-13T20:14:47.080 INFO:tasks.rados.rados.0.trial188.stdout:712: left oid 14 (ObjNum 279 snap 71 seq_num 279) 2026-02-13T20:14:47.080 INFO:tasks.rados.rados.0.trial188.stdout:710: finishing copy_from racing read to trial18843701-31 2026-02-13T20:14:47.080 INFO:tasks.rados.rados.0.trial188.stdout:710: finishing copy_from to trial18843701-31 2026-02-13T20:14:47.080 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 31 v 94 (ObjNum 232 snap 63 seq_num 232) dirty exists 2026-02-13T20:14:47.080 INFO:tasks.rados.rados.0.trial188.stdout:717: finishing copy_from racing read to trial18843701-10 2026-02-13T20:14:47.080 INFO:tasks.rados.rados.0.trial188.stdout:717: finishing copy_from to trial18843701-10 2026-02-13T20:14:47.080 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 10 v 107 (ObjNum 243 snap 64 seq_num 243) dirty exists 2026-02-13T20:14:47.080 INFO:tasks.rados.rados.0.trial188.stdout:710: done (6 left) 2026-02-13T20:14:47.080 INFO:tasks.rados.rados.0.trial188.stdout:711: done (5 left) 2026-02-13T20:14:47.080 INFO:tasks.rados.rados.0.trial188.stdout:712: done (4 left) 2026-02-13T20:14:47.080 INFO:tasks.rados.rados.0.trial188.stdout:713: done (3 left) 2026-02-13T20:14:47.080 INFO:tasks.rados.rados.0.trial188.stdout:714: done (2 left) 2026-02-13T20:14:47.080 INFO:tasks.rados.rados.0.trial188.stdout:715: done (1 left) 2026-02-13T20:14:47.080 INFO:tasks.rados.rados.0.trial188.stdout:717: done (0 left) 2026-02-13T20:14:47.080 INFO:tasks.rados.rados.0.trial188.stdout:718: rollback oid 12 current snap is 71 2026-02-13T20:14:47.080 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 12 to 69 2026-02-13T20:14:47.080 INFO:tasks.rados.rados.0.trial188.stdout:719: read oid 38 snap -1 2026-02-13T20:14:47.081 INFO:tasks.rados.rados.0.trial188.stdout:719: expect (ObjNum 193 snap 47 seq_num 193) 2026-02-13T20:14:47.081 INFO:tasks.rados.rados.0.trial188.stdout:720: read oid 42 snap 69 2026-02-13T20:14:47.081 INFO:tasks.rados.rados.0.trial188.stdout:720: expect (ObjNum 201 snap 52 seq_num 201) 2026-02-13T20:14:47.081 INFO:tasks.rados.rados.0.trial188.stdout:721: rollback oid 11 current snap is 71 2026-02-13T20:14:47.081 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 11 to 69 2026-02-13T20:14:47.081 INFO:tasks.rados.rados.0.trial188.stdout:722: read oid 9 snap 69 2026-02-13T20:14:47.081 INFO:tasks.rados.rados.0.trial188.stdout:722: expect (ObjNum 240 snap 64 seq_num 240) 2026-02-13T20:14:47.081 INFO:tasks.rados.rados.0.trial188.stdout:723: copy_from oid 16 from oid 40 current snap is 71 2026-02-13T20:14:47.081 INFO:tasks.rados.rados.0.trial188.stdout:724: write (excl) oid 24 current snap is 71 2026-02-13T20:14:47.081 INFO:tasks.rados.rados.0.trial188.stdout:724: seq_num 280 ranges {705960=458428,1735311=717424} 2026-02-13T20:14:47.084 INFO:tasks.rados.rados.0.trial188.stdout:724: writing trial18843701-24 from 705960 to 1164388 tid 1 2026-02-13T20:14:47.090 INFO:tasks.rados.rados.0.trial188.stdout:724: writing trial18843701-24 from 1735311 to 2452735 tid 2 2026-02-13T20:14:47.090 INFO:tasks.rados.rados.0.trial188.stdout:725: rollback oid 5 current snap is 71 2026-02-13T20:14:47.090 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 5 to 69 2026-02-13T20:14:47.090 INFO:tasks.rados.rados.0.trial188.stdout:723: finishing copy_from to trial18843701-16 2026-02-13T20:14:47.090 INFO:tasks.rados.rados.0.trial188.stdout:723: got expected ENOENT (src dne) 2026-02-13T20:14:47.090 INFO:tasks.rados.rados.0.trial188.stdout:723: finishing copy_from racing read to trial18843701-16 2026-02-13T20:14:47.090 INFO:tasks.rados.rados.0.trial188.stdout:718: finishing rollback tid 0 to trial18843701-12 2026-02-13T20:14:47.090 INFO:tasks.rados.rados.0.trial188.stdout:718: finishing rollback tid 1 to trial18843701-12 2026-02-13T20:14:47.090 INFO:tasks.rados.rados.0.trial188.stdout:718: finishing rollback tid 2 to trial18843701-12 2026-02-13T20:14:47.090 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 12 v 194 (ObjNum 255 snap 68 seq_num 255) dirty exists 2026-02-13T20:14:47.090 INFO:tasks.rados.rados.0.trial188.stdout:719: expect (ObjNum 193 snap 47 seq_num 193) 2026-02-13T20:14:47.137 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2269453 2026-02-13T20:14:47.144 INFO:tasks.rados.rados.0.trial188.stdout:721: finishing rollback tid 0 to trial18843701-11 2026-02-13T20:14:47.144 INFO:tasks.rados.rados.0.trial188.stdout:718: done (7 left) 2026-02-13T20:14:47.144 INFO:tasks.rados.rados.0.trial188.stdout:719: done (6 left) 2026-02-13T20:14:47.144 INFO:tasks.rados.rados.0.trial188.stdout:723: done (5 left) 2026-02-13T20:14:47.144 INFO:tasks.rados.rados.0.trial188.stdout:726: delete oid 8 current snap is 71 2026-02-13T20:14:47.144 INFO:tasks.rados.rados.0.trial188.stdout:720: expect (ObjNum 201 snap 52 seq_num 201) 2026-02-13T20:14:47.299 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2682451 2026-02-13T20:14:47.323 INFO:tasks.rados.rados.0.trial188.stdout:721: finishing rollback tid 1 to trial18843701-11 2026-02-13T20:14:47.323 INFO:tasks.rados.rados.0.trial188.stdout:720: done (5 left) 2026-02-13T20:14:47.323 INFO:tasks.rados.rados.0.trial188.stdout:726: done (4 left) 2026-02-13T20:14:47.323 INFO:tasks.rados.rados.0.trial188.stdout:727: read oid 15 snap 69 2026-02-13T20:14:47.323 INFO:tasks.rados.rados.0.trial188.stdout:727: expect (ObjNum 179 snap 41 seq_num 179) 2026-02-13T20:14:47.323 INFO:tasks.rados.rados.0.trial188.stdout:728: copy_from oid 4 from oid 23 current snap is 71 2026-02-13T20:14:47.323 INFO:tasks.rados.rados.0.trial188.stdout:721: finishing rollback tid 2 to trial18843701-11 2026-02-13T20:14:47.323 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 11 v 230 (ObjNum 235 snap 64 seq_num 235) dirty exists 2026-02-13T20:14:47.324 INFO:tasks.rados.rados.0.trial188.stdout:725: finishing rollback tid 1 to trial18843701-5 2026-02-13T20:14:47.324 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 5 v 0 (ObjNum 129 snap 0 seq_num 9921896) dirty dne 2026-02-13T20:14:47.324 INFO:tasks.rados.rados.0.trial188.stdout:722: expect (ObjNum 240 snap 64 seq_num 240) 2026-02-13T20:14:47.324 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:14:47.352 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:14:47.410 INFO:tasks.rados.rados.0.trial188.stdout:724: finishing write tid 1 to trial18843701-24 2026-02-13T20:14:47.410 INFO:tasks.rados.rados.0.trial188.stdout:724: finishing write tid 2 to trial18843701-24 2026-02-13T20:14:47.410 INFO:tasks.rados.rados.0.trial188.stdout:721: done (5 left) 2026-02-13T20:14:47.411 INFO:tasks.rados.rados.0.trial188.stdout:722: done (4 left) 2026-02-13T20:14:47.411 INFO:tasks.rados.rados.0.trial188.stdout:725: done (3 left) 2026-02-13T20:14:47.411 INFO:tasks.rados.rados.0.trial188.stdout:729: write (excl) oid 16 current snap is 71 2026-02-13T20:14:47.411 INFO:tasks.rados.rados.0.trial188.stdout:724: finishing write tid 3 to trial18843701-24 2026-02-13T20:14:47.411 INFO:tasks.rados.rados.0.trial188.stdout:729: seq_num 282 ranges {739574=725279,1968628=721093} 2026-02-13T20:14:47.415 INFO:tasks.rados.rados.0.trial188.stdout:729: writing trial18843701-16 from 739574 to 1464853 tid 1 2026-02-13T20:14:47.420 INFO:tasks.rados.rados.0.trial188.stdout:729: writing trial18843701-16 from 1968628 to 2689721 tid 2 2026-02-13T20:14:47.420 INFO:tasks.rados.rados.0.trial188.stdout:730: snap_create 2026-02-13T20:14:47.420 INFO:tasks.rados.rados.0.trial188.stdout:724: finishing write tid 4 to trial18843701-24 2026-02-13T20:14:47.421 INFO:tasks.rados.rados.0.trial188.stdout:724: oid 24 updating version 0 to 321 2026-02-13T20:14:47.421 INFO:tasks.rados.rados.0.trial188.stdout:724: oid 24 updating version 321 to 322 2026-02-13T20:14:47.421 INFO:tasks.rados.rados.0.trial188.stdout:724: oid 24 version 322 is already newer than 320 2026-02-13T20:14:47.421 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 24 v 322 (ObjNum 280 snap 71 seq_num 280) dirty exists 2026-02-13T20:14:47.421 INFO:tasks.rados.rados.0.trial188.stdout:724: left oid 24 (ObjNum 280 snap 71 seq_num 280) 2026-02-13T20:14:47.421 INFO:tasks.rados.rados.0.trial188.stdout:727: expect (ObjNum 179 snap 41 seq_num 179) 2026-02-13T20:14:47.421 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:14:47.442 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 90780 2026-02-13T20:14:47.465 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1462156 2026-02-13T20:14:47.479 INFO:tasks.rados.rados.0.trial188.stdout:728: finishing copy_from racing read to trial18843701-4 2026-02-13T20:14:47.480 INFO:tasks.rados.rados.0.trial188.stdout:728: finishing copy_from to trial18843701-4 2026-02-13T20:14:47.480 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 4 v 303 (ObjNum 258 snap 68 seq_num 258) dirty exists 2026-02-13T20:14:47.480 INFO:tasks.rados.rados.0.trial188.stdout:729: finishing write tid 1 to trial18843701-16 2026-02-13T20:14:47.480 INFO:tasks.rados.rados.0.trial188.stdout:729: finishing write tid 2 to trial18843701-16 2026-02-13T20:14:47.480 INFO:tasks.rados.rados.0.trial188.stdout:729: finishing write tid 3 to trial18843701-16 2026-02-13T20:14:47.480 INFO:tasks.rados.rados.0.trial188.stdout:729: finishing write tid 4 to trial18843701-16 2026-02-13T20:14:47.480 INFO:tasks.rados.rados.0.trial188.stdout:729: oid 16 updating version 0 to 325 2026-02-13T20:14:47.480 INFO:tasks.rados.rados.0.trial188.stdout:729: oid 16 version 325 is already newer than 323 2026-02-13T20:14:47.480 INFO:tasks.rados.rados.0.trial188.stdout:729: oid 16 version 325 is already newer than 324 2026-02-13T20:14:47.480 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 16 v 325 (ObjNum 282 snap 71 seq_num 282) dirty exists 2026-02-13T20:14:47.480 INFO:tasks.rados.rados.0.trial188.stdout:729: left oid 16 (ObjNum 282 snap 71 seq_num 282) 2026-02-13T20:14:47.876 INFO:tasks.rados.rados.0.trial188.stdout:724: done (4 left) 2026-02-13T20:14:47.876 INFO:tasks.rados.rados.0.trial188.stdout:727: done (3 left) 2026-02-13T20:14:47.876 INFO:tasks.rados.rados.0.trial188.stdout:728: done (2 left) 2026-02-13T20:14:47.877 INFO:tasks.rados.rados.0.trial188.stdout:729: done (1 left) 2026-02-13T20:14:47.877 INFO:tasks.rados.rados.0.trial188.stdout:730: done (0 left) 2026-02-13T20:14:47.877 INFO:tasks.rados.rados.0.trial188.stdout:731: write oid 5 current snap is 72 2026-02-13T20:14:47.877 INFO:tasks.rados.rados.0.trial188.stdout:731: seq_num 283 ranges {756381=400528,1910757=464751} 2026-02-13T20:14:47.880 INFO:tasks.rados.rados.0.trial188.stdout:731: writing trial18843701-5 from 756381 to 1156909 tid 1 2026-02-13T20:14:47.885 INFO:tasks.rados.rados.0.trial188.stdout:731: writing trial18843701-5 from 1910757 to 2375508 tid 2 2026-02-13T20:14:47.885 INFO:tasks.rados.rados.0.trial188.stdout:732: write oid 46 current snap is 72 2026-02-13T20:14:47.885 INFO:tasks.rados.rados.0.trial188.stdout:732: seq_num 284 ranges {773188=475777,1969239=724762} 2026-02-13T20:14:47.889 INFO:tasks.rados.rados.0.trial188.stdout:732: writing trial18843701-46 from 773188 to 1248965 tid 1 2026-02-13T20:14:47.895 INFO:tasks.rados.rados.0.trial188.stdout:732: writing trial18843701-46 from 1969239 to 2694001 tid 2 2026-02-13T20:14:47.895 INFO:tasks.rados.rados.0.trial188.stdout:733: copy_from oid 34 from oid 43 current snap is 72 2026-02-13T20:14:47.895 INFO:tasks.rados.rados.0.trial188.stdout:731: finishing write tid 1 to trial18843701-5 2026-02-13T20:14:47.895 INFO:tasks.rados.rados.0.trial188.stdout:731: finishing write tid 2 to trial18843701-5 2026-02-13T20:14:47.895 INFO:tasks.rados.rados.0.trial188.stdout:731: finishing write tid 3 to trial18843701-5 2026-02-13T20:14:47.896 INFO:tasks.rados.rados.0.trial188.stdout:731: finishing write tid 4 to trial18843701-5 2026-02-13T20:14:47.896 INFO:tasks.rados.rados.0.trial188.stdout:731: oid 5 updating version 0 to 370 2026-02-13T20:14:47.896 INFO:tasks.rados.rados.0.trial188.stdout:731: oid 5 version 370 is already newer than 368 2026-02-13T20:14:47.896 INFO:tasks.rados.rados.0.trial188.stdout:731: oid 5 version 370 is already newer than 369 2026-02-13T20:14:47.896 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 5 v 370 (ObjNum 283 snap 72 seq_num 283) dirty exists 2026-02-13T20:14:47.896 INFO:tasks.rados.rados.0.trial188.stdout:731: left oid 5 (ObjNum 283 snap 72 seq_num 283) 2026-02-13T20:14:47.896 INFO:tasks.rados.rados.0.trial188.stdout:731: done (2 left) 2026-02-13T20:14:47.896 INFO:tasks.rados.rados.0.trial188.stdout:734: copy_from oid 12 from oid 5 current snap is 72 2026-02-13T20:14:47.896 INFO:tasks.rados.rados.0.trial188.stdout:735: delete oid 8 current snap is 72 2026-02-13T20:14:47.897 INFO:tasks.rados.rados.0.trial188.stdout:735: done (3 left) 2026-02-13T20:14:47.897 INFO:tasks.rados.rados.0.trial188.stdout:736: read oid 2 snap -1 2026-02-13T20:14:47.897 INFO:tasks.rados.rados.0.trial188.stdout:736: expect (ObjNum 259 snap 68 seq_num 259) 2026-02-13T20:14:47.897 INFO:tasks.rados.rados.0.trial188.stdout:737: snap_create 2026-02-13T20:14:47.909 INFO:tasks.rados.rados.0.trial188.stdout:736: expect (ObjNum 259 snap 68 seq_num 259) 2026-02-13T20:14:47.909 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 293039 2026-02-13T20:14:47.939 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:14:47.961 INFO:tasks.rados.rados.0.trial188.stdout:734: finishing copy_from racing read to trial18843701-12 2026-02-13T20:14:47.961 INFO:tasks.rados.rados.0.trial188.stdout:732: finishing write tid 1 to trial18843701-46 2026-02-13T20:14:47.961 INFO:tasks.rados.rados.0.trial188.stdout:732: finishing write tid 2 to trial18843701-46 2026-02-13T20:14:47.961 INFO:tasks.rados.rados.0.trial188.stdout:732: finishing write tid 3 to trial18843701-46 2026-02-13T20:14:47.961 INFO:tasks.rados.rados.0.trial188.stdout:732: finishing write tid 4 to trial18843701-46 2026-02-13T20:14:47.961 INFO:tasks.rados.rados.0.trial188.stdout:732: oid 46 updating version 0 to 251 2026-02-13T20:14:47.961 INFO:tasks.rados.rados.0.trial188.stdout:732: oid 46 updating version 251 to 252 2026-02-13T20:14:47.962 INFO:tasks.rados.rados.0.trial188.stdout:732: oid 46 version 252 is already newer than 250 2026-02-13T20:14:47.962 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 46 v 252 (ObjNum 284 snap 72 seq_num 284) dirty exists 2026-02-13T20:14:47.962 INFO:tasks.rados.rados.0.trial188.stdout:732: left oid 46 (ObjNum 284 snap 72 seq_num 284) 2026-02-13T20:14:47.962 INFO:tasks.rados.rados.0.trial188.stdout:734: finishing copy_from to trial18843701-12 2026-02-13T20:14:47.962 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 12 v 370 (ObjNum 283 snap 72 seq_num 283) dirty exists 2026-02-13T20:14:47.962 INFO:tasks.rados.rados.0.trial188.stdout:733: finishing copy_from racing read to trial18843701-34 2026-02-13T20:14:47.962 INFO:tasks.rados.rados.0.trial188.stdout:733: finishing copy_from to trial18843701-34 2026-02-13T20:14:47.962 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 34 v 112 (ObjNum 161 snap 32 seq_num 161) dirty exists 2026-02-13T20:14:48.877 INFO:tasks.rados.rados.0.trial188.stdout:732: done (4 left) 2026-02-13T20:14:48.877 INFO:tasks.rados.rados.0.trial188.stdout:733: done (3 left) 2026-02-13T20:14:48.877 INFO:tasks.rados.rados.0.trial188.stdout:734: done (2 left) 2026-02-13T20:14:48.877 INFO:tasks.rados.rados.0.trial188.stdout:736: done (1 left) 2026-02-13T20:14:48.877 INFO:tasks.rados.rados.0.trial188.stdout:737: done (0 left) 2026-02-13T20:14:48.877 INFO:tasks.rados.rados.0.trial188.stdout:738: write (excl) oid 29 current snap is 73 2026-02-13T20:14:48.877 INFO:tasks.rados.rados.0.trial188.stdout:738: seq_num 286 ranges {406802=626275,1686203=728431} 2026-02-13T20:14:48.881 INFO:tasks.rados.rados.0.trial188.stdout:738: writing trial18843701-29 from 406802 to 1033077 tid 1 2026-02-13T20:14:48.886 INFO:tasks.rados.rados.0.trial188.stdout:738: writing trial18843701-29 from 1686203 to 2414634 tid 2 2026-02-13T20:14:48.886 INFO:tasks.rados.rados.0.trial188.stdout:739: read oid 25 snap 69 2026-02-13T20:14:48.886 INFO:tasks.rados.rados.0.trial188.stdout:739: expect (ObjNum 184 snap 43 seq_num 184) 2026-02-13T20:14:48.886 INFO:tasks.rados.rados.0.trial188.stdout:740: snap_create 2026-02-13T20:14:48.896 INFO:tasks.rados.rados.0.trial188.stdout:739: expect (ObjNum 184 snap 43 seq_num 184) 2026-02-13T20:14:48.896 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:14:49.028 INFO:tasks.rados.rados.0.trial188.stdout:738: finishing write tid 1 to trial18843701-29 2026-02-13T20:14:49.028 INFO:tasks.rados.rados.0.trial188.stdout:738: finishing write tid 2 to trial18843701-29 2026-02-13T20:14:49.028 INFO:tasks.rados.rados.0.trial188.stdout:738: finishing write tid 3 to trial18843701-29 2026-02-13T20:14:49.028 INFO:tasks.rados.rados.0.trial188.stdout:738: finishing write tid 4 to trial18843701-29 2026-02-13T20:14:49.028 INFO:tasks.rados.rados.0.trial188.stdout:738: oid 29 updating version 0 to 331 2026-02-13T20:14:49.028 INFO:tasks.rados.rados.0.trial188.stdout:738: oid 29 version 331 is already newer than 330 2026-02-13T20:14:49.028 INFO:tasks.rados.rados.0.trial188.stdout:738: oid 29 version 331 is already newer than 329 2026-02-13T20:14:49.028 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 29 v 331 (ObjNum 286 snap 73 seq_num 286) dirty exists 2026-02-13T20:14:49.028 INFO:tasks.rados.rados.0.trial188.stdout:738: left oid 29 (ObjNum 286 snap 73 seq_num 286) 2026-02-13T20:14:49.878 INFO:tasks.rados.rados.0.trial188.stdout:738: done (2 left) 2026-02-13T20:14:49.878 INFO:tasks.rados.rados.0.trial188.stdout:739: done (1 left) 2026-02-13T20:14:49.878 INFO:tasks.rados.rados.0.trial188.stdout:740: done (0 left) 2026-02-13T20:14:49.878 INFO:tasks.rados.rados.0.trial188.stdout:741: write oid 23 current snap is 74 2026-02-13T20:14:49.878 INFO:tasks.rados.rados.0.trial188.stdout:741: seq_num 287 ranges {423609=701524,1628332=472089,2648987=174622} 2026-02-13T20:14:49.883 INFO:tasks.rados.rados.0.trial188.stdout:741: writing trial18843701-23 from 423609 to 1125133 tid 1 2026-02-13T20:14:49.886 INFO:tasks.rados.rados.0.trial188.stdout:741: writing trial18843701-23 from 1628332 to 2100421 tid 2 2026-02-13T20:14:49.889 INFO:tasks.rados.rados.0.trial188.stdout:741: writing trial18843701-23 from 2648987 to 2823609 tid 3 2026-02-13T20:14:49.889 INFO:tasks.rados.rados.0.trial188.stdout:742: snap_remove snap 73 2026-02-13T20:14:50.880 INFO:tasks.rados.rados.0.trial188.stdout:742: done (1 left) 2026-02-13T20:14:50.881 INFO:tasks.rados.rados.0.trial188.stdout:743: read oid 21 snap 72 2026-02-13T20:14:50.881 INFO:tasks.rados.rados.0.trial188.stdout:743: expect (ObjNum 252 snap 67 seq_num 252) 2026-02-13T20:14:50.881 INFO:tasks.rados.rados.0.trial188.stdout:744: snap_remove snap 69 2026-02-13T20:14:51.883 INFO:tasks.rados.rados.0.trial188.stdout:744: done (2 left) 2026-02-13T20:14:51.884 INFO:tasks.rados.rados.0.trial188.stdout:745: delete oid 12 current snap is 74 2026-02-13T20:14:51.884 INFO:tasks.rados.rados.0.trial188.stdout:741: finishing write tid 1 to trial18843701-23 2026-02-13T20:14:51.884 INFO:tasks.rados.rados.0.trial188.stdout:741: finishing write tid 2 to trial18843701-23 2026-02-13T20:14:51.884 INFO:tasks.rados.rados.0.trial188.stdout:741: finishing write tid 3 to trial18843701-23 2026-02-13T20:14:51.884 INFO:tasks.rados.rados.0.trial188.stdout:741: finishing write tid 4 to trial18843701-23 2026-02-13T20:14:51.884 INFO:tasks.rados.rados.0.trial188.stdout:741: finishing write tid 5 to trial18843701-23 2026-02-13T20:14:51.884 INFO:tasks.rados.rados.0.trial188.stdout:741: oid 23 updating version 0 to 329 2026-02-13T20:14:51.884 INFO:tasks.rados.rados.0.trial188.stdout:741: oid 23 updating version 329 to 330 2026-02-13T20:14:51.884 INFO:tasks.rados.rados.0.trial188.stdout:741: oid 23 version 330 is already newer than 328 2026-02-13T20:14:51.884 INFO:tasks.rados.rados.0.trial188.stdout:741: oid 23 version 330 is already newer than 327 2026-02-13T20:14:51.884 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 23 v 330 (ObjNum 287 snap 74 seq_num 287) dirty exists 2026-02-13T20:14:51.885 INFO:tasks.rados.rados.0.trial188.stdout:741: left oid 23 (ObjNum 287 snap 74 seq_num 287) 2026-02-13T20:14:51.885 INFO:tasks.rados.rados.0.trial188.stdout:743: expect (ObjNum 252 snap 67 seq_num 252) 2026-02-13T20:14:51.885 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:14:51.980 INFO:tasks.rados.rados.0.trial188.stdout:741: done (2 left) 2026-02-13T20:14:51.981 INFO:tasks.rados.rados.0.trial188.stdout:743: done (1 left) 2026-02-13T20:14:51.981 INFO:tasks.rados.rados.0.trial188.stdout:745: done (0 left) 2026-02-13T20:14:51.981 INFO:tasks.rados.rados.0.trial188.stdout:746: snap_create 2026-02-13T20:14:52.875 INFO:tasks.rados.rados.0.trial188.stdout:746: done (0 left) 2026-02-13T20:14:52.876 INFO:tasks.rados.rados.0.trial188.stdout:747: read oid 32 snap -1 2026-02-13T20:14:52.876 INFO:tasks.rados.rados.0.trial188.stdout:747: expect (ObjNum 277 snap 70 seq_num 277) 2026-02-13T20:14:52.876 INFO:tasks.rados.rados.0.trial188.stdout:748: read oid 9 snap 72 2026-02-13T20:14:52.876 INFO:tasks.rados.rados.0.trial188.stdout:748: expect (ObjNum 240 snap 64 seq_num 240) 2026-02-13T20:14:52.876 INFO:tasks.rados.rados.0.trial188.stdout:749: snap_remove snap 74 2026-02-13T20:14:53.875 INFO:tasks.rados.rados.0.trial188.stdout:749: done (2 left) 2026-02-13T20:14:53.876 INFO:tasks.rados.rados.0.trial188.stdout:750: delete oid 14 current snap is 75 2026-02-13T20:14:53.876 INFO:tasks.rados.rados.0.trial188.stdout:748: expect (ObjNum 240 snap 64 seq_num 240) 2026-02-13T20:14:53.885 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1083448 2026-02-13T20:14:53.900 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 90662 2026-02-13T20:14:53.954 INFO:tasks.rados.rados.0.trial188.stdout:747: expect (ObjNum 277 snap 70 seq_num 277) 2026-02-13T20:14:53.955 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:14:54.004 INFO:tasks.rados.rados.0.trial188.stdout:747: done (2 left) 2026-02-13T20:14:54.004 INFO:tasks.rados.rados.0.trial188.stdout:748: done (1 left) 2026-02-13T20:14:54.005 INFO:tasks.rados.rados.0.trial188.stdout:750: done (0 left) 2026-02-13T20:14:54.005 INFO:tasks.rados.rados.0.trial188.stdout:751: read oid 7 snap -1 2026-02-13T20:14:54.005 INFO:tasks.rados.rados.0.trial188.stdout:751: expect (ObjNum 261 snap 68 seq_num 261) 2026-02-13T20:14:54.005 INFO:tasks.rados.rados.0.trial188.stdout:752: delete oid 18 current snap is 75 2026-02-13T20:14:54.009 INFO:tasks.rados.rados.0.trial188.stdout:751: expect (ObjNum 261 snap 68 seq_num 261) 2026-02-13T20:14:54.009 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:14:54.044 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:14:54.061 INFO:tasks.rados.rados.0.trial188.stdout:751: done (1 left) 2026-02-13T20:14:54.062 INFO:tasks.rados.rados.0.trial188.stdout:752: done (0 left) 2026-02-13T20:14:54.062 INFO:tasks.rados.rados.0.trial188.stdout:753: read oid 11 snap 71 2026-02-13T20:14:54.062 INFO:tasks.rados.rados.0.trial188.stdout:753: expect (ObjNum 235 snap 64 seq_num 235) 2026-02-13T20:14:54.062 INFO:tasks.rados.rados.0.trial188.stdout:754: read oid 42 snap -1 2026-02-13T20:14:54.062 INFO:tasks.rados.rados.0.trial188.stdout:754: expect (ObjNum 201 snap 52 seq_num 201) 2026-02-13T20:14:54.062 INFO:tasks.rados.rados.0.trial188.stdout:755: delete oid 17 current snap is 75 2026-02-13T20:14:54.071 INFO:tasks.rados.rados.0.trial188.stdout:754: expect (ObjNum 201 snap 52 seq_num 201) 2026-02-13T20:14:54.260 INFO:tasks.rados.rados.0.trial188.stdout:753: expect (ObjNum 235 snap 64 seq_num 235) 2026-02-13T20:14:54.260 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:14:54.297 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 296352 2026-02-13T20:14:54.368 INFO:tasks.rados.rados.0.trial188.stdout:753: done (2 left) 2026-02-13T20:14:54.369 INFO:tasks.rados.rados.0.trial188.stdout:754: done (1 left) 2026-02-13T20:14:54.369 INFO:tasks.rados.rados.0.trial188.stdout:755: done (0 left) 2026-02-13T20:14:54.369 INFO:tasks.rados.rados.0.trial188.stdout:756: write (excl) oid 49 current snap is 75 2026-02-13T20:14:54.369 INFO:tasks.rados.rados.0.trial188.stdout:756: seq_num 292 ranges {507644=794122,1920742=623085} 2026-02-13T20:14:54.372 INFO:tasks.rados.rados.0.trial188.stdout:756: writing trial18843701-49 from 507644 to 1301766 tid 1 2026-02-13T20:14:54.378 INFO:tasks.rados.rados.0.trial188.stdout:756: writing trial18843701-49 from 1920742 to 2543827 tid 2 2026-02-13T20:14:54.378 INFO:tasks.rados.rados.0.trial188.stdout:757: read oid 26 snap 71 2026-02-13T20:14:54.378 INFO:tasks.rados.rados.0.trial188.stdout:757: expect (ObjNum 213 snap 57 seq_num 213) 2026-02-13T20:14:54.378 INFO:tasks.rados.rados.0.trial188.stdout:758: copy_from oid 31 from oid 48 current snap is 75 2026-02-13T20:14:54.378 INFO:tasks.rados.rados.0.trial188.stdout:759: read oid 33 snap -1 2026-02-13T20:14:54.379 INFO:tasks.rados.rados.0.trial188.stdout:759: expect (ObjNum 187 snap 47 seq_num 187) 2026-02-13T20:14:54.379 INFO:tasks.rados.rados.0.trial188.stdout:760: snap_remove snap 72 2026-02-13T20:14:54.887 INFO:tasks.rados.rados.0.trial188.stdout:760: done (4 left) 2026-02-13T20:14:54.888 INFO:tasks.rados.rados.0.trial188.stdout:761: write (excl) oid 21 current snap is 75 2026-02-13T20:14:54.888 INFO:tasks.rados.rados.0.trial188.stdout:761: seq_num 293 ranges {524451=469371,1579224=483096,2529878=394573} 2026-02-13T20:14:54.891 INFO:tasks.rados.rados.0.trial188.stdout:761: writing trial18843701-21 from 524451 to 993822 tid 1 2026-02-13T20:14:54.895 INFO:tasks.rados.rados.0.trial188.stdout:761: writing trial18843701-21 from 1579224 to 2062320 tid 2 2026-02-13T20:14:54.899 INFO:tasks.rados.rados.0.trial188.stdout:761: writing trial18843701-21 from 2529878 to 2924451 tid 3 2026-02-13T20:14:54.899 INFO:tasks.rados.rados.0.trial188.stdout:762: snap_create 2026-02-13T20:14:54.899 INFO:tasks.rados.rados.0.trial188.stdout:757: expect (ObjNum 213 snap 57 seq_num 213) 2026-02-13T20:14:54.899 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:14:54.951 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1356116 2026-02-13T20:14:54.969 INFO:tasks.rados.rados.0.trial188.stdout:756: finishing write tid 1 to trial18843701-49 2026-02-13T20:14:54.969 INFO:tasks.rados.rados.0.trial188.stdout:756: finishing write tid 2 to trial18843701-49 2026-02-13T20:14:54.969 INFO:tasks.rados.rados.0.trial188.stdout:756: finishing write tid 3 to trial18843701-49 2026-02-13T20:14:54.969 INFO:tasks.rados.rados.0.trial188.stdout:759: expect (ObjNum 187 snap 47 seq_num 187) 2026-02-13T20:14:54.969 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:14:55.057 INFO:tasks.rados.rados.0.trial188.stdout:756: finishing write tid 4 to trial18843701-49 2026-02-13T20:14:55.058 INFO:tasks.rados.rados.0.trial188.stdout:756: oid 49 updating version 0 to 312 2026-02-13T20:14:55.058 INFO:tasks.rados.rados.0.trial188.stdout:756: oid 49 updating version 312 to 314 2026-02-13T20:14:55.058 INFO:tasks.rados.rados.0.trial188.stdout:756: oid 49 version 314 is already newer than 313 2026-02-13T20:14:55.058 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 49 v 314 (ObjNum 292 snap 75 seq_num 292) dirty exists 2026-02-13T20:14:55.058 INFO:tasks.rados.rados.0.trial188.stdout:756: left oid 49 (ObjNum 292 snap 75 seq_num 292) 2026-02-13T20:14:55.058 INFO:tasks.rados.rados.0.trial188.stdout:758: finishing copy_from racing read to trial18843701-31 2026-02-13T20:14:55.058 INFO:tasks.rados.rados.0.trial188.stdout:758: finishing copy_from to trial18843701-31 2026-02-13T20:14:55.058 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 31 v 107 (ObjNum 243 snap 64 seq_num 243) dirty exists 2026-02-13T20:14:55.058 INFO:tasks.rados.rados.0.trial188.stdout:761: finishing write tid 1 to trial18843701-21 2026-02-13T20:14:55.058 INFO:tasks.rados.rados.0.trial188.stdout:761: finishing write tid 2 to trial18843701-21 2026-02-13T20:14:55.059 INFO:tasks.rados.rados.0.trial188.stdout:761: finishing write tid 3 to trial18843701-21 2026-02-13T20:14:55.059 INFO:tasks.rados.rados.0.trial188.stdout:761: finishing write tid 4 to trial18843701-21 2026-02-13T20:14:55.059 INFO:tasks.rados.rados.0.trial188.stdout:761: finishing write tid 5 to trial18843701-21 2026-02-13T20:14:55.059 INFO:tasks.rados.rados.0.trial188.stdout:761: oid 21 updating version 0 to 139 2026-02-13T20:14:55.059 INFO:tasks.rados.rados.0.trial188.stdout:761: oid 21 updating version 139 to 140 2026-02-13T20:14:55.059 INFO:tasks.rados.rados.0.trial188.stdout:761: oid 21 updating version 140 to 141 2026-02-13T20:14:55.059 INFO:tasks.rados.rados.0.trial188.stdout:761: oid 21 version 141 is already newer than 138 2026-02-13T20:14:55.059 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 21 v 141 (ObjNum 293 snap 75 seq_num 293) dirty exists 2026-02-13T20:14:55.059 INFO:tasks.rados.rados.0.trial188.stdout:761: left oid 21 (ObjNum 293 snap 75 seq_num 293) 2026-02-13T20:14:55.891 INFO:tasks.rados.rados.0.trial188.stdout:756: done (5 left) 2026-02-13T20:14:55.891 INFO:tasks.rados.rados.0.trial188.stdout:757: done (4 left) 2026-02-13T20:14:55.891 INFO:tasks.rados.rados.0.trial188.stdout:758: done (3 left) 2026-02-13T20:14:55.891 INFO:tasks.rados.rados.0.trial188.stdout:759: done (2 left) 2026-02-13T20:14:55.891 INFO:tasks.rados.rados.0.trial188.stdout:761: done (1 left) 2026-02-13T20:14:55.891 INFO:tasks.rados.rados.0.trial188.stdout:762: done (0 left) 2026-02-13T20:14:55.891 INFO:tasks.rados.rados.0.trial188.stdout:763: copy_from oid 26 from oid 12 current snap is 76 2026-02-13T20:14:55.892 INFO:tasks.rados.rados.0.trial188.stdout:764: write oid 35 current snap is 76 2026-02-13T20:14:55.892 INFO:tasks.rados.rados.0.trial188.stdout:764: seq_num 294 ranges {541258=544620,1637706=626754,2840948=100310} 2026-02-13T20:14:55.894 INFO:tasks.rados.rados.0.trial188.stdout:764: writing trial18843701-35 from 541258 to 1085878 tid 1 2026-02-13T20:14:55.899 INFO:tasks.rados.rados.0.trial188.stdout:764: writing trial18843701-35 from 1637706 to 2264460 tid 2 2026-02-13T20:14:55.901 INFO:tasks.rados.rados.0.trial188.stdout:764: writing trial18843701-35 from 2840948 to 2941258 tid 3 2026-02-13T20:14:55.902 INFO:tasks.rados.rados.0.trial188.stdout:765: snap_create 2026-02-13T20:14:55.902 INFO:tasks.rados.rados.0.trial188.stdout:763: finishing copy_from to trial18843701-26 2026-02-13T20:14:55.902 INFO:tasks.rados.rados.0.trial188.stdout:763: got expected ENOENT (src dne) 2026-02-13T20:14:55.902 INFO:tasks.rados.rados.0.trial188.stdout:763: finishing copy_from racing read to trial18843701-26 2026-02-13T20:14:55.915 INFO:tasks.rados.rados.0.trial188.stdout:764: finishing write tid 1 to trial18843701-35 2026-02-13T20:14:55.915 INFO:tasks.rados.rados.0.trial188.stdout:764: finishing write tid 2 to trial18843701-35 2026-02-13T20:14:55.915 INFO:tasks.rados.rados.0.trial188.stdout:764: finishing write tid 3 to trial18843701-35 2026-02-13T20:14:55.915 INFO:tasks.rados.rados.0.trial188.stdout:764: finishing write tid 4 to trial18843701-35 2026-02-13T20:14:55.915 INFO:tasks.rados.rados.0.trial188.stdout:764: finishing write tid 5 to trial18843701-35 2026-02-13T20:14:55.915 INFO:tasks.rados.rados.0.trial188.stdout:764: oid 35 updating version 0 to 245 2026-02-13T20:14:55.915 INFO:tasks.rados.rados.0.trial188.stdout:764: oid 35 version 245 is already newer than 244 2026-02-13T20:14:55.915 INFO:tasks.rados.rados.0.trial188.stdout:764: oid 35 version 245 is already newer than 243 2026-02-13T20:14:55.915 INFO:tasks.rados.rados.0.trial188.stdout:764: oid 35 updating version 245 to 246 2026-02-13T20:14:55.915 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 35 v 246 (ObjNum 294 snap 76 seq_num 294) dirty exists 2026-02-13T20:14:55.916 INFO:tasks.rados.rados.0.trial188.stdout:764: left oid 35 (ObjNum 294 snap 76 seq_num 294) 2026-02-13T20:14:56.893 INFO:tasks.rados.rados.0.trial188.stdout:763: done (2 left) 2026-02-13T20:14:56.893 INFO:tasks.rados.rados.0.trial188.stdout:764: done (1 left) 2026-02-13T20:14:56.893 INFO:tasks.rados.rados.0.trial188.stdout:765: done (0 left) 2026-02-13T20:14:56.894 INFO:tasks.rados.rados.0.trial188.stdout:766: write oid 27 current snap is 77 2026-02-13T20:14:56.894 INFO:tasks.rados.rados.0.trial188.stdout:766: seq_num 295 ranges {558065=619869,1579835=486765,2468371=489694} 2026-02-13T20:14:56.897 INFO:tasks.rados.rados.0.trial188.stdout:766: writing trial18843701-27 from 558065 to 1177934 tid 1 2026-02-13T20:14:56.901 INFO:tasks.rados.rados.0.trial188.stdout:766: writing trial18843701-27 from 1579835 to 2066600 tid 2 2026-02-13T20:14:56.904 INFO:tasks.rados.rados.0.trial188.stdout:766: writing trial18843701-27 from 2468371 to 2958065 tid 3 2026-02-13T20:14:56.904 INFO:tasks.rados.rados.0.trial188.stdout:767: delete oid 33 current snap is 77 2026-02-13T20:14:56.921 INFO:tasks.rados.rados.0.trial188.stdout:766: finishing write tid 1 to trial18843701-27 2026-02-13T20:14:56.922 INFO:tasks.rados.rados.0.trial188.stdout:766: finishing write tid 2 to trial18843701-27 2026-02-13T20:14:56.923 INFO:tasks.rados.rados.0.trial188.stdout:766: finishing write tid 3 to trial18843701-27 2026-02-13T20:14:56.923 INFO:tasks.rados.rados.0.trial188.stdout:766: finishing write tid 4 to trial18843701-27 2026-02-13T20:14:56.923 INFO:tasks.rados.rados.0.trial188.stdout:766: finishing write tid 5 to trial18843701-27 2026-02-13T20:14:56.923 INFO:tasks.rados.rados.0.trial188.stdout:766: oid 27 updating version 0 to 320 2026-02-13T20:14:56.923 INFO:tasks.rados.rados.0.trial188.stdout:766: oid 27 updating version 320 to 321 2026-02-13T20:14:56.923 INFO:tasks.rados.rados.0.trial188.stdout:766: oid 27 version 321 is already newer than 318 2026-02-13T20:14:56.923 INFO:tasks.rados.rados.0.trial188.stdout:766: oid 27 version 321 is already newer than 319 2026-02-13T20:14:56.923 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 27 v 321 (ObjNum 295 snap 77 seq_num 295) dirty exists 2026-02-13T20:14:56.924 INFO:tasks.rados.rados.0.trial188.stdout:766: left oid 27 (ObjNum 295 snap 77 seq_num 295) 2026-02-13T20:14:56.924 INFO:tasks.rados.rados.0.trial188.stdout:766: done (1 left) 2026-02-13T20:14:56.924 INFO:tasks.rados.rados.0.trial188.stdout:767: done (0 left) 2026-02-13T20:14:56.924 INFO:tasks.rados.rados.0.trial188.stdout:768: copy_from oid 50 from oid 47 current snap is 77 2026-02-13T20:14:56.924 INFO:tasks.rados.rados.0.trial188.stdout:769: rollback oid 9 current snap is 77 2026-02-13T20:14:56.924 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 9 to 76 2026-02-13T20:14:56.924 INFO:tasks.rados.rados.0.trial188.stdout:770: snap_create 2026-02-13T20:14:56.925 INFO:tasks.rados.rados.0.trial188.stdout:769: finishing rollback tid 0 to trial18843701-9 2026-02-13T20:14:56.925 INFO:tasks.rados.rados.0.trial188.stdout:768: finishing copy_from to trial18843701-50 2026-02-13T20:14:56.925 INFO:tasks.rados.rados.0.trial188.stdout:768: got expected ENOENT (src dne) 2026-02-13T20:14:56.925 INFO:tasks.rados.rados.0.trial188.stdout:768: finishing copy_from racing read to trial18843701-50 2026-02-13T20:14:56.925 INFO:tasks.rados.rados.0.trial188.stdout:769: finishing rollback tid 1 to trial18843701-9 2026-02-13T20:14:56.925 INFO:tasks.rados.rados.0.trial188.stdout:769: finishing rollback tid 2 to trial18843701-9 2026-02-13T20:14:56.926 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 9 v 249 (ObjNum 240 snap 64 seq_num 240) dirty exists 2026-02-13T20:14:57.876 INFO:tasks.rados.rados.0.trial188.stdout:768: done (2 left) 2026-02-13T20:14:57.877 INFO:tasks.rados.rados.0.trial188.stdout:769: done (1 left) 2026-02-13T20:14:57.877 INFO:tasks.rados.rados.0.trial188.stdout:770: done (0 left) 2026-02-13T20:14:57.877 INFO:tasks.rados.rados.0.trial188.stdout:771: write oid 3 current snap is 78 2026-02-13T20:14:57.877 INFO:tasks.rados.rados.0.trial188.stdout:771: seq_num 297 ranges {591679=486720,1813152=490434} 2026-02-13T20:14:57.881 INFO:tasks.rados.rados.0.trial188.stdout:771: writing trial18843701-3 from 591679 to 1078399 tid 1 2026-02-13T20:14:57.885 INFO:tasks.rados.rados.0.trial188.stdout:771: writing trial18843701-3 from 1813152 to 2303586 tid 2 2026-02-13T20:14:57.885 INFO:tasks.rados.rados.0.trial188.stdout:772: read oid 24 snap -1 2026-02-13T20:14:57.885 INFO:tasks.rados.rados.0.trial188.stdout:772: expect (ObjNum 280 snap 71 seq_num 280) 2026-02-13T20:14:57.886 INFO:tasks.rados.rados.0.trial188.stdout:773: snap_create 2026-02-13T20:14:57.902 INFO:tasks.rados.rados.0.trial188.stdout:771: finishing write tid 1 to trial18843701-3 2026-02-13T20:14:57.902 INFO:tasks.rados.rados.0.trial188.stdout:771: finishing write tid 2 to trial18843701-3 2026-02-13T20:14:57.902 INFO:tasks.rados.rados.0.trial188.stdout:771: finishing write tid 3 to trial18843701-3 2026-02-13T20:14:57.902 INFO:tasks.rados.rados.0.trial188.stdout:771: finishing write tid 4 to trial18843701-3 2026-02-13T20:14:57.902 INFO:tasks.rados.rados.0.trial188.stdout:771: oid 3 updating version 0 to 300 2026-02-13T20:14:57.902 INFO:tasks.rados.rados.0.trial188.stdout:771: oid 3 updating version 300 to 302 2026-02-13T20:14:57.903 INFO:tasks.rados.rados.0.trial188.stdout:771: oid 3 version 302 is already newer than 301 2026-02-13T20:14:57.903 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 3 v 302 (ObjNum 297 snap 78 seq_num 297) dirty exists 2026-02-13T20:14:57.903 INFO:tasks.rados.rados.0.trial188.stdout:771: left oid 3 (ObjNum 297 snap 78 seq_num 297) 2026-02-13T20:14:57.903 INFO:tasks.rados.rados.0.trial188.stdout:772: expect (ObjNum 280 snap 71 seq_num 280) 2026-02-13T20:14:57.991 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2490217 2026-02-13T20:14:58.877 INFO:tasks.rados.rados.0.trial188.stdout:771: done (2 left) 2026-02-13T20:14:58.877 INFO:tasks.rados.rados.0.trial188.stdout:772: done (1 left) 2026-02-13T20:14:58.877 INFO:tasks.rados.rados.0.trial188.stdout:773: done (0 left) 2026-02-13T20:14:58.877 INFO:tasks.rados.rados.0.trial188.stdout:774: read oid 13 snap 78 2026-02-13T20:14:58.877 INFO:tasks.rados.rados.0.trial188.stdout:774: expect (ObjNum 260 snap 68 seq_num 260) 2026-02-13T20:14:58.878 INFO:tasks.rados.rados.0.trial188.stdout:775: snap_remove snap 75 2026-02-13T20:14:59.877 INFO:tasks.rados.rados.0.trial188.stdout:775: done (1 left) 2026-02-13T20:14:59.877 INFO:tasks.rados.rados.0.trial188.stdout:776: write (excl) oid 20 current snap is 79 2026-02-13T20:14:59.877 INFO:tasks.rados.rados.0.trial188.stdout:776: seq_num 298 ranges {608486=561969,1871634=634092,2950640=57846} 2026-02-13T20:14:59.882 INFO:tasks.rados.rados.0.trial188.stdout:776: writing trial18843701-20 from 608486 to 1170455 tid 1 2026-02-13T20:14:59.887 INFO:tasks.rados.rados.0.trial188.stdout:776: writing trial18843701-20 from 1871634 to 2505726 tid 2 2026-02-13T20:14:59.889 INFO:tasks.rados.rados.0.trial188.stdout:776: writing trial18843701-20 from 2950640 to 3008486 tid 3 2026-02-13T20:14:59.889 INFO:tasks.rados.rados.0.trial188.stdout:777: read oid 22 snap 71 2026-02-13T20:14:59.889 INFO:tasks.rados.rados.0.trial188.stdout:777: expect (ObjNum 273 snap 70 seq_num 273) 2026-02-13T20:14:59.889 INFO:tasks.rados.rados.0.trial188.stdout:778: copy_from oid 8 from oid 40 current snap is 79 2026-02-13T20:14:59.889 INFO:tasks.rados.rados.0.trial188.stdout:774: expect (ObjNum 260 snap 68 seq_num 260) 2026-02-13T20:14:59.889 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 41281 2026-02-13T20:14:59.910 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 862986 2026-02-13T20:14:59.935 INFO:tasks.rados.rados.0.trial188.stdout:777: expect (ObjNum 273 snap 70 seq_num 273) 2026-02-13T20:15:00.027 INFO:tasks.rados.rados.0.trial188.stdout:778: finishing copy_from to trial18843701-8 2026-02-13T20:15:00.028 INFO:tasks.rados.rados.0.trial188.stdout:778: got expected ENOENT (src dne) 2026-02-13T20:15:00.028 INFO:tasks.rados.rados.0.trial188.stdout:778: finishing copy_from racing read to trial18843701-8 2026-02-13T20:15:00.028 INFO:tasks.rados.rados.0.trial188.stdout:776: finishing write tid 1 to trial18843701-20 2026-02-13T20:15:00.028 INFO:tasks.rados.rados.0.trial188.stdout:774: done (3 left) 2026-02-13T20:15:00.028 INFO:tasks.rados.rados.0.trial188.stdout:777: done (2 left) 2026-02-13T20:15:00.028 INFO:tasks.rados.rados.0.trial188.stdout:778: done (1 left) 2026-02-13T20:15:00.028 INFO:tasks.rados.rados.0.trial188.stdout:779: snap_remove snap 76 2026-02-13T20:15:00.881 INFO:tasks.rados.rados.0.trial188.stdout:779: done (1 left) 2026-02-13T20:15:00.881 INFO:tasks.rados.rados.0.trial188.stdout:780: read oid 38 snap -1 2026-02-13T20:15:00.881 INFO:tasks.rados.rados.0.trial188.stdout:780: expect (ObjNum 193 snap 47 seq_num 193) 2026-02-13T20:15:00.881 INFO:tasks.rados.rados.0.trial188.stdout:781: read oid 16 snap -1 2026-02-13T20:15:00.881 INFO:tasks.rados.rados.0.trial188.stdout:781: expect (ObjNum 282 snap 71 seq_num 282) 2026-02-13T20:15:00.881 INFO:tasks.rados.rados.0.trial188.stdout:782: delete oid 5 current snap is 79 2026-02-13T20:15:00.881 INFO:tasks.rados.rados.0.trial188.stdout:776: finishing write tid 2 to trial18843701-20 2026-02-13T20:15:00.881 INFO:tasks.rados.rados.0.trial188.stdout:776: finishing write tid 3 to trial18843701-20 2026-02-13T20:15:00.881 INFO:tasks.rados.rados.0.trial188.stdout:776: finishing write tid 4 to trial18843701-20 2026-02-13T20:15:00.881 INFO:tasks.rados.rados.0.trial188.stdout:776: finishing write tid 5 to trial18843701-20 2026-02-13T20:15:00.881 INFO:tasks.rados.rados.0.trial188.stdout:776: oid 20 updating version 0 to 42 2026-02-13T20:15:00.881 INFO:tasks.rados.rados.0.trial188.stdout:776: oid 20 version 42 is already newer than 40 2026-02-13T20:15:00.881 INFO:tasks.rados.rados.0.trial188.stdout:776: oid 20 version 42 is already newer than 41 2026-02-13T20:15:00.881 INFO:tasks.rados.rados.0.trial188.stdout:776: oid 20 version 42 is already newer than 39 2026-02-13T20:15:00.881 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 20 v 42 (ObjNum 298 snap 79 seq_num 298) dirty exists 2026-02-13T20:15:00.881 INFO:tasks.rados.rados.0.trial188.stdout:776: left oid 20 (ObjNum 298 snap 79 seq_num 298) 2026-02-13T20:15:00.884 INFO:tasks.rados.rados.0.trial188.stdout:776: done (3 left) 2026-02-13T20:15:00.884 INFO:tasks.rados.rados.0.trial188.stdout:782: done (2 left) 2026-02-13T20:15:00.884 INFO:tasks.rados.rados.0.trial188.stdout:783: snap_remove snap 78 2026-02-13T20:15:01.884 INFO:tasks.rados.rados.0.trial188.stdout:783: done (2 left) 2026-02-13T20:15:01.884 INFO:tasks.rados.rados.0.trial188.stdout:784: snap_create 2026-02-13T20:15:01.884 INFO:tasks.rados.rados.0.trial188.stdout:781: expect (ObjNum 282 snap 71 seq_num 282) 2026-02-13T20:15:01.884 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:15:01.903 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:15:01.922 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:15:01.940 INFO:tasks.rados.rados.0.trial188.stdout:780: expect (ObjNum 193 snap 47 seq_num 193) 2026-02-13T20:15:01.942 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1143498 2026-02-13T20:15:01.989 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 3039693 2026-02-13T20:15:02.878 INFO:tasks.rados.rados.0.trial188.stdout:780: done (2 left) 2026-02-13T20:15:02.878 INFO:tasks.rados.rados.0.trial188.stdout:781: done (1 left) 2026-02-13T20:15:02.878 INFO:tasks.rados.rados.0.trial188.stdout:784: done (0 left) 2026-02-13T20:15:02.878 INFO:tasks.rados.rados.0.trial188.stdout:785: copy_from oid 27 from oid 37 current snap is 80 2026-02-13T20:15:02.878 INFO:tasks.rados.rados.0.trial188.stdout:786: read oid 18 snap 79 2026-02-13T20:15:02.878 INFO:tasks.rados.rados.0.trial188.stdout:786: expect deleted 2026-02-13T20:15:02.878 INFO:tasks.rados.rados.0.trial188.stdout:787: snap_create 2026-02-13T20:15:02.921 INFO:tasks.rados.rados.0.trial188.stdout:785: finishing copy_from racing read to trial18843701-27 2026-02-13T20:15:02.922 INFO:tasks.rados.rados.0.trial188.stdout:785: finishing copy_from to trial18843701-27 2026-02-13T20:15:02.923 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 27 v 94 (ObjNum 232 snap 63 seq_num 232) dirty exists 2026-02-13T20:15:03.881 INFO:tasks.rados.rados.0.trial188.stdout:785: done (2 left) 2026-02-13T20:15:03.882 INFO:tasks.rados.rados.0.trial188.stdout:786: done (1 left) 2026-02-13T20:15:03.882 INFO:tasks.rados.rados.0.trial188.stdout:787: done (0 left) 2026-02-13T20:15:03.882 INFO:tasks.rados.rados.0.trial188.stdout:788: rollback oid 30 current snap is 81 2026-02-13T20:15:03.882 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 30 to 80 2026-02-13T20:15:03.882 INFO:tasks.rados.rados.0.trial188.stdout:789: write (excl) oid 43 current snap is 81 2026-02-13T20:15:03.882 INFO:tasks.rados.rados.0.trial188.stdout:789: seq_num 300 ranges {642100=712467,1872245=637761} 2026-02-13T20:15:03.886 INFO:tasks.rados.rados.0.trial188.stdout:789: writing trial18843701-43 from 642100 to 1354567 tid 1 2026-02-13T20:15:03.891 INFO:tasks.rados.rados.0.trial188.stdout:789: writing trial18843701-43 from 1872245 to 2510006 tid 2 2026-02-13T20:15:03.891 INFO:tasks.rados.rados.0.trial188.stdout:790: write (excl) oid 8 current snap is 81 2026-02-13T20:15:03.891 INFO:tasks.rados.rados.0.trial188.stdout:788: finishing rollback tid 0 to trial18843701-30 2026-02-13T20:15:03.891 INFO:tasks.rados.rados.0.trial188.stdout:788: finishing rollback tid 1 to trial18843701-30 2026-02-13T20:15:03.891 INFO:tasks.rados.rados.0.trial188.stdout:788: finishing rollback tid 2 to trial18843701-30 2026-02-13T20:15:03.891 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 30 v 331 (ObjNum 254 snap 68 seq_num 254) dirty exists 2026-02-13T20:15:03.891 INFO:tasks.rados.rados.0.trial188.stdout:790: seq_num 301 ranges {658907=787716,1930727=497772,3032909=25998} 2026-02-13T20:15:03.896 INFO:tasks.rados.rados.0.trial188.stdout:790: writing trial18843701-8 from 658907 to 1446623 tid 1 2026-02-13T20:15:03.900 INFO:tasks.rados.rados.0.trial188.stdout:790: writing trial18843701-8 from 1930727 to 2428499 tid 2 2026-02-13T20:15:03.902 INFO:tasks.rados.rados.0.trial188.stdout:790: writing trial18843701-8 from 3032909 to 3058907 tid 3 2026-02-13T20:15:03.902 INFO:tasks.rados.rados.0.trial188.stdout:788: done (2 left) 2026-02-13T20:15:03.902 INFO:tasks.rados.rados.0.trial188.stdout:791: read oid 33 snap 77 2026-02-13T20:15:03.903 INFO:tasks.rados.rados.0.trial188.stdout:791: expect deleted 2026-02-13T20:15:03.903 INFO:tasks.rados.rados.0.trial188.stdout:792: snap_remove snap 80 2026-02-13T20:15:04.892 INFO:tasks.rados.rados.0.trial188.stdout:792: done (3 left) 2026-02-13T20:15:04.892 INFO:tasks.rados.rados.0.trial188.stdout:793: write (excl) oid 45 current snap is 81 2026-02-13T20:15:04.892 INFO:tasks.rados.rados.0.trial188.stdout:793: seq_num 302 ranges {675714=462965,1589209=641430,2943979=131735} 2026-02-13T20:15:04.897 INFO:tasks.rados.rados.0.trial188.stdout:793: writing trial18843701-45 from 675714 to 1138679 tid 1 2026-02-13T20:15:04.901 INFO:tasks.rados.rados.0.trial188.stdout:793: writing trial18843701-45 from 1589209 to 2230639 tid 2 2026-02-13T20:15:04.904 INFO:tasks.rados.rados.0.trial188.stdout:793: writing trial18843701-45 from 2943979 to 3075714 tid 3 2026-02-13T20:15:04.905 INFO:tasks.rados.rados.0.trial188.stdout:794: delete oid 27 current snap is 81 2026-02-13T20:15:04.905 INFO:tasks.rados.rados.0.trial188.stdout:789: finishing write tid 1 to trial18843701-43 2026-02-13T20:15:04.905 INFO:tasks.rados.rados.0.trial188.stdout:789: finishing write tid 2 to trial18843701-43 2026-02-13T20:15:04.905 INFO:tasks.rados.rados.0.trial188.stdout:789: finishing write tid 3 to trial18843701-43 2026-02-13T20:15:04.905 INFO:tasks.rados.rados.0.trial188.stdout:789: finishing write tid 4 to trial18843701-43 2026-02-13T20:15:04.905 INFO:tasks.rados.rados.0.trial188.stdout:789: oid 43 updating version 0 to 121 2026-02-13T20:15:04.905 INFO:tasks.rados.rados.0.trial188.stdout:789: oid 43 updating version 121 to 122 2026-02-13T20:15:04.905 INFO:tasks.rados.rados.0.trial188.stdout:789: oid 43 version 122 is already newer than 120 2026-02-13T20:15:04.905 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 43 v 122 (ObjNum 300 snap 81 seq_num 300) dirty exists 2026-02-13T20:15:04.905 INFO:tasks.rados.rados.0.trial188.stdout:789: left oid 43 (ObjNum 300 snap 81 seq_num 300) 2026-02-13T20:15:04.905 INFO:tasks.rados.rados.0.trial188.stdout:790: finishing write tid 1 to trial18843701-8 2026-02-13T20:15:04.906 INFO:tasks.rados.rados.0.trial188.stdout:790: finishing write tid 2 to trial18843701-8 2026-02-13T20:15:04.906 INFO:tasks.rados.rados.0.trial188.stdout:790: finishing write tid 3 to trial18843701-8 2026-02-13T20:15:04.906 INFO:tasks.rados.rados.0.trial188.stdout:790: finishing write tid 4 to trial18843701-8 2026-02-13T20:15:04.906 INFO:tasks.rados.rados.0.trial188.stdout:790: finishing write tid 5 to trial18843701-8 2026-02-13T20:15:04.906 INFO:tasks.rados.rados.0.trial188.stdout:790: oid 8 updating version 0 to 257 2026-02-13T20:15:04.906 INFO:tasks.rados.rados.0.trial188.stdout:790: oid 8 version 257 is already newer than 256 2026-02-13T20:15:04.906 INFO:tasks.rados.rados.0.trial188.stdout:790: oid 8 updating version 257 to 258 2026-02-13T20:15:04.906 INFO:tasks.rados.rados.0.trial188.stdout:790: oid 8 version 258 is already newer than 255 2026-02-13T20:15:04.906 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 8 v 258 (ObjNum 301 snap 81 seq_num 301) dirty exists 2026-02-13T20:15:04.906 INFO:tasks.rados.rados.0.trial188.stdout:790: left oid 8 (ObjNum 301 snap 81 seq_num 301) 2026-02-13T20:15:04.916 INFO:tasks.rados.rados.0.trial188.stdout:793: finishing write tid 1 to trial18843701-45 2026-02-13T20:15:04.916 INFO:tasks.rados.rados.0.trial188.stdout:793: finishing write tid 2 to trial18843701-45 2026-02-13T20:15:04.916 INFO:tasks.rados.rados.0.trial188.stdout:793: finishing write tid 3 to trial18843701-45 2026-02-13T20:15:04.917 INFO:tasks.rados.rados.0.trial188.stdout:793: finishing write tid 4 to trial18843701-45 2026-02-13T20:15:04.917 INFO:tasks.rados.rados.0.trial188.stdout:793: finishing write tid 5 to trial18843701-45 2026-02-13T20:15:04.917 INFO:tasks.rados.rados.0.trial188.stdout:793: oid 45 updating version 0 to 261 2026-02-13T20:15:04.917 INFO:tasks.rados.rados.0.trial188.stdout:793: oid 45 updating version 261 to 263 2026-02-13T20:15:04.918 INFO:tasks.rados.rados.0.trial188.stdout:793: oid 45 version 263 is already newer than 260 2026-02-13T20:15:04.918 INFO:tasks.rados.rados.0.trial188.stdout:793: oid 45 version 263 is already newer than 262 2026-02-13T20:15:04.918 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 45 v 263 (ObjNum 302 snap 81 seq_num 302) dirty exists 2026-02-13T20:15:04.918 INFO:tasks.rados.rados.0.trial188.stdout:793: left oid 45 (ObjNum 302 snap 81 seq_num 302) 2026-02-13T20:15:04.918 INFO:tasks.rados.rados.0.trial188.stdout:789: done (4 left) 2026-02-13T20:15:04.918 INFO:tasks.rados.rados.0.trial188.stdout:790: done (3 left) 2026-02-13T20:15:04.918 INFO:tasks.rados.rados.0.trial188.stdout:791: done (2 left) 2026-02-13T20:15:04.918 INFO:tasks.rados.rados.0.trial188.stdout:793: done (1 left) 2026-02-13T20:15:04.918 INFO:tasks.rados.rados.0.trial188.stdout:794: done (0 left) 2026-02-13T20:15:04.918 INFO:tasks.rados.rados.0.trial188.stdout:795: snap_create 2026-02-13T20:15:05.894 INFO:tasks.rados.rados.0.trial188.stdout:795: done (0 left) 2026-02-13T20:15:05.894 INFO:tasks.rados.rados.0.trial188.stdout:796: write oid 38 current snap is 82 2026-02-13T20:15:05.895 INFO:tasks.rados.rados.0.trial188.stdout:796: seq_num 304 ranges {709328=613463,1989820=645099} 2026-02-13T20:15:05.899 INFO:tasks.rados.rados.0.trial188.stdout:796: writing trial18843701-38 from 709328 to 1322791 tid 1 2026-02-13T20:15:05.904 INFO:tasks.rados.rados.0.trial188.stdout:796: writing trial18843701-38 from 1989820 to 2634919 tid 2 2026-02-13T20:15:05.905 INFO:tasks.rados.rados.0.trial188.stdout:797: read oid 7 snap -1 2026-02-13T20:15:05.905 INFO:tasks.rados.rados.0.trial188.stdout:797: expect (ObjNum 261 snap 68 seq_num 261) 2026-02-13T20:15:05.905 INFO:tasks.rados.rados.0.trial188.stdout:798: rollback oid 32 current snap is 82 2026-02-13T20:15:05.905 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 32 to 79 2026-02-13T20:15:05.905 INFO:tasks.rados.rados.0.trial188.stdout:799: rollback oid 45 current snap is 82 2026-02-13T20:15:05.905 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 45 to 81 2026-02-13T20:15:05.905 INFO:tasks.rados.rados.0.trial188.stdout:800: delete oid 40 current snap is 82 2026-02-13T20:15:05.908 INFO:tasks.rados.rados.0.trial188.stdout:798: finishing rollback tid 0 to trial18843701-32 2026-02-13T20:15:05.908 INFO:tasks.rados.rados.0.trial188.stdout:798: finishing rollback tid 1 to trial18843701-32 2026-02-13T20:15:05.908 INFO:tasks.rados.rados.0.trial188.stdout:798: finishing rollback tid 2 to trial18843701-32 2026-02-13T20:15:05.908 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 32 v 256 (ObjNum 277 snap 70 seq_num 277) dirty exists 2026-02-13T20:15:05.908 INFO:tasks.rados.rados.0.trial188.stdout:798: done (4 left) 2026-02-13T20:15:05.908 INFO:tasks.rados.rados.0.trial188.stdout:800: done (3 left) 2026-02-13T20:15:05.908 INFO:tasks.rados.rados.0.trial188.stdout:801: read oid 25 snap 81 2026-02-13T20:15:05.908 INFO:tasks.rados.rados.0.trial188.stdout:801: expect (ObjNum 269 snap 70 seq_num 269) 2026-02-13T20:15:05.908 INFO:tasks.rados.rados.0.trial188.stdout:802: write (excl) oid 37 current snap is 82 2026-02-13T20:15:05.909 INFO:tasks.rados.rados.0.trial188.stdout:802: seq_num 306 ranges {742942=480314,1823137=648768} 2026-02-13T20:15:05.912 INFO:tasks.rados.rados.0.trial188.stdout:802: writing trial18843701-37 from 742942 to 1223256 tid 1 2026-02-13T20:15:05.917 INFO:tasks.rados.rados.0.trial188.stdout:802: writing trial18843701-37 from 1823137 to 2471905 tid 2 2026-02-13T20:15:05.917 INFO:tasks.rados.rados.0.trial188.stdout:803: copy_from oid 4 from oid 43 current snap is 82 2026-02-13T20:15:05.917 INFO:tasks.rados.rados.0.trial188.stdout:797: expect (ObjNum 261 snap 68 seq_num 261) 2026-02-13T20:15:05.923 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1389215 2026-02-13T20:15:05.930 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:15:05.948 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:15:05.965 INFO:tasks.rados.rados.0.trial188.stdout:801: expect (ObjNum 269 snap 70 seq_num 269) 2026-02-13T20:15:05.985 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1713655 2026-02-13T20:15:06.012 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1476490 2026-02-13T20:15:06.039 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 785626 2026-02-13T20:15:06.069 INFO:tasks.rados.rados.0.trial188.stdout:796: finishing write tid 1 to trial18843701-38 2026-02-13T20:15:06.069 INFO:tasks.rados.rados.0.trial188.stdout:797: done (5 left) 2026-02-13T20:15:06.070 INFO:tasks.rados.rados.0.trial188.stdout:801: done (4 left) 2026-02-13T20:15:06.070 INFO:tasks.rados.rados.0.trial188.stdout:804: write (excl) oid 44 current snap is 82 2026-02-13T20:15:06.070 INFO:tasks.rados.rados.0.trial188.stdout:799: finishing rollback tid 0 to trial18843701-45 2026-02-13T20:15:06.070 INFO:tasks.rados.rados.0.trial188.stdout:799: finishing rollback tid 1 to trial18843701-45 2026-02-13T20:15:06.070 INFO:tasks.rados.rados.0.trial188.stdout:799: finishing rollback tid 2 to trial18843701-45 2026-02-13T20:15:06.070 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 45 v 267 (ObjNum 302 snap 81 seq_num 302) dirty exists 2026-02-13T20:15:06.070 INFO:tasks.rados.rados.0.trial188.stdout:802: finishing write tid 1 to trial18843701-37 2026-02-13T20:15:06.070 INFO:tasks.rados.rados.0.trial188.stdout:796: finishing write tid 2 to trial18843701-38 2026-02-13T20:15:06.070 INFO:tasks.rados.rados.0.trial188.stdout:796: finishing write tid 3 to trial18843701-38 2026-02-13T20:15:06.070 INFO:tasks.rados.rados.0.trial188.stdout:796: finishing write tid 4 to trial18843701-38 2026-02-13T20:15:06.071 INFO:tasks.rados.rados.0.trial188.stdout:796: oid 38 updating version 0 to 337 2026-02-13T20:15:06.071 INFO:tasks.rados.rados.0.trial188.stdout:796: oid 38 version 337 is already newer than 336 2026-02-13T20:15:06.071 INFO:tasks.rados.rados.0.trial188.stdout:796: oid 38 updating version 337 to 338 2026-02-13T20:15:06.071 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 38 v 338 (ObjNum 304 snap 82 seq_num 304) dirty exists 2026-02-13T20:15:06.071 INFO:tasks.rados.rados.0.trial188.stdout:796: left oid 38 (ObjNum 304 snap 82 seq_num 304) 2026-02-13T20:15:06.071 INFO:tasks.rados.rados.0.trial188.stdout:802: finishing write tid 2 to trial18843701-37 2026-02-13T20:15:06.071 INFO:tasks.rados.rados.0.trial188.stdout:802: finishing write tid 3 to trial18843701-37 2026-02-13T20:15:06.071 INFO:tasks.rados.rados.0.trial188.stdout:802: finishing write tid 4 to trial18843701-37 2026-02-13T20:15:06.071 INFO:tasks.rados.rados.0.trial188.stdout:802: oid 37 updating version 0 to 270 2026-02-13T20:15:06.071 INFO:tasks.rados.rados.0.trial188.stdout:802: oid 37 version 270 is already newer than 269 2026-02-13T20:15:06.072 INFO:tasks.rados.rados.0.trial188.stdout:802: oid 37 updating version 270 to 271 2026-02-13T20:15:06.072 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 37 v 271 (ObjNum 306 snap 82 seq_num 306) dirty exists 2026-02-13T20:15:06.072 INFO:tasks.rados.rados.0.trial188.stdout:802: left oid 37 (ObjNum 306 snap 82 seq_num 306) 2026-02-13T20:15:06.072 INFO:tasks.rados.rados.0.trial188.stdout:803: finishing copy_from racing read to trial18843701-4 2026-02-13T20:15:06.072 INFO:tasks.rados.rados.0.trial188.stdout:803: finishing copy_from to trial18843701-4 2026-02-13T20:15:06.072 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 4 v 122 (ObjNum 300 snap 81 seq_num 300) dirty exists 2026-02-13T20:15:06.072 INFO:tasks.rados.rados.0.trial188.stdout:804: seq_num 307 ranges {759749=555563,1765266=792426,2964741=195008} 2026-02-13T20:15:06.074 INFO:tasks.rados.rados.0.trial188.stdout:804: writing trial18843701-44 from 759749 to 1315312 tid 1 2026-02-13T20:15:06.078 INFO:tasks.rados.rados.0.trial188.stdout:804: writing trial18843701-44 from 1765266 to 2557692 tid 2 2026-02-13T20:15:06.081 INFO:tasks.rados.rados.0.trial188.stdout:804: writing trial18843701-44 from 2964741 to 3159749 tid 3 2026-02-13T20:15:06.081 INFO:tasks.rados.rados.0.trial188.stdout:796: done (4 left) 2026-02-13T20:15:06.081 INFO:tasks.rados.rados.0.trial188.stdout:799: done (3 left) 2026-02-13T20:15:06.081 INFO:tasks.rados.rados.0.trial188.stdout:802: done (2 left) 2026-02-13T20:15:06.081 INFO:tasks.rados.rados.0.trial188.stdout:803: done (1 left) 2026-02-13T20:15:06.081 INFO:tasks.rados.rados.0.trial188.stdout:805: snap_create 2026-02-13T20:15:06.095 INFO:tasks.rados.rados.0.trial188.stdout:804: finishing write tid 1 to trial18843701-44 2026-02-13T20:15:06.096 INFO:tasks.rados.rados.0.trial188.stdout:804: finishing write tid 2 to trial18843701-44 2026-02-13T20:15:06.096 INFO:tasks.rados.rados.0.trial188.stdout:804: finishing write tid 3 to trial18843701-44 2026-02-13T20:15:06.096 INFO:tasks.rados.rados.0.trial188.stdout:804: finishing write tid 4 to trial18843701-44 2026-02-13T20:15:06.096 INFO:tasks.rados.rados.0.trial188.stdout:804: finishing write tid 5 to trial18843701-44 2026-02-13T20:15:06.096 INFO:tasks.rados.rados.0.trial188.stdout:804: oid 44 updating version 0 to 376 2026-02-13T20:15:06.096 INFO:tasks.rados.rados.0.trial188.stdout:804: oid 44 version 376 is already newer than 375 2026-02-13T20:15:06.096 INFO:tasks.rados.rados.0.trial188.stdout:804: oid 44 updating version 376 to 378 2026-02-13T20:15:06.096 INFO:tasks.rados.rados.0.trial188.stdout:804: oid 44 version 378 is already newer than 377 2026-02-13T20:15:06.097 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 44 v 378 (ObjNum 307 snap 82 seq_num 307) dirty exists 2026-02-13T20:15:06.097 INFO:tasks.rados.rados.0.trial188.stdout:804: left oid 44 (ObjNum 307 snap 82 seq_num 307) 2026-02-13T20:15:06.898 INFO:tasks.rados.rados.0.trial188.stdout:804: done (1 left) 2026-02-13T20:15:06.899 INFO:tasks.rados.rados.0.trial188.stdout:805: done (0 left) 2026-02-13T20:15:06.899 INFO:tasks.rados.rados.0.trial188.stdout:806: write oid 4 current snap is 83 2026-02-13T20:15:06.899 INFO:tasks.rados.rados.0.trial188.stdout:806: seq_num 308 ranges {776556=630812,1823748=652437,3108517=68039} 2026-02-13T20:15:06.903 INFO:tasks.rados.rados.0.trial188.stdout:806: writing trial18843701-4 from 776556 to 1407368 tid 1 2026-02-13T20:15:06.907 INFO:tasks.rados.rados.0.trial188.stdout:806: writing trial18843701-4 from 1823748 to 2476185 tid 2 2026-02-13T20:15:06.910 INFO:tasks.rados.rados.0.trial188.stdout:806: writing trial18843701-4 from 3108517 to 3176556 tid 3 2026-02-13T20:15:06.910 INFO:tasks.rados.rados.0.trial188.stdout:807: write oid 7 current snap is 83 2026-02-13T20:15:06.910 INFO:tasks.rados.rados.0.trial188.stdout:807: seq_num 309 ranges {793363=706061,2282230=796095} 2026-02-13T20:15:06.916 INFO:tasks.rados.rados.0.trial188.stdout:807: writing trial18843701-7 from 793363 to 1499424 tid 1 2026-02-13T20:15:06.921 INFO:tasks.rados.rados.0.trial188.stdout:807: writing trial18843701-7 from 2282230 to 3078325 tid 2 2026-02-13T20:15:06.922 INFO:tasks.rados.rados.0.trial188.stdout:808: snap_create 2026-02-13T20:15:06.933 INFO:tasks.rados.rados.0.trial188.stdout:806: finishing write tid 1 to trial18843701-4 2026-02-13T20:15:06.933 INFO:tasks.rados.rados.0.trial188.stdout:806: finishing write tid 2 to trial18843701-4 2026-02-13T20:15:06.943 INFO:tasks.rados.rados.0.trial188.stdout:806: finishing write tid 3 to trial18843701-4 2026-02-13T20:15:06.943 INFO:tasks.rados.rados.0.trial188.stdout:806: finishing write tid 4 to trial18843701-4 2026-02-13T20:15:06.943 INFO:tasks.rados.rados.0.trial188.stdout:807: finishing write tid 1 to trial18843701-7 2026-02-13T20:15:06.943 INFO:tasks.rados.rados.0.trial188.stdout:806: finishing write tid 5 to trial18843701-4 2026-02-13T20:15:06.943 INFO:tasks.rados.rados.0.trial188.stdout:806: oid 4 updating version 0 to 304 2026-02-13T20:15:06.943 INFO:tasks.rados.rados.0.trial188.stdout:806: oid 4 updating version 304 to 305 2026-02-13T20:15:06.943 INFO:tasks.rados.rados.0.trial188.stdout:806: oid 4 updating version 305 to 307 2026-02-13T20:15:06.943 INFO:tasks.rados.rados.0.trial188.stdout:806: oid 4 version 307 is already newer than 306 2026-02-13T20:15:06.943 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 4 v 307 (ObjNum 308 snap 83 seq_num 308) dirty exists 2026-02-13T20:15:06.943 INFO:tasks.rados.rados.0.trial188.stdout:806: left oid 4 (ObjNum 308 snap 83 seq_num 308) 2026-02-13T20:15:06.944 INFO:tasks.rados.rados.0.trial188.stdout:807: finishing write tid 2 to trial18843701-7 2026-02-13T20:15:06.944 INFO:tasks.rados.rados.0.trial188.stdout:807: finishing write tid 3 to trial18843701-7 2026-02-13T20:15:06.944 INFO:tasks.rados.rados.0.trial188.stdout:807: finishing write tid 4 to trial18843701-7 2026-02-13T20:15:06.944 INFO:tasks.rados.rados.0.trial188.stdout:807: oid 7 updating version 0 to 337 2026-02-13T20:15:06.944 INFO:tasks.rados.rados.0.trial188.stdout:807: oid 7 updating version 337 to 338 2026-02-13T20:15:06.944 INFO:tasks.rados.rados.0.trial188.stdout:807: oid 7 updating version 338 to 339 2026-02-13T20:15:06.944 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 7 v 339 (ObjNum 309 snap 83 seq_num 309) dirty exists 2026-02-13T20:15:06.944 INFO:tasks.rados.rados.0.trial188.stdout:807: left oid 7 (ObjNum 309 snap 83 seq_num 309) 2026-02-13T20:15:07.877 INFO:tasks.rados.rados.0.trial188.stdout:806: done (2 left) 2026-02-13T20:15:07.878 INFO:tasks.rados.rados.0.trial188.stdout:807: done (1 left) 2026-02-13T20:15:07.878 INFO:tasks.rados.rados.0.trial188.stdout:808: done (0 left) 2026-02-13T20:15:07.878 INFO:tasks.rados.rados.0.trial188.stdout:809: snap_create 2026-02-13T20:15:08.878 INFO:tasks.rados.rados.0.trial188.stdout:809: done (0 left) 2026-02-13T20:15:08.878 INFO:tasks.rados.rados.0.trial188.stdout:810: write (excl) oid 24 current snap is 85 2026-02-13T20:15:08.878 INFO:tasks.rados.rados.0.trial188.stdout:810: seq_num 310 ranges {410170=781310,1940712=656106,3163363=46807} 2026-02-13T20:15:08.882 INFO:tasks.rados.rados.0.trial188.stdout:810: writing trial18843701-24 from 410170 to 1191480 tid 1 2026-02-13T20:15:08.887 INFO:tasks.rados.rados.0.trial188.stdout:810: writing trial18843701-24 from 1940712 to 2596818 tid 2 2026-02-13T20:15:08.890 INFO:tasks.rados.rados.0.trial188.stdout:810: writing trial18843701-24 from 3163363 to 3210170 tid 3 2026-02-13T20:15:08.890 INFO:tasks.rados.rados.0.trial188.stdout:811: delete oid 48 current snap is 85 2026-02-13T20:15:08.893 INFO:tasks.rados.rados.0.trial188.stdout:811: done (1 left) 2026-02-13T20:15:08.893 INFO:tasks.rados.rados.0.trial188.stdout:812: rollback oid 25 current snap is 85 2026-02-13T20:15:08.893 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 25 to 84 2026-02-13T20:15:08.894 INFO:tasks.rados.rados.0.trial188.stdout:813: copy_from oid 35 from oid 11 current snap is 85 2026-02-13T20:15:08.894 INFO:tasks.rados.rados.0.trial188.stdout:814: read oid 7 snap -1 2026-02-13T20:15:08.894 INFO:tasks.rados.rados.0.trial188.stdout:814: expect (ObjNum 309 snap 83 seq_num 309) 2026-02-13T20:15:08.894 INFO:tasks.rados.rados.0.trial188.stdout:815: copy_from oid 19 from oid 46 current snap is 85 2026-02-13T20:15:08.894 INFO:tasks.rados.rados.0.trial188.stdout:816: snap_remove snap 71 2026-02-13T20:15:09.881 INFO:tasks.rados.rados.0.trial188.stdout:816: done (5 left) 2026-02-13T20:15:09.881 INFO:tasks.rados.rados.0.trial188.stdout:817: rollback oid 28 current snap is 85 2026-02-13T20:15:09.881 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 28 to 77 2026-02-13T20:15:09.881 INFO:tasks.rados.rados.0.trial188.stdout:814: expect (ObjNum 309 snap 83 seq_num 309) 2026-02-13T20:15:09.900 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2926324 2026-02-13T20:15:09.924 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2868152 2026-02-13T20:15:09.958 INFO:tasks.rados.rados.0.trial188.stdout:812: finishing rollback tid 0 to trial18843701-25 2026-02-13T20:15:09.958 INFO:tasks.rados.rados.0.trial188.stdout:812: finishing rollback tid 1 to trial18843701-25 2026-02-13T20:15:09.958 INFO:tasks.rados.rados.0.trial188.stdout:812: finishing rollback tid 2 to trial18843701-25 2026-02-13T20:15:09.958 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 25 v 342 (ObjNum 269 snap 70 seq_num 269) dirty exists 2026-02-13T20:15:09.958 INFO:tasks.rados.rados.0.trial188.stdout:815: finishing copy_from racing read to trial18843701-19 2026-02-13T20:15:09.959 INFO:tasks.rados.rados.0.trial188.stdout:810: finishing write tid 1 to trial18843701-24 2026-02-13T20:15:09.959 INFO:tasks.rados.rados.0.trial188.stdout:810: finishing write tid 2 to trial18843701-24 2026-02-13T20:15:09.959 INFO:tasks.rados.rados.0.trial188.stdout:810: finishing write tid 3 to trial18843701-24 2026-02-13T20:15:09.959 INFO:tasks.rados.rados.0.trial188.stdout:815: finishing copy_from to trial18843701-19 2026-02-13T20:15:09.959 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 19 v 252 (ObjNum 284 snap 72 seq_num 284) dirty exists 2026-02-13T20:15:09.959 INFO:tasks.rados.rados.0.trial188.stdout:810: finishing write tid 4 to trial18843701-24 2026-02-13T20:15:09.959 INFO:tasks.rados.rados.0.trial188.stdout:810: finishing write tid 5 to trial18843701-24 2026-02-13T20:15:09.959 INFO:tasks.rados.rados.0.trial188.stdout:810: oid 24 updating version 0 to 345 2026-02-13T20:15:09.959 INFO:tasks.rados.rados.0.trial188.stdout:810: oid 24 updating version 345 to 346 2026-02-13T20:15:09.959 INFO:tasks.rados.rados.0.trial188.stdout:810: oid 24 updating version 346 to 347 2026-02-13T20:15:09.959 INFO:tasks.rados.rados.0.trial188.stdout:810: oid 24 version 347 is already newer than 344 2026-02-13T20:15:09.959 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 24 v 347 (ObjNum 310 snap 85 seq_num 310) dirty exists 2026-02-13T20:15:09.960 INFO:tasks.rados.rados.0.trial188.stdout:810: left oid 24 (ObjNum 310 snap 85 seq_num 310) 2026-02-13T20:15:09.960 INFO:tasks.rados.rados.0.trial188.stdout:813: finishing copy_from racing read to trial18843701-35 2026-02-13T20:15:09.960 INFO:tasks.rados.rados.0.trial188.stdout:813: finishing copy_from to trial18843701-35 2026-02-13T20:15:09.960 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 35 v 230 (ObjNum 235 snap 64 seq_num 235) dirty exists 2026-02-13T20:15:09.960 INFO:tasks.rados.rados.0.trial188.stdout:810: done (5 left) 2026-02-13T20:15:09.960 INFO:tasks.rados.rados.0.trial188.stdout:812: done (4 left) 2026-02-13T20:15:09.960 INFO:tasks.rados.rados.0.trial188.stdout:813: done (3 left) 2026-02-13T20:15:09.960 INFO:tasks.rados.rados.0.trial188.stdout:814: done (2 left) 2026-02-13T20:15:09.960 INFO:tasks.rados.rados.0.trial188.stdout:815: done (1 left) 2026-02-13T20:15:09.960 INFO:tasks.rados.rados.0.trial188.stdout:818: snap_remove snap 84 2026-02-13T20:15:10.882 INFO:tasks.rados.rados.0.trial188.stdout:818: done (1 left) 2026-02-13T20:15:10.883 INFO:tasks.rados.rados.0.trial188.stdout:819: read oid 16 snap -1 2026-02-13T20:15:10.883 INFO:tasks.rados.rados.0.trial188.stdout:819: expect (ObjNum 282 snap 71 seq_num 282) 2026-02-13T20:15:10.883 INFO:tasks.rados.rados.0.trial188.stdout:820: snap_remove snap 83 2026-02-13T20:15:11.884 INFO:tasks.rados.rados.0.trial188.stdout:820: done (2 left) 2026-02-13T20:15:11.884 INFO:tasks.rados.rados.0.trial188.stdout:821: snap_remove snap 79 2026-02-13T20:15:12.878 INFO:tasks.rados.rados.0.trial188.stdout:821: done (2 left) 2026-02-13T20:15:12.878 INFO:tasks.rados.rados.0.trial188.stdout:822: write oid 10 current snap is 85 2026-02-13T20:15:12.878 INFO:tasks.rados.rados.0.trial188.stdout:817: finishing rollback tid 0 to trial18843701-28 2026-02-13T20:15:12.879 INFO:tasks.rados.rados.0.trial188.stdout:817: finishing rollback tid 1 to trial18843701-28 2026-02-13T20:15:12.879 INFO:tasks.rados.rados.0.trial188.stdout:817: finishing rollback tid 2 to trial18843701-28 2026-02-13T20:15:12.879 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 28 v 275 (ObjNum 231 snap 63 seq_num 231) dirty exists 2026-02-13T20:15:12.879 INFO:tasks.rados.rados.0.trial188.stdout:819: expect (ObjNum 282 snap 71 seq_num 282) 2026-02-13T20:15:12.879 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:15:12.898 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:15:12.936 INFO:tasks.rados.rados.0.trial188.stdout:822: seq_num 312 ranges {443784=648161,1657676=659775,2818209=425575} 2026-02-13T20:15:12.940 INFO:tasks.rados.rados.0.trial188.stdout:822: writing trial18843701-10 from 443784 to 1091945 tid 1 2026-02-13T20:15:12.946 INFO:tasks.rados.rados.0.trial188.stdout:822: writing trial18843701-10 from 1657676 to 2317451 tid 2 2026-02-13T20:15:12.950 INFO:tasks.rados.rados.0.trial188.stdout:822: writing trial18843701-10 from 2818209 to 3243784 tid 3 2026-02-13T20:15:12.950 INFO:tasks.rados.rados.0.trial188.stdout:817: done (2 left) 2026-02-13T20:15:12.950 INFO:tasks.rados.rados.0.trial188.stdout:819: done (1 left) 2026-02-13T20:15:12.950 INFO:tasks.rados.rados.0.trial188.stdout:823: rollback oid 20 current snap is 85 2026-02-13T20:15:12.950 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 20 to 82 2026-02-13T20:15:12.951 INFO:tasks.rados.rados.0.trial188.stdout:824: write (excl) oid 35 current snap is 85 2026-02-13T20:15:12.951 INFO:tasks.rados.rados.0.trial188.stdout:824: seq_num 313 ranges {460591=723410,1716158=403433,2729279=440140} 2026-02-13T20:15:12.954 INFO:tasks.rados.rados.0.trial188.stdout:824: writing trial18843701-35 from 460591 to 1184001 tid 1 2026-02-13T20:15:12.957 INFO:tasks.rados.rados.0.trial188.stdout:824: writing trial18843701-35 from 1716158 to 2119591 tid 2 2026-02-13T20:15:12.962 INFO:tasks.rados.rados.0.trial188.stdout:824: writing trial18843701-35 from 2729279 to 3169419 tid 3 2026-02-13T20:15:12.962 INFO:tasks.rados.rados.0.trial188.stdout:825: rollback oid 29 current snap is 85 2026-02-13T20:15:12.962 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 29 to 81 2026-02-13T20:15:12.962 INFO:tasks.rados.rados.0.trial188.stdout:823: finishing rollback tid 0 to trial18843701-20 2026-02-13T20:15:12.962 INFO:tasks.rados.rados.0.trial188.stdout:823: finishing rollback tid 1 to trial18843701-20 2026-02-13T20:15:12.963 INFO:tasks.rados.rados.0.trial188.stdout:823: finishing rollback tid 2 to trial18843701-20 2026-02-13T20:15:12.963 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 20 v 46 (ObjNum 298 snap 79 seq_num 298) dirty exists 2026-02-13T20:15:12.963 INFO:tasks.rados.rados.0.trial188.stdout:823: done (3 left) 2026-02-13T20:15:12.963 INFO:tasks.rados.rados.0.trial188.stdout:826: snap_create 2026-02-13T20:15:12.966 INFO:tasks.rados.rados.0.trial188.stdout:822: finishing write tid 1 to trial18843701-10 2026-02-13T20:15:12.974 INFO:tasks.rados.rados.0.trial188.stdout:825: finishing rollback tid 0 to trial18843701-29 2026-02-13T20:15:12.974 INFO:tasks.rados.rados.0.trial188.stdout:825: finishing rollback tid 1 to trial18843701-29 2026-02-13T20:15:12.974 INFO:tasks.rados.rados.0.trial188.stdout:825: finishing rollback tid 2 to trial18843701-29 2026-02-13T20:15:12.974 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 29 v 359 (ObjNum 286 snap 73 seq_num 286) dirty exists 2026-02-13T20:15:12.981 INFO:tasks.rados.rados.0.trial188.stdout:824: finishing write tid 1 to trial18843701-35 2026-02-13T20:15:12.981 INFO:tasks.rados.rados.0.trial188.stdout:822: finishing write tid 2 to trial18843701-10 2026-02-13T20:15:12.981 INFO:tasks.rados.rados.0.trial188.stdout:822: finishing write tid 3 to trial18843701-10 2026-02-13T20:15:12.981 INFO:tasks.rados.rados.0.trial188.stdout:822: finishing write tid 4 to trial18843701-10 2026-02-13T20:15:12.981 INFO:tasks.rados.rados.0.trial188.stdout:822: finishing write tid 5 to trial18843701-10 2026-02-13T20:15:12.981 INFO:tasks.rados.rados.0.trial188.stdout:822: oid 10 updating version 0 to 311 2026-02-13T20:15:12.981 INFO:tasks.rados.rados.0.trial188.stdout:822: oid 10 version 311 is already newer than 310 2026-02-13T20:15:12.981 INFO:tasks.rados.rados.0.trial188.stdout:822: oid 10 version 311 is already newer than 308 2026-02-13T20:15:12.981 INFO:tasks.rados.rados.0.trial188.stdout:822: oid 10 version 311 is already newer than 309 2026-02-13T20:15:12.981 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 10 v 311 (ObjNum 312 snap 85 seq_num 312) dirty exists 2026-02-13T20:15:12.982 INFO:tasks.rados.rados.0.trial188.stdout:822: left oid 10 (ObjNum 312 snap 85 seq_num 312) 2026-02-13T20:15:12.983 INFO:tasks.rados.rados.0.trial188.stdout:824: finishing write tid 2 to trial18843701-35 2026-02-13T20:15:12.983 INFO:tasks.rados.rados.0.trial188.stdout:824: finishing write tid 3 to trial18843701-35 2026-02-13T20:15:12.983 INFO:tasks.rados.rados.0.trial188.stdout:824: finishing write tid 4 to trial18843701-35 2026-02-13T20:15:12.983 INFO:tasks.rados.rados.0.trial188.stdout:824: finishing write tid 5 to trial18843701-35 2026-02-13T20:15:12.983 INFO:tasks.rados.rados.0.trial188.stdout:824: oid 35 updating version 0 to 252 2026-02-13T20:15:12.983 INFO:tasks.rados.rados.0.trial188.stdout:824: oid 35 version 252 is already newer than 250 2026-02-13T20:15:12.983 INFO:tasks.rados.rados.0.trial188.stdout:824: oid 35 version 252 is already newer than 251 2026-02-13T20:15:12.983 INFO:tasks.rados.rados.0.trial188.stdout:824: oid 35 updating version 252 to 253 2026-02-13T20:15:12.983 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 35 v 253 (ObjNum 313 snap 85 seq_num 313) dirty exists 2026-02-13T20:15:12.983 INFO:tasks.rados.rados.0.trial188.stdout:824: left oid 35 (ObjNum 313 snap 85 seq_num 313) 2026-02-13T20:15:13.890 INFO:tasks.rados.rados.0.trial188.stdout:822: done (3 left) 2026-02-13T20:15:13.891 INFO:tasks.rados.rados.0.trial188.stdout:824: done (2 left) 2026-02-13T20:15:13.891 INFO:tasks.rados.rados.0.trial188.stdout:825: done (1 left) 2026-02-13T20:15:13.891 INFO:tasks.rados.rados.0.trial188.stdout:826: done (0 left) 2026-02-13T20:15:13.891 INFO:tasks.rados.rados.0.trial188.stdout:827: snap_remove snap 81 2026-02-13T20:15:14.890 INFO:tasks.rados.rados.0.trial188.stdout:827: done (0 left) 2026-02-13T20:15:14.890 INFO:tasks.rados.rados.0.trial188.stdout:828: copy_from oid 32 from oid 16 current snap is 86 2026-02-13T20:15:14.890 INFO:tasks.rados.rados.0.trial188.stdout:829: write (excl) oid 49 current snap is 86 2026-02-13T20:15:14.891 INFO:tasks.rados.rados.0.trial188.stdout:829: seq_num 314 ranges {477398=798659,1774640=663444,2873055=404343} 2026-02-13T20:15:14.895 INFO:tasks.rados.rados.0.trial188.stdout:829: writing trial18843701-49 from 477398 to 1276057 tid 1 2026-02-13T20:15:14.899 INFO:tasks.rados.rados.0.trial188.stdout:829: writing trial18843701-49 from 1774640 to 2438084 tid 2 2026-02-13T20:15:14.903 INFO:tasks.rados.rados.0.trial188.stdout:829: writing trial18843701-49 from 2873055 to 3277398 tid 3 2026-02-13T20:15:14.903 INFO:tasks.rados.rados.0.trial188.stdout:830: delete oid 21 current snap is 86 2026-02-13T20:15:14.904 INFO:tasks.rados.rados.0.trial188.stdout:830: done (2 left) 2026-02-13T20:15:14.904 INFO:tasks.rados.rados.0.trial188.stdout:831: read oid 45 snap -1 2026-02-13T20:15:14.905 INFO:tasks.rados.rados.0.trial188.stdout:831: expect (ObjNum 302 snap 81 seq_num 302) 2026-02-13T20:15:14.905 INFO:tasks.rados.rados.0.trial188.stdout:832: write oid 11 current snap is 86 2026-02-13T20:15:14.905 INFO:tasks.rados.rados.0.trial188.stdout:832: seq_num 316 ranges {511012=549157,1775251=550760,3095195=215817} 2026-02-13T20:15:14.908 INFO:tasks.rados.rados.0.trial188.stdout:832: writing trial18843701-11 from 511012 to 1060169 tid 1 2026-02-13T20:15:14.913 INFO:tasks.rados.rados.0.trial188.stdout:832: writing trial18843701-11 from 1775251 to 2326011 tid 2 2026-02-13T20:15:14.917 INFO:tasks.rados.rados.0.trial188.stdout:832: writing trial18843701-11 from 3095195 to 3311012 tid 3 2026-02-13T20:15:14.917 INFO:tasks.rados.rados.0.trial188.stdout:833: write oid 1 current snap is 86 2026-02-13T20:15:14.917 INFO:tasks.rados.rados.0.trial188.stdout:833: seq_num 317 ranges {527819=624406,1833733=410771,2722618=601581} 2026-02-13T20:15:14.921 INFO:tasks.rados.rados.0.trial188.stdout:833: writing trial18843701-1 from 527819 to 1152225 tid 1 2026-02-13T20:15:14.925 INFO:tasks.rados.rados.0.trial188.stdout:833: writing trial18843701-1 from 1833733 to 2244504 tid 2 2026-02-13T20:15:14.929 INFO:tasks.rados.rados.0.trial188.stdout:833: writing trial18843701-1 from 2722618 to 3324199 tid 3 2026-02-13T20:15:14.929 INFO:tasks.rados.rados.0.trial188.stdout:834: rollback oid 5 current snap is 86 2026-02-13T20:15:14.929 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 5 to 82 2026-02-13T20:15:14.929 INFO:tasks.rados.rados.0.trial188.stdout:831: expect (ObjNum 302 snap 81 seq_num 302) 2026-02-13T20:15:15.008 INFO:tasks.rados.rados.0.trial188.stdout:828: finishing copy_from racing read to trial18843701-32 2026-02-13T20:15:15.009 INFO:tasks.rados.rados.0.trial188.stdout:828: finishing copy_from to trial18843701-32 2026-02-13T20:15:15.009 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 32 v 325 (ObjNum 282 snap 71 seq_num 282) dirty exists 2026-02-13T20:15:15.009 INFO:tasks.rados.rados.0.trial188.stdout:829: finishing write tid 1 to trial18843701-49 2026-02-13T20:15:15.009 INFO:tasks.rados.rados.0.trial188.stdout:829: finishing write tid 2 to trial18843701-49 2026-02-13T20:15:15.009 INFO:tasks.rados.rados.0.trial188.stdout:828: done (5 left) 2026-02-13T20:15:15.009 INFO:tasks.rados.rados.0.trial188.stdout:831: done (4 left) 2026-02-13T20:15:15.009 INFO:tasks.rados.rados.0.trial188.stdout:835: write oid 27 current snap is 86 2026-02-13T20:15:15.009 INFO:tasks.rados.rados.0.trial188.stdout:835: seq_num 318 ranges {544626=699655,1892215=554429,3150041=194585} 2026-02-13T20:15:15.013 INFO:tasks.rados.rados.0.trial188.stdout:835: writing trial18843701-27 from 544626 to 1244281 tid 1 2026-02-13T20:15:15.017 INFO:tasks.rados.rados.0.trial188.stdout:835: writing trial18843701-27 from 1892215 to 2446644 tid 2 2026-02-13T20:15:15.021 INFO:tasks.rados.rados.0.trial188.stdout:835: writing trial18843701-27 from 3150041 to 3344626 tid 3 2026-02-13T20:15:15.021 INFO:tasks.rados.rados.0.trial188.stdout:836: copy_from oid 31 from oid 16 current snap is 86 2026-02-13T20:15:15.021 INFO:tasks.rados.rados.0.trial188.stdout:829: finishing write tid 3 to trial18843701-49 2026-02-13T20:15:15.022 INFO:tasks.rados.rados.0.trial188.stdout:832: finishing write tid 1 to trial18843701-11 2026-02-13T20:15:15.022 INFO:tasks.rados.rados.0.trial188.stdout:832: finishing write tid 2 to trial18843701-11 2026-02-13T20:15:15.022 INFO:tasks.rados.rados.0.trial188.stdout:829: finishing write tid 4 to trial18843701-49 2026-02-13T20:15:15.022 INFO:tasks.rados.rados.0.trial188.stdout:837: snap_remove snap 77 2026-02-13T20:15:15.903 INFO:tasks.rados.rados.0.trial188.stdout:837: done (6 left) 2026-02-13T20:15:15.903 INFO:tasks.rados.rados.0.trial188.stdout:838: rollback oid 8 current snap is 86 2026-02-13T20:15:15.904 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 8 to 82 2026-02-13T20:15:15.904 INFO:tasks.rados.rados.0.trial188.stdout:832: finishing write tid 3 to trial18843701-11 2026-02-13T20:15:15.904 INFO:tasks.rados.rados.0.trial188.stdout:832: finishing write tid 4 to trial18843701-11 2026-02-13T20:15:15.904 INFO:tasks.rados.rados.0.trial188.stdout:832: finishing write tid 5 to trial18843701-11 2026-02-13T20:15:15.904 INFO:tasks.rados.rados.0.trial188.stdout:832: oid 11 updating version 0 to 314 2026-02-13T20:15:15.904 INFO:tasks.rados.rados.0.trial188.stdout:832: oid 11 version 314 is already newer than 312 2026-02-13T20:15:15.904 INFO:tasks.rados.rados.0.trial188.stdout:832: oid 11 updating version 314 to 315 2026-02-13T20:15:15.904 INFO:tasks.rados.rados.0.trial188.stdout:832: oid 11 version 315 is already newer than 313 2026-02-13T20:15:15.904 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 11 v 315 (ObjNum 316 snap 86 seq_num 316) dirty exists 2026-02-13T20:15:15.905 INFO:tasks.rados.rados.0.trial188.stdout:832: left oid 11 (ObjNum 316 snap 86 seq_num 316) 2026-02-13T20:15:15.905 INFO:tasks.rados.rados.0.trial188.stdout:829: finishing write tid 5 to trial18843701-49 2026-02-13T20:15:15.905 INFO:tasks.rados.rados.0.trial188.stdout:829: oid 49 updating version 0 to 372 2026-02-13T20:15:15.905 INFO:tasks.rados.rados.0.trial188.stdout:829: oid 49 version 372 is already newer than 371 2026-02-13T20:15:15.905 INFO:tasks.rados.rados.0.trial188.stdout:829: oid 49 updating version 372 to 373 2026-02-13T20:15:15.905 INFO:tasks.rados.rados.0.trial188.stdout:829: oid 49 version 373 is already newer than 370 2026-02-13T20:15:15.905 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 49 v 373 (ObjNum 314 snap 86 seq_num 314) dirty exists 2026-02-13T20:15:15.905 INFO:tasks.rados.rados.0.trial188.stdout:829: left oid 49 (ObjNum 314 snap 86 seq_num 314) 2026-02-13T20:15:15.905 INFO:tasks.rados.rados.0.trial188.stdout:833: finishing write tid 1 to trial18843701-1 2026-02-13T20:15:15.905 INFO:tasks.rados.rados.0.trial188.stdout:833: finishing write tid 2 to trial18843701-1 2026-02-13T20:15:15.905 INFO:tasks.rados.rados.0.trial188.stdout:833: finishing write tid 3 to trial18843701-1 2026-02-13T20:15:15.905 INFO:tasks.rados.rados.0.trial188.stdout:833: finishing write tid 4 to trial18843701-1 2026-02-13T20:15:15.906 INFO:tasks.rados.rados.0.trial188.stdout:833: finishing write tid 5 to trial18843701-1 2026-02-13T20:15:15.906 INFO:tasks.rados.rados.0.trial188.stdout:833: oid 1 updating version 0 to 381 2026-02-13T20:15:15.906 INFO:tasks.rados.rados.0.trial188.stdout:833: oid 1 updating version 381 to 383 2026-02-13T20:15:15.906 INFO:tasks.rados.rados.0.trial188.stdout:833: oid 1 version 383 is already newer than 380 2026-02-13T20:15:15.906 INFO:tasks.rados.rados.0.trial188.stdout:833: oid 1 version 383 is already newer than 382 2026-02-13T20:15:15.906 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 1 v 383 (ObjNum 317 snap 86 seq_num 317) dirty exists 2026-02-13T20:15:15.906 INFO:tasks.rados.rados.0.trial188.stdout:833: left oid 1 (ObjNum 317 snap 86 seq_num 317) 2026-02-13T20:15:15.906 INFO:tasks.rados.rados.0.trial188.stdout:834: finishing rollback tid 1 to trial18843701-5 2026-02-13T20:15:15.906 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 5 v 372 (ObjNum 273 snap 0 seq_num 11814080) dirty dne 2026-02-13T20:15:15.906 INFO:tasks.rados.rados.0.trial188.stdout:835: finishing write tid 1 to trial18843701-27 2026-02-13T20:15:15.907 INFO:tasks.rados.rados.0.trial188.stdout:835: finishing write tid 2 to trial18843701-27 2026-02-13T20:15:15.907 INFO:tasks.rados.rados.0.trial188.stdout:835: finishing write tid 3 to trial18843701-27 2026-02-13T20:15:15.907 INFO:tasks.rados.rados.0.trial188.stdout:835: finishing write tid 4 to trial18843701-27 2026-02-13T20:15:15.907 INFO:tasks.rados.rados.0.trial188.stdout:835: finishing write tid 5 to trial18843701-27 2026-02-13T20:15:15.907 INFO:tasks.rados.rados.0.trial188.stdout:835: oid 27 updating version 0 to 374 2026-02-13T20:15:15.907 INFO:tasks.rados.rados.0.trial188.stdout:835: oid 27 updating version 374 to 376 2026-02-13T20:15:15.907 INFO:tasks.rados.rados.0.trial188.stdout:835: oid 27 updating version 376 to 377 2026-02-13T20:15:15.907 INFO:tasks.rados.rados.0.trial188.stdout:835: oid 27 version 377 is already newer than 375 2026-02-13T20:15:15.907 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 27 v 377 (ObjNum 318 snap 86 seq_num 318) dirty exists 2026-02-13T20:15:15.907 INFO:tasks.rados.rados.0.trial188.stdout:835: left oid 27 (ObjNum 318 snap 86 seq_num 318) 2026-02-13T20:15:15.908 INFO:tasks.rados.rados.0.trial188.stdout:836: finishing copy_from racing read to trial18843701-31 2026-02-13T20:15:15.908 INFO:tasks.rados.rados.0.trial188.stdout:836: finishing copy_from to trial18843701-31 2026-02-13T20:15:15.908 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 31 v 325 (ObjNum 282 snap 71 seq_num 282) dirty exists 2026-02-13T20:15:15.908 INFO:tasks.rados.rados.0.trial188.stdout:829: done (6 left) 2026-02-13T20:15:15.908 INFO:tasks.rados.rados.0.trial188.stdout:832: done (5 left) 2026-02-13T20:15:15.908 INFO:tasks.rados.rados.0.trial188.stdout:833: done (4 left) 2026-02-13T20:15:15.908 INFO:tasks.rados.rados.0.trial188.stdout:834: done (3 left) 2026-02-13T20:15:15.908 INFO:tasks.rados.rados.0.trial188.stdout:835: done (2 left) 2026-02-13T20:15:15.908 INFO:tasks.rados.rados.0.trial188.stdout:836: done (1 left) 2026-02-13T20:15:15.908 INFO:tasks.rados.rados.0.trial188.stdout:839: write (excl) oid 26 current snap is 86 2026-02-13T20:15:15.908 INFO:tasks.rados.rados.0.trial188.stdout:839: seq_num 319 ranges {561433=774904,1950697=414440,2777464=583969} 2026-02-13T20:15:15.909 INFO:tasks.rados.rados.0.trial188.stdout:839: writing trial18843701-26 from 561433 to 1336337 tid 1 2026-02-13T20:15:15.911 INFO:tasks.rados.rados.0.trial188.stdout:839: writing trial18843701-26 from 1950697 to 2365137 tid 2 2026-02-13T20:15:15.915 INFO:tasks.rados.rados.0.trial188.stdout:839: writing trial18843701-26 from 2777464 to 3361433 tid 3 2026-02-13T20:15:15.916 INFO:tasks.rados.rados.0.trial188.stdout:840: copy_from oid 13 from oid 35 current snap is 86 2026-02-13T20:15:15.916 INFO:tasks.rados.rados.0.trial188.stdout:838: finishing rollback tid 0 to trial18843701-8 2026-02-13T20:15:15.916 INFO:tasks.rados.rados.0.trial188.stdout:838: finishing rollback tid 1 to trial18843701-8 2026-02-13T20:15:15.916 INFO:tasks.rados.rados.0.trial188.stdout:838: finishing rollback tid 2 to trial18843701-8 2026-02-13T20:15:15.916 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 8 v 301 (ObjNum 301 snap 81 seq_num 301) dirty exists 2026-02-13T20:15:15.916 INFO:tasks.rados.rados.0.trial188.stdout:838: done (2 left) 2026-02-13T20:15:15.916 INFO:tasks.rados.rados.0.trial188.stdout:841: read oid 29 snap -1 2026-02-13T20:15:15.916 INFO:tasks.rados.rados.0.trial188.stdout:841: expect (ObjNum 286 snap 73 seq_num 286) 2026-02-13T20:15:15.916 INFO:tasks.rados.rados.0.trial188.stdout:842: snap_create 2026-02-13T20:15:15.922 INFO:tasks.rados.rados.0.trial188.stdout:841: expect (ObjNum 286 snap 73 seq_num 286) 2026-02-13T20:15:16.042 INFO:tasks.rados.rados.0.trial188.stdout:840: finishing copy_from racing read to trial18843701-13 2026-02-13T20:15:16.042 INFO:tasks.rados.rados.0.trial188.stdout:839: finishing write tid 1 to trial18843701-26 2026-02-13T20:15:16.043 INFO:tasks.rados.rados.0.trial188.stdout:839: finishing write tid 2 to trial18843701-26 2026-02-13T20:15:16.043 INFO:tasks.rados.rados.0.trial188.stdout:839: finishing write tid 3 to trial18843701-26 2026-02-13T20:15:16.043 INFO:tasks.rados.rados.0.trial188.stdout:839: finishing write tid 4 to trial18843701-26 2026-02-13T20:15:16.043 INFO:tasks.rados.rados.0.trial188.stdout:839: finishing write tid 5 to trial18843701-26 2026-02-13T20:15:16.043 INFO:tasks.rados.rados.0.trial188.stdout:839: oid 26 updating version 0 to 307 2026-02-13T20:15:16.043 INFO:tasks.rados.rados.0.trial188.stdout:839: oid 26 version 307 is already newer than 306 2026-02-13T20:15:16.043 INFO:tasks.rados.rados.0.trial188.stdout:839: oid 26 updating version 307 to 309 2026-02-13T20:15:16.043 INFO:tasks.rados.rados.0.trial188.stdout:839: oid 26 version 309 is already newer than 308 2026-02-13T20:15:16.043 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 26 v 309 (ObjNum 319 snap 86 seq_num 319) dirty exists 2026-02-13T20:15:16.044 INFO:tasks.rados.rados.0.trial188.stdout:839: left oid 26 (ObjNum 319 snap 86 seq_num 319) 2026-02-13T20:15:16.044 INFO:tasks.rados.rados.0.trial188.stdout:840: finishing copy_from to trial18843701-13 2026-02-13T20:15:16.044 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 13 v 253 (ObjNum 313 snap 85 seq_num 313) dirty exists 2026-02-13T20:15:16.906 INFO:tasks.rados.rados.0.trial188.stdout:839: done (3 left) 2026-02-13T20:15:16.906 INFO:tasks.rados.rados.0.trial188.stdout:840: done (2 left) 2026-02-13T20:15:16.906 INFO:tasks.rados.rados.0.trial188.stdout:841: done (1 left) 2026-02-13T20:15:16.906 INFO:tasks.rados.rados.0.trial188.stdout:842: done (0 left) 2026-02-13T20:15:16.906 INFO:tasks.rados.rados.0.trial188.stdout:843: write oid 8 current snap is 87 2026-02-13T20:15:16.906 INFO:tasks.rados.rados.0.trial188.stdout:843: seq_num 320 ranges {578240=566506,1609179=558098,2804887=551750} 2026-02-13T20:15:16.910 INFO:tasks.rados.rados.0.trial188.stdout:843: writing trial18843701-8 from 578240 to 1144746 tid 1 2026-02-13T20:15:16.914 INFO:tasks.rados.rados.0.trial188.stdout:843: writing trial18843701-8 from 1609179 to 2167277 tid 2 2026-02-13T20:15:16.919 INFO:tasks.rados.rados.0.trial188.stdout:843: writing trial18843701-8 from 2804887 to 3356637 tid 3 2026-02-13T20:15:16.919 INFO:tasks.rados.rados.0.trial188.stdout:844: read oid 17 snap -1 2026-02-13T20:15:16.919 INFO:tasks.rados.rados.0.trial188.stdout:844: expect deleted 2026-02-13T20:15:16.920 INFO:tasks.rados.rados.0.trial188.stdout:845: snap_remove snap 86 2026-02-13T20:15:17.878 INFO:tasks.rados.rados.0.trial188.stdout:845: done (2 left) 2026-02-13T20:15:17.878 INFO:tasks.rados.rados.0.trial188.stdout:846: copy_from oid 22 from oid 50 current snap is 87 2026-02-13T20:15:17.878 INFO:tasks.rados.rados.0.trial188.stdout:843: finishing write tid 1 to trial18843701-8 2026-02-13T20:15:17.878 INFO:tasks.rados.rados.0.trial188.stdout:843: finishing write tid 2 to trial18843701-8 2026-02-13T20:15:17.878 INFO:tasks.rados.rados.0.trial188.stdout:843: finishing write tid 3 to trial18843701-8 2026-02-13T20:15:17.878 INFO:tasks.rados.rados.0.trial188.stdout:843: finishing write tid 4 to trial18843701-8 2026-02-13T20:15:17.878 INFO:tasks.rados.rados.0.trial188.stdout:843: finishing write tid 5 to trial18843701-8 2026-02-13T20:15:17.878 INFO:tasks.rados.rados.0.trial188.stdout:843: oid 8 updating version 0 to 312 2026-02-13T20:15:17.878 INFO:tasks.rados.rados.0.trial188.stdout:843: oid 8 version 312 is already newer than 309 2026-02-13T20:15:17.878 INFO:tasks.rados.rados.0.trial188.stdout:843: oid 8 version 312 is already newer than 311 2026-02-13T20:15:17.878 INFO:tasks.rados.rados.0.trial188.stdout:843: oid 8 version 312 is already newer than 310 2026-02-13T20:15:17.879 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 8 v 312 (ObjNum 320 snap 87 seq_num 320) dirty exists 2026-02-13T20:15:17.879 INFO:tasks.rados.rados.0.trial188.stdout:843: left oid 8 (ObjNum 320 snap 87 seq_num 320) 2026-02-13T20:15:17.879 INFO:tasks.rados.rados.0.trial188.stdout:843: done (2 left) 2026-02-13T20:15:17.879 INFO:tasks.rados.rados.0.trial188.stdout:844: done (1 left) 2026-02-13T20:15:17.879 INFO:tasks.rados.rados.0.trial188.stdout:847: read oid 25 snap 82 2026-02-13T20:15:17.879 INFO:tasks.rados.rados.0.trial188.stdout:847: expect (ObjNum 269 snap 70 seq_num 269) 2026-02-13T20:15:17.879 INFO:tasks.rados.rados.0.trial188.stdout:848: write (excl) oid 21 current snap is 87 2026-02-13T20:15:17.879 INFO:tasks.rados.rados.0.trial188.stdout:848: seq_num 321 ranges {595047=641755,1667661=418109,2548663=763022} 2026-02-13T20:15:17.883 INFO:tasks.rados.rados.0.trial188.stdout:848: writing trial18843701-21 from 595047 to 1236802 tid 1 2026-02-13T20:15:17.886 INFO:tasks.rados.rados.0.trial188.stdout:848: writing trial18843701-21 from 1667661 to 2085770 tid 2 2026-02-13T20:15:17.890 INFO:tasks.rados.rados.0.trial188.stdout:848: writing trial18843701-21 from 2548663 to 3311685 tid 3 2026-02-13T20:15:17.890 INFO:tasks.rados.rados.0.trial188.stdout:849: snap_remove snap 85 2026-02-13T20:15:18.879 INFO:tasks.rados.rados.0.trial188.stdout:849: done (3 left) 2026-02-13T20:15:18.880 INFO:tasks.rados.rados.0.trial188.stdout:850: read oid 29 snap -1 2026-02-13T20:15:18.880 INFO:tasks.rados.rados.0.trial188.stdout:850: expect (ObjNum 286 snap 73 seq_num 286) 2026-02-13T20:15:18.880 INFO:tasks.rados.rados.0.trial188.stdout:851: snap_create 2026-02-13T20:15:18.880 INFO:tasks.rados.rados.0.trial188.stdout:847: expect (ObjNum 269 snap 70 seq_num 269) 2026-02-13T20:15:18.893 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1568552 2026-02-13T20:15:18.914 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:15:18.959 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 814601 2026-02-13T20:15:18.989 INFO:tasks.rados.rados.0.trial188.stdout:848: finishing write tid 1 to trial18843701-21 2026-02-13T20:15:18.989 INFO:tasks.rados.rados.0.trial188.stdout:846: finishing copy_from racing read to trial18843701-22 2026-02-13T20:15:18.989 INFO:tasks.rados.rados.0.trial188.stdout:848: finishing write tid 2 to trial18843701-21 2026-02-13T20:15:18.989 INFO:tasks.rados.rados.0.trial188.stdout:846: finishing copy_from to trial18843701-22 2026-02-13T20:15:18.989 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 22 v 279 (ObjNum 247 snap 66 seq_num 247) dirty exists 2026-02-13T20:15:18.989 INFO:tasks.rados.rados.0.trial188.stdout:848: finishing write tid 3 to trial18843701-21 2026-02-13T20:15:18.989 INFO:tasks.rados.rados.0.trial188.stdout:848: finishing write tid 4 to trial18843701-21 2026-02-13T20:15:18.990 INFO:tasks.rados.rados.0.trial188.stdout:848: finishing write tid 5 to trial18843701-21 2026-02-13T20:15:18.990 INFO:tasks.rados.rados.0.trial188.stdout:848: oid 21 updating version 0 to 162 2026-02-13T20:15:18.990 INFO:tasks.rados.rados.0.trial188.stdout:848: oid 21 updating version 162 to 165 2026-02-13T20:15:18.990 INFO:tasks.rados.rados.0.trial188.stdout:848: oid 21 version 165 is already newer than 164 2026-02-13T20:15:18.990 INFO:tasks.rados.rados.0.trial188.stdout:848: oid 21 version 165 is already newer than 163 2026-02-13T20:15:18.990 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 21 v 165 (ObjNum 321 snap 87 seq_num 321) dirty exists 2026-02-13T20:15:18.990 INFO:tasks.rados.rados.0.trial188.stdout:848: left oid 21 (ObjNum 321 snap 87 seq_num 321) 2026-02-13T20:15:18.990 INFO:tasks.rados.rados.0.trial188.stdout:850: expect (ObjNum 286 snap 73 seq_num 286) 2026-02-13T20:15:19.050 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1999726 2026-02-13T20:15:19.064 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:15:19.880 INFO:tasks.rados.rados.0.trial188.stdout:846: done (4 left) 2026-02-13T20:15:19.881 INFO:tasks.rados.rados.0.trial188.stdout:847: done (3 left) 2026-02-13T20:15:19.881 INFO:tasks.rados.rados.0.trial188.stdout:848: done (2 left) 2026-02-13T20:15:19.881 INFO:tasks.rados.rados.0.trial188.stdout:850: done (1 left) 2026-02-13T20:15:19.881 INFO:tasks.rados.rados.0.trial188.stdout:851: done (0 left) 2026-02-13T20:15:19.881 INFO:tasks.rados.rados.0.trial188.stdout:852: write oid 8 current snap is 88 2026-02-13T20:15:19.881 INFO:tasks.rados.rados.0.trial188.stdout:852: seq_num 322 ranges {611854=717004,2126143=561767,3259733=152121} 2026-02-13T20:15:19.885 INFO:tasks.rados.rados.0.trial188.stdout:852: writing trial18843701-8 from 611854 to 1328858 tid 1 2026-02-13T20:15:19.890 INFO:tasks.rados.rados.0.trial188.stdout:852: writing trial18843701-8 from 2126143 to 2687910 tid 2 2026-02-13T20:15:19.894 INFO:tasks.rados.rados.0.trial188.stdout:852: writing trial18843701-8 from 3259733 to 3411854 tid 3 2026-02-13T20:15:19.894 INFO:tasks.rados.rados.0.trial188.stdout:853: read oid 14 snap 87 2026-02-13T20:15:19.894 INFO:tasks.rados.rados.0.trial188.stdout:853: expect deleted 2026-02-13T20:15:19.894 INFO:tasks.rados.rados.0.trial188.stdout:854: rollback oid 24 current snap is 88 2026-02-13T20:15:19.894 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 24 to 87 2026-02-13T20:15:19.894 INFO:tasks.rados.rados.0.trial188.stdout:855: read oid 11 snap 87 2026-02-13T20:15:19.895 INFO:tasks.rados.rados.0.trial188.stdout:855: expect (ObjNum 316 snap 86 seq_num 316) 2026-02-13T20:15:19.895 INFO:tasks.rados.rados.0.trial188.stdout:856: write oid 4 current snap is 88 2026-02-13T20:15:19.895 INFO:tasks.rados.rados.0.trial188.stdout:856: seq_num 323 ranges {628661=792253,2184625=421778,3403509=25152} 2026-02-13T20:15:19.899 INFO:tasks.rados.rados.0.trial188.stdout:856: writing trial18843701-4 from 628661 to 1420914 tid 1 2026-02-13T20:15:19.903 INFO:tasks.rados.rados.0.trial188.stdout:856: writing trial18843701-4 from 2184625 to 2606403 tid 2 2026-02-13T20:15:19.907 INFO:tasks.rados.rados.0.trial188.stdout:856: writing trial18843701-4 from 3403509 to 3428661 tid 3 2026-02-13T20:15:19.907 INFO:tasks.rados.rados.0.trial188.stdout:857: read oid 13 snap -1 2026-02-13T20:15:19.907 INFO:tasks.rados.rados.0.trial188.stdout:857: expect (ObjNum 313 snap 85 seq_num 313) 2026-02-13T20:15:19.907 INFO:tasks.rados.rados.0.trial188.stdout:858: delete oid 26 current snap is 88 2026-02-13T20:15:19.907 INFO:tasks.rados.rados.0.trial188.stdout:854: finishing rollback tid 0 to trial18843701-24 2026-02-13T20:15:19.907 INFO:tasks.rados.rados.0.trial188.stdout:854: finishing rollback tid 1 to trial18843701-24 2026-02-13T20:15:19.907 INFO:tasks.rados.rados.0.trial188.stdout:854: finishing rollback tid 2 to trial18843701-24 2026-02-13T20:15:19.907 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 24 v 365 (ObjNum 310 snap 85 seq_num 310) dirty exists 2026-02-13T20:15:19.908 INFO:tasks.rados.rados.0.trial188.stdout:855: expect (ObjNum 316 snap 86 seq_num 316) 2026-02-13T20:15:19.924 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2597830 2026-02-13T20:15:19.983 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:15:20.024 INFO:tasks.rados.rados.0.trial188.stdout:852: finishing write tid 1 to trial18843701-8 2026-02-13T20:15:20.024 INFO:tasks.rados.rados.0.trial188.stdout:852: finishing write tid 2 to trial18843701-8 2026-02-13T20:15:20.024 INFO:tasks.rados.rados.0.trial188.stdout:852: finishing write tid 3 to trial18843701-8 2026-02-13T20:15:20.024 INFO:tasks.rados.rados.0.trial188.stdout:852: finishing write tid 4 to trial18843701-8 2026-02-13T20:15:20.025 INFO:tasks.rados.rados.0.trial188.stdout:852: finishing write tid 5 to trial18843701-8 2026-02-13T20:15:20.025 INFO:tasks.rados.rados.0.trial188.stdout:852: oid 8 updating version 0 to 318 2026-02-13T20:15:20.025 INFO:tasks.rados.rados.0.trial188.stdout:852: oid 8 updating version 318 to 319 2026-02-13T20:15:20.025 INFO:tasks.rados.rados.0.trial188.stdout:852: oid 8 updating version 319 to 321 2026-02-13T20:15:20.025 INFO:tasks.rados.rados.0.trial188.stdout:852: oid 8 version 321 is already newer than 320 2026-02-13T20:15:20.025 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 8 v 321 (ObjNum 322 snap 88 seq_num 322) dirty exists 2026-02-13T20:15:20.025 INFO:tasks.rados.rados.0.trial188.stdout:852: left oid 8 (ObjNum 322 snap 88 seq_num 322) 2026-02-13T20:15:20.025 INFO:tasks.rados.rados.0.trial188.stdout:857: expect (ObjNum 313 snap 85 seq_num 313) 2026-02-13T20:15:20.061 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:15:20.147 INFO:tasks.rados.rados.0.trial188.stdout:856: finishing write tid 1 to trial18843701-4 2026-02-13T20:15:20.147 INFO:tasks.rados.rados.0.trial188.stdout:856: finishing write tid 2 to trial18843701-4 2026-02-13T20:15:20.147 INFO:tasks.rados.rados.0.trial188.stdout:852: done (6 left) 2026-02-13T20:15:20.148 INFO:tasks.rados.rados.0.trial188.stdout:853: done (5 left) 2026-02-13T20:15:20.148 INFO:tasks.rados.rados.0.trial188.stdout:854: done (4 left) 2026-02-13T20:15:20.148 INFO:tasks.rados.rados.0.trial188.stdout:855: done (3 left) 2026-02-13T20:15:20.148 INFO:tasks.rados.rados.0.trial188.stdout:857: done (2 left) 2026-02-13T20:15:20.148 INFO:tasks.rados.rados.0.trial188.stdout:858: done (1 left) 2026-02-13T20:15:20.148 INFO:tasks.rados.rados.0.trial188.stdout:859: read oid 27 snap 87 2026-02-13T20:15:20.148 INFO:tasks.rados.rados.0.trial188.stdout:859: expect (ObjNum 318 snap 86 seq_num 318) 2026-02-13T20:15:20.148 INFO:tasks.rados.rados.0.trial188.stdout:860: read oid 7 snap -1 2026-02-13T20:15:20.148 INFO:tasks.rados.rados.0.trial188.stdout:860: expect (ObjNum 309 snap 83 seq_num 309) 2026-02-13T20:15:20.148 INFO:tasks.rados.rados.0.trial188.stdout:861: delete oid 37 current snap is 88 2026-02-13T20:15:20.148 INFO:tasks.rados.rados.0.trial188.stdout:856: finishing write tid 3 to trial18843701-4 2026-02-13T20:15:20.148 INFO:tasks.rados.rados.0.trial188.stdout:856: finishing write tid 4 to trial18843701-4 2026-02-13T20:15:20.148 INFO:tasks.rados.rados.0.trial188.stdout:856: finishing write tid 5 to trial18843701-4 2026-02-13T20:15:20.148 INFO:tasks.rados.rados.0.trial188.stdout:856: oid 4 updating version 0 to 317 2026-02-13T20:15:20.148 INFO:tasks.rados.rados.0.trial188.stdout:856: oid 4 updating version 317 to 319 2026-02-13T20:15:20.148 INFO:tasks.rados.rados.0.trial188.stdout:856: oid 4 version 319 is already newer than 316 2026-02-13T20:15:20.148 INFO:tasks.rados.rados.0.trial188.stdout:856: oid 4 version 319 is already newer than 318 2026-02-13T20:15:20.148 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 4 v 319 (ObjNum 323 snap 88 seq_num 323) dirty exists 2026-02-13T20:15:20.148 INFO:tasks.rados.rados.0.trial188.stdout:856: left oid 4 (ObjNum 323 snap 88 seq_num 323) 2026-02-13T20:15:20.149 INFO:tasks.rados.rados.0.trial188.stdout:856: done (3 left) 2026-02-13T20:15:20.149 INFO:tasks.rados.rados.0.trial188.stdout:861: done (2 left) 2026-02-13T20:15:20.149 INFO:tasks.rados.rados.0.trial188.stdout:862: snap_create 2026-02-13T20:15:20.152 INFO:tasks.rados.rados.0.trial188.stdout:860: expect (ObjNum 309 snap 83 seq_num 309) 2026-02-13T20:15:20.163 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2225943 2026-02-13T20:15:20.177 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 496887 2026-02-13T20:15:20.217 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1613480 2026-02-13T20:15:20.236 INFO:tasks.rados.rados.0.trial188.stdout:859: expect (ObjNum 318 snap 86 seq_num 318) 2026-02-13T20:15:20.237 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:15:20.260 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:15:20.286 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1577086 2026-02-13T20:15:20.885 INFO:tasks.rados.rados.0.trial188.stdout:859: done (2 left) 2026-02-13T20:15:20.885 INFO:tasks.rados.rados.0.trial188.stdout:860: done (1 left) 2026-02-13T20:15:20.885 INFO:tasks.rados.rados.0.trial188.stdout:862: done (0 left) 2026-02-13T20:15:20.885 INFO:tasks.rados.rados.0.trial188.stdout:863: snap_create 2026-02-13T20:15:21.887 INFO:tasks.rados.rados.0.trial188.stdout:863: done (0 left) 2026-02-13T20:15:21.887 INFO:tasks.rados.rados.0.trial188.stdout:864: read oid 5 snap 89 2026-02-13T20:15:21.887 INFO:tasks.rados.rados.0.trial188.stdout:864: expect deleted 2026-02-13T20:15:21.888 INFO:tasks.rados.rados.0.trial188.stdout:865: copy_from oid 36 from oid 8 current snap is 90 2026-02-13T20:15:21.888 INFO:tasks.rados.rados.0.trial188.stdout:866: write oid 30 current snap is 90 2026-02-13T20:15:21.888 INFO:tasks.rados.rados.0.trial188.stdout:866: seq_num 326 ranges {679082=618000,1843718=569105,2853072=626010} 2026-02-13T20:15:21.892 INFO:tasks.rados.rados.0.trial188.stdout:866: writing trial18843701-30 from 679082 to 1297082 tid 1 2026-02-13T20:15:21.896 INFO:tasks.rados.rados.0.trial188.stdout:866: writing trial18843701-30 from 1843718 to 2412823 tid 2 2026-02-13T20:15:21.901 INFO:tasks.rados.rados.0.trial188.stdout:866: writing trial18843701-30 from 2853072 to 3479082 tid 3 2026-02-13T20:15:21.901 INFO:tasks.rados.rados.0.trial188.stdout:867: copy_from oid 28 from oid 41 current snap is 90 2026-02-13T20:15:21.901 INFO:tasks.rados.rados.0.trial188.stdout:864: done (3 left) 2026-02-13T20:15:21.901 INFO:tasks.rados.rados.0.trial188.stdout:868: write oid 31 current snap is 90 2026-02-13T20:15:21.901 INFO:tasks.rados.rados.0.trial188.stdout:868: seq_num 327 ranges {695889=409602,1618553=712763,2996848=499041} 2026-02-13T20:15:21.905 INFO:tasks.rados.rados.0.trial188.stdout:868: writing trial18843701-31 from 695889 to 1105491 tid 1 2026-02-13T20:15:21.909 INFO:tasks.rados.rados.0.trial188.stdout:868: writing trial18843701-31 from 1618553 to 2331316 tid 2 2026-02-13T20:15:21.914 INFO:tasks.rados.rados.0.trial188.stdout:868: writing trial18843701-31 from 2996848 to 3495889 tid 3 2026-02-13T20:15:21.914 INFO:tasks.rados.rados.0.trial188.stdout:869: snap_remove snap 87 2026-02-13T20:15:22.881 INFO:tasks.rados.rados.0.trial188.stdout:869: done (4 left) 2026-02-13T20:15:22.882 INFO:tasks.rados.rados.0.trial188.stdout:870: snap_create 2026-02-13T20:15:22.882 INFO:tasks.rados.rados.0.trial188.stdout:866: finishing write tid 1 to trial18843701-30 2026-02-13T20:15:22.882 INFO:tasks.rados.rados.0.trial188.stdout:866: finishing write tid 2 to trial18843701-30 2026-02-13T20:15:22.882 INFO:tasks.rados.rados.0.trial188.stdout:866: finishing write tid 3 to trial18843701-30 2026-02-13T20:15:22.882 INFO:tasks.rados.rados.0.trial188.stdout:866: finishing write tid 4 to trial18843701-30 2026-02-13T20:15:22.882 INFO:tasks.rados.rados.0.trial188.stdout:866: finishing write tid 5 to trial18843701-30 2026-02-13T20:15:22.882 INFO:tasks.rados.rados.0.trial188.stdout:866: oid 30 updating version 0 to 394 2026-02-13T20:15:22.882 INFO:tasks.rados.rados.0.trial188.stdout:866: oid 30 version 394 is already newer than 393 2026-02-13T20:15:22.882 INFO:tasks.rados.rados.0.trial188.stdout:866: oid 30 version 394 is already newer than 392 2026-02-13T20:15:22.883 INFO:tasks.rados.rados.0.trial188.stdout:866: oid 30 version 394 is already newer than 391 2026-02-13T20:15:22.883 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 30 v 394 (ObjNum 326 snap 90 seq_num 326) dirty exists 2026-02-13T20:15:22.883 INFO:tasks.rados.rados.0.trial188.stdout:866: left oid 30 (ObjNum 326 snap 90 seq_num 326) 2026-02-13T20:15:22.883 INFO:tasks.rados.rados.0.trial188.stdout:868: finishing write tid 1 to trial18843701-31 2026-02-13T20:15:22.883 INFO:tasks.rados.rados.0.trial188.stdout:868: finishing write tid 2 to trial18843701-31 2026-02-13T20:15:22.883 INFO:tasks.rados.rados.0.trial188.stdout:865: finishing copy_from racing read to trial18843701-36 2026-02-13T20:15:22.883 INFO:tasks.rados.rados.0.trial188.stdout:868: finishing write tid 3 to trial18843701-31 2026-02-13T20:15:22.883 INFO:tasks.rados.rados.0.trial188.stdout:868: finishing write tid 4 to trial18843701-31 2026-02-13T20:15:22.883 INFO:tasks.rados.rados.0.trial188.stdout:868: finishing write tid 5 to trial18843701-31 2026-02-13T20:15:22.883 INFO:tasks.rados.rados.0.trial188.stdout:868: oid 31 updating version 0 to 327 2026-02-13T20:15:22.883 INFO:tasks.rados.rados.0.trial188.stdout:868: oid 31 version 327 is already newer than 326 2026-02-13T20:15:22.883 INFO:tasks.rados.rados.0.trial188.stdout:868: oid 31 updating version 327 to 329 2026-02-13T20:15:22.883 INFO:tasks.rados.rados.0.trial188.stdout:868: oid 31 version 329 is already newer than 328 2026-02-13T20:15:22.884 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 31 v 329 (ObjNum 327 snap 90 seq_num 327) dirty exists 2026-02-13T20:15:22.884 INFO:tasks.rados.rados.0.trial188.stdout:868: left oid 31 (ObjNum 327 snap 90 seq_num 327) 2026-02-13T20:15:22.884 INFO:tasks.rados.rados.0.trial188.stdout:867: finishing copy_from racing read to trial18843701-28 2026-02-13T20:15:22.884 INFO:tasks.rados.rados.0.trial188.stdout:865: finishing copy_from to trial18843701-36 2026-02-13T20:15:22.884 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 36 v 321 (ObjNum 322 snap 88 seq_num 322) dirty exists 2026-02-13T20:15:22.884 INFO:tasks.rados.rados.0.trial188.stdout:867: finishing copy_from to trial18843701-28 2026-02-13T20:15:22.884 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 28 v 162 (ObjNum 187 snap 47 seq_num 187) dirty exists 2026-02-13T20:15:23.882 INFO:tasks.rados.rados.0.trial188.stdout:865: done (4 left) 2026-02-13T20:15:23.882 INFO:tasks.rados.rados.0.trial188.stdout:866: done (3 left) 2026-02-13T20:15:23.882 INFO:tasks.rados.rados.0.trial188.stdout:867: done (2 left) 2026-02-13T20:15:23.882 INFO:tasks.rados.rados.0.trial188.stdout:868: done (1 left) 2026-02-13T20:15:23.882 INFO:tasks.rados.rados.0.trial188.stdout:870: done (0 left) 2026-02-13T20:15:23.882 INFO:tasks.rados.rados.0.trial188.stdout:871: snap_remove snap 89 2026-02-13T20:15:24.881 INFO:tasks.rados.rados.0.trial188.stdout:871: done (0 left) 2026-02-13T20:15:24.881 INFO:tasks.rados.rados.0.trial188.stdout:872: snap_remove snap 88 2026-02-13T20:15:25.882 INFO:tasks.rados.rados.0.trial188.stdout:872: done (0 left) 2026-02-13T20:15:25.882 INFO:tasks.rados.rados.0.trial188.stdout:873: read oid 6 snap 90 2026-02-13T20:15:25.882 INFO:tasks.rados.rados.0.trial188.stdout:873: expect (ObjNum 266 snap 70 seq_num 266) 2026-02-13T20:15:25.882 INFO:tasks.rados.rados.0.trial188.stdout:874: write (excl) oid 25 current snap is 91 2026-02-13T20:15:25.882 INFO:tasks.rados.rados.0.trial188.stdout:874: seq_num 328 ranges {712696=484851,1960682=572774,3307918=204778} 2026-02-13T20:15:25.887 INFO:tasks.rados.rados.0.trial188.stdout:874: writing trial18843701-25 from 712696 to 1197547 tid 1 2026-02-13T20:15:25.892 INFO:tasks.rados.rados.0.trial188.stdout:874: writing trial18843701-25 from 1960682 to 2533456 tid 2 2026-02-13T20:15:25.896 INFO:tasks.rados.rados.0.trial188.stdout:874: writing trial18843701-25 from 3307918 to 3512696 tid 3 2026-02-13T20:15:25.896 INFO:tasks.rados.rados.0.trial188.stdout:875: read oid 37 snap -1 2026-02-13T20:15:25.896 INFO:tasks.rados.rados.0.trial188.stdout:875: expect deleted 2026-02-13T20:15:25.896 INFO:tasks.rados.rados.0.trial188.stdout:876: write oid 49 current snap is 91 2026-02-13T20:15:25.896 INFO:tasks.rados.rados.0.trial188.stdout:876: seq_num 329 ranges {729503=560100,2019164=716432,3335341=194162} 2026-02-13T20:15:25.900 INFO:tasks.rados.rados.0.trial188.stdout:876: writing trial18843701-49 from 729503 to 1289603 tid 1 2026-02-13T20:15:25.907 INFO:tasks.rados.rados.0.trial188.stdout:876: writing trial18843701-49 from 2019164 to 2735596 tid 2 2026-02-13T20:15:25.911 INFO:tasks.rados.rados.0.trial188.stdout:876: writing trial18843701-49 from 3335341 to 3529503 tid 3 2026-02-13T20:15:25.911 INFO:tasks.rados.rados.0.trial188.stdout:877: delete oid 13 current snap is 91 2026-02-13T20:15:25.912 INFO:tasks.rados.rados.0.trial188.stdout:873: expect (ObjNum 266 snap 70 seq_num 266) 2026-02-13T20:15:25.926 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2137222 2026-02-13T20:15:25.965 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2389161 2026-02-13T20:15:25.969 INFO:tasks.rados.rados.0.trial188.stdout:874: finishing write tid 1 to trial18843701-25 2026-02-13T20:15:25.969 INFO:tasks.rados.rados.0.trial188.stdout:874: finishing write tid 2 to trial18843701-25 2026-02-13T20:15:25.969 INFO:tasks.rados.rados.0.trial188.stdout:874: finishing write tid 3 to trial18843701-25 2026-02-13T20:15:25.969 INFO:tasks.rados.rados.0.trial188.stdout:874: finishing write tid 4 to trial18843701-25 2026-02-13T20:15:25.969 INFO:tasks.rados.rados.0.trial188.stdout:874: finishing write tid 5 to trial18843701-25 2026-02-13T20:15:25.969 INFO:tasks.rados.rados.0.trial188.stdout:874: oid 25 updating version 0 to 403 2026-02-13T20:15:25.969 INFO:tasks.rados.rados.0.trial188.stdout:874: oid 25 version 403 is already newer than 402 2026-02-13T20:15:25.970 INFO:tasks.rados.rados.0.trial188.stdout:874: oid 25 updating version 403 to 405 2026-02-13T20:15:25.970 INFO:tasks.rados.rados.0.trial188.stdout:874: oid 25 version 405 is already newer than 404 2026-02-13T20:15:25.970 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 25 v 405 (ObjNum 328 snap 91 seq_num 328) dirty exists 2026-02-13T20:15:25.970 INFO:tasks.rados.rados.0.trial188.stdout:874: left oid 25 (ObjNum 328 snap 91 seq_num 328) 2026-02-13T20:15:25.970 INFO:tasks.rados.rados.0.trial188.stdout:876: finishing write tid 1 to trial18843701-49 2026-02-13T20:15:25.970 INFO:tasks.rados.rados.0.trial188.stdout:876: finishing write tid 2 to trial18843701-49 2026-02-13T20:15:25.970 INFO:tasks.rados.rados.0.trial188.stdout:876: finishing write tid 3 to trial18843701-49 2026-02-13T20:15:25.970 INFO:tasks.rados.rados.0.trial188.stdout:876: finishing write tid 4 to trial18843701-49 2026-02-13T20:15:25.970 INFO:tasks.rados.rados.0.trial188.stdout:876: finishing write tid 5 to trial18843701-49 2026-02-13T20:15:25.970 INFO:tasks.rados.rados.0.trial188.stdout:876: oid 49 updating version 0 to 410 2026-02-13T20:15:25.970 INFO:tasks.rados.rados.0.trial188.stdout:876: oid 49 version 410 is already newer than 408 2026-02-13T20:15:25.971 INFO:tasks.rados.rados.0.trial188.stdout:876: oid 49 version 410 is already newer than 407 2026-02-13T20:15:25.971 INFO:tasks.rados.rados.0.trial188.stdout:876: oid 49 version 410 is already newer than 409 2026-02-13T20:15:25.971 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 49 v 410 (ObjNum 329 snap 91 seq_num 329) dirty exists 2026-02-13T20:15:25.971 INFO:tasks.rados.rados.0.trial188.stdout:876: left oid 49 (ObjNum 329 snap 91 seq_num 329) 2026-02-13T20:15:25.971 INFO:tasks.rados.rados.0.trial188.stdout:873: done (4 left) 2026-02-13T20:15:25.971 INFO:tasks.rados.rados.0.trial188.stdout:874: done (3 left) 2026-02-13T20:15:25.971 INFO:tasks.rados.rados.0.trial188.stdout:875: done (2 left) 2026-02-13T20:15:25.971 INFO:tasks.rados.rados.0.trial188.stdout:876: done (1 left) 2026-02-13T20:15:25.971 INFO:tasks.rados.rados.0.trial188.stdout:877: done (0 left) 2026-02-13T20:15:25.971 INFO:tasks.rados.rados.0.trial188.stdout:878: write (excl) oid 41 current snap is 91 2026-02-13T20:15:25.971 INFO:tasks.rados.rados.0.trial188.stdout:878: seq_num 331 ranges {763117=710598,2136128=720101,3390187=172930} 2026-02-13T20:15:25.974 INFO:tasks.rados.rados.0.trial188.stdout:878: writing trial18843701-41 from 763117 to 1473715 tid 1 2026-02-13T20:15:25.979 INFO:tasks.rados.rados.0.trial188.stdout:878: writing trial18843701-41 from 2136128 to 2856229 tid 2 2026-02-13T20:15:25.982 INFO:tasks.rados.rados.0.trial188.stdout:878: writing trial18843701-41 from 3390187 to 3563117 tid 3 2026-02-13T20:15:25.982 INFO:tasks.rados.rados.0.trial188.stdout:879: delete oid 15 current snap is 91 2026-02-13T20:15:25.984 INFO:tasks.rados.rados.0.trial188.stdout:879: done (1 left) 2026-02-13T20:15:25.984 INFO:tasks.rados.rados.0.trial188.stdout:880: write (excl) oid 16 current snap is 91 2026-02-13T20:15:25.984 INFO:tasks.rados.rados.0.trial188.stdout:880: seq_num 333 ranges {796731=461096,1736739=723770,2928680=668051} 2026-02-13T20:15:25.989 INFO:tasks.rados.rados.0.trial188.stdout:880: writing trial18843701-16 from 796731 to 1257827 tid 1 2026-02-13T20:15:25.993 INFO:tasks.rados.rados.0.trial188.stdout:880: writing trial18843701-16 from 1736739 to 2460509 tid 2 2026-02-13T20:15:25.998 INFO:tasks.rados.rados.0.trial188.stdout:880: writing trial18843701-16 from 2928680 to 3596731 tid 3 2026-02-13T20:15:25.998 INFO:tasks.rados.rados.0.trial188.stdout:881: snap_create 2026-02-13T20:15:26.000 INFO:tasks.rados.rados.0.trial188.stdout:878: finishing write tid 1 to trial18843701-41 2026-02-13T20:15:26.000 INFO:tasks.rados.rados.0.trial188.stdout:878: finishing write tid 2 to trial18843701-41 2026-02-13T20:15:26.005 INFO:tasks.rados.rados.0.trial188.stdout:878: finishing write tid 3 to trial18843701-41 2026-02-13T20:15:26.005 INFO:tasks.rados.rados.0.trial188.stdout:878: finishing write tid 4 to trial18843701-41 2026-02-13T20:15:26.005 INFO:tasks.rados.rados.0.trial188.stdout:878: finishing write tid 5 to trial18843701-41 2026-02-13T20:15:26.005 INFO:tasks.rados.rados.0.trial188.stdout:878: oid 41 updating version 0 to 326 2026-02-13T20:15:26.005 INFO:tasks.rados.rados.0.trial188.stdout:878: oid 41 updating version 326 to 328 2026-02-13T20:15:26.005 INFO:tasks.rados.rados.0.trial188.stdout:878: oid 41 version 328 is already newer than 327 2026-02-13T20:15:26.005 INFO:tasks.rados.rados.0.trial188.stdout:878: oid 41 updating version 328 to 329 2026-02-13T20:15:26.005 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 41 v 329 (ObjNum 331 snap 91 seq_num 331) dirty exists 2026-02-13T20:15:26.006 INFO:tasks.rados.rados.0.trial188.stdout:878: left oid 41 (ObjNum 331 snap 91 seq_num 331) 2026-02-13T20:15:26.016 INFO:tasks.rados.rados.0.trial188.stdout:880: finishing write tid 1 to trial18843701-16 2026-02-13T20:15:26.016 INFO:tasks.rados.rados.0.trial188.stdout:880: finishing write tid 2 to trial18843701-16 2026-02-13T20:15:26.016 INFO:tasks.rados.rados.0.trial188.stdout:880: finishing write tid 3 to trial18843701-16 2026-02-13T20:15:26.016 INFO:tasks.rados.rados.0.trial188.stdout:880: finishing write tid 4 to trial18843701-16 2026-02-13T20:15:26.016 INFO:tasks.rados.rados.0.trial188.stdout:880: finishing write tid 5 to trial18843701-16 2026-02-13T20:15:26.016 INFO:tasks.rados.rados.0.trial188.stdout:880: oid 16 updating version 0 to 370 2026-02-13T20:15:26.016 INFO:tasks.rados.rados.0.trial188.stdout:880: oid 16 updating version 370 to 371 2026-02-13T20:15:26.016 INFO:tasks.rados.rados.0.trial188.stdout:880: oid 16 updating version 371 to 372 2026-02-13T20:15:26.017 INFO:tasks.rados.rados.0.trial188.stdout:880: oid 16 updating version 372 to 373 2026-02-13T20:15:26.017 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 16 v 373 (ObjNum 333 snap 91 seq_num 333) dirty exists 2026-02-13T20:15:26.017 INFO:tasks.rados.rados.0.trial188.stdout:880: left oid 16 (ObjNum 333 snap 91 seq_num 333) 2026-02-13T20:15:26.888 INFO:tasks.rados.rados.0.trial188.stdout:878: done (2 left) 2026-02-13T20:15:26.888 INFO:tasks.rados.rados.0.trial188.stdout:880: done (1 left) 2026-02-13T20:15:26.888 INFO:tasks.rados.rados.0.trial188.stdout:881: done (0 left) 2026-02-13T20:15:26.888 INFO:tasks.rados.rados.0.trial188.stdout:882: read oid 33 snap -1 2026-02-13T20:15:26.888 INFO:tasks.rados.rados.0.trial188.stdout:882: expect deleted 2026-02-13T20:15:26.888 INFO:tasks.rados.rados.0.trial188.stdout:883: write oid 26 current snap is 92 2026-02-13T20:15:26.889 INFO:tasks.rados.rados.0.trial188.stdout:883: seq_num 334 ranges {413538=536345,1395221=583781,2556103=658617} 2026-02-13T20:15:26.892 INFO:tasks.rados.rados.0.trial188.stdout:883: writing trial18843701-26 from 413538 to 949883 tid 1 2026-02-13T20:15:26.896 INFO:tasks.rados.rados.0.trial188.stdout:883: writing trial18843701-26 from 1395221 to 1979002 tid 2 2026-02-13T20:15:26.901 INFO:tasks.rados.rados.0.trial188.stdout:883: writing trial18843701-26 from 2556103 to 3214720 tid 3 2026-02-13T20:15:26.901 INFO:tasks.rados.rados.0.trial188.stdout:884: write (excl) oid 3 current snap is 92 2026-02-13T20:15:26.901 INFO:tasks.rados.rados.0.trial188.stdout:884: seq_num 335 ranges {430345=727947,1570056=727439,2699879=469889} 2026-02-13T20:15:26.905 INFO:tasks.rados.rados.0.trial188.stdout:884: writing trial18843701-3 from 430345 to 1158292 tid 1 2026-02-13T20:15:26.910 INFO:tasks.rados.rados.0.trial188.stdout:884: writing trial18843701-3 from 1570056 to 2297495 tid 2 2026-02-13T20:15:26.913 INFO:tasks.rados.rados.0.trial188.stdout:884: writing trial18843701-3 from 2699879 to 3169768 tid 3 2026-02-13T20:15:26.913 INFO:tasks.rados.rados.0.trial188.stdout:885: read oid 21 snap 91 2026-02-13T20:15:26.913 INFO:tasks.rados.rados.0.trial188.stdout:885: expect (ObjNum 321 snap 87 seq_num 321) 2026-02-13T20:15:26.913 INFO:tasks.rados.rados.0.trial188.stdout:886: write oid 29 current snap is 92 2026-02-13T20:15:26.914 INFO:tasks.rados.rados.0.trial188.stdout:886: seq_num 336 ranges {447152=403196,1512185=587450,2727302=681161} 2026-02-13T20:15:26.916 INFO:tasks.rados.rados.0.trial188.stdout:886: writing trial18843701-29 from 447152 to 850348 tid 1 2026-02-13T20:15:26.921 INFO:tasks.rados.rados.0.trial188.stdout:886: writing trial18843701-29 from 1512185 to 2099635 tid 2 2026-02-13T20:15:26.927 INFO:tasks.rados.rados.0.trial188.stdout:886: writing trial18843701-29 from 2727302 to 3408463 tid 3 2026-02-13T20:15:26.927 INFO:tasks.rados.rados.0.trial188.stdout:887: read oid 4 snap -1 2026-02-13T20:15:26.927 INFO:tasks.rados.rados.0.trial188.stdout:887: expect (ObjNum 323 snap 88 seq_num 323) 2026-02-13T20:15:26.927 INFO:tasks.rados.rados.0.trial188.stdout:888: snap_create 2026-02-13T20:15:26.927 INFO:tasks.rados.rados.0.trial188.stdout:885: expect (ObjNum 321 snap 87 seq_num 321) 2026-02-13T20:15:26.933 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2325182 2026-02-13T20:15:26.952 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2888313 2026-02-13T20:15:26.972 INFO:tasks.rados.rados.0.trial188.stdout:883: finishing write tid 1 to trial18843701-26 2026-02-13T20:15:26.972 INFO:tasks.rados.rados.0.trial188.stdout:883: finishing write tid 2 to trial18843701-26 2026-02-13T20:15:26.973 INFO:tasks.rados.rados.0.trial188.stdout:883: finishing write tid 3 to trial18843701-26 2026-02-13T20:15:26.973 INFO:tasks.rados.rados.0.trial188.stdout:883: finishing write tid 4 to trial18843701-26 2026-02-13T20:15:26.973 INFO:tasks.rados.rados.0.trial188.stdout:887: expect (ObjNum 323 snap 88 seq_num 323) 2026-02-13T20:15:27.196 INFO:tasks.rados.rados.0.trial188.stdout:884: finishing write tid 1 to trial18843701-3 2026-02-13T20:15:27.196 INFO:tasks.rados.rados.0.trial188.stdout:884: finishing write tid 2 to trial18843701-3 2026-02-13T20:15:27.196 INFO:tasks.rados.rados.0.trial188.stdout:886: finishing write tid 1 to trial18843701-29 2026-02-13T20:15:27.196 INFO:tasks.rados.rados.0.trial188.stdout:883: finishing write tid 5 to trial18843701-26 2026-02-13T20:15:27.196 INFO:tasks.rados.rados.0.trial188.stdout:883: oid 26 updating version 0 to 319 2026-02-13T20:15:27.197 INFO:tasks.rados.rados.0.trial188.stdout:883: oid 26 updating version 319 to 320 2026-02-13T20:15:27.197 INFO:tasks.rados.rados.0.trial188.stdout:883: oid 26 version 320 is already newer than 318 2026-02-13T20:15:27.197 INFO:tasks.rados.rados.0.trial188.stdout:883: oid 26 updating version 320 to 321 2026-02-13T20:15:27.197 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 26 v 321 (ObjNum 334 snap 92 seq_num 334) dirty exists 2026-02-13T20:15:27.197 INFO:tasks.rados.rados.0.trial188.stdout:883: left oid 26 (ObjNum 334 snap 92 seq_num 334) 2026-02-13T20:15:27.197 INFO:tasks.rados.rados.0.trial188.stdout:886: finishing write tid 2 to trial18843701-29 2026-02-13T20:15:27.197 INFO:tasks.rados.rados.0.trial188.stdout:884: finishing write tid 3 to trial18843701-3 2026-02-13T20:15:27.197 INFO:tasks.rados.rados.0.trial188.stdout:886: finishing write tid 3 to trial18843701-29 2026-02-13T20:15:27.197 INFO:tasks.rados.rados.0.trial188.stdout:886: finishing write tid 4 to trial18843701-29 2026-02-13T20:15:27.197 INFO:tasks.rados.rados.0.trial188.stdout:886: finishing write tid 5 to trial18843701-29 2026-02-13T20:15:27.198 INFO:tasks.rados.rados.0.trial188.stdout:886: oid 29 updating version 0 to 374 2026-02-13T20:15:27.198 INFO:tasks.rados.rados.0.trial188.stdout:886: oid 29 version 374 is already newer than 373 2026-02-13T20:15:27.198 INFO:tasks.rados.rados.0.trial188.stdout:886: oid 29 updating version 374 to 376 2026-02-13T20:15:27.198 INFO:tasks.rados.rados.0.trial188.stdout:886: oid 29 version 376 is already newer than 375 2026-02-13T20:15:27.198 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 29 v 376 (ObjNum 336 snap 92 seq_num 336) dirty exists 2026-02-13T20:15:27.198 INFO:tasks.rados.rados.0.trial188.stdout:886: left oid 29 (ObjNum 336 snap 92 seq_num 336) 2026-02-13T20:15:27.198 INFO:tasks.rados.rados.0.trial188.stdout:884: finishing write tid 4 to trial18843701-3 2026-02-13T20:15:27.198 INFO:tasks.rados.rados.0.trial188.stdout:884: finishing write tid 5 to trial18843701-3 2026-02-13T20:15:27.198 INFO:tasks.rados.rados.0.trial188.stdout:884: oid 3 updating version 0 to 325 2026-02-13T20:15:27.198 INFO:tasks.rados.rados.0.trial188.stdout:884: oid 3 updating version 325 to 326 2026-02-13T20:15:27.198 INFO:tasks.rados.rados.0.trial188.stdout:884: oid 3 version 326 is already newer than 323 2026-02-13T20:15:27.198 INFO:tasks.rados.rados.0.trial188.stdout:884: oid 3 version 326 is already newer than 324 2026-02-13T20:15:27.198 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 3 v 326 (ObjNum 335 snap 92 seq_num 335) dirty exists 2026-02-13T20:15:27.199 INFO:tasks.rados.rados.0.trial188.stdout:884: left oid 3 (ObjNum 335 snap 92 seq_num 335) 2026-02-13T20:15:27.882 INFO:tasks.rados.rados.0.trial188.stdout:882: done (6 left) 2026-02-13T20:15:27.882 INFO:tasks.rados.rados.0.trial188.stdout:883: done (5 left) 2026-02-13T20:15:27.882 INFO:tasks.rados.rados.0.trial188.stdout:884: done (4 left) 2026-02-13T20:15:27.882 INFO:tasks.rados.rados.0.trial188.stdout:885: done (3 left) 2026-02-13T20:15:27.882 INFO:tasks.rados.rados.0.trial188.stdout:886: done (2 left) 2026-02-13T20:15:27.883 INFO:tasks.rados.rados.0.trial188.stdout:887: done (1 left) 2026-02-13T20:15:27.883 INFO:tasks.rados.rados.0.trial188.stdout:888: done (0 left) 2026-02-13T20:15:27.883 INFO:tasks.rados.rados.0.trial188.stdout:889: read oid 8 snap -1 2026-02-13T20:15:27.883 INFO:tasks.rados.rados.0.trial188.stdout:889: expect (ObjNum 322 snap 88 seq_num 322) 2026-02-13T20:15:27.883 INFO:tasks.rados.rados.0.trial188.stdout:890: snap_create 2026-02-13T20:15:27.885 INFO:tasks.rados.rados.0.trial188.stdout:889: expect (ObjNum 322 snap 88 seq_num 322) 2026-02-13T20:15:27.956 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:15:28.306 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-13T20:15:28.307 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-13T20:15:28.307 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-13T20:15:28.307 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-13T20:15:28.320 INFO:tasks.ceph.mon.c:Started 2026-02-13T20:15:28.320 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-13T20:15:28.320 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T20:15:28.381 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:15:28.379+0000 7f5099437c00 -1 mon.c@-1(???).log v0 log_external_backlog rewinding external_log_to from 100 -> 0 (sync_force? mon rebuild?) 2026-02-13T20:15:28.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.383+0000 7eff5e452640 10 monclient: get_monmap_and_config 2026-02-13T20:15:28.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.383+0000 7eff5e452640 10 monclient: build_initial_monmap 2026-02-13T20:15:28.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.383+0000 7eff5e452640 10 monclient: monmap: 2026-02-13T20:15:28.385 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:15:28.385 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:28.385 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:15:28.385110+0000 2026-02-13T20:15:28.385 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:15:28.385110+0000 2026-02-13T20:15:28.385 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:15:28.385 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:28.385 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:15:28.385 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:15:28.385 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:15:28.385 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:28.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.384+0000 7eff5e452640 1 Processor -- start 2026-02-13T20:15:28.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.384+0000 7eff5e452640 1 -- start start 2026-02-13T20:15:28.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.384+0000 7eff5e452640 10 monclient: init 2026-02-13T20:15:28.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.384+0000 7eff5e452640 10 monclient: _reopen_session rank -1 2026-02-13T20:15:28.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.384+0000 7eff5e452640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:15:28.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.384+0000 7eff5e452640 10 monclient(hunting): picked mon.noname-c con 0x7eff58089250 addr v1:10.20.193.188:6789/0 2026-02-13T20:15:28.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.384+0000 7eff5e452640 10 monclient(hunting): picked mon.noname-a con 0x7eff58057780 addr v1:10.20.193.110:6789/0 2026-02-13T20:15:28.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.384+0000 7eff5e452640 10 monclient(hunting): picked mon.noname-b con 0x7eff58184b60 addr v1:10.20.193.110:6790/0 2026-02-13T20:15:28.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.384+0000 7eff5e452640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff5808a950 con 0x7eff58057780 2026-02-13T20:15:28.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.384+0000 7eff5e452640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff58089620 con 0x7eff58089250 2026-02-13T20:15:28.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.384+0000 7eff5e452640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff58057c60 con 0x7eff58184b60 2026-02-13T20:15:28.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.384+0000 7eff5e452640 10 monclient(hunting): _renew_subs 2026-02-13T20:15:28.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.384+0000 7eff5e452640 10 monclient(hunting): authenticate will time out at 890.075583s 2026-02-13T20:15:28.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.384+0000 7eff577fe640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7eff58057780 0x7eff58183440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:59392/0 (socket says 10.20.193.110:59392) 2026-02-13T20:15:28.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.384+0000 7eff577fe640 1 -- 10.20.193.110:0/3852252494 learned_addr learned my addr 10.20.193.110:0/3852252494 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:15:28.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.384+0000 7eff56ffd640 1 -- 10.20.193.110:0/3852252494 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1142400805 0 0) 0x7eff5808a950 con 0x7eff58057780 2026-02-13T20:15:28.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.384+0000 7eff56ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:15:28.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.384+0000 7eff56ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:28.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.384+0000 7eff56ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:28.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.384+0000 7eff56ffd640 10 monclient(hunting): my global_id is 84207 2026-02-13T20:15:28.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.384+0000 7eff56ffd640 1 -- 10.20.193.110:0/3852252494 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff3c0035e0 con 0x7eff58057780 2026-02-13T20:15:28.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.384+0000 7eff56ffd640 1 -- 10.20.193.110:0/3852252494 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3849164400 0 0) 0x7eff3c0035e0 con 0x7eff58057780 2026-02-13T20:15:28.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.384+0000 7eff56ffd640 1 -- 10.20.193.110:0/3852252494 >> v1:10.20.193.110:6790/0 conn(0x7eff58184b60 legacy=0x7eff581a4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:28.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.384+0000 7eff56ffd640 1 -- 10.20.193.110:0/3852252494 >> v1:10.20.193.188:6789/0 conn(0x7eff58089250 legacy=0x7eff580580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:28.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.384+0000 7eff56ffd640 10 monclient: _finish_hunting 0 2026-02-13T20:15:28.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.384+0000 7eff56ffd640 1 monclient: found mon.noname-a 2026-02-13T20:15:28.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.384+0000 7eff56ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:15:28.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.384+0000 7eff56ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:15:28.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.384+0000 7eff56ffd640 1 -- 10.20.193.110:0/3852252494 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff58089a50 con 0x7eff58057780 2026-02-13T20:15:28.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.384+0000 7eff56ffd640 10 monclient: _finish_auth 0 2026-02-13T20:15:28.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.384+0000 7eff56ffd640 10 monclient: _check_auth_tickets 2026-02-13T20:15:28.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.384+0000 7eff56ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:15:28.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.384+0000 7eff56ffd640 1 -- 10.20.193.110:0/3852252494 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7eff48002dd0 con 0x7eff58057780 2026-02-13T20:15:28.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.384+0000 7eff5e452640 5 monclient: authenticate success, global_id 84207 2026-02-13T20:15:28.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.384+0000 7eff5e452640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:15:28.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.384+0000 7eff56ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:28.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.384+0000 7eff56ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:15:28.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.384+0000 7eff56ffd640 10 monclient: dump: 2026-02-13T20:15:28.388 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:28.388 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:28.388 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.388 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.388 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:28.388 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:28.388 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:28.388 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:28.388 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:28.388 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:28.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.384+0000 7eff5e452640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:15:28.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.385+0000 7eff56ffd640 1 -- 10.20.193.110:0/3852252494 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7eff48003090 con 0x7eff58057780 2026-02-13T20:15:28.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.385+0000 7eff56ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:15:28.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.385+0000 7eff5e452640 10 monclient: get_monmap_and_config success 2026-02-13T20:15:28.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.385+0000 7eff5e452640 4 set_mon_vals no callback set 2026-02-13T20:15:28.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.385+0000 7eff56ffd640 1 -- 10.20.193.110:0/3852252494 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7eff480034a0 con 0x7eff58057780 2026-02-13T20:15:28.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.385+0000 7eff56ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:28.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.385+0000 7eff56ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:15:28.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.385+0000 7eff56ffd640 10 monclient: dump: 2026-02-13T20:15:28.388 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:28.388 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:28.388 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.388 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.388 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:28.388 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:28.388 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:28.388 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:28.388 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:28.388 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:28.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.385+0000 7eff5e452640 10 monclient: shutdown 2026-02-13T20:15:28.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.385+0000 7eff5e452640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:15:28.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.385+0000 7eff5e452640 1 -- 10.20.193.110:0/3852252494 >> v1:10.20.193.110:6789/0 conn(0x7eff58057780 legacy=0x7eff58183440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:28.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.385+0000 7eff5e452640 1 -- 10.20.193.110:0/3852252494 shutdown_connections 2026-02-13T20:15:28.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.385+0000 7eff5e452640 1 -- 10.20.193.110:0/3852252494 >> 10.20.193.110:0/3852252494 conn(0x7eff58054330 msgr2=0x7eff58054730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:15:28.389 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.385+0000 7eff5e452640 1 -- 10.20.193.110:0/3852252494 shutdown_connections 2026-02-13T20:15:28.389 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.385+0000 7eff5e452640 1 -- 10.20.193.110:0/3852252494 wait complete. 2026-02-13T20:15:28.390 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.385+0000 7eff5e452640 10 monclient: build_initial_monmap 2026-02-13T20:15:28.390 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.385+0000 7eff5e452640 10 monclient: monmap: 2026-02-13T20:15:28.390 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:15:28.390 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:15:28.390 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:15:28.390 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:15:28.390 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:15:28.390 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:15:28.390 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:15:28.390 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:15:28.390 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:15:28.390 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:28.390 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.386+0000 7eff5e452640 1 Processor -- start 2026-02-13T20:15:28.390 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.386+0000 7eff5e452640 1 -- start start 2026-02-13T20:15:28.390 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.386+0000 7eff5e452640 10 monclient: init 2026-02-13T20:15:28.390 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.386+0000 7eff5e452640 10 monclient: _reopen_session rank -1 2026-02-13T20:15:28.390 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.386+0000 7eff5e452640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:15:28.390 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.386+0000 7eff5e452640 10 monclient(hunting): picked mon.noname-a con 0x7eff58057780 addr v1:10.20.193.110:6789/0 2026-02-13T20:15:28.390 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.386+0000 7eff5e452640 10 monclient(hunting): picked mon.noname-c con 0x7eff58089250 addr v1:10.20.193.110:6790/0 2026-02-13T20:15:28.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.386+0000 7eff5e452640 10 monclient(hunting): picked mon.noname-b con 0x7eff58184b60 addr v1:10.20.193.188:6789/0 2026-02-13T20:15:28.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.386+0000 7eff5e452640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff58062290 con 0x7eff58057780 2026-02-13T20:15:28.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.386+0000 7eff5e452640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff581119f0 con 0x7eff58184b60 2026-02-13T20:15:28.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.386+0000 7eff5e452640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff5812b610 con 0x7eff58089250 2026-02-13T20:15:28.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.386+0000 7eff5e452640 10 monclient(hunting): _renew_subs 2026-02-13T20:15:28.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.386+0000 7eff5e452640 10 monclient(hunting): authenticate will time out at 890.077538s 2026-02-13T20:15:28.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.386+0000 7eff57fff640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7eff58057780 0x7eff5812af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:59394/0 (socket says 10.20.193.110:59394) 2026-02-13T20:15:28.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.386+0000 7eff577fe640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7eff58089250 0x7eff581722c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:42840/0 (socket says 10.20.193.110:42840) 2026-02-13T20:15:28.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.386+0000 7eff57fff640 1 -- 10.20.193.110:0/1800077581 learned_addr learned my addr 10.20.193.110:0/1800077581 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:15:28.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.386+0000 7eff54ff9640 1 -- 10.20.193.110:0/1800077581 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2440262753 0 0) 0x7eff58062290 con 0x7eff58057780 2026-02-13T20:15:28.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.386+0000 7eff54ff9640 10 monclient(hunting): _negotiate 2026-02-13T20:15:28.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.386+0000 7eff54ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:28.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.386+0000 7eff54ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:28.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.386+0000 7eff54ff9640 10 monclient(hunting): my global_id is 84210 2026-02-13T20:15:28.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.386+0000 7eff54ff9640 1 -- 10.20.193.110:0/1800077581 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff280035e0 con 0x7eff58057780 2026-02-13T20:15:28.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.386+0000 7eff54ff9640 1 -- 10.20.193.110:0/1800077581 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 287072866 0 0) 0x7eff280035e0 con 0x7eff58057780 2026-02-13T20:15:28.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.386+0000 7eff54ff9640 1 -- 10.20.193.110:0/1800077581 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7eff58062290 con 0x7eff58057780 2026-02-13T20:15:28.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.386+0000 7eff54ff9640 1 -- 10.20.193.110:0/1800077581 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7eff440030e0 con 0x7eff58057780 2026-02-13T20:15:28.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.386+0000 7eff54ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:15:28.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.386+0000 7eff54ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:15:28.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.386+0000 7eff54ff9640 10 monclient(hunting): dump: 2026-02-13T20:15:28.391 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:28.391 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:28.391 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.391 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.391 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:28.391 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:28.391 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:28.391 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:28.391 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:28.391 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:28.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.386+0000 7eff54ff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:15:28.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.387+0000 7eff54ff9640 1 -- 10.20.193.110:0/1800077581 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2775181615 0 0) 0x7eff58062290 con 0x7eff58057780 2026-02-13T20:15:28.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.387+0000 7eff54ff9640 1 -- 10.20.193.110:0/1800077581 >> v1:10.20.193.110:6790/0 conn(0x7eff58089250 legacy=0x7eff581722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:28.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.387+0000 7eff54ff9640 1 -- 10.20.193.110:0/1800077581 >> v1:10.20.193.188:6789/0 conn(0x7eff58184b60 legacy=0x7eff581739e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:28.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.387+0000 7eff54ff9640 10 monclient: _finish_hunting 0 2026-02-13T20:15:28.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.387+0000 7eff54ff9640 1 monclient: found mon.a 2026-02-13T20:15:28.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.387+0000 7eff54ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:15:28.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.387+0000 7eff54ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:15:28.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.387+0000 7eff54ff9640 1 -- 10.20.193.110:0/1800077581 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff58110500 con 0x7eff58057780 2026-02-13T20:15:28.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.387+0000 7eff54ff9640 10 monclient: _finish_auth 0 2026-02-13T20:15:28.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.387+0000 7eff54ff9640 10 monclient: _check_auth_tickets 2026-02-13T20:15:28.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.387+0000 7eff54ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:15:28.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.387+0000 7eff5e452640 5 monclient: authenticate success, global_id 84210 2026-02-13T20:15:28.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.387+0000 7eff5e452640 10 monclient: _renew_subs 2026-02-13T20:15:28.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.387+0000 7eff5e452640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:15:28.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.387+0000 7eff5e452640 1 -- 10.20.193.110:0/1800077581 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7eff58112860 con 0x7eff58057780 2026-02-13T20:15:28.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.387+0000 7eff5e452640 10 monclient: _renew_subs 2026-02-13T20:15:28.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.387+0000 7eff5e452640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:15:28.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.387+0000 7eff5e452640 1 -- 10.20.193.110:0/1800077581 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7eff58112070 con 0x7eff58057780 2026-02-13T20:15:28.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.387+0000 7eff54ff9640 1 -- 10.20.193.110:0/1800077581 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7eff440032b0 con 0x7eff58057780 2026-02-13T20:15:28.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.387+0000 7eff54ff9640 10 monclient: handle_config config(0 keys) 2026-02-13T20:15:28.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.387+0000 7eff54ff9640 1 -- 10.20.193.110:0/1800077581 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7eff440039c0 con 0x7eff58057780 2026-02-13T20:15:28.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.387+0000 7eff54ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:28.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.387+0000 7eff54ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:15:28.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.387+0000 7eff54ff9640 10 monclient: dump: 2026-02-13T20:15:28.392 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:28.392 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:28.392 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.392 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.392 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:28.392 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:28.392 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:28.392 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:28.392 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:28.392 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:28.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.387+0000 7eff567fc640 4 set_mon_vals no callback set 2026-02-13T20:15:28.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.387+0000 7eff5e452640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:15:28.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.387+0000 7eff5e452640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:15:28.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.387+0000 7eff5e452640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:15:28.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.387+0000 7eff5e452640 1 -- 10.20.193.110:0/1800077581 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff58089030 con 0x7eff58057780 2026-02-13T20:15:28.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.387+0000 7eff54ff9640 1 -- 10.20.193.110:0/1800077581 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7eff44003b20 con 0x7eff58057780 2026-02-13T20:15:28.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.387+0000 7eff54ff9640 1 -- 10.20.193.110:0/1800077581 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(206..206 src has 1..206) ==== 3927+0+0 (unknown 3090514301 0 0) 0x7eff4404e920 con 0x7eff58057780 2026-02-13T20:15:28.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.388+0000 7eff577fe640 10 monclient: get_auth_request con 0x7eff2803f6f0 auth_method 0 2026-02-13T20:15:28.393 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.390+0000 7eff54ff9640 1 -- 10.20.193.110:0/1800077581 <== mon.0 v1:10.20.193.110:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7eff44004360 con 0x7eff58057780 2026-02-13T20:15:28.393 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.390+0000 7eff54ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:15:28.393 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.390+0000 7eff54ff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:15:28.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.537+0000 7eff5e452640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T20:15:28.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.537+0000 7eff5e452640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T20:15:28.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.537+0000 7eff5e452640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:15:28.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.537+0000 7eff5e452640 1 -- 10.20.193.110:0/1800077581 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7eff5808e3b0 con 0x7eff58057780 2026-02-13T20:15:28.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.537+0000 7eff54ff9640 1 -- 10.20.193.110:0/1800077581 <== mon.0 v1:10.20.193.110:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 3858857994) 0x7eff440167b0 con 0x7eff58057780 2026-02-13T20:15:28.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.537+0000 7eff54ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T20:15:28.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.537+0000 7eff54ff9640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:15:28.541 INFO:teuthology.orchestra.run.trial110.stdout:{"election_epoch":16,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","modified":"2026-02-13T20:11:07.161192Z","created":"2026-02-13T20:11:07.161192Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6789","nonce":0}]},"addr":"10.20.193.110:6789/0","public_addr":"10.20.193.110:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161241+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6789","nonce":0}]},"addr":"10.20.193.188:6789/0","public_addr":"10.20.193.188:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161242+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6790","nonce":0}]},"addr":"10.20.193.110:6790/0","public_addr":"10.20.193.110:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161243+0000","crush_location":[]}]}} 2026-02-13T20:15:28.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.538+0000 7eff5e452640 1 -- 10.20.193.110:0/1800077581 >> v1:10.20.193.188:6812/1623052694 conn(0x7eff2803f6f0 legacy=0x7eff2805fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:28.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.538+0000 7eff5e452640 10 monclient: shutdown 2026-02-13T20:15:28.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.538+0000 7eff5e452640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:15:28.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.538+0000 7eff5e452640 1 -- 10.20.193.110:0/1800077581 >> v1:10.20.193.110:6789/0 conn(0x7eff58057780 legacy=0x7eff5812af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:28.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.538+0000 7eff5e452640 1 -- 10.20.193.110:0/1800077581 shutdown_connections 2026-02-13T20:15:28.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.538+0000 7eff5e452640 1 -- 10.20.193.110:0/1800077581 >> 10.20.193.110:0/1800077581 conn(0x7eff58054330 msgr2=0x7eff5808d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:15:28.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.538+0000 7eff5e452640 1 -- 10.20.193.110:0/1800077581 shutdown_connections 2026-02-13T20:15:28.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.538+0000 7eff5e452640 1 -- 10.20.193.110:0/1800077581 wait complete. 2026-02-13T20:15:28.548 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-13T20:15:28.548 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-13T20:15:28.548 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T20:15:28.613 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.611+0000 7ffb0f50c640 10 monclient: get_monmap_and_config 2026-02-13T20:15:28.613 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.611+0000 7ffb0f50c640 10 monclient: build_initial_monmap 2026-02-13T20:15:28.613 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.611+0000 7ffb0f50c640 10 monclient: monmap: 2026-02-13T20:15:28.613 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:15:28.613 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:28.613 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:15:28.612645+0000 2026-02-13T20:15:28.613 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:15:28.612645+0000 2026-02-13T20:15:28.613 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:15:28.613 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:28.613 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:15:28.613 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:15:28.613 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:15:28.613 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:28.614 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.611+0000 7ffb0f50c640 1 Processor -- start 2026-02-13T20:15:28.614 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.611+0000 7ffb0f50c640 1 -- start start 2026-02-13T20:15:28.614 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.611+0000 7ffb0f50c640 10 monclient: init 2026-02-13T20:15:28.614 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.611+0000 7ffb0f50c640 10 monclient: _reopen_session rank -1 2026-02-13T20:15:28.614 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.611+0000 7ffb0f50c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:15:28.614 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.611+0000 7ffb0f50c640 10 monclient(hunting): picked mon.noname-a con 0x7ffb081401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:15:28.614 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.611+0000 7ffb0f50c640 10 monclient(hunting): picked mon.noname-c con 0x7ffb08092020 addr v1:10.20.193.188:6789/0 2026-02-13T20:15:28.614 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.611+0000 7ffb0f50c640 10 monclient(hunting): picked mon.noname-b con 0x7ffb08091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:15:28.614 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.611+0000 7ffb0f50c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb0808b730 con 0x7ffb081401c0 2026-02-13T20:15:28.614 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.611+0000 7ffb0f50c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb0805c5b0 con 0x7ffb08092020 2026-02-13T20:15:28.614 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.611+0000 7ffb0f50c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb0808bcf0 con 0x7ffb08091950 2026-02-13T20:15:28.614 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.611+0000 7ffb0f50c640 10 monclient(hunting): _renew_subs 2026-02-13T20:15:28.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.612+0000 7ffb0f50c640 10 monclient(hunting): authenticate will time out at 890.303011s 2026-02-13T20:15:28.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.612+0000 7ffb0d281640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7ffb081401c0 0x7ffb08091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:59404/0 (socket says 10.20.193.110:59404) 2026-02-13T20:15:28.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.612+0000 7ffb0d281640 1 -- 10.20.193.110:0/2316270777 learned_addr learned my addr 10.20.193.110:0/2316270777 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:15:28.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.612+0000 7ffb0da82640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7ffb08091950 0x7ffb081a2a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:42854/0 (socket says 10.20.193.110:42854) 2026-02-13T20:15:28.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.612+0000 7ffaf7fff640 1 -- 10.20.193.110:0/2316270777 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3454448429 0 0) 0x7ffb0808b730 con 0x7ffb081401c0 2026-02-13T20:15:28.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.612+0000 7ffaf7fff640 10 monclient(hunting): _negotiate 2026-02-13T20:15:28.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.612+0000 7ffaf7fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:28.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.612+0000 7ffaf7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:28.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.612+0000 7ffaf7fff640 10 monclient(hunting): my global_id is 84213 2026-02-13T20:15:28.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.612+0000 7ffaf7fff640 1 -- 10.20.193.110:0/2316270777 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffaf00035e0 con 0x7ffb081401c0 2026-02-13T20:15:28.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.612+0000 7ffaf7fff640 1 -- 10.20.193.110:0/2316270777 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2687372160 0 0) 0x7ffaf00035e0 con 0x7ffb081401c0 2026-02-13T20:15:28.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.612+0000 7ffaf7fff640 1 -- 10.20.193.110:0/2316270777 >> v1:10.20.193.110:6790/0 conn(0x7ffb08091950 legacy=0x7ffb081a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:28.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.612+0000 7ffaf7fff640 1 -- 10.20.193.110:0/2316270777 >> v1:10.20.193.188:6789/0 conn(0x7ffb08092020 legacy=0x7ffb081812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:28.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.612+0000 7ffaf7fff640 10 monclient: _finish_hunting 0 2026-02-13T20:15:28.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.612+0000 7ffaf7fff640 1 monclient: found mon.noname-a 2026-02-13T20:15:28.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.612+0000 7ffaf7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:15:28.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.612+0000 7ffaf7fff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:15:28.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.612+0000 7ffaf7fff640 1 -- 10.20.193.110:0/2316270777 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb08140590 con 0x7ffb081401c0 2026-02-13T20:15:28.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.612+0000 7ffaf7fff640 10 monclient: _finish_auth 0 2026-02-13T20:15:28.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.612+0000 7ffaf7fff640 10 monclient: _check_auth_tickets 2026-02-13T20:15:28.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.612+0000 7ffaf7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:15:28.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.612+0000 7ffaf7fff640 1 -- 10.20.193.110:0/2316270777 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ffaf8002dd0 con 0x7ffb081401c0 2026-02-13T20:15:28.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.612+0000 7ffb0f50c640 5 monclient: authenticate success, global_id 84213 2026-02-13T20:15:28.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.612+0000 7ffb0f50c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:15:28.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.612+0000 7ffaf7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:28.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.612+0000 7ffaf7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:15:28.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.612+0000 7ffaf7fff640 10 monclient: dump: 2026-02-13T20:15:28.615 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:28.615 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:28.615 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.615 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.615 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:28.615 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:28.615 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:28.615 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:28.615 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:28.616 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:28.616 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.612+0000 7ffb0f50c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:15:28.616 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.612+0000 7ffaf7fff640 1 -- 10.20.193.110:0/2316270777 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ffaf8002fa0 con 0x7ffb081401c0 2026-02-13T20:15:28.616 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.612+0000 7ffaf7fff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:15:28.616 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.612+0000 7ffaf7fff640 1 -- 10.20.193.110:0/2316270777 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ffaf80033b0 con 0x7ffb081401c0 2026-02-13T20:15:28.616 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.612+0000 7ffb0f50c640 10 monclient: get_monmap_and_config success 2026-02-13T20:15:28.616 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.612+0000 7ffb0f50c640 4 set_mon_vals no callback set 2026-02-13T20:15:28.616 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.612+0000 7ffaf7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:28.616 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.612+0000 7ffaf7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:15:28.616 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.612+0000 7ffaf7fff640 10 monclient: dump: 2026-02-13T20:15:28.616 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:28.616 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:28.616 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.616 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.616 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:28.616 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:28.616 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:28.616 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:28.616 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:28.616 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:28.616 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.612+0000 7ffb0f50c640 10 monclient: shutdown 2026-02-13T20:15:28.616 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.612+0000 7ffb0f50c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:15:28.616 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.612+0000 7ffb0f50c640 1 -- 10.20.193.110:0/2316270777 >> v1:10.20.193.110:6789/0 conn(0x7ffb081401c0 legacy=0x7ffb08091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:28.616 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.612+0000 7ffb0f50c640 1 -- 10.20.193.110:0/2316270777 shutdown_connections 2026-02-13T20:15:28.616 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.612+0000 7ffb0f50c640 1 -- 10.20.193.110:0/2316270777 >> 10.20.193.110:0/2316270777 conn(0x7ffb08054e90 msgr2=0x7ffb08058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:15:28.616 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.612+0000 7ffb0f50c640 1 -- 10.20.193.110:0/2316270777 shutdown_connections 2026-02-13T20:15:28.616 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.612+0000 7ffb0f50c640 1 -- 10.20.193.110:0/2316270777 wait complete. 2026-02-13T20:15:28.618 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.613+0000 7ffb0f50c640 10 monclient: build_initial_monmap 2026-02-13T20:15:28.618 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.613+0000 7ffb0f50c640 10 monclient: monmap: 2026-02-13T20:15:28.618 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:15:28.618 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:15:28.618 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:15:28.618 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:15:28.618 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:15:28.618 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:15:28.618 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:15:28.618 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:15:28.618 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:15:28.618 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:28.619 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.613+0000 7ffb0f50c640 1 Processor -- start 2026-02-13T20:15:28.619 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.613+0000 7ffb0f50c640 1 -- start start 2026-02-13T20:15:28.619 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.613+0000 7ffb0f50c640 10 monclient: init 2026-02-13T20:15:28.619 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.613+0000 7ffb0f50c640 10 monclient: _reopen_session rank -1 2026-02-13T20:15:28.619 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.613+0000 7ffb0f50c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:15:28.619 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.613+0000 7ffb0f50c640 10 monclient(hunting): picked mon.noname-a con 0x7ffb08091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:15:28.619 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.613+0000 7ffb0f50c640 10 monclient(hunting): picked mon.noname-c con 0x7ffb081401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:15:28.619 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.613+0000 7ffb0f50c640 10 monclient(hunting): picked mon.noname-b con 0x7ffb08152770 addr v1:10.20.193.188:6789/0 2026-02-13T20:15:28.619 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.613+0000 7ffb0f50c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb0808a8d0 con 0x7ffb08091950 2026-02-13T20:15:28.619 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.613+0000 7ffb0f50c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb0808c470 con 0x7ffb08152770 2026-02-13T20:15:28.619 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffb0f50c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb0805d320 con 0x7ffb081401c0 2026-02-13T20:15:28.619 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffb0f50c640 10 monclient(hunting): _renew_subs 2026-02-13T20:15:28.619 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffb0f50c640 10 monclient(hunting): authenticate will time out at 890.305016s 2026-02-13T20:15:28.619 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffb0ca80640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7ffb081401c0 0x7ffb08193ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:42858/0 (socket says 10.20.193.110:42858) 2026-02-13T20:15:28.619 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffb0d281640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7ffb08091950 0x7ffb0813e4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:59412/0 (socket says 10.20.193.110:59412) 2026-02-13T20:15:28.619 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffb0ca80640 1 -- 10.20.193.110:0/504259907 learned_addr learned my addr 10.20.193.110:0/504259907 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:15:28.619 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffaf5ffb640 1 -- 10.20.193.110:0/504259907 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 881800200 0 0) 0x7ffb0808a8d0 con 0x7ffb08091950 2026-02-13T20:15:28.619 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffaf5ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:15:28.619 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffaf5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:28.619 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffaf5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:28.619 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffaf5ffb640 10 monclient(hunting): my global_id is 84216 2026-02-13T20:15:28.619 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffaf5ffb640 1 -- 10.20.193.110:0/504259907 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffad80035e0 con 0x7ffb08091950 2026-02-13T20:15:28.619 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffaf5ffb640 1 -- 10.20.193.110:0/504259907 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 696093381 0 0) 0x7ffb0808c470 con 0x7ffb08152770 2026-02-13T20:15:28.619 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffaf5ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:15:28.619 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffaf5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:28.619 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffaf5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:28.619 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffaf5ffb640 10 monclient(hunting): my global_id is 4549 2026-02-13T20:15:28.619 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffaf5ffb640 1 -- 10.20.193.110:0/504259907 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb0808a8d0 con 0x7ffb08152770 2026-02-13T20:15:28.619 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffaf5ffb640 1 -- 10.20.193.110:0/504259907 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2063919623 0 0) 0x7ffb0805d320 con 0x7ffb081401c0 2026-02-13T20:15:28.619 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffaf5ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:15:28.619 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffaf5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:28.619 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffaf5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:28.619 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffaf5ffb640 10 monclient(hunting): my global_id is 94100 2026-02-13T20:15:28.619 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffaf5ffb640 1 -- 10.20.193.110:0/504259907 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb0808c470 con 0x7ffb081401c0 2026-02-13T20:15:28.619 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffaf5ffb640 1 -- 10.20.193.110:0/504259907 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1923915788 0 0) 0x7ffad80035e0 con 0x7ffb08091950 2026-02-13T20:15:28.620 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffaf5ffb640 1 -- 10.20.193.110:0/504259907 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffb0805d320 con 0x7ffb08091950 2026-02-13T20:15:28.620 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffaf5ffb640 1 -- 10.20.193.110:0/504259907 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ffaf8002ce0 con 0x7ffb08091950 2026-02-13T20:15:28.620 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffaf5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:15:28.620 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffaf5ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:15:28.620 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffaf5ffb640 10 monclient(hunting): dump: 2026-02-13T20:15:28.620 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:28.620 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:28.620 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.620 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.620 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:28.620 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:28.620 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:28.620 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:28.620 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:28.620 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:28.620 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffaf5ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:15:28.620 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffaf5ffb640 1 -- 10.20.193.110:0/504259907 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 627786304 0 0) 0x7ffb0808a8d0 con 0x7ffb08152770 2026-02-13T20:15:28.620 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffaf5ffb640 1 -- 10.20.193.110:0/504259907 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffad80035e0 con 0x7ffb08152770 2026-02-13T20:15:28.620 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffaf5ffb640 1 -- 10.20.193.110:0/504259907 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ffb04004050 con 0x7ffb08152770 2026-02-13T20:15:28.620 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffaf5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:15:28.620 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffaf5ffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-13T20:15:28.620 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffaf5ffb640 10 monclient(hunting): dump: 2026-02-13T20:15:28.620 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:28.620 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:28.620 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.620 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.620 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:28.620 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:28.620 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:28.620 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:28.620 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:28.620 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:28.620 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffaf5ffb640 1 -- 10.20.193.110:0/504259907 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 621311221 0 0) 0x7ffb0805d320 con 0x7ffb08091950 2026-02-13T20:15:28.620 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffaf5ffb640 1 -- 10.20.193.110:0/504259907 >> v1:10.20.193.110:6790/0 conn(0x7ffb081401c0 legacy=0x7ffb08193ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:28.620 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffaf5ffb640 1 -- 10.20.193.110:0/504259907 >> v1:10.20.193.188:6789/0 conn(0x7ffb08152770 legacy=0x7ffb081951f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:28.620 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffaf5ffb640 10 monclient: _finish_hunting 0 2026-02-13T20:15:28.620 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffaf5ffb640 1 monclient: found mon.a 2026-02-13T20:15:28.620 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffaf5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:15:28.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffaf5ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:15:28.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffaf5ffb640 1 -- 10.20.193.110:0/504259907 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb08130970 con 0x7ffb08091950 2026-02-13T20:15:28.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffaf5ffb640 10 monclient: _finish_auth 0 2026-02-13T20:15:28.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffaf5ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:15:28.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffaf5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:15:28.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffb0f50c640 5 monclient: authenticate success, global_id 84216 2026-02-13T20:15:28.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffb0f50c640 10 monclient: _renew_subs 2026-02-13T20:15:28.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffb0f50c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:15:28.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.614+0000 7ffb0f50c640 1 -- 10.20.193.110:0/504259907 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ffb08131ec0 con 0x7ffb08091950 2026-02-13T20:15:28.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.615+0000 7ffb0f50c640 10 monclient: _renew_subs 2026-02-13T20:15:28.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.615+0000 7ffb0f50c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:15:28.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.615+0000 7ffb0f50c640 1 -- 10.20.193.110:0/504259907 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ffb0813ebb0 con 0x7ffb08091950 2026-02-13T20:15:28.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.615+0000 7ffaf5ffb640 1 -- 10.20.193.110:0/504259907 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ffaf8004b50 con 0x7ffb08091950 2026-02-13T20:15:28.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.615+0000 7ffaf5ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T20:15:28.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.615+0000 7ffaf5ffb640 1 -- 10.20.193.110:0/504259907 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ffaf8002e40 con 0x7ffb08091950 2026-02-13T20:15:28.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.615+0000 7ffaf5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:28.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.615+0000 7ffaf5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:15:28.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.615+0000 7ffaf5ffb640 10 monclient: dump: 2026-02-13T20:15:28.621 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:28.621 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:28.621 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.621 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.621 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:28.621 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:28.621 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:28.621 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:28.621 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:28.621 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:28.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.615+0000 7ffaf77fe640 4 set_mon_vals no callback set 2026-02-13T20:15:28.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.615+0000 7ffb0f50c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:15:28.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.615+0000 7ffb0f50c640 1 -- 10.20.193.110:0/504259907 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ffb08131a90 con 0x7ffb08092020 2026-02-13T20:15:28.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.615+0000 7ffaf5ffb640 1 -- 10.20.193.110:0/504259907 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7ffaf8011980 con 0x7ffb08091950 2026-02-13T20:15:28.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.615+0000 7ffaf5ffb640 1 -- 10.20.193.110:0/504259907 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(206..206 src has 1..206) ==== 3927+0+0 (unknown 3090514301 0 0) 0x7ffaf804e8d0 con 0x7ffb08091950 2026-02-13T20:15:28.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.615+0000 7ffaf5ffb640 1 -- 10.20.193.110:0/504259907 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 361144399 0 0) 0x7ffb08131a90 con 0x7ffb08092020 2026-02-13T20:15:28.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.615+0000 7ffaf5ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:15:28.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.615+0000 7ffaf5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:28.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.615+0000 7ffaf5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:28.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.615+0000 7ffaf5ffb640 10 monclient(hunting): my global_id is 84219 2026-02-13T20:15:28.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.615+0000 7ffaf5ffb640 1 -- 10.20.193.110:0/504259907 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb0805d320 con 0x7ffb08092020 2026-02-13T20:15:28.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.616+0000 7ffb0da82640 10 monclient: get_auth_request con 0x7ffad803fb30 auth_method 0 2026-02-13T20:15:28.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.616+0000 7ffaf5ffb640 1 -- 10.20.193.110:0/504259907 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3173081401 0 0) 0x7ffb0805d320 con 0x7ffb08092020 2026-02-13T20:15:28.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.616+0000 7ffaf5ffb640 1 -- 10.20.193.110:0/504259907 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffb08131a90 con 0x7ffb08092020 2026-02-13T20:15:28.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.616+0000 7ffaf5ffb640 1 -- 10.20.193.110:0/504259907 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ffafc0037a0 con 0x7ffb08092020 2026-02-13T20:15:28.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.616+0000 7ffaf5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:28.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.616+0000 7ffaf5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:15:28.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.616+0000 7ffaf5ffb640 10 monclient: dump: 2026-02-13T20:15:28.622 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:28.622 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:28.622 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.622 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.622 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:28.622 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:28.622 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:28.622 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:28.622 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:28.622 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:28.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.616+0000 7ffaf5ffb640 1 -- 10.20.193.110:0/504259907 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2431387456 0 0) 0x7ffb08131a90 con 0x7ffb08092020 2026-02-13T20:15:28.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.616+0000 7ffaf5ffb640 1 -- 10.20.193.110:0/504259907 --> v1:10.20.193.110:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffb0808b450 con 0x7ffb08092020 2026-02-13T20:15:28.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.616+0000 7ffaf5ffb640 1 -- 10.20.193.110:0/504259907 <== mon.0 v1:10.20.193.110:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7ffafc005880 con 0x7ffb08092020 2026-02-13T20:15:28.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.616+0000 7ffaf5ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:15:28.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.616+0000 7ffaf5ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:15:28.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.616+0000 7ffaf5ffb640 1 -- 10.20.193.110:0/504259907 >> v1:10.20.193.110:6789/0 conn(0x7ffb08092020 legacy=0x7ffb08127b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:28.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.616+0000 7ffaf5ffb640 1 -- 10.20.193.110:0/504259907 >> v1:10.20.193.110:6789/0 conn(0x7ffb08092020 legacy=0x7ffb08127b20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:15:28.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.619+0000 7ffb0f50c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:15:28.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.619+0000 7ffb0f50c640 1 -- 10.20.193.110:0/504259907 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ffb08055bb0 con 0x7ffb08128230 2026-02-13T20:15:28.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.620+0000 7ffaf5ffb640 1 -- 10.20.193.110:0/504259907 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 560255963 0 0) 0x7ffb08055bb0 con 0x7ffb08128230 2026-02-13T20:15:28.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.620+0000 7ffaf5ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:15:28.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.620+0000 7ffaf5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:28.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.620+0000 7ffaf5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:28.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.620+0000 7ffaf5ffb640 10 monclient(hunting): my global_id is 84222 2026-02-13T20:15:28.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.620+0000 7ffaf5ffb640 1 -- 10.20.193.110:0/504259907 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb08131a90 con 0x7ffb08128230 2026-02-13T20:15:28.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.620+0000 7ffaf5ffb640 1 -- 10.20.193.110:0/504259907 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2324649167 0 0) 0x7ffb08131a90 con 0x7ffb08128230 2026-02-13T20:15:28.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.620+0000 7ffaf5ffb640 1 -- 10.20.193.110:0/504259907 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffb08055bb0 con 0x7ffb08128230 2026-02-13T20:15:28.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.620+0000 7ffaf5ffb640 1 -- 10.20.193.110:0/504259907 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ffafc0040a0 con 0x7ffb08128230 2026-02-13T20:15:28.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.620+0000 7ffaf5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:28.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.620+0000 7ffaf5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:15:28.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.620+0000 7ffaf5ffb640 10 monclient: dump: 2026-02-13T20:15:28.623 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:28.623 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:28.623 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.623 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.623 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:28.623 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:28.623 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:28.623 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:28.623 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:28.623 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:28.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.620+0000 7ffaf5ffb640 1 -- 10.20.193.110:0/504259907 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1233140381 0 0) 0x7ffb08055bb0 con 0x7ffb08128230 2026-02-13T20:15:28.624 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.620+0000 7ffaf5ffb640 1 -- 10.20.193.110:0/504259907 --> v1:10.20.193.110:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ffb08058410 con 0x7ffb08128230 2026-02-13T20:15:28.624 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.620+0000 7ffaf5ffb640 1 -- 10.20.193.110:0/504259907 <== mon.0 v1:10.20.193.110:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4514 (unknown 0 0 280518978) 0x7ffafc0044c0 con 0x7ffb08128230 2026-02-13T20:15:28.624 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.620+0000 7ffaf5ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:15:28.624 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.620+0000 7ffaf5ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:15:28.624 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.620+0000 7ffaf5ffb640 1 -- 10.20.193.110:0/504259907 >> v1:10.20.193.110:6789/0 conn(0x7ffb08128230 legacy=0x7ffb08197920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:28.624 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.620+0000 7ffaf5ffb640 1 -- 10.20.193.110:0/504259907 >> v1:10.20.193.110:6789/0 conn(0x7ffb08128230 legacy=0x7ffb08197920 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:15:28.624 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:15:28.624 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:15:28.624 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:15:28.624 INFO:teuthology.orchestra.run.trial110.stdout: "state": "peon", 2026-02-13T20:15:28.624 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 16, 2026-02-13T20:15:28.624 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 122711, 2026-02-13T20:15:28.624 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:15:28.624 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:15:28.624 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:15:28.624 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:15:28.624 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:15:28.624 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 0, 2026-02-13T20:15:28.624 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:15:28.624 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:15:28.624 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:15:28.624 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:15:28.624 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:15:28.624 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:15:28.624 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:15:28.624 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:15:28.624 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:15:28.624 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:15:28.624 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:15:28.624 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:15:28.624 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:15:28.624 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:15:28.625 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:15:28.625 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:15:28.625 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:15:28.625 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:15:28.625 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:15:28.625 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:15:28.625 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:15:28.625 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:15:28.625 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:15:28.625 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:15:28.625 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:15:28.625 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:15:28.625 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:15:28.625 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:15:28.625 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:15:28.625 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:15:28.625 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:15:28.625 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:15:28.625 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:15:28.625 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:28.625 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:15:28.625 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:15:28.625 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:15:28.625 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:15:28.625 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:15:28.625 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:15:28.625 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:15:28.625 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:15:28.625 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:15:28.625 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:15:28.625 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:15:28.625 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:15:28.625 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:15:28.625 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:15:28.625 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:15:28.625 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:15:28.625 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:15:28.625 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:15:28.625 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:15:28.626 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:15:28.626 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:15:28.626 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:15:28.626 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:15:28.626 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:15:28.626 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:15:28.626 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:15:28.626 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:15:28.626 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:15:28.626 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:15:28.626 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:15:28.626 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:15:28.626 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:15:28.626 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:28.626 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:15:28.626 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:28.626 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:15:28.626 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:15:28.626 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:15:28.626 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:15:28.626 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:28.626 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:15:28.626 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:15:28.626 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:15:28.626 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:28.626 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:15:28.626 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:28.626 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:15:28.626 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:15:28.626 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:15:28.626 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:15:28.626 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:15:28.626 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:15:28.626 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:28.626 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:28.626 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:15:28.626 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:15:28.626 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:15:28.627 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:15:28.627 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:28.627 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:15:28.627 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:15:28.627 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:15:28.627 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:28.627 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:15:28.627 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:28.627 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:15:28.627 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:15:28.627 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:15:28.627 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:15:28.627 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:15:28.627 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:15:28.627 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:28.627 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:28.627 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:15:28.627 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:15:28.627 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:15:28.627 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:15:28.627 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:28.627 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:15:28.627 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:15:28.627 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:15:28.627 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:28.627 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:15:28.627 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:28.627 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:15:28.627 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:15:28.627 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:15:28.627 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:15:28.627 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:15:28.627 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:15:28.627 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:28.627 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:15:28.627 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:28.627 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:15:28.627 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:15:28.627 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:28.627 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:15:28.628 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:15:28.628 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:15:28.628 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:28.628 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:15:28.628 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:15:28.628 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:28.628 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:15:28.628 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:15:28.628 INFO:teuthology.orchestra.run.trial110.stdout: "num": 2 2026-02-13T20:15:28.628 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:28.628 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:15:28.628 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:15:28.628 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:28.628 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:15:28.628 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:15:28.628 INFO:teuthology.orchestra.run.trial110.stdout: "num": 2 2026-02-13T20:15:28.628 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:28.628 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:15:28.628 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:28.628 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:15:28.628 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:15:28.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.621+0000 7ffb0f50c640 1 -- 10.20.193.110:0/504259907 >> v1:10.20.193.188:6812/1623052694 conn(0x7ffad803fb30 legacy=0x7ffad805ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:28.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.621+0000 7ffb0f50c640 10 monclient: shutdown 2026-02-13T20:15:28.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.621+0000 7ffb0f50c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:15:28.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.621+0000 7ffb0f50c640 1 -- 10.20.193.110:0/504259907 >> v1:10.20.193.110:6789/0 conn(0x7ffb08091950 legacy=0x7ffb0813e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:28.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.621+0000 7ffb0da82640 1 -- 10.20.193.110:0/504259907 reap_dead start 2026-02-13T20:15:28.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.621+0000 7ffb0da82640 1 -- 10.20.193.110:0/504259907 reap_dead start 2026-02-13T20:15:28.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.621+0000 7ffb0f50c640 1 -- 10.20.193.110:0/504259907 shutdown_connections 2026-02-13T20:15:28.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.621+0000 7ffb0f50c640 1 -- 10.20.193.110:0/504259907 >> 10.20.193.110:0/504259907 conn(0x7ffb08054e90 msgr2=0x7ffb0808de30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:15:28.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.621+0000 7ffb0f50c640 1 -- 10.20.193.110:0/504259907 shutdown_connections 2026-02-13T20:15:28.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.621+0000 7ffb0f50c640 1 -- 10.20.193.110:0/504259907 wait complete. 2026-02-13T20:15:28.629 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:15:28.629 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-13T20:15:28.629 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T20:15:28.697 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.695+0000 7fc930007640 10 monclient: get_monmap_and_config 2026-02-13T20:15:28.697 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.695+0000 7fc930007640 10 monclient: build_initial_monmap 2026-02-13T20:15:28.697 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.695+0000 7fc930007640 10 monclient: monmap: 2026-02-13T20:15:28.697 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:15:28.697 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:28.697 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:15:28.696884+0000 2026-02-13T20:15:28.697 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:15:28.696884+0000 2026-02-13T20:15:28.697 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:15:28.697 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:28.697 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:15:28.697 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:15:28.697 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:15:28.697 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:28.699 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.695+0000 7fc930007640 1 Processor -- start 2026-02-13T20:15:28.699 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.695+0000 7fc930007640 1 -- start start 2026-02-13T20:15:28.699 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.695+0000 7fc930007640 10 monclient: init 2026-02-13T20:15:28.699 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.696+0000 7fc930007640 10 monclient: _reopen_session rank -1 2026-02-13T20:15:28.699 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.696+0000 7fc930007640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:15:28.699 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.696+0000 7fc930007640 10 monclient(hunting): picked mon.noname-c con 0x7fc9281401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:15:28.699 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.696+0000 7fc930007640 10 monclient(hunting): picked mon.noname-b con 0x7fc928092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:15:28.699 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.696+0000 7fc930007640 10 monclient(hunting): picked mon.noname-a con 0x7fc928091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:15:28.699 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.696+0000 7fc930007640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc92808b730 con 0x7fc928091950 2026-02-13T20:15:28.699 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.696+0000 7fc930007640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc92805c5b0 con 0x7fc9281401c0 2026-02-13T20:15:28.699 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.696+0000 7fc930007640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc92808bcf0 con 0x7fc928092020 2026-02-13T20:15:28.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.696+0000 7fc930007640 10 monclient(hunting): _renew_subs 2026-02-13T20:15:28.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.696+0000 7fc930007640 10 monclient(hunting): authenticate will time out at 890.387273s 2026-02-13T20:15:28.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.696+0000 7fc92e57d640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fc928091950 0x7fc9281a2a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:59422/0 (socket says 10.20.193.110:59422) 2026-02-13T20:15:28.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.696+0000 7fc92e57d640 1 -- 10.20.193.110:0/397093319 learned_addr learned my addr 10.20.193.110:0/397093319 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:15:28.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.696+0000 7fc92cd7a640 1 -- 10.20.193.110:0/397093319 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2280285845 0 0) 0x7fc92808b730 con 0x7fc928091950 2026-02-13T20:15:28.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.696+0000 7fc92cd7a640 10 monclient(hunting): _negotiate 2026-02-13T20:15:28.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.696+0000 7fc92cd7a640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:28.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.696+0000 7fc92cd7a640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:28.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.696+0000 7fc92cd7a640 10 monclient(hunting): my global_id is 84225 2026-02-13T20:15:28.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.696+0000 7fc92cd7a640 1 -- 10.20.193.110:0/397093319 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9100035e0 con 0x7fc928091950 2026-02-13T20:15:28.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.696+0000 7fc92cd7a640 1 -- 10.20.193.110:0/397093319 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 908728063 0 0) 0x7fc92808bcf0 con 0x7fc928092020 2026-02-13T20:15:28.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.696+0000 7fc92cd7a640 10 monclient(hunting): _negotiate 2026-02-13T20:15:28.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.696+0000 7fc92cd7a640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:28.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.696+0000 7fc92cd7a640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:28.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.696+0000 7fc92cd7a640 10 monclient(hunting): my global_id is 94103 2026-02-13T20:15:28.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.696+0000 7fc92cd7a640 1 -- 10.20.193.110:0/397093319 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc92808b730 con 0x7fc928092020 2026-02-13T20:15:28.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.696+0000 7fc92cd7a640 1 -- 10.20.193.110:0/397093319 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1611766751 0 0) 0x7fc9100035e0 con 0x7fc928091950 2026-02-13T20:15:28.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.696+0000 7fc92cd7a640 1 -- 10.20.193.110:0/397093319 >> v1:10.20.193.110:6790/0 conn(0x7fc928092020 legacy=0x7fc9281812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:28.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.696+0000 7fc92cd7a640 1 -- 10.20.193.110:0/397093319 >> v1:10.20.193.188:6789/0 conn(0x7fc9281401c0 legacy=0x7fc928091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:28.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.696+0000 7fc92cd7a640 10 monclient: _finish_hunting 0 2026-02-13T20:15:28.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.696+0000 7fc92cd7a640 1 monclient: found mon.noname-a 2026-02-13T20:15:28.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.696+0000 7fc92cd7a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:15:28.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.696+0000 7fc92cd7a640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:15:28.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.696+0000 7fc92cd7a640 1 -- 10.20.193.110:0/397093319 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc928140590 con 0x7fc928091950 2026-02-13T20:15:28.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.696+0000 7fc92cd7a640 10 monclient: _finish_auth 0 2026-02-13T20:15:28.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.696+0000 7fc92cd7a640 10 monclient: _check_auth_tickets 2026-02-13T20:15:28.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.696+0000 7fc92cd7a640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:15:28.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.696+0000 7fc92cd7a640 1 -- 10.20.193.110:0/397093319 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc924003eb0 con 0x7fc928091950 2026-02-13T20:15:28.701 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.696+0000 7fc930007640 5 monclient: authenticate success, global_id 84225 2026-02-13T20:15:28.701 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.696+0000 7fc930007640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:15:28.701 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.696+0000 7fc92cd7a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:28.701 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.696+0000 7fc92cd7a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:15:28.701 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.696+0000 7fc92cd7a640 10 monclient: dump: 2026-02-13T20:15:28.701 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:28.701 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:28.701 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.701 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.701 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:28.701 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:28.701 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:28.701 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:28.701 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:28.701 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:28.701 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.696+0000 7fc930007640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:15:28.701 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.696+0000 7fc92cd7a640 1 -- 10.20.193.110:0/397093319 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc924004080 con 0x7fc928091950 2026-02-13T20:15:28.701 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.696+0000 7fc92cd7a640 10 monclient: handle_config config(0 keys) 2026-02-13T20:15:28.701 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.696+0000 7fc92cd7a640 1 -- 10.20.193.110:0/397093319 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc924004490 con 0x7fc928091950 2026-02-13T20:15:28.701 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.696+0000 7fc92cd7a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:28.701 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.696+0000 7fc92cd7a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:15:28.701 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.696+0000 7fc92cd7a640 10 monclient: dump: 2026-02-13T20:15:28.701 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:28.701 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:28.701 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.701 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.701 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:28.701 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:28.701 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:28.702 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:28.702 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:28.702 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:28.702 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.696+0000 7fc930007640 10 monclient: get_monmap_and_config success 2026-02-13T20:15:28.702 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.696+0000 7fc930007640 4 set_mon_vals no callback set 2026-02-13T20:15:28.702 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.697+0000 7fc930007640 10 monclient: shutdown 2026-02-13T20:15:28.702 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.697+0000 7fc930007640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:15:28.702 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.697+0000 7fc930007640 1 -- 10.20.193.110:0/397093319 >> v1:10.20.193.110:6789/0 conn(0x7fc928091950 legacy=0x7fc9281a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:28.702 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.697+0000 7fc930007640 1 -- 10.20.193.110:0/397093319 shutdown_connections 2026-02-13T20:15:28.702 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.697+0000 7fc930007640 1 -- 10.20.193.110:0/397093319 >> 10.20.193.110:0/397093319 conn(0x7fc928054e90 msgr2=0x7fc928058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:15:28.702 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.697+0000 7fc930007640 1 -- 10.20.193.110:0/397093319 shutdown_connections 2026-02-13T20:15:28.702 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.697+0000 7fc930007640 1 -- 10.20.193.110:0/397093319 wait complete. 2026-02-13T20:15:28.702 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.697+0000 7fc930007640 10 monclient: build_initial_monmap 2026-02-13T20:15:28.702 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.697+0000 7fc930007640 10 monclient: monmap: 2026-02-13T20:15:28.702 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:15:28.702 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:15:28.702 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:15:28.702 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:15:28.702 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:15:28.702 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:15:28.702 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:15:28.702 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:15:28.702 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:15:28.702 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:28.702 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.697+0000 7fc930007640 1 Processor -- start 2026-02-13T20:15:28.702 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc930007640 1 -- start start 2026-02-13T20:15:28.702 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc930007640 10 monclient: init 2026-02-13T20:15:28.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc930007640 10 monclient: _reopen_session rank -1 2026-02-13T20:15:28.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc930007640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:15:28.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc930007640 10 monclient(hunting): picked mon.noname-c con 0x7fc928091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:15:28.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc930007640 10 monclient(hunting): picked mon.noname-a con 0x7fc9281401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:15:28.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc930007640 10 monclient(hunting): picked mon.noname-b con 0x7fc928114190 addr v1:10.20.193.188:6789/0 2026-02-13T20:15:28.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc930007640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc92812c3c0 con 0x7fc9281401c0 2026-02-13T20:15:28.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc930007640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc92805d320 con 0x7fc928114190 2026-02-13T20:15:28.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc930007640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc92812b080 con 0x7fc928091950 2026-02-13T20:15:28.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc930007640 10 monclient(hunting): _renew_subs 2026-02-13T20:15:28.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc930007640 10 monclient(hunting): authenticate will time out at 890.389283s 2026-02-13T20:15:28.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc92d57b640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fc9281401c0 0x7fc9281a1040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:59426/0 (socket says 10.20.193.110:59426) 2026-02-13T20:15:28.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc92d57b640 1 -- 10.20.193.110:0/3646469414 learned_addr learned my addr 10.20.193.110:0/3646469414 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:15:28.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc9167fc640 1 -- 10.20.193.110:0/3646469414 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2298186205 0 0) 0x7fc92812c3c0 con 0x7fc9281401c0 2026-02-13T20:15:28.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc9167fc640 10 monclient(hunting): _negotiate 2026-02-13T20:15:28.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc9167fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:28.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc9167fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:28.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc9167fc640 10 monclient(hunting): my global_id is 84228 2026-02-13T20:15:28.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc9167fc640 1 -- 10.20.193.110:0/3646469414 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8f80035e0 con 0x7fc9281401c0 2026-02-13T20:15:28.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc9167fc640 1 -- 10.20.193.110:0/3646469414 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3402598353 0 0) 0x7fc92812b080 con 0x7fc928091950 2026-02-13T20:15:28.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc9167fc640 10 monclient(hunting): _negotiate 2026-02-13T20:15:28.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc9167fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:28.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc9167fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:28.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc9167fc640 10 monclient(hunting): my global_id is 94106 2026-02-13T20:15:28.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc9167fc640 1 -- 10.20.193.110:0/3646469414 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc92812c3c0 con 0x7fc928091950 2026-02-13T20:15:28.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc9167fc640 1 -- 10.20.193.110:0/3646469414 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3944775368 0 0) 0x7fc8f80035e0 con 0x7fc9281401c0 2026-02-13T20:15:28.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc9167fc640 1 -- 10.20.193.110:0/3646469414 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc92812b080 con 0x7fc9281401c0 2026-02-13T20:15:28.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc9167fc640 1 -- 10.20.193.110:0/3646469414 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc91c003150 con 0x7fc9281401c0 2026-02-13T20:15:28.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc9167fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:15:28.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc9167fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:15:28.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc9167fc640 10 monclient(hunting): dump: 2026-02-13T20:15:28.705 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:28.705 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:28.706 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.706 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.706 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:28.706 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:28.706 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:28.706 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:28.706 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:28.706 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:28.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc9167fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:15:28.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc9167fc640 1 -- 10.20.193.110:0/3646469414 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 447484293 0 0) 0x7fc92812c3c0 con 0x7fc928091950 2026-02-13T20:15:28.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc9167fc640 1 -- 10.20.193.110:0/3646469414 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc8f80035e0 con 0x7fc928091950 2026-02-13T20:15:28.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc9167fc640 1 -- 10.20.193.110:0/3646469414 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc918003070 con 0x7fc928091950 2026-02-13T20:15:28.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc9167fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:15:28.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc9167fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:15:28.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc9167fc640 10 monclient(hunting): dump: 2026-02-13T20:15:28.706 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:28.706 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:28.706 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.706 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.706 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:28.706 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:28.706 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:28.706 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:28.706 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:28.706 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:28.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc9167fc640 1 -- 10.20.193.110:0/3646469414 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3499654279 0 0) 0x7fc92812b080 con 0x7fc9281401c0 2026-02-13T20:15:28.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc9167fc640 1 -- 10.20.193.110:0/3646469414 >> v1:10.20.193.110:6790/0 conn(0x7fc928091950 legacy=0x7fc9281245c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:28.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc9167fc640 1 -- 10.20.193.110:0/3646469414 >> v1:10.20.193.188:6789/0 conn(0x7fc928114190 legacy=0x7fc9281a2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:28.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc9167fc640 10 monclient: _finish_hunting 0 2026-02-13T20:15:28.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc9167fc640 1 monclient: found mon.a 2026-02-13T20:15:28.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc9167fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:15:28.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc9167fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:15:28.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc9167fc640 1 -- 10.20.193.110:0/3646469414 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc92812d3e0 con 0x7fc9281401c0 2026-02-13T20:15:28.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc9167fc640 10 monclient: _finish_auth 0 2026-02-13T20:15:28.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc9167fc640 10 monclient: _check_auth_tickets 2026-02-13T20:15:28.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc9167fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:15:28.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc930007640 5 monclient: authenticate success, global_id 84228 2026-02-13T20:15:28.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc930007640 10 monclient: _renew_subs 2026-02-13T20:15:28.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc930007640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:15:28.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc930007640 1 -- 10.20.193.110:0/3646469414 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc92812cb40 con 0x7fc9281401c0 2026-02-13T20:15:28.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc930007640 10 monclient: _renew_subs 2026-02-13T20:15:28.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc930007640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:15:28.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc930007640 1 -- 10.20.193.110:0/3646469414 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc92812bbe0 con 0x7fc9281401c0 2026-02-13T20:15:28.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc9167fc640 1 -- 10.20.193.110:0/3646469414 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc91c0034c0 con 0x7fc9281401c0 2026-02-13T20:15:28.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc9167fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:15:28.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc9167fc640 1 -- 10.20.193.110:0/3646469414 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc91c003b30 con 0x7fc9281401c0 2026-02-13T20:15:28.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc9167fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:28.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc9167fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:15:28.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc917fff640 4 set_mon_vals no callback set 2026-02-13T20:15:28.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.698+0000 7fc9167fc640 10 monclient: dump: 2026-02-13T20:15:28.707 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:28.707 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:28.707 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.707 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.707 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:28.707 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:28.707 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:28.707 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:28.707 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:28.707 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:28.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.699+0000 7fc930007640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:15:28.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.699+0000 7fc930007640 1 -- 10.20.193.110:0/3646469414 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc92812d1e0 con 0x7fc928092020 2026-02-13T20:15:28.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.699+0000 7fc9167fc640 1 -- 10.20.193.110:0/3646469414 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fc91c003c90 con 0x7fc9281401c0 2026-02-13T20:15:28.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.699+0000 7fc9167fc640 1 -- 10.20.193.110:0/3646469414 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(206..206 src has 1..206) ==== 3927+0+0 (unknown 3090514301 0 0) 0x7fc91c04e960 con 0x7fc9281401c0 2026-02-13T20:15:28.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.699+0000 7fc9167fc640 1 -- 10.20.193.110:0/3646469414 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1611528469 0 0) 0x7fc92812d1e0 con 0x7fc928092020 2026-02-13T20:15:28.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.699+0000 7fc9167fc640 10 monclient(hunting): _negotiate 2026-02-13T20:15:28.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.699+0000 7fc9167fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:28.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.699+0000 7fc9167fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:28.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.699+0000 7fc9167fc640 10 monclient(hunting): my global_id is 94109 2026-02-13T20:15:28.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.699+0000 7fc9167fc640 1 -- 10.20.193.110:0/3646469414 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc92812b080 con 0x7fc928092020 2026-02-13T20:15:28.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.699+0000 7fc92e57d640 10 monclient: get_auth_request con 0x7fc8f803fa50 auth_method 0 2026-02-13T20:15:28.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.699+0000 7fc9167fc640 1 -- 10.20.193.110:0/3646469414 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 746849897 0 0) 0x7fc92812b080 con 0x7fc928092020 2026-02-13T20:15:28.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.699+0000 7fc9167fc640 1 -- 10.20.193.110:0/3646469414 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc92812d1e0 con 0x7fc928092020 2026-02-13T20:15:28.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.699+0000 7fc9167fc640 1 -- 10.20.193.110:0/3646469414 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc9180036d0 con 0x7fc928092020 2026-02-13T20:15:28.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.699+0000 7fc9167fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:28.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.699+0000 7fc9167fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:15:28.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.699+0000 7fc9167fc640 10 monclient: dump: 2026-02-13T20:15:28.707 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:28.707 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:28.707 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.707 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.707 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:28.707 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:28.707 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:28.707 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:28.707 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:28.707 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:28.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.699+0000 7fc9167fc640 1 -- 10.20.193.110:0/3646469414 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2457676325 0 0) 0x7fc92812d1e0 con 0x7fc928092020 2026-02-13T20:15:28.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.699+0000 7fc9167fc640 1 -- 10.20.193.110:0/3646469414 --> v1:10.20.193.110:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc92808b450 con 0x7fc928092020 2026-02-13T20:15:28.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.700+0000 7fc9167fc640 1 -- 10.20.193.110:0/3646469414 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fc918004700 con 0x7fc928092020 2026-02-13T20:15:28.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.700+0000 7fc9167fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:15:28.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.700+0000 7fc9167fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:15:28.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.700+0000 7fc9167fc640 1 -- 10.20.193.110:0/3646469414 >> v1:10.20.193.110:6790/0 conn(0x7fc928092020 legacy=0x7fc928124ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:28.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.700+0000 7fc9167fc640 1 -- 10.20.193.110:0/3646469414 >> v1:10.20.193.110:6790/0 conn(0x7fc928092020 legacy=0x7fc928124ef0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:15:28.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.703+0000 7fc930007640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:15:28.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.703+0000 7fc930007640 1 -- 10.20.193.110:0/3646469414 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc928114590 con 0x7fc9281a4020 2026-02-13T20:15:28.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.703+0000 7fc9167fc640 1 -- 10.20.193.110:0/3646469414 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 151378467 0 0) 0x7fc8f80035e0 con 0x7fc9281a4020 2026-02-13T20:15:28.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.703+0000 7fc9167fc640 10 monclient(hunting): _negotiate 2026-02-13T20:15:28.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.703+0000 7fc9167fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:28.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.703+0000 7fc9167fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:28.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.703+0000 7fc9167fc640 10 monclient(hunting): my global_id is 94112 2026-02-13T20:15:28.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.703+0000 7fc9167fc640 1 -- 10.20.193.110:0/3646469414 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc92812d1e0 con 0x7fc9281a4020 2026-02-13T20:15:28.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.703+0000 7fc9167fc640 1 -- 10.20.193.110:0/3646469414 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1706591321 0 0) 0x7fc92812d1e0 con 0x7fc9281a4020 2026-02-13T20:15:28.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.703+0000 7fc9167fc640 1 -- 10.20.193.110:0/3646469414 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc8f80035e0 con 0x7fc9281a4020 2026-02-13T20:15:28.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.703+0000 7fc9167fc640 1 -- 10.20.193.110:0/3646469414 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc918003fe0 con 0x7fc9281a4020 2026-02-13T20:15:28.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.703+0000 7fc9167fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:28.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.703+0000 7fc9167fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:15:28.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.703+0000 7fc9167fc640 10 monclient: dump: 2026-02-13T20:15:28.708 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:28.708 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:28.709 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.709 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.709 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:28.709 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:28.709 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:28.709 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:28.709 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:28.709 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:28.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.703+0000 7fc9167fc640 1 -- 10.20.193.110:0/3646469414 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 138310041 0 0) 0x7fc8f80035e0 con 0x7fc9281a4020 2026-02-13T20:15:28.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.703+0000 7fc9167fc640 1 -- 10.20.193.110:0/3646469414 --> v1:10.20.193.110:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc92812ce80 con 0x7fc9281a4020 2026-02-13T20:15:28.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.704+0000 7fc9167fc640 1 -- 10.20.193.110:0/3646469414 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4344 (unknown 0 0 2289401311) 0x7fc918004360 con 0x7fc9281a4020 2026-02-13T20:15:28.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.704+0000 7fc9167fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:15:28.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.704+0000 7fc9167fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:15:28.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.704+0000 7fc9167fc640 1 -- 10.20.193.110:0/3646469414 >> v1:10.20.193.110:6790/0 conn(0x7fc9281a4020 legacy=0x7fc928125600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:28.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.704+0000 7fc9167fc640 1 -- 10.20.193.110:0/3646469414 >> v1:10.20.193.110:6790/0 conn(0x7fc9281a4020 legacy=0x7fc928125600 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:15:28.709 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:15:28.709 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:15:28.709 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:15:28.709 INFO:teuthology.orchestra.run.trial110.stdout: "state": "peon", 2026-02-13T20:15:28.709 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 16, 2026-02-13T20:15:28.709 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 327, 2026-02-13T20:15:28.709 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:15:28.709 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:15:28.709 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:15:28.709 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:15:28.709 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:15:28.709 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 0, 2026-02-13T20:15:28.709 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:15:28.709 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:15:28.709 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:15:28.709 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:15:28.709 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:15:28.709 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:15:28.709 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:15:28.709 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:15:28.709 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:15:28.709 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:15:28.710 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:15:28.710 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:15:28.710 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:15:28.710 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:15:28.710 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:15:28.710 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:15:28.710 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:15:28.710 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:15:28.710 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:15:28.710 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:15:28.710 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:15:28.710 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:15:28.710 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:15:28.710 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:15:28.710 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:15:28.710 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:15:28.710 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:15:28.710 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:15:28.710 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:15:28.710 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:15:28.710 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:15:28.710 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:15:28.710 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:15:28.710 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:28.710 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:15:28.710 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:15:28.710 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:15:28.710 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:15:28.710 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:15:28.710 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:15:28.710 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:15:28.710 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:15:28.710 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:15:28.710 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:15:28.710 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:15:28.710 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:15:28.710 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:15:28.710 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:15:28.710 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:15:28.710 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:15:28.710 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:15:28.710 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:15:28.710 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:15:28.710 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:15:28.711 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:15:28.711 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:15:28.711 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:15:28.711 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:15:28.711 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:15:28.711 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:15:28.711 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:15:28.711 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:15:28.711 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:15:28.711 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:15:28.711 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:15:28.711 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:15:28.711 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:28.711 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:15:28.711 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:28.711 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:15:28.711 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:15:28.711 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:15:28.711 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:15:28.711 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:28.711 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:15:28.711 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:15:28.711 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:15:28.711 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:28.711 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:15:28.711 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:28.711 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:15:28.711 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:15:28.711 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:15:28.711 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:15:28.711 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:15:28.711 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:15:28.711 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:28.711 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:28.711 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:15:28.711 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:15:28.711 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:15:28.711 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:15:28.711 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:28.711 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:15:28.711 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:15:28.711 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:15:28.711 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:28.711 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:15:28.711 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:28.711 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:15:28.712 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:15:28.712 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:15:28.712 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:15:28.712 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:15:28.712 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:15:28.712 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:28.712 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:28.712 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:15:28.712 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:15:28.712 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:15:28.712 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:15:28.712 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:28.712 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:15:28.712 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:15:28.712 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:15:28.712 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:28.712 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:15:28.712 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:28.712 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:15:28.712 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:15:28.712 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:15:28.712 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:15:28.712 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:15:28.712 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:15:28.712 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:28.712 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:15:28.712 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:28.712 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:15:28.712 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:15:28.712 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:28.712 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:15:28.712 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:15:28.712 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:15:28.712 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:28.712 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:15:28.712 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:15:28.712 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:28.712 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:15:28.712 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:15:28.712 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:15:28.712 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:28.712 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:15:28.712 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:28.712 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:15:28.712 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:15:28.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.704+0000 7fc930007640 1 -- 10.20.193.110:0/3646469414 >> v1:10.20.193.188:6812/1623052694 conn(0x7fc8f803fa50 legacy=0x7fc8f805ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:28.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.704+0000 7fc930007640 10 monclient: shutdown 2026-02-13T20:15:28.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.704+0000 7fc930007640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:15:28.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.704+0000 7fc930007640 1 -- 10.20.193.110:0/3646469414 >> v1:10.20.193.110:6789/0 conn(0x7fc9281401c0 legacy=0x7fc9281a1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:28.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.704+0000 7fc92e57d640 1 -- 10.20.193.110:0/3646469414 reap_dead start 2026-02-13T20:15:28.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.704+0000 7fc92e57d640 1 -- 10.20.193.110:0/3646469414 reap_dead start 2026-02-13T20:15:28.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.704+0000 7fc930007640 1 -- 10.20.193.110:0/3646469414 shutdown_connections 2026-02-13T20:15:28.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.704+0000 7fc930007640 1 -- 10.20.193.110:0/3646469414 >> 10.20.193.110:0/3646469414 conn(0x7fc928054e90 msgr2=0x7fc92808dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:15:28.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.704+0000 7fc930007640 1 -- 10.20.193.110:0/3646469414 shutdown_connections 2026-02-13T20:15:28.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.704+0000 7fc930007640 1 -- 10.20.193.110:0/3646469414 wait complete. 2026-02-13T20:15:28.713 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:15:28.713 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-13T20:15:28.713 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T20:15:28.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.776+0000 7fb338212640 10 monclient: get_monmap_and_config 2026-02-13T20:15:28.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.776+0000 7fb338212640 10 monclient: build_initial_monmap 2026-02-13T20:15:28.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.776+0000 7fb338212640 10 monclient: monmap: 2026-02-13T20:15:28.778 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:15:28.778 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:28.778 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:15:28.777579+0000 2026-02-13T20:15:28.778 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:15:28.777579+0000 2026-02-13T20:15:28.778 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:15:28.778 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:28.778 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:15:28.778 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:15:28.778 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:15:28.778 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:28.783 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.776+0000 7fb338212640 1 Processor -- start 2026-02-13T20:15:28.783 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.776+0000 7fb338212640 1 -- start start 2026-02-13T20:15:28.783 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.776+0000 7fb338212640 10 monclient: init 2026-02-13T20:15:28.783 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.776+0000 7fb338212640 10 monclient: _reopen_session rank -1 2026-02-13T20:15:28.783 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.776+0000 7fb338212640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:15:28.783 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.776+0000 7fb338212640 10 monclient(hunting): picked mon.noname-c con 0x7fb3301401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:15:28.783 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.776+0000 7fb338212640 10 monclient(hunting): picked mon.noname-a con 0x7fb330092020 addr v1:10.20.193.110:6789/0 2026-02-13T20:15:28.783 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.776+0000 7fb338212640 10 monclient(hunting): picked mon.noname-b con 0x7fb330091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:15:28.783 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.776+0000 7fb338212640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb33008b730 con 0x7fb330092020 2026-02-13T20:15:28.783 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.776+0000 7fb338212640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb33005c5b0 con 0x7fb3301401c0 2026-02-13T20:15:28.784 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.776+0000 7fb338212640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb33008bcf0 con 0x7fb330091950 2026-02-13T20:15:28.784 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.776+0000 7fb338212640 10 monclient(hunting): _renew_subs 2026-02-13T20:15:28.784 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.776+0000 7fb338212640 10 monclient(hunting): authenticate will time out at 890.467912s 2026-02-13T20:15:28.784 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb336788640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fb330091950 0x7fb3301a2a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:42902/0 (socket says 10.20.193.110:42902) 2026-02-13T20:15:28.784 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb336788640 1 -- 10.20.193.110:0/1486342064 learned_addr learned my addr 10.20.193.110:0/1486342064 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:15:28.784 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb334f85640 1 -- 10.20.193.110:0/1486342064 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3810649055 0 0) 0x7fb33008b730 con 0x7fb330092020 2026-02-13T20:15:28.784 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb334f85640 10 monclient(hunting): _negotiate 2026-02-13T20:15:28.784 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb334f85640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:28.784 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb334f85640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:28.784 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb334f85640 10 monclient(hunting): my global_id is 84231 2026-02-13T20:15:28.784 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb334f85640 1 -- 10.20.193.110:0/1486342064 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3180035e0 con 0x7fb330092020 2026-02-13T20:15:28.784 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb334f85640 1 -- 10.20.193.110:0/1486342064 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1758346148 0 0) 0x7fb33008bcf0 con 0x7fb330091950 2026-02-13T20:15:28.784 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb334f85640 10 monclient(hunting): _negotiate 2026-02-13T20:15:28.784 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb334f85640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:28.784 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb334f85640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:28.784 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb334f85640 10 monclient(hunting): my global_id is 94115 2026-02-13T20:15:28.784 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb334f85640 1 -- 10.20.193.110:0/1486342064 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb33008b730 con 0x7fb330091950 2026-02-13T20:15:28.784 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb334f85640 1 -- 10.20.193.110:0/1486342064 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 973733197 0 0) 0x7fb33005c5b0 con 0x7fb3301401c0 2026-02-13T20:15:28.784 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb334f85640 10 monclient(hunting): _negotiate 2026-02-13T20:15:28.784 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb334f85640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:28.784 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb334f85640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:28.785 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb334f85640 10 monclient(hunting): my global_id is 4558 2026-02-13T20:15:28.785 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb334f85640 1 -- 10.20.193.110:0/1486342064 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb33008bcf0 con 0x7fb3301401c0 2026-02-13T20:15:28.785 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb334f85640 1 -- 10.20.193.110:0/1486342064 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4057132925 0 0) 0x7fb3180035e0 con 0x7fb330092020 2026-02-13T20:15:28.785 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb334f85640 1 -- 10.20.193.110:0/1486342064 >> v1:10.20.193.110:6790/0 conn(0x7fb330091950 legacy=0x7fb3301a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:28.785 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb334f85640 1 -- 10.20.193.110:0/1486342064 >> v1:10.20.193.188:6789/0 conn(0x7fb3301401c0 legacy=0x7fb330091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:28.785 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb334f85640 10 monclient: _finish_hunting 0 2026-02-13T20:15:28.785 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb334f85640 1 monclient: found mon.noname-a 2026-02-13T20:15:28.785 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb334f85640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:15:28.785 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb334f85640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:15:28.785 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb334f85640 1 -- 10.20.193.110:0/1486342064 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb330140590 con 0x7fb330092020 2026-02-13T20:15:28.785 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb334f85640 10 monclient: _finish_auth 0 2026-02-13T20:15:28.785 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb334f85640 10 monclient: _check_auth_tickets 2026-02-13T20:15:28.785 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb334f85640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:15:28.785 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb338212640 5 monclient: authenticate success, global_id 84231 2026-02-13T20:15:28.785 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb338212640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:15:28.785 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb334f85640 1 -- 10.20.193.110:0/1486342064 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb324002dd0 con 0x7fb330092020 2026-02-13T20:15:28.785 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb334f85640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:28.785 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb334f85640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:15:28.785 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb334f85640 10 monclient: dump: 2026-02-13T20:15:28.785 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:28.785 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:28.785 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.785 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.786 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:28.786 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:28.786 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:28.786 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:28.786 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:28.786 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:28.786 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb338212640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:15:28.786 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb334f85640 1 -- 10.20.193.110:0/1486342064 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb324002f60 con 0x7fb330092020 2026-02-13T20:15:28.786 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb334f85640 10 monclient: handle_config config(0 keys) 2026-02-13T20:15:28.786 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb334f85640 1 -- 10.20.193.110:0/1486342064 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb324003370 con 0x7fb330092020 2026-02-13T20:15:28.786 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb338212640 10 monclient: get_monmap_and_config success 2026-02-13T20:15:28.786 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb338212640 4 set_mon_vals no callback set 2026-02-13T20:15:28.786 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb334f85640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:28.786 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb334f85640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:15:28.786 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb334f85640 10 monclient: dump: 2026-02-13T20:15:28.786 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:28.786 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:28.786 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.786 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.786 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:28.786 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:28.786 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:28.786 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:28.787 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:28.787 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:28.787 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb338212640 10 monclient: shutdown 2026-02-13T20:15:28.787 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb338212640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:15:28.787 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb338212640 1 -- 10.20.193.110:0/1486342064 >> v1:10.20.193.110:6789/0 conn(0x7fb330092020 legacy=0x7fb3301812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:28.787 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb338212640 1 -- 10.20.193.110:0/1486342064 shutdown_connections 2026-02-13T20:15:28.787 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb338212640 1 -- 10.20.193.110:0/1486342064 >> 10.20.193.110:0/1486342064 conn(0x7fb330054e90 msgr2=0x7fb330058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:15:28.787 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb338212640 1 -- 10.20.193.110:0/1486342064 shutdown_connections 2026-02-13T20:15:28.787 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.777+0000 7fb338212640 1 -- 10.20.193.110:0/1486342064 wait complete. 2026-02-13T20:15:28.787 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.778+0000 7fb338212640 10 monclient: build_initial_monmap 2026-02-13T20:15:28.787 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.778+0000 7fb338212640 10 monclient: monmap: 2026-02-13T20:15:28.787 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:15:28.787 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:15:28.787 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:15:28.787 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:15:28.787 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:15:28.787 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:15:28.787 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:15:28.787 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:15:28.787 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:15:28.787 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:28.787 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.778+0000 7fb338212640 1 Processor -- start 2026-02-13T20:15:28.788 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.778+0000 7fb338212640 1 -- start start 2026-02-13T20:15:28.788 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.778+0000 7fb338212640 10 monclient: init 2026-02-13T20:15:28.788 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.778+0000 7fb338212640 10 monclient: _reopen_session rank -1 2026-02-13T20:15:28.788 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.778+0000 7fb338212640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:15:28.788 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.778+0000 7fb338212640 10 monclient(hunting): picked mon.noname-c con 0x7fb330091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:15:28.788 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.778+0000 7fb338212640 10 monclient(hunting): picked mon.noname-a con 0x7fb3301401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:15:28.788 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.778+0000 7fb338212640 10 monclient(hunting): picked mon.noname-b con 0x7fb330130ce0 addr v1:10.20.193.188:6789/0 2026-02-13T20:15:28.788 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.778+0000 7fb338212640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb33008c5c0 con 0x7fb3301401c0 2026-02-13T20:15:28.788 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.778+0000 7fb338212640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb33005d320 con 0x7fb330130ce0 2026-02-13T20:15:28.788 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.778+0000 7fb338212640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb330130180 con 0x7fb330091950 2026-02-13T20:15:28.788 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.778+0000 7fb338212640 10 monclient(hunting): _renew_subs 2026-02-13T20:15:28.788 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.778+0000 7fb338212640 10 monclient(hunting): authenticate will time out at 890.469711s 2026-02-13T20:15:28.788 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.778+0000 7fb335786640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fb3301401c0 0x7fb330193a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:59452/0 (socket says 10.20.193.110:59452) 2026-02-13T20:15:28.788 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.778+0000 7fb335786640 1 -- 10.20.193.110:0/4019044528 learned_addr learned my addr 10.20.193.110:0/4019044528 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:15:28.788 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.778+0000 7fb335f87640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fb330091950 0x7fb33013eac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:42918/0 (socket says 10.20.193.110:42918) 2026-02-13T20:15:28.788 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.778+0000 7fb31e7fc640 1 -- 10.20.193.110:0/4019044528 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2760864261 0 0) 0x7fb33008c5c0 con 0x7fb3301401c0 2026-02-13T20:15:28.788 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.778+0000 7fb31e7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:15:28.788 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.778+0000 7fb31e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:28.788 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.778+0000 7fb31e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:28.788 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.778+0000 7fb31e7fc640 10 monclient(hunting): my global_id is 84234 2026-02-13T20:15:28.788 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.778+0000 7fb31e7fc640 1 -- 10.20.193.110:0/4019044528 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3000035e0 con 0x7fb3301401c0 2026-02-13T20:15:28.788 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.778+0000 7fb31e7fc640 1 -- 10.20.193.110:0/4019044528 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 700508499 0 0) 0x7fb330130180 con 0x7fb330091950 2026-02-13T20:15:28.788 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.778+0000 7fb31e7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:15:28.789 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.778+0000 7fb31e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:28.789 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.778+0000 7fb31e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:28.789 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.778+0000 7fb31e7fc640 10 monclient(hunting): my global_id is 94118 2026-02-13T20:15:28.789 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.778+0000 7fb31e7fc640 1 -- 10.20.193.110:0/4019044528 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb33008c5c0 con 0x7fb330091950 2026-02-13T20:15:28.789 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.779+0000 7fb31e7fc640 1 -- 10.20.193.110:0/4019044528 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1093963374 0 0) 0x7fb3000035e0 con 0x7fb3301401c0 2026-02-13T20:15:28.789 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.779+0000 7fb31e7fc640 1 -- 10.20.193.110:0/4019044528 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb330130180 con 0x7fb3301401c0 2026-02-13T20:15:28.789 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.779+0000 7fb31e7fc640 1 -- 10.20.193.110:0/4019044528 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3169382027 0 0) 0x7fb33008c5c0 con 0x7fb330091950 2026-02-13T20:15:28.789 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.779+0000 7fb31e7fc640 1 -- 10.20.193.110:0/4019044528 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb3000035e0 con 0x7fb330091950 2026-02-13T20:15:28.789 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.779+0000 7fb31e7fc640 1 -- 10.20.193.110:0/4019044528 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb3240032c0 con 0x7fb3301401c0 2026-02-13T20:15:28.789 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.779+0000 7fb31e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:15:28.789 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.779+0000 7fb31e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:15:28.789 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.779+0000 7fb31e7fc640 10 monclient(hunting): dump: 2026-02-13T20:15:28.789 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:28.789 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:28.789 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.789 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.789 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:28.789 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:28.789 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:28.789 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:28.789 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:28.789 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:28.789 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.779+0000 7fb31e7fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:15:28.790 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.779+0000 7fb31e7fc640 1 -- 10.20.193.110:0/4019044528 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb320003010 con 0x7fb330091950 2026-02-13T20:15:28.790 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.779+0000 7fb31e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:15:28.790 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.779+0000 7fb31e7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:15:28.790 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.779+0000 7fb31e7fc640 10 monclient(hunting): dump: 2026-02-13T20:15:28.790 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:28.790 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:28.790 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.790 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.790 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:28.790 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:28.790 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:28.790 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:28.790 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:28.790 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:28.790 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.779+0000 7fb31e7fc640 1 -- 10.20.193.110:0/4019044528 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4210100380 0 0) 0x7fb3000035e0 con 0x7fb330091950 2026-02-13T20:15:28.790 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.779+0000 7fb31e7fc640 1 -- 10.20.193.110:0/4019044528 >> v1:10.20.193.188:6789/0 conn(0x7fb330130ce0 legacy=0x7fb330195160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:28.790 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.779+0000 7fb31e7fc640 1 -- 10.20.193.110:0/4019044528 >> v1:10.20.193.110:6789/0 conn(0x7fb3301401c0 legacy=0x7fb330193a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:28.790 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.779+0000 7fb31e7fc640 10 monclient: _finish_hunting 0 2026-02-13T20:15:28.790 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.779+0000 7fb31e7fc640 1 monclient: found mon.c 2026-02-13T20:15:28.790 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.779+0000 7fb31e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:15:28.790 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.779+0000 7fb31e7fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:15:28.790 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.779+0000 7fb31e7fc640 1 -- 10.20.193.110:0/4019044528 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb330131c40 con 0x7fb330091950 2026-02-13T20:15:28.790 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.779+0000 7fb31e7fc640 10 monclient: _finish_auth 0 2026-02-13T20:15:28.791 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.779+0000 7fb31e7fc640 10 monclient: _check_auth_tickets 2026-02-13T20:15:28.791 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.779+0000 7fb31e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:15:28.791 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.779+0000 7fb338212640 5 monclient: authenticate success, global_id 94118 2026-02-13T20:15:28.791 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.779+0000 7fb338212640 10 monclient: _renew_subs 2026-02-13T20:15:28.791 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.779+0000 7fb338212640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:15:28.791 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.779+0000 7fb338212640 1 -- 10.20.193.110:0/4019044528 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb3301324e0 con 0x7fb330091950 2026-02-13T20:15:28.791 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.779+0000 7fb338212640 10 monclient: _renew_subs 2026-02-13T20:15:28.791 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.779+0000 7fb338212640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:15:28.791 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.779+0000 7fb338212640 1 -- 10.20.193.110:0/4019044528 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fb33013f370 con 0x7fb330091950 2026-02-13T20:15:28.791 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.779+0000 7fb31e7fc640 1 -- 10.20.193.110:0/4019044528 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb320003630 con 0x7fb330091950 2026-02-13T20:15:28.791 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.779+0000 7fb31e7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:15:28.791 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.779+0000 7fb31e7fc640 1 -- 10.20.193.110:0/4019044528 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb320003a40 con 0x7fb330091950 2026-02-13T20:15:28.791 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.779+0000 7fb31e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:28.791 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.779+0000 7fb31e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:15:28.791 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.779+0000 7fb31e7fc640 10 monclient: dump: 2026-02-13T20:15:28.791 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:28.791 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:28.791 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.791 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.791 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:28.791 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:28.791 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:28.791 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:28.792 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:28.792 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:28.792 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.779+0000 7fb31ffff640 4 set_mon_vals no callback set 2026-02-13T20:15:28.792 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.779+0000 7fb338212640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:15:28.792 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.779+0000 7fb338212640 1 -- 10.20.193.110:0/4019044528 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb3300008d0 con 0x7fb330092020 2026-02-13T20:15:28.792 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.779+0000 7fb31e7fc640 1 -- 10.20.193.110:0/4019044528 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fb320003ba0 con 0x7fb330091950 2026-02-13T20:15:28.792 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.780+0000 7fb31e7fc640 1 -- 10.20.193.110:0/4019044528 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(206..206 src has 1..206) ==== 3927+0+0 (unknown 3090514301 0 0) 0x7fb32004e800 con 0x7fb330091950 2026-02-13T20:15:28.792 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.780+0000 7fb31e7fc640 1 -- 10.20.193.110:0/4019044528 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1879568384 0 0) 0x7fb3300008d0 con 0x7fb330092020 2026-02-13T20:15:28.792 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.780+0000 7fb31e7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:15:28.792 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.780+0000 7fb31e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:28.792 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.780+0000 7fb31e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:28.792 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.780+0000 7fb31e7fc640 10 monclient(hunting): my global_id is 4564 2026-02-13T20:15:28.792 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.780+0000 7fb31e7fc640 1 -- 10.20.193.110:0/4019044528 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3000035e0 con 0x7fb330092020 2026-02-13T20:15:28.792 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.780+0000 7fb336788640 10 monclient: get_auth_request con 0x7fb30003fa30 auth_method 0 2026-02-13T20:15:28.792 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.780+0000 7fb31e7fc640 1 -- 10.20.193.110:0/4019044528 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3270743087 0 0) 0x7fb3000035e0 con 0x7fb330092020 2026-02-13T20:15:28.792 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.780+0000 7fb31e7fc640 1 -- 10.20.193.110:0/4019044528 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb3300008d0 con 0x7fb330092020 2026-02-13T20:15:28.792 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.780+0000 7fb31e7fc640 1 -- 10.20.193.110:0/4019044528 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb324003d30 con 0x7fb330092020 2026-02-13T20:15:28.792 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.780+0000 7fb31e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:28.792 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.780+0000 7fb31e7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:15:28.793 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.780+0000 7fb31e7fc640 10 monclient: dump: 2026-02-13T20:15:28.793 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:28.793 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:28.793 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.793 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.793 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:28.793 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:28.793 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:28.793 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:28.793 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:28.793 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:28.793 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.780+0000 7fb31e7fc640 1 -- 10.20.193.110:0/4019044528 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2729912882 0 0) 0x7fb3300008d0 con 0x7fb330092020 2026-02-13T20:15:28.793 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.780+0000 7fb31e7fc640 1 -- 10.20.193.110:0/4019044528 --> v1:10.20.193.188:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb33008b450 con 0x7fb330092020 2026-02-13T20:15:28.793 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.780+0000 7fb31e7fc640 1 -- 10.20.193.110:0/4019044528 <== mon.1 v1:10.20.193.188:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fb3240040c0 con 0x7fb330092020 2026-02-13T20:15:28.793 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.780+0000 7fb31e7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:15:28.793 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.780+0000 7fb31e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:15:28.793 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.780+0000 7fb31e7fc640 1 -- 10.20.193.110:0/4019044528 >> v1:10.20.193.188:6789/0 conn(0x7fb330092020 legacy=0x7fb33008ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:28.793 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.780+0000 7fb31e7fc640 1 -- 10.20.193.110:0/4019044528 >> v1:10.20.193.188:6789/0 conn(0x7fb330092020 legacy=0x7fb33008ef90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:15:28.794 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.784+0000 7fb338212640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:15:28.795 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.784+0000 7fb338212640 1 -- 10.20.193.110:0/4019044528 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb330058410 con 0x7fb33004d1c0 2026-02-13T20:15:28.795 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.785+0000 7fb31e7fc640 1 -- 10.20.193.110:0/4019044528 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 780004912 0 0) 0x7fb330058410 con 0x7fb33004d1c0 2026-02-13T20:15:28.795 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.785+0000 7fb31e7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:15:28.795 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.785+0000 7fb31e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:28.795 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.785+0000 7fb31e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:28.795 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.785+0000 7fb31e7fc640 10 monclient(hunting): my global_id is 4567 2026-02-13T20:15:28.795 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.785+0000 7fb31e7fc640 1 -- 10.20.193.110:0/4019044528 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3300008d0 con 0x7fb33004d1c0 2026-02-13T20:15:28.795 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.785+0000 7fb31e7fc640 1 -- 10.20.193.110:0/4019044528 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2494363159 0 0) 0x7fb3300008d0 con 0x7fb33004d1c0 2026-02-13T20:15:28.795 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.785+0000 7fb31e7fc640 1 -- 10.20.193.110:0/4019044528 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb330058410 con 0x7fb33004d1c0 2026-02-13T20:15:28.795 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.785+0000 7fb31e7fc640 1 -- 10.20.193.110:0/4019044528 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb324005920 con 0x7fb33004d1c0 2026-02-13T20:15:28.795 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.785+0000 7fb31e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:28.795 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.785+0000 7fb31e7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:15:28.795 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.785+0000 7fb31e7fc640 10 monclient: dump: 2026-02-13T20:15:28.795 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:28.795 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:28.795 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.795 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.796 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:28.796 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:28.796 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:28.796 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:28.796 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:28.796 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:28.796 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.785+0000 7fb31e7fc640 1 -- 10.20.193.110:0/4019044528 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 962310309 0 0) 0x7fb330058410 con 0x7fb33004d1c0 2026-02-13T20:15:28.796 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.785+0000 7fb31e7fc640 1 -- 10.20.193.110:0/4019044528 --> v1:10.20.193.188:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb330152910 con 0x7fb33004d1c0 2026-02-13T20:15:28.796 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.785+0000 7fb31e7fc640 1 -- 10.20.193.110:0/4019044528 <== mon.1 v1:10.20.193.188:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4683 (unknown 0 0 204424998) 0x7fb324007b40 con 0x7fb33004d1c0 2026-02-13T20:15:28.796 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.785+0000 7fb31e7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:15:28.796 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.785+0000 7fb31e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:15:28.796 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.785+0000 7fb31e7fc640 1 -- 10.20.193.110:0/4019044528 >> v1:10.20.193.188:6789/0 conn(0x7fb33004d1c0 legacy=0x7fb330197890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:28.796 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.785+0000 7fb31e7fc640 1 -- 10.20.193.110:0/4019044528 >> v1:10.20.193.188:6789/0 conn(0x7fb33004d1c0 legacy=0x7fb330197890 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:15:28.796 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:15:28.796 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:15:28.797 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:15:28.797 INFO:teuthology.orchestra.run.trial110.stdout: "state": "leader", 2026-02-13T20:15:28.797 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 16, 2026-02-13T20:15:28.797 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 250932, 2026-02-13T20:15:28.797 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:15:28.797 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:15:28.797 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:15:28.797 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:15:28.797 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:15:28.797 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 0, 2026-02-13T20:15:28.797 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:15:28.797 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:15:28.797 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:15:28.797 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:15:28.797 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:15:28.797 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:15:28.797 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:15:28.797 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:15:28.798 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:15:28.798 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:15:28.798 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:15:28.798 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:15:28.798 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:15:28.798 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:15:28.798 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:15:28.798 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:15:28.798 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:15:28.798 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:15:28.798 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:15:28.798 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:15:28.798 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:15:28.798 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:15:28.798 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:15:28.798 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:15:28.798 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:15:28.798 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:15:28.798 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:15:28.799 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:15:28.799 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:15:28.799 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:15:28.799 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:15:28.799 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:15:28.799 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:15:28.799 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:28.799 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:15:28.799 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:15:28.799 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:15:28.799 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:15:28.799 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:15:28.799 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:15:28.799 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:15:28.799 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:15:28.799 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:15:28.799 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:15:28.799 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:15:28.799 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:15:28.799 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:15:28.800 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:15:28.800 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:15:28.800 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:15:28.800 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:15:28.800 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:15:28.800 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:15:28.800 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:15:28.800 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:15:28.800 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:15:28.800 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:15:28.800 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:15:28.800 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:15:28.800 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:15:28.800 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:15:28.800 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:15:28.800 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:15:28.800 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:15:28.800 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:15:28.800 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:15:28.800 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:28.800 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:15:28.801 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:28.801 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:15:28.801 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:15:28.801 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:15:28.801 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:15:28.801 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:28.801 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:15:28.801 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:15:28.801 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:15:28.801 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:28.801 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:15:28.801 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:28.801 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:15:28.801 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:15:28.801 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:15:28.801 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:15:28.801 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:15:28.801 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:15:28.801 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:28.801 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:28.801 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:15:28.802 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:15:28.802 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:15:28.802 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:15:28.802 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:28.802 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:15:28.802 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:15:28.802 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:15:28.802 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:28.802 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:15:28.802 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:28.802 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:15:28.802 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:15:28.802 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:15:28.802 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:15:28.802 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:15:28.802 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:15:28.802 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:28.802 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:28.802 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:15:28.802 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:15:28.802 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:15:28.803 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:15:28.803 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:28.803 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:15:28.803 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:15:28.803 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:15:28.803 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:28.803 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:15:28.803 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:28.803 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:15:28.803 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:15:28.803 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:15:28.803 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:15:28.803 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:15:28.803 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:15:28.803 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:28.803 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:15:28.803 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:28.803 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:15:28.803 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:15:28.803 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:28.804 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:15:28.804 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:15:28.804 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:15:28.804 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:28.804 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:15:28.804 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:15:28.804 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:28.804 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:15:28.804 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:15:28.804 INFO:teuthology.orchestra.run.trial110.stdout: "num": 4 2026-02-13T20:15:28.804 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:28.804 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:15:28.804 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:15:28.804 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:28.804 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:15:28.804 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:15:28.804 INFO:teuthology.orchestra.run.trial110.stdout: "num": 6 2026-02-13T20:15:28.804 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:28.804 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:15:28.804 INFO:teuthology.orchestra.run.trial110.stdout: "mgr": [ 2026-02-13T20:15:28.804 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:28.804 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:15:28.805 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:15:28.805 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:15:28.805 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:28.805 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:15:28.805 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:28.805 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:15:28.805 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:15:28.806 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.786+0000 7fb338212640 1 -- 10.20.193.110:0/4019044528 >> v1:10.20.193.188:6812/1623052694 conn(0x7fb30003fa30 legacy=0x7fb30005fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:28.806 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.786+0000 7fb338212640 10 monclient: shutdown 2026-02-13T20:15:28.806 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.786+0000 7fb338212640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:15:28.806 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.786+0000 7fb338212640 1 -- 10.20.193.110:0/4019044528 >> v1:10.20.193.110:6790/0 conn(0x7fb330091950 legacy=0x7fb33013eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:28.806 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.786+0000 7fb336788640 1 -- 10.20.193.110:0/4019044528 reap_dead start 2026-02-13T20:15:28.806 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.786+0000 7fb336788640 1 -- 10.20.193.110:0/4019044528 reap_dead start 2026-02-13T20:15:28.806 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.786+0000 7fb338212640 1 -- 10.20.193.110:0/4019044528 shutdown_connections 2026-02-13T20:15:28.806 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.786+0000 7fb338212640 1 -- 10.20.193.110:0/4019044528 >> 10.20.193.110:0/4019044528 conn(0x7fb330054e90 msgr2=0x7fb330089eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:15:28.806 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.786+0000 7fb338212640 1 -- 10.20.193.110:0/4019044528 shutdown_connections 2026-02-13T20:15:28.806 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.786+0000 7fb338212640 1 -- 10.20.193.110:0/4019044528 wait complete. 2026-02-13T20:15:28.806 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:15:28.806 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-13T20:15:28.807 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-13T20:15:28.877 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.869+0000 7fe4f3ba5640 10 monclient: get_monmap_and_config 2026-02-13T20:15:28.877 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.869+0000 7fe4f3ba5640 10 monclient: build_initial_monmap 2026-02-13T20:15:28.877 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.869+0000 7fe4f3ba5640 10 monclient: monmap: 2026-02-13T20:15:28.877 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:15:28.877 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:28.877 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:15:28.870742+0000 2026-02-13T20:15:28.877 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:15:28.870742+0000 2026-02-13T20:15:28.877 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:15:28.877 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:28.877 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:15:28.877 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:15:28.877 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:15:28.878 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:28.878 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.869+0000 7fe4f3ba5640 1 Processor -- start 2026-02-13T20:15:28.878 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.869+0000 7fe4f3ba5640 1 -- start start 2026-02-13T20:15:28.878 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.869+0000 7fe4f3ba5640 10 monclient: init 2026-02-13T20:15:28.878 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.869+0000 7fe4f3ba5640 10 monclient: _reopen_session rank -1 2026-02-13T20:15:28.878 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.869+0000 7fe4f3ba5640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:15:28.878 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.869+0000 7fe4f3ba5640 10 monclient(hunting): picked mon.noname-b con 0x7fe4ec1401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:15:28.878 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f3ba5640 10 monclient(hunting): picked mon.noname-a con 0x7fe4ec092020 addr v1:10.20.193.110:6789/0 2026-02-13T20:15:28.878 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f3ba5640 10 monclient(hunting): picked mon.noname-c con 0x7fe4ec091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:15:28.878 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f3ba5640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4ec08b730 con 0x7fe4ec092020 2026-02-13T20:15:28.878 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f3ba5640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4ec05c5b0 con 0x7fe4ec091950 2026-02-13T20:15:28.878 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f3ba5640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4ec08bcf0 con 0x7fe4ec1401c0 2026-02-13T20:15:28.878 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f3ba5640 10 monclient(hunting): _renew_subs 2026-02-13T20:15:28.878 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f3ba5640 10 monclient(hunting): authenticate will time out at 890.561044s 2026-02-13T20:15:28.878 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f191a640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fe4ec1401c0 0x7fe4ec091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:42932/0 (socket says 10.20.193.110:42932) 2026-02-13T20:15:28.878 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f191a640 1 -- 10.20.193.110:0/1318332745 learned_addr learned my addr 10.20.193.110:0/1318332745 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:15:28.879 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f0918640 1 -- 10.20.193.110:0/1318332745 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3452344445 0 0) 0x7fe4ec08bcf0 con 0x7fe4ec1401c0 2026-02-13T20:15:28.879 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f0918640 10 monclient(hunting): _negotiate 2026-02-13T20:15:28.879 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f0918640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:28.879 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f0918640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:28.879 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f0918640 10 monclient(hunting): my global_id is 94121 2026-02-13T20:15:28.879 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f0918640 1 -- 10.20.193.110:0/1318332745 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4d40035e0 con 0x7fe4ec1401c0 2026-02-13T20:15:28.879 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f0918640 1 -- 10.20.193.110:0/1318332745 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4020633090 0 0) 0x7fe4ec08b730 con 0x7fe4ec092020 2026-02-13T20:15:28.879 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f0918640 10 monclient(hunting): _negotiate 2026-02-13T20:15:28.879 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f0918640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:28.879 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f0918640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:28.879 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f0918640 10 monclient(hunting): my global_id is 84237 2026-02-13T20:15:28.879 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f0918640 1 -- 10.20.193.110:0/1318332745 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4ec08bcf0 con 0x7fe4ec092020 2026-02-13T20:15:28.879 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f0918640 1 -- 10.20.193.110:0/1318332745 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3879662873 0 0) 0x7fe4d40035e0 con 0x7fe4ec1401c0 2026-02-13T20:15:28.879 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f0918640 1 -- 10.20.193.110:0/1318332745 >> v1:10.20.193.188:6789/0 conn(0x7fe4ec091950 legacy=0x7fe4ec1a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:28.879 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f0918640 1 -- 10.20.193.110:0/1318332745 >> v1:10.20.193.110:6789/0 conn(0x7fe4ec092020 legacy=0x7fe4ec1812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:28.880 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f0918640 10 monclient: _finish_hunting 0 2026-02-13T20:15:28.880 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f0918640 1 monclient: found mon.noname-b 2026-02-13T20:15:28.880 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f0918640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:15:28.880 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f0918640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:15:28.880 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f0918640 1 -- 10.20.193.110:0/1318332745 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4ec140590 con 0x7fe4ec1401c0 2026-02-13T20:15:28.880 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f0918640 10 monclient: _finish_auth 0 2026-02-13T20:15:28.880 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f0918640 10 monclient: _check_auth_tickets 2026-02-13T20:15:28.880 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f0918640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:15:28.880 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f0918640 1 -- 10.20.193.110:0/1318332745 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe4dc002dd0 con 0x7fe4ec1401c0 2026-02-13T20:15:28.880 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f0918640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:28.880 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f0918640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:15:28.880 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f0918640 10 monclient: dump: 2026-02-13T20:15:28.880 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:28.880 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:28.880 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.880 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.880 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:28.881 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:28.881 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:28.881 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:28.881 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:28.881 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:28.881 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f3ba5640 5 monclient: authenticate success, global_id 94121 2026-02-13T20:15:28.881 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f3ba5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:15:28.881 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f0918640 1 -- 10.20.193.110:0/1318332745 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe4dc002fa0 con 0x7fe4ec1401c0 2026-02-13T20:15:28.881 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f0918640 10 monclient: handle_config config(0 keys) 2026-02-13T20:15:28.881 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f0918640 1 -- 10.20.193.110:0/1318332745 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe4dc0033b0 con 0x7fe4ec1401c0 2026-02-13T20:15:28.881 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f0918640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:28.881 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f0918640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:15:28.881 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f0918640 10 monclient: dump: 2026-02-13T20:15:28.881 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:28.881 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:28.881 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.881 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.882 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:28.882 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:28.882 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:28.882 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:28.882 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:28.882 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:28.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f3ba5640 10 monclient: get_monmap_and_config success 2026-02-13T20:15:28.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f3ba5640 4 set_mon_vals no callback set 2026-02-13T20:15:28.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f3ba5640 10 monclient: shutdown 2026-02-13T20:15:28.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f3ba5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:15:28.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f3ba5640 1 -- 10.20.193.110:0/1318332745 >> v1:10.20.193.110:6790/0 conn(0x7fe4ec1401c0 legacy=0x7fe4ec091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:28.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f3ba5640 1 -- 10.20.193.110:0/1318332745 shutdown_connections 2026-02-13T20:15:28.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f3ba5640 1 -- 10.20.193.110:0/1318332745 >> 10.20.193.110:0/1318332745 conn(0x7fe4ec054e90 msgr2=0x7fe4ec058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:15:28.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f3ba5640 1 -- 10.20.193.110:0/1318332745 shutdown_connections 2026-02-13T20:15:28.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.870+0000 7fe4f3ba5640 1 -- 10.20.193.110:0/1318332745 wait complete. 2026-02-13T20:15:28.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.871+0000 7fe4f3ba5640 10 monclient: build_initial_monmap 2026-02-13T20:15:28.883 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.871+0000 7fe4f3ba5640 10 monclient: monmap: 2026-02-13T20:15:28.883 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:15:28.883 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:15:28.883 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:15:28.883 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:15:28.883 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:15:28.883 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:15:28.883 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:15:28.883 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:15:28.883 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:15:28.883 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:28.883 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.871+0000 7fe4f3ba5640 1 Processor -- start 2026-02-13T20:15:28.883 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.871+0000 7fe4f3ba5640 1 -- start start 2026-02-13T20:15:28.883 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.871+0000 7fe4f3ba5640 10 monclient: init 2026-02-13T20:15:28.883 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.871+0000 7fe4f3ba5640 10 monclient: _reopen_session rank -1 2026-02-13T20:15:28.883 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.871+0000 7fe4f3ba5640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:15:28.883 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.871+0000 7fe4f3ba5640 10 monclient(hunting): picked mon.noname-a con 0x7fe4ec091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:15:28.884 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.871+0000 7fe4f3ba5640 10 monclient(hunting): picked mon.noname-b con 0x7fe4ec1401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:15:28.884 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.871+0000 7fe4f3ba5640 10 monclient(hunting): picked mon.noname-c con 0x7fe4ec1111f0 addr v1:10.20.193.110:6790/0 2026-02-13T20:15:28.884 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.871+0000 7fe4f3ba5640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4ec12cc70 con 0x7fe4ec091950 2026-02-13T20:15:28.884 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.871+0000 7fe4f3ba5640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4ec05d390 con 0x7fe4ec1401c0 2026-02-13T20:15:28.884 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.871+0000 7fe4f3ba5640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4ec1150b0 con 0x7fe4ec1111f0 2026-02-13T20:15:28.884 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.871+0000 7fe4f3ba5640 10 monclient(hunting): _renew_subs 2026-02-13T20:15:28.884 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.871+0000 7fe4f3ba5640 10 monclient(hunting): authenticate will time out at 890.562913s 2026-02-13T20:15:28.884 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.871+0000 7fe4f211b640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fe4ec1111f0 0x7fe4ec1a2050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:42944/0 (socket says 10.20.193.110:42944) 2026-02-13T20:15:28.884 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.871+0000 7fe4f211b640 1 -- 10.20.193.110:0/4225202145 learned_addr learned my addr 10.20.193.110:0/4225202145 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:15:28.884 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4da7fc640 1 -- 10.20.193.110:0/4225202145 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 697107211 0 0) 0x7fe4ec1150b0 con 0x7fe4ec1111f0 2026-02-13T20:15:28.884 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4da7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:15:28.884 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4da7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:28.884 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4da7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:28.885 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4da7fc640 10 monclient(hunting): my global_id is 94124 2026-02-13T20:15:28.885 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4da7fc640 1 -- 10.20.193.110:0/4225202145 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4bc0035e0 con 0x7fe4ec1111f0 2026-02-13T20:15:28.885 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4da7fc640 1 -- 10.20.193.110:0/4225202145 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1304966662 0 0) 0x7fe4ec12cc70 con 0x7fe4ec091950 2026-02-13T20:15:28.885 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4da7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:15:28.885 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4da7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:28.885 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4da7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:28.885 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4da7fc640 10 monclient(hunting): my global_id is 84240 2026-02-13T20:15:28.885 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4da7fc640 1 -- 10.20.193.110:0/4225202145 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4ec1150b0 con 0x7fe4ec091950 2026-02-13T20:15:28.885 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4da7fc640 1 -- 10.20.193.110:0/4225202145 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 322112248 0 0) 0x7fe4bc0035e0 con 0x7fe4ec1111f0 2026-02-13T20:15:28.885 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4da7fc640 1 -- 10.20.193.110:0/4225202145 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe4ec12cc70 con 0x7fe4ec1111f0 2026-02-13T20:15:28.885 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4da7fc640 1 -- 10.20.193.110:0/4225202145 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe4e80041d0 con 0x7fe4ec1111f0 2026-02-13T20:15:28.885 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4da7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:15:28.885 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4da7fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:15:28.885 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4da7fc640 10 monclient(hunting): dump: 2026-02-13T20:15:28.885 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:28.885 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:28.885 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.886 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.886 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:28.886 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:28.886 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:28.886 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:28.886 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:28.886 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:28.886 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4da7fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:15:28.886 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4da7fc640 1 -- 10.20.193.110:0/4225202145 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1724636748 0 0) 0x7fe4ec08bcf0 con 0x7fe4ec1401c0 2026-02-13T20:15:28.886 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4da7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:15:28.886 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4da7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:28.886 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4da7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:28.886 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4da7fc640 10 monclient(hunting): my global_id is 4573 2026-02-13T20:15:28.886 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4da7fc640 1 -- 10.20.193.110:0/4225202145 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4bc0035e0 con 0x7fe4ec1401c0 2026-02-13T20:15:28.886 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4da7fc640 1 -- 10.20.193.110:0/4225202145 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 834406316 0 0) 0x7fe4ec1150b0 con 0x7fe4ec091950 2026-02-13T20:15:28.886 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4da7fc640 1 -- 10.20.193.110:0/4225202145 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe4ec08bcf0 con 0x7fe4ec091950 2026-02-13T20:15:28.886 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4da7fc640 1 -- 10.20.193.110:0/4225202145 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe4dc002ce0 con 0x7fe4ec091950 2026-02-13T20:15:28.887 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4da7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:15:28.887 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4da7fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:15:28.887 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4da7fc640 10 monclient(hunting): dump: 2026-02-13T20:15:28.887 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:28.887 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:28.887 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.887 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.887 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:28.887 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:28.887 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:28.887 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:28.887 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:28.887 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:28.887 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4da7fc640 1 -- 10.20.193.110:0/4225202145 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4070830343 0 0) 0x7fe4ec12cc70 con 0x7fe4ec1111f0 2026-02-13T20:15:28.887 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4da7fc640 1 -- 10.20.193.110:0/4225202145 >> v1:10.20.193.188:6789/0 conn(0x7fe4ec1401c0 legacy=0x7fe4ec1149a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:28.887 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4da7fc640 1 -- 10.20.193.110:0/4225202145 >> v1:10.20.193.110:6789/0 conn(0x7fe4ec091950 legacy=0x7fe4ec114290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:28.888 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4da7fc640 10 monclient: _finish_hunting 0 2026-02-13T20:15:28.888 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4da7fc640 1 monclient: found mon.c 2026-02-13T20:15:28.888 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4da7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:15:28.888 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4da7fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:15:28.888 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4da7fc640 1 -- 10.20.193.110:0/4225202145 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4ec12c610 con 0x7fe4ec1111f0 2026-02-13T20:15:28.888 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4da7fc640 10 monclient: _finish_auth 0 2026-02-13T20:15:28.888 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4da7fc640 10 monclient: _check_auth_tickets 2026-02-13T20:15:28.888 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4da7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:15:28.888 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4f3ba5640 5 monclient: authenticate success, global_id 94124 2026-02-13T20:15:28.888 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4f3ba5640 10 monclient: _renew_subs 2026-02-13T20:15:28.888 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4f3ba5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:15:28.888 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4f3ba5640 1 -- 10.20.193.110:0/4225202145 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe4ec12b1b0 con 0x7fe4ec1111f0 2026-02-13T20:15:28.888 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4f3ba5640 10 monclient: _renew_subs 2026-02-13T20:15:28.888 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4f3ba5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:15:28.888 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4f3ba5640 1 -- 10.20.193.110:0/4225202145 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fe4ec12bd10 con 0x7fe4ec1111f0 2026-02-13T20:15:28.888 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4da7fc640 1 -- 10.20.193.110:0/4225202145 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe4e80043a0 con 0x7fe4ec1111f0 2026-02-13T20:15:28.889 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4da7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:15:28.889 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4da7fc640 1 -- 10.20.193.110:0/4225202145 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe4e8004a60 con 0x7fe4ec1111f0 2026-02-13T20:15:28.889 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4da7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:28.889 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4da7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:15:28.889 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4dbfff640 4 set_mon_vals no callback set 2026-02-13T20:15:28.889 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4da7fc640 10 monclient: dump: 2026-02-13T20:15:28.889 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:28.889 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:28.889 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.889 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:28.889 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:28.889 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:28.889 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:28.889 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:28.889 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:28.889 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:28.889 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4f3ba5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:15:28.890 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4f3ba5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:15:28.890 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4f3ba5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:15:28.890 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.872+0000 7fe4f3ba5640 1 -- 10.20.193.110:0/4225202145 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4ec0008d0 con 0x7fe4ec1111f0 2026-02-13T20:15:28.890 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.873+0000 7fe4da7fc640 1 -- 10.20.193.110:0/4225202145 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fe4e8004bc0 con 0x7fe4ec1111f0 2026-02-13T20:15:28.890 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.873+0000 7fe4da7fc640 1 -- 10.20.193.110:0/4225202145 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(206..206 src has 1..206) ==== 3927+0+0 (unknown 3090514301 0 0) 0x7fe4e804f950 con 0x7fe4ec1111f0 2026-02-13T20:15:28.890 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.873+0000 7fe4f191a640 10 monclient: get_auth_request con 0x7fe4bc03fcc0 auth_method 0 2026-02-13T20:15:28.890 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.875+0000 7fe4da7fc640 1 -- 10.20.193.110:0/4225202145 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fe4e8005230 con 0x7fe4ec1111f0 2026-02-13T20:15:28.890 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.875+0000 7fe4da7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:15:28.890 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:28.875+0000 7fe4da7fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:15:28.891 INFO:tasks.rados.rados.0.trial188.stdout:889: done (1 left) 2026-02-13T20:15:28.891 INFO:tasks.rados.rados.0.trial188.stdout:890: done (0 left) 2026-02-13T20:15:28.891 INFO:tasks.rados.rados.0.trial188.stdout:891: rollback oid 45 current snap is 94 2026-02-13T20:15:28.891 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 45 to 92 2026-02-13T20:15:28.891 INFO:tasks.rados.rados.0.trial188.stdout:892: delete oid 46 current snap is 94 2026-02-13T20:15:28.893 INFO:tasks.rados.rados.0.trial188.stdout:892: done (1 left) 2026-02-13T20:15:28.893 INFO:tasks.rados.rados.0.trial188.stdout:893: write oid 3 current snap is 94 2026-02-13T20:15:28.893 INFO:tasks.rados.rados.0.trial188.stdout:893: seq_num 338 ranges {480766=553694,1629149=591119,2782148=420058} 2026-02-13T20:15:28.897 INFO:tasks.rados.rados.0.trial188.stdout:893: writing trial18843701-3 from 480766 to 1034460 tid 1 2026-02-13T20:15:28.901 INFO:tasks.rados.rados.0.trial188.stdout:893: writing trial18843701-3 from 1629149 to 2220268 tid 2 2026-02-13T20:15:28.905 INFO:tasks.rados.rados.0.trial188.stdout:893: writing trial18843701-3 from 2782148 to 3202206 tid 3 2026-02-13T20:15:28.905 INFO:tasks.rados.rados.0.trial188.stdout:894: read oid 9 snap 92 2026-02-13T20:15:28.906 INFO:tasks.rados.rados.0.trial188.stdout:894: expect (ObjNum 240 snap 64 seq_num 240) 2026-02-13T20:15:28.906 INFO:tasks.rados.rados.0.trial188.stdout:895: rollback oid 17 current snap is 94 2026-02-13T20:15:28.906 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 17 to 90 2026-02-13T20:15:28.906 INFO:tasks.rados.rados.0.trial188.stdout:891: finishing rollback tid 0 to trial18843701-45 2026-02-13T20:15:28.906 INFO:tasks.rados.rados.0.trial188.stdout:891: finishing rollback tid 1 to trial18843701-45 2026-02-13T20:15:28.906 INFO:tasks.rados.rados.0.trial188.stdout:891: finishing rollback tid 2 to trial18843701-45 2026-02-13T20:15:28.906 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 45 v 339 (ObjNum 302 snap 81 seq_num 302) dirty exists 2026-02-13T20:15:28.906 INFO:tasks.rados.rados.0.trial188.stdout:891: done (3 left) 2026-02-13T20:15:28.906 INFO:tasks.rados.rados.0.trial188.stdout:896: write oid 39 current snap is 94 2026-02-13T20:15:28.906 INFO:tasks.rados.rados.0.trial188.stdout:896: seq_num 339 ranges {497573=628943,1687631=734777,3093218=604355} 2026-02-13T20:15:28.909 INFO:tasks.rados.rados.0.trial188.stdout:896: writing trial18843701-39 from 497573 to 1126516 tid 1 2026-02-13T20:15:28.914 INFO:tasks.rados.rados.0.trial188.stdout:896: writing trial18843701-39 from 1687631 to 2422408 tid 2 2026-02-13T20:15:28.918 INFO:tasks.rados.rados.0.trial188.stdout:896: writing trial18843701-39 from 3093218 to 3697573 tid 3 2026-02-13T20:15:28.918 INFO:tasks.rados.rados.0.trial188.stdout:897: delete oid 38 current snap is 94 2026-02-13T20:15:28.918 INFO:tasks.rados.rados.0.trial188.stdout:895: finishing rollback tid 1 to trial18843701-17 2026-02-13T20:15:28.918 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 17 v 0 (ObjNum 33 snap 0 seq_num 4556992) dirty dne 2026-02-13T20:15:28.918 INFO:tasks.rados.rados.0.trial188.stdout:894: expect (ObjNum 240 snap 64 seq_num 240) 2026-02-13T20:15:28.963 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1474948 2026-02-13T20:15:28.998 INFO:tasks.rados.rados.0.trial188.stdout:893: finishing write tid 1 to trial18843701-3 2026-02-13T20:15:28.998 INFO:tasks.rados.rados.0.trial188.stdout:894: done (4 left) 2026-02-13T20:15:28.998 INFO:tasks.rados.rados.0.trial188.stdout:895: done (3 left) 2026-02-13T20:15:28.998 INFO:tasks.rados.rados.0.trial188.stdout:897: done (2 left) 2026-02-13T20:15:28.998 INFO:tasks.rados.rados.0.trial188.stdout:898: delete oid 38 current snap is 94 2026-02-13T20:15:28.998 INFO:tasks.rados.rados.0.trial188.stdout:893: finishing write tid 2 to trial18843701-3 2026-02-13T20:15:28.998 INFO:tasks.rados.rados.0.trial188.stdout:896: finishing write tid 1 to trial18843701-39 2026-02-13T20:15:28.999 INFO:tasks.rados.rados.0.trial188.stdout:893: finishing write tid 3 to trial18843701-3 2026-02-13T20:15:28.999 INFO:tasks.rados.rados.0.trial188.stdout:896: finishing write tid 2 to trial18843701-39 2026-02-13T20:15:28.999 INFO:tasks.rados.rados.0.trial188.stdout:893: finishing write tid 4 to trial18843701-3 2026-02-13T20:15:28.999 INFO:tasks.rados.rados.0.trial188.stdout:893: finishing write tid 5 to trial18843701-3 2026-02-13T20:15:28.999 INFO:tasks.rados.rados.0.trial188.stdout:893: oid 3 updating version 0 to 330 2026-02-13T20:15:28.999 INFO:tasks.rados.rados.0.trial188.stdout:893: oid 3 updating version 330 to 331 2026-02-13T20:15:28.999 INFO:tasks.rados.rados.0.trial188.stdout:893: oid 3 version 331 is already newer than 329 2026-02-13T20:15:28.999 INFO:tasks.rados.rados.0.trial188.stdout:893: oid 3 version 331 is already newer than 328 2026-02-13T20:15:28.999 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 3 v 331 (ObjNum 338 snap 94 seq_num 338) dirty exists 2026-02-13T20:15:28.999 INFO:tasks.rados.rados.0.trial188.stdout:893: left oid 3 (ObjNum 338 snap 94 seq_num 338) 2026-02-13T20:15:28.999 INFO:tasks.rados.rados.0.trial188.stdout:896: finishing write tid 3 to trial18843701-39 2026-02-13T20:15:28.999 INFO:tasks.rados.rados.0.trial188.stdout:896: finishing write tid 4 to trial18843701-39 2026-02-13T20:15:29.000 INFO:tasks.rados.rados.0.trial188.stdout:896: finishing write tid 5 to trial18843701-39 2026-02-13T20:15:29.000 INFO:tasks.rados.rados.0.trial188.stdout:896: oid 39 updating version 0 to 378 2026-02-13T20:15:29.000 INFO:tasks.rados.rados.0.trial188.stdout:896: oid 39 updating version 378 to 380 2026-02-13T20:15:29.000 INFO:tasks.rados.rados.0.trial188.stdout:896: oid 39 version 380 is already newer than 379 2026-02-13T20:15:29.000 INFO:tasks.rados.rados.0.trial188.stdout:896: oid 39 updating version 380 to 381 2026-02-13T20:15:29.000 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 39 v 381 (ObjNum 339 snap 94 seq_num 339) dirty exists 2026-02-13T20:15:29.000 INFO:tasks.rados.rados.0.trial188.stdout:896: left oid 39 (ObjNum 339 snap 94 seq_num 339) 2026-02-13T20:15:29.000 INFO:tasks.rados.rados.0.trial188.stdout:893: done (2 left) 2026-02-13T20:15:29.000 INFO:tasks.rados.rados.0.trial188.stdout:896: done (1 left) 2026-02-13T20:15:29.000 INFO:tasks.rados.rados.0.trial188.stdout:898: done (0 left) 2026-02-13T20:15:29.000 INFO:tasks.rados.rados.0.trial188.stdout:899: delete oid 20 current snap is 94 2026-02-13T20:15:29.001 INFO:tasks.rados.rados.0.trial188.stdout:899: done (0 left) 2026-02-13T20:15:29.001 INFO:tasks.rados.rados.0.trial188.stdout:900: read oid 3 snap -1 2026-02-13T20:15:29.001 INFO:tasks.rados.rados.0.trial188.stdout:900: expect (ObjNum 338 snap 94 seq_num 338) 2026-02-13T20:15:29.001 INFO:tasks.rados.rados.0.trial188.stdout:901: copy_from oid 25 from oid 14 current snap is 94 2026-02-13T20:15:29.002 INFO:tasks.rados.rados.0.trial188.stdout:902: delete oid 50 current snap is 94 2026-02-13T20:15:29.004 INFO:tasks.rados.rados.0.trial188.stdout:901: finishing copy_from to trial18843701-25 2026-02-13T20:15:29.004 INFO:tasks.rados.rados.0.trial188.stdout:901: got expected ENOENT (src dne) 2026-02-13T20:15:29.004 INFO:tasks.rados.rados.0.trial188.stdout:901: finishing copy_from racing read to trial18843701-25 2026-02-13T20:15:29.006 INFO:tasks.rados.rados.0.trial188.stdout:900: expect (ObjNum 338 snap 94 seq_num 338) 2026-02-13T20:15:29.012 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 961732 2026-02-13T20:15:29.021 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:29.019+0000 7fe4f3ba5640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-13T20:15:29.021 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:29.019+0000 7fe4f3ba5640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-13T20:15:29.021 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:29.019+0000 7fe4f3ba5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:15:29.021 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:29.019+0000 7fe4f3ba5640 1 -- 10.20.193.110:0/4225202145 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fe4ec12cf90 con 0x7fe4ec1111f0 2026-02-13T20:15:29.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:29.020+0000 7fe4da7fc640 1 -- 10.20.193.110:0/4225202145 <== mon.2 v1:10.20.193.110:6790/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7fe4e80178f0 con 0x7fe4ec1111f0 2026-02-13T20:15:29.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:29.020+0000 7fe4da7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-13T20:15:29.023 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:29.020+0000 7fe4da7fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:15:29.029 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:29.022+0000 7fe4f3ba5640 1 -- 10.20.193.110:0/4225202145 >> v1:10.20.193.188:6812/1623052694 conn(0x7fe4bc03fcc0 legacy=0x7fe4bc060170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:29.029 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:29.022+0000 7fe4f3ba5640 10 monclient: shutdown 2026-02-13T20:15:29.029 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:29.022+0000 7fe4f3ba5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:15:29.029 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:29.022+0000 7fe4f3ba5640 1 -- 10.20.193.110:0/4225202145 >> v1:10.20.193.110:6790/0 conn(0x7fe4ec1111f0 legacy=0x7fe4ec1a2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:29.029 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:29.022+0000 7fe4f3ba5640 1 -- 10.20.193.110:0/4225202145 shutdown_connections 2026-02-13T20:15:29.029 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:29.022+0000 7fe4f3ba5640 1 -- 10.20.193.110:0/4225202145 >> 10.20.193.110:0/4225202145 conn(0x7fe4ec054e90 msgr2=0x7fe4ec08ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:15:29.029 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:29.022+0000 7fe4f3ba5640 1 -- 10.20.193.110:0/4225202145 shutdown_connections 2026-02-13T20:15:29.029 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:29.022+0000 7fe4f3ba5640 1 -- 10.20.193.110:0/4225202145 wait complete. 2026-02-13T20:15:29.031 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.019+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:15:29.031 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.019+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=15,config=2,health=13,kv=9,logm=61} crc {auth=1327220068,config=1618278320,health=1796179531,kv=3018006752,logm=3585190011}) 2026-02-13T20:15:29.031 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.019+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=16,config=1,health=11,kv=9,logm=63} crc {auth=2735605570,config=2457401934,health=3550663312,kv=420930087,logm=1550721785}) 2026-02-13T20:15:29.031 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.019+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:15:29.031 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.020+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=15,config=2,health=13,kv=9,logm=61} crc {auth=1327220068,config=1618278320,health=1796179531,kv=3018006752,logm=3585190011}) 2026-02-13T20:15:29.031 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.020+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=16,config=2,health=12,kv=11,logm=59} crc {auth=1043148718,config=1618278320,health=205293324,kv=1564860261,logm=724800645}) 2026-02-13T20:15:29.031 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.020+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:15:29.032 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.020+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2560989836}) 2026-02-13T20:15:29.032 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.020+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1507357625}) 2026-02-13T20:15:29.032 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.020+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:15:29.032 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.020+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2560989836}) 2026-02-13T20:15:29.032 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.020+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1486721643}) 2026-02-13T20:15:29.032 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.021+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:15:29.032 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.021+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2398360471}) 2026-02-13T20:15:29.032 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.021+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1043260966}) 2026-02-13T20:15:29.032 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.021+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:15:29.032 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.021+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2398360471}) 2026-02-13T20:15:29.032 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.021+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3094480620}) 2026-02-13T20:15:29.032 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.021+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:15:29.033 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.021+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=933097226}) 2026-02-13T20:15:29.033 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.021+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1406553119}) 2026-02-13T20:15:29.033 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.021+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:15:29.033 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.021+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=933097226}) 2026-02-13T20:15:29.033 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.021+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1221618859}) 2026-02-13T20:15:29.033 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.022+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:15:29.033 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.022+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=474938449}) 2026-02-13T20:15:29.033 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.022+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1581285649}) 2026-02-13T20:15:29.033 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.022+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:15:29.033 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.022+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=474938449}) 2026-02-13T20:15:29.033 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.022+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2690335588}) 2026-02-13T20:15:29.034 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.022+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:15:29.034 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.022+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=153903436}) 2026-02-13T20:15:29.034 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.022+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2041587213}) 2026-02-13T20:15:29.034 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.022+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:15:29.034 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.022+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=153903436}) 2026-02-13T20:15:29.034 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.022+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=735701440}) 2026-02-13T20:15:29.034 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.023+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:15:29.034 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.023+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3300048792}) 2026-02-13T20:15:29.034 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.023+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=456983113}) 2026-02-13T20:15:29.034 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.023+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:15:29.035 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.023+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3300048792}) 2026-02-13T20:15:29.035 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.023+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1968694867}) 2026-02-13T20:15:29.035 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.023+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:15:29.035 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.023+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1227967944}) 2026-02-13T20:15:29.035 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.023+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3597059376}) 2026-02-13T20:15:29.035 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.023+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:15:29.035 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.023+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1227967944}) 2026-02-13T20:15:29.035 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.023+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2094545734}) 2026-02-13T20:15:29.035 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.024+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:15:29.035 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.024+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=66,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=2} crc {logm=1197650758,mdsmap=3827184867,mgr=2881591711,mgr_command_descs=714296370,mgr_metadata=2819730505,mgrstat=2487593695,mon_config_key=3557484700,monmap=2677135861}) 2026-02-13T20:15:29.035 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.024+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=70,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=6} crc {logm=3258604128,mdsmap=3740562891,mgr=2881591710,mgr_command_descs=714296370,mgr_metadata=2819730505,mgrstat=650215833,mon_config_key=1465036090}) 2026-02-13T20:15:29.036 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.024+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:15:29.036 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.024+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=66,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=2} crc {logm=1197650758,mdsmap=3827184867,mgr=2881591711,mgr_command_descs=714296370,mgr_metadata=2819730505,mgrstat=2487593695,mon_config_key=3557484700,monmap=2677135861}) 2026-02-13T20:15:29.036 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.024+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=70,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=6} crc {logm=3554249282,mdsmap=3740562891,mgr=2881591710,mgr_command_descs=714296370,mgr_metadata=2819730505,mgrstat=650215833,mon_config_key=1465036090}) 2026-02-13T20:15:29.036 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.025+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:15:29.036 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.025+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {monmap=1,nvmeofgw=2,osd_metadata=6,osd_pg_creating=1,osd_snap=33,osdmap=57} crc {monmap=1228700967,nvmeofgw=935146538,osd_metadata=91123727,osd_pg_creating=3867609465,osd_snap=472222336,osdmap=1727447613}) 2026-02-13T20:15:29.036 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.025+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {monmap=1,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=37,osdmap=52} crc {monmap=1228700967,nvmeofgw=3360707892,osd_metadata=91123727,osd_pg_creating=3867609465,osd_snap=95001742,osdmap=1172820608}) 2026-02-13T20:15:29.036 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.025+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:15:29.036 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.025+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {monmap=1,nvmeofgw=2,osd_metadata=6,osd_pg_creating=1,osd_snap=33,osdmap=57} crc {monmap=1228700967,nvmeofgw=935146538,osd_metadata=91123727,osd_pg_creating=3867609465,osd_snap=472222336,osdmap=1727447613}) 2026-02-13T20:15:29.036 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.025+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {monmap=1,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=35,osdmap=54} crc {monmap=1228700967,nvmeofgw=3360707892,osd_metadata=91123727,osd_pg_creating=3867609465,osd_snap=2571913687,osdmap=2035782253}) 2026-02-13T20:15:29.036 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.025+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:15:29.036 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.025+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=497838675}) 2026-02-13T20:15:29.036 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.025+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4105826393}) 2026-02-13T20:15:29.037 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.025+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:15:29.037 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.025+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=497838675}) 2026-02-13T20:15:29.037 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.025+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2942129793}) 2026-02-13T20:15:29.037 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.026+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:15:29.037 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.026+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1970386388}) 2026-02-13T20:15:29.037 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.026+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1024068880}) 2026-02-13T20:15:29.037 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.026+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:15:29.037 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.026+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1970386388}) 2026-02-13T20:15:29.037 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.026+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3843472449}) 2026-02-13T20:15:29.037 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.028+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:15:29.037 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.028+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=59} crc {osdmap=4208184825}) 2026-02-13T20:15:29.037 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.028+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=59} crc {osdmap=3161039550}) 2026-02-13T20:15:29.038 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.028+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:15:29.038 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.028+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=59} crc {osdmap=4208184825}) 2026-02-13T20:15:29.038 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:15:29.028+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=58} crc {osdmap=3573464828}) 2026-02-13T20:15:29.039 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-13T20:15:29.055 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:15:29.105 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:15:29.156 INFO:tasks.rados.rados.0.trial188.stdout:900: done (2 left) 2026-02-13T20:15:29.156 INFO:tasks.rados.rados.0.trial188.stdout:901: done (1 left) 2026-02-13T20:15:29.156 INFO:tasks.rados.rados.0.trial188.stdout:902: done (0 left) 2026-02-13T20:15:29.156 INFO:tasks.rados.rados.0.trial188.stdout:903: copy_from oid 20 from oid 4 current snap is 94 2026-02-13T20:15:29.156 INFO:tasks.rados.rados.0.trial188.stdout:904: write (excl) oid 17 current snap is 94 2026-02-13T20:15:29.156 INFO:tasks.rados.rados.0.trial188.stdout:904: seq_num 344 ranges {581608=721541,1863688=485773,3113980=604043} 2026-02-13T20:15:29.160 INFO:tasks.rados.rados.0.trial188.stdout:904: writing trial18843701-17 from 581608 to 1303149 tid 1 2026-02-13T20:15:29.164 INFO:tasks.rados.rados.0.trial188.stdout:904: writing trial18843701-17 from 1863688 to 2349461 tid 2 2026-02-13T20:15:29.170 INFO:tasks.rados.rados.0.trial188.stdout:904: writing trial18843701-17 from 3113980 to 3718023 tid 3 2026-02-13T20:15:29.170 INFO:tasks.rados.rados.0.trial188.stdout:905: copy_from oid 9 from oid 35 current snap is 94 2026-02-13T20:15:29.170 INFO:tasks.rados.rados.0.trial188.stdout:906: write oid 8 current snap is 94 2026-02-13T20:15:29.170 INFO:tasks.rados.rados.0.trial188.stdout:906: seq_num 345 ranges {598415=796790,1922170=745784,3141403=415315} 2026-02-13T20:15:29.174 INFO:tasks.rados.rados.0.trial188.stdout:906: writing trial18843701-8 from 598415 to 1395205 tid 1 2026-02-13T20:15:29.179 INFO:tasks.rados.rados.0.trial188.stdout:906: writing trial18843701-8 from 1922170 to 2667954 tid 2 2026-02-13T20:15:29.183 INFO:tasks.rados.rados.0.trial188.stdout:906: writing trial18843701-8 from 3141403 to 3556718 tid 3 2026-02-13T20:15:29.183 INFO:tasks.rados.rados.0.trial188.stdout:907: read oid 33 snap -1 2026-02-13T20:15:29.183 INFO:tasks.rados.rados.0.trial188.stdout:907: expect deleted 2026-02-13T20:15:29.183 INFO:tasks.rados.rados.0.trial188.stdout:908: copy_from oid 13 from oid 1 current snap is 94 2026-02-13T20:15:29.183 INFO:tasks.rados.rados.0.trial188.stdout:909: write oid 48 current snap is 94 2026-02-13T20:15:29.184 INFO:tasks.rados.rados.0.trial188.stdout:909: seq_num 346 ranges {615222=472039,1580652=489442,2768826=626587} 2026-02-13T20:15:29.187 INFO:tasks.rados.rados.0.trial188.stdout:909: writing trial18843701-48 from 615222 to 1087261 tid 1 2026-02-13T20:15:29.190 INFO:tasks.rados.rados.0.trial188.stdout:909: writing trial18843701-48 from 1580652 to 2070094 tid 2 2026-02-13T20:15:29.195 INFO:tasks.rados.rados.0.trial188.stdout:909: writing trial18843701-48 from 2768826 to 3395413 tid 3 2026-02-13T20:15:29.196 INFO:tasks.rados.rados.0.trial188.stdout:910: write oid 32 current snap is 94 2026-02-13T20:15:29.196 INFO:tasks.rados.rados.0.trial188.stdout:910: seq_num 347 ranges {632029=547288,1639134=749453,2796249=437859,3653524=178505} 2026-02-13T20:15:29.200 INFO:tasks.rados.rados.0.trial188.stdout:910: writing trial18843701-32 from 632029 to 1179317 tid 1 2026-02-13T20:15:29.204 INFO:tasks.rados.rados.0.trial188.stdout:910: writing trial18843701-32 from 1639134 to 2388587 tid 2 2026-02-13T20:15:29.207 INFO:tasks.rados.rados.0.trial188.stdout:910: writing trial18843701-32 from 2796249 to 3234108 tid 3 2026-02-13T20:15:29.211 INFO:tasks.rados.rados.0.trial188.stdout:910: writing trial18843701-32 from 3653524 to 3832029 tid 4 2026-02-13T20:15:29.211 INFO:tasks.rados.rados.0.trial188.stdout:911: copy_from oid 38 from oid 30 current snap is 94 2026-02-13T20:15:29.211 INFO:tasks.rados.rados.0.trial188.stdout:904: finishing write tid 1 to trial18843701-17 2026-02-13T20:15:29.211 INFO:tasks.rados.rados.0.trial188.stdout:904: finishing write tid 2 to trial18843701-17 2026-02-13T20:15:29.212 INFO:tasks.rados.rados.0.trial188.stdout:904: finishing write tid 3 to trial18843701-17 2026-02-13T20:15:29.212 INFO:tasks.rados.rados.0.trial188.stdout:904: finishing write tid 4 to trial18843701-17 2026-02-13T20:15:29.212 INFO:tasks.rados.rados.0.trial188.stdout:904: finishing write tid 5 to trial18843701-17 2026-02-13T20:15:29.212 INFO:tasks.rados.rados.0.trial188.stdout:904: oid 17 updating version 0 to 375 2026-02-13T20:15:29.212 INFO:tasks.rados.rados.0.trial188.stdout:904: oid 17 version 375 is already newer than 374 2026-02-13T20:15:29.212 INFO:tasks.rados.rados.0.trial188.stdout:904: oid 17 updating version 375 to 376 2026-02-13T20:15:29.212 INFO:tasks.rados.rados.0.trial188.stdout:904: oid 17 version 376 is already newer than 373 2026-02-13T20:15:29.212 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 17 v 376 (ObjNum 344 snap 94 seq_num 344) dirty exists 2026-02-13T20:15:29.212 INFO:tasks.rados.rados.0.trial188.stdout:904: left oid 17 (ObjNum 344 snap 94 seq_num 344) 2026-02-13T20:15:29.212 INFO:tasks.rados.rados.0.trial188.stdout:903: finishing copy_from racing read to trial18843701-20 2026-02-13T20:15:29.213 INFO:tasks.rados.rados.0.trial188.stdout:903: finishing copy_from to trial18843701-20 2026-02-13T20:15:29.213 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 20 v 319 (ObjNum 323 snap 88 seq_num 323) dirty exists 2026-02-13T20:15:29.213 INFO:tasks.rados.rados.0.trial188.stdout:909: finishing write tid 1 to trial18843701-48 2026-02-13T20:15:29.213 INFO:tasks.rados.rados.0.trial188.stdout:909: finishing write tid 2 to trial18843701-48 2026-02-13T20:15:29.213 INFO:tasks.rados.rados.0.trial188.stdout:903: done (8 left) 2026-02-13T20:15:29.213 INFO:tasks.rados.rados.0.trial188.stdout:904: done (7 left) 2026-02-13T20:15:29.213 INFO:tasks.rados.rados.0.trial188.stdout:907: done (6 left) 2026-02-13T20:15:29.213 INFO:tasks.rados.rados.0.trial188.stdout:912: read oid 29 snap 93 2026-02-13T20:15:29.213 INFO:tasks.rados.rados.0.trial188.stdout:912: expect (ObjNum 336 snap 92 seq_num 336) 2026-02-13T20:15:29.213 INFO:tasks.rados.rados.0.trial188.stdout:913: read oid 31 snap -1 2026-02-13T20:15:29.213 INFO:tasks.rados.rados.0.trial188.stdout:913: expect (ObjNum 327 snap 90 seq_num 327) 2026-02-13T20:15:29.213 INFO:tasks.rados.rados.0.trial188.stdout:914: delete oid 44 current snap is 94 2026-02-13T20:15:29.214 INFO:tasks.rados.rados.0.trial188.stdout:905: finishing copy_from racing read to trial18843701-9 2026-02-13T20:15:29.220 INFO:tasks.rados.rados.0.trial188.stdout:906: finishing write tid 1 to trial18843701-8 2026-02-13T20:15:29.220 INFO:tasks.rados.rados.0.trial188.stdout:906: finishing write tid 2 to trial18843701-8 2026-02-13T20:15:29.220 INFO:tasks.rados.rados.0.trial188.stdout:905: finishing copy_from to trial18843701-9 2026-02-13T20:15:29.220 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 9 v 253 (ObjNum 313 snap 85 seq_num 313) dirty exists 2026-02-13T20:15:29.220 INFO:tasks.rados.rados.0.trial188.stdout:906: finishing write tid 3 to trial18843701-8 2026-02-13T20:15:29.221 INFO:tasks.rados.rados.0.trial188.stdout:912: expect (ObjNum 336 snap 92 seq_num 336) 2026-02-13T20:15:29.273 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:15:29.332 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:15:29.390 INFO:tasks.rados.rados.0.trial188.stdout:906: finishing write tid 4 to trial18843701-8 2026-02-13T20:15:29.391 INFO:tasks.rados.rados.0.trial188.stdout:906: finishing write tid 5 to trial18843701-8 2026-02-13T20:15:29.391 INFO:tasks.rados.rados.0.trial188.stdout:906: oid 8 updating version 0 to 344 2026-02-13T20:15:29.391 INFO:tasks.rados.rados.0.trial188.stdout:906: oid 8 version 344 is already newer than 343 2026-02-13T20:15:29.391 INFO:tasks.rados.rados.0.trial188.stdout:906: oid 8 version 344 is already newer than 341 2026-02-13T20:15:29.391 INFO:tasks.rados.rados.0.trial188.stdout:906: oid 8 version 344 is already newer than 342 2026-02-13T20:15:29.391 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 8 v 344 (ObjNum 345 snap 94 seq_num 345) dirty exists 2026-02-13T20:15:29.391 INFO:tasks.rados.rados.0.trial188.stdout:906: left oid 8 (ObjNum 345 snap 94 seq_num 345) 2026-02-13T20:15:29.391 INFO:tasks.rados.rados.0.trial188.stdout:908: finishing copy_from racing read to trial18843701-13 2026-02-13T20:15:29.391 INFO:tasks.rados.rados.0.trial188.stdout:913: expect (ObjNum 327 snap 90 seq_num 327) 2026-02-13T20:15:29.446 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:15:29.480 INFO:tasks.rados.rados.0.trial188.stdout:909: finishing write tid 3 to trial18843701-48 2026-02-13T20:15:29.480 INFO:tasks.rados.rados.0.trial188.stdout:905: done (8 left) 2026-02-13T20:15:29.480 INFO:tasks.rados.rados.0.trial188.stdout:906: done (7 left) 2026-02-13T20:15:29.480 INFO:tasks.rados.rados.0.trial188.stdout:912: done (6 left) 2026-02-13T20:15:29.480 INFO:tasks.rados.rados.0.trial188.stdout:913: done (5 left) 2026-02-13T20:15:29.480 INFO:tasks.rados.rados.0.trial188.stdout:914: done (4 left) 2026-02-13T20:15:29.480 INFO:tasks.rados.rados.0.trial188.stdout:915: delete oid 12 current snap is 94 2026-02-13T20:15:29.480 INFO:tasks.rados.rados.0.trial188.stdout:909: finishing write tid 4 to trial18843701-48 2026-02-13T20:15:29.481 INFO:tasks.rados.rados.0.trial188.stdout:909: finishing write tid 5 to trial18843701-48 2026-02-13T20:15:29.481 INFO:tasks.rados.rados.0.trial188.stdout:909: oid 48 updating version 0 to 169 2026-02-13T20:15:29.481 INFO:tasks.rados.rados.0.trial188.stdout:909: oid 48 version 169 is already newer than 168 2026-02-13T20:15:29.481 INFO:tasks.rados.rados.0.trial188.stdout:909: oid 48 updating version 169 to 171 2026-02-13T20:15:29.481 INFO:tasks.rados.rados.0.trial188.stdout:909: oid 48 version 171 is already newer than 170 2026-02-13T20:15:29.481 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 48 v 171 (ObjNum 346 snap 94 seq_num 346) dirty exists 2026-02-13T20:15:29.481 INFO:tasks.rados.rados.0.trial188.stdout:909: left oid 48 (ObjNum 346 snap 94 seq_num 346) 2026-02-13T20:15:29.481 INFO:tasks.rados.rados.0.trial188.stdout:910: finishing write tid 1 to trial18843701-32 2026-02-13T20:15:29.481 INFO:tasks.rados.rados.0.trial188.stdout:908: finishing copy_from to trial18843701-13 2026-02-13T20:15:29.481 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 13 v 383 (ObjNum 317 snap 86 seq_num 317) dirty exists 2026-02-13T20:15:29.481 INFO:tasks.rados.rados.0.trial188.stdout:910: finishing write tid 2 to trial18843701-32 2026-02-13T20:15:29.481 INFO:tasks.rados.rados.0.trial188.stdout:910: finishing write tid 3 to trial18843701-32 2026-02-13T20:15:29.482 INFO:tasks.rados.rados.0.trial188.stdout:910: finishing write tid 4 to trial18843701-32 2026-02-13T20:15:29.482 INFO:tasks.rados.rados.0.trial188.stdout:910: finishing write tid 5 to trial18843701-32 2026-02-13T20:15:29.482 INFO:tasks.rados.rados.0.trial188.stdout:910: finishing write tid 6 to trial18843701-32 2026-02-13T20:15:29.482 INFO:tasks.rados.rados.0.trial188.stdout:910: oid 32 updating version 0 to 334 2026-02-13T20:15:29.482 INFO:tasks.rados.rados.0.trial188.stdout:910: oid 32 version 334 is already newer than 331 2026-02-13T20:15:29.482 INFO:tasks.rados.rados.0.trial188.stdout:910: oid 32 version 334 is already newer than 333 2026-02-13T20:15:29.482 INFO:tasks.rados.rados.0.trial188.stdout:910: oid 32 updating version 334 to 335 2026-02-13T20:15:29.482 INFO:tasks.rados.rados.0.trial188.stdout:910: oid 32 version 335 is already newer than 332 2026-02-13T20:15:29.482 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 32 v 335 (ObjNum 347 snap 94 seq_num 347) dirty exists 2026-02-13T20:15:29.482 INFO:tasks.rados.rados.0.trial188.stdout:910: left oid 32 (ObjNum 347 snap 94 seq_num 347) 2026-02-13T20:15:29.482 INFO:tasks.rados.rados.0.trial188.stdout:911: finishing copy_from racing read to trial18843701-38 2026-02-13T20:15:29.482 INFO:tasks.rados.rados.0.trial188.stdout:911: finishing copy_from to trial18843701-38 2026-02-13T20:15:29.483 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 38 v 394 (ObjNum 326 snap 90 seq_num 326) dirty exists 2026-02-13T20:15:29.483 INFO:tasks.rados.rados.0.trial188.stdout:908: done (4 left) 2026-02-13T20:15:29.483 INFO:tasks.rados.rados.0.trial188.stdout:909: done (3 left) 2026-02-13T20:15:29.483 INFO:tasks.rados.rados.0.trial188.stdout:910: done (2 left) 2026-02-13T20:15:29.483 INFO:tasks.rados.rados.0.trial188.stdout:911: done (1 left) 2026-02-13T20:15:29.483 INFO:tasks.rados.rados.0.trial188.stdout:915: done (0 left) 2026-02-13T20:15:29.483 INFO:tasks.rados.rados.0.trial188.stdout:916: delete oid 25 current snap is 94 2026-02-13T20:15:29.485 INFO:tasks.rados.rados.0.trial188.stdout:916: done (0 left) 2026-02-13T20:15:29.485 INFO:tasks.rados.rados.0.trial188.stdout:917: read oid 46 snap -1 2026-02-13T20:15:29.485 INFO:tasks.rados.rados.0.trial188.stdout:917: expect deleted 2026-02-13T20:15:29.485 INFO:tasks.rados.rados.0.trial188.stdout:918: rollback oid 6 current snap is 94 2026-02-13T20:15:29.485 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 6 to 91 2026-02-13T20:15:29.485 INFO:tasks.rados.rados.0.trial188.stdout:919: delete oid 37 current snap is 94 2026-02-13T20:15:29.485 INFO:tasks.rados.rados.0.trial188.stdout:918: finishing rollback tid 0 to trial18843701-6 2026-02-13T20:15:29.485 INFO:tasks.rados.rados.0.trial188.stdout:917: done (2 left) 2026-02-13T20:15:29.485 INFO:tasks.rados.rados.0.trial188.stdout:919: done (1 left) 2026-02-13T20:15:29.485 INFO:tasks.rados.rados.0.trial188.stdout:920: read oid 8 snap -1 2026-02-13T20:15:29.486 INFO:tasks.rados.rados.0.trial188.stdout:920: expect (ObjNum 345 snap 94 seq_num 345) 2026-02-13T20:15:29.486 INFO:tasks.rados.rados.0.trial188.stdout:921: read oid 41 snap 82 2026-02-13T20:15:29.486 INFO:tasks.rados.rados.0.trial188.stdout:921: expect (ObjNum 187 snap 47 seq_num 187) 2026-02-13T20:15:29.486 INFO:tasks.rados.rados.0.trial188.stdout:922: write (excl) oid 25 current snap is 94 2026-02-13T20:15:29.486 INFO:tasks.rados.rados.0.trial188.stdout:918: finishing rollback tid 1 to trial18843701-6 2026-02-13T20:15:29.486 INFO:tasks.rados.rados.0.trial188.stdout:922: seq_num 352 ranges {716064=639886,1815191=500449,2817011=526925} 2026-02-13T20:15:29.488 INFO:tasks.rados.rados.0.trial188.stdout:922: writing trial18843701-25 from 716064 to 1355950 tid 1 2026-02-13T20:15:29.492 INFO:tasks.rados.rados.0.trial188.stdout:922: writing trial18843701-25 from 1815191 to 2315640 tid 2 2026-02-13T20:15:29.496 INFO:tasks.rados.rados.0.trial188.stdout:922: writing trial18843701-25 from 2817011 to 3343936 tid 3 2026-02-13T20:15:29.496 INFO:tasks.rados.rados.0.trial188.stdout:923: write oid 44 current snap is 94 2026-02-13T20:15:29.496 INFO:tasks.rados.rados.0.trial188.stdout:923: seq_num 353 ranges {732871=715135,1873673=644107,3244434=688437} 2026-02-13T20:15:29.501 INFO:tasks.rados.rados.0.trial188.stdout:923: writing trial18843701-44 from 732871 to 1448006 tid 1 2026-02-13T20:15:29.505 INFO:tasks.rados.rados.0.trial188.stdout:923: writing trial18843701-44 from 1873673 to 2517780 tid 2 2026-02-13T20:15:29.510 INFO:tasks.rados.rados.0.trial188.stdout:923: writing trial18843701-44 from 3244434 to 3932871 tid 3 2026-02-13T20:15:29.511 INFO:tasks.rados.rados.0.trial188.stdout:924: copy_from oid 34 from oid 39 current snap is 94 2026-02-13T20:15:29.511 INFO:tasks.rados.rados.0.trial188.stdout:925: write oid 31 current snap is 94 2026-02-13T20:15:29.511 INFO:tasks.rados.rados.0.trial188.stdout:925: seq_num 354 ranges {749678=790384,2332155=504118,3271857=549469} 2026-02-13T20:15:29.516 INFO:tasks.rados.rados.0.trial188.stdout:925: writing trial18843701-31 from 749678 to 1540062 tid 1 2026-02-13T20:15:29.521 INFO:tasks.rados.rados.0.trial188.stdout:925: writing trial18843701-31 from 2332155 to 2836273 tid 2 2026-02-13T20:15:29.525 INFO:tasks.rados.rados.0.trial188.stdout:925: writing trial18843701-31 from 3271857 to 3821326 tid 3 2026-02-13T20:15:29.525 INFO:tasks.rados.rados.0.trial188.stdout:926: write (excl) oid 18 current snap is 94 2026-02-13T20:15:29.525 INFO:tasks.rados.rados.0.trial188.stdout:926: seq_num 355 ranges {766485=465633,1990637=647776,3299280=667205} 2026-02-13T20:15:29.529 INFO:tasks.rados.rados.0.trial188.stdout:926: writing trial18843701-18 from 766485 to 1232118 tid 1 2026-02-13T20:15:29.535 INFO:tasks.rados.rados.0.trial188.stdout:926: writing trial18843701-18 from 1990637 to 2638413 tid 2 2026-02-13T20:15:29.540 INFO:tasks.rados.rados.0.trial188.stdout:926: writing trial18843701-18 from 3299280 to 3966485 tid 3 2026-02-13T20:15:29.541 INFO:tasks.rados.rados.0.trial188.stdout:927: write oid 22 current snap is 94 2026-02-13T20:15:29.541 INFO:tasks.rados.rados.0.trial188.stdout:927: seq_num 356 ranges {783292=540882,1932766=507787,3210350=572013} 2026-02-13T20:15:29.545 INFO:tasks.rados.rados.0.trial188.stdout:927: writing trial18843701-22 from 783292 to 1324174 tid 1 2026-02-13T20:15:29.550 INFO:tasks.rados.rados.0.trial188.stdout:927: writing trial18843701-22 from 1932766 to 2440553 tid 2 2026-02-13T20:15:29.555 INFO:tasks.rados.rados.0.trial188.stdout:927: writing trial18843701-22 from 3210350 to 3782363 tid 3 2026-02-13T20:15:29.555 INFO:tasks.rados.rados.0.trial188.stdout:928: write (excl) oid 24 current snap is 94 2026-02-13T20:15:29.555 INFO:tasks.rados.rados.0.trial188.stdout:918: finishing rollback tid 2 to trial18843701-6 2026-02-13T20:15:29.555 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 6 v 379 (ObjNum 266 snap 70 seq_num 266) dirty exists 2026-02-13T20:15:29.555 INFO:tasks.rados.rados.0.trial188.stdout:928: seq_num 357 ranges {400099=616131,1591248=408851} 2026-02-13T20:15:29.559 INFO:tasks.rados.rados.0.trial188.stdout:928: writing trial18843701-24 from 400099 to 1016230 tid 1 2026-02-13T20:15:29.562 INFO:tasks.rados.rados.0.trial188.stdout:928: writing trial18843701-24 from 1591248 to 2000099 tid 2 2026-02-13T20:15:29.563 INFO:tasks.rados.rados.0.trial188.stdout:918: done (9 left) 2026-02-13T20:15:29.563 INFO:tasks.rados.rados.0.trial188.stdout:929: snap_create 2026-02-13T20:15:29.563 INFO:tasks.rados.rados.0.trial188.stdout:920: expect (ObjNum 345 snap 94 seq_num 345) 2026-02-13T20:15:29.607 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:15:29.713 INFO:tasks.rados.rados.0.trial188.stdout:921: expect (ObjNum 187 snap 47 seq_num 187) 2026-02-13T20:15:29.808 INFO:tasks.rados.rados.0.trial188.stdout:922: finishing write tid 1 to trial18843701-25 2026-02-13T20:15:29.808 INFO:tasks.rados.rados.0.trial188.stdout:922: finishing write tid 2 to trial18843701-25 2026-02-13T20:15:29.808 INFO:tasks.rados.rados.0.trial188.stdout:922: finishing write tid 3 to trial18843701-25 2026-02-13T20:15:29.808 INFO:tasks.rados.rados.0.trial188.stdout:922: finishing write tid 4 to trial18843701-25 2026-02-13T20:15:29.808 INFO:tasks.rados.rados.0.trial188.stdout:922: finishing write tid 5 to trial18843701-25 2026-02-13T20:15:29.808 INFO:tasks.rados.rados.0.trial188.stdout:922: oid 25 updating version 0 to 420 2026-02-13T20:15:29.808 INFO:tasks.rados.rados.0.trial188.stdout:922: oid 25 version 420 is already newer than 418 2026-02-13T20:15:29.808 INFO:tasks.rados.rados.0.trial188.stdout:922: oid 25 version 420 is already newer than 419 2026-02-13T20:15:29.808 INFO:tasks.rados.rados.0.trial188.stdout:922: oid 25 version 420 is already newer than 417 2026-02-13T20:15:29.808 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 25 v 420 (ObjNum 352 snap 94 seq_num 352) dirty exists 2026-02-13T20:15:29.808 INFO:tasks.rados.rados.0.trial188.stdout:922: left oid 25 (ObjNum 352 snap 94 seq_num 352) 2026-02-13T20:15:29.808 INFO:tasks.rados.rados.0.trial188.stdout:923: finishing write tid 1 to trial18843701-44 2026-02-13T20:15:29.808 INFO:tasks.rados.rados.0.trial188.stdout:924: finishing copy_from racing read to trial18843701-34 2026-02-13T20:15:29.808 INFO:tasks.rados.rados.0.trial188.stdout:923: finishing write tid 2 to trial18843701-44 2026-02-13T20:15:29.808 INFO:tasks.rados.rados.0.trial188.stdout:923: finishing write tid 3 to trial18843701-44 2026-02-13T20:15:29.808 INFO:tasks.rados.rados.0.trial188.stdout:923: finishing write tid 4 to trial18843701-44 2026-02-13T20:15:29.808 INFO:tasks.rados.rados.0.trial188.stdout:923: finishing write tid 5 to trial18843701-44 2026-02-13T20:15:29.808 INFO:tasks.rados.rados.0.trial188.stdout:923: oid 44 updating version 0 to 402 2026-02-13T20:15:29.808 INFO:tasks.rados.rados.0.trial188.stdout:923: oid 44 updating version 402 to 403 2026-02-13T20:15:29.808 INFO:tasks.rados.rados.0.trial188.stdout:923: oid 44 version 403 is already newer than 401 2026-02-13T20:15:29.808 INFO:tasks.rados.rados.0.trial188.stdout:923: oid 44 version 403 is already newer than 400 2026-02-13T20:15:29.809 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 44 v 403 (ObjNum 353 snap 94 seq_num 353) dirty exists 2026-02-13T20:15:29.809 INFO:tasks.rados.rados.0.trial188.stdout:923: left oid 44 (ObjNum 353 snap 94 seq_num 353) 2026-02-13T20:15:29.809 INFO:tasks.rados.rados.0.trial188.stdout:924: finishing copy_from to trial18843701-34 2026-02-13T20:15:29.809 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 34 v 381 (ObjNum 339 snap 94 seq_num 339) dirty exists 2026-02-13T20:15:29.809 INFO:tasks.rados.rados.0.trial188.stdout:925: finishing write tid 1 to trial18843701-31 2026-02-13T20:15:29.809 INFO:tasks.rados.rados.0.trial188.stdout:925: finishing write tid 2 to trial18843701-31 2026-02-13T20:15:29.809 INFO:tasks.rados.rados.0.trial188.stdout:926: finishing write tid 1 to trial18843701-18 2026-02-13T20:15:29.809 INFO:tasks.rados.rados.0.trial188.stdout:925: finishing write tid 3 to trial18843701-31 2026-02-13T20:15:29.809 INFO:tasks.rados.rados.0.trial188.stdout:926: finishing write tid 2 to trial18843701-18 2026-02-13T20:15:29.809 INFO:tasks.rados.rados.0.trial188.stdout:925: finishing write tid 4 to trial18843701-31 2026-02-13T20:15:29.809 INFO:tasks.rados.rados.0.trial188.stdout:925: finishing write tid 5 to trial18843701-31 2026-02-13T20:15:29.809 INFO:tasks.rados.rados.0.trial188.stdout:925: oid 31 updating version 0 to 333 2026-02-13T20:15:29.809 INFO:tasks.rados.rados.0.trial188.stdout:925: oid 31 version 333 is already newer than 332 2026-02-13T20:15:29.809 INFO:tasks.rados.rados.0.trial188.stdout:925: oid 31 version 333 is already newer than 331 2026-02-13T20:15:29.809 INFO:tasks.rados.rados.0.trial188.stdout:925: oid 31 version 333 is already newer than 330 2026-02-13T20:15:29.809 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 31 v 333 (ObjNum 354 snap 94 seq_num 354) dirty exists 2026-02-13T20:15:29.809 INFO:tasks.rados.rados.0.trial188.stdout:925: left oid 31 (ObjNum 354 snap 94 seq_num 354) 2026-02-13T20:15:29.809 INFO:tasks.rados.rados.0.trial188.stdout:927: finishing write tid 1 to trial18843701-22 2026-02-13T20:15:29.809 INFO:tasks.rados.rados.0.trial188.stdout:927: finishing write tid 2 to trial18843701-22 2026-02-13T20:15:29.809 INFO:tasks.rados.rados.0.trial188.stdout:927: finishing write tid 3 to trial18843701-22 2026-02-13T20:15:29.809 INFO:tasks.rados.rados.0.trial188.stdout:927: finishing write tid 4 to trial18843701-22 2026-02-13T20:15:29.809 INFO:tasks.rados.rados.0.trial188.stdout:927: finishing write tid 5 to trial18843701-22 2026-02-13T20:15:29.809 INFO:tasks.rados.rados.0.trial188.stdout:927: oid 22 updating version 0 to 283 2026-02-13T20:15:29.809 INFO:tasks.rados.rados.0.trial188.stdout:927: oid 22 version 283 is already newer than 280 2026-02-13T20:15:29.809 INFO:tasks.rados.rados.0.trial188.stdout:927: oid 22 version 283 is already newer than 281 2026-02-13T20:15:29.809 INFO:tasks.rados.rados.0.trial188.stdout:927: oid 22 version 283 is already newer than 282 2026-02-13T20:15:29.809 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 22 v 283 (ObjNum 356 snap 94 seq_num 356) dirty exists 2026-02-13T20:15:29.809 INFO:tasks.rados.rados.0.trial188.stdout:927: left oid 22 (ObjNum 356 snap 94 seq_num 356) 2026-02-13T20:15:29.809 INFO:tasks.rados.rados.0.trial188.stdout:926: finishing write tid 3 to trial18843701-18 2026-02-13T20:15:29.809 INFO:tasks.rados.rados.0.trial188.stdout:926: finishing write tid 4 to trial18843701-18 2026-02-13T20:15:29.809 INFO:tasks.rados.rados.0.trial188.stdout:926: finishing write tid 5 to trial18843701-18 2026-02-13T20:15:29.809 INFO:tasks.rados.rados.0.trial188.stdout:926: oid 18 updating version 0 to 380 2026-02-13T20:15:29.809 INFO:tasks.rados.rados.0.trial188.stdout:926: oid 18 version 380 is already newer than 378 2026-02-13T20:15:29.809 INFO:tasks.rados.rados.0.trial188.stdout:926: oid 18 version 380 is already newer than 379 2026-02-13T20:15:29.809 INFO:tasks.rados.rados.0.trial188.stdout:926: oid 18 version 380 is already newer than 377 2026-02-13T20:15:29.809 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 18 v 380 (ObjNum 355 snap 94 seq_num 355) dirty exists 2026-02-13T20:15:29.809 INFO:tasks.rados.rados.0.trial188.stdout:926: left oid 18 (ObjNum 355 snap 94 seq_num 355) 2026-02-13T20:15:29.809 INFO:tasks.rados.rados.0.trial188.stdout:928: finishing write tid 1 to trial18843701-24 2026-02-13T20:15:29.810 INFO:tasks.rados.rados.0.trial188.stdout:928: finishing write tid 2 to trial18843701-24 2026-02-13T20:15:29.810 INFO:tasks.rados.rados.0.trial188.stdout:928: finishing write tid 3 to trial18843701-24 2026-02-13T20:15:29.810 INFO:tasks.rados.rados.0.trial188.stdout:928: finishing write tid 4 to trial18843701-24 2026-02-13T20:15:29.810 INFO:tasks.rados.rados.0.trial188.stdout:928: oid 24 updating version 0 to 382 2026-02-13T20:15:29.810 INFO:tasks.rados.rados.0.trial188.stdout:928: oid 24 version 382 is already newer than 381 2026-02-13T20:15:29.810 INFO:tasks.rados.rados.0.trial188.stdout:928: oid 24 updating version 382 to 383 2026-02-13T20:15:29.810 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 24 v 383 (ObjNum 357 snap 94 seq_num 357) dirty exists 2026-02-13T20:15:29.810 INFO:tasks.rados.rados.0.trial188.stdout:928: left oid 24 (ObjNum 357 snap 94 seq_num 357) 2026-02-13T20:15:29.898 INFO:tasks.rados.rados.0.trial188.stdout:920: done (9 left) 2026-02-13T20:15:29.898 INFO:tasks.rados.rados.0.trial188.stdout:921: done (8 left) 2026-02-13T20:15:29.898 INFO:tasks.rados.rados.0.trial188.stdout:922: done (7 left) 2026-02-13T20:15:29.898 INFO:tasks.rados.rados.0.trial188.stdout:923: done (6 left) 2026-02-13T20:15:29.898 INFO:tasks.rados.rados.0.trial188.stdout:924: done (5 left) 2026-02-13T20:15:29.898 INFO:tasks.rados.rados.0.trial188.stdout:925: done (4 left) 2026-02-13T20:15:29.898 INFO:tasks.rados.rados.0.trial188.stdout:926: done (3 left) 2026-02-13T20:15:29.898 INFO:tasks.rados.rados.0.trial188.stdout:927: done (2 left) 2026-02-13T20:15:29.898 INFO:tasks.rados.rados.0.trial188.stdout:928: done (1 left) 2026-02-13T20:15:29.898 INFO:tasks.rados.rados.0.trial188.stdout:929: done (0 left) 2026-02-13T20:15:29.898 INFO:tasks.rados.rados.0.trial188.stdout:930: delete oid 43 current snap is 95 2026-02-13T20:15:29.901 INFO:tasks.rados.rados.0.trial188.stdout:930: done (0 left) 2026-02-13T20:15:29.902 INFO:tasks.rados.rados.0.trial188.stdout:931: rollback oid 17 current snap is 95 2026-02-13T20:15:29.902 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 17 to 82 2026-02-13T20:15:29.902 INFO:tasks.rados.rados.0.trial188.stdout:932: read oid 23 snap 91 2026-02-13T20:15:29.902 INFO:tasks.rados.rados.0.trial188.stdout:932: expect (ObjNum 287 snap 74 seq_num 287) 2026-02-13T20:15:29.902 INFO:tasks.rados.rados.0.trial188.stdout:933: read oid 2 snap -1 2026-02-13T20:15:29.902 INFO:tasks.rados.rados.0.trial188.stdout:933: expect (ObjNum 259 snap 68 seq_num 259) 2026-02-13T20:15:29.902 INFO:tasks.rados.rados.0.trial188.stdout:934: copy_from oid 43 from oid 10 current snap is 95 2026-02-13T20:15:29.902 INFO:tasks.rados.rados.0.trial188.stdout:935: copy_from oid 28 from oid 25 current snap is 95 2026-02-13T20:15:29.902 INFO:tasks.rados.rados.0.trial188.stdout:936: write (excl) oid 24 current snap is 95 2026-02-13T20:15:29.903 INFO:tasks.rados.rados.0.trial188.stdout:936: seq_num 359 ranges {433713=482982,1424565=609148} 2026-02-13T20:15:29.905 INFO:tasks.rados.rados.0.trial188.stdout:936: writing trial18843701-24 from 433713 to 916695 tid 1 2026-02-13T20:15:29.909 INFO:tasks.rados.rados.0.trial188.stdout:936: writing trial18843701-24 from 1424565 to 2033713 tid 2 2026-02-13T20:15:29.909 INFO:tasks.rados.rados.0.trial188.stdout:937: write (excl) oid 35 current snap is 95 2026-02-13T20:15:29.909 INFO:tasks.rados.rados.0.trial188.stdout:937: seq_num 360 ranges {450520=558231,1483047=515125} 2026-02-13T20:15:29.912 INFO:tasks.rados.rados.0.trial188.stdout:937: writing trial18843701-35 from 450520 to 1008751 tid 1 2026-02-13T20:15:29.916 INFO:tasks.rados.rados.0.trial188.stdout:937: writing trial18843701-35 from 1483047 to 1998172 tid 2 2026-02-13T20:15:29.916 INFO:tasks.rados.rados.0.trial188.stdout:938: snap_remove snap 93 2026-02-13T20:15:30.039 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-13T20:15:30.040 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T20:15:30.104 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.102+0000 7ff93fc1b640 10 monclient: get_monmap_and_config 2026-02-13T20:15:30.104 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.102+0000 7ff93fc1b640 10 monclient: build_initial_monmap 2026-02-13T20:15:30.104 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.102+0000 7ff93fc1b640 10 monclient: monmap: 2026-02-13T20:15:30.104 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:15:30.105 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:30.105 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:15:30.104344+0000 2026-02-13T20:15:30.105 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:15:30.104344+0000 2026-02-13T20:15:30.105 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:15:30.105 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:30.105 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:15:30.105 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:15:30.105 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:15:30.105 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:30.106 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.103+0000 7ff93fc1b640 1 Processor -- start 2026-02-13T20:15:30.106 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.103+0000 7ff93fc1b640 1 -- start start 2026-02-13T20:15:30.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.103+0000 7ff93fc1b640 10 monclient: init 2026-02-13T20:15:30.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.103+0000 7ff93fc1b640 10 monclient: _reopen_session rank -1 2026-02-13T20:15:30.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.103+0000 7ff93fc1b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:15:30.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.103+0000 7ff93fc1b640 10 monclient(hunting): picked mon.noname-a con 0x7ff9381401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:15:30.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.103+0000 7ff93fc1b640 10 monclient(hunting): picked mon.noname-b con 0x7ff938092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:15:30.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.103+0000 7ff93fc1b640 10 monclient(hunting): picked mon.noname-c con 0x7ff938091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:15:30.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.103+0000 7ff93fc1b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff93808b730 con 0x7ff9381401c0 2026-02-13T20:15:30.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.103+0000 7ff93fc1b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff93805c5b0 con 0x7ff938091950 2026-02-13T20:15:30.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.103+0000 7ff93fc1b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff93808bcf0 con 0x7ff938092020 2026-02-13T20:15:30.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.103+0000 7ff93fc1b640 10 monclient(hunting): _renew_subs 2026-02-13T20:15:30.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.103+0000 7ff93fc1b640 10 monclient(hunting): authenticate will time out at 891.794735s 2026-02-13T20:15:30.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.103+0000 7ff93d990640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7ff9381401c0 0x7ff938091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:59484/0 (socket says 10.20.193.110:59484) 2026-02-13T20:15:30.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.103+0000 7ff93d990640 1 -- 10.20.193.110:0/2071092645 learned_addr learned my addr 10.20.193.110:0/2071092645 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:15:30.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.104+0000 7ff93c98e640 1 -- 10.20.193.110:0/2071092645 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2407689054 0 0) 0x7ff93808b730 con 0x7ff9381401c0 2026-02-13T20:15:30.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.104+0000 7ff93c98e640 10 monclient(hunting): _negotiate 2026-02-13T20:15:30.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.104+0000 7ff93c98e640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:30.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.104+0000 7ff93c98e640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:30.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.104+0000 7ff93c98e640 10 monclient(hunting): my global_id is 84243 2026-02-13T20:15:30.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.104+0000 7ff93c98e640 1 -- 10.20.193.110:0/2071092645 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9200035e0 con 0x7ff9381401c0 2026-02-13T20:15:30.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.104+0000 7ff93c98e640 1 -- 10.20.193.110:0/2071092645 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3338645108 0 0) 0x7ff93808bcf0 con 0x7ff938092020 2026-02-13T20:15:30.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.104+0000 7ff93c98e640 10 monclient(hunting): _negotiate 2026-02-13T20:15:30.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.104+0000 7ff93c98e640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:30.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.104+0000 7ff93c98e640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:30.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.104+0000 7ff93c98e640 10 monclient(hunting): my global_id is 94127 2026-02-13T20:15:30.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.104+0000 7ff93c98e640 1 -- 10.20.193.110:0/2071092645 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff93808b730 con 0x7ff938092020 2026-02-13T20:15:30.108 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.104+0000 7ff93c98e640 1 -- 10.20.193.110:0/2071092645 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 456547824 0 0) 0x7ff9200035e0 con 0x7ff9381401c0 2026-02-13T20:15:30.108 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.104+0000 7ff93c98e640 1 -- 10.20.193.110:0/2071092645 >> v1:10.20.193.110:6790/0 conn(0x7ff938092020 legacy=0x7ff9381812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:30.108 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.104+0000 7ff93c98e640 1 -- 10.20.193.110:0/2071092645 >> v1:10.20.193.188:6789/0 conn(0x7ff938091950 legacy=0x7ff9381a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:30.108 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.104+0000 7ff93c98e640 10 monclient: _finish_hunting 0 2026-02-13T20:15:30.108 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.104+0000 7ff93c98e640 1 monclient: found mon.noname-a 2026-02-13T20:15:30.108 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.104+0000 7ff93c98e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:15:30.108 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.104+0000 7ff93c98e640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:15:30.108 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.104+0000 7ff93c98e640 1 -- 10.20.193.110:0/2071092645 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff938140590 con 0x7ff9381401c0 2026-02-13T20:15:30.108 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.104+0000 7ff93c98e640 10 monclient: _finish_auth 0 2026-02-13T20:15:30.108 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.104+0000 7ff93c98e640 10 monclient: _check_auth_tickets 2026-02-13T20:15:30.108 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.104+0000 7ff93c98e640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:15:30.108 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.104+0000 7ff93c98e640 1 -- 10.20.193.110:0/2071092645 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff928002dd0 con 0x7ff9381401c0 2026-02-13T20:15:30.108 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.104+0000 7ff93c98e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:30.108 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.104+0000 7ff93c98e640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:15:30.108 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.104+0000 7ff93c98e640 10 monclient: dump: 2026-02-13T20:15:30.108 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:30.108 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:30.108 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.108 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.108 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:30.108 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:30.108 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:30.108 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:30.108 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:30.108 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:30.108 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.104+0000 7ff93fc1b640 5 monclient: authenticate success, global_id 84243 2026-02-13T20:15:30.108 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.104+0000 7ff93fc1b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:15:30.108 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.104+0000 7ff93c98e640 1 -- 10.20.193.110:0/2071092645 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff928002f60 con 0x7ff9381401c0 2026-02-13T20:15:30.109 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.104+0000 7ff93c98e640 10 monclient: handle_config config(0 keys) 2026-02-13T20:15:30.109 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.104+0000 7ff93fc1b640 10 monclient: get_monmap_and_config success 2026-02-13T20:15:30.109 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.104+0000 7ff93fc1b640 4 set_mon_vals no callback set 2026-02-13T20:15:30.109 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.104+0000 7ff93c98e640 1 -- 10.20.193.110:0/2071092645 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff928003370 con 0x7ff9381401c0 2026-02-13T20:15:30.109 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.104+0000 7ff93c98e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:30.109 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.104+0000 7ff93c98e640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:15:30.109 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.104+0000 7ff93c98e640 10 monclient: dump: 2026-02-13T20:15:30.109 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:30.109 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:30.109 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.109 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.109 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:30.109 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:30.109 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:30.109 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:30.109 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:30.109 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:30.109 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.104+0000 7ff93fc1b640 10 monclient: shutdown 2026-02-13T20:15:30.109 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.104+0000 7ff93fc1b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:15:30.109 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.104+0000 7ff93fc1b640 1 -- 10.20.193.110:0/2071092645 >> v1:10.20.193.110:6789/0 conn(0x7ff9381401c0 legacy=0x7ff938091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:30.109 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.104+0000 7ff93fc1b640 1 -- 10.20.193.110:0/2071092645 shutdown_connections 2026-02-13T20:15:30.109 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.104+0000 7ff93fc1b640 1 -- 10.20.193.110:0/2071092645 >> 10.20.193.110:0/2071092645 conn(0x7ff938054e90 msgr2=0x7ff938058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:15:30.109 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.104+0000 7ff93fc1b640 1 -- 10.20.193.110:0/2071092645 shutdown_connections 2026-02-13T20:15:30.109 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.104+0000 7ff93fc1b640 1 -- 10.20.193.110:0/2071092645 wait complete. 2026-02-13T20:15:30.109 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.105+0000 7ff93fc1b640 10 monclient: build_initial_monmap 2026-02-13T20:15:30.109 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.105+0000 7ff93fc1b640 10 monclient: monmap: 2026-02-13T20:15:30.109 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:15:30.109 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:15:30.109 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:15:30.110 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:15:30.110 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:15:30.110 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:15:30.110 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:15:30.110 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:15:30.110 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:15:30.110 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:30.110 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.105+0000 7ff93fc1b640 1 Processor -- start 2026-02-13T20:15:30.110 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.105+0000 7ff93fc1b640 1 -- start start 2026-02-13T20:15:30.110 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.105+0000 7ff93fc1b640 10 monclient: init 2026-02-13T20:15:30.112 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.105+0000 7ff93fc1b640 10 monclient: _reopen_session rank -1 2026-02-13T20:15:30.112 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.105+0000 7ff93fc1b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:15:30.112 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.105+0000 7ff93fc1b640 10 monclient(hunting): picked mon.noname-a con 0x7ff938091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:15:30.112 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.105+0000 7ff93fc1b640 10 monclient(hunting): picked mon.noname-c con 0x7ff9381401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:15:30.112 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.105+0000 7ff93fc1b640 10 monclient(hunting): picked mon.noname-b con 0x7ff9381948c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:15:30.112 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.105+0000 7ff93fc1b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff93805d320 con 0x7ff938091950 2026-02-13T20:15:30.112 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.105+0000 7ff93fc1b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff938132240 con 0x7ff9381948c0 2026-02-13T20:15:30.112 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.105+0000 7ff93fc1b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff938089c50 con 0x7ff9381401c0 2026-02-13T20:15:30.112 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.105+0000 7ff93fc1b640 10 monclient(hunting): _renew_subs 2026-02-13T20:15:30.112 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.105+0000 7ff93fc1b640 10 monclient(hunting): authenticate will time out at 891.796807s 2026-02-13T20:15:30.112 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.105+0000 7ff93d990640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7ff938091950 0x7ff938088e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:59498/0 (socket says 10.20.193.110:59498) 2026-02-13T20:15:30.112 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.105+0000 7ff93d990640 1 -- 10.20.193.110:0/3379366461 learned_addr learned my addr 10.20.193.110:0/3379366461 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:15:30.112 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.105+0000 7ff9267fc640 1 -- 10.20.193.110:0/3379366461 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3642137431 0 0) 0x7ff938089c50 con 0x7ff9381401c0 2026-02-13T20:15:30.112 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.105+0000 7ff9267fc640 10 monclient(hunting): _negotiate 2026-02-13T20:15:30.112 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.105+0000 7ff9267fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:30.112 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.105+0000 7ff9267fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:30.112 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.105+0000 7ff9267fc640 10 monclient(hunting): my global_id is 94130 2026-02-13T20:15:30.112 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.105+0000 7ff9267fc640 1 -- 10.20.193.110:0/3379366461 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9080035e0 con 0x7ff9381401c0 2026-02-13T20:15:30.112 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.105+0000 7ff9267fc640 1 -- 10.20.193.110:0/3379366461 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1685787747 0 0) 0x7ff93805d320 con 0x7ff938091950 2026-02-13T20:15:30.112 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.105+0000 7ff9267fc640 10 monclient(hunting): _negotiate 2026-02-13T20:15:30.112 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.106+0000 7ff9267fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:30.112 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.106+0000 7ff9267fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:30.112 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.106+0000 7ff9267fc640 10 monclient(hunting): my global_id is 84246 2026-02-13T20:15:30.112 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.106+0000 7ff9267fc640 1 -- 10.20.193.110:0/3379366461 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff938089c50 con 0x7ff938091950 2026-02-13T20:15:30.112 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.106+0000 7ff9267fc640 1 -- 10.20.193.110:0/3379366461 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 892789303 0 0) 0x7ff9080035e0 con 0x7ff9381401c0 2026-02-13T20:15:30.113 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.106+0000 7ff9267fc640 1 -- 10.20.193.110:0/3379366461 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff93805d320 con 0x7ff9381401c0 2026-02-13T20:15:30.113 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.106+0000 7ff9267fc640 1 -- 10.20.193.110:0/3379366461 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff92c003170 con 0x7ff9381401c0 2026-02-13T20:15:30.113 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.106+0000 7ff9267fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:15:30.113 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.106+0000 7ff9267fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:15:30.113 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.106+0000 7ff9267fc640 10 monclient(hunting): dump: 2026-02-13T20:15:30.113 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:30.113 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:30.113 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.113 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.113 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:30.113 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:30.113 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:30.113 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:30.113 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:30.113 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:30.113 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.106+0000 7ff9267fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:15:30.113 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.106+0000 7ff9267fc640 1 -- 10.20.193.110:0/3379366461 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1992712549 0 0) 0x7ff938089c50 con 0x7ff938091950 2026-02-13T20:15:30.113 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.106+0000 7ff9267fc640 1 -- 10.20.193.110:0/3379366461 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff9080035e0 con 0x7ff938091950 2026-02-13T20:15:30.113 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.106+0000 7ff9267fc640 1 -- 10.20.193.110:0/3379366461 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff928003280 con 0x7ff938091950 2026-02-13T20:15:30.113 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.106+0000 7ff9267fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:15:30.113 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.106+0000 7ff9267fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:15:30.113 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.106+0000 7ff9267fc640 10 monclient(hunting): dump: 2026-02-13T20:15:30.113 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:30.113 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:30.113 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.113 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.113 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:30.113 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:30.114 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:30.114 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:30.114 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:30.114 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:30.114 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.106+0000 7ff9267fc640 1 -- 10.20.193.110:0/3379366461 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3873571796 0 0) 0x7ff93805d320 con 0x7ff9381401c0 2026-02-13T20:15:30.114 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.106+0000 7ff9267fc640 1 -- 10.20.193.110:0/3379366461 >> v1:10.20.193.188:6789/0 conn(0x7ff9381948c0 legacy=0x7ff938194d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:30.114 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.106+0000 7ff9267fc640 1 -- 10.20.193.110:0/3379366461 >> v1:10.20.193.110:6789/0 conn(0x7ff938091950 legacy=0x7ff938088e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:30.114 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.106+0000 7ff9267fc640 10 monclient: _finish_hunting 0 2026-02-13T20:15:30.114 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.106+0000 7ff9267fc640 1 monclient: found mon.c 2026-02-13T20:15:30.114 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.106+0000 7ff9267fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:15:30.114 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.106+0000 7ff9267fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:15:30.114 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.106+0000 7ff9267fc640 1 -- 10.20.193.110:0/3379366461 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff938131f60 con 0x7ff9381401c0 2026-02-13T20:15:30.114 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.106+0000 7ff9267fc640 10 monclient: _finish_auth 0 2026-02-13T20:15:30.114 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.106+0000 7ff9267fc640 10 monclient: _check_auth_tickets 2026-02-13T20:15:30.114 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.106+0000 7ff9267fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:15:30.114 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.106+0000 7ff93fc1b640 5 monclient: authenticate success, global_id 94130 2026-02-13T20:15:30.114 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.106+0000 7ff93fc1b640 10 monclient: _renew_subs 2026-02-13T20:15:30.114 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.106+0000 7ff93fc1b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:15:30.114 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.106+0000 7ff93fc1b640 1 -- 10.20.193.110:0/3379366461 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff93813f1b0 con 0x7ff9381401c0 2026-02-13T20:15:30.114 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.106+0000 7ff93fc1b640 10 monclient: _renew_subs 2026-02-13T20:15:30.114 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.106+0000 7ff93fc1b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:15:30.114 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.106+0000 7ff93fc1b640 1 -- 10.20.193.110:0/3379366461 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7ff938196460 con 0x7ff9381401c0 2026-02-13T20:15:30.114 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.106+0000 7ff9267fc640 1 -- 10.20.193.110:0/3379366461 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff92c003580 con 0x7ff9381401c0 2026-02-13T20:15:30.114 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.106+0000 7ff9267fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:15:30.114 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.106+0000 7ff9267fc640 1 -- 10.20.193.110:0/3379366461 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff92c003960 con 0x7ff9381401c0 2026-02-13T20:15:30.114 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.106+0000 7ff9267fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:30.114 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.106+0000 7ff9267fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:15:30.114 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.106+0000 7ff9267fc640 10 monclient: dump: 2026-02-13T20:15:30.115 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:30.115 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:30.115 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.115 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.115 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:30.115 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:30.115 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:30.115 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:30.115 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:30.115 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:30.115 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.106+0000 7ff927fff640 4 set_mon_vals no callback set 2026-02-13T20:15:30.115 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.106+0000 7ff93fc1b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:15:30.115 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.106+0000 7ff93fc1b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:15:30.115 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.106+0000 7ff93fc1b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:15:30.115 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.106+0000 7ff9267fc640 1 -- 10.20.193.110:0/3379366461 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7ff92c003ac0 con 0x7ff9381401c0 2026-02-13T20:15:30.115 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.106+0000 7ff93fc1b640 1 -- 10.20.193.110:0/3379366461 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9381319a0 con 0x7ff9381401c0 2026-02-13T20:15:30.115 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.106+0000 7ff9267fc640 1 -- 10.20.193.110:0/3379366461 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(208..208 src has 1..208) ==== 3899+0+0 (unknown 164138633 0 0) 0x7ff92c04d690 con 0x7ff9381401c0 2026-02-13T20:15:30.115 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.107+0000 7ff93d990640 10 monclient: get_auth_request con 0x7ff90803fa50 auth_method 0 2026-02-13T20:15:30.115 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.109+0000 7ff9267fc640 1 -- 10.20.193.110:0/3379366461 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7ff92c005090 con 0x7ff9381401c0 2026-02-13T20:15:30.115 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.109+0000 7ff9267fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:15:30.115 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.109+0000 7ff9267fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:15:30.256 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.255+0000 7ff93fc1b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T20:15:30.257 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.255+0000 7ff93fc1b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T20:15:30.257 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.255+0000 7ff93fc1b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:15:30.257 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.255+0000 7ff93fc1b640 1 -- 10.20.193.110:0/3379366461 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7ff938090fa0 con 0x7ff9381401c0 2026-02-13T20:15:30.257 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.255+0000 7ff9267fc640 1 -- 10.20.193.110:0/3379366461 <== mon.2 v1:10.20.193.110:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 4054055018) 0x7ff938090fa0 con 0x7ff9381401c0 2026-02-13T20:15:30.257 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.255+0000 7ff9267fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T20:15:30.257 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.255+0000 7ff9267fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:15:30.257 INFO:teuthology.orchestra.run.trial110.stdout:{"election_epoch":16,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","modified":"2026-02-13T20:11:07.161192Z","created":"2026-02-13T20:11:07.161192Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6789","nonce":0}]},"addr":"10.20.193.110:6789/0","public_addr":"10.20.193.110:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161241+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6789","nonce":0}]},"addr":"10.20.193.188:6789/0","public_addr":"10.20.193.188:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161242+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6790","nonce":0}]},"addr":"10.20.193.110:6790/0","public_addr":"10.20.193.110:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161243+0000","crush_location":[]}]}} 2026-02-13T20:15:30.258 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.256+0000 7ff93fc1b640 1 -- 10.20.193.110:0/3379366461 >> v1:10.20.193.188:6812/1623052694 conn(0x7ff90803fa50 legacy=0x7ff90805ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:30.258 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.256+0000 7ff93fc1b640 10 monclient: shutdown 2026-02-13T20:15:30.258 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.256+0000 7ff93fc1b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:15:30.259 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.256+0000 7ff93fc1b640 1 -- 10.20.193.110:0/3379366461 >> v1:10.20.193.110:6790/0 conn(0x7ff9381401c0 legacy=0x7ff938089540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:30.259 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.256+0000 7ff93fc1b640 1 -- 10.20.193.110:0/3379366461 shutdown_connections 2026-02-13T20:15:30.259 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.256+0000 7ff93fc1b640 1 -- 10.20.193.110:0/3379366461 >> 10.20.193.110:0/3379366461 conn(0x7ff938054e90 msgr2=0x7ff93808dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:15:30.259 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.256+0000 7ff93fc1b640 1 -- 10.20.193.110:0/3379366461 shutdown_connections 2026-02-13T20:15:30.259 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.256+0000 7ff93fc1b640 1 -- 10.20.193.110:0/3379366461 wait complete. 2026-02-13T20:15:30.266 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-13T20:15:30.266 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-13T20:15:30.266 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-13T20:15:30.266 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T20:15:30.345 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.329+0000 7f6f89b0c640 10 monclient: get_monmap_and_config 2026-02-13T20:15:30.346 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.329+0000 7f6f89b0c640 10 monclient: build_initial_monmap 2026-02-13T20:15:30.346 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.329+0000 7f6f89b0c640 10 monclient: monmap: 2026-02-13T20:15:30.346 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:15:30.346 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:30.346 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:15:30.330795+0000 2026-02-13T20:15:30.346 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:15:30.330795+0000 2026-02-13T20:15:30.346 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:15:30.346 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:30.347 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:15:30.347 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:15:30.347 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:15:30.347 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:30.347 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.329+0000 7f6f89b0c640 1 Processor -- start 2026-02-13T20:15:30.347 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.329+0000 7f6f89b0c640 1 -- start start 2026-02-13T20:15:30.347 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.329+0000 7f6f89b0c640 10 monclient: init 2026-02-13T20:15:30.347 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.330+0000 7f6f89b0c640 10 monclient: _reopen_session rank -1 2026-02-13T20:15:30.347 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.330+0000 7f6f89b0c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:15:30.347 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.330+0000 7f6f89b0c640 10 monclient(hunting): picked mon.noname-c con 0x7f6f841401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:15:30.347 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.330+0000 7f6f89b0c640 10 monclient(hunting): picked mon.noname-b con 0x7f6f84092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:15:30.347 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.330+0000 7f6f89b0c640 10 monclient(hunting): picked mon.noname-a con 0x7f6f84091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:15:30.348 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.330+0000 7f6f89b0c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f8408b730 con 0x7f6f84091950 2026-02-13T20:15:30.348 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.330+0000 7f6f89b0c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f8405c5b0 con 0x7f6f841401c0 2026-02-13T20:15:30.348 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.330+0000 7f6f89b0c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f8408bcf0 con 0x7f6f84092020 2026-02-13T20:15:30.348 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.330+0000 7f6f89b0c640 10 monclient(hunting): _renew_subs 2026-02-13T20:15:30.348 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.330+0000 7f6f89b0c640 10 monclient(hunting): authenticate will time out at 892.021172s 2026-02-13T20:15:30.348 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.330+0000 7f6f83fff640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f6f84091950 0x7f6f841a2a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:59512/0 (socket says 10.20.193.110:59512) 2026-02-13T20:15:30.348 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.330+0000 7f6f83fff640 1 -- 10.20.193.110:0/1409956923 learned_addr learned my addr 10.20.193.110:0/1409956923 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:15:30.348 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.330+0000 7f6f827fc640 1 -- 10.20.193.110:0/1409956923 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3176413766 0 0) 0x7f6f8408b730 con 0x7f6f84091950 2026-02-13T20:15:30.348 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.330+0000 7f6f827fc640 10 monclient(hunting): _negotiate 2026-02-13T20:15:30.348 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.330+0000 7f6f827fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:30.348 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.330+0000 7f6f827fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:30.349 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.330+0000 7f6f827fc640 10 monclient(hunting): my global_id is 84249 2026-02-13T20:15:30.349 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.330+0000 7f6f827fc640 1 -- 10.20.193.110:0/1409956923 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f680035e0 con 0x7f6f84091950 2026-02-13T20:15:30.349 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.330+0000 7f6f827fc640 1 -- 10.20.193.110:0/1409956923 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2458231104 0 0) 0x7f6f8408bcf0 con 0x7f6f84092020 2026-02-13T20:15:30.349 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.330+0000 7f6f827fc640 10 monclient(hunting): _negotiate 2026-02-13T20:15:30.349 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.330+0000 7f6f827fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:30.349 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.330+0000 7f6f827fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:30.349 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.330+0000 7f6f827fc640 10 monclient(hunting): my global_id is 94133 2026-02-13T20:15:30.349 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.330+0000 7f6f827fc640 1 -- 10.20.193.110:0/1409956923 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f8408b730 con 0x7f6f84092020 2026-02-13T20:15:30.349 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.330+0000 7f6f827fc640 1 -- 10.20.193.110:0/1409956923 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1568301237 0 0) 0x7f6f8408b730 con 0x7f6f84092020 2026-02-13T20:15:30.349 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.330+0000 7f6f827fc640 1 -- 10.20.193.110:0/1409956923 >> v1:10.20.193.188:6789/0 conn(0x7f6f841401c0 legacy=0x7f6f84091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:30.349 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.330+0000 7f6f827fc640 1 -- 10.20.193.110:0/1409956923 >> v1:10.20.193.110:6789/0 conn(0x7f6f84091950 legacy=0x7f6f841a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:30.350 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.330+0000 7f6f827fc640 10 monclient: _finish_hunting 0 2026-02-13T20:15:30.350 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.330+0000 7f6f827fc640 1 monclient: found mon.noname-b 2026-02-13T20:15:30.350 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.330+0000 7f6f827fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:15:30.350 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.330+0000 7f6f827fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:15:30.350 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.330+0000 7f6f827fc640 1 -- 10.20.193.110:0/1409956923 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f84140590 con 0x7f6f84092020 2026-02-13T20:15:30.350 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.330+0000 7f6f827fc640 10 monclient: _finish_auth 0 2026-02-13T20:15:30.350 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.330+0000 7f6f827fc640 10 monclient: _check_auth_tickets 2026-02-13T20:15:30.350 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.330+0000 7f6f827fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:15:30.350 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.330+0000 7f6f827fc640 1 -- 10.20.193.110:0/1409956923 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f6f74002dd0 con 0x7f6f84092020 2026-02-13T20:15:30.350 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.330+0000 7f6f89b0c640 5 monclient: authenticate success, global_id 94133 2026-02-13T20:15:30.350 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.330+0000 7f6f89b0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:15:30.350 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.330+0000 7f6f827fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:30.350 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.330+0000 7f6f827fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:15:30.351 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.330+0000 7f6f827fc640 10 monclient: dump: 2026-02-13T20:15:30.351 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:30.351 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:30.351 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.351 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.351 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:30.351 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:30.351 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:30.351 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:30.351 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:30.351 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:30.351 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.330+0000 7f6f89b0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:15:30.352 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.330+0000 7f6f827fc640 1 -- 10.20.193.110:0/1409956923 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6f74002f60 con 0x7f6f84092020 2026-02-13T20:15:30.352 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.330+0000 7f6f827fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:15:30.352 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.330+0000 7f6f89b0c640 10 monclient: get_monmap_and_config success 2026-02-13T20:15:30.352 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.330+0000 7f6f827fc640 1 -- 10.20.193.110:0/1409956923 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f6f740032f0 con 0x7f6f84092020 2026-02-13T20:15:30.352 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.330+0000 7f6f89b0c640 4 set_mon_vals no callback set 2026-02-13T20:15:30.352 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.330+0000 7f6f827fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:30.352 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.330+0000 7f6f827fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:15:30.352 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.330+0000 7f6f827fc640 10 monclient: dump: 2026-02-13T20:15:30.352 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:30.352 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:30.352 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.352 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.353 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:30.353 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:30.353 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:30.353 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:30.353 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:30.353 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:30.353 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.331+0000 7f6f89b0c640 10 monclient: shutdown 2026-02-13T20:15:30.353 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.331+0000 7f6f89b0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:15:30.353 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.331+0000 7f6f89b0c640 1 -- 10.20.193.110:0/1409956923 >> v1:10.20.193.110:6790/0 conn(0x7f6f84092020 legacy=0x7f6f841812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:30.353 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.331+0000 7f6f89b0c640 1 -- 10.20.193.110:0/1409956923 shutdown_connections 2026-02-13T20:15:30.353 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.331+0000 7f6f89b0c640 1 -- 10.20.193.110:0/1409956923 >> 10.20.193.110:0/1409956923 conn(0x7f6f84054e90 msgr2=0x7f6f84058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:15:30.353 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.331+0000 7f6f89b0c640 1 -- 10.20.193.110:0/1409956923 shutdown_connections 2026-02-13T20:15:30.353 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.331+0000 7f6f89b0c640 1 -- 10.20.193.110:0/1409956923 wait complete. 2026-02-13T20:15:30.354 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.331+0000 7f6f89b0c640 10 monclient: build_initial_monmap 2026-02-13T20:15:30.354 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.331+0000 7f6f89b0c640 10 monclient: monmap: 2026-02-13T20:15:30.354 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:15:30.354 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:15:30.354 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:15:30.354 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:15:30.354 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:15:30.354 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:15:30.354 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:15:30.354 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:15:30.354 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:15:30.354 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:30.354 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.331+0000 7f6f89b0c640 1 Processor -- start 2026-02-13T20:15:30.355 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.331+0000 7f6f89b0c640 1 -- start start 2026-02-13T20:15:30.355 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.331+0000 7f6f89b0c640 10 monclient: init 2026-02-13T20:15:30.355 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.331+0000 7f6f89b0c640 10 monclient: _reopen_session rank -1 2026-02-13T20:15:30.355 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.331+0000 7f6f89b0c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:15:30.355 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.331+0000 7f6f89b0c640 10 monclient(hunting): picked mon.noname-a con 0x7f6f84091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:15:30.355 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.331+0000 7f6f89b0c640 10 monclient(hunting): picked mon.noname-c con 0x7f6f841401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:15:30.355 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.331+0000 7f6f89b0c640 10 monclient(hunting): picked mon.noname-b con 0x7f6f8413ee00 addr v1:10.20.193.188:6789/0 2026-02-13T20:15:30.355 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.331+0000 7f6f89b0c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f8408c380 con 0x7f6f84091950 2026-02-13T20:15:30.355 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.331+0000 7f6f89b0c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f841300f0 con 0x7f6f8413ee00 2026-02-13T20:15:30.355 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.331+0000 7f6f89b0c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f8405d320 con 0x7f6f841401c0 2026-02-13T20:15:30.355 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.331+0000 7f6f89b0c640 10 monclient(hunting): _renew_subs 2026-02-13T20:15:30.355 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.331+0000 7f6f89b0c640 10 monclient(hunting): authenticate will time out at 892.022959s 2026-02-13T20:15:30.355 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f82ffd640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f6f841401c0 0x7f6f8413e6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:42990/0 (socket says 10.20.193.110:42990) 2026-02-13T20:15:30.355 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f82ffd640 1 -- 10.20.193.110:0/3903516867 learned_addr learned my addr 10.20.193.110:0/3903516867 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:15:30.356 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f5ffff640 1 -- 10.20.193.110:0/3903516867 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3863211501 0 0) 0x7f6f8405d320 con 0x7f6f841401c0 2026-02-13T20:15:30.356 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f5ffff640 10 monclient(hunting): _negotiate 2026-02-13T20:15:30.356 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f5ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:30.356 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f5ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:30.356 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f5ffff640 10 monclient(hunting): my global_id is 94136 2026-02-13T20:15:30.356 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f5ffff640 1 -- 10.20.193.110:0/3903516867 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f540035e0 con 0x7f6f841401c0 2026-02-13T20:15:30.356 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f5ffff640 1 -- 10.20.193.110:0/3903516867 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1715059295 0 0) 0x7f6f8405c5b0 con 0x7f6f84091950 2026-02-13T20:15:30.356 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f5ffff640 10 monclient(hunting): _negotiate 2026-02-13T20:15:30.356 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f5ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:30.356 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f5ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:30.356 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f5ffff640 10 monclient(hunting): my global_id is 84252 2026-02-13T20:15:30.356 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f5ffff640 1 -- 10.20.193.110:0/3903516867 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f8405d320 con 0x7f6f84091950 2026-02-13T20:15:30.356 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f5ffff640 1 -- 10.20.193.110:0/3903516867 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4279520629 0 0) 0x7f6f540035e0 con 0x7f6f841401c0 2026-02-13T20:15:30.356 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f5ffff640 1 -- 10.20.193.110:0/3903516867 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6f8405c5b0 con 0x7f6f841401c0 2026-02-13T20:15:30.357 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f5ffff640 1 -- 10.20.193.110:0/3903516867 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f6f740035a0 con 0x7f6f841401c0 2026-02-13T20:15:30.357 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f5ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:15:30.357 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f5ffff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:15:30.357 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f5ffff640 10 monclient(hunting): dump: 2026-02-13T20:15:30.357 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:30.357 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:30.357 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.357 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.357 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:30.357 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:30.357 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:30.357 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:30.357 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:30.357 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:30.357 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f5ffff640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:15:30.358 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f5ffff640 1 -- 10.20.193.110:0/3903516867 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 463499484 0 0) 0x7f6f8405d320 con 0x7f6f84091950 2026-02-13T20:15:30.358 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f5ffff640 1 -- 10.20.193.110:0/3903516867 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6f540035e0 con 0x7f6f84091950 2026-02-13T20:15:30.358 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f5ffff640 1 -- 10.20.193.110:0/3903516867 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f6f70003070 con 0x7f6f84091950 2026-02-13T20:15:30.358 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f5ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:15:30.358 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f5ffff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:15:30.358 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f5ffff640 10 monclient(hunting): dump: 2026-02-13T20:15:30.358 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:30.358 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:30.358 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.358 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.358 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:30.358 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:30.358 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:30.358 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:30.358 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:30.359 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:30.359 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f5ffff640 1 -- 10.20.193.110:0/3903516867 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2067053497 0 0) 0x7f6f8405c5b0 con 0x7f6f841401c0 2026-02-13T20:15:30.359 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f5ffff640 1 -- 10.20.193.110:0/3903516867 >> v1:10.20.193.188:6789/0 conn(0x7f6f8413ee00 legacy=0x7f6f84192810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:30.359 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f5ffff640 1 -- 10.20.193.110:0/3903516867 >> v1:10.20.193.110:6789/0 conn(0x7f6f84091950 legacy=0x7f6f841504a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:30.359 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f5ffff640 10 monclient: _finish_hunting 0 2026-02-13T20:15:30.359 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f5ffff640 1 monclient: found mon.c 2026-02-13T20:15:30.359 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f5ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:15:30.359 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f5ffff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:15:30.359 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f5ffff640 1 -- 10.20.193.110:0/3903516867 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f8412eed0 con 0x7f6f841401c0 2026-02-13T20:15:30.359 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f5ffff640 10 monclient: _finish_auth 0 2026-02-13T20:15:30.359 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f5ffff640 10 monclient: _check_auth_tickets 2026-02-13T20:15:30.359 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f5ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:15:30.359 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f89b0c640 5 monclient: authenticate success, global_id 94136 2026-02-13T20:15:30.359 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f89b0c640 10 monclient: _renew_subs 2026-02-13T20:15:30.359 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f89b0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:15:30.360 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f89b0c640 1 -- 10.20.193.110:0/3903516867 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6f8412dd90 con 0x7f6f841401c0 2026-02-13T20:15:30.360 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f89b0c640 10 monclient: _renew_subs 2026-02-13T20:15:30.360 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f89b0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:15:30.360 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f89b0c640 1 -- 10.20.193.110:0/3903516867 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f6f8412fec0 con 0x7f6f841401c0 2026-02-13T20:15:30.360 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f5ffff640 1 -- 10.20.193.110:0/3903516867 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6f74003a80 con 0x7f6f841401c0 2026-02-13T20:15:30.360 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f5ffff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:15:30.360 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f5ffff640 1 -- 10.20.193.110:0/3903516867 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f6f74003e20 con 0x7f6f841401c0 2026-02-13T20:15:30.360 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f5ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:30.360 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f5ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:15:30.360 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f5ffff640 10 monclient: dump: 2026-02-13T20:15:30.360 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:30.360 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:30.360 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.360 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.360 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:30.361 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:30.361 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:30.361 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:30.361 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:30.361 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:30.361 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f81ffb640 4 set_mon_vals no callback set 2026-02-13T20:15:30.361 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f89b0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:15:30.361 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f89b0c640 1 -- 10.20.193.110:0/3903516867 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6f840008d0 con 0x7f6f84092020 2026-02-13T20:15:30.361 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.332+0000 7f6f5ffff640 1 -- 10.20.193.110:0/3903516867 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f6f74003f80 con 0x7f6f841401c0 2026-02-13T20:15:30.361 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.333+0000 7f6f5ffff640 1 -- 10.20.193.110:0/3903516867 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4282818618 0 0) 0x7f6f840008d0 con 0x7f6f84092020 2026-02-13T20:15:30.361 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.333+0000 7f6f5ffff640 10 monclient(hunting): _negotiate 2026-02-13T20:15:30.361 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.333+0000 7f6f5ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:30.361 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.333+0000 7f6f5ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:30.361 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.333+0000 7f6f5ffff640 10 monclient(hunting): my global_id is 84255 2026-02-13T20:15:30.361 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.333+0000 7f6f5ffff640 1 -- 10.20.193.110:0/3903516867 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f8405c5b0 con 0x7f6f84092020 2026-02-13T20:15:30.362 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.333+0000 7f6f5ffff640 1 -- 10.20.193.110:0/3903516867 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(208..208 src has 1..208) ==== 3899+0+0 (unknown 164138633 0 0) 0x7f6f7404eab0 con 0x7f6f841401c0 2026-02-13T20:15:30.362 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.333+0000 7f6f5ffff640 1 -- 10.20.193.110:0/3903516867 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3880764292 0 0) 0x7f6f8405c5b0 con 0x7f6f84092020 2026-02-13T20:15:30.362 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.333+0000 7f6f5ffff640 1 -- 10.20.193.110:0/3903516867 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6f840008d0 con 0x7f6f84092020 2026-02-13T20:15:30.362 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.333+0000 7f6f5ffff640 1 -- 10.20.193.110:0/3903516867 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f6f70003880 con 0x7f6f84092020 2026-02-13T20:15:30.362 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.333+0000 7f6f83fff640 10 monclient: get_auth_request con 0x7f6f5403fa00 auth_method 0 2026-02-13T20:15:30.362 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.333+0000 7f6f5ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:30.362 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.333+0000 7f6f5ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:15:30.362 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.333+0000 7f6f5ffff640 10 monclient: dump: 2026-02-13T20:15:30.362 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:30.362 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:30.362 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.362 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.362 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:30.362 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:30.362 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:30.362 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:30.362 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:30.363 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:30.363 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.333+0000 7f6f5ffff640 1 -- 10.20.193.110:0/3903516867 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4026522337 0 0) 0x7f6f840008d0 con 0x7f6f84092020 2026-02-13T20:15:30.363 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.333+0000 7f6f5ffff640 1 -- 10.20.193.110:0/3903516867 --> v1:10.20.193.110:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6f8408b450 con 0x7f6f84092020 2026-02-13T20:15:30.363 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.333+0000 7f6f5ffff640 1 -- 10.20.193.110:0/3903516867 <== mon.0 v1:10.20.193.110:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f6f70003540 con 0x7f6f84092020 2026-02-13T20:15:30.363 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.333+0000 7f6f5ffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:15:30.363 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.333+0000 7f6f5ffff640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:15:30.363 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.333+0000 7f6f5ffff640 1 -- 10.20.193.110:0/3903516867 >> v1:10.20.193.110:6789/0 conn(0x7f6f84092020 legacy=0x7f6f84127b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:30.363 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.333+0000 7f6f5ffff640 1 -- 10.20.193.110:0/3903516867 >> v1:10.20.193.110:6789/0 conn(0x7f6f84092020 legacy=0x7f6f84127b20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:15:30.363 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.337+0000 7f6f89b0c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:15:30.363 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.337+0000 7f6f89b0c640 1 -- 10.20.193.110:0/3903516867 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6f84058410 con 0x7f6f84128230 2026-02-13T20:15:30.363 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.337+0000 7f6f5ffff640 1 -- 10.20.193.110:0/3903516867 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2453107854 0 0) 0x7f6f84058410 con 0x7f6f84128230 2026-02-13T20:15:30.363 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.337+0000 7f6f5ffff640 10 monclient(hunting): _negotiate 2026-02-13T20:15:30.363 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.337+0000 7f6f5ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:30.363 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.337+0000 7f6f5ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:30.363 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.337+0000 7f6f5ffff640 10 monclient(hunting): my global_id is 84258 2026-02-13T20:15:30.363 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.337+0000 7f6f5ffff640 1 -- 10.20.193.110:0/3903516867 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f840008d0 con 0x7f6f84128230 2026-02-13T20:15:30.364 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.337+0000 7f6f5ffff640 1 -- 10.20.193.110:0/3903516867 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 26266681 0 0) 0x7f6f840008d0 con 0x7f6f84128230 2026-02-13T20:15:30.364 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.337+0000 7f6f5ffff640 1 -- 10.20.193.110:0/3903516867 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6f84058410 con 0x7f6f84128230 2026-02-13T20:15:30.364 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.337+0000 7f6f5ffff640 1 -- 10.20.193.110:0/3903516867 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f6f70005200 con 0x7f6f84128230 2026-02-13T20:15:30.364 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.337+0000 7f6f5ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:30.364 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.337+0000 7f6f5ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:15:30.364 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.337+0000 7f6f5ffff640 10 monclient: dump: 2026-02-13T20:15:30.364 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:30.364 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:30.364 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.364 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.364 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:30.364 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:30.364 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:30.364 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:30.364 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:30.364 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:30.364 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.337+0000 7f6f5ffff640 1 -- 10.20.193.110:0/3903516867 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2986075680 0 0) 0x7f6f84058410 con 0x7f6f84128230 2026-02-13T20:15:30.365 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.337+0000 7f6f5ffff640 1 -- 10.20.193.110:0/3903516867 --> v1:10.20.193.110:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6f840561b0 con 0x7f6f84128230 2026-02-13T20:15:30.365 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.337+0000 7f6f5ffff640 1 -- 10.20.193.110:0/3903516867 <== mon.0 v1:10.20.193.110:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4514 (unknown 0 0 2686599145) 0x7f6f700056c0 con 0x7f6f84128230 2026-02-13T20:15:30.365 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.337+0000 7f6f5ffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:15:30.365 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.337+0000 7f6f5ffff640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:15:30.365 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.337+0000 7f6f5ffff640 1 -- 10.20.193.110:0/3903516867 >> v1:10.20.193.110:6789/0 conn(0x7f6f84128230 legacy=0x7f6f84194fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:30.365 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.337+0000 7f6f5ffff640 1 -- 10.20.193.110:0/3903516867 >> v1:10.20.193.110:6789/0 conn(0x7f6f84128230 legacy=0x7f6f84194fa0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:15:30.365 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:15:30.365 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:15:30.365 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:15:30.365 INFO:teuthology.orchestra.run.trial110.stdout: "state": "peon", 2026-02-13T20:15:30.366 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 16, 2026-02-13T20:15:30.366 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 124428, 2026-02-13T20:15:30.366 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:15:30.366 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:15:30.366 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:15:30.366 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:15:30.366 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:15:30.366 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 1, 2026-02-13T20:15:30.366 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:15:30.366 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:15:30.366 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:15:30.366 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:15:30.366 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:15:30.366 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:15:30.366 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:15:30.366 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:15:30.366 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:15:30.367 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:15:30.367 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:15:30.367 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:15:30.367 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:15:30.367 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:15:30.367 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:15:30.367 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:15:30.367 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:15:30.367 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:15:30.367 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:15:30.367 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:15:30.367 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:15:30.367 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:15:30.367 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:15:30.367 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:15:30.367 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:15:30.367 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:15:30.368 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:15:30.368 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:15:30.368 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:15:30.368 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:15:30.368 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:15:30.368 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:15:30.368 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:15:30.368 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:30.368 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:15:30.368 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:15:30.368 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:15:30.368 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:15:30.368 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:15:30.368 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:15:30.368 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:15:30.368 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:15:30.368 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:15:30.368 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:15:30.369 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:15:30.369 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:15:30.369 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:15:30.369 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:15:30.369 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:15:30.369 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:15:30.369 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:15:30.369 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:15:30.369 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:15:30.369 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:15:30.369 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:15:30.369 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:15:30.369 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:15:30.369 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:15:30.369 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:15:30.369 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:15:30.369 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:15:30.369 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:15:30.370 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:15:30.370 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:15:30.370 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:15:30.370 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:15:30.370 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:30.370 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:15:30.370 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:30.370 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:15:30.370 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:15:30.370 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:15:30.370 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:15:30.370 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:30.370 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:15:30.370 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:15:30.370 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:15:30.370 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:30.370 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:15:30.370 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:30.371 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:15:30.371 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:15:30.371 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:15:30.371 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:15:30.371 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:15:30.371 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:15:30.371 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:30.371 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:30.371 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:15:30.371 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:15:30.371 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:15:30.371 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:15:30.371 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:30.371 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:15:30.371 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:15:30.371 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:15:30.371 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:30.371 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:15:30.371 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:30.372 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:15:30.372 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:15:30.372 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:15:30.372 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:15:30.372 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:15:30.372 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:15:30.372 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:30.372 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:30.372 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:15:30.372 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:15:30.372 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:15:30.372 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:15:30.372 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:30.372 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:15:30.372 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:15:30.372 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:15:30.372 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:30.372 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:15:30.372 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:30.372 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:15:30.373 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:15:30.373 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:15:30.373 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:15:30.373 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:15:30.373 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:15:30.373 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:30.373 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:15:30.373 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:30.373 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:15:30.373 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:15:30.373 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:30.373 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:15:30.373 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:15:30.373 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:15:30.373 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:30.373 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:15:30.373 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:15:30.373 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:30.373 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:15:30.373 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:15:30.374 INFO:teuthology.orchestra.run.trial110.stdout: "num": 2 2026-02-13T20:15:30.374 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:30.374 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:15:30.374 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:15:30.374 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:30.374 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:15:30.374 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:15:30.374 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:15:30.374 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:30.374 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:15:30.374 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:30.374 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:15:30.374 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:15:30.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.338+0000 7f6f89b0c640 1 -- 10.20.193.110:0/3903516867 >> v1:10.20.193.188:6812/1623052694 conn(0x7f6f5403fa00 legacy=0x7f6f5405feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:30.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.338+0000 7f6f89b0c640 10 monclient: shutdown 2026-02-13T20:15:30.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.338+0000 7f6f89b0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:15:30.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.338+0000 7f6f89b0c640 1 -- 10.20.193.110:0/3903516867 >> v1:10.20.193.110:6790/0 conn(0x7f6f841401c0 legacy=0x7f6f8413e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:30.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.338+0000 7f6f83fff640 1 -- 10.20.193.110:0/3903516867 reap_dead start 2026-02-13T20:15:30.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.338+0000 7f6f89b0c640 1 -- 10.20.193.110:0/3903516867 shutdown_connections 2026-02-13T20:15:30.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.338+0000 7f6f89b0c640 1 -- 10.20.193.110:0/3903516867 >> 10.20.193.110:0/3903516867 conn(0x7f6f84054e90 msgr2=0x7f6f8408dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:15:30.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.338+0000 7f6f89b0c640 1 -- 10.20.193.110:0/3903516867 shutdown_connections 2026-02-13T20:15:30.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.338+0000 7f6f89b0c640 1 -- 10.20.193.110:0/3903516867 wait complete. 2026-02-13T20:15:30.376 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:15:30.376 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-13T20:15:30.376 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T20:15:30.444 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.440+0000 7f7001bc2640 10 monclient: get_monmap_and_config 2026-02-13T20:15:30.445 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.440+0000 7f7001bc2640 10 monclient: build_initial_monmap 2026-02-13T20:15:30.445 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.440+0000 7f7001bc2640 10 monclient: monmap: 2026-02-13T20:15:30.445 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:15:30.445 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:30.445 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:15:30.442133+0000 2026-02-13T20:15:30.445 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:15:30.442133+0000 2026-02-13T20:15:30.445 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:15:30.445 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:30.445 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:15:30.445 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:15:30.445 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:15:30.445 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:30.445 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.441+0000 7f7001bc2640 1 Processor -- start 2026-02-13T20:15:30.445 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.441+0000 7f7001bc2640 1 -- start start 2026-02-13T20:15:30.445 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.441+0000 7f7001bc2640 10 monclient: init 2026-02-13T20:15:30.446 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.441+0000 7f7001bc2640 10 monclient: _reopen_session rank -1 2026-02-13T20:15:30.446 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.441+0000 7f7001bc2640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:15:30.446 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.441+0000 7f7001bc2640 10 monclient(hunting): picked mon.noname-b con 0x7f6ffc1401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:15:30.446 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.441+0000 7f7001bc2640 10 monclient(hunting): picked mon.noname-a con 0x7f6ffc092020 addr v1:10.20.193.110:6789/0 2026-02-13T20:15:30.446 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.441+0000 7f7001bc2640 10 monclient(hunting): picked mon.noname-c con 0x7f6ffc091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:15:30.446 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.441+0000 7f7001bc2640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ffc08b730 con 0x7f6ffc092020 2026-02-13T20:15:30.446 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.441+0000 7f7001bc2640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ffc05c5b0 con 0x7f6ffc091950 2026-02-13T20:15:30.446 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.441+0000 7f7001bc2640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ffc08bcf0 con 0x7f6ffc1401c0 2026-02-13T20:15:30.446 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.441+0000 7f7001bc2640 10 monclient(hunting): _renew_subs 2026-02-13T20:15:30.446 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.441+0000 7f7001bc2640 10 monclient(hunting): authenticate will time out at 892.132504s 2026-02-13T20:15:30.446 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.441+0000 7f6ffb7fe640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f6ffc1401c0 0x7f6ffc091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:42992/0 (socket says 10.20.193.110:42992) 2026-02-13T20:15:30.446 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.441+0000 7f6ffb7fe640 1 -- 10.20.193.110:0/1513761028 learned_addr learned my addr 10.20.193.110:0/1513761028 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:15:30.446 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.441+0000 7f6ffaffd640 1 --1- 10.20.193.110:0/1513761028 >> v1:10.20.193.110:6789/0 conn(0x7f6ffc092020 0x7f6ffc1812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:59538/0 (socket says 10.20.193.110:59538) 2026-02-13T20:15:30.446 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.441+0000 7f6ffa7fc640 1 -- 10.20.193.110:0/1513761028 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3276262462 0 0) 0x7f6ffc08b730 con 0x7f6ffc092020 2026-02-13T20:15:30.446 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.441+0000 7f6ffa7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:15:30.446 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.441+0000 7f6ffa7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:30.446 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.441+0000 7f6ffa7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:30.446 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.441+0000 7f6ffa7fc640 10 monclient(hunting): my global_id is 84261 2026-02-13T20:15:30.446 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.441+0000 7f6ffa7fc640 1 -- 10.20.193.110:0/1513761028 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fe00035e0 con 0x7f6ffc092020 2026-02-13T20:15:30.446 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.441+0000 7f6ffa7fc640 1 -- 10.20.193.110:0/1513761028 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1320974252 0 0) 0x7f6ffc08bcf0 con 0x7f6ffc1401c0 2026-02-13T20:15:30.447 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.441+0000 7f6ffa7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:15:30.447 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.441+0000 7f6ffa7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:30.447 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.441+0000 7f6ffa7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:30.447 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.441+0000 7f6ffa7fc640 10 monclient(hunting): my global_id is 94139 2026-02-13T20:15:30.447 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.441+0000 7f6ffa7fc640 1 -- 10.20.193.110:0/1513761028 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ffc08b730 con 0x7f6ffc1401c0 2026-02-13T20:15:30.447 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.442+0000 7f6ffa7fc640 1 -- 10.20.193.110:0/1513761028 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4140047894 0 0) 0x7f6fe00035e0 con 0x7f6ffc092020 2026-02-13T20:15:30.447 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.442+0000 7f6ffa7fc640 1 -- 10.20.193.110:0/1513761028 >> v1:10.20.193.110:6790/0 conn(0x7f6ffc1401c0 legacy=0x7f6ffc091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:30.447 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.442+0000 7f6ffa7fc640 1 -- 10.20.193.110:0/1513761028 >> v1:10.20.193.188:6789/0 conn(0x7f6ffc091950 legacy=0x7f6ffc1a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T20:15:30.447 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.442+0000 7f6ffa7fc640 10 monclient: _finish_hunting 0 2026-02-13T20:15:30.447 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.442+0000 7f6ffa7fc640 1 monclient: found mon.noname-a 2026-02-13T20:15:30.447 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.442+0000 7f6ffa7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:15:30.447 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.442+0000 7f6ffa7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:15:30.447 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.442+0000 7f6ffa7fc640 1 -- 10.20.193.110:0/1513761028 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ffc140590 con 0x7f6ffc092020 2026-02-13T20:15:30.447 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.442+0000 7f6ffa7fc640 10 monclient: _finish_auth 0 2026-02-13T20:15:30.447 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.442+0000 7f6ffa7fc640 10 monclient: _check_auth_tickets 2026-02-13T20:15:30.447 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.442+0000 7f6ffa7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:15:30.447 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.442+0000 7f6ffa7fc640 1 -- 10.20.193.110:0/1513761028 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f6fec002dd0 con 0x7f6ffc092020 2026-02-13T20:15:30.447 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.442+0000 7f6ffa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:30.447 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.442+0000 7f6ffa7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:15:30.447 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.442+0000 7f6ffa7fc640 10 monclient: dump: 2026-02-13T20:15:30.447 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:30.448 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:30.448 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.448 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.448 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:30.448 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:30.448 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:30.448 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:30.448 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:30.448 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:30.448 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.442+0000 7f7001bc2640 5 monclient: authenticate success, global_id 84261 2026-02-13T20:15:30.448 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.442+0000 7f7001bc2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:15:30.448 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.442+0000 7f6ffa7fc640 1 -- 10.20.193.110:0/1513761028 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6fec002fa0 con 0x7f6ffc092020 2026-02-13T20:15:30.448 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.442+0000 7f6ffa7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:15:30.448 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.442+0000 7f6ffa7fc640 1 -- 10.20.193.110:0/1513761028 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f6fec0033b0 con 0x7f6ffc092020 2026-02-13T20:15:30.448 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.442+0000 7f6ffa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:30.448 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.442+0000 7f6ffa7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:15:30.448 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.442+0000 7f6ffa7fc640 10 monclient: dump: 2026-02-13T20:15:30.448 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:30.448 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:30.448 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.448 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.448 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:30.449 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:30.449 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:30.449 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:30.449 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:30.449 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:30.449 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.442+0000 7f7001bc2640 10 monclient: get_monmap_and_config success 2026-02-13T20:15:30.449 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.442+0000 7f7001bc2640 4 set_mon_vals no callback set 2026-02-13T20:15:30.449 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.442+0000 7f7001bc2640 10 monclient: shutdown 2026-02-13T20:15:30.449 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.442+0000 7f7001bc2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:15:30.449 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.442+0000 7f7001bc2640 1 -- 10.20.193.110:0/1513761028 >> v1:10.20.193.110:6789/0 conn(0x7f6ffc092020 legacy=0x7f6ffc1812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:30.449 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.442+0000 7f7001bc2640 1 -- 10.20.193.110:0/1513761028 shutdown_connections 2026-02-13T20:15:30.449 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.442+0000 7f7001bc2640 1 -- 10.20.193.110:0/1513761028 >> 10.20.193.110:0/1513761028 conn(0x7f6ffc054e90 msgr2=0x7f6ffc058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:15:30.449 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.442+0000 7f7001bc2640 1 -- 10.20.193.110:0/1513761028 shutdown_connections 2026-02-13T20:15:30.449 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.442+0000 7f7001bc2640 1 -- 10.20.193.110:0/1513761028 wait complete. 2026-02-13T20:15:30.449 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.443+0000 7f7001bc2640 10 monclient: build_initial_monmap 2026-02-13T20:15:30.449 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.443+0000 7f7001bc2640 10 monclient: monmap: 2026-02-13T20:15:30.449 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:15:30.449 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:15:30.449 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:15:30.449 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:15:30.450 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:15:30.450 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:15:30.450 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:15:30.450 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:15:30.450 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:15:30.450 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:30.450 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.443+0000 7f7001bc2640 1 Processor -- start 2026-02-13T20:15:30.450 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.443+0000 7f7001bc2640 1 -- start start 2026-02-13T20:15:30.450 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.443+0000 7f7001bc2640 10 monclient: init 2026-02-13T20:15:30.453 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.443+0000 7f7001bc2640 10 monclient: _reopen_session rank -1 2026-02-13T20:15:30.453 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.443+0000 7f7001bc2640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:15:30.453 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.443+0000 7f7001bc2640 10 monclient(hunting): picked mon.noname-c con 0x7f6ffc091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:15:30.453 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.443+0000 7f7001bc2640 10 monclient(hunting): picked mon.noname-a con 0x7f6ffc1401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:15:30.453 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.443+0000 7f7001bc2640 10 monclient(hunting): picked mon.noname-b con 0x7f6ffc116300 addr v1:10.20.193.188:6789/0 2026-02-13T20:15:30.453 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.443+0000 7f7001bc2640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ffc124b50 con 0x7f6ffc1401c0 2026-02-13T20:15:30.453 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.443+0000 7f7001bc2640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ffc12f650 con 0x7f6ffc116300 2026-02-13T20:15:30.453 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.443+0000 7f7001bc2640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ffc113bc0 con 0x7f6ffc091950 2026-02-13T20:15:30.453 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.443+0000 7f7001bc2640 10 monclient(hunting): _renew_subs 2026-02-13T20:15:30.453 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.443+0000 7f7001bc2640 10 monclient(hunting): authenticate will time out at 892.134587s 2026-02-13T20:15:30.453 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.443+0000 7f6ffb7fe640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f6ffc091950 0x7f6ffc112da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:43002/0 (socket says 10.20.193.110:43002) 2026-02-13T20:15:30.454 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.443+0000 7f6ffb7fe640 1 -- 10.20.193.110:0/3816108663 learned_addr learned my addr 10.20.193.110:0/3816108663 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:15:30.454 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.443+0000 7f6fd7fff640 1 -- 10.20.193.110:0/3816108663 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3615165076 0 0) 0x7f6ffc113bc0 con 0x7f6ffc091950 2026-02-13T20:15:30.454 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.443+0000 7f6fd7fff640 10 monclient(hunting): _negotiate 2026-02-13T20:15:30.454 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.443+0000 7f6fd7fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:30.454 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.443+0000 7f6fd7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:30.454 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.443+0000 7f6fd7fff640 10 monclient(hunting): my global_id is 94142 2026-02-13T20:15:30.454 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.443+0000 7f6fd7fff640 1 -- 10.20.193.110:0/3816108663 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fcc0035e0 con 0x7f6ffc091950 2026-02-13T20:15:30.454 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.443+0000 7f6fd7fff640 1 -- 10.20.193.110:0/3816108663 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3957635642 0 0) 0x7f6ffc124b50 con 0x7f6ffc1401c0 2026-02-13T20:15:30.454 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.443+0000 7f6fd7fff640 10 monclient(hunting): _negotiate 2026-02-13T20:15:30.454 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.443+0000 7f6fd7fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:30.454 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.443+0000 7f6fd7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:30.454 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.443+0000 7f6fd7fff640 10 monclient(hunting): my global_id is 84264 2026-02-13T20:15:30.454 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.443+0000 7f6fd7fff640 1 -- 10.20.193.110:0/3816108663 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ffc113bc0 con 0x7f6ffc1401c0 2026-02-13T20:15:30.454 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.443+0000 7f6fd7fff640 1 -- 10.20.193.110:0/3816108663 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1043469456 0 0) 0x7f6fcc0035e0 con 0x7f6ffc091950 2026-02-13T20:15:30.454 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.443+0000 7f6fd7fff640 1 -- 10.20.193.110:0/3816108663 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6ffc124b50 con 0x7f6ffc091950 2026-02-13T20:15:30.454 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.443+0000 7f6fd7fff640 1 -- 10.20.193.110:0/3816108663 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f6fe80030d0 con 0x7f6ffc091950 2026-02-13T20:15:30.454 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.443+0000 7f6fd7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:15:30.454 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.443+0000 7f6fd7fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:15:30.454 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.443+0000 7f6fd7fff640 10 monclient(hunting): dump: 2026-02-13T20:15:30.454 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:30.454 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:30.455 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.455 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.455 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:30.455 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:30.455 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:30.455 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:30.455 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:30.455 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:30.455 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.443+0000 7f6fd7fff640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:15:30.455 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.443+0000 7f6fd7fff640 1 -- 10.20.193.110:0/3816108663 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4164850700 0 0) 0x7f6ffc113bc0 con 0x7f6ffc1401c0 2026-02-13T20:15:30.455 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.443+0000 7f6fd7fff640 1 -- 10.20.193.110:0/3816108663 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6fcc0035e0 con 0x7f6ffc1401c0 2026-02-13T20:15:30.455 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.443+0000 7f6fd7fff640 1 -- 10.20.193.110:0/3816108663 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f6fec002ce0 con 0x7f6ffc1401c0 2026-02-13T20:15:30.455 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.443+0000 7f6fd7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:15:30.455 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.444+0000 7f6fd7fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:15:30.455 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.444+0000 7f6fd7fff640 10 monclient(hunting): dump: 2026-02-13T20:15:30.455 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:30.455 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:30.455 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.455 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.455 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:30.455 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:30.455 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:30.456 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:30.456 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:30.456 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:30.456 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.444+0000 7f6fd7fff640 1 -- 10.20.193.110:0/3816108663 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1381008976 0 0) 0x7f6ffc124b50 con 0x7f6ffc091950 2026-02-13T20:15:30.456 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.444+0000 7f6fd7fff640 1 -- 10.20.193.110:0/3816108663 >> v1:10.20.193.188:6789/0 conn(0x7f6ffc116300 legacy=0x7f6ffc1a2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:30.456 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.444+0000 7f6fd7fff640 1 -- 10.20.193.110:0/3816108663 >> v1:10.20.193.110:6789/0 conn(0x7f6ffc1401c0 legacy=0x7f6ffc1134b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:30.456 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.444+0000 7f6fd7fff640 10 monclient: _finish_hunting 0 2026-02-13T20:15:30.456 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.444+0000 7f6fd7fff640 1 monclient: found mon.c 2026-02-13T20:15:30.456 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.444+0000 7f6fd7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:15:30.456 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.444+0000 7f6fd7fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:15:30.456 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.444+0000 7f6fd7fff640 1 -- 10.20.193.110:0/3816108663 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ffc08c2a0 con 0x7f6ffc091950 2026-02-13T20:15:30.456 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.444+0000 7f6fd7fff640 10 monclient: _finish_auth 0 2026-02-13T20:15:30.456 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.444+0000 7f6fd7fff640 10 monclient: _check_auth_tickets 2026-02-13T20:15:30.456 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.444+0000 7f6fd7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:15:30.456 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.444+0000 7f7001bc2640 5 monclient: authenticate success, global_id 94142 2026-02-13T20:15:30.456 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.444+0000 7f7001bc2640 10 monclient: _renew_subs 2026-02-13T20:15:30.456 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.444+0000 7f7001bc2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:15:30.456 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.444+0000 7f7001bc2640 1 -- 10.20.193.110:0/3816108663 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6ffc05d320 con 0x7f6ffc091950 2026-02-13T20:15:30.456 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.444+0000 7f7001bc2640 10 monclient: _renew_subs 2026-02-13T20:15:30.456 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.444+0000 7f7001bc2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:15:30.456 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.444+0000 7f7001bc2640 1 -- 10.20.193.110:0/3816108663 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f6ffc12e190 con 0x7f6ffc091950 2026-02-13T20:15:30.457 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.444+0000 7f6fd7fff640 1 -- 10.20.193.110:0/3816108663 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6fe80048a0 con 0x7f6ffc091950 2026-02-13T20:15:30.457 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.444+0000 7f6fd7fff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:15:30.457 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.444+0000 7f6fd7fff640 1 -- 10.20.193.110:0/3816108663 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f6fe8004bc0 con 0x7f6ffc091950 2026-02-13T20:15:30.457 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.444+0000 7f6fd7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:30.457 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.444+0000 7f6fd7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:15:30.457 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.444+0000 7f6fd7fff640 10 monclient: dump: 2026-02-13T20:15:30.457 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:30.457 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:30.457 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.457 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.457 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:30.457 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:30.457 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:30.457 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:30.457 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:30.457 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:30.457 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.444+0000 7f6ff9ffb640 4 set_mon_vals no callback set 2026-02-13T20:15:30.457 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.444+0000 7f7001bc2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:15:30.457 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.444+0000 7f7001bc2640 1 -- 10.20.193.110:0/3816108663 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6ffc12f0d0 con 0x7f6ffc092020 2026-02-13T20:15:30.457 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.444+0000 7f6fd7fff640 1 -- 10.20.193.110:0/3816108663 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4134838156 0 0) 0x7f6fcc0035e0 con 0x7f6ffc092020 2026-02-13T20:15:30.457 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.444+0000 7f6fd7fff640 10 monclient(hunting): _negotiate 2026-02-13T20:15:30.458 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.444+0000 7f6fd7fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:30.458 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.444+0000 7f6fd7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:30.458 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.444+0000 7f6fd7fff640 10 monclient(hunting): my global_id is 94145 2026-02-13T20:15:30.458 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.444+0000 7f6fd7fff640 1 -- 10.20.193.110:0/3816108663 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ffc124b50 con 0x7f6ffc092020 2026-02-13T20:15:30.458 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.444+0000 7f6fd7fff640 1 -- 10.20.193.110:0/3816108663 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f6fe8011830 con 0x7f6ffc091950 2026-02-13T20:15:30.458 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.444+0000 7f6fd7fff640 1 -- 10.20.193.110:0/3816108663 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(208..208 src has 1..208) ==== 3899+0+0 (unknown 164138633 0 0) 0x7f6fe804e960 con 0x7f6ffc091950 2026-02-13T20:15:30.458 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.444+0000 7f6fd7fff640 1 -- 10.20.193.110:0/3816108663 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 307370568 0 0) 0x7f6ffc124b50 con 0x7f6ffc092020 2026-02-13T20:15:30.458 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.444+0000 7f6fd7fff640 1 -- 10.20.193.110:0/3816108663 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6fcc0035e0 con 0x7f6ffc092020 2026-02-13T20:15:30.458 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.444+0000 7f6fd7fff640 1 -- 10.20.193.110:0/3816108663 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f6fec002e40 con 0x7f6ffc092020 2026-02-13T20:15:30.458 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.444+0000 7f6fd7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:30.458 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.444+0000 7f6fd7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:15:30.458 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.444+0000 7f6fd7fff640 10 monclient: dump: 2026-02-13T20:15:30.458 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:30.458 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:30.458 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.458 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.458 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:30.458 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:30.458 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:30.458 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:30.458 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:30.459 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:30.459 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.444+0000 7f6fd7fff640 1 -- 10.20.193.110:0/3816108663 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3606239637 0 0) 0x7f6fcc0035e0 con 0x7f6ffc092020 2026-02-13T20:15:30.459 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.444+0000 7f6fd7fff640 1 -- 10.20.193.110:0/3816108663 --> v1:10.20.193.110:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6ffc08a920 con 0x7f6ffc092020 2026-02-13T20:15:30.459 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.445+0000 7f6ffbfff640 10 monclient: get_auth_request con 0x7f6fcc03fb10 auth_method 0 2026-02-13T20:15:30.459 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.445+0000 7f6fd7fff640 1 -- 10.20.193.110:0/3816108663 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f6fec007a20 con 0x7f6ffc092020 2026-02-13T20:15:30.459 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.445+0000 7f6fd7fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:15:30.459 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.445+0000 7f6fd7fff640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:15:30.459 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.445+0000 7f6fd7fff640 1 -- 10.20.193.110:0/3816108663 >> v1:10.20.193.110:6790/0 conn(0x7f6ffc092020 legacy=0x7f6ffc1a3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:30.459 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.445+0000 7f6fd7fff640 1 -- 10.20.193.110:0/3816108663 >> v1:10.20.193.110:6790/0 conn(0x7f6ffc092020 legacy=0x7f6ffc1a3770 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:15:30.459 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.448+0000 7f7001bc2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:15:30.459 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.448+0000 7f7001bc2640 1 -- 10.20.193.110:0/3816108663 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6ffc1a4250 con 0x7f6ffc1a3e80 2026-02-13T20:15:30.459 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.448+0000 7f6fd7fff640 1 -- 10.20.193.110:0/3816108663 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1608484078 0 0) 0x7f6ffc1a4250 con 0x7f6ffc1a3e80 2026-02-13T20:15:30.459 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.448+0000 7f6fd7fff640 10 monclient(hunting): _negotiate 2026-02-13T20:15:30.459 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.448+0000 7f6fd7fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:30.459 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.448+0000 7f6fd7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:30.459 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.448+0000 7f6fd7fff640 10 monclient(hunting): my global_id is 94148 2026-02-13T20:15:30.459 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.448+0000 7f6fd7fff640 1 -- 10.20.193.110:0/3816108663 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fcc0035e0 con 0x7f6ffc1a3e80 2026-02-13T20:15:30.459 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.448+0000 7f6fd7fff640 1 -- 10.20.193.110:0/3816108663 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1471437554 0 0) 0x7f6fcc0035e0 con 0x7f6ffc1a3e80 2026-02-13T20:15:30.459 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.448+0000 7f6fd7fff640 1 -- 10.20.193.110:0/3816108663 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6ffc1a4250 con 0x7f6ffc1a3e80 2026-02-13T20:15:30.459 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.448+0000 7f6fd7fff640 1 -- 10.20.193.110:0/3816108663 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f6fec005570 con 0x7f6ffc1a3e80 2026-02-13T20:15:30.459 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.448+0000 7f6fd7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:30.459 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.448+0000 7f6fd7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:15:30.460 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.448+0000 7f6fd7fff640 10 monclient: dump: 2026-02-13T20:15:30.460 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:30.460 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:30.460 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.460 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.460 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:30.460 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:30.460 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:30.460 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:30.460 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:30.460 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:30.460 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.448+0000 7f6fd7fff640 1 -- 10.20.193.110:0/3816108663 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3876527175 0 0) 0x7f6ffc1a4250 con 0x7f6ffc1a3e80 2026-02-13T20:15:30.460 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.448+0000 7f6fd7fff640 1 -- 10.20.193.110:0/3816108663 --> v1:10.20.193.110:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6ffc125f00 con 0x7f6ffc1a3e80 2026-02-13T20:15:30.460 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.448+0000 7f6fd7fff640 1 -- 10.20.193.110:0/3816108663 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4345 (unknown 0 0 2791489970) 0x7f6fec007b90 con 0x7f6ffc1a3e80 2026-02-13T20:15:30.460 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.448+0000 7f6fd7fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:15:30.460 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.448+0000 7f6fd7fff640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:15:30.460 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.448+0000 7f6fd7fff640 1 -- 10.20.193.110:0/3816108663 >> v1:10.20.193.110:6790/0 conn(0x7f6ffc1a3e80 legacy=0x7f6ffc132b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:30.460 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.448+0000 7f6fd7fff640 1 -- 10.20.193.110:0/3816108663 >> v1:10.20.193.110:6790/0 conn(0x7f6ffc1a3e80 legacy=0x7f6ffc132b80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:15:30.461 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:15:30.461 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:15:30.461 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:15:30.461 INFO:teuthology.orchestra.run.trial110.stdout: "state": "peon", 2026-02-13T20:15:30.461 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 16, 2026-02-13T20:15:30.461 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 2071, 2026-02-13T20:15:30.461 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:15:30.461 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:15:30.461 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:15:30.461 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:15:30.461 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:15:30.461 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 2, 2026-02-13T20:15:30.461 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:15:30.461 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:15:30.461 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:15:30.461 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:15:30.461 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:15:30.461 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:15:30.462 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:15:30.462 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:15:30.462 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:15:30.462 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:15:30.462 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:15:30.462 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:15:30.462 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:15:30.462 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:15:30.462 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:15:30.462 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:15:30.462 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:15:30.462 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:15:30.462 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:15:30.462 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:15:30.462 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:15:30.462 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:15:30.462 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:15:30.462 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:15:30.462 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:15:30.462 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:15:30.462 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:15:30.463 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:15:30.463 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:15:30.463 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:15:30.463 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:15:30.463 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:15:30.463 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:15:30.463 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:30.463 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:15:30.463 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:15:30.463 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:15:30.463 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:15:30.463 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:15:30.463 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:15:30.463 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:15:30.463 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:15:30.463 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:15:30.463 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:15:30.463 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:15:30.463 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:15:30.463 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:15:30.463 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:15:30.464 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:15:30.464 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:15:30.464 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:15:30.464 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:15:30.464 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:15:30.464 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:15:30.464 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:15:30.464 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:15:30.464 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:15:30.464 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:15:30.464 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:15:30.464 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:15:30.464 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:15:30.464 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:15:30.464 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:15:30.464 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:15:30.464 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:15:30.464 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:15:30.464 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:30.464 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:15:30.464 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:30.465 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:15:30.465 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:15:30.465 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:15:30.465 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:15:30.465 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:30.465 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:15:30.465 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:15:30.465 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:15:30.465 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:30.465 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:15:30.465 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:30.465 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:15:30.465 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:15:30.465 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:15:30.465 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:15:30.465 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:15:30.465 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:15:30.465 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:30.465 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:30.465 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:15:30.465 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:15:30.466 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:15:30.466 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:15:30.466 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:30.466 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:15:30.466 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:15:30.466 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:15:30.466 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:30.466 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:15:30.466 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:30.466 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:15:30.466 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:15:30.466 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:15:30.466 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:15:30.466 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:15:30.466 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:15:30.466 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:30.466 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:30.466 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:15:30.466 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:15:30.466 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:15:30.466 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:15:30.467 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:30.467 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:15:30.467 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:15:30.467 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:15:30.467 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:30.467 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:15:30.467 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:30.467 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:15:30.467 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:15:30.467 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:15:30.467 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:15:30.467 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:15:30.467 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:15:30.467 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:30.467 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:15:30.467 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:30.467 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:15:30.467 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:15:30.467 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:30.467 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:15:30.468 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:15:30.468 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:15:30.468 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:30.468 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:15:30.468 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:15:30.468 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:30.468 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:15:30.468 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:15:30.468 INFO:teuthology.orchestra.run.trial110.stdout: "num": 2 2026-02-13T20:15:30.468 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:30.468 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:15:30.468 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:30.468 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:15:30.468 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:15:30.469 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.449+0000 7f7001bc2640 1 -- 10.20.193.110:0/3816108663 >> v1:10.20.193.188:6812/1623052694 conn(0x7f6fcc03fb10 legacy=0x7f6fcc05ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:30.469 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.449+0000 7f7001bc2640 10 monclient: shutdown 2026-02-13T20:15:30.469 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.449+0000 7f7001bc2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:15:30.469 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.449+0000 7f7001bc2640 1 -- 10.20.193.110:0/3816108663 >> v1:10.20.193.110:6790/0 conn(0x7f6ffc091950 legacy=0x7f6ffc112da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:30.469 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.449+0000 7f6ffbfff640 1 -- 10.20.193.110:0/3816108663 reap_dead start 2026-02-13T20:15:30.469 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.449+0000 7f6ffbfff640 1 -- 10.20.193.110:0/3816108663 reap_dead start 2026-02-13T20:15:30.469 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.449+0000 7f7001bc2640 1 -- 10.20.193.110:0/3816108663 shutdown_connections 2026-02-13T20:15:30.469 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.449+0000 7f7001bc2640 1 -- 10.20.193.110:0/3816108663 >> 10.20.193.110:0/3816108663 conn(0x7f6ffc054e90 msgr2=0x7f6ffc08dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:15:30.470 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.449+0000 7f7001bc2640 1 -- 10.20.193.110:0/3816108663 shutdown_connections 2026-02-13T20:15:30.470 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.449+0000 7f7001bc2640 1 -- 10.20.193.110:0/3816108663 wait complete. 2026-02-13T20:15:30.470 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:15:30.470 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-13T20:15:30.470 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T20:15:30.541 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.533+0000 7ff41eb4c640 10 monclient: get_monmap_and_config 2026-02-13T20:15:30.541 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.533+0000 7ff41eb4c640 10 monclient: build_initial_monmap 2026-02-13T20:15:30.541 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.533+0000 7ff41eb4c640 10 monclient: monmap: 2026-02-13T20:15:30.541 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:15:30.541 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:30.541 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:15:30.534726+0000 2026-02-13T20:15:30.541 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:15:30.534726+0000 2026-02-13T20:15:30.541 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:15:30.541 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:30.541 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:15:30.541 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:15:30.541 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:15:30.542 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:30.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.533+0000 7ff41eb4c640 1 Processor -- start 2026-02-13T20:15:30.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.533+0000 7ff41eb4c640 1 -- start start 2026-02-13T20:15:30.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.533+0000 7ff41eb4c640 10 monclient: init 2026-02-13T20:15:30.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff41eb4c640 10 monclient: _reopen_session rank -1 2026-02-13T20:15:30.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff41eb4c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:15:30.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff41eb4c640 10 monclient(hunting): picked mon.noname-b con 0x7ff4181401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:15:30.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff41eb4c640 10 monclient(hunting): picked mon.noname-a con 0x7ff418092020 addr v1:10.20.193.110:6789/0 2026-02-13T20:15:30.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff41eb4c640 10 monclient(hunting): picked mon.noname-c con 0x7ff418091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:15:30.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff41eb4c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff41808b730 con 0x7ff418092020 2026-02-13T20:15:30.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff41eb4c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff41805c5b0 con 0x7ff418091950 2026-02-13T20:15:30.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff41eb4c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff41808bcf0 con 0x7ff4181401c0 2026-02-13T20:15:30.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff41eb4c640 10 monclient(hunting): _renew_subs 2026-02-13T20:15:30.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff41eb4c640 10 monclient(hunting): authenticate will time out at 892.225082s 2026-02-13T20:15:30.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff41c8c1640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7ff4181401c0 0x7ff418091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:43034/0 (socket says 10.20.193.110:43034) 2026-02-13T20:15:30.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff41c8c1640 1 -- 10.20.193.110:0/162787831 learned_addr learned my addr 10.20.193.110:0/162787831 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:15:30.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff40ffff640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7ff418092020 0x7ff4181812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:59552/0 (socket says 10.20.193.110:59552) 2026-02-13T20:15:30.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff40f7fe640 1 -- 10.20.193.110:0/162787831 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2228694533 0 0) 0x7ff41808b730 con 0x7ff418092020 2026-02-13T20:15:30.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff40f7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:15:30.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff40f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:30.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff40f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:30.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff40f7fe640 10 monclient(hunting): my global_id is 84267 2026-02-13T20:15:30.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff40f7fe640 1 -- 10.20.193.110:0/162787831 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4040035e0 con 0x7ff418092020 2026-02-13T20:15:30.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff40f7fe640 1 -- 10.20.193.110:0/162787831 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1759301894 0 0) 0x7ff41808bcf0 con 0x7ff4181401c0 2026-02-13T20:15:30.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff40f7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:15:30.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff40f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:30.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff40f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:30.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff40f7fe640 10 monclient(hunting): my global_id is 94151 2026-02-13T20:15:30.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff40f7fe640 1 -- 10.20.193.110:0/162787831 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff41808b730 con 0x7ff4181401c0 2026-02-13T20:15:30.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff40f7fe640 1 -- 10.20.193.110:0/162787831 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 80773099 0 0) 0x7ff41808b730 con 0x7ff4181401c0 2026-02-13T20:15:30.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff40f7fe640 1 -- 10.20.193.110:0/162787831 >> v1:10.20.193.188:6789/0 conn(0x7ff418091950 legacy=0x7ff4181a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:30.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff40f7fe640 1 -- 10.20.193.110:0/162787831 >> v1:10.20.193.110:6789/0 conn(0x7ff418092020 legacy=0x7ff4181812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:30.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff40f7fe640 10 monclient: _finish_hunting 0 2026-02-13T20:15:30.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff40f7fe640 1 monclient: found mon.noname-b 2026-02-13T20:15:30.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff40f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:15:30.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff40f7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:15:30.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff40f7fe640 1 -- 10.20.193.110:0/162787831 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff418140590 con 0x7ff4181401c0 2026-02-13T20:15:30.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff40f7fe640 10 monclient: _finish_auth 0 2026-02-13T20:15:30.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff40f7fe640 10 monclient: _check_auth_tickets 2026-02-13T20:15:30.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff40f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:15:30.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff40f7fe640 1 -- 10.20.193.110:0/162787831 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff408002dd0 con 0x7ff4181401c0 2026-02-13T20:15:30.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff40f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:30.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff40f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:15:30.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff40f7fe640 10 monclient: dump: 2026-02-13T20:15:30.544 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:30.544 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:30.544 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.544 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.544 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:30.545 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:30.545 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:30.545 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:30.545 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:30.545 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:30.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff41eb4c640 5 monclient: authenticate success, global_id 94151 2026-02-13T20:15:30.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff41eb4c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:15:30.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff40f7fe640 1 -- 10.20.193.110:0/162787831 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff408002f60 con 0x7ff4181401c0 2026-02-13T20:15:30.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff40f7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:15:30.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff40f7fe640 1 -- 10.20.193.110:0/162787831 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff4080032f0 con 0x7ff4181401c0 2026-02-13T20:15:30.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff41eb4c640 10 monclient: get_monmap_and_config success 2026-02-13T20:15:30.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff41eb4c640 4 set_mon_vals no callback set 2026-02-13T20:15:30.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff40f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:30.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff40f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:15:30.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff40f7fe640 10 monclient: dump: 2026-02-13T20:15:30.545 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:30.546 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:30.546 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.546 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.546 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:30.546 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:30.546 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:30.546 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:30.546 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:30.546 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:30.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff41eb4c640 10 monclient: shutdown 2026-02-13T20:15:30.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff41eb4c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:15:30.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff41eb4c640 1 -- 10.20.193.110:0/162787831 >> v1:10.20.193.110:6790/0 conn(0x7ff4181401c0 legacy=0x7ff418091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:30.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff41eb4c640 1 -- 10.20.193.110:0/162787831 shutdown_connections 2026-02-13T20:15:30.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.534+0000 7ff41eb4c640 1 -- 10.20.193.110:0/162787831 >> 10.20.193.110:0/162787831 conn(0x7ff418054e90 msgr2=0x7ff418058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:15:30.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.535+0000 7ff41eb4c640 1 -- 10.20.193.110:0/162787831 shutdown_connections 2026-02-13T20:15:30.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.535+0000 7ff41eb4c640 1 -- 10.20.193.110:0/162787831 wait complete. 2026-02-13T20:15:30.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.535+0000 7ff41eb4c640 10 monclient: build_initial_monmap 2026-02-13T20:15:30.547 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.535+0000 7ff41eb4c640 10 monclient: monmap: 2026-02-13T20:15:30.547 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:15:30.547 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:15:30.547 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:15:30.547 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:15:30.547 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:15:30.547 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:15:30.547 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:15:30.547 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:15:30.547 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:15:30.547 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:30.547 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.535+0000 7ff41eb4c640 1 Processor -- start 2026-02-13T20:15:30.547 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.535+0000 7ff41eb4c640 1 -- start start 2026-02-13T20:15:30.547 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.535+0000 7ff41eb4c640 10 monclient: init 2026-02-13T20:15:30.547 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.535+0000 7ff41eb4c640 10 monclient: _reopen_session rank -1 2026-02-13T20:15:30.547 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.535+0000 7ff41eb4c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:15:30.547 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.535+0000 7ff41eb4c640 10 monclient(hunting): picked mon.noname-c con 0x7ff418091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:15:30.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.535+0000 7ff41eb4c640 10 monclient(hunting): picked mon.noname-a con 0x7ff4181401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:15:30.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.535+0000 7ff41eb4c640 10 monclient(hunting): picked mon.noname-b con 0x7ff41813ef70 addr v1:10.20.193.188:6789/0 2026-02-13T20:15:30.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.535+0000 7ff41eb4c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff418131fa0 con 0x7ff4181401c0 2026-02-13T20:15:30.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.535+0000 7ff41eb4c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4181319e0 con 0x7ff41813ef70 2026-02-13T20:15:30.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.535+0000 7ff41eb4c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff418132280 con 0x7ff418091950 2026-02-13T20:15:30.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.535+0000 7ff41eb4c640 10 monclient(hunting): _renew_subs 2026-02-13T20:15:30.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.535+0000 7ff41eb4c640 10 monclient(hunting): authenticate will time out at 892.226955s 2026-02-13T20:15:30.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.535+0000 7ff40ffff640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7ff4181401c0 0x7ff418193940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:59562/0 (socket says 10.20.193.110:59562) 2026-02-13T20:15:30.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff40ffff640 1 -- 10.20.193.110:0/1962179666 learned_addr learned my addr 10.20.193.110:0/1962179666 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:15:30.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff40d7fa640 1 -- 10.20.193.110:0/1962179666 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2394436076 0 0) 0x7ff418131fa0 con 0x7ff4181401c0 2026-02-13T20:15:30.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff40d7fa640 10 monclient(hunting): _negotiate 2026-02-13T20:15:30.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff40d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:30.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff40d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:30.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff40d7fa640 10 monclient(hunting): my global_id is 84270 2026-02-13T20:15:30.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff40d7fa640 1 -- 10.20.193.110:0/1962179666 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3e80035e0 con 0x7ff4181401c0 2026-02-13T20:15:30.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff40d7fa640 1 -- 10.20.193.110:0/1962179666 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3675888604 0 0) 0x7ff418132280 con 0x7ff418091950 2026-02-13T20:15:30.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff40d7fa640 10 monclient(hunting): _negotiate 2026-02-13T20:15:30.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff40d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:30.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff40d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:30.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff40d7fa640 10 monclient(hunting): my global_id is 94154 2026-02-13T20:15:30.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff40d7fa640 1 -- 10.20.193.110:0/1962179666 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff418131fa0 con 0x7ff418091950 2026-02-13T20:15:30.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff40d7fa640 1 -- 10.20.193.110:0/1962179666 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4190938510 0 0) 0x7ff3e80035e0 con 0x7ff4181401c0 2026-02-13T20:15:30.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff40d7fa640 1 -- 10.20.193.110:0/1962179666 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff418132280 con 0x7ff4181401c0 2026-02-13T20:15:30.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff40d7fa640 1 -- 10.20.193.110:0/1962179666 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4081421515 0 0) 0x7ff418131fa0 con 0x7ff418091950 2026-02-13T20:15:30.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff40d7fa640 1 -- 10.20.193.110:0/1962179666 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff3e80035e0 con 0x7ff418091950 2026-02-13T20:15:30.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff40d7fa640 1 -- 10.20.193.110:0/1962179666 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff400003170 con 0x7ff4181401c0 2026-02-13T20:15:30.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff40d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:15:30.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff40d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:15:30.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff40d7fa640 10 monclient(hunting): dump: 2026-02-13T20:15:30.549 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:30.549 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:30.549 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.549 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.549 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:30.550 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:30.550 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:30.550 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:30.550 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:30.550 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:30.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff40d7fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:15:30.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff40d7fa640 1 -- 10.20.193.110:0/1962179666 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff408002b30 con 0x7ff418091950 2026-02-13T20:15:30.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff40d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:15:30.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff40d7fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:15:30.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff40d7fa640 10 monclient(hunting): dump: 2026-02-13T20:15:30.550 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:30.550 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:30.550 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.550 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.550 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:30.550 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:30.550 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:30.550 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:30.551 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:30.551 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:30.551 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff40d7fa640 1 -- 10.20.193.110:0/1962179666 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 749492745 0 0) 0x7ff4181319e0 con 0x7ff41813ef70 2026-02-13T20:15:30.551 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff40d7fa640 10 monclient(hunting): _negotiate 2026-02-13T20:15:30.551 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff40d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:30.551 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff40d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:30.551 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff40d7fa640 10 monclient(hunting): my global_id is 4591 2026-02-13T20:15:30.551 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff40d7fa640 1 -- 10.20.193.110:0/1962179666 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff418131fa0 con 0x7ff41813ef70 2026-02-13T20:15:30.551 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff40d7fa640 1 -- 10.20.193.110:0/1962179666 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 924818206 0 0) 0x7ff3e80035e0 con 0x7ff418091950 2026-02-13T20:15:30.551 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff40d7fa640 1 -- 10.20.193.110:0/1962179666 >> v1:10.20.193.188:6789/0 conn(0x7ff41813ef70 legacy=0x7ff418195060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:30.551 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff40d7fa640 1 -- 10.20.193.110:0/1962179666 >> v1:10.20.193.110:6789/0 conn(0x7ff4181401c0 legacy=0x7ff418193940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:30.551 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff40d7fa640 10 monclient: _finish_hunting 0 2026-02-13T20:15:30.551 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff40d7fa640 1 monclient: found mon.c 2026-02-13T20:15:30.551 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff40d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:15:30.551 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff40d7fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:15:30.551 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff40d7fa640 1 -- 10.20.193.110:0/1962179666 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff41805d320 con 0x7ff418091950 2026-02-13T20:15:30.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff40d7fa640 10 monclient: _finish_auth 0 2026-02-13T20:15:30.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff40d7fa640 10 monclient: _check_auth_tickets 2026-02-13T20:15:30.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff40d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:15:30.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff41eb4c640 5 monclient: authenticate success, global_id 94154 2026-02-13T20:15:30.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff41eb4c640 10 monclient: _renew_subs 2026-02-13T20:15:30.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff41eb4c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:15:30.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff41eb4c640 1 -- 10.20.193.110:0/1962179666 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff4181311e0 con 0x7ff418091950 2026-02-13T20:15:30.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff41eb4c640 10 monclient: _renew_subs 2026-02-13T20:15:30.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff41eb4c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:15:30.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff41eb4c640 1 -- 10.20.193.110:0/1962179666 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7ff418130c20 con 0x7ff418091950 2026-02-13T20:15:30.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff40d7fa640 1 -- 10.20.193.110:0/1962179666 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff408002c90 con 0x7ff418091950 2026-02-13T20:15:30.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff40d7fa640 10 monclient: handle_config config(0 keys) 2026-02-13T20:15:30.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff40d7fa640 1 -- 10.20.193.110:0/1962179666 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff408004d00 con 0x7ff418091950 2026-02-13T20:15:30.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff40d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:30.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff40d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:15:30.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff40d7fa640 10 monclient: dump: 2026-02-13T20:15:30.552 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:30.553 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:30.553 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.553 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.553 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:30.553 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:30.553 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:30.553 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:30.553 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:30.553 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:30.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff40effd640 4 set_mon_vals no callback set 2026-02-13T20:15:30.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff41eb4c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:15:30.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.536+0000 7ff41eb4c640 1 -- 10.20.193.110:0/1962179666 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff4180008d0 con 0x7ff418092020 2026-02-13T20:15:30.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.537+0000 7ff40d7fa640 1 -- 10.20.193.110:0/1962179666 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7ff408011970 con 0x7ff418091950 2026-02-13T20:15:30.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.537+0000 7ff40d7fa640 1 -- 10.20.193.110:0/1962179666 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(208..208 src has 1..208) ==== 3899+0+0 (unknown 164138633 0 0) 0x7ff40804e890 con 0x7ff418091950 2026-02-13T20:15:30.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.537+0000 7ff41d0c2640 10 monclient: get_auth_request con 0x7ff3e80486a0 auth_method 0 2026-02-13T20:15:30.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.537+0000 7ff40d7fa640 1 -- 10.20.193.110:0/1962179666 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 525150917 0 0) 0x7ff4180008d0 con 0x7ff418092020 2026-02-13T20:15:30.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.537+0000 7ff40d7fa640 10 monclient(hunting): _negotiate 2026-02-13T20:15:30.554 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.537+0000 7ff40d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:30.554 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.537+0000 7ff40d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:30.554 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.537+0000 7ff40d7fa640 10 monclient(hunting): my global_id is 4594 2026-02-13T20:15:30.554 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.537+0000 7ff40d7fa640 1 -- 10.20.193.110:0/1962179666 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3e80035e0 con 0x7ff418092020 2026-02-13T20:15:30.554 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.537+0000 7ff40d7fa640 1 -- 10.20.193.110:0/1962179666 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1384245064 0 0) 0x7ff3e80035e0 con 0x7ff418092020 2026-02-13T20:15:30.554 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.537+0000 7ff40d7fa640 1 -- 10.20.193.110:0/1962179666 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff4180008d0 con 0x7ff418092020 2026-02-13T20:15:30.554 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.537+0000 7ff40d7fa640 1 -- 10.20.193.110:0/1962179666 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff400004a50 con 0x7ff418092020 2026-02-13T20:15:30.554 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.537+0000 7ff40d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:30.554 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.537+0000 7ff40d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:15:30.554 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.537+0000 7ff40d7fa640 10 monclient: dump: 2026-02-13T20:15:30.554 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:30.554 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:30.554 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.554 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.554 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:30.554 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:30.554 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:30.555 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:30.555 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:30.555 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:30.555 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.537+0000 7ff40d7fa640 1 -- 10.20.193.110:0/1962179666 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4290689476 0 0) 0x7ff4180008d0 con 0x7ff418092020 2026-02-13T20:15:30.555 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.537+0000 7ff40d7fa640 1 -- 10.20.193.110:0/1962179666 --> v1:10.20.193.188:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff41808b450 con 0x7ff418092020 2026-02-13T20:15:30.555 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.538+0000 7ff40d7fa640 1 -- 10.20.193.110:0/1962179666 <== mon.1 v1:10.20.193.188:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7ff400004e20 con 0x7ff418092020 2026-02-13T20:15:30.555 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.538+0000 7ff40d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:15:30.555 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.538+0000 7ff40d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:15:30.555 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.538+0000 7ff40d7fa640 1 -- 10.20.193.110:0/1962179666 >> v1:10.20.193.188:6789/0 conn(0x7ff418092020 legacy=0x7ff41808eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:30.555 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.538+0000 7ff40d7fa640 1 -- 10.20.193.110:0/1962179666 >> v1:10.20.193.188:6789/0 conn(0x7ff418092020 legacy=0x7ff41808eea0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:15:30.556 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.541+0000 7ff41eb4c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:15:30.556 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.541+0000 7ff41eb4c640 1 -- 10.20.193.110:0/1962179666 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff41804d8d0 con 0x7ff418152750 2026-02-13T20:15:30.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.541+0000 7ff40d7fa640 1 -- 10.20.193.110:0/1962179666 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1471716503 0 0) 0x7ff41804d8d0 con 0x7ff418152750 2026-02-13T20:15:30.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.541+0000 7ff40d7fa640 10 monclient(hunting): _negotiate 2026-02-13T20:15:30.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.541+0000 7ff40d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:30.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.541+0000 7ff40d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:30.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.541+0000 7ff40d7fa640 10 monclient(hunting): my global_id is 4597 2026-02-13T20:15:30.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.541+0000 7ff40d7fa640 1 -- 10.20.193.110:0/1962179666 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4180008d0 con 0x7ff418152750 2026-02-13T20:15:30.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.542+0000 7ff40d7fa640 1 -- 10.20.193.110:0/1962179666 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1954135944 0 0) 0x7ff4180008d0 con 0x7ff418152750 2026-02-13T20:15:30.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.542+0000 7ff40d7fa640 1 -- 10.20.193.110:0/1962179666 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff41804d8d0 con 0x7ff418152750 2026-02-13T20:15:30.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.542+0000 7ff40d7fa640 1 -- 10.20.193.110:0/1962179666 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff400005420 con 0x7ff418152750 2026-02-13T20:15:30.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.542+0000 7ff40d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:30.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.542+0000 7ff40d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:15:30.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.542+0000 7ff40d7fa640 10 monclient: dump: 2026-02-13T20:15:30.557 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:30.557 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:30.557 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.557 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.558 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:30.558 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:30.558 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:30.558 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:30.558 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:30.558 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:30.558 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.542+0000 7ff40d7fa640 1 -- 10.20.193.110:0/1962179666 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2240567966 0 0) 0x7ff41804d8d0 con 0x7ff418152750 2026-02-13T20:15:30.558 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.542+0000 7ff40d7fa640 1 -- 10.20.193.110:0/1962179666 --> v1:10.20.193.188:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff418058410 con 0x7ff418152750 2026-02-13T20:15:30.558 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.542+0000 7ff40d7fa640 1 -- 10.20.193.110:0/1962179666 <== mon.1 v1:10.20.193.188:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4683 (unknown 0 0 2195398336) 0x7ff400006870 con 0x7ff418152750 2026-02-13T20:15:30.558 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.542+0000 7ff40d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:15:30.558 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.542+0000 7ff40d7fa640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:15:30.558 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.542+0000 7ff40d7fa640 1 -- 10.20.193.110:0/1962179666 >> v1:10.20.193.188:6789/0 conn(0x7ff418152750 legacy=0x7ff41804d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:30.558 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.542+0000 7ff40d7fa640 1 -- 10.20.193.110:0/1962179666 >> v1:10.20.193.188:6789/0 conn(0x7ff418152750 legacy=0x7ff41804d1c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:15:30.559 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:15:30.559 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:15:30.559 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:15:30.559 INFO:teuthology.orchestra.run.trial110.stdout: "state": "leader", 2026-02-13T20:15:30.559 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 16, 2026-02-13T20:15:30.559 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 252689, 2026-02-13T20:15:30.559 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:15:30.559 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:15:30.559 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:15:30.559 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:15:30.559 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:15:30.559 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 2, 2026-02-13T20:15:30.559 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:15:30.559 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:15:30.560 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:15:30.560 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:15:30.560 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:15:30.560 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:15:30.560 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:15:30.560 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:15:30.560 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:15:30.560 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:15:30.560 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:15:30.560 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:15:30.560 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:15:30.560 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:15:30.560 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:15:30.560 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:15:30.560 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:15:30.560 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:15:30.561 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:15:30.561 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:15:30.561 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:15:30.561 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:15:30.561 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:15:30.561 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:15:30.561 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:15:30.561 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:15:30.561 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:15:30.561 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:15:30.561 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:15:30.561 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:15:30.561 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:15:30.561 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:15:30.561 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:15:30.561 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:30.561 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:15:30.562 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:15:30.562 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:15:30.562 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:15:30.562 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:15:30.562 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:15:30.562 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:15:30.562 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:15:30.562 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:15:30.562 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:15:30.562 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:15:30.562 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:15:30.562 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:15:30.562 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:15:30.562 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:15:30.562 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:15:30.562 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:15:30.563 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:15:30.563 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:15:30.563 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:15:30.563 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:15:30.563 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:15:30.563 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:15:30.563 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:15:30.563 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:15:30.563 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:15:30.563 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:15:30.563 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:15:30.563 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:15:30.563 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:15:30.563 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:15:30.563 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:15:30.563 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:30.563 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:15:30.564 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:30.564 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:15:30.564 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:15:30.564 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:15:30.564 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:15:30.564 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:30.564 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:15:30.564 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:15:30.564 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:15:30.564 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:30.564 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:15:30.564 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:30.564 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:15:30.564 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:15:30.564 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:15:30.564 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:15:30.565 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:15:30.565 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:15:30.565 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:30.565 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:30.565 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:15:30.565 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:15:30.565 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:15:30.565 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:15:30.565 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:30.565 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:15:30.565 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:15:30.565 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:15:30.565 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:30.565 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:15:30.565 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:30.565 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:15:30.565 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:15:30.565 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:15:30.566 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:15:30.566 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:15:30.566 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:15:30.566 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:30.566 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:30.566 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:15:30.566 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:15:30.566 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:15:30.566 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:15:30.566 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:30.566 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:15:30.566 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:15:30.566 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:15:30.566 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:30.566 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:15:30.566 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:30.566 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:15:30.566 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:15:30.566 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:15:30.567 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:15:30.567 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:15:30.567 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:15:30.567 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:30.567 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:15:30.567 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:30.567 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:15:30.567 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:15:30.567 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:30.567 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:15:30.567 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:15:30.567 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:15:30.567 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:30.567 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:15:30.567 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:15:30.567 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:30.567 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:15:30.567 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:15:30.568 INFO:teuthology.orchestra.run.trial110.stdout: "num": 4 2026-02-13T20:15:30.568 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:30.568 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:15:30.568 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:15:30.568 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:30.568 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:15:30.568 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:15:30.568 INFO:teuthology.orchestra.run.trial110.stdout: "num": 6 2026-02-13T20:15:30.568 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:30.568 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:15:30.568 INFO:teuthology.orchestra.run.trial110.stdout: "mgr": [ 2026-02-13T20:15:30.568 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:30.568 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:15:30.568 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:15:30.568 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:15:30.568 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:30.568 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:15:30.568 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:30.568 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:15:30.569 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:15:30.569 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.542+0000 7ff41eb4c640 1 -- 10.20.193.110:0/1962179666 >> v1:10.20.193.188:6812/1623052694 conn(0x7ff3e80486a0 legacy=0x7ff3e8068b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:30.570 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.542+0000 7ff41eb4c640 10 monclient: shutdown 2026-02-13T20:15:30.570 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.542+0000 7ff41eb4c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:15:30.570 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.542+0000 7ff41eb4c640 1 -- 10.20.193.110:0/1962179666 >> v1:10.20.193.110:6790/0 conn(0x7ff418091950 legacy=0x7ff41813e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:30.570 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.542+0000 7ff41d0c2640 1 -- 10.20.193.110:0/1962179666 reap_dead start 2026-02-13T20:15:30.570 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.542+0000 7ff41eb4c640 1 -- 10.20.193.110:0/1962179666 shutdown_connections 2026-02-13T20:15:30.570 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.542+0000 7ff41eb4c640 1 -- 10.20.193.110:0/1962179666 >> 10.20.193.110:0/1962179666 conn(0x7ff418054e90 msgr2=0x7ff418088e30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:15:30.570 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.542+0000 7ff41eb4c640 1 -- 10.20.193.110:0/1962179666 shutdown_connections 2026-02-13T20:15:30.570 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.542+0000 7ff41eb4c640 1 -- 10.20.193.110:0/1962179666 wait complete. 2026-02-13T20:15:30.570 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:15:30.570 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2026-02-13T20:15:30.570 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-13T20:15:30.570 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2026-02-13T20:15:30.571 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2026-02-13T20:15:30.571 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-13T20:15:30.571 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T20:15:30.579 INFO:tasks.ceph.mon.a:Stopped 2026-02-13T20:15:30.579 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-13T20:15:30.579 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T20:15:30.692 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.684+0000 7f235248c640 10 monclient: get_monmap_and_config 2026-02-13T20:15:30.692 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.684+0000 7f235248c640 10 monclient: build_initial_monmap 2026-02-13T20:15:30.693 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.684+0000 7f235248c640 10 monclient: monmap: 2026-02-13T20:15:30.693 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:15:30.693 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:30.693 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:15:30.685908+0000 2026-02-13T20:15:30.693 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:15:30.685908+0000 2026-02-13T20:15:30.693 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:15:30.693 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:30.693 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:15:30.693 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:15:30.693 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:15:30.693 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:30.693 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.684+0000 7f235248c640 1 Processor -- start 2026-02-13T20:15:30.694 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.684+0000 7f235248c640 1 -- start start 2026-02-13T20:15:30.694 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.684+0000 7f235248c640 10 monclient: init 2026-02-13T20:15:30.694 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.685+0000 7f235248c640 10 monclient: _reopen_session rank -1 2026-02-13T20:15:30.694 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.685+0000 7f235248c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:15:30.694 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.685+0000 7f235248c640 10 monclient(hunting): picked mon.noname-b con 0x7f234c1401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:15:30.694 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.685+0000 7f235248c640 10 monclient(hunting): picked mon.noname-a con 0x7f234c092020 addr v1:10.20.193.110:6789/0 2026-02-13T20:15:30.694 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.685+0000 7f235248c640 10 monclient(hunting): picked mon.noname-c con 0x7f234c091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:15:30.694 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.685+0000 7f235248c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f234c08b730 con 0x7f234c092020 2026-02-13T20:15:30.694 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.685+0000 7f235248c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f234c05c5b0 con 0x7f234c091950 2026-02-13T20:15:30.694 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.685+0000 7f235248c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f234c08bcf0 con 0x7f234c1401c0 2026-02-13T20:15:30.694 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.685+0000 7f235248c640 10 monclient(hunting): _renew_subs 2026-02-13T20:15:30.694 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.685+0000 7f235248c640 10 monclient(hunting): authenticate will time out at 892.376330s 2026-02-13T20:15:30.694 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.685+0000 7f234b7fe640 1 -- >> v1:10.20.193.110:6789/0 conn(0x7f234c092020 legacy=0x7f234c1812f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:15:30.695 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.685+0000 7f234bfff640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f234c1401c0 0x7f234c091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:43068/0 (socket says 10.20.193.110:43068) 2026-02-13T20:15:30.695 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.685+0000 7f234bfff640 1 -- 10.20.193.110:0/651817965 learned_addr learned my addr 10.20.193.110:0/651817965 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:15:30.695 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.685+0000 7f234affd640 1 -- 10.20.193.110:0/651817965 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4096223620 0 0) 0x7f234c08bcf0 con 0x7f234c1401c0 2026-02-13T20:15:30.695 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.685+0000 7f234affd640 10 monclient(hunting): _negotiate 2026-02-13T20:15:30.695 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.685+0000 7f234affd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:30.695 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.685+0000 7f234affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:30.695 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.685+0000 7f234affd640 10 monclient(hunting): my global_id is 94157 2026-02-13T20:15:30.695 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.685+0000 7f234affd640 1 -- 10.20.193.110:0/651817965 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23300035e0 con 0x7f234c1401c0 2026-02-13T20:15:30.695 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.685+0000 7f234affd640 1 -- 10.20.193.110:0/651817965 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2143379525 0 0) 0x7f23300035e0 con 0x7f234c1401c0 2026-02-13T20:15:30.695 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.685+0000 7f234affd640 1 -- 10.20.193.110:0/651817965 >> v1:10.20.193.188:6789/0 conn(0x7f234c091950 legacy=0x7f234c1a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:30.695 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.685+0000 7f234affd640 1 -- 10.20.193.110:0/651817965 >> v1:10.20.193.110:6789/0 conn(0x7f234c092020 legacy=0x7f234c1812f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:15:30.695 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.685+0000 7f234affd640 10 monclient: _finish_hunting 0 2026-02-13T20:15:30.695 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.685+0000 7f234affd640 1 monclient: found mon.noname-b 2026-02-13T20:15:30.695 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.685+0000 7f234affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:15:30.696 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.685+0000 7f234affd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:15:30.696 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.685+0000 7f234affd640 1 -- 10.20.193.110:0/651817965 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f234c140590 con 0x7f234c1401c0 2026-02-13T20:15:30.696 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.685+0000 7f234affd640 10 monclient: _finish_auth 0 2026-02-13T20:15:30.696 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.685+0000 7f234affd640 10 monclient: _check_auth_tickets 2026-02-13T20:15:30.696 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.685+0000 7f234affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:15:30.696 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.685+0000 7f234affd640 1 -- 10.20.193.110:0/651817965 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f2338002dd0 con 0x7f234c1401c0 2026-02-13T20:15:30.696 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.685+0000 7f234affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:30.696 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.685+0000 7f234affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:15:30.696 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.685+0000 7f234affd640 10 monclient: dump: 2026-02-13T20:15:30.696 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:30.696 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:30.696 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.697 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.697 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:30.697 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:30.697 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:30.697 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:30.697 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:30.697 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:30.697 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.685+0000 7f235248c640 5 monclient: authenticate success, global_id 94157 2026-02-13T20:15:30.697 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.685+0000 7f235248c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:15:30.697 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.686+0000 7f234affd640 1 -- 10.20.193.110:0/651817965 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2338002fa0 con 0x7f234c1401c0 2026-02-13T20:15:30.697 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.686+0000 7f234affd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:15:30.697 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.686+0000 7f234affd640 1 -- 10.20.193.110:0/651817965 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f23380033b0 con 0x7f234c1401c0 2026-02-13T20:15:30.697 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.686+0000 7f235248c640 10 monclient: get_monmap_and_config success 2026-02-13T20:15:30.697 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.686+0000 7f235248c640 4 set_mon_vals no callback set 2026-02-13T20:15:30.698 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.686+0000 7f234affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:30.698 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.686+0000 7f234affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:15:30.698 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.686+0000 7f234affd640 10 monclient: dump: 2026-02-13T20:15:30.698 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:30.698 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:30.698 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.698 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.698 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:30.698 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:30.698 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:30.698 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:30.698 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:30.698 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:30.698 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.686+0000 7f235248c640 10 monclient: shutdown 2026-02-13T20:15:30.699 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.686+0000 7f235248c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:15:30.699 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.686+0000 7f235248c640 1 -- 10.20.193.110:0/651817965 >> v1:10.20.193.110:6790/0 conn(0x7f234c1401c0 legacy=0x7f234c091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:30.699 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.686+0000 7f235248c640 1 -- 10.20.193.110:0/651817965 shutdown_connections 2026-02-13T20:15:30.699 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.686+0000 7f235248c640 1 -- 10.20.193.110:0/651817965 >> 10.20.193.110:0/651817965 conn(0x7f234c054e90 msgr2=0x7f234c058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:15:30.699 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.686+0000 7f235248c640 1 -- 10.20.193.110:0/651817965 shutdown_connections 2026-02-13T20:15:30.699 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.686+0000 7f235248c640 1 -- 10.20.193.110:0/651817965 wait complete. 2026-02-13T20:15:30.699 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.686+0000 7f235248c640 10 monclient: build_initial_monmap 2026-02-13T20:15:30.699 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.686+0000 7f235248c640 10 monclient: monmap: 2026-02-13T20:15:30.699 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:15:30.699 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:15:30.699 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:15:30.699 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:15:30.699 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:15:30.699 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:15:30.700 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:15:30.700 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:15:30.700 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:15:30.700 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:30.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.686+0000 7f235248c640 1 Processor -- start 2026-02-13T20:15:30.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.686+0000 7f235248c640 1 -- start start 2026-02-13T20:15:30.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.686+0000 7f235248c640 10 monclient: init 2026-02-13T20:15:30.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f235248c640 10 monclient: _reopen_session rank -1 2026-02-13T20:15:30.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f235248c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:15:30.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f235248c640 10 monclient(hunting): picked mon.noname-c con 0x7f234c091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:15:30.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f235248c640 10 monclient(hunting): picked mon.noname-b con 0x7f234c1401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:15:30.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f235248c640 10 monclient(hunting): picked mon.noname-a con 0x7f234c12bee0 addr v1:10.20.193.110:6789/0 2026-02-13T20:15:30.701 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f235248c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f234c12d400 con 0x7f234c12bee0 2026-02-13T20:15:30.701 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f235248c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f234c12d6e0 con 0x7f234c1401c0 2026-02-13T20:15:30.701 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f235248c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f234c05d320 con 0x7f234c091950 2026-02-13T20:15:30.701 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f235248c640 10 monclient(hunting): _renew_subs 2026-02-13T20:15:30.701 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f235248c640 10 monclient(hunting): authenticate will time out at 892.378097s 2026-02-13T20:15:30.701 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f2350a02640 1 -- >> v1:10.20.193.110:6789/0 conn(0x7f234c12bee0 legacy=0x7f234c1a2050 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:15:30.701 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f234bfff640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f234c091950 0x7f234c129960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:43074/0 (socket says 10.20.193.110:43074) 2026-02-13T20:15:30.701 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f234bfff640 1 -- 10.20.193.110:0/1981491664 learned_addr learned my addr 10.20.193.110:0/1981491664 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:15:30.701 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f2348ff9640 1 -- 10.20.193.110:0/1981491664 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2557438171 0 0) 0x7f234c05d320 con 0x7f234c091950 2026-02-13T20:15:30.701 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f2348ff9640 10 monclient(hunting): _negotiate 2026-02-13T20:15:30.701 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f2348ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:30.701 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f2348ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:30.701 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f2348ff9640 10 monclient(hunting): my global_id is 94160 2026-02-13T20:15:30.702 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f2348ff9640 1 -- 10.20.193.110:0/1981491664 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f231c0035e0 con 0x7f234c091950 2026-02-13T20:15:30.702 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f2348ff9640 1 -- 10.20.193.110:0/1981491664 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2573622815 0 0) 0x7f231c0035e0 con 0x7f234c091950 2026-02-13T20:15:30.702 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f2348ff9640 1 -- 10.20.193.110:0/1981491664 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f234c05d320 con 0x7f234c091950 2026-02-13T20:15:30.702 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f2348ff9640 1 -- 10.20.193.110:0/1981491664 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f2338002ce0 con 0x7f234c091950 2026-02-13T20:15:30.702 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f2348ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:15:30.702 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f2348ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:15:30.702 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f2348ff9640 10 monclient(hunting): dump: 2026-02-13T20:15:30.702 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:30.702 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:30.702 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.702 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.702 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:30.702 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:30.702 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:30.703 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:30.703 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:30.703 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:30.703 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f2348ff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:15:30.703 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f2348ff9640 1 -- 10.20.193.110:0/1981491664 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2587817490 0 0) 0x7f234c05d320 con 0x7f234c091950 2026-02-13T20:15:30.703 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f2348ff9640 1 -- 10.20.193.110:0/1981491664 >> v1:10.20.193.188:6789/0 conn(0x7f234c1401c0 legacy=0x7f234c12a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:30.703 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f2348ff9640 1 -- 10.20.193.110:0/1981491664 >> v1:10.20.193.110:6789/0 conn(0x7f234c12bee0 legacy=0x7f234c1a2050 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T20:15:30.703 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f2348ff9640 10 monclient: _finish_hunting 0 2026-02-13T20:15:30.703 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f2348ff9640 1 monclient: found mon.c 2026-02-13T20:15:30.703 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f2348ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:15:30.703 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f2348ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:15:30.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f2348ff9640 1 -- 10.20.193.110:0/1981491664 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f234c12c870 con 0x7f234c091950 2026-02-13T20:15:30.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f2348ff9640 10 monclient: _finish_auth 0 2026-02-13T20:15:30.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f2348ff9640 10 monclient: _check_auth_tickets 2026-02-13T20:15:30.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f2348ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:15:30.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f235248c640 5 monclient: authenticate success, global_id 94160 2026-02-13T20:15:30.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f235248c640 10 monclient: _renew_subs 2026-02-13T20:15:30.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f235248c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:15:30.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f235248c640 1 -- 10.20.193.110:0/1981491664 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f234c12b380 con 0x7f234c091950 2026-02-13T20:15:30.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f235248c640 10 monclient: _renew_subs 2026-02-13T20:15:30.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f235248c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:15:30.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f235248c640 1 -- 10.20.193.110:0/1981491664 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f234c12a780 con 0x7f234c091950 2026-02-13T20:15:30.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f2348ff9640 1 -- 10.20.193.110:0/1981491664 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2338004b90 con 0x7f234c091950 2026-02-13T20:15:30.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f2348ff9640 10 monclient: handle_config config(0 keys) 2026-02-13T20:15:30.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f2348ff9640 1 -- 10.20.193.110:0/1981491664 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f2338004f70 con 0x7f234c091950 2026-02-13T20:15:30.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f2348ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:30.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f2348ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:15:30.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f2348ff9640 10 monclient: dump: 2026-02-13T20:15:30.705 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:30.705 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:30.705 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.705 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:30.705 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:30.705 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:30.705 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:30.705 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:30.705 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:30.705 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:30.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.687+0000 7f234a7fc640 4 set_mon_vals no callback set 2026-02-13T20:15:30.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.688+0000 7f235248c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:15:30.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.688+0000 7f235248c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:15:30.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.688+0000 7f235248c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:15:30.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.688+0000 7f235248c640 1 -- 10.20.193.110:0/1981491664 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f234c12d080 con 0x7f234c091950 2026-02-13T20:15:30.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.688+0000 7f2348ff9640 1 -- 10.20.193.110:0/1981491664 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f23380050d0 con 0x7f234c091950 2026-02-13T20:15:30.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.688+0000 7f2348ff9640 1 -- 10.20.193.110:0/1981491664 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(208..208 src has 1..208) ==== 3899+0+0 (unknown 164138633 0 0) 0x7f233804e9e0 con 0x7f234c091950 2026-02-13T20:15:30.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.688+0000 7f234b7fe640 10 monclient: get_auth_request con 0x7f231c03f5e0 auth_method 0 2026-02-13T20:15:30.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.690+0000 7f2348ff9640 1 -- 10.20.193.110:0/1981491664 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f234c12d080 con 0x7f234c091950 2026-02-13T20:15:30.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.690+0000 7f2348ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:15:30.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.690+0000 7f2348ff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:15:30.841 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.838+0000 7f235248c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T20:15:30.841 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.838+0000 7f235248c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T20:15:30.841 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.838+0000 7f235248c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:15:30.841 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.838+0000 7f235248c640 1 -- 10.20.193.110:0/1981491664 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f234c12d080 con 0x7f234c091950 2026-02-13T20:15:30.841 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.839+0000 7f2348ff9640 1 -- 10.20.193.110:0/1981491664 <== mon.2 v1:10.20.193.110:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 3376771274) 0x7f234c12d080 con 0x7f234c091950 2026-02-13T20:15:30.841 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.839+0000 7f2348ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T20:15:30.841 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.839+0000 7f2348ff9640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:15:30.842 INFO:teuthology.orchestra.run.trial110.stdout:{"election_epoch":16,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","modified":"2026-02-13T20:11:07.161192Z","created":"2026-02-13T20:11:07.161192Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6789","nonce":0}]},"addr":"10.20.193.110:6789/0","public_addr":"10.20.193.110:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161241+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6789","nonce":0}]},"addr":"10.20.193.188:6789/0","public_addr":"10.20.193.188:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161242+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6790","nonce":0}]},"addr":"10.20.193.110:6790/0","public_addr":"10.20.193.110:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161243+0000","crush_location":[]}]}} 2026-02-13T20:15:30.843 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.840+0000 7f235248c640 1 -- 10.20.193.110:0/1981491664 >> v1:10.20.193.188:6812/1623052694 conn(0x7f231c03f5e0 legacy=0x7f231c05fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:30.843 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.840+0000 7f235248c640 10 monclient: shutdown 2026-02-13T20:15:30.843 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.840+0000 7f235248c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:15:30.843 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.840+0000 7f235248c640 1 -- 10.20.193.110:0/1981491664 >> v1:10.20.193.110:6790/0 conn(0x7f234c091950 legacy=0x7f234c129960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:30.843 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.840+0000 7f235248c640 1 -- 10.20.193.110:0/1981491664 shutdown_connections 2026-02-13T20:15:30.843 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.840+0000 7f235248c640 1 -- 10.20.193.110:0/1981491664 >> 10.20.193.110:0/1981491664 conn(0x7f234c054e90 msgr2=0x7f234c08dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:15:30.843 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.840+0000 7f235248c640 1 -- 10.20.193.110:0/1981491664 shutdown_connections 2026-02-13T20:15:30.843 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:30.840+0000 7f235248c640 1 -- 10.20.193.110:0/1981491664 wait complete. 2026-02-13T20:15:33.851 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T20:15:33.923 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.915+0000 7fadfd1ae640 10 monclient: get_monmap_and_config 2026-02-13T20:15:33.924 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.915+0000 7fadfd1ae640 10 monclient: build_initial_monmap 2026-02-13T20:15:33.924 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.915+0000 7fadfd1ae640 10 monclient: monmap: 2026-02-13T20:15:33.924 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:15:33.924 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:33.924 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:15:33.917050+0000 2026-02-13T20:15:33.924 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:15:33.917050+0000 2026-02-13T20:15:33.924 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:15:33.924 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:33.925 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:15:33.925 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:15:33.925 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:15:33.925 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:33.925 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.915+0000 7fadfd1ae640 1 Processor -- start 2026-02-13T20:15:33.925 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.916+0000 7fadfd1ae640 1 -- start start 2026-02-13T20:15:33.925 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.916+0000 7fadfd1ae640 10 monclient: init 2026-02-13T20:15:33.925 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.916+0000 7fadfd1ae640 10 monclient: _reopen_session rank -1 2026-02-13T20:15:33.925 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.916+0000 7fadfd1ae640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:15:33.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.916+0000 7fadfd1ae640 10 monclient(hunting): picked mon.noname-c con 0x7fadf81401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:15:33.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.916+0000 7fadfd1ae640 10 monclient(hunting): picked mon.noname-b con 0x7fadf8092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:15:33.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.916+0000 7fadfd1ae640 10 monclient(hunting): picked mon.noname-a con 0x7fadf8091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:15:33.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.916+0000 7fadfd1ae640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadf808b730 con 0x7fadf8091950 2026-02-13T20:15:33.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.916+0000 7fadfd1ae640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadf805c5b0 con 0x7fadf81401c0 2026-02-13T20:15:33.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.916+0000 7fadfd1ae640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadf808bcf0 con 0x7fadf8092020 2026-02-13T20:15:33.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.916+0000 7fadfd1ae640 10 monclient(hunting): _renew_subs 2026-02-13T20:15:33.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.916+0000 7fadfd1ae640 10 monclient(hunting): authenticate will time out at 895.607367s 2026-02-13T20:15:33.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.916+0000 7fadf7577640 1 -- >> v1:10.20.193.110:6789/0 conn(0x7fadf8091950 legacy=0x7fadf81a2a20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:15:33.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.916+0000 7fadf6575640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fadf8092020 0x7fadf81812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:50514/0 (socket says 10.20.193.110:50514) 2026-02-13T20:15:33.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.916+0000 7fadf6575640 1 -- 10.20.193.110:0/2723667228 learned_addr learned my addr 10.20.193.110:0/2723667228 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:15:33.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.916+0000 7fadf5d74640 1 -- 10.20.193.110:0/2723667228 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2506525442 0 0) 0x7fadf805c5b0 con 0x7fadf81401c0 2026-02-13T20:15:33.927 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.916+0000 7fadf5d74640 10 monclient(hunting): _negotiate 2026-02-13T20:15:33.927 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.916+0000 7fadf5d74640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:33.927 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.916+0000 7fadf5d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:33.927 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.916+0000 7fadf5d74640 10 monclient(hunting): my global_id is 4606 2026-02-13T20:15:33.927 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.916+0000 7fadf5d74640 1 -- 10.20.193.110:0/2723667228 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fade40035e0 con 0x7fadf81401c0 2026-02-13T20:15:33.927 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.917+0000 7fadf5d74640 1 -- 10.20.193.110:0/2723667228 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1127940820 0 0) 0x7fade40035e0 con 0x7fadf81401c0 2026-02-13T20:15:33.927 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.917+0000 7fadf5d74640 1 -- 10.20.193.110:0/2723667228 >> v1:10.20.193.110:6790/0 conn(0x7fadf8092020 legacy=0x7fadf81812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:33.927 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.917+0000 7fadf5d74640 1 -- 10.20.193.110:0/2723667228 >> v1:10.20.193.110:6789/0 conn(0x7fadf8091950 legacy=0x7fadf81a2a20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:15:33.927 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.917+0000 7fadf5d74640 10 monclient: _finish_hunting 0 2026-02-13T20:15:33.927 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.917+0000 7fadf5d74640 1 monclient: found mon.noname-c 2026-02-13T20:15:33.927 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.917+0000 7fadf5d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:15:33.927 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.917+0000 7fadf5d74640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.188:6789/0 2026-02-13T20:15:33.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.917+0000 7fadf5d74640 1 -- 10.20.193.110:0/2723667228 --> v1:10.20.193.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadf8140590 con 0x7fadf81401c0 2026-02-13T20:15:33.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.917+0000 7fadf5d74640 10 monclient: _finish_auth 0 2026-02-13T20:15:33.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.917+0000 7fadf5d74640 10 monclient: _check_auth_tickets 2026-02-13T20:15:33.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.917+0000 7fadf5d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:15:33.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.917+0000 7fadf5d74640 1 -- 10.20.193.110:0/2723667228 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fadec002dd0 con 0x7fadf81401c0 2026-02-13T20:15:33.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.917+0000 7fadfd1ae640 5 monclient: authenticate success, global_id 4606 2026-02-13T20:15:33.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.917+0000 7fadfd1ae640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:15:33.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.917+0000 7fadf5d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:33.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.917+0000 7fadf5d74640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:15:33.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.917+0000 7fadf5d74640 10 monclient: dump: 2026-02-13T20:15:33.928 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:33.928 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:33.929 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:33.929 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:33.929 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:33.929 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:33.929 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:33.929 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:33.929 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:33.929 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:33.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.917+0000 7fadfd1ae640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:15:33.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.917+0000 7fadf5d74640 1 -- 10.20.193.110:0/2723667228 <== mon.1 v1:10.20.193.188:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fadec002fa0 con 0x7fadf81401c0 2026-02-13T20:15:33.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.917+0000 7fadf5d74640 10 monclient: handle_config config(0 keys) 2026-02-13T20:15:33.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.917+0000 7fadf5d74640 1 -- 10.20.193.110:0/2723667228 <== mon.1 v1:10.20.193.188:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fadec0033b0 con 0x7fadf81401c0 2026-02-13T20:15:33.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.917+0000 7fadf5d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:33.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.917+0000 7fadf5d74640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:15:33.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.917+0000 7fadf5d74640 10 monclient: dump: 2026-02-13T20:15:33.930 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:33.930 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:33.930 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:33.930 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:33.930 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:33.930 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:33.930 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:33.930 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:33.930 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:33.930 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:33.931 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.917+0000 7fadfd1ae640 10 monclient: get_monmap_and_config success 2026-02-13T20:15:33.931 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.917+0000 7fadfd1ae640 4 set_mon_vals no callback set 2026-02-13T20:15:33.931 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.917+0000 7fadfd1ae640 10 monclient: shutdown 2026-02-13T20:15:33.931 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.917+0000 7fadfd1ae640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:15:33.931 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.917+0000 7fadfd1ae640 1 -- 10.20.193.110:0/2723667228 >> v1:10.20.193.188:6789/0 conn(0x7fadf81401c0 legacy=0x7fadf8091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:33.931 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.917+0000 7fadfd1ae640 1 -- 10.20.193.110:0/2723667228 shutdown_connections 2026-02-13T20:15:33.931 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.917+0000 7fadfd1ae640 1 -- 10.20.193.110:0/2723667228 >> 10.20.193.110:0/2723667228 conn(0x7fadf8054e90 msgr2=0x7fadf8058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:15:33.931 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.917+0000 7fadfd1ae640 1 -- 10.20.193.110:0/2723667228 shutdown_connections 2026-02-13T20:15:33.931 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.917+0000 7fadfd1ae640 1 -- 10.20.193.110:0/2723667228 wait complete. 2026-02-13T20:15:33.931 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.918+0000 7fadfd1ae640 10 monclient: build_initial_monmap 2026-02-13T20:15:33.931 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.918+0000 7fadfd1ae640 10 monclient: monmap: 2026-02-13T20:15:33.931 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:15:33.932 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:15:33.932 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:15:33.932 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:15:33.932 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:15:33.932 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:15:33.932 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:15:33.932 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:15:33.932 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:15:33.932 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:33.932 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.918+0000 7fadfd1ae640 1 Processor -- start 2026-02-13T20:15:33.932 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.918+0000 7fadfd1ae640 1 -- start start 2026-02-13T20:15:33.932 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.918+0000 7fadfd1ae640 10 monclient: init 2026-02-13T20:15:33.933 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.918+0000 7fadfd1ae640 10 monclient: _reopen_session rank -1 2026-02-13T20:15:33.933 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.918+0000 7fadfd1ae640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:15:33.933 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.918+0000 7fadfd1ae640 10 monclient(hunting): picked mon.noname-c con 0x7fadf8091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:15:33.933 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.918+0000 7fadfd1ae640 10 monclient(hunting): picked mon.noname-a con 0x7fadf81401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:15:33.933 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.918+0000 7fadfd1ae640 10 monclient(hunting): picked mon.noname-b con 0x7fadf8089c80 addr v1:10.20.193.188:6789/0 2026-02-13T20:15:33.933 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.918+0000 7fadfd1ae640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadf813f050 con 0x7fadf81401c0 2026-02-13T20:15:33.933 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.918+0000 7fadfd1ae640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadf8090fa0 con 0x7fadf8089c80 2026-02-13T20:15:33.933 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.918+0000 7fadfd1ae640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadf812f3e0 con 0x7fadf8091950 2026-02-13T20:15:33.933 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.918+0000 7fadfd1ae640 10 monclient(hunting): _renew_subs 2026-02-13T20:15:33.933 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.918+0000 7fadfd1ae640 10 monclient(hunting): authenticate will time out at 895.609577s 2026-02-13T20:15:33.933 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.918+0000 7fadf6575640 1 -- >> v1:10.20.193.110:6789/0 conn(0x7fadf81401c0 legacy=0x7fadf8089570 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:15:33.933 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.918+0000 7fadf6d76640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fadf8091950 0x7fadf8088e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:50518/0 (socket says 10.20.193.110:50518) 2026-02-13T20:15:33.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.918+0000 7fadf6d76640 1 -- 10.20.193.110:0/639368514 learned_addr learned my addr 10.20.193.110:0/639368514 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:15:33.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.918+0000 7fadd77fe640 1 -- 10.20.193.110:0/639368514 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3946439072 0 0) 0x7fadf8090fa0 con 0x7fadf8089c80 2026-02-13T20:15:33.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.918+0000 7fadd77fe640 10 monclient(hunting): _negotiate 2026-02-13T20:15:33.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.918+0000 7fadd77fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:33.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.918+0000 7fadd77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:33.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.918+0000 7fadd77fe640 10 monclient(hunting): my global_id is 4609 2026-02-13T20:15:33.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.918+0000 7fadd77fe640 1 -- 10.20.193.110:0/639368514 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fadc40035e0 con 0x7fadf8089c80 2026-02-13T20:15:33.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.919+0000 7fadd77fe640 1 -- 10.20.193.110:0/639368514 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 73485575 0 0) 0x7fadc40035e0 con 0x7fadf8089c80 2026-02-13T20:15:33.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.919+0000 7fadd77fe640 1 -- 10.20.193.110:0/639368514 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fadf8090fa0 con 0x7fadf8089c80 2026-02-13T20:15:33.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.919+0000 7fadd77fe640 1 -- 10.20.193.110:0/639368514 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fade8005120 con 0x7fadf8089c80 2026-02-13T20:15:33.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.919+0000 7fadd77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:15:33.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.919+0000 7fadd77fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:15:33.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.919+0000 7fadd77fe640 10 monclient(hunting): dump: 2026-02-13T20:15:33.935 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:33.935 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:33.935 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:33.935 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:33.935 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:33.935 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:33.935 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:33.935 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:33.935 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:33.936 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:33.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.919+0000 7fadd77fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:15:33.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.919+0000 7fadd77fe640 1 -- 10.20.193.110:0/639368514 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 859328221 0 0) 0x7fadf8090fa0 con 0x7fadf8089c80 2026-02-13T20:15:33.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.919+0000 7fadd77fe640 1 -- 10.20.193.110:0/639368514 >> v1:10.20.193.110:6790/0 conn(0x7fadf8091950 legacy=0x7fadf8088e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:33.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.919+0000 7fadd77fe640 1 -- 10.20.193.110:0/639368514 >> v1:10.20.193.110:6789/0 conn(0x7fadf81401c0 legacy=0x7fadf8089570 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T20:15:33.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.919+0000 7fadd77fe640 10 monclient: _finish_hunting 0 2026-02-13T20:15:33.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.919+0000 7fadd77fe640 1 monclient: found mon.b 2026-02-13T20:15:33.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.919+0000 7fadd77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:15:33.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.919+0000 7fadd77fe640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:15:33.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.919+0000 7fadd77fe640 1 -- 10.20.193.110:0/639368514 --> v1:10.20.193.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadf808c3c0 con 0x7fadf8089c80 2026-02-13T20:15:33.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.919+0000 7fadd77fe640 10 monclient: _finish_auth 0 2026-02-13T20:15:33.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.919+0000 7fadd77fe640 10 monclient: _check_auth_tickets 2026-02-13T20:15:33.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.919+0000 7fadd77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:15:33.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.919+0000 7fadfd1ae640 5 monclient: authenticate success, global_id 4609 2026-02-13T20:15:33.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.919+0000 7fadfd1ae640 10 monclient: _renew_subs 2026-02-13T20:15:33.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.919+0000 7fadfd1ae640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:15:33.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.919+0000 7fadfd1ae640 1 -- 10.20.193.110:0/639368514 --> v1:10.20.193.188:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fadf805d320 con 0x7fadf8089c80 2026-02-13T20:15:33.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.919+0000 7fadfd1ae640 10 monclient: _renew_subs 2026-02-13T20:15:33.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.919+0000 7fadfd1ae640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:15:33.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.919+0000 7fadfd1ae640 1 -- 10.20.193.110:0/639368514 --> v1:10.20.193.188:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fadf812dc10 con 0x7fadf8089c80 2026-02-13T20:15:33.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.919+0000 7fadd77fe640 1 -- 10.20.193.110:0/639368514 <== mon.1 v1:10.20.193.188:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fade8005650 con 0x7fadf8089c80 2026-02-13T20:15:33.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.919+0000 7fadd77fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:15:33.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.919+0000 7fadd77fe640 1 -- 10.20.193.110:0/639368514 <== mon.1 v1:10.20.193.188:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fade8005a30 con 0x7fadf8089c80 2026-02-13T20:15:33.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.919+0000 7fadd77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:33.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.919+0000 7fadd77fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:15:33.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.919+0000 7fadf5573640 4 set_mon_vals no callback set 2026-02-13T20:15:33.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.919+0000 7fadd77fe640 10 monclient: dump: 2026-02-13T20:15:33.938 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:33.938 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:33.938 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:33.938 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:33.938 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:33.938 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:33.938 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:33.938 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:33.938 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:33.938 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:33.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.919+0000 7fadfd1ae640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:15:33.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.919+0000 7fadfd1ae640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:15:33.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.919+0000 7fadfd1ae640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:15:33.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.919+0000 7fadfd1ae640 1 -- 10.20.193.110:0/639368514 --> v1:10.20.193.188:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadf808a1e0 con 0x7fadf8089c80 2026-02-13T20:15:33.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.920+0000 7fadd77fe640 1 -- 10.20.193.110:0/639368514 <== mon.1 v1:10.20.193.188:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fade8005b90 con 0x7fadf8089c80 2026-02-13T20:15:33.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.920+0000 7fadd77fe640 1 -- 10.20.193.110:0/639368514 <== mon.1 v1:10.20.193.188:6789/0 8 ==== osd_map(208..208 src has 1..208) ==== 3899+0+0 (unknown 164138633 0 0) 0x7fade804f750 con 0x7fadf8089c80 2026-02-13T20:15:33.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.920+0000 7fadf6d76640 10 monclient: get_auth_request con 0x7fadc403f630 auth_method 0 2026-02-13T20:15:33.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.922+0000 7fadd77fe640 1 -- 10.20.193.110:0/639368514 <== mon.1 v1:10.20.193.188:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fade8017f00 con 0x7fadf8089c80 2026-02-13T20:15:33.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.922+0000 7fadd77fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:15:33.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:33.922+0000 7fadd77fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:15:34.071 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:34.068+0000 7fadfd1ae640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T20:15:34.071 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:34.068+0000 7fadfd1ae640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T20:15:34.071 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:34.068+0000 7fadfd1ae640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:15:34.071 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:34.068+0000 7fadfd1ae640 1 -- 10.20.193.110:0/639368514 --> v1:10.20.193.188:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fadf8055bb0 con 0x7fadf8089c80 2026-02-13T20:15:34.071 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:34.069+0000 7fadd77fe640 1 -- 10.20.193.110:0/639368514 <== mon.1 v1:10.20.193.188:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 2938771946) 0x7fade804c520 con 0x7fadf8089c80 2026-02-13T20:15:34.071 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:34.069+0000 7fadd77fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T20:15:34.071 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:34.069+0000 7fadd77fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:15:34.072 INFO:teuthology.orchestra.run.trial110.stdout:{"election_epoch":16,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":5,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","modified":"2026-02-13T20:11:07.161192Z","created":"2026-02-13T20:11:07.161192Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6789","nonce":0}]},"addr":"10.20.193.110:6789/0","public_addr":"10.20.193.110:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161241+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6789","nonce":0}]},"addr":"10.20.193.188:6789/0","public_addr":"10.20.193.188:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161242+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6790","nonce":0}]},"addr":"10.20.193.110:6790/0","public_addr":"10.20.193.110:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161243+0000","crush_location":[]}]}} 2026-02-13T20:15:34.073 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:34.070+0000 7fadfd1ae640 1 -- 10.20.193.110:0/639368514 >> v1:10.20.193.188:6812/1623052694 conn(0x7fadc403f630 legacy=0x7fadc405fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:34.073 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:34.070+0000 7fadfd1ae640 10 monclient: shutdown 2026-02-13T20:15:34.073 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:34.070+0000 7fadfd1ae640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:15:34.073 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:34.070+0000 7fadfd1ae640 1 -- 10.20.193.110:0/639368514 >> v1:10.20.193.188:6789/0 conn(0x7fadf8089c80 legacy=0x7fadf81a2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:34.073 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:34.070+0000 7fadfd1ae640 1 -- 10.20.193.110:0/639368514 shutdown_connections 2026-02-13T20:15:34.073 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:34.070+0000 7fadfd1ae640 1 -- 10.20.193.110:0/639368514 >> 10.20.193.110:0/639368514 conn(0x7fadf8054e90 msgr2=0x7fadf808ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:15:34.073 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:34.070+0000 7fadfd1ae640 1 -- 10.20.193.110:0/639368514 shutdown_connections 2026-02-13T20:15:34.074 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:34.070+0000 7fadfd1ae640 1 -- 10.20.193.110:0/639368514 wait complete. 2026-02-13T20:15:37.081 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T20:15:37.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:37.147+0000 7f39933d4640 10 monclient: get_monmap_and_config 2026-02-13T20:15:37.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:37.147+0000 7f39933d4640 10 monclient: build_initial_monmap 2026-02-13T20:15:37.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:37.147+0000 7f39933d4640 10 monclient: monmap: 2026-02-13T20:15:37.151 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:15:37.152 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:37.152 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:15:37.149271+0000 2026-02-13T20:15:37.152 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:15:37.149271+0000 2026-02-13T20:15:37.152 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:15:37.152 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:37.152 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:15:37.152 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:15:37.152 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:15:37.152 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:37.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:37.148+0000 7f39933d4640 1 Processor -- start 2026-02-13T20:15:37.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:37.148+0000 7f39933d4640 1 -- start start 2026-02-13T20:15:37.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:37.148+0000 7f39933d4640 10 monclient: init 2026-02-13T20:15:37.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:37.148+0000 7f39933d4640 10 monclient: _reopen_session rank -1 2026-02-13T20:15:37.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:37.148+0000 7f39933d4640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:15:37.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:37.148+0000 7f39933d4640 10 monclient(hunting): picked mon.noname-a con 0x7f398c1401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:15:37.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:37.148+0000 7f39933d4640 10 monclient(hunting): picked mon.noname-b con 0x7f398c092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:15:37.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:37.148+0000 7f39933d4640 10 monclient(hunting): picked mon.noname-c con 0x7f398c091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:15:37.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:37.148+0000 7f39933d4640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f398c08b730 con 0x7f398c1401c0 2026-02-13T20:15:37.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:37.148+0000 7f39933d4640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f398c05c5b0 con 0x7f398c091950 2026-02-13T20:15:37.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:37.148+0000 7f39933d4640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f398c08bcf0 con 0x7f398c092020 2026-02-13T20:15:37.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:37.148+0000 7f39933d4640 10 monclient(hunting): _renew_subs 2026-02-13T20:15:37.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:37.148+0000 7f3991149640 1 -- >> v1:10.20.193.110:6789/0 conn(0x7f398c1401c0 legacy=0x7f398c091240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:15:37.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:37.148+0000 7f39933d4640 10 monclient(hunting): authenticate will time out at 898.839604s 2026-02-13T20:15:37.154 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:37.148+0000 7f3990948640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f398c092020 0x7f398c1812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:50528/0 (socket says 10.20.193.110:50528) 2026-02-13T20:15:37.154 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:37.148+0000 7f3990948640 1 -- 10.20.193.110:0/2140917222 learned_addr learned my addr 10.20.193.110:0/2140917222 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:15:37.350 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:37.349+0000 7f3991149640 1 -- 10.20.193.110:0/2140917222 >> v1:10.20.193.110:6789/0 conn(0x7f398c1401c0 legacy=0x7f398c091240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:15:37.751 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:37.750+0000 7f3991149640 1 -- 10.20.193.110:0/2140917222 >> v1:10.20.193.110:6789/0 conn(0x7f398c1401c0 legacy=0x7f398c091240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:15:38.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:38.551+0000 7f3991149640 1 -- 10.20.193.110:0/2140917222 >> v1:10.20.193.110:6789/0 conn(0x7f398c1401c0 legacy=0x7f398c091240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:15:40.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:40.149+0000 7f397affd640 10 monclient(hunting): tick 2026-02-13T20:15:40.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:40.149+0000 7f397affd640 10 monclient(hunting): _check_auth_tickets 2026-02-13T20:15:40.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:40.149+0000 7f397affd640 1 monclient(hunting): continuing hunt 2026-02-13T20:15:40.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:40.149+0000 7f397affd640 10 monclient(hunting): _reopen_session rank -1 2026-02-13T20:15:40.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:40.149+0000 7f397affd640 1 -- 10.20.193.110:0/2140917222 >> v1:10.20.193.110:6790/0 conn(0x7f398c092020 legacy=0x7f398c1812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:40.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:40.149+0000 7f397affd640 1 -- 10.20.193.110:0/2140917222 >> v1:10.20.193.188:6789/0 conn(0x7f398c091950 legacy=0x7f398c1a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:40.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:40.149+0000 7f397affd640 1 -- 10.20.193.110:0/2140917222 >> v1:10.20.193.110:6789/0 conn(0x7f398c1401c0 legacy=0x7f398c091240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:15:40.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:40.149+0000 7f397affd640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:15:40.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:40.149+0000 7f397affd640 10 monclient(hunting): picked mon.noname-c con 0x7f398c091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:15:40.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:40.149+0000 7f397affd640 10 monclient(hunting): picked mon.noname-a con 0x7f398c1401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:15:40.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:40.149+0000 7f397affd640 10 monclient(hunting): picked mon.noname-b con 0x7f39700466a0 addr v1:10.20.193.110:6790/0 2026-02-13T20:15:40.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:40.149+0000 7f397affd640 1 -- 10.20.193.110:0/2140917222 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f398c140590 con 0x7f398c1401c0 2026-02-13T20:15:40.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:40.149+0000 7f397affd640 1 -- 10.20.193.110:0/2140917222 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f398c08b730 con 0x7f398c091950 2026-02-13T20:15:40.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:40.149+0000 7f397affd640 1 -- 10.20.193.110:0/2140917222 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f397006a350 con 0x7f39700466a0 2026-02-13T20:15:40.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:40.149+0000 7f397affd640 10 monclient(hunting): _renew_subs 2026-02-13T20:15:40.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:40.149+0000 7f3990948640 1 -- 10.20.193.110:0/2140917222 >> v1:10.20.193.110:6789/0 conn(0x7f398c1401c0 legacy=0x7f3970044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:15:40.352 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:40.351+0000 7f3990948640 1 -- 10.20.193.110:0/2140917222 >> v1:10.20.193.110:6789/0 conn(0x7f398c1401c0 legacy=0x7f3970044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:15:40.754 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:40.753+0000 7f3990948640 1 -- 10.20.193.110:0/2140917222 >> v1:10.20.193.110:6789/0 conn(0x7f398c1401c0 legacy=0x7f3970044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:15:41.555 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:41.554+0000 7f3990948640 1 -- 10.20.193.110:0/2140917222 >> v1:10.20.193.110:6789/0 conn(0x7f398c1401c0 legacy=0x7f3970044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:15:43.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:43.149+0000 7f397affd640 10 monclient(hunting): tick 2026-02-13T20:15:43.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:43.149+0000 7f397affd640 10 monclient(hunting): _check_auth_tickets 2026-02-13T20:15:43.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:43.149+0000 7f397affd640 1 monclient(hunting): continuing hunt 2026-02-13T20:15:43.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:43.149+0000 7f397affd640 10 monclient(hunting): _reopen_session rank -1 2026-02-13T20:15:43.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:43.149+0000 7f397affd640 1 -- 10.20.193.110:0/2140917222 >> v1:10.20.193.110:6790/0 conn(0x7f39700466a0 legacy=0x7f3970066b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:43.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:43.149+0000 7f397affd640 1 -- 10.20.193.110:0/2140917222 >> v1:10.20.193.188:6789/0 conn(0x7f398c091950 legacy=0x7f3970023790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:43.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:43.149+0000 7f397affd640 1 -- 10.20.193.110:0/2140917222 >> v1:10.20.193.110:6789/0 conn(0x7f398c1401c0 legacy=0x7f3970044f60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:15:43.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:43.149+0000 7f397affd640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:15:43.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:43.149+0000 7f397affd640 10 monclient(hunting): picked mon.noname-c con 0x7f39700693b0 addr v1:10.20.193.188:6789/0 2026-02-13T20:15:43.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:43.149+0000 7f397affd640 10 monclient(hunting): picked mon.noname-a con 0x7f398c1401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:15:43.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:43.149+0000 7f397affd640 10 monclient(hunting): picked mon.noname-b con 0x7f39700466a0 addr v1:10.20.193.110:6790/0 2026-02-13T20:15:43.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:43.149+0000 7f397affd640 1 -- 10.20.193.110:0/2140917222 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f397006b610 con 0x7f398c1401c0 2026-02-13T20:15:43.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:43.149+0000 7f397affd640 1 -- 10.20.193.110:0/2140917222 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f398c140590 con 0x7f39700693b0 2026-02-13T20:15:43.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:43.149+0000 7f397affd640 1 -- 10.20.193.110:0/2140917222 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f397006a0e0 con 0x7f39700466a0 2026-02-13T20:15:43.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:43.149+0000 7f397affd640 10 monclient(hunting): _renew_subs 2026-02-13T20:15:43.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:43.149+0000 7f3990948640 1 -- 10.20.193.110:0/2140917222 >> v1:10.20.193.110:6789/0 conn(0x7f398c1401c0 legacy=0x7f3970044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:15:43.351 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:43.350+0000 7f3990948640 1 -- 10.20.193.110:0/2140917222 >> v1:10.20.193.110:6789/0 conn(0x7f398c1401c0 legacy=0x7f3970044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:15:43.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:43.751+0000 7f3990948640 1 -- 10.20.193.110:0/2140917222 >> v1:10.20.193.110:6789/0 conn(0x7f398c1401c0 legacy=0x7f3970044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:15:44.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.552+0000 7f3990948640 1 -- 10.20.193.110:0/2140917222 >> v1:10.20.193.110:6789/0 conn(0x7f398c1401c0 legacy=0x7f3970044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:15:44.912 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.904+0000 7f397bfff640 1 -- 10.20.193.110:0/2140917222 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1112607875 0 0) 0x7f397006a0e0 con 0x7f39700466a0 2026-02-13T20:15:44.912 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.904+0000 7f397bfff640 10 monclient(hunting): _negotiate 2026-02-13T20:15:44.912 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.904+0000 7f397bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:44.912 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.904+0000 7f397bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:44.912 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.904+0000 7f397bfff640 10 monclient(hunting): my global_id is 94163 2026-02-13T20:15:44.912 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.904+0000 7f397bfff640 1 -- 10.20.193.110:0/2140917222 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f39740035e0 con 0x7f39700466a0 2026-02-13T20:15:44.912 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.904+0000 7f397bfff640 1 -- 10.20.193.110:0/2140917222 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 174552640 0 0) 0x7f39740035e0 con 0x7f39700466a0 2026-02-13T20:15:44.912 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.904+0000 7f397bfff640 1 -- 10.20.193.110:0/2140917222 >> v1:10.20.193.188:6789/0 conn(0x7f39700693b0 legacy=0x7f3970069780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:44.913 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.904+0000 7f397bfff640 1 -- 10.20.193.110:0/2140917222 >> v1:10.20.193.110:6789/0 conn(0x7f398c1401c0 legacy=0x7f3970044f60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:15:44.913 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.904+0000 7f397bfff640 10 monclient: _finish_hunting 0 2026-02-13T20:15:44.913 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.904+0000 7f397bfff640 1 monclient: found mon.noname-b 2026-02-13T20:15:44.913 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.904+0000 7f397bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:15:44.913 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.904+0000 7f397bfff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:15:44.913 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.904+0000 7f397bfff640 1 -- 10.20.193.110:0/2140917222 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39700047f0 con 0x7f39700466a0 2026-02-13T20:15:44.913 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.904+0000 7f397bfff640 10 monclient: _finish_auth 0 2026-02-13T20:15:44.913 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.904+0000 7f397bfff640 10 monclient: _check_auth_tickets 2026-02-13T20:15:44.913 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.904+0000 7f397bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:15:44.913 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.904+0000 7f397bfff640 1 -- 10.20.193.110:0/2140917222 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f3988003d90 con 0x7f39700466a0 2026-02-13T20:15:44.913 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.904+0000 7f397bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:44.914 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.904+0000 7f397bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:15:44.914 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.904+0000 7f397bfff640 10 monclient: dump: 2026-02-13T20:15:44.914 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:44.914 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:44.914 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:44.914 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:44.914 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:44.914 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:44.914 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:44.914 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:44.915 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:44.915 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:44.915 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.904+0000 7f39933d4640 5 monclient: authenticate success, global_id 94163 2026-02-13T20:15:44.915 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.904+0000 7f39933d4640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:15:44.915 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.904+0000 7f397bfff640 1 -- 10.20.193.110:0/2140917222 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3988003f90 con 0x7f39700466a0 2026-02-13T20:15:44.915 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.904+0000 7f397bfff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:15:44.915 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.904+0000 7f397bfff640 1 -- 10.20.193.110:0/2140917222 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f39880043a0 con 0x7f39700466a0 2026-02-13T20:15:44.915 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.904+0000 7f397bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:44.915 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.904+0000 7f397bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:15:44.915 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.904+0000 7f397bfff640 10 monclient: dump: 2026-02-13T20:15:44.915 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:44.916 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:44.916 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:44.916 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:44.916 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:44.916 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:44.916 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:44.916 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:44.916 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:44.916 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:44.916 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.904+0000 7f39933d4640 10 monclient: get_monmap_and_config success 2026-02-13T20:15:44.916 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.904+0000 7f39933d4640 4 set_mon_vals no callback set 2026-02-13T20:15:44.917 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.904+0000 7f39933d4640 10 monclient: shutdown 2026-02-13T20:15:44.917 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.904+0000 7f39933d4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:15:44.917 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.904+0000 7f39933d4640 1 -- 10.20.193.110:0/2140917222 >> v1:10.20.193.110:6790/0 conn(0x7f39700466a0 legacy=0x7f3970066b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:44.917 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.905+0000 7f39933d4640 1 -- 10.20.193.110:0/2140917222 shutdown_connections 2026-02-13T20:15:44.917 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.905+0000 7f39933d4640 1 -- 10.20.193.110:0/2140917222 >> 10.20.193.110:0/2140917222 conn(0x7f398c054e90 msgr2=0x7f398c058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:15:44.917 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.905+0000 7f39933d4640 1 -- 10.20.193.110:0/2140917222 shutdown_connections 2026-02-13T20:15:44.917 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.905+0000 7f39933d4640 1 -- 10.20.193.110:0/2140917222 wait complete. 2026-02-13T20:15:44.917 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.905+0000 7f39933d4640 10 monclient: build_initial_monmap 2026-02-13T20:15:44.917 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.905+0000 7f39933d4640 10 monclient: monmap: 2026-02-13T20:15:44.917 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:15:44.917 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:15:44.918 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:15:44.918 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:15:44.918 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:15:44.918 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:15:44.918 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:15:44.918 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:15:44.918 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:15:44.918 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:44.918 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.906+0000 7f39933d4640 1 Processor -- start 2026-02-13T20:15:44.918 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.906+0000 7f39933d4640 1 -- start start 2026-02-13T20:15:44.918 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.906+0000 7f39933d4640 10 monclient: init 2026-02-13T20:15:44.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.906+0000 7f39933d4640 10 monclient: _reopen_session rank -1 2026-02-13T20:15:44.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.906+0000 7f39933d4640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:15:44.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.906+0000 7f39933d4640 10 monclient(hunting): picked mon.noname-a con 0x7f39700466a0 addr v1:10.20.193.110:6789/0 2026-02-13T20:15:44.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.906+0000 7f39933d4640 10 monclient(hunting): picked mon.noname-c con 0x7f39700693b0 addr v1:10.20.193.110:6790/0 2026-02-13T20:15:44.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.906+0000 7f39933d4640 10 monclient(hunting): picked mon.noname-b con 0x7f398c1401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:15:44.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.906+0000 7f39933d4640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f398c05d320 con 0x7f39700466a0 2026-02-13T20:15:44.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.906+0000 7f3991149640 1 -- >> v1:10.20.193.110:6789/0 conn(0x7f39700466a0 legacy=0x7f398c088e30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:15:44.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.906+0000 7f39933d4640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f398c1321b0 con 0x7f398c1401c0 2026-02-13T20:15:44.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.906+0000 7f39933d4640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f398c089c50 con 0x7f39700693b0 2026-02-13T20:15:44.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.906+0000 7f39933d4640 10 monclient(hunting): _renew_subs 2026-02-13T20:15:44.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.906+0000 7f39933d4640 10 monclient(hunting): authenticate will time out at 906.596472s 2026-02-13T20:15:44.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.906+0000 7f3990948640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f39700693b0 0x7f398c089540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:56190/0 (socket says 10.20.193.110:56190) 2026-02-13T20:15:44.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.906+0000 7f3990948640 1 -- 10.20.193.110:0/1936100901 learned_addr learned my addr 10.20.193.110:0/1936100901 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:15:44.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.906+0000 7f3979ffb640 1 -- 10.20.193.110:0/1936100901 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 884551255 0 0) 0x7f398c089c50 con 0x7f39700693b0 2026-02-13T20:15:44.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.906+0000 7f3979ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:15:44.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.906+0000 7f3979ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:44.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.906+0000 7f3979ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:44.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.906+0000 7f3979ffb640 10 monclient(hunting): my global_id is 94166 2026-02-13T20:15:44.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.906+0000 7f3979ffb640 1 -- 10.20.193.110:0/1936100901 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f395c0035e0 con 0x7f39700693b0 2026-02-13T20:15:44.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.906+0000 7f3979ffb640 1 -- 10.20.193.110:0/1936100901 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4064048055 0 0) 0x7f395c0035e0 con 0x7f39700693b0 2026-02-13T20:15:44.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.907+0000 7f3979ffb640 1 -- 10.20.193.110:0/1936100901 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f398c089c50 con 0x7f39700693b0 2026-02-13T20:15:44.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.907+0000 7f3979ffb640 1 -- 10.20.193.110:0/1936100901 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f3980003030 con 0x7f39700693b0 2026-02-13T20:15:44.921 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.907+0000 7f3979ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:15:44.921 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.907+0000 7f3979ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:15:44.921 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.907+0000 7f3979ffb640 10 monclient(hunting): dump: 2026-02-13T20:15:44.921 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:44.921 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:44.921 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:44.921 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:44.921 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:44.921 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:44.921 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:44.921 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:44.922 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:44.922 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:44.922 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.907+0000 7f3979ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:15:44.922 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.907+0000 7f3979ffb640 1 -- 10.20.193.110:0/1936100901 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2978202419 0 0) 0x7f398c1321b0 con 0x7f398c1401c0 2026-02-13T20:15:44.922 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.907+0000 7f3979ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:15:44.922 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.907+0000 7f3979ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:44.922 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.907+0000 7f3979ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:44.922 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.907+0000 7f3979ffb640 10 monclient(hunting): my global_id is 4612 2026-02-13T20:15:44.922 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.907+0000 7f3979ffb640 1 -- 10.20.193.110:0/1936100901 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f395c0035e0 con 0x7f398c1401c0 2026-02-13T20:15:44.922 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.907+0000 7f3979ffb640 1 -- 10.20.193.110:0/1936100901 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 141128072 0 0) 0x7f398c089c50 con 0x7f39700693b0 2026-02-13T20:15:44.922 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.907+0000 7f3979ffb640 1 -- 10.20.193.110:0/1936100901 >> v1:10.20.193.188:6789/0 conn(0x7f398c1401c0 legacy=0x7f398c23bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:44.923 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.907+0000 7f3979ffb640 1 -- 10.20.193.110:0/1936100901 >> v1:10.20.193.110:6789/0 conn(0x7f39700466a0 legacy=0x7f398c088e30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T20:15:44.923 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.907+0000 7f3979ffb640 10 monclient: _finish_hunting 0 2026-02-13T20:15:44.923 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.907+0000 7f3979ffb640 1 monclient: found mon.c 2026-02-13T20:15:44.923 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.907+0000 7f3979ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:15:44.923 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.907+0000 7f3979ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:15:44.923 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.907+0000 7f3979ffb640 1 -- 10.20.193.110:0/1936100901 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f398c13f5f0 con 0x7f39700693b0 2026-02-13T20:15:44.923 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.907+0000 7f3979ffb640 10 monclient: _finish_auth 0 2026-02-13T20:15:44.923 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.907+0000 7f3979ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:15:44.923 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.907+0000 7f3979ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:15:44.923 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.907+0000 7f39933d4640 5 monclient: authenticate success, global_id 94166 2026-02-13T20:15:44.923 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.907+0000 7f39933d4640 10 monclient: _renew_subs 2026-02-13T20:15:44.923 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.907+0000 7f39933d4640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:15:44.923 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.907+0000 7f39933d4640 1 -- 10.20.193.110:0/1936100901 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f398c090f20 con 0x7f39700693b0 2026-02-13T20:15:44.924 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.907+0000 7f39933d4640 10 monclient: _renew_subs 2026-02-13T20:15:44.924 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.907+0000 7f39933d4640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:15:44.924 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.907+0000 7f39933d4640 1 -- 10.20.193.110:0/1936100901 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f398c131ed0 con 0x7f39700693b0 2026-02-13T20:15:44.924 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.907+0000 7f3979ffb640 1 -- 10.20.193.110:0/1936100901 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f39800048a0 con 0x7f39700693b0 2026-02-13T20:15:44.924 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.907+0000 7f3979ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T20:15:44.924 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.907+0000 7f3979ffb640 1 -- 10.20.193.110:0/1936100901 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f3980004c40 con 0x7f39700693b0 2026-02-13T20:15:44.924 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.907+0000 7f3979ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:44.924 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.907+0000 7f3979ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:15:44.924 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.907+0000 7f3979ffb640 10 monclient: dump: 2026-02-13T20:15:44.924 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:44.924 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:44.925 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:44.925 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:44.925 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:44.925 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:44.925 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:44.925 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:44.925 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:44.925 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:44.925 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.907+0000 7f397b7fe640 4 set_mon_vals no callback set 2026-02-13T20:15:44.925 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.907+0000 7f39933d4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:15:44.925 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.907+0000 7f39933d4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:15:44.925 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.907+0000 7f39933d4640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:15:44.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.907+0000 7f39933d4640 1 -- 10.20.193.110:0/1936100901 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f398c1306f0 con 0x7f39700693b0 2026-02-13T20:15:44.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.907+0000 7f3979ffb640 1 -- 10.20.193.110:0/1936100901 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f3980004da0 con 0x7f39700693b0 2026-02-13T20:15:44.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.908+0000 7f3979ffb640 1 -- 10.20.193.110:0/1936100901 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(208..208 src has 1..208) ==== 3899+0+0 (unknown 164138633 0 0) 0x7f398004e950 con 0x7f39700693b0 2026-02-13T20:15:44.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.908+0000 7f3991149640 10 monclient: get_auth_request con 0x7f395c03f760 auth_method 0 2026-02-13T20:15:44.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.910+0000 7f3979ffb640 1 -- 10.20.193.110:0/1936100901 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f3980017110 con 0x7f39700693b0 2026-02-13T20:15:44.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.910+0000 7f3979ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:15:44.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:44.910+0000 7f3979ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:15:45.057 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.056+0000 7f39933d4640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T20:15:45.058 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.056+0000 7f39933d4640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T20:15:45.058 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.056+0000 7f39933d4640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:15:45.058 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.056+0000 7f39933d4640 1 -- 10.20.193.110:0/1936100901 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f398c055bb0 con 0x7f39700693b0 2026-02-13T20:15:45.058 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.056+0000 7f3979ffb640 1 -- 10.20.193.110:0/1936100901 <== mon.2 v1:10.20.193.110:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 2695834445) 0x7f39800168c0 con 0x7f39700693b0 2026-02-13T20:15:45.058 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.056+0000 7f3979ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T20:15:45.058 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.056+0000 7f3979ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:15:45.059 INFO:teuthology.orchestra.run.trial110.stdout:{"election_epoch":20,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","modified":"2026-02-13T20:11:07.161192Z","created":"2026-02-13T20:11:07.161192Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6789","nonce":0}]},"addr":"10.20.193.110:6789/0","public_addr":"10.20.193.110:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161241+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6789","nonce":0}]},"addr":"10.20.193.188:6789/0","public_addr":"10.20.193.188:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161242+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6790","nonce":0}]},"addr":"10.20.193.110:6790/0","public_addr":"10.20.193.110:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161243+0000","crush_location":[]}]}} 2026-02-13T20:15:45.060 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.057+0000 7f39933d4640 1 -- 10.20.193.110:0/1936100901 >> v1:10.20.193.188:6812/1623052694 conn(0x7f395c03f760 legacy=0x7f395c05fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:45.060 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.057+0000 7f39933d4640 10 monclient: shutdown 2026-02-13T20:15:45.060 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.057+0000 7f39933d4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:15:45.060 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.057+0000 7f39933d4640 1 -- 10.20.193.110:0/1936100901 >> v1:10.20.193.110:6790/0 conn(0x7f39700693b0 legacy=0x7f398c089540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:45.060 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.057+0000 7f39933d4640 1 -- 10.20.193.110:0/1936100901 shutdown_connections 2026-02-13T20:15:45.060 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.057+0000 7f39933d4640 1 -- 10.20.193.110:0/1936100901 >> 10.20.193.110:0/1936100901 conn(0x7f398c054e90 msgr2=0x7f398c08d750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:15:45.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.057+0000 7f39933d4640 1 -- 10.20.193.110:0/1936100901 shutdown_connections 2026-02-13T20:15:45.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.057+0000 7f39933d4640 1 -- 10.20.193.110:0/1936100901 wait complete. 2026-02-13T20:15:45.067 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-13T20:15:45.067 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-13T20:15:45.067 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T20:15:45.143 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.132+0000 7fa0a461b640 10 monclient: get_monmap_and_config 2026-02-13T20:15:45.143 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.132+0000 7fa0a461b640 10 monclient: build_initial_monmap 2026-02-13T20:15:45.144 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.132+0000 7fa0a461b640 10 monclient: monmap: 2026-02-13T20:15:45.144 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:15:45.144 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:45.144 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:15:45.132702+0000 2026-02-13T20:15:45.144 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:15:45.132702+0000 2026-02-13T20:15:45.144 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:15:45.144 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:45.144 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:15:45.144 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:15:45.144 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:15:45.145 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:45.145 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.132+0000 7fa0a461b640 1 Processor -- start 2026-02-13T20:15:45.145 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.132+0000 7fa0a461b640 1 -- start start 2026-02-13T20:15:45.145 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.132+0000 7fa0a461b640 10 monclient: init 2026-02-13T20:15:45.145 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.132+0000 7fa0a461b640 10 monclient: _reopen_session rank -1 2026-02-13T20:15:45.145 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.132+0000 7fa0a461b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:15:45.145 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.132+0000 7fa0a461b640 10 monclient(hunting): picked mon.noname-b con 0x7fa09c1401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:15:45.145 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.132+0000 7fa0a461b640 10 monclient(hunting): picked mon.noname-a con 0x7fa09c092020 addr v1:10.20.193.110:6789/0 2026-02-13T20:15:45.145 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.133+0000 7fa0a461b640 10 monclient(hunting): picked mon.noname-c con 0x7fa09c091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:15:45.145 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.133+0000 7fa0a461b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa09c08b730 con 0x7fa09c092020 2026-02-13T20:15:45.145 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.133+0000 7fa0a461b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa09c05c5b0 con 0x7fa09c091950 2026-02-13T20:15:45.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.133+0000 7fa0a461b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa09c08bcf0 con 0x7fa09c1401c0 2026-02-13T20:15:45.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.133+0000 7fa0a461b640 10 monclient(hunting): _renew_subs 2026-02-13T20:15:45.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.133+0000 7fa0a461b640 10 monclient(hunting): authenticate will time out at 906.823025s 2026-02-13T20:15:45.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.133+0000 7fa0a1b8f640 1 -- >> v1:10.20.193.110:6789/0 conn(0x7fa09c092020 legacy=0x7fa09c1812f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:15:45.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.133+0000 7fa0a2390640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fa09c1401c0 0x7fa09c091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:56192/0 (socket says 10.20.193.110:56192) 2026-02-13T20:15:45.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.133+0000 7fa0a2390640 1 -- 10.20.193.110:0/1713267047 learned_addr learned my addr 10.20.193.110:0/1713267047 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:15:45.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.133+0000 7fa0a138e640 1 -- 10.20.193.110:0/1713267047 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2750661897 0 0) 0x7fa09c08bcf0 con 0x7fa09c1401c0 2026-02-13T20:15:45.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.133+0000 7fa0a138e640 10 monclient(hunting): _negotiate 2026-02-13T20:15:45.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.133+0000 7fa0a138e640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:45.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.133+0000 7fa0a138e640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:45.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.133+0000 7fa0a138e640 10 monclient(hunting): my global_id is 94169 2026-02-13T20:15:45.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.133+0000 7fa0a138e640 1 -- 10.20.193.110:0/1713267047 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0840035e0 con 0x7fa09c1401c0 2026-02-13T20:15:45.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.133+0000 7fa0a138e640 1 -- 10.20.193.110:0/1713267047 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 338201317 0 0) 0x7fa0840035e0 con 0x7fa09c1401c0 2026-02-13T20:15:45.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.133+0000 7fa0a138e640 1 -- 10.20.193.110:0/1713267047 >> v1:10.20.193.188:6789/0 conn(0x7fa09c091950 legacy=0x7fa09c1a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:45.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.133+0000 7fa0a138e640 1 -- 10.20.193.110:0/1713267047 >> v1:10.20.193.110:6789/0 conn(0x7fa09c092020 legacy=0x7fa09c1812f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:15:45.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.133+0000 7fa0a138e640 10 monclient: _finish_hunting 0 2026-02-13T20:15:45.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.133+0000 7fa0a138e640 1 monclient: found mon.noname-b 2026-02-13T20:15:45.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.133+0000 7fa0a138e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:15:45.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.133+0000 7fa0a138e640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:15:45.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.133+0000 7fa0a138e640 1 -- 10.20.193.110:0/1713267047 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa09c140590 con 0x7fa09c1401c0 2026-02-13T20:15:45.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.133+0000 7fa0a138e640 10 monclient: _finish_auth 0 2026-02-13T20:15:45.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.133+0000 7fa0a138e640 10 monclient: _check_auth_tickets 2026-02-13T20:15:45.148 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.133+0000 7fa0a138e640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:15:45.148 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.133+0000 7fa0a138e640 1 -- 10.20.193.110:0/1713267047 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa08c002dd0 con 0x7fa09c1401c0 2026-02-13T20:15:45.148 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.133+0000 7fa0a138e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:45.148 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.133+0000 7fa0a138e640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:15:45.148 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.133+0000 7fa0a138e640 10 monclient: dump: 2026-02-13T20:15:45.148 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:45.148 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:45.148 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:45.148 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:45.148 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:45.148 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:45.149 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:45.149 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:45.149 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:45.149 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:45.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.133+0000 7fa0a461b640 5 monclient: authenticate success, global_id 94169 2026-02-13T20:15:45.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.133+0000 7fa0a461b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:15:45.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.133+0000 7fa0a138e640 1 -- 10.20.193.110:0/1713267047 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa08c003020 con 0x7fa09c1401c0 2026-02-13T20:15:45.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.133+0000 7fa0a138e640 10 monclient: handle_config config(0 keys) 2026-02-13T20:15:45.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.133+0000 7fa0a138e640 1 -- 10.20.193.110:0/1713267047 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa08c003430 con 0x7fa09c1401c0 2026-02-13T20:15:45.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.133+0000 7fa0a138e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:45.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.133+0000 7fa0a138e640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:15:45.150 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.133+0000 7fa0a138e640 10 monclient: dump: 2026-02-13T20:15:45.150 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:45.150 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:45.150 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:45.150 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:45.150 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:45.150 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:45.150 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:45.150 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:45.150 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:45.150 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:45.150 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.133+0000 7fa0a461b640 10 monclient: get_monmap_and_config success 2026-02-13T20:15:45.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.133+0000 7fa0a461b640 4 set_mon_vals no callback set 2026-02-13T20:15:45.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.133+0000 7fa0a461b640 10 monclient: shutdown 2026-02-13T20:15:45.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.133+0000 7fa0a461b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:15:45.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.133+0000 7fa0a461b640 1 -- 10.20.193.110:0/1713267047 >> v1:10.20.193.110:6790/0 conn(0x7fa09c1401c0 legacy=0x7fa09c091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:45.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.133+0000 7fa0a461b640 1 -- 10.20.193.110:0/1713267047 shutdown_connections 2026-02-13T20:15:45.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.133+0000 7fa0a461b640 1 -- 10.20.193.110:0/1713267047 >> 10.20.193.110:0/1713267047 conn(0x7fa09c054e90 msgr2=0x7fa09c058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:15:45.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.133+0000 7fa0a461b640 1 -- 10.20.193.110:0/1713267047 shutdown_connections 2026-02-13T20:15:45.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.133+0000 7fa0a461b640 1 -- 10.20.193.110:0/1713267047 wait complete. 2026-02-13T20:15:45.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.134+0000 7fa0a461b640 10 monclient: build_initial_monmap 2026-02-13T20:15:45.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.134+0000 7fa0a461b640 10 monclient: monmap: 2026-02-13T20:15:45.151 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:15:45.151 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:15:45.152 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:15:45.152 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:15:45.152 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:15:45.152 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:15:45.152 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:15:45.152 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:15:45.152 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:15:45.152 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:45.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.134+0000 7fa0a461b640 1 Processor -- start 2026-02-13T20:15:45.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.134+0000 7fa0a461b640 1 -- start start 2026-02-13T20:15:45.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.134+0000 7fa0a461b640 10 monclient: init 2026-02-13T20:15:45.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.134+0000 7fa0a461b640 10 monclient: _reopen_session rank -1 2026-02-13T20:15:45.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.134+0000 7fa0a461b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:15:45.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.134+0000 7fa0a461b640 10 monclient(hunting): picked mon.noname-c con 0x7fa09c091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:15:45.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.134+0000 7fa0a461b640 10 monclient(hunting): picked mon.noname-b con 0x7fa09c1401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:15:45.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.134+0000 7fa0a461b640 10 monclient(hunting): picked mon.noname-a con 0x7fa09c192710 addr v1:10.20.193.110:6789/0 2026-02-13T20:15:45.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.134+0000 7fa0a461b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa09c05d320 con 0x7fa09c192710 2026-02-13T20:15:45.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.134+0000 7fa0a461b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa09c12dba0 con 0x7fa09c1401c0 2026-02-13T20:15:45.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.134+0000 7fa0a461b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa09c12fc20 con 0x7fa09c091950 2026-02-13T20:15:45.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.134+0000 7fa0a461b640 10 monclient(hunting): _renew_subs 2026-02-13T20:15:45.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.134+0000 7fa0a461b640 10 monclient(hunting): authenticate will time out at 906.824926s 2026-02-13T20:15:45.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.134+0000 7fa0a2b91640 1 -- >> v1:10.20.193.110:6789/0 conn(0x7fa09c192710 legacy=0x7fa09c192b90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:15:45.154 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.134+0000 7fa0a2390640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fa09c091950 0x7fa09c1503a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:56202/0 (socket says 10.20.193.110:56202) 2026-02-13T20:15:45.154 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.134+0000 7fa0a2390640 1 -- 10.20.193.110:0/1643535560 learned_addr learned my addr 10.20.193.110:0/1643535560 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:15:45.154 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.135+0000 7fa082ffd640 1 -- 10.20.193.110:0/1643535560 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 334466741 0 0) 0x7fa09c12fc20 con 0x7fa09c091950 2026-02-13T20:15:45.154 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.135+0000 7fa082ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:15:45.154 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.135+0000 7fa082ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:45.154 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.135+0000 7fa082ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:45.154 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.135+0000 7fa082ffd640 10 monclient(hunting): my global_id is 94172 2026-02-13T20:15:45.154 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.135+0000 7fa082ffd640 1 -- 10.20.193.110:0/1643535560 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa06c0035e0 con 0x7fa09c091950 2026-02-13T20:15:45.154 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.135+0000 7fa082ffd640 1 -- 10.20.193.110:0/1643535560 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1303135006 0 0) 0x7fa06c0035e0 con 0x7fa09c091950 2026-02-13T20:15:45.154 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.135+0000 7fa082ffd640 1 -- 10.20.193.110:0/1643535560 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa09c12fc20 con 0x7fa09c091950 2026-02-13T20:15:45.154 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.135+0000 7fa082ffd640 1 -- 10.20.193.110:0/1643535560 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa08c003340 con 0x7fa09c091950 2026-02-13T20:15:45.155 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.135+0000 7fa082ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:15:45.155 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.135+0000 7fa082ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:15:45.155 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.135+0000 7fa082ffd640 10 monclient(hunting): dump: 2026-02-13T20:15:45.155 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:45.155 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:45.155 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:45.155 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:45.155 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:45.155 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:45.155 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:45.155 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:45.155 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:45.156 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:45.156 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.135+0000 7fa082ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:15:45.156 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.135+0000 7fa082ffd640 1 -- 10.20.193.110:0/1643535560 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3336461372 0 0) 0x7fa09c12fc20 con 0x7fa09c091950 2026-02-13T20:15:45.156 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.135+0000 7fa082ffd640 1 -- 10.20.193.110:0/1643535560 >> v1:10.20.193.188:6789/0 conn(0x7fa09c1401c0 legacy=0x7fa09c13e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:45.156 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.135+0000 7fa082ffd640 1 -- 10.20.193.110:0/1643535560 >> v1:10.20.193.110:6789/0 conn(0x7fa09c192710 legacy=0x7fa09c192b90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T20:15:45.156 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.135+0000 7fa082ffd640 10 monclient: _finish_hunting 0 2026-02-13T20:15:45.156 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.135+0000 7fa082ffd640 1 monclient: found mon.c 2026-02-13T20:15:45.156 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.135+0000 7fa082ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:15:45.156 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.135+0000 7fa082ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:15:45.156 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.135+0000 7fa082ffd640 1 -- 10.20.193.110:0/1643535560 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa09c12ff00 con 0x7fa09c091950 2026-02-13T20:15:45.156 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.135+0000 7fa082ffd640 10 monclient: _finish_auth 0 2026-02-13T20:15:45.157 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.135+0000 7fa082ffd640 10 monclient: _check_auth_tickets 2026-02-13T20:15:45.157 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.135+0000 7fa082ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:15:45.157 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.135+0000 7fa0a461b640 5 monclient: authenticate success, global_id 94172 2026-02-13T20:15:45.157 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.135+0000 7fa0a461b640 10 monclient: _renew_subs 2026-02-13T20:15:45.157 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.135+0000 7fa0a461b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:15:45.157 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.135+0000 7fa0a461b640 1 -- 10.20.193.110:0/1643535560 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa09c12ebc0 con 0x7fa09c091950 2026-02-13T20:15:45.157 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.135+0000 7fa0a461b640 10 monclient: _renew_subs 2026-02-13T20:15:45.157 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.135+0000 7fa0a461b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:15:45.157 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.135+0000 7fa0a461b640 1 -- 10.20.193.110:0/1643535560 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fa09c13efe0 con 0x7fa09c091950 2026-02-13T20:15:45.157 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.135+0000 7fa082ffd640 1 -- 10.20.193.110:0/1643535560 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa08c004c00 con 0x7fa09c091950 2026-02-13T20:15:45.157 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.135+0000 7fa082ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:15:45.157 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.135+0000 7fa082ffd640 1 -- 10.20.193.110:0/1643535560 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa08c004fe0 con 0x7fa09c091950 2026-02-13T20:15:45.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.135+0000 7fa082ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:45.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.135+0000 7fa082ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:15:45.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.135+0000 7fa0a0b8d640 4 set_mon_vals no callback set 2026-02-13T20:15:45.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.135+0000 7fa082ffd640 10 monclient: dump: 2026-02-13T20:15:45.158 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:45.158 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:45.158 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:45.158 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:45.158 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:45.158 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:45.158 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:45.158 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:45.159 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:45.159 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:45.159 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.135+0000 7fa0a461b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:15:45.159 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.136+0000 7fa0a461b640 1 -- 10.20.193.110:0/1643535560 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa09c12f660 con 0x7fa09c092020 2026-02-13T20:15:45.159 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.136+0000 7fa082ffd640 1 -- 10.20.193.110:0/1643535560 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4244877818 0 0) 0x7fa09c12f660 con 0x7fa09c092020 2026-02-13T20:15:45.159 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.136+0000 7fa082ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:15:45.159 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.136+0000 7fa082ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:45.159 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.136+0000 7fa082ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:45.159 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.136+0000 7fa082ffd640 10 monclient(hunting): my global_id is 94175 2026-02-13T20:15:45.159 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.136+0000 7fa082ffd640 1 -- 10.20.193.110:0/1643535560 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa09c12fc20 con 0x7fa09c092020 2026-02-13T20:15:45.159 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.136+0000 7fa082ffd640 1 -- 10.20.193.110:0/1643535560 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fa08c005140 con 0x7fa09c091950 2026-02-13T20:15:45.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.136+0000 7fa082ffd640 1 -- 10.20.193.110:0/1643535560 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(208..208 src has 1..208) ==== 3899+0+0 (unknown 164138633 0 0) 0x7fa08c04eb00 con 0x7fa09c091950 2026-02-13T20:15:45.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.136+0000 7fa082ffd640 1 -- 10.20.193.110:0/1643535560 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1076681533 0 0) 0x7fa09c12fc20 con 0x7fa09c092020 2026-02-13T20:15:45.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.136+0000 7fa082ffd640 1 -- 10.20.193.110:0/1643535560 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa09c12f660 con 0x7fa09c092020 2026-02-13T20:15:45.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.136+0000 7fa082ffd640 1 -- 10.20.193.110:0/1643535560 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa090003ee0 con 0x7fa09c092020 2026-02-13T20:15:45.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.136+0000 7fa082ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:45.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.136+0000 7fa082ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:15:45.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.136+0000 7fa082ffd640 10 monclient: dump: 2026-02-13T20:15:45.160 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:45.160 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:45.160 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:45.160 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:45.161 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:45.161 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:45.161 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:45.161 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:45.161 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:45.161 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:45.161 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.136+0000 7fa0a2b91640 10 monclient: get_auth_request con 0x7fa06c03f750 auth_method 0 2026-02-13T20:15:45.161 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.136+0000 7fa082ffd640 1 -- 10.20.193.110:0/1643535560 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1420390068 0 0) 0x7fa09c12f660 con 0x7fa09c092020 2026-02-13T20:15:45.161 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.136+0000 7fa082ffd640 1 -- 10.20.193.110:0/1643535560 --> v1:10.20.193.110:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa09c12f8a0 con 0x7fa09c092020 2026-02-13T20:15:45.161 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.137+0000 7fa082ffd640 1 -- 10.20.193.110:0/1643535560 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fa0900054c0 con 0x7fa09c092020 2026-02-13T20:15:45.161 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.137+0000 7fa082ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:15:45.161 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.137+0000 7fa082ffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:15:45.162 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.137+0000 7fa082ffd640 1 -- 10.20.193.110:0/1643535560 >> v1:10.20.193.110:6790/0 conn(0x7fa09c092020 legacy=0x7fa09c127b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:45.162 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.137+0000 7fa082ffd640 1 -- 10.20.193.110:0/1643535560 >> v1:10.20.193.110:6790/0 conn(0x7fa09c092020 legacy=0x7fa09c127b20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:15:45.162 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.140+0000 7fa0a461b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:15:45.162 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.140+0000 7fa0a461b640 1 -- 10.20.193.110:0/1643535560 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa09c055bb0 con 0x7fa09c128230 2026-02-13T20:15:45.162 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.140+0000 7fa082ffd640 1 -- 10.20.193.110:0/1643535560 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2608632253 0 0) 0x7fa09c055bb0 con 0x7fa09c128230 2026-02-13T20:15:45.162 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.140+0000 7fa082ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:15:45.162 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.140+0000 7fa082ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:45.162 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.140+0000 7fa082ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:45.162 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.140+0000 7fa082ffd640 10 monclient(hunting): my global_id is 94178 2026-02-13T20:15:45.162 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.140+0000 7fa082ffd640 1 -- 10.20.193.110:0/1643535560 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa09c12f660 con 0x7fa09c128230 2026-02-13T20:15:45.162 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.140+0000 7fa082ffd640 1 -- 10.20.193.110:0/1643535560 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 646189630 0 0) 0x7fa09c12f660 con 0x7fa09c128230 2026-02-13T20:15:45.162 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.140+0000 7fa082ffd640 1 -- 10.20.193.110:0/1643535560 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa09c055bb0 con 0x7fa09c128230 2026-02-13T20:15:45.163 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.140+0000 7fa082ffd640 1 -- 10.20.193.110:0/1643535560 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa0900045e0 con 0x7fa09c128230 2026-02-13T20:15:45.163 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.140+0000 7fa082ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:45.163 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.140+0000 7fa082ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:15:45.163 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.140+0000 7fa082ffd640 10 monclient: dump: 2026-02-13T20:15:45.163 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:45.163 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:45.163 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:45.163 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:45.163 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:45.163 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:45.163 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:45.163 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:45.164 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:45.164 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:45.164 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.140+0000 7fa082ffd640 1 -- 10.20.193.110:0/1643535560 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1248316494 0 0) 0x7fa09c055bb0 con 0x7fa09c128230 2026-02-13T20:15:45.164 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.140+0000 7fa082ffd640 1 -- 10.20.193.110:0/1643535560 --> v1:10.20.193.110:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa09c08b450 con 0x7fa09c128230 2026-02-13T20:15:45.164 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.141+0000 7fa082ffd640 1 -- 10.20.193.110:0/1643535560 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4502 (unknown 0 0 624244905) 0x7fa090004a20 con 0x7fa09c128230 2026-02-13T20:15:45.164 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.141+0000 7fa082ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:15:45.164 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.141+0000 7fa082ffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:15:45.164 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.141+0000 7fa082ffd640 1 -- 10.20.193.110:0/1643535560 >> v1:10.20.193.110:6790/0 conn(0x7fa09c128230 legacy=0x7fa09c1952c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:45.164 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.141+0000 7fa082ffd640 1 -- 10.20.193.110:0/1643535560 >> v1:10.20.193.110:6790/0 conn(0x7fa09c128230 legacy=0x7fa09c1952c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:15:45.165 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:15:45.165 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:15:45.165 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:15:45.165 INFO:teuthology.orchestra.run.trial110.stdout: "state": "peon", 2026-02-13T20:15:45.165 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 20, 2026-02-13T20:15:45.165 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 16764, 2026-02-13T20:15:45.165 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:15:45.166 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:15:45.166 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:15:45.166 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:15:45.166 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 0, 2026-02-13T20:15:45.166 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:15:45.166 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:15:45.166 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:15:45.166 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:15:45.166 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:15:45.166 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:15:45.166 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:15:45.167 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:15:45.167 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:15:45.167 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:15:45.167 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:15:45.167 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:15:45.167 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:15:45.167 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:15:45.167 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:15:45.167 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:15:45.167 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:15:45.167 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:15:45.167 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:15:45.167 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:15:45.168 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:15:45.168 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:15:45.168 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:15:45.168 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:15:45.168 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:15:45.168 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:15:45.168 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:15:45.168 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:15:45.168 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:15:45.168 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:15:45.168 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:15:45.168 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:15:45.168 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:15:45.169 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:45.169 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:15:45.169 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:15:45.169 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:15:45.169 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:15:45.169 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:15:45.169 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:15:45.169 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:15:45.169 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:15:45.169 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:15:45.169 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:15:45.169 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:15:45.170 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:15:45.170 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:15:45.170 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:15:45.170 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:15:45.170 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:15:45.170 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:15:45.170 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:15:45.170 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:15:45.170 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:15:45.170 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:15:45.170 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:15:45.170 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:15:45.170 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:15:45.171 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:15:45.171 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:15:45.171 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:15:45.171 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:15:45.171 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:15:45.171 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:15:45.171 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:15:45.171 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:15:45.171 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:45.171 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:15:45.171 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:45.171 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:15:45.171 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:15:45.172 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:15:45.172 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:15:45.172 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:45.172 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:15:45.172 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:15:45.172 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:15:45.172 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:45.172 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:15:45.172 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:45.172 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:15:45.172 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:15:45.172 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:15:45.172 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:15:45.172 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:15:45.173 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:15:45.173 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:45.173 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:45.173 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:15:45.173 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:15:45.173 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:15:45.173 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:15:45.173 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:45.173 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:15:45.173 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:15:45.173 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:15:45.173 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:45.173 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:15:45.173 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:45.173 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:15:45.174 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:15:45.174 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:15:45.174 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:15:45.174 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:15:45.174 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:15:45.174 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:45.174 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:45.174 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:15:45.174 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:15:45.174 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:15:45.174 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:15:45.174 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:45.174 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:15:45.174 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:15:45.174 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:15:45.174 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:45.175 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:15:45.175 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:45.175 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:15:45.175 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:15:45.175 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:15:45.175 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:15:45.175 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:15:45.175 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:15:45.175 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:45.175 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:15:45.175 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:45.175 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:15:45.175 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:15:45.175 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:45.175 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:15:45.175 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:15:45.176 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:15:45.176 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:45.176 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:15:45.176 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:15:45.176 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:45.176 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:15:45.176 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:15:45.176 INFO:teuthology.orchestra.run.trial110.stdout: "num": 2 2026-02-13T20:15:45.176 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:45.176 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:15:45.176 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:15:45.176 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:45.176 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:15:45.176 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:15:45.176 INFO:teuthology.orchestra.run.trial110.stdout: "num": 2 2026-02-13T20:15:45.176 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:45.177 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:15:45.177 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:45.177 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:15:45.177 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:15:45.178 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.141+0000 7fa0a461b640 1 -- 10.20.193.110:0/1643535560 >> v1:10.20.193.188:6812/1623052694 conn(0x7fa06c03f750 legacy=0x7fa06c05fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:45.178 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.141+0000 7fa0a461b640 10 monclient: shutdown 2026-02-13T20:15:45.178 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.141+0000 7fa0a461b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:15:45.178 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.141+0000 7fa0a461b640 1 -- 10.20.193.110:0/1643535560 >> v1:10.20.193.110:6790/0 conn(0x7fa09c091950 legacy=0x7fa09c1503a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:45.178 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.141+0000 7fa0a2b91640 1 -- 10.20.193.110:0/1643535560 reap_dead start 2026-02-13T20:15:45.178 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.141+0000 7fa0a2b91640 1 -- 10.20.193.110:0/1643535560 reap_dead start 2026-02-13T20:15:45.178 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.141+0000 7fa0a461b640 1 -- 10.20.193.110:0/1643535560 shutdown_connections 2026-02-13T20:15:45.178 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.141+0000 7fa0a461b640 1 -- 10.20.193.110:0/1643535560 >> 10.20.193.110:0/1643535560 conn(0x7fa09c054e90 msgr2=0x7fa09c08dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:15:45.179 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.141+0000 7fa0a461b640 1 -- 10.20.193.110:0/1643535560 shutdown_connections 2026-02-13T20:15:45.179 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.141+0000 7fa0a461b640 1 -- 10.20.193.110:0/1643535560 wait complete. 2026-02-13T20:15:45.179 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-13T20:15:45.179 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-13T20:15:45.179 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T20:15:45.245 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.244+0000 7fb9196c3640 10 monclient: get_monmap_and_config 2026-02-13T20:15:45.245 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.244+0000 7fb9196c3640 10 monclient: build_initial_monmap 2026-02-13T20:15:45.246 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.244+0000 7fb9196c3640 10 monclient: monmap: 2026-02-13T20:15:45.246 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:15:45.246 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:45.246 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:15:45.245059+0000 2026-02-13T20:15:45.246 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:15:45.245059+0000 2026-02-13T20:15:45.246 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:15:45.246 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:45.246 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:15:45.246 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:15:45.246 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:15:45.246 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:45.246 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.245+0000 7fb9196c3640 1 Processor -- start 2026-02-13T20:15:45.247 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.245+0000 7fb9196c3640 1 -- start start 2026-02-13T20:15:45.247 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.245+0000 7fb9196c3640 10 monclient: init 2026-02-13T20:15:45.255 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.245+0000 7fb9196c3640 10 monclient: _reopen_session rank -1 2026-02-13T20:15:45.255 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.245+0000 7fb9196c3640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:15:45.256 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.245+0000 7fb9196c3640 10 monclient(hunting): picked mon.noname-a con 0x7fb9141401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:15:45.256 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.245+0000 7fb9196c3640 10 monclient(hunting): picked mon.noname-c con 0x7fb914092020 addr v1:10.20.193.188:6789/0 2026-02-13T20:15:45.256 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.245+0000 7fb9196c3640 10 monclient(hunting): picked mon.noname-b con 0x7fb914091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:15:45.256 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.245+0000 7fb9196c3640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb91408b730 con 0x7fb9141401c0 2026-02-13T20:15:45.256 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.245+0000 7fb9196c3640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb91405c5b0 con 0x7fb914092020 2026-02-13T20:15:45.256 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.245+0000 7fb9196c3640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb91408bcf0 con 0x7fb914091950 2026-02-13T20:15:45.256 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.245+0000 7fb9196c3640 10 monclient(hunting): _renew_subs 2026-02-13T20:15:45.256 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.245+0000 7fb9196c3640 10 monclient(hunting): authenticate will time out at 906.935401s 2026-02-13T20:15:45.256 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.245+0000 7fb912ffd640 1 -- >> v1:10.20.193.110:6789/0 conn(0x7fb9141401c0 legacy=0x7fb914091240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:15:45.256 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.245+0000 7fb9137fe640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fb914091950 0x7fb9141a2a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:56232/0 (socket says 10.20.193.110:56232) 2026-02-13T20:15:45.256 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.245+0000 7fb9137fe640 1 -- 10.20.193.110:0/2493619689 learned_addr learned my addr 10.20.193.110:0/2493619689 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:15:45.256 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.245+0000 7fb911ffb640 1 -- 10.20.193.110:0/2493619689 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2515310848 0 0) 0x7fb91408bcf0 con 0x7fb914091950 2026-02-13T20:15:45.257 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.245+0000 7fb911ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:15:45.257 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.245+0000 7fb911ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:45.257 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.245+0000 7fb911ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:45.257 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.245+0000 7fb911ffb640 10 monclient(hunting): my global_id is 94181 2026-02-13T20:15:45.257 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.245+0000 7fb911ffb640 1 -- 10.20.193.110:0/2493619689 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb9000035e0 con 0x7fb914091950 2026-02-13T20:15:45.257 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.245+0000 7fb911ffb640 1 -- 10.20.193.110:0/2493619689 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 729079050 0 0) 0x7fb9000035e0 con 0x7fb914091950 2026-02-13T20:15:45.257 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.245+0000 7fb911ffb640 1 -- 10.20.193.110:0/2493619689 >> v1:10.20.193.188:6789/0 conn(0x7fb914092020 legacy=0x7fb9141812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:45.257 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.245+0000 7fb911ffb640 1 -- 10.20.193.110:0/2493619689 >> v1:10.20.193.110:6789/0 conn(0x7fb9141401c0 legacy=0x7fb914091240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:15:45.257 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.245+0000 7fb911ffb640 10 monclient: _finish_hunting 0 2026-02-13T20:15:45.257 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.245+0000 7fb911ffb640 1 monclient: found mon.noname-b 2026-02-13T20:15:45.257 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.245+0000 7fb911ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:15:45.257 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.245+0000 7fb911ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:15:45.258 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.245+0000 7fb911ffb640 1 -- 10.20.193.110:0/2493619689 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb914140590 con 0x7fb914091950 2026-02-13T20:15:45.258 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.245+0000 7fb911ffb640 10 monclient: _finish_auth 0 2026-02-13T20:15:45.258 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.245+0000 7fb911ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:15:45.258 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.245+0000 7fb911ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:15:45.258 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.245+0000 7fb911ffb640 1 -- 10.20.193.110:0/2493619689 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb904003eb0 con 0x7fb914091950 2026-02-13T20:15:45.258 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.245+0000 7fb911ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:45.258 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.245+0000 7fb911ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:15:45.258 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.245+0000 7fb911ffb640 10 monclient: dump: 2026-02-13T20:15:45.258 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:45.258 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:45.258 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:45.258 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:45.258 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:45.259 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:45.259 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:45.259 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:45.259 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:45.259 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:45.259 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.246+0000 7fb9196c3640 5 monclient: authenticate success, global_id 94181 2026-02-13T20:15:45.259 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.246+0000 7fb9196c3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:15:45.259 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.246+0000 7fb911ffb640 1 -- 10.20.193.110:0/2493619689 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb904004100 con 0x7fb914091950 2026-02-13T20:15:45.259 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.246+0000 7fb911ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T20:15:45.259 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.246+0000 7fb911ffb640 1 -- 10.20.193.110:0/2493619689 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb904004510 con 0x7fb914091950 2026-02-13T20:15:45.259 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.246+0000 7fb9196c3640 10 monclient: get_monmap_and_config success 2026-02-13T20:15:45.259 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.246+0000 7fb9196c3640 4 set_mon_vals no callback set 2026-02-13T20:15:45.259 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.246+0000 7fb911ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:45.259 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.246+0000 7fb911ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:15:45.260 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.246+0000 7fb911ffb640 10 monclient: dump: 2026-02-13T20:15:45.260 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:45.260 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:45.260 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:45.260 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:45.260 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:45.260 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:45.260 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:45.260 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:45.260 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:45.260 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:45.260 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.246+0000 7fb9196c3640 10 monclient: shutdown 2026-02-13T20:15:45.260 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.246+0000 7fb9196c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:15:45.260 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.246+0000 7fb9196c3640 1 -- 10.20.193.110:0/2493619689 >> v1:10.20.193.110:6790/0 conn(0x7fb914091950 legacy=0x7fb9141a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:45.261 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.246+0000 7fb9196c3640 1 -- 10.20.193.110:0/2493619689 shutdown_connections 2026-02-13T20:15:45.261 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.246+0000 7fb9196c3640 1 -- 10.20.193.110:0/2493619689 >> 10.20.193.110:0/2493619689 conn(0x7fb914054e90 msgr2=0x7fb914058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:15:45.261 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.246+0000 7fb9196c3640 1 -- 10.20.193.110:0/2493619689 shutdown_connections 2026-02-13T20:15:45.261 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.246+0000 7fb9196c3640 1 -- 10.20.193.110:0/2493619689 wait complete. 2026-02-13T20:15:45.261 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.246+0000 7fb9196c3640 10 monclient: build_initial_monmap 2026-02-13T20:15:45.261 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.246+0000 7fb9196c3640 10 monclient: monmap: 2026-02-13T20:15:45.261 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:15:45.261 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:15:45.261 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:15:45.261 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:15:45.261 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:15:45.261 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:15:45.261 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:15:45.262 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:15:45.262 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:15:45.262 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:45.262 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.246+0000 7fb9196c3640 1 Processor -- start 2026-02-13T20:15:45.262 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.246+0000 7fb9196c3640 1 -- start start 2026-02-13T20:15:45.262 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.246+0000 7fb9196c3640 10 monclient: init 2026-02-13T20:15:45.262 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb9196c3640 10 monclient: _reopen_session rank -1 2026-02-13T20:15:45.262 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb9196c3640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:15:45.262 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb9196c3640 10 monclient(hunting): picked mon.noname-a con 0x7fb914091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:15:45.262 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb9196c3640 10 monclient(hunting): picked mon.noname-c con 0x7fb9141401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:15:45.262 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb9196c3640 10 monclient(hunting): picked mon.noname-b con 0x7fb9141a2050 addr v1:10.20.193.188:6789/0 2026-02-13T20:15:45.263 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb9196c3640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb91408c310 con 0x7fb914091950 2026-02-13T20:15:45.263 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb9196c3640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb91412d6b0 con 0x7fb9141a2050 2026-02-13T20:15:45.263 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb9196c3640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb91412a750 con 0x7fb9141401c0 2026-02-13T20:15:45.263 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb9196c3640 10 monclient(hunting): _renew_subs 2026-02-13T20:15:45.263 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb9196c3640 10 monclient(hunting): authenticate will time out at 906.937189s 2026-02-13T20:15:45.263 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb912ffd640 1 -- >> v1:10.20.193.110:6789/0 conn(0x7fb914091950 legacy=0x7fb914129930 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:15:45.263 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb9127fc640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fb9141401c0 0x7fb91412a040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:56242/0 (socket says 10.20.193.110:56242) 2026-02-13T20:15:45.263 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb9127fc640 1 -- 10.20.193.110:0/3020180756 learned_addr learned my addr 10.20.193.110:0/3020180756 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:15:45.264 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb8f37fe640 1 -- 10.20.193.110:0/3020180756 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1518038226 0 0) 0x7fb91412a750 con 0x7fb9141401c0 2026-02-13T20:15:45.264 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb8f37fe640 10 monclient(hunting): _negotiate 2026-02-13T20:15:45.264 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb8f37fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:45.264 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb8f37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:45.264 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb8f37fe640 10 monclient(hunting): my global_id is 94184 2026-02-13T20:15:45.264 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb8f37fe640 1 -- 10.20.193.110:0/3020180756 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8e00035e0 con 0x7fb9141401c0 2026-02-13T20:15:45.264 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb8f37fe640 1 -- 10.20.193.110:0/3020180756 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3999062609 0 0) 0x7fb8e00035e0 con 0x7fb9141401c0 2026-02-13T20:15:45.264 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb8f37fe640 1 -- 10.20.193.110:0/3020180756 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb91412a750 con 0x7fb9141401c0 2026-02-13T20:15:45.265 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb8f37fe640 1 -- 10.20.193.110:0/3020180756 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb8fc0030e0 con 0x7fb9141401c0 2026-02-13T20:15:45.265 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb8f37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:15:45.265 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb8f37fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:15:45.265 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb8f37fe640 10 monclient(hunting): dump: 2026-02-13T20:15:45.265 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:45.265 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:45.265 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:45.265 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:45.265 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:45.265 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:45.265 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:45.265 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:45.265 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:45.265 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:45.266 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb8f37fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:15:45.266 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb8f37fe640 1 -- 10.20.193.110:0/3020180756 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2520097286 0 0) 0x7fb91412d6b0 con 0x7fb9141a2050 2026-02-13T20:15:45.266 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb8f37fe640 10 monclient(hunting): _negotiate 2026-02-13T20:15:45.266 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb8f37fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:45.266 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb8f37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:45.266 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb8f37fe640 10 monclient(hunting): my global_id is 4624 2026-02-13T20:15:45.266 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb8f37fe640 1 -- 10.20.193.110:0/3020180756 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8e00035e0 con 0x7fb9141a2050 2026-02-13T20:15:45.266 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb8f37fe640 1 -- 10.20.193.110:0/3020180756 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4231173742 0 0) 0x7fb91412a750 con 0x7fb9141401c0 2026-02-13T20:15:45.266 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb8f37fe640 1 -- 10.20.193.110:0/3020180756 >> v1:10.20.193.188:6789/0 conn(0x7fb9141a2050 legacy=0x7fb9141a24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:45.266 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb8f37fe640 1 -- 10.20.193.110:0/3020180756 >> v1:10.20.193.110:6789/0 conn(0x7fb914091950 legacy=0x7fb914129930 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T20:15:45.266 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb8f37fe640 10 monclient: _finish_hunting 0 2026-02-13T20:15:45.266 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb8f37fe640 1 monclient: found mon.c 2026-02-13T20:15:45.266 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb8f37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:15:45.267 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb8f37fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:15:45.267 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb8f37fe640 1 -- 10.20.193.110:0/3020180756 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb91405d320 con 0x7fb9141401c0 2026-02-13T20:15:45.267 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb8f37fe640 10 monclient: _finish_auth 0 2026-02-13T20:15:45.267 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb8f37fe640 10 monclient: _check_auth_tickets 2026-02-13T20:15:45.267 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb8f37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:15:45.267 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb9196c3640 5 monclient: authenticate success, global_id 94184 2026-02-13T20:15:45.267 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb9196c3640 10 monclient: _renew_subs 2026-02-13T20:15:45.267 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb9196c3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:15:45.267 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb9196c3640 1 -- 10.20.193.110:0/3020180756 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb91412c840 con 0x7fb9141401c0 2026-02-13T20:15:45.267 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb9196c3640 10 monclient: _renew_subs 2026-02-13T20:15:45.267 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb9196c3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:15:45.267 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb9196c3640 1 -- 10.20.193.110:0/3020180756 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fb91412c0e0 con 0x7fb9141401c0 2026-02-13T20:15:45.267 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb8f37fe640 1 -- 10.20.193.110:0/3020180756 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb8fc0034d0 con 0x7fb9141401c0 2026-02-13T20:15:45.267 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb8f37fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:15:45.268 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb8f37fe640 1 -- 10.20.193.110:0/3020180756 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb8fc003b30 con 0x7fb9141401c0 2026-02-13T20:15:45.268 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb8f37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:45.268 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb8f37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:15:45.268 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb9117fa640 4 set_mon_vals no callback set 2026-02-13T20:15:45.268 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.247+0000 7fb8f37fe640 10 monclient: dump: 2026-02-13T20:15:45.268 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:45.268 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:45.268 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:45.268 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:45.268 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:45.268 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:45.268 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:45.269 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:45.269 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:45.269 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:45.269 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.248+0000 7fb9196c3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:15:45.269 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.248+0000 7fb9196c3640 1 -- 10.20.193.110:0/3020180756 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb91408f520 con 0x7fb914092020 2026-02-13T20:15:45.269 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.248+0000 7fb8f37fe640 1 -- 10.20.193.110:0/3020180756 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fb8fc003c90 con 0x7fb9141401c0 2026-02-13T20:15:45.269 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.248+0000 7fb8f37fe640 1 -- 10.20.193.110:0/3020180756 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(208..208 src has 1..208) ==== 3899+0+0 (unknown 164138633 0 0) 0x7fb8fc04e950 con 0x7fb9141401c0 2026-02-13T20:15:45.269 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.248+0000 7fb9137fe640 10 monclient: get_auth_request con 0x7fb8e003f740 auth_method 0 2026-02-13T20:15:45.269 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.248+0000 7fb8f37fe640 1 -- 10.20.193.110:0/3020180756 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1337407110 0 0) 0x7fb91408f520 con 0x7fb914092020 2026-02-13T20:15:45.269 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.249+0000 7fb8f37fe640 10 monclient(hunting): _negotiate 2026-02-13T20:15:45.269 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.249+0000 7fb8f37fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:45.270 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.249+0000 7fb8f37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:45.270 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.249+0000 7fb8f37fe640 10 monclient(hunting): my global_id is 4627 2026-02-13T20:15:45.270 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.249+0000 7fb8f37fe640 1 -- 10.20.193.110:0/3020180756 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb91412a750 con 0x7fb914092020 2026-02-13T20:15:45.270 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.249+0000 7fb8f37fe640 1 -- 10.20.193.110:0/3020180756 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3731063830 0 0) 0x7fb91412a750 con 0x7fb914092020 2026-02-13T20:15:45.270 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.249+0000 7fb8f37fe640 1 -- 10.20.193.110:0/3020180756 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb91408f520 con 0x7fb914092020 2026-02-13T20:15:45.270 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.249+0000 7fb8f37fe640 1 -- 10.20.193.110:0/3020180756 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb908003fb0 con 0x7fb914092020 2026-02-13T20:15:45.270 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.249+0000 7fb8f37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:45.270 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.249+0000 7fb8f37fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:15:45.270 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.249+0000 7fb8f37fe640 10 monclient: dump: 2026-02-13T20:15:45.270 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:45.270 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:45.270 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:45.271 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:45.271 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:45.271 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:45.271 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:45.271 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:45.271 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:45.271 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:45.271 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.249+0000 7fb8f37fe640 1 -- 10.20.193.110:0/3020180756 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2125416925 0 0) 0x7fb91408f520 con 0x7fb914092020 2026-02-13T20:15:45.271 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.249+0000 7fb8f37fe640 1 -- 10.20.193.110:0/3020180756 --> v1:10.20.193.188:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb91412b400 con 0x7fb914092020 2026-02-13T20:15:45.271 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.249+0000 7fb8f37fe640 1 -- 10.20.193.110:0/3020180756 <== mon.1 v1:10.20.193.188:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fb908005590 con 0x7fb914092020 2026-02-13T20:15:45.271 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.249+0000 7fb8f37fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:15:45.271 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.249+0000 7fb8f37fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:15:45.271 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.249+0000 7fb8f37fe640 1 -- 10.20.193.110:0/3020180756 >> v1:10.20.193.188:6789/0 conn(0x7fb914092020 legacy=0x7fb91408de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:45.272 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.249+0000 7fb8f37fe640 1 -- 10.20.193.110:0/3020180756 >> v1:10.20.193.188:6789/0 conn(0x7fb914092020 legacy=0x7fb91408de00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:15:45.272 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.253+0000 7fb9196c3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:15:45.272 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.253+0000 7fb9196c3640 1 -- 10.20.193.110:0/3020180756 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb914055bb0 con 0x7fb91411a100 2026-02-13T20:15:45.272 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.253+0000 7fb8f37fe640 1 -- 10.20.193.110:0/3020180756 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1080124318 0 0) 0x7fb914055bb0 con 0x7fb91411a100 2026-02-13T20:15:45.272 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.253+0000 7fb8f37fe640 10 monclient(hunting): _negotiate 2026-02-13T20:15:45.272 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.253+0000 7fb8f37fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:15:45.272 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.253+0000 7fb8f37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:15:45.272 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.253+0000 7fb8f37fe640 10 monclient(hunting): my global_id is 4630 2026-02-13T20:15:45.272 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.253+0000 7fb8f37fe640 1 -- 10.20.193.110:0/3020180756 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb91408f520 con 0x7fb91411a100 2026-02-13T20:15:45.272 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.254+0000 7fb8f37fe640 1 -- 10.20.193.110:0/3020180756 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3158380002 0 0) 0x7fb91408f520 con 0x7fb91411a100 2026-02-13T20:15:45.272 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.254+0000 7fb8f37fe640 1 -- 10.20.193.110:0/3020180756 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb914055bb0 con 0x7fb91411a100 2026-02-13T20:15:45.272 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.254+0000 7fb8f37fe640 1 -- 10.20.193.110:0/3020180756 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb908004630 con 0x7fb91411a100 2026-02-13T20:15:45.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.254+0000 7fb8f37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:15:45.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.254+0000 7fb8f37fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:15:45.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.254+0000 7fb8f37fe640 10 monclient: dump: 2026-02-13T20:15:45.273 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:15:45.273 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:15:45.273 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:45.273 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:15:45.273 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:15:45.273 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:15:45.273 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:15:45.273 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:15:45.273 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:15:45.273 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:15:45.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.254+0000 7fb8f37fe640 1 -- 10.20.193.110:0/3020180756 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1965212175 0 0) 0x7fb914055bb0 con 0x7fb91411a100 2026-02-13T20:15:45.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.254+0000 7fb8f37fe640 1 -- 10.20.193.110:0/3020180756 --> v1:10.20.193.188:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb91408b450 con 0x7fb91411a100 2026-02-13T20:15:45.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.254+0000 7fb8f37fe640 1 -- 10.20.193.110:0/3020180756 <== mon.1 v1:10.20.193.188:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4672 (unknown 0 0 214198535) 0x7fb908004ac0 con 0x7fb91411a100 2026-02-13T20:15:45.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.254+0000 7fb8f37fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:15:45.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.254+0000 7fb8f37fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:15:45.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.254+0000 7fb8f37fe640 1 -- 10.20.193.110:0/3020180756 >> v1:10.20.193.188:6789/0 conn(0x7fb91411a100 legacy=0x7fb91411a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:45.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.254+0000 7fb8f37fe640 1 -- 10.20.193.110:0/3020180756 >> v1:10.20.193.188:6789/0 conn(0x7fb91411a100 legacy=0x7fb91411a500 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:15:45.274 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:15:45.275 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:15:45.275 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:15:45.275 INFO:teuthology.orchestra.run.trial110.stdout: "state": "leader", 2026-02-13T20:15:45.275 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 20, 2026-02-13T20:15:45.275 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 267400, 2026-02-13T20:15:45.275 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:15:45.275 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:15:45.275 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:15:45.275 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:15:45.275 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 0, 2026-02-13T20:15:45.275 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:15:45.275 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:15:45.276 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:15:45.276 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:15:45.276 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:15:45.276 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:15:45.276 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:15:45.276 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:15:45.276 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:15:45.276 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:15:45.276 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:15:45.276 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:15:45.276 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:15:45.276 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:15:45.276 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:15:45.276 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:15:45.276 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:15:45.277 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:15:45.277 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:15:45.277 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:15:45.277 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:15:45.277 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:15:45.277 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:15:45.277 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:15:45.277 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:15:45.277 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:15:45.277 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:15:45.277 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:15:45.277 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:15:45.278 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:15:45.278 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:15:45.278 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:15:45.278 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:15:45.278 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:45.278 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:15:45.278 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:15:45.278 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:15:45.278 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:15:45.278 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:15:45.278 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:15:45.278 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:15:45.278 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:15:45.278 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:15:45.279 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:15:45.279 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:15:45.279 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:15:45.279 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:15:45.279 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:15:45.279 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:15:45.279 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:15:45.279 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:15:45.279 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:15:45.279 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:15:45.279 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:15:45.279 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:15:45.279 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:15:45.279 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:15:45.279 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:15:45.280 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:15:45.280 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:15:45.280 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:15:45.280 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:15:45.280 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:15:45.280 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:15:45.280 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:15:45.280 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:15:45.280 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:45.280 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:15:45.280 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:45.280 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:15:45.280 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:15:45.280 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:15:45.280 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:15:45.281 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:45.281 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:15:45.281 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:15:45.281 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:15:45.281 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:45.281 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:15:45.281 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:45.281 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:15:45.281 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:15:45.281 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:15:45.281 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:15:45.281 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:15:45.281 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:15:45.281 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:45.281 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:45.282 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:15:45.282 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:15:45.282 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:15:45.282 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:15:45.282 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:45.282 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:15:45.282 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:15:45.282 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:15:45.282 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:45.282 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:15:45.282 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:45.282 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:15:45.282 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:15:45.282 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:15:45.282 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:15:45.283 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:15:45.283 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:15:45.283 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:45.283 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:45.283 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:15:45.283 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:15:45.283 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:15:45.283 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:15:45.283 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:45.283 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:15:45.283 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:15:45.283 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:15:45.283 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:45.283 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:15:45.283 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:45.283 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:15:45.283 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:15:45.284 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:15:45.284 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:15:45.284 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:15:45.284 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:15:45.284 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:45.284 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:15:45.284 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:45.284 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:15:45.284 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:15:45.284 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:45.284 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:15:45.284 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:15:45.284 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:15:45.284 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:45.284 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:15:45.284 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:15:45.284 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:45.284 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:15:45.285 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:15:45.285 INFO:teuthology.orchestra.run.trial110.stdout: "num": 4 2026-02-13T20:15:45.285 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:45.285 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:15:45.285 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:15:45.285 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:45.285 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:15:45.285 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:15:45.285 INFO:teuthology.orchestra.run.trial110.stdout: "num": 6 2026-02-13T20:15:45.285 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:45.285 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:15:45.285 INFO:teuthology.orchestra.run.trial110.stdout: "mgr": [ 2026-02-13T20:15:45.285 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:15:45.285 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:15:45.285 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:15:45.285 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:15:45.285 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:15:45.286 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:15:45.286 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:15:45.286 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:15:45.286 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:15:45.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.254+0000 7fb9196c3640 1 -- 10.20.193.110:0/3020180756 >> v1:10.20.193.188:6812/1623052694 conn(0x7fb8e003f740 legacy=0x7fb8e005fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:45.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.254+0000 7fb9196c3640 10 monclient: shutdown 2026-02-13T20:15:45.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.254+0000 7fb9196c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:15:45.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.254+0000 7fb9196c3640 1 -- 10.20.193.110:0/3020180756 >> v1:10.20.193.110:6790/0 conn(0x7fb9141401c0 legacy=0x7fb91412a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:15:45.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.254+0000 7fb9137fe640 1 -- 10.20.193.110:0/3020180756 reap_dead start 2026-02-13T20:15:45.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.254+0000 7fb9137fe640 1 -- 10.20.193.110:0/3020180756 reap_dead start 2026-02-13T20:15:45.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.254+0000 7fb9196c3640 1 -- 10.20.193.110:0/3020180756 shutdown_connections 2026-02-13T20:15:45.288 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.254+0000 7fb9196c3640 1 -- 10.20.193.110:0/3020180756 >> 10.20.193.110:0/3020180756 conn(0x7fb914054e90 msgr2=0x7fb91408a060 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:15:45.288 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.254+0000 7fb9196c3640 1 -- 10.20.193.110:0/3020180756 shutdown_connections 2026-02-13T20:15:45.288 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:15:45.254+0000 7fb9196c3640 1 -- 10.20.193.110:0/3020180756 wait complete. 2026-02-13T20:15:45.288 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-13T20:15:45.288 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-13T20:15:45.908 INFO:tasks.rados.rados.0.trial188.stdout:938: done (7 left) 2026-02-13T20:15:45.909 INFO:tasks.rados.rados.0.trial188.stdout:939: read oid 8 snap -1 2026-02-13T20:15:45.909 INFO:tasks.rados.rados.0.trial188.stdout:939: expect (ObjNum 345 snap 94 seq_num 345) 2026-02-13T20:15:45.909 INFO:tasks.rados.rados.0.trial188.stdout:940: copy_from oid 44 from oid 46 current snap is 95 2026-02-13T20:15:45.909 INFO:tasks.rados.rados.0.trial188.stdout:931: finishing rollback tid 0 to trial18843701-17 2026-02-13T20:15:45.909 INFO:tasks.rados.rados.0.trial188.stdout:931: finishing rollback tid 1 to trial18843701-17 2026-02-13T20:15:45.909 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 17 v 382 (ObjNum -165696256 snap 32656 seq_num 304) dirty dne 2026-02-13T20:15:45.909 INFO:tasks.rados.rados.0.trial188.stdout:933: expect (ObjNum 259 snap 68 seq_num 259) 2026-02-13T20:15:45.914 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 951975 2026-02-13T20:15:45.959 INFO:tasks.rados.rados.0.trial188.stdout:932: expect (ObjNum 287 snap 74 seq_num 287) 2026-02-13T20:15:45.992 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 403499 2026-02-13T20:15:46.044 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2681616 2026-02-13T20:15:46.047 INFO:tasks.rados.rados.0.trial188.stdout:936: finishing write tid 1 to trial18843701-24 2026-02-13T20:15:46.047 INFO:tasks.rados.rados.0.trial188.stdout:931: done (8 left) 2026-02-13T20:15:46.047 INFO:tasks.rados.rados.0.trial188.stdout:932: done (7 left) 2026-02-13T20:15:46.047 INFO:tasks.rados.rados.0.trial188.stdout:933: done (6 left) 2026-02-13T20:15:46.047 INFO:tasks.rados.rados.0.trial188.stdout:941: rollback oid 18 current snap is 95 2026-02-13T20:15:46.047 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 18 to 94 2026-02-13T20:15:46.047 INFO:tasks.rados.rados.0.trial188.stdout:936: finishing write tid 2 to trial18843701-24 2026-02-13T20:15:46.047 INFO:tasks.rados.rados.0.trial188.stdout:935: finishing copy_from racing read to trial18843701-28 2026-02-13T20:15:46.047 INFO:tasks.rados.rados.0.trial188.stdout:937: finishing write tid 1 to trial18843701-35 2026-02-13T20:15:46.048 INFO:tasks.rados.rados.0.trial188.stdout:937: finishing write tid 2 to trial18843701-35 2026-02-13T20:15:46.048 INFO:tasks.rados.rados.0.trial188.stdout:936: finishing write tid 3 to trial18843701-24 2026-02-13T20:15:46.048 INFO:tasks.rados.rados.0.trial188.stdout:937: finishing write tid 3 to trial18843701-35 2026-02-13T20:15:46.048 INFO:tasks.rados.rados.0.trial188.stdout:936: finishing write tid 4 to trial18843701-24 2026-02-13T20:15:46.048 INFO:tasks.rados.rados.0.trial188.stdout:936: oid 24 updating version 0 to 385 2026-02-13T20:15:46.048 INFO:tasks.rados.rados.0.trial188.stdout:936: oid 24 updating version 385 to 386 2026-02-13T20:15:46.048 INFO:tasks.rados.rados.0.trial188.stdout:936: oid 24 updating version 386 to 387 2026-02-13T20:15:46.048 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 24 v 387 (ObjNum 359 snap 95 seq_num 359) dirty exists 2026-02-13T20:15:46.048 INFO:tasks.rados.rados.0.trial188.stdout:936: left oid 24 (ObjNum 359 snap 95 seq_num 359) 2026-02-13T20:15:46.048 INFO:tasks.rados.rados.0.trial188.stdout:935: finishing copy_from to trial18843701-28 2026-02-13T20:15:46.048 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 28 v 420 (ObjNum 352 snap 94 seq_num 352) dirty exists 2026-02-13T20:15:46.049 INFO:tasks.rados.rados.0.trial188.stdout:937: finishing write tid 4 to trial18843701-35 2026-02-13T20:15:46.049 INFO:tasks.rados.rados.0.trial188.stdout:937: oid 35 updating version 0 to 254 2026-02-13T20:15:46.049 INFO:tasks.rados.rados.0.trial188.stdout:937: oid 35 updating version 254 to 256 2026-02-13T20:15:46.049 INFO:tasks.rados.rados.0.trial188.stdout:937: oid 35 version 256 is already newer than 255 2026-02-13T20:15:46.049 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 35 v 256 (ObjNum 360 snap 95 seq_num 360) dirty exists 2026-02-13T20:15:46.049 INFO:tasks.rados.rados.0.trial188.stdout:937: left oid 35 (ObjNum 360 snap 95 seq_num 360) 2026-02-13T20:15:46.049 INFO:tasks.rados.rados.0.trial188.stdout:934: finishing copy_from racing read to trial18843701-43 2026-02-13T20:15:46.049 INFO:tasks.rados.rados.0.trial188.stdout:934: finishing copy_from to trial18843701-43 2026-02-13T20:15:46.049 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 43 v 311 (ObjNum 312 snap 85 seq_num 312) dirty exists 2026-02-13T20:15:46.049 INFO:tasks.rados.rados.0.trial188.stdout:940: finishing copy_from to trial18843701-44 2026-02-13T20:15:46.049 INFO:tasks.rados.rados.0.trial188.stdout:940: got expected ENOENT (src dne) 2026-02-13T20:15:46.050 INFO:tasks.rados.rados.0.trial188.stdout:940: finishing copy_from racing read to trial18843701-44 2026-02-13T20:15:46.050 INFO:tasks.rados.rados.0.trial188.stdout:939: expect (ObjNum 345 snap 94 seq_num 345) 2026-02-13T20:15:46.050 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 810775 2026-02-13T20:15:46.201 INFO:tasks.rados.rados.0.trial188.stdout:941: finishing rollback tid 0 to trial18843701-18 2026-02-13T20:15:46.201 INFO:tasks.rados.rados.0.trial188.stdout:941: finishing rollback tid 1 to trial18843701-18 2026-02-13T20:15:46.201 INFO:tasks.rados.rados.0.trial188.stdout:941: finishing rollback tid 2 to trial18843701-18 2026-02-13T20:15:46.201 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 18 v 385 (ObjNum 355 snap 94 seq_num 355) dirty exists 2026-02-13T20:15:46.201 INFO:tasks.rados.rados.0.trial188.stdout:934: done (6 left) 2026-02-13T20:15:46.201 INFO:tasks.rados.rados.0.trial188.stdout:935: done (5 left) 2026-02-13T20:15:46.202 INFO:tasks.rados.rados.0.trial188.stdout:936: done (4 left) 2026-02-13T20:15:46.202 INFO:tasks.rados.rados.0.trial188.stdout:937: done (3 left) 2026-02-13T20:15:46.202 INFO:tasks.rados.rados.0.trial188.stdout:939: done (2 left) 2026-02-13T20:15:46.202 INFO:tasks.rados.rados.0.trial188.stdout:940: done (1 left) 2026-02-13T20:15:46.202 INFO:tasks.rados.rados.0.trial188.stdout:941: done (0 left) 2026-02-13T20:15:46.202 INFO:tasks.rados.rados.0.trial188.stdout:942: delete oid 45 current snap is 95 2026-02-13T20:15:46.202 INFO:tasks.rados.rados.0.trial188.stdout:942: done (0 left) 2026-02-13T20:15:46.202 INFO:tasks.rados.rados.0.trial188.stdout:943: delete oid 19 current snap is 95 2026-02-13T20:15:46.204 INFO:tasks.rados.rados.0.trial188.stdout:943: done (0 left) 2026-02-13T20:15:46.204 INFO:tasks.rados.rados.0.trial188.stdout:944: rollback oid 34 current snap is 95 2026-02-13T20:15:46.204 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 34 to 91 2026-02-13T20:15:46.204 INFO:tasks.rados.rados.0.trial188.stdout:945: write (excl) oid 4 current snap is 95 2026-02-13T20:15:46.204 INFO:tasks.rados.rados.0.trial188.stdout:945: seq_num 363 ranges {500941=783978,1942140=158801} 2026-02-13T20:15:46.209 INFO:tasks.rados.rados.0.trial188.stdout:945: writing trial18843701-4 from 500941 to 1284919 tid 1 2026-02-13T20:15:46.212 INFO:tasks.rados.rados.0.trial188.stdout:945: writing trial18843701-4 from 1942140 to 2100941 tid 2 2026-02-13T20:15:46.212 INFO:tasks.rados.rados.0.trial188.stdout:946: delete oid 24 current snap is 95 2026-02-13T20:15:46.212 INFO:tasks.rados.rados.0.trial188.stdout:944: finishing rollback tid 0 to trial18843701-34 2026-02-13T20:15:46.212 INFO:tasks.rados.rados.0.trial188.stdout:944: finishing rollback tid 1 to trial18843701-34 2026-02-13T20:15:46.212 INFO:tasks.rados.rados.0.trial188.stdout:944: finishing rollback tid 2 to trial18843701-34 2026-02-13T20:15:46.212 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 34 v 424 (ObjNum 161 snap 32 seq_num 161) dirty exists 2026-02-13T20:15:46.225 INFO:tasks.rados.rados.0.trial188.stdout:944: done (2 left) 2026-02-13T20:15:46.225 INFO:tasks.rados.rados.0.trial188.stdout:946: done (1 left) 2026-02-13T20:15:46.225 INFO:tasks.rados.rados.0.trial188.stdout:947: snap_remove snap 91 2026-02-13T20:15:46.911 INFO:tasks.rados.rados.0.trial188.stdout:947: done (1 left) 2026-02-13T20:15:46.912 INFO:tasks.rados.rados.0.trial188.stdout:948: write (excl) oid 36 current snap is 95 2026-02-13T20:15:46.912 INFO:tasks.rados.rados.0.trial188.stdout:945: finishing write tid 1 to trial18843701-4 2026-02-13T20:15:46.912 INFO:tasks.rados.rados.0.trial188.stdout:945: finishing write tid 2 to trial18843701-4 2026-02-13T20:15:46.912 INFO:tasks.rados.rados.0.trial188.stdout:945: finishing write tid 3 to trial18843701-4 2026-02-13T20:15:46.912 INFO:tasks.rados.rados.0.trial188.stdout:945: finishing write tid 4 to trial18843701-4 2026-02-13T20:15:46.912 INFO:tasks.rados.rados.0.trial188.stdout:945: oid 4 updating version 0 to 320 2026-02-13T20:15:46.912 INFO:tasks.rados.rados.0.trial188.stdout:945: oid 4 updating version 320 to 322 2026-02-13T20:15:46.912 INFO:tasks.rados.rados.0.trial188.stdout:945: oid 4 version 322 is already newer than 321 2026-02-13T20:15:46.912 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 4 v 322 (ObjNum 363 snap 95 seq_num 363) dirty exists 2026-02-13T20:15:46.912 INFO:tasks.rados.rados.0.trial188.stdout:945: left oid 4 (ObjNum 363 snap 95 seq_num 363) 2026-02-13T20:15:46.912 INFO:tasks.rados.rados.0.trial188.stdout:948: seq_num 365 ranges {534555=650829,1659104=475451} 2026-02-13T20:15:46.916 INFO:tasks.rados.rados.0.trial188.stdout:948: writing trial18843701-36 from 534555 to 1185384 tid 1 2026-02-13T20:15:46.920 INFO:tasks.rados.rados.0.trial188.stdout:948: writing trial18843701-36 from 1659104 to 2134555 tid 2 2026-02-13T20:15:46.921 INFO:tasks.rados.rados.0.trial188.stdout:945: done (1 left) 2026-02-13T20:15:46.921 INFO:tasks.rados.rados.0.trial188.stdout:949: snap_remove snap 82 2026-02-13T20:15:47.881 INFO:tasks.rados.rados.0.trial188.stdout:949: done (1 left) 2026-02-13T20:15:47.882 INFO:tasks.rados.rados.0.trial188.stdout:950: read oid 29 snap -1 2026-02-13T20:15:47.882 INFO:tasks.rados.rados.0.trial188.stdout:950: expect (ObjNum 336 snap 92 seq_num 336) 2026-02-13T20:15:47.882 INFO:tasks.rados.rados.0.trial188.stdout:951: write oid 48 current snap is 95 2026-02-13T20:15:47.882 INFO:tasks.rados.rados.0.trial188.stdout:948: finishing write tid 1 to trial18843701-36 2026-02-13T20:15:47.882 INFO:tasks.rados.rados.0.trial188.stdout:948: finishing write tid 2 to trial18843701-36 2026-02-13T20:15:47.882 INFO:tasks.rados.rados.0.trial188.stdout:948: finishing write tid 3 to trial18843701-36 2026-02-13T20:15:47.882 INFO:tasks.rados.rados.0.trial188.stdout:948: finishing write tid 4 to trial18843701-36 2026-02-13T20:15:47.882 INFO:tasks.rados.rados.0.trial188.stdout:948: oid 36 updating version 0 to 404 2026-02-13T20:15:47.882 INFO:tasks.rados.rados.0.trial188.stdout:948: oid 36 version 404 is already newer than 403 2026-02-13T20:15:47.882 INFO:tasks.rados.rados.0.trial188.stdout:948: oid 36 version 404 is already newer than 402 2026-02-13T20:15:47.882 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 36 v 404 (ObjNum 365 snap 95 seq_num 365) dirty exists 2026-02-13T20:15:47.882 INFO:tasks.rados.rados.0.trial188.stdout:948: left oid 36 (ObjNum 365 snap 95 seq_num 365) 2026-02-13T20:15:47.882 INFO:tasks.rados.rados.0.trial188.stdout:951: seq_num 366 ranges {551362=726078,1717586=409779} 2026-02-13T20:15:47.886 INFO:tasks.rados.rados.0.trial188.stdout:951: writing trial18843701-48 from 551362 to 1277440 tid 1 2026-02-13T20:15:47.890 INFO:tasks.rados.rados.0.trial188.stdout:951: writing trial18843701-48 from 1717586 to 2127365 tid 2 2026-02-13T20:15:47.890 INFO:tasks.rados.rados.0.trial188.stdout:948: done (2 left) 2026-02-13T20:15:47.890 INFO:tasks.rados.rados.0.trial188.stdout:952: read oid 50 snap 90 2026-02-13T20:15:47.890 INFO:tasks.rados.rados.0.trial188.stdout:952: expect (ObjNum 247 snap 66 seq_num 247) 2026-02-13T20:15:47.890 INFO:tasks.rados.rados.0.trial188.stdout:953: write oid 32 current snap is 95 2026-02-13T20:15:47.890 INFO:tasks.rados.rados.0.trial188.stdout:953: seq_num 367 ranges {568169=401327,1376068=669790} 2026-02-13T20:15:47.893 INFO:tasks.rados.rados.0.trial188.stdout:953: writing trial18843701-32 from 568169 to 969496 tid 1 2026-02-13T20:15:47.898 INFO:tasks.rados.rados.0.trial188.stdout:953: writing trial18843701-32 from 1376068 to 2045858 tid 2 2026-02-13T20:15:47.898 INFO:tasks.rados.rados.0.trial188.stdout:954: snap_remove snap 94 2026-02-13T20:15:48.885 INFO:tasks.rados.rados.0.trial188.stdout:954: done (4 left) 2026-02-13T20:15:48.885 INFO:tasks.rados.rados.0.trial188.stdout:955: copy_from oid 46 from oid 18 current snap is 95 2026-02-13T20:15:48.886 INFO:tasks.rados.rados.0.trial188.stdout:952: expect (ObjNum 247 snap 66 seq_num 247) 2026-02-13T20:15:48.942 INFO:tasks.rados.rados.0.trial188.stdout:950: expect (ObjNum 336 snap 92 seq_num 336) 2026-02-13T20:15:48.942 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:15:49.060 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:15:49.120 INFO:tasks.rados.rados.0.trial188.stdout:951: finishing write tid 1 to trial18843701-48 2026-02-13T20:15:49.121 INFO:tasks.rados.rados.0.trial188.stdout:951: finishing write tid 2 to trial18843701-48 2026-02-13T20:15:49.121 INFO:tasks.rados.rados.0.trial188.stdout:951: finishing write tid 3 to trial18843701-48 2026-02-13T20:15:49.121 INFO:tasks.rados.rados.0.trial188.stdout:950: done (4 left) 2026-02-13T20:15:49.121 INFO:tasks.rados.rados.0.trial188.stdout:952: done (3 left) 2026-02-13T20:15:49.121 INFO:tasks.rados.rados.0.trial188.stdout:956: read oid 33 snap 92 2026-02-13T20:15:49.121 INFO:tasks.rados.rados.0.trial188.stdout:956: expect deleted 2026-02-13T20:15:49.121 INFO:tasks.rados.rados.0.trial188.stdout:957: read oid 5 snap -1 2026-02-13T20:15:49.121 INFO:tasks.rados.rados.0.trial188.stdout:957: expect deleted 2026-02-13T20:15:49.121 INFO:tasks.rados.rados.0.trial188.stdout:958: rollback oid 36 current snap is 95 2026-02-13T20:15:49.121 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 36 to 90 2026-02-13T20:15:49.122 INFO:tasks.rados.rados.0.trial188.stdout:951: finishing write tid 4 to trial18843701-48 2026-02-13T20:15:49.122 INFO:tasks.rados.rados.0.trial188.stdout:951: oid 48 updating version 0 to 177 2026-02-13T20:15:49.122 INFO:tasks.rados.rados.0.trial188.stdout:951: oid 48 updating version 177 to 178 2026-02-13T20:15:49.122 INFO:tasks.rados.rados.0.trial188.stdout:951: oid 48 updating version 178 to 179 2026-02-13T20:15:49.122 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 48 v 179 (ObjNum 366 snap 95 seq_num 366) dirty exists 2026-02-13T20:15:49.122 INFO:tasks.rados.rados.0.trial188.stdout:951: left oid 48 (ObjNum 366 snap 95 seq_num 366) 2026-02-13T20:15:49.122 INFO:tasks.rados.rados.0.trial188.stdout:953: finishing write tid 1 to trial18843701-32 2026-02-13T20:15:49.122 INFO:tasks.rados.rados.0.trial188.stdout:953: finishing write tid 2 to trial18843701-32 2026-02-13T20:15:49.122 INFO:tasks.rados.rados.0.trial188.stdout:953: finishing write tid 3 to trial18843701-32 2026-02-13T20:15:49.122 INFO:tasks.rados.rados.0.trial188.stdout:953: finishing write tid 4 to trial18843701-32 2026-02-13T20:15:49.123 INFO:tasks.rados.rados.0.trial188.stdout:953: oid 32 updating version 0 to 336 2026-02-13T20:15:49.123 INFO:tasks.rados.rados.0.trial188.stdout:953: oid 32 updating version 336 to 337 2026-02-13T20:15:49.123 INFO:tasks.rados.rados.0.trial188.stdout:953: oid 32 updating version 337 to 338 2026-02-13T20:15:49.123 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 32 v 338 (ObjNum 367 snap 95 seq_num 367) dirty exists 2026-02-13T20:15:49.123 INFO:tasks.rados.rados.0.trial188.stdout:953: left oid 32 (ObjNum 367 snap 95 seq_num 367) 2026-02-13T20:15:49.123 INFO:tasks.rados.rados.0.trial188.stdout:955: finishing copy_from racing read to trial18843701-46 2026-02-13T20:15:49.123 INFO:tasks.rados.rados.0.trial188.stdout:955: finishing copy_from to trial18843701-46 2026-02-13T20:15:49.123 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 46 v 385 (ObjNum 355 snap 94 seq_num 355) dirty exists 2026-02-13T20:15:49.123 INFO:tasks.rados.rados.0.trial188.stdout:951: done (5 left) 2026-02-13T20:15:49.123 INFO:tasks.rados.rados.0.trial188.stdout:953: done (4 left) 2026-02-13T20:15:49.124 INFO:tasks.rados.rados.0.trial188.stdout:955: done (3 left) 2026-02-13T20:15:49.124 INFO:tasks.rados.rados.0.trial188.stdout:959: delete oid 7 current snap is 95 2026-02-13T20:15:49.125 INFO:tasks.rados.rados.0.trial188.stdout:958: finishing rollback tid 0 to trial18843701-36 2026-02-13T20:15:49.125 INFO:tasks.rados.rados.0.trial188.stdout:956: done (3 left) 2026-02-13T20:15:49.125 INFO:tasks.rados.rados.0.trial188.stdout:957: done (2 left) 2026-02-13T20:15:49.125 INFO:tasks.rados.rados.0.trial188.stdout:959: done (1 left) 2026-02-13T20:15:49.125 INFO:tasks.rados.rados.0.trial188.stdout:960: read oid 9 snap -1 2026-02-13T20:15:49.125 INFO:tasks.rados.rados.0.trial188.stdout:960: expect (ObjNum 313 snap 85 seq_num 313) 2026-02-13T20:15:49.125 INFO:tasks.rados.rados.0.trial188.stdout:961: write oid 11 current snap is 95 2026-02-13T20:15:49.126 INFO:tasks.rados.rados.0.trial188.stdout:961: seq_num 369 ranges {601783=551825,1776679=425104} 2026-02-13T20:15:49.127 INFO:tasks.rados.rados.0.trial188.stdout:961: writing trial18843701-11 from 601783 to 1153608 tid 1 2026-02-13T20:15:49.131 INFO:tasks.rados.rados.0.trial188.stdout:961: writing trial18843701-11 from 1776679 to 2201783 tid 2 2026-02-13T20:15:49.131 INFO:tasks.rados.rados.0.trial188.stdout:962: snap_create 2026-02-13T20:15:49.131 INFO:tasks.rados.rados.0.trial188.stdout:958: finishing rollback tid 1 to trial18843701-36 2026-02-13T20:15:49.131 INFO:tasks.rados.rados.0.trial188.stdout:958: finishing rollback tid 2 to trial18843701-36 2026-02-13T20:15:49.131 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 36 v 419 (ObjNum 322 snap 88 seq_num 322) dirty exists 2026-02-13T20:15:49.135 INFO:tasks.rados.rados.0.trial188.stdout:960: expect (ObjNum 313 snap 85 seq_num 313) 2026-02-13T20:15:49.135 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:15:49.221 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:15:49.265 INFO:tasks.rados.rados.0.trial188.stdout:961: finishing write tid 1 to trial18843701-11 2026-02-13T20:15:49.265 INFO:tasks.rados.rados.0.trial188.stdout:961: finishing write tid 2 to trial18843701-11 2026-02-13T20:15:49.265 INFO:tasks.rados.rados.0.trial188.stdout:961: finishing write tid 3 to trial18843701-11 2026-02-13T20:15:49.265 INFO:tasks.rados.rados.0.trial188.stdout:961: finishing write tid 4 to trial18843701-11 2026-02-13T20:15:49.265 INFO:tasks.rados.rados.0.trial188.stdout:961: oid 11 updating version 0 to 323 2026-02-13T20:15:49.265 INFO:tasks.rados.rados.0.trial188.stdout:961: oid 11 updating version 323 to 325 2026-02-13T20:15:49.265 INFO:tasks.rados.rados.0.trial188.stdout:961: oid 11 version 325 is already newer than 324 2026-02-13T20:15:49.266 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 11 v 325 (ObjNum 369 snap 95 seq_num 369) dirty exists 2026-02-13T20:15:49.266 INFO:tasks.rados.rados.0.trial188.stdout:961: left oid 11 (ObjNum 369 snap 95 seq_num 369) 2026-02-13T20:15:49.914 INFO:tasks.rados.rados.0.trial188.stdout:958: done (3 left) 2026-02-13T20:15:49.914 INFO:tasks.rados.rados.0.trial188.stdout:960: done (2 left) 2026-02-13T20:15:49.914 INFO:tasks.rados.rados.0.trial188.stdout:961: done (1 left) 2026-02-13T20:15:49.915 INFO:tasks.rados.rados.0.trial188.stdout:962: done (0 left) 2026-02-13T20:15:49.915 INFO:tasks.rados.rados.0.trial188.stdout:963: write oid 20 current snap is 96 2026-02-13T20:15:49.915 INFO:tasks.rados.rados.0.trial188.stdout:963: seq_num 370 ranges {618590=627074,1835161=383429} 2026-02-13T20:15:49.918 INFO:tasks.rados.rados.0.trial188.stdout:963: writing trial18843701-20 from 618590 to 1245664 tid 1 2026-02-13T20:15:49.922 INFO:tasks.rados.rados.0.trial188.stdout:963: writing trial18843701-20 from 1835161 to 2218590 tid 2 2026-02-13T20:15:49.922 INFO:tasks.rados.rados.0.trial188.stdout:964: read oid 36 snap -1 2026-02-13T20:15:49.922 INFO:tasks.rados.rados.0.trial188.stdout:964: expect (ObjNum 322 snap 88 seq_num 322) 2026-02-13T20:15:49.922 INFO:tasks.rados.rados.0.trial188.stdout:965: write (excl) oid 11 current snap is 96 2026-02-13T20:15:49.922 INFO:tasks.rados.rados.0.trial188.stdout:965: seq_num 371 ranges {635397=702323,1893643=341754} 2026-02-13T20:15:49.927 INFO:tasks.rados.rados.0.trial188.stdout:965: writing trial18843701-11 from 635397 to 1337720 tid 1 2026-02-13T20:15:49.931 INFO:tasks.rados.rados.0.trial188.stdout:965: writing trial18843701-11 from 1893643 to 2235397 tid 2 2026-02-13T20:15:49.931 INFO:tasks.rados.rados.0.trial188.stdout:966: snap_remove snap 95 2026-02-13T20:15:50.918 INFO:tasks.rados.rados.0.trial188.stdout:966: done (3 left) 2026-02-13T20:15:50.918 INFO:tasks.rados.rados.0.trial188.stdout:967: read oid 13 snap 90 2026-02-13T20:15:50.918 INFO:tasks.rados.rados.0.trial188.stdout:967: expect (ObjNum 313 snap 85 seq_num 313) 2026-02-13T20:15:50.918 INFO:tasks.rados.rados.0.trial188.stdout:968: snap_remove snap 92 2026-02-13T20:15:51.921 INFO:tasks.rados.rados.0.trial188.stdout:968: done (4 left) 2026-02-13T20:15:51.921 INFO:tasks.rados.rados.0.trial188.stdout:969: delete oid 43 current snap is 96 2026-02-13T20:15:51.921 INFO:tasks.rados.rados.0.trial188.stdout:964: expect (ObjNum 322 snap 88 seq_num 322) 2026-02-13T20:15:51.961 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 917731 2026-02-13T20:15:52.021 INFO:tasks.rados.rados.0.trial188.stdout:963: finishing write tid 1 to trial18843701-20 2026-02-13T20:15:52.021 INFO:tasks.rados.rados.0.trial188.stdout:964: done (4 left) 2026-02-13T20:15:52.022 INFO:tasks.rados.rados.0.trial188.stdout:969: done (3 left) 2026-02-13T20:15:52.022 INFO:tasks.rados.rados.0.trial188.stdout:970: copy_from oid 31 from oid 7 current snap is 96 2026-02-13T20:15:52.022 INFO:tasks.rados.rados.0.trial188.stdout:963: finishing write tid 2 to trial18843701-20 2026-02-13T20:15:52.022 INFO:tasks.rados.rados.0.trial188.stdout:963: finishing write tid 3 to trial18843701-20 2026-02-13T20:15:52.022 INFO:tasks.rados.rados.0.trial188.stdout:963: finishing write tid 4 to trial18843701-20 2026-02-13T20:15:52.022 INFO:tasks.rados.rados.0.trial188.stdout:963: oid 20 updating version 0 to 320 2026-02-13T20:15:52.022 INFO:tasks.rados.rados.0.trial188.stdout:963: oid 20 updating version 320 to 321 2026-02-13T20:15:52.022 INFO:tasks.rados.rados.0.trial188.stdout:963: oid 20 updating version 321 to 322 2026-02-13T20:15:52.022 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 20 v 322 (ObjNum 370 snap 96 seq_num 370) dirty exists 2026-02-13T20:15:52.023 INFO:tasks.rados.rados.0.trial188.stdout:963: left oid 20 (ObjNum 370 snap 96 seq_num 370) 2026-02-13T20:15:52.023 INFO:tasks.rados.rados.0.trial188.stdout:965: finishing write tid 1 to trial18843701-11 2026-02-13T20:15:52.023 INFO:tasks.rados.rados.0.trial188.stdout:965: finishing write tid 2 to trial18843701-11 2026-02-13T20:15:52.023 INFO:tasks.rados.rados.0.trial188.stdout:965: finishing write tid 3 to trial18843701-11 2026-02-13T20:15:52.023 INFO:tasks.rados.rados.0.trial188.stdout:965: finishing write tid 4 to trial18843701-11 2026-02-13T20:15:52.023 INFO:tasks.rados.rados.0.trial188.stdout:965: oid 11 updating version 0 to 327 2026-02-13T20:15:52.023 INFO:tasks.rados.rados.0.trial188.stdout:965: oid 11 version 327 is already newer than 326 2026-02-13T20:15:52.023 INFO:tasks.rados.rados.0.trial188.stdout:965: oid 11 updating version 327 to 328 2026-02-13T20:15:52.023 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 11 v 328 (ObjNum 371 snap 96 seq_num 371) dirty exists 2026-02-13T20:15:52.023 INFO:tasks.rados.rados.0.trial188.stdout:965: left oid 11 (ObjNum 371 snap 96 seq_num 371) 2026-02-13T20:15:52.024 INFO:tasks.rados.rados.0.trial188.stdout:967: expect (ObjNum 313 snap 85 seq_num 313) 2026-02-13T20:15:52.024 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:15:52.145 INFO:tasks.rados.rados.0.trial188.stdout:970: finishing copy_from to trial18843701-31 2026-02-13T20:15:52.145 INFO:tasks.rados.rados.0.trial188.stdout:970: got expected ENOENT (src dne) 2026-02-13T20:15:52.145 INFO:tasks.rados.rados.0.trial188.stdout:970: finishing copy_from racing read to trial18843701-31 2026-02-13T20:15:52.145 INFO:tasks.rados.rados.0.trial188.stdout:963: done (3 left) 2026-02-13T20:15:52.145 INFO:tasks.rados.rados.0.trial188.stdout:965: done (2 left) 2026-02-13T20:15:52.145 INFO:tasks.rados.rados.0.trial188.stdout:967: done (1 left) 2026-02-13T20:15:52.146 INFO:tasks.rados.rados.0.trial188.stdout:970: done (0 left) 2026-02-13T20:15:52.146 INFO:tasks.rados.rados.0.trial188.stdout:971: write (excl) oid 18 current snap is 96 2026-02-13T20:15:52.146 INFO:tasks.rados.rados.0.trial188.stdout:971: seq_num 373 ranges {669011=569174,2010607=258404} 2026-02-13T20:15:52.149 INFO:tasks.rados.rados.0.trial188.stdout:971: writing trial18843701-18 from 669011 to 1238185 tid 1 2026-02-13T20:15:52.154 INFO:tasks.rados.rados.0.trial188.stdout:971: writing trial18843701-18 from 2010607 to 2269011 tid 2 2026-02-13T20:15:52.154 INFO:tasks.rados.rados.0.trial188.stdout:972: read oid 14 snap -1 2026-02-13T20:15:52.154 INFO:tasks.rados.rados.0.trial188.stdout:972: expect deleted 2026-02-13T20:15:52.154 INFO:tasks.rados.rados.0.trial188.stdout:973: delete oid 13 current snap is 96 2026-02-13T20:15:52.155 INFO:tasks.rados.rados.0.trial188.stdout:972: done (2 left) 2026-02-13T20:15:52.155 INFO:tasks.rados.rados.0.trial188.stdout:973: done (1 left) 2026-02-13T20:15:52.155 INFO:tasks.rados.rados.0.trial188.stdout:974: write (excl) oid 46 current snap is 96 2026-02-13T20:15:52.155 INFO:tasks.rados.rados.0.trial188.stdout:974: seq_num 375 ranges {702625=719672,2127571=175054} 2026-02-13T20:15:52.160 INFO:tasks.rados.rados.0.trial188.stdout:974: writing trial18843701-46 from 702625 to 1422297 tid 1 2026-02-13T20:15:52.164 INFO:tasks.rados.rados.0.trial188.stdout:974: writing trial18843701-46 from 2127571 to 2302625 tid 2 2026-02-13T20:15:52.164 INFO:tasks.rados.rados.0.trial188.stdout:975: rollback oid 41 current snap is 96 2026-02-13T20:15:52.164 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 41 to 90 2026-02-13T20:15:52.164 INFO:tasks.rados.rados.0.trial188.stdout:971: finishing write tid 1 to trial18843701-18 2026-02-13T20:15:52.164 INFO:tasks.rados.rados.0.trial188.stdout:976: write oid 17 current snap is 96 2026-02-13T20:15:52.164 INFO:tasks.rados.rados.0.trial188.stdout:976: seq_num 376 ranges {719432=794921,2186053=133379} 2026-02-13T20:15:52.169 INFO:tasks.rados.rados.0.trial188.stdout:976: writing trial18843701-17 from 719432 to 1514353 tid 1 2026-02-13T20:15:52.172 INFO:tasks.rados.rados.0.trial188.stdout:976: writing trial18843701-17 from 2186053 to 2319432 tid 2 2026-02-13T20:15:52.172 INFO:tasks.rados.rados.0.trial188.stdout:977: delete oid 29 current snap is 96 2026-02-13T20:15:52.181 INFO:tasks.rados.rados.0.trial188.stdout:974: finishing write tid 1 to trial18843701-46 2026-02-13T20:15:52.181 INFO:tasks.rados.rados.0.trial188.stdout:974: finishing write tid 2 to trial18843701-46 2026-02-13T20:15:52.181 INFO:tasks.rados.rados.0.trial188.stdout:974: finishing write tid 3 to trial18843701-46 2026-02-13T20:15:52.181 INFO:tasks.rados.rados.0.trial188.stdout:975: finishing rollback tid 0 to trial18843701-41 2026-02-13T20:15:52.181 INFO:tasks.rados.rados.0.trial188.stdout:975: finishing rollback tid 1 to trial18843701-41 2026-02-13T20:15:52.182 INFO:tasks.rados.rados.0.trial188.stdout:975: finishing rollback tid 2 to trial18843701-41 2026-02-13T20:15:52.182 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 41 v 391 (ObjNum 187 snap 47 seq_num 187) dirty exists 2026-02-13T20:15:52.182 INFO:tasks.rados.rados.0.trial188.stdout:974: finishing write tid 4 to trial18843701-46 2026-02-13T20:15:52.182 INFO:tasks.rados.rados.0.trial188.stdout:974: oid 46 updating version 0 to 386 2026-02-13T20:15:52.182 INFO:tasks.rados.rados.0.trial188.stdout:974: oid 46 updating version 386 to 387 2026-02-13T20:15:52.182 INFO:tasks.rados.rados.0.trial188.stdout:974: oid 46 updating version 387 to 388 2026-02-13T20:15:52.182 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 46 v 388 (ObjNum 375 snap 96 seq_num 375) dirty exists 2026-02-13T20:15:52.182 INFO:tasks.rados.rados.0.trial188.stdout:974: left oid 46 (ObjNum 375 snap 96 seq_num 375) 2026-02-13T20:15:52.183 INFO:tasks.rados.rados.0.trial188.stdout:971: finishing write tid 2 to trial18843701-18 2026-02-13T20:15:52.183 INFO:tasks.rados.rados.0.trial188.stdout:971: finishing write tid 3 to trial18843701-18 2026-02-13T20:15:52.183 INFO:tasks.rados.rados.0.trial188.stdout:971: finishing write tid 4 to trial18843701-18 2026-02-13T20:15:52.184 INFO:tasks.rados.rados.0.trial188.stdout:971: oid 18 updating version 0 to 387 2026-02-13T20:15:52.184 INFO:tasks.rados.rados.0.trial188.stdout:971: oid 18 version 387 is already newer than 386 2026-02-13T20:15:52.184 INFO:tasks.rados.rados.0.trial188.stdout:971: oid 18 updating version 387 to 388 2026-02-13T20:15:52.184 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 18 v 388 (ObjNum 373 snap 96 seq_num 373) dirty exists 2026-02-13T20:15:52.184 INFO:tasks.rados.rados.0.trial188.stdout:971: left oid 18 (ObjNum 373 snap 96 seq_num 373) 2026-02-13T20:15:52.184 INFO:tasks.rados.rados.0.trial188.stdout:976: finishing write tid 1 to trial18843701-17 2026-02-13T20:15:52.184 INFO:tasks.rados.rados.0.trial188.stdout:976: finishing write tid 2 to trial18843701-17 2026-02-13T20:15:52.184 INFO:tasks.rados.rados.0.trial188.stdout:976: finishing write tid 3 to trial18843701-17 2026-02-13T20:15:52.184 INFO:tasks.rados.rados.0.trial188.stdout:976: finishing write tid 4 to trial18843701-17 2026-02-13T20:15:52.184 INFO:tasks.rados.rados.0.trial188.stdout:976: oid 17 updating version 0 to 390 2026-02-13T20:15:52.184 INFO:tasks.rados.rados.0.trial188.stdout:976: oid 17 updating version 390 to 391 2026-02-13T20:15:52.184 INFO:tasks.rados.rados.0.trial188.stdout:976: oid 17 version 391 is already newer than 389 2026-02-13T20:15:52.185 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 17 v 391 (ObjNum 376 snap 96 seq_num 376) dirty exists 2026-02-13T20:15:52.185 INFO:tasks.rados.rados.0.trial188.stdout:976: left oid 17 (ObjNum 376 snap 96 seq_num 376) 2026-02-13T20:15:52.185 INFO:tasks.rados.rados.0.trial188.stdout:971: done (4 left) 2026-02-13T20:15:52.185 INFO:tasks.rados.rados.0.trial188.stdout:974: done (3 left) 2026-02-13T20:15:52.186 INFO:tasks.rados.rados.0.trial188.stdout:975: done (2 left) 2026-02-13T20:15:52.186 INFO:tasks.rados.rados.0.trial188.stdout:976: done (1 left) 2026-02-13T20:15:52.186 INFO:tasks.rados.rados.0.trial188.stdout:977: done (0 left) 2026-02-13T20:15:52.186 INFO:tasks.rados.rados.0.trial188.stdout:978: write oid 3 current snap is 96 2026-02-13T20:15:52.186 INFO:tasks.rados.rados.0.trial188.stdout:978: seq_num 378 ranges {753046=545419,1786664=431793} 2026-02-13T20:15:52.189 INFO:tasks.rados.rados.0.trial188.stdout:978: writing trial18843701-3 from 753046 to 1298465 tid 1 2026-02-13T20:15:52.192 INFO:tasks.rados.rados.0.trial188.stdout:978: writing trial18843701-3 from 1786664 to 2218457 tid 2 2026-02-13T20:15:52.192 INFO:tasks.rados.rados.0.trial188.stdout:979: write (excl) oid 37 current snap is 96 2026-02-13T20:15:52.193 INFO:tasks.rados.rados.0.trial188.stdout:979: seq_num 379 ranges {769853=620668,1845146=524707} 2026-02-13T20:15:52.197 INFO:tasks.rados.rados.0.trial188.stdout:979: writing trial18843701-37 from 769853 to 1390521 tid 1 2026-02-13T20:15:52.201 INFO:tasks.rados.rados.0.trial188.stdout:979: writing trial18843701-37 from 1845146 to 2369853 tid 2 2026-02-13T20:15:52.201 INFO:tasks.rados.rados.0.trial188.stdout:980: copy_from oid 29 from oid 6 current snap is 96 2026-02-13T20:15:52.201 INFO:tasks.rados.rados.0.trial188.stdout:981: copy_from oid 50 from oid 9 current snap is 96 2026-02-13T20:15:52.201 INFO:tasks.rados.rados.0.trial188.stdout:982: snap_remove snap 90 2026-02-13T20:15:52.884 INFO:tasks.rados.rados.0.trial188.stdout:982: done (4 left) 2026-02-13T20:15:52.884 INFO:tasks.rados.rados.0.trial188.stdout:983: rollback oid 15 current snap is 96 2026-02-13T20:15:52.884 INFO:tasks.rados.rados.0.trial188.stdout:983: done (4 left) 2026-02-13T20:15:52.885 INFO:tasks.rados.rados.0.trial188.stdout:984: delete oid 16 current snap is 96 2026-02-13T20:15:52.885 INFO:tasks.rados.rados.0.trial188.stdout:978: finishing write tid 1 to trial18843701-3 2026-02-13T20:15:52.885 INFO:tasks.rados.rados.0.trial188.stdout:978: finishing write tid 2 to trial18843701-3 2026-02-13T20:15:52.885 INFO:tasks.rados.rados.0.trial188.stdout:978: finishing write tid 3 to trial18843701-3 2026-02-13T20:15:52.885 INFO:tasks.rados.rados.0.trial188.stdout:978: finishing write tid 4 to trial18843701-3 2026-02-13T20:15:52.885 INFO:tasks.rados.rados.0.trial188.stdout:978: oid 3 updating version 0 to 346 2026-02-13T20:15:52.885 INFO:tasks.rados.rados.0.trial188.stdout:978: oid 3 version 346 is already newer than 345 2026-02-13T20:15:52.885 INFO:tasks.rados.rados.0.trial188.stdout:978: oid 3 version 346 is already newer than 344 2026-02-13T20:15:52.885 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 3 v 346 (ObjNum 378 snap 96 seq_num 378) dirty exists 2026-02-13T20:15:52.886 INFO:tasks.rados.rados.0.trial188.stdout:978: left oid 3 (ObjNum 378 snap 96 seq_num 378) 2026-02-13T20:15:52.886 INFO:tasks.rados.rados.0.trial188.stdout:980: finishing copy_from racing read to trial18843701-29 2026-02-13T20:15:52.886 INFO:tasks.rados.rados.0.trial188.stdout:979: finishing write tid 1 to trial18843701-37 2026-02-13T20:15:52.886 INFO:tasks.rados.rados.0.trial188.stdout:979: finishing write tid 2 to trial18843701-37 2026-02-13T20:15:52.886 INFO:tasks.rados.rados.0.trial188.stdout:979: finishing write tid 3 to trial18843701-37 2026-02-13T20:15:52.886 INFO:tasks.rados.rados.0.trial188.stdout:979: finishing write tid 4 to trial18843701-37 2026-02-13T20:15:52.886 INFO:tasks.rados.rados.0.trial188.stdout:979: oid 37 updating version 0 to 426 2026-02-13T20:15:52.886 INFO:tasks.rados.rados.0.trial188.stdout:979: oid 37 version 426 is already newer than 425 2026-02-13T20:15:52.886 INFO:tasks.rados.rados.0.trial188.stdout:979: oid 37 updating version 426 to 427 2026-02-13T20:15:52.886 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 37 v 427 (ObjNum 379 snap 96 seq_num 379) dirty exists 2026-02-13T20:15:52.886 INFO:tasks.rados.rados.0.trial188.stdout:979: left oid 37 (ObjNum 379 snap 96 seq_num 379) 2026-02-13T20:15:52.887 INFO:tasks.rados.rados.0.trial188.stdout:980: finishing copy_from to trial18843701-29 2026-02-13T20:15:52.887 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 29 v 379 (ObjNum 266 snap 70 seq_num 266) dirty exists 2026-02-13T20:15:52.887 INFO:tasks.rados.rados.0.trial188.stdout:981: finishing copy_from racing read to trial18843701-50 2026-02-13T20:15:52.887 INFO:tasks.rados.rados.0.trial188.stdout:981: finishing copy_from to trial18843701-50 2026-02-13T20:15:52.887 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 50 v 253 (ObjNum 313 snap 85 seq_num 313) dirty exists 2026-02-13T20:15:52.887 INFO:tasks.rados.rados.0.trial188.stdout:978: done (4 left) 2026-02-13T20:15:52.887 INFO:tasks.rados.rados.0.trial188.stdout:979: done (3 left) 2026-02-13T20:15:52.888 INFO:tasks.rados.rados.0.trial188.stdout:980: done (2 left) 2026-02-13T20:15:52.888 INFO:tasks.rados.rados.0.trial188.stdout:981: done (1 left) 2026-02-13T20:15:52.888 INFO:tasks.rados.rados.0.trial188.stdout:984: done (0 left) 2026-02-13T20:15:52.888 INFO:tasks.rados.rados.0.trial188.stdout:985: snap_create 2026-02-13T20:15:53.883 INFO:tasks.rados.rados.0.trial188.stdout:985: done (0 left) 2026-02-13T20:15:53.883 INFO:tasks.rados.rados.0.trial188.stdout:986: copy_from oid 47 from oid 30 current snap is 97 2026-02-13T20:15:53.883 INFO:tasks.rados.rados.0.trial188.stdout:987: copy_from oid 41 from oid 2 current snap is 97 2026-02-13T20:15:53.883 INFO:tasks.rados.rados.0.trial188.stdout:988: rollback oid 48 current snap is 97 2026-02-13T20:15:53.884 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 48 to 96 2026-02-13T20:15:53.884 INFO:tasks.rados.rados.0.trial188.stdout:989: snap_create 2026-02-13T20:15:53.886 INFO:tasks.rados.rados.0.trial188.stdout:988: finishing rollback tid 0 to trial18843701-48 2026-02-13T20:15:53.886 INFO:tasks.rados.rados.0.trial188.stdout:988: finishing rollback tid 1 to trial18843701-48 2026-02-13T20:15:53.886 INFO:tasks.rados.rados.0.trial188.stdout:988: finishing rollback tid 2 to trial18843701-48 2026-02-13T20:15:53.886 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 48 v 185 (ObjNum 366 snap 95 seq_num 366) dirty exists 2026-02-13T20:15:53.906 INFO:tasks.rados.rados.0.trial188.stdout:987: finishing copy_from racing read to trial18843701-41 2026-02-13T20:15:53.908 INFO:tasks.rados.rados.0.trial188.stdout:987: finishing copy_from to trial18843701-41 2026-02-13T20:15:53.908 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 41 v 360 (ObjNum 259 snap 68 seq_num 259) dirty exists 2026-02-13T20:15:53.924 INFO:tasks.rados.rados.0.trial188.stdout:986: finishing copy_from racing read to trial18843701-47 2026-02-13T20:15:53.924 INFO:tasks.rados.rados.0.trial188.stdout:986: finishing copy_from to trial18843701-47 2026-02-13T20:15:53.924 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 47 v 394 (ObjNum 326 snap 90 seq_num 326) dirty exists 2026-02-13T20:15:54.885 INFO:tasks.rados.rados.0.trial188.stdout:986: done (3 left) 2026-02-13T20:15:54.885 INFO:tasks.rados.rados.0.trial188.stdout:987: done (2 left) 2026-02-13T20:15:54.885 INFO:tasks.rados.rados.0.trial188.stdout:988: done (1 left) 2026-02-13T20:15:54.885 INFO:tasks.rados.rados.0.trial188.stdout:989: done (0 left) 2026-02-13T20:15:54.885 INFO:tasks.rados.rados.0.trial188.stdout:990: delete oid 35 current snap is 98 2026-02-13T20:15:54.888 INFO:tasks.rados.rados.0.trial188.stdout:990: done (0 left) 2026-02-13T20:15:54.888 INFO:tasks.rados.rados.0.trial188.stdout:991: snap_remove snap 97 2026-02-13T20:15:55.885 INFO:tasks.rados.rados.0.trial188.stdout:991: done (0 left) 2026-02-13T20:15:55.886 INFO:tasks.rados.rados.0.trial188.stdout:992: read oid 37 snap -1 2026-02-13T20:15:55.886 INFO:tasks.rados.rados.0.trial188.stdout:992: expect (ObjNum 379 snap 96 seq_num 379) 2026-02-13T20:15:55.886 INFO:tasks.rados.rados.0.trial188.stdout:993: delete oid 28 current snap is 98 2026-02-13T20:15:55.890 INFO:tasks.rados.rados.0.trial188.stdout:992: expect (ObjNum 379 snap 96 seq_num 379) 2026-02-13T20:15:55.890 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:15:55.939 INFO:tasks.rados.rados.0.trial188.stdout:992: done (1 left) 2026-02-13T20:15:55.939 INFO:tasks.rados.rados.0.trial188.stdout:993: done (0 left) 2026-02-13T20:15:55.939 INFO:tasks.rados.rados.0.trial188.stdout:994: rollback oid 12 current snap is 98 2026-02-13T20:15:55.939 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 12 to 96 2026-02-13T20:15:55.939 INFO:tasks.rados.rados.0.trial188.stdout:995: read oid 31 snap -1 2026-02-13T20:15:55.939 INFO:tasks.rados.rados.0.trial188.stdout:995: expect (ObjNum 354 snap 94 seq_num 354) 2026-02-13T20:15:55.939 INFO:tasks.rados.rados.0.trial188.stdout:996: read oid 38 snap -1 2026-02-13T20:15:55.940 INFO:tasks.rados.rados.0.trial188.stdout:996: expect (ObjNum 326 snap 90 seq_num 326) 2026-02-13T20:15:55.940 INFO:tasks.rados.rados.0.trial188.stdout:997: write (excl) oid 21 current snap is 98 2026-02-13T20:15:55.940 INFO:tasks.rados.rados.0.trial188.stdout:997: seq_num 383 ranges {437081=638017,1679074=582789} 2026-02-13T20:15:55.942 INFO:tasks.rados.rados.0.trial188.stdout:997: writing trial18843701-21 from 437081 to 1075098 tid 1 2026-02-13T20:15:55.946 INFO:tasks.rados.rados.0.trial188.stdout:997: writing trial18843701-21 from 1679074 to 2261863 tid 2 2026-02-13T20:15:55.947 INFO:tasks.rados.rados.0.trial188.stdout:998: snap_create 2026-02-13T20:15:55.951 INFO:tasks.rados.rados.0.trial188.stdout:996: expect (ObjNum 326 snap 90 seq_num 326) 2026-02-13T20:15:55.963 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1462687 2026-02-13T20:15:55.996 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:15:56.045 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:15:56.094 INFO:tasks.rados.rados.0.trial188.stdout:995: expect (ObjNum 354 snap 94 seq_num 354) 2026-02-13T20:15:56.143 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:15:56.192 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:15:56.242 INFO:tasks.rados.rados.0.trial188.stdout:994: finishing rollback tid 1 to trial18843701-12 2026-02-13T20:15:56.242 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 12 v 0 (ObjNum 33 snap 0 seq_num 16162720) dirty dne 2026-02-13T20:15:56.242 INFO:tasks.rados.rados.0.trial188.stdout:997: finishing write tid 1 to trial18843701-21 2026-02-13T20:15:56.242 INFO:tasks.rados.rados.0.trial188.stdout:997: finishing write tid 2 to trial18843701-21 2026-02-13T20:15:56.242 INFO:tasks.rados.rados.0.trial188.stdout:997: finishing write tid 3 to trial18843701-21 2026-02-13T20:15:56.242 INFO:tasks.rados.rados.0.trial188.stdout:997: finishing write tid 4 to trial18843701-21 2026-02-13T20:15:56.243 INFO:tasks.rados.rados.0.trial188.stdout:997: oid 21 updating version 0 to 188 2026-02-13T20:15:56.243 INFO:tasks.rados.rados.0.trial188.stdout:997: oid 21 version 188 is already newer than 187 2026-02-13T20:15:56.243 INFO:tasks.rados.rados.0.trial188.stdout:997: oid 21 updating version 188 to 189 2026-02-13T20:15:56.243 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 21 v 189 (ObjNum 383 snap 98 seq_num 383) dirty exists 2026-02-13T20:15:56.243 INFO:tasks.rados.rados.0.trial188.stdout:997: left oid 21 (ObjNum 383 snap 98 seq_num 383) 2026-02-13T20:15:56.891 INFO:tasks.rados.rados.0.trial188.stdout:994: done (4 left) 2026-02-13T20:15:56.892 INFO:tasks.rados.rados.0.trial188.stdout:995: done (3 left) 2026-02-13T20:15:56.892 INFO:tasks.rados.rados.0.trial188.stdout:996: done (2 left) 2026-02-13T20:15:56.892 INFO:tasks.rados.rados.0.trial188.stdout:997: done (1 left) 2026-02-13T20:15:56.892 INFO:tasks.rados.rados.0.trial188.stdout:998: done (0 left) 2026-02-13T20:15:56.892 INFO:tasks.rados.rados.0.trial188.stdout:999: snap_create 2026-02-13T20:15:57.882 INFO:tasks.rados.rados.0.trial188.stdout:999: done (0 left) 2026-02-13T20:15:57.882 INFO:tasks.rados.rados.0.trial188.stdout:1000: write (excl) oid 36 current snap is 100 2026-02-13T20:15:57.882 INFO:tasks.rados.rados.0.trial188.stdout:1000: seq_num 384 ranges {453888=713266,1737556=442800} 2026-02-13T20:15:57.886 INFO:tasks.rados.rados.0.trial188.stdout:1000: writing trial18843701-36 from 453888 to 1167154 tid 1 2026-02-13T20:15:57.890 INFO:tasks.rados.rados.0.trial188.stdout:1000: writing trial18843701-36 from 1737556 to 2180356 tid 2 2026-02-13T20:15:57.890 INFO:tasks.rados.rados.0.trial188.stdout:1001: copy_from oid 9 from oid 39 current snap is 100 2026-02-13T20:15:57.891 INFO:tasks.rados.rados.0.trial188.stdout:1002: rollback oid 7 current snap is 100 2026-02-13T20:15:57.891 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 7 to 99 2026-02-13T20:15:57.891 INFO:tasks.rados.rados.0.trial188.stdout:1003: snap_create 2026-02-13T20:15:57.899 INFO:tasks.rados.rados.0.trial188.stdout:1002: finishing rollback tid 1 to trial18843701-7 2026-02-13T20:15:57.899 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 7 v 0 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-13T20:15:57.906 INFO:tasks.rados.rados.0.trial188.stdout:1000: finishing write tid 1 to trial18843701-36 2026-02-13T20:15:57.906 INFO:tasks.rados.rados.0.trial188.stdout:1000: finishing write tid 2 to trial18843701-36 2026-02-13T20:15:57.906 INFO:tasks.rados.rados.0.trial188.stdout:1000: finishing write tid 3 to trial18843701-36 2026-02-13T20:15:57.907 INFO:tasks.rados.rados.0.trial188.stdout:1000: finishing write tid 4 to trial18843701-36 2026-02-13T20:15:57.907 INFO:tasks.rados.rados.0.trial188.stdout:1000: oid 36 updating version 0 to 441 2026-02-13T20:15:57.907 INFO:tasks.rados.rados.0.trial188.stdout:1000: oid 36 updating version 441 to 442 2026-02-13T20:15:57.907 INFO:tasks.rados.rados.0.trial188.stdout:1000: oid 36 updating version 442 to 443 2026-02-13T20:15:57.907 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 36 v 443 (ObjNum 384 snap 100 seq_num 384) dirty exists 2026-02-13T20:15:57.907 INFO:tasks.rados.rados.0.trial188.stdout:1000: left oid 36 (ObjNum 384 snap 100 seq_num 384) 2026-02-13T20:15:57.937 INFO:tasks.rados.rados.0.trial188.stdout:1001: finishing copy_from racing read to trial18843701-9 2026-02-13T20:15:57.938 INFO:tasks.rados.rados.0.trial188.stdout:1001: finishing copy_from to trial18843701-9 2026-02-13T20:15:57.938 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 9 v 381 (ObjNum 339 snap 94 seq_num 339) dirty exists 2026-02-13T20:15:58.894 INFO:tasks.rados.rados.0.trial188.stdout:1000: done (3 left) 2026-02-13T20:15:58.895 INFO:tasks.rados.rados.0.trial188.stdout:1001: done (2 left) 2026-02-13T20:15:58.895 INFO:tasks.rados.rados.0.trial188.stdout:1002: done (1 left) 2026-02-13T20:15:58.895 INFO:tasks.rados.rados.0.trial188.stdout:1003: done (0 left) 2026-02-13T20:15:58.895 INFO:tasks.rados.rados.0.trial188.stdout:1004: delete oid 12 current snap is 101 2026-02-13T20:15:58.897 INFO:tasks.rados.rados.0.trial188.stdout:1004: done (0 left) 2026-02-13T20:15:58.897 INFO:tasks.rados.rados.0.trial188.stdout:1005: delete oid 37 current snap is 101 2026-02-13T20:15:58.899 INFO:tasks.rados.rados.0.trial188.stdout:1005: done (0 left) 2026-02-13T20:15:58.899 INFO:tasks.rados.rados.0.trial188.stdout:1006: write (excl) oid 27 current snap is 101 2026-02-13T20:15:58.899 INFO:tasks.rados.rados.0.trial188.stdout:1006: seq_num 387 ranges {504309=539013,1796649=590127} 2026-02-13T20:15:58.903 INFO:tasks.rados.rados.0.trial188.stdout:1006: writing trial18843701-27 from 504309 to 1043322 tid 1 2026-02-13T20:15:58.908 INFO:tasks.rados.rados.0.trial188.stdout:1006: writing trial18843701-27 from 1796649 to 2386776 tid 2 2026-02-13T20:15:58.908 INFO:tasks.rados.rados.0.trial188.stdout:1007: snap_remove snap 98 2026-02-13T20:15:59.897 INFO:tasks.rados.rados.0.trial188.stdout:1007: done (1 left) 2026-02-13T20:15:59.897 INFO:tasks.rados.rados.0.trial188.stdout:1008: snap_remove snap 96 2026-02-13T20:16:00.899 INFO:tasks.rados.rados.0.trial188.stdout:1008: done (1 left) 2026-02-13T20:16:00.899 INFO:tasks.rados.rados.0.trial188.stdout:1009: copy_from oid 3 from oid 22 current snap is 101 2026-02-13T20:16:00.900 INFO:tasks.rados.rados.0.trial188.stdout:1006: finishing write tid 1 to trial18843701-27 2026-02-13T20:16:00.900 INFO:tasks.rados.rados.0.trial188.stdout:1006: finishing write tid 2 to trial18843701-27 2026-02-13T20:16:00.900 INFO:tasks.rados.rados.0.trial188.stdout:1006: finishing write tid 3 to trial18843701-27 2026-02-13T20:16:00.900 INFO:tasks.rados.rados.0.trial188.stdout:1006: finishing write tid 4 to trial18843701-27 2026-02-13T20:16:00.900 INFO:tasks.rados.rados.0.trial188.stdout:1006: oid 27 updating version 0 to 448 2026-02-13T20:16:00.900 INFO:tasks.rados.rados.0.trial188.stdout:1006: oid 27 updating version 448 to 449 2026-02-13T20:16:00.900 INFO:tasks.rados.rados.0.trial188.stdout:1006: oid 27 updating version 449 to 450 2026-02-13T20:16:00.900 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 27 v 450 (ObjNum 387 snap 101 seq_num 387) dirty exists 2026-02-13T20:16:00.900 INFO:tasks.rados.rados.0.trial188.stdout:1006: left oid 27 (ObjNum 387 snap 101 seq_num 387) 2026-02-13T20:16:00.900 INFO:tasks.rados.rados.0.trial188.stdout:1006: done (1 left) 2026-02-13T20:16:00.900 INFO:tasks.rados.rados.0.trial188.stdout:1010: copy_from oid 36 from oid 23 current snap is 101 2026-02-13T20:16:00.901 INFO:tasks.rados.rados.0.trial188.stdout:1011: snap_create 2026-02-13T20:16:00.931 INFO:tasks.rados.rados.0.trial188.stdout:1010: finishing copy_from racing read to trial18843701-36 2026-02-13T20:16:00.966 INFO:tasks.rados.rados.0.trial188.stdout:1009: finishing copy_from racing read to trial18843701-3 2026-02-13T20:16:00.966 INFO:tasks.rados.rados.0.trial188.stdout:1010: finishing copy_from to trial18843701-36 2026-02-13T20:16:00.967 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 36 v 330 (ObjNum 287 snap 74 seq_num 287) dirty exists 2026-02-13T20:16:00.967 INFO:tasks.rados.rados.0.trial188.stdout:1009: finishing copy_from to trial18843701-3 2026-02-13T20:16:00.967 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 3 v 283 (ObjNum 356 snap 94 seq_num 356) dirty exists 2026-02-13T20:16:01.900 INFO:tasks.rados.rados.0.trial188.stdout:1009: done (2 left) 2026-02-13T20:16:01.900 INFO:tasks.rados.rados.0.trial188.stdout:1010: done (1 left) 2026-02-13T20:16:01.900 INFO:tasks.rados.rados.0.trial188.stdout:1011: done (0 left) 2026-02-13T20:16:01.900 INFO:tasks.rados.rados.0.trial188.stdout:1012: write oid 7 current snap is 102 2026-02-13T20:16:01.900 INFO:tasks.rados.rados.0.trial188.stdout:1012: seq_num 388 ranges {521116=730615,1971484=549632} 2026-02-13T20:16:01.905 INFO:tasks.rados.rados.0.trial188.stdout:1012: writing trial18843701-7 from 521116 to 1251731 tid 1 2026-02-13T20:16:01.910 INFO:tasks.rados.rados.0.trial188.stdout:1012: writing trial18843701-7 from 1971484 to 2521116 tid 2 2026-02-13T20:16:01.910 INFO:tasks.rados.rados.0.trial188.stdout:1013: read oid 22 snap 101 2026-02-13T20:16:01.910 INFO:tasks.rados.rados.0.trial188.stdout:1013: expect (ObjNum 356 snap 94 seq_num 356) 2026-02-13T20:16:01.910 INFO:tasks.rados.rados.0.trial188.stdout:1014: snap_create 2026-02-13T20:16:01.915 INFO:tasks.rados.rados.0.trial188.stdout:1013: expect (ObjNum 356 snap 94 seq_num 356) 2026-02-13T20:16:01.916 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:16:02.042 INFO:tasks.rados.rados.0.trial188.stdout:1012: finishing write tid 1 to trial18843701-7 2026-02-13T20:16:02.042 INFO:tasks.rados.rados.0.trial188.stdout:1012: finishing write tid 2 to trial18843701-7 2026-02-13T20:16:02.042 INFO:tasks.rados.rados.0.trial188.stdout:1012: finishing write tid 3 to trial18843701-7 2026-02-13T20:16:02.042 INFO:tasks.rados.rados.0.trial188.stdout:1012: finishing write tid 4 to trial18843701-7 2026-02-13T20:16:02.042 INFO:tasks.rados.rados.0.trial188.stdout:1012: oid 7 updating version 0 to 420 2026-02-13T20:16:02.042 INFO:tasks.rados.rados.0.trial188.stdout:1012: oid 7 updating version 420 to 422 2026-02-13T20:16:02.042 INFO:tasks.rados.rados.0.trial188.stdout:1012: oid 7 version 422 is already newer than 421 2026-02-13T20:16:02.042 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 7 v 422 (ObjNum 388 snap 102 seq_num 388) dirty exists 2026-02-13T20:16:02.042 INFO:tasks.rados.rados.0.trial188.stdout:1012: left oid 7 (ObjNum 388 snap 102 seq_num 388) 2026-02-13T20:16:02.883 INFO:tasks.rados.rados.0.trial188.stdout:1012: done (2 left) 2026-02-13T20:16:02.884 INFO:tasks.rados.rados.0.trial188.stdout:1013: done (1 left) 2026-02-13T20:16:02.884 INFO:tasks.rados.rados.0.trial188.stdout:1014: done (0 left) 2026-02-13T20:16:02.884 INFO:tasks.rados.rados.0.trial188.stdout:1015: snap_remove snap 101 2026-02-13T20:16:03.885 INFO:tasks.rados.rados.0.trial188.stdout:1015: done (0 left) 2026-02-13T20:16:03.885 INFO:tasks.rados.rados.0.trial188.stdout:1016: read oid 44 snap 99 2026-02-13T20:16:03.885 INFO:tasks.rados.rados.0.trial188.stdout:1016: expect (ObjNum 353 snap 94 seq_num 353) 2026-02-13T20:16:03.885 INFO:tasks.rados.rados.0.trial188.stdout:1017: read oid 16 snap -1 2026-02-13T20:16:03.885 INFO:tasks.rados.rados.0.trial188.stdout:1017: expect deleted 2026-02-13T20:16:03.885 INFO:tasks.rados.rados.0.trial188.stdout:1018: read oid 23 snap -1 2026-02-13T20:16:03.885 INFO:tasks.rados.rados.0.trial188.stdout:1018: expect (ObjNum 287 snap 74 seq_num 287) 2026-02-13T20:16:03.885 INFO:tasks.rados.rados.0.trial188.stdout:1019: read oid 29 snap -1 2026-02-13T20:16:03.886 INFO:tasks.rados.rados.0.trial188.stdout:1019: expect (ObjNum 266 snap 70 seq_num 266) 2026-02-13T20:16:03.886 INFO:tasks.rados.rados.0.trial188.stdout:1020: write (excl) oid 49 current snap is 103 2026-02-13T20:16:03.886 INFO:tasks.rados.rados.0.trial188.stdout:1020: seq_num 389 ranges {537923=405864,1513613=593796} 2026-02-13T20:16:03.889 INFO:tasks.rados.rados.0.trial188.stdout:1020: writing trial18843701-49 from 537923 to 943787 tid 1 2026-02-13T20:16:03.893 INFO:tasks.rados.rados.0.trial188.stdout:1020: writing trial18843701-49 from 1513613 to 2107409 tid 2 2026-02-13T20:16:03.893 INFO:tasks.rados.rados.0.trial188.stdout:1021: delete oid 39 current snap is 103 2026-02-13T20:16:03.893 INFO:tasks.rados.rados.0.trial188.stdout:1016: expect (ObjNum 353 snap 94 seq_num 353) 2026-02-13T20:16:03.948 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1261849 2026-02-13T20:16:03.966 INFO:tasks.rados.rados.0.trial188.stdout:1018: expect (ObjNum 287 snap 74 seq_num 287) 2026-02-13T20:16:03.967 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:16:04.064 INFO:tasks.rados.rados.0.trial188.stdout:1019: expect (ObjNum 266 snap 70 seq_num 266) 2026-02-13T20:16:04.064 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:16:04.087 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 158541 2026-02-13T20:16:04.127 INFO:tasks.rados.rados.0.trial188.stdout:1020: finishing write tid 1 to trial18843701-49 2026-02-13T20:16:04.127 INFO:tasks.rados.rados.0.trial188.stdout:1020: finishing write tid 2 to trial18843701-49 2026-02-13T20:16:04.127 INFO:tasks.rados.rados.0.trial188.stdout:1020: finishing write tid 3 to trial18843701-49 2026-02-13T20:16:04.127 INFO:tasks.rados.rados.0.trial188.stdout:1020: finishing write tid 4 to trial18843701-49 2026-02-13T20:16:04.127 INFO:tasks.rados.rados.0.trial188.stdout:1020: oid 49 updating version 0 to 456 2026-02-13T20:16:04.127 INFO:tasks.rados.rados.0.trial188.stdout:1020: oid 49 updating version 456 to 457 2026-02-13T20:16:04.127 INFO:tasks.rados.rados.0.trial188.stdout:1020: oid 49 updating version 457 to 458 2026-02-13T20:16:04.127 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 49 v 458 (ObjNum 389 snap 103 seq_num 389) dirty exists 2026-02-13T20:16:04.127 INFO:tasks.rados.rados.0.trial188.stdout:1020: left oid 49 (ObjNum 389 snap 103 seq_num 389) 2026-02-13T20:16:04.127 INFO:tasks.rados.rados.0.trial188.stdout:1016: done (5 left) 2026-02-13T20:16:04.127 INFO:tasks.rados.rados.0.trial188.stdout:1017: done (4 left) 2026-02-13T20:16:04.127 INFO:tasks.rados.rados.0.trial188.stdout:1018: done (3 left) 2026-02-13T20:16:04.127 INFO:tasks.rados.rados.0.trial188.stdout:1019: done (2 left) 2026-02-13T20:16:04.127 INFO:tasks.rados.rados.0.trial188.stdout:1020: done (1 left) 2026-02-13T20:16:04.127 INFO:tasks.rados.rados.0.trial188.stdout:1021: done (0 left) 2026-02-13T20:16:04.127 INFO:tasks.rados.rados.0.trial188.stdout:1022: rollback oid 2 current snap is 103 2026-02-13T20:16:04.127 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 2 to 100 2026-02-13T20:16:04.127 INFO:tasks.rados.rados.0.trial188.stdout:1023: snap_create 2026-02-13T20:16:04.128 INFO:tasks.rados.rados.0.trial188.stdout:1022: finishing rollback tid 0 to trial18843701-2 2026-02-13T20:16:04.129 INFO:tasks.rados.rados.0.trial188.stdout:1022: finishing rollback tid 1 to trial18843701-2 2026-02-13T20:16:04.129 INFO:tasks.rados.rados.0.trial188.stdout:1022: finishing rollback tid 2 to trial18843701-2 2026-02-13T20:16:04.129 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 2 v 424 (ObjNum 259 snap 68 seq_num 259) dirty exists 2026-02-13T20:16:04.909 INFO:tasks.rados.rados.0.trial188.stdout:1022: done (1 left) 2026-02-13T20:16:04.909 INFO:tasks.rados.rados.0.trial188.stdout:1023: done (0 left) 2026-02-13T20:16:04.909 INFO:tasks.rados.rados.0.trial188.stdout:1024: write (excl) oid 23 current snap is 104 2026-02-13T20:16:04.909 INFO:tasks.rados.rados.0.trial188.stdout:1024: seq_num 391 ranges {571537=556362,1630577=597465} 2026-02-13T20:16:04.913 INFO:tasks.rados.rados.0.trial188.stdout:1024: writing trial18843701-23 from 571537 to 1127899 tid 1 2026-02-13T20:16:04.917 INFO:tasks.rados.rados.0.trial188.stdout:1024: writing trial18843701-23 from 1630577 to 2228042 tid 2 2026-02-13T20:16:04.917 INFO:tasks.rados.rados.0.trial188.stdout:1025: snap_remove snap 102 2026-02-13T20:16:05.911 INFO:tasks.rados.rados.0.trial188.stdout:1025: done (1 left) 2026-02-13T20:16:05.911 INFO:tasks.rados.rados.0.trial188.stdout:1026: write (excl) oid 6 current snap is 104 2026-02-13T20:16:05.911 INFO:tasks.rados.rados.0.trial188.stdout:1026: seq_num 392 ranges {588344=631611,1689059=741123} 2026-02-13T20:16:05.916 INFO:tasks.rados.rados.0.trial188.stdout:1026: writing trial18843701-6 from 588344 to 1219955 tid 1 2026-02-13T20:16:05.920 INFO:tasks.rados.rados.0.trial188.stdout:1026: writing trial18843701-6 from 1689059 to 2430182 tid 2 2026-02-13T20:16:05.920 INFO:tasks.rados.rados.0.trial188.stdout:1027: read oid 14 snap -1 2026-02-13T20:16:05.921 INFO:tasks.rados.rados.0.trial188.stdout:1027: expect deleted 2026-02-13T20:16:05.921 INFO:tasks.rados.rados.0.trial188.stdout:1028: write oid 7 current snap is 104 2026-02-13T20:16:05.921 INFO:tasks.rados.rados.0.trial188.stdout:1024: finishing write tid 1 to trial18843701-23 2026-02-13T20:16:05.921 INFO:tasks.rados.rados.0.trial188.stdout:1024: finishing write tid 2 to trial18843701-23 2026-02-13T20:16:05.921 INFO:tasks.rados.rados.0.trial188.stdout:1024: finishing write tid 3 to trial18843701-23 2026-02-13T20:16:05.921 INFO:tasks.rados.rados.0.trial188.stdout:1028: seq_num 393 ranges {605151=706860,2031188=573963} 2026-02-13T20:16:05.925 INFO:tasks.rados.rados.0.trial188.stdout:1028: writing trial18843701-7 from 605151 to 1312011 tid 1 2026-02-13T20:16:05.930 INFO:tasks.rados.rados.0.trial188.stdout:1028: writing trial18843701-7 from 2031188 to 2605151 tid 2 2026-02-13T20:16:05.930 INFO:tasks.rados.rados.0.trial188.stdout:1029: read oid 50 snap -1 2026-02-13T20:16:05.930 INFO:tasks.rados.rados.0.trial188.stdout:1029: expect (ObjNum 313 snap 85 seq_num 313) 2026-02-13T20:16:05.930 INFO:tasks.rados.rados.0.trial188.stdout:1030: read oid 29 snap -1 2026-02-13T20:16:05.930 INFO:tasks.rados.rados.0.trial188.stdout:1030: expect (ObjNum 266 snap 70 seq_num 266) 2026-02-13T20:16:05.930 INFO:tasks.rados.rados.0.trial188.stdout:1031: write oid 39 current snap is 104 2026-02-13T20:16:05.930 INFO:tasks.rados.rados.0.trial188.stdout:1031: seq_num 394 ranges {621958=782109,2089670=532288} 2026-02-13T20:16:05.935 INFO:tasks.rados.rados.0.trial188.stdout:1031: writing trial18843701-39 from 621958 to 1404067 tid 1 2026-02-13T20:16:05.940 INFO:tasks.rados.rados.0.trial188.stdout:1031: writing trial18843701-39 from 2089670 to 2621958 tid 2 2026-02-13T20:16:05.940 INFO:tasks.rados.rados.0.trial188.stdout:1032: delete oid 8 current snap is 104 2026-02-13T20:16:05.940 INFO:tasks.rados.rados.0.trial188.stdout:1024: finishing write tid 4 to trial18843701-23 2026-02-13T20:16:05.940 INFO:tasks.rados.rados.0.trial188.stdout:1024: oid 23 updating version 0 to 453 2026-02-13T20:16:05.940 INFO:tasks.rados.rados.0.trial188.stdout:1024: oid 23 version 453 is already newer than 452 2026-02-13T20:16:05.940 INFO:tasks.rados.rados.0.trial188.stdout:1024: oid 23 version 453 is already newer than 451 2026-02-13T20:16:05.940 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 23 v 453 (ObjNum 391 snap 104 seq_num 391) dirty exists 2026-02-13T20:16:05.940 INFO:tasks.rados.rados.0.trial188.stdout:1024: left oid 23 (ObjNum 391 snap 104 seq_num 391) 2026-02-13T20:16:05.945 INFO:tasks.rados.rados.0.trial188.stdout:1026: finishing write tid 1 to trial18843701-6 2026-02-13T20:16:05.945 INFO:tasks.rados.rados.0.trial188.stdout:1026: finishing write tid 2 to trial18843701-6 2026-02-13T20:16:05.945 INFO:tasks.rados.rados.0.trial188.stdout:1026: finishing write tid 3 to trial18843701-6 2026-02-13T20:16:05.946 INFO:tasks.rados.rados.0.trial188.stdout:1030: expect (ObjNum 266 snap 70 seq_num 266) 2026-02-13T20:16:05.987 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:16:06.011 INFO:tasks.rados.rados.0.trial188.stdout:1026: finishing write tid 4 to trial18843701-6 2026-02-13T20:16:06.011 INFO:tasks.rados.rados.0.trial188.stdout:1026: oid 6 updating version 0 to 458 2026-02-13T20:16:06.011 INFO:tasks.rados.rados.0.trial188.stdout:1026: oid 6 version 458 is already newer than 457 2026-02-13T20:16:06.011 INFO:tasks.rados.rados.0.trial188.stdout:1026: oid 6 updating version 458 to 459 2026-02-13T20:16:06.011 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 6 v 459 (ObjNum 392 snap 104 seq_num 392) dirty exists 2026-02-13T20:16:06.012 INFO:tasks.rados.rados.0.trial188.stdout:1026: left oid 6 (ObjNum 392 snap 104 seq_num 392) 2026-02-13T20:16:06.012 INFO:tasks.rados.rados.0.trial188.stdout:1029: expect (ObjNum 313 snap 85 seq_num 313) 2026-02-13T20:16:06.022 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1761413 2026-02-13T20:16:06.136 INFO:tasks.rados.rados.0.trial188.stdout:1028: finishing write tid 1 to trial18843701-7 2026-02-13T20:16:06.136 INFO:tasks.rados.rados.0.trial188.stdout:1028: finishing write tid 2 to trial18843701-7 2026-02-13T20:16:06.136 INFO:tasks.rados.rados.0.trial188.stdout:1028: finishing write tid 3 to trial18843701-7 2026-02-13T20:16:06.136 INFO:tasks.rados.rados.0.trial188.stdout:1028: finishing write tid 4 to trial18843701-7 2026-02-13T20:16:06.136 INFO:tasks.rados.rados.0.trial188.stdout:1028: oid 7 updating version 0 to 430 2026-02-13T20:16:06.137 INFO:tasks.rados.rados.0.trial188.stdout:1028: oid 7 version 430 is already newer than 429 2026-02-13T20:16:06.137 INFO:tasks.rados.rados.0.trial188.stdout:1028: oid 7 version 430 is already newer than 428 2026-02-13T20:16:06.137 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 7 v 430 (ObjNum 393 snap 104 seq_num 393) dirty exists 2026-02-13T20:16:06.137 INFO:tasks.rados.rados.0.trial188.stdout:1028: left oid 7 (ObjNum 393 snap 104 seq_num 393) 2026-02-13T20:16:06.137 INFO:tasks.rados.rados.0.trial188.stdout:1031: finishing write tid 1 to trial18843701-39 2026-02-13T20:16:06.137 INFO:tasks.rados.rados.0.trial188.stdout:1031: finishing write tid 2 to trial18843701-39 2026-02-13T20:16:06.137 INFO:tasks.rados.rados.0.trial188.stdout:1024: done (7 left) 2026-02-13T20:16:06.137 INFO:tasks.rados.rados.0.trial188.stdout:1026: done (6 left) 2026-02-13T20:16:06.137 INFO:tasks.rados.rados.0.trial188.stdout:1027: done (5 left) 2026-02-13T20:16:06.137 INFO:tasks.rados.rados.0.trial188.stdout:1028: done (4 left) 2026-02-13T20:16:06.137 INFO:tasks.rados.rados.0.trial188.stdout:1029: done (3 left) 2026-02-13T20:16:06.137 INFO:tasks.rados.rados.0.trial188.stdout:1030: done (2 left) 2026-02-13T20:16:06.138 INFO:tasks.rados.rados.0.trial188.stdout:1032: done (1 left) 2026-02-13T20:16:06.138 INFO:tasks.rados.rados.0.trial188.stdout:1033: read oid 50 snap -1 2026-02-13T20:16:06.138 INFO:tasks.rados.rados.0.trial188.stdout:1033: expect (ObjNum 313 snap 85 seq_num 313) 2026-02-13T20:16:06.138 INFO:tasks.rados.rados.0.trial188.stdout:1034: snap_remove snap 103 2026-02-13T20:16:06.917 INFO:tasks.rados.rados.0.trial188.stdout:1034: done (2 left) 2026-02-13T20:16:06.917 INFO:tasks.rados.rados.0.trial188.stdout:1035: copy_from oid 30 from oid 21 current snap is 104 2026-02-13T20:16:06.917 INFO:tasks.rados.rados.0.trial188.stdout:1031: finishing write tid 3 to trial18843701-39 2026-02-13T20:16:06.917 INFO:tasks.rados.rados.0.trial188.stdout:1031: finishing write tid 4 to trial18843701-39 2026-02-13T20:16:06.918 INFO:tasks.rados.rados.0.trial188.stdout:1031: oid 39 updating version 0 to 432 2026-02-13T20:16:06.918 INFO:tasks.rados.rados.0.trial188.stdout:1031: oid 39 updating version 432 to 433 2026-02-13T20:16:06.918 INFO:tasks.rados.rados.0.trial188.stdout:1031: oid 39 version 433 is already newer than 431 2026-02-13T20:16:06.918 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 39 v 433 (ObjNum 394 snap 104 seq_num 394) dirty exists 2026-02-13T20:16:06.918 INFO:tasks.rados.rados.0.trial188.stdout:1031: left oid 39 (ObjNum 394 snap 104 seq_num 394) 2026-02-13T20:16:06.918 INFO:tasks.rados.rados.0.trial188.stdout:1033: expect (ObjNum 313 snap 85 seq_num 313) 2026-02-13T20:16:07.045 INFO:tasks.rados.rados.0.trial188.stdout:1035: finishing copy_from racing read to trial18843701-30 2026-02-13T20:16:07.045 INFO:tasks.rados.rados.0.trial188.stdout:1035: finishing copy_from to trial18843701-30 2026-02-13T20:16:07.045 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 30 v 189 (ObjNum 383 snap 98 seq_num 383) dirty exists 2026-02-13T20:16:07.045 INFO:tasks.rados.rados.0.trial188.stdout:1031: done (2 left) 2026-02-13T20:16:07.045 INFO:tasks.rados.rados.0.trial188.stdout:1033: done (1 left) 2026-02-13T20:16:07.045 INFO:tasks.rados.rados.0.trial188.stdout:1035: done (0 left) 2026-02-13T20:16:07.045 INFO:tasks.rados.rados.0.trial188.stdout:1036: write oid 49 current snap is 104 2026-02-13T20:16:07.045 INFO:tasks.rados.rados.0.trial188.stdout:1036: seq_num 396 ranges {655572=648960,1922987=732585} 2026-02-13T20:16:07.050 INFO:tasks.rados.rados.0.trial188.stdout:1036: writing trial18843701-49 from 655572 to 1304532 tid 1 2026-02-13T20:16:07.055 INFO:tasks.rados.rados.0.trial188.stdout:1036: writing trial18843701-49 from 1922987 to 2655572 tid 2 2026-02-13T20:16:07.055 INFO:tasks.rados.rados.0.trial188.stdout:1037: copy_from oid 4 from oid 19 current snap is 104 2026-02-13T20:16:07.055 INFO:tasks.rados.rados.0.trial188.stdout:1038: rollback oid 21 current snap is 104 2026-02-13T20:16:07.055 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 21 to 99 2026-02-13T20:16:07.056 INFO:tasks.rados.rados.0.trial188.stdout:1039: snap_remove snap 100 2026-02-13T20:16:07.886 INFO:tasks.rados.rados.0.trial188.stdout:1039: done (3 left) 2026-02-13T20:16:07.886 INFO:tasks.rados.rados.0.trial188.stdout:1040: delete oid 47 current snap is 104 2026-02-13T20:16:07.886 INFO:tasks.rados.rados.0.trial188.stdout:1037: finishing copy_from to trial18843701-4 2026-02-13T20:16:07.886 INFO:tasks.rados.rados.0.trial188.stdout:1037: got expected ENOENT (src dne) 2026-02-13T20:16:07.886 INFO:tasks.rados.rados.0.trial188.stdout:1037: finishing copy_from racing read to trial18843701-4 2026-02-13T20:16:07.886 INFO:tasks.rados.rados.0.trial188.stdout:1038: finishing rollback tid 0 to trial18843701-21 2026-02-13T20:16:07.887 INFO:tasks.rados.rados.0.trial188.stdout:1038: finishing rollback tid 1 to trial18843701-21 2026-02-13T20:16:07.887 INFO:tasks.rados.rados.0.trial188.stdout:1038: finishing rollback tid 2 to trial18843701-21 2026-02-13T20:16:07.887 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 21 v 197 (ObjNum 383 snap 98 seq_num 383) dirty exists 2026-02-13T20:16:07.887 INFO:tasks.rados.rados.0.trial188.stdout:1036: finishing write tid 1 to trial18843701-49 2026-02-13T20:16:07.887 INFO:tasks.rados.rados.0.trial188.stdout:1036: finishing write tid 2 to trial18843701-49 2026-02-13T20:16:07.887 INFO:tasks.rados.rados.0.trial188.stdout:1036: finishing write tid 3 to trial18843701-49 2026-02-13T20:16:07.887 INFO:tasks.rados.rados.0.trial188.stdout:1036: finishing write tid 4 to trial18843701-49 2026-02-13T20:16:07.887 INFO:tasks.rados.rados.0.trial188.stdout:1036: oid 49 updating version 0 to 464 2026-02-13T20:16:07.887 INFO:tasks.rados.rados.0.trial188.stdout:1036: oid 49 updating version 464 to 465 2026-02-13T20:16:07.887 INFO:tasks.rados.rados.0.trial188.stdout:1036: oid 49 version 465 is already newer than 463 2026-02-13T20:16:07.887 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 49 v 465 (ObjNum 396 snap 104 seq_num 396) dirty exists 2026-02-13T20:16:07.887 INFO:tasks.rados.rados.0.trial188.stdout:1036: left oid 49 (ObjNum 396 snap 104 seq_num 396) 2026-02-13T20:16:07.889 INFO:tasks.rados.rados.0.trial188.stdout:1036: done (3 left) 2026-02-13T20:16:07.890 INFO:tasks.rados.rados.0.trial188.stdout:1037: done (2 left) 2026-02-13T20:16:07.890 INFO:tasks.rados.rados.0.trial188.stdout:1038: done (1 left) 2026-02-13T20:16:07.890 INFO:tasks.rados.rados.0.trial188.stdout:1040: done (0 left) 2026-02-13T20:16:07.890 INFO:tasks.rados.rados.0.trial188.stdout:1041: snap_remove snap 99 2026-02-13T20:16:08.888 INFO:tasks.rados.rados.0.trial188.stdout:1041: done (0 left) 2026-02-13T20:16:08.888 INFO:tasks.rados.rados.0.trial188.stdout:1042: write (excl) oid 47 current snap is 104 2026-02-13T20:16:08.888 INFO:tasks.rados.rados.0.trial188.stdout:1042: seq_num 398 ranges {689186=799458,1923598=752130} 2026-02-13T20:16:08.894 INFO:tasks.rados.rados.0.trial188.stdout:1042: writing trial18843701-47 from 689186 to 1488644 tid 1 2026-02-13T20:16:08.899 INFO:tasks.rados.rados.0.trial188.stdout:1042: writing trial18843701-47 from 1923598 to 2675728 tid 2 2026-02-13T20:16:08.899 INFO:tasks.rados.rados.0.trial188.stdout:1043: copy_from oid 35 from oid 31 current snap is 104 2026-02-13T20:16:08.899 INFO:tasks.rados.rados.0.trial188.stdout:1044: rollback oid 38 current snap is 104 2026-02-13T20:16:08.899 INFO:tasks.rados.rados.0.trial188.stdout:1044: done (2 left) 2026-02-13T20:16:08.899 INFO:tasks.rados.rados.0.trial188.stdout:1045: copy_from oid 25 from oid 50 current snap is 104 2026-02-13T20:16:08.899 INFO:tasks.rados.rados.0.trial188.stdout:1046: copy_from oid 40 from oid 3 current snap is 104 2026-02-13T20:16:08.899 INFO:tasks.rados.rados.0.trial188.stdout:1047: delete oid 32 current snap is 104 2026-02-13T20:16:08.904 INFO:tasks.rados.rados.0.trial188.stdout:1047: done (4 left) 2026-02-13T20:16:08.904 INFO:tasks.rados.rados.0.trial188.stdout:1048: rollback oid 23 current snap is 104 2026-02-13T20:16:08.904 INFO:tasks.rados.rados.0.trial188.stdout:1048: done (4 left) 2026-02-13T20:16:08.904 INFO:tasks.rados.rados.0.trial188.stdout:1049: rollback oid 33 current snap is 104 2026-02-13T20:16:08.904 INFO:tasks.rados.rados.0.trial188.stdout:1049: done (4 left) 2026-02-13T20:16:08.904 INFO:tasks.rados.rados.0.trial188.stdout:1050: write (excl) oid 11 current snap is 104 2026-02-13T20:16:08.905 INFO:tasks.rados.rados.0.trial188.stdout:1050: seq_num 400 ranges {722800=549956,2040562=682238} 2026-02-13T20:16:08.909 INFO:tasks.rados.rados.0.trial188.stdout:1050: writing trial18843701-11 from 722800 to 1272756 tid 1 2026-02-13T20:16:08.915 INFO:tasks.rados.rados.0.trial188.stdout:1050: writing trial18843701-11 from 2040562 to 2722800 tid 2 2026-02-13T20:16:08.915 INFO:tasks.rados.rados.0.trial188.stdout:1051: write (excl) oid 18 current snap is 104 2026-02-13T20:16:08.915 INFO:tasks.rados.rados.0.trial188.stdout:1051: seq_num 401 ranges {739607=625205,1982691=499457} 2026-02-13T20:16:08.920 INFO:tasks.rados.rados.0.trial188.stdout:1051: writing trial18843701-18 from 739607 to 1364812 tid 1 2026-02-13T20:16:08.924 INFO:tasks.rados.rados.0.trial188.stdout:1051: writing trial18843701-18 from 1982691 to 2482148 tid 2 2026-02-13T20:16:08.924 INFO:tasks.rados.rados.0.trial188.stdout:1052: read oid 45 snap -1 2026-02-13T20:16:08.924 INFO:tasks.rados.rados.0.trial188.stdout:1052: expect deleted 2026-02-13T20:16:08.924 INFO:tasks.rados.rados.0.trial188.stdout:1053: snap_create 2026-02-13T20:16:08.925 INFO:tasks.rados.rados.0.trial188.stdout:1042: finishing write tid 1 to trial18843701-47 2026-02-13T20:16:08.940 INFO:tasks.rados.rados.0.trial188.stdout:1050: finishing write tid 1 to trial18843701-11 2026-02-13T20:16:08.941 INFO:tasks.rados.rados.0.trial188.stdout:1050: finishing write tid 2 to trial18843701-11 2026-02-13T20:16:08.941 INFO:tasks.rados.rados.0.trial188.stdout:1050: finishing write tid 3 to trial18843701-11 2026-02-13T20:16:08.941 INFO:tasks.rados.rados.0.trial188.stdout:1050: finishing write tid 4 to trial18843701-11 2026-02-13T20:16:08.941 INFO:tasks.rados.rados.0.trial188.stdout:1050: oid 11 updating version 0 to 331 2026-02-13T20:16:08.941 INFO:tasks.rados.rados.0.trial188.stdout:1050: oid 11 version 331 is already newer than 330 2026-02-13T20:16:08.941 INFO:tasks.rados.rados.0.trial188.stdout:1050: oid 11 version 331 is already newer than 329 2026-02-13T20:16:08.941 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 11 v 331 (ObjNum 400 snap 104 seq_num 400) dirty exists 2026-02-13T20:16:08.941 INFO:tasks.rados.rados.0.trial188.stdout:1050: left oid 11 (ObjNum 400 snap 104 seq_num 400) 2026-02-13T20:16:08.941 INFO:tasks.rados.rados.0.trial188.stdout:1046: finishing copy_from racing read to trial18843701-40 2026-02-13T20:16:08.943 INFO:tasks.rados.rados.0.trial188.stdout:1042: finishing write tid 2 to trial18843701-47 2026-02-13T20:16:08.943 INFO:tasks.rados.rados.0.trial188.stdout:1042: finishing write tid 3 to trial18843701-47 2026-02-13T20:16:08.943 INFO:tasks.rados.rados.0.trial188.stdout:1042: finishing write tid 4 to trial18843701-47 2026-02-13T20:16:08.943 INFO:tasks.rados.rados.0.trial188.stdout:1042: oid 47 updating version 0 to 397 2026-02-13T20:16:08.943 INFO:tasks.rados.rados.0.trial188.stdout:1042: oid 47 updating version 397 to 398 2026-02-13T20:16:08.943 INFO:tasks.rados.rados.0.trial188.stdout:1042: oid 47 version 398 is already newer than 396 2026-02-13T20:16:08.943 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 47 v 398 (ObjNum 398 snap 104 seq_num 398) dirty exists 2026-02-13T20:16:08.943 INFO:tasks.rados.rados.0.trial188.stdout:1042: left oid 47 (ObjNum 398 snap 104 seq_num 398) 2026-02-13T20:16:08.947 INFO:tasks.rados.rados.0.trial188.stdout:1046: finishing copy_from to trial18843701-40 2026-02-13T20:16:08.947 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 40 v 283 (ObjNum 356 snap 94 seq_num 356) dirty exists 2026-02-13T20:16:08.948 INFO:tasks.rados.rados.0.trial188.stdout:1051: finishing write tid 1 to trial18843701-18 2026-02-13T20:16:08.948 INFO:tasks.rados.rados.0.trial188.stdout:1051: finishing write tid 2 to trial18843701-18 2026-02-13T20:16:08.949 INFO:tasks.rados.rados.0.trial188.stdout:1051: finishing write tid 3 to trial18843701-18 2026-02-13T20:16:08.949 INFO:tasks.rados.rados.0.trial188.stdout:1051: finishing write tid 4 to trial18843701-18 2026-02-13T20:16:08.949 INFO:tasks.rados.rados.0.trial188.stdout:1051: oid 18 updating version 0 to 392 2026-02-13T20:16:08.949 INFO:tasks.rados.rados.0.trial188.stdout:1051: oid 18 updating version 392 to 393 2026-02-13T20:16:08.949 INFO:tasks.rados.rados.0.trial188.stdout:1051: oid 18 updating version 393 to 394 2026-02-13T20:16:08.949 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 18 v 394 (ObjNum 401 snap 104 seq_num 401) dirty exists 2026-02-13T20:16:08.949 INFO:tasks.rados.rados.0.trial188.stdout:1051: left oid 18 (ObjNum 401 snap 104 seq_num 401) 2026-02-13T20:16:08.954 INFO:tasks.rados.rados.0.trial188.stdout:1045: finishing copy_from racing read to trial18843701-25 2026-02-13T20:16:08.954 INFO:tasks.rados.rados.0.trial188.stdout:1045: finishing copy_from to trial18843701-25 2026-02-13T20:16:08.955 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 25 v 253 (ObjNum 313 snap 85 seq_num 313) dirty exists 2026-02-13T20:16:08.991 INFO:tasks.rados.rados.0.trial188.stdout:1043: finishing copy_from racing read to trial18843701-35 2026-02-13T20:16:08.995 INFO:tasks.rados.rados.0.trial188.stdout:1043: finishing copy_from to trial18843701-35 2026-02-13T20:16:08.995 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 35 v 333 (ObjNum 354 snap 94 seq_num 354) dirty exists 2026-02-13T20:16:09.919 INFO:tasks.rados.rados.0.trial188.stdout:1042: done (7 left) 2026-02-13T20:16:09.919 INFO:tasks.rados.rados.0.trial188.stdout:1043: done (6 left) 2026-02-13T20:16:09.919 INFO:tasks.rados.rados.0.trial188.stdout:1045: done (5 left) 2026-02-13T20:16:09.919 INFO:tasks.rados.rados.0.trial188.stdout:1046: done (4 left) 2026-02-13T20:16:09.919 INFO:tasks.rados.rados.0.trial188.stdout:1050: done (3 left) 2026-02-13T20:16:09.919 INFO:tasks.rados.rados.0.trial188.stdout:1051: done (2 left) 2026-02-13T20:16:09.919 INFO:tasks.rados.rados.0.trial188.stdout:1052: done (1 left) 2026-02-13T20:16:09.919 INFO:tasks.rados.rados.0.trial188.stdout:1053: done (0 left) 2026-02-13T20:16:09.919 INFO:tasks.rados.rados.0.trial188.stdout:1054: read oid 26 snap 104 2026-02-13T20:16:09.920 INFO:tasks.rados.rados.0.trial188.stdout:1054: expect (ObjNum 334 snap 92 seq_num 334) 2026-02-13T20:16:09.920 INFO:tasks.rados.rados.0.trial188.stdout:1055: write oid 33 current snap is 105 2026-02-13T20:16:09.920 INFO:tasks.rados.rados.0.trial188.stdout:1055: seq_num 402 ranges {756414=700454,2041173=715241} 2026-02-13T20:16:09.924 INFO:tasks.rados.rados.0.trial188.stdout:1055: writing trial18843701-33 from 756414 to 1456868 tid 1 2026-02-13T20:16:09.929 INFO:tasks.rados.rados.0.trial188.stdout:1055: writing trial18843701-33 from 2041173 to 2756414 tid 2 2026-02-13T20:16:09.929 INFO:tasks.rados.rados.0.trial188.stdout:1056: snap_create 2026-02-13T20:16:09.929 INFO:tasks.rados.rados.0.trial188.stdout:1054: expect (ObjNum 334 snap 92 seq_num 334) 2026-02-13T20:16:09.965 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:16:09.992 INFO:tasks.rados.rados.0.trial188.stdout:1055: finishing write tid 1 to trial18843701-33 2026-02-13T20:16:09.992 INFO:tasks.rados.rados.0.trial188.stdout:1055: finishing write tid 2 to trial18843701-33 2026-02-13T20:16:09.992 INFO:tasks.rados.rados.0.trial188.stdout:1055: finishing write tid 3 to trial18843701-33 2026-02-13T20:16:09.992 INFO:tasks.rados.rados.0.trial188.stdout:1055: finishing write tid 4 to trial18843701-33 2026-02-13T20:16:09.992 INFO:tasks.rados.rados.0.trial188.stdout:1055: oid 33 updating version 0 to 399 2026-02-13T20:16:09.992 INFO:tasks.rados.rados.0.trial188.stdout:1055: oid 33 updating version 399 to 401 2026-02-13T20:16:09.993 INFO:tasks.rados.rados.0.trial188.stdout:1055: oid 33 version 401 is already newer than 400 2026-02-13T20:16:09.993 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 33 v 401 (ObjNum 402 snap 105 seq_num 402) dirty exists 2026-02-13T20:16:09.993 INFO:tasks.rados.rados.0.trial188.stdout:1055: left oid 33 (ObjNum 402 snap 105 seq_num 402) 2026-02-13T20:16:10.922 INFO:tasks.rados.rados.0.trial188.stdout:1054: done (2 left) 2026-02-13T20:16:10.922 INFO:tasks.rados.rados.0.trial188.stdout:1055: done (1 left) 2026-02-13T20:16:10.923 INFO:tasks.rados.rados.0.trial188.stdout:1056: done (0 left) 2026-02-13T20:16:10.923 INFO:tasks.rados.rados.0.trial188.stdout:1057: write (excl) oid 10 current snap is 106 2026-02-13T20:16:10.923 INFO:tasks.rados.rados.0.trial188.stdout:1057: seq_num 403 ranges {773221=492056,1816008=503126} 2026-02-13T20:16:10.927 INFO:tasks.rados.rados.0.trial188.stdout:1057: writing trial18843701-10 from 773221 to 1265277 tid 1 2026-02-13T20:16:10.931 INFO:tasks.rados.rados.0.trial188.stdout:1057: writing trial18843701-10 from 1816008 to 2319134 tid 2 2026-02-13T20:16:10.931 INFO:tasks.rados.rados.0.trial188.stdout:1058: rollback oid 27 current snap is 106 2026-02-13T20:16:10.931 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 27 to 104 2026-02-13T20:16:10.931 INFO:tasks.rados.rados.0.trial188.stdout:1059: write oid 15 current snap is 106 2026-02-13T20:16:10.932 INFO:tasks.rados.rados.0.trial188.stdout:1059: seq_num 404 ranges {790028=567305,1874490=763137} 2026-02-13T20:16:10.936 INFO:tasks.rados.rados.0.trial188.stdout:1059: writing trial18843701-15 from 790028 to 1357333 tid 1 2026-02-13T20:16:10.941 INFO:tasks.rados.rados.0.trial188.stdout:1059: writing trial18843701-15 from 1874490 to 2637627 tid 2 2026-02-13T20:16:10.941 INFO:tasks.rados.rados.0.trial188.stdout:1060: snap_remove snap 105 2026-02-13T20:16:11.923 INFO:tasks.rados.rados.0.trial188.stdout:1060: done (3 left) 2026-02-13T20:16:11.924 INFO:tasks.rados.rados.0.trial188.stdout:1061: snap_create 2026-02-13T20:16:11.924 INFO:tasks.rados.rados.0.trial188.stdout:1058: finishing rollback tid 0 to trial18843701-27 2026-02-13T20:16:11.924 INFO:tasks.rados.rados.0.trial188.stdout:1058: finishing rollback tid 1 to trial18843701-27 2026-02-13T20:16:11.924 INFO:tasks.rados.rados.0.trial188.stdout:1058: finishing rollback tid 2 to trial18843701-27 2026-02-13T20:16:11.924 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 27 v 482 (ObjNum 387 snap 101 seq_num 387) dirty exists 2026-02-13T20:16:11.924 INFO:tasks.rados.rados.0.trial188.stdout:1057: finishing write tid 1 to trial18843701-10 2026-02-13T20:16:11.924 INFO:tasks.rados.rados.0.trial188.stdout:1057: finishing write tid 2 to trial18843701-10 2026-02-13T20:16:11.924 INFO:tasks.rados.rados.0.trial188.stdout:1057: finishing write tid 3 to trial18843701-10 2026-02-13T20:16:11.924 INFO:tasks.rados.rados.0.trial188.stdout:1057: finishing write tid 4 to trial18843701-10 2026-02-13T20:16:11.924 INFO:tasks.rados.rados.0.trial188.stdout:1057: oid 10 updating version 0 to 332 2026-02-13T20:16:11.924 INFO:tasks.rados.rados.0.trial188.stdout:1057: oid 10 updating version 332 to 333 2026-02-13T20:16:11.925 INFO:tasks.rados.rados.0.trial188.stdout:1057: oid 10 updating version 333 to 334 2026-02-13T20:16:11.925 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 10 v 334 (ObjNum 403 snap 106 seq_num 403) dirty exists 2026-02-13T20:16:11.925 INFO:tasks.rados.rados.0.trial188.stdout:1057: left oid 10 (ObjNum 403 snap 106 seq_num 403) 2026-02-13T20:16:11.925 INFO:tasks.rados.rados.0.trial188.stdout:1059: finishing write tid 1 to trial18843701-15 2026-02-13T20:16:11.925 INFO:tasks.rados.rados.0.trial188.stdout:1059: finishing write tid 2 to trial18843701-15 2026-02-13T20:16:11.925 INFO:tasks.rados.rados.0.trial188.stdout:1059: finishing write tid 3 to trial18843701-15 2026-02-13T20:16:11.925 INFO:tasks.rados.rados.0.trial188.stdout:1059: finishing write tid 4 to trial18843701-15 2026-02-13T20:16:11.925 INFO:tasks.rados.rados.0.trial188.stdout:1059: oid 15 updating version 0 to 358 2026-02-13T20:16:11.925 INFO:tasks.rados.rados.0.trial188.stdout:1059: oid 15 updating version 358 to 359 2026-02-13T20:16:11.926 INFO:tasks.rados.rados.0.trial188.stdout:1059: oid 15 version 359 is already newer than 357 2026-02-13T20:16:11.926 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 15 v 359 (ObjNum 404 snap 106 seq_num 404) dirty exists 2026-02-13T20:16:11.926 INFO:tasks.rados.rados.0.trial188.stdout:1059: left oid 15 (ObjNum 404 snap 106 seq_num 404) 2026-02-13T20:16:12.886 INFO:tasks.rados.rados.0.trial188.stdout:1057: done (3 left) 2026-02-13T20:16:12.886 INFO:tasks.rados.rados.0.trial188.stdout:1058: done (2 left) 2026-02-13T20:16:12.886 INFO:tasks.rados.rados.0.trial188.stdout:1059: done (1 left) 2026-02-13T20:16:12.886 INFO:tasks.rados.rados.0.trial188.stdout:1061: done (0 left) 2026-02-13T20:16:12.886 INFO:tasks.rados.rados.0.trial188.stdout:1062: rollback oid 36 current snap is 107 2026-02-13T20:16:12.886 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 36 to 106 2026-02-13T20:16:12.886 INFO:tasks.rados.rados.0.trial188.stdout:1063: copy_from oid 16 from oid 5 current snap is 107 2026-02-13T20:16:12.886 INFO:tasks.rados.rados.0.trial188.stdout:1064: rollback oid 19 current snap is 107 2026-02-13T20:16:12.886 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 19 to 106 2026-02-13T20:16:12.886 INFO:tasks.rados.rados.0.trial188.stdout:1065: snap_create 2026-02-13T20:16:12.888 INFO:tasks.rados.rados.0.trial188.stdout:1062: finishing rollback tid 0 to trial18843701-36 2026-02-13T20:16:12.889 INFO:tasks.rados.rados.0.trial188.stdout:1064: finishing rollback tid 1 to trial18843701-19 2026-02-13T20:16:12.889 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 19 v 0 (ObjNum 353 snap 0 seq_num 4129271376) dirty dne 2026-02-13T20:16:12.889 INFO:tasks.rados.rados.0.trial188.stdout:1062: finishing rollback tid 1 to trial18843701-36 2026-02-13T20:16:12.889 INFO:tasks.rados.rados.0.trial188.stdout:1062: finishing rollback tid 2 to trial18843701-36 2026-02-13T20:16:12.889 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 36 v 479 (ObjNum 287 snap 74 seq_num 287) dirty exists 2026-02-13T20:16:12.889 INFO:tasks.rados.rados.0.trial188.stdout:1063: finishing copy_from to trial18843701-16 2026-02-13T20:16:12.889 INFO:tasks.rados.rados.0.trial188.stdout:1063: got expected ENOENT (src dne) 2026-02-13T20:16:12.890 INFO:tasks.rados.rados.0.trial188.stdout:1063: finishing copy_from racing read to trial18843701-16 2026-02-13T20:16:13.887 INFO:tasks.rados.rados.0.trial188.stdout:1062: done (3 left) 2026-02-13T20:16:13.887 INFO:tasks.rados.rados.0.trial188.stdout:1063: done (2 left) 2026-02-13T20:16:13.888 INFO:tasks.rados.rados.0.trial188.stdout:1064: done (1 left) 2026-02-13T20:16:13.888 INFO:tasks.rados.rados.0.trial188.stdout:1065: done (0 left) 2026-02-13T20:16:13.888 INFO:tasks.rados.rados.0.trial188.stdout:1066: read oid 24 snap -1 2026-02-13T20:16:13.888 INFO:tasks.rados.rados.0.trial188.stdout:1066: expect deleted 2026-02-13T20:16:13.888 INFO:tasks.rados.rados.0.trial188.stdout:1067: snap_create 2026-02-13T20:16:14.888 INFO:tasks.rados.rados.0.trial188.stdout:1066: done (1 left) 2026-02-13T20:16:14.888 INFO:tasks.rados.rados.0.trial188.stdout:1067: done (0 left) 2026-02-13T20:16:14.888 INFO:tasks.rados.rados.0.trial188.stdout:1068: rollback oid 46 current snap is 109 2026-02-13T20:16:14.888 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 46 to 104 2026-02-13T20:16:14.889 INFO:tasks.rados.rados.0.trial188.stdout:1069: read oid 40 snap -1 2026-02-13T20:16:14.889 INFO:tasks.rados.rados.0.trial188.stdout:1069: expect (ObjNum 356 snap 94 seq_num 356) 2026-02-13T20:16:14.889 INFO:tasks.rados.rados.0.trial188.stdout:1070: write (excl) oid 9 current snap is 109 2026-02-13T20:16:14.889 INFO:tasks.rados.rados.0.trial188.stdout:1070: seq_num 405 ranges {406835=642554,1532972=506795,2772312=34523} 2026-02-13T20:16:14.892 INFO:tasks.rados.rados.0.trial188.stdout:1070: writing trial18843701-9 from 406835 to 1049389 tid 1 2026-02-13T20:16:14.895 INFO:tasks.rados.rados.0.trial188.stdout:1070: writing trial18843701-9 from 1532972 to 2039767 tid 2 2026-02-13T20:16:14.899 INFO:tasks.rados.rados.0.trial188.stdout:1070: writing trial18843701-9 from 2772312 to 2806835 tid 3 2026-02-13T20:16:14.899 INFO:tasks.rados.rados.0.trial188.stdout:1071: copy_from oid 16 from oid 49 current snap is 109 2026-02-13T20:16:14.899 INFO:tasks.rados.rados.0.trial188.stdout:1072: copy_from oid 28 from oid 25 current snap is 109 2026-02-13T20:16:14.899 INFO:tasks.rados.rados.0.trial188.stdout:1073: write (excl) oid 3 current snap is 109 2026-02-13T20:16:14.899 INFO:tasks.rados.rados.0.trial188.stdout:1073: seq_num 406 ranges {423642=717803,1875101=766806} 2026-02-13T20:16:14.903 INFO:tasks.rados.rados.0.trial188.stdout:1073: writing trial18843701-3 from 423642 to 1141445 tid 1 2026-02-13T20:16:14.908 INFO:tasks.rados.rados.0.trial188.stdout:1073: writing trial18843701-3 from 1875101 to 2641907 tid 2 2026-02-13T20:16:14.909 INFO:tasks.rados.rados.0.trial188.stdout:1074: rollback oid 44 current snap is 109 2026-02-13T20:16:14.909 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 44 to 107 2026-02-13T20:16:14.909 INFO:tasks.rados.rados.0.trial188.stdout:1068: finishing rollback tid 0 to trial18843701-46 2026-02-13T20:16:14.909 INFO:tasks.rados.rados.0.trial188.stdout:1068: finishing rollback tid 1 to trial18843701-46 2026-02-13T20:16:14.909 INFO:tasks.rados.rados.0.trial188.stdout:1068: finishing rollback tid 2 to trial18843701-46 2026-02-13T20:16:14.909 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 46 v 395 (ObjNum 375 snap 96 seq_num 375) dirty exists 2026-02-13T20:16:14.909 INFO:tasks.rados.rados.0.trial188.stdout:1069: expect (ObjNum 356 snap 94 seq_num 356) 2026-02-13T20:16:14.951 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:16:15.046 INFO:tasks.rados.rados.0.trial188.stdout:1070: finishing write tid 1 to trial18843701-9 2026-02-13T20:16:15.046 INFO:tasks.rados.rados.0.trial188.stdout:1074: finishing rollback tid 0 to trial18843701-44 2026-02-13T20:16:15.047 INFO:tasks.rados.rados.0.trial188.stdout:1070: finishing write tid 2 to trial18843701-9 2026-02-13T20:16:15.047 INFO:tasks.rados.rados.0.trial188.stdout:1068: done (6 left) 2026-02-13T20:16:15.047 INFO:tasks.rados.rados.0.trial188.stdout:1069: done (5 left) 2026-02-13T20:16:15.047 INFO:tasks.rados.rados.0.trial188.stdout:1075: delete oid 43 current snap is 109 2026-02-13T20:16:15.047 INFO:tasks.rados.rados.0.trial188.stdout:1070: finishing write tid 3 to trial18843701-9 2026-02-13T20:16:15.047 INFO:tasks.rados.rados.0.trial188.stdout:1074: finishing rollback tid 1 to trial18843701-44 2026-02-13T20:16:15.047 INFO:tasks.rados.rados.0.trial188.stdout:1074: finishing rollback tid 2 to trial18843701-44 2026-02-13T20:16:15.047 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 44 v 434 (ObjNum 353 snap 94 seq_num 353) dirty exists 2026-02-13T20:16:15.047 INFO:tasks.rados.rados.0.trial188.stdout:1070: finishing write tid 4 to trial18843701-9 2026-02-13T20:16:15.047 INFO:tasks.rados.rados.0.trial188.stdout:1073: finishing write tid 1 to trial18843701-3 2026-02-13T20:16:15.047 INFO:tasks.rados.rados.0.trial188.stdout:1070: finishing write tid 5 to trial18843701-9 2026-02-13T20:16:15.048 INFO:tasks.rados.rados.0.trial188.stdout:1070: oid 9 updating version 0 to 384 2026-02-13T20:16:15.048 INFO:tasks.rados.rados.0.trial188.stdout:1070: oid 9 version 384 is already newer than 382 2026-02-13T20:16:15.048 INFO:tasks.rados.rados.0.trial188.stdout:1070: oid 9 version 384 is already newer than 383 2026-02-13T20:16:15.048 INFO:tasks.rados.rados.0.trial188.stdout:1070: oid 9 updating version 384 to 385 2026-02-13T20:16:15.048 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 9 v 385 (ObjNum 405 snap 109 seq_num 405) dirty exists 2026-02-13T20:16:15.048 INFO:tasks.rados.rados.0.trial188.stdout:1070: left oid 9 (ObjNum 405 snap 109 seq_num 405) 2026-02-13T20:16:15.048 INFO:tasks.rados.rados.0.trial188.stdout:1073: finishing write tid 2 to trial18843701-3 2026-02-13T20:16:15.048 INFO:tasks.rados.rados.0.trial188.stdout:1073: finishing write tid 3 to trial18843701-3 2026-02-13T20:16:15.048 INFO:tasks.rados.rados.0.trial188.stdout:1073: finishing write tid 4 to trial18843701-3 2026-02-13T20:16:15.048 INFO:tasks.rados.rados.0.trial188.stdout:1073: oid 3 updating version 0 to 362 2026-02-13T20:16:15.048 INFO:tasks.rados.rados.0.trial188.stdout:1073: oid 3 updating version 362 to 363 2026-02-13T20:16:15.048 INFO:tasks.rados.rados.0.trial188.stdout:1073: oid 3 version 363 is already newer than 361 2026-02-13T20:16:15.048 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 3 v 363 (ObjNum 406 snap 109 seq_num 406) dirty exists 2026-02-13T20:16:15.049 INFO:tasks.rados.rados.0.trial188.stdout:1073: left oid 3 (ObjNum 406 snap 109 seq_num 406) 2026-02-13T20:16:15.049 INFO:tasks.rados.rados.0.trial188.stdout:1071: finishing copy_from racing read to trial18843701-16 2026-02-13T20:16:15.049 INFO:tasks.rados.rados.0.trial188.stdout:1071: finishing copy_from to trial18843701-16 2026-02-13T20:16:15.049 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 16 v 465 (ObjNum 396 snap 104 seq_num 396) dirty exists 2026-02-13T20:16:15.049 INFO:tasks.rados.rados.0.trial188.stdout:1072: finishing copy_from racing read to trial18843701-28 2026-02-13T20:16:15.049 INFO:tasks.rados.rados.0.trial188.stdout:1072: finishing copy_from to trial18843701-28 2026-02-13T20:16:15.049 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 28 v 253 (ObjNum 313 snap 85 seq_num 313) dirty exists 2026-02-13T20:16:15.049 INFO:tasks.rados.rados.0.trial188.stdout:1070: done (5 left) 2026-02-13T20:16:15.049 INFO:tasks.rados.rados.0.trial188.stdout:1071: done (4 left) 2026-02-13T20:16:15.049 INFO:tasks.rados.rados.0.trial188.stdout:1072: done (3 left) 2026-02-13T20:16:15.049 INFO:tasks.rados.rados.0.trial188.stdout:1073: done (2 left) 2026-02-13T20:16:15.049 INFO:tasks.rados.rados.0.trial188.stdout:1074: done (1 left) 2026-02-13T20:16:15.049 INFO:tasks.rados.rados.0.trial188.stdout:1075: done (0 left) 2026-02-13T20:16:15.050 INFO:tasks.rados.rados.0.trial188.stdout:1076: write (excl) oid 33 current snap is 109 2026-02-13T20:16:15.050 INFO:tasks.rados.rados.0.trial188.stdout:1076: seq_num 408 ranges {457256=468301,1592065=770475,2854581=2675} 2026-02-13T20:16:15.050 INFO:tasks.rados.rados.0.trial188.stdout:1076: writing trial18843701-33 from 457256 to 925557 tid 1 2026-02-13T20:16:15.055 INFO:tasks.rados.rados.0.trial188.stdout:1076: writing trial18843701-33 from 1592065 to 2362540 tid 2 2026-02-13T20:16:15.057 INFO:tasks.rados.rados.0.trial188.stdout:1076: writing trial18843701-33 from 2854581 to 2857256 tid 3 2026-02-13T20:16:15.057 INFO:tasks.rados.rados.0.trial188.stdout:1077: write oid 22 current snap is 109 2026-02-13T20:16:15.057 INFO:tasks.rados.rados.0.trial188.stdout:1077: seq_num 409 ranges {474063=543550,1650547=514133,2765651=108412} 2026-02-13T20:16:15.060 INFO:tasks.rados.rados.0.trial188.stdout:1077: writing trial18843701-22 from 474063 to 1017613 tid 1 2026-02-13T20:16:15.065 INFO:tasks.rados.rados.0.trial188.stdout:1077: writing trial18843701-22 from 1650547 to 2164680 tid 2 2026-02-13T20:16:15.067 INFO:tasks.rados.rados.0.trial188.stdout:1077: writing trial18843701-22 from 2765651 to 2874063 tid 3 2026-02-13T20:16:15.067 INFO:tasks.rados.rados.0.trial188.stdout:1078: snap_remove snap 108 2026-02-13T20:16:15.930 INFO:tasks.rados.rados.0.trial188.stdout:1078: done (2 left) 2026-02-13T20:16:15.930 INFO:tasks.rados.rados.0.trial188.stdout:1079: copy_from oid 50 from oid 4 current snap is 109 2026-02-13T20:16:15.930 INFO:tasks.rados.rados.0.trial188.stdout:1076: finishing write tid 1 to trial18843701-33 2026-02-13T20:16:15.930 INFO:tasks.rados.rados.0.trial188.stdout:1077: finishing write tid 1 to trial18843701-22 2026-02-13T20:16:15.930 INFO:tasks.rados.rados.0.trial188.stdout:1076: finishing write tid 2 to trial18843701-33 2026-02-13T20:16:15.930 INFO:tasks.rados.rados.0.trial188.stdout:1076: finishing write tid 3 to trial18843701-33 2026-02-13T20:16:15.930 INFO:tasks.rados.rados.0.trial188.stdout:1076: finishing write tid 4 to trial18843701-33 2026-02-13T20:16:15.930 INFO:tasks.rados.rados.0.trial188.stdout:1076: finishing write tid 5 to trial18843701-33 2026-02-13T20:16:15.930 INFO:tasks.rados.rados.0.trial188.stdout:1076: oid 33 updating version 0 to 404 2026-02-13T20:16:15.931 INFO:tasks.rados.rados.0.trial188.stdout:1076: oid 33 updating version 404 to 405 2026-02-13T20:16:15.931 INFO:tasks.rados.rados.0.trial188.stdout:1076: oid 33 version 405 is already newer than 403 2026-02-13T20:16:15.931 INFO:tasks.rados.rados.0.trial188.stdout:1076: oid 33 version 405 is already newer than 402 2026-02-13T20:16:15.931 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 33 v 405 (ObjNum 408 snap 109 seq_num 408) dirty exists 2026-02-13T20:16:15.931 INFO:tasks.rados.rados.0.trial188.stdout:1076: left oid 33 (ObjNum 408 snap 109 seq_num 408) 2026-02-13T20:16:15.931 INFO:tasks.rados.rados.0.trial188.stdout:1076: done (2 left) 2026-02-13T20:16:15.931 INFO:tasks.rados.rados.0.trial188.stdout:1080: read oid 39 snap 107 2026-02-13T20:16:15.931 INFO:tasks.rados.rados.0.trial188.stdout:1080: expect (ObjNum 394 snap 104 seq_num 394) 2026-02-13T20:16:15.931 INFO:tasks.rados.rados.0.trial188.stdout:1081: snap_remove snap 104 2026-02-13T20:16:16.933 INFO:tasks.rados.rados.0.trial188.stdout:1081: done (3 left) 2026-02-13T20:16:16.933 INFO:tasks.rados.rados.0.trial188.stdout:1082: write oid 35 current snap is 109 2026-02-13T20:16:16.933 INFO:tasks.rados.rados.0.trial188.stdout:1082: seq_num 410 ranges {490870=618799,1592676=774144,2793074=97796} 2026-02-13T20:16:16.937 INFO:tasks.rados.rados.0.trial188.stdout:1082: writing trial18843701-35 from 490870 to 1109669 tid 1 2026-02-13T20:16:16.941 INFO:tasks.rados.rados.0.trial188.stdout:1082: writing trial18843701-35 from 1592676 to 2366820 tid 2 2026-02-13T20:16:16.944 INFO:tasks.rados.rados.0.trial188.stdout:1082: writing trial18843701-35 from 2793074 to 2890870 tid 3 2026-02-13T20:16:16.944 INFO:tasks.rados.rados.0.trial188.stdout:1083: write oid 45 current snap is 109 2026-02-13T20:16:16.944 INFO:tasks.rados.rados.0.trial188.stdout:1083: seq_num 411 ranges {507677=410401,1367511=517802,2420497=487180} 2026-02-13T20:16:16.947 INFO:tasks.rados.rados.0.trial188.stdout:1083: writing trial18843701-45 from 507677 to 918078 tid 1 2026-02-13T20:16:16.950 INFO:tasks.rados.rados.0.trial188.stdout:1083: writing trial18843701-45 from 1367511 to 1885313 tid 2 2026-02-13T20:16:16.954 INFO:tasks.rados.rados.0.trial188.stdout:1083: writing trial18843701-45 from 2420497 to 2907677 tid 3 2026-02-13T20:16:16.955 INFO:tasks.rados.rados.0.trial188.stdout:1084: write oid 38 current snap is 109 2026-02-13T20:16:16.955 INFO:tasks.rados.rados.0.trial188.stdout:1084: seq_num 412 ranges {524484=485650,1425993=661460,2847920=76564} 2026-02-13T20:16:16.958 INFO:tasks.rados.rados.0.trial188.stdout:1084: writing trial18843701-38 from 524484 to 1010134 tid 1 2026-02-13T20:16:16.962 INFO:tasks.rados.rados.0.trial188.stdout:1084: writing trial18843701-38 from 1425993 to 2087453 tid 2 2026-02-13T20:16:16.966 INFO:tasks.rados.rados.0.trial188.stdout:1084: writing trial18843701-38 from 2847920 to 2924484 tid 3 2026-02-13T20:16:16.966 INFO:tasks.rados.rados.0.trial188.stdout:1085: read oid 24 snap -1 2026-02-13T20:16:16.966 INFO:tasks.rados.rados.0.trial188.stdout:1085: expect deleted 2026-02-13T20:16:16.966 INFO:tasks.rados.rados.0.trial188.stdout:1086: read oid 42 snap 106 2026-02-13T20:16:16.966 INFO:tasks.rados.rados.0.trial188.stdout:1086: expect (ObjNum 201 snap 52 seq_num 201) 2026-02-13T20:16:16.967 INFO:tasks.rados.rados.0.trial188.stdout:1087: snap_create 2026-02-13T20:16:16.967 INFO:tasks.rados.rados.0.trial188.stdout:1077: finishing write tid 2 to trial18843701-22 2026-02-13T20:16:16.967 INFO:tasks.rados.rados.0.trial188.stdout:1077: finishing write tid 3 to trial18843701-22 2026-02-13T20:16:16.967 INFO:tasks.rados.rados.0.trial188.stdout:1077: finishing write tid 4 to trial18843701-22 2026-02-13T20:16:16.967 INFO:tasks.rados.rados.0.trial188.stdout:1077: finishing write tid 5 to trial18843701-22 2026-02-13T20:16:16.967 INFO:tasks.rados.rados.0.trial188.stdout:1077: oid 22 updating version 0 to 315 2026-02-13T20:16:16.967 INFO:tasks.rados.rados.0.trial188.stdout:1077: oid 22 version 315 is already newer than 313 2026-02-13T20:16:16.967 INFO:tasks.rados.rados.0.trial188.stdout:1077: oid 22 updating version 315 to 316 2026-02-13T20:16:16.967 INFO:tasks.rados.rados.0.trial188.stdout:1077: oid 22 version 316 is already newer than 314 2026-02-13T20:16:16.967 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 22 v 316 (ObjNum 409 snap 109 seq_num 409) dirty exists 2026-02-13T20:16:16.968 INFO:tasks.rados.rados.0.trial188.stdout:1077: left oid 22 (ObjNum 409 snap 109 seq_num 409) 2026-02-13T20:16:16.968 INFO:tasks.rados.rados.0.trial188.stdout:1080: expect (ObjNum 394 snap 104 seq_num 394) 2026-02-13T20:16:17.021 INFO:tasks.rados.rados.0.trial188.stdout:1079: finishing copy_from racing read to trial18843701-50 2026-02-13T20:16:17.021 INFO:tasks.rados.rados.0.trial188.stdout:1079: finishing copy_from to trial18843701-50 2026-02-13T20:16:17.021 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 50 v 322 (ObjNum 363 snap 95 seq_num 363) dirty exists 2026-02-13T20:16:17.021 INFO:tasks.rados.rados.0.trial188.stdout:1082: finishing write tid 1 to trial18843701-35 2026-02-13T20:16:17.021 INFO:tasks.rados.rados.0.trial188.stdout:1082: finishing write tid 2 to trial18843701-35 2026-02-13T20:16:17.021 INFO:tasks.rados.rados.0.trial188.stdout:1082: finishing write tid 3 to trial18843701-35 2026-02-13T20:16:17.021 INFO:tasks.rados.rados.0.trial188.stdout:1082: finishing write tid 4 to trial18843701-35 2026-02-13T20:16:17.021 INFO:tasks.rados.rados.0.trial188.stdout:1082: finishing write tid 5 to trial18843701-35 2026-02-13T20:16:17.022 INFO:tasks.rados.rados.0.trial188.stdout:1082: oid 35 updating version 0 to 386 2026-02-13T20:16:17.022 INFO:tasks.rados.rados.0.trial188.stdout:1082: oid 35 updating version 386 to 388 2026-02-13T20:16:17.022 INFO:tasks.rados.rados.0.trial188.stdout:1082: oid 35 version 388 is already newer than 387 2026-02-13T20:16:17.022 INFO:tasks.rados.rados.0.trial188.stdout:1082: oid 35 updating version 388 to 389 2026-02-13T20:16:17.022 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 35 v 389 (ObjNum 410 snap 109 seq_num 410) dirty exists 2026-02-13T20:16:17.022 INFO:tasks.rados.rados.0.trial188.stdout:1082: left oid 35 (ObjNum 410 snap 109 seq_num 410) 2026-02-13T20:16:17.022 INFO:tasks.rados.rados.0.trial188.stdout:1083: finishing write tid 1 to trial18843701-45 2026-02-13T20:16:17.022 INFO:tasks.rados.rados.0.trial188.stdout:1083: finishing write tid 2 to trial18843701-45 2026-02-13T20:16:17.022 INFO:tasks.rados.rados.0.trial188.stdout:1083: finishing write tid 3 to trial18843701-45 2026-02-13T20:16:17.022 INFO:tasks.rados.rados.0.trial188.stdout:1083: finishing write tid 4 to trial18843701-45 2026-02-13T20:16:17.022 INFO:tasks.rados.rados.0.trial188.stdout:1083: finishing write tid 5 to trial18843701-45 2026-02-13T20:16:17.022 INFO:tasks.rados.rados.0.trial188.stdout:1083: oid 45 updating version 0 to 432 2026-02-13T20:16:17.023 INFO:tasks.rados.rados.0.trial188.stdout:1083: oid 45 updating version 432 to 433 2026-02-13T20:16:17.023 INFO:tasks.rados.rados.0.trial188.stdout:1083: oid 45 version 433 is already newer than 431 2026-02-13T20:16:17.023 INFO:tasks.rados.rados.0.trial188.stdout:1083: oid 45 updating version 433 to 434 2026-02-13T20:16:17.023 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 45 v 434 (ObjNum 411 snap 109 seq_num 411) dirty exists 2026-02-13T20:16:17.023 INFO:tasks.rados.rados.0.trial188.stdout:1083: left oid 45 (ObjNum 411 snap 109 seq_num 411) 2026-02-13T20:16:17.023 INFO:tasks.rados.rados.0.trial188.stdout:1086: expect (ObjNum 201 snap 52 seq_num 201) 2026-02-13T20:16:17.033 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1507588 2026-02-13T20:16:17.104 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1858602 2026-02-13T20:16:17.201 INFO:tasks.rados.rados.0.trial188.stdout:1084: finishing write tid 1 to trial18843701-38 2026-02-13T20:16:17.202 INFO:tasks.rados.rados.0.trial188.stdout:1084: finishing write tid 2 to trial18843701-38 2026-02-13T20:16:17.202 INFO:tasks.rados.rados.0.trial188.stdout:1084: finishing write tid 3 to trial18843701-38 2026-02-13T20:16:17.202 INFO:tasks.rados.rados.0.trial188.stdout:1084: finishing write tid 4 to trial18843701-38 2026-02-13T20:16:17.202 INFO:tasks.rados.rados.0.trial188.stdout:1084: finishing write tid 5 to trial18843701-38 2026-02-13T20:16:17.202 INFO:tasks.rados.rados.0.trial188.stdout:1084: oid 38 updating version 0 to 488 2026-02-13T20:16:17.202 INFO:tasks.rados.rados.0.trial188.stdout:1084: oid 38 updating version 488 to 490 2026-02-13T20:16:17.202 INFO:tasks.rados.rados.0.trial188.stdout:1084: oid 38 version 490 is already newer than 489 2026-02-13T20:16:17.202 INFO:tasks.rados.rados.0.trial188.stdout:1084: oid 38 updating version 490 to 491 2026-02-13T20:16:17.202 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 38 v 491 (ObjNum 412 snap 109 seq_num 412) dirty exists 2026-02-13T20:16:17.202 INFO:tasks.rados.rados.0.trial188.stdout:1084: left oid 38 (ObjNum 412 snap 109 seq_num 412) 2026-02-13T20:16:17.888 INFO:tasks.rados.rados.0.trial188.stdout:1077: done (8 left) 2026-02-13T20:16:17.888 INFO:tasks.rados.rados.0.trial188.stdout:1079: done (7 left) 2026-02-13T20:16:17.889 INFO:tasks.rados.rados.0.trial188.stdout:1080: done (6 left) 2026-02-13T20:16:17.889 INFO:tasks.rados.rados.0.trial188.stdout:1082: done (5 left) 2026-02-13T20:16:17.889 INFO:tasks.rados.rados.0.trial188.stdout:1083: done (4 left) 2026-02-13T20:16:17.889 INFO:tasks.rados.rados.0.trial188.stdout:1084: done (3 left) 2026-02-13T20:16:17.889 INFO:tasks.rados.rados.0.trial188.stdout:1085: done (2 left) 2026-02-13T20:16:17.889 INFO:tasks.rados.rados.0.trial188.stdout:1086: done (1 left) 2026-02-13T20:16:17.889 INFO:tasks.rados.rados.0.trial188.stdout:1087: done (0 left) 2026-02-13T20:16:17.889 INFO:tasks.rados.rados.0.trial188.stdout:1088: write (excl) oid 18 current snap is 110 2026-02-13T20:16:17.889 INFO:tasks.rados.rados.0.trial188.stdout:1088: seq_num 413 ranges {541291=560899,1884475=521471} 2026-02-13T20:16:17.892 INFO:tasks.rados.rados.0.trial188.stdout:1088: writing trial18843701-18 from 541291 to 1102190 tid 1 2026-02-13T20:16:17.897 INFO:tasks.rados.rados.0.trial188.stdout:1088: writing trial18843701-18 from 1884475 to 2405946 tid 2 2026-02-13T20:16:17.897 INFO:tasks.rados.rados.0.trial188.stdout:1089: snap_create 2026-02-13T20:16:17.909 INFO:tasks.rados.rados.0.trial188.stdout:1088: finishing write tid 1 to trial18843701-18 2026-02-13T20:16:17.909 INFO:tasks.rados.rados.0.trial188.stdout:1088: finishing write tid 2 to trial18843701-18 2026-02-13T20:16:17.909 INFO:tasks.rados.rados.0.trial188.stdout:1088: finishing write tid 3 to trial18843701-18 2026-02-13T20:16:17.909 INFO:tasks.rados.rados.0.trial188.stdout:1088: finishing write tid 4 to trial18843701-18 2026-02-13T20:16:17.909 INFO:tasks.rados.rados.0.trial188.stdout:1088: oid 18 updating version 0 to 397 2026-02-13T20:16:17.909 INFO:tasks.rados.rados.0.trial188.stdout:1088: oid 18 version 397 is already newer than 396 2026-02-13T20:16:17.909 INFO:tasks.rados.rados.0.trial188.stdout:1088: oid 18 version 397 is already newer than 395 2026-02-13T20:16:17.909 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 18 v 397 (ObjNum 413 snap 110 seq_num 413) dirty exists 2026-02-13T20:16:17.909 INFO:tasks.rados.rados.0.trial188.stdout:1088: left oid 18 (ObjNum 413 snap 110 seq_num 413) 2026-02-13T20:16:18.890 INFO:tasks.rados.rados.0.trial188.stdout:1088: done (1 left) 2026-02-13T20:16:18.891 INFO:tasks.rados.rados.0.trial188.stdout:1089: done (0 left) 2026-02-13T20:16:18.891 INFO:tasks.rados.rados.0.trial188.stdout:1090: read oid 1 snap -1 2026-02-13T20:16:18.891 INFO:tasks.rados.rados.0.trial188.stdout:1090: expect (ObjNum 317 snap 86 seq_num 317) 2026-02-13T20:16:18.891 INFO:tasks.rados.rados.0.trial188.stdout:1091: read oid 42 snap 109 2026-02-13T20:16:18.891 INFO:tasks.rados.rados.0.trial188.stdout:1091: expect (ObjNum 201 snap 52 seq_num 201) 2026-02-13T20:16:18.891 INFO:tasks.rados.rados.0.trial188.stdout:1092: rollback oid 21 current snap is 111 2026-02-13T20:16:18.892 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 21 to 110 2026-02-13T20:16:18.892 INFO:tasks.rados.rados.0.trial188.stdout:1093: copy_from oid 13 from oid 8 current snap is 111 2026-02-13T20:16:18.892 INFO:tasks.rados.rados.0.trial188.stdout:1094: delete oid 36 current snap is 111 2026-02-13T20:16:18.893 INFO:tasks.rados.rados.0.trial188.stdout:1092: finishing rollback tid 0 to trial18843701-21 2026-02-13T20:16:18.893 INFO:tasks.rados.rados.0.trial188.stdout:1092: finishing rollback tid 1 to trial18843701-21 2026-02-13T20:16:18.893 INFO:tasks.rados.rados.0.trial188.stdout:1092: finishing rollback tid 2 to trial18843701-21 2026-02-13T20:16:18.893 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 21 v 205 (ObjNum 383 snap 98 seq_num 383) dirty exists 2026-02-13T20:16:18.895 INFO:tasks.rados.rados.0.trial188.stdout:1092: done (4 left) 2026-02-13T20:16:18.895 INFO:tasks.rados.rados.0.trial188.stdout:1094: done (3 left) 2026-02-13T20:16:18.895 INFO:tasks.rados.rados.0.trial188.stdout:1095: read oid 46 snap 106 2026-02-13T20:16:18.895 INFO:tasks.rados.rados.0.trial188.stdout:1095: expect (ObjNum 375 snap 96 seq_num 375) 2026-02-13T20:16:18.896 INFO:tasks.rados.rados.0.trial188.stdout:1096: read oid 44 snap -1 2026-02-13T20:16:18.896 INFO:tasks.rados.rados.0.trial188.stdout:1096: expect (ObjNum 353 snap 94 seq_num 353) 2026-02-13T20:16:18.896 INFO:tasks.rados.rados.0.trial188.stdout:1097: rollback oid 34 current snap is 111 2026-02-13T20:16:18.896 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 34 to 107 2026-02-13T20:16:18.896 INFO:tasks.rados.rados.0.trial188.stdout:1098: snap_remove snap 110 2026-02-13T20:16:19.891 INFO:tasks.rados.rados.0.trial188.stdout:1098: done (6 left) 2026-02-13T20:16:19.891 INFO:tasks.rados.rados.0.trial188.stdout:1099: read oid 9 snap -1 2026-02-13T20:16:19.891 INFO:tasks.rados.rados.0.trial188.stdout:1099: expect (ObjNum 405 snap 109 seq_num 405) 2026-02-13T20:16:19.892 INFO:tasks.rados.rados.0.trial188.stdout:1100: rollback oid 41 current snap is 111 2026-02-13T20:16:19.892 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 41 to 109 2026-02-13T20:16:19.892 INFO:tasks.rados.rados.0.trial188.stdout:1090: expect (ObjNum 317 snap 86 seq_num 317) 2026-02-13T20:16:20.026 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1656415 2026-02-13T20:16:20.061 INFO:tasks.rados.rados.0.trial188.stdout:1097: finishing rollback tid 0 to trial18843701-34 2026-02-13T20:16:20.061 INFO:tasks.rados.rados.0.trial188.stdout:1097: finishing rollback tid 1 to trial18843701-34 2026-02-13T20:16:20.061 INFO:tasks.rados.rados.0.trial188.stdout:1093: finishing copy_from to trial18843701-13 2026-02-13T20:16:20.061 INFO:tasks.rados.rados.0.trial188.stdout:1093: got expected ENOENT (src dne) 2026-02-13T20:16:20.061 INFO:tasks.rados.rados.0.trial188.stdout:1093: finishing copy_from racing read to trial18843701-13 2026-02-13T20:16:20.061 INFO:tasks.rados.rados.0.trial188.stdout:1097: finishing rollback tid 2 to trial18843701-34 2026-02-13T20:16:20.061 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 34 v 437 (ObjNum 161 snap 32 seq_num 161) dirty exists 2026-02-13T20:16:20.061 INFO:tasks.rados.rados.0.trial188.stdout:1096: expect (ObjNum 353 snap 94 seq_num 353) 2026-02-13T20:16:20.082 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2832251 2026-02-13T20:16:20.120 INFO:tasks.rados.rados.0.trial188.stdout:1091: expect (ObjNum 201 snap 52 seq_num 201) 2026-02-13T20:16:20.125 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1115692 2026-02-13T20:16:20.180 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:16:20.306 INFO:tasks.rados.rados.0.trial188.stdout:1095: expect (ObjNum 375 snap 96 seq_num 375) 2026-02-13T20:16:20.306 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:16:20.330 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:16:20.354 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:16:20.378 INFO:tasks.rados.rados.0.trial188.stdout:1100: finishing rollback tid 0 to trial18843701-41 2026-02-13T20:16:20.378 INFO:tasks.rados.rados.0.trial188.stdout:1100: finishing rollback tid 1 to trial18843701-41 2026-02-13T20:16:20.378 INFO:tasks.rados.rados.0.trial188.stdout:1100: finishing rollback tid 2 to trial18843701-41 2026-02-13T20:16:20.378 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 41 v 398 (ObjNum 259 snap 68 seq_num 259) dirty exists 2026-02-13T20:16:20.379 INFO:tasks.rados.rados.0.trial188.stdout:1099: expect (ObjNum 405 snap 109 seq_num 405) 2026-02-13T20:16:20.384 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1407005 2026-02-13T20:16:20.416 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1416583 2026-02-13T20:16:20.449 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1490692 2026-02-13T20:16:20.476 INFO:tasks.rados.rados.0.trial188.stdout:1090: done (7 left) 2026-02-13T20:16:20.476 INFO:tasks.rados.rados.0.trial188.stdout:1091: done (6 left) 2026-02-13T20:16:20.476 INFO:tasks.rados.rados.0.trial188.stdout:1093: done (5 left) 2026-02-13T20:16:20.476 INFO:tasks.rados.rados.0.trial188.stdout:1095: done (4 left) 2026-02-13T20:16:20.476 INFO:tasks.rados.rados.0.trial188.stdout:1096: done (3 left) 2026-02-13T20:16:20.476 INFO:tasks.rados.rados.0.trial188.stdout:1097: done (2 left) 2026-02-13T20:16:20.476 INFO:tasks.rados.rados.0.trial188.stdout:1099: done (1 left) 2026-02-13T20:16:20.476 INFO:tasks.rados.rados.0.trial188.stdout:1100: done (0 left) 2026-02-13T20:16:20.476 INFO:tasks.rados.rados.0.trial188.stdout:1101: write oid 28 current snap is 111 2026-02-13T20:16:20.476 INFO:tasks.rados.rados.0.trial188.stdout:1101: seq_num 415 ranges {574905=711397,1885086=525140,2930189=44716} 2026-02-13T20:16:20.481 INFO:tasks.rados.rados.0.trial188.stdout:1101: writing trial18843701-28 from 574905 to 1286302 tid 1 2026-02-13T20:16:20.485 INFO:tasks.rados.rados.0.trial188.stdout:1101: writing trial18843701-28 from 1885086 to 2410226 tid 2 2026-02-13T20:16:20.487 INFO:tasks.rados.rados.0.trial188.stdout:1101: writing trial18843701-28 from 2930189 to 2974905 tid 3 2026-02-13T20:16:20.487 INFO:tasks.rados.rados.0.trial188.stdout:1102: write oid 8 current snap is 111 2026-02-13T20:16:20.487 INFO:tasks.rados.rados.0.trial188.stdout:1102: seq_num 416 ranges {591712=786646,1943568=668798} 2026-02-13T20:16:20.492 INFO:tasks.rados.rados.0.trial188.stdout:1102: writing trial18843701-8 from 591712 to 1378358 tid 1 2026-02-13T20:16:20.497 INFO:tasks.rados.rados.0.trial188.stdout:1102: writing trial18843701-8 from 1943568 to 2612366 tid 2 2026-02-13T20:16:20.497 INFO:tasks.rados.rados.0.trial188.stdout:1103: copy_from oid 33 from oid 5 current snap is 111 2026-02-13T20:16:20.497 INFO:tasks.rados.rados.0.trial188.stdout:1104: read oid 50 snap 107 2026-02-13T20:16:20.497 INFO:tasks.rados.rados.0.trial188.stdout:1104: expect (ObjNum 313 snap 85 seq_num 313) 2026-02-13T20:16:20.497 INFO:tasks.rados.rados.0.trial188.stdout:1105: rollback oid 3 current snap is 111 2026-02-13T20:16:20.497 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 3 to 107 2026-02-13T20:16:20.497 INFO:tasks.rados.rados.0.trial188.stdout:1106: copy_from oid 38 from oid 48 current snap is 111 2026-02-13T20:16:20.497 INFO:tasks.rados.rados.0.trial188.stdout:1107: copy_from oid 23 from oid 49 current snap is 111 2026-02-13T20:16:20.497 INFO:tasks.rados.rados.0.trial188.stdout:1108: read oid 37 snap -1 2026-02-13T20:16:20.497 INFO:tasks.rados.rados.0.trial188.stdout:1108: expect deleted 2026-02-13T20:16:20.497 INFO:tasks.rados.rados.0.trial188.stdout:1109: read oid 46 snap 109 2026-02-13T20:16:20.497 INFO:tasks.rados.rados.0.trial188.stdout:1109: expect (ObjNum 375 snap 96 seq_num 375) 2026-02-13T20:16:20.497 INFO:tasks.rados.rados.0.trial188.stdout:1110: snap_remove snap 106 2026-02-13T20:16:20.896 INFO:tasks.rados.rados.0.trial188.stdout:1110: done (9 left) 2026-02-13T20:16:20.896 INFO:tasks.rados.rados.0.trial188.stdout:1111: read oid 36 snap -1 2026-02-13T20:16:20.896 INFO:tasks.rados.rados.0.trial188.stdout:1111: expect deleted 2026-02-13T20:16:20.897 INFO:tasks.rados.rados.0.trial188.stdout:1112: write (excl) oid 29 current snap is 111 2026-02-13T20:16:20.897 INFO:tasks.rados.rados.0.trial188.stdout:1112: seq_num 417 ranges {608519=461895,1602050=528809,2585035=423484} 2026-02-13T20:16:20.900 INFO:tasks.rados.rados.0.trial188.stdout:1112: writing trial18843701-29 from 608519 to 1070414 tid 1 2026-02-13T20:16:20.904 INFO:tasks.rados.rados.0.trial188.stdout:1112: writing trial18843701-29 from 1602050 to 2130859 tid 2 2026-02-13T20:16:20.907 INFO:tasks.rados.rados.0.trial188.stdout:1112: writing trial18843701-29 from 2585035 to 3008519 tid 3 2026-02-13T20:16:20.907 INFO:tasks.rados.rados.0.trial188.stdout:1113: delete oid 19 current snap is 111 2026-02-13T20:16:20.907 INFO:tasks.rados.rados.0.trial188.stdout:1103: finishing copy_from to trial18843701-33 2026-02-13T20:16:20.907 INFO:tasks.rados.rados.0.trial188.stdout:1103: got expected ENOENT (src dne) 2026-02-13T20:16:20.907 INFO:tasks.rados.rados.0.trial188.stdout:1103: finishing copy_from racing read to trial18843701-33 2026-02-13T20:16:20.907 INFO:tasks.rados.rados.0.trial188.stdout:1104: expect (ObjNum 313 snap 85 seq_num 313) 2026-02-13T20:16:20.952 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:16:21.031 INFO:tasks.rados.rados.0.trial188.stdout:1109: expect (ObjNum 375 snap 96 seq_num 375) 2026-02-13T20:16:21.032 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:16:21.093 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2185779 2026-02-13T20:16:21.094 INFO:tasks.rados.rados.0.trial188.stdout:1101: finishing write tid 1 to trial18843701-28 2026-02-13T20:16:21.094 INFO:tasks.rados.rados.0.trial188.stdout:1103: done (11 left) 2026-02-13T20:16:21.094 INFO:tasks.rados.rados.0.trial188.stdout:1104: done (10 left) 2026-02-13T20:16:21.094 INFO:tasks.rados.rados.0.trial188.stdout:1109: done (9 left) 2026-02-13T20:16:21.094 INFO:tasks.rados.rados.0.trial188.stdout:1113: done (8 left) 2026-02-13T20:16:21.094 INFO:tasks.rados.rados.0.trial188.stdout:1114: snap_remove snap 109 2026-02-13T20:16:21.899 INFO:tasks.rados.rados.0.trial188.stdout:1114: done (8 left) 2026-02-13T20:16:21.899 INFO:tasks.rados.rados.0.trial188.stdout:1115: delete oid 9 current snap is 111 2026-02-13T20:16:21.899 INFO:tasks.rados.rados.0.trial188.stdout:1101: finishing write tid 2 to trial18843701-28 2026-02-13T20:16:21.899 INFO:tasks.rados.rados.0.trial188.stdout:1101: finishing write tid 3 to trial18843701-28 2026-02-13T20:16:21.899 INFO:tasks.rados.rados.0.trial188.stdout:1101: finishing write tid 4 to trial18843701-28 2026-02-13T20:16:21.899 INFO:tasks.rados.rados.0.trial188.stdout:1101: finishing write tid 5 to trial18843701-28 2026-02-13T20:16:21.899 INFO:tasks.rados.rados.0.trial188.stdout:1101: oid 28 updating version 0 to 442 2026-02-13T20:16:21.899 INFO:tasks.rados.rados.0.trial188.stdout:1101: oid 28 updating version 442 to 443 2026-02-13T20:16:21.899 INFO:tasks.rados.rados.0.trial188.stdout:1101: oid 28 updating version 443 to 444 2026-02-13T20:16:21.899 INFO:tasks.rados.rados.0.trial188.stdout:1101: oid 28 version 444 is already newer than 441 2026-02-13T20:16:21.899 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 28 v 444 (ObjNum 415 snap 111 seq_num 415) dirty exists 2026-02-13T20:16:21.899 INFO:tasks.rados.rados.0.trial188.stdout:1101: left oid 28 (ObjNum 415 snap 111 seq_num 415) 2026-02-13T20:16:21.899 INFO:tasks.rados.rados.0.trial188.stdout:1102: finishing write tid 1 to trial18843701-8 2026-02-13T20:16:21.899 INFO:tasks.rados.rados.0.trial188.stdout:1105: finishing rollback tid 0 to trial18843701-3 2026-02-13T20:16:21.899 INFO:tasks.rados.rados.0.trial188.stdout:1105: finishing rollback tid 1 to trial18843701-3 2026-02-13T20:16:21.899 INFO:tasks.rados.rados.0.trial188.stdout:1105: finishing rollback tid 2 to trial18843701-3 2026-02-13T20:16:21.899 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 3 v 371 (ObjNum 356 snap 94 seq_num 356) dirty exists 2026-02-13T20:16:21.900 INFO:tasks.rados.rados.0.trial188.stdout:1106: finishing copy_from racing read to trial18843701-38 2026-02-13T20:16:21.900 INFO:tasks.rados.rados.0.trial188.stdout:1102: finishing write tid 2 to trial18843701-8 2026-02-13T20:16:21.900 INFO:tasks.rados.rados.0.trial188.stdout:1102: finishing write tid 3 to trial18843701-8 2026-02-13T20:16:21.900 INFO:tasks.rados.rados.0.trial188.stdout:1102: finishing write tid 4 to trial18843701-8 2026-02-13T20:16:21.900 INFO:tasks.rados.rados.0.trial188.stdout:1102: oid 8 updating version 0 to 447 2026-02-13T20:16:21.900 INFO:tasks.rados.rados.0.trial188.stdout:1102: oid 8 version 447 is already newer than 445 2026-02-13T20:16:21.900 INFO:tasks.rados.rados.0.trial188.stdout:1102: oid 8 version 447 is already newer than 446 2026-02-13T20:16:21.900 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 8 v 447 (ObjNum 416 snap 111 seq_num 416) dirty exists 2026-02-13T20:16:21.900 INFO:tasks.rados.rados.0.trial188.stdout:1102: left oid 8 (ObjNum 416 snap 111 seq_num 416) 2026-02-13T20:16:21.900 INFO:tasks.rados.rados.0.trial188.stdout:1106: finishing copy_from to trial18843701-38 2026-02-13T20:16:21.900 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 38 v 185 (ObjNum 366 snap 95 seq_num 366) dirty exists 2026-02-13T20:16:21.900 INFO:tasks.rados.rados.0.trial188.stdout:1107: finishing copy_from racing read to trial18843701-23 2026-02-13T20:16:21.900 INFO:tasks.rados.rados.0.trial188.stdout:1107: finishing copy_from to trial18843701-23 2026-02-13T20:16:21.900 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 23 v 465 (ObjNum 396 snap 104 seq_num 396) dirty exists 2026-02-13T20:16:21.900 INFO:tasks.rados.rados.0.trial188.stdout:1112: finishing write tid 1 to trial18843701-29 2026-02-13T20:16:21.900 INFO:tasks.rados.rados.0.trial188.stdout:1112: finishing write tid 2 to trial18843701-29 2026-02-13T20:16:21.900 INFO:tasks.rados.rados.0.trial188.stdout:1112: finishing write tid 3 to trial18843701-29 2026-02-13T20:16:21.900 INFO:tasks.rados.rados.0.trial188.stdout:1112: finishing write tid 4 to trial18843701-29 2026-02-13T20:16:21.900 INFO:tasks.rados.rados.0.trial188.stdout:1112: finishing write tid 5 to trial18843701-29 2026-02-13T20:16:21.900 INFO:tasks.rados.rados.0.trial188.stdout:1112: oid 29 updating version 0 to 444 2026-02-13T20:16:21.900 INFO:tasks.rados.rados.0.trial188.stdout:1112: oid 29 version 444 is already newer than 441 2026-02-13T20:16:21.900 INFO:tasks.rados.rados.0.trial188.stdout:1112: oid 29 version 444 is already newer than 442 2026-02-13T20:16:21.900 INFO:tasks.rados.rados.0.trial188.stdout:1112: oid 29 version 444 is already newer than 443 2026-02-13T20:16:21.900 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 29 v 444 (ObjNum 417 snap 111 seq_num 417) dirty exists 2026-02-13T20:16:21.900 INFO:tasks.rados.rados.0.trial188.stdout:1112: left oid 29 (ObjNum 417 snap 111 seq_num 417) 2026-02-13T20:16:21.902 INFO:tasks.rados.rados.0.trial188.stdout:1101: done (8 left) 2026-02-13T20:16:21.902 INFO:tasks.rados.rados.0.trial188.stdout:1102: done (7 left) 2026-02-13T20:16:21.902 INFO:tasks.rados.rados.0.trial188.stdout:1105: done (6 left) 2026-02-13T20:16:21.902 INFO:tasks.rados.rados.0.trial188.stdout:1106: done (5 left) 2026-02-13T20:16:21.902 INFO:tasks.rados.rados.0.trial188.stdout:1107: done (4 left) 2026-02-13T20:16:21.902 INFO:tasks.rados.rados.0.trial188.stdout:1108: done (3 left) 2026-02-13T20:16:21.902 INFO:tasks.rados.rados.0.trial188.stdout:1111: done (2 left) 2026-02-13T20:16:21.902 INFO:tasks.rados.rados.0.trial188.stdout:1112: done (1 left) 2026-02-13T20:16:21.902 INFO:tasks.rados.rados.0.trial188.stdout:1115: done (0 left) 2026-02-13T20:16:21.902 INFO:tasks.rados.rados.0.trial188.stdout:1116: read oid 42 snap -1 2026-02-13T20:16:21.902 INFO:tasks.rados.rados.0.trial188.stdout:1116: expect (ObjNum 201 snap 52 seq_num 201) 2026-02-13T20:16:21.902 INFO:tasks.rados.rados.0.trial188.stdout:1117: snap_remove snap 107 2026-02-13T20:16:22.887 INFO:tasks.rados.rados.0.trial188.stdout:1117: done (1 left) 2026-02-13T20:16:22.887 INFO:tasks.rados.rados.0.trial188.stdout:1118: read oid 23 snap -1 2026-02-13T20:16:22.888 INFO:tasks.rados.rados.0.trial188.stdout:1118: expect (ObjNum 396 snap 104 seq_num 396) 2026-02-13T20:16:22.888 INFO:tasks.rados.rados.0.trial188.stdout:1119: write oid 2 current snap is 111 2026-02-13T20:16:22.888 INFO:tasks.rados.rados.0.trial188.stdout:1119: seq_num 420 ranges {658940=403995,1777496=676136,2950951=107989} 2026-02-13T20:16:22.891 INFO:tasks.rados.rados.0.trial188.stdout:1119: writing trial18843701-2 from 658940 to 1062935 tid 1 2026-02-13T20:16:22.896 INFO:tasks.rados.rados.0.trial188.stdout:1119: writing trial18843701-2 from 1777496 to 2453632 tid 2 2026-02-13T20:16:22.898 INFO:tasks.rados.rados.0.trial188.stdout:1119: writing trial18843701-2 from 2950951 to 3058940 tid 3 2026-02-13T20:16:22.899 INFO:tasks.rados.rados.0.trial188.stdout:1120: read oid 12 snap -1 2026-02-13T20:16:22.899 INFO:tasks.rados.rados.0.trial188.stdout:1120: expect deleted 2026-02-13T20:16:22.899 INFO:tasks.rados.rados.0.trial188.stdout:1121: write oid 6 current snap is 111 2026-02-13T20:16:22.899 INFO:tasks.rados.rados.0.trial188.stdout:1121: seq_num 421 ranges {675747=479244,1835978=536147} 2026-02-13T20:16:22.902 INFO:tasks.rados.rados.0.trial188.stdout:1121: writing trial18843701-6 from 675747 to 1154991 tid 1 2026-02-13T20:16:22.907 INFO:tasks.rados.rados.0.trial188.stdout:1121: writing trial18843701-6 from 1835978 to 2372125 tid 2 2026-02-13T20:16:22.907 INFO:tasks.rados.rados.0.trial188.stdout:1122: write (excl) oid 39 current snap is 111 2026-02-13T20:16:22.907 INFO:tasks.rados.rados.0.trial188.stdout:1116: expect (ObjNum 201 snap 52 seq_num 201) 2026-02-13T20:16:22.941 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2862360 2026-02-13T20:16:23.027 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:16:23.090 INFO:tasks.rados.rados.0.trial188.stdout:1118: expect (ObjNum 396 snap 104 seq_num 396) 2026-02-13T20:16:23.090 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:16:23.173 INFO:tasks.rados.rados.0.trial188.stdout:1119: finishing write tid 1 to trial18843701-2 2026-02-13T20:16:23.173 INFO:tasks.rados.rados.0.trial188.stdout:1119: finishing write tid 2 to trial18843701-2 2026-02-13T20:16:23.173 INFO:tasks.rados.rados.0.trial188.stdout:1119: finishing write tid 3 to trial18843701-2 2026-02-13T20:16:23.173 INFO:tasks.rados.rados.0.trial188.stdout:1119: finishing write tid 4 to trial18843701-2 2026-02-13T20:16:23.173 INFO:tasks.rados.rados.0.trial188.stdout:1119: finishing write tid 5 to trial18843701-2 2026-02-13T20:16:23.173 INFO:tasks.rados.rados.0.trial188.stdout:1119: oid 2 updating version 0 to 446 2026-02-13T20:16:23.173 INFO:tasks.rados.rados.0.trial188.stdout:1119: oid 2 version 446 is already newer than 444 2026-02-13T20:16:23.173 INFO:tasks.rados.rados.0.trial188.stdout:1119: oid 2 version 446 is already newer than 445 2026-02-13T20:16:23.173 INFO:tasks.rados.rados.0.trial188.stdout:1119: oid 2 version 446 is already newer than 443 2026-02-13T20:16:23.173 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 2 v 446 (ObjNum 420 snap 111 seq_num 420) dirty exists 2026-02-13T20:16:23.173 INFO:tasks.rados.rados.0.trial188.stdout:1119: left oid 2 (ObjNum 420 snap 111 seq_num 420) 2026-02-13T20:16:23.173 INFO:tasks.rados.rados.0.trial188.stdout:1121: finishing write tid 1 to trial18843701-6 2026-02-13T20:16:23.173 INFO:tasks.rados.rados.0.trial188.stdout:1121: finishing write tid 2 to trial18843701-6 2026-02-13T20:16:23.173 INFO:tasks.rados.rados.0.trial188.stdout:1121: finishing write tid 3 to trial18843701-6 2026-02-13T20:16:23.173 INFO:tasks.rados.rados.0.trial188.stdout:1121: finishing write tid 4 to trial18843701-6 2026-02-13T20:16:23.173 INFO:tasks.rados.rados.0.trial188.stdout:1121: oid 6 updating version 0 to 508 2026-02-13T20:16:23.173 INFO:tasks.rados.rados.0.trial188.stdout:1121: oid 6 version 508 is already newer than 507 2026-02-13T20:16:23.173 INFO:tasks.rados.rados.0.trial188.stdout:1121: oid 6 updating version 508 to 509 2026-02-13T20:16:23.173 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 6 v 509 (ObjNum 421 snap 111 seq_num 421) dirty exists 2026-02-13T20:16:23.173 INFO:tasks.rados.rados.0.trial188.stdout:1121: left oid 6 (ObjNum 421 snap 111 seq_num 421) 2026-02-13T20:16:23.173 INFO:tasks.rados.rados.0.trial188.stdout:1122: seq_num 422 ranges {692554=554493,1778107=679805,2889444=203110} 2026-02-13T20:16:23.178 INFO:tasks.rados.rados.0.trial188.stdout:1122: writing trial18843701-39 from 692554 to 1247047 tid 1 2026-02-13T20:16:23.182 INFO:tasks.rados.rados.0.trial188.stdout:1122: writing trial18843701-39 from 1778107 to 2457912 tid 2 2026-02-13T20:16:23.185 INFO:tasks.rados.rados.0.trial188.stdout:1122: writing trial18843701-39 from 2889444 to 3092554 tid 3 2026-02-13T20:16:23.185 INFO:tasks.rados.rados.0.trial188.stdout:1116: done (5 left) 2026-02-13T20:16:23.185 INFO:tasks.rados.rados.0.trial188.stdout:1118: done (4 left) 2026-02-13T20:16:23.185 INFO:tasks.rados.rados.0.trial188.stdout:1119: done (3 left) 2026-02-13T20:16:23.185 INFO:tasks.rados.rados.0.trial188.stdout:1120: done (2 left) 2026-02-13T20:16:23.185 INFO:tasks.rados.rados.0.trial188.stdout:1121: done (1 left) 2026-02-13T20:16:23.185 INFO:tasks.rados.rados.0.trial188.stdout:1123: copy_from oid 4 from oid 10 current snap is 111 2026-02-13T20:16:23.185 INFO:tasks.rados.rados.0.trial188.stdout:1124: write oid 34 current snap is 111 2026-02-13T20:16:23.185 INFO:tasks.rados.rados.0.trial188.stdout:1124: seq_num 423 ranges {709361=629742,1836589=539816,3033220=76141} 2026-02-13T20:16:23.190 INFO:tasks.rados.rados.0.trial188.stdout:1124: writing trial18843701-34 from 709361 to 1339103 tid 1 2026-02-13T20:16:23.194 INFO:tasks.rados.rados.0.trial188.stdout:1124: writing trial18843701-34 from 1836589 to 2376405 tid 2 2026-02-13T20:16:23.196 INFO:tasks.rados.rados.0.trial188.stdout:1124: writing trial18843701-34 from 3033220 to 3109361 tid 3 2026-02-13T20:16:23.196 INFO:tasks.rados.rados.0.trial188.stdout:1125: delete oid 48 current snap is 111 2026-02-13T20:16:23.202 INFO:tasks.rados.rados.0.trial188.stdout:1122: finishing write tid 1 to trial18843701-39 2026-02-13T20:16:23.202 INFO:tasks.rados.rados.0.trial188.stdout:1125: done (3 left) 2026-02-13T20:16:23.202 INFO:tasks.rados.rados.0.trial188.stdout:1126: write (excl) oid 44 current snap is 111 2026-02-13T20:16:23.202 INFO:tasks.rados.rados.0.trial188.stdout:1126: seq_num 425 ranges {742975=780240,1953553=427132,2971713=171262} 2026-02-13T20:16:23.208 INFO:tasks.rados.rados.0.trial188.stdout:1126: writing trial18843701-44 from 742975 to 1523215 tid 1 2026-02-13T20:16:23.212 INFO:tasks.rados.rados.0.trial188.stdout:1126: writing trial18843701-44 from 1953553 to 2380685 tid 2 2026-02-13T20:16:23.215 INFO:tasks.rados.rados.0.trial188.stdout:1126: writing trial18843701-44 from 2971713 to 3142975 tid 3 2026-02-13T20:16:23.215 INFO:tasks.rados.rados.0.trial188.stdout:1127: delete oid 13 current snap is 111 2026-02-13T20:16:23.215 INFO:tasks.rados.rados.0.trial188.stdout:1122: finishing write tid 2 to trial18843701-39 2026-02-13T20:16:23.215 INFO:tasks.rados.rados.0.trial188.stdout:1122: finishing write tid 3 to trial18843701-39 2026-02-13T20:16:23.227 INFO:tasks.rados.rados.0.trial188.stdout:1122: finishing write tid 4 to trial18843701-39 2026-02-13T20:16:23.227 INFO:tasks.rados.rados.0.trial188.stdout:1124: finishing write tid 1 to trial18843701-34 2026-02-13T20:16:23.227 INFO:tasks.rados.rados.0.trial188.stdout:1124: finishing write tid 2 to trial18843701-34 2026-02-13T20:16:23.227 INFO:tasks.rados.rados.0.trial188.stdout:1122: finishing write tid 5 to trial18843701-39 2026-02-13T20:16:23.227 INFO:tasks.rados.rados.0.trial188.stdout:1122: oid 39 updating version 0 to 451 2026-02-13T20:16:23.227 INFO:tasks.rados.rados.0.trial188.stdout:1122: oid 39 version 451 is already newer than 450 2026-02-13T20:16:23.227 INFO:tasks.rados.rados.0.trial188.stdout:1122: oid 39 updating version 451 to 453 2026-02-13T20:16:23.227 INFO:tasks.rados.rados.0.trial188.stdout:1122: oid 39 version 453 is already newer than 452 2026-02-13T20:16:23.227 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 39 v 453 (ObjNum 422 snap 111 seq_num 422) dirty exists 2026-02-13T20:16:23.227 INFO:tasks.rados.rados.0.trial188.stdout:1122: left oid 39 (ObjNum 422 snap 111 seq_num 422) 2026-02-13T20:16:23.228 INFO:tasks.rados.rados.0.trial188.stdout:1123: finishing copy_from racing read to trial18843701-4 2026-02-13T20:16:23.229 INFO:tasks.rados.rados.0.trial188.stdout:1123: finishing copy_from to trial18843701-4 2026-02-13T20:16:23.229 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 4 v 334 (ObjNum 403 snap 106 seq_num 403) dirty exists 2026-02-13T20:16:23.236 INFO:tasks.rados.rados.0.trial188.stdout:1124: finishing write tid 3 to trial18843701-34 2026-02-13T20:16:23.236 INFO:tasks.rados.rados.0.trial188.stdout:1124: finishing write tid 4 to trial18843701-34 2026-02-13T20:16:23.236 INFO:tasks.rados.rados.0.trial188.stdout:1126: finishing write tid 1 to trial18843701-44 2026-02-13T20:16:23.236 INFO:tasks.rados.rados.0.trial188.stdout:1126: finishing write tid 2 to trial18843701-44 2026-02-13T20:16:23.236 INFO:tasks.rados.rados.0.trial188.stdout:1126: finishing write tid 3 to trial18843701-44 2026-02-13T20:16:23.237 INFO:tasks.rados.rados.0.trial188.stdout:1124: finishing write tid 5 to trial18843701-34 2026-02-13T20:16:23.238 INFO:tasks.rados.rados.0.trial188.stdout:1124: oid 34 updating version 0 to 456 2026-02-13T20:16:23.238 INFO:tasks.rados.rados.0.trial188.stdout:1124: oid 34 version 456 is already newer than 454 2026-02-13T20:16:23.238 INFO:tasks.rados.rados.0.trial188.stdout:1124: oid 34 version 456 is already newer than 455 2026-02-13T20:16:23.238 INFO:tasks.rados.rados.0.trial188.stdout:1124: oid 34 updating version 456 to 457 2026-02-13T20:16:23.238 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 34 v 457 (ObjNum 423 snap 111 seq_num 423) dirty exists 2026-02-13T20:16:23.238 INFO:tasks.rados.rados.0.trial188.stdout:1124: left oid 34 (ObjNum 423 snap 111 seq_num 423) 2026-02-13T20:16:23.238 INFO:tasks.rados.rados.0.trial188.stdout:1126: finishing write tid 4 to trial18843701-44 2026-02-13T20:16:23.238 INFO:tasks.rados.rados.0.trial188.stdout:1126: finishing write tid 5 to trial18843701-44 2026-02-13T20:16:23.238 INFO:tasks.rados.rados.0.trial188.stdout:1126: oid 44 updating version 0 to 448 2026-02-13T20:16:23.238 INFO:tasks.rados.rados.0.trial188.stdout:1126: oid 44 updating version 448 to 450 2026-02-13T20:16:23.239 INFO:tasks.rados.rados.0.trial188.stdout:1126: oid 44 version 450 is already newer than 449 2026-02-13T20:16:23.239 INFO:tasks.rados.rados.0.trial188.stdout:1126: oid 44 version 450 is already newer than 447 2026-02-13T20:16:23.239 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 44 v 450 (ObjNum 425 snap 111 seq_num 425) dirty exists 2026-02-13T20:16:23.239 INFO:tasks.rados.rados.0.trial188.stdout:1126: left oid 44 (ObjNum 425 snap 111 seq_num 425) 2026-02-13T20:16:23.239 INFO:tasks.rados.rados.0.trial188.stdout:1122: done (4 left) 2026-02-13T20:16:23.239 INFO:tasks.rados.rados.0.trial188.stdout:1123: done (3 left) 2026-02-13T20:16:23.239 INFO:tasks.rados.rados.0.trial188.stdout:1124: done (2 left) 2026-02-13T20:16:23.239 INFO:tasks.rados.rados.0.trial188.stdout:1126: done (1 left) 2026-02-13T20:16:23.239 INFO:tasks.rados.rados.0.trial188.stdout:1127: done (0 left) 2026-02-13T20:16:23.239 INFO:tasks.rados.rados.0.trial188.stdout:1128: write (excl) oid 2 current snap is 111 2026-02-13T20:16:23.239 INFO:tasks.rados.rados.0.trial188.stdout:1128: seq_num 427 ranges {776589=647091,2070517=430801,3026559=150030} 2026-02-13T20:16:23.242 INFO:tasks.rados.rados.0.trial188.stdout:1128: writing trial18843701-2 from 776589 to 1423680 tid 1 2026-02-13T20:16:23.246 INFO:tasks.rados.rados.0.trial188.stdout:1128: writing trial18843701-2 from 2070517 to 2501318 tid 2 2026-02-13T20:16:23.249 INFO:tasks.rados.rados.0.trial188.stdout:1128: writing trial18843701-2 from 3026559 to 3176589 tid 3 2026-02-13T20:16:23.249 INFO:tasks.rados.rados.0.trial188.stdout:1129: snap_create 2026-02-13T20:16:23.263 INFO:tasks.rados.rados.0.trial188.stdout:1128: finishing write tid 1 to trial18843701-2 2026-02-13T20:16:23.263 INFO:tasks.rados.rados.0.trial188.stdout:1128: finishing write tid 2 to trial18843701-2 2026-02-13T20:16:23.263 INFO:tasks.rados.rados.0.trial188.stdout:1128: finishing write tid 3 to trial18843701-2 2026-02-13T20:16:23.263 INFO:tasks.rados.rados.0.trial188.stdout:1128: finishing write tid 4 to trial18843701-2 2026-02-13T20:16:23.263 INFO:tasks.rados.rados.0.trial188.stdout:1128: finishing write tid 5 to trial18843701-2 2026-02-13T20:16:23.263 INFO:tasks.rados.rados.0.trial188.stdout:1128: oid 2 updating version 0 to 452 2026-02-13T20:16:23.263 INFO:tasks.rados.rados.0.trial188.stdout:1128: oid 2 updating version 452 to 455 2026-02-13T20:16:23.263 INFO:tasks.rados.rados.0.trial188.stdout:1128: oid 2 version 455 is already newer than 453 2026-02-13T20:16:23.263 INFO:tasks.rados.rados.0.trial188.stdout:1128: oid 2 version 455 is already newer than 454 2026-02-13T20:16:23.263 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 2 v 455 (ObjNum 427 snap 111 seq_num 427) dirty exists 2026-02-13T20:16:23.263 INFO:tasks.rados.rados.0.trial188.stdout:1128: left oid 2 (ObjNum 427 snap 111 seq_num 427) 2026-02-13T20:16:23.907 INFO:tasks.rados.rados.0.trial188.stdout:1128: done (1 left) 2026-02-13T20:16:23.907 INFO:tasks.rados.rados.0.trial188.stdout:1129: done (0 left) 2026-02-13T20:16:23.907 INFO:tasks.rados.rados.0.trial188.stdout:1130: read oid 13 snap -1 2026-02-13T20:16:23.907 INFO:tasks.rados.rados.0.trial188.stdout:1130: expect deleted 2026-02-13T20:16:23.907 INFO:tasks.rados.rados.0.trial188.stdout:1131: delete oid 3 current snap is 112 2026-02-13T20:16:23.908 INFO:tasks.rados.rados.0.trial188.stdout:1130: done (1 left) 2026-02-13T20:16:23.908 INFO:tasks.rados.rados.0.trial188.stdout:1131: done (0 left) 2026-02-13T20:16:23.908 INFO:tasks.rados.rados.0.trial188.stdout:1132: write (excl) oid 44 current snap is 112 2026-02-13T20:16:23.908 INFO:tasks.rados.rados.0.trial188.stdout:1132: seq_num 429 ranges {410203=797589,1787481=434470,2681405=528798} 2026-02-13T20:16:23.912 INFO:tasks.rados.rados.0.trial188.stdout:1132: writing trial18843701-44 from 410203 to 1207792 tid 1 2026-02-13T20:16:23.916 INFO:tasks.rados.rados.0.trial188.stdout:1132: writing trial18843701-44 from 1787481 to 2221951 tid 2 2026-02-13T20:16:23.920 INFO:tasks.rados.rados.0.trial188.stdout:1132: writing trial18843701-44 from 2681405 to 3210203 tid 3 2026-02-13T20:16:23.920 INFO:tasks.rados.rados.0.trial188.stdout:1133: read oid 23 snap -1 2026-02-13T20:16:23.920 INFO:tasks.rados.rados.0.trial188.stdout:1133: expect (ObjNum 396 snap 104 seq_num 396) 2026-02-13T20:16:23.920 INFO:tasks.rados.rados.0.trial188.stdout:1134: rollback oid 8 current snap is 112 2026-02-13T20:16:23.920 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 8 to 111 2026-02-13T20:16:23.920 INFO:tasks.rados.rados.0.trial188.stdout:1135: copy_from oid 40 from oid 4 current snap is 112 2026-02-13T20:16:23.920 INFO:tasks.rados.rados.0.trial188.stdout:1136: write (excl) oid 43 current snap is 112 2026-02-13T20:16:23.920 INFO:tasks.rados.rados.0.trial188.stdout:1136: seq_num 430 ranges {427010=472838,1329610=694481,2708828=518182} 2026-02-13T20:16:23.924 INFO:tasks.rados.rados.0.trial188.stdout:1136: writing trial18843701-43 from 427010 to 899848 tid 1 2026-02-13T20:16:23.929 INFO:tasks.rados.rados.0.trial188.stdout:1136: writing trial18843701-43 from 1329610 to 2024091 tid 2 2026-02-13T20:16:23.933 INFO:tasks.rados.rados.0.trial188.stdout:1136: writing trial18843701-43 from 2708828 to 3227010 tid 3 2026-02-13T20:16:23.933 INFO:tasks.rados.rados.0.trial188.stdout:1137: read oid 42 snap -1 2026-02-13T20:16:23.933 INFO:tasks.rados.rados.0.trial188.stdout:1137: expect (ObjNum 201 snap 52 seq_num 201) 2026-02-13T20:16:23.933 INFO:tasks.rados.rados.0.trial188.stdout:1138: copy_from oid 50 from oid 29 current snap is 112 2026-02-13T20:16:23.933 INFO:tasks.rados.rados.0.trial188.stdout:1134: finishing rollback tid 0 to trial18843701-8 2026-02-13T20:16:23.933 INFO:tasks.rados.rados.0.trial188.stdout:1134: finishing rollback tid 1 to trial18843701-8 2026-02-13T20:16:23.933 INFO:tasks.rados.rados.0.trial188.stdout:1134: finishing rollback tid 2 to trial18843701-8 2026-02-13T20:16:23.933 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 8 v 463 (ObjNum 416 snap 111 seq_num 416) dirty exists 2026-02-13T20:16:23.933 INFO:tasks.rados.rados.0.trial188.stdout:1133: expect (ObjNum 396 snap 104 seq_num 396) 2026-02-13T20:16:23.970 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 701828 2026-02-13T20:16:24.013 INFO:tasks.rados.rados.0.trial188.stdout:1137: expect (ObjNum 201 snap 52 seq_num 201) 2026-02-13T20:16:24.018 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 928369 2026-02-13T20:16:24.192 INFO:tasks.rados.rados.0.trial188.stdout:1135: finishing copy_from racing read to trial18843701-40 2026-02-13T20:16:24.192 INFO:tasks.rados.rados.0.trial188.stdout:1132: finishing write tid 1 to trial18843701-44 2026-02-13T20:16:24.192 INFO:tasks.rados.rados.0.trial188.stdout:1133: done (6 left) 2026-02-13T20:16:24.193 INFO:tasks.rados.rados.0.trial188.stdout:1134: done (5 left) 2026-02-13T20:16:24.193 INFO:tasks.rados.rados.0.trial188.stdout:1137: done (4 left) 2026-02-13T20:16:24.193 INFO:tasks.rados.rados.0.trial188.stdout:1139: write (excl) oid 13 current snap is 112 2026-02-13T20:16:24.193 INFO:tasks.rados.rados.0.trial188.stdout:1132: finishing write tid 2 to trial18843701-44 2026-02-13T20:16:24.193 INFO:tasks.rados.rados.0.trial188.stdout:1132: finishing write tid 3 to trial18843701-44 2026-02-13T20:16:24.193 INFO:tasks.rados.rados.0.trial188.stdout:1132: finishing write tid 4 to trial18843701-44 2026-02-13T20:16:24.193 INFO:tasks.rados.rados.0.trial188.stdout:1139: seq_num 431 ranges {443817=548087,1788092=438139,3019898=223919} 2026-02-13T20:16:24.196 INFO:tasks.rados.rados.0.trial188.stdout:1139: writing trial18843701-13 from 443817 to 991904 tid 1 2026-02-13T20:16:24.200 INFO:tasks.rados.rados.0.trial188.stdout:1139: writing trial18843701-13 from 1788092 to 2226231 tid 2 2026-02-13T20:16:24.205 INFO:tasks.rados.rados.0.trial188.stdout:1139: writing trial18843701-13 from 3019898 to 3243817 tid 3 2026-02-13T20:16:24.205 INFO:tasks.rados.rados.0.trial188.stdout:1140: read oid 5 snap -1 2026-02-13T20:16:24.205 INFO:tasks.rados.rados.0.trial188.stdout:1140: expect deleted 2026-02-13T20:16:24.205 INFO:tasks.rados.rados.0.trial188.stdout:1141: write oid 36 current snap is 112 2026-02-13T20:16:24.205 INFO:tasks.rados.rados.0.trial188.stdout:1136: finishing write tid 1 to trial18843701-43 2026-02-13T20:16:24.205 INFO:tasks.rados.rados.0.trial188.stdout:1132: finishing write tid 5 to trial18843701-44 2026-02-13T20:16:24.205 INFO:tasks.rados.rados.0.trial188.stdout:1132: oid 44 updating version 0 to 460 2026-02-13T20:16:24.205 INFO:tasks.rados.rados.0.trial188.stdout:1132: oid 44 version 460 is already newer than 459 2026-02-13T20:16:24.205 INFO:tasks.rados.rados.0.trial188.stdout:1132: oid 44 version 460 is already newer than 458 2026-02-13T20:16:24.206 INFO:tasks.rados.rados.0.trial188.stdout:1132: oid 44 version 460 is already newer than 457 2026-02-13T20:16:24.206 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 44 v 460 (ObjNum 429 snap 112 seq_num 429) dirty exists 2026-02-13T20:16:24.206 INFO:tasks.rados.rados.0.trial188.stdout:1132: left oid 44 (ObjNum 429 snap 112 seq_num 429) 2026-02-13T20:16:24.206 INFO:tasks.rados.rados.0.trial188.stdout:1141: seq_num 432 ranges {460624=623336,1846574=698150,3163674=96950} 2026-02-13T20:16:24.208 INFO:tasks.rados.rados.0.trial188.stdout:1141: writing trial18843701-36 from 460624 to 1083960 tid 1 2026-02-13T20:16:24.214 INFO:tasks.rados.rados.0.trial188.stdout:1141: writing trial18843701-36 from 1846574 to 2544724 tid 2 2026-02-13T20:16:24.216 INFO:tasks.rados.rados.0.trial188.stdout:1141: writing trial18843701-36 from 3163674 to 3260624 tid 3 2026-02-13T20:16:24.217 INFO:tasks.rados.rados.0.trial188.stdout:1132: done (6 left) 2026-02-13T20:16:24.217 INFO:tasks.rados.rados.0.trial188.stdout:1142: snap_remove snap 111 2026-02-13T20:16:24.910 INFO:tasks.rados.rados.0.trial188.stdout:1142: done (6 left) 2026-02-13T20:16:24.910 INFO:tasks.rados.rados.0.trial188.stdout:1143: copy_from oid 14 from oid 1 current snap is 112 2026-02-13T20:16:24.910 INFO:tasks.rados.rados.0.trial188.stdout:1136: finishing write tid 2 to trial18843701-43 2026-02-13T20:16:24.910 INFO:tasks.rados.rados.0.trial188.stdout:1135: finishing copy_from to trial18843701-40 2026-02-13T20:16:24.910 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 40 v 334 (ObjNum 403 snap 106 seq_num 403) dirty exists 2026-02-13T20:16:24.910 INFO:tasks.rados.rados.0.trial188.stdout:1136: finishing write tid 3 to trial18843701-43 2026-02-13T20:16:24.910 INFO:tasks.rados.rados.0.trial188.stdout:1136: finishing write tid 4 to trial18843701-43 2026-02-13T20:16:24.910 INFO:tasks.rados.rados.0.trial188.stdout:1136: finishing write tid 5 to trial18843701-43 2026-02-13T20:16:24.910 INFO:tasks.rados.rados.0.trial188.stdout:1136: oid 43 updating version 0 to 320 2026-02-13T20:16:24.910 INFO:tasks.rados.rados.0.trial188.stdout:1136: oid 43 version 320 is already newer than 319 2026-02-13T20:16:24.910 INFO:tasks.rados.rados.0.trial188.stdout:1136: oid 43 version 320 is already newer than 317 2026-02-13T20:16:24.910 INFO:tasks.rados.rados.0.trial188.stdout:1136: oid 43 version 320 is already newer than 318 2026-02-13T20:16:24.910 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 43 v 320 (ObjNum 430 snap 112 seq_num 430) dirty exists 2026-02-13T20:16:24.910 INFO:tasks.rados.rados.0.trial188.stdout:1136: left oid 43 (ObjNum 430 snap 112 seq_num 430) 2026-02-13T20:16:24.910 INFO:tasks.rados.rados.0.trial188.stdout:1138: finishing copy_from racing read to trial18843701-50 2026-02-13T20:16:24.910 INFO:tasks.rados.rados.0.trial188.stdout:1138: finishing copy_from to trial18843701-50 2026-02-13T20:16:24.910 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 50 v 444 (ObjNum 417 snap 111 seq_num 417) dirty exists 2026-02-13T20:16:24.910 INFO:tasks.rados.rados.0.trial188.stdout:1139: finishing write tid 1 to trial18843701-13 2026-02-13T20:16:24.911 INFO:tasks.rados.rados.0.trial188.stdout:1139: finishing write tid 2 to trial18843701-13 2026-02-13T20:16:24.911 INFO:tasks.rados.rados.0.trial188.stdout:1139: finishing write tid 3 to trial18843701-13 2026-02-13T20:16:24.911 INFO:tasks.rados.rados.0.trial188.stdout:1139: finishing write tid 4 to trial18843701-13 2026-02-13T20:16:24.911 INFO:tasks.rados.rados.0.trial188.stdout:1139: finishing write tid 5 to trial18843701-13 2026-02-13T20:16:24.911 INFO:tasks.rados.rados.0.trial188.stdout:1139: oid 13 updating version 0 to 462 2026-02-13T20:16:24.911 INFO:tasks.rados.rados.0.trial188.stdout:1139: oid 13 version 462 is already newer than 461 2026-02-13T20:16:24.911 INFO:tasks.rados.rados.0.trial188.stdout:1139: oid 13 updating version 462 to 463 2026-02-13T20:16:24.911 INFO:tasks.rados.rados.0.trial188.stdout:1139: oid 13 updating version 463 to 464 2026-02-13T20:16:24.911 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 13 v 464 (ObjNum 431 snap 112 seq_num 431) dirty exists 2026-02-13T20:16:24.911 INFO:tasks.rados.rados.0.trial188.stdout:1139: left oid 13 (ObjNum 431 snap 112 seq_num 431) 2026-02-13T20:16:24.911 INFO:tasks.rados.rados.0.trial188.stdout:1141: finishing write tid 1 to trial18843701-36 2026-02-13T20:16:24.911 INFO:tasks.rados.rados.0.trial188.stdout:1141: finishing write tid 2 to trial18843701-36 2026-02-13T20:16:24.911 INFO:tasks.rados.rados.0.trial188.stdout:1141: finishing write tid 3 to trial18843701-36 2026-02-13T20:16:24.911 INFO:tasks.rados.rados.0.trial188.stdout:1141: finishing write tid 4 to trial18843701-36 2026-02-13T20:16:24.911 INFO:tasks.rados.rados.0.trial188.stdout:1141: finishing write tid 5 to trial18843701-36 2026-02-13T20:16:24.911 INFO:tasks.rados.rados.0.trial188.stdout:1141: oid 36 updating version 0 to 517 2026-02-13T20:16:24.911 INFO:tasks.rados.rados.0.trial188.stdout:1141: oid 36 version 517 is already newer than 515 2026-02-13T20:16:24.911 INFO:tasks.rados.rados.0.trial188.stdout:1141: oid 36 version 517 is already newer than 516 2026-02-13T20:16:24.911 INFO:tasks.rados.rados.0.trial188.stdout:1141: oid 36 version 517 is already newer than 514 2026-02-13T20:16:24.911 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 36 v 517 (ObjNum 432 snap 112 seq_num 432) dirty exists 2026-02-13T20:16:24.911 INFO:tasks.rados.rados.0.trial188.stdout:1141: left oid 36 (ObjNum 432 snap 112 seq_num 432) 2026-02-13T20:16:24.911 INFO:tasks.rados.rados.0.trial188.stdout:1135: done (6 left) 2026-02-13T20:16:24.911 INFO:tasks.rados.rados.0.trial188.stdout:1136: done (5 left) 2026-02-13T20:16:24.911 INFO:tasks.rados.rados.0.trial188.stdout:1138: done (4 left) 2026-02-13T20:16:24.911 INFO:tasks.rados.rados.0.trial188.stdout:1139: done (3 left) 2026-02-13T20:16:24.911 INFO:tasks.rados.rados.0.trial188.stdout:1140: done (2 left) 2026-02-13T20:16:24.911 INFO:tasks.rados.rados.0.trial188.stdout:1141: done (1 left) 2026-02-13T20:16:24.911 INFO:tasks.rados.rados.0.trial188.stdout:1144: delete oid 11 current snap is 112 2026-02-13T20:16:24.913 INFO:tasks.rados.rados.0.trial188.stdout:1144: done (1 left) 2026-02-13T20:16:24.913 INFO:tasks.rados.rados.0.trial188.stdout:1145: copy_from oid 21 from oid 30 current snap is 112 2026-02-13T20:16:24.913 INFO:tasks.rados.rados.0.trial188.stdout:1146: read oid 46 snap -1 2026-02-13T20:16:24.913 INFO:tasks.rados.rados.0.trial188.stdout:1146: expect (ObjNum 375 snap 96 seq_num 375) 2026-02-13T20:16:24.913 INFO:tasks.rados.rados.0.trial188.stdout:1147: copy_from oid 49 from oid 9 current snap is 112 2026-02-13T20:16:24.913 INFO:tasks.rados.rados.0.trial188.stdout:1148: write oid 20 current snap is 112 2026-02-13T20:16:24.913 INFO:tasks.rados.rados.0.trial188.stdout:1148: seq_num 434 ranges {494238=490187,1563538=701819,2818520=475718} 2026-02-13T20:16:24.917 INFO:tasks.rados.rados.0.trial188.stdout:1148: writing trial18843701-20 from 494238 to 984425 tid 1 2026-02-13T20:16:24.922 INFO:tasks.rados.rados.0.trial188.stdout:1148: writing trial18843701-20 from 1563538 to 2265357 tid 2 2026-02-13T20:16:24.926 INFO:tasks.rados.rados.0.trial188.stdout:1148: writing trial18843701-20 from 2818520 to 3294238 tid 3 2026-02-13T20:16:24.926 INFO:tasks.rados.rados.0.trial188.stdout:1149: rollback oid 22 current snap is 112 2026-02-13T20:16:24.926 INFO:tasks.rados.rados.0.trial188.stdout:1149: done (5 left) 2026-02-13T20:16:24.926 INFO:tasks.rados.rados.0.trial188.stdout:1150: read oid 12 snap -1 2026-02-13T20:16:24.926 INFO:tasks.rados.rados.0.trial188.stdout:1150: expect deleted 2026-02-13T20:16:24.926 INFO:tasks.rados.rados.0.trial188.stdout:1151: read oid 17 snap -1 2026-02-13T20:16:24.926 INFO:tasks.rados.rados.0.trial188.stdout:1151: expect (ObjNum 376 snap 96 seq_num 376) 2026-02-13T20:16:24.926 INFO:tasks.rados.rados.0.trial188.stdout:1152: copy_from oid 24 from oid 28 current snap is 112 2026-02-13T20:16:24.926 INFO:tasks.rados.rados.0.trial188.stdout:1146: expect (ObjNum 375 snap 96 seq_num 375) 2026-02-13T20:16:24.926 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:16:24.975 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1026402 2026-02-13T20:16:24.991 INFO:tasks.rados.rados.0.trial188.stdout:1147: finishing copy_from to trial18843701-49 2026-02-13T20:16:24.991 INFO:tasks.rados.rados.0.trial188.stdout:1147: got expected ENOENT (src dne) 2026-02-13T20:16:24.991 INFO:tasks.rados.rados.0.trial188.stdout:1147: finishing copy_from racing read to trial18843701-49 2026-02-13T20:16:24.991 INFO:tasks.rados.rados.0.trial188.stdout:1146: done (7 left) 2026-02-13T20:16:24.991 INFO:tasks.rados.rados.0.trial188.stdout:1147: done (6 left) 2026-02-13T20:16:24.991 INFO:tasks.rados.rados.0.trial188.stdout:1153: write (excl) oid 43 current snap is 112 2026-02-13T20:16:24.991 INFO:tasks.rados.rados.0.trial188.stdout:1145: finishing copy_from racing read to trial18843701-21 2026-02-13T20:16:24.991 INFO:tasks.rados.rados.0.trial188.stdout:1148: finishing write tid 1 to trial18843701-20 2026-02-13T20:16:24.991 INFO:tasks.rados.rados.0.trial188.stdout:1151: expect (ObjNum 376 snap 96 seq_num 376) 2026-02-13T20:16:25.025 INFO:tasks.rados.rados.0.trial188.stdout:1148: finishing write tid 2 to trial18843701-20 2026-02-13T20:16:25.025 INFO:tasks.rados.rados.0.trial188.stdout:1148: finishing write tid 3 to trial18843701-20 2026-02-13T20:16:25.025 INFO:tasks.rados.rados.0.trial188.stdout:1148: finishing write tid 4 to trial18843701-20 2026-02-13T20:16:25.025 INFO:tasks.rados.rados.0.trial188.stdout:1153: seq_num 435 ranges {511045=565436,1622020=445477,2729590=556855} 2026-02-13T20:16:25.029 INFO:tasks.rados.rados.0.trial188.stdout:1153: writing trial18843701-43 from 511045 to 1076481 tid 1 2026-02-13T20:16:25.033 INFO:tasks.rados.rados.0.trial188.stdout:1153: writing trial18843701-43 from 1622020 to 2067497 tid 2 2026-02-13T20:16:25.038 INFO:tasks.rados.rados.0.trial188.stdout:1153: writing trial18843701-43 from 2729590 to 3286445 tid 3 2026-02-13T20:16:25.039 INFO:tasks.rados.rados.0.trial188.stdout:1150: done (6 left) 2026-02-13T20:16:25.039 INFO:tasks.rados.rados.0.trial188.stdout:1151: done (5 left) 2026-02-13T20:16:25.039 INFO:tasks.rados.rados.0.trial188.stdout:1154: copy_from oid 35 from oid 38 current snap is 112 2026-02-13T20:16:25.039 INFO:tasks.rados.rados.0.trial188.stdout:1148: finishing write tid 5 to trial18843701-20 2026-02-13T20:16:25.039 INFO:tasks.rados.rados.0.trial188.stdout:1148: oid 20 updating version 0 to 326 2026-02-13T20:16:25.039 INFO:tasks.rados.rados.0.trial188.stdout:1148: oid 20 version 326 is already newer than 323 2026-02-13T20:16:25.039 INFO:tasks.rados.rados.0.trial188.stdout:1148: oid 20 version 326 is already newer than 324 2026-02-13T20:16:25.039 INFO:tasks.rados.rados.0.trial188.stdout:1148: oid 20 version 326 is already newer than 325 2026-02-13T20:16:25.039 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 20 v 326 (ObjNum 434 snap 112 seq_num 434) dirty exists 2026-02-13T20:16:25.039 INFO:tasks.rados.rados.0.trial188.stdout:1148: left oid 20 (ObjNum 434 snap 112 seq_num 434) 2026-02-13T20:16:25.039 INFO:tasks.rados.rados.0.trial188.stdout:1143: finishing copy_from racing read to trial18843701-14 2026-02-13T20:16:25.039 INFO:tasks.rados.rados.0.trial188.stdout:1145: finishing copy_from to trial18843701-21 2026-02-13T20:16:25.040 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 21 v 189 (ObjNum 383 snap 98 seq_num 383) dirty exists 2026-02-13T20:16:25.040 INFO:tasks.rados.rados.0.trial188.stdout:1143: finishing copy_from to trial18843701-14 2026-02-13T20:16:25.040 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 14 v 383 (ObjNum 317 snap 86 seq_num 317) dirty exists 2026-02-13T20:16:25.040 INFO:tasks.rados.rados.0.trial188.stdout:1152: finishing copy_from racing read to trial18843701-24 2026-02-13T20:16:25.040 INFO:tasks.rados.rados.0.trial188.stdout:1152: finishing copy_from to trial18843701-24 2026-02-13T20:16:25.040 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 24 v 444 (ObjNum 415 snap 111 seq_num 415) dirty exists 2026-02-13T20:16:25.040 INFO:tasks.rados.rados.0.trial188.stdout:1143: done (5 left) 2026-02-13T20:16:25.040 INFO:tasks.rados.rados.0.trial188.stdout:1145: done (4 left) 2026-02-13T20:16:25.040 INFO:tasks.rados.rados.0.trial188.stdout:1148: done (3 left) 2026-02-13T20:16:25.040 INFO:tasks.rados.rados.0.trial188.stdout:1152: done (2 left) 2026-02-13T20:16:25.040 INFO:tasks.rados.rados.0.trial188.stdout:1155: write oid 15 current snap is 112 2026-02-13T20:16:25.040 INFO:tasks.rados.rados.0.trial188.stdout:1155: seq_num 436 ranges {527852=640685,1680502=589135,2757013=570839} 2026-02-13T20:16:25.042 INFO:tasks.rados.rados.0.trial188.stdout:1155: writing trial18843701-15 from 527852 to 1168537 tid 1 2026-02-13T20:16:25.046 INFO:tasks.rados.rados.0.trial188.stdout:1155: writing trial18843701-15 from 1680502 to 2269637 tid 2 2026-02-13T20:16:25.050 INFO:tasks.rados.rados.0.trial188.stdout:1155: writing trial18843701-15 from 2757013 to 3327852 tid 3 2026-02-13T20:16:25.051 INFO:tasks.rados.rados.0.trial188.stdout:1156: snap_create 2026-02-13T20:16:25.053 INFO:tasks.rados.rados.0.trial188.stdout:1153: finishing write tid 1 to trial18843701-43 2026-02-13T20:16:25.055 INFO:tasks.rados.rados.0.trial188.stdout:1153: finishing write tid 2 to trial18843701-43 2026-02-13T20:16:25.056 INFO:tasks.rados.rados.0.trial188.stdout:1153: finishing write tid 3 to trial18843701-43 2026-02-13T20:16:25.056 INFO:tasks.rados.rados.0.trial188.stdout:1153: finishing write tid 4 to trial18843701-43 2026-02-13T20:16:25.057 INFO:tasks.rados.rados.0.trial188.stdout:1153: finishing write tid 5 to trial18843701-43 2026-02-13T20:16:25.057 INFO:tasks.rados.rados.0.trial188.stdout:1153: oid 43 updating version 0 to 324 2026-02-13T20:16:25.057 INFO:tasks.rados.rados.0.trial188.stdout:1153: oid 43 version 324 is already newer than 322 2026-02-13T20:16:25.057 INFO:tasks.rados.rados.0.trial188.stdout:1153: oid 43 version 324 is already newer than 321 2026-02-13T20:16:25.057 INFO:tasks.rados.rados.0.trial188.stdout:1153: oid 43 version 324 is already newer than 323 2026-02-13T20:16:25.057 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 43 v 324 (ObjNum 435 snap 112 seq_num 435) dirty exists 2026-02-13T20:16:25.057 INFO:tasks.rados.rados.0.trial188.stdout:1153: left oid 43 (ObjNum 435 snap 112 seq_num 435) 2026-02-13T20:16:25.061 INFO:tasks.rados.rados.0.trial188.stdout:1154: finishing copy_from racing read to trial18843701-35 2026-02-13T20:16:25.070 INFO:tasks.rados.rados.0.trial188.stdout:1155: finishing write tid 1 to trial18843701-15 2026-02-13T20:16:25.071 INFO:tasks.rados.rados.0.trial188.stdout:1154: finishing copy_from to trial18843701-35 2026-02-13T20:16:25.071 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 35 v 185 (ObjNum 366 snap 95 seq_num 366) dirty exists 2026-02-13T20:16:25.071 INFO:tasks.rados.rados.0.trial188.stdout:1155: finishing write tid 2 to trial18843701-15 2026-02-13T20:16:25.072 INFO:tasks.rados.rados.0.trial188.stdout:1155: finishing write tid 3 to trial18843701-15 2026-02-13T20:16:25.072 INFO:tasks.rados.rados.0.trial188.stdout:1155: finishing write tid 4 to trial18843701-15 2026-02-13T20:16:25.072 INFO:tasks.rados.rados.0.trial188.stdout:1155: finishing write tid 5 to trial18843701-15 2026-02-13T20:16:25.072 INFO:tasks.rados.rados.0.trial188.stdout:1155: oid 15 updating version 0 to 386 2026-02-13T20:16:25.072 INFO:tasks.rados.rados.0.trial188.stdout:1155: oid 15 version 386 is already newer than 384 2026-02-13T20:16:25.072 INFO:tasks.rados.rados.0.trial188.stdout:1155: oid 15 version 386 is already newer than 385 2026-02-13T20:16:25.072 INFO:tasks.rados.rados.0.trial188.stdout:1155: oid 15 updating version 386 to 387 2026-02-13T20:16:25.072 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 15 v 387 (ObjNum 436 snap 112 seq_num 436) dirty exists 2026-02-13T20:16:25.073 INFO:tasks.rados.rados.0.trial188.stdout:1155: left oid 15 (ObjNum 436 snap 112 seq_num 436) 2026-02-13T20:16:25.914 INFO:tasks.rados.rados.0.trial188.stdout:1153: done (3 left) 2026-02-13T20:16:25.914 INFO:tasks.rados.rados.0.trial188.stdout:1154: done (2 left) 2026-02-13T20:16:25.914 INFO:tasks.rados.rados.0.trial188.stdout:1155: done (1 left) 2026-02-13T20:16:25.914 INFO:tasks.rados.rados.0.trial188.stdout:1156: done (0 left) 2026-02-13T20:16:25.915 INFO:tasks.rados.rados.0.trial188.stdout:1157: read oid 34 snap 112 2026-02-13T20:16:25.915 INFO:tasks.rados.rados.0.trial188.stdout:1157: expect (ObjNum 423 snap 111 seq_num 423) 2026-02-13T20:16:25.915 INFO:tasks.rados.rados.0.trial188.stdout:1158: write (excl) oid 31 current snap is 113 2026-02-13T20:16:25.915 INFO:tasks.rados.rados.0.trial188.stdout:1158: seq_num 437 ranges {544659=715934,1738984=449146,2784436=560223} 2026-02-13T20:16:25.918 INFO:tasks.rados.rados.0.trial188.stdout:1158: writing trial18843701-31 from 544659 to 1260593 tid 1 2026-02-13T20:16:25.922 INFO:tasks.rados.rados.0.trial188.stdout:1158: writing trial18843701-31 from 1738984 to 2188130 tid 2 2026-02-13T20:16:25.926 INFO:tasks.rados.rados.0.trial188.stdout:1158: writing trial18843701-31 from 2784436 to 3344659 tid 3 2026-02-13T20:16:25.926 INFO:tasks.rados.rados.0.trial188.stdout:1159: read oid 33 snap -1 2026-02-13T20:16:25.926 INFO:tasks.rados.rados.0.trial188.stdout:1159: expect (ObjNum 408 snap 109 seq_num 408) 2026-02-13T20:16:25.926 INFO:tasks.rados.rados.0.trial188.stdout:1160: write (excl) oid 32 current snap is 113 2026-02-13T20:16:25.926 INFO:tasks.rados.rados.0.trial188.stdout:1160: seq_num 438 ranges {561466=791183,2081113=592804,3095506=265960} 2026-02-13T20:16:25.931 INFO:tasks.rados.rados.0.trial188.stdout:1160: writing trial18843701-32 from 561466 to 1352649 tid 1 2026-02-13T20:16:25.936 INFO:tasks.rados.rados.0.trial188.stdout:1160: writing trial18843701-32 from 2081113 to 2673917 tid 2 2026-02-13T20:16:25.939 INFO:tasks.rados.rados.0.trial188.stdout:1160: writing trial18843701-32 from 3095506 to 3361466 tid 3 2026-02-13T20:16:25.939 INFO:tasks.rados.rados.0.trial188.stdout:1161: read oid 13 snap -1 2026-02-13T20:16:25.939 INFO:tasks.rados.rados.0.trial188.stdout:1161: expect (ObjNum 431 snap 112 seq_num 431) 2026-02-13T20:16:25.939 INFO:tasks.rados.rados.0.trial188.stdout:1162: write (excl) oid 25 current snap is 113 2026-02-13T20:16:25.939 INFO:tasks.rados.rados.0.trial188.stdout:1162: seq_num 439 ranges {578273=466432,1739595=452815,2722929=655344} 2026-02-13T20:16:25.942 INFO:tasks.rados.rados.0.trial188.stdout:1162: writing trial18843701-25 from 578273 to 1044705 tid 1 2026-02-13T20:16:25.947 INFO:tasks.rados.rados.0.trial188.stdout:1162: writing trial18843701-25 from 1739595 to 2192410 tid 2 2026-02-13T20:16:25.952 INFO:tasks.rados.rados.0.trial188.stdout:1162: writing trial18843701-25 from 2722929 to 3378273 tid 3 2026-02-13T20:16:25.952 INFO:tasks.rados.rados.0.trial188.stdout:1163: snap_create 2026-02-13T20:16:25.953 INFO:tasks.rados.rados.0.trial188.stdout:1157: expect (ObjNum 423 snap 111 seq_num 423) 2026-02-13T20:16:25.953 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:16:26.095 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2952370 2026-02-13T20:16:26.100 INFO:tasks.rados.rados.0.trial188.stdout:1159: expect (ObjNum 408 snap 109 seq_num 408) 2026-02-13T20:16:26.100 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:16:26.127 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:16:26.182 INFO:tasks.rados.rados.0.trial188.stdout:1161: expect (ObjNum 431 snap 112 seq_num 431) 2026-02-13T20:16:26.206 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:16:26.255 INFO:tasks.rados.rados.0.trial188.stdout:1158: finishing write tid 1 to trial18843701-31 2026-02-13T20:16:26.255 INFO:tasks.rados.rados.0.trial188.stdout:1158: finishing write tid 2 to trial18843701-31 2026-02-13T20:16:26.255 INFO:tasks.rados.rados.0.trial188.stdout:1158: finishing write tid 3 to trial18843701-31 2026-02-13T20:16:26.255 INFO:tasks.rados.rados.0.trial188.stdout:1158: finishing write tid 4 to trial18843701-31 2026-02-13T20:16:26.255 INFO:tasks.rados.rados.0.trial188.stdout:1158: finishing write tid 5 to trial18843701-31 2026-02-13T20:16:26.255 INFO:tasks.rados.rados.0.trial188.stdout:1158: oid 31 updating version 0 to 336 2026-02-13T20:16:26.255 INFO:tasks.rados.rados.0.trial188.stdout:1158: oid 31 updating version 336 to 337 2026-02-13T20:16:26.255 INFO:tasks.rados.rados.0.trial188.stdout:1158: oid 31 version 337 is already newer than 335 2026-02-13T20:16:26.255 INFO:tasks.rados.rados.0.trial188.stdout:1158: oid 31 version 337 is already newer than 334 2026-02-13T20:16:26.255 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 31 v 337 (ObjNum 437 snap 113 seq_num 437) dirty exists 2026-02-13T20:16:26.255 INFO:tasks.rados.rados.0.trial188.stdout:1158: left oid 31 (ObjNum 437 snap 113 seq_num 437) 2026-02-13T20:16:26.255 INFO:tasks.rados.rados.0.trial188.stdout:1160: finishing write tid 1 to trial18843701-32 2026-02-13T20:16:26.255 INFO:tasks.rados.rados.0.trial188.stdout:1160: finishing write tid 2 to trial18843701-32 2026-02-13T20:16:26.255 INFO:tasks.rados.rados.0.trial188.stdout:1160: finishing write tid 3 to trial18843701-32 2026-02-13T20:16:26.255 INFO:tasks.rados.rados.0.trial188.stdout:1160: finishing write tid 4 to trial18843701-32 2026-02-13T20:16:26.255 INFO:tasks.rados.rados.0.trial188.stdout:1160: finishing write tid 5 to trial18843701-32 2026-02-13T20:16:26.255 INFO:tasks.rados.rados.0.trial188.stdout:1160: oid 32 updating version 0 to 400 2026-02-13T20:16:26.255 INFO:tasks.rados.rados.0.trial188.stdout:1160: oid 32 version 400 is already newer than 399 2026-02-13T20:16:26.255 INFO:tasks.rados.rados.0.trial188.stdout:1160: oid 32 updating version 400 to 402 2026-02-13T20:16:26.255 INFO:tasks.rados.rados.0.trial188.stdout:1160: oid 32 version 402 is already newer than 401 2026-02-13T20:16:26.255 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 32 v 402 (ObjNum 438 snap 113 seq_num 438) dirty exists 2026-02-13T20:16:26.255 INFO:tasks.rados.rados.0.trial188.stdout:1160: left oid 32 (ObjNum 438 snap 113 seq_num 438) 2026-02-13T20:16:26.255 INFO:tasks.rados.rados.0.trial188.stdout:1162: finishing write tid 1 to trial18843701-25 2026-02-13T20:16:26.255 INFO:tasks.rados.rados.0.trial188.stdout:1162: finishing write tid 2 to trial18843701-25 2026-02-13T20:16:26.255 INFO:tasks.rados.rados.0.trial188.stdout:1162: finishing write tid 3 to trial18843701-25 2026-02-13T20:16:26.255 INFO:tasks.rados.rados.0.trial188.stdout:1162: finishing write tid 4 to trial18843701-25 2026-02-13T20:16:26.255 INFO:tasks.rados.rados.0.trial188.stdout:1162: finishing write tid 5 to trial18843701-25 2026-02-13T20:16:26.255 INFO:tasks.rados.rados.0.trial188.stdout:1162: oid 25 updating version 0 to 504 2026-02-13T20:16:26.255 INFO:tasks.rados.rados.0.trial188.stdout:1162: oid 25 version 504 is already newer than 501 2026-02-13T20:16:26.255 INFO:tasks.rados.rados.0.trial188.stdout:1162: oid 25 version 504 is already newer than 502 2026-02-13T20:16:26.255 INFO:tasks.rados.rados.0.trial188.stdout:1162: oid 25 version 504 is already newer than 503 2026-02-13T20:16:26.255 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 25 v 504 (ObjNum 439 snap 113 seq_num 439) dirty exists 2026-02-13T20:16:26.255 INFO:tasks.rados.rados.0.trial188.stdout:1162: left oid 25 (ObjNum 439 snap 113 seq_num 439) 2026-02-13T20:16:26.918 INFO:tasks.rados.rados.0.trial188.stdout:1157: done (6 left) 2026-02-13T20:16:26.919 INFO:tasks.rados.rados.0.trial188.stdout:1158: done (5 left) 2026-02-13T20:16:26.919 INFO:tasks.rados.rados.0.trial188.stdout:1159: done (4 left) 2026-02-13T20:16:26.919 INFO:tasks.rados.rados.0.trial188.stdout:1160: done (3 left) 2026-02-13T20:16:26.919 INFO:tasks.rados.rados.0.trial188.stdout:1161: done (2 left) 2026-02-13T20:16:26.919 INFO:tasks.rados.rados.0.trial188.stdout:1162: done (1 left) 2026-02-13T20:16:26.919 INFO:tasks.rados.rados.0.trial188.stdout:1163: done (0 left) 2026-02-13T20:16:26.919 INFO:tasks.rados.rados.0.trial188.stdout:1164: copy_from oid 37 from oid 2 current snap is 114 2026-02-13T20:16:26.919 INFO:tasks.rados.rados.0.trial188.stdout:1165: write oid 50 current snap is 114 2026-02-13T20:16:26.920 INFO:tasks.rados.rados.0.trial188.stdout:1165: seq_num 440 ranges {595080=541681,1798077=596473,3150352=244728} 2026-02-13T20:16:26.922 INFO:tasks.rados.rados.0.trial188.stdout:1165: writing trial18843701-50 from 595080 to 1136761 tid 1 2026-02-13T20:16:26.927 INFO:tasks.rados.rados.0.trial188.stdout:1165: writing trial18843701-50 from 1798077 to 2394550 tid 2 2026-02-13T20:16:26.931 INFO:tasks.rados.rados.0.trial188.stdout:1165: writing trial18843701-50 from 3150352 to 3395080 tid 3 2026-02-13T20:16:26.931 INFO:tasks.rados.rados.0.trial188.stdout:1166: read oid 31 snap -1 2026-02-13T20:16:26.931 INFO:tasks.rados.rados.0.trial188.stdout:1166: expect (ObjNum 437 snap 113 seq_num 437) 2026-02-13T20:16:26.932 INFO:tasks.rados.rados.0.trial188.stdout:1167: copy_from oid 46 from oid 40 current snap is 114 2026-02-13T20:16:26.932 INFO:tasks.rados.rados.0.trial188.stdout:1168: rollback oid 43 current snap is 114 2026-02-13T20:16:26.932 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 43 to 112 2026-02-13T20:16:26.932 INFO:tasks.rados.rados.0.trial188.stdout:1169: write (excl) oid 1 current snap is 114 2026-02-13T20:16:26.932 INFO:tasks.rados.rados.0.trial188.stdout:1169: seq_num 441 ranges {611887=733283,1972912=456484,2894128=517759} 2026-02-13T20:16:26.936 INFO:tasks.rados.rados.0.trial188.stdout:1169: writing trial18843701-1 from 611887 to 1345170 tid 1 2026-02-13T20:16:26.940 INFO:tasks.rados.rados.0.trial188.stdout:1169: writing trial18843701-1 from 1972912 to 2429396 tid 2 2026-02-13T20:16:26.944 INFO:tasks.rados.rados.0.trial188.stdout:1169: writing trial18843701-1 from 2894128 to 3411887 tid 3 2026-02-13T20:16:26.944 INFO:tasks.rados.rados.0.trial188.stdout:1170: delete oid 36 current snap is 114 2026-02-13T20:16:26.944 INFO:tasks.rados.rados.0.trial188.stdout:1168: finishing rollback tid 0 to trial18843701-43 2026-02-13T20:16:26.944 INFO:tasks.rados.rados.0.trial188.stdout:1168: finishing rollback tid 1 to trial18843701-43 2026-02-13T20:16:26.944 INFO:tasks.rados.rados.0.trial188.stdout:1168: finishing rollback tid 2 to trial18843701-43 2026-02-13T20:16:26.944 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 43 v 327 (ObjNum 435 snap 112 seq_num 435) dirty exists 2026-02-13T20:16:26.945 INFO:tasks.rados.rados.0.trial188.stdout:1165: finishing write tid 1 to trial18843701-50 2026-02-13T20:16:26.945 INFO:tasks.rados.rados.0.trial188.stdout:1166: expect (ObjNum 437 snap 113 seq_num 437) 2026-02-13T20:16:26.946 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 569921 2026-02-13T20:16:26.988 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:16:27.035 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:16:27.084 INFO:tasks.rados.rados.0.trial188.stdout:1164: finishing copy_from racing read to trial18843701-37 2026-02-13T20:16:27.084 INFO:tasks.rados.rados.0.trial188.stdout:1165: finishing write tid 2 to trial18843701-50 2026-02-13T20:16:27.084 INFO:tasks.rados.rados.0.trial188.stdout:1167: finishing copy_from racing read to trial18843701-46 2026-02-13T20:16:27.084 INFO:tasks.rados.rados.0.trial188.stdout:1166: done (6 left) 2026-02-13T20:16:27.084 INFO:tasks.rados.rados.0.trial188.stdout:1168: done (5 left) 2026-02-13T20:16:27.084 INFO:tasks.rados.rados.0.trial188.stdout:1170: done (4 left) 2026-02-13T20:16:27.085 INFO:tasks.rados.rados.0.trial188.stdout:1171: rollback oid 3 current snap is 114 2026-02-13T20:16:27.085 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 3 to 112 2026-02-13T20:16:27.085 INFO:tasks.rados.rados.0.trial188.stdout:1164: finishing copy_from to trial18843701-37 2026-02-13T20:16:27.085 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 37 v 455 (ObjNum 427 snap 111 seq_num 427) dirty exists 2026-02-13T20:16:27.085 INFO:tasks.rados.rados.0.trial188.stdout:1165: finishing write tid 3 to trial18843701-50 2026-02-13T20:16:27.085 INFO:tasks.rados.rados.0.trial188.stdout:1165: finishing write tid 4 to trial18843701-50 2026-02-13T20:16:27.085 INFO:tasks.rados.rados.0.trial188.stdout:1165: finishing write tid 5 to trial18843701-50 2026-02-13T20:16:27.085 INFO:tasks.rados.rados.0.trial188.stdout:1165: oid 50 updating version 0 to 524 2026-02-13T20:16:27.085 INFO:tasks.rados.rados.0.trial188.stdout:1165: oid 50 version 524 is already newer than 523 2026-02-13T20:16:27.085 INFO:tasks.rados.rados.0.trial188.stdout:1165: oid 50 version 524 is already newer than 522 2026-02-13T20:16:27.085 INFO:tasks.rados.rados.0.trial188.stdout:1165: oid 50 updating version 524 to 525 2026-02-13T20:16:27.085 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 50 v 525 (ObjNum 440 snap 114 seq_num 440) dirty exists 2026-02-13T20:16:27.086 INFO:tasks.rados.rados.0.trial188.stdout:1165: left oid 50 (ObjNum 440 snap 114 seq_num 440) 2026-02-13T20:16:27.086 INFO:tasks.rados.rados.0.trial188.stdout:1169: finishing write tid 1 to trial18843701-1 2026-02-13T20:16:27.086 INFO:tasks.rados.rados.0.trial188.stdout:1169: finishing write tid 2 to trial18843701-1 2026-02-13T20:16:27.086 INFO:tasks.rados.rados.0.trial188.stdout:1169: finishing write tid 3 to trial18843701-1 2026-02-13T20:16:27.086 INFO:tasks.rados.rados.0.trial188.stdout:1169: finishing write tid 4 to trial18843701-1 2026-02-13T20:16:27.086 INFO:tasks.rados.rados.0.trial188.stdout:1169: finishing write tid 5 to trial18843701-1 2026-02-13T20:16:27.086 INFO:tasks.rados.rados.0.trial188.stdout:1169: oid 1 updating version 0 to 469 2026-02-13T20:16:27.086 INFO:tasks.rados.rados.0.trial188.stdout:1169: oid 1 updating version 469 to 470 2026-02-13T20:16:27.086 INFO:tasks.rados.rados.0.trial188.stdout:1169: oid 1 version 470 is already newer than 468 2026-02-13T20:16:27.086 INFO:tasks.rados.rados.0.trial188.stdout:1169: oid 1 updating version 470 to 471 2026-02-13T20:16:27.086 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 1 v 471 (ObjNum 441 snap 114 seq_num 441) dirty exists 2026-02-13T20:16:27.086 INFO:tasks.rados.rados.0.trial188.stdout:1169: left oid 1 (ObjNum 441 snap 114 seq_num 441) 2026-02-13T20:16:27.087 INFO:tasks.rados.rados.0.trial188.stdout:1167: finishing copy_from to trial18843701-46 2026-02-13T20:16:27.087 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 46 v 334 (ObjNum 403 snap 106 seq_num 403) dirty exists 2026-02-13T20:16:27.087 INFO:tasks.rados.rados.0.trial188.stdout:1164: done (4 left) 2026-02-13T20:16:27.087 INFO:tasks.rados.rados.0.trial188.stdout:1165: done (3 left) 2026-02-13T20:16:27.087 INFO:tasks.rados.rados.0.trial188.stdout:1167: done (2 left) 2026-02-13T20:16:27.087 INFO:tasks.rados.rados.0.trial188.stdout:1169: done (1 left) 2026-02-13T20:16:27.087 INFO:tasks.rados.rados.0.trial188.stdout:1172: copy_from oid 26 from oid 28 current snap is 114 2026-02-13T20:16:27.087 INFO:tasks.rados.rados.0.trial188.stdout:1173: read oid 9 snap -1 2026-02-13T20:16:27.087 INFO:tasks.rados.rados.0.trial188.stdout:1173: expect deleted 2026-02-13T20:16:27.087 INFO:tasks.rados.rados.0.trial188.stdout:1174: copy_from oid 4 from oid 20 current snap is 114 2026-02-13T20:16:27.087 INFO:tasks.rados.rados.0.trial188.stdout:1175: write oid 38 current snap is 114 2026-02-13T20:16:27.087 INFO:tasks.rados.rados.0.trial188.stdout:1175: seq_num 443 ranges {645501=483781,1573523=460153,2548974=763384} 2026-02-13T20:16:27.088 INFO:tasks.rados.rados.0.trial188.stdout:1175: writing trial18843701-38 from 645501 to 1129282 tid 1 2026-02-13T20:16:27.090 INFO:tasks.rados.rados.0.trial188.stdout:1175: writing trial18843701-38 from 1573523 to 2033676 tid 2 2026-02-13T20:16:27.095 INFO:tasks.rados.rados.0.trial188.stdout:1175: writing trial18843701-38 from 2548974 to 3312358 tid 3 2026-02-13T20:16:27.095 INFO:tasks.rados.rados.0.trial188.stdout:1176: copy_from oid 17 from oid 39 current snap is 114 2026-02-13T20:16:27.095 INFO:tasks.rados.rados.0.trial188.stdout:1171: finishing rollback tid 1 to trial18843701-3 2026-02-13T20:16:27.095 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 3 v 0 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-13T20:16:27.095 INFO:tasks.rados.rados.0.trial188.stdout:1171: done (5 left) 2026-02-13T20:16:27.095 INFO:tasks.rados.rados.0.trial188.stdout:1173: done (4 left) 2026-02-13T20:16:27.095 INFO:tasks.rados.rados.0.trial188.stdout:1177: write (excl) oid 24 current snap is 114 2026-02-13T20:16:27.095 INFO:tasks.rados.rados.0.trial188.stdout:1177: seq_num 444 ranges {662308=559030,1632005=603811,2860044=602264} 2026-02-13T20:16:27.100 INFO:tasks.rados.rados.0.trial188.stdout:1177: writing trial18843701-24 from 662308 to 1221338 tid 1 2026-02-13T20:16:27.104 INFO:tasks.rados.rados.0.trial188.stdout:1177: writing trial18843701-24 from 1632005 to 2235816 tid 2 2026-02-13T20:16:27.109 INFO:tasks.rados.rados.0.trial188.stdout:1177: writing trial18843701-24 from 2860044 to 3462308 tid 3 2026-02-13T20:16:27.109 INFO:tasks.rados.rados.0.trial188.stdout:1178: rollback oid 16 current snap is 114 2026-02-13T20:16:27.109 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 16 to 113 2026-02-13T20:16:27.109 INFO:tasks.rados.rados.0.trial188.stdout:1179: snap_remove snap 112 2026-02-13T20:16:27.889 INFO:tasks.rados.rados.0.trial188.stdout:1179: done (6 left) 2026-02-13T20:16:27.890 INFO:tasks.rados.rados.0.trial188.stdout:1180: read oid 34 snap -1 2026-02-13T20:16:27.890 INFO:tasks.rados.rados.0.trial188.stdout:1180: expect (ObjNum 423 snap 111 seq_num 423) 2026-02-13T20:16:27.890 INFO:tasks.rados.rados.0.trial188.stdout:1181: delete oid 13 current snap is 114 2026-02-13T20:16:27.890 INFO:tasks.rados.rados.0.trial188.stdout:1174: finishing copy_from racing read to trial18843701-4 2026-02-13T20:16:27.890 INFO:tasks.rados.rados.0.trial188.stdout:1175: finishing write tid 1 to trial18843701-38 2026-02-13T20:16:27.890 INFO:tasks.rados.rados.0.trial188.stdout:1175: finishing write tid 2 to trial18843701-38 2026-02-13T20:16:27.890 INFO:tasks.rados.rados.0.trial188.stdout:1175: finishing write tid 3 to trial18843701-38 2026-02-13T20:16:27.890 INFO:tasks.rados.rados.0.trial188.stdout:1175: finishing write tid 4 to trial18843701-38 2026-02-13T20:16:27.890 INFO:tasks.rados.rados.0.trial188.stdout:1175: finishing write tid 5 to trial18843701-38 2026-02-13T20:16:27.890 INFO:tasks.rados.rados.0.trial188.stdout:1175: oid 38 updating version 0 to 506 2026-02-13T20:16:27.891 INFO:tasks.rados.rados.0.trial188.stdout:1175: oid 38 updating version 506 to 508 2026-02-13T20:16:27.891 INFO:tasks.rados.rados.0.trial188.stdout:1175: oid 38 version 508 is already newer than 507 2026-02-13T20:16:27.891 INFO:tasks.rados.rados.0.trial188.stdout:1175: oid 38 updating version 508 to 509 2026-02-13T20:16:27.891 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 38 v 509 (ObjNum 443 snap 114 seq_num 443) dirty exists 2026-02-13T20:16:27.891 INFO:tasks.rados.rados.0.trial188.stdout:1175: left oid 38 (ObjNum 443 snap 114 seq_num 443) 2026-02-13T20:16:27.891 INFO:tasks.rados.rados.0.trial188.stdout:1174: finishing copy_from to trial18843701-4 2026-02-13T20:16:27.891 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 4 v 326 (ObjNum 434 snap 112 seq_num 434) dirty exists 2026-02-13T20:16:27.891 INFO:tasks.rados.rados.0.trial188.stdout:1177: finishing write tid 1 to trial18843701-24 2026-02-13T20:16:27.891 INFO:tasks.rados.rados.0.trial188.stdout:1172: finishing copy_from racing read to trial18843701-26 2026-02-13T20:16:27.892 INFO:tasks.rados.rados.0.trial188.stdout:1177: finishing write tid 2 to trial18843701-24 2026-02-13T20:16:27.892 INFO:tasks.rados.rados.0.trial188.stdout:1172: finishing copy_from to trial18843701-26 2026-02-13T20:16:27.892 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 26 v 444 (ObjNum 415 snap 111 seq_num 415) dirty exists 2026-02-13T20:16:27.892 INFO:tasks.rados.rados.0.trial188.stdout:1177: finishing write tid 3 to trial18843701-24 2026-02-13T20:16:27.892 INFO:tasks.rados.rados.0.trial188.stdout:1177: finishing write tid 4 to trial18843701-24 2026-02-13T20:16:27.892 INFO:tasks.rados.rados.0.trial188.stdout:1177: finishing write tid 5 to trial18843701-24 2026-02-13T20:16:27.892 INFO:tasks.rados.rados.0.trial188.stdout:1177: oid 24 updating version 0 to 531 2026-02-13T20:16:27.892 INFO:tasks.rados.rados.0.trial188.stdout:1177: oid 24 version 531 is already newer than 530 2026-02-13T20:16:27.892 INFO:tasks.rados.rados.0.trial188.stdout:1177: oid 24 version 531 is already newer than 529 2026-02-13T20:16:27.892 INFO:tasks.rados.rados.0.trial188.stdout:1177: oid 24 updating version 531 to 532 2026-02-13T20:16:27.892 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 24 v 532 (ObjNum 444 snap 114 seq_num 444) dirty exists 2026-02-13T20:16:27.892 INFO:tasks.rados.rados.0.trial188.stdout:1177: left oid 24 (ObjNum 444 snap 114 seq_num 444) 2026-02-13T20:16:27.892 INFO:tasks.rados.rados.0.trial188.stdout:1178: finishing rollback tid 0 to trial18843701-16 2026-02-13T20:16:27.893 INFO:tasks.rados.rados.0.trial188.stdout:1178: finishing rollback tid 1 to trial18843701-16 2026-02-13T20:16:27.893 INFO:tasks.rados.rados.0.trial188.stdout:1178: finishing rollback tid 2 to trial18843701-16 2026-02-13T20:16:27.893 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 16 v 536 (ObjNum 396 snap 104 seq_num 396) dirty exists 2026-02-13T20:16:27.893 INFO:tasks.rados.rados.0.trial188.stdout:1176: finishing copy_from racing read to trial18843701-17 2026-02-13T20:16:27.893 INFO:tasks.rados.rados.0.trial188.stdout:1176: finishing copy_from to trial18843701-17 2026-02-13T20:16:27.893 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 17 v 453 (ObjNum 422 snap 111 seq_num 422) dirty exists 2026-02-13T20:16:27.894 INFO:tasks.rados.rados.0.trial188.stdout:1172: done (7 left) 2026-02-13T20:16:27.894 INFO:tasks.rados.rados.0.trial188.stdout:1174: done (6 left) 2026-02-13T20:16:27.894 INFO:tasks.rados.rados.0.trial188.stdout:1175: done (5 left) 2026-02-13T20:16:27.894 INFO:tasks.rados.rados.0.trial188.stdout:1176: done (4 left) 2026-02-13T20:16:27.894 INFO:tasks.rados.rados.0.trial188.stdout:1177: done (3 left) 2026-02-13T20:16:27.894 INFO:tasks.rados.rados.0.trial188.stdout:1178: done (2 left) 2026-02-13T20:16:27.895 INFO:tasks.rados.rados.0.trial188.stdout:1181: done (1 left) 2026-02-13T20:16:27.895 INFO:tasks.rados.rados.0.trial188.stdout:1182: read oid 20 snap 113 2026-02-13T20:16:27.895 INFO:tasks.rados.rados.0.trial188.stdout:1182: expect (ObjNum 434 snap 112 seq_num 434) 2026-02-13T20:16:27.895 INFO:tasks.rados.rados.0.trial188.stdout:1183: snap_create 2026-02-13T20:16:27.895 INFO:tasks.rados.rados.0.trial188.stdout:1180: expect (ObjNum 423 snap 111 seq_num 423) 2026-02-13T20:16:27.908 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1378300 2026-02-13T20:16:27.944 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:16:28.042 INFO:tasks.rados.rados.0.trial188.stdout:1182: expect (ObjNum 434 snap 112 seq_num 434) 2026-02-13T20:16:28.080 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:16:28.123 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:16:28.892 INFO:tasks.rados.rados.0.trial188.stdout:1180: done (2 left) 2026-02-13T20:16:28.893 INFO:tasks.rados.rados.0.trial188.stdout:1182: done (1 left) 2026-02-13T20:16:28.893 INFO:tasks.rados.rados.0.trial188.stdout:1183: done (0 left) 2026-02-13T20:16:28.893 INFO:tasks.rados.rados.0.trial188.stdout:1184: read oid 26 snap -1 2026-02-13T20:16:28.893 INFO:tasks.rados.rados.0.trial188.stdout:1184: expect (ObjNum 415 snap 111 seq_num 415) 2026-02-13T20:16:28.893 INFO:tasks.rados.rados.0.trial188.stdout:1185: snap_create 2026-02-13T20:16:28.905 INFO:tasks.rados.rados.0.trial188.stdout:1184: expect (ObjNum 415 snap 111 seq_num 415) 2026-02-13T20:16:29.893 INFO:tasks.rados.rados.0.trial188.stdout:1184: done (1 left) 2026-02-13T20:16:29.893 INFO:tasks.rados.rados.0.trial188.stdout:1185: done (0 left) 2026-02-13T20:16:29.893 INFO:tasks.rados.rados.0.trial188.stdout:1186: rollback oid 39 current snap is 116 2026-02-13T20:16:29.893 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 39 to 115 2026-02-13T20:16:29.893 INFO:tasks.rados.rados.0.trial188.stdout:1187: read oid 46 snap -1 2026-02-13T20:16:29.893 INFO:tasks.rados.rados.0.trial188.stdout:1187: expect (ObjNum 403 snap 106 seq_num 403) 2026-02-13T20:16:29.894 INFO:tasks.rados.rados.0.trial188.stdout:1188: read oid 27 snap 115 2026-02-13T20:16:29.894 INFO:tasks.rados.rados.0.trial188.stdout:1188: expect (ObjNum 387 snap 101 seq_num 387) 2026-02-13T20:16:29.894 INFO:tasks.rados.rados.0.trial188.stdout:1189: write (excl) oid 42 current snap is 116 2026-02-13T20:16:29.894 INFO:tasks.rados.rados.0.trial188.stdout:1189: seq_num 446 ranges {695922=709528,2032616=607480,3198537=297385} 2026-02-13T20:16:29.898 INFO:tasks.rados.rados.0.trial188.stdout:1189: writing trial18843701-42 from 695922 to 1405450 tid 1 2026-02-13T20:16:29.903 INFO:tasks.rados.rados.0.trial188.stdout:1189: writing trial18843701-42 from 2032616 to 2640096 tid 2 2026-02-13T20:16:29.906 INFO:tasks.rados.rados.0.trial188.stdout:1189: writing trial18843701-42 from 3198537 to 3495922 tid 3 2026-02-13T20:16:29.907 INFO:tasks.rados.rados.0.trial188.stdout:1190: write (excl) oid 48 current snap is 116 2026-02-13T20:16:29.907 INFO:tasks.rados.rados.0.trial188.stdout:1190: seq_num 447 ranges {712729=784777,2091098=467491,3342313=170416} 2026-02-13T20:16:29.912 INFO:tasks.rados.rados.0.trial188.stdout:1190: writing trial18843701-48 from 712729 to 1497506 tid 1 2026-02-13T20:16:29.916 INFO:tasks.rados.rados.0.trial188.stdout:1190: writing trial18843701-48 from 2091098 to 2558589 tid 2 2026-02-13T20:16:29.920 INFO:tasks.rados.rados.0.trial188.stdout:1190: writing trial18843701-48 from 3342313 to 3512729 tid 3 2026-02-13T20:16:29.920 INFO:tasks.rados.rados.0.trial188.stdout:1191: delete oid 50 current snap is 116 2026-02-13T20:16:29.920 INFO:tasks.rados.rados.0.trial188.stdout:1186: finishing rollback tid 0 to trial18843701-39 2026-02-13T20:16:29.920 INFO:tasks.rados.rados.0.trial188.stdout:1186: finishing rollback tid 1 to trial18843701-39 2026-02-13T20:16:29.920 INFO:tasks.rados.rados.0.trial188.stdout:1186: finishing rollback tid 2 to trial18843701-39 2026-02-13T20:16:29.921 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 39 v 457 (ObjNum 422 snap 111 seq_num 422) dirty exists 2026-02-13T20:16:29.921 INFO:tasks.rados.rados.0.trial188.stdout:1188: expect (ObjNum 387 snap 101 seq_num 387) 2026-02-13T20:16:29.945 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:16:29.971 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:16:29.997 INFO:tasks.rados.rados.0.trial188.stdout:1187: expect (ObjNum 403 snap 106 seq_num 403) 2026-02-13T20:16:30.084 INFO:tasks.rados.rados.0.trial188.stdout:1189: finishing write tid 1 to trial18843701-42 2026-02-13T20:16:30.084 INFO:tasks.rados.rados.0.trial188.stdout:1189: finishing write tid 2 to trial18843701-42 2026-02-13T20:16:30.084 INFO:tasks.rados.rados.0.trial188.stdout:1186: done (5 left) 2026-02-13T20:16:30.084 INFO:tasks.rados.rados.0.trial188.stdout:1187: done (4 left) 2026-02-13T20:16:30.084 INFO:tasks.rados.rados.0.trial188.stdout:1188: done (3 left) 2026-02-13T20:16:30.084 INFO:tasks.rados.rados.0.trial188.stdout:1191: done (2 left) 2026-02-13T20:16:30.084 INFO:tasks.rados.rados.0.trial188.stdout:1192: read oid 23 snap 114 2026-02-13T20:16:30.084 INFO:tasks.rados.rados.0.trial188.stdout:1192: expect (ObjNum 396 snap 104 seq_num 396) 2026-02-13T20:16:30.084 INFO:tasks.rados.rados.0.trial188.stdout:1193: copy_from oid 13 from oid 15 current snap is 116 2026-02-13T20:16:30.084 INFO:tasks.rados.rados.0.trial188.stdout:1189: finishing write tid 3 to trial18843701-42 2026-02-13T20:16:30.084 INFO:tasks.rados.rados.0.trial188.stdout:1189: finishing write tid 4 to trial18843701-42 2026-02-13T20:16:30.084 INFO:tasks.rados.rados.0.trial188.stdout:1189: finishing write tid 5 to trial18843701-42 2026-02-13T20:16:30.084 INFO:tasks.rados.rados.0.trial188.stdout:1189: oid 42 updating version 0 to 392 2026-02-13T20:16:30.084 INFO:tasks.rados.rados.0.trial188.stdout:1189: oid 42 updating version 392 to 394 2026-02-13T20:16:30.084 INFO:tasks.rados.rados.0.trial188.stdout:1189: oid 42 version 394 is already newer than 393 2026-02-13T20:16:30.084 INFO:tasks.rados.rados.0.trial188.stdout:1189: oid 42 version 394 is already newer than 391 2026-02-13T20:16:30.084 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 42 v 394 (ObjNum 446 snap 116 seq_num 446) dirty exists 2026-02-13T20:16:30.084 INFO:tasks.rados.rados.0.trial188.stdout:1189: left oid 42 (ObjNum 446 snap 116 seq_num 446) 2026-02-13T20:16:30.084 INFO:tasks.rados.rados.0.trial188.stdout:1190: finishing write tid 1 to trial18843701-48 2026-02-13T20:16:30.084 INFO:tasks.rados.rados.0.trial188.stdout:1189: done (3 left) 2026-02-13T20:16:30.084 INFO:tasks.rados.rados.0.trial188.stdout:1194: delete oid 28 current snap is 116 2026-02-13T20:16:30.084 INFO:tasks.rados.rados.0.trial188.stdout:1190: finishing write tid 2 to trial18843701-48 2026-02-13T20:16:30.084 INFO:tasks.rados.rados.0.trial188.stdout:1190: finishing write tid 3 to trial18843701-48 2026-02-13T20:16:30.084 INFO:tasks.rados.rados.0.trial188.stdout:1190: finishing write tid 4 to trial18843701-48 2026-02-13T20:16:30.084 INFO:tasks.rados.rados.0.trial188.stdout:1190: finishing write tid 5 to trial18843701-48 2026-02-13T20:16:30.084 INFO:tasks.rados.rados.0.trial188.stdout:1190: oid 48 updating version 0 to 219 2026-02-13T20:16:30.084 INFO:tasks.rados.rados.0.trial188.stdout:1190: oid 48 version 219 is already newer than 218 2026-02-13T20:16:30.084 INFO:tasks.rados.rados.0.trial188.stdout:1190: oid 48 version 219 is already newer than 216 2026-02-13T20:16:30.085 INFO:tasks.rados.rados.0.trial188.stdout:1190: oid 48 version 219 is already newer than 217 2026-02-13T20:16:30.085 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 48 v 219 (ObjNum 447 snap 116 seq_num 447) dirty exists 2026-02-13T20:16:30.085 INFO:tasks.rados.rados.0.trial188.stdout:1190: left oid 48 (ObjNum 447 snap 116 seq_num 447) 2026-02-13T20:16:30.091 INFO:tasks.rados.rados.0.trial188.stdout:1192: expect (ObjNum 396 snap 104 seq_num 396) 2026-02-13T20:16:30.119 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:16:30.149 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:16:30.178 INFO:tasks.rados.rados.0.trial188.stdout:1193: finishing copy_from racing read to trial18843701-13 2026-02-13T20:16:30.178 INFO:tasks.rados.rados.0.trial188.stdout:1193: finishing copy_from to trial18843701-13 2026-02-13T20:16:30.178 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 13 v 387 (ObjNum 436 snap 112 seq_num 436) dirty exists 2026-02-13T20:16:30.178 INFO:tasks.rados.rados.0.trial188.stdout:1190: done (3 left) 2026-02-13T20:16:30.178 INFO:tasks.rados.rados.0.trial188.stdout:1192: done (2 left) 2026-02-13T20:16:30.178 INFO:tasks.rados.rados.0.trial188.stdout:1193: done (1 left) 2026-02-13T20:16:30.178 INFO:tasks.rados.rados.0.trial188.stdout:1194: done (0 left) 2026-02-13T20:16:30.178 INFO:tasks.rados.rados.0.trial188.stdout:1195: copy_from oid 9 from oid 14 current snap is 116 2026-02-13T20:16:30.178 INFO:tasks.rados.rados.0.trial188.stdout:1196: delete oid 3 current snap is 116 2026-02-13T20:16:30.181 INFO:tasks.rados.rados.0.trial188.stdout:1196: done (1 left) 2026-02-13T20:16:30.181 INFO:tasks.rados.rados.0.trial188.stdout:1197: rollback oid 24 current snap is 116 2026-02-13T20:16:30.181 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 24 to 113 2026-02-13T20:16:30.182 INFO:tasks.rados.rados.0.trial188.stdout:1198: delete oid 27 current snap is 116 2026-02-13T20:16:30.183 INFO:tasks.rados.rados.0.trial188.stdout:1198: done (2 left) 2026-02-13T20:16:30.183 INFO:tasks.rados.rados.0.trial188.stdout:1199: write (excl) oid 33 current snap is 116 2026-02-13T20:16:30.183 INFO:tasks.rados.rados.0.trial188.stdout:1199: seq_num 452 ranges {796764=477375,1983508=618487,3363075=233689} 2026-02-13T20:16:30.188 INFO:tasks.rados.rados.0.trial188.stdout:1199: writing trial18843701-33 from 796764 to 1274139 tid 1 2026-02-13T20:16:30.193 INFO:tasks.rados.rados.0.trial188.stdout:1199: writing trial18843701-33 from 1983508 to 2601995 tid 2 2026-02-13T20:16:30.197 INFO:tasks.rados.rados.0.trial188.stdout:1199: writing trial18843701-33 from 3363075 to 3596764 tid 3 2026-02-13T20:16:30.197 INFO:tasks.rados.rados.0.trial188.stdout:1200: delete oid 46 current snap is 116 2026-02-13T20:16:30.197 INFO:tasks.rados.rados.0.trial188.stdout:1197: finishing rollback tid 0 to trial18843701-24 2026-02-13T20:16:30.197 INFO:tasks.rados.rados.0.trial188.stdout:1197: finishing rollback tid 1 to trial18843701-24 2026-02-13T20:16:30.197 INFO:tasks.rados.rados.0.trial188.stdout:1197: finishing rollback tid 2 to trial18843701-24 2026-02-13T20:16:30.197 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 24 v 550 (ObjNum 415 snap 111 seq_num 415) dirty exists 2026-02-13T20:16:30.206 INFO:tasks.rados.rados.0.trial188.stdout:1199: finishing write tid 1 to trial18843701-33 2026-02-13T20:16:30.207 INFO:tasks.rados.rados.0.trial188.stdout:1199: finishing write tid 2 to trial18843701-33 2026-02-13T20:16:30.207 INFO:tasks.rados.rados.0.trial188.stdout:1197: done (3 left) 2026-02-13T20:16:30.207 INFO:tasks.rados.rados.0.trial188.stdout:1200: done (2 left) 2026-02-13T20:16:30.207 INFO:tasks.rados.rados.0.trial188.stdout:1201: read oid 11 snap -1 2026-02-13T20:16:30.207 INFO:tasks.rados.rados.0.trial188.stdout:1201: expect deleted 2026-02-13T20:16:30.207 INFO:tasks.rados.rados.0.trial188.stdout:1202: write oid 42 current snap is 116 2026-02-13T20:16:30.208 INFO:tasks.rados.rados.0.trial188.stdout:1199: finishing write tid 3 to trial18843701-33 2026-02-13T20:16:30.208 INFO:tasks.rados.rados.0.trial188.stdout:1202: seq_num 454 ranges {430378=627873,1700472=622156,3017921=612457} 2026-02-13T20:16:30.212 INFO:tasks.rados.rados.0.trial188.stdout:1202: writing trial18843701-42 from 430378 to 1058251 tid 1 2026-02-13T20:16:30.217 INFO:tasks.rados.rados.0.trial188.stdout:1202: writing trial18843701-42 from 1700472 to 2322628 tid 2 2026-02-13T20:16:30.222 INFO:tasks.rados.rados.0.trial188.stdout:1202: writing trial18843701-42 from 3017921 to 3630378 tid 3 2026-02-13T20:16:30.222 INFO:tasks.rados.rados.0.trial188.stdout:1203: copy_from oid 18 from oid 7 current snap is 116 2026-02-13T20:16:30.222 INFO:tasks.rados.rados.0.trial188.stdout:1199: finishing write tid 4 to trial18843701-33 2026-02-13T20:16:30.223 INFO:tasks.rados.rados.0.trial188.stdout:1199: finishing write tid 5 to trial18843701-33 2026-02-13T20:16:30.223 INFO:tasks.rados.rados.0.trial188.stdout:1199: oid 33 updating version 0 to 407 2026-02-13T20:16:30.223 INFO:tasks.rados.rados.0.trial188.stdout:1199: oid 33 updating version 407 to 408 2026-02-13T20:16:30.223 INFO:tasks.rados.rados.0.trial188.stdout:1199: oid 33 version 408 is already newer than 406 2026-02-13T20:16:30.223 INFO:tasks.rados.rados.0.trial188.stdout:1199: oid 33 updating version 408 to 409 2026-02-13T20:16:30.223 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 33 v 409 (ObjNum 452 snap 116 seq_num 452) dirty exists 2026-02-13T20:16:30.223 INFO:tasks.rados.rados.0.trial188.stdout:1199: left oid 33 (ObjNum 452 snap 116 seq_num 452) 2026-02-13T20:16:30.223 INFO:tasks.rados.rados.0.trial188.stdout:1195: finishing copy_from racing read to trial18843701-9 2026-02-13T20:16:30.223 INFO:tasks.rados.rados.0.trial188.stdout:1199: done (4 left) 2026-02-13T20:16:30.223 INFO:tasks.rados.rados.0.trial188.stdout:1201: done (3 left) 2026-02-13T20:16:30.223 INFO:tasks.rados.rados.0.trial188.stdout:1204: write (excl) oid 48 current snap is 116 2026-02-13T20:16:30.223 INFO:tasks.rados.rados.0.trial188.stdout:1204: seq_num 455 ranges {447185=703122,1642601=765814,2928991=447707} 2026-02-13T20:16:30.227 INFO:tasks.rados.rados.0.trial188.stdout:1204: writing trial18843701-48 from 447185 to 1150307 tid 1 2026-02-13T20:16:30.231 INFO:tasks.rados.rados.0.trial188.stdout:1204: writing trial18843701-48 from 1642601 to 2408415 tid 2 2026-02-13T20:16:30.235 INFO:tasks.rados.rados.0.trial188.stdout:1204: writing trial18843701-48 from 2928991 to 3376698 tid 3 2026-02-13T20:16:30.235 INFO:tasks.rados.rados.0.trial188.stdout:1205: read oid 34 snap -1 2026-02-13T20:16:30.235 INFO:tasks.rados.rados.0.trial188.stdout:1205: expect (ObjNum 423 snap 111 seq_num 423) 2026-02-13T20:16:30.235 INFO:tasks.rados.rados.0.trial188.stdout:1206: snap_create 2026-02-13T20:16:30.238 INFO:tasks.rados.rados.0.trial188.stdout:1205: expect (ObjNum 423 snap 111 seq_num 423) 2026-02-13T20:16:30.258 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1386093 2026-02-13T20:16:30.307 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1500099 2026-02-13T20:16:30.376 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2845796 2026-02-13T20:16:30.383 INFO:tasks.rados.rados.0.trial188.stdout:1195: finishing copy_from to trial18843701-9 2026-02-13T20:16:30.383 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 9 v 383 (ObjNum 317 snap 86 seq_num 317) dirty exists 2026-02-13T20:16:30.383 INFO:tasks.rados.rados.0.trial188.stdout:1203: finishing copy_from racing read to trial18843701-18 2026-02-13T20:16:30.383 INFO:tasks.rados.rados.0.trial188.stdout:1202: finishing write tid 1 to trial18843701-42 2026-02-13T20:16:30.383 INFO:tasks.rados.rados.0.trial188.stdout:1202: finishing write tid 2 to trial18843701-42 2026-02-13T20:16:30.383 INFO:tasks.rados.rados.0.trial188.stdout:1202: finishing write tid 3 to trial18843701-42 2026-02-13T20:16:30.383 INFO:tasks.rados.rados.0.trial188.stdout:1202: finishing write tid 4 to trial18843701-42 2026-02-13T20:16:30.383 INFO:tasks.rados.rados.0.trial188.stdout:1202: finishing write tid 5 to trial18843701-42 2026-02-13T20:16:30.383 INFO:tasks.rados.rados.0.trial188.stdout:1202: oid 42 updating version 0 to 395 2026-02-13T20:16:30.383 INFO:tasks.rados.rados.0.trial188.stdout:1202: oid 42 updating version 395 to 397 2026-02-13T20:16:30.383 INFO:tasks.rados.rados.0.trial188.stdout:1202: oid 42 version 397 is already newer than 396 2026-02-13T20:16:30.384 INFO:tasks.rados.rados.0.trial188.stdout:1202: oid 42 updating version 397 to 398 2026-02-13T20:16:30.384 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 42 v 398 (ObjNum 454 snap 116 seq_num 454) dirty exists 2026-02-13T20:16:30.384 INFO:tasks.rados.rados.0.trial188.stdout:1202: left oid 42 (ObjNum 454 snap 116 seq_num 454) 2026-02-13T20:16:30.384 INFO:tasks.rados.rados.0.trial188.stdout:1204: finishing write tid 1 to trial18843701-48 2026-02-13T20:16:30.384 INFO:tasks.rados.rados.0.trial188.stdout:1203: finishing copy_from to trial18843701-18 2026-02-13T20:16:30.384 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 18 v 430 (ObjNum 393 snap 104 seq_num 393) dirty exists 2026-02-13T20:16:30.384 INFO:tasks.rados.rados.0.trial188.stdout:1204: finishing write tid 2 to trial18843701-48 2026-02-13T20:16:30.384 INFO:tasks.rados.rados.0.trial188.stdout:1204: finishing write tid 3 to trial18843701-48 2026-02-13T20:16:30.384 INFO:tasks.rados.rados.0.trial188.stdout:1204: finishing write tid 4 to trial18843701-48 2026-02-13T20:16:30.384 INFO:tasks.rados.rados.0.trial188.stdout:1204: finishing write tid 5 to trial18843701-48 2026-02-13T20:16:30.384 INFO:tasks.rados.rados.0.trial188.stdout:1204: oid 48 updating version 0 to 221 2026-02-13T20:16:30.384 INFO:tasks.rados.rados.0.trial188.stdout:1204: oid 48 updating version 221 to 223 2026-02-13T20:16:30.385 INFO:tasks.rados.rados.0.trial188.stdout:1204: oid 48 version 223 is already newer than 222 2026-02-13T20:16:30.385 INFO:tasks.rados.rados.0.trial188.stdout:1204: oid 48 version 223 is already newer than 220 2026-02-13T20:16:30.385 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 48 v 223 (ObjNum 455 snap 116 seq_num 455) dirty exists 2026-02-13T20:16:30.385 INFO:tasks.rados.rados.0.trial188.stdout:1204: left oid 48 (ObjNum 455 snap 116 seq_num 455) 2026-02-13T20:16:30.899 INFO:tasks.rados.rados.0.trial188.stdout:1195: done (5 left) 2026-02-13T20:16:30.899 INFO:tasks.rados.rados.0.trial188.stdout:1202: done (4 left) 2026-02-13T20:16:30.899 INFO:tasks.rados.rados.0.trial188.stdout:1203: done (3 left) 2026-02-13T20:16:30.900 INFO:tasks.rados.rados.0.trial188.stdout:1204: done (2 left) 2026-02-13T20:16:30.900 INFO:tasks.rados.rados.0.trial188.stdout:1205: done (1 left) 2026-02-13T20:16:30.900 INFO:tasks.rados.rados.0.trial188.stdout:1206: done (0 left) 2026-02-13T20:16:30.900 INFO:tasks.rados.rados.0.trial188.stdout:1207: copy_from oid 8 from oid 31 current snap is 117 2026-02-13T20:16:30.900 INFO:tasks.rados.rados.0.trial188.stdout:1208: copy_from oid 4 from oid 11 current snap is 117 2026-02-13T20:16:30.900 INFO:tasks.rados.rados.0.trial188.stdout:1209: snap_create 2026-02-13T20:16:30.900 INFO:tasks.rados.rados.0.trial188.stdout:1208: finishing copy_from to trial18843701-4 2026-02-13T20:16:30.900 INFO:tasks.rados.rados.0.trial188.stdout:1208: got expected ENOENT (src dne) 2026-02-13T20:16:30.900 INFO:tasks.rados.rados.0.trial188.stdout:1208: finishing copy_from racing read to trial18843701-4 2026-02-13T20:16:30.940 INFO:tasks.rados.rados.0.trial188.stdout:1207: finishing copy_from racing read to trial18843701-8 2026-02-13T20:16:30.941 INFO:tasks.rados.rados.0.trial188.stdout:1207: finishing copy_from to trial18843701-8 2026-02-13T20:16:30.942 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 8 v 337 (ObjNum 437 snap 113 seq_num 437) dirty exists 2026-02-13T20:16:31.901 INFO:tasks.rados.rados.0.trial188.stdout:1207: done (2 left) 2026-02-13T20:16:31.901 INFO:tasks.rados.rados.0.trial188.stdout:1208: done (1 left) 2026-02-13T20:16:31.901 INFO:tasks.rados.rados.0.trial188.stdout:1209: done (0 left) 2026-02-13T20:16:31.901 INFO:tasks.rados.rados.0.trial188.stdout:1210: snap_remove snap 115 2026-02-13T20:16:32.887 INFO:tasks.rados.rados.0.trial188.stdout:1210: done (0 left) 2026-02-13T20:16:32.887 INFO:tasks.rados.rados.0.trial188.stdout:1211: rollback oid 40 current snap is 118 2026-02-13T20:16:32.887 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 40 to 113 2026-02-13T20:16:32.887 INFO:tasks.rados.rados.0.trial188.stdout:1212: delete oid 7 current snap is 118 2026-02-13T20:16:32.890 INFO:tasks.rados.rados.0.trial188.stdout:1212: done (1 left) 2026-02-13T20:16:32.891 INFO:tasks.rados.rados.0.trial188.stdout:1213: read oid 46 snap -1 2026-02-13T20:16:32.891 INFO:tasks.rados.rados.0.trial188.stdout:1213: expect deleted 2026-02-13T20:16:32.891 INFO:tasks.rados.rados.0.trial188.stdout:1214: snap_create 2026-02-13T20:16:32.892 INFO:tasks.rados.rados.0.trial188.stdout:1211: finishing rollback tid 0 to trial18843701-40 2026-02-13T20:16:32.892 INFO:tasks.rados.rados.0.trial188.stdout:1211: finishing rollback tid 1 to trial18843701-40 2026-02-13T20:16:32.892 INFO:tasks.rados.rados.0.trial188.stdout:1211: finishing rollback tid 2 to trial18843701-40 2026-02-13T20:16:32.892 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 40 v 406 (ObjNum 403 snap 106 seq_num 403) dirty exists 2026-02-13T20:16:33.888 INFO:tasks.rados.rados.0.trial188.stdout:1211: done (2 left) 2026-02-13T20:16:33.889 INFO:tasks.rados.rados.0.trial188.stdout:1213: done (1 left) 2026-02-13T20:16:33.889 INFO:tasks.rados.rados.0.trial188.stdout:1214: done (0 left) 2026-02-13T20:16:33.889 INFO:tasks.rados.rados.0.trial188.stdout:1215: snap_create 2026-02-13T20:16:34.889 INFO:tasks.rados.rados.0.trial188.stdout:1215: done (0 left) 2026-02-13T20:16:34.890 INFO:tasks.rados.rados.0.trial188.stdout:1216: read oid 31 snap -1 2026-02-13T20:16:34.890 INFO:tasks.rados.rados.0.trial188.stdout:1216: expect (ObjNum 437 snap 113 seq_num 437) 2026-02-13T20:16:34.890 INFO:tasks.rados.rados.0.trial188.stdout:1217: read oid 41 snap 113 2026-02-13T20:16:34.890 INFO:tasks.rados.rados.0.trial188.stdout:1217: expect (ObjNum 259 snap 68 seq_num 259) 2026-02-13T20:16:34.890 INFO:tasks.rados.rados.0.trial188.stdout:1218: write oid 17 current snap is 120 2026-02-13T20:16:34.890 INFO:tasks.rados.rados.0.trial188.stdout:1218: seq_num 457 ranges {480799=569973,1475918=769483,2700190=586604} 2026-02-13T20:16:34.893 INFO:tasks.rados.rados.0.trial188.stdout:1218: writing trial18843701-17 from 480799 to 1050772 tid 1 2026-02-13T20:16:34.898 INFO:tasks.rados.rados.0.trial188.stdout:1218: writing trial18843701-17 from 1475918 to 2245401 tid 2 2026-02-13T20:16:34.903 INFO:tasks.rados.rados.0.trial188.stdout:1218: writing trial18843701-17 from 2700190 to 3286794 tid 3 2026-02-13T20:16:34.903 INFO:tasks.rados.rados.0.trial188.stdout:1219: delete oid 15 current snap is 120 2026-02-13T20:16:34.903 INFO:tasks.rados.rados.0.trial188.stdout:1217: expect (ObjNum 259 snap 68 seq_num 259) 2026-02-13T20:16:34.913 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2210357 2026-02-13T20:16:34.919 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1478848 2026-02-13T20:16:34.948 INFO:tasks.rados.rados.0.trial188.stdout:1216: expect (ObjNum 437 snap 113 seq_num 437) 2026-02-13T20:16:35.042 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:16:35.090 INFO:tasks.rados.rados.0.trial188.stdout:1218: finishing write tid 1 to trial18843701-17 2026-02-13T20:16:35.090 INFO:tasks.rados.rados.0.trial188.stdout:1218: finishing write tid 2 to trial18843701-17 2026-02-13T20:16:35.090 INFO:tasks.rados.rados.0.trial188.stdout:1218: finishing write tid 3 to trial18843701-17 2026-02-13T20:16:35.090 INFO:tasks.rados.rados.0.trial188.stdout:1218: finishing write tid 4 to trial18843701-17 2026-02-13T20:16:35.090 INFO:tasks.rados.rados.0.trial188.stdout:1218: finishing write tid 5 to trial18843701-17 2026-02-13T20:16:35.090 INFO:tasks.rados.rados.0.trial188.stdout:1218: oid 17 updating version 0 to 454 2026-02-13T20:16:35.090 INFO:tasks.rados.rados.0.trial188.stdout:1218: oid 17 updating version 454 to 457 2026-02-13T20:16:35.090 INFO:tasks.rados.rados.0.trial188.stdout:1218: oid 17 version 457 is already newer than 456 2026-02-13T20:16:35.090 INFO:tasks.rados.rados.0.trial188.stdout:1218: oid 17 version 457 is already newer than 455 2026-02-13T20:16:35.090 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 17 v 457 (ObjNum 457 snap 120 seq_num 457) dirty exists 2026-02-13T20:16:35.090 INFO:tasks.rados.rados.0.trial188.stdout:1218: left oid 17 (ObjNum 457 snap 120 seq_num 457) 2026-02-13T20:16:35.090 INFO:tasks.rados.rados.0.trial188.stdout:1216: done (3 left) 2026-02-13T20:16:35.090 INFO:tasks.rados.rados.0.trial188.stdout:1217: done (2 left) 2026-02-13T20:16:35.090 INFO:tasks.rados.rados.0.trial188.stdout:1218: done (1 left) 2026-02-13T20:16:35.090 INFO:tasks.rados.rados.0.trial188.stdout:1219: done (0 left) 2026-02-13T20:16:35.090 INFO:tasks.rados.rados.0.trial188.stdout:1220: snap_remove snap 116 2026-02-13T20:16:35.905 INFO:tasks.rados.rados.0.trial188.stdout:1220: done (0 left) 2026-02-13T20:16:35.905 INFO:tasks.rados.rados.0.trial188.stdout:1221: snap_remove snap 114 2026-02-13T20:16:36.908 INFO:tasks.rados.rados.0.trial188.stdout:1221: done (0 left) 2026-02-13T20:16:36.908 INFO:tasks.rados.rados.0.trial188.stdout:1222: write oid 27 current snap is 120 2026-02-13T20:16:36.908 INFO:tasks.rados.rados.0.trial188.stdout:1222: seq_num 459 ranges {514413=720471,1876529=773152,3438683=275730} 2026-02-13T20:16:36.912 INFO:tasks.rados.rados.0.trial188.stdout:1222: writing trial18843701-27 from 514413 to 1234884 tid 1 2026-02-13T20:16:36.917 INFO:tasks.rados.rados.0.trial188.stdout:1222: writing trial18843701-27 from 1876529 to 2649681 tid 2 2026-02-13T20:16:36.922 INFO:tasks.rados.rados.0.trial188.stdout:1222: writing trial18843701-27 from 3438683 to 3714413 tid 3 2026-02-13T20:16:36.922 INFO:tasks.rados.rados.0.trial188.stdout:1223: copy_from oid 23 from oid 2 current snap is 120 2026-02-13T20:16:36.922 INFO:tasks.rados.rados.0.trial188.stdout:1224: snap_remove snap 119 2026-02-13T20:16:37.889 INFO:tasks.rados.rados.0.trial188.stdout:1224: done (2 left) 2026-02-13T20:16:37.889 INFO:tasks.rados.rados.0.trial188.stdout:1225: copy_from oid 24 from oid 22 current snap is 120 2026-02-13T20:16:37.889 INFO:tasks.rados.rados.0.trial188.stdout:1222: finishing write tid 1 to trial18843701-27 2026-02-13T20:16:37.890 INFO:tasks.rados.rados.0.trial188.stdout:1222: finishing write tid 2 to trial18843701-27 2026-02-13T20:16:37.890 INFO:tasks.rados.rados.0.trial188.stdout:1222: finishing write tid 3 to trial18843701-27 2026-02-13T20:16:37.890 INFO:tasks.rados.rados.0.trial188.stdout:1222: finishing write tid 4 to trial18843701-27 2026-02-13T20:16:37.890 INFO:tasks.rados.rados.0.trial188.stdout:1222: finishing write tid 5 to trial18843701-27 2026-02-13T20:16:37.890 INFO:tasks.rados.rados.0.trial188.stdout:1222: oid 27 updating version 0 to 523 2026-02-13T20:16:37.890 INFO:tasks.rados.rados.0.trial188.stdout:1222: oid 27 version 523 is already newer than 521 2026-02-13T20:16:37.890 INFO:tasks.rados.rados.0.trial188.stdout:1222: oid 27 version 523 is already newer than 518 2026-02-13T20:16:37.890 INFO:tasks.rados.rados.0.trial188.stdout:1222: oid 27 version 523 is already newer than 522 2026-02-13T20:16:37.890 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 27 v 523 (ObjNum 459 snap 120 seq_num 459) dirty exists 2026-02-13T20:16:37.890 INFO:tasks.rados.rados.0.trial188.stdout:1222: left oid 27 (ObjNum 459 snap 120 seq_num 459) 2026-02-13T20:16:37.890 INFO:tasks.rados.rados.0.trial188.stdout:1223: finishing copy_from racing read to trial18843701-23 2026-02-13T20:16:37.890 INFO:tasks.rados.rados.0.trial188.stdout:1223: finishing copy_from to trial18843701-23 2026-02-13T20:16:37.890 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 23 v 455 (ObjNum 427 snap 111 seq_num 427) dirty exists 2026-02-13T20:16:37.890 INFO:tasks.rados.rados.0.trial188.stdout:1222: done (2 left) 2026-02-13T20:16:37.890 INFO:tasks.rados.rados.0.trial188.stdout:1223: done (1 left) 2026-02-13T20:16:37.890 INFO:tasks.rados.rados.0.trial188.stdout:1226: read oid 34 snap 118 2026-02-13T20:16:37.890 INFO:tasks.rados.rados.0.trial188.stdout:1226: expect (ObjNum 423 snap 111 seq_num 423) 2026-02-13T20:16:37.890 INFO:tasks.rados.rados.0.trial188.stdout:1227: delete oid 25 current snap is 120 2026-02-13T20:16:37.895 INFO:tasks.rados.rados.0.trial188.stdout:1226: expect (ObjNum 423 snap 111 seq_num 423) 2026-02-13T20:16:37.895 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:16:37.978 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2061234 2026-02-13T20:16:38.043 INFO:tasks.rados.rados.0.trial188.stdout:1225: finishing copy_from racing read to trial18843701-24 2026-02-13T20:16:38.043 INFO:tasks.rados.rados.0.trial188.stdout:1225: finishing copy_from to trial18843701-24 2026-02-13T20:16:38.043 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 24 v 316 (ObjNum 409 snap 109 seq_num 409) dirty exists 2026-02-13T20:16:38.043 INFO:tasks.rados.rados.0.trial188.stdout:1225: done (2 left) 2026-02-13T20:16:38.044 INFO:tasks.rados.rados.0.trial188.stdout:1226: done (1 left) 2026-02-13T20:16:38.044 INFO:tasks.rados.rados.0.trial188.stdout:1227: done (0 left) 2026-02-13T20:16:38.044 INFO:tasks.rados.rados.0.trial188.stdout:1228: read oid 20 snap 113 2026-02-13T20:16:38.044 INFO:tasks.rados.rados.0.trial188.stdout:1228: expect (ObjNum 434 snap 112 seq_num 434) 2026-02-13T20:16:38.044 INFO:tasks.rados.rados.0.trial188.stdout:1229: read oid 18 snap 117 2026-02-13T20:16:38.044 INFO:tasks.rados.rados.0.trial188.stdout:1229: expect (ObjNum 393 snap 104 seq_num 393) 2026-02-13T20:16:38.044 INFO:tasks.rados.rados.0.trial188.stdout:1230: write oid 30 current snap is 120 2026-02-13T20:16:38.044 INFO:tasks.rados.rados.0.trial188.stdout:1230: seq_num 461 ranges {548027=470969,1593493=776821,3093529=631692} 2026-02-13T20:16:38.047 INFO:tasks.rados.rados.0.trial188.stdout:1230: writing trial18843701-30 from 548027 to 1018996 tid 1 2026-02-13T20:16:38.052 INFO:tasks.rados.rados.0.trial188.stdout:1230: writing trial18843701-30 from 1593493 to 2370314 tid 2 2026-02-13T20:16:38.058 INFO:tasks.rados.rados.0.trial188.stdout:1230: writing trial18843701-30 from 3093529 to 3725221 tid 3 2026-02-13T20:16:38.058 INFO:tasks.rados.rados.0.trial188.stdout:1231: rollback oid 10 current snap is 120 2026-02-13T20:16:38.058 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 10 to 117 2026-02-13T20:16:38.058 INFO:tasks.rados.rados.0.trial188.stdout:1228: expect (ObjNum 434 snap 112 seq_num 434) 2026-02-13T20:16:38.065 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 503510 2026-02-13T20:16:38.189 INFO:tasks.rados.rados.0.trial188.stdout:1229: expect (ObjNum 393 snap 104 seq_num 393) 2026-02-13T20:16:38.219 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 896831 2026-02-13T20:16:38.261 INFO:tasks.rados.rados.0.trial188.stdout:1228: done (3 left) 2026-02-13T20:16:38.261 INFO:tasks.rados.rados.0.trial188.stdout:1229: done (2 left) 2026-02-13T20:16:38.261 INFO:tasks.rados.rados.0.trial188.stdout:1232: read oid 5 snap -1 2026-02-13T20:16:38.261 INFO:tasks.rados.rados.0.trial188.stdout:1232: expect deleted 2026-02-13T20:16:38.261 INFO:tasks.rados.rados.0.trial188.stdout:1233: copy_from oid 6 from oid 31 current snap is 120 2026-02-13T20:16:38.261 INFO:tasks.rados.rados.0.trial188.stdout:1230: finishing write tid 1 to trial18843701-30 2026-02-13T20:16:38.261 INFO:tasks.rados.rados.0.trial188.stdout:1230: finishing write tid 2 to trial18843701-30 2026-02-13T20:16:38.261 INFO:tasks.rados.rados.0.trial188.stdout:1231: finishing rollback tid 0 to trial18843701-10 2026-02-13T20:16:38.262 INFO:tasks.rados.rados.0.trial188.stdout:1230: finishing write tid 3 to trial18843701-30 2026-02-13T20:16:38.262 INFO:tasks.rados.rados.0.trial188.stdout:1231: finishing rollback tid 1 to trial18843701-10 2026-02-13T20:16:38.262 INFO:tasks.rados.rados.0.trial188.stdout:1230: finishing write tid 4 to trial18843701-30 2026-02-13T20:16:38.262 INFO:tasks.rados.rados.0.trial188.stdout:1231: finishing rollback tid 2 to trial18843701-10 2026-02-13T20:16:38.262 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 10 v 338 (ObjNum 403 snap 106 seq_num 403) dirty exists 2026-02-13T20:16:38.262 INFO:tasks.rados.rados.0.trial188.stdout:1230: finishing write tid 5 to trial18843701-30 2026-02-13T20:16:38.262 INFO:tasks.rados.rados.0.trial188.stdout:1230: oid 30 updating version 0 to 527 2026-02-13T20:16:38.262 INFO:tasks.rados.rados.0.trial188.stdout:1230: oid 30 updating version 527 to 530 2026-02-13T20:16:38.262 INFO:tasks.rados.rados.0.trial188.stdout:1230: oid 30 version 530 is already newer than 528 2026-02-13T20:16:38.262 INFO:tasks.rados.rados.0.trial188.stdout:1230: oid 30 version 530 is already newer than 529 2026-02-13T20:16:38.262 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 30 v 530 (ObjNum 461 snap 120 seq_num 461) dirty exists 2026-02-13T20:16:38.262 INFO:tasks.rados.rados.0.trial188.stdout:1230: left oid 30 (ObjNum 461 snap 120 seq_num 461) 2026-02-13T20:16:38.262 INFO:tasks.rados.rados.0.trial188.stdout:1230: done (3 left) 2026-02-13T20:16:38.262 INFO:tasks.rados.rados.0.trial188.stdout:1231: done (2 left) 2026-02-13T20:16:38.262 INFO:tasks.rados.rados.0.trial188.stdout:1234: rollback oid 13 current snap is 120 2026-02-13T20:16:38.262 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 13 to 118 2026-02-13T20:16:38.262 INFO:tasks.rados.rados.0.trial188.stdout:1235: snap_create 2026-02-13T20:16:38.264 INFO:tasks.rados.rados.0.trial188.stdout:1234: finishing rollback tid 0 to trial18843701-13 2026-02-13T20:16:38.264 INFO:tasks.rados.rados.0.trial188.stdout:1234: finishing rollback tid 1 to trial18843701-13 2026-02-13T20:16:38.264 INFO:tasks.rados.rados.0.trial188.stdout:1234: finishing rollback tid 2 to trial18843701-13 2026-02-13T20:16:38.265 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 13 v 480 (ObjNum 436 snap 112 seq_num 436) dirty exists 2026-02-13T20:16:38.303 INFO:tasks.rados.rados.0.trial188.stdout:1233: finishing copy_from racing read to trial18843701-6 2026-02-13T20:16:38.304 INFO:tasks.rados.rados.0.trial188.stdout:1233: finishing copy_from to trial18843701-6 2026-02-13T20:16:38.304 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 6 v 337 (ObjNum 437 snap 113 seq_num 437) dirty exists 2026-02-13T20:16:38.912 INFO:tasks.rados.rados.0.trial188.stdout:1232: done (3 left) 2026-02-13T20:16:38.913 INFO:tasks.rados.rados.0.trial188.stdout:1233: done (2 left) 2026-02-13T20:16:38.913 INFO:tasks.rados.rados.0.trial188.stdout:1234: done (1 left) 2026-02-13T20:16:38.913 INFO:tasks.rados.rados.0.trial188.stdout:1235: done (0 left) 2026-02-13T20:16:38.913 INFO:tasks.rados.rados.0.trial188.stdout:1236: write oid 5 current snap is 121 2026-02-13T20:16:38.913 INFO:tasks.rados.rados.0.trial188.stdout:1236: seq_num 462 ranges {564834=546218,1651975=520479,2720952=559317} 2026-02-13T20:16:38.916 INFO:tasks.rados.rados.0.trial188.stdout:1236: writing trial18843701-5 from 564834 to 1111052 tid 1 2026-02-13T20:16:38.920 INFO:tasks.rados.rados.0.trial188.stdout:1236: writing trial18843701-5 from 1651975 to 2172454 tid 2 2026-02-13T20:16:38.925 INFO:tasks.rados.rados.0.trial188.stdout:1236: writing trial18843701-5 from 2720952 to 3280269 tid 3 2026-02-13T20:16:38.925 INFO:tasks.rados.rados.0.trial188.stdout:1237: snap_remove snap 118 2026-02-13T20:16:39.914 INFO:tasks.rados.rados.0.trial188.stdout:1237: done (1 left) 2026-02-13T20:16:39.914 INFO:tasks.rados.rados.0.trial188.stdout:1238: delete oid 8 current snap is 121 2026-02-13T20:16:39.914 INFO:tasks.rados.rados.0.trial188.stdout:1236: finishing write tid 1 to trial18843701-5 2026-02-13T20:16:39.914 INFO:tasks.rados.rados.0.trial188.stdout:1236: finishing write tid 2 to trial18843701-5 2026-02-13T20:16:39.914 INFO:tasks.rados.rados.0.trial188.stdout:1236: finishing write tid 3 to trial18843701-5 2026-02-13T20:16:39.914 INFO:tasks.rados.rados.0.trial188.stdout:1236: finishing write tid 4 to trial18843701-5 2026-02-13T20:16:39.914 INFO:tasks.rados.rados.0.trial188.stdout:1236: finishing write tid 5 to trial18843701-5 2026-02-13T20:16:39.914 INFO:tasks.rados.rados.0.trial188.stdout:1236: oid 5 updating version 0 to 482 2026-02-13T20:16:39.914 INFO:tasks.rados.rados.0.trial188.stdout:1236: oid 5 updating version 482 to 483 2026-02-13T20:16:39.915 INFO:tasks.rados.rados.0.trial188.stdout:1236: oid 5 version 483 is already newer than 481 2026-02-13T20:16:39.915 INFO:tasks.rados.rados.0.trial188.stdout:1236: oid 5 updating version 483 to 484 2026-02-13T20:16:39.915 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 5 v 484 (ObjNum 462 snap 121 seq_num 462) dirty exists 2026-02-13T20:16:39.915 INFO:tasks.rados.rados.0.trial188.stdout:1236: left oid 5 (ObjNum 462 snap 121 seq_num 462) 2026-02-13T20:16:39.918 INFO:tasks.rados.rados.0.trial188.stdout:1236: done (1 left) 2026-02-13T20:16:39.918 INFO:tasks.rados.rados.0.trial188.stdout:1238: done (0 left) 2026-02-13T20:16:39.918 INFO:tasks.rados.rados.0.trial188.stdout:1239: write (excl) oid 49 current snap is 121 2026-02-13T20:16:39.918 INFO:tasks.rados.rados.0.trial188.stdout:1239: seq_num 464 ranges {598448=413069,1768939=524148,2775798=581861,3781488=16960} 2026-02-13T20:16:39.922 INFO:tasks.rados.rados.0.trial188.stdout:1239: writing trial18843701-49 from 598448 to 1011517 tid 1 2026-02-13T20:16:39.927 INFO:tasks.rados.rados.0.trial188.stdout:1239: writing trial18843701-49 from 1768939 to 2293087 tid 2 2026-02-13T20:16:39.931 INFO:tasks.rados.rados.0.trial188.stdout:1239: writing trial18843701-49 from 2775798 to 3357659 tid 3 2026-02-13T20:16:39.933 INFO:tasks.rados.rados.0.trial188.stdout:1239: writing trial18843701-49 from 3781488 to 3798448 tid 4 2026-02-13T20:16:39.933 INFO:tasks.rados.rados.0.trial188.stdout:1240: rollback oid 44 current snap is 121 2026-02-13T20:16:39.933 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 44 to 113 2026-02-13T20:16:39.933 INFO:tasks.rados.rados.0.trial188.stdout:1241: snap_remove snap 117 2026-02-13T20:16:40.917 INFO:tasks.rados.rados.0.trial188.stdout:1241: done (2 left) 2026-02-13T20:16:40.917 INFO:tasks.rados.rados.0.trial188.stdout:1242: snap_remove snap 120 2026-02-13T20:16:41.919 INFO:tasks.rados.rados.0.trial188.stdout:1242: done (2 left) 2026-02-13T20:16:41.919 INFO:tasks.rados.rados.0.trial188.stdout:1243: rollback oid 27 current snap is 121 2026-02-13T20:16:41.919 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 27 to 113 2026-02-13T20:16:41.919 INFO:tasks.rados.rados.0.trial188.stdout:1240: finishing rollback tid 0 to trial18843701-44 2026-02-13T20:16:41.919 INFO:tasks.rados.rados.0.trial188.stdout:1240: finishing rollback tid 1 to trial18843701-44 2026-02-13T20:16:41.919 INFO:tasks.rados.rados.0.trial188.stdout:1240: finishing rollback tid 2 to trial18843701-44 2026-02-13T20:16:41.919 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 44 v 490 (ObjNum 429 snap 112 seq_num 429) dirty exists 2026-02-13T20:16:41.919 INFO:tasks.rados.rados.0.trial188.stdout:1239: finishing write tid 1 to trial18843701-49 2026-02-13T20:16:41.920 INFO:tasks.rados.rados.0.trial188.stdout:1239: finishing write tid 2 to trial18843701-49 2026-02-13T20:16:41.920 INFO:tasks.rados.rados.0.trial188.stdout:1239: finishing write tid 3 to trial18843701-49 2026-02-13T20:16:41.920 INFO:tasks.rados.rados.0.trial188.stdout:1239: finishing write tid 4 to trial18843701-49 2026-02-13T20:16:41.920 INFO:tasks.rados.rados.0.trial188.stdout:1239: finishing write tid 5 to trial18843701-49 2026-02-13T20:16:41.920 INFO:tasks.rados.rados.0.trial188.stdout:1239: finishing write tid 6 to trial18843701-49 2026-02-13T20:16:41.920 INFO:tasks.rados.rados.0.trial188.stdout:1239: oid 49 updating version 0 to 536 2026-02-13T20:16:41.920 INFO:tasks.rados.rados.0.trial188.stdout:1239: oid 49 updating version 536 to 540 2026-02-13T20:16:41.920 INFO:tasks.rados.rados.0.trial188.stdout:1239: oid 49 version 540 is already newer than 539 2026-02-13T20:16:41.920 INFO:tasks.rados.rados.0.trial188.stdout:1239: oid 49 version 540 is already newer than 538 2026-02-13T20:16:41.920 INFO:tasks.rados.rados.0.trial188.stdout:1239: oid 49 version 540 is already newer than 537 2026-02-13T20:16:41.920 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 49 v 540 (ObjNum 464 snap 121 seq_num 464) dirty exists 2026-02-13T20:16:41.920 INFO:tasks.rados.rados.0.trial188.stdout:1239: left oid 49 (ObjNum 464 snap 121 seq_num 464) 2026-02-13T20:16:41.920 INFO:tasks.rados.rados.0.trial188.stdout:1239: done (2 left) 2026-02-13T20:16:41.921 INFO:tasks.rados.rados.0.trial188.stdout:1240: done (1 left) 2026-02-13T20:16:41.921 INFO:tasks.rados.rados.0.trial188.stdout:1244: write (excl) oid 40 current snap is 121 2026-02-13T20:16:41.921 INFO:tasks.rados.rados.0.trial188.stdout:1244: seq_num 465 ranges {615255=488318,1827421=784159,3203221=612034} 2026-02-13T20:16:41.922 INFO:tasks.rados.rados.0.trial188.stdout:1244: writing trial18843701-40 from 615255 to 1103573 tid 1 2026-02-13T20:16:41.928 INFO:tasks.rados.rados.0.trial188.stdout:1244: writing trial18843701-40 from 1827421 to 2611580 tid 2 2026-02-13T20:16:41.934 INFO:tasks.rados.rados.0.trial188.stdout:1244: writing trial18843701-40 from 3203221 to 3815255 tid 3 2026-02-13T20:16:41.934 INFO:tasks.rados.rados.0.trial188.stdout:1245: copy_from oid 1 from oid 37 current snap is 121 2026-02-13T20:16:41.934 INFO:tasks.rados.rados.0.trial188.stdout:1243: finishing rollback tid 0 to trial18843701-27 2026-02-13T20:16:41.934 INFO:tasks.rados.rados.0.trial188.stdout:1243: finishing rollback tid 1 to trial18843701-27 2026-02-13T20:16:41.934 INFO:tasks.rados.rados.0.trial188.stdout:1243: finishing rollback tid 2 to trial18843701-27 2026-02-13T20:16:41.934 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 27 v 549 (ObjNum 387 snap 101 seq_num 387) dirty exists 2026-02-13T20:16:41.934 INFO:tasks.rados.rados.0.trial188.stdout:1243: done (2 left) 2026-02-13T20:16:41.934 INFO:tasks.rados.rados.0.trial188.stdout:1246: rollback oid 47 current snap is 121 2026-02-13T20:16:41.934 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 47 to 113 2026-02-13T20:16:41.934 INFO:tasks.rados.rados.0.trial188.stdout:1247: write oid 44 current snap is 121 2026-02-13T20:16:41.934 INFO:tasks.rados.rados.0.trial188.stdout:1247: seq_num 466 ranges {632062=563567,1885903=527817,2830644=720758} 2026-02-13T20:16:41.938 INFO:tasks.rados.rados.0.trial188.stdout:1247: writing trial18843701-44 from 632062 to 1195629 tid 1 2026-02-13T20:16:41.942 INFO:tasks.rados.rados.0.trial188.stdout:1247: writing trial18843701-44 from 1885903 to 2413720 tid 2 2026-02-13T20:16:41.947 INFO:tasks.rados.rados.0.trial188.stdout:1247: writing trial18843701-44 from 2830644 to 3551402 tid 3 2026-02-13T20:16:41.947 INFO:tasks.rados.rados.0.trial188.stdout:1248: rollback oid 25 current snap is 121 2026-02-13T20:16:41.948 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 25 to 113 2026-02-13T20:16:41.948 INFO:tasks.rados.rados.0.trial188.stdout:1246: finishing rollback tid 0 to trial18843701-47 2026-02-13T20:16:41.948 INFO:tasks.rados.rados.0.trial188.stdout:1249: delete oid 17 current snap is 121 2026-02-13T20:16:41.948 INFO:tasks.rados.rados.0.trial188.stdout:1246: finishing rollback tid 1 to trial18843701-47 2026-02-13T20:16:41.948 INFO:tasks.rados.rados.0.trial188.stdout:1246: finishing rollback tid 2 to trial18843701-47 2026-02-13T20:16:41.948 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 47 v 412 (ObjNum 398 snap 104 seq_num 398) dirty exists 2026-02-13T20:16:41.948 INFO:tasks.rados.rados.0.trial188.stdout:1244: finishing write tid 1 to trial18843701-40 2026-02-13T20:16:41.949 INFO:tasks.rados.rados.0.trial188.stdout:1248: finishing rollback tid 1 to trial18843701-25 2026-02-13T20:16:41.949 INFO:tasks.rados.rados.0.trial188.stdout:1248: finishing rollback tid 2 to trial18843701-25 2026-02-13T20:16:41.949 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 25 v 553 (ObjNum 439 snap 113 seq_num 439) dirty exists 2026-02-13T20:16:41.951 INFO:tasks.rados.rados.0.trial188.stdout:1246: done (5 left) 2026-02-13T20:16:41.951 INFO:tasks.rados.rados.0.trial188.stdout:1248: done (4 left) 2026-02-13T20:16:41.951 INFO:tasks.rados.rados.0.trial188.stdout:1249: done (3 left) 2026-02-13T20:16:41.951 INFO:tasks.rados.rados.0.trial188.stdout:1250: write (excl) oid 28 current snap is 121 2026-02-13T20:16:41.951 INFO:tasks.rados.rados.0.trial188.stdout:1250: seq_num 468 ranges {665676=714065,1886514=531486,3169137=696539} 2026-02-13T20:16:41.956 INFO:tasks.rados.rados.0.trial188.stdout:1250: writing trial18843701-28 from 665676 to 1379741 tid 1 2026-02-13T20:16:41.960 INFO:tasks.rados.rados.0.trial188.stdout:1250: writing trial18843701-28 from 1886514 to 2418000 tid 2 2026-02-13T20:16:41.966 INFO:tasks.rados.rados.0.trial188.stdout:1250: writing trial18843701-28 from 3169137 to 3865676 tid 3 2026-02-13T20:16:41.966 INFO:tasks.rados.rados.0.trial188.stdout:1251: read oid 23 snap -1 2026-02-13T20:16:41.966 INFO:tasks.rados.rados.0.trial188.stdout:1251: expect (ObjNum 427 snap 111 seq_num 427) 2026-02-13T20:16:41.966 INFO:tasks.rados.rados.0.trial188.stdout:1252: write oid 21 current snap is 121 2026-02-13T20:16:41.966 INFO:tasks.rados.rados.0.trial188.stdout:1252: seq_num 469 ranges {682483=789314,1944996=791497,3196560=554574} 2026-02-13T20:16:41.971 INFO:tasks.rados.rados.0.trial188.stdout:1252: writing trial18843701-21 from 682483 to 1471797 tid 1 2026-02-13T20:16:41.977 INFO:tasks.rados.rados.0.trial188.stdout:1252: writing trial18843701-21 from 1944996 to 2736493 tid 2 2026-02-13T20:16:41.981 INFO:tasks.rados.rados.0.trial188.stdout:1252: writing trial18843701-21 from 3196560 to 3751134 tid 3 2026-02-13T20:16:41.981 INFO:tasks.rados.rados.0.trial188.stdout:1253: write (excl) oid 9 current snap is 121 2026-02-13T20:16:41.981 INFO:tasks.rados.rados.0.trial188.stdout:1253: seq_num 470 ranges {699290=464563,1603478=535155,2823983=765846} 2026-02-13T20:16:41.986 INFO:tasks.rados.rados.0.trial188.stdout:1253: writing trial18843701-9 from 699290 to 1163853 tid 1 2026-02-13T20:16:41.989 INFO:tasks.rados.rados.0.trial188.stdout:1253: writing trial18843701-9 from 1603478 to 2138633 tid 2 2026-02-13T20:16:41.995 INFO:tasks.rados.rados.0.trial188.stdout:1253: writing trial18843701-9 from 2823983 to 3589829 tid 3 2026-02-13T20:16:41.995 INFO:tasks.rados.rados.0.trial188.stdout:1254: write (excl) oid 45 current snap is 121 2026-02-13T20:16:41.995 INFO:tasks.rados.rados.0.trial188.stdout:1254: seq_num 471 ranges {716097=539812,1945607=795166,3535053=381044} 2026-02-13T20:16:41.999 INFO:tasks.rados.rados.0.trial188.stdout:1254: writing trial18843701-45 from 716097 to 1255909 tid 1 2026-02-13T20:16:42.005 INFO:tasks.rados.rados.0.trial188.stdout:1254: writing trial18843701-45 from 1945607 to 2740773 tid 2 2026-02-13T20:16:42.009 INFO:tasks.rados.rados.0.trial188.stdout:1254: writing trial18843701-45 from 3535053 to 3916097 tid 3 2026-02-13T20:16:42.010 INFO:tasks.rados.rados.0.trial188.stdout:1255: snap_remove snap 113 2026-02-13T20:16:42.890 INFO:tasks.rados.rados.0.trial188.stdout:1255: done (8 left) 2026-02-13T20:16:42.890 INFO:tasks.rados.rados.0.trial188.stdout:1256: snap_create 2026-02-13T20:16:42.890 INFO:tasks.rados.rados.0.trial188.stdout:1245: finishing copy_from racing read to trial18843701-1 2026-02-13T20:16:42.890 INFO:tasks.rados.rados.0.trial188.stdout:1244: finishing write tid 2 to trial18843701-40 2026-02-13T20:16:42.890 INFO:tasks.rados.rados.0.trial188.stdout:1247: finishing write tid 1 to trial18843701-44 2026-02-13T20:16:42.890 INFO:tasks.rados.rados.0.trial188.stdout:1244: finishing write tid 3 to trial18843701-40 2026-02-13T20:16:42.890 INFO:tasks.rados.rados.0.trial188.stdout:1250: finishing write tid 1 to trial18843701-28 2026-02-13T20:16:42.890 INFO:tasks.rados.rados.0.trial188.stdout:1250: finishing write tid 2 to trial18843701-28 2026-02-13T20:16:42.890 INFO:tasks.rados.rados.0.trial188.stdout:1245: finishing copy_from to trial18843701-1 2026-02-13T20:16:42.890 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 1 v 455 (ObjNum 427 snap 111 seq_num 427) dirty exists 2026-02-13T20:16:42.890 INFO:tasks.rados.rados.0.trial188.stdout:1250: finishing write tid 3 to trial18843701-28 2026-02-13T20:16:42.890 INFO:tasks.rados.rados.0.trial188.stdout:1247: finishing write tid 2 to trial18843701-44 2026-02-13T20:16:42.890 INFO:tasks.rados.rados.0.trial188.stdout:1250: finishing write tid 4 to trial18843701-28 2026-02-13T20:16:42.890 INFO:tasks.rados.rados.0.trial188.stdout:1250: finishing write tid 5 to trial18843701-28 2026-02-13T20:16:42.890 INFO:tasks.rados.rados.0.trial188.stdout:1250: oid 28 updating version 0 to 488 2026-02-13T20:16:42.890 INFO:tasks.rados.rados.0.trial188.stdout:1250: oid 28 version 488 is already newer than 487 2026-02-13T20:16:42.890 INFO:tasks.rados.rados.0.trial188.stdout:1250: oid 28 updating version 488 to 490 2026-02-13T20:16:42.890 INFO:tasks.rados.rados.0.trial188.stdout:1250: oid 28 version 490 is already newer than 489 2026-02-13T20:16:42.890 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 28 v 490 (ObjNum 468 snap 121 seq_num 468) dirty exists 2026-02-13T20:16:42.890 INFO:tasks.rados.rados.0.trial188.stdout:1250: left oid 28 (ObjNum 468 snap 121 seq_num 468) 2026-02-13T20:16:42.890 INFO:tasks.rados.rados.0.trial188.stdout:1251: expect (ObjNum 427 snap 111 seq_num 427) 2026-02-13T20:16:42.931 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:16:43.020 INFO:tasks.rados.rados.0.trial188.stdout:1252: finishing write tid 1 to trial18843701-21 2026-02-13T20:16:43.020 INFO:tasks.rados.rados.0.trial188.stdout:1244: finishing write tid 4 to trial18843701-40 2026-02-13T20:16:43.020 INFO:tasks.rados.rados.0.trial188.stdout:1252: finishing write tid 2 to trial18843701-21 2026-02-13T20:16:43.020 INFO:tasks.rados.rados.0.trial188.stdout:1244: finishing write tid 5 to trial18843701-40 2026-02-13T20:16:43.021 INFO:tasks.rados.rados.0.trial188.stdout:1244: oid 40 updating version 0 to 409 2026-02-13T20:16:43.021 INFO:tasks.rados.rados.0.trial188.stdout:1244: oid 40 version 409 is already newer than 407 2026-02-13T20:16:43.021 INFO:tasks.rados.rados.0.trial188.stdout:1244: oid 40 updating version 409 to 410 2026-02-13T20:16:43.021 INFO:tasks.rados.rados.0.trial188.stdout:1244: oid 40 version 410 is already newer than 408 2026-02-13T20:16:43.021 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 40 v 410 (ObjNum 465 snap 121 seq_num 465) dirty exists 2026-02-13T20:16:43.021 INFO:tasks.rados.rados.0.trial188.stdout:1244: left oid 40 (ObjNum 465 snap 121 seq_num 465) 2026-02-13T20:16:43.021 INFO:tasks.rados.rados.0.trial188.stdout:1252: finishing write tid 3 to trial18843701-21 2026-02-13T20:16:43.021 INFO:tasks.rados.rados.0.trial188.stdout:1252: finishing write tid 4 to trial18843701-21 2026-02-13T20:16:43.021 INFO:tasks.rados.rados.0.trial188.stdout:1252: finishing write tid 5 to trial18843701-21 2026-02-13T20:16:43.021 INFO:tasks.rados.rados.0.trial188.stdout:1252: oid 21 updating version 0 to 227 2026-02-13T20:16:43.021 INFO:tasks.rados.rados.0.trial188.stdout:1252: oid 21 version 227 is already newer than 226 2026-02-13T20:16:43.021 INFO:tasks.rados.rados.0.trial188.stdout:1252: oid 21 updating version 227 to 228 2026-02-13T20:16:43.021 INFO:tasks.rados.rados.0.trial188.stdout:1252: oid 21 version 228 is already newer than 225 2026-02-13T20:16:43.021 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 21 v 228 (ObjNum 469 snap 121 seq_num 469) dirty exists 2026-02-13T20:16:43.021 INFO:tasks.rados.rados.0.trial188.stdout:1252: left oid 21 (ObjNum 469 snap 121 seq_num 469) 2026-02-13T20:16:43.021 INFO:tasks.rados.rados.0.trial188.stdout:1247: finishing write tid 3 to trial18843701-44 2026-02-13T20:16:43.021 INFO:tasks.rados.rados.0.trial188.stdout:1247: finishing write tid 4 to trial18843701-44 2026-02-13T20:16:43.021 INFO:tasks.rados.rados.0.trial188.stdout:1247: finishing write tid 5 to trial18843701-44 2026-02-13T20:16:43.021 INFO:tasks.rados.rados.0.trial188.stdout:1247: oid 44 updating version 0 to 499 2026-02-13T20:16:43.021 INFO:tasks.rados.rados.0.trial188.stdout:1247: oid 44 updating version 499 to 501 2026-02-13T20:16:43.021 INFO:tasks.rados.rados.0.trial188.stdout:1247: oid 44 version 501 is already newer than 497 2026-02-13T20:16:43.021 INFO:tasks.rados.rados.0.trial188.stdout:1247: oid 44 version 501 is already newer than 500 2026-02-13T20:16:43.021 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 44 v 501 (ObjNum 466 snap 121 seq_num 466) dirty exists 2026-02-13T20:16:43.021 INFO:tasks.rados.rados.0.trial188.stdout:1247: left oid 44 (ObjNum 466 snap 121 seq_num 466) 2026-02-13T20:16:43.021 INFO:tasks.rados.rados.0.trial188.stdout:1253: finishing write tid 1 to trial18843701-9 2026-02-13T20:16:43.021 INFO:tasks.rados.rados.0.trial188.stdout:1254: finishing write tid 1 to trial18843701-45 2026-02-13T20:16:43.021 INFO:tasks.rados.rados.0.trial188.stdout:1254: finishing write tid 2 to trial18843701-45 2026-02-13T20:16:43.022 INFO:tasks.rados.rados.0.trial188.stdout:1253: finishing write tid 2 to trial18843701-9 2026-02-13T20:16:43.022 INFO:tasks.rados.rados.0.trial188.stdout:1253: finishing write tid 3 to trial18843701-9 2026-02-13T20:16:43.022 INFO:tasks.rados.rados.0.trial188.stdout:1254: finishing write tid 3 to trial18843701-45 2026-02-13T20:16:43.022 INFO:tasks.rados.rados.0.trial188.stdout:1253: finishing write tid 4 to trial18843701-9 2026-02-13T20:16:43.022 INFO:tasks.rados.rados.0.trial188.stdout:1254: finishing write tid 4 to trial18843701-45 2026-02-13T20:16:43.022 INFO:tasks.rados.rados.0.trial188.stdout:1254: finishing write tid 5 to trial18843701-45 2026-02-13T20:16:43.022 INFO:tasks.rados.rados.0.trial188.stdout:1254: oid 45 updating version 0 to 495 2026-02-13T20:16:43.022 INFO:tasks.rados.rados.0.trial188.stdout:1254: oid 45 version 495 is already newer than 493 2026-02-13T20:16:43.022 INFO:tasks.rados.rados.0.trial188.stdout:1254: oid 45 version 495 is already newer than 492 2026-02-13T20:16:43.022 INFO:tasks.rados.rados.0.trial188.stdout:1254: oid 45 version 495 is already newer than 494 2026-02-13T20:16:43.022 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 45 v 495 (ObjNum 471 snap 121 seq_num 471) dirty exists 2026-02-13T20:16:43.022 INFO:tasks.rados.rados.0.trial188.stdout:1254: left oid 45 (ObjNum 471 snap 121 seq_num 471) 2026-02-13T20:16:43.022 INFO:tasks.rados.rados.0.trial188.stdout:1253: finishing write tid 5 to trial18843701-9 2026-02-13T20:16:43.022 INFO:tasks.rados.rados.0.trial188.stdout:1253: oid 9 updating version 0 to 400 2026-02-13T20:16:43.022 INFO:tasks.rados.rados.0.trial188.stdout:1253: oid 9 updating version 400 to 402 2026-02-13T20:16:43.022 INFO:tasks.rados.rados.0.trial188.stdout:1253: oid 9 version 402 is already newer than 399 2026-02-13T20:16:43.022 INFO:tasks.rados.rados.0.trial188.stdout:1253: oid 9 version 402 is already newer than 401 2026-02-13T20:16:43.022 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 9 v 402 (ObjNum 470 snap 121 seq_num 470) dirty exists 2026-02-13T20:16:43.022 INFO:tasks.rados.rados.0.trial188.stdout:1253: left oid 9 (ObjNum 470 snap 121 seq_num 470) 2026-02-13T20:16:43.890 INFO:tasks.rados.rados.0.trial188.stdout:1244: done (8 left) 2026-02-13T20:16:43.890 INFO:tasks.rados.rados.0.trial188.stdout:1245: done (7 left) 2026-02-13T20:16:43.890 INFO:tasks.rados.rados.0.trial188.stdout:1247: done (6 left) 2026-02-13T20:16:43.890 INFO:tasks.rados.rados.0.trial188.stdout:1250: done (5 left) 2026-02-13T20:16:43.890 INFO:tasks.rados.rados.0.trial188.stdout:1251: done (4 left) 2026-02-13T20:16:43.890 INFO:tasks.rados.rados.0.trial188.stdout:1252: done (3 left) 2026-02-13T20:16:43.890 INFO:tasks.rados.rados.0.trial188.stdout:1253: done (2 left) 2026-02-13T20:16:43.890 INFO:tasks.rados.rados.0.trial188.stdout:1254: done (1 left) 2026-02-13T20:16:43.890 INFO:tasks.rados.rados.0.trial188.stdout:1256: done (0 left) 2026-02-13T20:16:43.890 INFO:tasks.rados.rados.0.trial188.stdout:1257: snap_remove snap 121 2026-02-13T20:16:44.890 INFO:tasks.rados.rados.0.trial188.stdout:1257: done (0 left) 2026-02-13T20:16:44.891 INFO:tasks.rados.rados.0.trial188.stdout:1258: rollback oid 21 current snap is 122 2026-02-13T20:16:44.891 INFO:tasks.rados.rados.0.trial188.stdout:1258: done (0 left) 2026-02-13T20:16:44.891 INFO:tasks.rados.rados.0.trial188.stdout:1259: rollback oid 46 current snap is 122 2026-02-13T20:16:44.891 INFO:tasks.rados.rados.0.trial188.stdout:1259: done (0 left) 2026-02-13T20:16:44.891 INFO:tasks.rados.rados.0.trial188.stdout:1260: write (excl) oid 36 current snap is 122 2026-02-13T20:16:44.891 INFO:tasks.rados.rados.0.trial188.stdout:1260: seq_num 472 ranges {732904=731414,2120442=538824,3278829=504743} 2026-02-13T20:16:44.896 INFO:tasks.rados.rados.0.trial188.stdout:1260: writing trial18843701-36 from 732904 to 1464318 tid 1 2026-02-13T20:16:44.900 INFO:tasks.rados.rados.0.trial188.stdout:1260: writing trial18843701-36 from 2120442 to 2659266 tid 2 2026-02-13T20:16:44.905 INFO:tasks.rados.rados.0.trial188.stdout:1260: writing trial18843701-36 from 3278829 to 3783572 tid 3 2026-02-13T20:16:44.905 INFO:tasks.rados.rados.0.trial188.stdout:1261: copy_from oid 19 from oid 33 current snap is 122 2026-02-13T20:16:44.905 INFO:tasks.rados.rados.0.trial188.stdout:1262: write (excl) oid 11 current snap is 122 2026-02-13T20:16:44.905 INFO:tasks.rados.rados.0.trial188.stdout:1262: seq_num 473 ranges {749711=406663,1778924=682482,3189899=716015} 2026-02-13T20:16:44.909 INFO:tasks.rados.rados.0.trial188.stdout:1262: writing trial18843701-11 from 749711 to 1156374 tid 1 2026-02-13T20:16:44.914 INFO:tasks.rados.rados.0.trial188.stdout:1262: writing trial18843701-11 from 1778924 to 2461406 tid 2 2026-02-13T20:16:44.919 INFO:tasks.rados.rados.0.trial188.stdout:1262: writing trial18843701-11 from 3189899 to 3905914 tid 3 2026-02-13T20:16:44.919 INFO:tasks.rados.rados.0.trial188.stdout:1263: delete oid 13 current snap is 122 2026-02-13T20:16:44.921 INFO:tasks.rados.rados.0.trial188.stdout:1260: finishing write tid 1 to trial18843701-36 2026-02-13T20:16:44.922 INFO:tasks.rados.rados.0.trial188.stdout:1263: done (3 left) 2026-02-13T20:16:44.922 INFO:tasks.rados.rados.0.trial188.stdout:1264: read oid 44 snap -1 2026-02-13T20:16:44.922 INFO:tasks.rados.rados.0.trial188.stdout:1264: expect (ObjNum 466 snap 121 seq_num 466) 2026-02-13T20:16:44.922 INFO:tasks.rados.rados.0.trial188.stdout:1265: read oid 31 snap -1 2026-02-13T20:16:44.922 INFO:tasks.rados.rados.0.trial188.stdout:1265: expect (ObjNum 437 snap 113 seq_num 437) 2026-02-13T20:16:44.922 INFO:tasks.rados.rados.0.trial188.stdout:1266: snap_create 2026-02-13T20:16:44.925 INFO:tasks.rados.rados.0.trial188.stdout:1260: finishing write tid 2 to trial18843701-36 2026-02-13T20:16:44.925 INFO:tasks.rados.rados.0.trial188.stdout:1262: finishing write tid 1 to trial18843701-11 2026-02-13T20:16:44.925 INFO:tasks.rados.rados.0.trial188.stdout:1260: finishing write tid 3 to trial18843701-36 2026-02-13T20:16:44.928 INFO:tasks.rados.rados.0.trial188.stdout:1264: expect (ObjNum 466 snap 121 seq_num 466) 2026-02-13T20:16:44.928 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 158247 2026-02-13T20:16:45.050 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2623573 2026-02-13T20:16:45.067 INFO:tasks.rados.rados.0.trial188.stdout:1262: finishing write tid 2 to trial18843701-11 2026-02-13T20:16:45.067 INFO:tasks.rados.rados.0.trial188.stdout:1260: finishing write tid 4 to trial18843701-36 2026-02-13T20:16:45.067 INFO:tasks.rados.rados.0.trial188.stdout:1260: finishing write tid 5 to trial18843701-36 2026-02-13T20:16:45.067 INFO:tasks.rados.rados.0.trial188.stdout:1260: oid 36 updating version 0 to 593 2026-02-13T20:16:45.067 INFO:tasks.rados.rados.0.trial188.stdout:1260: oid 36 updating version 593 to 594 2026-02-13T20:16:45.068 INFO:tasks.rados.rados.0.trial188.stdout:1260: oid 36 version 594 is already newer than 591 2026-02-13T20:16:45.068 INFO:tasks.rados.rados.0.trial188.stdout:1260: oid 36 version 594 is already newer than 592 2026-02-13T20:16:45.068 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 36 v 594 (ObjNum 472 snap 122 seq_num 472) dirty exists 2026-02-13T20:16:45.068 INFO:tasks.rados.rados.0.trial188.stdout:1260: left oid 36 (ObjNum 472 snap 122 seq_num 472) 2026-02-13T20:16:45.068 INFO:tasks.rados.rados.0.trial188.stdout:1262: finishing write tid 3 to trial18843701-11 2026-02-13T20:16:45.068 INFO:tasks.rados.rados.0.trial188.stdout:1262: finishing write tid 4 to trial18843701-11 2026-02-13T20:16:45.068 INFO:tasks.rados.rados.0.trial188.stdout:1262: finishing write tid 5 to trial18843701-11 2026-02-13T20:16:45.068 INFO:tasks.rados.rados.0.trial188.stdout:1262: oid 11 updating version 0 to 340 2026-02-13T20:16:45.068 INFO:tasks.rados.rados.0.trial188.stdout:1262: oid 11 version 340 is already newer than 339 2026-02-13T20:16:45.068 INFO:tasks.rados.rados.0.trial188.stdout:1262: oid 11 updating version 340 to 342 2026-02-13T20:16:45.068 INFO:tasks.rados.rados.0.trial188.stdout:1262: oid 11 version 342 is already newer than 341 2026-02-13T20:16:45.068 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 11 v 342 (ObjNum 473 snap 122 seq_num 473) dirty exists 2026-02-13T20:16:45.068 INFO:tasks.rados.rados.0.trial188.stdout:1262: left oid 11 (ObjNum 473 snap 122 seq_num 473) 2026-02-13T20:16:45.068 INFO:tasks.rados.rados.0.trial188.stdout:1265: expect (ObjNum 437 snap 113 seq_num 437) 2026-02-13T20:16:45.159 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:16:45.207 INFO:tasks.rados.rados.0.trial188.stdout:1261: finishing copy_from racing read to trial18843701-19 2026-02-13T20:16:45.207 INFO:tasks.rados.rados.0.trial188.stdout:1261: finishing copy_from to trial18843701-19 2026-02-13T20:16:45.207 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 19 v 409 (ObjNum 452 snap 116 seq_num 452) dirty exists 2026-02-13T20:16:45.893 INFO:tasks.rados.rados.0.trial188.stdout:1260: done (5 left) 2026-02-13T20:16:45.893 INFO:tasks.rados.rados.0.trial188.stdout:1261: done (4 left) 2026-02-13T20:16:45.893 INFO:tasks.rados.rados.0.trial188.stdout:1262: done (3 left) 2026-02-13T20:16:45.893 INFO:tasks.rados.rados.0.trial188.stdout:1264: done (2 left) 2026-02-13T20:16:45.893 INFO:tasks.rados.rados.0.trial188.stdout:1265: done (1 left) 2026-02-13T20:16:45.893 INFO:tasks.rados.rados.0.trial188.stdout:1266: done (0 left) 2026-02-13T20:16:45.893 INFO:tasks.rados.rados.0.trial188.stdout:1267: rollback oid 4 current snap is 123 2026-02-13T20:16:45.894 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 4 to 122 2026-02-13T20:16:45.894 INFO:tasks.rados.rados.0.trial188.stdout:1268: snap_create 2026-02-13T20:16:45.895 INFO:tasks.rados.rados.0.trial188.stdout:1267: finishing rollback tid 0 to trial18843701-4 2026-02-13T20:16:45.896 INFO:tasks.rados.rados.0.trial188.stdout:1267: finishing rollback tid 1 to trial18843701-4 2026-02-13T20:16:45.896 INFO:tasks.rados.rados.0.trial188.stdout:1267: finishing rollback tid 2 to trial18843701-4 2026-02-13T20:16:45.896 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 4 v 345 (ObjNum 434 snap 112 seq_num 434) dirty exists 2026-02-13T20:16:46.893 INFO:tasks.rados.rados.0.trial188.stdout:1267: done (1 left) 2026-02-13T20:16:46.893 INFO:tasks.rados.rados.0.trial188.stdout:1268: done (0 left) 2026-02-13T20:16:46.893 INFO:tasks.rados.rados.0.trial188.stdout:1269: read oid 40 snap 123 2026-02-13T20:16:46.894 INFO:tasks.rados.rados.0.trial188.stdout:1269: expect (ObjNum 465 snap 121 seq_num 465) 2026-02-13T20:16:46.894 INFO:tasks.rados.rados.0.trial188.stdout:1270: write oid 10 current snap is 124 2026-02-13T20:16:46.894 INFO:tasks.rados.rados.0.trial188.stdout:1270: seq_num 475 ranges {783325=557161,1779535=686151,3244745=454912} 2026-02-13T20:16:46.898 INFO:tasks.rados.rados.0.trial188.stdout:1270: writing trial18843701-10 from 783325 to 1340486 tid 1 2026-02-13T20:16:46.902 INFO:tasks.rados.rados.0.trial188.stdout:1270: writing trial18843701-10 from 1779535 to 2465686 tid 2 2026-02-13T20:16:46.907 INFO:tasks.rados.rados.0.trial188.stdout:1270: writing trial18843701-10 from 3244745 to 3699657 tid 3 2026-02-13T20:16:46.907 INFO:tasks.rados.rados.0.trial188.stdout:1271: rollback oid 46 current snap is 124 2026-02-13T20:16:46.907 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 46 to 122 2026-02-13T20:16:46.907 INFO:tasks.rados.rados.0.trial188.stdout:1269: expect (ObjNum 465 snap 121 seq_num 465) 2026-02-13T20:16:46.986 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2080467 2026-02-13T20:16:47.058 INFO:tasks.rados.rados.0.trial188.stdout:1271: finishing rollback tid 1 to trial18843701-46 2026-02-13T20:16:47.058 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 46 v 0 (ObjNum 289 snap 0 seq_num 1) dirty dne 2026-02-13T20:16:47.059 INFO:tasks.rados.rados.0.trial188.stdout:1270: finishing write tid 1 to trial18843701-10 2026-02-13T20:16:47.059 INFO:tasks.rados.rados.0.trial188.stdout:1270: finishing write tid 2 to trial18843701-10 2026-02-13T20:16:47.059 INFO:tasks.rados.rados.0.trial188.stdout:1269: done (2 left) 2026-02-13T20:16:47.059 INFO:tasks.rados.rados.0.trial188.stdout:1271: done (1 left) 2026-02-13T20:16:47.059 INFO:tasks.rados.rados.0.trial188.stdout:1272: read oid 41 snap -1 2026-02-13T20:16:47.059 INFO:tasks.rados.rados.0.trial188.stdout:1272: expect (ObjNum 259 snap 68 seq_num 259) 2026-02-13T20:16:47.059 INFO:tasks.rados.rados.0.trial188.stdout:1273: write oid 34 current snap is 124 2026-02-13T20:16:47.059 INFO:tasks.rados.rados.0.trial188.stdout:1273: seq_num 476 ranges {400132=632410,1438017=546162} 2026-02-13T20:16:47.061 INFO:tasks.rados.rados.0.trial188.stdout:1273: writing trial18843701-34 from 400132 to 1032542 tid 1 2026-02-13T20:16:47.065 INFO:tasks.rados.rados.0.trial188.stdout:1273: writing trial18843701-34 from 1438017 to 1984179 tid 2 2026-02-13T20:16:47.065 INFO:tasks.rados.rados.0.trial188.stdout:1274: snap_create 2026-02-13T20:16:47.066 INFO:tasks.rados.rados.0.trial188.stdout:1270: finishing write tid 3 to trial18843701-10 2026-02-13T20:16:47.066 INFO:tasks.rados.rados.0.trial188.stdout:1270: finishing write tid 4 to trial18843701-10 2026-02-13T20:16:47.066 INFO:tasks.rados.rados.0.trial188.stdout:1270: finishing write tid 5 to trial18843701-10 2026-02-13T20:16:47.066 INFO:tasks.rados.rados.0.trial188.stdout:1270: oid 10 updating version 0 to 346 2026-02-13T20:16:47.066 INFO:tasks.rados.rados.0.trial188.stdout:1270: oid 10 updating version 346 to 349 2026-02-13T20:16:47.066 INFO:tasks.rados.rados.0.trial188.stdout:1270: oid 10 version 349 is already newer than 348 2026-02-13T20:16:47.066 INFO:tasks.rados.rados.0.trial188.stdout:1270: oid 10 version 349 is already newer than 347 2026-02-13T20:16:47.066 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 10 v 349 (ObjNum 475 snap 124 seq_num 475) dirty exists 2026-02-13T20:16:47.066 INFO:tasks.rados.rados.0.trial188.stdout:1270: left oid 10 (ObjNum 475 snap 124 seq_num 475) 2026-02-13T20:16:47.066 INFO:tasks.rados.rados.0.trial188.stdout:1272: expect (ObjNum 259 snap 68 seq_num 259) 2026-02-13T20:16:47.070 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1423924 2026-02-13T20:16:47.080 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:16:47.110 INFO:tasks.rados.rados.0.trial188.stdout:1273: finishing write tid 1 to trial18843701-34 2026-02-13T20:16:47.110 INFO:tasks.rados.rados.0.trial188.stdout:1273: finishing write tid 2 to trial18843701-34 2026-02-13T20:16:47.110 INFO:tasks.rados.rados.0.trial188.stdout:1273: finishing write tid 3 to trial18843701-34 2026-02-13T20:16:47.110 INFO:tasks.rados.rados.0.trial188.stdout:1273: finishing write tid 4 to trial18843701-34 2026-02-13T20:16:47.110 INFO:tasks.rados.rados.0.trial188.stdout:1273: oid 34 updating version 0 to 503 2026-02-13T20:16:47.110 INFO:tasks.rados.rados.0.trial188.stdout:1273: oid 34 updating version 503 to 505 2026-02-13T20:16:47.110 INFO:tasks.rados.rados.0.trial188.stdout:1273: oid 34 version 505 is already newer than 504 2026-02-13T20:16:47.111 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 34 v 505 (ObjNum 476 snap 124 seq_num 476) dirty exists 2026-02-13T20:16:47.111 INFO:tasks.rados.rados.0.trial188.stdout:1273: left oid 34 (ObjNum 476 snap 124 seq_num 476) 2026-02-13T20:16:47.890 INFO:tasks.rados.rados.0.trial188.stdout:1270: done (3 left) 2026-02-13T20:16:47.890 INFO:tasks.rados.rados.0.trial188.stdout:1272: done (2 left) 2026-02-13T20:16:47.890 INFO:tasks.rados.rados.0.trial188.stdout:1273: done (1 left) 2026-02-13T20:16:47.890 INFO:tasks.rados.rados.0.trial188.stdout:1274: done (0 left) 2026-02-13T20:16:47.890 INFO:tasks.rados.rados.0.trial188.stdout:1275: write (excl) oid 25 current snap is 125 2026-02-13T20:16:47.890 INFO:tasks.rados.rados.0.trial188.stdout:1275: seq_num 477 ranges {416939=707659,1896499=120440} 2026-02-13T20:16:47.894 INFO:tasks.rados.rados.0.trial188.stdout:1275: writing trial18843701-25 from 416939 to 1124598 tid 1 2026-02-13T20:16:47.897 INFO:tasks.rados.rados.0.trial188.stdout:1275: writing trial18843701-25 from 1896499 to 2016939 tid 2 2026-02-13T20:16:47.897 INFO:tasks.rados.rados.0.trial188.stdout:1276: snap_remove snap 122 2026-02-13T20:16:48.900 INFO:tasks.rados.rados.0.trial188.stdout:1276: done (1 left) 2026-02-13T20:16:48.901 INFO:tasks.rados.rados.0.trial188.stdout:1277: read oid 19 snap -1 2026-02-13T20:16:48.901 INFO:tasks.rados.rados.0.trial188.stdout:1277: expect (ObjNum 452 snap 116 seq_num 452) 2026-02-13T20:16:48.901 INFO:tasks.rados.rados.0.trial188.stdout:1278: copy_from oid 16 from oid 29 current snap is 125 2026-02-13T20:16:48.901 INFO:tasks.rados.rados.0.trial188.stdout:1275: finishing write tid 1 to trial18843701-25 2026-02-13T20:16:48.901 INFO:tasks.rados.rados.0.trial188.stdout:1275: finishing write tid 2 to trial18843701-25 2026-02-13T20:16:48.901 INFO:tasks.rados.rados.0.trial188.stdout:1275: finishing write tid 3 to trial18843701-25 2026-02-13T20:16:48.901 INFO:tasks.rados.rados.0.trial188.stdout:1275: finishing write tid 4 to trial18843701-25 2026-02-13T20:16:48.901 INFO:tasks.rados.rados.0.trial188.stdout:1275: oid 25 updating version 0 to 566 2026-02-13T20:16:48.901 INFO:tasks.rados.rados.0.trial188.stdout:1275: oid 25 version 566 is already newer than 565 2026-02-13T20:16:48.902 INFO:tasks.rados.rados.0.trial188.stdout:1275: oid 25 updating version 566 to 567 2026-02-13T20:16:48.902 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 25 v 567 (ObjNum 477 snap 125 seq_num 477) dirty exists 2026-02-13T20:16:48.902 INFO:tasks.rados.rados.0.trial188.stdout:1275: left oid 25 (ObjNum 477 snap 125 seq_num 477) 2026-02-13T20:16:48.902 INFO:tasks.rados.rados.0.trial188.stdout:1275: done (2 left) 2026-02-13T20:16:48.902 INFO:tasks.rados.rados.0.trial188.stdout:1279: snap_remove snap 123 2026-02-13T20:16:49.902 INFO:tasks.rados.rados.0.trial188.stdout:1279: done (2 left) 2026-02-13T20:16:49.902 INFO:tasks.rados.rados.0.trial188.stdout:1280: delete oid 23 current snap is 125 2026-02-13T20:16:49.902 INFO:tasks.rados.rados.0.trial188.stdout:1277: expect (ObjNum 452 snap 116 seq_num 452) 2026-02-13T20:16:49.902 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:16:50.030 INFO:tasks.rados.rados.0.trial188.stdout:1278: finishing copy_from racing read to trial18843701-16 2026-02-13T20:16:50.030 INFO:tasks.rados.rados.0.trial188.stdout:1278: finishing copy_from to trial18843701-16 2026-02-13T20:16:50.030 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 16 v 444 (ObjNum 417 snap 111 seq_num 417) dirty exists 2026-02-13T20:16:50.031 INFO:tasks.rados.rados.0.trial188.stdout:1277: done (2 left) 2026-02-13T20:16:50.031 INFO:tasks.rados.rados.0.trial188.stdout:1278: done (1 left) 2026-02-13T20:16:50.031 INFO:tasks.rados.rados.0.trial188.stdout:1280: done (0 left) 2026-02-13T20:16:50.031 INFO:tasks.rados.rados.0.trial188.stdout:1281: rollback oid 16 current snap is 125 2026-02-13T20:16:50.031 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 16 to 124 2026-02-13T20:16:50.031 INFO:tasks.rados.rados.0.trial188.stdout:1282: delete oid 32 current snap is 125 2026-02-13T20:16:50.033 INFO:tasks.rados.rados.0.trial188.stdout:1281: finishing rollback tid 0 to trial18843701-16 2026-02-13T20:16:50.033 INFO:tasks.rados.rados.0.trial188.stdout:1282: done (1 left) 2026-02-13T20:16:50.033 INFO:tasks.rados.rados.0.trial188.stdout:1283: delete oid 5 current snap is 125 2026-02-13T20:16:50.033 INFO:tasks.rados.rados.0.trial188.stdout:1281: finishing rollback tid 1 to trial18843701-16 2026-02-13T20:16:50.033 INFO:tasks.rados.rados.0.trial188.stdout:1281: finishing rollback tid 2 to trial18843701-16 2026-02-13T20:16:50.033 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 16 v 603 (ObjNum 396 snap 104 seq_num 396) dirty exists 2026-02-13T20:16:50.034 INFO:tasks.rados.rados.0.trial188.stdout:1281: done (1 left) 2026-02-13T20:16:50.034 INFO:tasks.rados.rados.0.trial188.stdout:1283: done (0 left) 2026-02-13T20:16:50.034 INFO:tasks.rados.rados.0.trial188.stdout:1284: snap_create 2026-02-13T20:16:50.906 INFO:tasks.rados.rados.0.trial188.stdout:1284: done (0 left) 2026-02-13T20:16:50.906 INFO:tasks.rados.rados.0.trial188.stdout:1285: write oid 11 current snap is 126 2026-02-13T20:16:50.906 INFO:tasks.rados.rados.0.trial188.stdout:1285: seq_num 481 ranges {484167=725008,1730427=353740} 2026-02-13T20:16:50.911 INFO:tasks.rados.rados.0.trial188.stdout:1285: writing trial18843701-11 from 484167 to 1209175 tid 1 2026-02-13T20:16:50.914 INFO:tasks.rados.rados.0.trial188.stdout:1285: writing trial18843701-11 from 1730427 to 2084167 tid 2 2026-02-13T20:16:50.914 INFO:tasks.rados.rados.0.trial188.stdout:1286: write oid 48 current snap is 126 2026-02-13T20:16:50.914 INFO:tasks.rados.rados.0.trial188.stdout:1286: seq_num 482 ranges {500974=400257,1388909=557169} 2026-02-13T20:16:50.917 INFO:tasks.rados.rados.0.trial188.stdout:1286: writing trial18843701-48 from 500974 to 901231 tid 1 2026-02-13T20:16:50.921 INFO:tasks.rados.rados.0.trial188.stdout:1286: writing trial18843701-48 from 1388909 to 1946078 tid 2 2026-02-13T20:16:50.922 INFO:tasks.rados.rados.0.trial188.stdout:1287: write oid 14 current snap is 126 2026-02-13T20:16:50.922 INFO:tasks.rados.rados.0.trial188.stdout:1287: seq_num 483 ranges {517781=475506,1731038=386743} 2026-02-13T20:16:50.925 INFO:tasks.rados.rados.0.trial188.stdout:1287: writing trial18843701-14 from 517781 to 993287 tid 1 2026-02-13T20:16:50.929 INFO:tasks.rados.rados.0.trial188.stdout:1287: writing trial18843701-14 from 1731038 to 2117781 tid 2 2026-02-13T20:16:50.929 INFO:tasks.rados.rados.0.trial188.stdout:1288: snap_remove snap 124 2026-02-13T20:16:51.910 INFO:tasks.rados.rados.0.trial188.stdout:1288: done (3 left) 2026-02-13T20:16:51.910 INFO:tasks.rados.rados.0.trial188.stdout:1289: copy_from oid 42 from oid 15 current snap is 126 2026-02-13T20:16:51.910 INFO:tasks.rados.rados.0.trial188.stdout:1285: finishing write tid 1 to trial18843701-11 2026-02-13T20:16:51.910 INFO:tasks.rados.rados.0.trial188.stdout:1285: finishing write tid 2 to trial18843701-11 2026-02-13T20:16:51.910 INFO:tasks.rados.rados.0.trial188.stdout:1285: finishing write tid 3 to trial18843701-11 2026-02-13T20:16:51.911 INFO:tasks.rados.rados.0.trial188.stdout:1286: finishing write tid 1 to trial18843701-48 2026-02-13T20:16:51.911 INFO:tasks.rados.rados.0.trial188.stdout:1285: finishing write tid 4 to trial18843701-11 2026-02-13T20:16:51.911 INFO:tasks.rados.rados.0.trial188.stdout:1285: oid 11 updating version 0 to 352 2026-02-13T20:16:51.911 INFO:tasks.rados.rados.0.trial188.stdout:1285: oid 11 version 352 is already newer than 351 2026-02-13T20:16:51.911 INFO:tasks.rados.rados.0.trial188.stdout:1285: oid 11 version 352 is already newer than 350 2026-02-13T20:16:51.911 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 11 v 352 (ObjNum 481 snap 126 seq_num 481) dirty exists 2026-02-13T20:16:51.911 INFO:tasks.rados.rados.0.trial188.stdout:1285: left oid 11 (ObjNum 481 snap 126 seq_num 481) 2026-02-13T20:16:51.911 INFO:tasks.rados.rados.0.trial188.stdout:1286: finishing write tid 2 to trial18843701-48 2026-02-13T20:16:51.911 INFO:tasks.rados.rados.0.trial188.stdout:1286: finishing write tid 3 to trial18843701-48 2026-02-13T20:16:51.911 INFO:tasks.rados.rados.0.trial188.stdout:1286: finishing write tid 4 to trial18843701-48 2026-02-13T20:16:51.911 INFO:tasks.rados.rados.0.trial188.stdout:1286: oid 48 updating version 0 to 234 2026-02-13T20:16:51.912 INFO:tasks.rados.rados.0.trial188.stdout:1286: oid 48 version 234 is already newer than 232 2026-02-13T20:16:51.912 INFO:tasks.rados.rados.0.trial188.stdout:1286: oid 48 version 234 is already newer than 233 2026-02-13T20:16:51.912 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 48 v 234 (ObjNum 482 snap 126 seq_num 482) dirty exists 2026-02-13T20:16:51.912 INFO:tasks.rados.rados.0.trial188.stdout:1286: left oid 48 (ObjNum 482 snap 126 seq_num 482) 2026-02-13T20:16:51.912 INFO:tasks.rados.rados.0.trial188.stdout:1287: finishing write tid 1 to trial18843701-14 2026-02-13T20:16:51.912 INFO:tasks.rados.rados.0.trial188.stdout:1287: finishing write tid 2 to trial18843701-14 2026-02-13T20:16:51.912 INFO:tasks.rados.rados.0.trial188.stdout:1287: finishing write tid 3 to trial18843701-14 2026-02-13T20:16:51.912 INFO:tasks.rados.rados.0.trial188.stdout:1285: done (3 left) 2026-02-13T20:16:51.912 INFO:tasks.rados.rados.0.trial188.stdout:1286: done (2 left) 2026-02-13T20:16:51.912 INFO:tasks.rados.rados.0.trial188.stdout:1290: rollback oid 28 current snap is 126 2026-02-13T20:16:51.912 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 28 to 125 2026-02-13T20:16:51.912 INFO:tasks.rados.rados.0.trial188.stdout:1287: finishing write tid 4 to trial18843701-14 2026-02-13T20:16:51.912 INFO:tasks.rados.rados.0.trial188.stdout:1287: oid 14 updating version 0 to 447 2026-02-13T20:16:51.913 INFO:tasks.rados.rados.0.trial188.stdout:1287: oid 14 version 447 is already newer than 446 2026-02-13T20:16:51.913 INFO:tasks.rados.rados.0.trial188.stdout:1287: oid 14 updating version 447 to 448 2026-02-13T20:16:51.913 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 14 v 448 (ObjNum 483 snap 126 seq_num 483) dirty exists 2026-02-13T20:16:51.913 INFO:tasks.rados.rados.0.trial188.stdout:1287: left oid 14 (ObjNum 483 snap 126 seq_num 483) 2026-02-13T20:16:51.913 INFO:tasks.rados.rados.0.trial188.stdout:1287: done (2 left) 2026-02-13T20:16:51.913 INFO:tasks.rados.rados.0.trial188.stdout:1291: delete oid 49 current snap is 126 2026-02-13T20:16:51.913 INFO:tasks.rados.rados.0.trial188.stdout:1289: finishing copy_from to trial18843701-42 2026-02-13T20:16:51.913 INFO:tasks.rados.rados.0.trial188.stdout:1289: got expected ENOENT (src dne) 2026-02-13T20:16:51.914 INFO:tasks.rados.rados.0.trial188.stdout:1289: finishing copy_from racing read to trial18843701-42 2026-02-13T20:16:51.914 INFO:tasks.rados.rados.0.trial188.stdout:1289: done (2 left) 2026-02-13T20:16:51.914 INFO:tasks.rados.rados.0.trial188.stdout:1291: done (1 left) 2026-02-13T20:16:51.914 INFO:tasks.rados.rados.0.trial188.stdout:1292: write (excl) oid 30 current snap is 126 2026-02-13T20:16:51.914 INFO:tasks.rados.rados.0.trial188.stdout:1292: seq_num 485 ranges {551395=626004,1848002=303393} 2026-02-13T20:16:51.916 INFO:tasks.rados.rados.0.trial188.stdout:1292: writing trial18843701-30 from 551395 to 1177399 tid 1 2026-02-13T20:16:51.920 INFO:tasks.rados.rados.0.trial188.stdout:1292: writing trial18843701-30 from 1848002 to 2151395 tid 2 2026-02-13T20:16:51.920 INFO:tasks.rados.rados.0.trial188.stdout:1293: delete oid 13 current snap is 126 2026-02-13T20:16:51.920 INFO:tasks.rados.rados.0.trial188.stdout:1290: finishing rollback tid 0 to trial18843701-28 2026-02-13T20:16:51.920 INFO:tasks.rados.rados.0.trial188.stdout:1290: finishing rollback tid 1 to trial18843701-28 2026-02-13T20:16:51.920 INFO:tasks.rados.rados.0.trial188.stdout:1290: finishing rollback tid 2 to trial18843701-28 2026-02-13T20:16:51.920 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 28 v 513 (ObjNum 468 snap 121 seq_num 468) dirty exists 2026-02-13T20:16:51.921 INFO:tasks.rados.rados.0.trial188.stdout:1290: done (2 left) 2026-02-13T20:16:51.921 INFO:tasks.rados.rados.0.trial188.stdout:1293: done (1 left) 2026-02-13T20:16:51.921 INFO:tasks.rados.rados.0.trial188.stdout:1294: copy_from oid 23 from oid 32 current snap is 126 2026-02-13T20:16:51.922 INFO:tasks.rados.rados.0.trial188.stdout:1295: read oid 36 snap 125 2026-02-13T20:16:51.922 INFO:tasks.rados.rados.0.trial188.stdout:1295: expect (ObjNum 472 snap 122 seq_num 472) 2026-02-13T20:16:51.922 INFO:tasks.rados.rados.0.trial188.stdout:1296: rollback oid 10 current snap is 126 2026-02-13T20:16:51.922 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 10 to 125 2026-02-13T20:16:51.922 INFO:tasks.rados.rados.0.trial188.stdout:1297: snap_create 2026-02-13T20:16:51.926 INFO:tasks.rados.rados.0.trial188.stdout:1294: finishing copy_from to trial18843701-23 2026-02-13T20:16:51.926 INFO:tasks.rados.rados.0.trial188.stdout:1294: got expected ENOENT (src dne) 2026-02-13T20:16:51.927 INFO:tasks.rados.rados.0.trial188.stdout:1294: finishing copy_from racing read to trial18843701-23 2026-02-13T20:16:51.927 INFO:tasks.rados.rados.0.trial188.stdout:1295: expect (ObjNum 472 snap 122 seq_num 472) 2026-02-13T20:16:51.927 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:16:52.012 INFO:tasks.rados.rados.0.trial188.stdout:1292: finishing write tid 1 to trial18843701-30 2026-02-13T20:16:52.013 INFO:tasks.rados.rados.0.trial188.stdout:1296: finishing rollback tid 0 to trial18843701-10 2026-02-13T20:16:52.013 INFO:tasks.rados.rados.0.trial188.stdout:1292: finishing write tid 2 to trial18843701-30 2026-02-13T20:16:52.013 INFO:tasks.rados.rados.0.trial188.stdout:1296: finishing rollback tid 1 to trial18843701-10 2026-02-13T20:16:52.013 INFO:tasks.rados.rados.0.trial188.stdout:1296: finishing rollback tid 2 to trial18843701-10 2026-02-13T20:16:52.013 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 10 v 355 (ObjNum 475 snap 124 seq_num 475) dirty exists 2026-02-13T20:16:52.013 INFO:tasks.rados.rados.0.trial188.stdout:1292: finishing write tid 3 to trial18843701-30 2026-02-13T20:16:52.014 INFO:tasks.rados.rados.0.trial188.stdout:1292: finishing write tid 4 to trial18843701-30 2026-02-13T20:16:52.014 INFO:tasks.rados.rados.0.trial188.stdout:1292: oid 30 updating version 0 to 578 2026-02-13T20:16:52.014 INFO:tasks.rados.rados.0.trial188.stdout:1292: oid 30 updating version 578 to 579 2026-02-13T20:16:52.014 INFO:tasks.rados.rados.0.trial188.stdout:1292: oid 30 version 579 is already newer than 577 2026-02-13T20:16:52.014 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 30 v 579 (ObjNum 485 snap 126 seq_num 485) dirty exists 2026-02-13T20:16:52.014 INFO:tasks.rados.rados.0.trial188.stdout:1292: left oid 30 (ObjNum 485 snap 126 seq_num 485) 2026-02-13T20:16:52.892 INFO:tasks.rados.rados.0.trial188.stdout:1292: done (4 left) 2026-02-13T20:16:52.893 INFO:tasks.rados.rados.0.trial188.stdout:1294: done (3 left) 2026-02-13T20:16:52.893 INFO:tasks.rados.rados.0.trial188.stdout:1295: done (2 left) 2026-02-13T20:16:52.893 INFO:tasks.rados.rados.0.trial188.stdout:1296: done (1 left) 2026-02-13T20:16:52.893 INFO:tasks.rados.rados.0.trial188.stdout:1297: done (0 left) 2026-02-13T20:16:52.893 INFO:tasks.rados.rados.0.trial188.stdout:1298: read oid 5 snap -1 2026-02-13T20:16:52.893 INFO:tasks.rados.rados.0.trial188.stdout:1298: expect deleted 2026-02-13T20:16:52.893 INFO:tasks.rados.rados.0.trial188.stdout:1299: snap_remove snap 125 2026-02-13T20:16:53.892 INFO:tasks.rados.rados.0.trial188.stdout:1299: done (1 left) 2026-02-13T20:16:53.892 INFO:tasks.rados.rados.0.trial188.stdout:1300: snap_remove snap 126 2026-02-13T20:16:54.892 INFO:tasks.rados.rados.0.trial188.stdout:1300: done (1 left) 2026-02-13T20:16:54.893 INFO:tasks.rados.rados.0.trial188.stdout:1301: write oid 12 current snap is 127 2026-02-13T20:16:54.893 INFO:tasks.rados.rados.0.trial188.stdout:1301: seq_num 487 ranges {585009=492855,1564966=620043} 2026-02-13T20:16:54.897 INFO:tasks.rados.rados.0.trial188.stdout:1301: writing trial18843701-12 from 585009 to 1077864 tid 1 2026-02-13T20:16:54.901 INFO:tasks.rados.rados.0.trial188.stdout:1301: writing trial18843701-12 from 1564966 to 2185009 tid 2 2026-02-13T20:16:54.901 INFO:tasks.rados.rados.0.trial188.stdout:1302: copy_from oid 38 from oid 27 current snap is 127 2026-02-13T20:16:54.901 INFO:tasks.rados.rados.0.trial188.stdout:1298: done (2 left) 2026-02-13T20:16:54.902 INFO:tasks.rados.rados.0.trial188.stdout:1303: delete oid 41 current snap is 127 2026-02-13T20:16:54.903 INFO:tasks.rados.rados.0.trial188.stdout:1303: done (2 left) 2026-02-13T20:16:54.903 INFO:tasks.rados.rados.0.trial188.stdout:1304: write (excl) oid 46 current snap is 127 2026-02-13T20:16:54.903 INFO:tasks.rados.rados.0.trial188.stdout:1304: seq_num 489 ranges {618623=643353,1681930=536693} 2026-02-13T20:16:54.907 INFO:tasks.rados.rados.0.trial188.stdout:1304: writing trial18843701-46 from 618623 to 1261976 tid 1 2026-02-13T20:16:54.912 INFO:tasks.rados.rados.0.trial188.stdout:1304: writing trial18843701-46 from 1681930 to 2218623 tid 2 2026-02-13T20:16:54.912 INFO:tasks.rados.rados.0.trial188.stdout:1305: copy_from oid 17 from oid 29 current snap is 127 2026-02-13T20:16:54.912 INFO:tasks.rados.rados.0.trial188.stdout:1306: read oid 32 snap -1 2026-02-13T20:16:54.912 INFO:tasks.rados.rados.0.trial188.stdout:1306: expect deleted 2026-02-13T20:16:54.912 INFO:tasks.rados.rados.0.trial188.stdout:1307: read oid 23 snap -1 2026-02-13T20:16:54.912 INFO:tasks.rados.rados.0.trial188.stdout:1307: expect deleted 2026-02-13T20:16:54.912 INFO:tasks.rados.rados.0.trial188.stdout:1308: write (excl) oid 37 current snap is 127 2026-02-13T20:16:54.912 INFO:tasks.rados.rados.0.trial188.stdout:1308: seq_num 490 ranges {635430=718602,2140412=95018} 2026-02-13T20:16:54.916 INFO:tasks.rados.rados.0.trial188.stdout:1308: writing trial18843701-37 from 635430 to 1354032 tid 1 2026-02-13T20:16:54.920 INFO:tasks.rados.rados.0.trial188.stdout:1308: writing trial18843701-37 from 2140412 to 2235430 tid 2 2026-02-13T20:16:54.920 INFO:tasks.rados.rados.0.trial188.stdout:1309: copy_from oid 16 from oid 21 current snap is 127 2026-02-13T20:16:54.920 INFO:tasks.rados.rados.0.trial188.stdout:1301: finishing write tid 1 to trial18843701-12 2026-02-13T20:16:54.920 INFO:tasks.rados.rados.0.trial188.stdout:1307: done (7 left) 2026-02-13T20:16:54.921 INFO:tasks.rados.rados.0.trial188.stdout:1310: write oid 26 current snap is 127 2026-02-13T20:16:54.921 INFO:tasks.rados.rados.0.trial188.stdout:1310: seq_num 491 ranges {652237=793851,2198894=53343} 2026-02-13T20:16:54.925 INFO:tasks.rados.rados.0.trial188.stdout:1310: writing trial18843701-26 from 652237 to 1446088 tid 1 2026-02-13T20:16:54.929 INFO:tasks.rados.rados.0.trial188.stdout:1310: writing trial18843701-26 from 2198894 to 2252237 tid 2 2026-02-13T20:16:54.929 INFO:tasks.rados.rados.0.trial188.stdout:1311: copy_from oid 13 from oid 45 current snap is 127 2026-02-13T20:16:54.929 INFO:tasks.rados.rados.0.trial188.stdout:1301: finishing write tid 2 to trial18843701-12 2026-02-13T20:16:54.929 INFO:tasks.rados.rados.0.trial188.stdout:1304: finishing write tid 1 to trial18843701-46 2026-02-13T20:16:54.929 INFO:tasks.rados.rados.0.trial188.stdout:1302: finishing copy_from racing read to trial18843701-38 2026-02-13T20:16:54.929 INFO:tasks.rados.rados.0.trial188.stdout:1312: rollback oid 11 current snap is 127 2026-02-13T20:16:54.930 INFO:tasks.rados.rados.0.trial188.stdout:1312: done (9 left) 2026-02-13T20:16:54.930 INFO:tasks.rados.rados.0.trial188.stdout:1313: write oid 25 current snap is 127 2026-02-13T20:16:54.930 INFO:tasks.rados.rados.0.trial188.stdout:1313: seq_num 492 ranges {669044=469100,1741023=459161} 2026-02-13T20:16:54.932 INFO:tasks.rados.rados.0.trial188.stdout:1313: writing trial18843701-25 from 669044 to 1138144 tid 1 2026-02-13T20:16:54.936 INFO:tasks.rados.rados.0.trial188.stdout:1313: writing trial18843701-25 from 1741023 to 2200184 tid 2 2026-02-13T20:16:54.936 INFO:tasks.rados.rados.0.trial188.stdout:1314: snap_create 2026-02-13T20:16:54.945 INFO:tasks.rados.rados.0.trial188.stdout:1310: finishing write tid 1 to trial18843701-26 2026-02-13T20:16:54.945 INFO:tasks.rados.rados.0.trial188.stdout:1310: finishing write tid 2 to trial18843701-26 2026-02-13T20:16:54.945 INFO:tasks.rados.rados.0.trial188.stdout:1310: finishing write tid 3 to trial18843701-26 2026-02-13T20:16:54.945 INFO:tasks.rados.rados.0.trial188.stdout:1310: finishing write tid 4 to trial18843701-26 2026-02-13T20:16:54.945 INFO:tasks.rados.rados.0.trial188.stdout:1310: oid 26 updating version 0 to 449 2026-02-13T20:16:54.945 INFO:tasks.rados.rados.0.trial188.stdout:1310: oid 26 updating version 449 to 450 2026-02-13T20:16:54.945 INFO:tasks.rados.rados.0.trial188.stdout:1310: oid 26 updating version 450 to 451 2026-02-13T20:16:54.946 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 26 v 451 (ObjNum 491 snap 127 seq_num 491) dirty exists 2026-02-13T20:16:54.946 INFO:tasks.rados.rados.0.trial188.stdout:1310: left oid 26 (ObjNum 491 snap 127 seq_num 491) 2026-02-13T20:16:54.946 INFO:tasks.rados.rados.0.trial188.stdout:1308: finishing write tid 1 to trial18843701-37 2026-02-13T20:16:54.946 INFO:tasks.rados.rados.0.trial188.stdout:1308: finishing write tid 2 to trial18843701-37 2026-02-13T20:16:54.946 INFO:tasks.rados.rados.0.trial188.stdout:1308: finishing write tid 3 to trial18843701-37 2026-02-13T20:16:54.946 INFO:tasks.rados.rados.0.trial188.stdout:1308: finishing write tid 4 to trial18843701-37 2026-02-13T20:16:54.946 INFO:tasks.rados.rados.0.trial188.stdout:1308: oid 37 updating version 0 to 516 2026-02-13T20:16:54.946 INFO:tasks.rados.rados.0.trial188.stdout:1308: oid 37 updating version 516 to 518 2026-02-13T20:16:54.946 INFO:tasks.rados.rados.0.trial188.stdout:1308: oid 37 version 518 is already newer than 517 2026-02-13T20:16:54.947 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 37 v 518 (ObjNum 490 snap 127 seq_num 490) dirty exists 2026-02-13T20:16:54.947 INFO:tasks.rados.rados.0.trial188.stdout:1308: left oid 37 (ObjNum 490 snap 127 seq_num 490) 2026-02-13T20:16:54.947 INFO:tasks.rados.rados.0.trial188.stdout:1302: finishing copy_from to trial18843701-38 2026-02-13T20:16:54.947 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 38 v 549 (ObjNum 387 snap 101 seq_num 387) dirty exists 2026-02-13T20:16:54.949 INFO:tasks.rados.rados.0.trial188.stdout:1305: finishing copy_from racing read to trial18843701-17 2026-02-13T20:16:54.950 INFO:tasks.rados.rados.0.trial188.stdout:1313: finishing write tid 1 to trial18843701-25 2026-02-13T20:16:54.952 INFO:tasks.rados.rados.0.trial188.stdout:1313: finishing write tid 2 to trial18843701-25 2026-02-13T20:16:54.952 INFO:tasks.rados.rados.0.trial188.stdout:1304: finishing write tid 2 to trial18843701-46 2026-02-13T20:16:54.952 INFO:tasks.rados.rados.0.trial188.stdout:1301: finishing write tid 3 to trial18843701-12 2026-02-13T20:16:54.952 INFO:tasks.rados.rados.0.trial188.stdout:1313: finishing write tid 3 to trial18843701-25 2026-02-13T20:16:54.952 INFO:tasks.rados.rados.0.trial188.stdout:1304: finishing write tid 3 to trial18843701-46 2026-02-13T20:16:54.953 INFO:tasks.rados.rados.0.trial188.stdout:1301: finishing write tid 4 to trial18843701-12 2026-02-13T20:16:54.953 INFO:tasks.rados.rados.0.trial188.stdout:1301: oid 12 updating version 0 to 461 2026-02-13T20:16:54.953 INFO:tasks.rados.rados.0.trial188.stdout:1301: oid 12 version 461 is already newer than 459 2026-02-13T20:16:54.953 INFO:tasks.rados.rados.0.trial188.stdout:1301: oid 12 version 461 is already newer than 460 2026-02-13T20:16:54.953 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 12 v 461 (ObjNum 487 snap 127 seq_num 487) dirty exists 2026-02-13T20:16:54.953 INFO:tasks.rados.rados.0.trial188.stdout:1301: left oid 12 (ObjNum 487 snap 127 seq_num 487) 2026-02-13T20:16:54.953 INFO:tasks.rados.rados.0.trial188.stdout:1313: finishing write tid 4 to trial18843701-25 2026-02-13T20:16:54.953 INFO:tasks.rados.rados.0.trial188.stdout:1313: oid 25 updating version 0 to 585 2026-02-13T20:16:54.953 INFO:tasks.rados.rados.0.trial188.stdout:1313: oid 25 updating version 585 to 587 2026-02-13T20:16:54.953 INFO:tasks.rados.rados.0.trial188.stdout:1313: oid 25 version 587 is already newer than 586 2026-02-13T20:16:54.954 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 25 v 587 (ObjNum 492 snap 127 seq_num 492) dirty exists 2026-02-13T20:16:54.954 INFO:tasks.rados.rados.0.trial188.stdout:1313: left oid 25 (ObjNum 492 snap 127 seq_num 492) 2026-02-13T20:16:54.954 INFO:tasks.rados.rados.0.trial188.stdout:1305: finishing copy_from to trial18843701-17 2026-02-13T20:16:54.954 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 17 v 444 (ObjNum 417 snap 111 seq_num 417) dirty exists 2026-02-13T20:16:54.954 INFO:tasks.rados.rados.0.trial188.stdout:1304: finishing write tid 4 to trial18843701-46 2026-02-13T20:16:54.954 INFO:tasks.rados.rados.0.trial188.stdout:1304: oid 46 updating version 0 to 415 2026-02-13T20:16:54.954 INFO:tasks.rados.rados.0.trial188.stdout:1304: oid 46 version 415 is already newer than 414 2026-02-13T20:16:54.954 INFO:tasks.rados.rados.0.trial188.stdout:1304: oid 46 version 415 is already newer than 413 2026-02-13T20:16:54.954 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 46 v 415 (ObjNum 489 snap 127 seq_num 489) dirty exists 2026-02-13T20:16:54.955 INFO:tasks.rados.rados.0.trial188.stdout:1304: left oid 46 (ObjNum 489 snap 127 seq_num 489) 2026-02-13T20:16:54.973 INFO:tasks.rados.rados.0.trial188.stdout:1311: finishing copy_from racing read to trial18843701-13 2026-02-13T20:16:54.982 INFO:tasks.rados.rados.0.trial188.stdout:1311: finishing copy_from to trial18843701-13 2026-02-13T20:16:54.982 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 13 v 495 (ObjNum 471 snap 121 seq_num 471) dirty exists 2026-02-13T20:16:54.993 INFO:tasks.rados.rados.0.trial188.stdout:1309: finishing copy_from racing read to trial18843701-16 2026-02-13T20:16:54.994 INFO:tasks.rados.rados.0.trial188.stdout:1309: finishing copy_from to trial18843701-16 2026-02-13T20:16:54.994 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 16 v 228 (ObjNum 469 snap 121 seq_num 469) dirty exists 2026-02-13T20:16:55.914 INFO:tasks.rados.rados.0.trial188.stdout:1301: done (10 left) 2026-02-13T20:16:55.914 INFO:tasks.rados.rados.0.trial188.stdout:1302: done (9 left) 2026-02-13T20:16:55.914 INFO:tasks.rados.rados.0.trial188.stdout:1304: done (8 left) 2026-02-13T20:16:55.914 INFO:tasks.rados.rados.0.trial188.stdout:1305: done (7 left) 2026-02-13T20:16:55.915 INFO:tasks.rados.rados.0.trial188.stdout:1306: done (6 left) 2026-02-13T20:16:55.915 INFO:tasks.rados.rados.0.trial188.stdout:1308: done (5 left) 2026-02-13T20:16:55.915 INFO:tasks.rados.rados.0.trial188.stdout:1309: done (4 left) 2026-02-13T20:16:55.915 INFO:tasks.rados.rados.0.trial188.stdout:1310: done (3 left) 2026-02-13T20:16:55.915 INFO:tasks.rados.rados.0.trial188.stdout:1311: done (2 left) 2026-02-13T20:16:55.915 INFO:tasks.rados.rados.0.trial188.stdout:1313: done (1 left) 2026-02-13T20:16:55.915 INFO:tasks.rados.rados.0.trial188.stdout:1314: done (0 left) 2026-02-13T20:16:55.915 INFO:tasks.rados.rados.0.trial188.stdout:1315: write (excl) oid 2 current snap is 128 2026-02-13T20:16:55.915 INFO:tasks.rados.rados.0.trial188.stdout:1315: seq_num 493 ranges {685851=544349,1799505=486346} 2026-02-13T20:16:55.918 INFO:tasks.rados.rados.0.trial188.stdout:1315: writing trial18843701-2 from 685851 to 1230200 tid 1 2026-02-13T20:16:55.923 INFO:tasks.rados.rados.0.trial188.stdout:1315: writing trial18843701-2 from 1799505 to 2285851 tid 2 2026-02-13T20:16:55.923 INFO:tasks.rados.rados.0.trial188.stdout:1316: read oid 22 snap -1 2026-02-13T20:16:55.923 INFO:tasks.rados.rados.0.trial188.stdout:1316: expect (ObjNum 409 snap 109 seq_num 409) 2026-02-13T20:16:55.923 INFO:tasks.rados.rados.0.trial188.stdout:1317: delete oid 26 current snap is 128 2026-02-13T20:16:55.928 INFO:tasks.rados.rados.0.trial188.stdout:1317: done (2 left) 2026-02-13T20:16:55.929 INFO:tasks.rados.rados.0.trial188.stdout:1318: rollback oid 10 current snap is 128 2026-02-13T20:16:55.929 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 10 to 127 2026-02-13T20:16:55.929 INFO:tasks.rados.rados.0.trial188.stdout:1319: write oid 35 current snap is 128 2026-02-13T20:16:55.929 INFO:tasks.rados.rados.0.trial188.stdout:1319: seq_num 495 ranges {719465=411200,1632822=686643} 2026-02-13T20:16:55.932 INFO:tasks.rados.rados.0.trial188.stdout:1319: writing trial18843701-35 from 719465 to 1130665 tid 1 2026-02-13T20:16:55.939 INFO:tasks.rados.rados.0.trial188.stdout:1319: writing trial18843701-35 from 1632822 to 2319465 tid 2 2026-02-13T20:16:55.939 INFO:tasks.rados.rados.0.trial188.stdout:1320: rollback oid 21 current snap is 128 2026-02-13T20:16:55.940 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 21 to 127 2026-02-13T20:16:55.940 INFO:tasks.rados.rados.0.trial188.stdout:1318: finishing rollback tid 0 to trial18843701-10 2026-02-13T20:16:55.940 INFO:tasks.rados.rados.0.trial188.stdout:1318: finishing rollback tid 1 to trial18843701-10 2026-02-13T20:16:55.940 INFO:tasks.rados.rados.0.trial188.stdout:1318: finishing rollback tid 2 to trial18843701-10 2026-02-13T20:16:55.940 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 10 v 359 (ObjNum 475 snap 124 seq_num 475) dirty exists 2026-02-13T20:16:55.940 INFO:tasks.rados.rados.0.trial188.stdout:1315: finishing write tid 1 to trial18843701-2 2026-02-13T20:16:55.940 INFO:tasks.rados.rados.0.trial188.stdout:1315: finishing write tid 2 to trial18843701-2 2026-02-13T20:16:55.940 INFO:tasks.rados.rados.0.trial188.stdout:1315: finishing write tid 3 to trial18843701-2 2026-02-13T20:16:55.941 INFO:tasks.rados.rados.0.trial188.stdout:1315: finishing write tid 4 to trial18843701-2 2026-02-13T20:16:55.941 INFO:tasks.rados.rados.0.trial188.stdout:1315: oid 2 updating version 0 to 516 2026-02-13T20:16:55.941 INFO:tasks.rados.rados.0.trial188.stdout:1315: oid 2 updating version 516 to 517 2026-02-13T20:16:55.941 INFO:tasks.rados.rados.0.trial188.stdout:1315: oid 2 updating version 517 to 518 2026-02-13T20:16:55.941 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 2 v 518 (ObjNum 493 snap 128 seq_num 493) dirty exists 2026-02-13T20:16:55.941 INFO:tasks.rados.rados.0.trial188.stdout:1315: left oid 2 (ObjNum 493 snap 128 seq_num 493) 2026-02-13T20:16:55.941 INFO:tasks.rados.rados.0.trial188.stdout:1315: done (4 left) 2026-02-13T20:16:55.941 INFO:tasks.rados.rados.0.trial188.stdout:1318: done (3 left) 2026-02-13T20:16:55.941 INFO:tasks.rados.rados.0.trial188.stdout:1321: rollback oid 32 current snap is 128 2026-02-13T20:16:55.942 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 32 to 127 2026-02-13T20:16:55.942 INFO:tasks.rados.rados.0.trial188.stdout:1322: read oid 11 snap 127 2026-02-13T20:16:55.942 INFO:tasks.rados.rados.0.trial188.stdout:1322: expect (ObjNum 481 snap 126 seq_num 481) 2026-02-13T20:16:55.942 INFO:tasks.rados.rados.0.trial188.stdout:1323: rollback oid 31 current snap is 128 2026-02-13T20:16:55.942 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 31 to 127 2026-02-13T20:16:55.942 INFO:tasks.rados.rados.0.trial188.stdout:1324: rollback oid 17 current snap is 128 2026-02-13T20:16:55.942 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 17 to 127 2026-02-13T20:16:55.942 INFO:tasks.rados.rados.0.trial188.stdout:1325: write oid 49 current snap is 128 2026-02-13T20:16:55.942 INFO:tasks.rados.rados.0.trial188.stdout:1325: seq_num 496 ranges {736272=486449,1974951=361321} 2026-02-13T20:16:55.943 INFO:tasks.rados.rados.0.trial188.stdout:1325: writing trial18843701-49 from 736272 to 1222721 tid 1 2026-02-13T20:16:55.947 INFO:tasks.rados.rados.0.trial188.stdout:1325: writing trial18843701-49 from 1974951 to 2336272 tid 2 2026-02-13T20:16:55.947 INFO:tasks.rados.rados.0.trial188.stdout:1326: read oid 6 snap 127 2026-02-13T20:16:55.947 INFO:tasks.rados.rados.0.trial188.stdout:1326: expect (ObjNum 437 snap 113 seq_num 437) 2026-02-13T20:16:55.947 INFO:tasks.rados.rados.0.trial188.stdout:1327: copy_from oid 5 from oid 38 current snap is 128 2026-02-13T20:16:55.947 INFO:tasks.rados.rados.0.trial188.stdout:1316: expect (ObjNum 409 snap 109 seq_num 409) 2026-02-13T20:16:55.991 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:16:56.072 INFO:tasks.rados.rados.0.trial188.stdout:1321: finishing rollback tid 1 to trial18843701-32 2026-02-13T20:16:56.072 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 32 v 0 (ObjNum 1201 snap 0 seq_num 15108528) dirty dne 2026-02-13T20:16:56.073 INFO:tasks.rados.rados.0.trial188.stdout:1322: expect (ObjNum 481 snap 126 seq_num 481) 2026-02-13T20:16:56.073 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:16:56.115 INFO:tasks.rados.rados.0.trial188.stdout:1320: finishing rollback tid 0 to trial18843701-21 2026-02-13T20:16:56.116 INFO:tasks.rados.rados.0.trial188.stdout:1316: done (9 left) 2026-02-13T20:16:56.116 INFO:tasks.rados.rados.0.trial188.stdout:1321: done (8 left) 2026-02-13T20:16:56.116 INFO:tasks.rados.rados.0.trial188.stdout:1322: done (7 left) 2026-02-13T20:16:56.116 INFO:tasks.rados.rados.0.trial188.stdout:1328: write (excl) oid 19 current snap is 128 2026-02-13T20:16:56.116 INFO:tasks.rados.rados.0.trial188.stdout:1320: finishing rollback tid 1 to trial18843701-21 2026-02-13T20:16:56.116 INFO:tasks.rados.rados.0.trial188.stdout:1320: finishing rollback tid 2 to trial18843701-21 2026-02-13T20:16:56.116 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 21 v 242 (ObjNum 469 snap 121 seq_num 469) dirty exists 2026-02-13T20:16:56.116 INFO:tasks.rados.rados.0.trial188.stdout:1324: finishing rollback tid 0 to trial18843701-17 2026-02-13T20:16:56.116 INFO:tasks.rados.rados.0.trial188.stdout:1328: seq_num 497 ranges {753079=561698,2033433=319646} 2026-02-13T20:16:56.120 INFO:tasks.rados.rados.0.trial188.stdout:1328: writing trial18843701-19 from 753079 to 1314777 tid 1 2026-02-13T20:16:56.125 INFO:tasks.rados.rados.0.trial188.stdout:1328: writing trial18843701-19 from 2033433 to 2353079 tid 2 2026-02-13T20:16:56.125 INFO:tasks.rados.rados.0.trial188.stdout:1320: done (7 left) 2026-02-13T20:16:56.125 INFO:tasks.rados.rados.0.trial188.stdout:1329: copy_from oid 39 from oid 16 current snap is 128 2026-02-13T20:16:56.125 INFO:tasks.rados.rados.0.trial188.stdout:1324: finishing rollback tid 1 to trial18843701-17 2026-02-13T20:16:56.125 INFO:tasks.rados.rados.0.trial188.stdout:1324: finishing rollback tid 2 to trial18843701-17 2026-02-13T20:16:56.125 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 17 v 464 (ObjNum 417 snap 111 seq_num 417) dirty exists 2026-02-13T20:16:56.125 INFO:tasks.rados.rados.0.trial188.stdout:1319: finishing write tid 1 to trial18843701-35 2026-02-13T20:16:56.125 INFO:tasks.rados.rados.0.trial188.stdout:1324: done (7 left) 2026-02-13T20:16:56.125 INFO:tasks.rados.rados.0.trial188.stdout:1330: rollback oid 21 current snap is 128 2026-02-13T20:16:56.125 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 21 to 127 2026-02-13T20:16:56.125 INFO:tasks.rados.rados.0.trial188.stdout:1323: finishing rollback tid 0 to trial18843701-31 2026-02-13T20:16:56.125 INFO:tasks.rados.rados.0.trial188.stdout:1323: finishing rollback tid 1 to trial18843701-31 2026-02-13T20:16:56.126 INFO:tasks.rados.rados.0.trial188.stdout:1323: finishing rollback tid 2 to trial18843701-31 2026-02-13T20:16:56.126 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 31 v 340 (ObjNum 437 snap 113 seq_num 437) dirty exists 2026-02-13T20:16:56.126 INFO:tasks.rados.rados.0.trial188.stdout:1326: expect (ObjNum 437 snap 113 seq_num 437) 2026-02-13T20:16:56.126 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:16:56.256 INFO:tasks.rados.rados.0.trial188.stdout:1319: finishing write tid 2 to trial18843701-35 2026-02-13T20:16:56.256 INFO:tasks.rados.rados.0.trial188.stdout:1323: done (7 left) 2026-02-13T20:16:56.256 INFO:tasks.rados.rados.0.trial188.stdout:1326: done (6 left) 2026-02-13T20:16:56.256 INFO:tasks.rados.rados.0.trial188.stdout:1331: write (excl) oid 40 current snap is 128 2026-02-13T20:16:56.256 INFO:tasks.rados.rados.0.trial188.stdout:1331: seq_num 498 ranges {769886=636947,2091915=277971} 2026-02-13T20:16:56.262 INFO:tasks.rados.rados.0.trial188.stdout:1331: writing trial18843701-40 from 769886 to 1406833 tid 1 2026-02-13T20:16:56.267 INFO:tasks.rados.rados.0.trial188.stdout:1331: writing trial18843701-40 from 2091915 to 2369886 tid 2 2026-02-13T20:16:56.267 INFO:tasks.rados.rados.0.trial188.stdout:1332: rollback oid 26 current snap is 128 2026-02-13T20:16:56.267 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 26 to 127 2026-02-13T20:16:56.267 INFO:tasks.rados.rados.0.trial188.stdout:1319: finishing write tid 3 to trial18843701-35 2026-02-13T20:16:56.268 INFO:tasks.rados.rados.0.trial188.stdout:1319: finishing write tid 4 to trial18843701-35 2026-02-13T20:16:56.268 INFO:tasks.rados.rados.0.trial188.stdout:1319: oid 35 updating version 0 to 404 2026-02-13T20:16:56.268 INFO:tasks.rados.rados.0.trial188.stdout:1319: oid 35 version 404 is already newer than 403 2026-02-13T20:16:56.268 INFO:tasks.rados.rados.0.trial188.stdout:1319: oid 35 updating version 404 to 405 2026-02-13T20:16:56.268 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 35 v 405 (ObjNum 495 snap 128 seq_num 495) dirty exists 2026-02-13T20:16:56.268 INFO:tasks.rados.rados.0.trial188.stdout:1319: left oid 35 (ObjNum 495 snap 128 seq_num 495) 2026-02-13T20:16:56.268 INFO:tasks.rados.rados.0.trial188.stdout:1325: finishing write tid 1 to trial18843701-49 2026-02-13T20:16:56.268 INFO:tasks.rados.rados.0.trial188.stdout:1325: finishing write tid 2 to trial18843701-49 2026-02-13T20:16:56.268 INFO:tasks.rados.rados.0.trial188.stdout:1325: finishing write tid 3 to trial18843701-49 2026-02-13T20:16:56.268 INFO:tasks.rados.rados.0.trial188.stdout:1325: finishing write tid 4 to trial18843701-49 2026-02-13T20:16:56.268 INFO:tasks.rados.rados.0.trial188.stdout:1325: oid 49 updating version 0 to 589 2026-02-13T20:16:56.268 INFO:tasks.rados.rados.0.trial188.stdout:1325: oid 49 updating version 589 to 590 2026-02-13T20:16:56.268 INFO:tasks.rados.rados.0.trial188.stdout:1325: oid 49 version 590 is already newer than 588 2026-02-13T20:16:56.268 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 49 v 590 (ObjNum 496 snap 128 seq_num 496) dirty exists 2026-02-13T20:16:56.268 INFO:tasks.rados.rados.0.trial188.stdout:1325: left oid 49 (ObjNum 496 snap 128 seq_num 496) 2026-02-13T20:16:56.268 INFO:tasks.rados.rados.0.trial188.stdout:1327: finishing copy_from racing read to trial18843701-5 2026-02-13T20:16:56.268 INFO:tasks.rados.rados.0.trial188.stdout:1327: finishing copy_from to trial18843701-5 2026-02-13T20:16:56.268 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 5 v 549 (ObjNum 387 snap 101 seq_num 387) dirty exists 2026-02-13T20:16:56.268 INFO:tasks.rados.rados.0.trial188.stdout:1330: finishing rollback tid 0 to trial18843701-21 2026-02-13T20:16:56.268 INFO:tasks.rados.rados.0.trial188.stdout:1330: finishing rollback tid 1 to trial18843701-21 2026-02-13T20:16:56.268 INFO:tasks.rados.rados.0.trial188.stdout:1330: finishing rollback tid 2 to trial18843701-21 2026-02-13T20:16:56.268 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 21 v 245 (ObjNum 469 snap 121 seq_num 469) dirty exists 2026-02-13T20:16:56.268 INFO:tasks.rados.rados.0.trial188.stdout:1328: finishing write tid 1 to trial18843701-19 2026-02-13T20:16:56.268 INFO:tasks.rados.rados.0.trial188.stdout:1319: done (7 left) 2026-02-13T20:16:56.268 INFO:tasks.rados.rados.0.trial188.stdout:1325: done (6 left) 2026-02-13T20:16:56.268 INFO:tasks.rados.rados.0.trial188.stdout:1327: done (5 left) 2026-02-13T20:16:56.268 INFO:tasks.rados.rados.0.trial188.stdout:1330: done (4 left) 2026-02-13T20:16:56.268 INFO:tasks.rados.rados.0.trial188.stdout:1333: snap_create 2026-02-13T20:16:56.268 INFO:tasks.rados.rados.0.trial188.stdout:1328: finishing write tid 2 to trial18843701-19 2026-02-13T20:16:56.268 INFO:tasks.rados.rados.0.trial188.stdout:1328: finishing write tid 3 to trial18843701-19 2026-02-13T20:16:56.268 INFO:tasks.rados.rados.0.trial188.stdout:1328: finishing write tid 4 to trial18843701-19 2026-02-13T20:16:56.268 INFO:tasks.rados.rados.0.trial188.stdout:1328: oid 19 updating version 0 to 477 2026-02-13T20:16:56.268 INFO:tasks.rados.rados.0.trial188.stdout:1328: oid 19 updating version 477 to 478 2026-02-13T20:16:56.268 INFO:tasks.rados.rados.0.trial188.stdout:1328: oid 19 version 478 is already newer than 476 2026-02-13T20:16:56.268 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 19 v 478 (ObjNum 497 snap 128 seq_num 497) dirty exists 2026-02-13T20:16:56.268 INFO:tasks.rados.rados.0.trial188.stdout:1328: left oid 19 (ObjNum 497 snap 128 seq_num 497) 2026-02-13T20:16:56.268 INFO:tasks.rados.rados.0.trial188.stdout:1329: finishing copy_from racing read to trial18843701-39 2026-02-13T20:16:56.268 INFO:tasks.rados.rados.0.trial188.stdout:1329: finishing copy_from to trial18843701-39 2026-02-13T20:16:56.268 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 39 v 228 (ObjNum 469 snap 121 seq_num 469) dirty exists 2026-02-13T20:16:56.268 INFO:tasks.rados.rados.0.trial188.stdout:1332: finishing rollback tid 1 to trial18843701-26 2026-02-13T20:16:56.268 INFO:tasks.rados.rados.0.trial188.stdout:1332: finishing rollback tid 2 to trial18843701-26 2026-02-13T20:16:56.269 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 26 v 454 (ObjNum 491 snap 127 seq_num 491) dirty exists 2026-02-13T20:16:56.278 INFO:tasks.rados.rados.0.trial188.stdout:1331: finishing write tid 1 to trial18843701-40 2026-02-13T20:16:56.278 INFO:tasks.rados.rados.0.trial188.stdout:1331: finishing write tid 2 to trial18843701-40 2026-02-13T20:16:56.278 INFO:tasks.rados.rados.0.trial188.stdout:1331: finishing write tid 3 to trial18843701-40 2026-02-13T20:16:56.278 INFO:tasks.rados.rados.0.trial188.stdout:1331: finishing write tid 4 to trial18843701-40 2026-02-13T20:16:56.278 INFO:tasks.rados.rados.0.trial188.stdout:1331: oid 40 updating version 0 to 418 2026-02-13T20:16:56.278 INFO:tasks.rados.rados.0.trial188.stdout:1331: oid 40 version 418 is already newer than 417 2026-02-13T20:16:56.278 INFO:tasks.rados.rados.0.trial188.stdout:1331: oid 40 version 418 is already newer than 416 2026-02-13T20:16:56.278 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 40 v 418 (ObjNum 498 snap 128 seq_num 498) dirty exists 2026-02-13T20:16:56.279 INFO:tasks.rados.rados.0.trial188.stdout:1331: left oid 40 (ObjNum 498 snap 128 seq_num 498) 2026-02-13T20:16:56.919 INFO:tasks.rados.rados.0.trial188.stdout:1328: done (4 left) 2026-02-13T20:16:56.919 INFO:tasks.rados.rados.0.trial188.stdout:1329: done (3 left) 2026-02-13T20:16:56.920 INFO:tasks.rados.rados.0.trial188.stdout:1331: done (2 left) 2026-02-13T20:16:56.920 INFO:tasks.rados.rados.0.trial188.stdout:1332: done (1 left) 2026-02-13T20:16:56.920 INFO:tasks.rados.rados.0.trial188.stdout:1333: done (0 left) 2026-02-13T20:16:56.920 INFO:tasks.rados.rados.0.trial188.stdout:1334: read oid 6 snap -1 2026-02-13T20:16:56.920 INFO:tasks.rados.rados.0.trial188.stdout:1334: expect (ObjNum 437 snap 113 seq_num 437) 2026-02-13T20:16:56.920 INFO:tasks.rados.rados.0.trial188.stdout:1335: snap_remove snap 128 2026-02-13T20:16:57.892 INFO:tasks.rados.rados.0.trial188.stdout:1335: done (1 left) 2026-02-13T20:16:57.892 INFO:tasks.rados.rados.0.trial188.stdout:1336: rollback oid 23 current snap is 129 2026-02-13T20:16:57.893 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 23 to 127 2026-02-13T20:16:57.893 INFO:tasks.rados.rados.0.trial188.stdout:1334: expect (ObjNum 437 snap 113 seq_num 437) 2026-02-13T20:16:58.014 INFO:tasks.rados.rados.0.trial188.stdout:1336: finishing rollback tid 1 to trial18843701-23 2026-02-13T20:16:58.014 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 23 v 0 (ObjNum 289 snap 0 seq_num 13867344) dirty dne 2026-02-13T20:16:58.014 INFO:tasks.rados.rados.0.trial188.stdout:1334: done (1 left) 2026-02-13T20:16:58.015 INFO:tasks.rados.rados.0.trial188.stdout:1336: done (0 left) 2026-02-13T20:16:58.015 INFO:tasks.rados.rados.0.trial188.stdout:1337: snap_create 2026-02-13T20:16:58.920 INFO:tasks.rados.rados.0.trial188.stdout:1337: done (0 left) 2026-02-13T20:16:58.921 INFO:tasks.rados.rados.0.trial188.stdout:1338: delete oid 22 current snap is 130 2026-02-13T20:16:58.922 INFO:tasks.rados.rados.0.trial188.stdout:1338: done (0 left) 2026-02-13T20:16:58.923 INFO:tasks.rados.rados.0.trial188.stdout:1339: snap_remove snap 127 2026-02-13T20:16:59.923 INFO:tasks.rados.rados.0.trial188.stdout:1339: done (0 left) 2026-02-13T20:16:59.923 INFO:tasks.rados.rados.0.trial188.stdout:1340: delete oid 49 current snap is 130 2026-02-13T20:16:59.926 INFO:tasks.rados.rados.0.trial188.stdout:1340: done (0 left) 2026-02-13T20:16:59.927 INFO:tasks.rados.rados.0.trial188.stdout:1341: write (excl) oid 12 current snap is 130 2026-02-13T20:16:59.927 INFO:tasks.rados.rados.0.trial188.stdout:1341: seq_num 501 ranges {420307=462694,1351008=617495} 2026-02-13T20:16:59.929 INFO:tasks.rados.rados.0.trial188.stdout:1341: writing trial18843701-12 from 420307 to 883001 tid 1 2026-02-13T20:16:59.933 INFO:tasks.rados.rados.0.trial188.stdout:1341: writing trial18843701-12 from 1351008 to 1968503 tid 2 2026-02-13T20:16:59.934 INFO:tasks.rados.rados.0.trial188.stdout:1342: delete oid 18 current snap is 130 2026-02-13T20:16:59.946 INFO:tasks.rados.rados.0.trial188.stdout:1341: finishing write tid 1 to trial18843701-12 2026-02-13T20:16:59.947 INFO:tasks.rados.rados.0.trial188.stdout:1341: finishing write tid 2 to trial18843701-12 2026-02-13T20:16:59.947 INFO:tasks.rados.rados.0.trial188.stdout:1341: finishing write tid 3 to trial18843701-12 2026-02-13T20:16:59.947 INFO:tasks.rados.rados.0.trial188.stdout:1341: finishing write tid 4 to trial18843701-12 2026-02-13T20:16:59.947 INFO:tasks.rados.rados.0.trial188.stdout:1341: oid 12 updating version 0 to 466 2026-02-13T20:16:59.947 INFO:tasks.rados.rados.0.trial188.stdout:1341: oid 12 version 466 is already newer than 465 2026-02-13T20:16:59.947 INFO:tasks.rados.rados.0.trial188.stdout:1341: oid 12 updating version 466 to 467 2026-02-13T20:16:59.947 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 12 v 467 (ObjNum 501 snap 130 seq_num 501) dirty exists 2026-02-13T20:16:59.947 INFO:tasks.rados.rados.0.trial188.stdout:1341: left oid 12 (ObjNum 501 snap 130 seq_num 501) 2026-02-13T20:16:59.948 INFO:tasks.rados.rados.0.trial188.stdout:1341: done (1 left) 2026-02-13T20:16:59.948 INFO:tasks.rados.rados.0.trial188.stdout:1342: done (0 left) 2026-02-13T20:16:59.948 INFO:tasks.rados.rados.0.trial188.stdout:1343: read oid 38 snap -1 2026-02-13T20:16:59.948 INFO:tasks.rados.rados.0.trial188.stdout:1343: expect (ObjNum 387 snap 101 seq_num 387) 2026-02-13T20:16:59.948 INFO:tasks.rados.rados.0.trial188.stdout:1344: write oid 35 current snap is 130 2026-02-13T20:16:59.948 INFO:tasks.rados.rados.0.trial188.stdout:1344: seq_num 503 ranges {453921=729545,1584325=621164} 2026-02-13T20:16:59.951 INFO:tasks.rados.rados.0.trial188.stdout:1344: writing trial18843701-35 from 453921 to 1183466 tid 1 2026-02-13T20:16:59.955 INFO:tasks.rados.rados.0.trial188.stdout:1344: writing trial18843701-35 from 1584325 to 2205489 tid 2 2026-02-13T20:16:59.955 INFO:tasks.rados.rados.0.trial188.stdout:1345: snap_create 2026-02-13T20:16:59.955 INFO:tasks.rados.rados.0.trial188.stdout:1343: expect (ObjNum 387 snap 101 seq_num 387) 2026-02-13T20:16:59.961 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1477115 2026-02-13T20:16:59.990 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2097244 2026-02-13T20:17:00.023 INFO:tasks.rados.rados.0.trial188.stdout:1344: finishing write tid 1 to trial18843701-35 2026-02-13T20:17:00.024 INFO:tasks.rados.rados.0.trial188.stdout:1344: finishing write tid 2 to trial18843701-35 2026-02-13T20:17:00.024 INFO:tasks.rados.rados.0.trial188.stdout:1344: finishing write tid 3 to trial18843701-35 2026-02-13T20:17:00.024 INFO:tasks.rados.rados.0.trial188.stdout:1344: finishing write tid 4 to trial18843701-35 2026-02-13T20:17:00.024 INFO:tasks.rados.rados.0.trial188.stdout:1344: oid 35 updating version 0 to 407 2026-02-13T20:17:00.024 INFO:tasks.rados.rados.0.trial188.stdout:1344: oid 35 updating version 407 to 408 2026-02-13T20:17:00.024 INFO:tasks.rados.rados.0.trial188.stdout:1344: oid 35 version 408 is already newer than 406 2026-02-13T20:17:00.024 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 35 v 408 (ObjNum 503 snap 130 seq_num 503) dirty exists 2026-02-13T20:17:00.024 INFO:tasks.rados.rados.0.trial188.stdout:1344: left oid 35 (ObjNum 503 snap 130 seq_num 503) 2026-02-13T20:17:00.926 INFO:tasks.rados.rados.0.trial188.stdout:1343: done (2 left) 2026-02-13T20:17:00.927 INFO:tasks.rados.rados.0.trial188.stdout:1344: done (1 left) 2026-02-13T20:17:00.927 INFO:tasks.rados.rados.0.trial188.stdout:1345: done (0 left) 2026-02-13T20:17:00.927 INFO:tasks.rados.rados.0.trial188.stdout:1346: copy_from oid 48 from oid 46 current snap is 131 2026-02-13T20:17:00.927 INFO:tasks.rados.rados.0.trial188.stdout:1347: snap_remove snap 130 2026-02-13T20:17:01.927 INFO:tasks.rados.rados.0.trial188.stdout:1347: done (1 left) 2026-02-13T20:17:01.927 INFO:tasks.rados.rados.0.trial188.stdout:1348: write (excl) oid 47 current snap is 131 2026-02-13T20:17:01.927 INFO:tasks.rados.rados.0.trial188.stdout:1346: finishing copy_from racing read to trial18843701-48 2026-02-13T20:17:01.927 INFO:tasks.rados.rados.0.trial188.stdout:1346: finishing copy_from to trial18843701-48 2026-02-13T20:17:01.928 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 48 v 415 (ObjNum 489 snap 127 seq_num 489) dirty exists 2026-02-13T20:17:01.928 INFO:tasks.rados.rados.0.trial188.stdout:1348: seq_num 504 ranges {470728=404794,1526454=481175} 2026-02-13T20:17:01.931 INFO:tasks.rados.rados.0.trial188.stdout:1348: writing trial18843701-47 from 470728 to 875522 tid 1 2026-02-13T20:17:01.935 INFO:tasks.rados.rados.0.trial188.stdout:1348: writing trial18843701-47 from 1526454 to 2007629 tid 2 2026-02-13T20:17:01.935 INFO:tasks.rados.rados.0.trial188.stdout:1346: done (1 left) 2026-02-13T20:17:01.935 INFO:tasks.rados.rados.0.trial188.stdout:1349: snap_create 2026-02-13T20:17:01.944 INFO:tasks.rados.rados.0.trial188.stdout:1348: finishing write tid 1 to trial18843701-47 2026-02-13T20:17:01.944 INFO:tasks.rados.rados.0.trial188.stdout:1348: finishing write tid 2 to trial18843701-47 2026-02-13T20:17:01.944 INFO:tasks.rados.rados.0.trial188.stdout:1348: finishing write tid 3 to trial18843701-47 2026-02-13T20:17:01.944 INFO:tasks.rados.rados.0.trial188.stdout:1348: finishing write tid 4 to trial18843701-47 2026-02-13T20:17:01.944 INFO:tasks.rados.rados.0.trial188.stdout:1348: oid 47 updating version 0 to 414 2026-02-13T20:17:01.944 INFO:tasks.rados.rados.0.trial188.stdout:1348: oid 47 version 414 is already newer than 413 2026-02-13T20:17:01.944 INFO:tasks.rados.rados.0.trial188.stdout:1348: oid 47 updating version 414 to 415 2026-02-13T20:17:01.945 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 47 v 415 (ObjNum 504 snap 131 seq_num 504) dirty exists 2026-02-13T20:17:01.945 INFO:tasks.rados.rados.0.trial188.stdout:1348: left oid 47 (ObjNum 504 snap 131 seq_num 504) 2026-02-13T20:17:02.892 INFO:tasks.rados.rados.0.trial188.stdout:1348: done (1 left) 2026-02-13T20:17:02.893 INFO:tasks.rados.rados.0.trial188.stdout:1349: done (0 left) 2026-02-13T20:17:02.893 INFO:tasks.rados.rados.0.trial188.stdout:1350: rollback oid 43 current snap is 132 2026-02-13T20:17:02.893 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 43 to 129 2026-02-13T20:17:02.893 INFO:tasks.rados.rados.0.trial188.stdout:1351: write (excl) oid 35 current snap is 132 2026-02-13T20:17:02.893 INFO:tasks.rados.rados.0.trial188.stdout:1351: seq_num 505 ranges {487535=480043,1584936=624833} 2026-02-13T20:17:02.896 INFO:tasks.rados.rados.0.trial188.stdout:1351: writing trial18843701-35 from 487535 to 967578 tid 1 2026-02-13T20:17:02.901 INFO:tasks.rados.rados.0.trial188.stdout:1351: writing trial18843701-35 from 1584936 to 2209769 tid 2 2026-02-13T20:17:02.902 INFO:tasks.rados.rados.0.trial188.stdout:1352: write (excl) oid 4 current snap is 132 2026-02-13T20:17:02.902 INFO:tasks.rados.rados.0.trial188.stdout:1352: seq_num 506 ranges {504342=555292,1643418=484844} 2026-02-13T20:17:02.905 INFO:tasks.rados.rados.0.trial188.stdout:1352: writing trial18843701-4 from 504342 to 1059634 tid 1 2026-02-13T20:17:02.909 INFO:tasks.rados.rados.0.trial188.stdout:1352: writing trial18843701-4 from 1643418 to 2128262 tid 2 2026-02-13T20:17:02.910 INFO:tasks.rados.rados.0.trial188.stdout:1353: delete oid 21 current snap is 132 2026-02-13T20:17:02.910 INFO:tasks.rados.rados.0.trial188.stdout:1350: finishing rollback tid 0 to trial18843701-43 2026-02-13T20:17:02.910 INFO:tasks.rados.rados.0.trial188.stdout:1350: finishing rollback tid 1 to trial18843701-43 2026-02-13T20:17:02.910 INFO:tasks.rados.rados.0.trial188.stdout:1350: finishing rollback tid 2 to trial18843701-43 2026-02-13T20:17:02.910 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 43 v 331 (ObjNum 435 snap 112 seq_num 435) dirty exists 2026-02-13T20:17:02.922 INFO:tasks.rados.rados.0.trial188.stdout:1351: finishing write tid 1 to trial18843701-35 2026-02-13T20:17:02.922 INFO:tasks.rados.rados.0.trial188.stdout:1351: finishing write tid 2 to trial18843701-35 2026-02-13T20:17:02.922 INFO:tasks.rados.rados.0.trial188.stdout:1351: finishing write tid 3 to trial18843701-35 2026-02-13T20:17:02.922 INFO:tasks.rados.rados.0.trial188.stdout:1351: finishing write tid 4 to trial18843701-35 2026-02-13T20:17:02.922 INFO:tasks.rados.rados.0.trial188.stdout:1351: oid 35 updating version 0 to 411 2026-02-13T20:17:02.922 INFO:tasks.rados.rados.0.trial188.stdout:1351: oid 35 version 411 is already newer than 409 2026-02-13T20:17:02.922 INFO:tasks.rados.rados.0.trial188.stdout:1351: oid 35 version 411 is already newer than 410 2026-02-13T20:17:02.922 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 35 v 411 (ObjNum 505 snap 132 seq_num 505) dirty exists 2026-02-13T20:17:02.923 INFO:tasks.rados.rados.0.trial188.stdout:1351: left oid 35 (ObjNum 505 snap 132 seq_num 505) 2026-02-13T20:17:02.923 INFO:tasks.rados.rados.0.trial188.stdout:1350: done (3 left) 2026-02-13T20:17:02.923 INFO:tasks.rados.rados.0.trial188.stdout:1351: done (2 left) 2026-02-13T20:17:02.924 INFO:tasks.rados.rados.0.trial188.stdout:1353: done (1 left) 2026-02-13T20:17:02.924 INFO:tasks.rados.rados.0.trial188.stdout:1354: copy_from oid 1 from oid 40 current snap is 132 2026-02-13T20:17:02.924 INFO:tasks.rados.rados.0.trial188.stdout:1355: write oid 6 current snap is 132 2026-02-13T20:17:02.924 INFO:tasks.rados.rados.0.trial188.stdout:1355: seq_num 508 ranges {537956=705790,1644029=772160} 2026-02-13T20:17:02.928 INFO:tasks.rados.rados.0.trial188.stdout:1355: writing trial18843701-6 from 537956 to 1243746 tid 1 2026-02-13T20:17:02.933 INFO:tasks.rados.rados.0.trial188.stdout:1355: writing trial18843701-6 from 1644029 to 2416189 tid 2 2026-02-13T20:17:02.933 INFO:tasks.rados.rados.0.trial188.stdout:1356: read oid 47 snap -1 2026-02-13T20:17:02.934 INFO:tasks.rados.rados.0.trial188.stdout:1356: expect (ObjNum 504 snap 131 seq_num 504) 2026-02-13T20:17:02.934 INFO:tasks.rados.rados.0.trial188.stdout:1357: rollback oid 24 current snap is 132 2026-02-13T20:17:02.934 INFO:tasks.rados.rados.0.trial188.stdout:1352: finishing write tid 1 to trial18843701-4 2026-02-13T20:17:02.934 INFO:tasks.rados.rados.0.trial188.stdout:1352: finishing write tid 2 to trial18843701-4 2026-02-13T20:17:02.934 INFO:tasks.rados.rados.0.trial188.stdout:1352: finishing write tid 3 to trial18843701-4 2026-02-13T20:17:02.934 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 24 to 131 2026-02-13T20:17:02.934 INFO:tasks.rados.rados.0.trial188.stdout:1352: finishing write tid 4 to trial18843701-4 2026-02-13T20:17:02.934 INFO:tasks.rados.rados.0.trial188.stdout:1352: oid 4 updating version 0 to 363 2026-02-13T20:17:02.934 INFO:tasks.rados.rados.0.trial188.stdout:1352: oid 4 updating version 363 to 365 2026-02-13T20:17:02.934 INFO:tasks.rados.rados.0.trial188.stdout:1352: oid 4 version 365 is already newer than 364 2026-02-13T20:17:02.934 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 4 v 365 (ObjNum 506 snap 132 seq_num 506) dirty exists 2026-02-13T20:17:02.934 INFO:tasks.rados.rados.0.trial188.stdout:1352: left oid 4 (ObjNum 506 snap 132 seq_num 506) 2026-02-13T20:17:02.935 INFO:tasks.rados.rados.0.trial188.stdout:1352: done (4 left) 2026-02-13T20:17:02.935 INFO:tasks.rados.rados.0.trial188.stdout:1358: delete oid 21 current snap is 132 2026-02-13T20:17:02.936 INFO:tasks.rados.rados.0.trial188.stdout:1356: expect (ObjNum 504 snap 131 seq_num 504) 2026-02-13T20:17:02.939 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 703484 2026-02-13T20:17:02.963 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 956048 2026-02-13T20:17:03.002 INFO:tasks.rados.rados.0.trial188.stdout:1354: finishing copy_from racing read to trial18843701-1 2026-02-13T20:17:03.003 INFO:tasks.rados.rados.0.trial188.stdout:1356: done (4 left) 2026-02-13T20:17:03.003 INFO:tasks.rados.rados.0.trial188.stdout:1358: done (3 left) 2026-02-13T20:17:03.003 INFO:tasks.rados.rados.0.trial188.stdout:1359: write oid 50 current snap is 132 2026-02-13T20:17:03.003 INFO:tasks.rados.rados.0.trial188.stdout:1355: finishing write tid 1 to trial18843701-6 2026-02-13T20:17:03.003 INFO:tasks.rados.rados.0.trial188.stdout:1355: finishing write tid 2 to trial18843701-6 2026-02-13T20:17:03.003 INFO:tasks.rados.rados.0.trial188.stdout:1355: finishing write tid 3 to trial18843701-6 2026-02-13T20:17:03.003 INFO:tasks.rados.rados.0.trial188.stdout:1357: finishing rollback tid 0 to trial18843701-24 2026-02-13T20:17:03.003 INFO:tasks.rados.rados.0.trial188.stdout:1357: finishing rollback tid 1 to trial18843701-24 2026-02-13T20:17:03.003 INFO:tasks.rados.rados.0.trial188.stdout:1357: finishing rollback tid 2 to trial18843701-24 2026-02-13T20:17:03.004 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 24 v 616 (ObjNum 409 snap 109 seq_num 409) dirty exists 2026-02-13T20:17:03.004 INFO:tasks.rados.rados.0.trial188.stdout:1355: finishing write tid 4 to trial18843701-6 2026-02-13T20:17:03.004 INFO:tasks.rados.rados.0.trial188.stdout:1355: oid 6 updating version 0 to 610 2026-02-13T20:17:03.004 INFO:tasks.rados.rados.0.trial188.stdout:1355: oid 6 updating version 610 to 612 2026-02-13T20:17:03.004 INFO:tasks.rados.rados.0.trial188.stdout:1355: oid 6 version 612 is already newer than 611 2026-02-13T20:17:03.004 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 6 v 612 (ObjNum 508 snap 132 seq_num 508) dirty exists 2026-02-13T20:17:03.004 INFO:tasks.rados.rados.0.trial188.stdout:1355: left oid 6 (ObjNum 508 snap 132 seq_num 508) 2026-02-13T20:17:03.004 INFO:tasks.rados.rados.0.trial188.stdout:1354: finishing copy_from to trial18843701-1 2026-02-13T20:17:03.004 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 1 v 418 (ObjNum 498 snap 128 seq_num 498) dirty exists 2026-02-13T20:17:03.004 INFO:tasks.rados.rados.0.trial188.stdout:1359: seq_num 510 ranges {571570=572641,1877346=694224} 2026-02-13T20:17:03.007 INFO:tasks.rados.rados.0.trial188.stdout:1359: writing trial18843701-50 from 571570 to 1144211 tid 1 2026-02-13T20:17:03.013 INFO:tasks.rados.rados.0.trial188.stdout:1359: writing trial18843701-50 from 1877346 to 2571570 tid 2 2026-02-13T20:17:03.013 INFO:tasks.rados.rados.0.trial188.stdout:1354: done (3 left) 2026-02-13T20:17:03.013 INFO:tasks.rados.rados.0.trial188.stdout:1355: done (2 left) 2026-02-13T20:17:03.013 INFO:tasks.rados.rados.0.trial188.stdout:1357: done (1 left) 2026-02-13T20:17:03.013 INFO:tasks.rados.rados.0.trial188.stdout:1360: snap_remove snap 129 2026-02-13T20:17:03.934 INFO:tasks.rados.rados.0.trial188.stdout:1360: done (1 left) 2026-02-13T20:17:03.934 INFO:tasks.rados.rados.0.trial188.stdout:1361: rollback oid 21 current snap is 132 2026-02-13T20:17:03.934 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 21 to 131 2026-02-13T20:17:03.934 INFO:tasks.rados.rados.0.trial188.stdout:1359: finishing write tid 1 to trial18843701-50 2026-02-13T20:17:03.935 INFO:tasks.rados.rados.0.trial188.stdout:1359: finishing write tid 2 to trial18843701-50 2026-02-13T20:17:03.935 INFO:tasks.rados.rados.0.trial188.stdout:1359: finishing write tid 3 to trial18843701-50 2026-02-13T20:17:03.935 INFO:tasks.rados.rados.0.trial188.stdout:1359: finishing write tid 4 to trial18843701-50 2026-02-13T20:17:03.935 INFO:tasks.rados.rados.0.trial188.stdout:1359: oid 50 updating version 0 to 619 2026-02-13T20:17:03.935 INFO:tasks.rados.rados.0.trial188.stdout:1359: oid 50 version 619 is already newer than 618 2026-02-13T20:17:03.935 INFO:tasks.rados.rados.0.trial188.stdout:1359: oid 50 version 619 is already newer than 617 2026-02-13T20:17:03.935 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 50 v 619 (ObjNum 510 snap 132 seq_num 510) dirty exists 2026-02-13T20:17:03.935 INFO:tasks.rados.rados.0.trial188.stdout:1359: left oid 50 (ObjNum 510 snap 132 seq_num 510) 2026-02-13T20:17:03.935 INFO:tasks.rados.rados.0.trial188.stdout:1359: done (1 left) 2026-02-13T20:17:03.935 INFO:tasks.rados.rados.0.trial188.stdout:1362: read oid 30 snap -1 2026-02-13T20:17:03.935 INFO:tasks.rados.rados.0.trial188.stdout:1362: expect (ObjNum 485 snap 126 seq_num 485) 2026-02-13T20:17:03.935 INFO:tasks.rados.rados.0.trial188.stdout:1363: write (excl) oid 23 current snap is 132 2026-02-13T20:17:03.935 INFO:tasks.rados.rados.0.trial188.stdout:1363: seq_num 511 ranges {588377=647890,1935828=635840} 2026-02-13T20:17:03.939 INFO:tasks.rados.rados.0.trial188.stdout:1363: writing trial18843701-23 from 588377 to 1236267 tid 1 2026-02-13T20:17:03.944 INFO:tasks.rados.rados.0.trial188.stdout:1363: writing trial18843701-23 from 1935828 to 2571668 tid 2 2026-02-13T20:17:03.944 INFO:tasks.rados.rados.0.trial188.stdout:1364: rollback oid 16 current snap is 132 2026-02-13T20:17:03.944 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 16 to 131 2026-02-13T20:17:03.944 INFO:tasks.rados.rados.0.trial188.stdout:1361: finishing rollback tid 1 to trial18843701-21 2026-02-13T20:17:03.944 INFO:tasks.rados.rados.0.trial188.stdout:1361: finishing rollback tid 2 to trial18843701-21 2026-02-13T20:17:03.944 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 21 v 418 (ObjNum 469 snap 121 seq_num 469) dirty exists 2026-02-13T20:17:03.944 INFO:tasks.rados.rados.0.trial188.stdout:1362: expect (ObjNum 485 snap 126 seq_num 485) 2026-02-13T20:17:03.944 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:17:03.972 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:17:04.010 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1275736 2026-02-13T20:17:04.023 INFO:tasks.rados.rados.0.trial188.stdout:1363: finishing write tid 1 to trial18843701-23 2026-02-13T20:17:04.023 INFO:tasks.rados.rados.0.trial188.stdout:1363: finishing write tid 2 to trial18843701-23 2026-02-13T20:17:04.023 INFO:tasks.rados.rados.0.trial188.stdout:1363: finishing write tid 3 to trial18843701-23 2026-02-13T20:17:04.024 INFO:tasks.rados.rados.0.trial188.stdout:1363: finishing write tid 4 to trial18843701-23 2026-02-13T20:17:04.024 INFO:tasks.rados.rados.0.trial188.stdout:1363: oid 23 updating version 0 to 625 2026-02-13T20:17:04.024 INFO:tasks.rados.rados.0.trial188.stdout:1363: oid 23 updating version 625 to 626 2026-02-13T20:17:04.024 INFO:tasks.rados.rados.0.trial188.stdout:1363: oid 23 version 626 is already newer than 624 2026-02-13T20:17:04.024 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 23 v 626 (ObjNum 511 snap 132 seq_num 511) dirty exists 2026-02-13T20:17:04.024 INFO:tasks.rados.rados.0.trial188.stdout:1363: left oid 23 (ObjNum 511 snap 132 seq_num 511) 2026-02-13T20:17:04.024 INFO:tasks.rados.rados.0.trial188.stdout:1364: finishing rollback tid 0 to trial18843701-16 2026-02-13T20:17:04.024 INFO:tasks.rados.rados.0.trial188.stdout:1364: finishing rollback tid 1 to trial18843701-16 2026-02-13T20:17:04.025 INFO:tasks.rados.rados.0.trial188.stdout:1364: finishing rollback tid 2 to trial18843701-16 2026-02-13T20:17:04.025 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 16 v 630 (ObjNum 469 snap 121 seq_num 469) dirty exists 2026-02-13T20:17:04.025 INFO:tasks.rados.rados.0.trial188.stdout:1361: done (3 left) 2026-02-13T20:17:04.025 INFO:tasks.rados.rados.0.trial188.stdout:1362: done (2 left) 2026-02-13T20:17:04.025 INFO:tasks.rados.rados.0.trial188.stdout:1363: done (1 left) 2026-02-13T20:17:04.025 INFO:tasks.rados.rados.0.trial188.stdout:1364: done (0 left) 2026-02-13T20:17:04.025 INFO:tasks.rados.rados.0.trial188.stdout:1365: copy_from oid 41 from oid 39 current snap is 132 2026-02-13T20:17:04.025 INFO:tasks.rados.rados.0.trial188.stdout:1366: write (excl) oid 47 current snap is 132 2026-02-13T20:17:04.025 INFO:tasks.rados.rados.0.trial188.stdout:1366: seq_num 512 ranges {605184=723139,1877957=727227} 2026-02-13T20:17:04.028 INFO:tasks.rados.rados.0.trial188.stdout:1366: writing trial18843701-47 from 605184 to 1328323 tid 1 2026-02-13T20:17:04.033 INFO:tasks.rados.rados.0.trial188.stdout:1366: writing trial18843701-47 from 1877957 to 2605184 tid 2 2026-02-13T20:17:04.033 INFO:tasks.rados.rados.0.trial188.stdout:1367: write oid 44 current snap is 132 2026-02-13T20:17:04.033 INFO:tasks.rados.rados.0.trial188.stdout:1367: seq_num 513 ranges {621991=798388,1936439=639509} 2026-02-13T20:17:04.039 INFO:tasks.rados.rados.0.trial188.stdout:1367: writing trial18843701-44 from 621991 to 1420379 tid 1 2026-02-13T20:17:04.043 INFO:tasks.rados.rados.0.trial188.stdout:1367: writing trial18843701-44 from 1936439 to 2575948 tid 2 2026-02-13T20:17:04.043 INFO:tasks.rados.rados.0.trial188.stdout:1368: snap_create 2026-02-13T20:17:04.067 INFO:tasks.rados.rados.0.trial188.stdout:1365: finishing copy_from racing read to trial18843701-41 2026-02-13T20:17:04.071 INFO:tasks.rados.rados.0.trial188.stdout:1367: finishing write tid 1 to trial18843701-44 2026-02-13T20:17:04.071 INFO:tasks.rados.rados.0.trial188.stdout:1367: finishing write tid 2 to trial18843701-44 2026-02-13T20:17:04.071 INFO:tasks.rados.rados.0.trial188.stdout:1367: finishing write tid 3 to trial18843701-44 2026-02-13T20:17:04.071 INFO:tasks.rados.rados.0.trial188.stdout:1366: finishing write tid 1 to trial18843701-47 2026-02-13T20:17:04.071 INFO:tasks.rados.rados.0.trial188.stdout:1366: finishing write tid 2 to trial18843701-47 2026-02-13T20:17:04.071 INFO:tasks.rados.rados.0.trial188.stdout:1367: finishing write tid 4 to trial18843701-44 2026-02-13T20:17:04.071 INFO:tasks.rados.rados.0.trial188.stdout:1367: oid 44 updating version 0 to 550 2026-02-13T20:17:04.071 INFO:tasks.rados.rados.0.trial188.stdout:1367: oid 44 updating version 550 to 552 2026-02-13T20:17:04.072 INFO:tasks.rados.rados.0.trial188.stdout:1367: oid 44 version 552 is already newer than 551 2026-02-13T20:17:04.072 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 44 v 552 (ObjNum 513 snap 132 seq_num 513) dirty exists 2026-02-13T20:17:04.072 INFO:tasks.rados.rados.0.trial188.stdout:1367: left oid 44 (ObjNum 513 snap 132 seq_num 513) 2026-02-13T20:17:04.072 INFO:tasks.rados.rados.0.trial188.stdout:1366: finishing write tid 3 to trial18843701-47 2026-02-13T20:17:04.072 INFO:tasks.rados.rados.0.trial188.stdout:1366: finishing write tid 4 to trial18843701-47 2026-02-13T20:17:04.072 INFO:tasks.rados.rados.0.trial188.stdout:1366: oid 47 updating version 0 to 417 2026-02-13T20:17:04.072 INFO:tasks.rados.rados.0.trial188.stdout:1366: oid 47 version 417 is already newer than 416 2026-02-13T20:17:04.072 INFO:tasks.rados.rados.0.trial188.stdout:1366: oid 47 updating version 417 to 418 2026-02-13T20:17:04.072 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 47 v 418 (ObjNum 512 snap 132 seq_num 512) dirty exists 2026-02-13T20:17:04.072 INFO:tasks.rados.rados.0.trial188.stdout:1366: left oid 47 (ObjNum 512 snap 132 seq_num 512) 2026-02-13T20:17:04.072 INFO:tasks.rados.rados.0.trial188.stdout:1365: finishing copy_from to trial18843701-41 2026-02-13T20:17:04.072 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 41 v 228 (ObjNum 469 snap 121 seq_num 469) dirty exists 2026-02-13T20:17:04.938 INFO:tasks.rados.rados.0.trial188.stdout:1365: done (3 left) 2026-02-13T20:17:04.938 INFO:tasks.rados.rados.0.trial188.stdout:1366: done (2 left) 2026-02-13T20:17:04.938 INFO:tasks.rados.rados.0.trial188.stdout:1367: done (1 left) 2026-02-13T20:17:04.939 INFO:tasks.rados.rados.0.trial188.stdout:1368: done (0 left) 2026-02-13T20:17:04.939 INFO:tasks.rados.rados.0.trial188.stdout:1369: read oid 42 snap 131 2026-02-13T20:17:04.939 INFO:tasks.rados.rados.0.trial188.stdout:1369: expect (ObjNum 454 snap 116 seq_num 454) 2026-02-13T20:17:04.939 INFO:tasks.rados.rados.0.trial188.stdout:1370: read oid 41 snap -1 2026-02-13T20:17:04.939 INFO:tasks.rados.rados.0.trial188.stdout:1370: expect (ObjNum 469 snap 121 seq_num 469) 2026-02-13T20:17:04.939 INFO:tasks.rados.rados.0.trial188.stdout:1371: write (excl) oid 25 current snap is 133 2026-02-13T20:17:04.939 INFO:tasks.rados.rados.0.trial188.stdout:1371: seq_num 514 ranges {638798=473637,1594921=783167} 2026-02-13T20:17:04.943 INFO:tasks.rados.rados.0.trial188.stdout:1371: writing trial18843701-25 from 638798 to 1112435 tid 1 2026-02-13T20:17:04.947 INFO:tasks.rados.rados.0.trial188.stdout:1371: writing trial18843701-25 from 1594921 to 2378088 tid 2 2026-02-13T20:17:04.948 INFO:tasks.rados.rados.0.trial188.stdout:1372: snap_create 2026-02-13T20:17:04.948 INFO:tasks.rados.rados.0.trial188.stdout:1369: expect (ObjNum 454 snap 116 seq_num 454) 2026-02-13T20:17:05.008 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:17:05.097 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1793855 2026-02-13T20:17:05.123 INFO:tasks.rados.rados.0.trial188.stdout:1370: expect (ObjNum 469 snap 121 seq_num 469) 2026-02-13T20:17:05.123 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:17:05.213 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:17:05.258 INFO:tasks.rados.rados.0.trial188.stdout:1371: finishing write tid 1 to trial18843701-25 2026-02-13T20:17:05.258 INFO:tasks.rados.rados.0.trial188.stdout:1371: finishing write tid 2 to trial18843701-25 2026-02-13T20:17:05.258 INFO:tasks.rados.rados.0.trial188.stdout:1371: finishing write tid 3 to trial18843701-25 2026-02-13T20:17:05.258 INFO:tasks.rados.rados.0.trial188.stdout:1371: finishing write tid 4 to trial18843701-25 2026-02-13T20:17:05.258 INFO:tasks.rados.rados.0.trial188.stdout:1371: oid 25 updating version 0 to 597 2026-02-13T20:17:05.258 INFO:tasks.rados.rados.0.trial188.stdout:1371: oid 25 updating version 597 to 598 2026-02-13T20:17:05.258 INFO:tasks.rados.rados.0.trial188.stdout:1371: oid 25 version 598 is already newer than 596 2026-02-13T20:17:05.258 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 25 v 598 (ObjNum 514 snap 133 seq_num 514) dirty exists 2026-02-13T20:17:05.259 INFO:tasks.rados.rados.0.trial188.stdout:1371: left oid 25 (ObjNum 514 snap 133 seq_num 514) 2026-02-13T20:17:05.940 INFO:tasks.rados.rados.0.trial188.stdout:1369: done (3 left) 2026-02-13T20:17:05.940 INFO:tasks.rados.rados.0.trial188.stdout:1370: done (2 left) 2026-02-13T20:17:05.940 INFO:tasks.rados.rados.0.trial188.stdout:1371: done (1 left) 2026-02-13T20:17:05.940 INFO:tasks.rados.rados.0.trial188.stdout:1372: done (0 left) 2026-02-13T20:17:05.941 INFO:tasks.rados.rados.0.trial188.stdout:1373: copy_from oid 45 from oid 42 current snap is 134 2026-02-13T20:17:05.941 INFO:tasks.rados.rados.0.trial188.stdout:1374: read oid 33 snap 133 2026-02-13T20:17:05.941 INFO:tasks.rados.rados.0.trial188.stdout:1374: expect (ObjNum 452 snap 116 seq_num 452) 2026-02-13T20:17:05.941 INFO:tasks.rados.rados.0.trial188.stdout:1375: read oid 18 snap -1 2026-02-13T20:17:05.941 INFO:tasks.rados.rados.0.trial188.stdout:1375: expect deleted 2026-02-13T20:17:05.941 INFO:tasks.rados.rados.0.trial188.stdout:1376: copy_from oid 19 from oid 44 current snap is 134 2026-02-13T20:17:05.941 INFO:tasks.rados.rados.0.trial188.stdout:1377: write oid 2 current snap is 134 2026-02-13T20:17:05.941 INFO:tasks.rados.rados.0.trial188.stdout:1377: seq_num 515 ranges {655605=548886,1653403=643178} 2026-02-13T20:17:05.945 INFO:tasks.rados.rados.0.trial188.stdout:1377: writing trial18843701-2 from 655605 to 1204491 tid 1 2026-02-13T20:17:05.949 INFO:tasks.rados.rados.0.trial188.stdout:1377: writing trial18843701-2 from 1653403 to 2296581 tid 2 2026-02-13T20:17:05.949 INFO:tasks.rados.rados.0.trial188.stdout:1378: write (excl) oid 35 current snap is 134 2026-02-13T20:17:05.949 INFO:tasks.rados.rados.0.trial188.stdout:1378: seq_num 516 ranges {672412=624135,1995532=676880} 2026-02-13T20:17:05.955 INFO:tasks.rados.rados.0.trial188.stdout:1378: writing trial18843701-35 from 672412 to 1296547 tid 1 2026-02-13T20:17:05.960 INFO:tasks.rados.rados.0.trial188.stdout:1378: writing trial18843701-35 from 1995532 to 2672412 tid 2 2026-02-13T20:17:05.960 INFO:tasks.rados.rados.0.trial188.stdout:1379: write (excl) oid 5 current snap is 134 2026-02-13T20:17:05.960 INFO:tasks.rados.rados.0.trial188.stdout:1379: seq_num 517 ranges {689219=415737,1770367=646847} 2026-02-13T20:17:05.964 INFO:tasks.rados.rados.0.trial188.stdout:1379: writing trial18843701-5 from 689219 to 1104956 tid 1 2026-02-13T20:17:05.969 INFO:tasks.rados.rados.0.trial188.stdout:1379: writing trial18843701-5 from 1770367 to 2417214 tid 2 2026-02-13T20:17:05.969 INFO:tasks.rados.rados.0.trial188.stdout:1380: write oid 39 current snap is 134 2026-02-13T20:17:05.969 INFO:tasks.rados.rados.0.trial188.stdout:1380: seq_num 518 ranges {706026=490986,1828849=790505} 2026-02-13T20:17:05.974 INFO:tasks.rados.rados.0.trial188.stdout:1380: writing trial18843701-39 from 706026 to 1197012 tid 1 2026-02-13T20:17:05.979 INFO:tasks.rados.rados.0.trial188.stdout:1380: writing trial18843701-39 from 1828849 to 2619354 tid 2 2026-02-13T20:17:05.979 INFO:tasks.rados.rados.0.trial188.stdout:1381: delete oid 21 current snap is 134 2026-02-13T20:17:05.979 INFO:tasks.rados.rados.0.trial188.stdout:1374: expect (ObjNum 452 snap 116 seq_num 452) 2026-02-13T20:17:06.019 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:17:06.063 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:17:06.109 INFO:tasks.rados.rados.0.trial188.stdout:1376: finishing copy_from racing read to trial18843701-19 2026-02-13T20:17:06.109 INFO:tasks.rados.rados.0.trial188.stdout:1373: finishing copy_from racing read to trial18843701-45 2026-02-13T20:17:06.109 INFO:tasks.rados.rados.0.trial188.stdout:1377: finishing write tid 1 to trial18843701-2 2026-02-13T20:17:06.109 INFO:tasks.rados.rados.0.trial188.stdout:1377: finishing write tid 2 to trial18843701-2 2026-02-13T20:17:06.110 INFO:tasks.rados.rados.0.trial188.stdout:1376: finishing copy_from to trial18843701-19 2026-02-13T20:17:06.110 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 19 v 552 (ObjNum 513 snap 132 seq_num 513) dirty exists 2026-02-13T20:17:06.110 INFO:tasks.rados.rados.0.trial188.stdout:1378: finishing write tid 1 to trial18843701-35 2026-02-13T20:17:06.110 INFO:tasks.rados.rados.0.trial188.stdout:1377: finishing write tid 3 to trial18843701-2 2026-02-13T20:17:06.110 INFO:tasks.rados.rados.0.trial188.stdout:1373: finishing copy_from to trial18843701-45 2026-02-13T20:17:06.110 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 45 v 398 (ObjNum 454 snap 116 seq_num 454) dirty exists 2026-02-13T20:17:06.110 INFO:tasks.rados.rados.0.trial188.stdout:1377: finishing write tid 4 to trial18843701-2 2026-02-13T20:17:06.110 INFO:tasks.rados.rados.0.trial188.stdout:1377: oid 2 updating version 0 to 554 2026-02-13T20:17:06.110 INFO:tasks.rados.rados.0.trial188.stdout:1377: oid 2 updating version 554 to 555 2026-02-13T20:17:06.110 INFO:tasks.rados.rados.0.trial188.stdout:1377: oid 2 version 555 is already newer than 553 2026-02-13T20:17:06.110 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 2 v 555 (ObjNum 515 snap 134 seq_num 515) dirty exists 2026-02-13T20:17:06.110 INFO:tasks.rados.rados.0.trial188.stdout:1377: left oid 2 (ObjNum 515 snap 134 seq_num 515) 2026-02-13T20:17:06.111 INFO:tasks.rados.rados.0.trial188.stdout:1380: finishing write tid 1 to trial18843701-39 2026-02-13T20:17:06.111 INFO:tasks.rados.rados.0.trial188.stdout:1378: finishing write tid 2 to trial18843701-35 2026-02-13T20:17:06.111 INFO:tasks.rados.rados.0.trial188.stdout:1379: finishing write tid 1 to trial18843701-5 2026-02-13T20:17:06.111 INFO:tasks.rados.rados.0.trial188.stdout:1378: finishing write tid 3 to trial18843701-35 2026-02-13T20:17:06.111 INFO:tasks.rados.rados.0.trial188.stdout:1380: finishing write tid 2 to trial18843701-39 2026-02-13T20:17:06.111 INFO:tasks.rados.rados.0.trial188.stdout:1373: done (8 left) 2026-02-13T20:17:06.111 INFO:tasks.rados.rados.0.trial188.stdout:1374: done (7 left) 2026-02-13T20:17:06.111 INFO:tasks.rados.rados.0.trial188.stdout:1375: done (6 left) 2026-02-13T20:17:06.111 INFO:tasks.rados.rados.0.trial188.stdout:1376: done (5 left) 2026-02-13T20:17:06.111 INFO:tasks.rados.rados.0.trial188.stdout:1377: done (4 left) 2026-02-13T20:17:06.111 INFO:tasks.rados.rados.0.trial188.stdout:1381: done (3 left) 2026-02-13T20:17:06.111 INFO:tasks.rados.rados.0.trial188.stdout:1382: rollback oid 21 current snap is 134 2026-02-13T20:17:06.111 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 21 to 132 2026-02-13T20:17:06.112 INFO:tasks.rados.rados.0.trial188.stdout:1380: finishing write tid 3 to trial18843701-39 2026-02-13T20:17:06.112 INFO:tasks.rados.rados.0.trial188.stdout:1379: finishing write tid 2 to trial18843701-5 2026-02-13T20:17:06.112 INFO:tasks.rados.rados.0.trial188.stdout:1380: finishing write tid 4 to trial18843701-39 2026-02-13T20:17:06.112 INFO:tasks.rados.rados.0.trial188.stdout:1380: oid 39 updating version 0 to 555 2026-02-13T20:17:06.112 INFO:tasks.rados.rados.0.trial188.stdout:1380: oid 39 version 555 is already newer than 553 2026-02-13T20:17:06.112 INFO:tasks.rados.rados.0.trial188.stdout:1380: oid 39 version 555 is already newer than 554 2026-02-13T20:17:06.112 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 39 v 555 (ObjNum 518 snap 134 seq_num 518) dirty exists 2026-02-13T20:17:06.112 INFO:tasks.rados.rados.0.trial188.stdout:1380: left oid 39 (ObjNum 518 snap 134 seq_num 518) 2026-02-13T20:17:06.112 INFO:tasks.rados.rados.0.trial188.stdout:1379: finishing write tid 3 to trial18843701-5 2026-02-13T20:17:06.112 INFO:tasks.rados.rados.0.trial188.stdout:1378: finishing write tid 4 to trial18843701-35 2026-02-13T20:17:06.112 INFO:tasks.rados.rados.0.trial188.stdout:1378: oid 35 updating version 0 to 412 2026-02-13T20:17:06.112 INFO:tasks.rados.rados.0.trial188.stdout:1378: oid 35 updating version 412 to 414 2026-02-13T20:17:06.112 INFO:tasks.rados.rados.0.trial188.stdout:1378: oid 35 version 414 is already newer than 413 2026-02-13T20:17:06.113 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 35 v 414 (ObjNum 516 snap 134 seq_num 516) dirty exists 2026-02-13T20:17:06.113 INFO:tasks.rados.rados.0.trial188.stdout:1378: left oid 35 (ObjNum 516 snap 134 seq_num 516) 2026-02-13T20:17:06.113 INFO:tasks.rados.rados.0.trial188.stdout:1379: finishing write tid 4 to trial18843701-5 2026-02-13T20:17:06.113 INFO:tasks.rados.rados.0.trial188.stdout:1379: oid 5 updating version 0 to 557 2026-02-13T20:17:06.113 INFO:tasks.rados.rados.0.trial188.stdout:1379: oid 5 version 557 is already newer than 556 2026-02-13T20:17:06.113 INFO:tasks.rados.rados.0.trial188.stdout:1379: oid 5 updating version 557 to 558 2026-02-13T20:17:06.113 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 5 v 558 (ObjNum 517 snap 134 seq_num 517) dirty exists 2026-02-13T20:17:06.113 INFO:tasks.rados.rados.0.trial188.stdout:1379: left oid 5 (ObjNum 517 snap 134 seq_num 517) 2026-02-13T20:17:06.113 INFO:tasks.rados.rados.0.trial188.stdout:1378: done (3 left) 2026-02-13T20:17:06.113 INFO:tasks.rados.rados.0.trial188.stdout:1379: done (2 left) 2026-02-13T20:17:06.113 INFO:tasks.rados.rados.0.trial188.stdout:1380: done (1 left) 2026-02-13T20:17:06.113 INFO:tasks.rados.rados.0.trial188.stdout:1383: snap_remove snap 131 2026-02-13T20:17:06.945 INFO:tasks.rados.rados.0.trial188.stdout:1383: done (1 left) 2026-02-13T20:17:06.945 INFO:tasks.rados.rados.0.trial188.stdout:1384: write oid 28 current snap is 134 2026-02-13T20:17:06.945 INFO:tasks.rados.rados.0.trial188.stdout:1382: finishing rollback tid 1 to trial18843701-21 2026-02-13T20:17:06.945 INFO:tasks.rados.rados.0.trial188.stdout:1382: finishing rollback tid 2 to trial18843701-21 2026-02-13T20:17:06.945 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 21 v 421 (ObjNum 469 snap 121 seq_num 469) dirty exists 2026-02-13T20:17:06.945 INFO:tasks.rados.rados.0.trial188.stdout:1384: seq_num 520 ranges {739640=641484,1829460=794174} 2026-02-13T20:17:06.951 INFO:tasks.rados.rados.0.trial188.stdout:1384: writing trial18843701-28 from 739640 to 1381124 tid 1 2026-02-13T20:17:06.955 INFO:tasks.rados.rados.0.trial188.stdout:1384: writing trial18843701-28 from 1829460 to 2623634 tid 2 2026-02-13T20:17:06.956 INFO:tasks.rados.rados.0.trial188.stdout:1382: done (1 left) 2026-02-13T20:17:06.956 INFO:tasks.rados.rados.0.trial188.stdout:1385: copy_from oid 49 from oid 40 current snap is 134 2026-02-13T20:17:06.956 INFO:tasks.rados.rados.0.trial188.stdout:1386: write (excl) oid 9 current snap is 134 2026-02-13T20:17:06.956 INFO:tasks.rados.rados.0.trial188.stdout:1386: seq_num 521 ranges {756447=716733,1887942=537832} 2026-02-13T20:17:06.961 INFO:tasks.rados.rados.0.trial188.stdout:1386: writing trial18843701-9 from 756447 to 1473180 tid 1 2026-02-13T20:17:06.965 INFO:tasks.rados.rados.0.trial188.stdout:1386: writing trial18843701-9 from 1887942 to 2425774 tid 2 2026-02-13T20:17:06.965 INFO:tasks.rados.rados.0.trial188.stdout:1387: read oid 15 snap -1 2026-02-13T20:17:06.965 INFO:tasks.rados.rados.0.trial188.stdout:1387: expect deleted 2026-02-13T20:17:06.965 INFO:tasks.rados.rados.0.trial188.stdout:1388: snap_create 2026-02-13T20:17:06.972 INFO:tasks.rados.rados.0.trial188.stdout:1384: finishing write tid 1 to trial18843701-28 2026-02-13T20:17:06.974 INFO:tasks.rados.rados.0.trial188.stdout:1384: finishing write tid 2 to trial18843701-28 2026-02-13T20:17:06.974 INFO:tasks.rados.rados.0.trial188.stdout:1384: finishing write tid 3 to trial18843701-28 2026-02-13T20:17:06.974 INFO:tasks.rados.rados.0.trial188.stdout:1384: finishing write tid 4 to trial18843701-28 2026-02-13T20:17:06.974 INFO:tasks.rados.rados.0.trial188.stdout:1384: oid 28 updating version 0 to 524 2026-02-13T20:17:06.974 INFO:tasks.rados.rados.0.trial188.stdout:1384: oid 28 updating version 524 to 526 2026-02-13T20:17:06.975 INFO:tasks.rados.rados.0.trial188.stdout:1384: oid 28 version 526 is already newer than 525 2026-02-13T20:17:06.975 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 28 v 526 (ObjNum 520 snap 134 seq_num 520) dirty exists 2026-02-13T20:17:06.975 INFO:tasks.rados.rados.0.trial188.stdout:1384: left oid 28 (ObjNum 520 snap 134 seq_num 520) 2026-02-13T20:17:06.982 INFO:tasks.rados.rados.0.trial188.stdout:1386: finishing write tid 1 to trial18843701-9 2026-02-13T20:17:06.982 INFO:tasks.rados.rados.0.trial188.stdout:1386: finishing write tid 2 to trial18843701-9 2026-02-13T20:17:06.983 INFO:tasks.rados.rados.0.trial188.stdout:1386: finishing write tid 3 to trial18843701-9 2026-02-13T20:17:06.983 INFO:tasks.rados.rados.0.trial188.stdout:1386: finishing write tid 4 to trial18843701-9 2026-02-13T20:17:06.983 INFO:tasks.rados.rados.0.trial188.stdout:1386: oid 9 updating version 0 to 415 2026-02-13T20:17:06.983 INFO:tasks.rados.rados.0.trial188.stdout:1386: oid 9 updating version 415 to 416 2026-02-13T20:17:06.983 INFO:tasks.rados.rados.0.trial188.stdout:1386: oid 9 updating version 416 to 417 2026-02-13T20:17:06.983 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 9 v 417 (ObjNum 521 snap 134 seq_num 521) dirty exists 2026-02-13T20:17:06.984 INFO:tasks.rados.rados.0.trial188.stdout:1386: left oid 9 (ObjNum 521 snap 134 seq_num 521) 2026-02-13T20:17:06.984 INFO:tasks.rados.rados.0.trial188.stdout:1385: finishing copy_from racing read to trial18843701-49 2026-02-13T20:17:06.994 INFO:tasks.rados.rados.0.trial188.stdout:1385: finishing copy_from to trial18843701-49 2026-02-13T20:17:06.995 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 49 v 418 (ObjNum 498 snap 128 seq_num 498) dirty exists 2026-02-13T20:17:07.893 INFO:tasks.rados.rados.0.trial188.stdout:1384: done (4 left) 2026-02-13T20:17:07.893 INFO:tasks.rados.rados.0.trial188.stdout:1385: done (3 left) 2026-02-13T20:17:07.893 INFO:tasks.rados.rados.0.trial188.stdout:1386: done (2 left) 2026-02-13T20:17:07.893 INFO:tasks.rados.rados.0.trial188.stdout:1387: done (1 left) 2026-02-13T20:17:07.893 INFO:tasks.rados.rados.0.trial188.stdout:1388: done (0 left) 2026-02-13T20:17:07.893 INFO:tasks.rados.rados.0.trial188.stdout:1389: write (excl) oid 16 current snap is 135 2026-02-13T20:17:07.893 INFO:tasks.rados.rados.0.trial188.stdout:1389: seq_num 522 ranges {773254=791982,2346424=426830} 2026-02-13T20:17:07.899 INFO:tasks.rados.rados.0.trial188.stdout:1389: writing trial18843701-16 from 773254 to 1565236 tid 1 2026-02-13T20:17:07.904 INFO:tasks.rados.rados.0.trial188.stdout:1389: writing trial18843701-16 from 2346424 to 2773254 tid 2 2026-02-13T20:17:07.904 INFO:tasks.rados.rados.0.trial188.stdout:1390: copy_from oid 44 from oid 3 current snap is 135 2026-02-13T20:17:07.904 INFO:tasks.rados.rados.0.trial188.stdout:1391: write (excl) oid 49 current snap is 135 2026-02-13T20:17:07.904 INFO:tasks.rados.rados.0.trial188.stdout:1391: seq_num 523 ranges {790061=467231,2004906=541501} 2026-02-13T20:17:07.909 INFO:tasks.rados.rados.0.trial188.stdout:1391: writing trial18843701-49 from 790061 to 1257292 tid 1 2026-02-13T20:17:07.914 INFO:tasks.rados.rados.0.trial188.stdout:1391: writing trial18843701-49 from 2004906 to 2546407 tid 2 2026-02-13T20:17:07.915 INFO:tasks.rados.rados.0.trial188.stdout:1392: snap_create 2026-02-13T20:17:07.917 INFO:tasks.rados.rados.0.trial188.stdout:1390: finishing copy_from to trial18843701-44 2026-02-13T20:17:07.917 INFO:tasks.rados.rados.0.trial188.stdout:1390: got expected ENOENT (src dne) 2026-02-13T20:17:07.917 INFO:tasks.rados.rados.0.trial188.stdout:1390: finishing copy_from racing read to trial18843701-44 2026-02-13T20:17:07.918 INFO:tasks.rados.rados.0.trial188.stdout:1389: finishing write tid 1 to trial18843701-16 2026-02-13T20:17:07.918 INFO:tasks.rados.rados.0.trial188.stdout:1389: finishing write tid 2 to trial18843701-16 2026-02-13T20:17:07.918 INFO:tasks.rados.rados.0.trial188.stdout:1389: finishing write tid 3 to trial18843701-16 2026-02-13T20:17:07.918 INFO:tasks.rados.rados.0.trial188.stdout:1389: finishing write tid 4 to trial18843701-16 2026-02-13T20:17:07.918 INFO:tasks.rados.rados.0.trial188.stdout:1389: oid 16 updating version 0 to 638 2026-02-13T20:17:07.918 INFO:tasks.rados.rados.0.trial188.stdout:1389: oid 16 updating version 638 to 640 2026-02-13T20:17:07.918 INFO:tasks.rados.rados.0.trial188.stdout:1389: oid 16 version 640 is already newer than 639 2026-02-13T20:17:07.919 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 16 v 640 (ObjNum 522 snap 135 seq_num 522) dirty exists 2026-02-13T20:17:07.919 INFO:tasks.rados.rados.0.trial188.stdout:1389: left oid 16 (ObjNum 522 snap 135 seq_num 522) 2026-02-13T20:17:07.926 INFO:tasks.rados.rados.0.trial188.stdout:1391: finishing write tid 1 to trial18843701-49 2026-02-13T20:17:07.927 INFO:tasks.rados.rados.0.trial188.stdout:1391: finishing write tid 2 to trial18843701-49 2026-02-13T20:17:07.927 INFO:tasks.rados.rados.0.trial188.stdout:1391: finishing write tid 3 to trial18843701-49 2026-02-13T20:17:07.927 INFO:tasks.rados.rados.0.trial188.stdout:1391: finishing write tid 4 to trial18843701-49 2026-02-13T20:17:07.927 INFO:tasks.rados.rados.0.trial188.stdout:1391: oid 49 updating version 0 to 604 2026-02-13T20:17:07.927 INFO:tasks.rados.rados.0.trial188.stdout:1391: oid 49 updating version 604 to 605 2026-02-13T20:17:07.927 INFO:tasks.rados.rados.0.trial188.stdout:1391: oid 49 version 605 is already newer than 603 2026-02-13T20:17:07.927 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 49 v 605 (ObjNum 523 snap 135 seq_num 523) dirty exists 2026-02-13T20:17:07.927 INFO:tasks.rados.rados.0.trial188.stdout:1391: left oid 49 (ObjNum 523 snap 135 seq_num 523) 2026-02-13T20:17:08.896 INFO:tasks.rados.rados.0.trial188.stdout:1389: done (3 left) 2026-02-13T20:17:08.896 INFO:tasks.rados.rados.0.trial188.stdout:1390: done (2 left) 2026-02-13T20:17:08.896 INFO:tasks.rados.rados.0.trial188.stdout:1391: done (1 left) 2026-02-13T20:17:08.896 INFO:tasks.rados.rados.0.trial188.stdout:1392: done (0 left) 2026-02-13T20:17:08.896 INFO:tasks.rados.rados.0.trial188.stdout:1393: write oid 27 current snap is 136 2026-02-13T20:17:08.896 INFO:tasks.rados.rados.0.trial188.stdout:1393: seq_num 524 ranges {406868=542480,1547035=401512,2690354=116514} 2026-02-13T20:17:08.900 INFO:tasks.rados.rados.0.trial188.stdout:1393: writing trial18843701-27 from 406868 to 949348 tid 1 2026-02-13T20:17:08.903 INFO:tasks.rados.rados.0.trial188.stdout:1393: writing trial18843701-27 from 1547035 to 1948547 tid 2 2026-02-13T20:17:08.907 INFO:tasks.rados.rados.0.trial188.stdout:1393: writing trial18843701-27 from 2690354 to 2806868 tid 3 2026-02-13T20:17:08.907 INFO:tasks.rados.rados.0.trial188.stdout:1394: rollback oid 9 current snap is 136 2026-02-13T20:17:08.907 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 9 to 133 2026-02-13T20:17:08.907 INFO:tasks.rados.rados.0.trial188.stdout:1395: read oid 14 snap -1 2026-02-13T20:17:08.907 INFO:tasks.rados.rados.0.trial188.stdout:1395: expect (ObjNum 483 snap 126 seq_num 483) 2026-02-13T20:17:08.907 INFO:tasks.rados.rados.0.trial188.stdout:1396: read oid 26 snap 135 2026-02-13T20:17:08.907 INFO:tasks.rados.rados.0.trial188.stdout:1396: expect (ObjNum 491 snap 127 seq_num 491) 2026-02-13T20:17:08.907 INFO:tasks.rados.rados.0.trial188.stdout:1397: read oid 3 snap -1 2026-02-13T20:17:08.907 INFO:tasks.rados.rados.0.trial188.stdout:1397: expect deleted 2026-02-13T20:17:08.907 INFO:tasks.rados.rados.0.trial188.stdout:1398: delete oid 7 current snap is 136 2026-02-13T20:17:08.908 INFO:tasks.rados.rados.0.trial188.stdout:1398: done (5 left) 2026-02-13T20:17:08.908 INFO:tasks.rados.rados.0.trial188.stdout:1399: rollback oid 6 current snap is 136 2026-02-13T20:17:08.908 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 6 to 135 2026-02-13T20:17:08.908 INFO:tasks.rados.rados.0.trial188.stdout:1400: delete oid 24 current snap is 136 2026-02-13T20:17:08.914 INFO:tasks.rados.rados.0.trial188.stdout:1395: expect (ObjNum 483 snap 126 seq_num 483) 2026-02-13T20:17:08.951 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:17:09.024 INFO:tasks.rados.rados.0.trial188.stdout:1393: finishing write tid 1 to trial18843701-27 2026-02-13T20:17:09.024 INFO:tasks.rados.rados.0.trial188.stdout:1393: finishing write tid 2 to trial18843701-27 2026-02-13T20:17:09.024 INFO:tasks.rados.rados.0.trial188.stdout:1393: finishing write tid 3 to trial18843701-27 2026-02-13T20:17:09.024 INFO:tasks.rados.rados.0.trial188.stdout:1395: done (6 left) 2026-02-13T20:17:09.024 INFO:tasks.rados.rados.0.trial188.stdout:1400: done (5 left) 2026-02-13T20:17:09.024 INFO:tasks.rados.rados.0.trial188.stdout:1401: delete oid 1 current snap is 136 2026-02-13T20:17:09.024 INFO:tasks.rados.rados.0.trial188.stdout:1393: finishing write tid 4 to trial18843701-27 2026-02-13T20:17:09.024 INFO:tasks.rados.rados.0.trial188.stdout:1393: finishing write tid 5 to trial18843701-27 2026-02-13T20:17:09.024 INFO:tasks.rados.rados.0.trial188.stdout:1393: oid 27 updating version 0 to 608 2026-02-13T20:17:09.024 INFO:tasks.rados.rados.0.trial188.stdout:1393: oid 27 version 608 is already newer than 607 2026-02-13T20:17:09.024 INFO:tasks.rados.rados.0.trial188.stdout:1393: oid 27 updating version 608 to 609 2026-02-13T20:17:09.024 INFO:tasks.rados.rados.0.trial188.stdout:1393: oid 27 updating version 609 to 610 2026-02-13T20:17:09.024 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 27 v 610 (ObjNum 524 snap 136 seq_num 524) dirty exists 2026-02-13T20:17:09.024 INFO:tasks.rados.rados.0.trial188.stdout:1393: left oid 27 (ObjNum 524 snap 136 seq_num 524) 2026-02-13T20:17:09.024 INFO:tasks.rados.rados.0.trial188.stdout:1396: expect (ObjNum 491 snap 127 seq_num 491) 2026-02-13T20:17:09.035 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1664330 2026-02-13T20:17:09.053 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:17:09.123 INFO:tasks.rados.rados.0.trial188.stdout:1394: finishing rollback tid 0 to trial18843701-9 2026-02-13T20:17:09.123 INFO:tasks.rados.rados.0.trial188.stdout:1399: finishing rollback tid 0 to trial18843701-6 2026-02-13T20:17:09.123 INFO:tasks.rados.rados.0.trial188.stdout:1394: finishing rollback tid 1 to trial18843701-9 2026-02-13T20:17:09.123 INFO:tasks.rados.rados.0.trial188.stdout:1394: finishing rollback tid 2 to trial18843701-9 2026-02-13T20:17:09.123 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 9 v 420 (ObjNum 470 snap 121 seq_num 470) dirty exists 2026-02-13T20:17:09.123 INFO:tasks.rados.rados.0.trial188.stdout:1399: finishing rollback tid 1 to trial18843701-6 2026-02-13T20:17:09.123 INFO:tasks.rados.rados.0.trial188.stdout:1399: finishing rollback tid 2 to trial18843701-6 2026-02-13T20:17:09.123 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 6 v 644 (ObjNum 508 snap 132 seq_num 508) dirty exists 2026-02-13T20:17:09.123 INFO:tasks.rados.rados.0.trial188.stdout:1393: done (5 left) 2026-02-13T20:17:09.123 INFO:tasks.rados.rados.0.trial188.stdout:1394: done (4 left) 2026-02-13T20:17:09.124 INFO:tasks.rados.rados.0.trial188.stdout:1396: done (3 left) 2026-02-13T20:17:09.124 INFO:tasks.rados.rados.0.trial188.stdout:1397: done (2 left) 2026-02-13T20:17:09.124 INFO:tasks.rados.rados.0.trial188.stdout:1399: done (1 left) 2026-02-13T20:17:09.124 INFO:tasks.rados.rados.0.trial188.stdout:1401: done (0 left) 2026-02-13T20:17:09.124 INFO:tasks.rados.rados.0.trial188.stdout:1402: copy_from oid 31 from oid 48 current snap is 136 2026-02-13T20:17:09.124 INFO:tasks.rados.rados.0.trial188.stdout:1403: delete oid 21 current snap is 136 2026-02-13T20:17:09.127 INFO:tasks.rados.rados.0.trial188.stdout:1403: done (1 left) 2026-02-13T20:17:09.127 INFO:tasks.rados.rados.0.trial188.stdout:1404: write (excl) oid 39 current snap is 136 2026-02-13T20:17:09.127 INFO:tasks.rados.rados.0.trial188.stdout:1404: seq_num 529 ranges {490903=635078,1839445=552508} 2026-02-13T20:17:09.132 INFO:tasks.rados.rados.0.trial188.stdout:1404: writing trial18843701-39 from 490903 to 1125981 tid 1 2026-02-13T20:17:09.137 INFO:tasks.rados.rados.0.trial188.stdout:1404: writing trial18843701-39 from 1839445 to 2391953 tid 2 2026-02-13T20:17:09.137 INFO:tasks.rados.rados.0.trial188.stdout:1405: write (excl) oid 11 current snap is 136 2026-02-13T20:17:09.137 INFO:tasks.rados.rados.0.trial188.stdout:1405: seq_num 530 ranges {507710=710327,1897927=412519,2854892=52818} 2026-02-13T20:17:09.141 INFO:tasks.rados.rados.0.trial188.stdout:1405: writing trial18843701-11 from 507710 to 1218037 tid 1 2026-02-13T20:17:09.145 INFO:tasks.rados.rados.0.trial188.stdout:1405: writing trial18843701-11 from 1897927 to 2310446 tid 2 2026-02-13T20:17:09.148 INFO:tasks.rados.rados.0.trial188.stdout:1405: writing trial18843701-11 from 2854892 to 2907710 tid 3 2026-02-13T20:17:09.148 INFO:tasks.rados.rados.0.trial188.stdout:1406: read oid 13 snap -1 2026-02-13T20:17:09.148 INFO:tasks.rados.rados.0.trial188.stdout:1406: expect (ObjNum 471 snap 121 seq_num 471) 2026-02-13T20:17:09.148 INFO:tasks.rados.rados.0.trial188.stdout:1407: read oid 17 snap 134 2026-02-13T20:17:09.148 INFO:tasks.rados.rados.0.trial188.stdout:1407: expect (ObjNum 417 snap 111 seq_num 417) 2026-02-13T20:17:09.148 INFO:tasks.rados.rados.0.trial188.stdout:1408: read oid 41 snap -1 2026-02-13T20:17:09.148 INFO:tasks.rados.rados.0.trial188.stdout:1408: expect (ObjNum 469 snap 121 seq_num 469) 2026-02-13T20:17:09.149 INFO:tasks.rados.rados.0.trial188.stdout:1409: copy_from oid 2 from oid 37 current snap is 136 2026-02-13T20:17:09.149 INFO:tasks.rados.rados.0.trial188.stdout:1410: read oid 33 snap -1 2026-02-13T20:17:09.149 INFO:tasks.rados.rados.0.trial188.stdout:1410: expect (ObjNum 452 snap 116 seq_num 452) 2026-02-13T20:17:09.149 INFO:tasks.rados.rados.0.trial188.stdout:1411: copy_from oid 15 from oid 3 current snap is 136 2026-02-13T20:17:09.149 INFO:tasks.rados.rados.0.trial188.stdout:1412: snap_remove snap 132 2026-02-13T20:17:09.947 INFO:tasks.rados.rados.0.trial188.stdout:1412: done (9 left) 2026-02-13T20:17:09.947 INFO:tasks.rados.rados.0.trial188.stdout:1413: write oid 20 current snap is 136 2026-02-13T20:17:09.947 INFO:tasks.rados.rados.0.trial188.stdout:1402: finishing copy_from racing read to trial18843701-31 2026-02-13T20:17:09.947 INFO:tasks.rados.rados.0.trial188.stdout:1410: expect (ObjNum 452 snap 116 seq_num 452) 2026-02-13T20:17:09.948 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:17:10.073 INFO:tasks.rados.rados.0.trial188.stdout:1411: finishing copy_from to trial18843701-15 2026-02-13T20:17:10.074 INFO:tasks.rados.rados.0.trial188.stdout:1411: got expected ENOENT (src dne) 2026-02-13T20:17:10.074 INFO:tasks.rados.rados.0.trial188.stdout:1411: finishing copy_from racing read to trial18843701-15 2026-02-13T20:17:10.074 INFO:tasks.rados.rados.0.trial188.stdout:1413: seq_num 531 ranges {524517=785576,1956409=556177} 2026-02-13T20:17:10.078 INFO:tasks.rados.rados.0.trial188.stdout:1413: writing trial18843701-20 from 524517 to 1310093 tid 1 2026-02-13T20:17:10.083 INFO:tasks.rados.rados.0.trial188.stdout:1413: writing trial18843701-20 from 1956409 to 2512586 tid 2 2026-02-13T20:17:10.083 INFO:tasks.rados.rados.0.trial188.stdout:1410: done (9 left) 2026-02-13T20:17:10.083 INFO:tasks.rados.rados.0.trial188.stdout:1411: done (8 left) 2026-02-13T20:17:10.083 INFO:tasks.rados.rados.0.trial188.stdout:1414: write (excl) oid 14 current snap is 136 2026-02-13T20:17:10.083 INFO:tasks.rados.rados.0.trial188.stdout:1404: finishing write tid 1 to trial18843701-39 2026-02-13T20:17:10.083 INFO:tasks.rados.rados.0.trial188.stdout:1402: finishing copy_from to trial18843701-31 2026-02-13T20:17:10.084 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 31 v 415 (ObjNum 489 snap 127 seq_num 489) dirty exists 2026-02-13T20:17:10.084 INFO:tasks.rados.rados.0.trial188.stdout:1404: finishing write tid 2 to trial18843701-39 2026-02-13T20:17:10.084 INFO:tasks.rados.rados.0.trial188.stdout:1404: finishing write tid 3 to trial18843701-39 2026-02-13T20:17:10.084 INFO:tasks.rados.rados.0.trial188.stdout:1414: seq_num 532 ranges {541324=460825,1498538=416188,2393385=547939} 2026-02-13T20:17:10.086 INFO:tasks.rados.rados.0.trial188.stdout:1414: writing trial18843701-14 from 541324 to 1002149 tid 1 2026-02-13T20:17:10.090 INFO:tasks.rados.rados.0.trial188.stdout:1414: writing trial18843701-14 from 1498538 to 1914726 tid 2 2026-02-13T20:17:10.094 INFO:tasks.rados.rados.0.trial188.stdout:1414: writing trial18843701-14 from 2393385 to 2941324 tid 3 2026-02-13T20:17:10.094 INFO:tasks.rados.rados.0.trial188.stdout:1402: done (8 left) 2026-02-13T20:17:10.095 INFO:tasks.rados.rados.0.trial188.stdout:1415: read oid 32 snap -1 2026-02-13T20:17:10.095 INFO:tasks.rados.rados.0.trial188.stdout:1415: expect deleted 2026-02-13T20:17:10.095 INFO:tasks.rados.rados.0.trial188.stdout:1416: copy_from oid 47 from oid 31 current snap is 136 2026-02-13T20:17:10.095 INFO:tasks.rados.rados.0.trial188.stdout:1404: finishing write tid 4 to trial18843701-39 2026-02-13T20:17:10.095 INFO:tasks.rados.rados.0.trial188.stdout:1404: oid 39 updating version 0 to 557 2026-02-13T20:17:10.095 INFO:tasks.rados.rados.0.trial188.stdout:1404: oid 39 updating version 557 to 558 2026-02-13T20:17:10.095 INFO:tasks.rados.rados.0.trial188.stdout:1404: oid 39 version 558 is already newer than 556 2026-02-13T20:17:10.095 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 39 v 558 (ObjNum 529 snap 136 seq_num 529) dirty exists 2026-02-13T20:17:10.095 INFO:tasks.rados.rados.0.trial188.stdout:1404: left oid 39 (ObjNum 529 snap 136 seq_num 529) 2026-02-13T20:17:10.095 INFO:tasks.rados.rados.0.trial188.stdout:1408: expect (ObjNum 469 snap 121 seq_num 469) 2026-02-13T20:17:10.124 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 3673604 2026-02-13T20:17:10.129 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:17:10.218 INFO:tasks.rados.rados.0.trial188.stdout:1406: expect (ObjNum 471 snap 121 seq_num 471) 2026-02-13T20:17:10.218 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:17:10.254 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:17:10.289 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:17:10.326 INFO:tasks.rados.rados.0.trial188.stdout:1405: finishing write tid 1 to trial18843701-11 2026-02-13T20:17:10.326 INFO:tasks.rados.rados.0.trial188.stdout:1405: finishing write tid 2 to trial18843701-11 2026-02-13T20:17:10.326 INFO:tasks.rados.rados.0.trial188.stdout:1405: finishing write tid 3 to trial18843701-11 2026-02-13T20:17:10.326 INFO:tasks.rados.rados.0.trial188.stdout:1405: finishing write tid 4 to trial18843701-11 2026-02-13T20:17:10.326 INFO:tasks.rados.rados.0.trial188.stdout:1404: done (9 left) 2026-02-13T20:17:10.326 INFO:tasks.rados.rados.0.trial188.stdout:1406: done (8 left) 2026-02-13T20:17:10.327 INFO:tasks.rados.rados.0.trial188.stdout:1408: done (7 left) 2026-02-13T20:17:10.327 INFO:tasks.rados.rados.0.trial188.stdout:1417: read oid 49 snap 135 2026-02-13T20:17:10.327 INFO:tasks.rados.rados.0.trial188.stdout:1417: expect (ObjNum 523 snap 135 seq_num 523) 2026-02-13T20:17:10.327 INFO:tasks.rados.rados.0.trial188.stdout:1418: write oid 3 current snap is 136 2026-02-13T20:17:10.327 INFO:tasks.rados.rados.0.trial188.stdout:1405: finishing write tid 5 to trial18843701-11 2026-02-13T20:17:10.327 INFO:tasks.rados.rados.0.trial188.stdout:1405: oid 11 updating version 0 to 374 2026-02-13T20:17:10.327 INFO:tasks.rados.rados.0.trial188.stdout:1405: oid 11 version 374 is already newer than 372 2026-02-13T20:17:10.327 INFO:tasks.rados.rados.0.trial188.stdout:1405: oid 11 version 374 is already newer than 373 2026-02-13T20:17:10.327 INFO:tasks.rados.rados.0.trial188.stdout:1405: oid 11 version 374 is already newer than 371 2026-02-13T20:17:10.327 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 11 v 374 (ObjNum 530 snap 136 seq_num 530) dirty exists 2026-02-13T20:17:10.327 INFO:tasks.rados.rados.0.trial188.stdout:1405: left oid 11 (ObjNum 530 snap 136 seq_num 530) 2026-02-13T20:17:10.328 INFO:tasks.rados.rados.0.trial188.stdout:1407: expect (ObjNum 417 snap 111 seq_num 417) 2026-02-13T20:17:10.400 INFO:tasks.rados.rados.0.trial188.stdout:1409: finishing copy_from racing read to trial18843701-2 2026-02-13T20:17:10.401 INFO:tasks.rados.rados.0.trial188.stdout:1409: finishing copy_from to trial18843701-2 2026-02-13T20:17:10.401 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 2 v 518 (ObjNum 490 snap 127 seq_num 490) dirty exists 2026-02-13T20:17:10.401 INFO:tasks.rados.rados.0.trial188.stdout:1418: seq_num 533 ranges {558131=652427,1673373=559846,2820808=137323} 2026-02-13T20:17:10.404 INFO:tasks.rados.rados.0.trial188.stdout:1418: writing trial18843701-3 from 558131 to 1210558 tid 1 2026-02-13T20:17:10.408 INFO:tasks.rados.rados.0.trial188.stdout:1418: writing trial18843701-3 from 1673373 to 2233219 tid 2 2026-02-13T20:17:10.412 INFO:tasks.rados.rados.0.trial188.stdout:1418: writing trial18843701-3 from 2820808 to 2958131 tid 3 2026-02-13T20:17:10.412 INFO:tasks.rados.rados.0.trial188.stdout:1405: done (8 left) 2026-02-13T20:17:10.412 INFO:tasks.rados.rados.0.trial188.stdout:1407: done (7 left) 2026-02-13T20:17:10.412 INFO:tasks.rados.rados.0.trial188.stdout:1409: done (6 left) 2026-02-13T20:17:10.412 INFO:tasks.rados.rados.0.trial188.stdout:1419: snap_remove snap 133 2026-02-13T20:17:10.952 INFO:tasks.rados.rados.0.trial188.stdout:1419: done (6 left) 2026-02-13T20:17:10.952 INFO:tasks.rados.rados.0.trial188.stdout:1420: rollback oid 34 current snap is 136 2026-02-13T20:17:10.952 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 34 to 135 2026-02-13T20:17:10.953 INFO:tasks.rados.rados.0.trial188.stdout:1413: finishing write tid 1 to trial18843701-20 2026-02-13T20:17:10.953 INFO:tasks.rados.rados.0.trial188.stdout:1413: finishing write tid 2 to trial18843701-20 2026-02-13T20:17:10.953 INFO:tasks.rados.rados.0.trial188.stdout:1413: finishing write tid 3 to trial18843701-20 2026-02-13T20:17:10.953 INFO:tasks.rados.rados.0.trial188.stdout:1413: finishing write tid 4 to trial18843701-20 2026-02-13T20:17:10.953 INFO:tasks.rados.rados.0.trial188.stdout:1413: oid 20 updating version 0 to 327 2026-02-13T20:17:10.953 INFO:tasks.rados.rados.0.trial188.stdout:1413: oid 20 updating version 327 to 329 2026-02-13T20:17:10.953 INFO:tasks.rados.rados.0.trial188.stdout:1413: oid 20 version 329 is already newer than 328 2026-02-13T20:17:10.953 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 20 v 329 (ObjNum 531 snap 136 seq_num 531) dirty exists 2026-02-13T20:17:10.953 INFO:tasks.rados.rados.0.trial188.stdout:1413: left oid 20 (ObjNum 531 snap 136 seq_num 531) 2026-02-13T20:17:10.953 INFO:tasks.rados.rados.0.trial188.stdout:1414: finishing write tid 1 to trial18843701-14 2026-02-13T20:17:10.953 INFO:tasks.rados.rados.0.trial188.stdout:1414: finishing write tid 2 to trial18843701-14 2026-02-13T20:17:10.953 INFO:tasks.rados.rados.0.trial188.stdout:1414: finishing write tid 3 to trial18843701-14 2026-02-13T20:17:10.953 INFO:tasks.rados.rados.0.trial188.stdout:1414: finishing write tid 4 to trial18843701-14 2026-02-13T20:17:10.953 INFO:tasks.rados.rados.0.trial188.stdout:1414: finishing write tid 5 to trial18843701-14 2026-02-13T20:17:10.953 INFO:tasks.rados.rados.0.trial188.stdout:1414: oid 14 updating version 0 to 455 2026-02-13T20:17:10.953 INFO:tasks.rados.rados.0.trial188.stdout:1414: oid 14 updating version 455 to 457 2026-02-13T20:17:10.953 INFO:tasks.rados.rados.0.trial188.stdout:1414: oid 14 version 457 is already newer than 456 2026-02-13T20:17:10.953 INFO:tasks.rados.rados.0.trial188.stdout:1414: oid 14 updating version 457 to 458 2026-02-13T20:17:10.953 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 14 v 458 (ObjNum 532 snap 136 seq_num 532) dirty exists 2026-02-13T20:17:10.953 INFO:tasks.rados.rados.0.trial188.stdout:1414: left oid 14 (ObjNum 532 snap 136 seq_num 532) 2026-02-13T20:17:10.953 INFO:tasks.rados.rados.0.trial188.stdout:1416: finishing copy_from racing read to trial18843701-47 2026-02-13T20:17:10.953 INFO:tasks.rados.rados.0.trial188.stdout:1416: finishing copy_from to trial18843701-47 2026-02-13T20:17:10.953 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 47 v 415 (ObjNum 489 snap 127 seq_num 489) dirty exists 2026-02-13T20:17:10.954 INFO:tasks.rados.rados.0.trial188.stdout:1417: expect (ObjNum 523 snap 135 seq_num 523) 2026-02-13T20:17:11.009 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1292677 2026-02-13T20:17:11.048 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:17:11.103 INFO:tasks.rados.rados.0.trial188.stdout:1418: finishing write tid 1 to trial18843701-3 2026-02-13T20:17:11.103 INFO:tasks.rados.rados.0.trial188.stdout:1418: finishing write tid 2 to trial18843701-3 2026-02-13T20:17:11.103 INFO:tasks.rados.rados.0.trial188.stdout:1418: finishing write tid 3 to trial18843701-3 2026-02-13T20:17:11.103 INFO:tasks.rados.rados.0.trial188.stdout:1418: finishing write tid 4 to trial18843701-3 2026-02-13T20:17:11.104 INFO:tasks.rados.rados.0.trial188.stdout:1418: finishing write tid 5 to trial18843701-3 2026-02-13T20:17:11.104 INFO:tasks.rados.rados.0.trial188.stdout:1418: oid 3 updating version 0 to 459 2026-02-13T20:17:11.104 INFO:tasks.rados.rados.0.trial188.stdout:1418: oid 3 updating version 459 to 461 2026-02-13T20:17:11.104 INFO:tasks.rados.rados.0.trial188.stdout:1418: oid 3 updating version 461 to 462 2026-02-13T20:17:11.104 INFO:tasks.rados.rados.0.trial188.stdout:1418: oid 3 version 462 is already newer than 460 2026-02-13T20:17:11.104 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 3 v 462 (ObjNum 533 snap 136 seq_num 533) dirty exists 2026-02-13T20:17:11.104 INFO:tasks.rados.rados.0.trial188.stdout:1418: left oid 3 (ObjNum 533 snap 136 seq_num 533) 2026-02-13T20:17:11.104 INFO:tasks.rados.rados.0.trial188.stdout:1420: finishing rollback tid 0 to trial18843701-34 2026-02-13T20:17:11.104 INFO:tasks.rados.rados.0.trial188.stdout:1420: finishing rollback tid 1 to trial18843701-34 2026-02-13T20:17:11.104 INFO:tasks.rados.rados.0.trial188.stdout:1413: done (6 left) 2026-02-13T20:17:11.104 INFO:tasks.rados.rados.0.trial188.stdout:1414: done (5 left) 2026-02-13T20:17:11.105 INFO:tasks.rados.rados.0.trial188.stdout:1415: done (4 left) 2026-02-13T20:17:11.105 INFO:tasks.rados.rados.0.trial188.stdout:1416: done (3 left) 2026-02-13T20:17:11.105 INFO:tasks.rados.rados.0.trial188.stdout:1417: done (2 left) 2026-02-13T20:17:11.105 INFO:tasks.rados.rados.0.trial188.stdout:1418: done (1 left) 2026-02-13T20:17:11.105 INFO:tasks.rados.rados.0.trial188.stdout:1421: write oid 42 current snap is 136 2026-02-13T20:17:11.105 INFO:tasks.rados.rados.0.trial188.stdout:1420: finishing rollback tid 2 to trial18843701-34 2026-02-13T20:17:11.105 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 34 v 538 (ObjNum 476 snap 124 seq_num 476) dirty exists 2026-02-13T20:17:11.105 INFO:tasks.rados.rados.0.trial188.stdout:1421: seq_num 534 ranges {574938=727676,1731855=703504,2848231=126707} 2026-02-13T20:17:11.107 INFO:tasks.rados.rados.0.trial188.stdout:1421: writing trial18843701-42 from 574938 to 1302614 tid 1 2026-02-13T20:17:11.111 INFO:tasks.rados.rados.0.trial188.stdout:1421: writing trial18843701-42 from 1731855 to 2435359 tid 2 2026-02-13T20:17:11.114 INFO:tasks.rados.rados.0.trial188.stdout:1421: writing trial18843701-42 from 2848231 to 2974938 tid 3 2026-02-13T20:17:11.114 INFO:tasks.rados.rados.0.trial188.stdout:1420: done (1 left) 2026-02-13T20:17:11.114 INFO:tasks.rados.rados.0.trial188.stdout:1422: rollback oid 33 current snap is 136 2026-02-13T20:17:11.114 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 33 to 134 2026-02-13T20:17:11.114 INFO:tasks.rados.rados.0.trial188.stdout:1423: read oid 43 snap -1 2026-02-13T20:17:11.114 INFO:tasks.rados.rados.0.trial188.stdout:1423: expect (ObjNum 435 snap 112 seq_num 435) 2026-02-13T20:17:11.114 INFO:tasks.rados.rados.0.trial188.stdout:1424: read oid 4 snap 135 2026-02-13T20:17:11.115 INFO:tasks.rados.rados.0.trial188.stdout:1424: expect (ObjNum 506 snap 132 seq_num 506) 2026-02-13T20:17:11.115 INFO:tasks.rados.rados.0.trial188.stdout:1425: write oid 39 current snap is 136 2026-02-13T20:17:11.115 INFO:tasks.rados.rados.0.trial188.stdout:1425: seq_num 535 ranges {591745=402925,1790337=563515} 2026-02-13T20:17:11.117 INFO:tasks.rados.rados.0.trial188.stdout:1425: writing trial18843701-39 from 591745 to 994670 tid 1 2026-02-13T20:17:11.122 INFO:tasks.rados.rados.0.trial188.stdout:1425: writing trial18843701-39 from 1790337 to 2353852 tid 2 2026-02-13T20:17:11.122 INFO:tasks.rados.rados.0.trial188.stdout:1426: delete oid 37 current snap is 136 2026-02-13T20:17:11.123 INFO:tasks.rados.rados.0.trial188.stdout:1423: expect (ObjNum 435 snap 112 seq_num 435) 2026-02-13T20:17:11.207 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2923067 2026-02-13T20:17:11.211 INFO:tasks.rados.rados.0.trial188.stdout:1424: expect (ObjNum 506 snap 132 seq_num 506) 2026-02-13T20:17:11.277 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1638047 2026-02-13T20:17:11.341 INFO:tasks.rados.rados.0.trial188.stdout:1421: finishing write tid 1 to trial18843701-42 2026-02-13T20:17:11.341 INFO:tasks.rados.rados.0.trial188.stdout:1422: finishing rollback tid 0 to trial18843701-33 2026-02-13T20:17:11.341 INFO:tasks.rados.rados.0.trial188.stdout:1422: finishing rollback tid 1 to trial18843701-33 2026-02-13T20:17:11.341 INFO:tasks.rados.rados.0.trial188.stdout:1422: finishing rollback tid 2 to trial18843701-33 2026-02-13T20:17:11.341 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 33 v 421 (ObjNum 452 snap 116 seq_num 452) dirty exists 2026-02-13T20:17:11.341 INFO:tasks.rados.rados.0.trial188.stdout:1425: finishing write tid 1 to trial18843701-39 2026-02-13T20:17:11.341 INFO:tasks.rados.rados.0.trial188.stdout:1421: finishing write tid 2 to trial18843701-42 2026-02-13T20:17:11.341 INFO:tasks.rados.rados.0.trial188.stdout:1421: finishing write tid 3 to trial18843701-42 2026-02-13T20:17:11.342 INFO:tasks.rados.rados.0.trial188.stdout:1422: done (5 left) 2026-02-13T20:17:11.342 INFO:tasks.rados.rados.0.trial188.stdout:1423: done (4 left) 2026-02-13T20:17:11.342 INFO:tasks.rados.rados.0.trial188.stdout:1424: done (3 left) 2026-02-13T20:17:11.342 INFO:tasks.rados.rados.0.trial188.stdout:1426: done (2 left) 2026-02-13T20:17:11.342 INFO:tasks.rados.rados.0.trial188.stdout:1427: snap_create 2026-02-13T20:17:11.342 INFO:tasks.rados.rados.0.trial188.stdout:1425: finishing write tid 2 to trial18843701-39 2026-02-13T20:17:11.342 INFO:tasks.rados.rados.0.trial188.stdout:1421: finishing write tid 4 to trial18843701-42 2026-02-13T20:17:11.342 INFO:tasks.rados.rados.0.trial188.stdout:1425: finishing write tid 3 to trial18843701-39 2026-02-13T20:17:11.342 INFO:tasks.rados.rados.0.trial188.stdout:1421: finishing write tid 5 to trial18843701-42 2026-02-13T20:17:11.342 INFO:tasks.rados.rados.0.trial188.stdout:1421: oid 42 updating version 0 to 422 2026-02-13T20:17:11.342 INFO:tasks.rados.rados.0.trial188.stdout:1421: oid 42 updating version 422 to 424 2026-02-13T20:17:11.342 INFO:tasks.rados.rados.0.trial188.stdout:1421: oid 42 version 424 is already newer than 421 2026-02-13T20:17:11.343 INFO:tasks.rados.rados.0.trial188.stdout:1421: oid 42 version 424 is already newer than 423 2026-02-13T20:17:11.343 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 42 v 424 (ObjNum 534 snap 136 seq_num 534) dirty exists 2026-02-13T20:17:11.343 INFO:tasks.rados.rados.0.trial188.stdout:1421: left oid 42 (ObjNum 534 snap 136 seq_num 534) 2026-02-13T20:17:11.343 INFO:tasks.rados.rados.0.trial188.stdout:1425: finishing write tid 4 to trial18843701-39 2026-02-13T20:17:11.343 INFO:tasks.rados.rados.0.trial188.stdout:1425: oid 39 updating version 0 to 559 2026-02-13T20:17:11.343 INFO:tasks.rados.rados.0.trial188.stdout:1425: oid 39 updating version 559 to 560 2026-02-13T20:17:11.343 INFO:tasks.rados.rados.0.trial188.stdout:1425: oid 39 updating version 560 to 561 2026-02-13T20:17:11.343 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 39 v 561 (ObjNum 535 snap 136 seq_num 535) dirty exists 2026-02-13T20:17:11.343 INFO:tasks.rados.rados.0.trial188.stdout:1425: left oid 39 (ObjNum 535 snap 136 seq_num 535) 2026-02-13T20:17:11.955 INFO:tasks.rados.rados.0.trial188.stdout:1421: done (2 left) 2026-02-13T20:17:11.955 INFO:tasks.rados.rados.0.trial188.stdout:1425: done (1 left) 2026-02-13T20:17:11.956 INFO:tasks.rados.rados.0.trial188.stdout:1427: done (0 left) 2026-02-13T20:17:11.956 INFO:tasks.rados.rados.0.trial188.stdout:1428: rollback oid 2 current snap is 137 2026-02-13T20:17:11.956 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 2 to 136 2026-02-13T20:17:11.956 INFO:tasks.rados.rados.0.trial188.stdout:1429: read oid 49 snap -1 2026-02-13T20:17:11.956 INFO:tasks.rados.rados.0.trial188.stdout:1429: expect (ObjNum 523 snap 135 seq_num 523) 2026-02-13T20:17:11.956 INFO:tasks.rados.rados.0.trial188.stdout:1430: write (excl) oid 27 current snap is 137 2026-02-13T20:17:11.956 INFO:tasks.rados.rados.0.trial188.stdout:1430: seq_num 537 ranges {625359=553423,1790948=567184,2930500=94859} 2026-02-13T20:17:11.959 INFO:tasks.rados.rados.0.trial188.stdout:1430: writing trial18843701-27 from 625359 to 1178782 tid 1 2026-02-13T20:17:11.964 INFO:tasks.rados.rados.0.trial188.stdout:1430: writing trial18843701-27 from 1790948 to 2358132 tid 2 2026-02-13T20:17:11.967 INFO:tasks.rados.rados.0.trial188.stdout:1430: writing trial18843701-27 from 2930500 to 3025359 tid 3 2026-02-13T20:17:11.967 INFO:tasks.rados.rados.0.trial188.stdout:1431: snap_create 2026-02-13T20:17:11.967 INFO:tasks.rados.rados.0.trial188.stdout:1429: expect (ObjNum 523 snap 135 seq_num 523) 2026-02-13T20:17:11.967 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:17:12.021 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:17:12.119 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2720676 2026-02-13T20:17:12.122 INFO:tasks.rados.rados.0.trial188.stdout:1428: finishing rollback tid 0 to trial18843701-2 2026-02-13T20:17:12.122 INFO:tasks.rados.rados.0.trial188.stdout:1428: finishing rollback tid 1 to trial18843701-2 2026-02-13T20:17:12.122 INFO:tasks.rados.rados.0.trial188.stdout:1428: finishing rollback tid 2 to trial18843701-2 2026-02-13T20:17:12.122 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 2 v 565 (ObjNum 490 snap 127 seq_num 490) dirty exists 2026-02-13T20:17:12.122 INFO:tasks.rados.rados.0.trial188.stdout:1430: finishing write tid 1 to trial18843701-27 2026-02-13T20:17:12.123 INFO:tasks.rados.rados.0.trial188.stdout:1430: finishing write tid 2 to trial18843701-27 2026-02-13T20:17:12.123 INFO:tasks.rados.rados.0.trial188.stdout:1430: finishing write tid 3 to trial18843701-27 2026-02-13T20:17:12.123 INFO:tasks.rados.rados.0.trial188.stdout:1430: finishing write tid 4 to trial18843701-27 2026-02-13T20:17:12.123 INFO:tasks.rados.rados.0.trial188.stdout:1430: finishing write tid 5 to trial18843701-27 2026-02-13T20:17:12.123 INFO:tasks.rados.rados.0.trial188.stdout:1430: oid 27 updating version 0 to 621 2026-02-13T20:17:12.123 INFO:tasks.rados.rados.0.trial188.stdout:1430: oid 27 version 621 is already newer than 618 2026-02-13T20:17:12.123 INFO:tasks.rados.rados.0.trial188.stdout:1430: oid 27 version 621 is already newer than 619 2026-02-13T20:17:12.123 INFO:tasks.rados.rados.0.trial188.stdout:1430: oid 27 version 621 is already newer than 620 2026-02-13T20:17:12.123 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 27 v 621 (ObjNum 537 snap 137 seq_num 537) dirty exists 2026-02-13T20:17:12.123 INFO:tasks.rados.rados.0.trial188.stdout:1430: left oid 27 (ObjNum 537 snap 137 seq_num 537) 2026-02-13T20:17:12.895 INFO:tasks.rados.rados.0.trial188.stdout:1428: done (3 left) 2026-02-13T20:17:12.895 INFO:tasks.rados.rados.0.trial188.stdout:1429: done (2 left) 2026-02-13T20:17:12.895 INFO:tasks.rados.rados.0.trial188.stdout:1430: done (1 left) 2026-02-13T20:17:12.895 INFO:tasks.rados.rados.0.trial188.stdout:1431: done (0 left) 2026-02-13T20:17:12.895 INFO:tasks.rados.rados.0.trial188.stdout:1432: snap_create 2026-02-13T20:17:13.894 INFO:tasks.rados.rados.0.trial188.stdout:1432: done (0 left) 2026-02-13T20:17:13.895 INFO:tasks.rados.rados.0.trial188.stdout:1433: snap_remove snap 136 2026-02-13T20:17:14.895 INFO:tasks.rados.rados.0.trial188.stdout:1433: done (0 left) 2026-02-13T20:17:14.896 INFO:tasks.rados.rados.0.trial188.stdout:1434: read oid 33 snap 134 2026-02-13T20:17:14.896 INFO:tasks.rados.rados.0.trial188.stdout:1434: expect (ObjNum 452 snap 116 seq_num 452) 2026-02-13T20:17:14.896 INFO:tasks.rados.rados.0.trial188.stdout:1435: write oid 23 current snap is 139 2026-02-13T20:17:14.896 INFO:tasks.rados.rados.0.trial188.stdout:1435: seq_num 538 ranges {642166=628672,1849430=710842} 2026-02-13T20:17:14.900 INFO:tasks.rados.rados.0.trial188.stdout:1435: writing trial18843701-23 from 642166 to 1270838 tid 1 2026-02-13T20:17:14.906 INFO:tasks.rados.rados.0.trial188.stdout:1435: writing trial18843701-23 from 1849430 to 2560272 tid 2 2026-02-13T20:17:14.906 INFO:tasks.rados.rados.0.trial188.stdout:1436: snap_remove snap 137 2026-02-13T20:17:15.289 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-13T20:17:15.289 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-13T20:17:15.289 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-13T20:17:15.290 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-13T20:17:15.301 INFO:tasks.ceph.mon.a:Started 2026-02-13T20:17:15.301 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-13T20:17:15.302 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T20:17:15.373 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.367+0000 7f8851d0c640 10 monclient: get_monmap_and_config 2026-02-13T20:17:15.373 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.367+0000 7f8851d0c640 10 monclient: build_initial_monmap 2026-02-13T20:17:15.373 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.367+0000 7f8851d0c640 10 monclient: monmap: 2026-02-13T20:17:15.373 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:17:15.373 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:15.373 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:17:15.368895+0000 2026-02-13T20:17:15.373 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:17:15.368895+0000 2026-02-13T20:17:15.373 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:17:15.374 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:15.374 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:17:15.374 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:17:15.374 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:17:15.374 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:15.374 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.367+0000 7f8851d0c640 1 Processor -- start 2026-02-13T20:17:15.374 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.367+0000 7f8851d0c640 1 -- start start 2026-02-13T20:17:15.374 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.367+0000 7f8851d0c640 10 monclient: init 2026-02-13T20:17:15.374 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.368+0000 7f8851d0c640 10 monclient: _reopen_session rank -1 2026-02-13T20:17:15.374 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.368+0000 7f8851d0c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:17:15.374 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.368+0000 7f8851d0c640 10 monclient(hunting): picked mon.noname-b con 0x7f884c1401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:17:15.374 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.368+0000 7f8851d0c640 10 monclient(hunting): picked mon.noname-a con 0x7f884c092020 addr v1:10.20.193.110:6789/0 2026-02-13T20:17:15.374 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.368+0000 7f8851d0c640 10 monclient(hunting): picked mon.noname-c con 0x7f884c091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:17:15.374 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.368+0000 7f8851d0c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f884c08b730 con 0x7f884c092020 2026-02-13T20:17:15.374 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.368+0000 7f8851d0c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f884c05c5b0 con 0x7f884c091950 2026-02-13T20:17:15.374 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.368+0000 7f8851d0c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f884c08bcf0 con 0x7f884c1401c0 2026-02-13T20:17:15.374 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.368+0000 7f8851d0c640 10 monclient(hunting): _renew_subs 2026-02-13T20:17:15.374 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.368+0000 7f8851d0c640 10 monclient(hunting): authenticate will time out at 997.059212s 2026-02-13T20:17:15.374 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.368+0000 7f884b7fe640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f884c1401c0 0x7f884c091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:38438/0 (socket says 10.20.193.110:38438) 2026-02-13T20:17:15.374 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.368+0000 7f884b7fe640 1 -- 10.20.193.110:0/1629935650 learned_addr learned my addr 10.20.193.110:0/1629935650 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:17:15.374 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.368+0000 7f884a7fc640 1 -- 10.20.193.110:0/1629935650 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 447979906 0 0) 0x7f884c08bcf0 con 0x7f884c1401c0 2026-02-13T20:17:15.374 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.368+0000 7f884a7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:17:15.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.368+0000 7f884a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:15.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.368+0000 7f884a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:15.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.368+0000 7f884a7fc640 10 monclient(hunting): my global_id is 94187 2026-02-13T20:17:15.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.368+0000 7f884a7fc640 1 -- 10.20.193.110:0/1629935650 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88300035e0 con 0x7f884c1401c0 2026-02-13T20:17:15.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.368+0000 7f884a7fc640 1 -- 10.20.193.110:0/1629935650 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2180713450 0 0) 0x7f88300035e0 con 0x7f884c1401c0 2026-02-13T20:17:15.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.368+0000 7f884a7fc640 1 -- 10.20.193.110:0/1629935650 >> v1:10.20.193.188:6789/0 conn(0x7f884c091950 legacy=0x7f884c1a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T20:17:15.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.368+0000 7f884a7fc640 1 -- 10.20.193.110:0/1629935650 >> v1:10.20.193.110:6789/0 conn(0x7f884c092020 legacy=0x7f884c1812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:15.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.368+0000 7f884a7fc640 10 monclient: _finish_hunting 0 2026-02-13T20:17:15.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.368+0000 7f884a7fc640 1 monclient: found mon.noname-b 2026-02-13T20:17:15.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.368+0000 7f884a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:17:15.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.368+0000 7f884a7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:17:15.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.368+0000 7f884a7fc640 1 -- 10.20.193.110:0/1629935650 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f884c140590 con 0x7f884c1401c0 2026-02-13T20:17:15.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.368+0000 7f884a7fc640 10 monclient: _finish_auth 0 2026-02-13T20:17:15.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.368+0000 7f884a7fc640 10 monclient: _check_auth_tickets 2026-02-13T20:17:15.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.368+0000 7f884a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:17:15.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.368+0000 7f884a7fc640 1 -- 10.20.193.110:0/1629935650 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f8838002dd0 con 0x7f884c1401c0 2026-02-13T20:17:15.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.368+0000 7f8851d0c640 5 monclient: authenticate success, global_id 94187 2026-02-13T20:17:15.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.368+0000 7f884a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:15.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.368+0000 7f884a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:17:15.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.368+0000 7f884a7fc640 10 monclient: dump: 2026-02-13T20:17:15.375 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:15.375 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:15.375 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.376 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.376 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:15.376 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:15.376 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:15.376 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:15.376 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:15.376 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:15.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.368+0000 7f8851d0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:17:15.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.368+0000 7f884a7fc640 1 -- 10.20.193.110:0/1629935650 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8838002fa0 con 0x7f884c1401c0 2026-02-13T20:17:15.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.368+0000 7f884a7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:17:15.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.368+0000 7f884a7fc640 1 -- 10.20.193.110:0/1629935650 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f88380033b0 con 0x7f884c1401c0 2026-02-13T20:17:15.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.368+0000 7f8851d0c640 10 monclient: get_monmap_and_config success 2026-02-13T20:17:15.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.368+0000 7f884a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:15.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.368+0000 7f8851d0c640 4 set_mon_vals no callback set 2026-02-13T20:17:15.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.368+0000 7f884a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:17:15.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.368+0000 7f884a7fc640 10 monclient: dump: 2026-02-13T20:17:15.376 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:15.376 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:15.376 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.376 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.376 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:15.376 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:15.376 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:15.376 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:15.377 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:15.377 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:15.377 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.368+0000 7f8851d0c640 10 monclient: shutdown 2026-02-13T20:17:15.377 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.368+0000 7f8851d0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:17:15.377 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.368+0000 7f8851d0c640 1 -- 10.20.193.110:0/1629935650 >> v1:10.20.193.110:6790/0 conn(0x7f884c1401c0 legacy=0x7f884c091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:15.377 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.368+0000 7f8851d0c640 1 -- 10.20.193.110:0/1629935650 shutdown_connections 2026-02-13T20:17:15.377 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.368+0000 7f8851d0c640 1 -- 10.20.193.110:0/1629935650 >> 10.20.193.110:0/1629935650 conn(0x7f884c054e90 msgr2=0x7f884c058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:17:15.377 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.368+0000 7f8851d0c640 1 -- 10.20.193.110:0/1629935650 shutdown_connections 2026-02-13T20:17:15.377 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.368+0000 7f8851d0c640 1 -- 10.20.193.110:0/1629935650 wait complete. 2026-02-13T20:17:15.377 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.369+0000 7f8851d0c640 10 monclient: build_initial_monmap 2026-02-13T20:17:15.377 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.369+0000 7f8851d0c640 10 monclient: monmap: 2026-02-13T20:17:15.377 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:17:15.377 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:17:15.377 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:17:15.377 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:17:15.377 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:17:15.377 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:17:15.377 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:17:15.377 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:17:15.377 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:17:15.377 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:15.377 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.369+0000 7f8851d0c640 1 Processor -- start 2026-02-13T20:17:15.377 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.369+0000 7f8851d0c640 1 -- start start 2026-02-13T20:17:15.377 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.369+0000 7f8851d0c640 10 monclient: init 2026-02-13T20:17:15.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.369+0000 7f8851d0c640 10 monclient: _reopen_session rank -1 2026-02-13T20:17:15.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.369+0000 7f8851d0c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:17:15.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.369+0000 7f8851d0c640 10 monclient(hunting): picked mon.noname-c con 0x7f884c091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:17:15.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.369+0000 7f8851d0c640 10 monclient(hunting): picked mon.noname-a con 0x7f884c1401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:17:15.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.369+0000 7f8851d0c640 10 monclient(hunting): picked mon.noname-b con 0x7f884c152750 addr v1:10.20.193.188:6789/0 2026-02-13T20:17:15.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.369+0000 7f8851d0c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f884c13eb00 con 0x7f884c1401c0 2026-02-13T20:17:15.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.369+0000 7f8851d0c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f884c131140 con 0x7f884c152750 2026-02-13T20:17:15.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.369+0000 7f8851d0c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f884c08ae90 con 0x7f884c091950 2026-02-13T20:17:15.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.369+0000 7f8851d0c640 10 monclient(hunting): _renew_subs 2026-02-13T20:17:15.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.369+0000 7f8851d0c640 10 monclient(hunting): authenticate will time out at 997.060892s 2026-02-13T20:17:15.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.369+0000 7f884b7fe640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f884c091950 0x7f884c13d620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:38440/0 (socket says 10.20.193.110:38440) 2026-02-13T20:17:15.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.369+0000 7f884b7fe640 1 -- 10.20.193.110:0/3048068913 learned_addr learned my addr 10.20.193.110:0/3048068913 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:17:15.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.370+0000 7f8827fff640 1 -- 10.20.193.110:0/3048068913 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1548192997 0 0) 0x7f884c08ae90 con 0x7f884c091950 2026-02-13T20:17:15.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.370+0000 7f8827fff640 10 monclient(hunting): _negotiate 2026-02-13T20:17:15.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.370+0000 7f8827fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:15.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.370+0000 7f8827fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:15.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.370+0000 7f8827fff640 10 monclient(hunting): my global_id is 94190 2026-02-13T20:17:15.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.370+0000 7f8827fff640 1 -- 10.20.193.110:0/3048068913 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f881c0035e0 con 0x7f884c091950 2026-02-13T20:17:15.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.370+0000 7f8827fff640 1 -- 10.20.193.110:0/3048068913 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1414374889 0 0) 0x7f881c0035e0 con 0x7f884c091950 2026-02-13T20:17:15.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.370+0000 7f8827fff640 1 -- 10.20.193.110:0/3048068913 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f884c08ae90 con 0x7f884c091950 2026-02-13T20:17:15.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.370+0000 7f8827fff640 1 -- 10.20.193.110:0/3048068913 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2160067047 0 0) 0x7f884c131140 con 0x7f884c152750 2026-02-13T20:17:15.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.370+0000 7f8827fff640 10 monclient(hunting): _negotiate 2026-02-13T20:17:15.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.370+0000 7f8827fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:15.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.370+0000 7f8827fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:15.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.370+0000 7f8827fff640 10 monclient(hunting): my global_id is 4633 2026-02-13T20:17:15.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.370+0000 7f8827fff640 1 -- 10.20.193.110:0/3048068913 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f881c0035e0 con 0x7f884c152750 2026-02-13T20:17:15.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.370+0000 7f8827fff640 1 -- 10.20.193.110:0/3048068913 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f8838002ce0 con 0x7f884c091950 2026-02-13T20:17:15.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.370+0000 7f8827fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:17:15.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.370+0000 7f8827fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:17:15.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.370+0000 7f8827fff640 10 monclient(hunting): dump: 2026-02-13T20:17:15.379 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:15.379 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:15.379 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.379 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.379 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:15.379 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:15.379 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:15.379 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:15.379 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:15.379 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:15.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.370+0000 7f8827fff640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:17:15.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.370+0000 7f8827fff640 1 -- 10.20.193.110:0/3048068913 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2925448392 0 0) 0x7f884c08ae90 con 0x7f884c091950 2026-02-13T20:17:15.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.370+0000 7f8827fff640 1 -- 10.20.193.110:0/3048068913 >> v1:10.20.193.188:6789/0 conn(0x7f884c152750 legacy=0x7f884c1951f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:15.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.370+0000 7f8827fff640 1 -- 10.20.193.110:0/3048068913 >> v1:10.20.193.110:6789/0 conn(0x7f884c1401c0 legacy=0x7f884c193ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:15.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.370+0000 7f8827fff640 10 monclient: _finish_hunting 0 2026-02-13T20:17:15.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.370+0000 7f8827fff640 1 monclient: found mon.c 2026-02-13T20:17:15.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.370+0000 7f8827fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:17:15.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.370+0000 7f8827fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:17:15.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.370+0000 7f8827fff640 1 -- 10.20.193.110:0/3048068913 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f884c05d320 con 0x7f884c091950 2026-02-13T20:17:15.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.370+0000 7f8827fff640 10 monclient: _finish_auth 0 2026-02-13T20:17:15.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.370+0000 7f8827fff640 10 monclient: _check_auth_tickets 2026-02-13T20:17:15.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.370+0000 7f8827fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:17:15.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.370+0000 7f8851d0c640 5 monclient: authenticate success, global_id 94190 2026-02-13T20:17:15.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.370+0000 7f8851d0c640 10 monclient: _renew_subs 2026-02-13T20:17:15.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.370+0000 7f8851d0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:17:15.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.370+0000 7f8851d0c640 1 -- 10.20.193.110:0/3048068913 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f884c12ede0 con 0x7f884c091950 2026-02-13T20:17:15.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.370+0000 7f8851d0c640 10 monclient: _renew_subs 2026-02-13T20:17:15.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.370+0000 7f8851d0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:17:15.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.370+0000 7f8851d0c640 1 -- 10.20.193.110:0/3048068913 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f884c13dd30 con 0x7f884c091950 2026-02-13T20:17:15.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.370+0000 7f8827fff640 1 -- 10.20.193.110:0/3048068913 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8838004b50 con 0x7f884c091950 2026-02-13T20:17:15.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.370+0000 7f8827fff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:17:15.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.370+0000 7f8827fff640 1 -- 10.20.193.110:0/3048068913 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f8838004f30 con 0x7f884c091950 2026-02-13T20:17:15.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.370+0000 7f8827fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:15.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.370+0000 7f8827fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:17:15.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.370+0000 7f8827fff640 10 monclient: dump: 2026-02-13T20:17:15.380 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:15.380 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:15.380 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.380 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.380 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:15.380 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:15.380 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:15.380 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:15.380 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:15.380 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:15.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.370+0000 7f8849ffb640 4 set_mon_vals no callback set 2026-02-13T20:17:15.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.371+0000 7f8851d0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:17:15.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.371+0000 7f8851d0c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:17:15.381 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.371+0000 7f8851d0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:17:15.381 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.371+0000 7f8851d0c640 1 -- 10.20.193.110:0/3048068913 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f884c13f8b0 con 0x7f884c091950 2026-02-13T20:17:15.381 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.371+0000 7f8827fff640 1 -- 10.20.193.110:0/3048068913 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f8838005090 con 0x7f884c091950 2026-02-13T20:17:15.381 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.371+0000 7f8827fff640 1 -- 10.20.193.110:0/3048068913 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(298..298 src has 1..298) ==== 3943+0+0 (unknown 260527215 0 0) 0x7f883804ea70 con 0x7f884c091950 2026-02-13T20:17:15.381 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.371+0000 7f884affd640 10 monclient: get_auth_request con 0x7f881c03f7e0 auth_method 0 2026-02-13T20:17:15.381 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.374+0000 7f8827fff640 1 -- 10.20.193.110:0/3048068913 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f8838017260 con 0x7f884c091950 2026-02-13T20:17:15.381 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.374+0000 7f8827fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:17:15.381 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.374+0000 7f8827fff640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:17:15.518 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.517+0000 7f8851d0c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T20:17:15.518 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.517+0000 7f8851d0c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T20:17:15.519 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.517+0000 7f8851d0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:17:15.519 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.517+0000 7f8851d0c640 1 -- 10.20.193.110:0/3048068913 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f884c055bb0 con 0x7f884c091950 2026-02-13T20:17:15.519 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.517+0000 7f8827fff640 1 -- 10.20.193.110:0/3048068913 <== mon.2 v1:10.20.193.110:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 2532413852) 0x7f8838016a10 con 0x7f884c091950 2026-02-13T20:17:15.519 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.517+0000 7f8827fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T20:17:15.519 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.517+0000 7f8827fff640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:17:15.519 INFO:teuthology.orchestra.run.trial110.stdout:{"election_epoch":22,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","modified":"2026-02-13T20:11:07.161192Z","created":"2026-02-13T20:11:07.161192Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6789","nonce":0}]},"addr":"10.20.193.110:6789/0","public_addr":"10.20.193.110:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161241+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6789","nonce":0}]},"addr":"10.20.193.188:6789/0","public_addr":"10.20.193.188:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161242+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6790","nonce":0}]},"addr":"10.20.193.110:6790/0","public_addr":"10.20.193.110:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161243+0000","crush_location":[]}]}} 2026-02-13T20:17:15.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.517+0000 7f8851d0c640 1 -- 10.20.193.110:0/3048068913 >> v1:10.20.193.188:6812/1623052694 conn(0x7f881c03f7e0 legacy=0x7f881c05fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:15.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.517+0000 7f8851d0c640 10 monclient: shutdown 2026-02-13T20:17:15.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.517+0000 7f8851d0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:17:15.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.517+0000 7f8851d0c640 1 -- 10.20.193.110:0/3048068913 >> v1:10.20.193.110:6790/0 conn(0x7f884c091950 legacy=0x7f884c13d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:15.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.517+0000 7f8851d0c640 1 -- 10.20.193.110:0/3048068913 shutdown_connections 2026-02-13T20:17:15.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.517+0000 7f8851d0c640 1 -- 10.20.193.110:0/3048068913 >> 10.20.193.110:0/3048068913 conn(0x7f884c054e90 msgr2=0x7f884c13f050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:17:15.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.517+0000 7f8851d0c640 1 -- 10.20.193.110:0/3048068913 shutdown_connections 2026-02-13T20:17:15.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.517+0000 7f8851d0c640 1 -- 10.20.193.110:0/3048068913 wait complete. 2026-02-13T20:17:15.527 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-13T20:17:15.528 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-13T20:17:15.528 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T20:17:15.605 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.593+0000 7f839ec5b640 10 monclient: get_monmap_and_config 2026-02-13T20:17:15.605 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.593+0000 7f839ec5b640 10 monclient: build_initial_monmap 2026-02-13T20:17:15.605 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.593+0000 7f839ec5b640 10 monclient: monmap: 2026-02-13T20:17:15.606 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:17:15.606 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:15.606 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:17:15.594685+0000 2026-02-13T20:17:15.606 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:17:15.594685+0000 2026-02-13T20:17:15.606 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:17:15.606 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:15.606 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:17:15.606 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:17:15.606 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:17:15.606 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:15.607 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.593+0000 7f839ec5b640 1 Processor -- start 2026-02-13T20:17:15.607 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.593+0000 7f839ec5b640 1 -- start start 2026-02-13T20:17:15.607 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.593+0000 7f839ec5b640 10 monclient: init 2026-02-13T20:17:15.607 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.593+0000 7f839ec5b640 10 monclient: _reopen_session rank -1 2026-02-13T20:17:15.607 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.593+0000 7f839ec5b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:17:15.607 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.593+0000 7f839ec5b640 10 monclient(hunting): picked mon.noname-a con 0x7f83981401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:17:15.607 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.593+0000 7f839ec5b640 10 monclient(hunting): picked mon.noname-c con 0x7f8398092020 addr v1:10.20.193.188:6789/0 2026-02-13T20:17:15.607 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f839ec5b640 10 monclient(hunting): picked mon.noname-b con 0x7f8398091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:17:15.607 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f839ec5b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f839808b730 con 0x7f83981401c0 2026-02-13T20:17:15.607 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f839ec5b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f839805c5b0 con 0x7f8398092020 2026-02-13T20:17:15.607 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f839ec5b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f839808bcf0 con 0x7f8398091950 2026-02-13T20:17:15.608 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f839ec5b640 10 monclient(hunting): _renew_subs 2026-02-13T20:17:15.608 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f839ec5b640 10 monclient(hunting): authenticate will time out at 997.285034s 2026-02-13T20:17:15.608 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f839c9d0640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f83981401c0 0x7f8398091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:59332/0 (socket says 10.20.193.110:59332) 2026-02-13T20:17:15.608 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f839c9d0640 1 -- 10.20.193.110:0/968097235 learned_addr learned my addr 10.20.193.110:0/968097235 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:17:15.608 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f839d1d1640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f8398091950 0x7f83981a2a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:38450/0 (socket says 10.20.193.110:38450) 2026-02-13T20:17:15.608 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f838f7fe640 1 -- 10.20.193.110:0/968097235 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 90329924 0 0) 0x7f839808bcf0 con 0x7f8398091950 2026-02-13T20:17:15.608 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f838f7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:17:15.608 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f838f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:15.608 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f838f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:15.608 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f838f7fe640 10 monclient(hunting): my global_id is 94193 2026-02-13T20:17:15.608 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f838f7fe640 1 -- 10.20.193.110:0/968097235 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83840035e0 con 0x7f8398091950 2026-02-13T20:17:15.609 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f838f7fe640 1 -- 10.20.193.110:0/968097235 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2597083309 0 0) 0x7f83840035e0 con 0x7f8398091950 2026-02-13T20:17:15.609 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f838f7fe640 1 -- 10.20.193.110:0/968097235 >> v1:10.20.193.188:6789/0 conn(0x7f8398092020 legacy=0x7f83981812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:15.609 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f838f7fe640 1 -- 10.20.193.110:0/968097235 >> v1:10.20.193.110:6789/0 conn(0x7f83981401c0 legacy=0x7f8398091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:15.609 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f838f7fe640 10 monclient: _finish_hunting 0 2026-02-13T20:17:15.609 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f838f7fe640 1 monclient: found mon.noname-b 2026-02-13T20:17:15.609 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f838f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:17:15.609 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f838f7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:17:15.609 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f838f7fe640 1 -- 10.20.193.110:0/968097235 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8398140590 con 0x7f8398091950 2026-02-13T20:17:15.609 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f838f7fe640 10 monclient: _finish_auth 0 2026-02-13T20:17:15.609 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f838f7fe640 10 monclient: _check_auth_tickets 2026-02-13T20:17:15.609 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f838f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:17:15.609 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f838f7fe640 1 -- 10.20.193.110:0/968097235 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f8394003eb0 con 0x7f8398091950 2026-02-13T20:17:15.610 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f839ec5b640 5 monclient: authenticate success, global_id 94193 2026-02-13T20:17:15.610 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f839ec5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:17:15.610 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f838f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:15.610 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f838f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:17:15.610 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f838f7fe640 10 monclient: dump: 2026-02-13T20:17:15.610 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:15.610 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:15.610 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.610 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.610 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:15.610 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:15.610 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:15.611 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:15.611 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:15.611 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:15.611 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f839ec5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:17:15.611 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f838f7fe640 1 -- 10.20.193.110:0/968097235 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8394004080 con 0x7f8398091950 2026-02-13T20:17:15.611 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f838f7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:17:15.611 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f839ec5b640 10 monclient: get_monmap_and_config success 2026-02-13T20:17:15.611 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f838f7fe640 1 -- 10.20.193.110:0/968097235 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f8394004450 con 0x7f8398091950 2026-02-13T20:17:15.611 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f839ec5b640 4 set_mon_vals no callback set 2026-02-13T20:17:15.611 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f838f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:15.611 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f838f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:17:15.611 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f838f7fe640 10 monclient: dump: 2026-02-13T20:17:15.612 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:15.612 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:15.612 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.612 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.612 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:15.612 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:15.612 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:15.612 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:15.612 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:15.612 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:15.612 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f839ec5b640 10 monclient: shutdown 2026-02-13T20:17:15.612 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f839ec5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:17:15.613 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f839ec5b640 1 -- 10.20.193.110:0/968097235 >> v1:10.20.193.110:6790/0 conn(0x7f8398091950 legacy=0x7f83981a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:15.613 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f839ec5b640 1 -- 10.20.193.110:0/968097235 shutdown_connections 2026-02-13T20:17:15.613 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f839ec5b640 1 -- 10.20.193.110:0/968097235 >> 10.20.193.110:0/968097235 conn(0x7f8398054e90 msgr2=0x7f8398058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:17:15.613 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f839ec5b640 1 -- 10.20.193.110:0/968097235 shutdown_connections 2026-02-13T20:17:15.613 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f839ec5b640 1 -- 10.20.193.110:0/968097235 wait complete. 2026-02-13T20:17:15.613 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f839ec5b640 10 monclient: build_initial_monmap 2026-02-13T20:17:15.613 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f839ec5b640 10 monclient: monmap: 2026-02-13T20:17:15.613 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:17:15.613 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:17:15.613 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:17:15.613 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:17:15.613 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:17:15.614 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:17:15.614 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:17:15.614 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:17:15.614 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:17:15.614 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:15.614 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f839ec5b640 1 Processor -- start 2026-02-13T20:17:15.614 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f839ec5b640 1 -- start start 2026-02-13T20:17:15.614 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f839ec5b640 10 monclient: init 2026-02-13T20:17:15.614 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f839ec5b640 10 monclient: _reopen_session rank -1 2026-02-13T20:17:15.614 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f839ec5b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:17:15.614 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f839ec5b640 10 monclient(hunting): picked mon.noname-c con 0x7f8398091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:17:15.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f839ec5b640 10 monclient(hunting): picked mon.noname-a con 0x7f83981401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:17:15.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f839ec5b640 10 monclient(hunting): picked mon.noname-b con 0x7f8398089e40 addr v1:10.20.193.188:6789/0 2026-02-13T20:17:15.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f839ec5b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f839813e4f0 con 0x7f83981401c0 2026-02-13T20:17:15.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f839ec5b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f839813f0c0 con 0x7f8398089e40 2026-02-13T20:17:15.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f839ec5b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f839808c550 con 0x7f8398091950 2026-02-13T20:17:15.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f839ec5b640 10 monclient(hunting): _renew_subs 2026-02-13T20:17:15.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f839ec5b640 10 monclient(hunting): authenticate will time out at 997.286905s 2026-02-13T20:17:15.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f838ffff640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f83981401c0 0x7f83981a1040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:59342/0 (socket says 10.20.193.110:59342) 2026-02-13T20:17:15.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.595+0000 7f838ffff640 1 -- 10.20.193.110:0/2382927761 learned_addr learned my addr 10.20.193.110:0/2382927761 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:17:15.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f838d7fa640 1 -- 10.20.193.110:0/2382927761 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 259915114 0 0) 0x7f839813f0c0 con 0x7f8398089e40 2026-02-13T20:17:15.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f838d7fa640 10 monclient(hunting): _negotiate 2026-02-13T20:17:15.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f838d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:15.616 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f838d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:15.616 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f838d7fa640 10 monclient(hunting): my global_id is 4636 2026-02-13T20:17:15.616 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f838d7fa640 1 -- 10.20.193.110:0/2382927761 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83680035e0 con 0x7f8398089e40 2026-02-13T20:17:15.616 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f838d7fa640 1 -- 10.20.193.110:0/2382927761 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3473214302 0 0) 0x7f839813e4f0 con 0x7f83981401c0 2026-02-13T20:17:15.616 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f838d7fa640 10 monclient(hunting): _negotiate 2026-02-13T20:17:15.616 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f838d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:15.616 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f838d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:15.616 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f838d7fa640 10 monclient(hunting): my global_id is 104097 2026-02-13T20:17:15.616 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f838d7fa640 1 -- 10.20.193.110:0/2382927761 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f839813f0c0 con 0x7f83981401c0 2026-02-13T20:17:15.616 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f838d7fa640 1 -- 10.20.193.110:0/2382927761 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 863664766 0 0) 0x7f83680035e0 con 0x7f8398089e40 2026-02-13T20:17:15.616 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f838d7fa640 1 -- 10.20.193.110:0/2382927761 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f839813e4f0 con 0x7f8398089e40 2026-02-13T20:17:15.616 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f838d7fa640 1 -- 10.20.193.110:0/2382927761 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f83940043a0 con 0x7f8398089e40 2026-02-13T20:17:15.617 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f838d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:17:15.617 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f838d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:17:15.617 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f838d7fa640 10 monclient(hunting): dump: 2026-02-13T20:17:15.617 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:15.617 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:15.617 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.617 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.617 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:15.617 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:15.617 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:15.617 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:15.618 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:15.618 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:15.618 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f838d7fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:17:15.618 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f838d7fa640 1 -- 10.20.193.110:0/2382927761 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 447201474 0 0) 0x7f839808c550 con 0x7f8398091950 2026-02-13T20:17:15.618 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f838d7fa640 10 monclient(hunting): _negotiate 2026-02-13T20:17:15.618 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f838d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:15.618 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f838d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:15.618 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f838d7fa640 10 monclient(hunting): my global_id is 94196 2026-02-13T20:17:15.618 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f838d7fa640 1 -- 10.20.193.110:0/2382927761 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83680035e0 con 0x7f8398091950 2026-02-13T20:17:15.618 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f838d7fa640 1 -- 10.20.193.110:0/2382927761 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1560819034 0 0) 0x7f839813f0c0 con 0x7f83981401c0 2026-02-13T20:17:15.618 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f838d7fa640 1 -- 10.20.193.110:0/2382927761 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f839808c550 con 0x7f83981401c0 2026-02-13T20:17:15.618 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f838d7fa640 1 -- 10.20.193.110:0/2382927761 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f8380003170 con 0x7f83981401c0 2026-02-13T20:17:15.619 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f838d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:17:15.619 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f838d7fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:17:15.619 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f838d7fa640 10 monclient(hunting): dump: 2026-02-13T20:17:15.619 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:15.619 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:15.619 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.619 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.619 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:15.619 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:15.619 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:15.619 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:15.619 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:15.620 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:15.620 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f838d7fa640 1 -- 10.20.193.110:0/2382927761 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3643734201 0 0) 0x7f839813e4f0 con 0x7f8398089e40 2026-02-13T20:17:15.620 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f838d7fa640 1 -- 10.20.193.110:0/2382927761 >> v1:10.20.193.110:6790/0 conn(0x7f8398091950 legacy=0x7f8398116e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:15.620 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f838d7fa640 1 -- 10.20.193.110:0/2382927761 >> v1:10.20.193.110:6789/0 conn(0x7f83981401c0 legacy=0x7f83981a1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:15.620 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f838d7fa640 10 monclient: _finish_hunting 0 2026-02-13T20:17:15.620 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f838d7fa640 1 monclient: found mon.b 2026-02-13T20:17:15.620 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f838d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:17:15.620 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f838d7fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:17:15.620 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f838d7fa640 1 -- 10.20.193.110:0/2382927761 --> v1:10.20.193.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83980910f0 con 0x7f8398089e40 2026-02-13T20:17:15.620 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f838d7fa640 10 monclient: _finish_auth 0 2026-02-13T20:17:15.620 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f838d7fa640 10 monclient: _check_auth_tickets 2026-02-13T20:17:15.620 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f838d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:17:15.620 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f839ec5b640 5 monclient: authenticate success, global_id 4636 2026-02-13T20:17:15.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f839ec5b640 10 monclient: _renew_subs 2026-02-13T20:17:15.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f839ec5b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:17:15.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f839ec5b640 1 -- 10.20.193.110:0/2382927761 --> v1:10.20.193.188:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f839812f4c0 con 0x7f8398089e40 2026-02-13T20:17:15.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f839ec5b640 10 monclient: _renew_subs 2026-02-13T20:17:15.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f839ec5b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:17:15.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f839ec5b640 1 -- 10.20.193.110:0/2382927761 --> v1:10.20.193.188:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f839805d320 con 0x7f8398089e40 2026-02-13T20:17:15.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f838d7fa640 1 -- 10.20.193.110:0/2382927761 <== mon.1 v1:10.20.193.188:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8394005c30 con 0x7f8398089e40 2026-02-13T20:17:15.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f838d7fa640 10 monclient: handle_config config(0 keys) 2026-02-13T20:17:15.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f838d7fa640 1 -- 10.20.193.110:0/2382927761 <== mon.1 v1:10.20.193.188:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f8394005f50 con 0x7f8398089e40 2026-02-13T20:17:15.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f838d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:15.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f838d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:17:15.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f838effd640 4 set_mon_vals no callback set 2026-02-13T20:17:15.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.596+0000 7f838d7fa640 10 monclient: dump: 2026-02-13T20:17:15.622 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:15.622 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:15.622 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.622 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.622 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:15.622 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:15.622 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:15.622 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:15.622 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:15.622 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:15.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.598+0000 7f839ec5b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:17:15.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.598+0000 7f839ec5b640 1 -- 10.20.193.110:0/2382927761 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f83980008d0 con 0x7f8398092020 2026-02-13T20:17:15.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.598+0000 7f838d7fa640 1 -- 10.20.193.110:0/2382927761 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1774553154 0 0) 0x7f83980008d0 con 0x7f8398092020 2026-02-13T20:17:15.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.598+0000 7f838d7fa640 10 monclient(hunting): _negotiate 2026-02-13T20:17:15.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.598+0000 7f838d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:15.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.598+0000 7f838d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:15.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.598+0000 7f838d7fa640 10 monclient(hunting): my global_id is 104100 2026-02-13T20:17:15.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.598+0000 7f838d7fa640 1 -- 10.20.193.110:0/2382927761 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f839813e4f0 con 0x7f8398092020 2026-02-13T20:17:15.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.598+0000 7f838d7fa640 1 -- 10.20.193.110:0/2382927761 <== mon.1 v1:10.20.193.188:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f8394012bc0 con 0x7f8398089e40 2026-02-13T20:17:15.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.598+0000 7f838d7fa640 1 -- 10.20.193.110:0/2382927761 <== mon.1 v1:10.20.193.188:6789/0 8 ==== osd_map(298..298 src has 1..298) ==== 3943+0+0 (unknown 260527215 0 0) 0x7f839404f8a0 con 0x7f8398089e40 2026-02-13T20:17:15.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.598+0000 7f838d7fa640 1 -- 10.20.193.110:0/2382927761 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 512579370 0 0) 0x7f839813e4f0 con 0x7f8398092020 2026-02-13T20:17:15.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.598+0000 7f838d7fa640 1 -- 10.20.193.110:0/2382927761 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f83980008d0 con 0x7f8398092020 2026-02-13T20:17:15.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.598+0000 7f838d7fa640 1 -- 10.20.193.110:0/2382927761 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f8388002d90 con 0x7f8398092020 2026-02-13T20:17:15.624 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.598+0000 7f838d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:15.624 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.598+0000 7f838d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:17:15.624 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.598+0000 7f838d7fa640 10 monclient: dump: 2026-02-13T20:17:15.624 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:15.624 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:15.624 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.624 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.624 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:15.624 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:15.624 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:15.624 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:15.624 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:15.624 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:15.624 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.598+0000 7f838ffff640 10 monclient: get_auth_request con 0x7f836803fd20 auth_method 0 2026-02-13T20:17:15.625 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.598+0000 7f838d7fa640 1 -- 10.20.193.110:0/2382927761 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1138949814 0 0) 0x7f83980008d0 con 0x7f8398092020 2026-02-13T20:17:15.625 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.598+0000 7f838d7fa640 1 -- 10.20.193.110:0/2382927761 --> v1:10.20.193.110:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f839808b450 con 0x7f8398092020 2026-02-13T20:17:15.625 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.598+0000 7f838d7fa640 1 -- 10.20.193.110:0/2382927761 <== mon.0 v1:10.20.193.110:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f8388003270 con 0x7f8398092020 2026-02-13T20:17:15.625 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.598+0000 7f838d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:17:15.625 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.598+0000 7f838d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:17:15.625 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.598+0000 7f838d7fa640 1 -- 10.20.193.110:0/2382927761 >> v1:10.20.193.110:6789/0 conn(0x7f8398092020 legacy=0x7f8398124ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:15.625 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.598+0000 7f838d7fa640 1 -- 10.20.193.110:0/2382927761 >> v1:10.20.193.110:6789/0 conn(0x7f8398092020 legacy=0x7f8398124ef0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:17:15.625 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.602+0000 7f839ec5b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:17:15.625 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.602+0000 7f839ec5b640 1 -- 10.20.193.110:0/2382927761 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f83981a4250 con 0x7f83981a3e80 2026-02-13T20:17:15.625 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.602+0000 7f838d7fa640 1 -- 10.20.193.110:0/2382927761 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3731882189 0 0) 0x7f83981a4250 con 0x7f83981a3e80 2026-02-13T20:17:15.625 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.602+0000 7f838d7fa640 10 monclient(hunting): _negotiate 2026-02-13T20:17:15.625 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.602+0000 7f838d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:15.625 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.602+0000 7f838d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:15.626 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.602+0000 7f838d7fa640 10 monclient(hunting): my global_id is 104103 2026-02-13T20:17:15.626 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.602+0000 7f838d7fa640 1 -- 10.20.193.110:0/2382927761 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83980008d0 con 0x7f83981a3e80 2026-02-13T20:17:15.626 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.602+0000 7f838d7fa640 1 -- 10.20.193.110:0/2382927761 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 943048035 0 0) 0x7f83980008d0 con 0x7f83981a3e80 2026-02-13T20:17:15.626 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.602+0000 7f838d7fa640 1 -- 10.20.193.110:0/2382927761 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f83981a4250 con 0x7f83981a3e80 2026-02-13T20:17:15.626 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.602+0000 7f838d7fa640 1 -- 10.20.193.110:0/2382927761 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f8388004b10 con 0x7f83981a3e80 2026-02-13T20:17:15.626 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.602+0000 7f838d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:15.626 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.602+0000 7f838d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:17:15.626 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.602+0000 7f838d7fa640 10 monclient: dump: 2026-02-13T20:17:15.626 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:15.626 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:15.626 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.626 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.626 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:15.626 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:15.627 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:15.627 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:15.627 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:15.627 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:15.627 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.602+0000 7f838d7fa640 1 -- 10.20.193.110:0/2382927761 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1727436606 0 0) 0x7f83981a4250 con 0x7f83981a3e80 2026-02-13T20:17:15.627 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.602+0000 7f838d7fa640 1 -- 10.20.193.110:0/2382927761 --> v1:10.20.193.110:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f839808c880 con 0x7f83981a3e80 2026-02-13T20:17:15.627 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.603+0000 7f838d7fa640 1 -- 10.20.193.110:0/2382927761 <== mon.0 v1:10.20.193.110:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4344 (unknown 0 0 295626917) 0x7f8388004f20 con 0x7f83981a3e80 2026-02-13T20:17:15.627 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.603+0000 7f838d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:17:15.627 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.603+0000 7f838d7fa640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:17:15.627 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.603+0000 7f838d7fa640 1 -- 10.20.193.110:0/2382927761 >> v1:10.20.193.110:6789/0 conn(0x7f83981a3e80 legacy=0x7f8398125600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:15.627 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.603+0000 7f838d7fa640 1 -- 10.20.193.110:0/2382927761 >> v1:10.20.193.110:6789/0 conn(0x7f83981a3e80 legacy=0x7f8398125600 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:17:15.628 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:17:15.628 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:17:15.628 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:17:15.628 INFO:teuthology.orchestra.run.trial110.stdout: "state": "peon", 2026-02-13T20:17:15.628 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 22, 2026-02-13T20:17:15.628 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 243, 2026-02-13T20:17:15.628 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:17:15.628 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:17:15.628 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:17:15.628 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:17:15.628 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:17:15.628 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 0, 2026-02-13T20:17:15.629 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:17:15.629 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:17:15.629 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:17:15.629 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:17:15.629 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:17:15.629 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:17:15.629 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:17:15.629 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:17:15.629 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:17:15.629 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:17:15.629 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:17:15.629 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:17:15.629 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:17:15.629 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:17:15.629 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:17:15.630 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:17:15.630 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:17:15.630 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:17:15.630 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:17:15.630 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:17:15.630 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:17:15.630 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:17:15.630 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:17:15.630 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:17:15.630 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:17:15.630 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:17:15.630 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:17:15.630 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:17:15.630 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:17:15.630 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:17:15.631 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:17:15.631 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:17:15.631 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:17:15.631 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:15.631 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:17:15.631 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:17:15.631 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:17:15.631 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:17:15.631 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:17:15.631 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:17:15.631 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:17:15.631 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:17:15.631 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:17:15.631 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:17:15.632 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:17:15.632 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:17:15.632 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:17:15.632 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:17:15.632 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:17:15.632 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:17:15.632 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:17:15.632 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:17:15.632 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:17:15.632 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:17:15.632 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:17:15.632 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:17:15.632 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:17:15.632 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:17:15.632 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:17:15.632 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:17:15.632 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:17:15.633 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:17:15.633 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:17:15.633 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:17:15.633 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:17:15.633 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:17:15.633 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:15.633 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:17:15.633 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:15.633 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:17:15.633 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:17:15.633 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:17:15.633 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:17:15.633 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:15.633 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:17:15.633 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:17:15.633 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:17:15.633 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:15.633 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:17:15.633 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:15.634 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:17:15.634 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:17:15.634 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:17:15.634 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:17:15.634 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:17:15.634 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:17:15.634 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:15.634 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:15.634 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:17:15.634 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:17:15.634 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:17:15.634 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:17:15.634 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:15.634 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:17:15.634 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:17:15.634 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:17:15.634 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:15.634 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:17:15.635 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:15.635 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:17:15.635 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:17:15.635 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:17:15.635 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:17:15.635 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:17:15.635 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:17:15.635 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:15.635 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:15.635 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:17:15.635 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:17:15.635 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:17:15.635 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:17:15.635 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:15.635 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:17:15.635 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:17:15.635 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:17:15.635 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:15.636 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:17:15.636 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:15.636 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:17:15.636 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:17:15.636 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:17:15.636 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:17:15.636 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:17:15.636 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:17:15.636 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:15.636 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:17:15.636 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:15.636 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:17:15.636 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:17:15.636 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:15.636 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:17:15.636 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:17:15.636 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:17:15.636 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:15.636 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:17:15.636 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:17:15.637 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:15.637 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:17:15.637 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:17:15.637 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:17:15.637 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:15.637 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:17:15.637 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:15.637 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:17:15.637 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:17:15.638 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.603+0000 7f839ec5b640 1 -- 10.20.193.110:0/2382927761 >> v1:10.20.193.188:6812/1623052694 conn(0x7f836803fd20 legacy=0x7f83680601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:15.638 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.603+0000 7f839ec5b640 10 monclient: shutdown 2026-02-13T20:17:15.638 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.603+0000 7f839ec5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:17:15.638 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.603+0000 7f839ec5b640 1 -- 10.20.193.110:0/2382927761 >> v1:10.20.193.188:6789/0 conn(0x7f8398089e40 legacy=0x7f83981a2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:15.638 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.603+0000 7f839d1d1640 1 -- 10.20.193.110:0/2382927761 reap_dead start 2026-02-13T20:17:15.638 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.603+0000 7f839d1d1640 1 -- 10.20.193.110:0/2382927761 reap_dead start 2026-02-13T20:17:15.638 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.603+0000 7f839ec5b640 1 -- 10.20.193.110:0/2382927761 shutdown_connections 2026-02-13T20:17:15.638 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.603+0000 7f839ec5b640 1 -- 10.20.193.110:0/2382927761 >> 10.20.193.110:0/2382927761 conn(0x7f8398054e90 msgr2=0x7f839808de40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:17:15.638 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.603+0000 7f839ec5b640 1 -- 10.20.193.110:0/2382927761 shutdown_connections 2026-02-13T20:17:15.639 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.603+0000 7f839ec5b640 1 -- 10.20.193.110:0/2382927761 wait complete. 2026-02-13T20:17:15.639 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:17:15.639 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-13T20:17:15.639 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T20:17:15.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.705+0000 7ff604e5b640 10 monclient: get_monmap_and_config 2026-02-13T20:17:15.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.705+0000 7ff604e5b640 10 monclient: build_initial_monmap 2026-02-13T20:17:15.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.705+0000 7ff604e5b640 10 monclient: monmap: 2026-02-13T20:17:15.707 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:17:15.707 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:15.707 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:17:15.705463+0000 2026-02-13T20:17:15.707 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:17:15.705463+0000 2026-02-13T20:17:15.707 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:17:15.708 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:15.708 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:17:15.708 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:17:15.708 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:17:15.708 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:15.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.705+0000 7ff604e5b640 1 Processor -- start 2026-02-13T20:17:15.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.705+0000 7ff604e5b640 1 -- start start 2026-02-13T20:17:15.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.705+0000 7ff604e5b640 10 monclient: init 2026-02-13T20:17:15.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.705+0000 7ff604e5b640 10 monclient: _reopen_session rank -1 2026-02-13T20:17:15.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.705+0000 7ff604e5b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:17:15.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.705+0000 7ff604e5b640 10 monclient(hunting): picked mon.noname-b con 0x7ff6001401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:17:15.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.705+0000 7ff604e5b640 10 monclient(hunting): picked mon.noname-c con 0x7ff600092020 addr v1:10.20.193.188:6789/0 2026-02-13T20:17:15.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.705+0000 7ff604e5b640 10 monclient(hunting): picked mon.noname-a con 0x7ff600091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:17:15.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.705+0000 7ff604e5b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff60008b730 con 0x7ff600091950 2026-02-13T20:17:15.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.705+0000 7ff604e5b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff60005c5b0 con 0x7ff600092020 2026-02-13T20:17:15.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.705+0000 7ff604e5b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff60008bcf0 con 0x7ff6001401c0 2026-02-13T20:17:15.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.705+0000 7ff604e5b640 10 monclient(hunting): _renew_subs 2026-02-13T20:17:15.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.705+0000 7ff604e5b640 10 monclient(hunting): authenticate will time out at 997.395784s 2026-02-13T20:17:15.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.705+0000 7ff5fe575640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7ff6001401c0 0x7ff600091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:38474/0 (socket says 10.20.193.110:38474) 2026-02-13T20:17:15.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.705+0000 7ff5fe575640 1 -- 10.20.193.110:0/50258626 learned_addr learned my addr 10.20.193.110:0/50258626 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:17:15.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.706+0000 7ff5fd573640 1 -- 10.20.193.110:0/50258626 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 372637237 0 0) 0x7ff60008bcf0 con 0x7ff6001401c0 2026-02-13T20:17:15.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.706+0000 7ff5fd573640 10 monclient(hunting): _negotiate 2026-02-13T20:17:15.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.706+0000 7ff5fd573640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:15.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.706+0000 7ff5fd573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:15.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.706+0000 7ff5fd573640 10 monclient(hunting): my global_id is 94199 2026-02-13T20:17:15.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.706+0000 7ff5fd573640 1 -- 10.20.193.110:0/50258626 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5ec0035e0 con 0x7ff6001401c0 2026-02-13T20:17:15.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.706+0000 7ff5fd573640 1 -- 10.20.193.110:0/50258626 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 96964548 0 0) 0x7ff60008b730 con 0x7ff600091950 2026-02-13T20:17:15.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.706+0000 7ff5fd573640 10 monclient(hunting): _negotiate 2026-02-13T20:17:15.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.706+0000 7ff5fd573640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:15.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.706+0000 7ff5fd573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:15.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.706+0000 7ff5fd573640 10 monclient(hunting): my global_id is 104106 2026-02-13T20:17:15.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.706+0000 7ff5fd573640 1 -- 10.20.193.110:0/50258626 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff60008bcf0 con 0x7ff600091950 2026-02-13T20:17:15.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.706+0000 7ff5fd573640 1 -- 10.20.193.110:0/50258626 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4087268543 0 0) 0x7ff5ec0035e0 con 0x7ff6001401c0 2026-02-13T20:17:15.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.706+0000 7ff5fd573640 1 -- 10.20.193.110:0/50258626 >> v1:10.20.193.188:6789/0 conn(0x7ff600092020 legacy=0x7ff6001812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:15.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.706+0000 7ff5fd573640 1 -- 10.20.193.110:0/50258626 >> v1:10.20.193.110:6789/0 conn(0x7ff600091950 legacy=0x7ff6001a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:15.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.706+0000 7ff5fd573640 10 monclient: _finish_hunting 0 2026-02-13T20:17:15.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.706+0000 7ff5fd573640 1 monclient: found mon.noname-b 2026-02-13T20:17:15.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.706+0000 7ff5fd573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:17:15.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.706+0000 7ff5fd573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:17:15.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.706+0000 7ff5fd573640 1 -- 10.20.193.110:0/50258626 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff600140590 con 0x7ff6001401c0 2026-02-13T20:17:15.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.706+0000 7ff5fd573640 10 monclient: _finish_auth 0 2026-02-13T20:17:15.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.706+0000 7ff5fd573640 10 monclient: _check_auth_tickets 2026-02-13T20:17:15.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.706+0000 7ff5fd573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:17:15.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.706+0000 7ff5fd573640 1 -- 10.20.193.110:0/50258626 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff5f4002dd0 con 0x7ff6001401c0 2026-02-13T20:17:15.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.706+0000 7ff5fd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:15.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.706+0000 7ff5fd573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:17:15.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.706+0000 7ff5fd573640 10 monclient: dump: 2026-02-13T20:17:15.709 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:15.709 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:15.709 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.709 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.709 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:15.709 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:15.709 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:15.709 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:15.709 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:15.709 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:15.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.706+0000 7ff604e5b640 5 monclient: authenticate success, global_id 94199 2026-02-13T20:17:15.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.706+0000 7ff604e5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:17:15.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.706+0000 7ff5fd573640 1 -- 10.20.193.110:0/50258626 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff5f4002f60 con 0x7ff6001401c0 2026-02-13T20:17:15.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.706+0000 7ff5fd573640 10 monclient: handle_config config(0 keys) 2026-02-13T20:17:15.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.706+0000 7ff5fd573640 1 -- 10.20.193.110:0/50258626 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff5f4003370 con 0x7ff6001401c0 2026-02-13T20:17:15.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.706+0000 7ff5fd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:15.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.706+0000 7ff5fd573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:17:15.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.706+0000 7ff5fd573640 10 monclient: dump: 2026-02-13T20:17:15.709 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:15.709 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:15.709 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.709 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.709 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:15.709 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:15.709 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:15.709 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:15.709 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:15.709 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:15.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.706+0000 7ff604e5b640 10 monclient: get_monmap_and_config success 2026-02-13T20:17:15.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.706+0000 7ff604e5b640 4 set_mon_vals no callback set 2026-02-13T20:17:15.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.706+0000 7ff604e5b640 10 monclient: shutdown 2026-02-13T20:17:15.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.706+0000 7ff604e5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:17:15.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.706+0000 7ff604e5b640 1 -- 10.20.193.110:0/50258626 >> v1:10.20.193.110:6790/0 conn(0x7ff6001401c0 legacy=0x7ff600091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:15.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.706+0000 7ff604e5b640 1 -- 10.20.193.110:0/50258626 shutdown_connections 2026-02-13T20:17:15.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.706+0000 7ff604e5b640 1 -- 10.20.193.110:0/50258626 >> 10.20.193.110:0/50258626 conn(0x7ff600054e90 msgr2=0x7ff600058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:17:15.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.706+0000 7ff604e5b640 1 -- 10.20.193.110:0/50258626 shutdown_connections 2026-02-13T20:17:15.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.706+0000 7ff604e5b640 1 -- 10.20.193.110:0/50258626 wait complete. 2026-02-13T20:17:15.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.707+0000 7ff604e5b640 10 monclient: build_initial_monmap 2026-02-13T20:17:15.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.707+0000 7ff604e5b640 10 monclient: monmap: 2026-02-13T20:17:15.709 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:17:15.710 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:17:15.710 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:17:15.710 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:17:15.710 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:17:15.710 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:17:15.710 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:17:15.710 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:17:15.710 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:17:15.710 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:15.711 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.707+0000 7ff604e5b640 1 Processor -- start 2026-02-13T20:17:15.711 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.707+0000 7ff604e5b640 1 -- start start 2026-02-13T20:17:15.711 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.707+0000 7ff604e5b640 10 monclient: init 2026-02-13T20:17:15.711 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.707+0000 7ff604e5b640 10 monclient: _reopen_session rank -1 2026-02-13T20:17:15.711 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.707+0000 7ff604e5b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:17:15.711 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.707+0000 7ff604e5b640 10 monclient(hunting): picked mon.noname-c con 0x7ff600091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:17:15.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.707+0000 7ff604e5b640 10 monclient(hunting): picked mon.noname-a con 0x7ff6001401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:17:15.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.707+0000 7ff604e5b640 10 monclient(hunting): picked mon.noname-b con 0x7ff60013eeb0 addr v1:10.20.193.188:6789/0 2026-02-13T20:17:15.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.707+0000 7ff604e5b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff600153140 con 0x7ff6001401c0 2026-02-13T20:17:15.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.707+0000 7ff604e5b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff60008c4a0 con 0x7ff60013eeb0 2026-02-13T20:17:15.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.707+0000 7ff604e5b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff60005d320 con 0x7ff600091950 2026-02-13T20:17:15.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.707+0000 7ff604e5b640 10 monclient(hunting): _renew_subs 2026-02-13T20:17:15.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.707+0000 7ff604e5b640 10 monclient(hunting): authenticate will time out at 997.397924s 2026-02-13T20:17:15.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.707+0000 7ff5fe575640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7ff600091950 0x7ff60013e7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:38488/0 (socket says 10.20.193.110:38488) 2026-02-13T20:17:15.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.707+0000 7ff5fe575640 1 -- 10.20.193.110:0/3298973734 learned_addr learned my addr 10.20.193.110:0/3298973734 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:17:15.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff5e6ffd640 1 -- 10.20.193.110:0/3298973734 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2930345073 0 0) 0x7ff60005d320 con 0x7ff600091950 2026-02-13T20:17:15.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff5e6ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:17:15.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff5e6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:15.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff5e6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:15.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff5e6ffd640 10 monclient(hunting): my global_id is 94202 2026-02-13T20:17:15.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff5e6ffd640 1 -- 10.20.193.110:0/3298973734 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5cc0035e0 con 0x7ff600091950 2026-02-13T20:17:15.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff5e6ffd640 1 -- 10.20.193.110:0/3298973734 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1891625769 0 0) 0x7ff60005c5b0 con 0x7ff6001401c0 2026-02-13T20:17:15.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff5e6ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:17:15.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff5e6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:15.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff5e6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:15.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff5e6ffd640 10 monclient(hunting): my global_id is 104109 2026-02-13T20:17:15.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff5e6ffd640 1 -- 10.20.193.110:0/3298973734 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff60005d320 con 0x7ff6001401c0 2026-02-13T20:17:15.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff5e6ffd640 1 -- 10.20.193.110:0/3298973734 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3481197854 0 0) 0x7ff5cc0035e0 con 0x7ff600091950 2026-02-13T20:17:15.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff5e6ffd640 1 -- 10.20.193.110:0/3298973734 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff60005c5b0 con 0x7ff600091950 2026-02-13T20:17:15.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff5e6ffd640 1 -- 10.20.193.110:0/3298973734 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff5f4003280 con 0x7ff600091950 2026-02-13T20:17:15.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff5e6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:17:15.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff5e6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:17:15.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff5e6ffd640 10 monclient(hunting): dump: 2026-02-13T20:17:15.712 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:15.712 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:15.712 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.712 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.712 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:15.712 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:15.712 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:15.712 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:15.712 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:15.712 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:15.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff5e6ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:17:15.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff5e6ffd640 1 -- 10.20.193.110:0/3298973734 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2829297220 0 0) 0x7ff5f0003ad0 con 0x7ff60013eeb0 2026-02-13T20:17:15.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff5e6ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:17:15.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff5e6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:15.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff5e6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:15.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff5e6ffd640 10 monclient(hunting): my global_id is 4642 2026-02-13T20:17:15.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff5e6ffd640 1 -- 10.20.193.110:0/3298973734 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5cc0035e0 con 0x7ff60013eeb0 2026-02-13T20:17:15.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff5e6ffd640 1 -- 10.20.193.110:0/3298973734 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3489457622 0 0) 0x7ff60005d320 con 0x7ff6001401c0 2026-02-13T20:17:15.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff5e6ffd640 1 -- 10.20.193.110:0/3298973734 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff5f0003ad0 con 0x7ff6001401c0 2026-02-13T20:17:15.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff5e6ffd640 1 -- 10.20.193.110:0/3298973734 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff5e8002ff0 con 0x7ff6001401c0 2026-02-13T20:17:15.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff5e6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:17:15.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff5e6ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:17:15.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff5e6ffd640 10 monclient(hunting): dump: 2026-02-13T20:17:15.713 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:15.713 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:15.713 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.713 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.713 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:15.713 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:15.713 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:15.713 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:15.713 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:15.713 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:15.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff5e6ffd640 1 -- 10.20.193.110:0/3298973734 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3823344556 0 0) 0x7ff60005c5b0 con 0x7ff600091950 2026-02-13T20:17:15.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff5e6ffd640 1 -- 10.20.193.110:0/3298973734 >> v1:10.20.193.188:6789/0 conn(0x7ff60013eeb0 legacy=0x7ff600195160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:15.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff5e6ffd640 1 -- 10.20.193.110:0/3298973734 >> v1:10.20.193.110:6789/0 conn(0x7ff6001401c0 legacy=0x7ff600193a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:15.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff5e6ffd640 10 monclient: _finish_hunting 0 2026-02-13T20:17:15.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff5e6ffd640 1 monclient: found mon.c 2026-02-13T20:17:15.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff5e6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:17:15.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff5e6ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:17:15.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff5e6ffd640 1 -- 10.20.193.110:0/3298973734 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff60008a8d0 con 0x7ff600091950 2026-02-13T20:17:15.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff5e6ffd640 10 monclient: _finish_auth 0 2026-02-13T20:17:15.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff5e6ffd640 10 monclient: _check_auth_tickets 2026-02-13T20:17:15.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff5e6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:17:15.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff604e5b640 5 monclient: authenticate success, global_id 94202 2026-02-13T20:17:15.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff604e5b640 10 monclient: _renew_subs 2026-02-13T20:17:15.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff604e5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:17:15.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff604e5b640 1 -- 10.20.193.110:0/3298973734 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff6001321c0 con 0x7ff600091950 2026-02-13T20:17:15.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff604e5b640 10 monclient: _renew_subs 2026-02-13T20:17:15.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff604e5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:17:15.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff604e5b640 1 -- 10.20.193.110:0/3298973734 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7ff600130b60 con 0x7ff600091950 2026-02-13T20:17:15.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff5e6ffd640 1 -- 10.20.193.110:0/3298973734 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff5f4004b50 con 0x7ff600091950 2026-02-13T20:17:15.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff5e6ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:17:15.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff5e6ffd640 1 -- 10.20.193.110:0/3298973734 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff5f4004e70 con 0x7ff600091950 2026-02-13T20:17:15.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff5e6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:15.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff5e6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:17:15.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff5e6ffd640 10 monclient: dump: 2026-02-13T20:17:15.713 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:15.713 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:15.713 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.714 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.714 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:15.714 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:15.714 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:15.714 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:15.714 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:15.714 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:15.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff5fcd72640 4 set_mon_vals no callback set 2026-02-13T20:17:15.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff604e5b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:17:15.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.708+0000 7ff604e5b640 1 -- 10.20.193.110:0/3298973734 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff6000008d0 con 0x7ff600092020 2026-02-13T20:17:15.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.709+0000 7ff5e6ffd640 1 -- 10.20.193.110:0/3298973734 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2196281736 0 0) 0x7ff6000008d0 con 0x7ff600092020 2026-02-13T20:17:15.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.709+0000 7ff5e6ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:17:15.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.709+0000 7ff5e6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:15.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.709+0000 7ff5e6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:15.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.709+0000 7ff5e6ffd640 10 monclient(hunting): my global_id is 94205 2026-02-13T20:17:15.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.709+0000 7ff5e6ffd640 1 -- 10.20.193.110:0/3298973734 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff60005c5b0 con 0x7ff600092020 2026-02-13T20:17:15.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.709+0000 7ff5e6ffd640 1 -- 10.20.193.110:0/3298973734 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7ff5f4011ae0 con 0x7ff600091950 2026-02-13T20:17:15.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.709+0000 7ff5e6ffd640 1 -- 10.20.193.110:0/3298973734 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(298..298 src has 1..298) ==== 3943+0+0 (unknown 260527215 0 0) 0x7ff5f404e830 con 0x7ff600091950 2026-02-13T20:17:15.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.709+0000 7ff5e6ffd640 1 -- 10.20.193.110:0/3298973734 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4052072943 0 0) 0x7ff60005c5b0 con 0x7ff600092020 2026-02-13T20:17:15.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.709+0000 7ff5e6ffd640 1 -- 10.20.193.110:0/3298973734 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff6000008d0 con 0x7ff600092020 2026-02-13T20:17:15.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.709+0000 7ff5e6ffd640 1 -- 10.20.193.110:0/3298973734 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff5e8003530 con 0x7ff600092020 2026-02-13T20:17:15.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.709+0000 7ff5e6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:15.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.709+0000 7ff5e6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:17:15.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.709+0000 7ff5e6ffd640 10 monclient: dump: 2026-02-13T20:17:15.714 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:15.714 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:15.714 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.714 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.714 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:15.714 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:15.714 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:15.714 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:15.714 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:15.714 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:15.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.709+0000 7ff5e6ffd640 1 -- 10.20.193.110:0/3298973734 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1907487148 0 0) 0x7ff6000008d0 con 0x7ff600092020 2026-02-13T20:17:15.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.709+0000 7ff5e6ffd640 1 -- 10.20.193.110:0/3298973734 --> v1:10.20.193.110:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff60008b450 con 0x7ff600092020 2026-02-13T20:17:15.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.709+0000 7ff5fed76640 10 monclient: get_auth_request con 0x7ff5cc03fc70 auth_method 0 2026-02-13T20:17:15.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.709+0000 7ff5e6ffd640 1 -- 10.20.193.110:0/3298973734 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7ff5e8005850 con 0x7ff600092020 2026-02-13T20:17:15.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.709+0000 7ff5e6ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:17:15.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.709+0000 7ff5e6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:17:15.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.709+0000 7ff5e6ffd640 1 -- 10.20.193.110:0/3298973734 >> v1:10.20.193.110:6790/0 conn(0x7ff600092020 legacy=0x7ff600127b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:15.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.709+0000 7ff5e6ffd640 1 -- 10.20.193.110:0/3298973734 >> v1:10.20.193.110:6790/0 conn(0x7ff600092020 legacy=0x7ff600127b20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:17:15.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.713+0000 7ff604e5b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:17:15.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.713+0000 7ff604e5b640 1 -- 10.20.193.110:0/3298973734 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff600130b60 con 0x7ff6001526e0 2026-02-13T20:17:15.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.713+0000 7ff5e6ffd640 1 -- 10.20.193.110:0/3298973734 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3599183869 0 0) 0x7ff5f0003ad0 con 0x7ff6001526e0 2026-02-13T20:17:15.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.713+0000 7ff5e6ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:17:15.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.713+0000 7ff5e6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:15.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.713+0000 7ff5e6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:15.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.713+0000 7ff5e6ffd640 10 monclient(hunting): my global_id is 94208 2026-02-13T20:17:15.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.713+0000 7ff5e6ffd640 1 -- 10.20.193.110:0/3298973734 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6000008d0 con 0x7ff6001526e0 2026-02-13T20:17:15.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.713+0000 7ff5e6ffd640 1 -- 10.20.193.110:0/3298973734 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1969998123 0 0) 0x7ff6000008d0 con 0x7ff6001526e0 2026-02-13T20:17:15.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.713+0000 7ff5e6ffd640 1 -- 10.20.193.110:0/3298973734 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff5f0003ad0 con 0x7ff6001526e0 2026-02-13T20:17:15.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.713+0000 7ff5e6ffd640 1 -- 10.20.193.110:0/3298973734 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff5e8003f50 con 0x7ff6001526e0 2026-02-13T20:17:15.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.713+0000 7ff5e6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:15.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.713+0000 7ff5e6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:17:15.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.713+0000 7ff5e6ffd640 10 monclient: dump: 2026-02-13T20:17:15.715 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:15.715 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:15.715 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.715 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.715 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:15.715 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:15.715 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:15.715 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:15.715 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:15.715 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:15.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.713+0000 7ff5e6ffd640 1 -- 10.20.193.110:0/3298973734 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1891767977 0 0) 0x7ff5f0003ad0 con 0x7ff6001526e0 2026-02-13T20:17:15.716 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.713+0000 7ff5e6ffd640 1 -- 10.20.193.110:0/3298973734 --> v1:10.20.193.110:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff600131e40 con 0x7ff6001526e0 2026-02-13T20:17:15.716 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.714+0000 7ff5e6ffd640 1 -- 10.20.193.110:0/3298973734 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4514 (unknown 0 0 1579818847) 0x7ff5e8005300 con 0x7ff6001526e0 2026-02-13T20:17:15.716 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.714+0000 7ff5e6ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:17:15.716 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.714+0000 7ff5e6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:17:15.716 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.714+0000 7ff5e6ffd640 1 -- 10.20.193.110:0/3298973734 >> v1:10.20.193.110:6790/0 conn(0x7ff6001526e0 legacy=0x7ff600128230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:15.716 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.714+0000 7ff5e6ffd640 1 -- 10.20.193.110:0/3298973734 >> v1:10.20.193.110:6790/0 conn(0x7ff6001526e0 legacy=0x7ff600128230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:17:15.716 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:17:15.716 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:17:15.716 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:17:15.716 INFO:teuthology.orchestra.run.trial110.stdout: "state": "peon", 2026-02-13T20:17:15.716 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 22, 2026-02-13T20:17:15.716 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 107336, 2026-02-13T20:17:15.716 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:17:15.716 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:17:15.716 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:17:15.716 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:17:15.716 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:17:15.716 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 0, 2026-02-13T20:17:15.716 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:17:15.716 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:17:15.716 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:17:15.716 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:17:15.716 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:17:15.716 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:17:15.716 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:17:15.716 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:17:15.716 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:17:15.716 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:17:15.716 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:17:15.716 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:17:15.716 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:17:15.716 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:17:15.716 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:17:15.716 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:17:15.716 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:17:15.716 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:17:15.716 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:17:15.717 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:17:15.717 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:17:15.717 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:17:15.717 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:17:15.717 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:17:15.717 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:17:15.717 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:17:15.717 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:17:15.717 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:17:15.717 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:17:15.717 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:17:15.717 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:17:15.717 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:17:15.717 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:17:15.717 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:15.717 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:17:15.717 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:17:15.717 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:17:15.717 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:17:15.717 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:17:15.717 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:17:15.717 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:17:15.717 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:17:15.717 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:17:15.717 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:17:15.717 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:17:15.717 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:17:15.717 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:17:15.717 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:17:15.717 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:17:15.717 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:17:15.717 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:17:15.717 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:17:15.717 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:17:15.717 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:17:15.717 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:17:15.717 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:17:15.717 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:17:15.717 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:17:15.717 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:17:15.717 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:17:15.717 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:17:15.717 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:17:15.717 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:17:15.718 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:17:15.718 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:17:15.718 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:17:15.718 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:15.718 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:17:15.718 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:15.718 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:17:15.718 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:17:15.718 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:17:15.718 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:17:15.718 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:15.718 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:17:15.718 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:17:15.718 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:17:15.718 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:15.718 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:17:15.718 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:15.718 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:17:15.718 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:17:15.718 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:17:15.718 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:17:15.718 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:17:15.718 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:17:15.718 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:15.718 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:15.718 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:17:15.718 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:17:15.718 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:17:15.718 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:17:15.718 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:15.718 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:17:15.718 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:17:15.718 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:17:15.718 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:15.718 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:17:15.718 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:15.718 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:17:15.718 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:17:15.718 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:17:15.718 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:17:15.718 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:17:15.718 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:17:15.718 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:15.718 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:15.718 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:17:15.719 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:17:15.719 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:17:15.719 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:17:15.719 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:15.719 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:17:15.719 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:17:15.719 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:17:15.719 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:15.719 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:17:15.719 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:15.719 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:17:15.719 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:17:15.719 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:17:15.719 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:17:15.719 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:17:15.719 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:17:15.719 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:15.719 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:17:15.719 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:15.719 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:17:15.719 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:17:15.719 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:15.719 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:17:15.719 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:17:15.719 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:17:15.719 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:15.719 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:17:15.719 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:17:15.719 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:15.719 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:17:15.719 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:17:15.719 INFO:teuthology.orchestra.run.trial110.stdout: "num": 2 2026-02-13T20:17:15.719 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:15.719 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:17:15.719 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:17:15.719 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:15.719 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:17:15.719 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:17:15.719 INFO:teuthology.orchestra.run.trial110.stdout: "num": 2 2026-02-13T20:17:15.719 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:15.719 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:17:15.719 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:15.719 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:17:15.719 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:17:15.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.714+0000 7ff604e5b640 1 -- 10.20.193.110:0/3298973734 >> v1:10.20.193.188:6812/1623052694 conn(0x7ff5cc03fc70 legacy=0x7ff5cc060120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:15.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.714+0000 7ff604e5b640 10 monclient: shutdown 2026-02-13T20:17:15.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.714+0000 7ff604e5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:17:15.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.714+0000 7ff604e5b640 1 -- 10.20.193.110:0/3298973734 >> v1:10.20.193.110:6790/0 conn(0x7ff600091950 legacy=0x7ff60013e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:15.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.714+0000 7ff5fed76640 1 -- 10.20.193.110:0/3298973734 reap_dead start 2026-02-13T20:17:15.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.714+0000 7ff5fed76640 1 -- 10.20.193.110:0/3298973734 reap_dead start 2026-02-13T20:17:15.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.714+0000 7ff604e5b640 1 -- 10.20.193.110:0/3298973734 shutdown_connections 2026-02-13T20:17:15.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.714+0000 7ff604e5b640 1 -- 10.20.193.110:0/3298973734 >> 10.20.193.110:0/3298973734 conn(0x7ff600054e90 msgr2=0x7ff60008dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:17:15.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.714+0000 7ff604e5b640 1 -- 10.20.193.110:0/3298973734 shutdown_connections 2026-02-13T20:17:15.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.714+0000 7ff604e5b640 1 -- 10.20.193.110:0/3298973734 wait complete. 2026-02-13T20:17:15.720 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:17:15.720 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-13T20:17:15.720 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T20:17:15.785 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.784+0000 7f4fda10c640 10 monclient: get_monmap_and_config 2026-02-13T20:17:15.785 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.784+0000 7f4fda10c640 10 monclient: build_initial_monmap 2026-02-13T20:17:15.785 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.784+0000 7f4fda10c640 10 monclient: monmap: 2026-02-13T20:17:15.785 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:17:15.786 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:15.786 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:17:15.785349+0000 2026-02-13T20:17:15.786 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:17:15.785349+0000 2026-02-13T20:17:15.786 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:17:15.786 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:15.786 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:17:15.786 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:17:15.786 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:17:15.786 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:15.792 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.785+0000 7f4fda10c640 1 Processor -- start 2026-02-13T20:17:15.793 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.785+0000 7f4fda10c640 1 -- start start 2026-02-13T20:17:15.793 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.785+0000 7f4fda10c640 10 monclient: init 2026-02-13T20:17:15.793 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.785+0000 7f4fda10c640 10 monclient: _reopen_session rank -1 2026-02-13T20:17:15.793 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.785+0000 7f4fda10c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:17:15.793 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.785+0000 7f4fda10c640 10 monclient(hunting): picked mon.noname-c con 0x7f4fd41401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:17:15.793 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.785+0000 7f4fda10c640 10 monclient(hunting): picked mon.noname-b con 0x7f4fd4092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:17:15.793 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.785+0000 7f4fda10c640 10 monclient(hunting): picked mon.noname-a con 0x7f4fd4091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:17:15.793 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.785+0000 7f4fda10c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fd408b730 con 0x7f4fd4091950 2026-02-13T20:17:15.793 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.785+0000 7f4fda10c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fd405c5b0 con 0x7f4fd41401c0 2026-02-13T20:17:15.793 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.785+0000 7f4fda10c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fd408bcf0 con 0x7f4fd4092020 2026-02-13T20:17:15.793 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.785+0000 7f4fda10c640 10 monclient(hunting): _renew_subs 2026-02-13T20:17:15.793 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.785+0000 7f4fda10c640 10 monclient(hunting): authenticate will time out at 997.475925s 2026-02-13T20:17:15.793 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.786+0000 7f4fd2ffd640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f4fd4092020 0x7f4fd41812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:38516/0 (socket says 10.20.193.110:38516) 2026-02-13T20:17:15.794 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.786+0000 7f4fd2ffd640 1 -- 10.20.193.110:0/313005028 learned_addr learned my addr 10.20.193.110:0/313005028 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:17:15.794 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.786+0000 7f4fd27fc640 1 -- 10.20.193.110:0/313005028 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 701974016 0 0) 0x7f4fd408b730 con 0x7f4fd4091950 2026-02-13T20:17:15.794 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.786+0000 7f4fd27fc640 10 monclient(hunting): _negotiate 2026-02-13T20:17:15.794 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.786+0000 7f4fd27fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:15.794 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.786+0000 7f4fd27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:15.794 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.786+0000 7f4fd27fc640 10 monclient(hunting): my global_id is 104112 2026-02-13T20:17:15.794 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.786+0000 7f4fd27fc640 1 -- 10.20.193.110:0/313005028 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fb80035e0 con 0x7f4fd4091950 2026-02-13T20:17:15.794 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.786+0000 7f4fd27fc640 1 -- 10.20.193.110:0/313005028 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2574423211 0 0) 0x7f4fd408bcf0 con 0x7f4fd4092020 2026-02-13T20:17:15.794 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.786+0000 7f4fd27fc640 10 monclient(hunting): _negotiate 2026-02-13T20:17:15.794 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.786+0000 7f4fd27fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:15.794 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.786+0000 7f4fd27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:15.794 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.786+0000 7f4fd27fc640 10 monclient(hunting): my global_id is 94211 2026-02-13T20:17:15.794 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.786+0000 7f4fd27fc640 1 -- 10.20.193.110:0/313005028 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fd408b730 con 0x7f4fd4092020 2026-02-13T20:17:15.794 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.786+0000 7f4fd27fc640 1 -- 10.20.193.110:0/313005028 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3629140552 0 0) 0x7f4fb80035e0 con 0x7f4fd4091950 2026-02-13T20:17:15.794 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.786+0000 7f4fd27fc640 1 -- 10.20.193.110:0/313005028 >> v1:10.20.193.110:6790/0 conn(0x7f4fd4092020 legacy=0x7f4fd41812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:15.794 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.786+0000 7f4fd27fc640 1 -- 10.20.193.110:0/313005028 >> v1:10.20.193.188:6789/0 conn(0x7f4fd41401c0 legacy=0x7f4fd4091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:15.794 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.786+0000 7f4fd27fc640 10 monclient: _finish_hunting 0 2026-02-13T20:17:15.794 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.786+0000 7f4fd27fc640 1 monclient: found mon.noname-a 2026-02-13T20:17:15.795 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.786+0000 7f4fd27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:17:15.795 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.786+0000 7f4fd27fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:17:15.795 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.786+0000 7f4fd27fc640 1 -- 10.20.193.110:0/313005028 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fd4140590 con 0x7f4fd4091950 2026-02-13T20:17:15.795 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.786+0000 7f4fd27fc640 10 monclient: _finish_auth 0 2026-02-13T20:17:15.795 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.786+0000 7f4fd27fc640 10 monclient: _check_auth_tickets 2026-02-13T20:17:15.795 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.786+0000 7f4fd27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:17:15.795 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.786+0000 7f4fd27fc640 1 -- 10.20.193.110:0/313005028 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f4fc8003eb0 con 0x7f4fd4091950 2026-02-13T20:17:15.795 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.786+0000 7f4fd27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:15.795 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.786+0000 7f4fd27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:17:15.795 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.786+0000 7f4fd27fc640 10 monclient: dump: 2026-02-13T20:17:15.795 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:15.795 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:15.795 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.795 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.795 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:15.795 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:15.795 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:15.795 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:15.795 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:15.795 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:15.796 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.786+0000 7f4fda10c640 5 monclient: authenticate success, global_id 104112 2026-02-13T20:17:15.796 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.786+0000 7f4fda10c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:17:15.796 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.786+0000 7f4fd27fc640 1 -- 10.20.193.110:0/313005028 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4fc8004080 con 0x7f4fd4091950 2026-02-13T20:17:15.796 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.786+0000 7f4fd27fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:17:15.796 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.786+0000 7f4fd27fc640 1 -- 10.20.193.110:0/313005028 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f4fc8004490 con 0x7f4fd4091950 2026-02-13T20:17:15.796 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.786+0000 7f4fd27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:15.796 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.786+0000 7f4fd27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:17:15.796 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.786+0000 7f4fd27fc640 10 monclient: dump: 2026-02-13T20:17:15.796 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:15.796 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:15.796 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.796 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.796 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:15.796 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:15.796 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:15.796 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:15.796 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:15.796 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:15.796 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.786+0000 7f4fda10c640 10 monclient: get_monmap_and_config success 2026-02-13T20:17:15.796 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.786+0000 7f4fda10c640 4 set_mon_vals no callback set 2026-02-13T20:17:15.796 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.786+0000 7f4fda10c640 10 monclient: shutdown 2026-02-13T20:17:15.797 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.786+0000 7f4fda10c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:17:15.797 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.786+0000 7f4fda10c640 1 -- 10.20.193.110:0/313005028 >> v1:10.20.193.110:6789/0 conn(0x7f4fd4091950 legacy=0x7f4fd41a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:15.797 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.786+0000 7f4fda10c640 1 -- 10.20.193.110:0/313005028 shutdown_connections 2026-02-13T20:17:15.797 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.786+0000 7f4fda10c640 1 -- 10.20.193.110:0/313005028 >> 10.20.193.110:0/313005028 conn(0x7f4fd4054e90 msgr2=0x7f4fd4058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:17:15.797 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.786+0000 7f4fda10c640 1 -- 10.20.193.110:0/313005028 shutdown_connections 2026-02-13T20:17:15.797 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.786+0000 7f4fda10c640 1 -- 10.20.193.110:0/313005028 wait complete. 2026-02-13T20:17:15.797 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.787+0000 7f4fda10c640 10 monclient: build_initial_monmap 2026-02-13T20:17:15.797 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.787+0000 7f4fda10c640 10 monclient: monmap: 2026-02-13T20:17:15.797 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:17:15.797 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:17:15.797 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:17:15.797 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:17:15.797 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:17:15.797 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:17:15.797 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:17:15.797 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:17:15.797 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:17:15.797 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:15.797 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.787+0000 7f4fda10c640 1 Processor -- start 2026-02-13T20:17:15.798 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.787+0000 7f4fda10c640 1 -- start start 2026-02-13T20:17:15.798 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.787+0000 7f4fda10c640 10 monclient: init 2026-02-13T20:17:15.798 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.787+0000 7f4fda10c640 10 monclient: _reopen_session rank -1 2026-02-13T20:17:15.798 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.787+0000 7f4fda10c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:17:15.798 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.787+0000 7f4fda10c640 10 monclient(hunting): picked mon.noname-a con 0x7f4fd4091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:17:15.798 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.787+0000 7f4fda10c640 10 monclient(hunting): picked mon.noname-b con 0x7f4fd41401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:17:15.798 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.787+0000 7f4fda10c640 10 monclient(hunting): picked mon.noname-c con 0x7f4fd4152700 addr v1:10.20.193.110:6790/0 2026-02-13T20:17:15.798 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.787+0000 7f4fda10c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fd405d320 con 0x7f4fd4091950 2026-02-13T20:17:15.798 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.787+0000 7f4fda10c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fd4131100 con 0x7f4fd41401c0 2026-02-13T20:17:15.798 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.787+0000 7f4fda10c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fd412fb40 con 0x7f4fd4152700 2026-02-13T20:17:15.798 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.787+0000 7f4fda10c640 10 monclient(hunting): _renew_subs 2026-02-13T20:17:15.798 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.787+0000 7f4fda10c640 10 monclient(hunting): authenticate will time out at 997.477740s 2026-02-13T20:17:15.798 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.787+0000 7f4fd37fe640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f4fd4091950 0x7f4fd413d6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:59392/0 (socket says 10.20.193.110:59392) 2026-02-13T20:17:15.798 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.787+0000 7f4fd37fe640 1 -- 10.20.193.110:0/1067242388 learned_addr learned my addr 10.20.193.110:0/1067242388 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:17:15.798 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.787+0000 7f4faffff640 1 -- 10.20.193.110:0/1067242388 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2750451153 0 0) 0x7f4fd412fb40 con 0x7f4fd4152700 2026-02-13T20:17:15.798 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.787+0000 7f4faffff640 10 monclient(hunting): _negotiate 2026-02-13T20:17:15.798 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.787+0000 7f4faffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:15.798 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.787+0000 7f4faffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:15.798 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.787+0000 7f4faffff640 10 monclient(hunting): my global_id is 94214 2026-02-13T20:17:15.798 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.787+0000 7f4faffff640 1 -- 10.20.193.110:0/1067242388 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fa40035e0 con 0x7f4fd4152700 2026-02-13T20:17:15.799 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.787+0000 7f4faffff640 1 -- 10.20.193.110:0/1067242388 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3359863257 0 0) 0x7f4fd405d320 con 0x7f4fd4091950 2026-02-13T20:17:15.799 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4faffff640 10 monclient(hunting): _negotiate 2026-02-13T20:17:15.799 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4faffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:15.799 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4faffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:15.799 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4faffff640 10 monclient(hunting): my global_id is 104115 2026-02-13T20:17:15.799 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4faffff640 1 -- 10.20.193.110:0/1067242388 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fd412fb40 con 0x7f4fd4091950 2026-02-13T20:17:15.799 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4faffff640 1 -- 10.20.193.110:0/1067242388 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3513461679 0 0) 0x7f4fa40035e0 con 0x7f4fd4152700 2026-02-13T20:17:15.799 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4faffff640 1 -- 10.20.193.110:0/1067242388 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4fd405d320 con 0x7f4fd4152700 2026-02-13T20:17:15.799 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4faffff640 1 -- 10.20.193.110:0/1067242388 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f4fc8003dc0 con 0x7f4fd4152700 2026-02-13T20:17:15.799 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4faffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:17:15.799 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4faffff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:17:15.799 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4faffff640 10 monclient(hunting): dump: 2026-02-13T20:17:15.799 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:15.799 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:15.799 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.799 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.799 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:15.799 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:15.799 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:15.799 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:15.800 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:15.800 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:15.800 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4faffff640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:17:15.800 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4faffff640 1 -- 10.20.193.110:0/1067242388 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3143351124 0 0) 0x7f4fd412fb40 con 0x7f4fd4091950 2026-02-13T20:17:15.800 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4faffff640 1 -- 10.20.193.110:0/1067242388 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4fa40035e0 con 0x7f4fd4091950 2026-02-13T20:17:15.800 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4faffff640 1 -- 10.20.193.110:0/1067242388 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f4fc0003060 con 0x7f4fd4091950 2026-02-13T20:17:15.800 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4faffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:17:15.800 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4faffff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:17:15.800 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4faffff640 10 monclient(hunting): dump: 2026-02-13T20:17:15.800 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:15.800 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:15.800 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.800 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.800 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:15.800 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:15.800 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:15.800 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:15.800 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:15.800 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:15.800 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4faffff640 1 -- 10.20.193.110:0/1067242388 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3459983803 0 0) 0x7f4fd4131100 con 0x7f4fd41401c0 2026-02-13T20:17:15.801 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4faffff640 10 monclient(hunting): _negotiate 2026-02-13T20:17:15.801 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4faffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:15.801 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4faffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:15.801 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4faffff640 10 monclient(hunting): my global_id is 4648 2026-02-13T20:17:15.801 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4faffff640 1 -- 10.20.193.110:0/1067242388 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fd412fb40 con 0x7f4fd41401c0 2026-02-13T20:17:15.801 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4faffff640 1 -- 10.20.193.110:0/1067242388 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1361698525 0 0) 0x7f4fd405d320 con 0x7f4fd4152700 2026-02-13T20:17:15.801 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4faffff640 1 -- 10.20.193.110:0/1067242388 >> v1:10.20.193.188:6789/0 conn(0x7f4fd41401c0 legacy=0x7f4fd4193a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:15.801 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4faffff640 1 -- 10.20.193.110:0/1067242388 >> v1:10.20.193.110:6789/0 conn(0x7f4fd4091950 legacy=0x7f4fd413d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:15.801 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4faffff640 10 monclient: _finish_hunting 0 2026-02-13T20:17:15.801 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4faffff640 1 monclient: found mon.c 2026-02-13T20:17:15.801 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4faffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:17:15.801 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4faffff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:17:15.801 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4faffff640 1 -- 10.20.193.110:0/1067242388 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fd413e8c0 con 0x7f4fd4152700 2026-02-13T20:17:15.801 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4faffff640 10 monclient: _finish_auth 0 2026-02-13T20:17:15.801 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4faffff640 10 monclient: _check_auth_tickets 2026-02-13T20:17:15.801 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4faffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:17:15.801 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4fda10c640 5 monclient: authenticate success, global_id 94214 2026-02-13T20:17:15.801 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4fda10c640 10 monclient: _renew_subs 2026-02-13T20:17:15.801 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4fda10c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:17:15.801 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4fda10c640 1 -- 10.20.193.110:0/1067242388 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4fd412f900 con 0x7f4fd4152700 2026-02-13T20:17:15.802 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4fda10c640 10 monclient: _renew_subs 2026-02-13T20:17:15.802 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4fda10c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:17:15.802 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4fda10c640 1 -- 10.20.193.110:0/1067242388 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f4fd413ddf0 con 0x7f4fd4152700 2026-02-13T20:17:15.802 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4faffff640 1 -- 10.20.193.110:0/1067242388 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4fc80049b0 con 0x7f4fd4152700 2026-02-13T20:17:15.802 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4faffff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:17:15.802 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4faffff640 1 -- 10.20.193.110:0/1067242388 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f4fc8004cd0 con 0x7f4fd4152700 2026-02-13T20:17:15.802 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4faffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:15.802 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4faffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:17:15.802 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4faffff640 10 monclient: dump: 2026-02-13T20:17:15.802 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:15.802 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:15.802 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.802 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.802 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:15.802 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:15.802 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:15.802 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:15.803 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:15.803 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:15.803 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4fd1ffb640 4 set_mon_vals no callback set 2026-02-13T20:17:15.803 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4fda10c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:17:15.803 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4fda10c640 1 -- 10.20.193.110:0/1067242388 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4fd41530f0 con 0x7f4fd4092020 2026-02-13T20:17:15.803 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.788+0000 7f4faffff640 1 -- 10.20.193.110:0/1067242388 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f4fc8011940 con 0x7f4fd4152700 2026-02-13T20:17:15.803 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.789+0000 7f4faffff640 1 -- 10.20.193.110:0/1067242388 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(298..298 src has 1..298) ==== 3943+0+0 (unknown 260527215 0 0) 0x7f4fc804e7d0 con 0x7f4fd4152700 2026-02-13T20:17:15.803 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.789+0000 7f4faffff640 1 -- 10.20.193.110:0/1067242388 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2534853177 0 0) 0x7f4fa40035e0 con 0x7f4fd4092020 2026-02-13T20:17:15.803 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.789+0000 7f4faffff640 10 monclient(hunting): _negotiate 2026-02-13T20:17:15.803 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.789+0000 7f4faffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:15.803 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.789+0000 7f4faffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:15.803 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.789+0000 7f4faffff640 10 monclient(hunting): my global_id is 4651 2026-02-13T20:17:15.803 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.789+0000 7f4faffff640 1 -- 10.20.193.110:0/1067242388 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fd405d320 con 0x7f4fd4092020 2026-02-13T20:17:15.803 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.789+0000 7f4fd2ffd640 10 monclient: get_auth_request con 0x7f4fa403fc70 auth_method 0 2026-02-13T20:17:15.804 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.789+0000 7f4faffff640 1 -- 10.20.193.110:0/1067242388 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3146312755 0 0) 0x7f4fd405d320 con 0x7f4fd4092020 2026-02-13T20:17:15.804 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.789+0000 7f4faffff640 1 -- 10.20.193.110:0/1067242388 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4fa40035e0 con 0x7f4fd4092020 2026-02-13T20:17:15.804 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.789+0000 7f4faffff640 1 -- 10.20.193.110:0/1067242388 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f4fc00036d0 con 0x7f4fd4092020 2026-02-13T20:17:15.804 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.789+0000 7f4faffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:15.804 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.789+0000 7f4faffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:17:15.804 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.789+0000 7f4faffff640 10 monclient: dump: 2026-02-13T20:17:15.804 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:15.804 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:15.804 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.804 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.804 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:15.804 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:15.804 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:15.804 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:15.804 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:15.804 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:15.804 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.789+0000 7f4faffff640 1 -- 10.20.193.110:0/1067242388 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2426020286 0 0) 0x7f4fa40035e0 con 0x7f4fd4092020 2026-02-13T20:17:15.804 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.789+0000 7f4faffff640 1 -- 10.20.193.110:0/1067242388 --> v1:10.20.193.188:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4fd408b450 con 0x7f4fd4092020 2026-02-13T20:17:15.804 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.789+0000 7f4faffff640 1 -- 10.20.193.110:0/1067242388 <== mon.1 v1:10.20.193.188:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f4fc0005880 con 0x7f4fd4092020 2026-02-13T20:17:15.804 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.789+0000 7f4faffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:17:15.805 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.789+0000 7f4faffff640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:17:15.805 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.789+0000 7f4faffff640 1 -- 10.20.193.110:0/1067242388 >> v1:10.20.193.188:6789/0 conn(0x7f4fd4092020 legacy=0x7f4fd4128b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:15.805 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.789+0000 7f4faffff640 1 -- 10.20.193.110:0/1067242388 >> v1:10.20.193.188:6789/0 conn(0x7f4fd4092020 legacy=0x7f4fd4128b30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:17:15.806 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.793+0000 7f4fda10c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:17:15.806 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.793+0000 7f4fda10c640 1 -- 10.20.193.110:0/1067242388 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4fd4055bb0 con 0x7f4fd4129240 2026-02-13T20:17:15.806 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.794+0000 7f4faffff640 1 -- 10.20.193.110:0/1067242388 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1431691514 0 0) 0x7f4fd4055bb0 con 0x7f4fd4129240 2026-02-13T20:17:15.806 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.794+0000 7f4faffff640 10 monclient(hunting): _negotiate 2026-02-13T20:17:15.806 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.794+0000 7f4faffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:15.806 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.794+0000 7f4faffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:15.806 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.794+0000 7f4faffff640 10 monclient(hunting): my global_id is 4654 2026-02-13T20:17:15.806 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.794+0000 7f4faffff640 1 -- 10.20.193.110:0/1067242388 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fa40035e0 con 0x7f4fd4129240 2026-02-13T20:17:15.806 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.794+0000 7f4faffff640 1 -- 10.20.193.110:0/1067242388 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2601932069 0 0) 0x7f4fa40035e0 con 0x7f4fd4129240 2026-02-13T20:17:15.806 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.794+0000 7f4faffff640 1 -- 10.20.193.110:0/1067242388 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4fd4055bb0 con 0x7f4fd4129240 2026-02-13T20:17:15.806 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.794+0000 7f4faffff640 1 -- 10.20.193.110:0/1067242388 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f4fc0003fc0 con 0x7f4fd4129240 2026-02-13T20:17:15.807 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.794+0000 7f4faffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:15.807 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.794+0000 7f4faffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:17:15.807 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.794+0000 7f4faffff640 10 monclient: dump: 2026-02-13T20:17:15.807 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:15.807 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:15.807 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.807 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.807 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:15.807 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:15.807 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:15.807 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:15.807 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:15.807 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:15.807 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.794+0000 7f4faffff640 1 -- 10.20.193.110:0/1067242388 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 723716999 0 0) 0x7f4fd4055bb0 con 0x7f4fd4129240 2026-02-13T20:17:15.807 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.794+0000 7f4faffff640 1 -- 10.20.193.110:0/1067242388 --> v1:10.20.193.188:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4fd412e9b0 con 0x7f4fd4129240 2026-02-13T20:17:15.807 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.794+0000 7f4faffff640 1 -- 10.20.193.110:0/1067242388 <== mon.1 v1:10.20.193.188:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4683 (unknown 0 0 2355008086) 0x7f4fc0004400 con 0x7f4fd4129240 2026-02-13T20:17:15.807 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.794+0000 7f4faffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:17:15.807 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.794+0000 7f4faffff640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:17:15.807 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.794+0000 7f4faffff640 1 -- 10.20.193.110:0/1067242388 >> v1:10.20.193.188:6789/0 conn(0x7f4fd4129240 legacy=0x7f4fd41978b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:15.808 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.794+0000 7f4faffff640 1 -- 10.20.193.110:0/1067242388 >> v1:10.20.193.188:6789/0 conn(0x7f4fd4129240 legacy=0x7f4fd41978b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:17:15.808 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:17:15.808 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:17:15.808 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:17:15.808 INFO:teuthology.orchestra.run.trial110.stdout: "state": "leader", 2026-02-13T20:17:15.808 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 22, 2026-02-13T20:17:15.808 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 357940, 2026-02-13T20:17:15.808 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:17:15.808 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:17:15.808 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:17:15.808 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:17:15.808 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:17:15.808 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 0, 2026-02-13T20:17:15.808 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:17:15.809 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:17:15.809 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:17:15.809 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:17:15.809 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:17:15.809 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:17:15.809 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:17:15.809 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:17:15.809 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:17:15.809 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:17:15.809 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:17:15.809 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:17:15.809 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:17:15.809 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:17:15.809 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:17:15.809 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:17:15.809 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:17:15.809 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:17:15.809 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:17:15.809 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:17:15.809 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:17:15.810 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:17:15.810 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:17:15.810 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:17:15.810 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:17:15.810 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:17:15.810 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:17:15.810 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:17:15.810 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:17:15.810 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:17:15.810 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:17:15.810 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:17:15.810 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:17:15.810 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:15.810 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:17:15.810 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:17:15.810 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:17:15.810 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:17:15.810 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:17:15.810 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:17:15.810 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:17:15.811 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:17:15.811 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:17:15.811 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:17:15.811 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:17:15.811 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:17:15.811 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:17:15.811 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:17:15.811 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:17:15.811 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:17:15.811 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:17:15.811 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:17:15.811 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:17:15.811 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:17:15.811 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:17:15.811 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:17:15.811 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:17:15.811 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:17:15.811 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:17:15.811 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:17:15.811 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:17:15.812 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:17:15.812 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:17:15.812 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:17:15.812 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:17:15.812 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:17:15.812 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:15.812 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:17:15.812 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:15.812 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:17:15.812 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:17:15.812 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:17:15.812 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:17:15.812 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:15.812 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:17:15.812 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:17:15.812 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:17:15.812 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:15.812 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:17:15.812 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:15.812 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:17:15.813 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:17:15.813 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:17:15.813 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:17:15.813 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:17:15.813 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:17:15.813 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:15.813 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:15.813 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:17:15.813 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:17:15.813 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:17:15.813 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:17:15.813 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:15.813 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:17:15.813 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:17:15.813 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:17:15.813 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:15.813 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:17:15.813 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:15.813 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:17:15.813 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:17:15.814 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:17:15.814 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:17:15.814 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:17:15.814 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:17:15.814 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:15.814 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:15.814 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:17:15.814 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:17:15.814 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:17:15.814 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:17:15.814 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:15.814 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:17:15.814 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:17:15.814 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:17:15.814 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:15.814 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:17:15.814 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:15.814 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:17:15.814 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:17:15.814 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:17:15.814 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:17:15.814 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:17:15.815 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:17:15.815 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:15.815 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:17:15.815 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:15.815 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:17:15.815 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:17:15.815 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:15.815 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:17:15.815 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:17:15.815 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:17:15.815 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:15.815 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:17:15.815 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:17:15.815 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:15.815 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:17:15.815 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:17:15.815 INFO:teuthology.orchestra.run.trial110.stdout: "num": 4 2026-02-13T20:17:15.815 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:15.815 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:17:15.815 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:17:15.815 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:15.816 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:17:15.816 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:17:15.816 INFO:teuthology.orchestra.run.trial110.stdout: "num": 6 2026-02-13T20:17:15.816 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:15.816 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:17:15.816 INFO:teuthology.orchestra.run.trial110.stdout: "mgr": [ 2026-02-13T20:17:15.816 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:15.816 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:17:15.816 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:17:15.816 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:17:15.816 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:15.816 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:17:15.816 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:15.816 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:17:15.816 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:17:15.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.794+0000 7f4fda10c640 1 -- 10.20.193.110:0/1067242388 >> v1:10.20.193.188:6812/1623052694 conn(0x7f4fa403fc70 legacy=0x7f4fa4060120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:15.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.794+0000 7f4fda10c640 10 monclient: shutdown 2026-02-13T20:17:15.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.794+0000 7f4fda10c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:17:15.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.794+0000 7f4fda10c640 1 -- 10.20.193.110:0/1067242388 >> v1:10.20.193.110:6790/0 conn(0x7f4fd4152700 legacy=0x7f4fd4195180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:15.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.794+0000 7f4fd3fff640 1 -- 10.20.193.110:0/1067242388 reap_dead start 2026-02-13T20:17:15.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.794+0000 7f4fd3fff640 1 -- 10.20.193.110:0/1067242388 reap_dead start 2026-02-13T20:17:15.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.795+0000 7f4fda10c640 1 -- 10.20.193.110:0/1067242388 shutdown_connections 2026-02-13T20:17:15.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.795+0000 7f4fda10c640 1 -- 10.20.193.110:0/1067242388 >> 10.20.193.110:0/1067242388 conn(0x7f4fd4054e90 msgr2=0x7f4fd4088fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:17:15.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.795+0000 7f4fda10c640 1 -- 10.20.193.110:0/1067242388 shutdown_connections 2026-02-13T20:17:15.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.795+0000 7f4fda10c640 1 -- 10.20.193.110:0/1067242388 wait complete. 2026-02-13T20:17:15.818 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:17:15.818 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-13T20:17:15.818 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-13T20:17:15.884 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.883+0000 7fdd65f0c640 10 monclient: get_monmap_and_config 2026-02-13T20:17:15.884 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.883+0000 7fdd65f0c640 10 monclient: build_initial_monmap 2026-02-13T20:17:15.884 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.883+0000 7fdd65f0c640 10 monclient: monmap: 2026-02-13T20:17:15.884 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:17:15.884 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:15.884 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:17:15.883841+0000 2026-02-13T20:17:15.884 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:17:15.883841+0000 2026-02-13T20:17:15.884 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:17:15.885 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:15.885 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:17:15.885 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:17:15.885 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:17:15.885 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:15.885 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.883+0000 7fdd65f0c640 1 Processor -- start 2026-02-13T20:17:15.885 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.883+0000 7fdd65f0c640 1 -- start start 2026-02-13T20:17:15.885 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.883+0000 7fdd65f0c640 10 monclient: init 2026-02-13T20:17:15.891 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.884+0000 7fdd65f0c640 10 monclient: _reopen_session rank -1 2026-02-13T20:17:15.891 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.884+0000 7fdd65f0c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:17:15.891 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.884+0000 7fdd65f0c640 10 monclient(hunting): picked mon.noname-b con 0x7fdd601401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:17:15.891 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.884+0000 7fdd65f0c640 10 monclient(hunting): picked mon.noname-a con 0x7fdd60092020 addr v1:10.20.193.110:6789/0 2026-02-13T20:17:15.891 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.884+0000 7fdd65f0c640 10 monclient(hunting): picked mon.noname-c con 0x7fdd60091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:17:15.891 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.884+0000 7fdd65f0c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd6008b730 con 0x7fdd60092020 2026-02-13T20:17:15.891 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.884+0000 7fdd65f0c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd6005c5b0 con 0x7fdd60091950 2026-02-13T20:17:15.891 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.884+0000 7fdd65f0c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd6008bcf0 con 0x7fdd601401c0 2026-02-13T20:17:15.891 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.884+0000 7fdd65f0c640 10 monclient(hunting): _renew_subs 2026-02-13T20:17:15.891 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.884+0000 7fdd65f0c640 10 monclient(hunting): authenticate will time out at 997.574185s 2026-02-13T20:17:15.891 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.884+0000 7fdd5f7fe640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fdd601401c0 0x7fdd60091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:38528/0 (socket says 10.20.193.110:38528) 2026-02-13T20:17:15.891 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.884+0000 7fdd5f7fe640 1 -- 10.20.193.110:0/2041266153 learned_addr learned my addr 10.20.193.110:0/2041266153 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:17:15.891 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.884+0000 7fdd5effd640 1 --1- 10.20.193.110:0/2041266153 >> v1:10.20.193.110:6789/0 conn(0x7fdd60092020 0x7fdd601812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:59408/0 (socket says 10.20.193.110:59408) 2026-02-13T20:17:15.891 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.884+0000 7fdd5e7fc640 1 -- 10.20.193.110:0/2041266153 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2518363149 0 0) 0x7fdd6008bcf0 con 0x7fdd601401c0 2026-02-13T20:17:15.892 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.884+0000 7fdd5e7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:17:15.892 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.884+0000 7fdd5e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:15.892 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.884+0000 7fdd5e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:15.892 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.884+0000 7fdd5e7fc640 10 monclient(hunting): my global_id is 94217 2026-02-13T20:17:15.892 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.884+0000 7fdd5e7fc640 1 -- 10.20.193.110:0/2041266153 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd440035e0 con 0x7fdd601401c0 2026-02-13T20:17:15.892 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.884+0000 7fdd5e7fc640 1 -- 10.20.193.110:0/2041266153 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 846058897 0 0) 0x7fdd6008b730 con 0x7fdd60092020 2026-02-13T20:17:15.892 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.884+0000 7fdd5e7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:17:15.892 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.884+0000 7fdd5e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:15.892 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.884+0000 7fdd5e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:15.892 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.884+0000 7fdd5e7fc640 10 monclient(hunting): my global_id is 104118 2026-02-13T20:17:15.892 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.884+0000 7fdd5e7fc640 1 -- 10.20.193.110:0/2041266153 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd6008bcf0 con 0x7fdd60092020 2026-02-13T20:17:15.892 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.884+0000 7fdd5e7fc640 1 -- 10.20.193.110:0/2041266153 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2767339842 0 0) 0x7fdd440035e0 con 0x7fdd601401c0 2026-02-13T20:17:15.892 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.884+0000 7fdd5e7fc640 1 -- 10.20.193.110:0/2041266153 >> v1:10.20.193.188:6789/0 conn(0x7fdd60091950 legacy=0x7fdd601a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:15.892 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.884+0000 7fdd5e7fc640 1 -- 10.20.193.110:0/2041266153 >> v1:10.20.193.110:6789/0 conn(0x7fdd60092020 legacy=0x7fdd601812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:15.892 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.884+0000 7fdd5e7fc640 10 monclient: _finish_hunting 0 2026-02-13T20:17:15.892 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.884+0000 7fdd5e7fc640 1 monclient: found mon.noname-b 2026-02-13T20:17:15.892 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.884+0000 7fdd5e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:17:15.892 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.884+0000 7fdd5e7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:17:15.893 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.884+0000 7fdd5e7fc640 1 -- 10.20.193.110:0/2041266153 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd60140590 con 0x7fdd601401c0 2026-02-13T20:17:15.893 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.884+0000 7fdd5e7fc640 10 monclient: _finish_auth 0 2026-02-13T20:17:15.893 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.884+0000 7fdd5e7fc640 10 monclient: _check_auth_tickets 2026-02-13T20:17:15.893 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.884+0000 7fdd5e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:17:15.893 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.884+0000 7fdd5e7fc640 1 -- 10.20.193.110:0/2041266153 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fdd4c002dd0 con 0x7fdd601401c0 2026-02-13T20:17:15.893 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.884+0000 7fdd5e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:15.893 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.884+0000 7fdd5e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:17:15.893 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.884+0000 7fdd5e7fc640 10 monclient: dump: 2026-02-13T20:17:15.893 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:15.893 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:15.893 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.893 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.893 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:15.893 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:15.893 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:15.893 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:15.893 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:15.893 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:15.894 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.884+0000 7fdd65f0c640 5 monclient: authenticate success, global_id 94217 2026-02-13T20:17:15.894 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.884+0000 7fdd65f0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:17:15.894 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.884+0000 7fdd5e7fc640 1 -- 10.20.193.110:0/2041266153 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdd4c002f60 con 0x7fdd601401c0 2026-02-13T20:17:15.894 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.884+0000 7fdd5e7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:17:15.894 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.884+0000 7fdd5e7fc640 1 -- 10.20.193.110:0/2041266153 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fdd4c003370 con 0x7fdd601401c0 2026-02-13T20:17:15.894 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.884+0000 7fdd65f0c640 10 monclient: get_monmap_and_config success 2026-02-13T20:17:15.894 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.884+0000 7fdd65f0c640 4 set_mon_vals no callback set 2026-02-13T20:17:15.894 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.884+0000 7fdd5e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:15.894 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.884+0000 7fdd5e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:17:15.894 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.884+0000 7fdd5e7fc640 10 monclient: dump: 2026-02-13T20:17:15.894 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:15.894 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:15.894 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.894 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.894 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:15.895 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:15.895 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:15.895 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:15.895 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:15.895 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:15.895 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.885+0000 7fdd65f0c640 10 monclient: shutdown 2026-02-13T20:17:15.895 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.885+0000 7fdd65f0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:17:15.895 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.885+0000 7fdd65f0c640 1 -- 10.20.193.110:0/2041266153 >> v1:10.20.193.110:6790/0 conn(0x7fdd601401c0 legacy=0x7fdd60091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:15.895 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.885+0000 7fdd65f0c640 1 -- 10.20.193.110:0/2041266153 shutdown_connections 2026-02-13T20:17:15.895 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.885+0000 7fdd65f0c640 1 -- 10.20.193.110:0/2041266153 >> 10.20.193.110:0/2041266153 conn(0x7fdd60054e90 msgr2=0x7fdd60058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:17:15.895 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.885+0000 7fdd65f0c640 1 -- 10.20.193.110:0/2041266153 shutdown_connections 2026-02-13T20:17:15.895 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.885+0000 7fdd65f0c640 1 -- 10.20.193.110:0/2041266153 wait complete. 2026-02-13T20:17:15.895 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.885+0000 7fdd65f0c640 10 monclient: build_initial_monmap 2026-02-13T20:17:15.895 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.885+0000 7fdd65f0c640 10 monclient: monmap: 2026-02-13T20:17:15.895 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:17:15.895 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:17:15.895 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:17:15.895 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:17:15.895 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:17:15.896 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:17:15.896 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:17:15.896 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:17:15.896 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:17:15.896 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:15.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.885+0000 7fdd65f0c640 1 Processor -- start 2026-02-13T20:17:15.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.885+0000 7fdd65f0c640 1 -- start start 2026-02-13T20:17:15.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.885+0000 7fdd65f0c640 10 monclient: init 2026-02-13T20:17:15.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.885+0000 7fdd65f0c640 10 monclient: _reopen_session rank -1 2026-02-13T20:17:15.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.885+0000 7fdd65f0c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:17:15.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.885+0000 7fdd65f0c640 10 monclient(hunting): picked mon.noname-a con 0x7fdd60091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:17:15.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.885+0000 7fdd65f0c640 10 monclient(hunting): picked mon.noname-b con 0x7fdd601401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:17:15.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.885+0000 7fdd65f0c640 10 monclient(hunting): picked mon.noname-c con 0x7fdd6013ef70 addr v1:10.20.193.110:6790/0 2026-02-13T20:17:15.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.885+0000 7fdd65f0c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd60131fa0 con 0x7fdd60091950 2026-02-13T20:17:15.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.885+0000 7fdd65f0c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd601319e0 con 0x7fdd601401c0 2026-02-13T20:17:15.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.885+0000 7fdd65f0c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd60132280 con 0x7fdd6013ef70 2026-02-13T20:17:15.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.885+0000 7fdd65f0c640 10 monclient(hunting): _renew_subs 2026-02-13T20:17:15.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.885+0000 7fdd65f0c640 10 monclient(hunting): authenticate will time out at 997.575900s 2026-02-13T20:17:15.897 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.885+0000 7fdd5f7fe640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fdd60091950 0x7fdd6013e860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:59424/0 (socket says 10.20.193.110:59424) 2026-02-13T20:17:15.897 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.885+0000 7fdd5f7fe640 1 -- 10.20.193.110:0/1957909053 learned_addr learned my addr 10.20.193.110:0/1957909053 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:17:15.897 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd3bfff640 1 -- 10.20.193.110:0/1957909053 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2501238308 0 0) 0x7fdd60131fa0 con 0x7fdd60091950 2026-02-13T20:17:15.897 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd3bfff640 10 monclient(hunting): _negotiate 2026-02-13T20:17:15.897 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd3bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:15.897 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd3bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:15.897 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd3bfff640 10 monclient(hunting): my global_id is 104121 2026-02-13T20:17:15.897 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd3bfff640 1 -- 10.20.193.110:0/1957909053 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd300035e0 con 0x7fdd60091950 2026-02-13T20:17:15.897 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd3bfff640 1 -- 10.20.193.110:0/1957909053 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3758401911 0 0) 0x7fdd60132280 con 0x7fdd6013ef70 2026-02-13T20:17:15.897 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd3bfff640 10 monclient(hunting): _negotiate 2026-02-13T20:17:15.897 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd3bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:15.897 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd3bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:15.897 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd3bfff640 10 monclient(hunting): my global_id is 94220 2026-02-13T20:17:15.897 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd3bfff640 1 -- 10.20.193.110:0/1957909053 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd60131fa0 con 0x7fdd6013ef70 2026-02-13T20:17:15.897 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd3bfff640 1 -- 10.20.193.110:0/1957909053 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1100364144 0 0) 0x7fdd300035e0 con 0x7fdd60091950 2026-02-13T20:17:15.897 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd3bfff640 1 -- 10.20.193.110:0/1957909053 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdd60132280 con 0x7fdd60091950 2026-02-13T20:17:15.897 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd3bfff640 1 -- 10.20.193.110:0/1957909053 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fdd4c003280 con 0x7fdd60091950 2026-02-13T20:17:15.897 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd3bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:17:15.897 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd3bfff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:17:15.898 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd3bfff640 10 monclient(hunting): dump: 2026-02-13T20:17:15.898 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:15.898 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:15.898 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.898 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.898 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:15.898 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:15.898 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:15.898 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:15.898 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:15.898 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:15.898 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd3bfff640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:17:15.898 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd3bfff640 1 -- 10.20.193.110:0/1957909053 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1726818907 0 0) 0x7fdd60131fa0 con 0x7fdd6013ef70 2026-02-13T20:17:15.898 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd3bfff640 1 -- 10.20.193.110:0/1957909053 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdd300035e0 con 0x7fdd6013ef70 2026-02-13T20:17:15.898 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd3bfff640 1 -- 10.20.193.110:0/1957909053 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fdd540040d0 con 0x7fdd6013ef70 2026-02-13T20:17:15.898 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd3bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:17:15.898 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd3bfff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:17:15.898 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd3bfff640 10 monclient(hunting): dump: 2026-02-13T20:17:15.898 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:15.899 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:15.899 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.899 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.899 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:15.899 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:15.899 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:15.899 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:15.899 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:15.899 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:15.899 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd3bfff640 1 -- 10.20.193.110:0/1957909053 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 116819537 0 0) 0x7fdd300035e0 con 0x7fdd6013ef70 2026-02-13T20:17:15.899 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd3bfff640 1 -- 10.20.193.110:0/1957909053 >> v1:10.20.193.188:6789/0 conn(0x7fdd601401c0 legacy=0x7fdd60193940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:15.899 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd3bfff640 1 -- 10.20.193.110:0/1957909053 >> v1:10.20.193.110:6789/0 conn(0x7fdd60091950 legacy=0x7fdd6013e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:15.899 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd3bfff640 10 monclient: _finish_hunting 0 2026-02-13T20:17:15.899 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd3bfff640 1 monclient: found mon.c 2026-02-13T20:17:15.899 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd3bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:17:15.899 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd3bfff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:17:15.899 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd3bfff640 1 -- 10.20.193.110:0/1957909053 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd6005d320 con 0x7fdd6013ef70 2026-02-13T20:17:15.899 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd3bfff640 10 monclient: _finish_auth 0 2026-02-13T20:17:15.899 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd3bfff640 10 monclient: _check_auth_tickets 2026-02-13T20:17:15.900 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd3bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:17:15.900 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd65f0c640 5 monclient: authenticate success, global_id 94220 2026-02-13T20:17:15.900 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd65f0c640 10 monclient: _renew_subs 2026-02-13T20:17:15.900 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd65f0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:17:15.900 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd65f0c640 1 -- 10.20.193.110:0/1957909053 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdd601311e0 con 0x7fdd6013ef70 2026-02-13T20:17:15.900 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd65f0c640 10 monclient: _renew_subs 2026-02-13T20:17:15.900 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd65f0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:17:15.900 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd65f0c640 1 -- 10.20.193.110:0/1957909053 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fdd60130c20 con 0x7fdd6013ef70 2026-02-13T20:17:15.900 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd3bfff640 1 -- 10.20.193.110:0/1957909053 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdd54004620 con 0x7fdd6013ef70 2026-02-13T20:17:15.900 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd3bfff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:17:15.900 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd3bfff640 1 -- 10.20.193.110:0/1957909053 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fdd54004960 con 0x7fdd6013ef70 2026-02-13T20:17:15.900 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd3bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:15.900 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd3bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:17:15.900 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd5dffb640 4 set_mon_vals no callback set 2026-02-13T20:17:15.900 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd3bfff640 10 monclient: dump: 2026-02-13T20:17:15.900 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:15.900 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:15.900 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.901 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:15.901 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:15.901 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:15.901 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:15.901 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:15.901 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:15.901 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:15.901 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd65f0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:17:15.901 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd65f0c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:17:15.901 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd65f0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:17:15.901 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd65f0c640 1 -- 10.20.193.110:0/1957909053 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd600008d0 con 0x7fdd6013ef70 2026-02-13T20:17:15.901 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.886+0000 7fdd3bfff640 1 -- 10.20.193.110:0/1957909053 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fdd54004ac0 con 0x7fdd6013ef70 2026-02-13T20:17:15.901 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.887+0000 7fdd3bfff640 1 -- 10.20.193.110:0/1957909053 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(298..298 src has 1..298) ==== 3943+0+0 (unknown 260527215 0 0) 0x7fdd5404e630 con 0x7fdd6013ef70 2026-02-13T20:17:15.901 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.887+0000 7fdd5f7fe640 10 monclient: get_auth_request con 0x7fdd3003fae0 auth_method 0 2026-02-13T20:17:15.901 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.889+0000 7fdd3bfff640 1 -- 10.20.193.110:0/1957909053 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fdd54016db0 con 0x7fdd6013ef70 2026-02-13T20:17:15.901 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.889+0000 7fdd3bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:17:15.901 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:15.889+0000 7fdd3bfff640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:17:15.962 INFO:tasks.rados.rados.0.trial188.stdout:1436: done (2 left) 2026-02-13T20:17:15.962 INFO:tasks.rados.rados.0.trial188.stdout:1437: copy_from oid 9 from oid 26 current snap is 139 2026-02-13T20:17:15.962 INFO:tasks.rados.rados.0.trial188.stdout:1434: expect (ObjNum 452 snap 116 seq_num 452) 2026-02-13T20:17:15.962 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:17:16.006 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:17:16.041 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:16.040+0000 7fdd65f0c640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-13T20:17:16.041 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:16.040+0000 7fdd65f0c640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-13T20:17:16.041 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:16.040+0000 7fdd65f0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:17:16.041 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:16.040+0000 7fdd65f0c640 1 -- 10.20.193.110:0/1957909053 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fdd60058410 con 0x7fdd6013ef70 2026-02-13T20:17:16.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:16.041+0000 7fdd3bfff640 1 -- 10.20.193.110:0/1957909053 <== mon.2 v1:10.20.193.110:6790/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7fdd54016560 con 0x7fdd6013ef70 2026-02-13T20:17:16.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:16.041+0000 7fdd3bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-13T20:17:16.044 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:16.041+0000 7fdd3bfff640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:17:16.049 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:16.043+0000 7fdd65f0c640 1 -- 10.20.193.110:0/1957909053 >> v1:10.20.193.188:6812/1623052694 conn(0x7fdd3003fae0 legacy=0x7fdd3005ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:16.050 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:16.043+0000 7fdd65f0c640 10 monclient: shutdown 2026-02-13T20:17:16.050 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:16.043+0000 7fdd65f0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:17:16.050 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:16.043+0000 7fdd65f0c640 1 -- 10.20.193.110:0/1957909053 >> v1:10.20.193.110:6790/0 conn(0x7fdd6013ef70 legacy=0x7fdd60195060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:16.050 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:16.043+0000 7fdd65f0c640 1 -- 10.20.193.110:0/1957909053 shutdown_connections 2026-02-13T20:17:16.050 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:16.043+0000 7fdd65f0c640 1 -- 10.20.193.110:0/1957909053 >> 10.20.193.110:0/1957909053 conn(0x7fdd60054e90 msgr2=0x7fdd60088e30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:17:16.050 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:16.043+0000 7fdd65f0c640 1 -- 10.20.193.110:0/1957909053 shutdown_connections 2026-02-13T20:17:16.050 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:16.043+0000 7fdd65f0c640 1 -- 10.20.193.110:0/1957909053 wait complete. 2026-02-13T20:17:16.053 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.040+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:17:16.053 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.040+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=16,config=1,health=13,kv=10,logm=60} crc {auth=736148462,config=2457401934,health=1181117202,kv=1564860261,logm=2195372612}) 2026-02-13T20:17:16.053 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.040+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=14,config=2,health=13,kv=11,logm=60} crc {auth=151332394,config=1618278320,health=1181117202,kv=1564860261,logm=4137757127}) 2026-02-13T20:17:16.053 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.040+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:17:16.053 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.040+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=16,config=1,health=13,kv=10,logm=60} crc {auth=736148462,config=2457401934,health=1181117202,kv=1564860261,logm=2195372612}) 2026-02-13T20:17:16.053 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.040+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=16,config=2,health=13,kv=11,logm=58} crc {auth=3658452554,config=1618278320,health=1181117202,kv=1564860261,logm=26080577}) 2026-02-13T20:17:16.054 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.041+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:17:16.054 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.041+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=412982425}) 2026-02-13T20:17:16.054 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.041+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1811920702}) 2026-02-13T20:17:16.054 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.041+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:17:16.054 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.041+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=412982425}) 2026-02-13T20:17:16.054 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.041+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1399976340}) 2026-02-13T20:17:16.054 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.041+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:17:16.054 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.041+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1996535998}) 2026-02-13T20:17:16.054 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.041+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2019457925}) 2026-02-13T20:17:16.054 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.041+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:17:16.054 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.041+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1996535998}) 2026-02-13T20:17:16.054 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.041+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4259142217}) 2026-02-13T20:17:16.055 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.042+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:17:16.055 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.042+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1085126021}) 2026-02-13T20:17:16.055 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.042+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3283326755}) 2026-02-13T20:17:16.055 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.042+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:17:16.055 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.042+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1085126021}) 2026-02-13T20:17:16.055 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.042+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=755342933}) 2026-02-13T20:17:16.055 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.042+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:17:16.055 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.042+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3600060058}) 2026-02-13T20:17:16.055 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.042+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4204964021}) 2026-02-13T20:17:16.055 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.042+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:17:16.055 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.042+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3600060058}) 2026-02-13T20:17:16.056 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.042+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3491364105}) 2026-02-13T20:17:16.056 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.043+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:17:16.056 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.043+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1860772876}) 2026-02-13T20:17:16.056 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.043+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=111724136}) 2026-02-13T20:17:16.056 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.043+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:17:16.056 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.043+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1860772876}) 2026-02-13T20:17:16.056 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.043+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=896010847}) 2026-02-13T20:17:16.056 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.043+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:17:16.056 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.043+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2465888071}) 2026-02-13T20:17:16.056 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.043+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=947018451}) 2026-02-13T20:17:16.056 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.043+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:17:16.057 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.043+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2465888071}) 2026-02-13T20:17:16.057 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.043+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=479021157}) 2026-02-13T20:17:16.057 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.044+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:17:16.057 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.044+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3065883344}) 2026-02-13T20:17:16.057 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.044+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2743054363}) 2026-02-13T20:17:16.057 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.044+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:17:16.057 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.044+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3065883344}) 2026-02-13T20:17:16.057 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.044+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1509772853}) 2026-02-13T20:17:16.057 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.044+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:17:16.057 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.044+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=980903694}) 2026-02-13T20:17:16.057 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.044+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2919326166}) 2026-02-13T20:17:16.057 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.044+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:17:16.057 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.044+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=980903694}) 2026-02-13T20:17:16.058 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.044+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2135523994}) 2026-02-13T20:17:16.058 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.045+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:17:16.058 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.045+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=327892601}) 2026-02-13T20:17:16.058 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.045+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1019876813}) 2026-02-13T20:17:16.058 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.045+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:17:16.058 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.045+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=327892601}) 2026-02-13T20:17:16.058 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.045+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2199424089}) 2026-02-13T20:17:16.058 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.045+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:17:16.058 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.045+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2863983290}) 2026-02-13T20:17:16.058 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.045+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=410379459}) 2026-02-13T20:17:16.058 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.045+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:17:16.058 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.045+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2863983290}) 2026-02-13T20:17:16.059 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.045+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1054340383}) 2026-02-13T20:17:16.059 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.046+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:17:16.059 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.046+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1007105926}) 2026-02-13T20:17:16.059 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.046+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2486991896}) 2026-02-13T20:17:16.059 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.046+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:17:16.059 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.046+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1007105926}) 2026-02-13T20:17:16.059 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.046+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=98,mdsmap=2} crc {logm=1083900834,mdsmap=3827184867}) 2026-02-13T20:17:16.059 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.046+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:17:16.059 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.046+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=3,mdsmap=3,mgr=6,mgr_metadata=1,mgrstat=11,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=53} crc {logm=1841386336,mdsmap=3740562891,mgr=3816876224,mgr_metadata=2819730505,mgrstat=1088963182,mon_config_key=3557484700,monmap=207866894,nvmeofgw=3360707892,osd_metadata=91123727,osd_pg_creating=3798571723,osd_snap=1920996714}) 2026-02-13T20:17:16.059 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.046+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=2,mdsmap=2,mgr=8,mgr_command_descs=1,mgrstat=11,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=53} crc {logm=723889699,mdsmap=3140514009,mgr=2881591710,mgr_command_descs=714296370,mgrstat=3928485083,mon_config_key=3536796804,monmap=207866894,nvmeofgw=3360707892,osd_metadata=91123727,osd_pg_creating=3798571723,osd_snap=3400557989}) 2026-02-13T20:17:16.059 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.046+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:17:16.059 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.046+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=3,mdsmap=3,mgr=6,mgr_metadata=1,mgrstat=11,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=53} crc {logm=1841386336,mdsmap=3740562891,mgr=3816876224,mgr_metadata=2819730505,mgrstat=1088963182,mon_config_key=3557484700,monmap=207866894,nvmeofgw=3360707892,osd_metadata=91123727,osd_pg_creating=3798571723,osd_snap=1920996714}) 2026-02-13T20:17:16.060 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.046+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=3,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=50} crc {logm=1841386336,mdsmap=3740562891,mgr=2881591710,mgr_command_descs=714296370,mgr_metadata=2819730505,mgrstat=2933338861,mon_config_key=2473289879,monmap=207866894,nvmeofgw=3360707892,osd_metadata=91123727,osd_pg_creating=3798571723,osd_snap=3279425758}) 2026-02-13T20:17:16.060 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.047+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:17:16.060 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.047+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3801870967}) 2026-02-13T20:17:16.060 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.047+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3525976876}) 2026-02-13T20:17:16.060 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.047+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:17:16.060 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.047+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3801870967}) 2026-02-13T20:17:16.060 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.047+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1019664937}) 2026-02-13T20:17:16.060 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.047+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:17:16.060 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.047+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1195992448}) 2026-02-13T20:17:16.060 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.047+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=984300505}) 2026-02-13T20:17:16.060 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.047+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:17:16.060 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.047+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1195992448}) 2026-02-13T20:17:16.061 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.047+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=4091665793}) 2026-02-13T20:17:16.061 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.048+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:17:16.061 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.048+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=663078869}) 2026-02-13T20:17:16.061 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.048+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3637785346}) 2026-02-13T20:17:16.061 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.048+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:17:16.061 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.048+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=663078869}) 2026-02-13T20:17:16.061 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.048+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1256707214}) 2026-02-13T20:17:16.061 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.049+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:17:16.061 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.049+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=824713238}) 2026-02-13T20:17:16.061 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.049+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1587121498}) 2026-02-13T20:17:16.061 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.049+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:17:16.061 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.049+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=824713238}) 2026-02-13T20:17:16.061 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.049+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1085421614}) 2026-02-13T20:17:16.063 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.051+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:17:16.063 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.051+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=48} crc {osdmap=1313402026}) 2026-02-13T20:17:16.063 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.051+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=48} crc {osdmap=1847427926}) 2026-02-13T20:17:16.063 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.051+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:17:16.064 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.051+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=48} crc {osdmap=1313402026}) 2026-02-13T20:17:16.064 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:17:16.051+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=47} crc {osdmap=3886796784}) 2026-02-13T20:17:16.064 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-13T20:17:16.084 INFO:tasks.rados.rados.0.trial188.stdout:1435: finishing write tid 1 to trial18843701-23 2026-02-13T20:17:16.084 INFO:tasks.rados.rados.0.trial188.stdout:1435: finishing write tid 2 to trial18843701-23 2026-02-13T20:17:16.084 INFO:tasks.rados.rados.0.trial188.stdout:1434: done (2 left) 2026-02-13T20:17:16.084 INFO:tasks.rados.rados.0.trial188.stdout:1438: snap_create 2026-02-13T20:17:16.084 INFO:tasks.rados.rados.0.trial188.stdout:1435: finishing write tid 3 to trial18843701-23 2026-02-13T20:17:16.084 INFO:tasks.rados.rados.0.trial188.stdout:1435: finishing write tid 4 to trial18843701-23 2026-02-13T20:17:16.084 INFO:tasks.rados.rados.0.trial188.stdout:1435: oid 23 updating version 0 to 660 2026-02-13T20:17:16.084 INFO:tasks.rados.rados.0.trial188.stdout:1435: oid 23 updating version 660 to 661 2026-02-13T20:17:16.084 INFO:tasks.rados.rados.0.trial188.stdout:1435: oid 23 updating version 661 to 662 2026-02-13T20:17:16.084 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 23 v 662 (ObjNum 538 snap 139 seq_num 538) dirty exists 2026-02-13T20:17:16.084 INFO:tasks.rados.rados.0.trial188.stdout:1435: left oid 23 (ObjNum 538 snap 139 seq_num 538) 2026-02-13T20:17:16.085 INFO:tasks.rados.rados.0.trial188.stdout:1437: finishing copy_from racing read to trial18843701-9 2026-02-13T20:17:16.085 INFO:tasks.rados.rados.0.trial188.stdout:1437: finishing copy_from to trial18843701-9 2026-02-13T20:17:16.085 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 9 v 454 (ObjNum 491 snap 127 seq_num 491) dirty exists 2026-02-13T20:17:16.968 INFO:tasks.rados.rados.0.trial188.stdout:1435: done (2 left) 2026-02-13T20:17:16.969 INFO:tasks.rados.rados.0.trial188.stdout:1437: done (1 left) 2026-02-13T20:17:16.969 INFO:tasks.rados.rados.0.trial188.stdout:1438: done (0 left) 2026-02-13T20:17:16.969 INFO:tasks.rados.rados.0.trial188.stdout:1439: write (excl) oid 5 current snap is 140 2026-02-13T20:17:16.969 INFO:tasks.rados.rados.0.trial188.stdout:1439: seq_num 539 ranges {658973=703921,1907912=570853,2985346=73627} 2026-02-13T20:17:16.973 INFO:tasks.rados.rados.0.trial188.stdout:1439: writing trial18843701-5 from 658973 to 1362894 tid 1 2026-02-13T20:17:16.977 INFO:tasks.rados.rados.0.trial188.stdout:1439: writing trial18843701-5 from 1907912 to 2478765 tid 2 2026-02-13T20:17:16.980 INFO:tasks.rados.rados.0.trial188.stdout:1439: writing trial18843701-5 from 2985346 to 3058973 tid 3 2026-02-13T20:17:16.980 INFO:tasks.rados.rados.0.trial188.stdout:1440: read oid 21 snap 135 2026-02-13T20:17:16.980 INFO:tasks.rados.rados.0.trial188.stdout:1440: expect (ObjNum 469 snap 121 seq_num 469) 2026-02-13T20:17:16.980 INFO:tasks.rados.rados.0.trial188.stdout:1441: read oid 40 snap -1 2026-02-13T20:17:16.980 INFO:tasks.rados.rados.0.trial188.stdout:1441: expect (ObjNum 498 snap 128 seq_num 498) 2026-02-13T20:17:16.980 INFO:tasks.rados.rados.0.trial188.stdout:1442: write oid 1 current snap is 140 2026-02-13T20:17:16.981 INFO:tasks.rados.rados.0.trial188.stdout:1442: seq_num 540 ranges {675780=495523,1682747=714511,3012769=63011} 2026-02-13T20:17:16.984 INFO:tasks.rados.rados.0.trial188.stdout:1442: writing trial18843701-1 from 675780 to 1171303 tid 1 2026-02-13T20:17:16.989 INFO:tasks.rados.rados.0.trial188.stdout:1442: writing trial18843701-1 from 1682747 to 2397258 tid 2 2026-02-13T20:17:16.991 INFO:tasks.rados.rados.0.trial188.stdout:1442: writing trial18843701-1 from 3012769 to 3075780 tid 3 2026-02-13T20:17:16.992 INFO:tasks.rados.rados.0.trial188.stdout:1443: snap_create 2026-02-13T20:17:16.992 INFO:tasks.rados.rados.0.trial188.stdout:1440: expect (ObjNum 469 snap 121 seq_num 469) 2026-02-13T20:17:17.036 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:17:17.065 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-13T20:17:17.065 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T20:17:17.082 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 549874 2026-02-13T20:17:17.123 INFO:tasks.rados.rados.0.trial188.stdout:1441: expect (ObjNum 498 snap 128 seq_num 498) 2026-02-13T20:17:17.123 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:17:17.131 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.130+0000 7fb7e0d4c640 10 monclient: get_monmap_and_config 2026-02-13T20:17:17.131 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.130+0000 7fb7e0d4c640 10 monclient: build_initial_monmap 2026-02-13T20:17:17.131 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.130+0000 7fb7e0d4c640 10 monclient: monmap: 2026-02-13T20:17:17.131 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:17:17.131 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:17.131 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:17:17.130998+0000 2026-02-13T20:17:17.131 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:17:17.130998+0000 2026-02-13T20:17:17.131 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:17:17.132 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:17.132 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:17:17.132 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:17:17.132 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:17:17.132 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:17.140 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.130+0000 7fb7e0d4c640 1 Processor -- start 2026-02-13T20:17:17.141 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.131+0000 7fb7e0d4c640 1 -- start start 2026-02-13T20:17:17.141 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.131+0000 7fb7e0d4c640 10 monclient: init 2026-02-13T20:17:17.141 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.131+0000 7fb7e0d4c640 10 monclient: _reopen_session rank -1 2026-02-13T20:17:17.141 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.131+0000 7fb7e0d4c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:17:17.141 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.131+0000 7fb7e0d4c640 10 monclient(hunting): picked mon.noname-b con 0x7fb7dc1401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:17:17.141 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.131+0000 7fb7e0d4c640 10 monclient(hunting): picked mon.noname-a con 0x7fb7dc092020 addr v1:10.20.193.110:6789/0 2026-02-13T20:17:17.141 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.131+0000 7fb7e0d4c640 10 monclient(hunting): picked mon.noname-c con 0x7fb7dc091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:17:17.141 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.131+0000 7fb7e0d4c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7dc08b730 con 0x7fb7dc092020 2026-02-13T20:17:17.141 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.131+0000 7fb7e0d4c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7dc05c5b0 con 0x7fb7dc091950 2026-02-13T20:17:17.141 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.131+0000 7fb7e0d4c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7dc08bcf0 con 0x7fb7dc1401c0 2026-02-13T20:17:17.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.131+0000 7fb7e0d4c640 10 monclient(hunting): _renew_subs 2026-02-13T20:17:17.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.131+0000 7fb7e0d4c640 10 monclient(hunting): authenticate will time out at 998.821353s 2026-02-13T20:17:17.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.131+0000 7fb7da575640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fb7dc1401c0 0x7fb7dc091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:38542/0 (socket says 10.20.193.110:38542) 2026-02-13T20:17:17.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.131+0000 7fb7da575640 1 -- 10.20.193.110:0/360596903 learned_addr learned my addr 10.20.193.110:0/360596903 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:17:17.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.131+0000 7fb7d9d74640 1 --1- 10.20.193.110:0/360596903 >> v1:10.20.193.110:6789/0 conn(0x7fb7dc092020 0x7fb7dc1812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:59436/0 (socket says 10.20.193.110:59436) 2026-02-13T20:17:17.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.131+0000 7fb7d9573640 1 -- 10.20.193.110:0/360596903 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3617199546 0 0) 0x7fb7dc08b730 con 0x7fb7dc092020 2026-02-13T20:17:17.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.131+0000 7fb7d9573640 10 monclient(hunting): _negotiate 2026-02-13T20:17:17.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.131+0000 7fb7d9573640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:17.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.131+0000 7fb7d9573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:17.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.131+0000 7fb7d9573640 10 monclient(hunting): my global_id is 104124 2026-02-13T20:17:17.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.131+0000 7fb7d9573640 1 -- 10.20.193.110:0/360596903 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7c80035e0 con 0x7fb7dc092020 2026-02-13T20:17:17.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.131+0000 7fb7d9573640 1 -- 10.20.193.110:0/360596903 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1598440847 0 0) 0x7fb7dc08bcf0 con 0x7fb7dc1401c0 2026-02-13T20:17:17.143 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.131+0000 7fb7d9573640 10 monclient(hunting): _negotiate 2026-02-13T20:17:17.143 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.131+0000 7fb7d9573640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:17.143 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.131+0000 7fb7d9573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:17.143 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.131+0000 7fb7d9573640 10 monclient(hunting): my global_id is 94223 2026-02-13T20:17:17.143 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.131+0000 7fb7d9573640 1 -- 10.20.193.110:0/360596903 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7dc08b730 con 0x7fb7dc1401c0 2026-02-13T20:17:17.143 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.131+0000 7fb7d9573640 1 -- 10.20.193.110:0/360596903 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2572871836 0 0) 0x7fb7c80035e0 con 0x7fb7dc092020 2026-02-13T20:17:17.143 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.131+0000 7fb7d9573640 1 -- 10.20.193.110:0/360596903 >> v1:10.20.193.110:6790/0 conn(0x7fb7dc1401c0 legacy=0x7fb7dc091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:17.143 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.131+0000 7fb7d9573640 1 -- 10.20.193.110:0/360596903 >> v1:10.20.193.188:6789/0 conn(0x7fb7dc091950 legacy=0x7fb7dc1a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:17.143 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.131+0000 7fb7d9573640 10 monclient: _finish_hunting 0 2026-02-13T20:17:17.143 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.131+0000 7fb7d9573640 1 monclient: found mon.noname-a 2026-02-13T20:17:17.143 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.131+0000 7fb7d9573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:17:17.143 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.131+0000 7fb7d9573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:17:17.144 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.131+0000 7fb7d9573640 1 -- 10.20.193.110:0/360596903 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7dc140590 con 0x7fb7dc092020 2026-02-13T20:17:17.144 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.131+0000 7fb7d9573640 10 monclient: _finish_auth 0 2026-02-13T20:17:17.144 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.131+0000 7fb7d9573640 10 monclient: _check_auth_tickets 2026-02-13T20:17:17.144 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.131+0000 7fb7d9573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:17:17.144 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.131+0000 7fb7e0d4c640 5 monclient: authenticate success, global_id 104124 2026-02-13T20:17:17.144 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.131+0000 7fb7d9573640 1 -- 10.20.193.110:0/360596903 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb7c4002dd0 con 0x7fb7dc092020 2026-02-13T20:17:17.144 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.131+0000 7fb7e0d4c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:17:17.144 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.131+0000 7fb7d9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:17.144 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.131+0000 7fb7d9573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:17:17.144 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.131+0000 7fb7d9573640 10 monclient: dump: 2026-02-13T20:17:17.144 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:17.144 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:17.145 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.145 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.145 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:17.145 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:17.145 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:17.145 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:17.145 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:17.145 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:17.145 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.131+0000 7fb7e0d4c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:17:17.145 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.132+0000 7fb7d9573640 1 -- 10.20.193.110:0/360596903 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb7c4003020 con 0x7fb7dc092020 2026-02-13T20:17:17.145 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.132+0000 7fb7d9573640 10 monclient: handle_config config(0 keys) 2026-02-13T20:17:17.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.132+0000 7fb7e0d4c640 10 monclient: get_monmap_and_config success 2026-02-13T20:17:17.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.132+0000 7fb7e0d4c640 4 set_mon_vals no callback set 2026-02-13T20:17:17.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.132+0000 7fb7d9573640 1 -- 10.20.193.110:0/360596903 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb7c4003430 con 0x7fb7dc092020 2026-02-13T20:17:17.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.132+0000 7fb7d9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:17.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.132+0000 7fb7d9573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:17:17.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.132+0000 7fb7d9573640 10 monclient: dump: 2026-02-13T20:17:17.146 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:17.146 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:17.146 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.146 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.146 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:17.146 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:17.146 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:17.147 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:17.147 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:17.147 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:17.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.132+0000 7fb7e0d4c640 10 monclient: shutdown 2026-02-13T20:17:17.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.132+0000 7fb7e0d4c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:17:17.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.132+0000 7fb7e0d4c640 1 -- 10.20.193.110:0/360596903 >> v1:10.20.193.110:6789/0 conn(0x7fb7dc092020 legacy=0x7fb7dc1812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:17.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.132+0000 7fb7e0d4c640 1 -- 10.20.193.110:0/360596903 shutdown_connections 2026-02-13T20:17:17.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.132+0000 7fb7e0d4c640 1 -- 10.20.193.110:0/360596903 >> 10.20.193.110:0/360596903 conn(0x7fb7dc054e90 msgr2=0x7fb7dc058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:17:17.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.132+0000 7fb7e0d4c640 1 -- 10.20.193.110:0/360596903 shutdown_connections 2026-02-13T20:17:17.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.132+0000 7fb7e0d4c640 1 -- 10.20.193.110:0/360596903 wait complete. 2026-02-13T20:17:17.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.132+0000 7fb7e0d4c640 10 monclient: build_initial_monmap 2026-02-13T20:17:17.148 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.132+0000 7fb7e0d4c640 10 monclient: monmap: 2026-02-13T20:17:17.148 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:17:17.148 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:17:17.148 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:17:17.148 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:17:17.148 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:17:17.148 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:17:17.148 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:17:17.148 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:17:17.148 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:17:17.148 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:17.148 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.132+0000 7fb7e0d4c640 1 Processor -- start 2026-02-13T20:17:17.148 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.132+0000 7fb7e0d4c640 1 -- start start 2026-02-13T20:17:17.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.132+0000 7fb7e0d4c640 10 monclient: init 2026-02-13T20:17:17.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7e0d4c640 10 monclient: _reopen_session rank -1 2026-02-13T20:17:17.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7e0d4c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:17:17.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7e0d4c640 10 monclient(hunting): picked mon.noname-a con 0x7fb7dc091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:17:17.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7e0d4c640 10 monclient(hunting): picked mon.noname-b con 0x7fb7dc1401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:17:17.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7e0d4c640 10 monclient(hunting): picked mon.noname-c con 0x7fb7dc1142c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:17:17.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7e0d4c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7dc12e9d0 con 0x7fb7dc091950 2026-02-13T20:17:17.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7e0d4c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7dc118150 con 0x7fb7dc1401c0 2026-02-13T20:17:17.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7e0d4c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7dc13e850 con 0x7fb7dc1142c0 2026-02-13T20:17:17.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7e0d4c640 10 monclient(hunting): _renew_subs 2026-02-13T20:17:17.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7e0d4c640 10 monclient(hunting): authenticate will time out at 998.823248s 2026-02-13T20:17:17.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7da575640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fb7dc091950 0x7fb7dc117330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:59442/0 (socket says 10.20.193.110:59442) 2026-02-13T20:17:17.150 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7da575640 1 -- 10.20.193.110:0/640352299 learned_addr learned my addr 10.20.193.110:0/640352299 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:17:17.150 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7c2ffd640 1 -- 10.20.193.110:0/640352299 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3336748590 0 0) 0x7fb7dc13e850 con 0x7fb7dc1142c0 2026-02-13T20:17:17.150 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7c2ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:17:17.150 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7c2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:17.150 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7c2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:17.150 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7c2ffd640 10 monclient(hunting): my global_id is 94226 2026-02-13T20:17:17.150 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7c2ffd640 1 -- 10.20.193.110:0/640352299 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7a80035e0 con 0x7fb7dc1142c0 2026-02-13T20:17:17.150 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7c2ffd640 1 -- 10.20.193.110:0/640352299 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2355186904 0 0) 0x7fb7dc12e9d0 con 0x7fb7dc091950 2026-02-13T20:17:17.150 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7c2ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:17:17.150 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7c2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:17.150 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7c2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:17.150 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7c2ffd640 10 monclient(hunting): my global_id is 104127 2026-02-13T20:17:17.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7c2ffd640 1 -- 10.20.193.110:0/640352299 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7dc13e850 con 0x7fb7dc091950 2026-02-13T20:17:17.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7c2ffd640 1 -- 10.20.193.110:0/640352299 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3220862095 0 0) 0x7fb7a80035e0 con 0x7fb7dc1142c0 2026-02-13T20:17:17.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7c2ffd640 1 -- 10.20.193.110:0/640352299 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb7dc12e9d0 con 0x7fb7dc1142c0 2026-02-13T20:17:17.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7c2ffd640 1 -- 10.20.193.110:0/640352299 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb7cc004050 con 0x7fb7dc1142c0 2026-02-13T20:17:17.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7c2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:17:17.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7c2ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:17:17.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7c2ffd640 10 monclient(hunting): dump: 2026-02-13T20:17:17.151 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:17.151 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:17.151 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.151 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.151 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:17.151 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:17.152 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:17.152 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:17.152 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:17.152 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:17.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7c2ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:17:17.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7c2ffd640 1 -- 10.20.193.110:0/640352299 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3598999414 0 0) 0x7fb7dc13e850 con 0x7fb7dc091950 2026-02-13T20:17:17.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7c2ffd640 1 -- 10.20.193.110:0/640352299 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb7a80035e0 con 0x7fb7dc091950 2026-02-13T20:17:17.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7c2ffd640 1 -- 10.20.193.110:0/640352299 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb7d0002fe0 con 0x7fb7dc091950 2026-02-13T20:17:17.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7c2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:17:17.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7c2ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:17:17.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7c2ffd640 10 monclient(hunting): dump: 2026-02-13T20:17:17.152 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:17.153 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:17.153 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.153 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.153 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:17.153 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:17.153 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:17.153 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:17.153 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:17.153 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:17.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7c2ffd640 1 -- 10.20.193.110:0/640352299 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2936502643 0 0) 0x7fb7a80035e0 con 0x7fb7dc091950 2026-02-13T20:17:17.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7c2ffd640 1 -- 10.20.193.110:0/640352299 >> v1:10.20.193.110:6790/0 conn(0x7fb7dc1142c0 legacy=0x7fb7dc1a2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:17.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7c2ffd640 1 -- 10.20.193.110:0/640352299 >> v1:10.20.193.188:6789/0 conn(0x7fb7dc1401c0 legacy=0x7fb7dc117a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:17.154 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7c2ffd640 10 monclient: _finish_hunting 0 2026-02-13T20:17:17.154 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7c2ffd640 1 monclient: found mon.a 2026-02-13T20:17:17.154 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7c2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:17:17.154 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7c2ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:17:17.154 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7c2ffd640 1 -- 10.20.193.110:0/640352299 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7dc05d320 con 0x7fb7dc091950 2026-02-13T20:17:17.154 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7c2ffd640 10 monclient: _finish_auth 0 2026-02-13T20:17:17.154 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7c2ffd640 10 monclient: _check_auth_tickets 2026-02-13T20:17:17.154 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7c2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:17:17.154 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7e0d4c640 5 monclient: authenticate success, global_id 104127 2026-02-13T20:17:17.154 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7e0d4c640 10 monclient: _renew_subs 2026-02-13T20:17:17.154 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7e0d4c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:17:17.154 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7e0d4c640 1 -- 10.20.193.110:0/640352299 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb7dc12e3e0 con 0x7fb7dc091950 2026-02-13T20:17:17.154 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7e0d4c640 10 monclient: _renew_subs 2026-02-13T20:17:17.155 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7e0d4c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:17:17.155 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.133+0000 7fb7e0d4c640 1 -- 10.20.193.110:0/640352299 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb7dc12da70 con 0x7fb7dc091950 2026-02-13T20:17:17.155 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.134+0000 7fb7c2ffd640 1 -- 10.20.193.110:0/640352299 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb7d0003140 con 0x7fb7dc091950 2026-02-13T20:17:17.155 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.134+0000 7fb7c2ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:17:17.155 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.134+0000 7fb7c2ffd640 1 -- 10.20.193.110:0/640352299 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb7d0004a50 con 0x7fb7dc091950 2026-02-13T20:17:17.155 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.134+0000 7fb7c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:17.155 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.134+0000 7fb7c2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:17:17.155 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.134+0000 7fb7c2ffd640 10 monclient: dump: 2026-02-13T20:17:17.155 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:17.155 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:17.155 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.156 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.156 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:17.156 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:17.156 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:17.156 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:17.156 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:17.156 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:17.156 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.134+0000 7fb7d8d72640 4 set_mon_vals no callback set 2026-02-13T20:17:17.156 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.134+0000 7fb7e0d4c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:17:17.156 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.134+0000 7fb7e0d4c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:17:17.156 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.134+0000 7fb7e0d4c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:17:17.156 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.134+0000 7fb7e0d4c640 1 -- 10.20.193.110:0/640352299 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7dc0008d0 con 0x7fb7dc091950 2026-02-13T20:17:17.156 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.134+0000 7fb7c2ffd640 1 -- 10.20.193.110:0/640352299 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fb7d0004bb0 con 0x7fb7dc091950 2026-02-13T20:17:17.157 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.134+0000 7fb7c2ffd640 1 -- 10.20.193.110:0/640352299 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(300..300 src has 1..300) ==== 3915+0+0 (unknown 3531726731 0 0) 0x7fb7d004e860 con 0x7fb7dc091950 2026-02-13T20:17:17.157 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.134+0000 7fb7d9d74640 10 monclient: get_auth_request con 0x7fb7a803fa20 auth_method 0 2026-02-13T20:17:17.157 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.137+0000 7fb7c2ffd640 1 -- 10.20.193.110:0/640352299 <== mon.0 v1:10.20.193.110:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fb7d00169a0 con 0x7fb7dc091950 2026-02-13T20:17:17.157 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.137+0000 7fb7c2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:17:17.157 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.137+0000 7fb7c2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:17:17.243 INFO:tasks.rados.rados.0.trial188.stdout:1439: finishing write tid 1 to trial18843701-5 2026-02-13T20:17:17.243 INFO:tasks.rados.rados.0.trial188.stdout:1439: finishing write tid 2 to trial18843701-5 2026-02-13T20:17:17.243 INFO:tasks.rados.rados.0.trial188.stdout:1439: finishing write tid 3 to trial18843701-5 2026-02-13T20:17:17.243 INFO:tasks.rados.rados.0.trial188.stdout:1439: finishing write tid 4 to trial18843701-5 2026-02-13T20:17:17.243 INFO:tasks.rados.rados.0.trial188.stdout:1439: finishing write tid 5 to trial18843701-5 2026-02-13T20:17:17.243 INFO:tasks.rados.rados.0.trial188.stdout:1439: oid 5 updating version 0 to 571 2026-02-13T20:17:17.243 INFO:tasks.rados.rados.0.trial188.stdout:1439: oid 5 version 571 is already newer than 570 2026-02-13T20:17:17.243 INFO:tasks.rados.rados.0.trial188.stdout:1439: oid 5 updating version 571 to 572 2026-02-13T20:17:17.243 INFO:tasks.rados.rados.0.trial188.stdout:1439: oid 5 version 572 is already newer than 569 2026-02-13T20:17:17.243 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 5 v 572 (ObjNum 539 snap 140 seq_num 539) dirty exists 2026-02-13T20:17:17.243 INFO:tasks.rados.rados.0.trial188.stdout:1439: left oid 5 (ObjNum 539 snap 140 seq_num 539) 2026-02-13T20:17:17.243 INFO:tasks.rados.rados.0.trial188.stdout:1442: finishing write tid 1 to trial18843701-1 2026-02-13T20:17:17.243 INFO:tasks.rados.rados.0.trial188.stdout:1442: finishing write tid 2 to trial18843701-1 2026-02-13T20:17:17.243 INFO:tasks.rados.rados.0.trial188.stdout:1442: finishing write tid 3 to trial18843701-1 2026-02-13T20:17:17.243 INFO:tasks.rados.rados.0.trial188.stdout:1442: finishing write tid 4 to trial18843701-1 2026-02-13T20:17:17.243 INFO:tasks.rados.rados.0.trial188.stdout:1442: finishing write tid 5 to trial18843701-1 2026-02-13T20:17:17.243 INFO:tasks.rados.rados.0.trial188.stdout:1442: oid 1 updating version 0 to 573 2026-02-13T20:17:17.243 INFO:tasks.rados.rados.0.trial188.stdout:1442: oid 1 updating version 573 to 576 2026-02-13T20:17:17.244 INFO:tasks.rados.rados.0.trial188.stdout:1442: oid 1 version 576 is already newer than 574 2026-02-13T20:17:17.244 INFO:tasks.rados.rados.0.trial188.stdout:1442: oid 1 version 576 is already newer than 575 2026-02-13T20:17:17.244 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 1 v 576 (ObjNum 540 snap 140 seq_num 540) dirty exists 2026-02-13T20:17:17.244 INFO:tasks.rados.rados.0.trial188.stdout:1442: left oid 1 (ObjNum 540 snap 140 seq_num 540) 2026-02-13T20:17:17.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.281+0000 7fb7e0d4c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T20:17:17.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.281+0000 7fb7e0d4c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T20:17:17.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.281+0000 7fb7e0d4c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:17:17.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.281+0000 7fb7e0d4c640 1 -- 10.20.193.110:0/640352299 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb7dc058410 con 0x7fb7dc091950 2026-02-13T20:17:17.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.281+0000 7fb7c2ffd640 1 -- 10.20.193.110:0/640352299 <== mon.0 v1:10.20.193.110:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 2169760252) 0x7fb7d00167c0 con 0x7fb7dc091950 2026-02-13T20:17:17.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.281+0000 7fb7c2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T20:17:17.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.281+0000 7fb7c2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:17:17.283 INFO:teuthology.orchestra.run.trial110.stdout:{"election_epoch":22,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","modified":"2026-02-13T20:11:07.161192Z","created":"2026-02-13T20:11:07.161192Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6789","nonce":0}]},"addr":"10.20.193.110:6789/0","public_addr":"10.20.193.110:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161241+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6789","nonce":0}]},"addr":"10.20.193.188:6789/0","public_addr":"10.20.193.188:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161242+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6790","nonce":0}]},"addr":"10.20.193.110:6790/0","public_addr":"10.20.193.110:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161243+0000","crush_location":[]}]}} 2026-02-13T20:17:17.284 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.282+0000 7fb7e0d4c640 1 -- 10.20.193.110:0/640352299 >> v1:10.20.193.188:6812/1623052694 conn(0x7fb7a803fa20 legacy=0x7fb7a805fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:17.284 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.282+0000 7fb7e0d4c640 10 monclient: shutdown 2026-02-13T20:17:17.284 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.282+0000 7fb7e0d4c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:17:17.285 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.282+0000 7fb7e0d4c640 1 -- 10.20.193.110:0/640352299 >> v1:10.20.193.110:6789/0 conn(0x7fb7dc091950 legacy=0x7fb7dc117330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:17.285 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.282+0000 7fb7e0d4c640 1 -- 10.20.193.110:0/640352299 shutdown_connections 2026-02-13T20:17:17.285 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.282+0000 7fb7e0d4c640 1 -- 10.20.193.110:0/640352299 >> 10.20.193.110:0/640352299 conn(0x7fb7dc054e90 msgr2=0x7fb7dc090620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:17:17.285 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.282+0000 7fb7e0d4c640 1 -- 10.20.193.110:0/640352299 shutdown_connections 2026-02-13T20:17:17.285 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.282+0000 7fb7e0d4c640 1 -- 10.20.193.110:0/640352299 wait complete. 2026-02-13T20:17:17.291 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-13T20:17:17.291 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-13T20:17:17.292 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-13T20:17:17.292 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T20:17:17.369 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.357+0000 7fa2f1c5b640 10 monclient: get_monmap_and_config 2026-02-13T20:17:17.369 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.357+0000 7fa2f1c5b640 10 monclient: build_initial_monmap 2026-02-13T20:17:17.369 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.357+0000 7fa2f1c5b640 10 monclient: monmap: 2026-02-13T20:17:17.369 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:17:17.369 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:17.370 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:17:17.358371+0000 2026-02-13T20:17:17.370 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:17:17.358371+0000 2026-02-13T20:17:17.370 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:17:17.370 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:17.370 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:17:17.370 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:17:17.370 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:17:17.370 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:17.370 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.358+0000 7fa2f1c5b640 1 Processor -- start 2026-02-13T20:17:17.370 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.358+0000 7fa2f1c5b640 1 -- start start 2026-02-13T20:17:17.370 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.358+0000 7fa2f1c5b640 10 monclient: init 2026-02-13T20:17:17.370 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.358+0000 7fa2f1c5b640 10 monclient: _reopen_session rank -1 2026-02-13T20:17:17.371 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.358+0000 7fa2f1c5b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:17:17.371 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.358+0000 7fa2f1c5b640 10 monclient(hunting): picked mon.noname-a con 0x7fa2ec1401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:17:17.371 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.358+0000 7fa2f1c5b640 10 monclient(hunting): picked mon.noname-c con 0x7fa2ec092020 addr v1:10.20.193.188:6789/0 2026-02-13T20:17:17.371 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.358+0000 7fa2f1c5b640 10 monclient(hunting): picked mon.noname-b con 0x7fa2ec091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:17:17.371 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.358+0000 7fa2f1c5b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2ec08b730 con 0x7fa2ec1401c0 2026-02-13T20:17:17.371 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.358+0000 7fa2f1c5b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2ec05c5b0 con 0x7fa2ec092020 2026-02-13T20:17:17.371 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.358+0000 7fa2f1c5b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2ec08bcf0 con 0x7fa2ec091950 2026-02-13T20:17:17.371 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.358+0000 7fa2f1c5b640 10 monclient(hunting): _renew_subs 2026-02-13T20:17:17.371 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.358+0000 7fa2f1c5b640 10 monclient(hunting): authenticate will time out at 999.048718s 2026-02-13T20:17:17.371 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.358+0000 7fa2ebfff640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fa2ec091950 0x7fa2ec1a2a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:38566/0 (socket says 10.20.193.110:38566) 2026-02-13T20:17:17.371 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.358+0000 7fa2eb7fe640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fa2ec1401c0 0x7fa2ec091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:59444/0 (socket says 10.20.193.110:59444) 2026-02-13T20:17:17.372 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.358+0000 7fa2ebfff640 1 -- 10.20.193.110:0/1367062357 learned_addr learned my addr 10.20.193.110:0/1367062357 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:17:17.372 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.359+0000 7fa2ea7fc640 1 -- 10.20.193.110:0/1367062357 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1966753750 0 0) 0x7fa2ec08b730 con 0x7fa2ec1401c0 2026-02-13T20:17:17.372 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.359+0000 7fa2ea7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:17:17.372 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.359+0000 7fa2ea7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:17.372 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.359+0000 7fa2ea7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:17.372 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.359+0000 7fa2ea7fc640 10 monclient(hunting): my global_id is 104130 2026-02-13T20:17:17.372 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.359+0000 7fa2ea7fc640 1 -- 10.20.193.110:0/1367062357 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2d00035e0 con 0x7fa2ec1401c0 2026-02-13T20:17:17.372 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.359+0000 7fa2ea7fc640 1 -- 10.20.193.110:0/1367062357 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 83214766 0 0) 0x7fa2ec08bcf0 con 0x7fa2ec091950 2026-02-13T20:17:17.372 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.359+0000 7fa2ea7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:17:17.372 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.359+0000 7fa2ea7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:17.372 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.359+0000 7fa2ea7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:17.372 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.359+0000 7fa2ea7fc640 10 monclient(hunting): my global_id is 94229 2026-02-13T20:17:17.373 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.359+0000 7fa2ea7fc640 1 -- 10.20.193.110:0/1367062357 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2ec08b730 con 0x7fa2ec091950 2026-02-13T20:17:17.373 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.359+0000 7fa2ea7fc640 1 -- 10.20.193.110:0/1367062357 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3850980044 0 0) 0x7fa2d00035e0 con 0x7fa2ec1401c0 2026-02-13T20:17:17.373 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.359+0000 7fa2ea7fc640 1 -- 10.20.193.110:0/1367062357 >> v1:10.20.193.110:6790/0 conn(0x7fa2ec091950 legacy=0x7fa2ec1a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:17.373 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.359+0000 7fa2ea7fc640 1 -- 10.20.193.110:0/1367062357 >> v1:10.20.193.188:6789/0 conn(0x7fa2ec092020 legacy=0x7fa2ec1812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:17.373 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.359+0000 7fa2ea7fc640 10 monclient: _finish_hunting 0 2026-02-13T20:17:17.373 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.359+0000 7fa2ea7fc640 1 monclient: found mon.noname-a 2026-02-13T20:17:17.373 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.359+0000 7fa2ea7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:17:17.373 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.359+0000 7fa2ea7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:17:17.373 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.359+0000 7fa2ea7fc640 1 -- 10.20.193.110:0/1367062357 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2ec140590 con 0x7fa2ec1401c0 2026-02-13T20:17:17.373 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.359+0000 7fa2ea7fc640 10 monclient: _finish_auth 0 2026-02-13T20:17:17.373 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.359+0000 7fa2ea7fc640 10 monclient: _check_auth_tickets 2026-02-13T20:17:17.373 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.359+0000 7fa2ea7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:17:17.374 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.359+0000 7fa2ea7fc640 1 -- 10.20.193.110:0/1367062357 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa2d8002dd0 con 0x7fa2ec1401c0 2026-02-13T20:17:17.374 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.359+0000 7fa2ea7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:17.374 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.359+0000 7fa2ea7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:17:17.374 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.359+0000 7fa2ea7fc640 10 monclient: dump: 2026-02-13T20:17:17.374 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:17.374 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:17.374 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.374 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.374 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:17.374 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:17.374 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:17.374 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:17.374 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:17.375 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:17.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.359+0000 7fa2f1c5b640 5 monclient: authenticate success, global_id 104130 2026-02-13T20:17:17.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.359+0000 7fa2f1c5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:17:17.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.359+0000 7fa2ea7fc640 1 -- 10.20.193.110:0/1367062357 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa2d8003020 con 0x7fa2ec1401c0 2026-02-13T20:17:17.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.359+0000 7fa2ea7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:17:17.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.359+0000 7fa2ea7fc640 1 -- 10.20.193.110:0/1367062357 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa2d8003430 con 0x7fa2ec1401c0 2026-02-13T20:17:17.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.359+0000 7fa2ea7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:17.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.359+0000 7fa2ea7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:17:17.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.359+0000 7fa2ea7fc640 10 monclient: dump: 2026-02-13T20:17:17.375 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:17.375 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:17.376 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.376 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.376 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:17.376 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:17.376 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:17.376 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:17.376 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:17.376 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:17.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.359+0000 7fa2f1c5b640 10 monclient: get_monmap_and_config success 2026-02-13T20:17:17.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.359+0000 7fa2f1c5b640 4 set_mon_vals no callback set 2026-02-13T20:17:17.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.359+0000 7fa2f1c5b640 10 monclient: shutdown 2026-02-13T20:17:17.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.359+0000 7fa2f1c5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:17:17.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.359+0000 7fa2f1c5b640 1 -- 10.20.193.110:0/1367062357 >> v1:10.20.193.110:6789/0 conn(0x7fa2ec1401c0 legacy=0x7fa2ec091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:17.377 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.359+0000 7fa2f1c5b640 1 -- 10.20.193.110:0/1367062357 shutdown_connections 2026-02-13T20:17:17.377 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.359+0000 7fa2f1c5b640 1 -- 10.20.193.110:0/1367062357 >> 10.20.193.110:0/1367062357 conn(0x7fa2ec054e90 msgr2=0x7fa2ec058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:17:17.377 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.359+0000 7fa2f1c5b640 1 -- 10.20.193.110:0/1367062357 shutdown_connections 2026-02-13T20:17:17.377 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.359+0000 7fa2f1c5b640 1 -- 10.20.193.110:0/1367062357 wait complete. 2026-02-13T20:17:17.377 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2f1c5b640 10 monclient: build_initial_monmap 2026-02-13T20:17:17.377 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2f1c5b640 10 monclient: monmap: 2026-02-13T20:17:17.377 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:17:17.377 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:17:17.377 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:17:17.377 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:17:17.377 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:17:17.377 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:17:17.378 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:17:17.378 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:17:17.378 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:17:17.378 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:17.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2f1c5b640 1 Processor -- start 2026-02-13T20:17:17.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2f1c5b640 1 -- start start 2026-02-13T20:17:17.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2f1c5b640 10 monclient: init 2026-02-13T20:17:17.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2f1c5b640 10 monclient: _reopen_session rank -1 2026-02-13T20:17:17.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2f1c5b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:17:17.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2f1c5b640 10 monclient(hunting): picked mon.noname-a con 0x7fa2ec091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:17:17.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2f1c5b640 10 monclient(hunting): picked mon.noname-b con 0x7fa2ec1401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:17:17.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2f1c5b640 10 monclient(hunting): picked mon.noname-c con 0x7fa2ec130c30 addr v1:10.20.193.110:6790/0 2026-02-13T20:17:17.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2f1c5b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2ec132430 con 0x7fa2ec091950 2026-02-13T20:17:17.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2f1c5b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2ec089c50 con 0x7fa2ec1401c0 2026-02-13T20:17:17.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2f1c5b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2ec08a880 con 0x7fa2ec130c30 2026-02-13T20:17:17.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2f1c5b640 10 monclient(hunting): _renew_subs 2026-02-13T20:17:17.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2f1c5b640 10 monclient(hunting): authenticate will time out at 999.050476s 2026-02-13T20:17:17.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2eb7fe640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fa2ec091950 0x7fa2ec088e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:59448/0 (socket says 10.20.193.110:59448) 2026-02-13T20:17:17.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2eb7fe640 1 -- 10.20.193.110:0/307545498 learned_addr learned my addr 10.20.193.110:0/307545498 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:17:17.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2c7fff640 1 -- 10.20.193.110:0/307545498 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 72146837 0 0) 0x7fa2ec132430 con 0x7fa2ec091950 2026-02-13T20:17:17.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2c7fff640 10 monclient(hunting): _negotiate 2026-02-13T20:17:17.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2c7fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:17.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2c7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:17.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2c7fff640 10 monclient(hunting): my global_id is 104133 2026-02-13T20:17:17.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2c7fff640 1 -- 10.20.193.110:0/307545498 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2bc0035e0 con 0x7fa2ec091950 2026-02-13T20:17:17.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2c7fff640 1 -- 10.20.193.110:0/307545498 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3532749039 0 0) 0x7fa2ec08a880 con 0x7fa2ec130c30 2026-02-13T20:17:17.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2c7fff640 10 monclient(hunting): _negotiate 2026-02-13T20:17:17.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2c7fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:17.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2c7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:17.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2c7fff640 10 monclient(hunting): my global_id is 94232 2026-02-13T20:17:17.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2c7fff640 1 -- 10.20.193.110:0/307545498 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2ec132430 con 0x7fa2ec130c30 2026-02-13T20:17:17.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2c7fff640 1 -- 10.20.193.110:0/307545498 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1604304079 0 0) 0x7fa2bc0035e0 con 0x7fa2ec091950 2026-02-13T20:17:17.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2c7fff640 1 -- 10.20.193.110:0/307545498 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa2ec08a880 con 0x7fa2ec091950 2026-02-13T20:17:17.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2c7fff640 1 -- 10.20.193.110:0/307545498 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa2d8003340 con 0x7fa2ec091950 2026-02-13T20:17:17.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2c7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:17:17.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2c7fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:17:17.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2c7fff640 10 monclient(hunting): dump: 2026-02-13T20:17:17.381 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:17.381 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:17.381 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.381 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.381 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:17.381 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:17.381 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:17.381 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:17.381 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:17.381 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:17.381 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2c7fff640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:17:17.381 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2c7fff640 1 -- 10.20.193.110:0/307545498 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1436096455 0 0) 0x7fa2ec08a880 con 0x7fa2ec091950 2026-02-13T20:17:17.382 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2c7fff640 1 -- 10.20.193.110:0/307545498 >> v1:10.20.193.110:6790/0 conn(0x7fa2ec130c30 legacy=0x7fa2ec194a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:17.382 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2c7fff640 1 -- 10.20.193.110:0/307545498 >> v1:10.20.193.188:6789/0 conn(0x7fa2ec1401c0 legacy=0x7fa2ec089540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:17.382 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2c7fff640 10 monclient: _finish_hunting 0 2026-02-13T20:17:17.382 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2c7fff640 1 monclient: found mon.a 2026-02-13T20:17:17.382 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2c7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:17:17.382 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2c7fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:17:17.382 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2c7fff640 1 -- 10.20.193.110:0/307545498 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2ec131b90 con 0x7fa2ec091950 2026-02-13T20:17:17.382 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2c7fff640 10 monclient: _finish_auth 0 2026-02-13T20:17:17.382 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2c7fff640 10 monclient: _check_auth_tickets 2026-02-13T20:17:17.382 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2c7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:17:17.382 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2f1c5b640 5 monclient: authenticate success, global_id 104133 2026-02-13T20:17:17.382 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2f1c5b640 10 monclient: _renew_subs 2026-02-13T20:17:17.382 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2f1c5b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:17:17.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2f1c5b640 1 -- 10.20.193.110:0/307545498 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa2ec131e70 con 0x7fa2ec091950 2026-02-13T20:17:17.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2f1c5b640 10 monclient: _renew_subs 2026-02-13T20:17:17.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2f1c5b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:17:17.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.360+0000 7fa2f1c5b640 1 -- 10.20.193.110:0/307545498 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa2ec196120 con 0x7fa2ec091950 2026-02-13T20:17:17.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.361+0000 7fa2c7fff640 1 -- 10.20.193.110:0/307545498 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa2d8003510 con 0x7fa2ec091950 2026-02-13T20:17:17.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.361+0000 7fa2c7fff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:17:17.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.361+0000 7fa2c7fff640 1 -- 10.20.193.110:0/307545498 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa2d8004da0 con 0x7fa2ec091950 2026-02-13T20:17:17.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.361+0000 7fa2c7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:17.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.361+0000 7fa2c7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:17:17.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.361+0000 7fa2c7fff640 10 monclient: dump: 2026-02-13T20:17:17.383 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:17.383 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:17.384 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.384 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.384 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:17.384 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:17.384 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:17.384 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:17.384 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:17.384 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:17.384 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.361+0000 7fa2e9ffb640 4 set_mon_vals no callback set 2026-02-13T20:17:17.384 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.361+0000 7fa2f1c5b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:17:17.384 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.361+0000 7fa2f1c5b640 1 -- 10.20.193.110:0/307545498 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa2ec1320b0 con 0x7fa2ec092020 2026-02-13T20:17:17.384 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.361+0000 7fa2c7fff640 1 -- 10.20.193.110:0/307545498 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2205023228 0 0) 0x7fa2ec089c50 con 0x7fa2ec092020 2026-02-13T20:17:17.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.361+0000 7fa2c7fff640 10 monclient(hunting): _negotiate 2026-02-13T20:17:17.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.361+0000 7fa2c7fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:17.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.361+0000 7fa2c7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:17.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.361+0000 7fa2c7fff640 10 monclient(hunting): my global_id is 104136 2026-02-13T20:17:17.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.361+0000 7fa2c7fff640 1 -- 10.20.193.110:0/307545498 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2ec08a880 con 0x7fa2ec092020 2026-02-13T20:17:17.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.361+0000 7fa2c7fff640 1 -- 10.20.193.110:0/307545498 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fa2d8011a10 con 0x7fa2ec091950 2026-02-13T20:17:17.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.361+0000 7fa2c7fff640 1 -- 10.20.193.110:0/307545498 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(300..300 src has 1..300) ==== 3915+0+0 (unknown 3531726731 0 0) 0x7fa2d804ea80 con 0x7fa2ec091950 2026-02-13T20:17:17.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.361+0000 7fa2c7fff640 1 -- 10.20.193.110:0/307545498 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2891875287 0 0) 0x7fa2ec08a880 con 0x7fa2ec092020 2026-02-13T20:17:17.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.361+0000 7fa2c7fff640 1 -- 10.20.193.110:0/307545498 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa2ec089c50 con 0x7fa2ec092020 2026-02-13T20:17:17.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.361+0000 7fa2c7fff640 1 -- 10.20.193.110:0/307545498 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa2dc003d20 con 0x7fa2ec092020 2026-02-13T20:17:17.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.361+0000 7fa2c7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:17.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.361+0000 7fa2c7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:17:17.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.361+0000 7fa2c7fff640 10 monclient: dump: 2026-02-13T20:17:17.386 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:17.386 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:17.386 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.386 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.386 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:17.386 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:17.386 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:17.386 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:17.386 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:17.386 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:17.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.361+0000 7fa2c7fff640 1 -- 10.20.193.110:0/307545498 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1358912620 0 0) 0x7fa2ec089c50 con 0x7fa2ec092020 2026-02-13T20:17:17.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.361+0000 7fa2c7fff640 1 -- 10.20.193.110:0/307545498 --> v1:10.20.193.110:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa2ec08b450 con 0x7fa2ec092020 2026-02-13T20:17:17.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.362+0000 7fa2ebfff640 10 monclient: get_auth_request con 0x7fa2bc03f860 auth_method 0 2026-02-13T20:17:17.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.362+0000 7fa2c7fff640 1 -- 10.20.193.110:0/307545498 <== mon.0 v1:10.20.193.110:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fa2dc004280 con 0x7fa2ec092020 2026-02-13T20:17:17.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.362+0000 7fa2c7fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:17:17.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.362+0000 7fa2c7fff640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:17:17.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.362+0000 7fa2c7fff640 1 -- 10.20.193.110:0/307545498 >> v1:10.20.193.110:6789/0 conn(0x7fa2ec092020 legacy=0x7fa2ec127b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:17.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.362+0000 7fa2c7fff640 1 -- 10.20.193.110:0/307545498 >> v1:10.20.193.110:6789/0 conn(0x7fa2ec092020 legacy=0x7fa2ec127b20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:17:17.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.365+0000 7fa2f1c5b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:17:17.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.365+0000 7fa2f1c5b640 1 -- 10.20.193.110:0/307545498 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa2ec055bb0 con 0x7fa2ec128230 2026-02-13T20:17:17.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.365+0000 7fa2c7fff640 1 -- 10.20.193.110:0/307545498 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3253756502 0 0) 0x7fa2ec055bb0 con 0x7fa2ec128230 2026-02-13T20:17:17.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.365+0000 7fa2c7fff640 10 monclient(hunting): _negotiate 2026-02-13T20:17:17.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.365+0000 7fa2c7fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:17.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.365+0000 7fa2c7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:17.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.365+0000 7fa2c7fff640 10 monclient(hunting): my global_id is 104139 2026-02-13T20:17:17.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.365+0000 7fa2c7fff640 1 -- 10.20.193.110:0/307545498 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2ec089c50 con 0x7fa2ec128230 2026-02-13T20:17:17.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.365+0000 7fa2c7fff640 1 -- 10.20.193.110:0/307545498 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3708014572 0 0) 0x7fa2ec089c50 con 0x7fa2ec128230 2026-02-13T20:17:17.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.365+0000 7fa2c7fff640 1 -- 10.20.193.110:0/307545498 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa2ec055bb0 con 0x7fa2ec128230 2026-02-13T20:17:17.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.365+0000 7fa2c7fff640 1 -- 10.20.193.110:0/307545498 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa2dc002b20 con 0x7fa2ec128230 2026-02-13T20:17:17.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.365+0000 7fa2c7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:17.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.365+0000 7fa2c7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:17:17.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.365+0000 7fa2c7fff640 10 monclient: dump: 2026-02-13T20:17:17.388 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:17.388 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:17.388 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.388 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.388 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:17.388 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:17.389 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:17.389 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:17.389 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:17.389 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:17.389 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.365+0000 7fa2c7fff640 1 -- 10.20.193.110:0/307545498 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1489620658 0 0) 0x7fa2ec055bb0 con 0x7fa2ec128230 2026-02-13T20:17:17.389 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.365+0000 7fa2c7fff640 1 -- 10.20.193.110:0/307545498 --> v1:10.20.193.110:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa2ec058410 con 0x7fa2ec128230 2026-02-13T20:17:17.389 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.365+0000 7fa2c7fff640 1 -- 10.20.193.110:0/307545498 <== mon.0 v1:10.20.193.110:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4345 (unknown 0 0 3443020936) 0x7fa2dc004700 con 0x7fa2ec128230 2026-02-13T20:17:17.389 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.365+0000 7fa2c7fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:17:17.389 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.365+0000 7fa2c7fff640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:17:17.389 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.365+0000 7fa2c7fff640 1 -- 10.20.193.110:0/307545498 >> v1:10.20.193.110:6789/0 conn(0x7fa2ec128230 legacy=0x7fa2ec197480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:17.389 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.365+0000 7fa2c7fff640 1 -- 10.20.193.110:0/307545498 >> v1:10.20.193.110:6789/0 conn(0x7fa2ec128230 legacy=0x7fa2ec197480 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:17:17.390 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:17:17.390 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:17:17.390 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:17:17.390 INFO:teuthology.orchestra.run.trial110.stdout: "state": "peon", 2026-02-13T20:17:17.390 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 22, 2026-02-13T20:17:17.390 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 2006, 2026-02-13T20:17:17.390 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:17:17.390 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:17:17.391 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:17:17.391 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:17:17.391 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:17:17.391 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 1, 2026-02-13T20:17:17.391 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:17:17.391 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:17:17.391 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:17:17.391 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:17:17.391 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:17:17.391 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:17:17.391 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:17:17.392 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:17:17.392 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:17:17.392 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:17:17.392 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:17:17.392 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:17:17.392 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:17:17.392 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:17:17.392 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:17:17.392 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:17:17.392 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:17:17.392 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:17:17.392 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:17:17.392 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:17:17.393 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:17:17.393 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:17:17.393 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:17:17.393 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:17:17.393 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:17:17.393 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:17:17.393 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:17:17.393 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:17:17.393 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:17:17.393 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:17:17.393 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:17:17.393 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:17:17.393 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:17:17.393 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:17.394 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:17:17.394 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:17:17.394 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:17:17.394 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:17:17.394 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:17:17.394 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:17:17.394 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:17:17.394 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:17:17.394 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:17:17.394 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:17:17.394 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:17:17.394 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:17:17.394 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:17:17.394 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:17:17.395 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:17:17.395 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:17:17.395 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:17:17.395 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:17:17.395 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:17:17.395 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:17:17.395 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:17:17.395 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:17:17.395 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:17:17.395 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:17:17.395 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:17:17.395 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:17:17.395 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:17:17.395 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:17:17.396 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:17:17.396 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:17:17.396 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:17:17.396 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:17:17.396 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:17.396 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:17:17.396 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:17.396 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:17:17.396 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:17:17.396 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:17:17.396 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:17:17.396 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:17.396 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:17:17.396 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:17:17.396 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:17:17.397 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:17.397 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:17:17.397 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:17.397 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:17:17.397 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:17:17.397 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:17:17.397 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:17:17.397 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:17:17.397 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:17:17.397 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:17.397 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:17.397 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:17:17.397 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:17:17.397 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:17:17.397 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:17:17.397 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:17.398 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:17:17.398 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:17:17.398 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:17:17.398 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:17.398 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:17:17.398 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:17.398 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:17:17.398 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:17:17.398 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:17:17.398 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:17:17.398 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:17:17.398 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:17:17.398 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:17.398 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:17.398 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:17:17.398 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:17:17.399 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:17:17.399 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:17:17.399 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:17.399 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:17:17.399 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:17:17.399 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:17:17.399 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:17.399 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:17:17.399 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:17.399 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:17:17.399 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:17:17.399 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:17:17.399 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:17:17.399 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:17:17.399 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:17:17.399 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:17.400 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:17:17.400 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:17.400 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:17:17.400 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:17:17.400 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:17.400 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:17:17.400 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:17:17.400 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:17:17.400 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:17.400 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:17:17.400 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:17:17.400 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:17.400 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:17:17.400 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:17:17.400 INFO:teuthology.orchestra.run.trial110.stdout: "num": 2 2026-02-13T20:17:17.400 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:17.400 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:17:17.401 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:17.401 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:17:17.401 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:17:17.402 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.365+0000 7fa2f1c5b640 1 -- 10.20.193.110:0/307545498 >> v1:10.20.193.188:6812/1623052694 conn(0x7fa2bc03f860 legacy=0x7fa2bc05fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:17.402 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.365+0000 7fa2f1c5b640 10 monclient: shutdown 2026-02-13T20:17:17.402 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.365+0000 7fa2f1c5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:17:17.402 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.365+0000 7fa2f1c5b640 1 -- 10.20.193.110:0/307545498 >> v1:10.20.193.110:6789/0 conn(0x7fa2ec091950 legacy=0x7fa2ec088e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:17.402 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.365+0000 7fa2ebfff640 1 -- 10.20.193.110:0/307545498 reap_dead start 2026-02-13T20:17:17.402 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.365+0000 7fa2ebfff640 1 -- 10.20.193.110:0/307545498 reap_dead start 2026-02-13T20:17:17.402 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.365+0000 7fa2f1c5b640 1 -- 10.20.193.110:0/307545498 shutdown_connections 2026-02-13T20:17:17.402 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.365+0000 7fa2f1c5b640 1 -- 10.20.193.110:0/307545498 >> 10.20.193.110:0/307545498 conn(0x7fa2ec054e90 msgr2=0x7fa2ec08dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:17:17.402 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.365+0000 7fa2f1c5b640 1 -- 10.20.193.110:0/307545498 shutdown_connections 2026-02-13T20:17:17.402 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.366+0000 7fa2f1c5b640 1 -- 10.20.193.110:0/307545498 wait complete. 2026-02-13T20:17:17.403 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:17:17.403 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-13T20:17:17.403 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T20:17:17.468 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.468+0000 7f872f81b640 10 monclient: get_monmap_and_config 2026-02-13T20:17:17.468 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.468+0000 7f872f81b640 10 monclient: build_initial_monmap 2026-02-13T20:17:17.469 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.468+0000 7f872f81b640 10 monclient: monmap: 2026-02-13T20:17:17.469 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:17:17.469 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:17.469 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:17:17.468572+0000 2026-02-13T20:17:17.469 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:17:17.468572+0000 2026-02-13T20:17:17.469 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:17:17.469 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:17.469 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:17:17.469 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:17:17.469 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:17:17.469 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:17.478 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.468+0000 7f872f81b640 1 Processor -- start 2026-02-13T20:17:17.478 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.468+0000 7f872f81b640 1 -- start start 2026-02-13T20:17:17.478 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.468+0000 7f872f81b640 10 monclient: init 2026-02-13T20:17:17.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.468+0000 7f872f81b640 10 monclient: _reopen_session rank -1 2026-02-13T20:17:17.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.468+0000 7f872f81b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:17:17.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.468+0000 7f872f81b640 10 monclient(hunting): picked mon.noname-c con 0x7f87281401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:17:17.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.468+0000 7f872f81b640 10 monclient(hunting): picked mon.noname-b con 0x7f8728092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:17:17.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.468+0000 7f872f81b640 10 monclient(hunting): picked mon.noname-a con 0x7f8728091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:17:17.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.468+0000 7f872f81b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f872808b730 con 0x7f8728091950 2026-02-13T20:17:17.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.468+0000 7f872f81b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f872805c5b0 con 0x7f87281401c0 2026-02-13T20:17:17.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.468+0000 7f872f81b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f872808bcf0 con 0x7f8728092020 2026-02-13T20:17:17.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.468+0000 7f872f81b640 10 monclient(hunting): _renew_subs 2026-02-13T20:17:17.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.468+0000 7f872f81b640 10 monclient(hunting): authenticate will time out at 999.158880s 2026-02-13T20:17:17.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.468+0000 7f872cd8f640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f8728092020 0x7f87281812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:38578/0 (socket says 10.20.193.110:38578) 2026-02-13T20:17:17.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.468+0000 7f872cd8f640 1 -- 10.20.193.110:0/4118895541 learned_addr learned my addr 10.20.193.110:0/4118895541 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:17:17.480 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.468+0000 7f872dd91640 1 --1- 10.20.193.110:0/4118895541 >> v1:10.20.193.110:6789/0 conn(0x7f8728091950 0x7f87281a2a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:59462/0 (socket says 10.20.193.110:59462) 2026-02-13T20:17:17.480 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.469+0000 7f8717fff640 1 -- 10.20.193.110:0/4118895541 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2511437082 0 0) 0x7f872808bcf0 con 0x7f8728092020 2026-02-13T20:17:17.480 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.469+0000 7f8717fff640 10 monclient(hunting): _negotiate 2026-02-13T20:17:17.480 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.469+0000 7f8717fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:17.480 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.469+0000 7f8717fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:17.480 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.469+0000 7f8717fff640 10 monclient(hunting): my global_id is 94235 2026-02-13T20:17:17.480 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.469+0000 7f8717fff640 1 -- 10.20.193.110:0/4118895541 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87100035e0 con 0x7f8728092020 2026-02-13T20:17:17.480 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.469+0000 7f8717fff640 1 -- 10.20.193.110:0/4118895541 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 319832871 0 0) 0x7f872808b730 con 0x7f8728091950 2026-02-13T20:17:17.480 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.469+0000 7f8717fff640 10 monclient(hunting): _negotiate 2026-02-13T20:17:17.480 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.469+0000 7f8717fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:17.480 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.469+0000 7f8717fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:17.480 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.469+0000 7f8717fff640 10 monclient(hunting): my global_id is 104142 2026-02-13T20:17:17.480 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.469+0000 7f8717fff640 1 -- 10.20.193.110:0/4118895541 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f872808bcf0 con 0x7f8728091950 2026-02-13T20:17:17.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.469+0000 7f8717fff640 1 -- 10.20.193.110:0/4118895541 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1221463976 0 0) 0x7f872808bcf0 con 0x7f8728091950 2026-02-13T20:17:17.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.469+0000 7f8717fff640 1 -- 10.20.193.110:0/4118895541 >> v1:10.20.193.110:6790/0 conn(0x7f8728092020 legacy=0x7f87281812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:17.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.469+0000 7f8717fff640 1 -- 10.20.193.110:0/4118895541 >> v1:10.20.193.188:6789/0 conn(0x7f87281401c0 legacy=0x7f8728091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T20:17:17.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.469+0000 7f8717fff640 10 monclient: _finish_hunting 0 2026-02-13T20:17:17.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.469+0000 7f8717fff640 1 monclient: found mon.noname-a 2026-02-13T20:17:17.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.469+0000 7f8717fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:17:17.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.469+0000 7f8717fff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:17:17.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.469+0000 7f8717fff640 1 -- 10.20.193.110:0/4118895541 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8728140590 con 0x7f8728091950 2026-02-13T20:17:17.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.469+0000 7f8717fff640 10 monclient: _finish_auth 0 2026-02-13T20:17:17.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.469+0000 7f8717fff640 10 monclient: _check_auth_tickets 2026-02-13T20:17:17.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.469+0000 7f8717fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:17:17.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.469+0000 7f8717fff640 1 -- 10.20.193.110:0/4118895541 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f8724003e30 con 0x7f8728091950 2026-02-13T20:17:17.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.469+0000 7f8717fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:17.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.469+0000 7f8717fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:17:17.482 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.469+0000 7f8717fff640 10 monclient: dump: 2026-02-13T20:17:17.482 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:17.482 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:17.482 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.482 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.482 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:17.482 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:17.482 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:17.482 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:17.482 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:17.482 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:17.482 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.469+0000 7f872f81b640 5 monclient: authenticate success, global_id 104142 2026-02-13T20:17:17.482 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.469+0000 7f872f81b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:17:17.483 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.469+0000 7f8717fff640 1 -- 10.20.193.110:0/4118895541 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8724004040 con 0x7f8728091950 2026-02-13T20:17:17.483 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.469+0000 7f8717fff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:17:17.483 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.469+0000 7f8717fff640 1 -- 10.20.193.110:0/4118895541 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f8724004450 con 0x7f8728091950 2026-02-13T20:17:17.483 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.469+0000 7f8717fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:17.483 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.469+0000 7f8717fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:17:17.483 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.469+0000 7f8717fff640 10 monclient: dump: 2026-02-13T20:17:17.483 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:17.483 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:17.483 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.483 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.483 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:17.483 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:17.483 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:17.483 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:17.484 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:17.484 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:17.484 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.469+0000 7f872f81b640 10 monclient: get_monmap_and_config success 2026-02-13T20:17:17.484 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.469+0000 7f872f81b640 4 set_mon_vals no callback set 2026-02-13T20:17:17.484 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.469+0000 7f872f81b640 10 monclient: shutdown 2026-02-13T20:17:17.484 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.469+0000 7f872f81b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:17:17.484 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.469+0000 7f872f81b640 1 -- 10.20.193.110:0/4118895541 >> v1:10.20.193.110:6789/0 conn(0x7f8728091950 legacy=0x7f87281a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:17.484 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.469+0000 7f872f81b640 1 -- 10.20.193.110:0/4118895541 shutdown_connections 2026-02-13T20:17:17.484 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.469+0000 7f872f81b640 1 -- 10.20.193.110:0/4118895541 >> 10.20.193.110:0/4118895541 conn(0x7f8728054e90 msgr2=0x7f8728058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:17:17.484 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.469+0000 7f872f81b640 1 -- 10.20.193.110:0/4118895541 shutdown_connections 2026-02-13T20:17:17.484 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.469+0000 7f872f81b640 1 -- 10.20.193.110:0/4118895541 wait complete. 2026-02-13T20:17:17.484 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.470+0000 7f872f81b640 10 monclient: build_initial_monmap 2026-02-13T20:17:17.484 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.470+0000 7f872f81b640 10 monclient: monmap: 2026-02-13T20:17:17.485 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:17:17.485 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:17:17.485 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:17:17.485 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:17:17.485 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:17:17.485 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:17:17.485 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:17:17.485 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:17:17.485 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:17:17.485 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:17.485 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.470+0000 7f872f81b640 1 Processor -- start 2026-02-13T20:17:17.485 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.470+0000 7f872f81b640 1 -- start start 2026-02-13T20:17:17.485 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.470+0000 7f872f81b640 10 monclient: init 2026-02-13T20:17:17.486 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.470+0000 7f872f81b640 10 monclient: _reopen_session rank -1 2026-02-13T20:17:17.486 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.470+0000 7f872f81b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:17:17.486 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.470+0000 7f872f81b640 10 monclient(hunting): picked mon.noname-b con 0x7f8728091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:17:17.486 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.470+0000 7f872f81b640 10 monclient(hunting): picked mon.noname-a con 0x7f87281401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:17:17.486 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.470+0000 7f872f81b640 10 monclient(hunting): picked mon.noname-c con 0x7f87281a2740 addr v1:10.20.193.110:6790/0 2026-02-13T20:17:17.486 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.470+0000 7f872f81b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f872808c1c0 con 0x7f87281401c0 2026-02-13T20:17:17.486 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.470+0000 7f872f81b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f872812f530 con 0x7f8728091950 2026-02-13T20:17:17.486 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.470+0000 7f872f81b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8728090da0 con 0x7f87281a2740 2026-02-13T20:17:17.486 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.470+0000 7f872f81b640 10 monclient(hunting): _renew_subs 2026-02-13T20:17:17.486 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.470+0000 7f872f81b640 10 monclient(hunting): authenticate will time out at 999.160775s 2026-02-13T20:17:17.486 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.470+0000 7f872cd8f640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f87281401c0 0x7f87281a1020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:59474/0 (socket says 10.20.193.110:59474) 2026-02-13T20:17:17.486 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.470+0000 7f872cd8f640 1 -- 10.20.193.110:0/596413821 learned_addr learned my addr 10.20.193.110:0/596413821 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:17:17.486 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.470+0000 7f8715ffb640 1 -- 10.20.193.110:0/596413821 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1624588216 0 0) 0x7f872808c1c0 con 0x7f87281401c0 2026-02-13T20:17:17.486 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.470+0000 7f8715ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:17:17.487 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.470+0000 7f8715ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:17.487 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.470+0000 7f8715ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:17.487 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.470+0000 7f8715ffb640 10 monclient(hunting): my global_id is 104145 2026-02-13T20:17:17.487 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.470+0000 7f8715ffb640 1 -- 10.20.193.110:0/596413821 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86f80035e0 con 0x7f87281401c0 2026-02-13T20:17:17.487 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f8715ffb640 1 -- 10.20.193.110:0/596413821 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 330199997 0 0) 0x7f8728090da0 con 0x7f87281a2740 2026-02-13T20:17:17.487 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f8715ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:17:17.487 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f8715ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:17.487 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f8715ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:17.487 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f8715ffb640 10 monclient(hunting): my global_id is 94238 2026-02-13T20:17:17.487 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f8715ffb640 1 -- 10.20.193.110:0/596413821 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f872808c1c0 con 0x7f87281a2740 2026-02-13T20:17:17.487 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f8715ffb640 1 -- 10.20.193.110:0/596413821 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3701618591 0 0) 0x7f86f80035e0 con 0x7f87281401c0 2026-02-13T20:17:17.487 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f8715ffb640 1 -- 10.20.193.110:0/596413821 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8728090da0 con 0x7f87281401c0 2026-02-13T20:17:17.487 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f8715ffb640 1 -- 10.20.193.110:0/596413821 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f871c0031f0 con 0x7f87281401c0 2026-02-13T20:17:17.488 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f8715ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:17:17.488 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f8715ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:17:17.488 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f8715ffb640 10 monclient(hunting): dump: 2026-02-13T20:17:17.488 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:17.488 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:17.488 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.488 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.488 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:17.488 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:17.488 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:17.488 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:17.488 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:17.488 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:17.488 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f8715ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:17:17.489 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f8715ffb640 1 -- 10.20.193.110:0/596413821 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2499769670 0 0) 0x7f872808c1c0 con 0x7f87281a2740 2026-02-13T20:17:17.489 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f8715ffb640 1 -- 10.20.193.110:0/596413821 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f86f80035e0 con 0x7f87281a2740 2026-02-13T20:17:17.489 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f8715ffb640 1 -- 10.20.193.110:0/596413821 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f87240041b0 con 0x7f87281a2740 2026-02-13T20:17:17.489 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f8715ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:17:17.489 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f8715ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:17:17.489 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f8715ffb640 10 monclient(hunting): dump: 2026-02-13T20:17:17.489 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:17.489 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:17.489 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.489 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.489 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:17.489 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:17.489 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:17.489 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:17.490 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:17.490 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:17.490 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f8715ffb640 1 -- 10.20.193.110:0/596413821 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2140490127 0 0) 0x7f872812f530 con 0x7f8728091950 2026-02-13T20:17:17.490 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f8715ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:17:17.490 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f8715ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:17.490 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f8715ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:17.490 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f8715ffb640 10 monclient(hunting): my global_id is 4672 2026-02-13T20:17:17.490 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f8715ffb640 1 -- 10.20.193.110:0/596413821 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f872808c1c0 con 0x7f8728091950 2026-02-13T20:17:17.490 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f8715ffb640 1 -- 10.20.193.110:0/596413821 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3165823593 0 0) 0x7f8728090da0 con 0x7f87281401c0 2026-02-13T20:17:17.490 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f8715ffb640 1 -- 10.20.193.110:0/596413821 >> v1:10.20.193.110:6790/0 conn(0x7f87281a2740 legacy=0x7f87281a2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:17.490 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f8715ffb640 1 -- 10.20.193.110:0/596413821 >> v1:10.20.193.188:6789/0 conn(0x7f8728091950 legacy=0x7f8728116a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:17.490 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f8715ffb640 10 monclient: _finish_hunting 0 2026-02-13T20:17:17.490 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f8715ffb640 1 monclient: found mon.a 2026-02-13T20:17:17.490 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f8715ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:17:17.491 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f8715ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:17:17.491 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f8715ffb640 1 -- 10.20.193.110:0/596413821 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f872805d320 con 0x7f87281401c0 2026-02-13T20:17:17.491 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f8715ffb640 10 monclient: _finish_auth 0 2026-02-13T20:17:17.491 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f8715ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:17:17.491 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f8715ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:17:17.491 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f872f81b640 5 monclient: authenticate success, global_id 104145 2026-02-13T20:17:17.491 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f872f81b640 10 monclient: _renew_subs 2026-02-13T20:17:17.491 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f872f81b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:17:17.491 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f872f81b640 1 -- 10.20.193.110:0/596413821 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f872808a7e0 con 0x7f87281401c0 2026-02-13T20:17:17.491 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f872f81b640 10 monclient: _renew_subs 2026-02-13T20:17:17.491 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f872f81b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:17:17.491 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f872f81b640 1 -- 10.20.193.110:0/596413821 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f872812f250 con 0x7f87281401c0 2026-02-13T20:17:17.491 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f8715ffb640 1 -- 10.20.193.110:0/596413821 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f871c003450 con 0x7f87281401c0 2026-02-13T20:17:17.492 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f8715ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T20:17:17.492 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f8715ffb640 1 -- 10.20.193.110:0/596413821 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f871c004d00 con 0x7f87281401c0 2026-02-13T20:17:17.492 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f8715ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:17.492 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f8715ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:17:17.492 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f8715ffb640 10 monclient: dump: 2026-02-13T20:17:17.492 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:17.492 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:17.492 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.492 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.492 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:17.492 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:17.492 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:17.492 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:17.492 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:17.493 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:17.493 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f87177fe640 4 set_mon_vals no callback set 2026-02-13T20:17:17.493 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f872f81b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:17:17.493 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f872f81b640 1 -- 10.20.193.110:0/596413821 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f87280008d0 con 0x7f8728092020 2026-02-13T20:17:17.493 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.471+0000 7f8715ffb640 1 -- 10.20.193.110:0/596413821 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f871c011970 con 0x7f87281401c0 2026-02-13T20:17:17.493 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.472+0000 7f8715ffb640 1 -- 10.20.193.110:0/596413821 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(300..300 src has 1..300) ==== 3915+0+0 (unknown 3531726731 0 0) 0x7f871c04e8b0 con 0x7f87281401c0 2026-02-13T20:17:17.493 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.472+0000 7f8715ffb640 1 -- 10.20.193.110:0/596413821 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2260484230 0 0) 0x7f87280008d0 con 0x7f8728092020 2026-02-13T20:17:17.493 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.472+0000 7f8715ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:17:17.493 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.472+0000 7f8715ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:17.493 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.472+0000 7f8715ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:17.493 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.472+0000 7f8715ffb640 10 monclient(hunting): my global_id is 94241 2026-02-13T20:17:17.493 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.472+0000 7f8715ffb640 1 -- 10.20.193.110:0/596413821 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8728090da0 con 0x7f8728092020 2026-02-13T20:17:17.493 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.472+0000 7f872dd91640 10 monclient: get_auth_request con 0x7f86f803fc80 auth_method 0 2026-02-13T20:17:17.493 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.472+0000 7f8715ffb640 1 -- 10.20.193.110:0/596413821 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3543484026 0 0) 0x7f8728090da0 con 0x7f8728092020 2026-02-13T20:17:17.494 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.472+0000 7f8715ffb640 1 -- 10.20.193.110:0/596413821 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f87280008d0 con 0x7f8728092020 2026-02-13T20:17:17.494 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.472+0000 7f8715ffb640 1 -- 10.20.193.110:0/596413821 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f8718002c50 con 0x7f8728092020 2026-02-13T20:17:17.494 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.472+0000 7f8715ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:17.494 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.472+0000 7f8715ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:17:17.494 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.472+0000 7f8715ffb640 10 monclient: dump: 2026-02-13T20:17:17.494 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:17.494 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:17.494 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.494 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.494 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:17.494 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:17.494 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:17.494 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:17.494 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:17.494 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:17.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.472+0000 7f8715ffb640 1 -- 10.20.193.110:0/596413821 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1298879415 0 0) 0x7f87280008d0 con 0x7f8728092020 2026-02-13T20:17:17.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.472+0000 7f8715ffb640 1 -- 10.20.193.110:0/596413821 --> v1:10.20.193.110:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8728125f00 con 0x7f8728092020 2026-02-13T20:17:17.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.472+0000 7f8715ffb640 1 -- 10.20.193.110:0/596413821 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f87180031d0 con 0x7f8728092020 2026-02-13T20:17:17.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.472+0000 7f8715ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:17:17.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.472+0000 7f8715ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:17:17.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.472+0000 7f8715ffb640 1 -- 10.20.193.110:0/596413821 >> v1:10.20.193.110:6790/0 conn(0x7f8728092020 legacy=0x7f87281a32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:17.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.472+0000 7f8715ffb640 1 -- 10.20.193.110:0/596413821 >> v1:10.20.193.110:6790/0 conn(0x7f8728092020 legacy=0x7f87281a32f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:17:17.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.476+0000 7f872f81b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:17:17.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.476+0000 7f872f81b640 1 -- 10.20.193.110:0/596413821 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f87281165a0 con 0x7f87281a3a00 2026-02-13T20:17:17.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.476+0000 7f8715ffb640 1 -- 10.20.193.110:0/596413821 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3431545486 0 0) 0x7f87281165a0 con 0x7f87281a3a00 2026-02-13T20:17:17.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.476+0000 7f8715ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:17:17.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.476+0000 7f8715ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:17.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.476+0000 7f8715ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:17.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.476+0000 7f8715ffb640 10 monclient(hunting): my global_id is 94244 2026-02-13T20:17:17.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.476+0000 7f8715ffb640 1 -- 10.20.193.110:0/596413821 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87280008d0 con 0x7f87281a3a00 2026-02-13T20:17:17.496 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.476+0000 7f8715ffb640 1 -- 10.20.193.110:0/596413821 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2009079944 0 0) 0x7f87280008d0 con 0x7f87281a3a00 2026-02-13T20:17:17.496 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.476+0000 7f8715ffb640 1 -- 10.20.193.110:0/596413821 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f87281165a0 con 0x7f87281a3a00 2026-02-13T20:17:17.496 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.476+0000 7f8715ffb640 1 -- 10.20.193.110:0/596413821 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f8718003a40 con 0x7f87281a3a00 2026-02-13T20:17:17.496 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.476+0000 7f8715ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:17.496 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.476+0000 7f8715ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:17:17.496 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.476+0000 7f8715ffb640 10 monclient: dump: 2026-02-13T20:17:17.496 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:17.496 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:17.496 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.496 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.496 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:17.496 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:17.496 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:17.496 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:17.496 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:17.496 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:17.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.476+0000 7f8715ffb640 1 -- 10.20.193.110:0/596413821 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 960473980 0 0) 0x7f87281165a0 con 0x7f87281a3a00 2026-02-13T20:17:17.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.476+0000 7f8715ffb640 1 -- 10.20.193.110:0/596413821 --> v1:10.20.193.110:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f872808b450 con 0x7f87281a3a00 2026-02-13T20:17:17.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.476+0000 7f8715ffb640 1 -- 10.20.193.110:0/596413821 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4514 (unknown 0 0 3796429920) 0x7f8718003e70 con 0x7f87281a3a00 2026-02-13T20:17:17.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.476+0000 7f8715ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:17:17.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.476+0000 7f8715ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:17:17.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.476+0000 7f8715ffb640 1 -- 10.20.193.110:0/596413821 >> v1:10.20.193.110:6790/0 conn(0x7f87281a3a00 legacy=0x7f8728132a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:17.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.476+0000 7f8715ffb640 1 -- 10.20.193.110:0/596413821 >> v1:10.20.193.110:6790/0 conn(0x7f87281a3a00 legacy=0x7f8728132a80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:17:17.497 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:17:17.497 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:17:17.498 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:17:17.498 INFO:teuthology.orchestra.run.trial110.stdout: "state": "peon", 2026-02-13T20:17:17.498 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 22, 2026-02-13T20:17:17.498 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 109099, 2026-02-13T20:17:17.498 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:17:17.498 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:17:17.498 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:17:17.498 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:17:17.498 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:17:17.498 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 2, 2026-02-13T20:17:17.498 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:17:17.498 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:17:17.498 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:17:17.498 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:17:17.498 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:17:17.499 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:17:17.499 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:17:17.499 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:17:17.499 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:17:17.499 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:17:17.499 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:17:17.499 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:17:17.499 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:17:17.499 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:17:17.499 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:17:17.499 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:17:17.499 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:17:17.499 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:17:17.499 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:17:17.499 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:17:17.499 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:17:17.500 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:17:17.500 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:17:17.500 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:17:17.500 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:17:17.500 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:17:17.500 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:17:17.500 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:17:17.500 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:17:17.500 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:17:17.500 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:17:17.500 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:17:17.500 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:17:17.500 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:17.500 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:17:17.500 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:17:17.500 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:17:17.500 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:17:17.501 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:17:17.501 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:17:17.501 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:17:17.501 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:17:17.501 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:17:17.501 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:17:17.501 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:17:17.501 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:17:17.501 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:17:17.501 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:17:17.501 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:17:17.501 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:17:17.501 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:17:17.501 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:17:17.501 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:17:17.501 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:17:17.501 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:17:17.502 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:17:17.502 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:17:17.502 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:17:17.502 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:17:17.502 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:17:17.502 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:17:17.502 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:17:17.502 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:17:17.502 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:17:17.502 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:17:17.502 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:17:17.502 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:17.502 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:17:17.502 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:17.502 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:17:17.502 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:17:17.502 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:17:17.502 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:17:17.502 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:17.503 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:17:17.503 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:17:17.503 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:17:17.503 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:17.503 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:17:17.503 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:17.503 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:17:17.503 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:17:17.503 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:17:17.503 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:17:17.503 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:17:17.503 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:17:17.503 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:17.503 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:17.503 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:17:17.503 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:17:17.503 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:17:17.503 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:17:17.504 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:17.504 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:17:17.504 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:17:17.504 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:17:17.504 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:17.504 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:17:17.504 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:17.504 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:17:17.504 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:17:17.504 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:17:17.504 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:17:17.504 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:17:17.504 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:17:17.504 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:17.504 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:17.504 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:17:17.504 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:17:17.504 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:17:17.505 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:17:17.505 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:17.505 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:17:17.505 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:17:17.505 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:17:17.505 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:17.505 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:17:17.505 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:17.505 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:17:17.505 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:17:17.505 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:17:17.505 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:17:17.505 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:17:17.505 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:17:17.505 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:17.505 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:17:17.505 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:17.505 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:17:17.505 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:17:17.506 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:17.506 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:17:17.506 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:17:17.506 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:17:17.506 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:17.506 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:17:17.506 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:17:17.506 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:17.506 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:17:17.506 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:17:17.506 INFO:teuthology.orchestra.run.trial110.stdout: "num": 2 2026-02-13T20:17:17.506 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:17.506 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:17:17.506 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:17:17.506 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:17.506 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:17:17.506 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:17:17.506 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:17:17.506 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:17.506 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:17:17.507 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:17.507 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:17:17.507 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:17:17.508 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.477+0000 7f872f81b640 1 -- 10.20.193.110:0/596413821 >> v1:10.20.193.188:6812/1623052694 conn(0x7f86f803fc80 legacy=0x7f86f8060130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:17.508 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.477+0000 7f872f81b640 10 monclient: shutdown 2026-02-13T20:17:17.508 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.477+0000 7f872f81b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:17:17.508 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.477+0000 7f872f81b640 1 -- 10.20.193.110:0/596413821 >> v1:10.20.193.110:6789/0 conn(0x7f87281401c0 legacy=0x7f87281a1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:17.508 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.477+0000 7f872dd91640 1 -- 10.20.193.110:0/596413821 reap_dead start 2026-02-13T20:17:17.508 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.477+0000 7f872f81b640 1 -- 10.20.193.110:0/596413821 shutdown_connections 2026-02-13T20:17:17.508 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.477+0000 7f872f81b640 1 -- 10.20.193.110:0/596413821 >> 10.20.193.110:0/596413821 conn(0x7f8728054e90 msgr2=0x7f872808dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:17:17.508 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.477+0000 7f872f81b640 1 -- 10.20.193.110:0/596413821 shutdown_connections 2026-02-13T20:17:17.508 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.477+0000 7f872f81b640 1 -- 10.20.193.110:0/596413821 wait complete. 2026-02-13T20:17:17.508 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:17:17.509 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-13T20:17:17.509 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T20:17:17.573 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.573+0000 7f74f4f0c640 10 monclient: get_monmap_and_config 2026-02-13T20:17:17.573 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.573+0000 7f74f4f0c640 10 monclient: build_initial_monmap 2026-02-13T20:17:17.573 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.573+0000 7f74f4f0c640 10 monclient: monmap: 2026-02-13T20:17:17.573 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:17:17.573 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:17.573 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:17:17.573504+0000 2026-02-13T20:17:17.573 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:17:17.573504+0000 2026-02-13T20:17:17.573 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:17:17.574 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:17.574 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:17:17.574 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:17:17.574 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:17:17.574 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:17.574 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.573+0000 7f74f4f0c640 1 Processor -- start 2026-02-13T20:17:17.574 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.573+0000 7f74f4f0c640 1 -- start start 2026-02-13T20:17:17.574 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.573+0000 7f74f4f0c640 10 monclient: init 2026-02-13T20:17:17.574 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.574+0000 7f74f4f0c640 10 monclient: _reopen_session rank -1 2026-02-13T20:17:17.574 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.574+0000 7f74f4f0c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:17:17.574 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.574+0000 7f74f4f0c640 10 monclient(hunting): picked mon.noname-c con 0x7f74f005c540 addr v1:10.20.193.188:6789/0 2026-02-13T20:17:17.574 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.574+0000 7f74f4f0c640 10 monclient(hunting): picked mon.noname-b con 0x7f74f005d050 addr v1:10.20.193.110:6790/0 2026-02-13T20:17:17.574 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.574+0000 7f74f4f0c640 10 monclient(hunting): picked mon.noname-a con 0x7f74f0142430 addr v1:10.20.193.110:6789/0 2026-02-13T20:17:17.574 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.574+0000 7f74f4f0c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74f008f370 con 0x7f74f0142430 2026-02-13T20:17:17.575 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.574+0000 7f74f4f0c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74f008f540 con 0x7f74f005c540 2026-02-13T20:17:17.575 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.574+0000 7f74f4f0c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74f00905e0 con 0x7f74f005d050 2026-02-13T20:17:17.575 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.574+0000 7f74f4f0c640 10 monclient(hunting): _renew_subs 2026-02-13T20:17:17.575 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.574+0000 7f74f4f0c640 10 monclient(hunting): authenticate will time out at 999.264080s 2026-02-13T20:17:17.575 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.574+0000 7f74edd74640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f74f005d050 0x7f74f0183540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:38612/0 (socket says 10.20.193.110:38612) 2026-02-13T20:17:17.575 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.574+0000 7f74edd74640 1 -- 10.20.193.110:0/1885752722 learned_addr learned my addr 10.20.193.110:0/1885752722 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:17:17.575 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.574+0000 7f74ed573640 1 -- 10.20.193.110:0/1885752722 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4200778703 0 0) 0x7f74f00905e0 con 0x7f74f005d050 2026-02-13T20:17:17.575 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.574+0000 7f74ed573640 10 monclient(hunting): _negotiate 2026-02-13T20:17:17.575 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.574+0000 7f74ed573640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:17.575 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.574+0000 7f74ed573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:17.575 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.574+0000 7f74ed573640 10 monclient(hunting): my global_id is 94247 2026-02-13T20:17:17.575 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.574+0000 7f74ed573640 1 -- 10.20.193.110:0/1885752722 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74dc0035e0 con 0x7f74f005d050 2026-02-13T20:17:17.577 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.574+0000 7f74ed573640 1 -- 10.20.193.110:0/1885752722 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3555408637 0 0) 0x7f74f008f370 con 0x7f74f0142430 2026-02-13T20:17:17.577 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.574+0000 7f74ed573640 10 monclient(hunting): _negotiate 2026-02-13T20:17:17.577 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.574+0000 7f74ed573640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:17.577 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.574+0000 7f74ed573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:17.577 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.574+0000 7f74ed573640 10 monclient(hunting): my global_id is 104148 2026-02-13T20:17:17.577 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.574+0000 7f74ed573640 1 -- 10.20.193.110:0/1885752722 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74f00905e0 con 0x7f74f0142430 2026-02-13T20:17:17.577 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.574+0000 7f74ed573640 1 -- 10.20.193.110:0/1885752722 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4073407531 0 0) 0x7f74f00905e0 con 0x7f74f0142430 2026-02-13T20:17:17.577 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.574+0000 7f74ed573640 1 -- 10.20.193.110:0/1885752722 >> v1:10.20.193.110:6790/0 conn(0x7f74f005d050 legacy=0x7f74f0183540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:17.577 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.574+0000 7f74ed573640 1 -- 10.20.193.110:0/1885752722 >> v1:10.20.193.188:6789/0 conn(0x7f74f005c540 legacy=0x7f74f005c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:17.577 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.574+0000 7f74ed573640 10 monclient: _finish_hunting 0 2026-02-13T20:17:17.577 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.574+0000 7f74ed573640 1 monclient: found mon.noname-a 2026-02-13T20:17:17.577 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.574+0000 7f74ed573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:17:17.577 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.574+0000 7f74ed573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:17:17.577 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.574+0000 7f74ed573640 1 -- 10.20.193.110:0/1885752722 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74f0142850 con 0x7f74f0142430 2026-02-13T20:17:17.577 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.574+0000 7f74ed573640 10 monclient: _finish_auth 0 2026-02-13T20:17:17.577 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.574+0000 7f74ed573640 10 monclient: _check_auth_tickets 2026-02-13T20:17:17.577 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.574+0000 7f74ed573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:17:17.577 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.574+0000 7f74ed573640 1 -- 10.20.193.110:0/1885752722 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f74e0003eb0 con 0x7f74f0142430 2026-02-13T20:17:17.577 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.574+0000 7f74f4f0c640 5 monclient: authenticate success, global_id 104148 2026-02-13T20:17:17.578 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.574+0000 7f74f4f0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:17:17.578 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.574+0000 7f74ed573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:17.578 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.574+0000 7f74ed573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:17:17.578 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.574+0000 7f74ed573640 10 monclient: dump: 2026-02-13T20:17:17.578 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:17.578 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:17.578 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.578 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.578 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:17.578 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:17.578 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:17.578 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:17.578 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:17.578 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:17.578 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.574+0000 7f74f4f0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:17:17.578 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.574+0000 7f74ed573640 1 -- 10.20.193.110:0/1885752722 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f74e00040c0 con 0x7f74f0142430 2026-02-13T20:17:17.578 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.574+0000 7f74ed573640 10 monclient: handle_config config(0 keys) 2026-02-13T20:17:17.578 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.574+0000 7f74f4f0c640 10 monclient: get_monmap_and_config success 2026-02-13T20:17:17.578 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.574+0000 7f74f4f0c640 4 set_mon_vals no callback set 2026-02-13T20:17:17.578 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.574+0000 7f74ed573640 1 -- 10.20.193.110:0/1885752722 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f74e00044d0 con 0x7f74f0142430 2026-02-13T20:17:17.578 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.574+0000 7f74ed573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:17.578 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.574+0000 7f74ed573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:17:17.578 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.574+0000 7f74ed573640 10 monclient: dump: 2026-02-13T20:17:17.578 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:17.578 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:17.578 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.578 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.578 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:17.578 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:17.578 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:17.578 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:17.578 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:17.578 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:17.578 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.575+0000 7f74f4f0c640 10 monclient: shutdown 2026-02-13T20:17:17.578 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.575+0000 7f74f4f0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:17:17.578 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.575+0000 7f74f4f0c640 1 -- 10.20.193.110:0/1885752722 >> v1:10.20.193.110:6789/0 conn(0x7f74f0142430 legacy=0x7f74f01a4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:17.578 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.575+0000 7f74f4f0c640 1 -- 10.20.193.110:0/1885752722 shutdown_connections 2026-02-13T20:17:17.578 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.575+0000 7f74f4f0c640 1 -- 10.20.193.110:0/1885752722 >> 10.20.193.110:0/1885752722 conn(0x7f74f0093270 msgr2=0x7f74f0054330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:17:17.579 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.575+0000 7f74f4f0c640 1 -- 10.20.193.110:0/1885752722 shutdown_connections 2026-02-13T20:17:17.579 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.575+0000 7f74f4f0c640 1 -- 10.20.193.110:0/1885752722 wait complete. 2026-02-13T20:17:17.579 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.575+0000 7f74f4f0c640 10 monclient: build_initial_monmap 2026-02-13T20:17:17.579 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.575+0000 7f74f4f0c640 10 monclient: monmap: 2026-02-13T20:17:17.579 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:17:17.579 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:17:17.579 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:17:17.579 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:17:17.579 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:17:17.579 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:17:17.579 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:17:17.579 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:17:17.579 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:17:17.579 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:17.579 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.575+0000 7f74f4f0c640 1 Processor -- start 2026-02-13T20:17:17.579 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.575+0000 7f74f4f0c640 1 -- start start 2026-02-13T20:17:17.579 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.575+0000 7f74f4f0c640 10 monclient: init 2026-02-13T20:17:17.579 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.575+0000 7f74f4f0c640 10 monclient: _reopen_session rank -1 2026-02-13T20:17:17.579 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.575+0000 7f74f4f0c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:17:17.579 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.575+0000 7f74f4f0c640 10 monclient(hunting): picked mon.noname-c con 0x7f74f005c540 addr v1:10.20.193.110:6790/0 2026-02-13T20:17:17.579 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.575+0000 7f74f4f0c640 10 monclient(hunting): picked mon.noname-b con 0x7f74f005d050 addr v1:10.20.193.188:6789/0 2026-02-13T20:17:17.579 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74f4f0c640 10 monclient(hunting): picked mon.noname-a con 0x7f74f0142430 addr v1:10.20.193.110:6789/0 2026-02-13T20:17:17.579 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74f4f0c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74f005d590 con 0x7f74f0142430 2026-02-13T20:17:17.579 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74f4f0c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74f0130bc0 con 0x7f74f005d050 2026-02-13T20:17:17.579 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74f4f0c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74f012fba0 con 0x7f74f005c540 2026-02-13T20:17:17.579 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74f4f0c640 10 monclient(hunting): _renew_subs 2026-02-13T20:17:17.579 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74f4f0c640 10 monclient(hunting): authenticate will time out at 999.266020s 2026-02-13T20:17:17.579 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74ee575640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f74f005c540 0x7f74f0140730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:38616/0 (socket says 10.20.193.110:38616) 2026-02-13T20:17:17.579 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74ee575640 1 -- 10.20.193.110:0/1188286446 learned_addr learned my addr 10.20.193.110:0/1188286446 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:17:17.579 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74d6ffd640 1 -- 10.20.193.110:0/1188286446 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3333399995 0 0) 0x7f74f005d590 con 0x7f74f0142430 2026-02-13T20:17:17.579 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74d6ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:17:17.579 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74d6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:17.579 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74d6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:17.579 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74d6ffd640 10 monclient(hunting): my global_id is 104151 2026-02-13T20:17:17.579 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74d6ffd640 1 -- 10.20.193.110:0/1188286446 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74bc0035e0 con 0x7f74f0142430 2026-02-13T20:17:17.579 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74d6ffd640 1 -- 10.20.193.110:0/1188286446 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2460581678 0 0) 0x7f74f012fba0 con 0x7f74f005c540 2026-02-13T20:17:17.579 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74d6ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:17:17.579 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74d6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:17.579 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74d6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:17.580 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74d6ffd640 10 monclient(hunting): my global_id is 94250 2026-02-13T20:17:17.580 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74d6ffd640 1 -- 10.20.193.110:0/1188286446 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74f005d590 con 0x7f74f005c540 2026-02-13T20:17:17.580 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74d6ffd640 1 -- 10.20.193.110:0/1188286446 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 363057799 0 0) 0x7f74bc0035e0 con 0x7f74f0142430 2026-02-13T20:17:17.580 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74d6ffd640 1 -- 10.20.193.110:0/1188286446 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f74f012fba0 con 0x7f74f0142430 2026-02-13T20:17:17.580 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74d6ffd640 1 -- 10.20.193.110:0/1188286446 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f74e00043e0 con 0x7f74f0142430 2026-02-13T20:17:17.580 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74d6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:17:17.580 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74d6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:17:17.580 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74d6ffd640 10 monclient(hunting): dump: 2026-02-13T20:17:17.580 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:17.580 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:17.580 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.580 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.580 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:17.580 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:17.580 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:17.580 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:17.580 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:17.580 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:17.580 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74d6ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:17:17.580 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74d6ffd640 1 -- 10.20.193.110:0/1188286446 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 799015448 0 0) 0x7f74f005d590 con 0x7f74f005c540 2026-02-13T20:17:17.580 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74d6ffd640 1 -- 10.20.193.110:0/1188286446 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f74bc0035e0 con 0x7f74f005c540 2026-02-13T20:17:17.580 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74d6ffd640 1 -- 10.20.193.110:0/1188286446 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f74e4003170 con 0x7f74f005c540 2026-02-13T20:17:17.580 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74d6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:17:17.580 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74d6ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:17:17.580 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74d6ffd640 10 monclient(hunting): dump: 2026-02-13T20:17:17.580 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:17.580 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:17.580 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.580 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.580 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:17.580 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:17.580 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:17.580 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:17.580 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:17.580 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:17.580 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74d6ffd640 1 -- 10.20.193.110:0/1188286446 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1553668771 0 0) 0x7f74f012fba0 con 0x7f74f0142430 2026-02-13T20:17:17.580 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74d6ffd640 1 -- 10.20.193.110:0/1188286446 >> v1:10.20.193.110:6790/0 conn(0x7f74f005c540 legacy=0x7f74f0140730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:17.580 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74d6ffd640 1 -- 10.20.193.110:0/1188286446 >> v1:10.20.193.188:6789/0 conn(0x7f74f005d050 legacy=0x7f74f0193810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:17.581 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74d6ffd640 10 monclient: _finish_hunting 0 2026-02-13T20:17:17.581 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74d6ffd640 1 monclient: found mon.a 2026-02-13T20:17:17.581 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74d6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:17:17.581 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74d6ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:17:17.581 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74d6ffd640 1 -- 10.20.193.110:0/1188286446 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74f0131f00 con 0x7f74f0142430 2026-02-13T20:17:17.581 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74d6ffd640 10 monclient: _finish_auth 0 2026-02-13T20:17:17.581 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74d6ffd640 10 monclient: _check_auth_tickets 2026-02-13T20:17:17.581 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74d6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:17:17.581 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74f4f0c640 5 monclient: authenticate success, global_id 104151 2026-02-13T20:17:17.581 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74f4f0c640 10 monclient: _renew_subs 2026-02-13T20:17:17.581 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74f4f0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:17:17.581 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74f4f0c640 1 -- 10.20.193.110:0/1188286446 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f74f0130700 con 0x7f74f0142430 2026-02-13T20:17:17.581 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74f4f0c640 10 monclient: _renew_subs 2026-02-13T20:17:17.581 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74f4f0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:17:17.581 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74f4f0c640 1 -- 10.20.193.110:0/1188286446 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f74f0140fe0 con 0x7f74f0142430 2026-02-13T20:17:17.581 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74d6ffd640 1 -- 10.20.193.110:0/1188286446 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f74e0003990 con 0x7f74f0142430 2026-02-13T20:17:17.581 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74d6ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:17:17.581 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74d6ffd640 1 -- 10.20.193.110:0/1188286446 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f74e0004bf0 con 0x7f74f0142430 2026-02-13T20:17:17.581 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:17.581 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74d6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:17:17.581 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74d6ffd640 10 monclient: dump: 2026-02-13T20:17:17.581 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:17.581 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:17.581 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.581 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.581 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:17.581 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:17.581 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:17.581 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:17.581 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:17.581 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:17.581 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74ecd72640 4 set_mon_vals no callback set 2026-02-13T20:17:17.581 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74f4f0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:17:17.581 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.576+0000 7f74f4f0c640 1 -- 10.20.193.110:0/1188286446 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f74f0091630 con 0x7f74f01a65a0 2026-02-13T20:17:17.581 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.577+0000 7f74d6ffd640 1 -- 10.20.193.110:0/1188286446 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f74e0011860 con 0x7f74f0142430 2026-02-13T20:17:17.582 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.577+0000 7f74d6ffd640 1 -- 10.20.193.110:0/1188286446 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(300..300 src has 1..300) ==== 3915+0+0 (unknown 3531726731 0 0) 0x7f74e004e7e0 con 0x7f74f0142430 2026-02-13T20:17:17.582 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.577+0000 7f74edd74640 10 monclient: get_auth_request con 0x7f74bc03fae0 auth_method 0 2026-02-13T20:17:17.582 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.577+0000 7f74d6ffd640 1 -- 10.20.193.110:0/1188286446 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2082747016 0 0) 0x7f74f0091630 con 0x7f74f01a65a0 2026-02-13T20:17:17.582 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.577+0000 7f74d6ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:17:17.582 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.577+0000 7f74d6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:17.582 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.577+0000 7f74d6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:17.583 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.577+0000 7f74d6ffd640 10 monclient(hunting): my global_id is 4681 2026-02-13T20:17:17.583 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.577+0000 7f74d6ffd640 1 -- 10.20.193.110:0/1188286446 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74f012fba0 con 0x7f74f01a65a0 2026-02-13T20:17:17.583 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.577+0000 7f74d6ffd640 1 -- 10.20.193.110:0/1188286446 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 176996480 0 0) 0x7f74f012fba0 con 0x7f74f01a65a0 2026-02-13T20:17:17.583 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.577+0000 7f74d6ffd640 1 -- 10.20.193.110:0/1188286446 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f74f0091630 con 0x7f74f01a65a0 2026-02-13T20:17:17.583 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.577+0000 7f74d6ffd640 1 -- 10.20.193.110:0/1188286446 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f74e4003880 con 0x7f74f01a65a0 2026-02-13T20:17:17.583 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.577+0000 7f74d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:17.583 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.577+0000 7f74d6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:17:17.583 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.577+0000 7f74d6ffd640 10 monclient: dump: 2026-02-13T20:17:17.583 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:17.583 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:17.583 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.583 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.583 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:17.583 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:17.583 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:17.583 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:17.583 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:17.583 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:17.583 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.577+0000 7f74d6ffd640 1 -- 10.20.193.110:0/1188286446 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1092240457 0 0) 0x7f74f0091630 con 0x7f74f01a65a0 2026-02-13T20:17:17.583 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.577+0000 7f74d6ffd640 1 -- 10.20.193.110:0/1188286446 --> v1:10.20.193.188:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f74f0092810 con 0x7f74f01a65a0 2026-02-13T20:17:17.583 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.578+0000 7f74d6ffd640 1 -- 10.20.193.110:0/1188286446 <== mon.1 v1:10.20.193.188:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f74e4005880 con 0x7f74f01a65a0 2026-02-13T20:17:17.583 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.578+0000 7f74d6ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:17:17.583 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.578+0000 7f74d6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:17:17.583 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.578+0000 7f74d6ffd640 1 -- 10.20.193.110:0/1188286446 >> v1:10.20.193.188:6789/0 conn(0x7f74f01a65a0 legacy=0x7f74f0129d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:17.583 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.578+0000 7f74d6ffd640 1 -- 10.20.193.110:0/1188286446 >> v1:10.20.193.188:6789/0 conn(0x7f74f01a65a0 legacy=0x7f74f0129d90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:17:17.583 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.581+0000 7f74f4f0c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:17:17.583 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.581+0000 7f74f4f0c640 1 -- 10.20.193.110:0/1188286446 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f74f012f560 con 0x7f74f012f190 2026-02-13T20:17:17.583 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.582+0000 7f74d6ffd640 1 -- 10.20.193.110:0/1188286446 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1374554239 0 0) 0x7f74f012f560 con 0x7f74f012f190 2026-02-13T20:17:17.583 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.582+0000 7f74d6ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:17:17.583 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.582+0000 7f74d6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:17.583 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.582+0000 7f74d6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:17.583 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.582+0000 7f74d6ffd640 10 monclient(hunting): my global_id is 4684 2026-02-13T20:17:17.583 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.582+0000 7f74d6ffd640 1 -- 10.20.193.110:0/1188286446 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74f0091630 con 0x7f74f012f190 2026-02-13T20:17:17.583 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.582+0000 7f74d6ffd640 1 -- 10.20.193.110:0/1188286446 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1303786490 0 0) 0x7f74f0091630 con 0x7f74f012f190 2026-02-13T20:17:17.583 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.582+0000 7f74d6ffd640 1 -- 10.20.193.110:0/1188286446 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f74f012f560 con 0x7f74f012f190 2026-02-13T20:17:17.583 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.582+0000 7f74d6ffd640 1 -- 10.20.193.110:0/1188286446 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f74e4004080 con 0x7f74f012f190 2026-02-13T20:17:17.583 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.582+0000 7f74d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:17.584 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.582+0000 7f74d6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:17:17.584 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.582+0000 7f74d6ffd640 10 monclient: dump: 2026-02-13T20:17:17.584 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:17.584 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:17.584 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.584 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.584 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:17.584 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:17.584 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:17.584 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:17.584 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:17.584 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:17.584 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.582+0000 7f74d6ffd640 1 -- 10.20.193.110:0/1188286446 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 825029181 0 0) 0x7f74f012f560 con 0x7f74f012f190 2026-02-13T20:17:17.584 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.582+0000 7f74d6ffd640 1 -- 10.20.193.110:0/1188286446 --> v1:10.20.193.188:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f74f0055bb0 con 0x7f74f012f190 2026-02-13T20:17:17.584 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.582+0000 7f74d6ffd640 1 -- 10.20.193.110:0/1188286446 <== mon.1 v1:10.20.193.188:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4683 (unknown 0 0 3506539653) 0x7f74e4004500 con 0x7f74f012f190 2026-02-13T20:17:17.584 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.582+0000 7f74d6ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:17:17.584 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.582+0000 7f74d6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:17:17.584 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.582+0000 7f74d6ffd640 1 -- 10.20.193.110:0/1188286446 >> v1:10.20.193.188:6789/0 conn(0x7f74f012f190 legacy=0x7f74f012a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:17.584 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.582+0000 7f74d6ffd640 1 -- 10.20.193.110:0/1188286446 >> v1:10.20.193.188:6789/0 conn(0x7f74f012f190 legacy=0x7f74f012a4a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:17:17.585 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:17:17.585 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:17:17.585 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:17:17.585 INFO:teuthology.orchestra.run.trial110.stdout: "state": "leader", 2026-02-13T20:17:17.585 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 22, 2026-02-13T20:17:17.585 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 359728, 2026-02-13T20:17:17.585 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:17:17.585 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:17:17.585 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:17:17.585 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:17:17.585 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:17:17.585 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 2, 2026-02-13T20:17:17.585 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:17:17.585 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:17:17.585 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:17:17.585 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:17:17.585 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:17:17.585 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:17:17.585 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:17:17.585 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:17:17.585 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:17:17.585 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:17:17.585 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:17:17.585 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:17:17.585 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:17:17.585 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:17:17.585 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:17:17.585 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:17:17.585 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:17:17.585 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:17:17.585 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:17:17.585 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:17:17.585 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:17:17.585 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:17:17.585 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:17:17.585 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:17:17.586 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:17:17.586 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:17:17.586 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:17:17.586 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:17:17.586 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:17:17.586 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:17:17.586 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:17:17.586 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:17:17.586 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:17:17.586 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:17.586 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:17:17.586 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:17:17.586 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:17:17.586 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:17:17.586 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:17:17.586 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:17:17.586 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:17:17.586 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:17:17.586 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:17:17.586 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:17:17.586 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:17:17.586 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:17:17.586 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:17:17.586 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:17:17.586 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:17:17.586 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:17:17.586 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:17:17.586 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:17:17.586 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:17:17.586 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:17:17.586 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:17:17.586 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:17:17.586 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:17:17.586 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:17:17.586 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:17:17.586 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:17:17.586 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:17:17.586 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:17:17.586 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:17:17.586 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:17:17.586 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:17:17.586 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:17:17.586 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:17.587 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:17:17.587 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:17.587 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:17:17.587 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:17:17.587 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:17:17.587 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:17:17.587 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:17.587 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:17:17.587 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:17:17.587 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:17:17.587 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:17.587 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:17:17.587 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:17.587 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:17:17.587 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:17:17.587 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:17:17.587 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:17:17.587 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:17:17.587 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:17:17.587 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:17.587 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:17.587 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:17:17.587 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:17:17.587 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:17:17.587 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:17:17.587 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:17.587 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:17:17.587 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:17:17.587 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:17:17.587 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:17.587 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:17:17.587 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:17.587 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:17:17.587 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:17:17.587 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:17:17.587 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:17:17.587 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:17:17.587 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:17:17.587 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:17.587 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:17.587 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:17:17.587 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:17:17.587 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:17:17.587 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:17:17.587 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:17.587 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:17:17.588 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:17:17.588 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:17:17.588 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:17.588 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:17:17.588 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:17.588 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:17:17.588 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:17:17.588 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:17:17.588 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:17:17.588 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:17:17.588 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:17:17.588 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:17.588 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:17:17.588 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:17.588 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:17:17.588 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:17:17.588 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:17.588 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:17:17.588 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:17:17.588 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:17:17.588 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:17.588 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:17:17.588 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:17:17.588 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:17.588 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:17:17.588 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:17:17.588 INFO:teuthology.orchestra.run.trial110.stdout: "num": 4 2026-02-13T20:17:17.588 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:17.588 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:17:17.588 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:17:17.588 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:17.588 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:17:17.588 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:17:17.588 INFO:teuthology.orchestra.run.trial110.stdout: "num": 6 2026-02-13T20:17:17.588 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:17.588 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:17:17.588 INFO:teuthology.orchestra.run.trial110.stdout: "mgr": [ 2026-02-13T20:17:17.588 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:17.588 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:17:17.588 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:17:17.588 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:17:17.588 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:17.588 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:17:17.588 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:17.589 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:17:17.589 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:17:17.589 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.583+0000 7f74f4f0c640 1 -- 10.20.193.110:0/1188286446 >> v1:10.20.193.188:6812/1623052694 conn(0x7f74bc03fae0 legacy=0x7f74bc05ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:17.589 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.583+0000 7f74f4f0c640 10 monclient: shutdown 2026-02-13T20:17:17.589 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.583+0000 7f74f4f0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:17:17.589 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.583+0000 7f74f4f0c640 1 -- 10.20.193.110:0/1188286446 >> v1:10.20.193.110:6789/0 conn(0x7f74f0142430 legacy=0x7f74f0194f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:17.589 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.583+0000 7f74eed76640 1 -- 10.20.193.110:0/1188286446 reap_dead start 2026-02-13T20:17:17.589 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.583+0000 7f74eed76640 1 -- 10.20.193.110:0/1188286446 reap_dead start 2026-02-13T20:17:17.589 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.583+0000 7f74f4f0c640 1 -- 10.20.193.110:0/1188286446 shutdown_connections 2026-02-13T20:17:17.589 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.583+0000 7f74f4f0c640 1 -- 10.20.193.110:0/1188286446 >> 10.20.193.110:0/1188286446 conn(0x7f74f0093270 msgr2=0x7f74f0093ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:17:17.589 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.583+0000 7f74f4f0c640 1 -- 10.20.193.110:0/1188286446 shutdown_connections 2026-02-13T20:17:17.589 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.583+0000 7f74f4f0c640 1 -- 10.20.193.110:0/1188286446 wait complete. 2026-02-13T20:17:17.589 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:17:17.590 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2026-02-13T20:17:17.590 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['b'] 2026-02-13T20:17:17.590 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2026-02-13T20:17:17.590 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a store 2026-02-13T20:17:17.590 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a sync_force --yes-i-really-mean-it 2026-02-13T20:17:17.662 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.654+0000 7f6e59ccc640 10 monclient: get_monmap_and_config 2026-02-13T20:17:17.662 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.654+0000 7f6e59ccc640 10 monclient: build_initial_monmap 2026-02-13T20:17:17.662 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.654+0000 7f6e59ccc640 10 monclient: monmap: 2026-02-13T20:17:17.662 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:17:17.662 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:17.662 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:17:17.655216+0000 2026-02-13T20:17:17.662 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:17:17.655216+0000 2026-02-13T20:17:17.662 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:17:17.662 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:17.662 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:17:17.662 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:17:17.662 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:17:17.663 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:17.663 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.655+0000 7f6e59ccc640 1 Processor -- start 2026-02-13T20:17:17.663 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.655+0000 7f6e59ccc640 1 -- start start 2026-02-13T20:17:17.663 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.655+0000 7f6e59ccc640 10 monclient: init 2026-02-13T20:17:17.663 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.655+0000 7f6e59ccc640 10 monclient: _reopen_session rank -1 2026-02-13T20:17:17.663 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.655+0000 7f6e59ccc640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:17:17.663 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.655+0000 7f6e59ccc640 10 monclient(hunting): picked mon.noname-c con 0x7f6e541401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:17:17.663 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.655+0000 7f6e59ccc640 10 monclient(hunting): picked mon.noname-b con 0x7f6e54092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:17:17.663 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.655+0000 7f6e59ccc640 10 monclient(hunting): picked mon.noname-a con 0x7f6e54091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:17:17.663 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.655+0000 7f6e59ccc640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e5408b730 con 0x7f6e54091950 2026-02-13T20:17:17.663 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.655+0000 7f6e59ccc640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e5405c5b0 con 0x7f6e541401c0 2026-02-13T20:17:17.663 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.655+0000 7f6e59ccc640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e5408bcf0 con 0x7f6e54092020 2026-02-13T20:17:17.663 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.655+0000 7f6e59ccc640 10 monclient(hunting): _renew_subs 2026-02-13T20:17:17.663 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.655+0000 7f6e59ccc640 10 monclient(hunting): authenticate will time out at 999.345538s 2026-02-13T20:17:17.663 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.655+0000 7f6e52ffd640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f6e54092020 0x7f6e541812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:38620/0 (socket says 10.20.193.110:38620) 2026-02-13T20:17:17.663 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.655+0000 7f6e52ffd640 1 -- 10.20.193.110:0/965989274 learned_addr learned my addr 10.20.193.110:0/965989274 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:17:17.663 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.655+0000 7f6e527fc640 1 -- 10.20.193.110:0/965989274 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1575666003 0 0) 0x7f6e5408b730 con 0x7f6e54091950 2026-02-13T20:17:17.664 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.655+0000 7f6e527fc640 10 monclient(hunting): _negotiate 2026-02-13T20:17:17.664 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.655+0000 7f6e527fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:17.664 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.655+0000 7f6e527fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:17.664 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.655+0000 7f6e527fc640 10 monclient(hunting): my global_id is 104154 2026-02-13T20:17:17.664 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.655+0000 7f6e527fc640 1 -- 10.20.193.110:0/965989274 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e380035e0 con 0x7f6e54091950 2026-02-13T20:17:17.664 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.655+0000 7f6e527fc640 1 -- 10.20.193.110:0/965989274 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 910646018 0 0) 0x7f6e5408bcf0 con 0x7f6e54092020 2026-02-13T20:17:17.664 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.655+0000 7f6e527fc640 10 monclient(hunting): _negotiate 2026-02-13T20:17:17.664 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.655+0000 7f6e527fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:17.664 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.655+0000 7f6e527fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:17.664 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.655+0000 7f6e527fc640 10 monclient(hunting): my global_id is 94253 2026-02-13T20:17:17.664 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.655+0000 7f6e527fc640 1 -- 10.20.193.110:0/965989274 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e5408b730 con 0x7f6e54092020 2026-02-13T20:17:17.664 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.655+0000 7f6e527fc640 1 -- 10.20.193.110:0/965989274 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1204738464 0 0) 0x7f6e380035e0 con 0x7f6e54091950 2026-02-13T20:17:17.664 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.656+0000 7f6e527fc640 1 -- 10.20.193.110:0/965989274 >> v1:10.20.193.110:6790/0 conn(0x7f6e54092020 legacy=0x7f6e541812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:17.664 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.656+0000 7f6e527fc640 1 -- 10.20.193.110:0/965989274 >> v1:10.20.193.188:6789/0 conn(0x7f6e541401c0 legacy=0x7f6e54091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:17.664 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.656+0000 7f6e527fc640 10 monclient: _finish_hunting 0 2026-02-13T20:17:17.664 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.656+0000 7f6e527fc640 1 monclient: found mon.noname-a 2026-02-13T20:17:17.664 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.656+0000 7f6e527fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:17:17.664 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.656+0000 7f6e527fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:17:17.664 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.656+0000 7f6e527fc640 1 -- 10.20.193.110:0/965989274 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e54140590 con 0x7f6e54091950 2026-02-13T20:17:17.664 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.656+0000 7f6e527fc640 10 monclient: _finish_auth 0 2026-02-13T20:17:17.664 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.656+0000 7f6e527fc640 10 monclient: _check_auth_tickets 2026-02-13T20:17:17.664 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.656+0000 7f6e527fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:17:17.665 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.656+0000 7f6e527fc640 1 -- 10.20.193.110:0/965989274 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f6e48003eb0 con 0x7f6e54091950 2026-02-13T20:17:17.665 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.656+0000 7f6e527fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:17.665 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.656+0000 7f6e527fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:17:17.665 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.656+0000 7f6e527fc640 10 monclient: dump: 2026-02-13T20:17:17.665 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:17.665 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:17.665 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.665 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.665 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:17.665 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:17.665 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:17.665 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:17.665 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:17.665 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:17.665 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.656+0000 7f6e59ccc640 5 monclient: authenticate success, global_id 104154 2026-02-13T20:17:17.665 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.656+0000 7f6e59ccc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:17:17.665 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.656+0000 7f6e527fc640 1 -- 10.20.193.110:0/965989274 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6e48004100 con 0x7f6e54091950 2026-02-13T20:17:17.665 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.656+0000 7f6e527fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:17:17.665 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.656+0000 7f6e527fc640 1 -- 10.20.193.110:0/965989274 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f6e48004510 con 0x7f6e54091950 2026-02-13T20:17:17.665 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.656+0000 7f6e527fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:17.666 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.656+0000 7f6e527fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:17:17.666 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.656+0000 7f6e527fc640 10 monclient: dump: 2026-02-13T20:17:17.666 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:17.666 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:17.666 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.666 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.666 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:17.666 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:17.666 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:17.666 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:17.666 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:17.666 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:17.666 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.656+0000 7f6e59ccc640 10 monclient: get_monmap_and_config success 2026-02-13T20:17:17.666 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.656+0000 7f6e59ccc640 4 set_mon_vals no callback set 2026-02-13T20:17:17.666 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.656+0000 7f6e59ccc640 10 monclient: shutdown 2026-02-13T20:17:17.666 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.656+0000 7f6e59ccc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:17:17.666 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.656+0000 7f6e59ccc640 1 -- 10.20.193.110:0/965989274 >> v1:10.20.193.110:6789/0 conn(0x7f6e54091950 legacy=0x7f6e541a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:17.666 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.656+0000 7f6e59ccc640 1 -- 10.20.193.110:0/965989274 shutdown_connections 2026-02-13T20:17:17.666 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.656+0000 7f6e59ccc640 1 -- 10.20.193.110:0/965989274 >> 10.20.193.110:0/965989274 conn(0x7f6e54054e90 msgr2=0x7f6e54058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:17:17.666 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.656+0000 7f6e59ccc640 1 -- 10.20.193.110:0/965989274 shutdown_connections 2026-02-13T20:17:17.666 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.656+0000 7f6e59ccc640 1 -- 10.20.193.110:0/965989274 wait complete. 2026-02-13T20:17:17.666 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.656+0000 7f6e59ccc640 10 monclient: build_initial_monmap 2026-02-13T20:17:17.667 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.656+0000 7f6e59ccc640 10 monclient: monmap: 2026-02-13T20:17:17.667 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:17:17.667 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:17:17.667 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:17:17.667 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:17:17.667 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:17:17.667 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:17:17.667 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:17:17.667 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:17:17.667 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:17:17.667 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:17.667 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.656+0000 7f6e59ccc640 1 Processor -- start 2026-02-13T20:17:17.667 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.656+0000 7f6e59ccc640 1 -- start start 2026-02-13T20:17:17.667 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.656+0000 7f6e59ccc640 10 monclient: init 2026-02-13T20:17:17.667 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e59ccc640 10 monclient: _reopen_session rank -1 2026-02-13T20:17:17.667 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e59ccc640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:17:17.667 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e59ccc640 10 monclient(hunting): picked mon.noname-c con 0x7f6e54091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:17:17.667 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e59ccc640 10 monclient(hunting): picked mon.noname-b con 0x7f6e541401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:17:17.667 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e59ccc640 10 monclient(hunting): picked mon.noname-a con 0x7f6e541527c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:17:17.667 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e59ccc640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e5405d320 con 0x7f6e541527c0 2026-02-13T20:17:17.667 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e59ccc640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e5408c500 con 0x7f6e541401c0 2026-02-13T20:17:17.667 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e59ccc640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e5412fbe0 con 0x7f6e54091950 2026-02-13T20:17:17.667 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e59ccc640 10 monclient(hunting): _renew_subs 2026-02-13T20:17:17.667 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e59ccc640 10 monclient(hunting): authenticate will time out at 999.347243s 2026-02-13T20:17:17.668 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e537fe640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f6e54091950 0x7f6e5413e500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:38632/0 (socket says 10.20.193.110:38632) 2026-02-13T20:17:17.668 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e53fff640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f6e541527c0 0x7f6e54195220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:59508/0 (socket says 10.20.193.110:59508) 2026-02-13T20:17:17.668 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e537fe640 1 -- 10.20.193.110:0/2279903966 learned_addr learned my addr 10.20.193.110:0/2279903966 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:17:17.668 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e2ffff640 1 -- 10.20.193.110:0/2279903966 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2215766290 0 0) 0x7f6e5405d320 con 0x7f6e541527c0 2026-02-13T20:17:17.668 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e2ffff640 10 monclient(hunting): _negotiate 2026-02-13T20:17:17.668 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e2ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:17.668 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e2ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:17.668 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e2ffff640 10 monclient(hunting): my global_id is 104157 2026-02-13T20:17:17.668 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e2ffff640 1 -- 10.20.193.110:0/2279903966 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e240035e0 con 0x7f6e541527c0 2026-02-13T20:17:17.668 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e2ffff640 1 -- 10.20.193.110:0/2279903966 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2957632986 0 0) 0x7f6e5412fbe0 con 0x7f6e54091950 2026-02-13T20:17:17.668 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e2ffff640 10 monclient(hunting): _negotiate 2026-02-13T20:17:17.668 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e2ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:17.668 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e2ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:17.668 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e2ffff640 10 monclient(hunting): my global_id is 94256 2026-02-13T20:17:17.668 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e2ffff640 1 -- 10.20.193.110:0/2279903966 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e5405d320 con 0x7f6e54091950 2026-02-13T20:17:17.668 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e2ffff640 1 -- 10.20.193.110:0/2279903966 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 786476740 0 0) 0x7f6e240035e0 con 0x7f6e541527c0 2026-02-13T20:17:17.668 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e2ffff640 1 -- 10.20.193.110:0/2279903966 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6e5412fbe0 con 0x7f6e541527c0 2026-02-13T20:17:17.668 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e2ffff640 1 -- 10.20.193.110:0/2279903966 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f6e48004420 con 0x7f6e541527c0 2026-02-13T20:17:17.668 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e2ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:17:17.668 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e2ffff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:17:17.668 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e2ffff640 10 monclient(hunting): dump: 2026-02-13T20:17:17.668 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:17.669 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:17.669 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.669 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.669 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:17.669 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:17.669 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:17.669 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:17.669 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:17.669 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:17.669 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e2ffff640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:17:17.669 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e2ffff640 1 -- 10.20.193.110:0/2279903966 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2745205516 0 0) 0x7f6e5408c500 con 0x7f6e541401c0 2026-02-13T20:17:17.669 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e2ffff640 10 monclient(hunting): _negotiate 2026-02-13T20:17:17.669 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e2ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:17.669 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e2ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:17.669 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e2ffff640 10 monclient(hunting): my global_id is 4690 2026-02-13T20:17:17.669 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e2ffff640 1 -- 10.20.193.110:0/2279903966 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e240035e0 con 0x7f6e541401c0 2026-02-13T20:17:17.669 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e2ffff640 1 -- 10.20.193.110:0/2279903966 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 870565527 0 0) 0x7f6e5405d320 con 0x7f6e54091950 2026-02-13T20:17:17.669 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e2ffff640 1 -- 10.20.193.110:0/2279903966 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6e5408c500 con 0x7f6e54091950 2026-02-13T20:17:17.669 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e2ffff640 1 -- 10.20.193.110:0/2279903966 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f6e40003170 con 0x7f6e54091950 2026-02-13T20:17:17.669 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e2ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:17:17.669 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e2ffff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:17:17.670 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e2ffff640 10 monclient(hunting): dump: 2026-02-13T20:17:17.670 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:17.670 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:17.670 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.670 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.670 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:17.670 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:17.670 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:17.670 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:17.670 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:17.670 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:17.670 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e2ffff640 1 -- 10.20.193.110:0/2279903966 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 337996287 0 0) 0x7f6e5412fbe0 con 0x7f6e541527c0 2026-02-13T20:17:17.670 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e2ffff640 1 -- 10.20.193.110:0/2279903966 >> v1:10.20.193.110:6790/0 conn(0x7f6e54091950 legacy=0x7f6e5413e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:17.670 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e2ffff640 1 -- 10.20.193.110:0/2279903966 >> v1:10.20.193.188:6789/0 conn(0x7f6e541401c0 legacy=0x7f6e54193b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:17.670 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e2ffff640 10 monclient: _finish_hunting 0 2026-02-13T20:17:17.670 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e2ffff640 1 monclient: found mon.a 2026-02-13T20:17:17.670 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e2ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:17:17.670 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e2ffff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:17:17.670 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e2ffff640 1 -- 10.20.193.110:0/2279903966 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e54131c60 con 0x7f6e541527c0 2026-02-13T20:17:17.670 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e2ffff640 10 monclient: _finish_auth 0 2026-02-13T20:17:17.670 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e2ffff640 10 monclient: _check_auth_tickets 2026-02-13T20:17:17.671 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e2ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:17:17.671 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e59ccc640 5 monclient: authenticate success, global_id 104157 2026-02-13T20:17:17.671 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e59ccc640 10 monclient: _renew_subs 2026-02-13T20:17:17.671 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e59ccc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:17:17.671 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e59ccc640 1 -- 10.20.193.110:0/2279903966 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6e54131f40 con 0x7f6e541527c0 2026-02-13T20:17:17.671 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e59ccc640 10 monclient: _renew_subs 2026-02-13T20:17:17.671 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e59ccc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:17:17.671 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e59ccc640 1 -- 10.20.193.110:0/2279903966 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6e5413ec10 con 0x7f6e541527c0 2026-02-13T20:17:17.671 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e2ffff640 1 -- 10.20.193.110:0/2279903966 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6e48003a10 con 0x7f6e541527c0 2026-02-13T20:17:17.671 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e2ffff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:17:17.671 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e2ffff640 1 -- 10.20.193.110:0/2279903966 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f6e48004bf0 con 0x7f6e541527c0 2026-02-13T20:17:17.671 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e2ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:17.671 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e2ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:17:17.671 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e2ffff640 10 monclient: dump: 2026-02-13T20:17:17.671 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:17.671 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:17.671 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.671 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.671 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:17.671 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:17.672 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:17.672 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:17.672 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:17.672 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:17.672 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.657+0000 7f6e51ffb640 4 set_mon_vals no callback set 2026-02-13T20:17:17.672 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.658+0000 7f6e59ccc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:17:17.672 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.658+0000 7f6e59ccc640 1 -- 10.20.193.110:0/2279903966 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6e54131830 con 0x7f6e54092020 2026-02-13T20:17:17.672 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.658+0000 7f6e2ffff640 1 -- 10.20.193.110:0/2279903966 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f6e48004d50 con 0x7f6e541527c0 2026-02-13T20:17:17.672 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.658+0000 7f6e2ffff640 1 -- 10.20.193.110:0/2279903966 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(300..300 src has 1..300) ==== 3915+0+0 (unknown 3531726731 0 0) 0x7f6e4804f960 con 0x7f6e541527c0 2026-02-13T20:17:17.672 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.658+0000 7f6e2ffff640 1 -- 10.20.193.110:0/2279903966 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4253071375 0 0) 0x7f6e54131830 con 0x7f6e54092020 2026-02-13T20:17:17.672 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.658+0000 7f6e2ffff640 10 monclient(hunting): _negotiate 2026-02-13T20:17:17.672 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.658+0000 7f6e2ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:17.672 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.658+0000 7f6e2ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:17.672 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.658+0000 7f6e2ffff640 10 monclient(hunting): my global_id is 104160 2026-02-13T20:17:17.672 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.658+0000 7f6e2ffff640 1 -- 10.20.193.110:0/2279903966 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e5412fbe0 con 0x7f6e54092020 2026-02-13T20:17:17.672 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.658+0000 7f6e52ffd640 10 monclient: get_auth_request con 0x7f6e2403fcc0 auth_method 0 2026-02-13T20:17:17.672 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.658+0000 7f6e2ffff640 1 -- 10.20.193.110:0/2279903966 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3368757666 0 0) 0x7f6e5412fbe0 con 0x7f6e54092020 2026-02-13T20:17:17.672 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.658+0000 7f6e2ffff640 1 -- 10.20.193.110:0/2279903966 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6e54131830 con 0x7f6e54092020 2026-02-13T20:17:17.672 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.658+0000 7f6e2ffff640 1 -- 10.20.193.110:0/2279903966 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f6e40003880 con 0x7f6e54092020 2026-02-13T20:17:17.672 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.658+0000 7f6e2ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:17.672 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.658+0000 7f6e2ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:17:17.673 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.658+0000 7f6e2ffff640 10 monclient: dump: 2026-02-13T20:17:17.673 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:17.673 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:17.673 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.673 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.673 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:17.673 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:17.673 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:17.673 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:17.673 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:17.673 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:17.673 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.658+0000 7f6e2ffff640 1 -- 10.20.193.110:0/2279903966 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2837448951 0 0) 0x7f6e54131830 con 0x7f6e54092020 2026-02-13T20:17:17.673 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.658+0000 7f6e2ffff640 1 -- 10.20.193.110:0/2279903966 --> v1:10.20.193.110:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6e5408b450 con 0x7f6e54092020 2026-02-13T20:17:17.673 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.659+0000 7f6e2ffff640 1 -- 10.20.193.110:0/2279903966 <== mon.0 v1:10.20.193.110:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f6e40005880 con 0x7f6e54092020 2026-02-13T20:17:17.673 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.659+0000 7f6e2ffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:17:17.673 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.659+0000 7f6e2ffff640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:17:17.673 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.659+0000 7f6e2ffff640 1 -- 10.20.193.110:0/2279903966 >> v1:10.20.193.110:6789/0 conn(0x7f6e54092020 legacy=0x7f6e5408eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:17.673 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.659+0000 7f6e2ffff640 1 -- 10.20.193.110:0/2279903966 >> v1:10.20.193.110:6789/0 conn(0x7f6e54092020 legacy=0x7f6e5408eea0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:17:17.674 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.663+0000 7f6e59ccc640 10 start_mon_command cmd=[{"prefix": "sync_force", "yes_i_really_mean_it": true}] 2026-02-13T20:17:17.674 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.663+0000 7f6e59ccc640 1 -- 10.20.193.110:0/2279903966 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6e54131a80 con 0x7f6e5408f5b0 2026-02-13T20:17:17.674 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.663+0000 7f6e2ffff640 1 -- 10.20.193.110:0/2279903966 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3853469384 0 0) 0x7f6e54131a80 con 0x7f6e5408f5b0 2026-02-13T20:17:17.674 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.663+0000 7f6e2ffff640 10 monclient(hunting): _negotiate 2026-02-13T20:17:17.675 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.663+0000 7f6e2ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:17.675 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.663+0000 7f6e2ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:17.675 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.663+0000 7f6e2ffff640 10 monclient(hunting): my global_id is 104163 2026-02-13T20:17:17.675 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.663+0000 7f6e2ffff640 1 -- 10.20.193.110:0/2279903966 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e54131830 con 0x7f6e5408f5b0 2026-02-13T20:17:17.675 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.663+0000 7f6e2ffff640 1 -- 10.20.193.110:0/2279903966 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1196671502 0 0) 0x7f6e54131830 con 0x7f6e5408f5b0 2026-02-13T20:17:17.675 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.663+0000 7f6e2ffff640 1 -- 10.20.193.110:0/2279903966 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6e54131a80 con 0x7f6e5408f5b0 2026-02-13T20:17:17.675 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.663+0000 7f6e2ffff640 1 -- 10.20.193.110:0/2279903966 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f6e400040b0 con 0x7f6e5408f5b0 2026-02-13T20:17:17.675 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.663+0000 7f6e2ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:17.675 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.663+0000 7f6e2ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:17:17.675 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.663+0000 7f6e2ffff640 10 monclient: dump: 2026-02-13T20:17:17.675 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:17.675 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:17.675 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.675 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:17.675 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:17.675 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:17.675 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:17.675 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:17.675 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:17.675 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:17.675 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.663+0000 7f6e2ffff640 1 -- 10.20.193.110:0/2279903966 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2832547878 0 0) 0x7f6e54131a80 con 0x7f6e5408f5b0 2026-02-13T20:17:17.675 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.663+0000 7f6e2ffff640 1 -- 10.20.193.110:0/2279903966 --> v1:10.20.193.110:6789/0 -- command(tid 2: {"prefix": "sync_force", "yes_i_really_mean_it": true}) -- 0x7f6e54055bb0 con 0x7f6e5408f5b0 2026-02-13T20:17:17.675 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.664+0000 7f6e2ffff640 1 -- 10.20.193.110:0/2279903966 <== mon.0 v1:10.20.193.110:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+83 (unknown 0 0 2946029456) 0x7f6e40004430 con 0x7f6e5408f5b0 2026-02-13T20:17:17.676 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.664+0000 7f6e2ffff640 10 monclient: handle_command_reply 2 [{"prefix": "sync_force", "yes_i_really_mean_it": true}] 2026-02-13T20:17:17.676 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.664+0000 7f6e2ffff640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:17:17.676 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.664+0000 7f6e2ffff640 1 -- 10.20.193.110:0/2279903966 >> v1:10.20.193.110:6789/0 conn(0x7f6e5408f5b0 legacy=0x7f6e54197950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:17.676 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.664+0000 7f6e2ffff640 1 -- 10.20.193.110:0/2279903966 >> v1:10.20.193.110:6789/0 conn(0x7f6e5408f5b0 legacy=0x7f6e54197950 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:17:17.676 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:17:17.676 INFO:teuthology.orchestra.run.trial110.stdout: "ret": 0, 2026-02-13T20:17:17.676 INFO:teuthology.orchestra.run.trial110.stdout: "msg": "forcing store sync the next time the monitor starts" 2026-02-13T20:17:17.676 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:17:17.677 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.664+0000 7f6e59ccc640 1 -- 10.20.193.110:0/2279903966 >> v1:10.20.193.188:6812/1623052694 conn(0x7f6e2403fcc0 legacy=0x7f6e24060170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:17.677 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.664+0000 7f6e59ccc640 10 monclient: shutdown 2026-02-13T20:17:17.677 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.664+0000 7f6e59ccc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:17:17.677 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.664+0000 7f6e59ccc640 1 -- 10.20.193.110:0/2279903966 >> v1:10.20.193.110:6789/0 conn(0x7f6e541527c0 legacy=0x7f6e54195220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:17.677 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.664+0000 7f6e53fff640 1 -- 10.20.193.110:0/2279903966 reap_dead start 2026-02-13T20:17:17.677 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.664+0000 7f6e53fff640 1 -- 10.20.193.110:0/2279903966 reap_dead start 2026-02-13T20:17:17.677 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.664+0000 7f6e59ccc640 1 -- 10.20.193.110:0/2279903966 shutdown_connections 2026-02-13T20:17:17.677 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.664+0000 7f6e59ccc640 1 -- 10.20.193.110:0/2279903966 >> 10.20.193.110:0/2279903966 conn(0x7f6e54054e90 msgr2=0x7f6e54088e30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:17:17.677 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.664+0000 7f6e59ccc640 1 -- 10.20.193.110:0/2279903966 shutdown_connections 2026-02-13T20:17:17.677 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:17.664+0000 7f6e59ccc640 1 -- 10.20.193.110:0/2279903966 wait complete. 2026-02-13T20:17:17.678 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2026-02-13T20:17:17.678 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-13T20:17:17.678 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T20:17:17.686 INFO:tasks.ceph.mon.a:Stopped 2026-02-13T20:17:17.686 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.b 2026-02-13T20:17:17.686 INFO:tasks.mon_thrash:Sending STOP to mon b 2026-02-13T20:17:17.686 INFO:tasks.ceph.mon.b:Sent signal 19 2026-02-13T20:17:17.686 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-13T20:17:32.686 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.b 2026-02-13T20:17:32.686 INFO:tasks.mon_thrash:Sending CONT to mon b 2026-02-13T20:17:32.687 INFO:tasks.ceph.mon.b:Sent signal 18 2026-02-13T20:17:32.687 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-13T20:17:32.687 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T20:17:32.751 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:32.751+0000 7f93ca5d4640 10 monclient: get_monmap_and_config 2026-02-13T20:17:32.751 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:32.751+0000 7f93ca5d4640 10 monclient: build_initial_monmap 2026-02-13T20:17:32.751 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:32.751+0000 7f93ca5d4640 10 monclient: monmap: 2026-02-13T20:17:32.751 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:17:32.751 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:32.751 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:17:32.751481+0000 2026-02-13T20:17:32.751 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:17:32.751481+0000 2026-02-13T20:17:32.751 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:17:32.751 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:32.751 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:17:32.751 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:17:32.751 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:17:32.751 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:32.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:32.751+0000 7f93ca5d4640 1 Processor -- start 2026-02-13T20:17:32.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:32.751+0000 7f93ca5d4640 1 -- start start 2026-02-13T20:17:32.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:32.751+0000 7f93ca5d4640 10 monclient: init 2026-02-13T20:17:32.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:32.751+0000 7f93ca5d4640 10 monclient: _reopen_session rank -1 2026-02-13T20:17:32.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:32.751+0000 7f93ca5d4640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:17:32.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:32.751+0000 7f93ca5d4640 10 monclient(hunting): picked mon.noname-a con 0x7f93c41401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:17:32.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:32.751+0000 7f93ca5d4640 10 monclient(hunting): picked mon.noname-c con 0x7f93c4092020 addr v1:10.20.193.188:6789/0 2026-02-13T20:17:32.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:32.751+0000 7f93ca5d4640 10 monclient(hunting): picked mon.noname-b con 0x7f93c4091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:17:32.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:32.751+0000 7f93ca5d4640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93c408b730 con 0x7f93c41401c0 2026-02-13T20:17:32.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:32.751+0000 7f93ca5d4640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93c405c5b0 con 0x7f93c4092020 2026-02-13T20:17:32.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:32.751+0000 7f93ca5d4640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93c408bcf0 con 0x7f93c4091950 2026-02-13T20:17:32.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:32.751+0000 7f93ca5d4640 10 monclient(hunting): _renew_subs 2026-02-13T20:17:32.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:32.751+0000 7f93ca5d4640 10 monclient(hunting): authenticate will time out at 1014.441902s 2026-02-13T20:17:32.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:32.751+0000 7f93c3fff640 1 -- >> v1:10.20.193.110:6789/0 conn(0x7f93c41401c0 legacy=0x7f93c4091240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:17:32.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:32.751+0000 7f93c8b4a640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f93c4091950 0x7f93c41a2a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:59672/0 (socket says 10.20.193.110:59672) 2026-02-13T20:17:32.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:32.752+0000 7f93c8b4a640 1 -- 10.20.193.110:0/2931924329 learned_addr learned my addr 10.20.193.110:0/2931924329 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:17:32.952 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:32.952+0000 7f93c3fff640 1 -- 10.20.193.110:0/2931924329 >> v1:10.20.193.110:6789/0 conn(0x7f93c41401c0 legacy=0x7f93c4091240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:17:33.354 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:33.353+0000 7f93c3fff640 1 -- 10.20.193.110:0/2931924329 >> v1:10.20.193.110:6789/0 conn(0x7f93c41401c0 legacy=0x7f93c4091240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:17:34.155 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:34.154+0000 7f93c3fff640 1 -- 10.20.193.110:0/2931924329 >> v1:10.20.193.110:6789/0 conn(0x7f93c41401c0 legacy=0x7f93c4091240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:17:35.753 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:35.750+0000 7f93c1ffb640 10 monclient(hunting): tick 2026-02-13T20:17:35.753 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:35.750+0000 7f93c1ffb640 10 monclient(hunting): _check_auth_tickets 2026-02-13T20:17:35.753 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:35.750+0000 7f93c1ffb640 1 monclient(hunting): continuing hunt 2026-02-13T20:17:35.753 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:35.750+0000 7f93c1ffb640 10 monclient(hunting): _reopen_session rank -1 2026-02-13T20:17:35.754 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:35.750+0000 7f93c1ffb640 1 -- 10.20.193.110:0/2931924329 >> v1:10.20.193.110:6790/0 conn(0x7f93c4091950 legacy=0x7f93c41a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:35.754 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:35.750+0000 7f93c1ffb640 1 -- 10.20.193.110:0/2931924329 >> v1:10.20.193.188:6789/0 conn(0x7f93c4092020 legacy=0x7f93c41812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:35.754 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:35.750+0000 7f93c1ffb640 1 -- 10.20.193.110:0/2931924329 >> v1:10.20.193.110:6789/0 conn(0x7f93c41401c0 legacy=0x7f93c4091240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:17:35.754 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:35.750+0000 7f93c1ffb640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:17:35.754 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:35.750+0000 7f93c1ffb640 10 monclient(hunting): picked mon.noname-c con 0x7f93a0003780 addr v1:10.20.193.188:6789/0 2026-02-13T20:17:35.754 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:35.751+0000 7f93c1ffb640 10 monclient(hunting): picked mon.noname-b con 0x7f93c4091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:17:35.754 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:35.751+0000 7f93c1ffb640 10 monclient(hunting): picked mon.noname-a con 0x7f93c41401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:17:35.754 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:35.751+0000 7f93c1ffb640 1 -- 10.20.193.110:0/2931924329 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93c4140590 con 0x7f93c41401c0 2026-02-13T20:17:35.754 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:35.751+0000 7f93c1ffb640 1 -- 10.20.193.110:0/2931924329 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93c408b730 con 0x7f93a0003780 2026-02-13T20:17:35.754 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:35.751+0000 7f93c8b4a640 1 -- 10.20.193.110:0/2931924329 >> v1:10.20.193.110:6789/0 conn(0x7f93c41401c0 legacy=0x7f93a0066b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:17:35.754 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:35.751+0000 7f93c1ffb640 1 -- 10.20.193.110:0/2931924329 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93a006a380 con 0x7f93c4091950 2026-02-13T20:17:35.755 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:35.751+0000 7f93c1ffb640 10 monclient(hunting): _renew_subs 2026-02-13T20:17:35.954 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:35.952+0000 7f93c8b4a640 1 -- 10.20.193.110:0/2931924329 >> v1:10.20.193.110:6789/0 conn(0x7f93c41401c0 legacy=0x7f93a0066b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:17:36.354 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:36.353+0000 7f93c8b4a640 1 -- 10.20.193.110:0/2931924329 >> v1:10.20.193.110:6789/0 conn(0x7f93c41401c0 legacy=0x7f93a0066b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:17:37.155 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.154+0000 7f93c8b4a640 1 -- 10.20.193.110:0/2931924329 >> v1:10.20.193.110:6789/0 conn(0x7f93c41401c0 legacy=0x7f93a0066b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:17:37.698 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.696+0000 7f93c2ffd640 1 -- 10.20.193.110:0/2931924329 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1993879133 0 0) 0x7f93a006a380 con 0x7f93c4091950 2026-02-13T20:17:37.698 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.696+0000 7f93c2ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:17:37.698 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.696+0000 7f93c2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:37.698 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.696+0000 7f93c2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:37.698 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.696+0000 7f93c2ffd640 10 monclient(hunting): my global_id is 94259 2026-02-13T20:17:37.698 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.696+0000 7f93c2ffd640 1 -- 10.20.193.110:0/2931924329 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f93a80035e0 con 0x7f93c4091950 2026-02-13T20:17:37.698 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.696+0000 7f93c2ffd640 1 -- 10.20.193.110:0/2931924329 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 550905646 0 0) 0x7f93a80035e0 con 0x7f93c4091950 2026-02-13T20:17:37.698 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.696+0000 7f93c2ffd640 1 -- 10.20.193.110:0/2931924329 >> v1:10.20.193.188:6789/0 conn(0x7f93a0003780 legacy=0x7f93a0023b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:37.698 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.696+0000 7f93c2ffd640 1 -- 10.20.193.110:0/2931924329 >> v1:10.20.193.110:6789/0 conn(0x7f93c41401c0 legacy=0x7f93a0066b60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:17:37.698 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.696+0000 7f93c2ffd640 10 monclient: _finish_hunting 0 2026-02-13T20:17:37.698 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.696+0000 7f93c2ffd640 1 monclient: found mon.noname-b 2026-02-13T20:17:37.698 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.696+0000 7f93c2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:17:37.698 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.696+0000 7f93c2ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:17:37.698 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.696+0000 7f93c2ffd640 1 -- 10.20.193.110:0/2931924329 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93a006b640 con 0x7f93c4091950 2026-02-13T20:17:37.698 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.696+0000 7f93c2ffd640 10 monclient: _finish_auth 0 2026-02-13T20:17:37.698 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.696+0000 7f93c2ffd640 10 monclient: _check_auth_tickets 2026-02-13T20:17:37.698 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.696+0000 7f93c2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:17:37.698 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.696+0000 7f93c2ffd640 1 -- 10.20.193.110:0/2931924329 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f93b4002d20 con 0x7f93c4091950 2026-02-13T20:17:37.698 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.696+0000 7f93c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:37.698 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.696+0000 7f93c2ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:17:37.699 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.696+0000 7f93c2ffd640 10 monclient: dump: 2026-02-13T20:17:37.699 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:37.699 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:37.699 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:37.699 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:37.699 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:37.699 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:37.699 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:37.699 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:37.699 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:37.699 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:37.699 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.696+0000 7f93ca5d4640 5 monclient: authenticate success, global_id 94259 2026-02-13T20:17:37.699 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.696+0000 7f93ca5d4640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:17:37.699 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.696+0000 7f93c2ffd640 1 -- 10.20.193.110:0/2931924329 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f93b4002f20 con 0x7f93c4091950 2026-02-13T20:17:37.699 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.696+0000 7f93c2ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:17:37.699 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.696+0000 7f93c2ffd640 1 -- 10.20.193.110:0/2931924329 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f93b4003330 con 0x7f93c4091950 2026-02-13T20:17:37.699 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.696+0000 7f93ca5d4640 10 monclient: get_monmap_and_config success 2026-02-13T20:17:37.699 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.696+0000 7f93ca5d4640 4 set_mon_vals no callback set 2026-02-13T20:17:37.699 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.696+0000 7f93c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:37.699 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.696+0000 7f93c2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:17:37.699 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.696+0000 7f93c2ffd640 10 monclient: dump: 2026-02-13T20:17:37.699 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:37.699 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:37.699 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:37.699 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:37.699 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:37.699 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:37.699 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:37.699 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:37.699 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:37.699 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:37.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.697+0000 7f93ca5d4640 10 monclient: shutdown 2026-02-13T20:17:37.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.697+0000 7f93ca5d4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:17:37.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.697+0000 7f93ca5d4640 1 -- 10.20.193.110:0/2931924329 >> v1:10.20.193.110:6790/0 conn(0x7f93c4091950 legacy=0x7f93a0045360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:37.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.697+0000 7f93ca5d4640 1 -- 10.20.193.110:0/2931924329 shutdown_connections 2026-02-13T20:17:37.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.697+0000 7f93ca5d4640 1 -- 10.20.193.110:0/2931924329 >> 10.20.193.110:0/2931924329 conn(0x7f93c4054e90 msgr2=0x7f93c4058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:17:37.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.697+0000 7f93ca5d4640 1 -- 10.20.193.110:0/2931924329 shutdown_connections 2026-02-13T20:17:37.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.697+0000 7f93ca5d4640 1 -- 10.20.193.110:0/2931924329 wait complete. 2026-02-13T20:17:37.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.697+0000 7f93ca5d4640 10 monclient: build_initial_monmap 2026-02-13T20:17:37.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.697+0000 7f93ca5d4640 10 monclient: monmap: 2026-02-13T20:17:37.700 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:17:37.700 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:17:37.700 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:17:37.700 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:17:37.700 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:17:37.700 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:17:37.700 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:17:37.700 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:17:37.700 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:17:37.700 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:37.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.698+0000 7f93ca5d4640 1 Processor -- start 2026-02-13T20:17:37.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.698+0000 7f93ca5d4640 1 -- start start 2026-02-13T20:17:37.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.698+0000 7f93ca5d4640 10 monclient: init 2026-02-13T20:17:37.700 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.698+0000 7f93ca5d4640 10 monclient: _reopen_session rank -1 2026-02-13T20:17:37.701 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.698+0000 7f93ca5d4640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:17:37.701 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.698+0000 7f93ca5d4640 10 monclient(hunting): picked mon.noname-c con 0x7f93a0003780 addr v1:10.20.193.110:6790/0 2026-02-13T20:17:37.701 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.698+0000 7f93ca5d4640 10 monclient(hunting): picked mon.noname-a con 0x7f93c4091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:17:37.701 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.698+0000 7f93ca5d4640 10 monclient(hunting): picked mon.noname-b con 0x7f93c41401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:17:37.701 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.698+0000 7f93ca5d4640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93c413f9e0 con 0x7f93c4091950 2026-02-13T20:17:37.701 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.698+0000 7f93ca5d4640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93c4090830 con 0x7f93c41401c0 2026-02-13T20:17:37.701 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.698+0000 7f93ca5d4640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93c4132250 con 0x7f93a0003780 2026-02-13T20:17:37.701 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.698+0000 7f93ca5d4640 10 monclient(hunting): _renew_subs 2026-02-13T20:17:37.701 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.698+0000 7f93ca5d4640 10 monclient(hunting): authenticate will time out at 1019.389513s 2026-02-13T20:17:37.701 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.698+0000 7f93c37fe640 1 -- >> v1:10.20.193.110:6789/0 conn(0x7f93c4091950 legacy=0x7f93c4089540 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:17:37.701 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.698+0000 7f93c3fff640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f93a0003780 0x7f93c4088e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:59694/0 (socket says 10.20.193.110:59694) 2026-02-13T20:17:37.701 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.698+0000 7f93c3fff640 1 -- 10.20.193.110:0/377562950 learned_addr learned my addr 10.20.193.110:0/377562950 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:17:37.703 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.702+0000 7f93c0ff9640 1 -- 10.20.193.110:0/377562950 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1504872846 0 0) 0x7f93c4132250 con 0x7f93a0003780 2026-02-13T20:17:37.703 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.702+0000 7f93c0ff9640 10 monclient(hunting): _negotiate 2026-02-13T20:17:37.703 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.702+0000 7f93c0ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:37.703 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.702+0000 7f93c0ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:37.703 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.702+0000 7f93c0ff9640 10 monclient(hunting): my global_id is 94262 2026-02-13T20:17:37.703 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.702+0000 7f93c0ff9640 1 -- 10.20.193.110:0/377562950 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f93940035e0 con 0x7f93a0003780 2026-02-13T20:17:37.703 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.702+0000 7f93c0ff9640 1 -- 10.20.193.110:0/377562950 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1533498321 0 0) 0x7f93c4090830 con 0x7f93c41401c0 2026-02-13T20:17:37.703 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.702+0000 7f93c0ff9640 10 monclient(hunting): _negotiate 2026-02-13T20:17:37.703 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.702+0000 7f93c0ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:37.703 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.702+0000 7f93c0ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:37.703 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.702+0000 7f93c0ff9640 10 monclient(hunting): my global_id is 4693 2026-02-13T20:17:37.703 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.702+0000 7f93c0ff9640 1 -- 10.20.193.110:0/377562950 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f93c4132250 con 0x7f93c41401c0 2026-02-13T20:17:37.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.702+0000 7f93c0ff9640 1 -- 10.20.193.110:0/377562950 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 84573085 0 0) 0x7f93940035e0 con 0x7f93a0003780 2026-02-13T20:17:37.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.702+0000 7f93c0ff9640 1 -- 10.20.193.110:0/377562950 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f93c4090830 con 0x7f93a0003780 2026-02-13T20:17:37.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.702+0000 7f93c0ff9640 1 -- 10.20.193.110:0/377562950 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f93b0004340 con 0x7f93a0003780 2026-02-13T20:17:37.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.702+0000 7f93c0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:17:37.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.702+0000 7f93c0ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:17:37.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.702+0000 7f93c0ff9640 10 monclient(hunting): dump: 2026-02-13T20:17:37.704 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:37.704 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:37.704 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:37.704 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:37.704 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:37.704 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:37.704 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:37.704 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:37.704 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:37.704 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:37.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.702+0000 7f93c0ff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:17:37.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.702+0000 7f93c0ff9640 1 -- 10.20.193.110:0/377562950 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1651353344 0 0) 0x7f93c4090830 con 0x7f93a0003780 2026-02-13T20:17:37.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.702+0000 7f93c0ff9640 1 -- 10.20.193.110:0/377562950 >> v1:10.20.193.188:6789/0 conn(0x7f93c41401c0 legacy=0x7f93c423bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:37.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.702+0000 7f93c0ff9640 1 -- 10.20.193.110:0/377562950 >> v1:10.20.193.110:6789/0 conn(0x7f93c4091950 legacy=0x7f93c4089540 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T20:17:37.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.702+0000 7f93c0ff9640 10 monclient: _finish_hunting 0 2026-02-13T20:17:37.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.702+0000 7f93c0ff9640 1 monclient: found mon.c 2026-02-13T20:17:37.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.702+0000 7f93c0ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:17:37.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.702+0000 7f93c0ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:17:37.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.702+0000 7f93c0ff9640 1 -- 10.20.193.110:0/377562950 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93c4089c50 con 0x7f93a0003780 2026-02-13T20:17:37.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.702+0000 7f93c0ff9640 10 monclient: _finish_auth 0 2026-02-13T20:17:37.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.702+0000 7f93c0ff9640 10 monclient: _check_auth_tickets 2026-02-13T20:17:37.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.702+0000 7f93c0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:17:37.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.702+0000 7f93ca5d4640 5 monclient: authenticate success, global_id 94262 2026-02-13T20:17:37.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.702+0000 7f93ca5d4640 10 monclient: _renew_subs 2026-02-13T20:17:37.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.702+0000 7f93ca5d4640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:17:37.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.702+0000 7f93ca5d4640 1 -- 10.20.193.110:0/377562950 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f93c405d320 con 0x7f93a0003780 2026-02-13T20:17:37.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.702+0000 7f93ca5d4640 10 monclient: _renew_subs 2026-02-13T20:17:37.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.702+0000 7f93ca5d4640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:17:37.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.702+0000 7f93ca5d4640 1 -- 10.20.193.110:0/377562950 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f93c408a8d0 con 0x7f93a0003780 2026-02-13T20:17:37.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.702+0000 7f93c0ff9640 1 -- 10.20.193.110:0/377562950 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f93b0004790 con 0x7f93a0003780 2026-02-13T20:17:37.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.702+0000 7f93c0ff9640 10 monclient: handle_config config(0 keys) 2026-02-13T20:17:37.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.702+0000 7f93c0ff9640 1 -- 10.20.193.110:0/377562950 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f93b0004ba0 con 0x7f93a0003780 2026-02-13T20:17:37.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.702+0000 7f93c0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:37.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.702+0000 7f93c0ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:17:37.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.702+0000 7f93c0ff9640 10 monclient: dump: 2026-02-13T20:17:37.705 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:37.705 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:37.705 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:37.705 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:37.705 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:37.705 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:37.705 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:37.705 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:37.705 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:37.705 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:37.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.702+0000 7f93c27fc640 4 set_mon_vals no callback set 2026-02-13T20:17:37.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.702+0000 7f93c0ff9640 1 -- 10.20.193.110:0/377562950 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f93b0004d70 con 0x7f93a0003780 2026-02-13T20:17:37.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.703+0000 7f93ca5d4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:17:37.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.703+0000 7f93ca5d4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:17:37.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.703+0000 7f93ca5d4640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:17:37.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.703+0000 7f93ca5d4640 1 -- 10.20.193.110:0/377562950 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93c4132090 con 0x7f93a0003780 2026-02-13T20:17:37.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.703+0000 7f93c0ff9640 1 -- 10.20.193.110:0/377562950 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(301..301 src has 1..301) ==== 3915+0+0 (unknown 1406538563 0 0) 0x7f93b004e970 con 0x7f93a0003780 2026-02-13T20:17:37.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.703+0000 7f93c37fe640 10 monclient: get_auth_request con 0x7f939403f6f0 auth_method 0 2026-02-13T20:17:37.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.705+0000 7f93c0ff9640 1 -- 10.20.193.110:0/377562950 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f93b0017060 con 0x7f93a0003780 2026-02-13T20:17:37.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.705+0000 7f93c0ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:17:37.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.705+0000 7f93c0ff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:17:37.852 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.850+0000 7f93ca5d4640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T20:17:37.853 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.850+0000 7f93ca5d4640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T20:17:37.853 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.850+0000 7f93ca5d4640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:17:37.853 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.850+0000 7f93ca5d4640 1 -- 10.20.193.110:0/377562950 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f93c408c890 con 0x7f93a0003780 2026-02-13T20:17:37.853 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.851+0000 7f93c0ff9640 1 -- 10.20.193.110:0/377562950 <== mon.2 v1:10.20.193.110:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 4164305854) 0x7f93b004b790 con 0x7f93a0003780 2026-02-13T20:17:37.853 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.851+0000 7f93c0ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T20:17:37.853 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.851+0000 7f93c0ff9640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:17:37.854 INFO:teuthology.orchestra.run.trial110.stdout:{"election_epoch":26,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","modified":"2026-02-13T20:11:07.161192Z","created":"2026-02-13T20:11:07.161192Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6789","nonce":0}]},"addr":"10.20.193.110:6789/0","public_addr":"10.20.193.110:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161241+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6789","nonce":0}]},"addr":"10.20.193.188:6789/0","public_addr":"10.20.193.188:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161242+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6790","nonce":0}]},"addr":"10.20.193.110:6790/0","public_addr":"10.20.193.110:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161243+0000","crush_location":[]}]}} 2026-02-13T20:17:37.854 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.852+0000 7f93ca5d4640 1 -- 10.20.193.110:0/377562950 >> v1:10.20.193.188:6812/1623052694 conn(0x7f939403f6f0 legacy=0x7f939405fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:37.855 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.852+0000 7f93ca5d4640 10 monclient: shutdown 2026-02-13T20:17:37.855 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.852+0000 7f93ca5d4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:17:37.855 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.852+0000 7f93ca5d4640 1 -- 10.20.193.110:0/377562950 >> v1:10.20.193.110:6790/0 conn(0x7f93a0003780 legacy=0x7f93c4088e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:37.855 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.852+0000 7f93ca5d4640 1 -- 10.20.193.110:0/377562950 shutdown_connections 2026-02-13T20:17:37.855 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.852+0000 7f93ca5d4640 1 -- 10.20.193.110:0/377562950 >> 10.20.193.110:0/377562950 conn(0x7f93c4054e90 msgr2=0x7f93c408d580 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:17:37.855 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.852+0000 7f93ca5d4640 1 -- 10.20.193.110:0/377562950 shutdown_connections 2026-02-13T20:17:37.855 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.852+0000 7f93ca5d4640 1 -- 10.20.193.110:0/377562950 wait complete. 2026-02-13T20:17:37.862 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-13T20:17:37.862 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-13T20:17:37.862 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T20:17:37.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.926+0000 7f309f8c3640 10 monclient: get_monmap_and_config 2026-02-13T20:17:37.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.926+0000 7f309f8c3640 10 monclient: build_initial_monmap 2026-02-13T20:17:37.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.926+0000 7f309f8c3640 10 monclient: monmap: 2026-02-13T20:17:37.934 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:17:37.934 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:37.934 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:17:37.927762+0000 2026-02-13T20:17:37.934 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:17:37.927762+0000 2026-02-13T20:17:37.934 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:17:37.934 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:37.934 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:17:37.934 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:17:37.934 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:17:37.934 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:37.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.926+0000 7f309f8c3640 1 Processor -- start 2026-02-13T20:17:37.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.926+0000 7f309f8c3640 1 -- start start 2026-02-13T20:17:37.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.926+0000 7f309f8c3640 10 monclient: init 2026-02-13T20:17:37.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f309f8c3640 10 monclient: _reopen_session rank -1 2026-02-13T20:17:37.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f309f8c3640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:17:37.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f309f8c3640 10 monclient(hunting): picked mon.noname-b con 0x7f30981401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:17:37.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f309f8c3640 10 monclient(hunting): picked mon.noname-a con 0x7f3098092020 addr v1:10.20.193.110:6789/0 2026-02-13T20:17:37.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f309f8c3640 10 monclient(hunting): picked mon.noname-c con 0x7f3098091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:17:37.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f309f8c3640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f309808b730 con 0x7f3098092020 2026-02-13T20:17:37.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f309f8c3640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f309805c5b0 con 0x7f3098091950 2026-02-13T20:17:37.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f309f8c3640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f309808bcf0 con 0x7f30981401c0 2026-02-13T20:17:37.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f309f8c3640 10 monclient(hunting): _renew_subs 2026-02-13T20:17:37.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f309f8c3640 10 monclient(hunting): authenticate will time out at 1019.618136s 2026-02-13T20:17:37.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f309ce37640 1 -- >> v1:10.20.193.110:6789/0 conn(0x7f3098092020 legacy=0x7f30981812f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:17:37.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f309d638640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f30981401c0 0x7f3098091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:59708/0 (socket says 10.20.193.110:59708) 2026-02-13T20:17:37.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f309d638640 1 -- 10.20.193.110:0/3037249220 learned_addr learned my addr 10.20.193.110:0/3037249220 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:17:37.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f3087fff640 1 -- 10.20.193.110:0/3037249220 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 822845169 0 0) 0x7f309808bcf0 con 0x7f30981401c0 2026-02-13T20:17:37.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f3087fff640 10 monclient(hunting): _negotiate 2026-02-13T20:17:37.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f3087fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:37.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f3087fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:37.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f3087fff640 10 monclient(hunting): my global_id is 94265 2026-02-13T20:17:37.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f3087fff640 1 -- 10.20.193.110:0/3037249220 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30800035e0 con 0x7f30981401c0 2026-02-13T20:17:37.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f3087fff640 1 -- 10.20.193.110:0/3037249220 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1653439544 0 0) 0x7f309805c5b0 con 0x7f3098091950 2026-02-13T20:17:37.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f3087fff640 10 monclient(hunting): _negotiate 2026-02-13T20:17:37.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f3087fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:37.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f3087fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:37.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f3087fff640 10 monclient(hunting): my global_id is 4696 2026-02-13T20:17:37.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f3087fff640 1 -- 10.20.193.110:0/3037249220 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f309808bcf0 con 0x7f3098091950 2026-02-13T20:17:37.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f3087fff640 1 -- 10.20.193.110:0/3037249220 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2376408027 0 0) 0x7f30800035e0 con 0x7f30981401c0 2026-02-13T20:17:37.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f3087fff640 1 -- 10.20.193.110:0/3037249220 >> v1:10.20.193.188:6789/0 conn(0x7f3098091950 legacy=0x7f30981a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:37.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f3087fff640 1 -- 10.20.193.110:0/3037249220 >> v1:10.20.193.110:6789/0 conn(0x7f3098092020 legacy=0x7f30981812f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:17:37.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f3087fff640 10 monclient: _finish_hunting 0 2026-02-13T20:17:37.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f3087fff640 1 monclient: found mon.noname-b 2026-02-13T20:17:37.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f3087fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:17:37.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f3087fff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:17:37.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f3087fff640 1 -- 10.20.193.110:0/3037249220 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3098140590 con 0x7f30981401c0 2026-02-13T20:17:37.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f3087fff640 10 monclient: _finish_auth 0 2026-02-13T20:17:37.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f3087fff640 10 monclient: _check_auth_tickets 2026-02-13T20:17:37.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f3087fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:17:37.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f3087fff640 1 -- 10.20.193.110:0/3037249220 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f3088002dd0 con 0x7f30981401c0 2026-02-13T20:17:37.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f309f8c3640 5 monclient: authenticate success, global_id 94265 2026-02-13T20:17:37.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f309f8c3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:17:37.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f3087fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:37.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f3087fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:17:37.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f3087fff640 10 monclient: dump: 2026-02-13T20:17:37.935 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:37.935 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:37.935 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:37.935 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:37.935 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:37.935 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:37.935 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:37.935 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:37.936 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:37.936 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:37.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f309f8c3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:17:37.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f3087fff640 1 -- 10.20.193.110:0/3037249220 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3088003020 con 0x7f30981401c0 2026-02-13T20:17:37.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f3087fff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:17:37.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f3087fff640 1 -- 10.20.193.110:0/3037249220 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f3088003430 con 0x7f30981401c0 2026-02-13T20:17:37.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f309f8c3640 10 monclient: get_monmap_and_config success 2026-02-13T20:17:37.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f309f8c3640 4 set_mon_vals no callback set 2026-02-13T20:17:37.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f3087fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:37.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f3087fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:17:37.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.927+0000 7f3087fff640 10 monclient: dump: 2026-02-13T20:17:37.936 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:37.936 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:37.936 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:37.936 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:37.936 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:37.936 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:37.936 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:37.936 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:37.936 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:37.936 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:37.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.928+0000 7f309f8c3640 10 monclient: shutdown 2026-02-13T20:17:37.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.928+0000 7f309f8c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:17:37.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.928+0000 7f309f8c3640 1 -- 10.20.193.110:0/3037249220 >> v1:10.20.193.110:6790/0 conn(0x7f30981401c0 legacy=0x7f3098091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:37.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.928+0000 7f309f8c3640 1 -- 10.20.193.110:0/3037249220 shutdown_connections 2026-02-13T20:17:37.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.928+0000 7f309f8c3640 1 -- 10.20.193.110:0/3037249220 >> 10.20.193.110:0/3037249220 conn(0x7f3098054e90 msgr2=0x7f3098058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:17:37.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.928+0000 7f309f8c3640 1 -- 10.20.193.110:0/3037249220 shutdown_connections 2026-02-13T20:17:37.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.928+0000 7f309f8c3640 1 -- 10.20.193.110:0/3037249220 wait complete. 2026-02-13T20:17:37.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.928+0000 7f309f8c3640 10 monclient: build_initial_monmap 2026-02-13T20:17:37.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.928+0000 7f309f8c3640 10 monclient: monmap: 2026-02-13T20:17:37.936 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:17:37.936 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:17:37.936 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:17:37.936 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:17:37.936 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:17:37.936 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:17:37.936 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:17:37.936 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:17:37.936 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:17:37.936 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:37.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.928+0000 7f309f8c3640 1 Processor -- start 2026-02-13T20:17:37.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.928+0000 7f309f8c3640 1 -- start start 2026-02-13T20:17:37.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.928+0000 7f309f8c3640 10 monclient: init 2026-02-13T20:17:37.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.928+0000 7f309f8c3640 10 monclient: _reopen_session rank -1 2026-02-13T20:17:37.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.928+0000 7f309f8c3640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:17:37.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.928+0000 7f309f8c3640 10 monclient(hunting): picked mon.noname-c con 0x7f3098091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:17:37.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.928+0000 7f309f8c3640 10 monclient(hunting): picked mon.noname-a con 0x7f30981401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:17:37.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.928+0000 7f309f8c3640 10 monclient(hunting): picked mon.noname-b con 0x7f3098089c50 addr v1:10.20.193.188:6789/0 2026-02-13T20:17:37.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.928+0000 7f309f8c3640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3098130e10 con 0x7f30981401c0 2026-02-13T20:17:37.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.928+0000 7f309f8c3640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f309808c410 con 0x7f3098089c50 2026-02-13T20:17:37.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.928+0000 7f309f8c3640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f309805d320 con 0x7f3098091950 2026-02-13T20:17:37.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.928+0000 7f309f8c3640 10 monclient(hunting): _renew_subs 2026-02-13T20:17:37.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.928+0000 7f309f8c3640 10 monclient(hunting): authenticate will time out at 1019.619991s 2026-02-13T20:17:37.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.928+0000 7f309ce37640 1 -- >> v1:10.20.193.110:6789/0 conn(0x7f30981401c0 legacy=0x7f3098089540 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:17:37.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.929+0000 7f309d638640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f3098091950 0x7f3098088e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:59710/0 (socket says 10.20.193.110:59710) 2026-02-13T20:17:37.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.929+0000 7f309d638640 1 -- 10.20.193.110:0/3752491433 learned_addr learned my addr 10.20.193.110:0/3752491433 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:17:37.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.929+0000 7f3085ffb640 1 -- 10.20.193.110:0/3752491433 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1701163554 0 0) 0x7f309805d320 con 0x7f3098091950 2026-02-13T20:17:37.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.929+0000 7f3085ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:17:37.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.929+0000 7f3085ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:37.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.929+0000 7f3085ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:37.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.929+0000 7f3085ffb640 10 monclient(hunting): my global_id is 94268 2026-02-13T20:17:37.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.929+0000 7f3085ffb640 1 -- 10.20.193.110:0/3752491433 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30680035e0 con 0x7f3098091950 2026-02-13T20:17:37.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.929+0000 7f3085ffb640 1 -- 10.20.193.110:0/3752491433 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 271718879 0 0) 0x7f30680035e0 con 0x7f3098091950 2026-02-13T20:17:37.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.929+0000 7f3085ffb640 1 -- 10.20.193.110:0/3752491433 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f309805d320 con 0x7f3098091950 2026-02-13T20:17:37.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.929+0000 7f3085ffb640 1 -- 10.20.193.110:0/3752491433 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f3088003340 con 0x7f3098091950 2026-02-13T20:17:37.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.929+0000 7f3085ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:17:37.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.929+0000 7f3085ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:17:37.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.929+0000 7f3085ffb640 10 monclient(hunting): dump: 2026-02-13T20:17:37.937 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:37.937 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:37.937 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:37.937 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:37.937 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:37.937 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:37.937 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:37.937 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:37.937 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:37.937 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:37.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.929+0000 7f3085ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:17:37.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.929+0000 7f3085ffb640 1 -- 10.20.193.110:0/3752491433 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3525491743 0 0) 0x7f309805d320 con 0x7f3098091950 2026-02-13T20:17:37.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.929+0000 7f3085ffb640 1 -- 10.20.193.110:0/3752491433 >> v1:10.20.193.188:6789/0 conn(0x7f3098089c50 legacy=0x7f3098195170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:37.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.929+0000 7f3085ffb640 1 -- 10.20.193.110:0/3752491433 >> v1:10.20.193.110:6789/0 conn(0x7f30981401c0 legacy=0x7f3098089540 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T20:17:37.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.929+0000 7f3085ffb640 10 monclient: _finish_hunting 0 2026-02-13T20:17:37.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.929+0000 7f3085ffb640 1 monclient: found mon.c 2026-02-13T20:17:37.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.929+0000 7f3085ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:17:37.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.929+0000 7f3085ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:17:37.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.929+0000 7f3085ffb640 1 -- 10.20.193.110:0/3752491433 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3098090fe0 con 0x7f3098091950 2026-02-13T20:17:37.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.929+0000 7f3085ffb640 10 monclient: _finish_auth 0 2026-02-13T20:17:37.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.929+0000 7f3085ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:17:37.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.929+0000 7f3085ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:17:37.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.929+0000 7f309f8c3640 5 monclient: authenticate success, global_id 94268 2026-02-13T20:17:37.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.929+0000 7f309f8c3640 10 monclient: _renew_subs 2026-02-13T20:17:37.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.929+0000 7f309f8c3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:17:37.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.929+0000 7f309f8c3640 1 -- 10.20.193.110:0/3752491433 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3098131170 con 0x7f3098091950 2026-02-13T20:17:37.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.929+0000 7f309f8c3640 10 monclient: _renew_subs 2026-02-13T20:17:37.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.929+0000 7f309f8c3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:17:37.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.929+0000 7f309f8c3640 1 -- 10.20.193.110:0/3752491433 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f3098132050 con 0x7f3098091950 2026-02-13T20:17:37.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.929+0000 7f3085ffb640 1 -- 10.20.193.110:0/3752491433 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3088004b90 con 0x7f3098091950 2026-02-13T20:17:37.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.929+0000 7f3085ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T20:17:37.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.929+0000 7f3085ffb640 1 -- 10.20.193.110:0/3752491433 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f3088004f70 con 0x7f3098091950 2026-02-13T20:17:37.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.929+0000 7f3085ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:37.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.929+0000 7f3085ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:17:37.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.929+0000 7f3085ffb640 10 monclient: dump: 2026-02-13T20:17:37.938 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:37.938 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:37.938 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:37.938 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:37.938 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:37.938 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:37.938 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:37.938 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:37.938 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:37.938 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:37.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.929+0000 7f30877fe640 4 set_mon_vals no callback set 2026-02-13T20:17:37.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.929+0000 7f309f8c3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:17:37.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.930+0000 7f309f8c3640 1 -- 10.20.193.110:0/3752491433 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f309808d090 con 0x7f3098092020 2026-02-13T20:17:37.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.930+0000 7f3085ffb640 1 -- 10.20.193.110:0/3752491433 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2491502067 0 0) 0x7f309808d090 con 0x7f3098092020 2026-02-13T20:17:37.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.930+0000 7f3085ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:17:37.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.930+0000 7f3085ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:37.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.930+0000 7f3085ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:37.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.930+0000 7f3085ffb640 10 monclient(hunting): my global_id is 94271 2026-02-13T20:17:37.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.930+0000 7f3085ffb640 1 -- 10.20.193.110:0/3752491433 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f309805d320 con 0x7f3098092020 2026-02-13T20:17:37.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.930+0000 7f3085ffb640 1 -- 10.20.193.110:0/3752491433 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f30880050d0 con 0x7f3098091950 2026-02-13T20:17:37.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.930+0000 7f3085ffb640 1 -- 10.20.193.110:0/3752491433 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(301..301 src has 1..301) ==== 3915+0+0 (unknown 1406538563 0 0) 0x7f308804eae0 con 0x7f3098091950 2026-02-13T20:17:37.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.930+0000 7f3085ffb640 1 -- 10.20.193.110:0/3752491433 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 356362599 0 0) 0x7f309805d320 con 0x7f3098092020 2026-02-13T20:17:37.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.930+0000 7f3085ffb640 1 -- 10.20.193.110:0/3752491433 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f309808d090 con 0x7f3098092020 2026-02-13T20:17:37.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.930+0000 7f3085ffb640 1 -- 10.20.193.110:0/3752491433 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f308c003f30 con 0x7f3098092020 2026-02-13T20:17:37.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.930+0000 7f3085ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:37.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.930+0000 7f3085ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:17:37.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.930+0000 7f3085ffb640 10 monclient: dump: 2026-02-13T20:17:37.938 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:37.938 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:37.939 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:37.939 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:37.939 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:37.939 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:37.939 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:37.939 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:37.939 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:37.939 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:37.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.930+0000 7f3085ffb640 1 -- 10.20.193.110:0/3752491433 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 25627121 0 0) 0x7f309808d090 con 0x7f3098092020 2026-02-13T20:17:37.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.930+0000 7f3085ffb640 1 -- 10.20.193.110:0/3752491433 --> v1:10.20.193.110:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f309808b450 con 0x7f3098092020 2026-02-13T20:17:37.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.930+0000 7f309de39640 10 monclient: get_auth_request con 0x7f306803f7a0 auth_method 0 2026-02-13T20:17:37.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.930+0000 7f3085ffb640 1 -- 10.20.193.110:0/3752491433 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f308c0054a0 con 0x7f3098092020 2026-02-13T20:17:37.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.930+0000 7f3085ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:17:37.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.930+0000 7f3085ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:17:37.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.930+0000 7f3085ffb640 1 -- 10.20.193.110:0/3752491433 >> v1:10.20.193.110:6790/0 conn(0x7f3098092020 legacy=0x7f3098127b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:37.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.930+0000 7f3085ffb640 1 -- 10.20.193.110:0/3752491433 >> v1:10.20.193.110:6790/0 conn(0x7f3098092020 legacy=0x7f3098127b20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:17:37.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.934+0000 7f309f8c3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:17:37.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.934+0000 7f309f8c3640 1 -- 10.20.193.110:0/3752491433 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3098055bb0 con 0x7f3098128230 2026-02-13T20:17:37.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.934+0000 7f3085ffb640 1 -- 10.20.193.110:0/3752491433 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 988521311 0 0) 0x7f3098055bb0 con 0x7f3098128230 2026-02-13T20:17:37.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.934+0000 7f3085ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:17:37.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.934+0000 7f3085ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:37.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.934+0000 7f3085ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:37.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.934+0000 7f3085ffb640 10 monclient(hunting): my global_id is 94274 2026-02-13T20:17:37.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.934+0000 7f3085ffb640 1 -- 10.20.193.110:0/3752491433 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f309808d090 con 0x7f3098128230 2026-02-13T20:17:37.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.934+0000 7f3085ffb640 1 -- 10.20.193.110:0/3752491433 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 231311464 0 0) 0x7f309808d090 con 0x7f3098128230 2026-02-13T20:17:37.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.934+0000 7f3085ffb640 1 -- 10.20.193.110:0/3752491433 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3098055bb0 con 0x7f3098128230 2026-02-13T20:17:37.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.934+0000 7f3085ffb640 1 -- 10.20.193.110:0/3752491433 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f308c004660 con 0x7f3098128230 2026-02-13T20:17:37.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.934+0000 7f3085ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:37.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.934+0000 7f3085ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:17:37.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.934+0000 7f3085ffb640 10 monclient: dump: 2026-02-13T20:17:37.940 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:37.940 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:37.940 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:37.940 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:37.940 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:37.940 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:37.940 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:37.940 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:37.940 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:37.940 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:37.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.934+0000 7f3085ffb640 1 -- 10.20.193.110:0/3752491433 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1487161358 0 0) 0x7f3098055bb0 con 0x7f3098128230 2026-02-13T20:17:37.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.934+0000 7f3085ffb640 1 -- 10.20.193.110:0/3752491433 --> v1:10.20.193.110:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f309808a0f0 con 0x7f3098128230 2026-02-13T20:17:37.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.934+0000 7f3085ffb640 1 -- 10.20.193.110:0/3752491433 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4503 (unknown 0 0 1933700596) 0x7f308c004a60 con 0x7f3098128230 2026-02-13T20:17:37.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.934+0000 7f3085ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:17:37.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.934+0000 7f3085ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:17:37.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.934+0000 7f3085ffb640 1 -- 10.20.193.110:0/3752491433 >> v1:10.20.193.110:6790/0 conn(0x7f3098128230 legacy=0x7f30981978a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:37.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.934+0000 7f3085ffb640 1 -- 10.20.193.110:0/3752491433 >> v1:10.20.193.110:6790/0 conn(0x7f3098128230 legacy=0x7f30981978a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:17:37.940 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:17:37.940 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:17:37.940 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:17:37.940 INFO:teuthology.orchestra.run.trial110.stdout: "state": "peon", 2026-02-13T20:17:37.940 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 26, 2026-02-13T20:17:37.940 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 129558, 2026-02-13T20:17:37.940 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:17:37.940 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:17:37.940 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:17:37.941 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:17:37.941 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 0, 2026-02-13T20:17:37.941 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:17:37.941 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:17:37.941 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:17:37.941 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:17:37.941 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:17:37.941 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:17:37.941 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:17:37.941 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:17:37.941 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:17:37.941 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:17:37.941 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:17:37.941 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:17:37.941 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:17:37.941 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:17:37.941 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:17:37.941 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:17:37.941 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:17:37.941 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:17:37.941 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:17:37.941 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:17:37.941 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:17:37.941 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:17:37.941 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:17:37.941 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:17:37.941 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:17:37.941 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:17:37.941 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:17:37.941 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:17:37.941 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:17:37.941 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:17:37.941 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:17:37.941 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:17:37.941 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:17:37.941 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:37.941 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:17:37.941 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:17:37.941 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:17:37.941 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:17:37.941 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:17:37.941 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:17:37.942 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:17:37.942 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:17:37.942 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:17:37.942 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:17:37.942 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:17:37.942 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:17:37.942 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:17:37.942 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:17:37.942 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:17:37.942 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:17:37.942 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:17:37.942 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:17:37.942 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:17:37.942 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:17:37.942 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:17:37.942 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:17:37.942 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:17:37.942 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:17:37.942 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:17:37.942 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:17:37.942 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:17:37.942 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:17:37.942 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:17:37.942 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:17:37.942 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:17:37.942 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:17:37.942 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:37.942 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:17:37.942 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:37.942 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:17:37.942 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:17:37.942 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:17:37.942 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:17:37.942 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:37.942 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:17:37.942 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:17:37.942 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:17:37.942 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:37.942 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:17:37.942 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:37.942 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:17:37.942 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:17:37.942 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:17:37.942 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:17:37.942 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:17:37.943 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:17:37.943 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:37.943 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:37.943 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:17:37.943 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:17:37.943 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:17:37.943 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:17:37.943 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:37.943 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:17:37.943 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:17:37.943 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:17:37.943 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:37.943 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:17:37.943 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:37.943 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:17:37.943 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:17:37.943 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:17:37.943 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:17:37.943 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:17:37.943 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:17:37.943 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:37.943 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:37.943 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:17:37.943 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:17:37.943 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:17:37.943 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:17:37.943 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:37.943 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:17:37.943 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:17:37.943 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:17:37.943 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:37.943 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:17:37.943 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:37.943 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:17:37.943 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:17:37.943 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:17:37.943 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:17:37.943 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:17:37.943 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:17:37.943 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:37.943 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:17:37.943 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:37.943 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:17:37.943 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:17:37.943 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:37.944 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:17:37.944 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:17:37.944 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:17:37.944 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:37.944 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:17:37.944 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:17:37.944 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:37.944 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:17:37.944 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:17:37.944 INFO:teuthology.orchestra.run.trial110.stdout: "num": 2 2026-02-13T20:17:37.944 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:37.944 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:17:37.944 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:17:37.944 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:37.944 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:17:37.944 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:17:37.944 INFO:teuthology.orchestra.run.trial110.stdout: "num": 2 2026-02-13T20:17:37.944 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:37.944 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:17:37.944 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:37.944 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:17:37.944 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:17:37.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.935+0000 7f309f8c3640 1 -- 10.20.193.110:0/3752491433 >> v1:10.20.193.188:6812/1623052694 conn(0x7f306803f7a0 legacy=0x7f306805fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:37.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.935+0000 7f309f8c3640 10 monclient: shutdown 2026-02-13T20:17:37.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.935+0000 7f309f8c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:17:37.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.935+0000 7f309f8c3640 1 -- 10.20.193.110:0/3752491433 >> v1:10.20.193.110:6790/0 conn(0x7f3098091950 legacy=0x7f3098088e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:37.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.935+0000 7f309de39640 1 -- 10.20.193.110:0/3752491433 reap_dead start 2026-02-13T20:17:37.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.935+0000 7f309de39640 1 -- 10.20.193.110:0/3752491433 reap_dead start 2026-02-13T20:17:37.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.935+0000 7f309f8c3640 1 -- 10.20.193.110:0/3752491433 shutdown_connections 2026-02-13T20:17:37.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.935+0000 7f309f8c3640 1 -- 10.20.193.110:0/3752491433 >> 10.20.193.110:0/3752491433 conn(0x7f3098054e90 msgr2=0x7f309808dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:17:37.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.935+0000 7f309f8c3640 1 -- 10.20.193.110:0/3752491433 shutdown_connections 2026-02-13T20:17:37.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:37.935+0000 7f309f8c3640 1 -- 10.20.193.110:0/3752491433 wait complete. 2026-02-13T20:17:37.945 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-13T20:17:37.945 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-13T20:17:37.945 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T20:17:38.009 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.007+0000 7fb9f54cc640 10 monclient: get_monmap_and_config 2026-02-13T20:17:38.009 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.007+0000 7fb9f54cc640 10 monclient: build_initial_monmap 2026-02-13T20:17:38.009 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.007+0000 7fb9f54cc640 10 monclient: monmap: 2026-02-13T20:17:38.009 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:17:38.009 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:38.009 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:17:38.008856+0000 2026-02-13T20:17:38.009 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:17:38.008856+0000 2026-02-13T20:17:38.009 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:17:38.009 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:38.009 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:17:38.009 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:17:38.009 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:17:38.009 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:38.015 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.007+0000 7fb9f54cc640 1 Processor -- start 2026-02-13T20:17:38.015 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.007+0000 7fb9f54cc640 1 -- start start 2026-02-13T20:17:38.016 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.007+0000 7fb9f54cc640 10 monclient: init 2026-02-13T20:17:38.016 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9f54cc640 10 monclient: _reopen_session rank -1 2026-02-13T20:17:38.016 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9f54cc640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:17:38.016 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9f54cc640 10 monclient(hunting): picked mon.noname-c con 0x7fb9f01401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:17:38.016 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9f54cc640 10 monclient(hunting): picked mon.noname-a con 0x7fb9f0092020 addr v1:10.20.193.110:6789/0 2026-02-13T20:17:38.016 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9f54cc640 10 monclient(hunting): picked mon.noname-b con 0x7fb9f0091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:17:38.016 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9f54cc640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9f008b730 con 0x7fb9f0092020 2026-02-13T20:17:38.016 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9f54cc640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9f005c5b0 con 0x7fb9f01401c0 2026-02-13T20:17:38.016 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9f54cc640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9f008bcf0 con 0x7fb9f0091950 2026-02-13T20:17:38.016 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9f54cc640 10 monclient(hunting): _renew_subs 2026-02-13T20:17:38.016 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9f54cc640 10 monclient(hunting): authenticate will time out at 1019.699196s 2026-02-13T20:17:38.016 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9ee7fc640 1 -- >> v1:10.20.193.110:6789/0 conn(0x7fb9f0092020 legacy=0x7fb9f01812f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:17:38.016 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9ef7fe640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fb9f0091950 0x7fb9f01a2a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:59744/0 (socket says 10.20.193.110:59744) 2026-02-13T20:17:38.016 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9ef7fe640 1 -- 10.20.193.110:0/2975202132 learned_addr learned my addr 10.20.193.110:0/2975202132 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:17:38.016 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9edffb640 1 -- 10.20.193.110:0/2975202132 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2198880708 0 0) 0x7fb9f008bcf0 con 0x7fb9f0091950 2026-02-13T20:17:38.016 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9edffb640 10 monclient(hunting): _negotiate 2026-02-13T20:17:38.016 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9edffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:38.017 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9edffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:38.017 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9edffb640 10 monclient(hunting): my global_id is 94277 2026-02-13T20:17:38.017 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9edffb640 1 -- 10.20.193.110:0/2975202132 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb9dc0035e0 con 0x7fb9f0091950 2026-02-13T20:17:38.017 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9edffb640 1 -- 10.20.193.110:0/2975202132 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3805906869 0 0) 0x7fb9f005c5b0 con 0x7fb9f01401c0 2026-02-13T20:17:38.017 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9edffb640 10 monclient(hunting): _negotiate 2026-02-13T20:17:38.017 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9edffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:38.017 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9edffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:38.017 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9edffb640 10 monclient(hunting): my global_id is 4702 2026-02-13T20:17:38.017 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9edffb640 1 -- 10.20.193.110:0/2975202132 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb9f008bcf0 con 0x7fb9f01401c0 2026-02-13T20:17:38.017 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9edffb640 1 -- 10.20.193.110:0/2975202132 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 787495292 0 0) 0x7fb9dc0035e0 con 0x7fb9f0091950 2026-02-13T20:17:38.017 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9edffb640 1 -- 10.20.193.110:0/2975202132 >> v1:10.20.193.188:6789/0 conn(0x7fb9f01401c0 legacy=0x7fb9f0091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:38.017 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9edffb640 1 -- 10.20.193.110:0/2975202132 >> v1:10.20.193.110:6789/0 conn(0x7fb9f0092020 legacy=0x7fb9f01812f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:17:38.017 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9edffb640 10 monclient: _finish_hunting 0 2026-02-13T20:17:38.017 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9edffb640 1 monclient: found mon.noname-b 2026-02-13T20:17:38.017 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9edffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:17:38.017 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9edffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:17:38.017 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9edffb640 1 -- 10.20.193.110:0/2975202132 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9f0140590 con 0x7fb9f0091950 2026-02-13T20:17:38.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9edffb640 10 monclient: _finish_auth 0 2026-02-13T20:17:38.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9edffb640 10 monclient: _check_auth_tickets 2026-02-13T20:17:38.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9edffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:17:38.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9edffb640 1 -- 10.20.193.110:0/2975202132 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb9e0003eb0 con 0x7fb9f0091950 2026-02-13T20:17:38.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9f54cc640 5 monclient: authenticate success, global_id 94277 2026-02-13T20:17:38.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9f54cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:17:38.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9edffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:38.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9edffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:17:38.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9edffb640 10 monclient: dump: 2026-02-13T20:17:38.018 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:38.018 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:38.018 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:38.018 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:38.018 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:38.018 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:38.018 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:38.018 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:38.019 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:38.019 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:38.019 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9f54cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:17:38.019 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9edffb640 1 -- 10.20.193.110:0/2975202132 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb9e0004080 con 0x7fb9f0091950 2026-02-13T20:17:38.019 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9edffb640 10 monclient: handle_config config(0 keys) 2026-02-13T20:17:38.019 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9edffb640 1 -- 10.20.193.110:0/2975202132 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb9e0004490 con 0x7fb9f0091950 2026-02-13T20:17:38.019 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9f54cc640 10 monclient: get_monmap_and_config success 2026-02-13T20:17:38.019 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9edffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:38.019 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9f54cc640 4 set_mon_vals no callback set 2026-02-13T20:17:38.019 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9edffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:17:38.019 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.008+0000 7fb9edffb640 10 monclient: dump: 2026-02-13T20:17:38.019 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:38.019 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:38.019 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:38.019 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:38.019 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:38.019 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:38.020 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:38.020 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:38.020 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:38.020 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:38.020 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.009+0000 7fb9f54cc640 10 monclient: shutdown 2026-02-13T20:17:38.020 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.009+0000 7fb9f54cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:17:38.020 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.009+0000 7fb9f54cc640 1 -- 10.20.193.110:0/2975202132 >> v1:10.20.193.110:6790/0 conn(0x7fb9f0091950 legacy=0x7fb9f01a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:38.020 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.009+0000 7fb9f54cc640 1 -- 10.20.193.110:0/2975202132 shutdown_connections 2026-02-13T20:17:38.020 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.009+0000 7fb9f54cc640 1 -- 10.20.193.110:0/2975202132 >> 10.20.193.110:0/2975202132 conn(0x7fb9f0054e90 msgr2=0x7fb9f0058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:17:38.020 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.009+0000 7fb9f54cc640 1 -- 10.20.193.110:0/2975202132 shutdown_connections 2026-02-13T20:17:38.020 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.009+0000 7fb9f54cc640 1 -- 10.20.193.110:0/2975202132 wait complete. 2026-02-13T20:17:38.020 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.009+0000 7fb9f54cc640 10 monclient: build_initial_monmap 2026-02-13T20:17:38.020 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.009+0000 7fb9f54cc640 10 monclient: monmap: 2026-02-13T20:17:38.020 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:17:38.020 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:17:38.020 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:17:38.020 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:17:38.021 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:17:38.021 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:17:38.021 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:17:38.021 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:17:38.021 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:17:38.021 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:38.021 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.009+0000 7fb9f54cc640 1 Processor -- start 2026-02-13T20:17:38.021 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.009+0000 7fb9f54cc640 1 -- start start 2026-02-13T20:17:38.021 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.009+0000 7fb9f54cc640 10 monclient: init 2026-02-13T20:17:38.021 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9f54cc640 10 monclient: _reopen_session rank -1 2026-02-13T20:17:38.021 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9f54cc640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:17:38.021 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9f54cc640 10 monclient(hunting): picked mon.noname-a con 0x7fb9f0091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:17:38.021 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9f54cc640 10 monclient(hunting): picked mon.noname-b con 0x7fb9f01401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:17:38.021 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9f54cc640 10 monclient(hunting): picked mon.noname-c con 0x7fb9f013dde0 addr v1:10.20.193.110:6790/0 2026-02-13T20:17:38.021 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9f54cc640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9f005d320 con 0x7fb9f0091950 2026-02-13T20:17:38.021 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9f54cc640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9f01310f0 con 0x7fb9f01401c0 2026-02-13T20:17:38.021 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9eeffd640 1 -- >> v1:10.20.193.110:6789/0 conn(0x7fb9f0091950 legacy=0x7fb9f013d6d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:17:38.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9f54cc640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9f013ea00 con 0x7fb9f013dde0 2026-02-13T20:17:38.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9f54cc640 10 monclient(hunting): _renew_subs 2026-02-13T20:17:38.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9f54cc640 10 monclient(hunting): authenticate will time out at 1019.701136s 2026-02-13T20:17:38.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9ef7fe640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fb9f013dde0 0x7fb9f01950f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:59760/0 (socket says 10.20.193.110:59760) 2026-02-13T20:17:38.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9ef7fe640 1 -- 10.20.193.110:0/2220496236 learned_addr learned my addr 10.20.193.110:0/2220496236 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:17:38.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9cf7fe640 1 -- 10.20.193.110:0/2220496236 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3008307095 0 0) 0x7fb9f013ea00 con 0x7fb9f013dde0 2026-02-13T20:17:38.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9cf7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:17:38.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9cf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:38.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9cf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:38.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9cf7fe640 10 monclient(hunting): my global_id is 94280 2026-02-13T20:17:38.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9cf7fe640 1 -- 10.20.193.110:0/2220496236 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb9bc0035e0 con 0x7fb9f013dde0 2026-02-13T20:17:38.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9cf7fe640 1 -- 10.20.193.110:0/2220496236 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1994257754 0 0) 0x7fb9bc0035e0 con 0x7fb9f013dde0 2026-02-13T20:17:38.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9cf7fe640 1 -- 10.20.193.110:0/2220496236 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb9f013ea00 con 0x7fb9f013dde0 2026-02-13T20:17:38.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9cf7fe640 1 -- 10.20.193.110:0/2220496236 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb9e00043a0 con 0x7fb9f013dde0 2026-02-13T20:17:38.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9cf7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:17:38.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9cf7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:17:38.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9cf7fe640 10 monclient(hunting): dump: 2026-02-13T20:17:38.022 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:38.022 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:38.023 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:38.023 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:38.023 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:38.023 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:38.023 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:38.023 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:38.023 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:38.023 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:38.023 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9cf7fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:17:38.023 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9cf7fe640 1 -- 10.20.193.110:0/2220496236 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1924400396 0 0) 0x7fb9f013ea00 con 0x7fb9f013dde0 2026-02-13T20:17:38.023 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9cf7fe640 1 -- 10.20.193.110:0/2220496236 >> v1:10.20.193.188:6789/0 conn(0x7fb9f01401c0 legacy=0x7fb9f01939d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:38.023 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9cf7fe640 1 -- 10.20.193.110:0/2220496236 >> v1:10.20.193.110:6789/0 conn(0x7fb9f0091950 legacy=0x7fb9f013d6d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T20:17:38.023 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9cf7fe640 10 monclient: _finish_hunting 0 2026-02-13T20:17:38.023 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9cf7fe640 1 monclient: found mon.c 2026-02-13T20:17:38.023 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9cf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:17:38.023 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9cf7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:17:38.023 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9cf7fe640 1 -- 10.20.193.110:0/2220496236 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9f008aeb0 con 0x7fb9f013dde0 2026-02-13T20:17:38.023 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9cf7fe640 10 monclient: _finish_auth 0 2026-02-13T20:17:38.023 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9cf7fe640 10 monclient: _check_auth_tickets 2026-02-13T20:17:38.024 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9cf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:17:38.024 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9f54cc640 5 monclient: authenticate success, global_id 94280 2026-02-13T20:17:38.024 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9f54cc640 10 monclient: _renew_subs 2026-02-13T20:17:38.024 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9f54cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:17:38.024 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9f54cc640 1 -- 10.20.193.110:0/2220496236 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb9f012ed90 con 0x7fb9f013dde0 2026-02-13T20:17:38.024 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9f54cc640 10 monclient: _renew_subs 2026-02-13T20:17:38.024 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9f54cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:17:38.024 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9f54cc640 1 -- 10.20.193.110:0/2220496236 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fb9f0130ec0 con 0x7fb9f013dde0 2026-02-13T20:17:38.024 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9cf7fe640 1 -- 10.20.193.110:0/2220496236 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb9e0005c30 con 0x7fb9f013dde0 2026-02-13T20:17:38.024 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9cf7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:17:38.024 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9cf7fe640 1 -- 10.20.193.110:0/2220496236 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb9e0005f50 con 0x7fb9f013dde0 2026-02-13T20:17:38.024 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9cf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:38.024 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9cf7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:17:38.024 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9ed7fa640 4 set_mon_vals no callback set 2026-02-13T20:17:38.024 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.010+0000 7fb9cf7fe640 10 monclient: dump: 2026-02-13T20:17:38.024 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:38.024 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:38.024 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:38.024 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:38.025 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:38.025 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:38.025 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:38.025 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:38.025 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:38.025 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:38.025 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.011+0000 7fb9f54cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:17:38.025 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.011+0000 7fb9f54cc640 1 -- 10.20.193.110:0/2220496236 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb9f00008d0 con 0x7fb9f0092020 2026-02-13T20:17:38.025 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.011+0000 7fb9cf7fe640 1 -- 10.20.193.110:0/2220496236 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fb9e0012bc0 con 0x7fb9f013dde0 2026-02-13T20:17:38.025 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.011+0000 7fb9cf7fe640 1 -- 10.20.193.110:0/2220496236 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(301..301 src has 1..301) ==== 3915+0+0 (unknown 1406538563 0 0) 0x7fb9e004f9c0 con 0x7fb9f013dde0 2026-02-13T20:17:38.025 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.011+0000 7fb9cf7fe640 1 -- 10.20.193.110:0/2220496236 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3191984078 0 0) 0x7fb9f00008d0 con 0x7fb9f0092020 2026-02-13T20:17:38.025 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.011+0000 7fb9cf7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:17:38.025 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.011+0000 7fb9cf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:38.025 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.011+0000 7fb9cf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:38.025 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.011+0000 7fb9cf7fe640 10 monclient(hunting): my global_id is 4708 2026-02-13T20:17:38.025 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.011+0000 7fb9cf7fe640 1 -- 10.20.193.110:0/2220496236 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb9f013ea00 con 0x7fb9f0092020 2026-02-13T20:17:38.025 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.011+0000 7fb9ee7fc640 10 monclient: get_auth_request con 0x7fb9bc03f5c0 auth_method 0 2026-02-13T20:17:38.025 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.011+0000 7fb9cf7fe640 1 -- 10.20.193.110:0/2220496236 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4018880754 0 0) 0x7fb9f013ea00 con 0x7fb9f0092020 2026-02-13T20:17:38.025 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.011+0000 7fb9cf7fe640 1 -- 10.20.193.110:0/2220496236 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb9f00008d0 con 0x7fb9f0092020 2026-02-13T20:17:38.025 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.011+0000 7fb9cf7fe640 1 -- 10.20.193.110:0/2220496236 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb9e4002f20 con 0x7fb9f0092020 2026-02-13T20:17:38.026 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.011+0000 7fb9cf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:38.026 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.011+0000 7fb9cf7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:17:38.026 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.011+0000 7fb9cf7fe640 10 monclient: dump: 2026-02-13T20:17:38.026 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:38.026 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:38.026 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:38.026 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:38.026 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:38.026 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:38.026 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:38.026 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:38.026 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:38.026 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:38.026 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.012+0000 7fb9cf7fe640 1 -- 10.20.193.110:0/2220496236 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 880785112 0 0) 0x7fb9f00008d0 con 0x7fb9f0092020 2026-02-13T20:17:38.026 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.012+0000 7fb9cf7fe640 1 -- 10.20.193.110:0/2220496236 --> v1:10.20.193.188:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb9f008b450 con 0x7fb9f0092020 2026-02-13T20:17:38.026 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.012+0000 7fb9cf7fe640 1 -- 10.20.193.110:0/2220496236 <== mon.1 v1:10.20.193.188:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fb9e40033e0 con 0x7fb9f0092020 2026-02-13T20:17:38.026 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.012+0000 7fb9cf7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:17:38.026 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.012+0000 7fb9cf7fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:17:38.026 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.012+0000 7fb9cf7fe640 1 -- 10.20.193.110:0/2220496236 >> v1:10.20.193.188:6789/0 conn(0x7fb9f0092020 legacy=0x7fb9f0127b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:38.026 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.012+0000 7fb9cf7fe640 1 -- 10.20.193.110:0/2220496236 >> v1:10.20.193.188:6789/0 conn(0x7fb9f0092020 legacy=0x7fb9f0127b20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:17:38.027 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.015+0000 7fb9f54cc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:17:38.028 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.015+0000 7fb9f54cc640 1 -- 10.20.193.110:0/2220496236 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb9f0152b00 con 0x7fb9f0152730 2026-02-13T20:17:38.028 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.016+0000 7fb9cf7fe640 1 -- 10.20.193.110:0/2220496236 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4287414385 0 0) 0x7fb9f0152b00 con 0x7fb9f0152730 2026-02-13T20:17:38.028 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.016+0000 7fb9cf7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:17:38.028 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.016+0000 7fb9cf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:17:38.028 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.016+0000 7fb9cf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:17:38.028 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.016+0000 7fb9cf7fe640 10 monclient(hunting): my global_id is 4711 2026-02-13T20:17:38.028 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.016+0000 7fb9cf7fe640 1 -- 10.20.193.110:0/2220496236 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb9f00008d0 con 0x7fb9f0152730 2026-02-13T20:17:38.028 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.016+0000 7fb9cf7fe640 1 -- 10.20.193.110:0/2220496236 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3463148149 0 0) 0x7fb9f00008d0 con 0x7fb9f0152730 2026-02-13T20:17:38.028 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.016+0000 7fb9cf7fe640 1 -- 10.20.193.110:0/2220496236 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb9f0152b00 con 0x7fb9f0152730 2026-02-13T20:17:38.028 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.016+0000 7fb9cf7fe640 1 -- 10.20.193.110:0/2220496236 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb9e4003af0 con 0x7fb9f0152730 2026-02-13T20:17:38.028 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.016+0000 7fb9cf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:17:38.028 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.016+0000 7fb9cf7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:17:38.028 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.016+0000 7fb9cf7fe640 10 monclient: dump: 2026-02-13T20:17:38.028 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:17:38.028 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:17:38.028 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:38.028 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:17:38.028 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:17:38.029 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:17:38.029 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:17:38.029 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:17:38.029 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:17:38.029 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:17:38.029 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.016+0000 7fb9cf7fe640 1 -- 10.20.193.110:0/2220496236 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 834772817 0 0) 0x7fb9f0152b00 con 0x7fb9f0152730 2026-02-13T20:17:38.029 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.016+0000 7fb9cf7fe640 1 -- 10.20.193.110:0/2220496236 --> v1:10.20.193.188:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb9f0058410 con 0x7fb9f0152730 2026-02-13T20:17:38.029 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.016+0000 7fb9cf7fe640 1 -- 10.20.193.110:0/2220496236 <== mon.1 v1:10.20.193.188:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4672 (unknown 0 0 4090001745) 0x7fb9e4005880 con 0x7fb9f0152730 2026-02-13T20:17:38.029 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.016+0000 7fb9cf7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:17:38.029 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.016+0000 7fb9cf7fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:17:38.029 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.016+0000 7fb9cf7fe640 1 -- 10.20.193.110:0/2220496236 >> v1:10.20.193.188:6789/0 conn(0x7fb9f0152730 legacy=0x7fb9f0128230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:38.029 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.016+0000 7fb9cf7fe640 1 -- 10.20.193.110:0/2220496236 >> v1:10.20.193.188:6789/0 conn(0x7fb9f0152730 legacy=0x7fb9f0128230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:17:38.029 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:17:38.029 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:17:38.029 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:17:38.029 INFO:teuthology.orchestra.run.trial110.stdout: "state": "leader", 2026-02-13T20:17:38.030 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 26, 2026-02-13T20:17:38.030 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 380163, 2026-02-13T20:17:38.030 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:17:38.030 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:17:38.030 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:17:38.030 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:17:38.030 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 0, 2026-02-13T20:17:38.030 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:17:38.030 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:17:38.030 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:17:38.030 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:17:38.030 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:17:38.030 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:17:38.030 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:17:38.030 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:17:38.030 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:17:38.030 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:17:38.030 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:17:38.030 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:17:38.030 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:17:38.030 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:17:38.031 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:17:38.031 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:17:38.031 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:17:38.031 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:17:38.031 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:17:38.031 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:17:38.031 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:17:38.031 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:17:38.031 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:17:38.031 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:17:38.031 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:17:38.031 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:17:38.031 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:17:38.031 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:17:38.031 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:17:38.031 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:17:38.031 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:17:38.031 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:17:38.031 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:17:38.031 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:38.031 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:17:38.032 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:17:38.032 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:17:38.032 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:17:38.032 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:17:38.032 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:17:38.032 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:17:38.032 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:17:38.032 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:17:38.032 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:17:38.032 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:17:38.032 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:17:38.032 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:17:38.032 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:17:38.032 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:17:38.032 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:17:38.032 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:17:38.032 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:17:38.032 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:17:38.032 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:17:38.032 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:17:38.032 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:17:38.032 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:17:38.032 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:17:38.033 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:17:38.033 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:17:38.033 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:17:38.033 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:17:38.033 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:17:38.033 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:17:38.033 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:17:38.033 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:17:38.033 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:38.033 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:17:38.033 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:38.033 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:17:38.033 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:17:38.033 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:17:38.033 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:17:38.033 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:38.033 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:17:38.033 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:17:38.033 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:17:38.033 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:38.033 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:17:38.033 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:38.033 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:17:38.034 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:17:38.034 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:17:38.034 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:17:38.034 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:17:38.034 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:17:38.034 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:38.034 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:38.034 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:17:38.034 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:17:38.034 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:17:38.034 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:17:38.034 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:38.034 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:17:38.034 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:17:38.034 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:17:38.034 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:38.034 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:17:38.034 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:38.034 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:17:38.034 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:17:38.034 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:17:38.034 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:17:38.034 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:17:38.034 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:17:38.034 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:38.035 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:38.035 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:17:38.035 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:17:38.035 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:17:38.035 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:17:38.035 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:38.035 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:17:38.035 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:17:38.035 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:17:38.035 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:38.035 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:17:38.035 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:38.035 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:17:38.035 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:17:38.035 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:17:38.035 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:17:38.035 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:17:38.035 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:17:38.035 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:38.035 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:17:38.035 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:38.035 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:17:38.035 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:17:38.035 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:38.036 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:17:38.036 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:17:38.036 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:17:38.036 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:38.036 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:17:38.036 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:17:38.036 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:38.036 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:17:38.036 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:17:38.036 INFO:teuthology.orchestra.run.trial110.stdout: "num": 4 2026-02-13T20:17:38.036 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:38.036 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:17:38.036 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:17:38.036 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:38.036 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:17:38.036 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:17:38.036 INFO:teuthology.orchestra.run.trial110.stdout: "num": 6 2026-02-13T20:17:38.036 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:38.036 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:17:38.036 INFO:teuthology.orchestra.run.trial110.stdout: "mgr": [ 2026-02-13T20:17:38.036 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:17:38.036 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:17:38.036 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:17:38.036 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:17:38.036 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:17:38.036 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:17:38.036 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:17:38.037 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:17:38.037 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:17:38.037 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.016+0000 7fb9f54cc640 1 -- 10.20.193.110:0/2220496236 >> v1:10.20.193.188:6812/1623052694 conn(0x7fb9bc03f5c0 legacy=0x7fb9bc05fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:38.037 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.016+0000 7fb9f54cc640 10 monclient: shutdown 2026-02-13T20:17:38.037 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.016+0000 7fb9f54cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:17:38.037 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.016+0000 7fb9f54cc640 1 -- 10.20.193.110:0/2220496236 >> v1:10.20.193.110:6790/0 conn(0x7fb9f013dde0 legacy=0x7fb9f01950f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:17:38.038 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.016+0000 7fb9ef7fe640 1 -- 10.20.193.110:0/2220496236 reap_dead start 2026-02-13T20:17:38.038 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.016+0000 7fb9ef7fe640 1 -- 10.20.193.110:0/2220496236 reap_dead start 2026-02-13T20:17:38.038 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.016+0000 7fb9f54cc640 1 -- 10.20.193.110:0/2220496236 shutdown_connections 2026-02-13T20:17:38.038 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.016+0000 7fb9f54cc640 1 -- 10.20.193.110:0/2220496236 >> 10.20.193.110:0/2220496236 conn(0x7fb9f0054e90 msgr2=0x7fb9f013ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:17:38.038 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.016+0000 7fb9f54cc640 1 -- 10.20.193.110:0/2220496236 shutdown_connections 2026-02-13T20:17:38.038 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:17:38.016+0000 7fb9f54cc640 1 -- 10.20.193.110:0/2220496236 wait complete. 2026-02-13T20:17:38.038 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-13T20:17:38.038 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-13T20:17:38.699 INFO:tasks.rados.rados.0.trial188.stdout:1439: done (4 left) 2026-02-13T20:17:38.700 INFO:tasks.rados.rados.0.trial188.stdout:1440: done (3 left) 2026-02-13T20:17:38.700 INFO:tasks.rados.rados.0.trial188.stdout:1441: done (2 left) 2026-02-13T20:17:38.700 INFO:tasks.rados.rados.0.trial188.stdout:1442: done (1 left) 2026-02-13T20:17:38.700 INFO:tasks.rados.rados.0.trial188.stdout:1443: done (0 left) 2026-02-13T20:17:38.700 INFO:tasks.rados.rados.0.trial188.stdout:1444: delete oid 32 current snap is 141 2026-02-13T20:17:38.703 INFO:tasks.rados.rados.0.trial188.stdout:1444: done (0 left) 2026-02-13T20:17:38.703 INFO:tasks.rados.rados.0.trial188.stdout:1445: rollback oid 1 current snap is 141 2026-02-13T20:17:38.703 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 1 to 134 2026-02-13T20:17:38.703 INFO:tasks.rados.rados.0.trial188.stdout:1446: read oid 12 snap -1 2026-02-13T20:17:38.703 INFO:tasks.rados.rados.0.trial188.stdout:1446: expect (ObjNum 501 snap 130 seq_num 501) 2026-02-13T20:17:38.703 INFO:tasks.rados.rados.0.trial188.stdout:1447: write (excl) oid 9 current snap is 141 2026-02-13T20:17:38.703 INFO:tasks.rados.rados.0.trial188.stdout:1447: seq_num 542 ranges {709394=646021,2083358=718180} 2026-02-13T20:17:38.708 INFO:tasks.rados.rados.0.trial188.stdout:1447: writing trial18843701-9 from 709394 to 1355415 tid 1 2026-02-13T20:17:38.714 INFO:tasks.rados.rados.0.trial188.stdout:1447: writing trial18843701-9 from 2083358 to 2801538 tid 2 2026-02-13T20:17:38.714 INFO:tasks.rados.rados.0.trial188.stdout:1448: rollback oid 20 current snap is 141 2026-02-13T20:17:38.714 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 20 to 139 2026-02-13T20:17:38.714 INFO:tasks.rados.rados.0.trial188.stdout:1445: finishing rollback tid 0 to trial18843701-1 2026-02-13T20:17:38.714 INFO:tasks.rados.rados.0.trial188.stdout:1445: finishing rollback tid 1 to trial18843701-1 2026-02-13T20:17:38.714 INFO:tasks.rados.rados.0.trial188.stdout:1445: finishing rollback tid 2 to trial18843701-1 2026-02-13T20:17:38.714 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 1 v 580 (ObjNum 498 snap 128 seq_num 498) dirty exists 2026-02-13T20:17:38.714 INFO:tasks.rados.rados.0.trial188.stdout:1446: expect (ObjNum 501 snap 130 seq_num 501) 2026-02-13T20:17:38.738 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 249252 2026-02-13T20:17:38.760 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:17:38.784 INFO:tasks.rados.rados.0.trial188.stdout:1448: finishing rollback tid 0 to trial18843701-20 2026-02-13T20:17:38.784 INFO:tasks.rados.rados.0.trial188.stdout:1448: finishing rollback tid 1 to trial18843701-20 2026-02-13T20:17:38.785 INFO:tasks.rados.rados.0.trial188.stdout:1448: finishing rollback tid 2 to trial18843701-20 2026-02-13T20:17:38.785 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 20 v 332 (ObjNum 531 snap 136 seq_num 531) dirty exists 2026-02-13T20:17:38.785 INFO:tasks.rados.rados.0.trial188.stdout:1447: finishing write tid 1 to trial18843701-9 2026-02-13T20:17:38.785 INFO:tasks.rados.rados.0.trial188.stdout:1447: finishing write tid 2 to trial18843701-9 2026-02-13T20:17:38.785 INFO:tasks.rados.rados.0.trial188.stdout:1447: finishing write tid 3 to trial18843701-9 2026-02-13T20:17:38.785 INFO:tasks.rados.rados.0.trial188.stdout:1447: finishing write tid 4 to trial18843701-9 2026-02-13T20:17:38.785 INFO:tasks.rados.rados.0.trial188.stdout:1447: oid 9 updating version 0 to 457 2026-02-13T20:17:38.785 INFO:tasks.rados.rados.0.trial188.stdout:1447: oid 9 version 457 is already newer than 456 2026-02-13T20:17:38.785 INFO:tasks.rados.rados.0.trial188.stdout:1447: oid 9 version 457 is already newer than 455 2026-02-13T20:17:38.785 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 9 v 457 (ObjNum 542 snap 141 seq_num 542) dirty exists 2026-02-13T20:17:38.786 INFO:tasks.rados.rados.0.trial188.stdout:1447: left oid 9 (ObjNum 542 snap 141 seq_num 542) 2026-02-13T20:17:38.786 INFO:tasks.rados.rados.0.trial188.stdout:1445: done (3 left) 2026-02-13T20:17:38.786 INFO:tasks.rados.rados.0.trial188.stdout:1446: done (2 left) 2026-02-13T20:17:38.786 INFO:tasks.rados.rados.0.trial188.stdout:1447: done (1 left) 2026-02-13T20:17:38.786 INFO:tasks.rados.rados.0.trial188.stdout:1448: done (0 left) 2026-02-13T20:17:38.786 INFO:tasks.rados.rados.0.trial188.stdout:1449: snap_remove snap 139 2026-02-13T20:17:39.704 INFO:tasks.rados.rados.0.trial188.stdout:1449: done (0 left) 2026-02-13T20:17:39.704 INFO:tasks.rados.rados.0.trial188.stdout:1450: rollback oid 36 current snap is 141 2026-02-13T20:17:39.704 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 36 to 138 2026-02-13T20:17:39.704 INFO:tasks.rados.rados.0.trial188.stdout:1451: write oid 14 current snap is 141 2026-02-13T20:17:39.704 INFO:tasks.rados.rados.0.trial188.stdout:1451: seq_num 543 ranges {726201=721270,2141840=578191} 2026-02-13T20:17:39.708 INFO:tasks.rados.rados.0.trial188.stdout:1451: writing trial18843701-14 from 726201 to 1447471 tid 1 2026-02-13T20:17:39.714 INFO:tasks.rados.rados.0.trial188.stdout:1451: writing trial18843701-14 from 2141840 to 2720031 tid 2 2026-02-13T20:17:39.714 INFO:tasks.rados.rados.0.trial188.stdout:1452: copy_from oid 19 from oid 1 current snap is 141 2026-02-13T20:17:39.714 INFO:tasks.rados.rados.0.trial188.stdout:1450: finishing rollback tid 0 to trial18843701-36 2026-02-13T20:17:39.714 INFO:tasks.rados.rados.0.trial188.stdout:1450: finishing rollback tid 1 to trial18843701-36 2026-02-13T20:17:39.714 INFO:tasks.rados.rados.0.trial188.stdout:1450: finishing rollback tid 2 to trial18843701-36 2026-02-13T20:17:39.714 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 36 v 668 (ObjNum 472 snap 122 seq_num 472) dirty exists 2026-02-13T20:17:39.714 INFO:tasks.rados.rados.0.trial188.stdout:1450: done (2 left) 2026-02-13T20:17:39.714 INFO:tasks.rados.rados.0.trial188.stdout:1453: read oid 43 snap -1 2026-02-13T20:17:39.714 INFO:tasks.rados.rados.0.trial188.stdout:1453: expect (ObjNum 435 snap 112 seq_num 435) 2026-02-13T20:17:39.714 INFO:tasks.rados.rados.0.trial188.stdout:1454: rollback oid 30 current snap is 141 2026-02-13T20:17:39.714 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 30 to 134 2026-02-13T20:17:39.714 INFO:tasks.rados.rados.0.trial188.stdout:1455: delete oid 27 current snap is 141 2026-02-13T20:17:39.715 INFO:tasks.rados.rados.0.trial188.stdout:1453: expect (ObjNum 435 snap 112 seq_num 435) 2026-02-13T20:17:39.784 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2021493 2026-02-13T20:17:39.801 INFO:tasks.rados.rados.0.trial188.stdout:1454: finishing rollback tid 0 to trial18843701-30 2026-02-13T20:17:39.801 INFO:tasks.rados.rados.0.trial188.stdout:1454: finishing rollback tid 1 to trial18843701-30 2026-02-13T20:17:39.801 INFO:tasks.rados.rados.0.trial188.stdout:1454: finishing rollback tid 2 to trial18843701-30 2026-02-13T20:17:39.801 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 30 v 627 (ObjNum 485 snap 126 seq_num 485) dirty exists 2026-02-13T20:17:39.801 INFO:tasks.rados.rados.0.trial188.stdout:1451: finishing write tid 1 to trial18843701-14 2026-02-13T20:17:39.802 INFO:tasks.rados.rados.0.trial188.stdout:1451: finishing write tid 2 to trial18843701-14 2026-02-13T20:17:39.802 INFO:tasks.rados.rados.0.trial188.stdout:1451: finishing write tid 3 to trial18843701-14 2026-02-13T20:17:39.802 INFO:tasks.rados.rados.0.trial188.stdout:1451: finishing write tid 4 to trial18843701-14 2026-02-13T20:17:39.802 INFO:tasks.rados.rados.0.trial188.stdout:1451: oid 14 updating version 0 to 464 2026-02-13T20:17:39.802 INFO:tasks.rados.rados.0.trial188.stdout:1451: oid 14 version 464 is already newer than 463 2026-02-13T20:17:39.802 INFO:tasks.rados.rados.0.trial188.stdout:1451: oid 14 updating version 464 to 465 2026-02-13T20:17:39.802 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 14 v 465 (ObjNum 543 snap 141 seq_num 543) dirty exists 2026-02-13T20:17:39.802 INFO:tasks.rados.rados.0.trial188.stdout:1451: left oid 14 (ObjNum 543 snap 141 seq_num 543) 2026-02-13T20:17:39.802 INFO:tasks.rados.rados.0.trial188.stdout:1452: finishing copy_from racing read to trial18843701-19 2026-02-13T20:17:39.802 INFO:tasks.rados.rados.0.trial188.stdout:1452: finishing copy_from to trial18843701-19 2026-02-13T20:17:39.802 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 19 v 580 (ObjNum 498 snap 128 seq_num 498) dirty exists 2026-02-13T20:17:39.802 INFO:tasks.rados.rados.0.trial188.stdout:1451: done (4 left) 2026-02-13T20:17:39.803 INFO:tasks.rados.rados.0.trial188.stdout:1452: done (3 left) 2026-02-13T20:17:39.803 INFO:tasks.rados.rados.0.trial188.stdout:1453: done (2 left) 2026-02-13T20:17:39.803 INFO:tasks.rados.rados.0.trial188.stdout:1454: done (1 left) 2026-02-13T20:17:39.803 INFO:tasks.rados.rados.0.trial188.stdout:1455: done (0 left) 2026-02-13T20:17:39.803 INFO:tasks.rados.rados.0.trial188.stdout:1456: copy_from oid 38 from oid 42 current snap is 141 2026-02-13T20:17:39.803 INFO:tasks.rados.rados.0.trial188.stdout:1457: read oid 22 snap -1 2026-02-13T20:17:39.803 INFO:tasks.rados.rados.0.trial188.stdout:1457: expect deleted 2026-02-13T20:17:39.803 INFO:tasks.rados.rados.0.trial188.stdout:1458: write (excl) oid 3 current snap is 141 2026-02-13T20:17:39.803 INFO:tasks.rados.rados.0.trial188.stdout:1458: seq_num 545 ranges {759815=471768,1742451=465507,2917178=242637} 2026-02-13T20:17:39.805 INFO:tasks.rados.rados.0.trial188.stdout:1458: writing trial18843701-3 from 759815 to 1231583 tid 1 2026-02-13T20:17:39.808 INFO:tasks.rados.rados.0.trial188.stdout:1458: writing trial18843701-3 from 1742451 to 2207958 tid 2 2026-02-13T20:17:39.812 INFO:tasks.rados.rados.0.trial188.stdout:1458: writing trial18843701-3 from 2917178 to 3159815 tid 3 2026-02-13T20:17:39.812 INFO:tasks.rados.rados.0.trial188.stdout:1459: write oid 1 current snap is 141 2026-02-13T20:17:39.812 INFO:tasks.rados.rados.0.trial188.stdout:1459: seq_num 546 ranges {776622=547017,1800933=725518,2944601=232021} 2026-02-13T20:17:39.817 INFO:tasks.rados.rados.0.trial188.stdout:1459: writing trial18843701-1 from 776622 to 1323639 tid 1 2026-02-13T20:17:39.821 INFO:tasks.rados.rados.0.trial188.stdout:1459: writing trial18843701-1 from 1800933 to 2526451 tid 2 2026-02-13T20:17:39.824 INFO:tasks.rados.rados.0.trial188.stdout:1459: writing trial18843701-1 from 2944601 to 3176622 tid 3 2026-02-13T20:17:39.825 INFO:tasks.rados.rados.0.trial188.stdout:1460: read oid 29 snap -1 2026-02-13T20:17:39.825 INFO:tasks.rados.rados.0.trial188.stdout:1460: expect (ObjNum 417 snap 111 seq_num 417) 2026-02-13T20:17:39.825 INFO:tasks.rados.rados.0.trial188.stdout:1461: read oid 32 snap -1 2026-02-13T20:17:39.825 INFO:tasks.rados.rados.0.trial188.stdout:1461: expect deleted 2026-02-13T20:17:39.825 INFO:tasks.rados.rados.0.trial188.stdout:1462: delete oid 39 current snap is 141 2026-02-13T20:17:39.825 INFO:tasks.rados.rados.0.trial188.stdout:1458: finishing write tid 1 to trial18843701-3 2026-02-13T20:17:39.825 INFO:tasks.rados.rados.0.trial188.stdout:1458: finishing write tid 2 to trial18843701-3 2026-02-13T20:17:39.825 INFO:tasks.rados.rados.0.trial188.stdout:1458: finishing write tid 3 to trial18843701-3 2026-02-13T20:17:39.825 INFO:tasks.rados.rados.0.trial188.stdout:1458: finishing write tid 4 to trial18843701-3 2026-02-13T20:17:39.825 INFO:tasks.rados.rados.0.trial188.stdout:1458: finishing write tid 5 to trial18843701-3 2026-02-13T20:17:39.825 INFO:tasks.rados.rados.0.trial188.stdout:1458: oid 3 updating version 0 to 469 2026-02-13T20:17:39.826 INFO:tasks.rados.rados.0.trial188.stdout:1458: oid 3 version 469 is already newer than 467 2026-02-13T20:17:39.826 INFO:tasks.rados.rados.0.trial188.stdout:1458: oid 3 version 469 is already newer than 468 2026-02-13T20:17:39.826 INFO:tasks.rados.rados.0.trial188.stdout:1458: oid 3 version 469 is already newer than 466 2026-02-13T20:17:39.826 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 3 v 469 (ObjNum 545 snap 141 seq_num 545) dirty exists 2026-02-13T20:17:39.826 INFO:tasks.rados.rados.0.trial188.stdout:1458: left oid 3 (ObjNum 545 snap 141 seq_num 545) 2026-02-13T20:17:39.832 INFO:tasks.rados.rados.0.trial188.stdout:1460: expect (ObjNum 417 snap 111 seq_num 417) 2026-02-13T20:17:39.868 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2030258 2026-02-13T20:17:39.879 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:17:39.908 INFO:tasks.rados.rados.0.trial188.stdout:1456: finishing copy_from racing read to trial18843701-38 2026-02-13T20:17:39.909 INFO:tasks.rados.rados.0.trial188.stdout:1456: finishing copy_from to trial18843701-38 2026-02-13T20:17:39.909 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 38 v 424 (ObjNum 534 snap 136 seq_num 534) dirty exists 2026-02-13T20:17:39.909 INFO:tasks.rados.rados.0.trial188.stdout:1459: finishing write tid 1 to trial18843701-1 2026-02-13T20:17:39.909 INFO:tasks.rados.rados.0.trial188.stdout:1459: finishing write tid 2 to trial18843701-1 2026-02-13T20:17:39.909 INFO:tasks.rados.rados.0.trial188.stdout:1459: finishing write tid 3 to trial18843701-1 2026-02-13T20:17:39.909 INFO:tasks.rados.rados.0.trial188.stdout:1459: finishing write tid 4 to trial18843701-1 2026-02-13T20:17:39.909 INFO:tasks.rados.rados.0.trial188.stdout:1459: finishing write tid 5 to trial18843701-1 2026-02-13T20:17:39.909 INFO:tasks.rados.rados.0.trial188.stdout:1459: oid 1 updating version 0 to 583 2026-02-13T20:17:39.909 INFO:tasks.rados.rados.0.trial188.stdout:1459: oid 1 updating version 583 to 584 2026-02-13T20:17:39.909 INFO:tasks.rados.rados.0.trial188.stdout:1459: oid 1 updating version 584 to 586 2026-02-13T20:17:39.909 INFO:tasks.rados.rados.0.trial188.stdout:1459: oid 1 version 586 is already newer than 585 2026-02-13T20:17:39.909 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 1 v 586 (ObjNum 546 snap 141 seq_num 546) dirty exists 2026-02-13T20:17:39.909 INFO:tasks.rados.rados.0.trial188.stdout:1459: left oid 1 (ObjNum 546 snap 141 seq_num 546) 2026-02-13T20:17:39.909 INFO:tasks.rados.rados.0.trial188.stdout:1456: done (6 left) 2026-02-13T20:17:39.909 INFO:tasks.rados.rados.0.trial188.stdout:1457: done (5 left) 2026-02-13T20:17:39.909 INFO:tasks.rados.rados.0.trial188.stdout:1458: done (4 left) 2026-02-13T20:17:39.909 INFO:tasks.rados.rados.0.trial188.stdout:1459: done (3 left) 2026-02-13T20:17:39.910 INFO:tasks.rados.rados.0.trial188.stdout:1460: done (2 left) 2026-02-13T20:17:39.910 INFO:tasks.rados.rados.0.trial188.stdout:1461: done (1 left) 2026-02-13T20:17:39.910 INFO:tasks.rados.rados.0.trial188.stdout:1462: done (0 left) 2026-02-13T20:17:39.910 INFO:tasks.rados.rados.0.trial188.stdout:1463: snap_create 2026-02-13T20:17:40.707 INFO:tasks.rados.rados.0.trial188.stdout:1463: done (0 left) 2026-02-13T20:17:40.707 INFO:tasks.rados.rados.0.trial188.stdout:1464: snap_create 2026-02-13T20:17:41.708 INFO:tasks.rados.rados.0.trial188.stdout:1464: done (0 left) 2026-02-13T20:17:41.709 INFO:tasks.rados.rados.0.trial188.stdout:1465: read oid 24 snap -1 2026-02-13T20:17:41.709 INFO:tasks.rados.rados.0.trial188.stdout:1465: expect deleted 2026-02-13T20:17:41.709 INFO:tasks.rados.rados.0.trial188.stdout:1466: copy_from oid 19 from oid 38 current snap is 143 2026-02-13T20:17:41.709 INFO:tasks.rados.rados.0.trial188.stdout:1467: delete oid 40 current snap is 143 2026-02-13T20:17:41.712 INFO:tasks.rados.rados.0.trial188.stdout:1465: done (2 left) 2026-02-13T20:17:41.712 INFO:tasks.rados.rados.0.trial188.stdout:1467: done (1 left) 2026-02-13T20:17:41.712 INFO:tasks.rados.rados.0.trial188.stdout:1468: read oid 41 snap 135 2026-02-13T20:17:41.712 INFO:tasks.rados.rados.0.trial188.stdout:1468: expect (ObjNum 469 snap 121 seq_num 469) 2026-02-13T20:17:41.712 INFO:tasks.rados.rados.0.trial188.stdout:1469: write (excl) oid 33 current snap is 143 2026-02-13T20:17:41.712 INFO:tasks.rados.rados.0.trial188.stdout:1469: seq_num 549 ranges {427043=489117,1576379=472845,2626870=600173} 2026-02-13T20:17:41.715 INFO:tasks.rados.rados.0.trial188.stdout:1469: writing trial18843701-33 from 427043 to 916160 tid 1 2026-02-13T20:17:41.720 INFO:tasks.rados.rados.0.trial188.stdout:1469: writing trial18843701-33 from 1576379 to 2049224 tid 2 2026-02-13T20:17:41.725 INFO:tasks.rados.rados.0.trial188.stdout:1469: writing trial18843701-33 from 2626870 to 3227043 tid 3 2026-02-13T20:17:41.725 INFO:tasks.rados.rados.0.trial188.stdout:1470: read oid 2 snap -1 2026-02-13T20:17:41.725 INFO:tasks.rados.rados.0.trial188.stdout:1470: expect (ObjNum 490 snap 127 seq_num 490) 2026-02-13T20:17:41.725 INFO:tasks.rados.rados.0.trial188.stdout:1471: snap_remove snap 142 2026-02-13T20:17:42.692 INFO:tasks.rados.rados.0.trial188.stdout:1471: done (4 left) 2026-02-13T20:17:42.692 INFO:tasks.rados.rados.0.trial188.stdout:1472: snap_remove snap 138 2026-02-13T20:17:43.692 INFO:tasks.rados.rados.0.trial188.stdout:1472: done (4 left) 2026-02-13T20:17:43.692 INFO:tasks.rados.rados.0.trial188.stdout:1473: snap_remove snap 141 2026-02-13T20:17:44.692 INFO:tasks.rados.rados.0.trial188.stdout:1473: done (4 left) 2026-02-13T20:17:44.693 INFO:tasks.rados.rados.0.trial188.stdout:1474: copy_from oid 37 from oid 11 current snap is 143 2026-02-13T20:17:44.693 INFO:tasks.rados.rados.0.trial188.stdout:1468: expect (ObjNum 469 snap 121 seq_num 469) 2026-02-13T20:17:44.809 INFO:tasks.rados.rados.0.trial188.stdout:1470: expect (ObjNum 490 snap 127 seq_num 490) 2026-02-13T20:17:44.809 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:17:44.890 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2011653 2026-02-13T20:17:44.900 INFO:tasks.rados.rados.0.trial188.stdout:1469: finishing write tid 1 to trial18843701-33 2026-02-13T20:17:44.900 INFO:tasks.rados.rados.0.trial188.stdout:1468: done (4 left) 2026-02-13T20:17:44.900 INFO:tasks.rados.rados.0.trial188.stdout:1470: done (3 left) 2026-02-13T20:17:44.900 INFO:tasks.rados.rados.0.trial188.stdout:1475: snap_create 2026-02-13T20:17:44.900 INFO:tasks.rados.rados.0.trial188.stdout:1469: finishing write tid 2 to trial18843701-33 2026-02-13T20:17:44.900 INFO:tasks.rados.rados.0.trial188.stdout:1469: finishing write tid 3 to trial18843701-33 2026-02-13T20:17:44.900 INFO:tasks.rados.rados.0.trial188.stdout:1469: finishing write tid 4 to trial18843701-33 2026-02-13T20:17:44.900 INFO:tasks.rados.rados.0.trial188.stdout:1469: finishing write tid 5 to trial18843701-33 2026-02-13T20:17:44.900 INFO:tasks.rados.rados.0.trial188.stdout:1469: oid 33 updating version 0 to 422 2026-02-13T20:17:44.900 INFO:tasks.rados.rados.0.trial188.stdout:1469: oid 33 updating version 422 to 425 2026-02-13T20:17:44.901 INFO:tasks.rados.rados.0.trial188.stdout:1469: oid 33 version 425 is already newer than 424 2026-02-13T20:17:44.901 INFO:tasks.rados.rados.0.trial188.stdout:1469: oid 33 version 425 is already newer than 423 2026-02-13T20:17:44.901 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 33 v 425 (ObjNum 549 snap 143 seq_num 549) dirty exists 2026-02-13T20:17:44.901 INFO:tasks.rados.rados.0.trial188.stdout:1469: left oid 33 (ObjNum 549 snap 143 seq_num 549) 2026-02-13T20:17:44.901 INFO:tasks.rados.rados.0.trial188.stdout:1466: finishing copy_from racing read to trial18843701-19 2026-02-13T20:17:44.901 INFO:tasks.rados.rados.0.trial188.stdout:1466: finishing copy_from to trial18843701-19 2026-02-13T20:17:44.901 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 19 v 424 (ObjNum 534 snap 136 seq_num 534) dirty exists 2026-02-13T20:17:44.901 INFO:tasks.rados.rados.0.trial188.stdout:1474: finishing copy_from racing read to trial18843701-37 2026-02-13T20:17:44.901 INFO:tasks.rados.rados.0.trial188.stdout:1474: finishing copy_from to trial18843701-37 2026-02-13T20:17:44.901 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 37 v 374 (ObjNum 530 snap 136 seq_num 530) dirty exists 2026-02-13T20:17:45.714 INFO:tasks.rados.rados.0.trial188.stdout:1466: done (3 left) 2026-02-13T20:17:45.715 INFO:tasks.rados.rados.0.trial188.stdout:1469: done (2 left) 2026-02-13T20:17:45.715 INFO:tasks.rados.rados.0.trial188.stdout:1474: done (1 left) 2026-02-13T20:17:45.715 INFO:tasks.rados.rados.0.trial188.stdout:1475: done (0 left) 2026-02-13T20:17:45.715 INFO:tasks.rados.rados.0.trial188.stdout:1476: write (excl) oid 30 current snap is 144 2026-02-13T20:17:45.715 INFO:tasks.rados.rados.0.trial188.stdout:1476: seq_num 550 ranges {443850=564366,1634861=732856,2770646=473204} 2026-02-13T20:17:45.718 INFO:tasks.rados.rados.0.trial188.stdout:1476: writing trial18843701-30 from 443850 to 1008216 tid 1 2026-02-13T20:17:45.724 INFO:tasks.rados.rados.0.trial188.stdout:1476: writing trial18843701-30 from 1634861 to 2367717 tid 2 2026-02-13T20:17:45.727 INFO:tasks.rados.rados.0.trial188.stdout:1476: writing trial18843701-30 from 2770646 to 3243850 tid 3 2026-02-13T20:17:45.727 INFO:tasks.rados.rados.0.trial188.stdout:1477: write oid 22 current snap is 144 2026-02-13T20:17:45.728 INFO:tasks.rados.rados.0.trial188.stdout:1477: seq_num 551 ranges {460657=639615,1693343=476514,2681716=578941} 2026-02-13T20:17:45.731 INFO:tasks.rados.rados.0.trial188.stdout:1477: writing trial18843701-22 from 460657 to 1100272 tid 1 2026-02-13T20:17:45.735 INFO:tasks.rados.rados.0.trial188.stdout:1477: writing trial18843701-22 from 1693343 to 2169857 tid 2 2026-02-13T20:17:45.740 INFO:tasks.rados.rados.0.trial188.stdout:1477: writing trial18843701-22 from 2681716 to 3260657 tid 3 2026-02-13T20:17:45.740 INFO:tasks.rados.rados.0.trial188.stdout:1478: copy_from oid 29 from oid 44 current snap is 144 2026-02-13T20:17:45.740 INFO:tasks.rados.rados.0.trial188.stdout:1479: write (excl) oid 19 current snap is 144 2026-02-13T20:17:45.740 INFO:tasks.rados.rados.0.trial188.stdout:1479: seq_num 552 ranges {477464=714864,1751825=736525,3225492=51972} 2026-02-13T20:17:45.744 INFO:tasks.rados.rados.0.trial188.stdout:1479: writing trial18843701-19 from 477464 to 1192328 tid 1 2026-02-13T20:17:45.749 INFO:tasks.rados.rados.0.trial188.stdout:1479: writing trial18843701-19 from 1751825 to 2488350 tid 2 2026-02-13T20:17:45.752 INFO:tasks.rados.rados.0.trial188.stdout:1479: writing trial18843701-19 from 3225492 to 3277464 tid 3 2026-02-13T20:17:45.752 INFO:tasks.rados.rados.0.trial188.stdout:1480: rollback oid 21 current snap is 144 2026-02-13T20:17:45.752 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 21 to 140 2026-02-13T20:17:45.753 INFO:tasks.rados.rados.0.trial188.stdout:1476: finishing write tid 1 to trial18843701-30 2026-02-13T20:17:45.753 INFO:tasks.rados.rados.0.trial188.stdout:1481: read oid 4 snap -1 2026-02-13T20:17:45.753 INFO:tasks.rados.rados.0.trial188.stdout:1481: expect (ObjNum 506 snap 132 seq_num 506) 2026-02-13T20:17:45.753 INFO:tasks.rados.rados.0.trial188.stdout:1482: snap_create 2026-02-13T20:17:45.753 INFO:tasks.rados.rados.0.trial188.stdout:1476: finishing write tid 2 to trial18843701-30 2026-02-13T20:17:45.753 INFO:tasks.rados.rados.0.trial188.stdout:1476: finishing write tid 3 to trial18843701-30 2026-02-13T20:17:45.753 INFO:tasks.rados.rados.0.trial188.stdout:1476: finishing write tid 4 to trial18843701-30 2026-02-13T20:17:45.753 INFO:tasks.rados.rados.0.trial188.stdout:1476: finishing write tid 5 to trial18843701-30 2026-02-13T20:17:45.753 INFO:tasks.rados.rados.0.trial188.stdout:1476: oid 30 updating version 0 to 639 2026-02-13T20:17:45.753 INFO:tasks.rados.rados.0.trial188.stdout:1476: oid 30 updating version 639 to 642 2026-02-13T20:17:45.754 INFO:tasks.rados.rados.0.trial188.stdout:1476: oid 30 version 642 is already newer than 640 2026-02-13T20:17:45.754 INFO:tasks.rados.rados.0.trial188.stdout:1476: oid 30 version 642 is already newer than 641 2026-02-13T20:17:45.754 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 30 v 642 (ObjNum 550 snap 144 seq_num 550) dirty exists 2026-02-13T20:17:45.754 INFO:tasks.rados.rados.0.trial188.stdout:1476: left oid 30 (ObjNum 550 snap 144 seq_num 550) 2026-02-13T20:17:45.756 INFO:tasks.rados.rados.0.trial188.stdout:1477: finishing write tid 1 to trial18843701-22 2026-02-13T20:17:45.757 INFO:tasks.rados.rados.0.trial188.stdout:1477: finishing write tid 2 to trial18843701-22 2026-02-13T20:17:45.757 INFO:tasks.rados.rados.0.trial188.stdout:1477: finishing write tid 3 to trial18843701-22 2026-02-13T20:17:45.758 INFO:tasks.rados.rados.0.trial188.stdout:1477: finishing write tid 4 to trial18843701-22 2026-02-13T20:17:45.758 INFO:tasks.rados.rados.0.trial188.stdout:1477: finishing write tid 5 to trial18843701-22 2026-02-13T20:17:45.758 INFO:tasks.rados.rados.0.trial188.stdout:1477: oid 22 updating version 0 to 335 2026-02-13T20:17:45.758 INFO:tasks.rados.rados.0.trial188.stdout:1477: oid 22 version 335 is already newer than 334 2026-02-13T20:17:45.758 INFO:tasks.rados.rados.0.trial188.stdout:1477: oid 22 version 335 is already newer than 332 2026-02-13T20:17:45.758 INFO:tasks.rados.rados.0.trial188.stdout:1477: oid 22 version 335 is already newer than 333 2026-02-13T20:17:45.758 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 22 v 335 (ObjNum 551 snap 144 seq_num 551) dirty exists 2026-02-13T20:17:45.758 INFO:tasks.rados.rados.0.trial188.stdout:1477: left oid 22 (ObjNum 551 snap 144 seq_num 551) 2026-02-13T20:17:45.793 INFO:tasks.rados.rados.0.trial188.stdout:1478: finishing copy_from racing read to trial18843701-29 2026-02-13T20:17:45.793 INFO:tasks.rados.rados.0.trial188.stdout:1479: finishing write tid 1 to trial18843701-19 2026-02-13T20:17:45.794 INFO:tasks.rados.rados.0.trial188.stdout:1479: finishing write tid 2 to trial18843701-19 2026-02-13T20:17:45.795 INFO:tasks.rados.rados.0.trial188.stdout:1480: finishing rollback tid 1 to trial18843701-21 2026-02-13T20:17:45.795 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 21 v 422 (ObjNum 51985 snap 0 seq_num 1653191732) dirty dne 2026-02-13T20:17:45.795 INFO:tasks.rados.rados.0.trial188.stdout:1478: finishing copy_from to trial18843701-29 2026-02-13T20:17:45.795 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 29 v 552 (ObjNum 513 snap 132 seq_num 513) dirty exists 2026-02-13T20:17:45.798 INFO:tasks.rados.rados.0.trial188.stdout:1479: finishing write tid 3 to trial18843701-19 2026-02-13T20:17:45.798 INFO:tasks.rados.rados.0.trial188.stdout:1479: finishing write tid 4 to trial18843701-19 2026-02-13T20:17:45.798 INFO:tasks.rados.rados.0.trial188.stdout:1479: finishing write tid 5 to trial18843701-19 2026-02-13T20:17:45.798 INFO:tasks.rados.rados.0.trial188.stdout:1479: oid 19 updating version 0 to 582 2026-02-13T20:17:45.798 INFO:tasks.rados.rados.0.trial188.stdout:1479: oid 19 updating version 582 to 583 2026-02-13T20:17:45.798 INFO:tasks.rados.rados.0.trial188.stdout:1479: oid 19 updating version 583 to 585 2026-02-13T20:17:45.799 INFO:tasks.rados.rados.0.trial188.stdout:1479: oid 19 version 585 is already newer than 584 2026-02-13T20:17:45.799 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 19 v 585 (ObjNum 552 snap 144 seq_num 552) dirty exists 2026-02-13T20:17:45.799 INFO:tasks.rados.rados.0.trial188.stdout:1479: left oid 19 (ObjNum 552 snap 144 seq_num 552) 2026-02-13T20:17:45.800 INFO:tasks.rados.rados.0.trial188.stdout:1481: expect (ObjNum 506 snap 132 seq_num 506) 2026-02-13T20:17:46.719 INFO:tasks.rados.rados.0.trial188.stdout:1476: done (6 left) 2026-02-13T20:17:46.719 INFO:tasks.rados.rados.0.trial188.stdout:1477: done (5 left) 2026-02-13T20:17:46.719 INFO:tasks.rados.rados.0.trial188.stdout:1478: done (4 left) 2026-02-13T20:17:46.719 INFO:tasks.rados.rados.0.trial188.stdout:1479: done (3 left) 2026-02-13T20:17:46.719 INFO:tasks.rados.rados.0.trial188.stdout:1480: done (2 left) 2026-02-13T20:17:46.719 INFO:tasks.rados.rados.0.trial188.stdout:1481: done (1 left) 2026-02-13T20:17:46.719 INFO:tasks.rados.rados.0.trial188.stdout:1482: done (0 left) 2026-02-13T20:17:46.719 INFO:tasks.rados.rados.0.trial188.stdout:1483: read oid 17 snap -1 2026-02-13T20:17:46.720 INFO:tasks.rados.rados.0.trial188.stdout:1483: expect (ObjNum 417 snap 111 seq_num 417) 2026-02-13T20:17:46.720 INFO:tasks.rados.rados.0.trial188.stdout:1484: delete oid 2 current snap is 145 2026-02-13T20:17:46.720 INFO:tasks.rados.rados.0.trial188.stdout:1484: done (1 left) 2026-02-13T20:17:46.720 INFO:tasks.rados.rados.0.trial188.stdout:1485: delete oid 27 current snap is 145 2026-02-13T20:17:46.723 INFO:tasks.rados.rados.0.trial188.stdout:1485: done (1 left) 2026-02-13T20:17:46.723 INFO:tasks.rados.rados.0.trial188.stdout:1486: rollback oid 3 current snap is 145 2026-02-13T20:17:46.723 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 3 to 144 2026-02-13T20:17:46.723 INFO:tasks.rados.rados.0.trial188.stdout:1487: rollback oid 29 current snap is 145 2026-02-13T20:17:46.723 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 29 to 144 2026-02-13T20:17:46.723 INFO:tasks.rados.rados.0.trial188.stdout:1488: read oid 21 snap -1 2026-02-13T20:17:46.723 INFO:tasks.rados.rados.0.trial188.stdout:1488: expect deleted 2026-02-13T20:17:46.723 INFO:tasks.rados.rados.0.trial188.stdout:1489: write (excl) oid 31 current snap is 145 2026-02-13T20:17:46.723 INFO:tasks.rados.rados.0.trial188.stdout:1489: seq_num 555 ranges {527885=656964,1927271=483852,3191408=136477} 2026-02-13T20:17:46.727 INFO:tasks.rados.rados.0.trial188.stdout:1489: writing trial18843701-31 from 527885 to 1184849 tid 1 2026-02-13T20:17:46.732 INFO:tasks.rados.rados.0.trial188.stdout:1489: writing trial18843701-31 from 1927271 to 2411123 tid 2 2026-02-13T20:17:46.736 INFO:tasks.rados.rados.0.trial188.stdout:1489: writing trial18843701-31 from 3191408 to 3327885 tid 3 2026-02-13T20:17:46.736 INFO:tasks.rados.rados.0.trial188.stdout:1490: delete oid 35 current snap is 145 2026-02-13T20:17:46.736 INFO:tasks.rados.rados.0.trial188.stdout:1486: finishing rollback tid 0 to trial18843701-3 2026-02-13T20:17:46.736 INFO:tasks.rados.rados.0.trial188.stdout:1486: finishing rollback tid 1 to trial18843701-3 2026-02-13T20:17:46.736 INFO:tasks.rados.rados.0.trial188.stdout:1486: finishing rollback tid 2 to trial18843701-3 2026-02-13T20:17:46.736 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 3 v 472 (ObjNum 545 snap 141 seq_num 545) dirty exists 2026-02-13T20:17:46.736 INFO:tasks.rados.rados.0.trial188.stdout:1483: expect (ObjNum 417 snap 111 seq_num 417) 2026-02-13T20:17:46.741 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 963235 2026-02-13T20:17:46.762 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:17:46.820 INFO:tasks.rados.rados.0.trial188.stdout:1487: finishing rollback tid 0 to trial18843701-29 2026-02-13T20:17:46.820 INFO:tasks.rados.rados.0.trial188.stdout:1487: finishing rollback tid 1 to trial18843701-29 2026-02-13T20:17:46.820 INFO:tasks.rados.rados.0.trial188.stdout:1487: finishing rollback tid 2 to trial18843701-29 2026-02-13T20:17:46.820 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 29 v 588 (ObjNum 513 snap 132 seq_num 513) dirty exists 2026-02-13T20:17:46.820 INFO:tasks.rados.rados.0.trial188.stdout:1489: finishing write tid 1 to trial18843701-31 2026-02-13T20:17:46.820 INFO:tasks.rados.rados.0.trial188.stdout:1489: finishing write tid 2 to trial18843701-31 2026-02-13T20:17:46.820 INFO:tasks.rados.rados.0.trial188.stdout:1489: finishing write tid 3 to trial18843701-31 2026-02-13T20:17:46.820 INFO:tasks.rados.rados.0.trial188.stdout:1489: finishing write tid 4 to trial18843701-31 2026-02-13T20:17:46.820 INFO:tasks.rados.rados.0.trial188.stdout:1489: finishing write tid 5 to trial18843701-31 2026-02-13T20:17:46.820 INFO:tasks.rados.rados.0.trial188.stdout:1489: oid 31 updating version 0 to 418 2026-02-13T20:17:46.820 INFO:tasks.rados.rados.0.trial188.stdout:1489: oid 31 version 418 is already newer than 416 2026-02-13T20:17:46.820 INFO:tasks.rados.rados.0.trial188.stdout:1489: oid 31 updating version 418 to 419 2026-02-13T20:17:46.820 INFO:tasks.rados.rados.0.trial188.stdout:1489: oid 31 version 419 is already newer than 417 2026-02-13T20:17:46.820 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 31 v 419 (ObjNum 555 snap 145 seq_num 555) dirty exists 2026-02-13T20:17:46.820 INFO:tasks.rados.rados.0.trial188.stdout:1489: left oid 31 (ObjNum 555 snap 145 seq_num 555) 2026-02-13T20:17:46.820 INFO:tasks.rados.rados.0.trial188.stdout:1483: done (5 left) 2026-02-13T20:17:46.820 INFO:tasks.rados.rados.0.trial188.stdout:1486: done (4 left) 2026-02-13T20:17:46.820 INFO:tasks.rados.rados.0.trial188.stdout:1487: done (3 left) 2026-02-13T20:17:46.820 INFO:tasks.rados.rados.0.trial188.stdout:1488: done (2 left) 2026-02-13T20:17:46.820 INFO:tasks.rados.rados.0.trial188.stdout:1489: done (1 left) 2026-02-13T20:17:46.820 INFO:tasks.rados.rados.0.trial188.stdout:1490: done (0 left) 2026-02-13T20:17:46.820 INFO:tasks.rados.rados.0.trial188.stdout:1491: snap_create 2026-02-13T20:17:47.693 INFO:tasks.rados.rados.0.trial188.stdout:1491: done (0 left) 2026-02-13T20:17:47.693 INFO:tasks.rados.rados.0.trial188.stdout:1492: read oid 6 snap -1 2026-02-13T20:17:47.693 INFO:tasks.rados.rados.0.trial188.stdout:1492: expect (ObjNum 508 snap 132 seq_num 508) 2026-02-13T20:17:47.694 INFO:tasks.rados.rados.0.trial188.stdout:1493: snap_create 2026-02-13T20:17:47.701 INFO:tasks.rados.rados.0.trial188.stdout:1492: expect (ObjNum 508 snap 132 seq_num 508) 2026-02-13T20:17:47.701 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:17:48.693 INFO:tasks.rados.rados.0.trial188.stdout:1492: done (1 left) 2026-02-13T20:17:48.693 INFO:tasks.rados.rados.0.trial188.stdout:1493: done (0 left) 2026-02-13T20:17:48.693 INFO:tasks.rados.rados.0.trial188.stdout:1494: copy_from oid 6 from oid 35 current snap is 147 2026-02-13T20:17:48.694 INFO:tasks.rados.rados.0.trial188.stdout:1495: read oid 4 snap 145 2026-02-13T20:17:48.694 INFO:tasks.rados.rados.0.trial188.stdout:1495: expect (ObjNum 506 snap 132 seq_num 506) 2026-02-13T20:17:48.694 INFO:tasks.rados.rados.0.trial188.stdout:1496: delete oid 21 current snap is 147 2026-02-13T20:17:48.695 INFO:tasks.rados.rados.0.trial188.stdout:1494: finishing copy_from to trial18843701-6 2026-02-13T20:17:48.695 INFO:tasks.rados.rados.0.trial188.stdout:1494: got expected ENOENT (src dne) 2026-02-13T20:17:48.695 INFO:tasks.rados.rados.0.trial188.stdout:1494: finishing copy_from racing read to trial18843701-6 2026-02-13T20:17:48.698 INFO:tasks.rados.rados.0.trial188.stdout:1494: done (2 left) 2026-02-13T20:17:48.698 INFO:tasks.rados.rados.0.trial188.stdout:1496: done (1 left) 2026-02-13T20:17:48.698 INFO:tasks.rados.rados.0.trial188.stdout:1497: write oid 48 current snap is 147 2026-02-13T20:17:48.698 INFO:tasks.rados.rados.0.trial188.stdout:1497: seq_num 558 ranges {578306=482711,1586364=631179,2757324=484842} 2026-02-13T20:17:48.702 INFO:tasks.rados.rados.0.trial188.stdout:1497: writing trial18843701-48 from 578306 to 1061017 tid 1 2026-02-13T20:17:48.706 INFO:tasks.rados.rados.0.trial188.stdout:1497: writing trial18843701-48 from 1586364 to 2217543 tid 2 2026-02-13T20:17:48.710 INFO:tasks.rados.rados.0.trial188.stdout:1497: writing trial18843701-48 from 2757324 to 3242166 tid 3 2026-02-13T20:17:48.710 INFO:tasks.rados.rados.0.trial188.stdout:1498: copy_from oid 39 from oid 11 current snap is 147 2026-02-13T20:17:48.710 INFO:tasks.rados.rados.0.trial188.stdout:1495: expect (ObjNum 506 snap 132 seq_num 506) 2026-02-13T20:17:48.719 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 739554 2026-02-13T20:17:48.798 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:17:48.844 INFO:tasks.rados.rados.0.trial188.stdout:1497: finishing write tid 1 to trial18843701-48 2026-02-13T20:17:48.844 INFO:tasks.rados.rados.0.trial188.stdout:1497: finishing write tid 2 to trial18843701-48 2026-02-13T20:17:48.844 INFO:tasks.rados.rados.0.trial188.stdout:1497: finishing write tid 3 to trial18843701-48 2026-02-13T20:17:48.844 INFO:tasks.rados.rados.0.trial188.stdout:1497: finishing write tid 4 to trial18843701-48 2026-02-13T20:17:48.844 INFO:tasks.rados.rados.0.trial188.stdout:1497: finishing write tid 5 to trial18843701-48 2026-02-13T20:17:48.844 INFO:tasks.rados.rados.0.trial188.stdout:1497: oid 48 updating version 0 to 426 2026-02-13T20:17:48.844 INFO:tasks.rados.rados.0.trial188.stdout:1497: oid 48 version 426 is already newer than 424 2026-02-13T20:17:48.845 INFO:tasks.rados.rados.0.trial188.stdout:1497: oid 48 version 426 is already newer than 425 2026-02-13T20:17:48.845 INFO:tasks.rados.rados.0.trial188.stdout:1497: oid 48 version 426 is already newer than 423 2026-02-13T20:17:48.845 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 48 v 426 (ObjNum 558 snap 147 seq_num 558) dirty exists 2026-02-13T20:17:48.845 INFO:tasks.rados.rados.0.trial188.stdout:1497: left oid 48 (ObjNum 558 snap 147 seq_num 558) 2026-02-13T20:17:48.845 INFO:tasks.rados.rados.0.trial188.stdout:1498: finishing copy_from racing read to trial18843701-39 2026-02-13T20:17:48.845 INFO:tasks.rados.rados.0.trial188.stdout:1498: finishing copy_from to trial18843701-39 2026-02-13T20:17:48.845 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 39 v 374 (ObjNum 530 snap 136 seq_num 530) dirty exists 2026-02-13T20:17:48.845 INFO:tasks.rados.rados.0.trial188.stdout:1495: done (2 left) 2026-02-13T20:17:48.845 INFO:tasks.rados.rados.0.trial188.stdout:1497: done (1 left) 2026-02-13T20:17:48.845 INFO:tasks.rados.rados.0.trial188.stdout:1498: done (0 left) 2026-02-13T20:17:48.845 INFO:tasks.rados.rados.0.trial188.stdout:1499: snap_create 2026-02-13T20:17:49.720 INFO:tasks.rados.rados.0.trial188.stdout:1499: done (0 left) 2026-02-13T20:17:49.721 INFO:tasks.rados.rados.0.trial188.stdout:1500: copy_from oid 22 from oid 10 current snap is 148 2026-02-13T20:17:49.721 INFO:tasks.rados.rados.0.trial188.stdout:1501: snap_create 2026-02-13T20:17:49.761 INFO:tasks.rados.rados.0.trial188.stdout:1500: finishing copy_from racing read to trial18843701-22 2026-02-13T20:17:49.762 INFO:tasks.rados.rados.0.trial188.stdout:1500: finishing copy_from to trial18843701-22 2026-02-13T20:17:49.762 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 22 v 359 (ObjNum 475 snap 124 seq_num 475) dirty exists 2026-02-13T20:17:50.723 INFO:tasks.rados.rados.0.trial188.stdout:1500: done (1 left) 2026-02-13T20:17:50.724 INFO:tasks.rados.rados.0.trial188.stdout:1501: done (0 left) 2026-02-13T20:17:50.724 INFO:tasks.rados.rados.0.trial188.stdout:1502: write oid 13 current snap is 149 2026-02-13T20:17:50.724 INFO:tasks.rados.rados.0.trial188.stdout:1502: seq_num 559 ranges {595113=557960,1644846=491190,2784747=610366} 2026-02-13T20:17:50.728 INFO:tasks.rados.rados.0.trial188.stdout:1502: writing trial18843701-13 from 595113 to 1153073 tid 1 2026-02-13T20:17:50.731 INFO:tasks.rados.rados.0.trial188.stdout:1502: writing trial18843701-13 from 1644846 to 2136036 tid 2 2026-02-13T20:17:50.736 INFO:tasks.rados.rados.0.trial188.stdout:1502: writing trial18843701-13 from 2784747 to 3395113 tid 3 2026-02-13T20:17:50.737 INFO:tasks.rados.rados.0.trial188.stdout:1503: read oid 18 snap -1 2026-02-13T20:17:50.737 INFO:tasks.rados.rados.0.trial188.stdout:1503: expect deleted 2026-02-13T20:17:50.737 INFO:tasks.rados.rados.0.trial188.stdout:1504: read oid 45 snap 148 2026-02-13T20:17:50.737 INFO:tasks.rados.rados.0.trial188.stdout:1504: expect (ObjNum 454 snap 116 seq_num 454) 2026-02-13T20:17:50.737 INFO:tasks.rados.rados.0.trial188.stdout:1505: rollback oid 44 current snap is 149 2026-02-13T20:17:50.737 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 44 to 134 2026-02-13T20:17:50.737 INFO:tasks.rados.rados.0.trial188.stdout:1506: snap_remove snap 135 2026-02-13T20:17:51.727 INFO:tasks.rados.rados.0.trial188.stdout:1506: done (4 left) 2026-02-13T20:17:51.727 INFO:tasks.rados.rados.0.trial188.stdout:1507: snap_create 2026-02-13T20:17:51.727 INFO:tasks.rados.rados.0.trial188.stdout:1504: expect (ObjNum 454 snap 116 seq_num 454) 2026-02-13T20:17:51.777 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 3348593 2026-02-13T20:17:51.837 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:17:51.898 INFO:tasks.rados.rados.0.trial188.stdout:1502: finishing write tid 1 to trial18843701-13 2026-02-13T20:17:51.898 INFO:tasks.rados.rados.0.trial188.stdout:1502: finishing write tid 2 to trial18843701-13 2026-02-13T20:17:51.898 INFO:tasks.rados.rados.0.trial188.stdout:1502: finishing write tid 3 to trial18843701-13 2026-02-13T20:17:51.898 INFO:tasks.rados.rados.0.trial188.stdout:1502: finishing write tid 4 to trial18843701-13 2026-02-13T20:17:51.898 INFO:tasks.rados.rados.0.trial188.stdout:1502: finishing write tid 5 to trial18843701-13 2026-02-13T20:17:51.899 INFO:tasks.rados.rados.0.trial188.stdout:1502: oid 13 updating version 0 to 595 2026-02-13T20:17:51.899 INFO:tasks.rados.rados.0.trial188.stdout:1502: oid 13 version 595 is already newer than 594 2026-02-13T20:17:51.899 INFO:tasks.rados.rados.0.trial188.stdout:1502: oid 13 version 595 is already newer than 593 2026-02-13T20:17:51.899 INFO:tasks.rados.rados.0.trial188.stdout:1502: oid 13 version 595 is already newer than 592 2026-02-13T20:17:51.899 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 13 v 595 (ObjNum 559 snap 149 seq_num 559) dirty exists 2026-02-13T20:17:51.899 INFO:tasks.rados.rados.0.trial188.stdout:1502: left oid 13 (ObjNum 559 snap 149 seq_num 559) 2026-02-13T20:17:51.899 INFO:tasks.rados.rados.0.trial188.stdout:1505: finishing rollback tid 0 to trial18843701-44 2026-02-13T20:17:51.899 INFO:tasks.rados.rados.0.trial188.stdout:1505: finishing rollback tid 1 to trial18843701-44 2026-02-13T20:17:51.900 INFO:tasks.rados.rados.0.trial188.stdout:1505: finishing rollback tid 2 to trial18843701-44 2026-02-13T20:17:51.900 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 44 v 599 (ObjNum 513 snap 132 seq_num 513) dirty exists 2026-02-13T20:17:52.693 INFO:tasks.rados.rados.0.trial188.stdout:1502: done (4 left) 2026-02-13T20:17:52.693 INFO:tasks.rados.rados.0.trial188.stdout:1503: done (3 left) 2026-02-13T20:17:52.693 INFO:tasks.rados.rados.0.trial188.stdout:1504: done (2 left) 2026-02-13T20:17:52.693 INFO:tasks.rados.rados.0.trial188.stdout:1505: done (1 left) 2026-02-13T20:17:52.693 INFO:tasks.rados.rados.0.trial188.stdout:1507: done (0 left) 2026-02-13T20:17:52.693 INFO:tasks.rados.rados.0.trial188.stdout:1508: snap_remove snap 145 2026-02-13T20:17:53.693 INFO:tasks.rados.rados.0.trial188.stdout:1508: done (0 left) 2026-02-13T20:17:53.693 INFO:tasks.rados.rados.0.trial188.stdout:1509: snap_remove snap 143 2026-02-13T20:17:54.693 INFO:tasks.rados.rados.0.trial188.stdout:1509: done (0 left) 2026-02-13T20:17:54.693 INFO:tasks.rados.rados.0.trial188.stdout:1510: snap_remove snap 148 2026-02-13T20:17:55.696 INFO:tasks.rados.rados.0.trial188.stdout:1510: done (0 left) 2026-02-13T20:17:55.696 INFO:tasks.rados.rados.0.trial188.stdout:1511: read oid 43 snap -1 2026-02-13T20:17:55.696 INFO:tasks.rados.rados.0.trial188.stdout:1511: expect (ObjNum 435 snap 112 seq_num 435) 2026-02-13T20:17:55.696 INFO:tasks.rados.rados.0.trial188.stdout:1512: copy_from oid 36 from oid 15 current snap is 150 2026-02-13T20:17:55.697 INFO:tasks.rados.rados.0.trial188.stdout:1513: copy_from oid 4 from oid 37 current snap is 150 2026-02-13T20:17:55.697 INFO:tasks.rados.rados.0.trial188.stdout:1514: snap_remove snap 134 2026-02-13T20:17:56.698 INFO:tasks.rados.rados.0.trial188.stdout:1514: done (3 left) 2026-02-13T20:17:56.698 INFO:tasks.rados.rados.0.trial188.stdout:1515: read oid 12 snap -1 2026-02-13T20:17:56.698 INFO:tasks.rados.rados.0.trial188.stdout:1515: expect (ObjNum 501 snap 130 seq_num 501) 2026-02-13T20:17:56.698 INFO:tasks.rados.rados.0.trial188.stdout:1516: snap_remove snap 146 2026-02-13T20:17:57.695 INFO:tasks.rados.rados.0.trial188.stdout:1516: done (4 left) 2026-02-13T20:17:57.695 INFO:tasks.rados.rados.0.trial188.stdout:1517: read oid 7 snap -1 2026-02-13T20:17:57.695 INFO:tasks.rados.rados.0.trial188.stdout:1517: expect deleted 2026-02-13T20:17:57.695 INFO:tasks.rados.rados.0.trial188.stdout:1518: copy_from oid 32 from oid 2 current snap is 150 2026-02-13T20:17:57.695 INFO:tasks.rados.rados.0.trial188.stdout:1512: finishing copy_from to trial18843701-36 2026-02-13T20:17:57.695 INFO:tasks.rados.rados.0.trial188.stdout:1512: got expected ENOENT (src dne) 2026-02-13T20:17:57.695 INFO:tasks.rados.rados.0.trial188.stdout:1512: finishing copy_from racing read to trial18843701-36 2026-02-13T20:17:57.696 INFO:tasks.rados.rados.0.trial188.stdout:1511: expect (ObjNum 435 snap 112 seq_num 435) 2026-02-13T20:17:57.727 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:17:57.796 INFO:tasks.rados.rados.0.trial188.stdout:1513: finishing copy_from racing read to trial18843701-4 2026-02-13T20:17:57.796 INFO:tasks.rados.rados.0.trial188.stdout:1513: finishing copy_from to trial18843701-4 2026-02-13T20:17:57.796 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 4 v 374 (ObjNum 530 snap 136 seq_num 530) dirty exists 2026-02-13T20:17:57.796 INFO:tasks.rados.rados.0.trial188.stdout:1511: done (5 left) 2026-02-13T20:17:57.796 INFO:tasks.rados.rados.0.trial188.stdout:1512: done (4 left) 2026-02-13T20:17:57.796 INFO:tasks.rados.rados.0.trial188.stdout:1513: done (3 left) 2026-02-13T20:17:57.796 INFO:tasks.rados.rados.0.trial188.stdout:1519: write oid 46 current snap is 150 2026-02-13T20:17:57.796 INFO:tasks.rados.rados.0.trial188.stdout:1519: seq_num 560 ranges {611920=633209,1703328=634848,2812170=507386} 2026-02-13T20:17:57.800 INFO:tasks.rados.rados.0.trial188.stdout:1519: writing trial18843701-46 from 611920 to 1245129 tid 1 2026-02-13T20:17:57.804 INFO:tasks.rados.rados.0.trial188.stdout:1519: writing trial18843701-46 from 1703328 to 2338176 tid 2 2026-02-13T20:17:57.808 INFO:tasks.rados.rados.0.trial188.stdout:1519: writing trial18843701-46 from 2812170 to 3319556 tid 3 2026-02-13T20:17:57.808 INFO:tasks.rados.rados.0.trial188.stdout:1520: read oid 34 snap -1 2026-02-13T20:17:57.808 INFO:tasks.rados.rados.0.trial188.stdout:1520: expect (ObjNum 476 snap 124 seq_num 476) 2026-02-13T20:17:57.808 INFO:tasks.rados.rados.0.trial188.stdout:1521: write (excl) oid 31 current snap is 150 2026-02-13T20:17:57.808 INFO:tasks.rados.rados.0.trial188.stdout:1521: seq_num 561 ranges {628727=708458,2045457=494859,3123240=305487} 2026-02-13T20:17:57.812 INFO:tasks.rados.rados.0.trial188.stdout:1521: writing trial18843701-31 from 628727 to 1337185 tid 1 2026-02-13T20:17:57.817 INFO:tasks.rados.rados.0.trial188.stdout:1521: writing trial18843701-31 from 2045457 to 2540316 tid 2 2026-02-13T20:17:57.821 INFO:tasks.rados.rados.0.trial188.stdout:1521: writing trial18843701-31 from 3123240 to 3428727 tid 3 2026-02-13T20:17:57.821 INFO:tasks.rados.rados.0.trial188.stdout:1522: read oid 49 snap -1 2026-02-13T20:17:57.821 INFO:tasks.rados.rados.0.trial188.stdout:1522: expect (ObjNum 523 snap 135 seq_num 523) 2026-02-13T20:17:57.821 INFO:tasks.rados.rados.0.trial188.stdout:1523: read oid 4 snap -1 2026-02-13T20:17:57.821 INFO:tasks.rados.rados.0.trial188.stdout:1523: expect (ObjNum 530 snap 136 seq_num 530) 2026-02-13T20:17:57.821 INFO:tasks.rados.rados.0.trial188.stdout:1524: rollback oid 40 current snap is 150 2026-02-13T20:17:57.821 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 40 to 144 2026-02-13T20:17:57.821 INFO:tasks.rados.rados.0.trial188.stdout:1515: expect (ObjNum 501 snap 130 seq_num 501) 2026-02-13T20:17:57.840 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:17:57.864 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:17:57.888 INFO:tasks.rados.rados.0.trial188.stdout:1518: finishing copy_from to trial18843701-32 2026-02-13T20:17:57.889 INFO:tasks.rados.rados.0.trial188.stdout:1518: got expected ENOENT (src dne) 2026-02-13T20:17:57.889 INFO:tasks.rados.rados.0.trial188.stdout:1518: finishing copy_from racing read to trial18843701-32 2026-02-13T20:17:57.889 INFO:tasks.rados.rados.0.trial188.stdout:1515: done (8 left) 2026-02-13T20:17:57.889 INFO:tasks.rados.rados.0.trial188.stdout:1517: done (7 left) 2026-02-13T20:17:57.889 INFO:tasks.rados.rados.0.trial188.stdout:1518: done (6 left) 2026-02-13T20:17:57.889 INFO:tasks.rados.rados.0.trial188.stdout:1525: snap_create 2026-02-13T20:17:57.889 INFO:tasks.rados.rados.0.trial188.stdout:1520: expect (ObjNum 476 snap 124 seq_num 476) 2026-02-13T20:17:57.920 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 707179 2026-02-13T20:17:57.945 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:17:57.974 INFO:tasks.rados.rados.0.trial188.stdout:1522: expect (ObjNum 523 snap 135 seq_num 523) 2026-02-13T20:17:58.063 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1978696 2026-02-13T20:17:58.131 INFO:tasks.rados.rados.0.trial188.stdout:1519: finishing write tid 1 to trial18843701-46 2026-02-13T20:17:58.131 INFO:tasks.rados.rados.0.trial188.stdout:1519: finishing write tid 2 to trial18843701-46 2026-02-13T20:17:58.131 INFO:tasks.rados.rados.0.trial188.stdout:1519: finishing write tid 3 to trial18843701-46 2026-02-13T20:17:58.131 INFO:tasks.rados.rados.0.trial188.stdout:1519: finishing write tid 4 to trial18843701-46 2026-02-13T20:17:58.131 INFO:tasks.rados.rados.0.trial188.stdout:1519: finishing write tid 5 to trial18843701-46 2026-02-13T20:17:58.131 INFO:tasks.rados.rados.0.trial188.stdout:1519: oid 46 updating version 0 to 420 2026-02-13T20:17:58.131 INFO:tasks.rados.rados.0.trial188.stdout:1519: oid 46 updating version 420 to 421 2026-02-13T20:17:58.131 INFO:tasks.rados.rados.0.trial188.stdout:1519: oid 46 updating version 421 to 423 2026-02-13T20:17:58.131 INFO:tasks.rados.rados.0.trial188.stdout:1519: oid 46 version 423 is already newer than 422 2026-02-13T20:17:58.132 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 46 v 423 (ObjNum 560 snap 150 seq_num 560) dirty exists 2026-02-13T20:17:58.132 INFO:tasks.rados.rados.0.trial188.stdout:1519: left oid 46 (ObjNum 560 snap 150 seq_num 560) 2026-02-13T20:17:58.132 INFO:tasks.rados.rados.0.trial188.stdout:1524: finishing rollback tid 1 to trial18843701-40 2026-02-13T20:17:58.132 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 40 v 419 (ObjNum 33 snap 0 seq_num 16195728) dirty dne 2026-02-13T20:17:58.132 INFO:tasks.rados.rados.0.trial188.stdout:1521: finishing write tid 1 to trial18843701-31 2026-02-13T20:17:58.132 INFO:tasks.rados.rados.0.trial188.stdout:1521: finishing write tid 2 to trial18843701-31 2026-02-13T20:17:58.132 INFO:tasks.rados.rados.0.trial188.stdout:1521: finishing write tid 3 to trial18843701-31 2026-02-13T20:17:58.132 INFO:tasks.rados.rados.0.trial188.stdout:1521: finishing write tid 4 to trial18843701-31 2026-02-13T20:17:58.132 INFO:tasks.rados.rados.0.trial188.stdout:1521: finishing write tid 5 to trial18843701-31 2026-02-13T20:17:58.132 INFO:tasks.rados.rados.0.trial188.stdout:1521: oid 31 updating version 0 to 420 2026-02-13T20:17:58.132 INFO:tasks.rados.rados.0.trial188.stdout:1521: oid 31 updating version 420 to 421 2026-02-13T20:17:58.132 INFO:tasks.rados.rados.0.trial188.stdout:1521: oid 31 updating version 421 to 422 2026-02-13T20:17:58.132 INFO:tasks.rados.rados.0.trial188.stdout:1521: oid 31 updating version 422 to 423 2026-02-13T20:17:58.132 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 31 v 423 (ObjNum 561 snap 150 seq_num 561) dirty exists 2026-02-13T20:17:58.132 INFO:tasks.rados.rados.0.trial188.stdout:1521: left oid 31 (ObjNum 561 snap 150 seq_num 561) 2026-02-13T20:17:58.132 INFO:tasks.rados.rados.0.trial188.stdout:1523: expect (ObjNum 530 snap 136 seq_num 530) 2026-02-13T20:17:58.153 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:17:58.704 INFO:tasks.rados.rados.0.trial188.stdout:1519: done (6 left) 2026-02-13T20:17:58.704 INFO:tasks.rados.rados.0.trial188.stdout:1520: done (5 left) 2026-02-13T20:17:58.704 INFO:tasks.rados.rados.0.trial188.stdout:1521: done (4 left) 2026-02-13T20:17:58.704 INFO:tasks.rados.rados.0.trial188.stdout:1522: done (3 left) 2026-02-13T20:17:58.704 INFO:tasks.rados.rados.0.trial188.stdout:1523: done (2 left) 2026-02-13T20:17:58.704 INFO:tasks.rados.rados.0.trial188.stdout:1524: done (1 left) 2026-02-13T20:17:58.704 INFO:tasks.rados.rados.0.trial188.stdout:1525: done (0 left) 2026-02-13T20:17:58.704 INFO:tasks.rados.rados.0.trial188.stdout:1526: write oid 24 current snap is 151 2026-02-13T20:17:58.704 INFO:tasks.rados.rados.0.trial188.stdout:1526: seq_num 562 ranges {645534=783707,2103939=638517,3150663=294871} 2026-02-13T20:17:58.709 INFO:tasks.rados.rados.0.trial188.stdout:1526: writing trial18843701-24 from 645534 to 1429241 tid 1 2026-02-13T20:17:58.714 INFO:tasks.rados.rados.0.trial188.stdout:1526: writing trial18843701-24 from 2103939 to 2742456 tid 2 2026-02-13T20:17:58.717 INFO:tasks.rados.rados.0.trial188.stdout:1526: writing trial18843701-24 from 3150663 to 3445534 tid 3 2026-02-13T20:17:58.717 INFO:tasks.rados.rados.0.trial188.stdout:1527: read oid 15 snap -1 2026-02-13T20:17:58.717 INFO:tasks.rados.rados.0.trial188.stdout:1527: expect deleted 2026-02-13T20:17:58.717 INFO:tasks.rados.rados.0.trial188.stdout:1528: read oid 49 snap -1 2026-02-13T20:17:58.717 INFO:tasks.rados.rados.0.trial188.stdout:1528: expect (ObjNum 523 snap 135 seq_num 523) 2026-02-13T20:17:58.717 INFO:tasks.rados.rados.0.trial188.stdout:1529: read oid 2 snap -1 2026-02-13T20:17:58.717 INFO:tasks.rados.rados.0.trial188.stdout:1529: expect deleted 2026-02-13T20:17:58.717 INFO:tasks.rados.rados.0.trial188.stdout:1530: read oid 22 snap -1 2026-02-13T20:17:58.717 INFO:tasks.rados.rados.0.trial188.stdout:1530: expect (ObjNum 475 snap 124 seq_num 475) 2026-02-13T20:17:58.717 INFO:tasks.rados.rados.0.trial188.stdout:1531: read oid 33 snap -1 2026-02-13T20:17:58.717 INFO:tasks.rados.rados.0.trial188.stdout:1531: expect (ObjNum 549 snap 143 seq_num 549) 2026-02-13T20:17:58.717 INFO:tasks.rados.rados.0.trial188.stdout:1532: write oid 41 current snap is 151 2026-02-13T20:17:58.717 INFO:tasks.rados.rados.0.trial188.stdout:1532: seq_num 563 ranges {662341=575309,1878774=498528,2894439=457555} 2026-02-13T20:17:58.722 INFO:tasks.rados.rados.0.trial188.stdout:1532: writing trial18843701-41 from 662341 to 1237650 tid 1 2026-02-13T20:17:58.726 INFO:tasks.rados.rados.0.trial188.stdout:1532: writing trial18843701-41 from 1878774 to 2377302 tid 2 2026-02-13T20:17:58.730 INFO:tasks.rados.rados.0.trial188.stdout:1532: writing trial18843701-41 from 2894439 to 3351994 tid 3 2026-02-13T20:17:58.730 INFO:tasks.rados.rados.0.trial188.stdout:1533: write (excl) oid 50 current snap is 151 2026-02-13T20:17:58.730 INFO:tasks.rados.rados.0.trial188.stdout:1533: seq_num 564 ranges {679148=650558,1937256=642186,3321862=157286} 2026-02-13T20:17:58.734 INFO:tasks.rados.rados.0.trial188.stdout:1533: writing trial18843701-50 from 679148 to 1329706 tid 1 2026-02-13T20:17:58.739 INFO:tasks.rados.rados.0.trial188.stdout:1533: writing trial18843701-50 from 1937256 to 2579442 tid 2 2026-02-13T20:17:58.743 INFO:tasks.rados.rados.0.trial188.stdout:1533: writing trial18843701-50 from 3321862 to 3479148 tid 3 2026-02-13T20:17:58.743 INFO:tasks.rados.rados.0.trial188.stdout:1534: snap_remove snap 149 2026-02-13T20:17:59.708 INFO:tasks.rados.rados.0.trial188.stdout:1534: done (8 left) 2026-02-13T20:17:59.709 INFO:tasks.rados.rados.0.trial188.stdout:1535: write (excl) oid 13 current snap is 151 2026-02-13T20:17:59.709 INFO:tasks.rados.rados.0.trial188.stdout:1535: seq_num 565 ranges {695955=725807,1879385=502197,2949285=480099} 2026-02-13T20:17:59.714 INFO:tasks.rados.rados.0.trial188.stdout:1535: writing trial18843701-13 from 695955 to 1421762 tid 1 2026-02-13T20:17:59.717 INFO:tasks.rados.rados.0.trial188.stdout:1535: writing trial18843701-13 from 1879385 to 2381582 tid 2 2026-02-13T20:17:59.722 INFO:tasks.rados.rados.0.trial188.stdout:1535: writing trial18843701-13 from 2949285 to 3429384 tid 3 2026-02-13T20:17:59.723 INFO:tasks.rados.rados.0.trial188.stdout:1536: write (excl) oid 36 current snap is 151 2026-02-13T20:17:59.723 INFO:tasks.rados.rados.0.trial188.stdout:1536: seq_num 566 ranges {712762=401056,1537867=645855,2860355=652407} 2026-02-13T20:17:59.726 INFO:tasks.rados.rados.0.trial188.stdout:1536: writing trial18843701-36 from 712762 to 1113818 tid 1 2026-02-13T20:17:59.731 INFO:tasks.rados.rados.0.trial188.stdout:1536: writing trial18843701-36 from 1537867 to 2183722 tid 2 2026-02-13T20:17:59.737 INFO:tasks.rados.rados.0.trial188.stdout:1536: writing trial18843701-36 from 2860355 to 3512762 tid 3 2026-02-13T20:17:59.737 INFO:tasks.rados.rados.0.trial188.stdout:1537: write (excl) oid 1 current snap is 151 2026-02-13T20:17:59.737 INFO:tasks.rados.rados.0.trial188.stdout:1537: seq_num 567 ranges {729569=476305,1996349=505866,3004131=525438} 2026-02-13T20:17:59.742 INFO:tasks.rados.rados.0.trial188.stdout:1537: writing trial18843701-1 from 729569 to 1205874 tid 1 2026-02-13T20:17:59.746 INFO:tasks.rados.rados.0.trial188.stdout:1537: writing trial18843701-1 from 1996349 to 2502215 tid 2 2026-02-13T20:17:59.750 INFO:tasks.rados.rados.0.trial188.stdout:1537: writing trial18843701-1 from 3004131 to 3529569 tid 3 2026-02-13T20:17:59.750 INFO:tasks.rados.rados.0.trial188.stdout:1538: copy_from oid 26 from oid 10 current snap is 151 2026-02-13T20:17:59.750 INFO:tasks.rados.rados.0.trial188.stdout:1531: expect (ObjNum 549 snap 143 seq_num 549) 2026-02-13T20:17:59.750 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:17:59.861 INFO:tasks.rados.rados.0.trial188.stdout:1528: expect (ObjNum 523 snap 135 seq_num 523) 2026-02-13T20:17:59.862 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:17:59.915 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 202632 2026-02-13T20:17:59.971 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 549218 2026-02-13T20:18:00.021 INFO:tasks.rados.rados.0.trial188.stdout:1530: expect (ObjNum 475 snap 124 seq_num 475) 2026-02-13T20:18:00.053 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2966830 2026-02-13T20:18:00.124 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:18:00.182 INFO:tasks.rados.rados.0.trial188.stdout:1528: done (11 left) 2026-02-13T20:18:00.182 INFO:tasks.rados.rados.0.trial188.stdout:1529: done (10 left) 2026-02-13T20:18:00.182 INFO:tasks.rados.rados.0.trial188.stdout:1530: done (9 left) 2026-02-13T20:18:00.182 INFO:tasks.rados.rados.0.trial188.stdout:1531: done (8 left) 2026-02-13T20:18:00.182 INFO:tasks.rados.rados.0.trial188.stdout:1539: write oid 34 current snap is 151 2026-02-13T20:18:00.182 INFO:tasks.rados.rados.0.trial188.stdout:1526: finishing write tid 1 to trial18843701-24 2026-02-13T20:18:00.182 INFO:tasks.rados.rados.0.trial188.stdout:1526: finishing write tid 2 to trial18843701-24 2026-02-13T20:18:00.182 INFO:tasks.rados.rados.0.trial188.stdout:1526: finishing write tid 3 to trial18843701-24 2026-02-13T20:18:00.183 INFO:tasks.rados.rados.0.trial188.stdout:1526: finishing write tid 4 to trial18843701-24 2026-02-13T20:18:00.183 INFO:tasks.rados.rados.0.trial188.stdout:1539: seq_num 568 ranges {746376=551554,2054831=649524,3315201=231175} 2026-02-13T20:18:00.186 INFO:tasks.rados.rados.0.trial188.stdout:1539: writing trial18843701-34 from 746376 to 1297930 tid 1 2026-02-13T20:18:00.191 INFO:tasks.rados.rados.0.trial188.stdout:1539: writing trial18843701-34 from 2054831 to 2704355 tid 2 2026-02-13T20:18:00.195 INFO:tasks.rados.rados.0.trial188.stdout:1539: writing trial18843701-34 from 3315201 to 3546376 tid 3 2026-02-13T20:18:00.195 INFO:tasks.rados.rados.0.trial188.stdout:1527: done (8 left) 2026-02-13T20:18:00.195 INFO:tasks.rados.rados.0.trial188.stdout:1540: delete oid 22 current snap is 151 2026-02-13T20:18:00.195 INFO:tasks.rados.rados.0.trial188.stdout:1526: finishing write tid 5 to trial18843701-24 2026-02-13T20:18:00.195 INFO:tasks.rados.rados.0.trial188.stdout:1526: oid 24 updating version 0 to 692 2026-02-13T20:18:00.195 INFO:tasks.rados.rados.0.trial188.stdout:1526: oid 24 version 692 is already newer than 691 2026-02-13T20:18:00.195 INFO:tasks.rados.rados.0.trial188.stdout:1526: oid 24 updating version 692 to 694 2026-02-13T20:18:00.195 INFO:tasks.rados.rados.0.trial188.stdout:1526: oid 24 version 694 is already newer than 693 2026-02-13T20:18:00.195 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 24 v 694 (ObjNum 562 snap 151 seq_num 562) dirty exists 2026-02-13T20:18:00.195 INFO:tasks.rados.rados.0.trial188.stdout:1526: left oid 24 (ObjNum 562 snap 151 seq_num 562) 2026-02-13T20:18:00.196 INFO:tasks.rados.rados.0.trial188.stdout:1532: finishing write tid 1 to trial18843701-41 2026-02-13T20:18:00.196 INFO:tasks.rados.rados.0.trial188.stdout:1532: finishing write tid 2 to trial18843701-41 2026-02-13T20:18:00.196 INFO:tasks.rados.rados.0.trial188.stdout:1532: finishing write tid 3 to trial18843701-41 2026-02-13T20:18:00.196 INFO:tasks.rados.rados.0.trial188.stdout:1532: finishing write tid 4 to trial18843701-41 2026-02-13T20:18:00.196 INFO:tasks.rados.rados.0.trial188.stdout:1532: finishing write tid 5 to trial18843701-41 2026-02-13T20:18:00.196 INFO:tasks.rados.rados.0.trial188.stdout:1532: oid 41 updating version 0 to 424 2026-02-13T20:18:00.196 INFO:tasks.rados.rados.0.trial188.stdout:1532: oid 41 updating version 424 to 427 2026-02-13T20:18:00.196 INFO:tasks.rados.rados.0.trial188.stdout:1532: oid 41 version 427 is already newer than 426 2026-02-13T20:18:00.196 INFO:tasks.rados.rados.0.trial188.stdout:1532: oid 41 version 427 is already newer than 425 2026-02-13T20:18:00.196 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 41 v 427 (ObjNum 563 snap 151 seq_num 563) dirty exists 2026-02-13T20:18:00.196 INFO:tasks.rados.rados.0.trial188.stdout:1532: left oid 41 (ObjNum 563 snap 151 seq_num 563) 2026-02-13T20:18:00.196 INFO:tasks.rados.rados.0.trial188.stdout:1533: finishing write tid 1 to trial18843701-50 2026-02-13T20:18:00.196 INFO:tasks.rados.rados.0.trial188.stdout:1533: finishing write tid 2 to trial18843701-50 2026-02-13T20:18:00.196 INFO:tasks.rados.rados.0.trial188.stdout:1533: finishing write tid 3 to trial18843701-50 2026-02-13T20:18:00.196 INFO:tasks.rados.rados.0.trial188.stdout:1533: finishing write tid 4 to trial18843701-50 2026-02-13T20:18:00.196 INFO:tasks.rados.rados.0.trial188.stdout:1533: finishing write tid 5 to trial18843701-50 2026-02-13T20:18:00.196 INFO:tasks.rados.rados.0.trial188.stdout:1533: oid 50 updating version 0 to 696 2026-02-13T20:18:00.196 INFO:tasks.rados.rados.0.trial188.stdout:1533: oid 50 updating version 696 to 697 2026-02-13T20:18:00.196 INFO:tasks.rados.rados.0.trial188.stdout:1533: oid 50 updating version 697 to 699 2026-02-13T20:18:00.196 INFO:tasks.rados.rados.0.trial188.stdout:1533: oid 50 version 699 is already newer than 698 2026-02-13T20:18:00.196 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 50 v 699 (ObjNum 564 snap 151 seq_num 564) dirty exists 2026-02-13T20:18:00.196 INFO:tasks.rados.rados.0.trial188.stdout:1533: left oid 50 (ObjNum 564 snap 151 seq_num 564) 2026-02-13T20:18:00.196 INFO:tasks.rados.rados.0.trial188.stdout:1535: finishing write tid 1 to trial18843701-13 2026-02-13T20:18:00.196 INFO:tasks.rados.rados.0.trial188.stdout:1536: finishing write tid 1 to trial18843701-36 2026-02-13T20:18:00.196 INFO:tasks.rados.rados.0.trial188.stdout:1535: finishing write tid 2 to trial18843701-13 2026-02-13T20:18:00.196 INFO:tasks.rados.rados.0.trial188.stdout:1536: finishing write tid 2 to trial18843701-36 2026-02-13T20:18:00.196 INFO:tasks.rados.rados.0.trial188.stdout:1535: finishing write tid 3 to trial18843701-13 2026-02-13T20:18:00.196 INFO:tasks.rados.rados.0.trial188.stdout:1535: finishing write tid 4 to trial18843701-13 2026-02-13T20:18:00.196 INFO:tasks.rados.rados.0.trial188.stdout:1535: finishing write tid 5 to trial18843701-13 2026-02-13T20:18:00.196 INFO:tasks.rados.rados.0.trial188.stdout:1535: oid 13 updating version 0 to 640 2026-02-13T20:18:00.196 INFO:tasks.rados.rados.0.trial188.stdout:1535: oid 13 version 640 is already newer than 639 2026-02-13T20:18:00.196 INFO:tasks.rados.rados.0.trial188.stdout:1535: oid 13 updating version 640 to 641 2026-02-13T20:18:00.196 INFO:tasks.rados.rados.0.trial188.stdout:1535: oid 13 updating version 641 to 642 2026-02-13T20:18:00.196 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 13 v 642 (ObjNum 565 snap 151 seq_num 565) dirty exists 2026-02-13T20:18:00.196 INFO:tasks.rados.rados.0.trial188.stdout:1535: left oid 13 (ObjNum 565 snap 151 seq_num 565) 2026-02-13T20:18:00.196 INFO:tasks.rados.rados.0.trial188.stdout:1536: finishing write tid 3 to trial18843701-36 2026-02-13T20:18:00.196 INFO:tasks.rados.rados.0.trial188.stdout:1537: finishing write tid 1 to trial18843701-1 2026-02-13T20:18:00.196 INFO:tasks.rados.rados.0.trial188.stdout:1536: finishing write tid 4 to trial18843701-36 2026-02-13T20:18:00.196 INFO:tasks.rados.rados.0.trial188.stdout:1537: finishing write tid 2 to trial18843701-1 2026-02-13T20:18:00.196 INFO:tasks.rados.rados.0.trial188.stdout:1536: finishing write tid 5 to trial18843701-36 2026-02-13T20:18:00.196 INFO:tasks.rados.rados.0.trial188.stdout:1536: oid 36 updating version 0 to 705 2026-02-13T20:18:00.196 INFO:tasks.rados.rados.0.trial188.stdout:1536: oid 36 updating version 705 to 706 2026-02-13T20:18:00.197 INFO:tasks.rados.rados.0.trial188.stdout:1536: oid 36 version 706 is already newer than 704 2026-02-13T20:18:00.197 INFO:tasks.rados.rados.0.trial188.stdout:1536: oid 36 version 706 is already newer than 703 2026-02-13T20:18:00.197 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 36 v 706 (ObjNum 566 snap 151 seq_num 566) dirty exists 2026-02-13T20:18:00.197 INFO:tasks.rados.rados.0.trial188.stdout:1536: left oid 36 (ObjNum 566 snap 151 seq_num 566) 2026-02-13T20:18:00.197 INFO:tasks.rados.rados.0.trial188.stdout:1537: finishing write tid 3 to trial18843701-1 2026-02-13T20:18:00.197 INFO:tasks.rados.rados.0.trial188.stdout:1537: finishing write tid 4 to trial18843701-1 2026-02-13T20:18:00.197 INFO:tasks.rados.rados.0.trial188.stdout:1537: finishing write tid 5 to trial18843701-1 2026-02-13T20:18:00.197 INFO:tasks.rados.rados.0.trial188.stdout:1537: oid 1 updating version 0 to 646 2026-02-13T20:18:00.197 INFO:tasks.rados.rados.0.trial188.stdout:1537: oid 1 version 646 is already newer than 645 2026-02-13T20:18:00.197 INFO:tasks.rados.rados.0.trial188.stdout:1537: oid 1 updating version 646 to 647 2026-02-13T20:18:00.197 INFO:tasks.rados.rados.0.trial188.stdout:1537: oid 1 version 647 is already newer than 644 2026-02-13T20:18:00.197 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 1 v 647 (ObjNum 567 snap 151 seq_num 567) dirty exists 2026-02-13T20:18:00.197 INFO:tasks.rados.rados.0.trial188.stdout:1537: left oid 1 (ObjNum 567 snap 151 seq_num 567) 2026-02-13T20:18:00.197 INFO:tasks.rados.rados.0.trial188.stdout:1538: finishing copy_from racing read to trial18843701-26 2026-02-13T20:18:00.197 INFO:tasks.rados.rados.0.trial188.stdout:1538: finishing copy_from to trial18843701-26 2026-02-13T20:18:00.197 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 26 v 359 (ObjNum 475 snap 124 seq_num 475) dirty exists 2026-02-13T20:18:00.197 INFO:tasks.rados.rados.0.trial188.stdout:1526: done (8 left) 2026-02-13T20:18:00.197 INFO:tasks.rados.rados.0.trial188.stdout:1532: done (7 left) 2026-02-13T20:18:00.197 INFO:tasks.rados.rados.0.trial188.stdout:1533: done (6 left) 2026-02-13T20:18:00.197 INFO:tasks.rados.rados.0.trial188.stdout:1535: done (5 left) 2026-02-13T20:18:00.197 INFO:tasks.rados.rados.0.trial188.stdout:1536: done (4 left) 2026-02-13T20:18:00.197 INFO:tasks.rados.rados.0.trial188.stdout:1537: done (3 left) 2026-02-13T20:18:00.197 INFO:tasks.rados.rados.0.trial188.stdout:1538: done (2 left) 2026-02-13T20:18:00.197 INFO:tasks.rados.rados.0.trial188.stdout:1540: done (1 left) 2026-02-13T20:18:00.197 INFO:tasks.rados.rados.0.trial188.stdout:1541: snap_remove snap 140 2026-02-13T20:18:00.713 INFO:tasks.rados.rados.0.trial188.stdout:1541: done (1 left) 2026-02-13T20:18:00.713 INFO:tasks.rados.rados.0.trial188.stdout:1539: finishing write tid 1 to trial18843701-34 2026-02-13T20:18:00.713 INFO:tasks.rados.rados.0.trial188.stdout:1542: read oid 20 snap -1 2026-02-13T20:18:00.713 INFO:tasks.rados.rados.0.trial188.stdout:1542: expect (ObjNum 531 snap 136 seq_num 531) 2026-02-13T20:18:00.713 INFO:tasks.rados.rados.0.trial188.stdout:1543: rollback oid 12 current snap is 151 2026-02-13T20:18:00.713 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 12 to 144 2026-02-13T20:18:00.714 INFO:tasks.rados.rados.0.trial188.stdout:1539: finishing write tid 2 to trial18843701-34 2026-02-13T20:18:00.714 INFO:tasks.rados.rados.0.trial188.stdout:1539: finishing write tid 3 to trial18843701-34 2026-02-13T20:18:00.714 INFO:tasks.rados.rados.0.trial188.stdout:1539: finishing write tid 4 to trial18843701-34 2026-02-13T20:18:00.714 INFO:tasks.rados.rados.0.trial188.stdout:1539: finishing write tid 5 to trial18843701-34 2026-02-13T20:18:00.714 INFO:tasks.rados.rados.0.trial188.stdout:1539: oid 34 updating version 0 to 554 2026-02-13T20:18:00.714 INFO:tasks.rados.rados.0.trial188.stdout:1539: oid 34 version 554 is already newer than 551 2026-02-13T20:18:00.714 INFO:tasks.rados.rados.0.trial188.stdout:1539: oid 34 version 554 is already newer than 552 2026-02-13T20:18:00.714 INFO:tasks.rados.rados.0.trial188.stdout:1539: oid 34 version 554 is already newer than 553 2026-02-13T20:18:00.714 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 34 v 554 (ObjNum 568 snap 151 seq_num 568) dirty exists 2026-02-13T20:18:00.714 INFO:tasks.rados.rados.0.trial188.stdout:1539: left oid 34 (ObjNum 568 snap 151 seq_num 568) 2026-02-13T20:18:00.714 INFO:tasks.rados.rados.0.trial188.stdout:1539: done (2 left) 2026-02-13T20:18:00.714 INFO:tasks.rados.rados.0.trial188.stdout:1544: read oid 19 snap -1 2026-02-13T20:18:00.715 INFO:tasks.rados.rados.0.trial188.stdout:1544: expect (ObjNum 552 snap 144 seq_num 552) 2026-02-13T20:18:00.715 INFO:tasks.rados.rados.0.trial188.stdout:1545: copy_from oid 25 from oid 23 current snap is 151 2026-02-13T20:18:00.715 INFO:tasks.rados.rados.0.trial188.stdout:1546: delete oid 27 current snap is 151 2026-02-13T20:18:00.716 INFO:tasks.rados.rados.0.trial188.stdout:1546: done (4 left) 2026-02-13T20:18:00.716 INFO:tasks.rados.rados.0.trial188.stdout:1547: copy_from oid 11 from oid 14 current snap is 151 2026-02-13T20:18:00.716 INFO:tasks.rados.rados.0.trial188.stdout:1548: write (excl) oid 2 current snap is 151 2026-02-13T20:18:00.716 INFO:tasks.rados.rados.0.trial188.stdout:1548: seq_num 571 ranges {796797=493654,1830277=796851,3397470=199327} 2026-02-13T20:18:00.721 INFO:tasks.rados.rados.0.trial188.stdout:1548: writing trial18843701-2 from 796797 to 1290451 tid 1 2026-02-13T20:18:00.726 INFO:tasks.rados.rados.0.trial188.stdout:1548: writing trial18843701-2 from 1830277 to 2627128 tid 2 2026-02-13T20:18:00.730 INFO:tasks.rados.rados.0.trial188.stdout:1548: writing trial18843701-2 from 3397470 to 3596797 tid 3 2026-02-13T20:18:00.730 INFO:tasks.rados.rados.0.trial188.stdout:1549: rollback oid 38 current snap is 151 2026-02-13T20:18:00.730 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 38 to 150 2026-02-13T20:18:00.730 INFO:tasks.rados.rados.0.trial188.stdout:1542: expect (ObjNum 531 snap 136 seq_num 531) 2026-02-13T20:18:00.751 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1604736 2026-02-13T20:18:00.799 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1770081 2026-02-13T20:18:00.824 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:18:00.877 INFO:tasks.rados.rados.0.trial188.stdout:1544: expect (ObjNum 552 snap 144 seq_num 552) 2026-02-13T20:18:00.948 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:18:01.074 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 3190029 2026-02-13T20:18:01.081 INFO:tasks.rados.rados.0.trial188.stdout:1543: finishing rollback tid 0 to trial18843701-12 2026-02-13T20:18:01.082 INFO:tasks.rados.rados.0.trial188.stdout:1542: done (6 left) 2026-02-13T20:18:01.082 INFO:tasks.rados.rados.0.trial188.stdout:1544: done (5 left) 2026-02-13T20:18:01.082 INFO:tasks.rados.rados.0.trial188.stdout:1550: read oid 36 snap -1 2026-02-13T20:18:01.082 INFO:tasks.rados.rados.0.trial188.stdout:1550: expect (ObjNum 566 snap 151 seq_num 566) 2026-02-13T20:18:01.082 INFO:tasks.rados.rados.0.trial188.stdout:1551: delete oid 28 current snap is 151 2026-02-13T20:18:01.082 INFO:tasks.rados.rados.0.trial188.stdout:1543: finishing rollback tid 1 to trial18843701-12 2026-02-13T20:18:01.082 INFO:tasks.rados.rados.0.trial188.stdout:1543: finishing rollback tid 2 to trial18843701-12 2026-02-13T20:18:01.082 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 12 v 471 (ObjNum 501 snap 130 seq_num 501) dirty exists 2026-02-13T20:18:01.083 INFO:tasks.rados.rados.0.trial188.stdout:1545: finishing copy_from racing read to trial18843701-25 2026-02-13T20:18:01.083 INFO:tasks.rados.rados.0.trial188.stdout:1545: finishing copy_from to trial18843701-25 2026-02-13T20:18:01.083 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 25 v 662 (ObjNum 538 snap 139 seq_num 538) dirty exists 2026-02-13T20:18:01.083 INFO:tasks.rados.rados.0.trial188.stdout:1548: finishing write tid 1 to trial18843701-2 2026-02-13T20:18:01.083 INFO:tasks.rados.rados.0.trial188.stdout:1548: finishing write tid 2 to trial18843701-2 2026-02-13T20:18:01.083 INFO:tasks.rados.rados.0.trial188.stdout:1548: finishing write tid 3 to trial18843701-2 2026-02-13T20:18:01.083 INFO:tasks.rados.rados.0.trial188.stdout:1548: finishing write tid 4 to trial18843701-2 2026-02-13T20:18:01.083 INFO:tasks.rados.rados.0.trial188.stdout:1548: finishing write tid 5 to trial18843701-2 2026-02-13T20:18:01.083 INFO:tasks.rados.rados.0.trial188.stdout:1548: oid 2 updating version 0 to 656 2026-02-13T20:18:01.083 INFO:tasks.rados.rados.0.trial188.stdout:1548: oid 2 updating version 656 to 657 2026-02-13T20:18:01.083 INFO:tasks.rados.rados.0.trial188.stdout:1548: oid 2 updating version 657 to 658 2026-02-13T20:18:01.084 INFO:tasks.rados.rados.0.trial188.stdout:1548: oid 2 updating version 658 to 659 2026-02-13T20:18:01.084 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 2 v 659 (ObjNum 571 snap 151 seq_num 571) dirty exists 2026-02-13T20:18:01.084 INFO:tasks.rados.rados.0.trial188.stdout:1548: left oid 2 (ObjNum 571 snap 151 seq_num 571) 2026-02-13T20:18:01.084 INFO:tasks.rados.rados.0.trial188.stdout:1547: finishing copy_from racing read to trial18843701-11 2026-02-13T20:18:01.084 INFO:tasks.rados.rados.0.trial188.stdout:1549: finishing rollback tid 0 to trial18843701-38 2026-02-13T20:18:01.084 INFO:tasks.rados.rados.0.trial188.stdout:1549: finishing rollback tid 1 to trial18843701-38 2026-02-13T20:18:01.084 INFO:tasks.rados.rados.0.trial188.stdout:1549: finishing rollback tid 2 to trial18843701-38 2026-02-13T20:18:01.084 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 38 v 670 (ObjNum 534 snap 136 seq_num 534) dirty exists 2026-02-13T20:18:01.084 INFO:tasks.rados.rados.0.trial188.stdout:1547: finishing copy_from to trial18843701-11 2026-02-13T20:18:01.084 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 11 v 465 (ObjNum 543 snap 141 seq_num 543) dirty exists 2026-02-13T20:18:01.086 INFO:tasks.rados.rados.0.trial188.stdout:1543: done (6 left) 2026-02-13T20:18:01.086 INFO:tasks.rados.rados.0.trial188.stdout:1545: done (5 left) 2026-02-13T20:18:01.086 INFO:tasks.rados.rados.0.trial188.stdout:1547: done (4 left) 2026-02-13T20:18:01.086 INFO:tasks.rados.rados.0.trial188.stdout:1548: done (3 left) 2026-02-13T20:18:01.086 INFO:tasks.rados.rados.0.trial188.stdout:1549: done (2 left) 2026-02-13T20:18:01.086 INFO:tasks.rados.rados.0.trial188.stdout:1551: done (1 left) 2026-02-13T20:18:01.087 INFO:tasks.rados.rados.0.trial188.stdout:1552: snap_remove snap 147 2026-02-13T20:18:01.716 INFO:tasks.rados.rados.0.trial188.stdout:1552: done (1 left) 2026-02-13T20:18:01.716 INFO:tasks.rados.rados.0.trial188.stdout:1553: delete oid 32 current snap is 151 2026-02-13T20:18:01.716 INFO:tasks.rados.rados.0.trial188.stdout:1550: expect (ObjNum 566 snap 151 seq_num 566) 2026-02-13T20:18:01.716 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:18:01.773 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:18:01.805 INFO:tasks.rados.rados.0.trial188.stdout:1550: done (1 left) 2026-02-13T20:18:01.805 INFO:tasks.rados.rados.0.trial188.stdout:1553: done (0 left) 2026-02-13T20:18:01.805 INFO:tasks.rados.rados.0.trial188.stdout:1554: snap_remove snap 144 2026-02-13T20:18:02.694 INFO:tasks.rados.rados.0.trial188.stdout:1554: done (0 left) 2026-02-13T20:18:02.695 INFO:tasks.rados.rados.0.trial188.stdout:1555: copy_from oid 16 from oid 14 current snap is 151 2026-02-13T20:18:02.695 INFO:tasks.rados.rados.0.trial188.stdout:1556: write (excl) oid 41 current snap is 151 2026-02-13T20:18:02.695 INFO:tasks.rados.rados.0.trial188.stdout:1556: seq_num 574 ranges {447218=719401,1889370=660531,2963386=614253} 2026-02-13T20:18:02.699 INFO:tasks.rados.rados.0.trial188.stdout:1556: writing trial18843701-41 from 447218 to 1166619 tid 1 2026-02-13T20:18:02.704 INFO:tasks.rados.rados.0.trial188.stdout:1556: writing trial18843701-41 from 1889370 to 2549901 tid 2 2026-02-13T20:18:02.708 INFO:tasks.rados.rados.0.trial188.stdout:1556: writing trial18843701-41 from 2963386 to 3577639 tid 3 2026-02-13T20:18:02.708 INFO:tasks.rados.rados.0.trial188.stdout:1557: rollback oid 48 current snap is 151 2026-02-13T20:18:02.708 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 48 to 150 2026-02-13T20:18:02.708 INFO:tasks.rados.rados.0.trial188.stdout:1558: snap_create 2026-02-13T20:18:02.730 INFO:tasks.rados.rados.0.trial188.stdout:1556: finishing write tid 1 to trial18843701-41 2026-02-13T20:18:02.732 INFO:tasks.rados.rados.0.trial188.stdout:1556: finishing write tid 2 to trial18843701-41 2026-02-13T20:18:02.733 INFO:tasks.rados.rados.0.trial188.stdout:1556: finishing write tid 3 to trial18843701-41 2026-02-13T20:18:02.733 INFO:tasks.rados.rados.0.trial188.stdout:1557: finishing rollback tid 0 to trial18843701-48 2026-02-13T20:18:02.733 INFO:tasks.rados.rados.0.trial188.stdout:1556: finishing write tid 4 to trial18843701-41 2026-02-13T20:18:02.734 INFO:tasks.rados.rados.0.trial188.stdout:1557: finishing rollback tid 1 to trial18843701-48 2026-02-13T20:18:02.734 INFO:tasks.rados.rados.0.trial188.stdout:1557: finishing rollback tid 2 to trial18843701-48 2026-02-13T20:18:02.734 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 48 v 429 (ObjNum 558 snap 147 seq_num 558) dirty exists 2026-02-13T20:18:02.734 INFO:tasks.rados.rados.0.trial188.stdout:1556: finishing write tid 5 to trial18843701-41 2026-02-13T20:18:02.734 INFO:tasks.rados.rados.0.trial188.stdout:1556: oid 41 updating version 0 to 445 2026-02-13T20:18:02.734 INFO:tasks.rados.rados.0.trial188.stdout:1556: oid 41 version 445 is already newer than 444 2026-02-13T20:18:02.734 INFO:tasks.rados.rados.0.trial188.stdout:1556: oid 41 version 445 is already newer than 443 2026-02-13T20:18:02.734 INFO:tasks.rados.rados.0.trial188.stdout:1556: oid 41 version 445 is already newer than 442 2026-02-13T20:18:02.734 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 41 v 445 (ObjNum 574 snap 151 seq_num 574) dirty exists 2026-02-13T20:18:02.734 INFO:tasks.rados.rados.0.trial188.stdout:1556: left oid 41 (ObjNum 574 snap 151 seq_num 574) 2026-02-13T20:18:02.734 INFO:tasks.rados.rados.0.trial188.stdout:1555: finishing copy_from racing read to trial18843701-16 2026-02-13T20:18:02.735 INFO:tasks.rados.rados.0.trial188.stdout:1555: finishing copy_from to trial18843701-16 2026-02-13T20:18:02.735 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 16 v 465 (ObjNum 543 snap 141 seq_num 543) dirty exists 2026-02-13T20:18:03.696 INFO:tasks.rados.rados.0.trial188.stdout:1555: done (3 left) 2026-02-13T20:18:03.696 INFO:tasks.rados.rados.0.trial188.stdout:1556: done (2 left) 2026-02-13T20:18:03.697 INFO:tasks.rados.rados.0.trial188.stdout:1557: done (1 left) 2026-02-13T20:18:03.697 INFO:tasks.rados.rados.0.trial188.stdout:1558: done (0 left) 2026-02-13T20:18:03.697 INFO:tasks.rados.rados.0.trial188.stdout:1559: rollback oid 24 current snap is 152 2026-02-13T20:18:03.697 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 24 to 150 2026-02-13T20:18:03.697 INFO:tasks.rados.rados.0.trial188.stdout:1560: rollback oid 46 current snap is 152 2026-02-13T20:18:03.697 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 46 to 151 2026-02-13T20:18:03.697 INFO:tasks.rados.rados.0.trial188.stdout:1561: copy_from oid 40 from oid 47 current snap is 152 2026-02-13T20:18:03.697 INFO:tasks.rados.rados.0.trial188.stdout:1562: write (excl) oid 14 current snap is 152 2026-02-13T20:18:03.697 INFO:tasks.rados.rados.0.trial188.stdout:1562: seq_num 575 ranges {464025=794650,1947852=404189,2990809=425525} 2026-02-13T20:18:03.701 INFO:tasks.rados.rados.0.trial188.stdout:1562: writing trial18843701-14 from 464025 to 1258675 tid 1 2026-02-13T20:18:03.705 INFO:tasks.rados.rados.0.trial188.stdout:1562: writing trial18843701-14 from 1947852 to 2352041 tid 2 2026-02-13T20:18:03.709 INFO:tasks.rados.rados.0.trial188.stdout:1562: writing trial18843701-14 from 2990809 to 3416334 tid 3 2026-02-13T20:18:03.709 INFO:tasks.rados.rados.0.trial188.stdout:1563: write (excl) oid 27 current snap is 152 2026-02-13T20:18:03.709 INFO:tasks.rados.rados.0.trial188.stdout:1559: finishing rollback tid 0 to trial18843701-24 2026-02-13T20:18:03.709 INFO:tasks.rados.rados.0.trial188.stdout:1560: finishing rollback tid 0 to trial18843701-46 2026-02-13T20:18:03.709 INFO:tasks.rados.rados.0.trial188.stdout:1559: finishing rollback tid 1 to trial18843701-24 2026-02-13T20:18:03.709 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 24 v 723 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-13T20:18:03.710 INFO:tasks.rados.rados.0.trial188.stdout:1560: finishing rollback tid 1 to trial18843701-46 2026-02-13T20:18:03.710 INFO:tasks.rados.rados.0.trial188.stdout:1560: finishing rollback tid 2 to trial18843701-46 2026-02-13T20:18:03.710 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 46 v 449 (ObjNum 560 snap 150 seq_num 560) dirty exists 2026-02-13T20:18:03.710 INFO:tasks.rados.rados.0.trial188.stdout:1563: seq_num 576 ranges {480832=469899,1606334=664200,3018232=662600} 2026-02-13T20:18:03.713 INFO:tasks.rados.rados.0.trial188.stdout:1563: writing trial18843701-27 from 480832 to 950731 tid 1 2026-02-13T20:18:03.718 INFO:tasks.rados.rados.0.trial188.stdout:1563: writing trial18843701-27 from 1606334 to 2270534 tid 2 2026-02-13T20:18:03.723 INFO:tasks.rados.rados.0.trial188.stdout:1563: writing trial18843701-27 from 3018232 to 3680832 tid 3 2026-02-13T20:18:03.723 INFO:tasks.rados.rados.0.trial188.stdout:1559: done (4 left) 2026-02-13T20:18:03.723 INFO:tasks.rados.rados.0.trial188.stdout:1560: done (3 left) 2026-02-13T20:18:03.723 INFO:tasks.rados.rados.0.trial188.stdout:1564: copy_from oid 20 from oid 1 current snap is 152 2026-02-13T20:18:03.723 INFO:tasks.rados.rados.0.trial188.stdout:1561: finishing copy_from racing read to trial18843701-40 2026-02-13T20:18:03.723 INFO:tasks.rados.rados.0.trial188.stdout:1565: delete oid 34 current snap is 152 2026-02-13T20:18:03.725 INFO:tasks.rados.rados.0.trial188.stdout:1561: finishing copy_from to trial18843701-40 2026-02-13T20:18:03.725 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 40 v 415 (ObjNum 489 snap 127 seq_num 489) dirty exists 2026-02-13T20:18:03.725 INFO:tasks.rados.rados.0.trial188.stdout:1562: finishing write tid 1 to trial18843701-14 2026-02-13T20:18:03.725 INFO:tasks.rados.rados.0.trial188.stdout:1562: finishing write tid 2 to trial18843701-14 2026-02-13T20:18:03.726 INFO:tasks.rados.rados.0.trial188.stdout:1562: finishing write tid 3 to trial18843701-14 2026-02-13T20:18:03.726 INFO:tasks.rados.rados.0.trial188.stdout:1562: finishing write tid 4 to trial18843701-14 2026-02-13T20:18:03.726 INFO:tasks.rados.rados.0.trial188.stdout:1562: finishing write tid 5 to trial18843701-14 2026-02-13T20:18:03.726 INFO:tasks.rados.rados.0.trial188.stdout:1562: oid 14 updating version 0 to 476 2026-02-13T20:18:03.726 INFO:tasks.rados.rados.0.trial188.stdout:1562: oid 14 version 476 is already newer than 474 2026-02-13T20:18:03.726 INFO:tasks.rados.rados.0.trial188.stdout:1562: oid 14 version 476 is already newer than 475 2026-02-13T20:18:03.726 INFO:tasks.rados.rados.0.trial188.stdout:1562: oid 14 updating version 476 to 477 2026-02-13T20:18:03.726 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 14 v 477 (ObjNum 575 snap 152 seq_num 575) dirty exists 2026-02-13T20:18:03.726 INFO:tasks.rados.rados.0.trial188.stdout:1562: left oid 14 (ObjNum 575 snap 152 seq_num 575) 2026-02-13T20:18:03.738 INFO:tasks.rados.rados.0.trial188.stdout:1561: done (4 left) 2026-02-13T20:18:03.738 INFO:tasks.rados.rados.0.trial188.stdout:1562: done (3 left) 2026-02-13T20:18:03.738 INFO:tasks.rados.rados.0.trial188.stdout:1565: done (2 left) 2026-02-13T20:18:03.738 INFO:tasks.rados.rados.0.trial188.stdout:1566: snap_create 2026-02-13T20:18:03.739 INFO:tasks.rados.rados.0.trial188.stdout:1563: finishing write tid 1 to trial18843701-27 2026-02-13T20:18:03.739 INFO:tasks.rados.rados.0.trial188.stdout:1563: finishing write tid 2 to trial18843701-27 2026-02-13T20:18:03.739 INFO:tasks.rados.rados.0.trial188.stdout:1563: finishing write tid 3 to trial18843701-27 2026-02-13T20:18:03.739 INFO:tasks.rados.rados.0.trial188.stdout:1563: finishing write tid 4 to trial18843701-27 2026-02-13T20:18:03.739 INFO:tasks.rados.rados.0.trial188.stdout:1563: finishing write tid 5 to trial18843701-27 2026-02-13T20:18:03.739 INFO:tasks.rados.rados.0.trial188.stdout:1563: oid 27 updating version 0 to 684 2026-02-13T20:18:03.739 INFO:tasks.rados.rados.0.trial188.stdout:1563: oid 27 version 684 is already newer than 682 2026-02-13T20:18:03.739 INFO:tasks.rados.rados.0.trial188.stdout:1563: oid 27 version 684 is already newer than 681 2026-02-13T20:18:03.739 INFO:tasks.rados.rados.0.trial188.stdout:1563: oid 27 version 684 is already newer than 683 2026-02-13T20:18:03.739 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 27 v 684 (ObjNum 576 snap 152 seq_num 576) dirty exists 2026-02-13T20:18:03.739 INFO:tasks.rados.rados.0.trial188.stdout:1563: left oid 27 (ObjNum 576 snap 152 seq_num 576) 2026-02-13T20:18:03.768 INFO:tasks.rados.rados.0.trial188.stdout:1564: finishing copy_from racing read to trial18843701-20 2026-02-13T20:18:03.770 INFO:tasks.rados.rados.0.trial188.stdout:1564: finishing copy_from to trial18843701-20 2026-02-13T20:18:03.770 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 20 v 647 (ObjNum 567 snap 151 seq_num 567) dirty exists 2026-02-13T20:18:04.724 INFO:tasks.rados.rados.0.trial188.stdout:1563: done (2 left) 2026-02-13T20:18:04.725 INFO:tasks.rados.rados.0.trial188.stdout:1564: done (1 left) 2026-02-13T20:18:04.725 INFO:tasks.rados.rados.0.trial188.stdout:1566: done (0 left) 2026-02-13T20:18:04.725 INFO:tasks.rados.rados.0.trial188.stdout:1567: rollback oid 21 current snap is 153 2026-02-13T20:18:04.725 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 21 to 151 2026-02-13T20:18:04.725 INFO:tasks.rados.rados.0.trial188.stdout:1568: copy_from oid 12 from oid 5 current snap is 153 2026-02-13T20:18:04.725 INFO:tasks.rados.rados.0.trial188.stdout:1569: rollback oid 20 current snap is 153 2026-02-13T20:18:04.725 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 20 to 150 2026-02-13T20:18:04.726 INFO:tasks.rados.rados.0.trial188.stdout:1570: read oid 4 snap -1 2026-02-13T20:18:04.726 INFO:tasks.rados.rados.0.trial188.stdout:1570: expect (ObjNum 530 snap 136 seq_num 530) 2026-02-13T20:18:04.726 INFO:tasks.rados.rados.0.trial188.stdout:1571: write (excl) oid 48 current snap is 153 2026-02-13T20:18:04.726 INFO:tasks.rados.rados.0.trial188.stdout:1571: seq_num 578 ranges {514446=736750,1723298=667869,3073078=641368} 2026-02-13T20:18:04.727 INFO:tasks.rados.rados.0.trial188.stdout:1571: writing trial18843701-48 from 514446 to 1251196 tid 1 2026-02-13T20:18:04.731 INFO:tasks.rados.rados.0.trial188.stdout:1571: writing trial18843701-48 from 1723298 to 2391167 tid 2 2026-02-13T20:18:04.737 INFO:tasks.rados.rados.0.trial188.stdout:1571: writing trial18843701-48 from 3073078 to 3714446 tid 3 2026-02-13T20:18:04.737 INFO:tasks.rados.rados.0.trial188.stdout:1572: write (excl) oid 31 current snap is 153 2026-02-13T20:18:04.737 INFO:tasks.rados.rados.0.trial188.stdout:1572: seq_num 579 ranges {531253=411999,1381780=411527,2300501=586966,3376974=354279} 2026-02-13T20:18:04.740 INFO:tasks.rados.rados.0.trial188.stdout:1572: writing trial18843701-31 from 531253 to 943252 tid 1 2026-02-13T20:18:04.743 INFO:tasks.rados.rados.0.trial188.stdout:1572: writing trial18843701-31 from 1381780 to 1793307 tid 2 2026-02-13T20:18:04.747 INFO:tasks.rados.rados.0.trial188.stdout:1572: writing trial18843701-31 from 2300501 to 2887467 tid 3 2026-02-13T20:18:04.751 INFO:tasks.rados.rados.0.trial188.stdout:1572: writing trial18843701-31 from 3376974 to 3731253 tid 4 2026-02-13T20:18:04.751 INFO:tasks.rados.rados.0.trial188.stdout:1573: write (excl) oid 42 current snap is 153 2026-02-13T20:18:04.751 INFO:tasks.rados.rados.0.trial188.stdout:1567: finishing rollback tid 1 to trial18843701-21 2026-02-13T20:18:04.751 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 21 v 0 (ObjNum 49 snap 0 seq_num 1634300532) dirty dne 2026-02-13T20:18:04.751 INFO:tasks.rados.rados.0.trial188.stdout:1569: finishing rollback tid 0 to trial18843701-20 2026-02-13T20:18:04.751 INFO:tasks.rados.rados.0.trial188.stdout:1569: finishing rollback tid 1 to trial18843701-20 2026-02-13T20:18:04.751 INFO:tasks.rados.rados.0.trial188.stdout:1569: finishing rollback tid 2 to trial18843701-20 2026-02-13T20:18:04.752 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 20 v 650 (ObjNum 531 snap 136 seq_num 531) dirty exists 2026-02-13T20:18:04.752 INFO:tasks.rados.rados.0.trial188.stdout:1570: expect (ObjNum 530 snap 136 seq_num 530) 2026-02-13T20:18:04.752 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:18:04.809 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 363398 2026-02-13T20:18:04.837 INFO:tasks.rados.rados.0.trial188.stdout:1572: finishing write tid 1 to trial18843701-31 2026-02-13T20:18:04.837 INFO:tasks.rados.rados.0.trial188.stdout:1571: finishing write tid 1 to trial18843701-48 2026-02-13T20:18:04.837 INFO:tasks.rados.rados.0.trial188.stdout:1571: finishing write tid 2 to trial18843701-48 2026-02-13T20:18:04.837 INFO:tasks.rados.rados.0.trial188.stdout:1572: finishing write tid 2 to trial18843701-31 2026-02-13T20:18:04.838 INFO:tasks.rados.rados.0.trial188.stdout:1568: finishing copy_from racing read to trial18843701-12 2026-02-13T20:18:04.838 INFO:tasks.rados.rados.0.trial188.stdout:1568: finishing copy_from to trial18843701-12 2026-02-13T20:18:04.838 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 12 v 572 (ObjNum 539 snap 140 seq_num 539) dirty exists 2026-02-13T20:18:04.838 INFO:tasks.rados.rados.0.trial188.stdout:1571: finishing write tid 3 to trial18843701-48 2026-02-13T20:18:04.838 INFO:tasks.rados.rados.0.trial188.stdout:1572: finishing write tid 3 to trial18843701-31 2026-02-13T20:18:04.838 INFO:tasks.rados.rados.0.trial188.stdout:1571: finishing write tid 4 to trial18843701-48 2026-02-13T20:18:04.838 INFO:tasks.rados.rados.0.trial188.stdout:1572: finishing write tid 4 to trial18843701-31 2026-02-13T20:18:04.838 INFO:tasks.rados.rados.0.trial188.stdout:1571: finishing write tid 5 to trial18843701-48 2026-02-13T20:18:04.838 INFO:tasks.rados.rados.0.trial188.stdout:1571: oid 48 updating version 0 to 432 2026-02-13T20:18:04.838 INFO:tasks.rados.rados.0.trial188.stdout:1571: oid 48 updating version 432 to 433 2026-02-13T20:18:04.838 INFO:tasks.rados.rados.0.trial188.stdout:1571: oid 48 version 433 is already newer than 430 2026-02-13T20:18:04.839 INFO:tasks.rados.rados.0.trial188.stdout:1571: oid 48 version 433 is already newer than 431 2026-02-13T20:18:04.839 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 48 v 433 (ObjNum 578 snap 153 seq_num 578) dirty exists 2026-02-13T20:18:04.839 INFO:tasks.rados.rados.0.trial188.stdout:1571: left oid 48 (ObjNum 578 snap 153 seq_num 578) 2026-02-13T20:18:04.839 INFO:tasks.rados.rados.0.trial188.stdout:1572: finishing write tid 5 to trial18843701-31 2026-02-13T20:18:04.839 INFO:tasks.rados.rados.0.trial188.stdout:1572: finishing write tid 6 to trial18843701-31 2026-02-13T20:18:04.839 INFO:tasks.rados.rados.0.trial188.stdout:1572: oid 31 updating version 0 to 425 2026-02-13T20:18:04.839 INFO:tasks.rados.rados.0.trial188.stdout:1572: oid 31 updating version 425 to 426 2026-02-13T20:18:04.839 INFO:tasks.rados.rados.0.trial188.stdout:1572: oid 31 updating version 426 to 427 2026-02-13T20:18:04.839 INFO:tasks.rados.rados.0.trial188.stdout:1572: oid 31 version 427 is already newer than 424 2026-02-13T20:18:04.840 INFO:tasks.rados.rados.0.trial188.stdout:1572: oid 31 updating version 427 to 428 2026-02-13T20:18:04.840 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 31 v 428 (ObjNum 579 snap 153 seq_num 579) dirty exists 2026-02-13T20:18:04.840 INFO:tasks.rados.rados.0.trial188.stdout:1572: left oid 31 (ObjNum 579 snap 153 seq_num 579) 2026-02-13T20:18:04.840 INFO:tasks.rados.rados.0.trial188.stdout:1573: seq_num 580 ranges {548060=487248,1440262=671538,2844277=798238} 2026-02-13T20:18:04.840 INFO:tasks.rados.rados.0.trial188.stdout:1573: writing trial18843701-42 from 548060 to 1035308 tid 1 2026-02-13T20:18:04.844 INFO:tasks.rados.rados.0.trial188.stdout:1573: writing trial18843701-42 from 1440262 to 2111800 tid 2 2026-02-13T20:18:04.850 INFO:tasks.rados.rados.0.trial188.stdout:1573: writing trial18843701-42 from 2844277 to 3642515 tid 3 2026-02-13T20:18:04.851 INFO:tasks.rados.rados.0.trial188.stdout:1567: done (6 left) 2026-02-13T20:18:04.851 INFO:tasks.rados.rados.0.trial188.stdout:1568: done (5 left) 2026-02-13T20:18:04.851 INFO:tasks.rados.rados.0.trial188.stdout:1569: done (4 left) 2026-02-13T20:18:04.851 INFO:tasks.rados.rados.0.trial188.stdout:1570: done (3 left) 2026-02-13T20:18:04.851 INFO:tasks.rados.rados.0.trial188.stdout:1571: done (2 left) 2026-02-13T20:18:04.851 INFO:tasks.rados.rados.0.trial188.stdout:1572: done (1 left) 2026-02-13T20:18:04.851 INFO:tasks.rados.rados.0.trial188.stdout:1574: delete oid 28 current snap is 153 2026-02-13T20:18:04.858 INFO:tasks.rados.rados.0.trial188.stdout:1574: done (1 left) 2026-02-13T20:18:04.858 INFO:tasks.rados.rados.0.trial188.stdout:1575: copy_from oid 35 from oid 2 current snap is 153 2026-02-13T20:18:04.859 INFO:tasks.rados.rados.0.trial188.stdout:1576: write oid 45 current snap is 153 2026-02-13T20:18:04.859 INFO:tasks.rados.rados.0.trial188.stdout:1576: seq_num 582 ranges {581674=637746,1840873=558854,3066417=537135} 2026-02-13T20:18:04.863 INFO:tasks.rados.rados.0.trial188.stdout:1576: writing trial18843701-45 from 581674 to 1219420 tid 1 2026-02-13T20:18:04.867 INFO:tasks.rados.rados.0.trial188.stdout:1576: writing trial18843701-45 from 1840873 to 2399727 tid 2 2026-02-13T20:18:04.872 INFO:tasks.rados.rados.0.trial188.stdout:1576: writing trial18843701-45 from 3066417 to 3603552 tid 3 2026-02-13T20:18:04.872 INFO:tasks.rados.rados.0.trial188.stdout:1577: write oid 37 current snap is 153 2026-02-13T20:18:04.872 INFO:tasks.rados.rados.0.trial188.stdout:1577: seq_num 583 ranges {598481=712995,1899355=418865,3093840=704641} 2026-02-13T20:18:04.877 INFO:tasks.rados.rados.0.trial188.stdout:1577: writing trial18843701-37 from 598481 to 1311476 tid 1 2026-02-13T20:18:04.880 INFO:tasks.rados.rados.0.trial188.stdout:1577: writing trial18843701-37 from 1899355 to 2318220 tid 2 2026-02-13T20:18:04.887 INFO:tasks.rados.rados.0.trial188.stdout:1577: writing trial18843701-37 from 3093840 to 3798481 tid 3 2026-02-13T20:18:04.887 INFO:tasks.rados.rados.0.trial188.stdout:1578: read oid 8 snap 152 2026-02-13T20:18:04.887 INFO:tasks.rados.rados.0.trial188.stdout:1578: expect deleted 2026-02-13T20:18:04.887 INFO:tasks.rados.rados.0.trial188.stdout:1579: write (excl) oid 16 current snap is 153 2026-02-13T20:18:04.887 INFO:tasks.rados.rados.0.trial188.stdout:1573: finishing write tid 1 to trial18843701-42 2026-02-13T20:18:04.887 INFO:tasks.rados.rados.0.trial188.stdout:1573: finishing write tid 2 to trial18843701-42 2026-02-13T20:18:04.887 INFO:tasks.rados.rados.0.trial188.stdout:1573: finishing write tid 3 to trial18843701-42 2026-02-13T20:18:04.887 INFO:tasks.rados.rados.0.trial188.stdout:1573: finishing write tid 4 to trial18843701-42 2026-02-13T20:18:04.888 INFO:tasks.rados.rados.0.trial188.stdout:1573: finishing write tid 5 to trial18843701-42 2026-02-13T20:18:04.888 INFO:tasks.rados.rados.0.trial188.stdout:1573: oid 42 updating version 0 to 461 2026-02-13T20:18:04.888 INFO:tasks.rados.rados.0.trial188.stdout:1573: oid 42 version 461 is already newer than 459 2026-02-13T20:18:04.888 INFO:tasks.rados.rados.0.trial188.stdout:1573: oid 42 version 461 is already newer than 460 2026-02-13T20:18:04.888 INFO:tasks.rados.rados.0.trial188.stdout:1573: oid 42 updating version 461 to 462 2026-02-13T20:18:04.888 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 42 v 462 (ObjNum 580 snap 153 seq_num 580) dirty exists 2026-02-13T20:18:04.888 INFO:tasks.rados.rados.0.trial188.stdout:1573: left oid 42 (ObjNum 580 snap 153 seq_num 580) 2026-02-13T20:18:04.888 INFO:tasks.rados.rados.0.trial188.stdout:1579: seq_num 584 ranges {615288=788244,1957837=562523,3121263=559679} 2026-02-13T20:18:04.891 INFO:tasks.rados.rados.0.trial188.stdout:1579: writing trial18843701-16 from 615288 to 1403532 tid 1 2026-02-13T20:18:04.895 INFO:tasks.rados.rados.0.trial188.stdout:1579: writing trial18843701-16 from 1957837 to 2520360 tid 2 2026-02-13T20:18:04.900 INFO:tasks.rados.rados.0.trial188.stdout:1579: writing trial18843701-16 from 3121263 to 3680942 tid 3 2026-02-13T20:18:04.900 INFO:tasks.rados.rados.0.trial188.stdout:1573: done (5 left) 2026-02-13T20:18:04.901 INFO:tasks.rados.rados.0.trial188.stdout:1580: copy_from oid 33 from oid 6 current snap is 153 2026-02-13T20:18:04.901 INFO:tasks.rados.rados.0.trial188.stdout:1575: finishing copy_from racing read to trial18843701-35 2026-02-13T20:18:04.901 INFO:tasks.rados.rados.0.trial188.stdout:1576: finishing write tid 1 to trial18843701-45 2026-02-13T20:18:04.901 INFO:tasks.rados.rados.0.trial188.stdout:1576: finishing write tid 2 to trial18843701-45 2026-02-13T20:18:04.901 INFO:tasks.rados.rados.0.trial188.stdout:1576: finishing write tid 3 to trial18843701-45 2026-02-13T20:18:04.901 INFO:tasks.rados.rados.0.trial188.stdout:1581: read oid 23 snap -1 2026-02-13T20:18:04.901 INFO:tasks.rados.rados.0.trial188.stdout:1581: expect (ObjNum 538 snap 139 seq_num 538) 2026-02-13T20:18:04.901 INFO:tasks.rados.rados.0.trial188.stdout:1582: snap_remove snap 151 2026-02-13T20:18:05.728 INFO:tasks.rados.rados.0.trial188.stdout:1582: done (7 left) 2026-02-13T20:18:05.728 INFO:tasks.rados.rados.0.trial188.stdout:1583: copy_from oid 47 from oid 28 current snap is 153 2026-02-13T20:18:05.728 INFO:tasks.rados.rados.0.trial188.stdout:1576: finishing write tid 4 to trial18843701-45 2026-02-13T20:18:05.728 INFO:tasks.rados.rados.0.trial188.stdout:1576: finishing write tid 5 to trial18843701-45 2026-02-13T20:18:05.728 INFO:tasks.rados.rados.0.trial188.stdout:1576: oid 45 updating version 0 to 574 2026-02-13T20:18:05.728 INFO:tasks.rados.rados.0.trial188.stdout:1576: oid 45 version 574 is already newer than 571 2026-02-13T20:18:05.728 INFO:tasks.rados.rados.0.trial188.stdout:1576: oid 45 version 574 is already newer than 572 2026-02-13T20:18:05.729 INFO:tasks.rados.rados.0.trial188.stdout:1576: oid 45 version 574 is already newer than 573 2026-02-13T20:18:05.729 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 45 v 574 (ObjNum 582 snap 153 seq_num 582) dirty exists 2026-02-13T20:18:05.729 INFO:tasks.rados.rados.0.trial188.stdout:1576: left oid 45 (ObjNum 582 snap 153 seq_num 582) 2026-02-13T20:18:05.729 INFO:tasks.rados.rados.0.trial188.stdout:1577: finishing write tid 1 to trial18843701-37 2026-02-13T20:18:05.729 INFO:tasks.rados.rados.0.trial188.stdout:1575: finishing copy_from to trial18843701-35 2026-02-13T20:18:05.729 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 35 v 659 (ObjNum 571 snap 151 seq_num 571) dirty exists 2026-02-13T20:18:05.729 INFO:tasks.rados.rados.0.trial188.stdout:1577: finishing write tid 2 to trial18843701-37 2026-02-13T20:18:05.729 INFO:tasks.rados.rados.0.trial188.stdout:1575: done (7 left) 2026-02-13T20:18:05.729 INFO:tasks.rados.rados.0.trial188.stdout:1576: done (6 left) 2026-02-13T20:18:05.729 INFO:tasks.rados.rados.0.trial188.stdout:1578: done (5 left) 2026-02-13T20:18:05.730 INFO:tasks.rados.rados.0.trial188.stdout:1584: write (excl) oid 5 current snap is 153 2026-02-13T20:18:05.730 INFO:tasks.rados.rados.0.trial188.stdout:1579: finishing write tid 1 to trial18843701-16 2026-02-13T20:18:05.730 INFO:tasks.rados.rados.0.trial188.stdout:1584: seq_num 585 ranges {632095=463493,1616319=422534,2748686=487304} 2026-02-13T20:18:05.730 INFO:tasks.rados.rados.0.trial188.stdout:1584: writing trial18843701-5 from 632095 to 1095588 tid 1 2026-02-13T20:18:05.734 INFO:tasks.rados.rados.0.trial188.stdout:1584: writing trial18843701-5 from 1616319 to 2038853 tid 2 2026-02-13T20:18:05.740 INFO:tasks.rados.rados.0.trial188.stdout:1584: writing trial18843701-5 from 2748686 to 3235990 tid 3 2026-02-13T20:18:05.740 INFO:tasks.rados.rados.0.trial188.stdout:1585: read oid 29 snap 152 2026-02-13T20:18:05.740 INFO:tasks.rados.rados.0.trial188.stdout:1585: expect (ObjNum 513 snap 132 seq_num 513) 2026-02-13T20:18:05.740 INFO:tasks.rados.rados.0.trial188.stdout:1586: read oid 17 snap -1 2026-02-13T20:18:05.740 INFO:tasks.rados.rados.0.trial188.stdout:1586: expect (ObjNum 417 snap 111 seq_num 417) 2026-02-13T20:18:05.741 INFO:tasks.rados.rados.0.trial188.stdout:1587: snap_remove snap 150 2026-02-13T20:18:05.741 INFO:tasks.rados.rados.0.trial188.stdout:1577: finishing write tid 3 to trial18843701-37 2026-02-13T20:18:05.741 INFO:tasks.rados.rados.0.trial188.stdout:1579: finishing write tid 2 to trial18843701-16 2026-02-13T20:18:05.741 INFO:tasks.rados.rados.0.trial188.stdout:1577: finishing write tid 4 to trial18843701-37 2026-02-13T20:18:05.741 INFO:tasks.rados.rados.0.trial188.stdout:1577: finishing write tid 5 to trial18843701-37 2026-02-13T20:18:05.741 INFO:tasks.rados.rados.0.trial188.stdout:1577: oid 37 updating version 0 to 576 2026-02-13T20:18:05.741 INFO:tasks.rados.rados.0.trial188.stdout:1577: oid 37 updating version 576 to 578 2026-02-13T20:18:05.741 INFO:tasks.rados.rados.0.trial188.stdout:1577: oid 37 version 578 is already newer than 577 2026-02-13T20:18:05.741 INFO:tasks.rados.rados.0.trial188.stdout:1577: oid 37 updating version 578 to 579 2026-02-13T20:18:05.741 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 37 v 579 (ObjNum 583 snap 153 seq_num 583) dirty exists 2026-02-13T20:18:05.742 INFO:tasks.rados.rados.0.trial188.stdout:1577: left oid 37 (ObjNum 583 snap 153 seq_num 583) 2026-02-13T20:18:05.742 INFO:tasks.rados.rados.0.trial188.stdout:1579: finishing write tid 3 to trial18843701-16 2026-02-13T20:18:05.742 INFO:tasks.rados.rados.0.trial188.stdout:1579: finishing write tid 4 to trial18843701-16 2026-02-13T20:18:05.742 INFO:tasks.rados.rados.0.trial188.stdout:1579: finishing write tid 5 to trial18843701-16 2026-02-13T20:18:05.742 INFO:tasks.rados.rados.0.trial188.stdout:1579: oid 16 updating version 0 to 726 2026-02-13T20:18:05.742 INFO:tasks.rados.rados.0.trial188.stdout:1579: oid 16 updating version 726 to 728 2026-02-13T20:18:05.742 INFO:tasks.rados.rados.0.trial188.stdout:1579: oid 16 version 728 is already newer than 727 2026-02-13T20:18:05.742 INFO:tasks.rados.rados.0.trial188.stdout:1579: oid 16 version 728 is already newer than 725 2026-02-13T20:18:05.742 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 16 v 728 (ObjNum 584 snap 153 seq_num 584) dirty exists 2026-02-13T20:18:05.742 INFO:tasks.rados.rados.0.trial188.stdout:1579: left oid 16 (ObjNum 584 snap 153 seq_num 584) 2026-02-13T20:18:05.743 INFO:tasks.rados.rados.0.trial188.stdout:1581: expect (ObjNum 538 snap 139 seq_num 538) 2026-02-13T20:18:05.790 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:18:05.821 INFO:tasks.rados.rados.0.trial188.stdout:1580: finishing copy_from racing read to trial18843701-33 2026-02-13T20:18:05.822 INFO:tasks.rados.rados.0.trial188.stdout:1580: finishing copy_from to trial18843701-33 2026-02-13T20:18:05.822 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 33 v 644 (ObjNum 508 snap 132 seq_num 508) dirty exists 2026-02-13T20:18:06.730 INFO:tasks.rados.rados.0.trial188.stdout:1577: done (8 left) 2026-02-13T20:18:06.730 INFO:tasks.rados.rados.0.trial188.stdout:1579: done (7 left) 2026-02-13T20:18:06.730 INFO:tasks.rados.rados.0.trial188.stdout:1580: done (6 left) 2026-02-13T20:18:06.731 INFO:tasks.rados.rados.0.trial188.stdout:1581: done (5 left) 2026-02-13T20:18:06.731 INFO:tasks.rados.rados.0.trial188.stdout:1587: done (4 left) 2026-02-13T20:18:06.731 INFO:tasks.rados.rados.0.trial188.stdout:1588: write (excl) oid 32 current snap is 153 2026-02-13T20:18:06.731 INFO:tasks.rados.rados.0.trial188.stdout:1583: finishing copy_from to trial18843701-47 2026-02-13T20:18:06.731 INFO:tasks.rados.rados.0.trial188.stdout:1583: got expected ENOENT (src dne) 2026-02-13T20:18:06.731 INFO:tasks.rados.rados.0.trial188.stdout:1583: finishing copy_from racing read to trial18843701-47 2026-02-13T20:18:06.731 INFO:tasks.rados.rados.0.trial188.stdout:1585: expect (ObjNum 513 snap 132 seq_num 513) 2026-02-13T20:18:06.733 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 633411 2026-02-13T20:18:06.766 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 541568 2026-02-13T20:18:06.833 INFO:tasks.rados.rados.0.trial188.stdout:1586: expect (ObjNum 417 snap 111 seq_num 417) 2026-02-13T20:18:06.859 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 427321 2026-02-13T20:18:06.897 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1954704 2026-02-13T20:18:06.909 INFO:tasks.rados.rados.0.trial188.stdout:1584: finishing write tid 1 to trial18843701-5 2026-02-13T20:18:06.910 INFO:tasks.rados.rados.0.trial188.stdout:1584: finishing write tid 2 to trial18843701-5 2026-02-13T20:18:06.910 INFO:tasks.rados.rados.0.trial188.stdout:1584: finishing write tid 3 to trial18843701-5 2026-02-13T20:18:06.910 INFO:tasks.rados.rados.0.trial188.stdout:1584: finishing write tid 4 to trial18843701-5 2026-02-13T20:18:06.910 INFO:tasks.rados.rados.0.trial188.stdout:1588: seq_num 586 ranges {648902=655095,2074801=566192,3176109=672793} 2026-02-13T20:18:06.915 INFO:tasks.rados.rados.0.trial188.stdout:1588: writing trial18843701-32 from 648902 to 1303997 tid 1 2026-02-13T20:18:06.920 INFO:tasks.rados.rados.0.trial188.stdout:1588: writing trial18843701-32 from 2074801 to 2640993 tid 2 2026-02-13T20:18:06.925 INFO:tasks.rados.rados.0.trial188.stdout:1588: writing trial18843701-32 from 3176109 to 3848902 tid 3 2026-02-13T20:18:06.925 INFO:tasks.rados.rados.0.trial188.stdout:1583: done (4 left) 2026-02-13T20:18:06.925 INFO:tasks.rados.rados.0.trial188.stdout:1585: done (3 left) 2026-02-13T20:18:06.925 INFO:tasks.rados.rados.0.trial188.stdout:1586: done (2 left) 2026-02-13T20:18:06.925 INFO:tasks.rados.rados.0.trial188.stdout:1589: read oid 2 snap -1 2026-02-13T20:18:06.925 INFO:tasks.rados.rados.0.trial188.stdout:1589: expect (ObjNum 571 snap 151 seq_num 571) 2026-02-13T20:18:06.925 INFO:tasks.rados.rados.0.trial188.stdout:1590: read oid 9 snap -1 2026-02-13T20:18:06.925 INFO:tasks.rados.rados.0.trial188.stdout:1590: expect (ObjNum 542 snap 141 seq_num 542) 2026-02-13T20:18:06.926 INFO:tasks.rados.rados.0.trial188.stdout:1591: snap_remove snap 152 2026-02-13T20:18:07.697 INFO:tasks.rados.rados.0.trial188.stdout:1591: done (4 left) 2026-02-13T20:18:07.697 INFO:tasks.rados.rados.0.trial188.stdout:1592: read oid 24 snap -1 2026-02-13T20:18:07.697 INFO:tasks.rados.rados.0.trial188.stdout:1592: expect deleted 2026-02-13T20:18:07.697 INFO:tasks.rados.rados.0.trial188.stdout:1593: read oid 14 snap -1 2026-02-13T20:18:07.697 INFO:tasks.rados.rados.0.trial188.stdout:1593: expect (ObjNum 575 snap 152 seq_num 575) 2026-02-13T20:18:07.698 INFO:tasks.rados.rados.0.trial188.stdout:1594: copy_from oid 26 from oid 49 current snap is 153 2026-02-13T20:18:07.698 INFO:tasks.rados.rados.0.trial188.stdout:1584: finishing write tid 5 to trial18843701-5 2026-02-13T20:18:07.698 INFO:tasks.rados.rados.0.trial188.stdout:1584: oid 5 updating version 0 to 676 2026-02-13T20:18:07.698 INFO:tasks.rados.rados.0.trial188.stdout:1584: oid 5 version 676 is already newer than 675 2026-02-13T20:18:07.698 INFO:tasks.rados.rados.0.trial188.stdout:1584: oid 5 updating version 676 to 677 2026-02-13T20:18:07.698 INFO:tasks.rados.rados.0.trial188.stdout:1584: oid 5 updating version 677 to 678 2026-02-13T20:18:07.698 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 5 v 678 (ObjNum 585 snap 153 seq_num 585) dirty exists 2026-02-13T20:18:07.698 INFO:tasks.rados.rados.0.trial188.stdout:1584: left oid 5 (ObjNum 585 snap 153 seq_num 585) 2026-02-13T20:18:07.698 INFO:tasks.rados.rados.0.trial188.stdout:1589: expect (ObjNum 571 snap 151 seq_num 571) 2026-02-13T20:18:07.733 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2615683 2026-02-13T20:18:07.767 INFO:tasks.rados.rados.0.trial188.stdout:1590: expect (ObjNum 542 snap 141 seq_num 542) 2026-02-13T20:18:07.826 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1566928 2026-02-13T20:18:07.864 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 945047 2026-02-13T20:18:07.902 INFO:tasks.rados.rados.0.trial188.stdout:1588: finishing write tid 1 to trial18843701-32 2026-02-13T20:18:07.902 INFO:tasks.rados.rados.0.trial188.stdout:1588: finishing write tid 2 to trial18843701-32 2026-02-13T20:18:07.902 INFO:tasks.rados.rados.0.trial188.stdout:1588: finishing write tid 3 to trial18843701-32 2026-02-13T20:18:07.902 INFO:tasks.rados.rados.0.trial188.stdout:1588: finishing write tid 4 to trial18843701-32 2026-02-13T20:18:07.902 INFO:tasks.rados.rados.0.trial188.stdout:1584: done (6 left) 2026-02-13T20:18:07.902 INFO:tasks.rados.rados.0.trial188.stdout:1589: done (5 left) 2026-02-13T20:18:07.902 INFO:tasks.rados.rados.0.trial188.stdout:1590: done (4 left) 2026-02-13T20:18:07.902 INFO:tasks.rados.rados.0.trial188.stdout:1595: delete oid 5 current snap is 153 2026-02-13T20:18:07.902 INFO:tasks.rados.rados.0.trial188.stdout:1588: finishing write tid 5 to trial18843701-32 2026-02-13T20:18:07.902 INFO:tasks.rados.rados.0.trial188.stdout:1588: oid 32 updating version 0 to 459 2026-02-13T20:18:07.902 INFO:tasks.rados.rados.0.trial188.stdout:1588: oid 32 version 459 is already newer than 458 2026-02-13T20:18:07.902 INFO:tasks.rados.rados.0.trial188.stdout:1588: oid 32 version 459 is already newer than 457 2026-02-13T20:18:07.902 INFO:tasks.rados.rados.0.trial188.stdout:1588: oid 32 updating version 459 to 460 2026-02-13T20:18:07.902 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 32 v 460 (ObjNum 586 snap 153 seq_num 586) dirty exists 2026-02-13T20:18:07.902 INFO:tasks.rados.rados.0.trial188.stdout:1588: left oid 32 (ObjNum 586 snap 153 seq_num 586) 2026-02-13T20:18:07.902 INFO:tasks.rados.rados.0.trial188.stdout:1593: expect (ObjNum 575 snap 152 seq_num 575) 2026-02-13T20:18:07.992 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2613964 2026-02-13T20:18:08.062 INFO:tasks.rados.rados.0.trial188.stdout:1594: finishing copy_from racing read to trial18843701-26 2026-02-13T20:18:08.062 INFO:tasks.rados.rados.0.trial188.stdout:1594: finishing copy_from to trial18843701-26 2026-02-13T20:18:08.062 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 26 v 605 (ObjNum 523 snap 135 seq_num 523) dirty exists 2026-02-13T20:18:08.062 INFO:tasks.rados.rados.0.trial188.stdout:1588: done (4 left) 2026-02-13T20:18:08.062 INFO:tasks.rados.rados.0.trial188.stdout:1592: done (3 left) 2026-02-13T20:18:08.062 INFO:tasks.rados.rados.0.trial188.stdout:1593: done (2 left) 2026-02-13T20:18:08.062 INFO:tasks.rados.rados.0.trial188.stdout:1594: done (1 left) 2026-02-13T20:18:08.062 INFO:tasks.rados.rados.0.trial188.stdout:1595: done (0 left) 2026-02-13T20:18:08.062 INFO:tasks.rados.rados.0.trial188.stdout:1596: read oid 2 snap -1 2026-02-13T20:18:08.062 INFO:tasks.rados.rados.0.trial188.stdout:1596: expect (ObjNum 571 snap 151 seq_num 571) 2026-02-13T20:18:08.062 INFO:tasks.rados.rados.0.trial188.stdout:1597: copy_from oid 34 from oid 20 current snap is 153 2026-02-13T20:18:08.062 INFO:tasks.rados.rados.0.trial188.stdout:1598: write oid 21 current snap is 153 2026-02-13T20:18:08.062 INFO:tasks.rados.rados.0.trial188.stdout:1598: seq_num 588 ranges {682516=405593,1791765=569861,2830955=721120} 2026-02-13T20:18:08.066 INFO:tasks.rados.rados.0.trial188.stdout:1598: writing trial18843701-21 from 682516 to 1088109 tid 1 2026-02-13T20:18:08.071 INFO:tasks.rados.rados.0.trial188.stdout:1598: writing trial18843701-21 from 1791765 to 2361626 tid 2 2026-02-13T20:18:08.075 INFO:tasks.rados.rados.0.trial188.stdout:1598: writing trial18843701-21 from 2830955 to 3552075 tid 3 2026-02-13T20:18:08.075 INFO:tasks.rados.rados.0.trial188.stdout:1599: copy_from oid 26 from oid 9 current snap is 153 2026-02-13T20:18:08.075 INFO:tasks.rados.rados.0.trial188.stdout:1596: expect (ObjNum 571 snap 151 seq_num 571) 2026-02-13T20:18:08.090 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 445969 2026-02-13T20:18:08.121 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 3047005 2026-02-13T20:18:08.130 INFO:tasks.rados.rados.0.trial188.stdout:1598: finishing write tid 1 to trial18843701-21 2026-02-13T20:18:08.130 INFO:tasks.rados.rados.0.trial188.stdout:1598: finishing write tid 2 to trial18843701-21 2026-02-13T20:18:08.130 INFO:tasks.rados.rados.0.trial188.stdout:1596: done (3 left) 2026-02-13T20:18:08.130 INFO:tasks.rados.rados.0.trial188.stdout:1600: delete oid 42 current snap is 153 2026-02-13T20:18:08.130 INFO:tasks.rados.rados.0.trial188.stdout:1598: finishing write tid 3 to trial18843701-21 2026-02-13T20:18:08.130 INFO:tasks.rados.rados.0.trial188.stdout:1598: finishing write tid 4 to trial18843701-21 2026-02-13T20:18:08.130 INFO:tasks.rados.rados.0.trial188.stdout:1598: finishing write tid 5 to trial18843701-21 2026-02-13T20:18:08.130 INFO:tasks.rados.rados.0.trial188.stdout:1598: oid 21 updating version 0 to 436 2026-02-13T20:18:08.130 INFO:tasks.rados.rados.0.trial188.stdout:1598: oid 21 version 436 is already newer than 435 2026-02-13T20:18:08.130 INFO:tasks.rados.rados.0.trial188.stdout:1598: oid 21 version 436 is already newer than 434 2026-02-13T20:18:08.131 INFO:tasks.rados.rados.0.trial188.stdout:1598: oid 21 updating version 436 to 437 2026-02-13T20:18:08.131 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 21 v 437 (ObjNum 588 snap 153 seq_num 588) dirty exists 2026-02-13T20:18:08.131 INFO:tasks.rados.rados.0.trial188.stdout:1598: left oid 21 (ObjNum 588 snap 153 seq_num 588) 2026-02-13T20:18:08.131 INFO:tasks.rados.rados.0.trial188.stdout:1597: finishing copy_from racing read to trial18843701-34 2026-02-13T20:18:08.131 INFO:tasks.rados.rados.0.trial188.stdout:1597: finishing copy_from to trial18843701-34 2026-02-13T20:18:08.131 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 34 v 650 (ObjNum 531 snap 136 seq_num 531) dirty exists 2026-02-13T20:18:08.131 INFO:tasks.rados.rados.0.trial188.stdout:1599: finishing copy_from racing read to trial18843701-26 2026-02-13T20:18:08.131 INFO:tasks.rados.rados.0.trial188.stdout:1599: finishing copy_from to trial18843701-26 2026-02-13T20:18:08.131 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 26 v 457 (ObjNum 542 snap 141 seq_num 542) dirty exists 2026-02-13T20:18:08.132 INFO:tasks.rados.rados.0.trial188.stdout:1597: done (3 left) 2026-02-13T20:18:08.132 INFO:tasks.rados.rados.0.trial188.stdout:1598: done (2 left) 2026-02-13T20:18:08.132 INFO:tasks.rados.rados.0.trial188.stdout:1599: done (1 left) 2026-02-13T20:18:08.132 INFO:tasks.rados.rados.0.trial188.stdout:1600: done (0 left) 2026-02-13T20:18:08.132 INFO:tasks.rados.rados.0.trial188.stdout:1601: write (excl) oid 46 current snap is 153 2026-02-13T20:18:08.132 INFO:tasks.rados.rados.0.trial188.stdout:1601: seq_num 590 ranges {716130=556091,1792376=573530,2769448=460017,3821956=94174} 2026-02-13T20:18:08.135 INFO:tasks.rados.rados.0.trial188.stdout:1601: writing trial18843701-46 from 716130 to 1272221 tid 1 2026-02-13T20:18:08.139 INFO:tasks.rados.rados.0.trial188.stdout:1601: writing trial18843701-46 from 1792376 to 2365906 tid 2 2026-02-13T20:18:08.142 INFO:tasks.rados.rados.0.trial188.stdout:1601: writing trial18843701-46 from 2769448 to 3229465 tid 3 2026-02-13T20:18:08.145 INFO:tasks.rados.rados.0.trial188.stdout:1601: writing trial18843701-46 from 3821956 to 3916130 tid 4 2026-02-13T20:18:08.145 INFO:tasks.rados.rados.0.trial188.stdout:1602: read oid 25 snap -1 2026-02-13T20:18:08.145 INFO:tasks.rados.rados.0.trial188.stdout:1602: expect (ObjNum 538 snap 139 seq_num 538) 2026-02-13T20:18:08.145 INFO:tasks.rados.rados.0.trial188.stdout:1603: copy_from oid 13 from oid 48 current snap is 153 2026-02-13T20:18:08.145 INFO:tasks.rados.rados.0.trial188.stdout:1604: write oid 8 current snap is 153 2026-02-13T20:18:08.146 INFO:tasks.rados.rados.0.trial188.stdout:1604: seq_num 591 ranges {732937=631340,1850858=433541,2796871=671289,3888195=44742} 2026-02-13T20:18:08.150 INFO:tasks.rados.rados.0.trial188.stdout:1604: writing trial18843701-8 from 732937 to 1364277 tid 1 2026-02-13T20:18:08.153 INFO:tasks.rados.rados.0.trial188.stdout:1604: writing trial18843701-8 from 1850858 to 2284399 tid 2 2026-02-13T20:18:08.158 INFO:tasks.rados.rados.0.trial188.stdout:1604: writing trial18843701-8 from 2796871 to 3468160 tid 3 2026-02-13T20:18:08.159 INFO:tasks.rados.rados.0.trial188.stdout:1604: writing trial18843701-8 from 3888195 to 3932937 tid 4 2026-02-13T20:18:08.160 INFO:tasks.rados.rados.0.trial188.stdout:1605: snap_create 2026-02-13T20:18:08.160 INFO:tasks.rados.rados.0.trial188.stdout:1602: expect (ObjNum 538 snap 139 seq_num 538) 2026-02-13T20:18:08.188 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:18:08.243 INFO:tasks.rados.rados.0.trial188.stdout:1601: finishing write tid 1 to trial18843701-46 2026-02-13T20:18:08.243 INFO:tasks.rados.rados.0.trial188.stdout:1601: finishing write tid 2 to trial18843701-46 2026-02-13T20:18:08.243 INFO:tasks.rados.rados.0.trial188.stdout:1601: finishing write tid 3 to trial18843701-46 2026-02-13T20:18:08.243 INFO:tasks.rados.rados.0.trial188.stdout:1601: finishing write tid 4 to trial18843701-46 2026-02-13T20:18:08.243 INFO:tasks.rados.rados.0.trial188.stdout:1601: finishing write tid 5 to trial18843701-46 2026-02-13T20:18:08.244 INFO:tasks.rados.rados.0.trial188.stdout:1601: finishing write tid 6 to trial18843701-46 2026-02-13T20:18:08.244 INFO:tasks.rados.rados.0.trial188.stdout:1601: oid 46 updating version 0 to 461 2026-02-13T20:18:08.244 INFO:tasks.rados.rados.0.trial188.stdout:1601: oid 46 updating version 461 to 465 2026-02-13T20:18:08.244 INFO:tasks.rados.rados.0.trial188.stdout:1601: oid 46 version 465 is already newer than 464 2026-02-13T20:18:08.244 INFO:tasks.rados.rados.0.trial188.stdout:1601: oid 46 version 465 is already newer than 462 2026-02-13T20:18:08.244 INFO:tasks.rados.rados.0.trial188.stdout:1601: oid 46 version 465 is already newer than 463 2026-02-13T20:18:08.244 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 46 v 465 (ObjNum 590 snap 153 seq_num 590) dirty exists 2026-02-13T20:18:08.244 INFO:tasks.rados.rados.0.trial188.stdout:1601: left oid 46 (ObjNum 590 snap 153 seq_num 590) 2026-02-13T20:18:08.244 INFO:tasks.rados.rados.0.trial188.stdout:1604: finishing write tid 1 to trial18843701-8 2026-02-13T20:18:08.244 INFO:tasks.rados.rados.0.trial188.stdout:1604: finishing write tid 2 to trial18843701-8 2026-02-13T20:18:08.244 INFO:tasks.rados.rados.0.trial188.stdout:1604: finishing write tid 3 to trial18843701-8 2026-02-13T20:18:08.244 INFO:tasks.rados.rados.0.trial188.stdout:1604: finishing write tid 4 to trial18843701-8 2026-02-13T20:18:08.245 INFO:tasks.rados.rados.0.trial188.stdout:1604: finishing write tid 5 to trial18843701-8 2026-02-13T20:18:08.245 INFO:tasks.rados.rados.0.trial188.stdout:1604: finishing write tid 6 to trial18843701-8 2026-02-13T20:18:08.245 INFO:tasks.rados.rados.0.trial188.stdout:1604: oid 8 updating version 0 to 652 2026-02-13T20:18:08.245 INFO:tasks.rados.rados.0.trial188.stdout:1604: oid 8 updating version 652 to 655 2026-02-13T20:18:08.245 INFO:tasks.rados.rados.0.trial188.stdout:1604: oid 8 version 655 is already newer than 653 2026-02-13T20:18:08.245 INFO:tasks.rados.rados.0.trial188.stdout:1604: oid 8 version 655 is already newer than 651 2026-02-13T20:18:08.245 INFO:tasks.rados.rados.0.trial188.stdout:1604: oid 8 version 655 is already newer than 654 2026-02-13T20:18:08.245 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 8 v 655 (ObjNum 591 snap 153 seq_num 591) dirty exists 2026-02-13T20:18:08.245 INFO:tasks.rados.rados.0.trial188.stdout:1604: left oid 8 (ObjNum 591 snap 153 seq_num 591) 2026-02-13T20:18:08.245 INFO:tasks.rados.rados.0.trial188.stdout:1603: finishing copy_from racing read to trial18843701-13 2026-02-13T20:18:08.245 INFO:tasks.rados.rados.0.trial188.stdout:1603: finishing copy_from to trial18843701-13 2026-02-13T20:18:08.245 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 13 v 433 (ObjNum 578 snap 153 seq_num 578) dirty exists 2026-02-13T20:18:08.734 INFO:tasks.rados.rados.0.trial188.stdout:1601: done (4 left) 2026-02-13T20:18:08.734 INFO:tasks.rados.rados.0.trial188.stdout:1602: done (3 left) 2026-02-13T20:18:08.734 INFO:tasks.rados.rados.0.trial188.stdout:1603: done (2 left) 2026-02-13T20:18:08.734 INFO:tasks.rados.rados.0.trial188.stdout:1604: done (1 left) 2026-02-13T20:18:08.734 INFO:tasks.rados.rados.0.trial188.stdout:1605: done (0 left) 2026-02-13T20:18:08.734 INFO:tasks.rados.rados.0.trial188.stdout:1606: copy_from oid 45 from oid 19 current snap is 154 2026-02-13T20:18:08.734 INFO:tasks.rados.rados.0.trial188.stdout:1607: snap_remove snap 153 2026-02-13T20:18:09.736 INFO:tasks.rados.rados.0.trial188.stdout:1607: done (1 left) 2026-02-13T20:18:09.736 INFO:tasks.rados.rados.0.trial188.stdout:1608: write oid 42 current snap is 154 2026-02-13T20:18:09.736 INFO:tasks.rados.rados.0.trial188.stdout:1606: finishing copy_from racing read to trial18843701-45 2026-02-13T20:18:09.736 INFO:tasks.rados.rados.0.trial188.stdout:1608: seq_num 592 ranges {749744=706589,1909340=577199,3224294=482561} 2026-02-13T20:18:09.741 INFO:tasks.rados.rados.0.trial188.stdout:1608: writing trial18843701-42 from 749744 to 1456333 tid 1 2026-02-13T20:18:09.745 INFO:tasks.rados.rados.0.trial188.stdout:1608: writing trial18843701-42 from 1909340 to 2486539 tid 2 2026-02-13T20:18:09.750 INFO:tasks.rados.rados.0.trial188.stdout:1608: writing trial18843701-42 from 3224294 to 3706855 tid 3 2026-02-13T20:18:09.750 INFO:tasks.rados.rados.0.trial188.stdout:1609: rollback oid 6 current snap is 154 2026-02-13T20:18:09.750 INFO:tasks.rados.rados.0.trial188.stdout:1609: done (2 left) 2026-02-13T20:18:09.750 INFO:tasks.rados.rados.0.trial188.stdout:1610: snap_create 2026-02-13T20:18:09.750 INFO:tasks.rados.rados.0.trial188.stdout:1606: finishing copy_from to trial18843701-45 2026-02-13T20:18:09.751 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 45 v 585 (ObjNum 552 snap 144 seq_num 552) dirty exists 2026-02-13T20:18:09.767 INFO:tasks.rados.rados.0.trial188.stdout:1608: finishing write tid 1 to trial18843701-42 2026-02-13T20:18:09.768 INFO:tasks.rados.rados.0.trial188.stdout:1608: finishing write tid 2 to trial18843701-42 2026-02-13T20:18:09.768 INFO:tasks.rados.rados.0.trial188.stdout:1608: finishing write tid 3 to trial18843701-42 2026-02-13T20:18:09.768 INFO:tasks.rados.rados.0.trial188.stdout:1608: finishing write tid 4 to trial18843701-42 2026-02-13T20:18:09.768 INFO:tasks.rados.rados.0.trial188.stdout:1608: finishing write tid 5 to trial18843701-42 2026-02-13T20:18:09.768 INFO:tasks.rados.rados.0.trial188.stdout:1608: oid 42 updating version 0 to 661 2026-02-13T20:18:09.768 INFO:tasks.rados.rados.0.trial188.stdout:1608: oid 42 updating version 661 to 664 2026-02-13T20:18:09.768 INFO:tasks.rados.rados.0.trial188.stdout:1608: oid 42 version 664 is already newer than 662 2026-02-13T20:18:09.768 INFO:tasks.rados.rados.0.trial188.stdout:1608: oid 42 version 664 is already newer than 663 2026-02-13T20:18:09.768 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 42 v 664 (ObjNum 592 snap 154 seq_num 592) dirty exists 2026-02-13T20:18:09.768 INFO:tasks.rados.rados.0.trial188.stdout:1608: left oid 42 (ObjNum 592 snap 154 seq_num 592) 2026-02-13T20:18:10.740 INFO:tasks.rados.rados.0.trial188.stdout:1606: done (2 left) 2026-02-13T20:18:10.741 INFO:tasks.rados.rados.0.trial188.stdout:1608: done (1 left) 2026-02-13T20:18:10.741 INFO:tasks.rados.rados.0.trial188.stdout:1610: done (0 left) 2026-02-13T20:18:10.741 INFO:tasks.rados.rados.0.trial188.stdout:1611: write (excl) oid 14 current snap is 155 2026-02-13T20:18:10.741 INFO:tasks.rados.rados.0.trial188.stdout:1611: seq_num 593 ranges {766551=498191,1684175=720857,2851717=693833} 2026-02-13T20:18:10.744 INFO:tasks.rados.rados.0.trial188.stdout:1611: writing trial18843701-14 from 766551 to 1264742 tid 1 2026-02-13T20:18:10.749 INFO:tasks.rados.rados.0.trial188.stdout:1611: writing trial18843701-14 from 1684175 to 2405032 tid 2 2026-02-13T20:18:10.753 INFO:tasks.rados.rados.0.trial188.stdout:1611: writing trial18843701-14 from 2851717 to 3545550 tid 3 2026-02-13T20:18:10.754 INFO:tasks.rados.rados.0.trial188.stdout:1612: read oid 16 snap -1 2026-02-13T20:18:10.754 INFO:tasks.rados.rados.0.trial188.stdout:1612: expect (ObjNum 584 snap 153 seq_num 584) 2026-02-13T20:18:10.754 INFO:tasks.rados.rados.0.trial188.stdout:1613: rollback oid 44 current snap is 155 2026-02-13T20:18:10.754 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 44 to 154 2026-02-13T20:18:10.754 INFO:tasks.rados.rados.0.trial188.stdout:1614: rollback oid 48 current snap is 155 2026-02-13T20:18:10.754 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 48 to 154 2026-02-13T20:18:10.754 INFO:tasks.rados.rados.0.trial188.stdout:1615: read oid 22 snap -1 2026-02-13T20:18:10.754 INFO:tasks.rados.rados.0.trial188.stdout:1615: expect deleted 2026-02-13T20:18:10.754 INFO:tasks.rados.rados.0.trial188.stdout:1616: snap_create 2026-02-13T20:18:10.772 INFO:tasks.rados.rados.0.trial188.stdout:1611: finishing write tid 1 to trial18843701-14 2026-02-13T20:18:10.773 INFO:tasks.rados.rados.0.trial188.stdout:1613: finishing rollback tid 0 to trial18843701-44 2026-02-13T20:18:10.774 INFO:tasks.rados.rados.0.trial188.stdout:1614: finishing rollback tid 0 to trial18843701-48 2026-02-13T20:18:10.775 INFO:tasks.rados.rados.0.trial188.stdout:1614: finishing rollback tid 1 to trial18843701-48 2026-02-13T20:18:10.775 INFO:tasks.rados.rados.0.trial188.stdout:1614: finishing rollback tid 2 to trial18843701-48 2026-02-13T20:18:10.775 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 48 v 440 (ObjNum 578 snap 153 seq_num 578) dirty exists 2026-02-13T20:18:10.776 INFO:tasks.rados.rados.0.trial188.stdout:1613: finishing rollback tid 1 to trial18843701-44 2026-02-13T20:18:10.776 INFO:tasks.rados.rados.0.trial188.stdout:1613: finishing rollback tid 2 to trial18843701-44 2026-02-13T20:18:10.776 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 44 v 692 (ObjNum 513 snap 132 seq_num 513) dirty exists 2026-02-13T20:18:10.778 INFO:tasks.rados.rados.0.trial188.stdout:1611: finishing write tid 2 to trial18843701-14 2026-02-13T20:18:10.778 INFO:tasks.rados.rados.0.trial188.stdout:1611: finishing write tid 3 to trial18843701-14 2026-02-13T20:18:10.778 INFO:tasks.rados.rados.0.trial188.stdout:1611: finishing write tid 4 to trial18843701-14 2026-02-13T20:18:10.778 INFO:tasks.rados.rados.0.trial188.stdout:1611: finishing write tid 5 to trial18843701-14 2026-02-13T20:18:10.778 INFO:tasks.rados.rados.0.trial188.stdout:1611: oid 14 updating version 0 to 607 2026-02-13T20:18:10.778 INFO:tasks.rados.rados.0.trial188.stdout:1611: oid 14 updating version 607 to 608 2026-02-13T20:18:10.778 INFO:tasks.rados.rados.0.trial188.stdout:1611: oid 14 version 608 is already newer than 606 2026-02-13T20:18:10.778 INFO:tasks.rados.rados.0.trial188.stdout:1611: oid 14 updating version 608 to 609 2026-02-13T20:18:10.779 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 14 v 609 (ObjNum 593 snap 155 seq_num 593) dirty exists 2026-02-13T20:18:10.779 INFO:tasks.rados.rados.0.trial188.stdout:1611: left oid 14 (ObjNum 593 snap 155 seq_num 593) 2026-02-13T20:18:10.782 INFO:tasks.rados.rados.0.trial188.stdout:1612: expect (ObjNum 584 snap 153 seq_num 584) 2026-02-13T20:18:10.805 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1839148 2026-02-13T20:18:10.889 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 3716373 2026-02-13T20:18:10.892 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:18:11.741 INFO:tasks.rados.rados.0.trial188.stdout:1611: done (5 left) 2026-02-13T20:18:11.741 INFO:tasks.rados.rados.0.trial188.stdout:1612: done (4 left) 2026-02-13T20:18:11.741 INFO:tasks.rados.rados.0.trial188.stdout:1613: done (3 left) 2026-02-13T20:18:11.741 INFO:tasks.rados.rados.0.trial188.stdout:1614: done (2 left) 2026-02-13T20:18:11.741 INFO:tasks.rados.rados.0.trial188.stdout:1615: done (1 left) 2026-02-13T20:18:11.742 INFO:tasks.rados.rados.0.trial188.stdout:1616: done (0 left) 2026-02-13T20:18:11.742 INFO:tasks.rados.rados.0.trial188.stdout:1617: copy_from oid 1 from oid 37 current snap is 156 2026-02-13T20:18:11.742 INFO:tasks.rados.rados.0.trial188.stdout:1618: write oid 22 current snap is 156 2026-02-13T20:18:11.742 INFO:tasks.rados.rados.0.trial188.stdout:1618: seq_num 594 ranges {783358=573440,2026304=580868,3279140=621458} 2026-02-13T20:18:11.746 INFO:tasks.rados.rados.0.trial188.stdout:1618: writing trial18843701-22 from 783358 to 1356798 tid 1 2026-02-13T20:18:11.751 INFO:tasks.rados.rados.0.trial188.stdout:1618: writing trial18843701-22 from 2026304 to 2607172 tid 2 2026-02-13T20:18:11.756 INFO:tasks.rados.rados.0.trial188.stdout:1618: writing trial18843701-22 from 3279140 to 3900598 tid 3 2026-02-13T20:18:11.756 INFO:tasks.rados.rados.0.trial188.stdout:1619: delete oid 2 current snap is 156 2026-02-13T20:18:11.763 INFO:tasks.rados.rados.0.trial188.stdout:1618: finishing write tid 1 to trial18843701-22 2026-02-13T20:18:11.781 INFO:tasks.rados.rados.0.trial188.stdout:1617: finishing copy_from racing read to trial18843701-1 2026-02-13T20:18:11.782 INFO:tasks.rados.rados.0.trial188.stdout:1618: finishing write tid 2 to trial18843701-22 2026-02-13T20:18:11.782 INFO:tasks.rados.rados.0.trial188.stdout:1618: finishing write tid 3 to trial18843701-22 2026-02-13T20:18:11.782 INFO:tasks.rados.rados.0.trial188.stdout:1618: finishing write tid 4 to trial18843701-22 2026-02-13T20:18:11.782 INFO:tasks.rados.rados.0.trial188.stdout:1618: finishing write tid 5 to trial18843701-22 2026-02-13T20:18:11.782 INFO:tasks.rados.rados.0.trial188.stdout:1618: oid 22 updating version 0 to 364 2026-02-13T20:18:11.782 INFO:tasks.rados.rados.0.trial188.stdout:1618: oid 22 version 364 is already newer than 363 2026-02-13T20:18:11.782 INFO:tasks.rados.rados.0.trial188.stdout:1618: oid 22 version 364 is already newer than 362 2026-02-13T20:18:11.782 INFO:tasks.rados.rados.0.trial188.stdout:1618: oid 22 version 364 is already newer than 361 2026-02-13T20:18:11.782 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 22 v 364 (ObjNum 594 snap 156 seq_num 594) dirty exists 2026-02-13T20:18:11.782 INFO:tasks.rados.rados.0.trial188.stdout:1618: left oid 22 (ObjNum 594 snap 156 seq_num 594) 2026-02-13T20:18:11.785 INFO:tasks.rados.rados.0.trial188.stdout:1617: finishing copy_from to trial18843701-1 2026-02-13T20:18:11.785 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 1 v 579 (ObjNum 583 snap 153 seq_num 583) dirty exists 2026-02-13T20:18:11.785 INFO:tasks.rados.rados.0.trial188.stdout:1617: done (2 left) 2026-02-13T20:18:11.785 INFO:tasks.rados.rados.0.trial188.stdout:1618: done (1 left) 2026-02-13T20:18:11.785 INFO:tasks.rados.rados.0.trial188.stdout:1619: done (0 left) 2026-02-13T20:18:11.785 INFO:tasks.rados.rados.0.trial188.stdout:1620: snap_remove snap 154 2026-02-13T20:18:12.696 INFO:tasks.rados.rados.0.trial188.stdout:1620: done (0 left) 2026-02-13T20:18:12.697 INFO:tasks.rados.rados.0.trial188.stdout:1621: read oid 4 snap 155 2026-02-13T20:18:12.697 INFO:tasks.rados.rados.0.trial188.stdout:1621: expect (ObjNum 530 snap 136 seq_num 530) 2026-02-13T20:18:12.697 INFO:tasks.rados.rados.0.trial188.stdout:1622: snap_create 2026-02-13T20:18:12.704 INFO:tasks.rados.rados.0.trial188.stdout:1621: expect (ObjNum 530 snap 136 seq_num 530) 2026-02-13T20:18:12.704 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:18:12.733 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 333885 2026-02-13T20:18:13.696 INFO:tasks.rados.rados.0.trial188.stdout:1621: done (1 left) 2026-02-13T20:18:13.697 INFO:tasks.rados.rados.0.trial188.stdout:1622: done (0 left) 2026-02-13T20:18:13.697 INFO:tasks.rados.rados.0.trial188.stdout:1623: snap_create 2026-02-13T20:18:14.697 INFO:tasks.rados.rados.0.trial188.stdout:1623: done (0 left) 2026-02-13T20:18:14.697 INFO:tasks.rados.rados.0.trial188.stdout:1624: snap_remove snap 156 2026-02-13T20:18:15.698 INFO:tasks.rados.rados.0.trial188.stdout:1624: done (0 left) 2026-02-13T20:18:15.698 INFO:tasks.rados.rados.0.trial188.stdout:1625: write (excl) oid 10 current snap is 158 2026-02-13T20:18:15.698 INFO:tasks.rados.rados.0.trial188.stdout:1625: seq_num 596 ranges {416972=723938,1743268=273704} 2026-02-13T20:18:15.702 INFO:tasks.rados.rados.0.trial188.stdout:1625: writing trial18843701-10 from 416972 to 1140910 tid 1 2026-02-13T20:18:15.706 INFO:tasks.rados.rados.0.trial188.stdout:1625: writing trial18843701-10 from 1743268 to 2016972 tid 2 2026-02-13T20:18:15.706 INFO:tasks.rados.rados.0.trial188.stdout:1626: write oid 31 current snap is 158 2026-02-13T20:18:15.706 INFO:tasks.rados.rados.0.trial188.stdout:1626: seq_num 597 ranges {433779=799187,1801750=232029} 2026-02-13T20:18:15.710 INFO:tasks.rados.rados.0.trial188.stdout:1626: writing trial18843701-31 from 433779 to 1232966 tid 1 2026-02-13T20:18:15.713 INFO:tasks.rados.rados.0.trial188.stdout:1626: writing trial18843701-31 from 1801750 to 2033779 tid 2 2026-02-13T20:18:15.713 INFO:tasks.rados.rados.0.trial188.stdout:1627: snap_create 2026-02-13T20:18:15.730 INFO:tasks.rados.rados.0.trial188.stdout:1625: finishing write tid 1 to trial18843701-10 2026-02-13T20:18:15.730 INFO:tasks.rados.rados.0.trial188.stdout:1625: finishing write tid 2 to trial18843701-10 2026-02-13T20:18:15.730 INFO:tasks.rados.rados.0.trial188.stdout:1625: finishing write tid 3 to trial18843701-10 2026-02-13T20:18:15.730 INFO:tasks.rados.rados.0.trial188.stdout:1625: finishing write tid 4 to trial18843701-10 2026-02-13T20:18:15.730 INFO:tasks.rados.rados.0.trial188.stdout:1625: oid 10 updating version 0 to 467 2026-02-13T20:18:15.730 INFO:tasks.rados.rados.0.trial188.stdout:1625: oid 10 updating version 467 to 468 2026-02-13T20:18:15.731 INFO:tasks.rados.rados.0.trial188.stdout:1625: oid 10 version 468 is already newer than 466 2026-02-13T20:18:15.731 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 10 v 468 (ObjNum 596 snap 158 seq_num 596) dirty exists 2026-02-13T20:18:15.731 INFO:tasks.rados.rados.0.trial188.stdout:1625: left oid 10 (ObjNum 596 snap 158 seq_num 596) 2026-02-13T20:18:15.733 INFO:tasks.rados.rados.0.trial188.stdout:1626: finishing write tid 1 to trial18843701-31 2026-02-13T20:18:15.734 INFO:tasks.rados.rados.0.trial188.stdout:1626: finishing write tid 2 to trial18843701-31 2026-02-13T20:18:15.735 INFO:tasks.rados.rados.0.trial188.stdout:1626: finishing write tid 3 to trial18843701-31 2026-02-13T20:18:15.735 INFO:tasks.rados.rados.0.trial188.stdout:1626: finishing write tid 4 to trial18843701-31 2026-02-13T20:18:15.735 INFO:tasks.rados.rados.0.trial188.stdout:1626: oid 31 updating version 0 to 430 2026-02-13T20:18:15.735 INFO:tasks.rados.rados.0.trial188.stdout:1626: oid 31 updating version 430 to 431 2026-02-13T20:18:15.735 INFO:tasks.rados.rados.0.trial188.stdout:1626: oid 31 version 431 is already newer than 429 2026-02-13T20:18:15.735 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 31 v 431 (ObjNum 597 snap 158 seq_num 597) dirty exists 2026-02-13T20:18:15.735 INFO:tasks.rados.rados.0.trial188.stdout:1626: left oid 31 (ObjNum 597 snap 158 seq_num 597) 2026-02-13T20:18:16.702 INFO:tasks.rados.rados.0.trial188.stdout:1625: done (2 left) 2026-02-13T20:18:16.702 INFO:tasks.rados.rados.0.trial188.stdout:1626: done (1 left) 2026-02-13T20:18:16.702 INFO:tasks.rados.rados.0.trial188.stdout:1627: done (0 left) 2026-02-13T20:18:16.702 INFO:tasks.rados.rados.0.trial188.stdout:1628: copy_from oid 6 from oid 50 current snap is 159 2026-02-13T20:18:16.703 INFO:tasks.rados.rados.0.trial188.stdout:1629: copy_from oid 26 from oid 1 current snap is 159 2026-02-13T20:18:16.703 INFO:tasks.rados.rados.0.trial188.stdout:1630: read oid 3 snap -1 2026-02-13T20:18:16.703 INFO:tasks.rados.rados.0.trial188.stdout:1630: expect (ObjNum 545 snap 141 seq_num 545) 2026-02-13T20:18:16.703 INFO:tasks.rados.rados.0.trial188.stdout:1631: copy_from oid 23 from oid 19 current snap is 159 2026-02-13T20:18:16.703 INFO:tasks.rados.rados.0.trial188.stdout:1632: write (excl) oid 18 current snap is 159 2026-02-13T20:18:16.703 INFO:tasks.rados.rados.0.trial188.stdout:1632: seq_num 598 ranges {450586=474436,1343879=588206} 2026-02-13T20:18:16.706 INFO:tasks.rados.rados.0.trial188.stdout:1632: writing trial18843701-18 from 450586 to 925022 tid 1 2026-02-13T20:18:16.710 INFO:tasks.rados.rados.0.trial188.stdout:1632: writing trial18843701-18 from 1343879 to 1932085 tid 2 2026-02-13T20:18:16.710 INFO:tasks.rados.rados.0.trial188.stdout:1633: rollback oid 9 current snap is 159 2026-02-13T20:18:16.710 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 9 to 157 2026-02-13T20:18:16.710 INFO:tasks.rados.rados.0.trial188.stdout:1630: expect (ObjNum 545 snap 141 seq_num 545) 2026-02-13T20:18:16.749 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1026392 2026-02-13T20:18:16.798 INFO:tasks.rados.rados.0.trial188.stdout:1633: finishing rollback tid 0 to trial18843701-9 2026-02-13T20:18:16.798 INFO:tasks.rados.rados.0.trial188.stdout:1633: finishing rollback tid 1 to trial18843701-9 2026-02-13T20:18:16.798 INFO:tasks.rados.rados.0.trial188.stdout:1630: done (5 left) 2026-02-13T20:18:16.798 INFO:tasks.rados.rados.0.trial188.stdout:1634: read oid 49 snap -1 2026-02-13T20:18:16.798 INFO:tasks.rados.rados.0.trial188.stdout:1634: expect (ObjNum 523 snap 135 seq_num 523) 2026-02-13T20:18:16.798 INFO:tasks.rados.rados.0.trial188.stdout:1635: write oid 30 current snap is 159 2026-02-13T20:18:16.798 INFO:tasks.rados.rados.0.trial188.stdout:1633: finishing rollback tid 2 to trial18843701-9 2026-02-13T20:18:16.798 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 9 v 667 (ObjNum 542 snap 141 seq_num 542) dirty exists 2026-02-13T20:18:16.798 INFO:tasks.rados.rados.0.trial188.stdout:1632: finishing write tid 1 to trial18843701-18 2026-02-13T20:18:16.798 INFO:tasks.rados.rados.0.trial188.stdout:1632: finishing write tid 2 to trial18843701-18 2026-02-13T20:18:16.798 INFO:tasks.rados.rados.0.trial188.stdout:1632: finishing write tid 3 to trial18843701-18 2026-02-13T20:18:16.798 INFO:tasks.rados.rados.0.trial188.stdout:1632: finishing write tid 4 to trial18843701-18 2026-02-13T20:18:16.798 INFO:tasks.rados.rados.0.trial188.stdout:1632: oid 18 updating version 0 to 573 2026-02-13T20:18:16.798 INFO:tasks.rados.rados.0.trial188.stdout:1632: oid 18 updating version 573 to 574 2026-02-13T20:18:16.798 INFO:tasks.rados.rados.0.trial188.stdout:1632: oid 18 updating version 574 to 575 2026-02-13T20:18:16.798 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 18 v 575 (ObjNum 598 snap 159 seq_num 598) dirty exists 2026-02-13T20:18:16.798 INFO:tasks.rados.rados.0.trial188.stdout:1632: left oid 18 (ObjNum 598 snap 159 seq_num 598) 2026-02-13T20:18:16.798 INFO:tasks.rados.rados.0.trial188.stdout:1631: finishing copy_from racing read to trial18843701-23 2026-02-13T20:18:16.798 INFO:tasks.rados.rados.0.trial188.stdout:1628: finishing copy_from racing read to trial18843701-6 2026-02-13T20:18:16.798 INFO:tasks.rados.rados.0.trial188.stdout:1628: finishing copy_from to trial18843701-6 2026-02-13T20:18:16.799 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 6 v 699 (ObjNum 564 snap 151 seq_num 564) dirty exists 2026-02-13T20:18:16.799 INFO:tasks.rados.rados.0.trial188.stdout:1631: finishing copy_from to trial18843701-23 2026-02-13T20:18:16.799 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 23 v 585 (ObjNum 552 snap 144 seq_num 552) dirty exists 2026-02-13T20:18:16.799 INFO:tasks.rados.rados.0.trial188.stdout:1635: seq_num 599 ranges {467393=549685,1802361=265032} 2026-02-13T20:18:16.802 INFO:tasks.rados.rados.0.trial188.stdout:1635: writing trial18843701-30 from 467393 to 1017078 tid 1 2026-02-13T20:18:16.806 INFO:tasks.rados.rados.0.trial188.stdout:1635: writing trial18843701-30 from 1802361 to 2067393 tid 2 2026-02-13T20:18:16.806 INFO:tasks.rados.rados.0.trial188.stdout:1628: done (6 left) 2026-02-13T20:18:16.806 INFO:tasks.rados.rados.0.trial188.stdout:1631: done (5 left) 2026-02-13T20:18:16.806 INFO:tasks.rados.rados.0.trial188.stdout:1632: done (4 left) 2026-02-13T20:18:16.806 INFO:tasks.rados.rados.0.trial188.stdout:1633: done (3 left) 2026-02-13T20:18:16.806 INFO:tasks.rados.rados.0.trial188.stdout:1636: write oid 37 current snap is 159 2026-02-13T20:18:16.806 INFO:tasks.rados.rados.0.trial188.stdout:1636: seq_num 600 ranges {484200=624934,1860843=223357} 2026-02-13T20:18:16.810 INFO:tasks.rados.rados.0.trial188.stdout:1636: writing trial18843701-37 from 484200 to 1109134 tid 1 2026-02-13T20:18:16.814 INFO:tasks.rados.rados.0.trial188.stdout:1636: writing trial18843701-37 from 1860843 to 2084200 tid 2 2026-02-13T20:18:16.814 INFO:tasks.rados.rados.0.trial188.stdout:1637: read oid 24 snap -1 2026-02-13T20:18:16.814 INFO:tasks.rados.rados.0.trial188.stdout:1637: expect deleted 2026-02-13T20:18:16.814 INFO:tasks.rados.rados.0.trial188.stdout:1638: write (excl) oid 25 current snap is 159 2026-02-13T20:18:16.814 INFO:tasks.rados.rados.0.trial188.stdout:1638: seq_num 601 ranges {501007=416536,1635678=465329} 2026-02-13T20:18:16.817 INFO:tasks.rados.rados.0.trial188.stdout:1638: writing trial18843701-25 from 501007 to 917543 tid 1 2026-02-13T20:18:16.822 INFO:tasks.rados.rados.0.trial188.stdout:1638: writing trial18843701-25 from 1635678 to 2101007 tid 2 2026-02-13T20:18:16.822 INFO:tasks.rados.rados.0.trial188.stdout:1639: read oid 32 snap -1 2026-02-13T20:18:16.822 INFO:tasks.rados.rados.0.trial188.stdout:1639: expect (ObjNum 586 snap 153 seq_num 586) 2026-02-13T20:18:16.822 INFO:tasks.rados.rados.0.trial188.stdout:1640: copy_from oid 39 from oid 29 current snap is 159 2026-02-13T20:18:16.822 INFO:tasks.rados.rados.0.trial188.stdout:1634: expect (ObjNum 523 snap 135 seq_num 523) 2026-02-13T20:18:16.907 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2231129 2026-02-13T20:18:16.963 INFO:tasks.rados.rados.0.trial188.stdout:1629: finishing copy_from racing read to trial18843701-26 2026-02-13T20:18:16.964 INFO:tasks.rados.rados.0.trial188.stdout:1634: done (7 left) 2026-02-13T20:18:16.964 INFO:tasks.rados.rados.0.trial188.stdout:1641: write (excl) oid 17 current snap is 159 2026-02-13T20:18:16.964 INFO:tasks.rados.rados.0.trial188.stdout:1641: seq_num 602 ranges {517814=491785,1577807=540007} 2026-02-13T20:18:16.967 INFO:tasks.rados.rados.0.trial188.stdout:1641: writing trial18843701-17 from 517814 to 1009599 tid 1 2026-02-13T20:18:16.972 INFO:tasks.rados.rados.0.trial188.stdout:1641: writing trial18843701-17 from 1577807 to 2117814 tid 2 2026-02-13T20:18:16.972 INFO:tasks.rados.rados.0.trial188.stdout:1642: write (excl) oid 19 current snap is 159 2026-02-13T20:18:16.972 INFO:tasks.rados.rados.0.trial188.stdout:1642: seq_num 603 ranges {534621=567034,1636289=498332} 2026-02-13T20:18:16.976 INFO:tasks.rados.rados.0.trial188.stdout:1642: writing trial18843701-19 from 534621 to 1101655 tid 1 2026-02-13T20:18:16.980 INFO:tasks.rados.rados.0.trial188.stdout:1642: writing trial18843701-19 from 1636289 to 2134621 tid 2 2026-02-13T20:18:16.980 INFO:tasks.rados.rados.0.trial188.stdout:1643: rollback oid 21 current snap is 159 2026-02-13T20:18:16.980 INFO:tasks.rados.rados.0.trial188.stdout:1629: finishing copy_from to trial18843701-26 2026-02-13T20:18:16.980 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 26 v 579 (ObjNum 583 snap 153 seq_num 583) dirty exists 2026-02-13T20:18:16.981 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 21 to 158 2026-02-13T20:18:16.981 INFO:tasks.rados.rados.0.trial188.stdout:1635: finishing write tid 1 to trial18843701-30 2026-02-13T20:18:16.981 INFO:tasks.rados.rados.0.trial188.stdout:1636: finishing write tid 1 to trial18843701-37 2026-02-13T20:18:16.981 INFO:tasks.rados.rados.0.trial188.stdout:1635: finishing write tid 2 to trial18843701-30 2026-02-13T20:18:16.981 INFO:tasks.rados.rados.0.trial188.stdout:1639: expect (ObjNum 586 snap 153 seq_num 586) 2026-02-13T20:18:17.021 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:18:17.051 INFO:tasks.rados.rados.0.trial188.stdout:1636: finishing write tid 2 to trial18843701-37 2026-02-13T20:18:17.051 INFO:tasks.rados.rados.0.trial188.stdout:1636: finishing write tid 3 to trial18843701-37 2026-02-13T20:18:17.051 INFO:tasks.rados.rados.0.trial188.stdout:1636: finishing write tid 4 to trial18843701-37 2026-02-13T20:18:17.051 INFO:tasks.rados.rados.0.trial188.stdout:1636: oid 37 updating version 0 to 658 2026-02-13T20:18:17.052 INFO:tasks.rados.rados.0.trial188.stdout:1636: oid 37 version 658 is already newer than 657 2026-02-13T20:18:17.052 INFO:tasks.rados.rados.0.trial188.stdout:1636: oid 37 version 658 is already newer than 656 2026-02-13T20:18:17.052 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 37 v 658 (ObjNum 600 snap 159 seq_num 600) dirty exists 2026-02-13T20:18:17.052 INFO:tasks.rados.rados.0.trial188.stdout:1636: left oid 37 (ObjNum 600 snap 159 seq_num 600) 2026-02-13T20:18:17.052 INFO:tasks.rados.rados.0.trial188.stdout:1635: finishing write tid 3 to trial18843701-30 2026-02-13T20:18:17.052 INFO:tasks.rados.rados.0.trial188.stdout:1635: finishing write tid 4 to trial18843701-30 2026-02-13T20:18:17.052 INFO:tasks.rados.rados.0.trial188.stdout:1635: oid 30 updating version 0 to 690 2026-02-13T20:18:17.053 INFO:tasks.rados.rados.0.trial188.stdout:1635: oid 30 updating version 690 to 691 2026-02-13T20:18:17.053 INFO:tasks.rados.rados.0.trial188.stdout:1635: oid 30 updating version 691 to 692 2026-02-13T20:18:17.053 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 30 v 692 (ObjNum 599 snap 159 seq_num 599) dirty exists 2026-02-13T20:18:17.053 INFO:tasks.rados.rados.0.trial188.stdout:1635: left oid 30 (ObjNum 599 snap 159 seq_num 599) 2026-02-13T20:18:17.053 INFO:tasks.rados.rados.0.trial188.stdout:1638: finishing write tid 1 to trial18843701-25 2026-02-13T20:18:17.053 INFO:tasks.rados.rados.0.trial188.stdout:1638: finishing write tid 2 to trial18843701-25 2026-02-13T20:18:17.054 INFO:tasks.rados.rados.0.trial188.stdout:1638: finishing write tid 3 to trial18843701-25 2026-02-13T20:18:17.054 INFO:tasks.rados.rados.0.trial188.stdout:1629: done (9 left) 2026-02-13T20:18:17.054 INFO:tasks.rados.rados.0.trial188.stdout:1635: done (8 left) 2026-02-13T20:18:17.054 INFO:tasks.rados.rados.0.trial188.stdout:1636: done (7 left) 2026-02-13T20:18:17.054 INFO:tasks.rados.rados.0.trial188.stdout:1637: done (6 left) 2026-02-13T20:18:17.054 INFO:tasks.rados.rados.0.trial188.stdout:1639: done (5 left) 2026-02-13T20:18:17.055 INFO:tasks.rados.rados.0.trial188.stdout:1644: delete oid 44 current snap is 159 2026-02-13T20:18:17.055 INFO:tasks.rados.rados.0.trial188.stdout:1638: finishing write tid 4 to trial18843701-25 2026-02-13T20:18:17.055 INFO:tasks.rados.rados.0.trial188.stdout:1638: oid 25 updating version 0 to 695 2026-02-13T20:18:17.055 INFO:tasks.rados.rados.0.trial188.stdout:1638: oid 25 updating version 695 to 696 2026-02-13T20:18:17.055 INFO:tasks.rados.rados.0.trial188.stdout:1638: oid 25 version 696 is already newer than 694 2026-02-13T20:18:17.055 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 25 v 696 (ObjNum 601 snap 159 seq_num 601) dirty exists 2026-02-13T20:18:17.056 INFO:tasks.rados.rados.0.trial188.stdout:1638: left oid 25 (ObjNum 601 snap 159 seq_num 601) 2026-02-13T20:18:17.056 INFO:tasks.rados.rados.0.trial188.stdout:1640: finishing copy_from racing read to trial18843701-39 2026-02-13T20:18:17.056 INFO:tasks.rados.rados.0.trial188.stdout:1640: finishing copy_from to trial18843701-39 2026-02-13T20:18:17.056 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 39 v 588 (ObjNum 513 snap 132 seq_num 513) dirty exists 2026-02-13T20:18:17.056 INFO:tasks.rados.rados.0.trial188.stdout:1641: finishing write tid 1 to trial18843701-17 2026-02-13T20:18:17.056 INFO:tasks.rados.rados.0.trial188.stdout:1641: finishing write tid 2 to trial18843701-17 2026-02-13T20:18:17.057 INFO:tasks.rados.rados.0.trial188.stdout:1641: finishing write tid 3 to trial18843701-17 2026-02-13T20:18:17.057 INFO:tasks.rados.rados.0.trial188.stdout:1641: finishing write tid 4 to trial18843701-17 2026-02-13T20:18:17.057 INFO:tasks.rados.rados.0.trial188.stdout:1641: oid 17 updating version 0 to 577 2026-02-13T20:18:17.057 INFO:tasks.rados.rados.0.trial188.stdout:1641: oid 17 version 577 is already newer than 576 2026-02-13T20:18:17.057 INFO:tasks.rados.rados.0.trial188.stdout:1641: oid 17 updating version 577 to 578 2026-02-13T20:18:17.057 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 17 v 578 (ObjNum 602 snap 159 seq_num 602) dirty exists 2026-02-13T20:18:17.058 INFO:tasks.rados.rados.0.trial188.stdout:1641: left oid 17 (ObjNum 602 snap 159 seq_num 602) 2026-02-13T20:18:17.058 INFO:tasks.rados.rados.0.trial188.stdout:1643: finishing rollback tid 0 to trial18843701-21 2026-02-13T20:18:17.058 INFO:tasks.rados.rados.0.trial188.stdout:1643: finishing rollback tid 1 to trial18843701-21 2026-02-13T20:18:17.058 INFO:tasks.rados.rados.0.trial188.stdout:1643: finishing rollback tid 2 to trial18843701-21 2026-02-13T20:18:17.058 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 21 v 443 (ObjNum 588 snap 153 seq_num 588) dirty exists 2026-02-13T20:18:17.058 INFO:tasks.rados.rados.0.trial188.stdout:1642: finishing write tid 1 to trial18843701-19 2026-02-13T20:18:17.058 INFO:tasks.rados.rados.0.trial188.stdout:1642: finishing write tid 2 to trial18843701-19 2026-02-13T20:18:17.059 INFO:tasks.rados.rados.0.trial188.stdout:1642: finishing write tid 3 to trial18843701-19 2026-02-13T20:18:17.059 INFO:tasks.rados.rados.0.trial188.stdout:1642: finishing write tid 4 to trial18843701-19 2026-02-13T20:18:17.059 INFO:tasks.rados.rados.0.trial188.stdout:1642: oid 19 updating version 0 to 591 2026-02-13T20:18:17.059 INFO:tasks.rados.rados.0.trial188.stdout:1642: oid 19 version 591 is already newer than 589 2026-02-13T20:18:17.059 INFO:tasks.rados.rados.0.trial188.stdout:1642: oid 19 version 591 is already newer than 590 2026-02-13T20:18:17.059 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 19 v 591 (ObjNum 603 snap 159 seq_num 603) dirty exists 2026-02-13T20:18:17.059 INFO:tasks.rados.rados.0.trial188.stdout:1642: left oid 19 (ObjNum 603 snap 159 seq_num 603) 2026-02-13T20:18:17.060 INFO:tasks.rados.rados.0.trial188.stdout:1638: done (5 left) 2026-02-13T20:18:17.060 INFO:tasks.rados.rados.0.trial188.stdout:1640: done (4 left) 2026-02-13T20:18:17.060 INFO:tasks.rados.rados.0.trial188.stdout:1641: done (3 left) 2026-02-13T20:18:17.060 INFO:tasks.rados.rados.0.trial188.stdout:1642: done (2 left) 2026-02-13T20:18:17.060 INFO:tasks.rados.rados.0.trial188.stdout:1643: done (1 left) 2026-02-13T20:18:17.060 INFO:tasks.rados.rados.0.trial188.stdout:1644: done (0 left) 2026-02-13T20:18:17.061 INFO:tasks.rados.rados.0.trial188.stdout:1645: rollback oid 3 current snap is 159 2026-02-13T20:18:17.061 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 3 to 155 2026-02-13T20:18:17.061 INFO:tasks.rados.rados.0.trial188.stdout:1646: snap_remove snap 158 2026-02-13T20:18:17.698 INFO:tasks.rados.rados.0.trial188.stdout:1646: done (1 left) 2026-02-13T20:18:17.699 INFO:tasks.rados.rados.0.trial188.stdout:1647: delete oid 40 current snap is 159 2026-02-13T20:18:17.699 INFO:tasks.rados.rados.0.trial188.stdout:1645: finishing rollback tid 0 to trial18843701-3 2026-02-13T20:18:17.699 INFO:tasks.rados.rados.0.trial188.stdout:1645: finishing rollback tid 1 to trial18843701-3 2026-02-13T20:18:17.699 INFO:tasks.rados.rados.0.trial188.stdout:1645: finishing rollback tid 2 to trial18843701-3 2026-02-13T20:18:17.699 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 3 v 612 (ObjNum 545 snap 141 seq_num 545) dirty exists 2026-02-13T20:18:17.701 INFO:tasks.rados.rados.0.trial188.stdout:1645: done (1 left) 2026-02-13T20:18:17.701 INFO:tasks.rados.rados.0.trial188.stdout:1647: done (0 left) 2026-02-13T20:18:17.701 INFO:tasks.rados.rados.0.trial188.stdout:1648: snap_remove snap 157 2026-02-13T20:18:18.697 INFO:tasks.rados.rados.0.trial188.stdout:1648: done (0 left) 2026-02-13T20:18:18.697 INFO:tasks.rados.rados.0.trial188.stdout:1649: rollback oid 49 current snap is 159 2026-02-13T20:18:18.697 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 49 to 155 2026-02-13T20:18:18.697 INFO:tasks.rados.rados.0.trial188.stdout:1650: delete oid 1 current snap is 159 2026-02-13T20:18:18.699 INFO:tasks.rados.rados.0.trial188.stdout:1650: done (1 left) 2026-02-13T20:18:18.700 INFO:tasks.rados.rados.0.trial188.stdout:1651: snap_create 2026-02-13T20:18:18.702 INFO:tasks.rados.rados.0.trial188.stdout:1649: finishing rollback tid 0 to trial18843701-49 2026-02-13T20:18:18.702 INFO:tasks.rados.rados.0.trial188.stdout:1649: finishing rollback tid 1 to trial18843701-49 2026-02-13T20:18:18.702 INFO:tasks.rados.rados.0.trial188.stdout:1649: finishing rollback tid 2 to trial18843701-49 2026-02-13T20:18:18.702 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 49 v 704 (ObjNum 523 snap 135 seq_num 523) dirty exists 2026-02-13T20:18:19.699 INFO:tasks.rados.rados.0.trial188.stdout:1649: done (1 left) 2026-02-13T20:18:19.699 INFO:tasks.rados.rados.0.trial188.stdout:1651: done (0 left) 2026-02-13T20:18:19.699 INFO:tasks.rados.rados.0.trial188.stdout:1652: read oid 34 snap -1 2026-02-13T20:18:19.699 INFO:tasks.rados.rados.0.trial188.stdout:1652: expect (ObjNum 531 snap 136 seq_num 531) 2026-02-13T20:18:19.699 INFO:tasks.rados.rados.0.trial188.stdout:1653: read oid 32 snap -1 2026-02-13T20:18:19.699 INFO:tasks.rados.rados.0.trial188.stdout:1653: expect (ObjNum 586 snap 153 seq_num 586) 2026-02-13T20:18:19.699 INFO:tasks.rados.rados.0.trial188.stdout:1654: write (excl) oid 7 current snap is 160 2026-02-13T20:18:19.700 INFO:tasks.rados.rados.0.trial188.stdout:1654: seq_num 607 ranges {601849=468030,1753864=447985} 2026-02-13T20:18:19.703 INFO:tasks.rados.rados.0.trial188.stdout:1654: writing trial18843701-7 from 601849 to 1069879 tid 1 2026-02-13T20:18:19.707 INFO:tasks.rados.rados.0.trial188.stdout:1654: writing trial18843701-7 from 1753864 to 2201849 tid 2 2026-02-13T20:18:19.708 INFO:tasks.rados.rados.0.trial188.stdout:1655: copy_from oid 31 from oid 47 current snap is 160 2026-02-13T20:18:19.708 INFO:tasks.rados.rados.0.trial188.stdout:1653: expect (ObjNum 586 snap 153 seq_num 586) 2026-02-13T20:18:19.734 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:18:19.787 INFO:tasks.rados.rados.0.trial188.stdout:1652: expect (ObjNum 531 snap 136 seq_num 531) 2026-02-13T20:18:19.839 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:18:19.893 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:18:19.946 INFO:tasks.rados.rados.0.trial188.stdout:1654: finishing write tid 1 to trial18843701-7 2026-02-13T20:18:19.946 INFO:tasks.rados.rados.0.trial188.stdout:1652: done (3 left) 2026-02-13T20:18:19.947 INFO:tasks.rados.rados.0.trial188.stdout:1653: done (2 left) 2026-02-13T20:18:19.947 INFO:tasks.rados.rados.0.trial188.stdout:1656: delete oid 24 current snap is 160 2026-02-13T20:18:19.947 INFO:tasks.rados.rados.0.trial188.stdout:1654: finishing write tid 2 to trial18843701-7 2026-02-13T20:18:19.947 INFO:tasks.rados.rados.0.trial188.stdout:1654: finishing write tid 3 to trial18843701-7 2026-02-13T20:18:19.947 INFO:tasks.rados.rados.0.trial188.stdout:1654: finishing write tid 4 to trial18843701-7 2026-02-13T20:18:19.947 INFO:tasks.rados.rados.0.trial188.stdout:1654: oid 7 updating version 0 to 594 2026-02-13T20:18:19.947 INFO:tasks.rados.rados.0.trial188.stdout:1654: oid 7 version 594 is already newer than 593 2026-02-13T20:18:19.947 INFO:tasks.rados.rados.0.trial188.stdout:1654: oid 7 version 594 is already newer than 592 2026-02-13T20:18:19.947 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 7 v 594 (ObjNum 607 snap 160 seq_num 607) dirty exists 2026-02-13T20:18:19.947 INFO:tasks.rados.rados.0.trial188.stdout:1654: left oid 7 (ObjNum 607 snap 160 seq_num 607) 2026-02-13T20:18:19.947 INFO:tasks.rados.rados.0.trial188.stdout:1655: finishing copy_from racing read to trial18843701-31 2026-02-13T20:18:19.948 INFO:tasks.rados.rados.0.trial188.stdout:1655: finishing copy_from to trial18843701-31 2026-02-13T20:18:19.948 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 31 v 415 (ObjNum 489 snap 127 seq_num 489) dirty exists 2026-02-13T20:18:19.948 INFO:tasks.rados.rados.0.trial188.stdout:1654: done (2 left) 2026-02-13T20:18:19.948 INFO:tasks.rados.rados.0.trial188.stdout:1655: done (1 left) 2026-02-13T20:18:19.948 INFO:tasks.rados.rados.0.trial188.stdout:1656: done (0 left) 2026-02-13T20:18:19.949 INFO:tasks.rados.rados.0.trial188.stdout:1657: delete oid 2 current snap is 160 2026-02-13T20:18:19.949 INFO:tasks.rados.rados.0.trial188.stdout:1657: done (0 left) 2026-02-13T20:18:19.949 INFO:tasks.rados.rados.0.trial188.stdout:1658: write (excl) oid 44 current snap is 160 2026-02-13T20:18:19.949 INFO:tasks.rados.rados.0.trial188.stdout:1658: seq_num 610 ranges {652270=410130,1529310=493867} 2026-02-13T20:18:19.952 INFO:tasks.rados.rados.0.trial188.stdout:1658: writing trial18843701-44 from 652270 to 1062400 tid 1 2026-02-13T20:18:19.956 INFO:tasks.rados.rados.0.trial188.stdout:1658: writing trial18843701-44 from 1529310 to 2023177 tid 2 2026-02-13T20:18:19.956 INFO:tasks.rados.rados.0.trial188.stdout:1659: snap_remove snap 159 2026-02-13T20:18:20.703 INFO:tasks.rados.rados.0.trial188.stdout:1659: done (1 left) 2026-02-13T20:18:20.703 INFO:tasks.rados.rados.0.trial188.stdout:1660: snap_remove snap 155 2026-02-13T20:18:21.705 INFO:tasks.rados.rados.0.trial188.stdout:1660: done (1 left) 2026-02-13T20:18:21.705 INFO:tasks.rados.rados.0.trial188.stdout:1661: read oid 42 snap -1 2026-02-13T20:18:21.705 INFO:tasks.rados.rados.0.trial188.stdout:1661: expect (ObjNum 592 snap 154 seq_num 592) 2026-02-13T20:18:21.705 INFO:tasks.rados.rados.0.trial188.stdout:1662: delete oid 30 current snap is 160 2026-02-13T20:18:21.705 INFO:tasks.rados.rados.0.trial188.stdout:1658: finishing write tid 1 to trial18843701-44 2026-02-13T20:18:21.705 INFO:tasks.rados.rados.0.trial188.stdout:1658: finishing write tid 2 to trial18843701-44 2026-02-13T20:18:21.705 INFO:tasks.rados.rados.0.trial188.stdout:1658: finishing write tid 3 to trial18843701-44 2026-02-13T20:18:21.705 INFO:tasks.rados.rados.0.trial188.stdout:1658: finishing write tid 4 to trial18843701-44 2026-02-13T20:18:21.706 INFO:tasks.rados.rados.0.trial188.stdout:1658: oid 44 updating version 0 to 712 2026-02-13T20:18:21.706 INFO:tasks.rados.rados.0.trial188.stdout:1658: oid 44 version 712 is already newer than 711 2026-02-13T20:18:21.706 INFO:tasks.rados.rados.0.trial188.stdout:1658: oid 44 updating version 712 to 713 2026-02-13T20:18:21.706 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 44 v 713 (ObjNum 610 snap 160 seq_num 610) dirty exists 2026-02-13T20:18:21.706 INFO:tasks.rados.rados.0.trial188.stdout:1658: left oid 44 (ObjNum 610 snap 160 seq_num 610) 2026-02-13T20:18:21.713 INFO:tasks.rados.rados.0.trial188.stdout:1661: expect (ObjNum 592 snap 154 seq_num 592) 2026-02-13T20:18:21.713 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:18:21.742 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:18:21.770 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:18:21.799 INFO:tasks.rados.rados.0.trial188.stdout:1658: done (2 left) 2026-02-13T20:18:21.799 INFO:tasks.rados.rados.0.trial188.stdout:1661: done (1 left) 2026-02-13T20:18:21.799 INFO:tasks.rados.rados.0.trial188.stdout:1662: done (0 left) 2026-02-13T20:18:21.800 INFO:tasks.rados.rados.0.trial188.stdout:1663: delete oid 23 current snap is 160 2026-02-13T20:18:21.800 INFO:tasks.rados.rados.0.trial188.stdout:1663: done (0 left) 2026-02-13T20:18:21.801 INFO:tasks.rados.rados.0.trial188.stdout:1664: rollback oid 2 current snap is 160 2026-02-13T20:18:21.801 INFO:tasks.rados.rados.0.trial188.stdout:1664: done (0 left) 2026-02-13T20:18:21.801 INFO:tasks.rados.rados.0.trial188.stdout:1665: rollback oid 41 current snap is 160 2026-02-13T20:18:21.801 INFO:tasks.rados.rados.0.trial188.stdout:1665: done (0 left) 2026-02-13T20:18:21.801 INFO:tasks.rados.rados.0.trial188.stdout:1666: snap_create 2026-02-13T20:18:22.699 INFO:tasks.rados.rados.0.trial188.stdout:1666: done (0 left) 2026-02-13T20:18:22.699 INFO:tasks.rados.rados.0.trial188.stdout:1667: snap_remove snap 160 2026-02-13T20:18:23.702 INFO:tasks.rados.rados.0.trial188.stdout:1667: done (0 left) 2026-02-13T20:18:23.702 INFO:tasks.rados.rados.0.trial188.stdout:1668: write (excl) oid 29 current snap is 161 2026-02-13T20:18:23.702 INFO:tasks.rados.rados.0.trial188.stdout:1668: seq_num 613 ranges {702691=635877,2104756=197935} 2026-02-13T20:18:23.707 INFO:tasks.rados.rados.0.trial188.stdout:1668: writing trial18843701-29 from 702691 to 1338568 tid 1 2026-02-13T20:18:23.710 INFO:tasks.rados.rados.0.trial188.stdout:1668: writing trial18843701-29 from 2104756 to 2302691 tid 2 2026-02-13T20:18:23.711 INFO:tasks.rados.rados.0.trial188.stdout:1669: copy_from oid 32 from oid 16 current snap is 161 2026-02-13T20:18:23.711 INFO:tasks.rados.rados.0.trial188.stdout:1670: snap_create 2026-02-13T20:18:23.721 INFO:tasks.rados.rados.0.trial188.stdout:1668: finishing write tid 1 to trial18843701-29 2026-02-13T20:18:23.721 INFO:tasks.rados.rados.0.trial188.stdout:1668: finishing write tid 2 to trial18843701-29 2026-02-13T20:18:23.722 INFO:tasks.rados.rados.0.trial188.stdout:1668: finishing write tid 3 to trial18843701-29 2026-02-13T20:18:23.722 INFO:tasks.rados.rados.0.trial188.stdout:1668: finishing write tid 4 to trial18843701-29 2026-02-13T20:18:23.722 INFO:tasks.rados.rados.0.trial188.stdout:1668: oid 29 updating version 0 to 595 2026-02-13T20:18:23.722 INFO:tasks.rados.rados.0.trial188.stdout:1668: oid 29 updating version 595 to 596 2026-02-13T20:18:23.722 INFO:tasks.rados.rados.0.trial188.stdout:1668: oid 29 updating version 596 to 597 2026-02-13T20:18:23.722 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 29 v 597 (ObjNum 613 snap 161 seq_num 613) dirty exists 2026-02-13T20:18:23.722 INFO:tasks.rados.rados.0.trial188.stdout:1668: left oid 29 (ObjNum 613 snap 161 seq_num 613) 2026-02-13T20:18:23.758 INFO:tasks.rados.rados.0.trial188.stdout:1669: finishing copy_from racing read to trial18843701-32 2026-02-13T20:18:23.759 INFO:tasks.rados.rados.0.trial188.stdout:1669: finishing copy_from to trial18843701-32 2026-02-13T20:18:23.759 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 32 v 728 (ObjNum 584 snap 153 seq_num 584) dirty exists 2026-02-13T20:18:24.711 INFO:tasks.rados.rados.0.trial188.stdout:1668: done (2 left) 2026-02-13T20:18:24.712 INFO:tasks.rados.rados.0.trial188.stdout:1669: done (1 left) 2026-02-13T20:18:24.712 INFO:tasks.rados.rados.0.trial188.stdout:1670: done (0 left) 2026-02-13T20:18:24.712 INFO:tasks.rados.rados.0.trial188.stdout:1671: snap_remove snap 161 2026-02-13T20:18:25.712 INFO:tasks.rados.rados.0.trial188.stdout:1671: done (0 left) 2026-02-13T20:18:25.712 INFO:tasks.rados.rados.0.trial188.stdout:1672: delete oid 40 current snap is 162 2026-02-13T20:18:25.717 INFO:tasks.rados.rados.0.trial188.stdout:1672: done (0 left) 2026-02-13T20:18:25.717 INFO:tasks.rados.rados.0.trial188.stdout:1673: read oid 40 snap -1 2026-02-13T20:18:25.717 INFO:tasks.rados.rados.0.trial188.stdout:1673: expect deleted 2026-02-13T20:18:25.717 INFO:tasks.rados.rados.0.trial188.stdout:1674: write (excl) oid 25 current snap is 162 2026-02-13T20:18:25.717 INFO:tasks.rados.rados.0.trial188.stdout:1674: seq_num 615 ranges {736305=786375,2105367=230938} 2026-02-13T20:18:25.723 INFO:tasks.rados.rados.0.trial188.stdout:1674: writing trial18843701-25 from 736305 to 1522680 tid 1 2026-02-13T20:18:25.726 INFO:tasks.rados.rados.0.trial188.stdout:1674: writing trial18843701-25 from 2105367 to 2336305 tid 2 2026-02-13T20:18:25.726 INFO:tasks.rados.rados.0.trial188.stdout:1675: read oid 26 snap -1 2026-02-13T20:18:25.726 INFO:tasks.rados.rados.0.trial188.stdout:1675: expect (ObjNum 583 snap 153 seq_num 583) 2026-02-13T20:18:25.726 INFO:tasks.rados.rados.0.trial188.stdout:1676: read oid 50 snap -1 2026-02-13T20:18:25.726 INFO:tasks.rados.rados.0.trial188.stdout:1676: expect (ObjNum 564 snap 151 seq_num 564) 2026-02-13T20:18:25.726 INFO:tasks.rados.rados.0.trial188.stdout:1677: read oid 18 snap -1 2026-02-13T20:18:25.726 INFO:tasks.rados.rados.0.trial188.stdout:1677: expect (ObjNum 598 snap 159 seq_num 598) 2026-02-13T20:18:25.726 INFO:tasks.rados.rados.0.trial188.stdout:1678: rollback oid 33 current snap is 162 2026-02-13T20:18:25.726 INFO:tasks.rados.rados.0.trial188.stdout:1678: done (5 left) 2026-02-13T20:18:25.726 INFO:tasks.rados.rados.0.trial188.stdout:1679: copy_from oid 6 from oid 32 current snap is 162 2026-02-13T20:18:25.726 INFO:tasks.rados.rados.0.trial188.stdout:1673: done (5 left) 2026-02-13T20:18:25.726 INFO:tasks.rados.rados.0.trial188.stdout:1680: snap_create 2026-02-13T20:18:25.729 INFO:tasks.rados.rados.0.trial188.stdout:1677: expect (ObjNum 598 snap 159 seq_num 598) 2026-02-13T20:18:25.729 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:18:25.759 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1787665 2026-02-13T20:18:25.761 INFO:tasks.rados.rados.0.trial188.stdout:1674: finishing write tid 1 to trial18843701-25 2026-02-13T20:18:25.761 INFO:tasks.rados.rados.0.trial188.stdout:1674: finishing write tid 2 to trial18843701-25 2026-02-13T20:18:25.761 INFO:tasks.rados.rados.0.trial188.stdout:1674: finishing write tid 3 to trial18843701-25 2026-02-13T20:18:25.761 INFO:tasks.rados.rados.0.trial188.stdout:1674: finishing write tid 4 to trial18843701-25 2026-02-13T20:18:25.761 INFO:tasks.rados.rados.0.trial188.stdout:1674: oid 25 updating version 0 to 718 2026-02-13T20:18:25.761 INFO:tasks.rados.rados.0.trial188.stdout:1674: oid 25 version 718 is already newer than 717 2026-02-13T20:18:25.761 INFO:tasks.rados.rados.0.trial188.stdout:1674: oid 25 version 718 is already newer than 716 2026-02-13T20:18:25.761 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 25 v 718 (ObjNum 615 snap 162 seq_num 615) dirty exists 2026-02-13T20:18:25.761 INFO:tasks.rados.rados.0.trial188.stdout:1674: left oid 25 (ObjNum 615 snap 162 seq_num 615) 2026-02-13T20:18:25.761 INFO:tasks.rados.rados.0.trial188.stdout:1675: expect (ObjNum 583 snap 153 seq_num 583) 2026-02-13T20:18:25.761 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:18:25.806 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:18:25.896 INFO:tasks.rados.rados.0.trial188.stdout:1676: expect (ObjNum 564 snap 151 seq_num 564) 2026-02-13T20:18:25.914 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2974165 2026-02-13T20:18:25.922 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:18:25.988 INFO:tasks.rados.rados.0.trial188.stdout:1679: finishing copy_from racing read to trial18843701-6 2026-02-13T20:18:25.989 INFO:tasks.rados.rados.0.trial188.stdout:1679: finishing copy_from to trial18843701-6 2026-02-13T20:18:25.989 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 6 v 728 (ObjNum 584 snap 153 seq_num 584) dirty exists 2026-02-13T20:18:26.720 INFO:tasks.rados.rados.0.trial188.stdout:1674: done (5 left) 2026-02-13T20:18:26.720 INFO:tasks.rados.rados.0.trial188.stdout:1675: done (4 left) 2026-02-13T20:18:26.720 INFO:tasks.rados.rados.0.trial188.stdout:1676: done (3 left) 2026-02-13T20:18:26.721 INFO:tasks.rados.rados.0.trial188.stdout:1677: done (2 left) 2026-02-13T20:18:26.721 INFO:tasks.rados.rados.0.trial188.stdout:1679: done (1 left) 2026-02-13T20:18:26.721 INFO:tasks.rados.rados.0.trial188.stdout:1680: done (0 left) 2026-02-13T20:18:26.721 INFO:tasks.rados.rados.0.trial188.stdout:1681: read oid 43 snap -1 2026-02-13T20:18:26.721 INFO:tasks.rados.rados.0.trial188.stdout:1681: expect (ObjNum 435 snap 112 seq_num 435) 2026-02-13T20:18:26.721 INFO:tasks.rados.rados.0.trial188.stdout:1682: delete oid 5 current snap is 163 2026-02-13T20:18:26.725 INFO:tasks.rados.rados.0.trial188.stdout:1681: expect (ObjNum 435 snap 112 seq_num 435) 2026-02-13T20:18:26.725 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:18:26.795 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:18:26.831 INFO:tasks.rados.rados.0.trial188.stdout:1681: done (1 left) 2026-02-13T20:18:26.831 INFO:tasks.rados.rados.0.trial188.stdout:1682: done (0 left) 2026-02-13T20:18:26.831 INFO:tasks.rados.rados.0.trial188.stdout:1683: write oid 29 current snap is 163 2026-02-13T20:18:26.831 INFO:tasks.rados.rados.0.trial188.stdout:1683: seq_num 617 ranges {769919=653226,1938684=431235} 2026-02-13T20:18:26.836 INFO:tasks.rados.rados.0.trial188.stdout:1683: writing trial18843701-29 from 769919 to 1423145 tid 1 2026-02-13T20:18:26.840 INFO:tasks.rados.rados.0.trial188.stdout:1683: writing trial18843701-29 from 1938684 to 2369919 tid 2 2026-02-13T20:18:26.840 INFO:tasks.rados.rados.0.trial188.stdout:1684: read oid 42 snap -1 2026-02-13T20:18:26.840 INFO:tasks.rados.rados.0.trial188.stdout:1684: expect (ObjNum 592 snap 154 seq_num 592) 2026-02-13T20:18:26.840 INFO:tasks.rados.rados.0.trial188.stdout:1685: write oid 35 current snap is 163 2026-02-13T20:18:26.841 INFO:tasks.rados.rados.0.trial188.stdout:1685: seq_num 618 ranges {786726=728475,2280813=105913} 2026-02-13T20:18:26.845 INFO:tasks.rados.rados.0.trial188.stdout:1685: writing trial18843701-35 from 786726 to 1515201 tid 1 2026-02-13T20:18:26.849 INFO:tasks.rados.rados.0.trial188.stdout:1685: writing trial18843701-35 from 2280813 to 2386726 tid 2 2026-02-13T20:18:26.849 INFO:tasks.rados.rados.0.trial188.stdout:1686: read oid 40 snap -1 2026-02-13T20:18:26.849 INFO:tasks.rados.rados.0.trial188.stdout:1686: expect deleted 2026-02-13T20:18:26.849 INFO:tasks.rados.rados.0.trial188.stdout:1687: write oid 17 current snap is 163 2026-02-13T20:18:26.849 INFO:tasks.rados.rados.0.trial188.stdout:1687: seq_num 619 ranges {403533=403724,1539295=652201} 2026-02-13T20:18:26.852 INFO:tasks.rados.rados.0.trial188.stdout:1687: writing trial18843701-17 from 403533 to 807257 tid 1 2026-02-13T20:18:26.857 INFO:tasks.rados.rados.0.trial188.stdout:1687: writing trial18843701-17 from 1539295 to 2191496 tid 2 2026-02-13T20:18:26.857 INFO:tasks.rados.rados.0.trial188.stdout:1688: write oid 32 current snap is 163 2026-02-13T20:18:26.857 INFO:tasks.rados.rados.0.trial188.stdout:1688: seq_num 620 ranges {420340=478973,1597777=512212} 2026-02-13T20:18:26.860 INFO:tasks.rados.rados.0.trial188.stdout:1688: writing trial18843701-32 from 420340 to 899313 tid 1 2026-02-13T20:18:26.865 INFO:tasks.rados.rados.0.trial188.stdout:1688: writing trial18843701-32 from 1597777 to 2109989 tid 2 2026-02-13T20:18:26.865 INFO:tasks.rados.rados.0.trial188.stdout:1689: copy_from oid 8 from oid 43 current snap is 163 2026-02-13T20:18:26.865 INFO:tasks.rados.rados.0.trial188.stdout:1684: expect (ObjNum 592 snap 154 seq_num 592) 2026-02-13T20:18:26.872 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2069195 2026-02-13T20:18:26.886 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:18:26.942 INFO:tasks.rados.rados.0.trial188.stdout:1683: finishing write tid 1 to trial18843701-29 2026-02-13T20:18:26.943 INFO:tasks.rados.rados.0.trial188.stdout:1683: finishing write tid 2 to trial18843701-29 2026-02-13T20:18:26.943 INFO:tasks.rados.rados.0.trial188.stdout:1685: finishing write tid 1 to trial18843701-35 2026-02-13T20:18:26.943 INFO:tasks.rados.rados.0.trial188.stdout:1685: finishing write tid 2 to trial18843701-35 2026-02-13T20:18:26.943 INFO:tasks.rados.rados.0.trial188.stdout:1685: finishing write tid 3 to trial18843701-35 2026-02-13T20:18:26.943 INFO:tasks.rados.rados.0.trial188.stdout:1685: finishing write tid 4 to trial18843701-35 2026-02-13T20:18:26.943 INFO:tasks.rados.rados.0.trial188.stdout:1685: oid 35 updating version 0 to 669 2026-02-13T20:18:26.943 INFO:tasks.rados.rados.0.trial188.stdout:1685: oid 35 updating version 669 to 670 2026-02-13T20:18:26.943 INFO:tasks.rados.rados.0.trial188.stdout:1685: oid 35 version 670 is already newer than 668 2026-02-13T20:18:26.943 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 35 v 670 (ObjNum 618 snap 163 seq_num 618) dirty exists 2026-02-13T20:18:26.943 INFO:tasks.rados.rados.0.trial188.stdout:1685: left oid 35 (ObjNum 618 snap 163 seq_num 618) 2026-02-13T20:18:26.943 INFO:tasks.rados.rados.0.trial188.stdout:1683: finishing write tid 3 to trial18843701-29 2026-02-13T20:18:26.943 INFO:tasks.rados.rados.0.trial188.stdout:1683: finishing write tid 4 to trial18843701-29 2026-02-13T20:18:26.943 INFO:tasks.rados.rados.0.trial188.stdout:1683: oid 29 updating version 0 to 598 2026-02-13T20:18:26.943 INFO:tasks.rados.rados.0.trial188.stdout:1683: oid 29 updating version 598 to 599 2026-02-13T20:18:26.943 INFO:tasks.rados.rados.0.trial188.stdout:1683: oid 29 updating version 599 to 600 2026-02-13T20:18:26.943 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 29 v 600 (ObjNum 617 snap 163 seq_num 617) dirty exists 2026-02-13T20:18:26.943 INFO:tasks.rados.rados.0.trial188.stdout:1683: left oid 29 (ObjNum 617 snap 163 seq_num 617) 2026-02-13T20:18:26.943 INFO:tasks.rados.rados.0.trial188.stdout:1687: finishing write tid 1 to trial18843701-17 2026-02-13T20:18:26.943 INFO:tasks.rados.rados.0.trial188.stdout:1687: finishing write tid 2 to trial18843701-17 2026-02-13T20:18:26.943 INFO:tasks.rados.rados.0.trial188.stdout:1683: done (6 left) 2026-02-13T20:18:26.943 INFO:tasks.rados.rados.0.trial188.stdout:1684: done (5 left) 2026-02-13T20:18:26.943 INFO:tasks.rados.rados.0.trial188.stdout:1685: done (4 left) 2026-02-13T20:18:26.943 INFO:tasks.rados.rados.0.trial188.stdout:1686: done (3 left) 2026-02-13T20:18:26.943 INFO:tasks.rados.rados.0.trial188.stdout:1690: rollback oid 48 current snap is 163 2026-02-13T20:18:26.943 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 48 to 162 2026-02-13T20:18:26.943 INFO:tasks.rados.rados.0.trial188.stdout:1687: finishing write tid 3 to trial18843701-17 2026-02-13T20:18:26.943 INFO:tasks.rados.rados.0.trial188.stdout:1687: finishing write tid 4 to trial18843701-17 2026-02-13T20:18:26.943 INFO:tasks.rados.rados.0.trial188.stdout:1687: oid 17 updating version 0 to 579 2026-02-13T20:18:26.943 INFO:tasks.rados.rados.0.trial188.stdout:1687: oid 17 updating version 579 to 580 2026-02-13T20:18:26.943 INFO:tasks.rados.rados.0.trial188.stdout:1687: oid 17 updating version 580 to 581 2026-02-13T20:18:26.943 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 17 v 581 (ObjNum 619 snap 163 seq_num 619) dirty exists 2026-02-13T20:18:26.943 INFO:tasks.rados.rados.0.trial188.stdout:1687: left oid 17 (ObjNum 619 snap 163 seq_num 619) 2026-02-13T20:18:26.943 INFO:tasks.rados.rados.0.trial188.stdout:1688: finishing write tid 1 to trial18843701-32 2026-02-13T20:18:26.943 INFO:tasks.rados.rados.0.trial188.stdout:1688: finishing write tid 2 to trial18843701-32 2026-02-13T20:18:26.943 INFO:tasks.rados.rados.0.trial188.stdout:1688: finishing write tid 3 to trial18843701-32 2026-02-13T20:18:26.943 INFO:tasks.rados.rados.0.trial188.stdout:1688: finishing write tid 4 to trial18843701-32 2026-02-13T20:18:26.943 INFO:tasks.rados.rados.0.trial188.stdout:1688: oid 32 updating version 0 to 731 2026-02-13T20:18:26.944 INFO:tasks.rados.rados.0.trial188.stdout:1688: oid 32 version 731 is already newer than 729 2026-02-13T20:18:26.944 INFO:tasks.rados.rados.0.trial188.stdout:1688: oid 32 version 731 is already newer than 730 2026-02-13T20:18:26.944 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 32 v 731 (ObjNum 620 snap 163 seq_num 620) dirty exists 2026-02-13T20:18:26.944 INFO:tasks.rados.rados.0.trial188.stdout:1688: left oid 32 (ObjNum 620 snap 163 seq_num 620) 2026-02-13T20:18:26.944 INFO:tasks.rados.rados.0.trial188.stdout:1689: finishing copy_from racing read to trial18843701-8 2026-02-13T20:18:26.944 INFO:tasks.rados.rados.0.trial188.stdout:1689: finishing copy_from to trial18843701-8 2026-02-13T20:18:26.944 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 8 v 331 (ObjNum 435 snap 112 seq_num 435) dirty exists 2026-02-13T20:18:26.944 INFO:tasks.rados.rados.0.trial188.stdout:1687: done (3 left) 2026-02-13T20:18:26.944 INFO:tasks.rados.rados.0.trial188.stdout:1688: done (2 left) 2026-02-13T20:18:26.944 INFO:tasks.rados.rados.0.trial188.stdout:1689: done (1 left) 2026-02-13T20:18:26.944 INFO:tasks.rados.rados.0.trial188.stdout:1691: copy_from oid 8 from oid 19 current snap is 163 2026-02-13T20:18:26.944 INFO:tasks.rados.rados.0.trial188.stdout:1692: snap_create 2026-02-13T20:18:26.945 INFO:tasks.rados.rados.0.trial188.stdout:1690: finishing rollback tid 0 to trial18843701-48 2026-02-13T20:18:26.945 INFO:tasks.rados.rados.0.trial188.stdout:1690: finishing rollback tid 1 to trial18843701-48 2026-02-13T20:18:26.945 INFO:tasks.rados.rados.0.trial188.stdout:1690: finishing rollback tid 2 to trial18843701-48 2026-02-13T20:18:26.945 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 48 v 446 (ObjNum 578 snap 153 seq_num 578) dirty exists 2026-02-13T20:18:26.968 INFO:tasks.rados.rados.0.trial188.stdout:1691: finishing copy_from racing read to trial18843701-8 2026-02-13T20:18:26.970 INFO:tasks.rados.rados.0.trial188.stdout:1691: finishing copy_from to trial18843701-8 2026-02-13T20:18:26.970 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 8 v 591 (ObjNum 603 snap 159 seq_num 603) dirty exists 2026-02-13T20:18:27.699 INFO:tasks.rados.rados.0.trial188.stdout:1690: done (2 left) 2026-02-13T20:18:27.699 INFO:tasks.rados.rados.0.trial188.stdout:1691: done (1 left) 2026-02-13T20:18:27.700 INFO:tasks.rados.rados.0.trial188.stdout:1692: done (0 left) 2026-02-13T20:18:27.700 INFO:tasks.rados.rados.0.trial188.stdout:1693: read oid 38 snap -1 2026-02-13T20:18:27.700 INFO:tasks.rados.rados.0.trial188.stdout:1693: expect (ObjNum 534 snap 136 seq_num 534) 2026-02-13T20:18:27.700 INFO:tasks.rados.rados.0.trial188.stdout:1694: snap_create 2026-02-13T20:18:27.709 INFO:tasks.rados.rados.0.trial188.stdout:1693: expect (ObjNum 534 snap 136 seq_num 534) 2026-02-13T20:18:27.757 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2873135 2026-02-13T20:18:27.813 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:18:28.699 INFO:tasks.rados.rados.0.trial188.stdout:1693: done (1 left) 2026-02-13T20:18:28.699 INFO:tasks.rados.rados.0.trial188.stdout:1694: done (0 left) 2026-02-13T20:18:28.699 INFO:tasks.rados.rados.0.trial188.stdout:1695: snap_create 2026-02-13T20:18:29.700 INFO:tasks.rados.rados.0.trial188.stdout:1695: done (0 left) 2026-02-13T20:18:29.701 INFO:tasks.rados.rados.0.trial188.stdout:1696: write (excl) oid 33 current snap is 166 2026-02-13T20:18:29.701 INFO:tasks.rados.rados.0.trial188.stdout:1696: seq_num 621 ranges {437147=554222,1656259=655870} 2026-02-13T20:18:29.704 INFO:tasks.rados.rados.0.trial188.stdout:1696: writing trial18843701-33 from 437147 to 991369 tid 1 2026-02-13T20:18:29.709 INFO:tasks.rados.rados.0.trial188.stdout:1696: writing trial18843701-33 from 1656259 to 2312129 tid 2 2026-02-13T20:18:29.709 INFO:tasks.rados.rados.0.trial188.stdout:1697: read oid 15 snap -1 2026-02-13T20:18:29.709 INFO:tasks.rados.rados.0.trial188.stdout:1697: expect deleted 2026-02-13T20:18:29.709 INFO:tasks.rados.rados.0.trial188.stdout:1698: write oid 12 current snap is 166 2026-02-13T20:18:29.709 INFO:tasks.rados.rados.0.trial188.stdout:1698: seq_num 622 ranges {453954=629471,1598388=515881} 2026-02-13T20:18:29.713 INFO:tasks.rados.rados.0.trial188.stdout:1698: writing trial18843701-12 from 453954 to 1083425 tid 1 2026-02-13T20:18:29.716 INFO:tasks.rados.rados.0.trial188.stdout:1698: writing trial18843701-12 from 1598388 to 2114269 tid 2 2026-02-13T20:18:29.717 INFO:tasks.rados.rados.0.trial188.stdout:1699: write (excl) oid 8 current snap is 166 2026-02-13T20:18:29.717 INFO:tasks.rados.rados.0.trial188.stdout:1699: seq_num 623 ranges {470761=704720,1656870=659539} 2026-02-13T20:18:29.721 INFO:tasks.rados.rados.0.trial188.stdout:1699: writing trial18843701-8 from 470761 to 1175481 tid 1 2026-02-13T20:18:29.725 INFO:tasks.rados.rados.0.trial188.stdout:1699: writing trial18843701-8 from 1656870 to 2316409 tid 2 2026-02-13T20:18:29.725 INFO:tasks.rados.rados.0.trial188.stdout:1700: write oid 37 current snap is 166 2026-02-13T20:18:29.725 INFO:tasks.rados.rados.0.trial188.stdout:1700: seq_num 624 ranges {487568=496322,1431705=519550} 2026-02-13T20:18:29.729 INFO:tasks.rados.rados.0.trial188.stdout:1700: writing trial18843701-37 from 487568 to 983890 tid 1 2026-02-13T20:18:29.734 INFO:tasks.rados.rados.0.trial188.stdout:1700: writing trial18843701-37 from 1431705 to 1951255 tid 2 2026-02-13T20:18:29.734 INFO:tasks.rados.rados.0.trial188.stdout:1701: read oid 34 snap -1 2026-02-13T20:18:29.734 INFO:tasks.rados.rados.0.trial188.stdout:1701: expect (ObjNum 531 snap 136 seq_num 531) 2026-02-13T20:18:29.734 INFO:tasks.rados.rados.0.trial188.stdout:1702: rollback oid 24 current snap is 166 2026-02-13T20:18:29.734 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 24 to 164 2026-02-13T20:18:29.734 INFO:tasks.rados.rados.0.trial188.stdout:1696: finishing write tid 1 to trial18843701-33 2026-02-13T20:18:29.734 INFO:tasks.rados.rados.0.trial188.stdout:1696: finishing write tid 2 to trial18843701-33 2026-02-13T20:18:29.734 INFO:tasks.rados.rados.0.trial188.stdout:1696: finishing write tid 3 to trial18843701-33 2026-02-13T20:18:29.735 INFO:tasks.rados.rados.0.trial188.stdout:1696: finishing write tid 4 to trial18843701-33 2026-02-13T20:18:29.735 INFO:tasks.rados.rados.0.trial188.stdout:1696: oid 33 updating version 0 to 647 2026-02-13T20:18:29.735 INFO:tasks.rados.rados.0.trial188.stdout:1696: oid 33 version 647 is already newer than 646 2026-02-13T20:18:29.735 INFO:tasks.rados.rados.0.trial188.stdout:1696: oid 33 version 647 is already newer than 645 2026-02-13T20:18:29.735 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 33 v 647 (ObjNum 621 snap 166 seq_num 621) dirty exists 2026-02-13T20:18:29.735 INFO:tasks.rados.rados.0.trial188.stdout:1696: left oid 33 (ObjNum 621 snap 166 seq_num 621) 2026-02-13T20:18:29.735 INFO:tasks.rados.rados.0.trial188.stdout:1698: finishing write tid 1 to trial18843701-12 2026-02-13T20:18:29.735 INFO:tasks.rados.rados.0.trial188.stdout:1698: finishing write tid 2 to trial18843701-12 2026-02-13T20:18:29.735 INFO:tasks.rados.rados.0.trial188.stdout:1698: finishing write tid 3 to trial18843701-12 2026-02-13T20:18:29.735 INFO:tasks.rados.rados.0.trial188.stdout:1696: done (6 left) 2026-02-13T20:18:29.735 INFO:tasks.rados.rados.0.trial188.stdout:1697: done (5 left) 2026-02-13T20:18:29.735 INFO:tasks.rados.rados.0.trial188.stdout:1703: delete oid 2 current snap is 166 2026-02-13T20:18:29.735 INFO:tasks.rados.rados.0.trial188.stdout:1702: finishing rollback tid 1 to trial18843701-24 2026-02-13T20:18:29.735 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 24 v 0 (ObjNum 513 snap 0 seq_num 13766043) dirty dne 2026-02-13T20:18:29.735 INFO:tasks.rados.rados.0.trial188.stdout:1698: finishing write tid 4 to trial18843701-12 2026-02-13T20:18:29.736 INFO:tasks.rados.rados.0.trial188.stdout:1698: oid 12 updating version 0 to 584 2026-02-13T20:18:29.736 INFO:tasks.rados.rados.0.trial188.stdout:1698: oid 12 version 584 is already newer than 583 2026-02-13T20:18:29.736 INFO:tasks.rados.rados.0.trial188.stdout:1698: oid 12 version 584 is already newer than 582 2026-02-13T20:18:29.736 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 12 v 584 (ObjNum 622 snap 166 seq_num 622) dirty exists 2026-02-13T20:18:29.736 INFO:tasks.rados.rados.0.trial188.stdout:1698: left oid 12 (ObjNum 622 snap 166 seq_num 622) 2026-02-13T20:18:29.742 INFO:tasks.rados.rados.0.trial188.stdout:1698: done (5 left) 2026-02-13T20:18:29.742 INFO:tasks.rados.rados.0.trial188.stdout:1702: done (4 left) 2026-02-13T20:18:29.742 INFO:tasks.rados.rados.0.trial188.stdout:1703: done (3 left) 2026-02-13T20:18:29.742 INFO:tasks.rados.rados.0.trial188.stdout:1704: delete oid 16 current snap is 166 2026-02-13T20:18:29.749 INFO:tasks.rados.rados.0.trial188.stdout:1704: done (3 left) 2026-02-13T20:18:29.749 INFO:tasks.rados.rados.0.trial188.stdout:1705: rollback oid 38 current snap is 166 2026-02-13T20:18:29.749 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 38 to 164 2026-02-13T20:18:29.749 INFO:tasks.rados.rados.0.trial188.stdout:1706: snap_remove snap 165 2026-02-13T20:18:30.705 INFO:tasks.rados.rados.0.trial188.stdout:1706: done (4 left) 2026-02-13T20:18:30.706 INFO:tasks.rados.rados.0.trial188.stdout:1707: read oid 16 snap -1 2026-02-13T20:18:30.706 INFO:tasks.rados.rados.0.trial188.stdout:1707: expect deleted 2026-02-13T20:18:30.706 INFO:tasks.rados.rados.0.trial188.stdout:1708: read oid 5 snap -1 2026-02-13T20:18:30.706 INFO:tasks.rados.rados.0.trial188.stdout:1708: expect deleted 2026-02-13T20:18:30.706 INFO:tasks.rados.rados.0.trial188.stdout:1709: write oid 29 current snap is 166 2026-02-13T20:18:30.706 INFO:tasks.rados.rados.0.trial188.stdout:1699: finishing write tid 1 to trial18843701-8 2026-02-13T20:18:30.706 INFO:tasks.rados.rados.0.trial188.stdout:1709: seq_num 627 ranges {537989=722069,1890798=647191} 2026-02-13T20:18:30.710 INFO:tasks.rados.rados.0.trial188.stdout:1709: writing trial18843701-29 from 537989 to 1260058 tid 1 2026-02-13T20:18:30.716 INFO:tasks.rados.rados.0.trial188.stdout:1709: writing trial18843701-29 from 1890798 to 2537989 tid 2 2026-02-13T20:18:30.716 INFO:tasks.rados.rados.0.trial188.stdout:1710: rollback oid 44 current snap is 166 2026-02-13T20:18:30.716 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 44 to 164 2026-02-13T20:18:30.716 INFO:tasks.rados.rados.0.trial188.stdout:1699: finishing write tid 2 to trial18843701-8 2026-02-13T20:18:30.716 INFO:tasks.rados.rados.0.trial188.stdout:1699: finishing write tid 3 to trial18843701-8 2026-02-13T20:18:30.716 INFO:tasks.rados.rados.0.trial188.stdout:1699: finishing write tid 4 to trial18843701-8 2026-02-13T20:18:30.717 INFO:tasks.rados.rados.0.trial188.stdout:1699: oid 8 updating version 0 to 660 2026-02-13T20:18:30.717 INFO:tasks.rados.rados.0.trial188.stdout:1699: oid 8 version 660 is already newer than 659 2026-02-13T20:18:30.717 INFO:tasks.rados.rados.0.trial188.stdout:1699: oid 8 updating version 660 to 661 2026-02-13T20:18:30.717 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 8 v 661 (ObjNum 623 snap 166 seq_num 623) dirty exists 2026-02-13T20:18:30.717 INFO:tasks.rados.rados.0.trial188.stdout:1699: left oid 8 (ObjNum 623 snap 166 seq_num 623) 2026-02-13T20:18:30.717 INFO:tasks.rados.rados.0.trial188.stdout:1705: finishing rollback tid 0 to trial18843701-38 2026-02-13T20:18:30.717 INFO:tasks.rados.rados.0.trial188.stdout:1700: finishing write tid 1 to trial18843701-37 2026-02-13T20:18:30.717 INFO:tasks.rados.rados.0.trial188.stdout:1705: finishing rollback tid 1 to trial18843701-38 2026-02-13T20:18:30.717 INFO:tasks.rados.rados.0.trial188.stdout:1705: finishing rollback tid 2 to trial18843701-38 2026-02-13T20:18:30.717 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 38 v 722 (ObjNum 534 snap 136 seq_num 534) dirty exists 2026-02-13T20:18:30.718 INFO:tasks.rados.rados.0.trial188.stdout:1700: finishing write tid 2 to trial18843701-37 2026-02-13T20:18:30.718 INFO:tasks.rados.rados.0.trial188.stdout:1699: done (7 left) 2026-02-13T20:18:30.718 INFO:tasks.rados.rados.0.trial188.stdout:1705: done (6 left) 2026-02-13T20:18:30.718 INFO:tasks.rados.rados.0.trial188.stdout:1711: delete oid 41 current snap is 166 2026-02-13T20:18:30.718 INFO:tasks.rados.rados.0.trial188.stdout:1700: finishing write tid 3 to trial18843701-37 2026-02-13T20:18:30.718 INFO:tasks.rados.rados.0.trial188.stdout:1700: finishing write tid 4 to trial18843701-37 2026-02-13T20:18:30.718 INFO:tasks.rados.rados.0.trial188.stdout:1700: oid 37 updating version 0 to 663 2026-02-13T20:18:30.718 INFO:tasks.rados.rados.0.trial188.stdout:1700: oid 37 updating version 663 to 664 2026-02-13T20:18:30.718 INFO:tasks.rados.rados.0.trial188.stdout:1700: oid 37 version 664 is already newer than 662 2026-02-13T20:18:30.718 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 37 v 664 (ObjNum 624 snap 166 seq_num 624) dirty exists 2026-02-13T20:18:30.718 INFO:tasks.rados.rados.0.trial188.stdout:1700: left oid 37 (ObjNum 624 snap 166 seq_num 624) 2026-02-13T20:18:30.719 INFO:tasks.rados.rados.0.trial188.stdout:1701: expect (ObjNum 531 snap 136 seq_num 531) 2026-02-13T20:18:30.743 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2436691 2026-02-13T20:18:30.864 INFO:tasks.rados.rados.0.trial188.stdout:1710: finishing rollback tid 0 to trial18843701-44 2026-02-13T20:18:30.864 INFO:tasks.rados.rados.0.trial188.stdout:1710: finishing rollback tid 1 to trial18843701-44 2026-02-13T20:18:30.864 INFO:tasks.rados.rados.0.trial188.stdout:1710: finishing rollback tid 2 to trial18843701-44 2026-02-13T20:18:30.864 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 44 v 725 (ObjNum 610 snap 160 seq_num 610) dirty exists 2026-02-13T20:18:30.864 INFO:tasks.rados.rados.0.trial188.stdout:1709: finishing write tid 1 to trial18843701-29 2026-02-13T20:18:30.864 INFO:tasks.rados.rados.0.trial188.stdout:1709: finishing write tid 2 to trial18843701-29 2026-02-13T20:18:30.864 INFO:tasks.rados.rados.0.trial188.stdout:1709: finishing write tid 3 to trial18843701-29 2026-02-13T20:18:30.864 INFO:tasks.rados.rados.0.trial188.stdout:1709: finishing write tid 4 to trial18843701-29 2026-02-13T20:18:30.865 INFO:tasks.rados.rados.0.trial188.stdout:1709: oid 29 updating version 0 to 602 2026-02-13T20:18:30.865 INFO:tasks.rados.rados.0.trial188.stdout:1709: oid 29 version 602 is already newer than 601 2026-02-13T20:18:30.865 INFO:tasks.rados.rados.0.trial188.stdout:1709: oid 29 updating version 602 to 603 2026-02-13T20:18:30.865 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 29 v 603 (ObjNum 627 snap 166 seq_num 627) dirty exists 2026-02-13T20:18:30.865 INFO:tasks.rados.rados.0.trial188.stdout:1709: left oid 29 (ObjNum 627 snap 166 seq_num 627) 2026-02-13T20:18:30.865 INFO:tasks.rados.rados.0.trial188.stdout:1700: done (6 left) 2026-02-13T20:18:30.865 INFO:tasks.rados.rados.0.trial188.stdout:1701: done (5 left) 2026-02-13T20:18:30.865 INFO:tasks.rados.rados.0.trial188.stdout:1707: done (4 left) 2026-02-13T20:18:30.865 INFO:tasks.rados.rados.0.trial188.stdout:1708: done (3 left) 2026-02-13T20:18:30.865 INFO:tasks.rados.rados.0.trial188.stdout:1709: done (2 left) 2026-02-13T20:18:30.865 INFO:tasks.rados.rados.0.trial188.stdout:1710: done (1 left) 2026-02-13T20:18:30.865 INFO:tasks.rados.rados.0.trial188.stdout:1711: done (0 left) 2026-02-13T20:18:30.866 INFO:tasks.rados.rados.0.trial188.stdout:1712: delete oid 9 current snap is 166 2026-02-13T20:18:30.866 INFO:tasks.rados.rados.0.trial188.stdout:1712: done (0 left) 2026-02-13T20:18:30.866 INFO:tasks.rados.rados.0.trial188.stdout:1713: write oid 43 current snap is 166 2026-02-13T20:18:30.866 INFO:tasks.rados.rados.0.trial188.stdout:1713: seq_num 630 ranges {588410=547816,1666244=414204,2484603=103807} 2026-02-13T20:18:30.868 INFO:tasks.rados.rados.0.trial188.stdout:1713: writing trial18843701-43 from 588410 to 1136226 tid 1 2026-02-13T20:18:30.872 INFO:tasks.rados.rados.0.trial188.stdout:1713: writing trial18843701-43 from 1666244 to 2080448 tid 2 2026-02-13T20:18:30.874 INFO:tasks.rados.rados.0.trial188.stdout:1713: writing trial18843701-43 from 2484603 to 2588410 tid 3 2026-02-13T20:18:30.875 INFO:tasks.rados.rados.0.trial188.stdout:1714: snap_remove snap 164 2026-02-13T20:18:31.709 INFO:tasks.rados.rados.0.trial188.stdout:1714: done (1 left) 2026-02-13T20:18:31.709 INFO:tasks.rados.rados.0.trial188.stdout:1715: read oid 48 snap -1 2026-02-13T20:18:31.709 INFO:tasks.rados.rados.0.trial188.stdout:1715: expect (ObjNum 578 snap 153 seq_num 578) 2026-02-13T20:18:31.709 INFO:tasks.rados.rados.0.trial188.stdout:1716: read oid 23 snap -1 2026-02-13T20:18:31.709 INFO:tasks.rados.rados.0.trial188.stdout:1716: expect deleted 2026-02-13T20:18:31.709 INFO:tasks.rados.rados.0.trial188.stdout:1717: delete oid 32 current snap is 166 2026-02-13T20:18:31.709 INFO:tasks.rados.rados.0.trial188.stdout:1713: finishing write tid 1 to trial18843701-43 2026-02-13T20:18:31.709 INFO:tasks.rados.rados.0.trial188.stdout:1713: finishing write tid 2 to trial18843701-43 2026-02-13T20:18:31.709 INFO:tasks.rados.rados.0.trial188.stdout:1713: finishing write tid 3 to trial18843701-43 2026-02-13T20:18:31.709 INFO:tasks.rados.rados.0.trial188.stdout:1713: finishing write tid 4 to trial18843701-43 2026-02-13T20:18:31.709 INFO:tasks.rados.rados.0.trial188.stdout:1713: finishing write tid 5 to trial18843701-43 2026-02-13T20:18:31.710 INFO:tasks.rados.rados.0.trial188.stdout:1713: oid 43 updating version 0 to 368 2026-02-13T20:18:31.710 INFO:tasks.rados.rados.0.trial188.stdout:1713: oid 43 version 368 is already newer than 366 2026-02-13T20:18:31.710 INFO:tasks.rados.rados.0.trial188.stdout:1713: oid 43 version 368 is already newer than 365 2026-02-13T20:18:31.710 INFO:tasks.rados.rados.0.trial188.stdout:1713: oid 43 version 368 is already newer than 367 2026-02-13T20:18:31.710 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 43 v 368 (ObjNum 630 snap 166 seq_num 630) dirty exists 2026-02-13T20:18:31.710 INFO:tasks.rados.rados.0.trial188.stdout:1713: left oid 43 (ObjNum 630 snap 166 seq_num 630) 2026-02-13T20:18:31.719 INFO:tasks.rados.rados.0.trial188.stdout:1715: expect (ObjNum 578 snap 153 seq_num 578) 2026-02-13T20:18:31.720 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:18:31.840 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 3295902 2026-02-13T20:18:31.843 INFO:tasks.rados.rados.0.trial188.stdout:1713: done (3 left) 2026-02-13T20:18:31.843 INFO:tasks.rados.rados.0.trial188.stdout:1715: done (2 left) 2026-02-13T20:18:31.843 INFO:tasks.rados.rados.0.trial188.stdout:1716: done (1 left) 2026-02-13T20:18:31.843 INFO:tasks.rados.rados.0.trial188.stdout:1717: done (0 left) 2026-02-13T20:18:31.843 INFO:tasks.rados.rados.0.trial188.stdout:1718: rollback oid 20 current snap is 166 2026-02-13T20:18:31.843 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 20 to 162 2026-02-13T20:18:31.844 INFO:tasks.rados.rados.0.trial188.stdout:1719: write oid 36 current snap is 166 2026-02-13T20:18:31.844 INFO:tasks.rados.rados.0.trial188.stdout:1719: seq_num 632 ranges {622024=414667,1783208=417873} 2026-02-13T20:18:31.847 INFO:tasks.rados.rados.0.trial188.stdout:1719: writing trial18843701-36 from 622024 to 1036691 tid 1 2026-02-13T20:18:31.852 INFO:tasks.rados.rados.0.trial188.stdout:1719: writing trial18843701-36 from 1783208 to 2201081 tid 2 2026-02-13T20:18:31.852 INFO:tasks.rados.rados.0.trial188.stdout:1720: read oid 7 snap -1 2026-02-13T20:18:31.852 INFO:tasks.rados.rados.0.trial188.stdout:1720: expect (ObjNum 607 snap 160 seq_num 607) 2026-02-13T20:18:31.852 INFO:tasks.rados.rados.0.trial188.stdout:1721: write oid 14 current snap is 166 2026-02-13T20:18:31.852 INFO:tasks.rados.rados.0.trial188.stdout:1718: finishing rollback tid 0 to trial18843701-20 2026-02-13T20:18:31.853 INFO:tasks.rados.rados.0.trial188.stdout:1718: finishing rollback tid 1 to trial18843701-20 2026-02-13T20:18:31.853 INFO:tasks.rados.rados.0.trial188.stdout:1718: finishing rollback tid 2 to trial18843701-20 2026-02-13T20:18:31.853 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 20 v 653 (ObjNum 531 snap 136 seq_num 531) dirty exists 2026-02-13T20:18:31.853 INFO:tasks.rados.rados.0.trial188.stdout:1721: seq_num 633 ranges {638831=489916,1841690=677884} 2026-02-13T20:18:31.856 INFO:tasks.rados.rados.0.trial188.stdout:1721: writing trial18843701-14 from 638831 to 1128747 tid 1 2026-02-13T20:18:31.862 INFO:tasks.rados.rados.0.trial188.stdout:1721: writing trial18843701-14 from 1841690 to 2519574 tid 2 2026-02-13T20:18:31.862 INFO:tasks.rados.rados.0.trial188.stdout:1718: done (3 left) 2026-02-13T20:18:31.862 INFO:tasks.rados.rados.0.trial188.stdout:1722: write oid 20 current snap is 166 2026-02-13T20:18:31.862 INFO:tasks.rados.rados.0.trial188.stdout:1722: seq_num 634 ranges {655638=565165,1900172=421542} 2026-02-13T20:18:31.866 INFO:tasks.rados.rados.0.trial188.stdout:1722: writing trial18843701-20 from 655638 to 1220803 tid 1 2026-02-13T20:18:31.870 INFO:tasks.rados.rados.0.trial188.stdout:1722: writing trial18843701-20 from 1900172 to 2321714 tid 2 2026-02-13T20:18:31.870 INFO:tasks.rados.rados.0.trial188.stdout:1723: read oid 25 snap -1 2026-02-13T20:18:31.870 INFO:tasks.rados.rados.0.trial188.stdout:1723: expect (ObjNum 615 snap 162 seq_num 615) 2026-02-13T20:18:31.870 INFO:tasks.rados.rados.0.trial188.stdout:1724: rollback oid 6 current snap is 166 2026-02-13T20:18:31.870 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 6 to 163 2026-02-13T20:18:31.870 INFO:tasks.rados.rados.0.trial188.stdout:1720: expect (ObjNum 607 snap 160 seq_num 607) 2026-02-13T20:18:31.901 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2122173 2026-02-13T20:18:31.901 INFO:tasks.rados.rados.0.trial188.stdout:1719: finishing write tid 1 to trial18843701-36 2026-02-13T20:18:31.901 INFO:tasks.rados.rados.0.trial188.stdout:1720: done (5 left) 2026-02-13T20:18:31.901 INFO:tasks.rados.rados.0.trial188.stdout:1725: write oid 30 current snap is 166 2026-02-13T20:18:31.901 INFO:tasks.rados.rados.0.trial188.stdout:1725: seq_num 635 ranges {672445=640414,1842301=681553} 2026-02-13T20:18:31.906 INFO:tasks.rados.rados.0.trial188.stdout:1725: writing trial18843701-30 from 672445 to 1312859 tid 1 2026-02-13T20:18:31.912 INFO:tasks.rados.rados.0.trial188.stdout:1725: writing trial18843701-30 from 1842301 to 2523854 tid 2 2026-02-13T20:18:31.912 INFO:tasks.rados.rados.0.trial188.stdout:1726: copy_from oid 19 from oid 18 current snap is 166 2026-02-13T20:18:31.912 INFO:tasks.rados.rados.0.trial188.stdout:1719: finishing write tid 2 to trial18843701-36 2026-02-13T20:18:31.912 INFO:tasks.rados.rados.0.trial188.stdout:1719: finishing write tid 3 to trial18843701-36 2026-02-13T20:18:31.912 INFO:tasks.rados.rados.0.trial188.stdout:1719: finishing write tid 4 to trial18843701-36 2026-02-13T20:18:31.913 INFO:tasks.rados.rados.0.trial188.stdout:1719: oid 36 updating version 0 to 769 2026-02-13T20:18:31.913 INFO:tasks.rados.rados.0.trial188.stdout:1719: oid 36 version 769 is already newer than 768 2026-02-13T20:18:31.913 INFO:tasks.rados.rados.0.trial188.stdout:1719: oid 36 version 769 is already newer than 767 2026-02-13T20:18:31.913 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 36 v 769 (ObjNum 632 snap 166 seq_num 632) dirty exists 2026-02-13T20:18:31.913 INFO:tasks.rados.rados.0.trial188.stdout:1719: left oid 36 (ObjNum 632 snap 166 seq_num 632) 2026-02-13T20:18:31.913 INFO:tasks.rados.rados.0.trial188.stdout:1723: expect (ObjNum 615 snap 162 seq_num 615) 2026-02-13T20:18:31.916 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 866564 2026-02-13T20:18:31.953 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:18:31.975 INFO:tasks.rados.rados.0.trial188.stdout:1721: finishing write tid 1 to trial18843701-14 2026-02-13T20:18:31.975 INFO:tasks.rados.rados.0.trial188.stdout:1722: finishing write tid 1 to trial18843701-20 2026-02-13T20:18:31.975 INFO:tasks.rados.rados.0.trial188.stdout:1721: finishing write tid 2 to trial18843701-14 2026-02-13T20:18:31.976 INFO:tasks.rados.rados.0.trial188.stdout:1721: finishing write tid 3 to trial18843701-14 2026-02-13T20:18:31.976 INFO:tasks.rados.rados.0.trial188.stdout:1722: finishing write tid 2 to trial18843701-20 2026-02-13T20:18:31.976 INFO:tasks.rados.rados.0.trial188.stdout:1719: done (6 left) 2026-02-13T20:18:31.976 INFO:tasks.rados.rados.0.trial188.stdout:1723: done (5 left) 2026-02-13T20:18:31.976 INFO:tasks.rados.rados.0.trial188.stdout:1727: write (excl) oid 37 current snap is 166 2026-02-13T20:18:31.976 INFO:tasks.rados.rados.0.trial188.stdout:1727: seq_num 636 ranges {689252=715663,1900783=425211} 2026-02-13T20:18:31.980 INFO:tasks.rados.rados.0.trial188.stdout:1727: writing trial18843701-37 from 689252 to 1404915 tid 1 2026-02-13T20:18:31.983 INFO:tasks.rados.rados.0.trial188.stdout:1727: writing trial18843701-37 from 1900783 to 2325994 tid 2 2026-02-13T20:18:31.983 INFO:tasks.rados.rados.0.trial188.stdout:1728: write (excl) oid 9 current snap is 166 2026-02-13T20:18:31.984 INFO:tasks.rados.rados.0.trial188.stdout:1728: seq_num 637 ranges {706059=790912,1959265=685222} 2026-02-13T20:18:31.989 INFO:tasks.rados.rados.0.trial188.stdout:1728: writing trial18843701-9 from 706059 to 1496971 tid 1 2026-02-13T20:18:31.993 INFO:tasks.rados.rados.0.trial188.stdout:1728: writing trial18843701-9 from 1959265 to 2644487 tid 2 2026-02-13T20:18:31.993 INFO:tasks.rados.rados.0.trial188.stdout:1729: read oid 25 snap -1 2026-02-13T20:18:31.993 INFO:tasks.rados.rados.0.trial188.stdout:1729: expect (ObjNum 615 snap 162 seq_num 615) 2026-02-13T20:18:31.993 INFO:tasks.rados.rados.0.trial188.stdout:1730: snap_remove snap 162 2026-02-13T20:18:32.703 INFO:tasks.rados.rados.0.trial188.stdout:1730: done (8 left) 2026-02-13T20:18:32.704 INFO:tasks.rados.rados.0.trial188.stdout:1731: read oid 48 snap 163 2026-02-13T20:18:32.704 INFO:tasks.rados.rados.0.trial188.stdout:1731: expect (ObjNum 578 snap 153 seq_num 578) 2026-02-13T20:18:32.704 INFO:tasks.rados.rados.0.trial188.stdout:1732: read oid 17 snap -1 2026-02-13T20:18:32.704 INFO:tasks.rados.rados.0.trial188.stdout:1732: expect (ObjNum 619 snap 163 seq_num 619) 2026-02-13T20:18:32.704 INFO:tasks.rados.rados.0.trial188.stdout:1733: copy_from oid 15 from oid 40 current snap is 166 2026-02-13T20:18:32.704 INFO:tasks.rados.rados.0.trial188.stdout:1721: finishing write tid 4 to trial18843701-14 2026-02-13T20:18:32.705 INFO:tasks.rados.rados.0.trial188.stdout:1721: oid 14 updating version 0 to 614 2026-02-13T20:18:32.705 INFO:tasks.rados.rados.0.trial188.stdout:1721: oid 14 version 614 is already newer than 613 2026-02-13T20:18:32.705 INFO:tasks.rados.rados.0.trial188.stdout:1721: oid 14 updating version 614 to 615 2026-02-13T20:18:32.705 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 14 v 615 (ObjNum 633 snap 166 seq_num 633) dirty exists 2026-02-13T20:18:32.705 INFO:tasks.rados.rados.0.trial188.stdout:1721: left oid 14 (ObjNum 633 snap 166 seq_num 633) 2026-02-13T20:18:32.705 INFO:tasks.rados.rados.0.trial188.stdout:1721: done (10 left) 2026-02-13T20:18:32.706 INFO:tasks.rados.rados.0.trial188.stdout:1734: snap_create 2026-02-13T20:18:32.706 INFO:tasks.rados.rados.0.trial188.stdout:1722: finishing write tid 3 to trial18843701-20 2026-02-13T20:18:32.706 INFO:tasks.rados.rados.0.trial188.stdout:1722: finishing write tid 4 to trial18843701-20 2026-02-13T20:18:32.706 INFO:tasks.rados.rados.0.trial188.stdout:1722: oid 20 updating version 0 to 656 2026-02-13T20:18:32.706 INFO:tasks.rados.rados.0.trial188.stdout:1722: oid 20 version 656 is already newer than 654 2026-02-13T20:18:32.706 INFO:tasks.rados.rados.0.trial188.stdout:1722: oid 20 version 656 is already newer than 655 2026-02-13T20:18:32.706 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 20 v 656 (ObjNum 634 snap 166 seq_num 634) dirty exists 2026-02-13T20:18:32.706 INFO:tasks.rados.rados.0.trial188.stdout:1722: left oid 20 (ObjNum 634 snap 166 seq_num 634) 2026-02-13T20:18:32.707 INFO:tasks.rados.rados.0.trial188.stdout:1724: finishing rollback tid 0 to trial18843701-6 2026-02-13T20:18:32.707 INFO:tasks.rados.rados.0.trial188.stdout:1724: finishing rollback tid 1 to trial18843701-6 2026-02-13T20:18:32.707 INFO:tasks.rados.rados.0.trial188.stdout:1724: finishing rollback tid 2 to trial18843701-6 2026-02-13T20:18:32.707 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 6 v 773 (ObjNum 584 snap 153 seq_num 584) dirty exists 2026-02-13T20:18:32.707 INFO:tasks.rados.rados.0.trial188.stdout:1725: finishing write tid 1 to trial18843701-30 2026-02-13T20:18:32.707 INFO:tasks.rados.rados.0.trial188.stdout:1725: finishing write tid 2 to trial18843701-30 2026-02-13T20:18:32.707 INFO:tasks.rados.rados.0.trial188.stdout:1725: finishing write tid 3 to trial18843701-30 2026-02-13T20:18:32.707 INFO:tasks.rados.rados.0.trial188.stdout:1725: finishing write tid 4 to trial18843701-30 2026-02-13T20:18:32.708 INFO:tasks.rados.rados.0.trial188.stdout:1725: oid 30 updating version 0 to 729 2026-02-13T20:18:32.708 INFO:tasks.rados.rados.0.trial188.stdout:1725: oid 30 version 729 is already newer than 728 2026-02-13T20:18:32.708 INFO:tasks.rados.rados.0.trial188.stdout:1725: oid 30 version 729 is already newer than 727 2026-02-13T20:18:32.708 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 30 v 729 (ObjNum 635 snap 166 seq_num 635) dirty exists 2026-02-13T20:18:32.708 INFO:tasks.rados.rados.0.trial188.stdout:1725: left oid 30 (ObjNum 635 snap 166 seq_num 635) 2026-02-13T20:18:32.708 INFO:tasks.rados.rados.0.trial188.stdout:1726: finishing copy_from racing read to trial18843701-19 2026-02-13T20:18:32.708 INFO:tasks.rados.rados.0.trial188.stdout:1726: finishing copy_from to trial18843701-19 2026-02-13T20:18:32.708 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 19 v 575 (ObjNum 598 snap 159 seq_num 598) dirty exists 2026-02-13T20:18:32.709 INFO:tasks.rados.rados.0.trial188.stdout:1727: finishing write tid 1 to trial18843701-37 2026-02-13T20:18:32.709 INFO:tasks.rados.rados.0.trial188.stdout:1727: finishing write tid 2 to trial18843701-37 2026-02-13T20:18:32.709 INFO:tasks.rados.rados.0.trial188.stdout:1727: finishing write tid 3 to trial18843701-37 2026-02-13T20:18:32.709 INFO:tasks.rados.rados.0.trial188.stdout:1727: finishing write tid 4 to trial18843701-37 2026-02-13T20:18:32.709 INFO:tasks.rados.rados.0.trial188.stdout:1727: oid 37 updating version 0 to 667 2026-02-13T20:18:32.709 INFO:tasks.rados.rados.0.trial188.stdout:1727: oid 37 version 667 is already newer than 666 2026-02-13T20:18:32.709 INFO:tasks.rados.rados.0.trial188.stdout:1727: oid 37 version 667 is already newer than 665 2026-02-13T20:18:32.709 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 37 v 667 (ObjNum 636 snap 166 seq_num 636) dirty exists 2026-02-13T20:18:32.710 INFO:tasks.rados.rados.0.trial188.stdout:1727: left oid 37 (ObjNum 636 snap 166 seq_num 636) 2026-02-13T20:18:32.710 INFO:tasks.rados.rados.0.trial188.stdout:1728: finishing write tid 1 to trial18843701-9 2026-02-13T20:18:32.710 INFO:tasks.rados.rados.0.trial188.stdout:1728: finishing write tid 2 to trial18843701-9 2026-02-13T20:18:32.710 INFO:tasks.rados.rados.0.trial188.stdout:1728: finishing write tid 3 to trial18843701-9 2026-02-13T20:18:32.710 INFO:tasks.rados.rados.0.trial188.stdout:1729: expect (ObjNum 615 snap 162 seq_num 615) 2026-02-13T20:18:32.711 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1715963 2026-02-13T20:18:32.724 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1093647 2026-02-13T20:18:32.757 INFO:tasks.rados.rados.0.trial188.stdout:1728: finishing write tid 4 to trial18843701-9 2026-02-13T20:18:32.757 INFO:tasks.rados.rados.0.trial188.stdout:1728: oid 9 updating version 0 to 672 2026-02-13T20:18:32.757 INFO:tasks.rados.rados.0.trial188.stdout:1728: oid 9 updating version 672 to 673 2026-02-13T20:18:32.757 INFO:tasks.rados.rados.0.trial188.stdout:1728: oid 9 updating version 673 to 674 2026-02-13T20:18:32.758 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 9 v 674 (ObjNum 637 snap 166 seq_num 637) dirty exists 2026-02-13T20:18:32.758 INFO:tasks.rados.rados.0.trial188.stdout:1728: left oid 9 (ObjNum 637 snap 166 seq_num 637) 2026-02-13T20:18:32.758 INFO:tasks.rados.rados.0.trial188.stdout:1733: finishing copy_from to trial18843701-15 2026-02-13T20:18:32.758 INFO:tasks.rados.rados.0.trial188.stdout:1733: got expected ENOENT (src dne) 2026-02-13T20:18:32.758 INFO:tasks.rados.rados.0.trial188.stdout:1733: finishing copy_from racing read to trial18843701-15 2026-02-13T20:18:32.758 INFO:tasks.rados.rados.0.trial188.stdout:1732: expect (ObjNum 619 snap 163 seq_num 619) 2026-02-13T20:18:32.758 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:18:32.789 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:18:32.854 INFO:tasks.rados.rados.0.trial188.stdout:1731: expect (ObjNum 578 snap 153 seq_num 578) 2026-02-13T20:18:32.854 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:18:32.944 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:18:33.702 INFO:tasks.rados.rados.0.trial188.stdout:1722: done (10 left) 2026-02-13T20:18:33.702 INFO:tasks.rados.rados.0.trial188.stdout:1724: done (9 left) 2026-02-13T20:18:33.702 INFO:tasks.rados.rados.0.trial188.stdout:1725: done (8 left) 2026-02-13T20:18:33.703 INFO:tasks.rados.rados.0.trial188.stdout:1726: done (7 left) 2026-02-13T20:18:33.703 INFO:tasks.rados.rados.0.trial188.stdout:1727: done (6 left) 2026-02-13T20:18:33.703 INFO:tasks.rados.rados.0.trial188.stdout:1728: done (5 left) 2026-02-13T20:18:33.703 INFO:tasks.rados.rados.0.trial188.stdout:1729: done (4 left) 2026-02-13T20:18:33.703 INFO:tasks.rados.rados.0.trial188.stdout:1731: done (3 left) 2026-02-13T20:18:33.703 INFO:tasks.rados.rados.0.trial188.stdout:1732: done (2 left) 2026-02-13T20:18:33.703 INFO:tasks.rados.rados.0.trial188.stdout:1733: done (1 left) 2026-02-13T20:18:33.703 INFO:tasks.rados.rados.0.trial188.stdout:1734: done (0 left) 2026-02-13T20:18:33.703 INFO:tasks.rados.rados.0.trial188.stdout:1735: snap_remove snap 163 2026-02-13T20:18:34.701 INFO:tasks.rados.rados.0.trial188.stdout:1735: done (0 left) 2026-02-13T20:18:34.701 INFO:tasks.rados.rados.0.trial188.stdout:1736: snap_create 2026-02-13T20:18:35.702 INFO:tasks.rados.rados.0.trial188.stdout:1736: done (0 left) 2026-02-13T20:18:35.702 INFO:tasks.rados.rados.0.trial188.stdout:1737: snap_create 2026-02-13T20:18:36.703 INFO:tasks.rados.rados.0.trial188.stdout:1737: done (0 left) 2026-02-13T20:18:36.704 INFO:tasks.rados.rados.0.trial188.stdout:1738: read oid 29 snap -1 2026-02-13T20:18:36.704 INFO:tasks.rados.rados.0.trial188.stdout:1738: expect (ObjNum 627 snap 166 seq_num 627) 2026-02-13T20:18:36.704 INFO:tasks.rados.rados.0.trial188.stdout:1739: write oid 34 current snap is 169 2026-02-13T20:18:36.704 INFO:tasks.rados.rados.0.trial188.stdout:1739: seq_num 638 ranges {722866=466161,1617747=428880,2587634=135232} 2026-02-13T20:18:36.708 INFO:tasks.rados.rados.0.trial188.stdout:1739: writing trial18843701-34 from 722866 to 1189027 tid 1 2026-02-13T20:18:36.711 INFO:tasks.rados.rados.0.trial188.stdout:1739: writing trial18843701-34 from 1617747 to 2046627 tid 2 2026-02-13T20:18:36.715 INFO:tasks.rados.rados.0.trial188.stdout:1739: writing trial18843701-34 from 2587634 to 2722866 tid 3 2026-02-13T20:18:36.715 INFO:tasks.rados.rados.0.trial188.stdout:1740: rollback oid 6 current snap is 169 2026-02-13T20:18:36.715 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 6 to 167 2026-02-13T20:18:36.715 INFO:tasks.rados.rados.0.trial188.stdout:1738: expect (ObjNum 627 snap 166 seq_num 627) 2026-02-13T20:18:36.715 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:18:36.796 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:18:36.837 INFO:tasks.rados.rados.0.trial188.stdout:1740: finishing rollback tid 0 to trial18843701-6 2026-02-13T20:18:36.837 INFO:tasks.rados.rados.0.trial188.stdout:1740: finishing rollback tid 1 to trial18843701-6 2026-02-13T20:18:36.837 INFO:tasks.rados.rados.0.trial188.stdout:1740: finishing rollback tid 2 to trial18843701-6 2026-02-13T20:18:36.837 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 6 v 789 (ObjNum 584 snap 153 seq_num 584) dirty exists 2026-02-13T20:18:36.838 INFO:tasks.rados.rados.0.trial188.stdout:1739: finishing write tid 1 to trial18843701-34 2026-02-13T20:18:36.838 INFO:tasks.rados.rados.0.trial188.stdout:1739: finishing write tid 2 to trial18843701-34 2026-02-13T20:18:36.838 INFO:tasks.rados.rados.0.trial188.stdout:1739: finishing write tid 3 to trial18843701-34 2026-02-13T20:18:36.838 INFO:tasks.rados.rados.0.trial188.stdout:1739: finishing write tid 4 to trial18843701-34 2026-02-13T20:18:36.838 INFO:tasks.rados.rados.0.trial188.stdout:1739: finishing write tid 5 to trial18843701-34 2026-02-13T20:18:36.838 INFO:tasks.rados.rados.0.trial188.stdout:1739: oid 34 updating version 0 to 669 2026-02-13T20:18:36.838 INFO:tasks.rados.rados.0.trial188.stdout:1739: oid 34 updating version 669 to 670 2026-02-13T20:18:36.838 INFO:tasks.rados.rados.0.trial188.stdout:1739: oid 34 updating version 670 to 671 2026-02-13T20:18:36.838 INFO:tasks.rados.rados.0.trial188.stdout:1739: oid 34 version 671 is already newer than 668 2026-02-13T20:18:36.838 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 34 v 671 (ObjNum 638 snap 169 seq_num 638) dirty exists 2026-02-13T20:18:36.838 INFO:tasks.rados.rados.0.trial188.stdout:1739: left oid 34 (ObjNum 638 snap 169 seq_num 638) 2026-02-13T20:18:36.839 INFO:tasks.rados.rados.0.trial188.stdout:1738: done (2 left) 2026-02-13T20:18:36.839 INFO:tasks.rados.rados.0.trial188.stdout:1739: done (1 left) 2026-02-13T20:18:36.839 INFO:tasks.rados.rados.0.trial188.stdout:1740: done (0 left) 2026-02-13T20:18:36.839 INFO:tasks.rados.rados.0.trial188.stdout:1741: rollback oid 13 current snap is 169 2026-02-13T20:18:36.839 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 13 to 168 2026-02-13T20:18:36.839 INFO:tasks.rados.rados.0.trial188.stdout:1742: copy_from oid 4 from oid 31 current snap is 169 2026-02-13T20:18:36.839 INFO:tasks.rados.rados.0.trial188.stdout:1743: write oid 33 current snap is 169 2026-02-13T20:18:36.839 INFO:tasks.rados.rados.0.trial188.stdout:1743: seq_num 639 ranges {739673=657763,2076229=663444} 2026-02-13T20:18:36.842 INFO:tasks.rados.rados.0.trial188.stdout:1743: writing trial18843701-33 from 739673 to 1397436 tid 1 2026-02-13T20:18:36.849 INFO:tasks.rados.rados.0.trial188.stdout:1743: writing trial18843701-33 from 2076229 to 2739673 tid 2 2026-02-13T20:18:36.849 INFO:tasks.rados.rados.0.trial188.stdout:1744: read oid 35 snap -1 2026-02-13T20:18:36.849 INFO:tasks.rados.rados.0.trial188.stdout:1744: expect (ObjNum 618 snap 163 seq_num 618) 2026-02-13T20:18:36.849 INFO:tasks.rados.rados.0.trial188.stdout:1745: write oid 7 current snap is 169 2026-02-13T20:18:36.849 INFO:tasks.rados.rados.0.trial188.stdout:1741: finishing rollback tid 0 to trial18843701-13 2026-02-13T20:18:36.849 INFO:tasks.rados.rados.0.trial188.stdout:1741: finishing rollback tid 1 to trial18843701-13 2026-02-13T20:18:36.850 INFO:tasks.rados.rados.0.trial188.stdout:1741: finishing rollback tid 2 to trial18843701-13 2026-02-13T20:18:36.850 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 13 v 735 (ObjNum 578 snap 153 seq_num 578) dirty exists 2026-02-13T20:18:36.850 INFO:tasks.rados.rados.0.trial188.stdout:1745: seq_num 640 ranges {756480=733012,2134711=432549} 2026-02-13T20:18:36.853 INFO:tasks.rados.rados.0.trial188.stdout:1745: writing trial18843701-7 from 756480 to 1489492 tid 1 2026-02-13T20:18:36.858 INFO:tasks.rados.rados.0.trial188.stdout:1745: writing trial18843701-7 from 2134711 to 2567260 tid 2 2026-02-13T20:18:36.858 INFO:tasks.rados.rados.0.trial188.stdout:1741: done (4 left) 2026-02-13T20:18:36.858 INFO:tasks.rados.rados.0.trial188.stdout:1746: snap_create 2026-02-13T20:18:36.865 INFO:tasks.rados.rados.0.trial188.stdout:1742: finishing copy_from racing read to trial18843701-4 2026-02-13T20:18:36.866 INFO:tasks.rados.rados.0.trial188.stdout:1743: finishing write tid 1 to trial18843701-33 2026-02-13T20:18:36.867 INFO:tasks.rados.rados.0.trial188.stdout:1743: finishing write tid 2 to trial18843701-33 2026-02-13T20:18:36.867 INFO:tasks.rados.rados.0.trial188.stdout:1743: finishing write tid 3 to trial18843701-33 2026-02-13T20:18:36.867 INFO:tasks.rados.rados.0.trial188.stdout:1744: expect (ObjNum 618 snap 163 seq_num 618) 2026-02-13T20:18:36.894 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1666310 2026-02-13T20:18:36.935 INFO:tasks.rados.rados.0.trial188.stdout:1743: finishing write tid 4 to trial18843701-33 2026-02-13T20:18:36.935 INFO:tasks.rados.rados.0.trial188.stdout:1743: oid 33 updating version 0 to 650 2026-02-13T20:18:36.935 INFO:tasks.rados.rados.0.trial188.stdout:1743: oid 33 version 650 is already newer than 648 2026-02-13T20:18:36.936 INFO:tasks.rados.rados.0.trial188.stdout:1743: oid 33 version 650 is already newer than 649 2026-02-13T20:18:36.936 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 33 v 650 (ObjNum 639 snap 169 seq_num 639) dirty exists 2026-02-13T20:18:36.936 INFO:tasks.rados.rados.0.trial188.stdout:1743: left oid 33 (ObjNum 639 snap 169 seq_num 639) 2026-02-13T20:18:36.936 INFO:tasks.rados.rados.0.trial188.stdout:1742: finishing copy_from to trial18843701-4 2026-02-13T20:18:36.936 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 4 v 415 (ObjNum 489 snap 127 seq_num 489) dirty exists 2026-02-13T20:18:36.936 INFO:tasks.rados.rados.0.trial188.stdout:1745: finishing write tid 1 to trial18843701-7 2026-02-13T20:18:36.936 INFO:tasks.rados.rados.0.trial188.stdout:1745: finishing write tid 2 to trial18843701-7 2026-02-13T20:18:36.936 INFO:tasks.rados.rados.0.trial188.stdout:1745: finishing write tid 3 to trial18843701-7 2026-02-13T20:18:36.936 INFO:tasks.rados.rados.0.trial188.stdout:1745: finishing write tid 4 to trial18843701-7 2026-02-13T20:18:36.936 INFO:tasks.rados.rados.0.trial188.stdout:1745: oid 7 updating version 0 to 606 2026-02-13T20:18:36.936 INFO:tasks.rados.rados.0.trial188.stdout:1745: oid 7 updating version 606 to 608 2026-02-13T20:18:36.937 INFO:tasks.rados.rados.0.trial188.stdout:1745: oid 7 version 608 is already newer than 607 2026-02-13T20:18:36.937 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 7 v 608 (ObjNum 640 snap 169 seq_num 640) dirty exists 2026-02-13T20:18:36.937 INFO:tasks.rados.rados.0.trial188.stdout:1745: left oid 7 (ObjNum 640 snap 169 seq_num 640) 2026-02-13T20:18:37.702 INFO:tasks.rados.rados.0.trial188.stdout:1742: done (4 left) 2026-02-13T20:18:37.702 INFO:tasks.rados.rados.0.trial188.stdout:1743: done (3 left) 2026-02-13T20:18:37.702 INFO:tasks.rados.rados.0.trial188.stdout:1744: done (2 left) 2026-02-13T20:18:37.702 INFO:tasks.rados.rados.0.trial188.stdout:1745: done (1 left) 2026-02-13T20:18:37.702 INFO:tasks.rados.rados.0.trial188.stdout:1746: done (0 left) 2026-02-13T20:18:37.703 INFO:tasks.rados.rados.0.trial188.stdout:1747: read oid 14 snap -1 2026-02-13T20:18:37.703 INFO:tasks.rados.rados.0.trial188.stdout:1747: expect (ObjNum 633 snap 166 seq_num 633) 2026-02-13T20:18:37.703 INFO:tasks.rados.rados.0.trial188.stdout:1748: write oid 21 current snap is 170 2026-02-13T20:18:37.703 INFO:tasks.rados.rados.0.trial188.stdout:1748: seq_num 641 ranges {773287=408261,1793193=576207} 2026-02-13T20:18:37.706 INFO:tasks.rados.rados.0.trial188.stdout:1748: writing trial18843701-21 from 773287 to 1181548 tid 1 2026-02-13T20:18:37.710 INFO:tasks.rados.rados.0.trial188.stdout:1748: writing trial18843701-21 from 1793193 to 2369400 tid 2 2026-02-13T20:18:37.710 INFO:tasks.rados.rados.0.trial188.stdout:1749: snap_create 2026-02-13T20:18:37.713 INFO:tasks.rados.rados.0.trial188.stdout:1747: expect (ObjNum 633 snap 166 seq_num 633) 2026-02-13T20:18:37.713 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:18:37.767 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 749205 2026-02-13T20:18:37.853 INFO:tasks.rados.rados.0.trial188.stdout:1748: finishing write tid 1 to trial18843701-21 2026-02-13T20:18:37.853 INFO:tasks.rados.rados.0.trial188.stdout:1748: finishing write tid 2 to trial18843701-21 2026-02-13T20:18:37.853 INFO:tasks.rados.rados.0.trial188.stdout:1748: finishing write tid 3 to trial18843701-21 2026-02-13T20:18:37.854 INFO:tasks.rados.rados.0.trial188.stdout:1748: finishing write tid 4 to trial18843701-21 2026-02-13T20:18:37.854 INFO:tasks.rados.rados.0.trial188.stdout:1748: oid 21 updating version 0 to 447 2026-02-13T20:18:37.854 INFO:tasks.rados.rados.0.trial188.stdout:1748: oid 21 updating version 447 to 448 2026-02-13T20:18:37.854 INFO:tasks.rados.rados.0.trial188.stdout:1748: oid 21 updating version 448 to 449 2026-02-13T20:18:37.854 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 21 v 449 (ObjNum 641 snap 170 seq_num 641) dirty exists 2026-02-13T20:18:37.854 INFO:tasks.rados.rados.0.trial188.stdout:1748: left oid 21 (ObjNum 641 snap 170 seq_num 641) 2026-02-13T20:18:38.709 INFO:tasks.rados.rados.0.trial188.stdout:1747: done (2 left) 2026-02-13T20:18:38.710 INFO:tasks.rados.rados.0.trial188.stdout:1748: done (1 left) 2026-02-13T20:18:38.710 INFO:tasks.rados.rados.0.trial188.stdout:1749: done (0 left) 2026-02-13T20:18:38.710 INFO:tasks.rados.rados.0.trial188.stdout:1750: delete oid 32 current snap is 171 2026-02-13T20:18:38.711 INFO:tasks.rados.rados.0.trial188.stdout:1750: done (0 left) 2026-02-13T20:18:38.711 INFO:tasks.rados.rados.0.trial188.stdout:1751: rollback oid 40 current snap is 171 2026-02-13T20:18:38.711 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 40 to 169 2026-02-13T20:18:38.711 INFO:tasks.rados.rados.0.trial188.stdout:1752: read oid 2 snap -1 2026-02-13T20:18:38.711 INFO:tasks.rados.rados.0.trial188.stdout:1752: expect deleted 2026-02-13T20:18:38.711 INFO:tasks.rados.rados.0.trial188.stdout:1753: snap_create 2026-02-13T20:18:38.711 INFO:tasks.rados.rados.0.trial188.stdout:1751: finishing rollback tid 1 to trial18843701-40 2026-02-13T20:18:38.711 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 40 v 0 (ObjNum 289 snap 0 seq_num 0) dirty dne 2026-02-13T20:18:39.710 INFO:tasks.rados.rados.0.trial188.stdout:1751: done (2 left) 2026-02-13T20:18:39.710 INFO:tasks.rados.rados.0.trial188.stdout:1752: done (1 left) 2026-02-13T20:18:39.711 INFO:tasks.rados.rados.0.trial188.stdout:1753: done (0 left) 2026-02-13T20:18:39.711 INFO:tasks.rados.rados.0.trial188.stdout:1754: write (excl) oid 38 current snap is 172 2026-02-13T20:18:39.711 INFO:tasks.rados.rados.0.trial188.stdout:1754: seq_num 643 ranges {406901=558759,1393804=579876,2608396=198505} 2026-02-13T20:18:39.714 INFO:tasks.rados.rados.0.trial188.stdout:1754: writing trial18843701-38 from 406901 to 965660 tid 1 2026-02-13T20:18:39.717 INFO:tasks.rados.rados.0.trial188.stdout:1754: writing trial18843701-38 from 1393804 to 1973680 tid 2 2026-02-13T20:18:39.720 INFO:tasks.rados.rados.0.trial188.stdout:1754: writing trial18843701-38 from 2608396 to 2806901 tid 3 2026-02-13T20:18:39.721 INFO:tasks.rados.rados.0.trial188.stdout:1755: delete oid 27 current snap is 172 2026-02-13T20:18:39.737 INFO:tasks.rados.rados.0.trial188.stdout:1754: finishing write tid 1 to trial18843701-38 2026-02-13T20:18:39.737 INFO:tasks.rados.rados.0.trial188.stdout:1754: finishing write tid 2 to trial18843701-38 2026-02-13T20:18:39.738 INFO:tasks.rados.rados.0.trial188.stdout:1754: finishing write tid 3 to trial18843701-38 2026-02-13T20:18:39.738 INFO:tasks.rados.rados.0.trial188.stdout:1754: finishing write tid 4 to trial18843701-38 2026-02-13T20:18:39.739 INFO:tasks.rados.rados.0.trial188.stdout:1754: finishing write tid 5 to trial18843701-38 2026-02-13T20:18:39.739 INFO:tasks.rados.rados.0.trial188.stdout:1754: oid 38 updating version 0 to 738 2026-02-13T20:18:39.740 INFO:tasks.rados.rados.0.trial188.stdout:1754: oid 38 version 738 is already newer than 736 2026-02-13T20:18:39.740 INFO:tasks.rados.rados.0.trial188.stdout:1754: oid 38 version 738 is already newer than 735 2026-02-13T20:18:39.740 INFO:tasks.rados.rados.0.trial188.stdout:1754: oid 38 version 738 is already newer than 737 2026-02-13T20:18:39.740 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 38 v 738 (ObjNum 643 snap 172 seq_num 643) dirty exists 2026-02-13T20:18:39.740 INFO:tasks.rados.rados.0.trial188.stdout:1754: left oid 38 (ObjNum 643 snap 172 seq_num 643) 2026-02-13T20:18:39.740 INFO:tasks.rados.rados.0.trial188.stdout:1754: done (1 left) 2026-02-13T20:18:39.740 INFO:tasks.rados.rados.0.trial188.stdout:1755: done (0 left) 2026-02-13T20:18:39.740 INFO:tasks.rados.rados.0.trial188.stdout:1756: rollback oid 42 current snap is 172 2026-02-13T20:18:39.740 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 42 to 167 2026-02-13T20:18:39.740 INFO:tasks.rados.rados.0.trial188.stdout:1757: write oid 16 current snap is 172 2026-02-13T20:18:39.741 INFO:tasks.rados.rados.0.trial188.stdout:1757: seq_num 645 ranges {440515=709257,1910768=583545} 2026-02-13T20:18:39.743 INFO:tasks.rados.rados.0.trial188.stdout:1757: writing trial18843701-16 from 440515 to 1149772 tid 1 2026-02-13T20:18:39.748 INFO:tasks.rados.rados.0.trial188.stdout:1757: writing trial18843701-16 from 1910768 to 2494313 tid 2 2026-02-13T20:18:39.748 INFO:tasks.rados.rados.0.trial188.stdout:1758: snap_create 2026-02-13T20:18:39.749 INFO:tasks.rados.rados.0.trial188.stdout:1756: finishing rollback tid 0 to trial18843701-42 2026-02-13T20:18:39.749 INFO:tasks.rados.rados.0.trial188.stdout:1756: finishing rollback tid 1 to trial18843701-42 2026-02-13T20:18:39.749 INFO:tasks.rados.rados.0.trial188.stdout:1756: finishing rollback tid 2 to trial18843701-42 2026-02-13T20:18:39.749 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 42 v 677 (ObjNum 592 snap 154 seq_num 592) dirty exists 2026-02-13T20:18:39.761 INFO:tasks.rados.rados.0.trial188.stdout:1757: finishing write tid 1 to trial18843701-16 2026-02-13T20:18:39.763 INFO:tasks.rados.rados.0.trial188.stdout:1757: finishing write tid 2 to trial18843701-16 2026-02-13T20:18:39.763 INFO:tasks.rados.rados.0.trial188.stdout:1757: finishing write tid 3 to trial18843701-16 2026-02-13T20:18:39.763 INFO:tasks.rados.rados.0.trial188.stdout:1757: finishing write tid 4 to trial18843701-16 2026-02-13T20:18:39.763 INFO:tasks.rados.rados.0.trial188.stdout:1757: oid 16 updating version 0 to 790 2026-02-13T20:18:39.763 INFO:tasks.rados.rados.0.trial188.stdout:1757: oid 16 updating version 790 to 791 2026-02-13T20:18:39.763 INFO:tasks.rados.rados.0.trial188.stdout:1757: oid 16 updating version 791 to 792 2026-02-13T20:18:39.763 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 16 v 792 (ObjNum 645 snap 172 seq_num 645) dirty exists 2026-02-13T20:18:39.764 INFO:tasks.rados.rados.0.trial188.stdout:1757: left oid 16 (ObjNum 645 snap 172 seq_num 645) 2026-02-13T20:18:40.714 INFO:tasks.rados.rados.0.trial188.stdout:1756: done (2 left) 2026-02-13T20:18:40.714 INFO:tasks.rados.rados.0.trial188.stdout:1757: done (1 left) 2026-02-13T20:18:40.714 INFO:tasks.rados.rados.0.trial188.stdout:1758: done (0 left) 2026-02-13T20:18:40.714 INFO:tasks.rados.rados.0.trial188.stdout:1759: copy_from oid 43 from oid 39 current snap is 173 2026-02-13T20:18:40.714 INFO:tasks.rados.rados.0.trial188.stdout:1760: snap_create 2026-02-13T20:18:40.747 INFO:tasks.rados.rados.0.trial188.stdout:1759: finishing copy_from racing read to trial18843701-43 2026-02-13T20:18:40.749 INFO:tasks.rados.rados.0.trial188.stdout:1759: finishing copy_from to trial18843701-43 2026-02-13T20:18:40.749 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 43 v 588 (ObjNum 513 snap 132 seq_num 513) dirty exists 2026-02-13T20:18:41.717 INFO:tasks.rados.rados.0.trial188.stdout:1759: done (1 left) 2026-02-13T20:18:41.717 INFO:tasks.rados.rados.0.trial188.stdout:1760: done (0 left) 2026-02-13T20:18:41.717 INFO:tasks.rados.rados.0.trial188.stdout:1761: delete oid 22 current snap is 174 2026-02-13T20:18:41.719 INFO:tasks.rados.rados.0.trial188.stdout:1761: done (0 left) 2026-02-13T20:18:41.719 INFO:tasks.rados.rados.0.trial188.stdout:1762: snap_remove snap 169 2026-02-13T20:18:42.700 INFO:tasks.rados.rados.0.trial188.stdout:1762: done (0 left) 2026-02-13T20:18:42.701 INFO:tasks.rados.rados.0.trial188.stdout:1763: delete oid 5 current snap is 174 2026-02-13T20:18:42.704 INFO:tasks.rados.rados.0.trial188.stdout:1763: done (0 left) 2026-02-13T20:18:42.705 INFO:tasks.rados.rados.0.trial188.stdout:1764: read oid 15 snap -1 2026-02-13T20:18:42.705 INFO:tasks.rados.rados.0.trial188.stdout:1764: expect deleted 2026-02-13T20:18:42.705 INFO:tasks.rados.rados.0.trial188.stdout:1765: delete oid 7 current snap is 174 2026-02-13T20:18:42.706 INFO:tasks.rados.rados.0.trial188.stdout:1764: done (1 left) 2026-02-13T20:18:42.707 INFO:tasks.rados.rados.0.trial188.stdout:1765: done (0 left) 2026-02-13T20:18:42.707 INFO:tasks.rados.rados.0.trial188.stdout:1766: snap_remove snap 173 2026-02-13T20:18:43.703 INFO:tasks.rados.rados.0.trial188.stdout:1766: done (0 left) 2026-02-13T20:18:43.703 INFO:tasks.rados.rados.0.trial188.stdout:1767: snap_create 2026-02-13T20:18:44.703 INFO:tasks.rados.rados.0.trial188.stdout:1767: done (0 left) 2026-02-13T20:18:44.704 INFO:tasks.rados.rados.0.trial188.stdout:1768: write oid 46 current snap is 175 2026-02-13T20:18:44.704 INFO:tasks.rados.rados.0.trial188.stdout:1768: seq_num 649 ranges {507743=726606,1744696=590883,2772934=134809} 2026-02-13T20:18:44.709 INFO:tasks.rados.rados.0.trial188.stdout:1768: writing trial18843701-46 from 507743 to 1234349 tid 1 2026-02-13T20:18:44.713 INFO:tasks.rados.rados.0.trial188.stdout:1768: writing trial18843701-46 from 1744696 to 2335579 tid 2 2026-02-13T20:18:44.715 INFO:tasks.rados.rados.0.trial188.stdout:1768: writing trial18843701-46 from 2772934 to 2907743 tid 3 2026-02-13T20:18:44.715 INFO:tasks.rados.rados.0.trial188.stdout:1769: read oid 16 snap -1 2026-02-13T20:18:44.715 INFO:tasks.rados.rados.0.trial188.stdout:1769: expect (ObjNum 645 snap 172 seq_num 645) 2026-02-13T20:18:44.715 INFO:tasks.rados.rados.0.trial188.stdout:1770: snap_create 2026-02-13T20:18:44.720 INFO:tasks.rados.rados.0.trial188.stdout:1769: expect (ObjNum 645 snap 172 seq_num 645) 2026-02-13T20:18:44.781 INFO:tasks.rados.rados.0.trial188.stdout:1768: finishing write tid 1 to trial18843701-46 2026-02-13T20:18:44.782 INFO:tasks.rados.rados.0.trial188.stdout:1768: finishing write tid 2 to trial18843701-46 2026-02-13T20:18:44.782 INFO:tasks.rados.rados.0.trial188.stdout:1768: finishing write tid 3 to trial18843701-46 2026-02-13T20:18:44.782 INFO:tasks.rados.rados.0.trial188.stdout:1768: finishing write tid 4 to trial18843701-46 2026-02-13T20:18:44.782 INFO:tasks.rados.rados.0.trial188.stdout:1768: finishing write tid 5 to trial18843701-46 2026-02-13T20:18:44.782 INFO:tasks.rados.rados.0.trial188.stdout:1768: oid 46 updating version 0 to 736 2026-02-13T20:18:44.782 INFO:tasks.rados.rados.0.trial188.stdout:1768: oid 46 updating version 736 to 737 2026-02-13T20:18:44.782 INFO:tasks.rados.rados.0.trial188.stdout:1768: oid 46 version 737 is already newer than 735 2026-02-13T20:18:44.782 INFO:tasks.rados.rados.0.trial188.stdout:1768: oid 46 version 737 is already newer than 734 2026-02-13T20:18:44.782 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 46 v 737 (ObjNum 649 snap 175 seq_num 649) dirty exists 2026-02-13T20:18:44.782 INFO:tasks.rados.rados.0.trial188.stdout:1768: left oid 46 (ObjNum 649 snap 175 seq_num 649) 2026-02-13T20:18:45.706 INFO:tasks.rados.rados.0.trial188.stdout:1768: done (2 left) 2026-02-13T20:18:45.706 INFO:tasks.rados.rados.0.trial188.stdout:1769: done (1 left) 2026-02-13T20:18:45.706 INFO:tasks.rados.rados.0.trial188.stdout:1770: done (0 left) 2026-02-13T20:18:45.706 INFO:tasks.rados.rados.0.trial188.stdout:1771: write (excl) oid 49 current snap is 176 2026-02-13T20:18:45.706 INFO:tasks.rados.rados.0.trial188.stdout:1771: seq_num 650 ranges {524550=401855,1403178=450894,2516710=407840} 2026-02-13T20:18:45.709 INFO:tasks.rados.rados.0.trial188.stdout:1771: writing trial18843701-49 from 524550 to 926405 tid 1 2026-02-13T20:18:45.713 INFO:tasks.rados.rados.0.trial188.stdout:1771: writing trial18843701-49 from 1403178 to 1854072 tid 2 2026-02-13T20:18:45.717 INFO:tasks.rados.rados.0.trial188.stdout:1771: writing trial18843701-49 from 2516710 to 2924550 tid 3 2026-02-13T20:18:45.717 INFO:tasks.rados.rados.0.trial188.stdout:1772: snap_remove snap 168 2026-02-13T20:18:46.709 INFO:tasks.rados.rados.0.trial188.stdout:1772: done (1 left) 2026-02-13T20:18:46.709 INFO:tasks.rados.rados.0.trial188.stdout:1773: delete oid 45 current snap is 176 2026-02-13T20:18:46.709 INFO:tasks.rados.rados.0.trial188.stdout:1771: finishing write tid 1 to trial18843701-49 2026-02-13T20:18:46.709 INFO:tasks.rados.rados.0.trial188.stdout:1771: finishing write tid 2 to trial18843701-49 2026-02-13T20:18:46.709 INFO:tasks.rados.rados.0.trial188.stdout:1771: finishing write tid 3 to trial18843701-49 2026-02-13T20:18:46.709 INFO:tasks.rados.rados.0.trial188.stdout:1771: finishing write tid 4 to trial18843701-49 2026-02-13T20:18:46.709 INFO:tasks.rados.rados.0.trial188.stdout:1771: finishing write tid 5 to trial18843701-49 2026-02-13T20:18:46.709 INFO:tasks.rados.rados.0.trial188.stdout:1771: oid 49 updating version 0 to 747 2026-02-13T20:18:46.709 INFO:tasks.rados.rados.0.trial188.stdout:1771: oid 49 updating version 747 to 749 2026-02-13T20:18:46.709 INFO:tasks.rados.rados.0.trial188.stdout:1771: oid 49 version 749 is already newer than 748 2026-02-13T20:18:46.709 INFO:tasks.rados.rados.0.trial188.stdout:1771: oid 49 version 749 is already newer than 746 2026-02-13T20:18:46.709 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 49 v 749 (ObjNum 650 snap 176 seq_num 650) dirty exists 2026-02-13T20:18:46.709 INFO:tasks.rados.rados.0.trial188.stdout:1771: left oid 49 (ObjNum 650 snap 176 seq_num 650) 2026-02-13T20:18:46.713 INFO:tasks.rados.rados.0.trial188.stdout:1771: done (1 left) 2026-02-13T20:18:46.713 INFO:tasks.rados.rados.0.trial188.stdout:1773: done (0 left) 2026-02-13T20:18:46.713 INFO:tasks.rados.rados.0.trial188.stdout:1774: write (excl) oid 44 current snap is 176 2026-02-13T20:18:46.713 INFO:tasks.rados.rados.0.trial188.stdout:1774: seq_num 652 ranges {558164=552353,1803789=454563,2855203=102961} 2026-02-13T20:18:46.717 INFO:tasks.rados.rados.0.trial188.stdout:1774: writing trial18843701-44 from 558164 to 1110517 tid 1 2026-02-13T20:18:46.721 INFO:tasks.rados.rados.0.trial188.stdout:1774: writing trial18843701-44 from 1803789 to 2258352 tid 2 2026-02-13T20:18:46.724 INFO:tasks.rados.rados.0.trial188.stdout:1774: writing trial18843701-44 from 2855203 to 2958164 tid 3 2026-02-13T20:18:46.724 INFO:tasks.rados.rados.0.trial188.stdout:1775: rollback oid 19 current snap is 176 2026-02-13T20:18:46.724 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 19 to 171 2026-02-13T20:18:46.724 INFO:tasks.rados.rados.0.trial188.stdout:1776: read oid 5 snap -1 2026-02-13T20:18:46.724 INFO:tasks.rados.rados.0.trial188.stdout:1776: expect deleted 2026-02-13T20:18:46.724 INFO:tasks.rados.rados.0.trial188.stdout:1777: snap_remove snap 175 2026-02-13T20:18:47.701 INFO:tasks.rados.rados.0.trial188.stdout:1777: done (3 left) 2026-02-13T20:18:47.701 INFO:tasks.rados.rados.0.trial188.stdout:1778: write oid 32 current snap is 176 2026-02-13T20:18:47.701 INFO:tasks.rados.rados.0.trial188.stdout:1778: seq_num 653 ranges {574971=627602,1862271=598221} 2026-02-13T20:18:47.705 INFO:tasks.rados.rados.0.trial188.stdout:1778: writing trial18843701-32 from 574971 to 1202573 tid 1 2026-02-13T20:18:47.710 INFO:tasks.rados.rados.0.trial188.stdout:1778: writing trial18843701-32 from 1862271 to 2460492 tid 2 2026-02-13T20:18:47.710 INFO:tasks.rados.rados.0.trial188.stdout:1779: copy_from oid 47 from oid 45 current snap is 176 2026-02-13T20:18:47.710 INFO:tasks.rados.rados.0.trial188.stdout:1775: finishing rollback tid 0 to trial18843701-19 2026-02-13T20:18:47.710 INFO:tasks.rados.rados.0.trial188.stdout:1775: finishing rollback tid 1 to trial18843701-19 2026-02-13T20:18:47.710 INFO:tasks.rados.rados.0.trial188.stdout:1775: finishing rollback tid 2 to trial18843701-19 2026-02-13T20:18:47.710 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 19 v 618 (ObjNum 598 snap 159 seq_num 598) dirty exists 2026-02-13T20:18:47.710 INFO:tasks.rados.rados.0.trial188.stdout:1774: finishing write tid 1 to trial18843701-44 2026-02-13T20:18:47.710 INFO:tasks.rados.rados.0.trial188.stdout:1774: finishing write tid 2 to trial18843701-44 2026-02-13T20:18:47.710 INFO:tasks.rados.rados.0.trial188.stdout:1774: finishing write tid 3 to trial18843701-44 2026-02-13T20:18:47.711 INFO:tasks.rados.rados.0.trial188.stdout:1775: done (4 left) 2026-02-13T20:18:47.711 INFO:tasks.rados.rados.0.trial188.stdout:1780: snap_remove snap 172 2026-02-13T20:18:48.711 INFO:tasks.rados.rados.0.trial188.stdout:1780: done (4 left) 2026-02-13T20:18:48.711 INFO:tasks.rados.rados.0.trial188.stdout:1781: read oid 23 snap -1 2026-02-13T20:18:48.711 INFO:tasks.rados.rados.0.trial188.stdout:1781: expect deleted 2026-02-13T20:18:48.712 INFO:tasks.rados.rados.0.trial188.stdout:1782: snap_create 2026-02-13T20:18:48.712 INFO:tasks.rados.rados.0.trial188.stdout:1774: finishing write tid 4 to trial18843701-44 2026-02-13T20:18:48.712 INFO:tasks.rados.rados.0.trial188.stdout:1774: finishing write tid 5 to trial18843701-44 2026-02-13T20:18:48.712 INFO:tasks.rados.rados.0.trial188.stdout:1774: oid 44 updating version 0 to 743 2026-02-13T20:18:48.712 INFO:tasks.rados.rados.0.trial188.stdout:1774: oid 44 version 743 is already newer than 741 2026-02-13T20:18:48.712 INFO:tasks.rados.rados.0.trial188.stdout:1774: oid 44 version 743 is already newer than 742 2026-02-13T20:18:48.712 INFO:tasks.rados.rados.0.trial188.stdout:1774: oid 44 version 743 is already newer than 740 2026-02-13T20:18:48.712 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 44 v 743 (ObjNum 652 snap 176 seq_num 652) dirty exists 2026-02-13T20:18:48.712 INFO:tasks.rados.rados.0.trial188.stdout:1774: left oid 44 (ObjNum 652 snap 176 seq_num 652) 2026-02-13T20:18:48.712 INFO:tasks.rados.rados.0.trial188.stdout:1779: finishing copy_from to trial18843701-47 2026-02-13T20:18:48.712 INFO:tasks.rados.rados.0.trial188.stdout:1779: got expected ENOENT (src dne) 2026-02-13T20:18:48.712 INFO:tasks.rados.rados.0.trial188.stdout:1779: finishing copy_from racing read to trial18843701-47 2026-02-13T20:18:48.712 INFO:tasks.rados.rados.0.trial188.stdout:1778: finishing write tid 1 to trial18843701-32 2026-02-13T20:18:48.712 INFO:tasks.rados.rados.0.trial188.stdout:1778: finishing write tid 2 to trial18843701-32 2026-02-13T20:18:48.712 INFO:tasks.rados.rados.0.trial188.stdout:1778: finishing write tid 3 to trial18843701-32 2026-02-13T20:18:48.712 INFO:tasks.rados.rados.0.trial188.stdout:1778: finishing write tid 4 to trial18843701-32 2026-02-13T20:18:48.712 INFO:tasks.rados.rados.0.trial188.stdout:1778: oid 32 updating version 0 to 740 2026-02-13T20:18:48.712 INFO:tasks.rados.rados.0.trial188.stdout:1778: oid 32 version 740 is already newer than 739 2026-02-13T20:18:48.712 INFO:tasks.rados.rados.0.trial188.stdout:1778: oid 32 version 740 is already newer than 738 2026-02-13T20:18:48.712 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 32 v 740 (ObjNum 653 snap 176 seq_num 653) dirty exists 2026-02-13T20:18:48.713 INFO:tasks.rados.rados.0.trial188.stdout:1778: left oid 32 (ObjNum 653 snap 176 seq_num 653) 2026-02-13T20:18:49.714 INFO:tasks.rados.rados.0.trial188.stdout:1774: done (5 left) 2026-02-13T20:18:49.714 INFO:tasks.rados.rados.0.trial188.stdout:1776: done (4 left) 2026-02-13T20:18:49.714 INFO:tasks.rados.rados.0.trial188.stdout:1778: done (3 left) 2026-02-13T20:18:49.714 INFO:tasks.rados.rados.0.trial188.stdout:1779: done (2 left) 2026-02-13T20:18:49.714 INFO:tasks.rados.rados.0.trial188.stdout:1781: done (1 left) 2026-02-13T20:18:49.714 INFO:tasks.rados.rados.0.trial188.stdout:1782: done (0 left) 2026-02-13T20:18:49.715 INFO:tasks.rados.rados.0.trial188.stdout:1783: rollback oid 26 current snap is 177 2026-02-13T20:18:49.715 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 26 to 176 2026-02-13T20:18:49.715 INFO:tasks.rados.rados.0.trial188.stdout:1784: delete oid 17 current snap is 177 2026-02-13T20:18:49.716 INFO:tasks.rados.rados.0.trial188.stdout:1784: done (1 left) 2026-02-13T20:18:49.716 INFO:tasks.rados.rados.0.trial188.stdout:1785: delete oid 18 current snap is 177 2026-02-13T20:18:49.717 INFO:tasks.rados.rados.0.trial188.stdout:1785: done (1 left) 2026-02-13T20:18:49.717 INFO:tasks.rados.rados.0.trial188.stdout:1786: snap_remove snap 174 2026-02-13T20:18:50.717 INFO:tasks.rados.rados.0.trial188.stdout:1786: done (1 left) 2026-02-13T20:18:50.717 INFO:tasks.rados.rados.0.trial188.stdout:1787: delete oid 46 current snap is 177 2026-02-13T20:18:50.718 INFO:tasks.rados.rados.0.trial188.stdout:1783: finishing rollback tid 0 to trial18843701-26 2026-02-13T20:18:50.718 INFO:tasks.rados.rados.0.trial188.stdout:1783: finishing rollback tid 1 to trial18843701-26 2026-02-13T20:18:50.718 INFO:tasks.rados.rados.0.trial188.stdout:1783: finishing rollback tid 2 to trial18843701-26 2026-02-13T20:18:50.718 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 26 v 618 (ObjNum 583 snap 153 seq_num 583) dirty exists 2026-02-13T20:18:50.718 INFO:tasks.rados.rados.0.trial188.stdout:1783: done (1 left) 2026-02-13T20:18:50.718 INFO:tasks.rados.rados.0.trial188.stdout:1787: done (0 left) 2026-02-13T20:18:50.719 INFO:tasks.rados.rados.0.trial188.stdout:1788: delete oid 49 current snap is 177 2026-02-13T20:18:50.721 INFO:tasks.rados.rados.0.trial188.stdout:1788: done (0 left) 2026-02-13T20:18:50.721 INFO:tasks.rados.rados.0.trial188.stdout:1789: snap_create 2026-02-13T20:18:51.718 INFO:tasks.rados.rados.0.trial188.stdout:1789: done (0 left) 2026-02-13T20:18:51.718 INFO:tasks.rados.rados.0.trial188.stdout:1790: delete oid 11 current snap is 178 2026-02-13T20:18:51.722 INFO:tasks.rados.rados.0.trial188.stdout:1790: done (0 left) 2026-02-13T20:18:51.722 INFO:tasks.rados.rados.0.trial188.stdout:1791: write oid 39 current snap is 178 2026-02-13T20:18:51.722 INFO:tasks.rados.rados.0.trial188.stdout:1791: seq_num 659 ranges {675813=795449,2096810=609228} 2026-02-13T20:18:51.728 INFO:tasks.rados.rados.0.trial188.stdout:1791: writing trial18843701-39 from 675813 to 1471262 tid 1 2026-02-13T20:18:51.733 INFO:tasks.rados.rados.0.trial188.stdout:1791: writing trial18843701-39 from 2096810 to 2706038 tid 2 2026-02-13T20:18:51.733 INFO:tasks.rados.rados.0.trial188.stdout:1792: write oid 27 current snap is 178 2026-02-13T20:18:51.733 INFO:tasks.rados.rados.0.trial188.stdout:1792: seq_num 660 ranges {692620=470698,1755292=752886} 2026-02-13T20:18:51.737 INFO:tasks.rados.rados.0.trial188.stdout:1792: writing trial18843701-27 from 692620 to 1163318 tid 1 2026-02-13T20:18:51.743 INFO:tasks.rados.rados.0.trial188.stdout:1792: writing trial18843701-27 from 1755292 to 2508178 tid 2 2026-02-13T20:18:51.743 INFO:tasks.rados.rados.0.trial188.stdout:1793: delete oid 42 current snap is 178 2026-02-13T20:18:51.749 INFO:tasks.rados.rados.0.trial188.stdout:1791: finishing write tid 1 to trial18843701-39 2026-02-13T20:18:51.749 INFO:tasks.rados.rados.0.trial188.stdout:1791: finishing write tid 2 to trial18843701-39 2026-02-13T20:18:51.749 INFO:tasks.rados.rados.0.trial188.stdout:1791: finishing write tid 3 to trial18843701-39 2026-02-13T20:18:51.749 INFO:tasks.rados.rados.0.trial188.stdout:1791: finishing write tid 4 to trial18843701-39 2026-02-13T20:18:51.749 INFO:tasks.rados.rados.0.trial188.stdout:1791: oid 39 updating version 0 to 630 2026-02-13T20:18:51.749 INFO:tasks.rados.rados.0.trial188.stdout:1791: oid 39 version 630 is already newer than 628 2026-02-13T20:18:51.749 INFO:tasks.rados.rados.0.trial188.stdout:1791: oid 39 version 630 is already newer than 629 2026-02-13T20:18:51.749 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 39 v 630 (ObjNum 659 snap 178 seq_num 659) dirty exists 2026-02-13T20:18:51.749 INFO:tasks.rados.rados.0.trial188.stdout:1791: left oid 39 (ObjNum 659 snap 178 seq_num 659) 2026-02-13T20:18:51.755 INFO:tasks.rados.rados.0.trial188.stdout:1792: finishing write tid 1 to trial18843701-27 2026-02-13T20:18:51.756 INFO:tasks.rados.rados.0.trial188.stdout:1792: finishing write tid 2 to trial18843701-27 2026-02-13T20:18:51.756 INFO:tasks.rados.rados.0.trial188.stdout:1792: finishing write tid 3 to trial18843701-27 2026-02-13T20:18:51.756 INFO:tasks.rados.rados.0.trial188.stdout:1792: finishing write tid 4 to trial18843701-27 2026-02-13T20:18:51.756 INFO:tasks.rados.rados.0.trial188.stdout:1792: oid 27 updating version 0 to 765 2026-02-13T20:18:51.756 INFO:tasks.rados.rados.0.trial188.stdout:1792: oid 27 updating version 765 to 766 2026-02-13T20:18:51.756 INFO:tasks.rados.rados.0.trial188.stdout:1792: oid 27 version 766 is already newer than 764 2026-02-13T20:18:51.756 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 27 v 766 (ObjNum 660 snap 178 seq_num 660) dirty exists 2026-02-13T20:18:51.756 INFO:tasks.rados.rados.0.trial188.stdout:1792: left oid 27 (ObjNum 660 snap 178 seq_num 660) 2026-02-13T20:18:51.757 INFO:tasks.rados.rados.0.trial188.stdout:1791: done (2 left) 2026-02-13T20:18:51.757 INFO:tasks.rados.rados.0.trial188.stdout:1792: done (1 left) 2026-02-13T20:18:51.757 INFO:tasks.rados.rados.0.trial188.stdout:1793: done (0 left) 2026-02-13T20:18:51.757 INFO:tasks.rados.rados.0.trial188.stdout:1794: read oid 47 snap -1 2026-02-13T20:18:51.757 INFO:tasks.rados.rados.0.trial188.stdout:1794: expect (ObjNum 489 snap 127 seq_num 489) 2026-02-13T20:18:51.757 INFO:tasks.rados.rados.0.trial188.stdout:1795: snap_create 2026-02-13T20:18:51.758 INFO:tasks.rados.rados.0.trial188.stdout:1794: expect (ObjNum 489 snap 127 seq_num 489) 2026-02-13T20:18:51.758 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:18:51.785 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:18:52.702 INFO:tasks.rados.rados.0.trial188.stdout:1794: done (1 left) 2026-02-13T20:18:52.702 INFO:tasks.rados.rados.0.trial188.stdout:1795: done (0 left) 2026-02-13T20:18:52.703 INFO:tasks.rados.rados.0.trial188.stdout:1796: write oid 37 current snap is 179 2026-02-13T20:18:52.703 INFO:tasks.rados.rados.0.trial188.stdout:1796: seq_num 662 ranges {726234=737549,1988609=756555} 2026-02-13T20:18:52.708 INFO:tasks.rados.rados.0.trial188.stdout:1796: writing trial18843701-37 from 726234 to 1463783 tid 1 2026-02-13T20:18:52.713 INFO:tasks.rados.rados.0.trial188.stdout:1796: writing trial18843701-37 from 1988609 to 2745164 tid 2 2026-02-13T20:18:52.713 INFO:tasks.rados.rados.0.trial188.stdout:1797: rollback oid 29 current snap is 179 2026-02-13T20:18:52.713 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 29 to 171 2026-02-13T20:18:52.713 INFO:tasks.rados.rados.0.trial188.stdout:1798: read oid 48 snap -1 2026-02-13T20:18:52.714 INFO:tasks.rados.rados.0.trial188.stdout:1798: expect (ObjNum 578 snap 153 seq_num 578) 2026-02-13T20:18:52.714 INFO:tasks.rados.rados.0.trial188.stdout:1799: snap_remove snap 176 2026-02-13T20:18:53.705 INFO:tasks.rados.rados.0.trial188.stdout:1799: done (3 left) 2026-02-13T20:18:53.705 INFO:tasks.rados.rados.0.trial188.stdout:1800: copy_from oid 30 from oid 15 current snap is 179 2026-02-13T20:18:53.705 INFO:tasks.rados.rados.0.trial188.stdout:1797: finishing rollback tid 0 to trial18843701-29 2026-02-13T20:18:53.705 INFO:tasks.rados.rados.0.trial188.stdout:1797: finishing rollback tid 1 to trial18843701-29 2026-02-13T20:18:53.705 INFO:tasks.rados.rados.0.trial188.stdout:1797: finishing rollback tid 2 to trial18843701-29 2026-02-13T20:18:53.705 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 29 v 634 (ObjNum 627 snap 166 seq_num 627) dirty exists 2026-02-13T20:18:53.706 INFO:tasks.rados.rados.0.trial188.stdout:1798: expect (ObjNum 578 snap 153 seq_num 578) 2026-02-13T20:18:53.768 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1992286 2026-02-13T20:18:53.822 INFO:tasks.rados.rados.0.trial188.stdout:1796: finishing write tid 1 to trial18843701-37 2026-02-13T20:18:53.822 INFO:tasks.rados.rados.0.trial188.stdout:1797: done (3 left) 2026-02-13T20:18:53.823 INFO:tasks.rados.rados.0.trial188.stdout:1798: done (2 left) 2026-02-13T20:18:53.823 INFO:tasks.rados.rados.0.trial188.stdout:1801: snap_remove snap 171 2026-02-13T20:18:54.724 INFO:tasks.rados.rados.0.trial188.stdout:1801: done (2 left) 2026-02-13T20:18:54.724 INFO:tasks.rados.rados.0.trial188.stdout:1802: rollback oid 21 current snap is 179 2026-02-13T20:18:54.724 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 21 to 167 2026-02-13T20:18:54.724 INFO:tasks.rados.rados.0.trial188.stdout:1796: finishing write tid 2 to trial18843701-37 2026-02-13T20:18:54.724 INFO:tasks.rados.rados.0.trial188.stdout:1796: finishing write tid 3 to trial18843701-37 2026-02-13T20:18:54.725 INFO:tasks.rados.rados.0.trial188.stdout:1796: finishing write tid 4 to trial18843701-37 2026-02-13T20:18:54.725 INFO:tasks.rados.rados.0.trial188.stdout:1796: oid 37 updating version 0 to 673 2026-02-13T20:18:54.725 INFO:tasks.rados.rados.0.trial188.stdout:1796: oid 37 updating version 673 to 675 2026-02-13T20:18:54.725 INFO:tasks.rados.rados.0.trial188.stdout:1796: oid 37 version 675 is already newer than 674 2026-02-13T20:18:54.725 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 37 v 675 (ObjNum 662 snap 179 seq_num 662) dirty exists 2026-02-13T20:18:54.725 INFO:tasks.rados.rados.0.trial188.stdout:1796: left oid 37 (ObjNum 662 snap 179 seq_num 662) 2026-02-13T20:18:54.725 INFO:tasks.rados.rados.0.trial188.stdout:1800: finishing copy_from to trial18843701-30 2026-02-13T20:18:54.725 INFO:tasks.rados.rados.0.trial188.stdout:1800: got expected ENOENT (src dne) 2026-02-13T20:18:54.725 INFO:tasks.rados.rados.0.trial188.stdout:1800: finishing copy_from racing read to trial18843701-30 2026-02-13T20:18:54.725 INFO:tasks.rados.rados.0.trial188.stdout:1796: done (2 left) 2026-02-13T20:18:54.726 INFO:tasks.rados.rados.0.trial188.stdout:1800: done (1 left) 2026-02-13T20:18:54.726 INFO:tasks.rados.rados.0.trial188.stdout:1803: snap_remove snap 166 2026-02-13T20:18:55.724 INFO:tasks.rados.rados.0.trial188.stdout:1803: done (1 left) 2026-02-13T20:18:55.724 INFO:tasks.rados.rados.0.trial188.stdout:1804: read oid 40 snap -1 2026-02-13T20:18:55.725 INFO:tasks.rados.rados.0.trial188.stdout:1804: expect deleted 2026-02-13T20:18:55.725 INFO:tasks.rados.rados.0.trial188.stdout:1805: rollback oid 1 current snap is 179 2026-02-13T20:18:55.725 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 1 to 177 2026-02-13T20:18:55.725 INFO:tasks.rados.rados.0.trial188.stdout:1802: finishing rollback tid 0 to trial18843701-21 2026-02-13T20:18:55.725 INFO:tasks.rados.rados.0.trial188.stdout:1802: finishing rollback tid 1 to trial18843701-21 2026-02-13T20:18:55.725 INFO:tasks.rados.rados.0.trial188.stdout:1802: finishing rollback tid 2 to trial18843701-21 2026-02-13T20:18:55.725 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 21 v 452 (ObjNum 588 snap 153 seq_num 588) dirty exists 2026-02-13T20:18:55.725 INFO:tasks.rados.rados.0.trial188.stdout:1802: done (2 left) 2026-02-13T20:18:55.725 INFO:tasks.rados.rados.0.trial188.stdout:1806: rollback oid 14 current snap is 179 2026-02-13T20:18:55.725 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 14 to 177 2026-02-13T20:18:55.725 INFO:tasks.rados.rados.0.trial188.stdout:1807: read oid 32 snap -1 2026-02-13T20:18:55.725 INFO:tasks.rados.rados.0.trial188.stdout:1807: expect (ObjNum 653 snap 176 seq_num 653) 2026-02-13T20:18:55.725 INFO:tasks.rados.rados.0.trial188.stdout:1808: read oid 12 snap -1 2026-02-13T20:18:55.725 INFO:tasks.rados.rados.0.trial188.stdout:1808: expect (ObjNum 622 snap 166 seq_num 622) 2026-02-13T20:18:55.725 INFO:tasks.rados.rados.0.trial188.stdout:1809: copy_from oid 43 from oid 19 current snap is 179 2026-02-13T20:18:55.725 INFO:tasks.rados.rados.0.trial188.stdout:1810: rollback oid 23 current snap is 179 2026-02-13T20:18:55.725 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 23 to 178 2026-02-13T20:18:55.725 INFO:tasks.rados.rados.0.trial188.stdout:1811: write oid 34 current snap is 179 2026-02-13T20:18:55.725 INFO:tasks.rados.rados.0.trial188.stdout:1811: seq_num 663 ranges {743041=412798,1930738=616566,3040503=102538} 2026-02-13T20:18:55.729 INFO:tasks.rados.rados.0.trial188.stdout:1811: writing trial18843701-34 from 743041 to 1155839 tid 1 2026-02-13T20:18:55.734 INFO:tasks.rados.rados.0.trial188.stdout:1811: writing trial18843701-34 from 1930738 to 2547304 tid 2 2026-02-13T20:18:55.736 INFO:tasks.rados.rados.0.trial188.stdout:1811: writing trial18843701-34 from 3040503 to 3143041 tid 3 2026-02-13T20:18:55.736 INFO:tasks.rados.rados.0.trial188.stdout:1812: copy_from oid 4 from oid 44 current snap is 179 2026-02-13T20:18:55.736 INFO:tasks.rados.rados.0.trial188.stdout:1805: finishing rollback tid 1 to trial18843701-1 2026-02-13T20:18:55.736 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 1 v 0 (ObjNum 129 snap 0 seq_num 13835824) dirty dne 2026-02-13T20:18:55.736 INFO:tasks.rados.rados.0.trial188.stdout:1806: finishing rollback tid 0 to trial18843701-14 2026-02-13T20:18:55.736 INFO:tasks.rados.rados.0.trial188.stdout:1807: expect (ObjNum 653 snap 176 seq_num 653) 2026-02-13T20:18:55.759 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2728953 2026-02-13T20:18:55.767 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1335153 2026-02-13T20:18:55.782 INFO:tasks.rados.rados.0.trial188.stdout:1806: finishing rollback tid 1 to trial18843701-14 2026-02-13T20:18:55.782 INFO:tasks.rados.rados.0.trial188.stdout:1806: finishing rollback tid 2 to trial18843701-14 2026-02-13T20:18:55.782 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 14 v 621 (ObjNum 633 snap 166 seq_num 633) dirty exists 2026-02-13T20:18:55.782 INFO:tasks.rados.rados.0.trial188.stdout:1810: finishing rollback tid 1 to trial18843701-23 2026-02-13T20:18:55.782 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 23 v 0 (ObjNum 881 snap 0 seq_num 16197285) dirty dne 2026-02-13T20:18:55.782 INFO:tasks.rados.rados.0.trial188.stdout:1808: expect (ObjNum 622 snap 166 seq_num 622) 2026-02-13T20:18:55.782 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:18:55.816 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1667473 2026-02-13T20:18:55.831 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1101055 2026-02-13T20:18:55.847 INFO:tasks.rados.rados.0.trial188.stdout:1811: finishing write tid 1 to trial18843701-34 2026-02-13T20:18:55.848 INFO:tasks.rados.rados.0.trial188.stdout:1811: finishing write tid 2 to trial18843701-34 2026-02-13T20:18:55.848 INFO:tasks.rados.rados.0.trial188.stdout:1811: finishing write tid 3 to trial18843701-34 2026-02-13T20:18:55.848 INFO:tasks.rados.rados.0.trial188.stdout:1804: done (8 left) 2026-02-13T20:18:55.848 INFO:tasks.rados.rados.0.trial188.stdout:1805: done (7 left) 2026-02-13T20:18:55.848 INFO:tasks.rados.rados.0.trial188.stdout:1806: done (6 left) 2026-02-13T20:18:55.848 INFO:tasks.rados.rados.0.trial188.stdout:1807: done (5 left) 2026-02-13T20:18:55.848 INFO:tasks.rados.rados.0.trial188.stdout:1808: done (4 left) 2026-02-13T20:18:55.848 INFO:tasks.rados.rados.0.trial188.stdout:1810: done (3 left) 2026-02-13T20:18:55.848 INFO:tasks.rados.rados.0.trial188.stdout:1813: write (excl) oid 29 current snap is 179 2026-02-13T20:18:55.848 INFO:tasks.rados.rados.0.trial188.stdout:1811: finishing write tid 4 to trial18843701-34 2026-02-13T20:18:55.849 INFO:tasks.rados.rados.0.trial188.stdout:1811: finishing write tid 5 to trial18843701-34 2026-02-13T20:18:55.849 INFO:tasks.rados.rados.0.trial188.stdout:1811: oid 34 updating version 0 to 679 2026-02-13T20:18:55.849 INFO:tasks.rados.rados.0.trial188.stdout:1811: oid 34 updating version 679 to 680 2026-02-13T20:18:55.849 INFO:tasks.rados.rados.0.trial188.stdout:1811: oid 34 updating version 680 to 681 2026-02-13T20:18:55.849 INFO:tasks.rados.rados.0.trial188.stdout:1811: oid 34 version 681 is already newer than 676 2026-02-13T20:18:55.849 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 34 v 681 (ObjNum 663 snap 179 seq_num 663) dirty exists 2026-02-13T20:18:55.849 INFO:tasks.rados.rados.0.trial188.stdout:1811: left oid 34 (ObjNum 663 snap 179 seq_num 663) 2026-02-13T20:18:55.849 INFO:tasks.rados.rados.0.trial188.stdout:1809: finishing copy_from racing read to trial18843701-43 2026-02-13T20:18:55.849 INFO:tasks.rados.rados.0.trial188.stdout:1809: finishing copy_from to trial18843701-43 2026-02-13T20:18:55.849 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 43 v 618 (ObjNum 598 snap 159 seq_num 598) dirty exists 2026-02-13T20:18:55.849 INFO:tasks.rados.rados.0.trial188.stdout:1812: finishing copy_from racing read to trial18843701-4 2026-02-13T20:18:55.849 INFO:tasks.rados.rados.0.trial188.stdout:1813: seq_num 664 ranges {759848=488047,1989220=760224} 2026-02-13T20:18:55.851 INFO:tasks.rados.rados.0.trial188.stdout:1813: writing trial18843701-29 from 759848 to 1247895 tid 1 2026-02-13T20:18:55.857 INFO:tasks.rados.rados.0.trial188.stdout:1813: writing trial18843701-29 from 1989220 to 2749444 tid 2 2026-02-13T20:18:55.857 INFO:tasks.rados.rados.0.trial188.stdout:1809: done (3 left) 2026-02-13T20:18:55.857 INFO:tasks.rados.rados.0.trial188.stdout:1811: done (2 left) 2026-02-13T20:18:55.858 INFO:tasks.rados.rados.0.trial188.stdout:1814: write (excl) oid 46 current snap is 179 2026-02-13T20:18:55.858 INFO:tasks.rados.rados.0.trial188.stdout:1814: seq_num 665 ranges {776655=563296,2047702=620235,3095349=81306} 2026-02-13T20:18:55.862 INFO:tasks.rados.rados.0.trial188.stdout:1814: writing trial18843701-46 from 776655 to 1339951 tid 1 2026-02-13T20:18:55.867 INFO:tasks.rados.rados.0.trial188.stdout:1814: writing trial18843701-46 from 2047702 to 2667937 tid 2 2026-02-13T20:18:55.869 INFO:tasks.rados.rados.0.trial188.stdout:1814: writing trial18843701-46 from 3095349 to 3176655 tid 3 2026-02-13T20:18:55.869 INFO:tasks.rados.rados.0.trial188.stdout:1815: read oid 10 snap -1 2026-02-13T20:18:55.870 INFO:tasks.rados.rados.0.trial188.stdout:1815: expect (ObjNum 596 snap 158 seq_num 596) 2026-02-13T20:18:55.870 INFO:tasks.rados.rados.0.trial188.stdout:1816: snap_create 2026-02-13T20:18:55.870 INFO:tasks.rados.rados.0.trial188.stdout:1812: finishing copy_from to trial18843701-4 2026-02-13T20:18:55.870 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 4 v 743 (ObjNum 652 snap 176 seq_num 652) dirty exists 2026-02-13T20:18:55.870 INFO:tasks.rados.rados.0.trial188.stdout:1813: finishing write tid 1 to trial18843701-29 2026-02-13T20:18:55.873 INFO:tasks.rados.rados.0.trial188.stdout:1813: finishing write tid 2 to trial18843701-29 2026-02-13T20:18:55.874 INFO:tasks.rados.rados.0.trial188.stdout:1813: finishing write tid 3 to trial18843701-29 2026-02-13T20:18:55.874 INFO:tasks.rados.rados.0.trial188.stdout:1815: expect (ObjNum 596 snap 158 seq_num 596) 2026-02-13T20:18:55.905 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 340120 2026-02-13T20:18:55.940 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1534290 2026-02-13T20:18:55.959 INFO:tasks.rados.rados.0.trial188.stdout:1813: finishing write tid 4 to trial18843701-29 2026-02-13T20:18:55.959 INFO:tasks.rados.rados.0.trial188.stdout:1813: oid 29 updating version 0 to 656 2026-02-13T20:18:55.960 INFO:tasks.rados.rados.0.trial188.stdout:1813: oid 29 version 656 is already newer than 655 2026-02-13T20:18:55.960 INFO:tasks.rados.rados.0.trial188.stdout:1813: oid 29 updating version 656 to 657 2026-02-13T20:18:55.960 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 29 v 657 (ObjNum 664 snap 179 seq_num 664) dirty exists 2026-02-13T20:18:55.960 INFO:tasks.rados.rados.0.trial188.stdout:1813: left oid 29 (ObjNum 664 snap 179 seq_num 664) 2026-02-13T20:18:55.960 INFO:tasks.rados.rados.0.trial188.stdout:1814: finishing write tid 1 to trial18843701-46 2026-02-13T20:18:55.960 INFO:tasks.rados.rados.0.trial188.stdout:1814: finishing write tid 2 to trial18843701-46 2026-02-13T20:18:55.960 INFO:tasks.rados.rados.0.trial188.stdout:1814: finishing write tid 3 to trial18843701-46 2026-02-13T20:18:55.960 INFO:tasks.rados.rados.0.trial188.stdout:1814: finishing write tid 4 to trial18843701-46 2026-02-13T20:18:55.960 INFO:tasks.rados.rados.0.trial188.stdout:1814: finishing write tid 5 to trial18843701-46 2026-02-13T20:18:55.960 INFO:tasks.rados.rados.0.trial188.stdout:1814: oid 46 updating version 0 to 744 2026-02-13T20:18:55.960 INFO:tasks.rados.rados.0.trial188.stdout:1814: oid 46 version 744 is already newer than 743 2026-02-13T20:18:55.960 INFO:tasks.rados.rados.0.trial188.stdout:1814: oid 46 version 744 is already newer than 742 2026-02-13T20:18:55.960 INFO:tasks.rados.rados.0.trial188.stdout:1814: oid 46 updating version 744 to 745 2026-02-13T20:18:55.960 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 46 v 745 (ObjNum 665 snap 179 seq_num 665) dirty exists 2026-02-13T20:18:55.960 INFO:tasks.rados.rados.0.trial188.stdout:1814: left oid 46 (ObjNum 665 snap 179 seq_num 665) 2026-02-13T20:18:56.729 INFO:tasks.rados.rados.0.trial188.stdout:1812: done (4 left) 2026-02-13T20:18:56.729 INFO:tasks.rados.rados.0.trial188.stdout:1813: done (3 left) 2026-02-13T20:18:56.729 INFO:tasks.rados.rados.0.trial188.stdout:1814: done (2 left) 2026-02-13T20:18:56.729 INFO:tasks.rados.rados.0.trial188.stdout:1815: done (1 left) 2026-02-13T20:18:56.729 INFO:tasks.rados.rados.0.trial188.stdout:1816: done (0 left) 2026-02-13T20:18:56.729 INFO:tasks.rados.rados.0.trial188.stdout:1817: write oid 38 current snap is 180 2026-02-13T20:18:56.729 INFO:tasks.rados.rados.0.trial188.stdout:1817: seq_num 666 ranges {793462=638545,2106184=763893} 2026-02-13T20:18:56.734 INFO:tasks.rados.rados.0.trial188.stdout:1817: writing trial18843701-38 from 793462 to 1432007 tid 1 2026-02-13T20:18:56.740 INFO:tasks.rados.rados.0.trial188.stdout:1817: writing trial18843701-38 from 2106184 to 2870077 tid 2 2026-02-13T20:18:56.740 INFO:tasks.rados.rados.0.trial188.stdout:1818: snap_create 2026-02-13T20:18:56.758 INFO:tasks.rados.rados.0.trial188.stdout:1817: finishing write tid 1 to trial18843701-38 2026-02-13T20:18:56.758 INFO:tasks.rados.rados.0.trial188.stdout:1817: finishing write tid 2 to trial18843701-38 2026-02-13T20:18:56.758 INFO:tasks.rados.rados.0.trial188.stdout:1817: finishing write tid 3 to trial18843701-38 2026-02-13T20:18:56.758 INFO:tasks.rados.rados.0.trial188.stdout:1817: finishing write tid 4 to trial18843701-38 2026-02-13T20:18:56.758 INFO:tasks.rados.rados.0.trial188.stdout:1817: oid 38 updating version 0 to 782 2026-02-13T20:18:56.758 INFO:tasks.rados.rados.0.trial188.stdout:1817: oid 38 updating version 782 to 783 2026-02-13T20:18:56.758 INFO:tasks.rados.rados.0.trial188.stdout:1817: oid 38 updating version 783 to 784 2026-02-13T20:18:56.758 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 38 v 784 (ObjNum 666 snap 180 seq_num 666) dirty exists 2026-02-13T20:18:56.758 INFO:tasks.rados.rados.0.trial188.stdout:1817: left oid 38 (ObjNum 666 snap 180 seq_num 666) 2026-02-13T20:18:57.704 INFO:tasks.rados.rados.0.trial188.stdout:1817: done (1 left) 2026-02-13T20:18:57.704 INFO:tasks.rados.rados.0.trial188.stdout:1818: done (0 left) 2026-02-13T20:18:57.704 INFO:tasks.rados.rados.0.trial188.stdout:1819: read oid 35 snap -1 2026-02-13T20:18:57.704 INFO:tasks.rados.rados.0.trial188.stdout:1819: expect (ObjNum 618 snap 163 seq_num 618) 2026-02-13T20:18:57.704 INFO:tasks.rados.rados.0.trial188.stdout:1820: read oid 10 snap -1 2026-02-13T20:18:57.704 INFO:tasks.rados.rados.0.trial188.stdout:1820: expect (ObjNum 596 snap 158 seq_num 596) 2026-02-13T20:18:57.704 INFO:tasks.rados.rados.0.trial188.stdout:1821: snap_create 2026-02-13T20:18:57.708 INFO:tasks.rados.rados.0.trial188.stdout:1819: expect (ObjNum 618 snap 163 seq_num 618) 2026-02-13T20:18:57.729 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:18:57.754 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 599151 2026-02-13T20:18:57.776 INFO:tasks.rados.rados.0.trial188.stdout:1820: expect (ObjNum 596 snap 158 seq_num 596) 2026-02-13T20:18:57.812 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1532833 2026-02-13T20:18:58.704 INFO:tasks.rados.rados.0.trial188.stdout:1819: done (2 left) 2026-02-13T20:18:58.704 INFO:tasks.rados.rados.0.trial188.stdout:1820: done (1 left) 2026-02-13T20:18:58.704 INFO:tasks.rados.rados.0.trial188.stdout:1821: done (0 left) 2026-02-13T20:18:58.704 INFO:tasks.rados.rados.0.trial188.stdout:1822: delete oid 26 current snap is 182 2026-02-13T20:18:58.707 INFO:tasks.rados.rados.0.trial188.stdout:1822: done (0 left) 2026-02-13T20:18:58.707 INFO:tasks.rados.rados.0.trial188.stdout:1823: copy_from oid 13 from oid 35 current snap is 182 2026-02-13T20:18:58.707 INFO:tasks.rados.rados.0.trial188.stdout:1824: snap_remove snap 170 2026-02-13T20:18:59.707 INFO:tasks.rados.rados.0.trial188.stdout:1824: done (1 left) 2026-02-13T20:18:59.707 INFO:tasks.rados.rados.0.trial188.stdout:1825: write (excl) oid 14 current snap is 182 2026-02-13T20:18:59.707 INFO:tasks.rados.rados.0.trial188.stdout:1823: finishing copy_from racing read to trial18843701-13 2026-02-13T20:18:59.707 INFO:tasks.rados.rados.0.trial188.stdout:1825: seq_num 668 ranges {427076=789043,1706795=767562,2944912=282164} 2026-02-13T20:18:59.711 INFO:tasks.rados.rados.0.trial188.stdout:1825: writing trial18843701-14 from 427076 to 1216119 tid 1 2026-02-13T20:18:59.716 INFO:tasks.rados.rados.0.trial188.stdout:1825: writing trial18843701-14 from 1706795 to 2474357 tid 2 2026-02-13T20:18:59.719 INFO:tasks.rados.rados.0.trial188.stdout:1825: writing trial18843701-14 from 2944912 to 3227076 tid 3 2026-02-13T20:18:59.719 INFO:tasks.rados.rados.0.trial188.stdout:1826: snap_create 2026-02-13T20:18:59.719 INFO:tasks.rados.rados.0.trial188.stdout:1823: finishing copy_from to trial18843701-13 2026-02-13T20:18:59.719 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 13 v 670 (ObjNum 618 snap 163 seq_num 618) dirty exists 2026-02-13T20:18:59.739 INFO:tasks.rados.rados.0.trial188.stdout:1825: finishing write tid 1 to trial18843701-14 2026-02-13T20:18:59.739 INFO:tasks.rados.rados.0.trial188.stdout:1825: finishing write tid 2 to trial18843701-14 2026-02-13T20:18:59.739 INFO:tasks.rados.rados.0.trial188.stdout:1825: finishing write tid 3 to trial18843701-14 2026-02-13T20:18:59.739 INFO:tasks.rados.rados.0.trial188.stdout:1825: finishing write tid 4 to trial18843701-14 2026-02-13T20:18:59.740 INFO:tasks.rados.rados.0.trial188.stdout:1825: finishing write tid 5 to trial18843701-14 2026-02-13T20:18:59.740 INFO:tasks.rados.rados.0.trial188.stdout:1825: oid 14 updating version 0 to 624 2026-02-13T20:18:59.740 INFO:tasks.rados.rados.0.trial188.stdout:1825: oid 14 version 624 is already newer than 623 2026-02-13T20:18:59.740 INFO:tasks.rados.rados.0.trial188.stdout:1825: oid 14 updating version 624 to 625 2026-02-13T20:18:59.740 INFO:tasks.rados.rados.0.trial188.stdout:1825: oid 14 updating version 625 to 626 2026-02-13T20:18:59.740 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 14 v 626 (ObjNum 668 snap 182 seq_num 668) dirty exists 2026-02-13T20:18:59.740 INFO:tasks.rados.rados.0.trial188.stdout:1825: left oid 14 (ObjNum 668 snap 182 seq_num 668) 2026-02-13T20:19:00.709 INFO:tasks.rados.rados.0.trial188.stdout:1823: done (2 left) 2026-02-13T20:19:00.709 INFO:tasks.rados.rados.0.trial188.stdout:1825: done (1 left) 2026-02-13T20:19:00.709 INFO:tasks.rados.rados.0.trial188.stdout:1826: done (0 left) 2026-02-13T20:19:00.709 INFO:tasks.rados.rados.0.trial188.stdout:1827: rollback oid 49 current snap is 183 2026-02-13T20:19:00.709 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 49 to 178 2026-02-13T20:19:00.709 INFO:tasks.rados.rados.0.trial188.stdout:1828: snap_remove snap 179 2026-02-13T20:19:01.711 INFO:tasks.rados.rados.0.trial188.stdout:1828: done (1 left) 2026-02-13T20:19:01.712 INFO:tasks.rados.rados.0.trial188.stdout:1829: copy_from oid 36 from oid 18 current snap is 183 2026-02-13T20:19:01.712 INFO:tasks.rados.rados.0.trial188.stdout:1827: finishing rollback tid 1 to trial18843701-49 2026-02-13T20:19:01.712 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 49 v 761 (ObjNum 129 snap 0 seq_num 13858848) dirty dne 2026-02-13T20:19:01.712 INFO:tasks.rados.rados.0.trial188.stdout:1827: done (1 left) 2026-02-13T20:19:01.712 INFO:tasks.rados.rados.0.trial188.stdout:1830: snap_create 2026-02-13T20:19:01.713 INFO:tasks.rados.rados.0.trial188.stdout:1829: finishing copy_from to trial18843701-36 2026-02-13T20:19:01.713 INFO:tasks.rados.rados.0.trial188.stdout:1829: got expected ENOENT (src dne) 2026-02-13T20:19:01.713 INFO:tasks.rados.rados.0.trial188.stdout:1829: finishing copy_from racing read to trial18843701-36 2026-02-13T20:19:02.703 INFO:tasks.rados.rados.0.trial188.stdout:1829: done (1 left) 2026-02-13T20:19:02.703 INFO:tasks.rados.rados.0.trial188.stdout:1830: done (0 left) 2026-02-13T20:19:02.703 INFO:tasks.rados.rados.0.trial188.stdout:1831: read oid 23 snap -1 2026-02-13T20:19:02.703 INFO:tasks.rados.rados.0.trial188.stdout:1831: expect deleted 2026-02-13T20:19:02.703 INFO:tasks.rados.rados.0.trial188.stdout:1832: write oid 26 current snap is 184 2026-02-13T20:19:02.703 INFO:tasks.rados.rados.0.trial188.stdout:1832: seq_num 669 ranges {443883=464292,1365277=511220,2572335=671548} 2026-02-13T20:19:02.706 INFO:tasks.rados.rados.0.trial188.stdout:1832: writing trial18843701-26 from 443883 to 908175 tid 1 2026-02-13T20:19:02.710 INFO:tasks.rados.rados.0.trial188.stdout:1832: writing trial18843701-26 from 1365277 to 1876497 tid 2 2026-02-13T20:19:02.715 INFO:tasks.rados.rados.0.trial188.stdout:1832: writing trial18843701-26 from 2572335 to 3243883 tid 3 2026-02-13T20:19:02.716 INFO:tasks.rados.rados.0.trial188.stdout:1833: snap_create 2026-02-13T20:19:02.731 INFO:tasks.rados.rados.0.trial188.stdout:1832: finishing write tid 1 to trial18843701-26 2026-02-13T20:19:02.732 INFO:tasks.rados.rados.0.trial188.stdout:1832: finishing write tid 2 to trial18843701-26 2026-02-13T20:19:02.733 INFO:tasks.rados.rados.0.trial188.stdout:1832: finishing write tid 3 to trial18843701-26 2026-02-13T20:19:02.733 INFO:tasks.rados.rados.0.trial188.stdout:1832: finishing write tid 4 to trial18843701-26 2026-02-13T20:19:02.733 INFO:tasks.rados.rados.0.trial188.stdout:1832: finishing write tid 5 to trial18843701-26 2026-02-13T20:19:02.733 INFO:tasks.rados.rados.0.trial188.stdout:1832: oid 26 updating version 0 to 627 2026-02-13T20:19:02.733 INFO:tasks.rados.rados.0.trial188.stdout:1832: oid 26 updating version 627 to 628 2026-02-13T20:19:02.733 INFO:tasks.rados.rados.0.trial188.stdout:1832: oid 26 updating version 628 to 630 2026-02-13T20:19:02.733 INFO:tasks.rados.rados.0.trial188.stdout:1832: oid 26 version 630 is already newer than 629 2026-02-13T20:19:02.733 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 26 v 630 (ObjNum 669 snap 184 seq_num 669) dirty exists 2026-02-13T20:19:02.733 INFO:tasks.rados.rados.0.trial188.stdout:1832: left oid 26 (ObjNum 669 snap 184 seq_num 669) 2026-02-13T20:19:03.715 INFO:tasks.rados.rados.0.trial188.stdout:1831: done (2 left) 2026-02-13T20:19:03.715 INFO:tasks.rados.rados.0.trial188.stdout:1832: done (1 left) 2026-02-13T20:19:03.715 INFO:tasks.rados.rados.0.trial188.stdout:1833: done (0 left) 2026-02-13T20:19:03.715 INFO:tasks.rados.rados.0.trial188.stdout:1834: write (excl) oid 19 current snap is 185 2026-02-13T20:19:03.715 INFO:tasks.rados.rados.0.trial188.stdout:1834: seq_num 670 ranges {460690=655894,1540112=771231,2716111=539778} 2026-02-13T20:19:03.720 INFO:tasks.rados.rados.0.trial188.stdout:1834: writing trial18843701-19 from 460690 to 1116584 tid 1 2026-02-13T20:19:03.724 INFO:tasks.rados.rados.0.trial188.stdout:1834: writing trial18843701-19 from 1540112 to 2311343 tid 2 2026-02-13T20:19:03.729 INFO:tasks.rados.rados.0.trial188.stdout:1834: writing trial18843701-19 from 2716111 to 3255889 tid 3 2026-02-13T20:19:03.730 INFO:tasks.rados.rados.0.trial188.stdout:1835: copy_from oid 26 from oid 32 current snap is 185 2026-02-13T20:19:03.730 INFO:tasks.rados.rados.0.trial188.stdout:1836: read oid 11 snap -1 2026-02-13T20:19:03.730 INFO:tasks.rados.rados.0.trial188.stdout:1836: expect deleted 2026-02-13T20:19:03.730 INFO:tasks.rados.rados.0.trial188.stdout:1837: read oid 25 snap -1 2026-02-13T20:19:03.730 INFO:tasks.rados.rados.0.trial188.stdout:1837: expect (ObjNum 615 snap 162 seq_num 615) 2026-02-13T20:19:03.730 INFO:tasks.rados.rados.0.trial188.stdout:1838: write (excl) oid 24 current snap is 185 2026-02-13T20:19:03.731 INFO:tasks.rados.rados.0.trial188.stdout:1838: seq_num 671 ranges {477497=731143,1998594=514889,3143534=133963} 2026-02-13T20:19:03.733 INFO:tasks.rados.rados.0.trial188.stdout:1838: writing trial18843701-24 from 477497 to 1208640 tid 1 2026-02-13T20:19:03.738 INFO:tasks.rados.rados.0.trial188.stdout:1838: writing trial18843701-24 from 1998594 to 2513483 tid 2 2026-02-13T20:19:03.741 INFO:tasks.rados.rados.0.trial188.stdout:1838: writing trial18843701-24 from 3143534 to 3277497 tid 3 2026-02-13T20:19:03.741 INFO:tasks.rados.rados.0.trial188.stdout:1839: snap_create 2026-02-13T20:19:03.742 INFO:tasks.rados.rados.0.trial188.stdout:1837: expect (ObjNum 615 snap 162 seq_num 615) 2026-02-13T20:19:03.742 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:19:03.765 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:19:03.788 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:19:03.810 INFO:tasks.rados.rados.0.trial188.stdout:1835: finishing copy_from racing read to trial18843701-26 2026-02-13T20:19:03.810 INFO:tasks.rados.rados.0.trial188.stdout:1834: finishing write tid 1 to trial18843701-19 2026-02-13T20:19:03.811 INFO:tasks.rados.rados.0.trial188.stdout:1834: finishing write tid 2 to trial18843701-19 2026-02-13T20:19:03.811 INFO:tasks.rados.rados.0.trial188.stdout:1838: finishing write tid 1 to trial18843701-24 2026-02-13T20:19:03.811 INFO:tasks.rados.rados.0.trial188.stdout:1834: finishing write tid 3 to trial18843701-19 2026-02-13T20:19:03.811 INFO:tasks.rados.rados.0.trial188.stdout:1834: finishing write tid 4 to trial18843701-19 2026-02-13T20:19:03.811 INFO:tasks.rados.rados.0.trial188.stdout:1838: finishing write tid 2 to trial18843701-24 2026-02-13T20:19:03.811 INFO:tasks.rados.rados.0.trial188.stdout:1838: finishing write tid 3 to trial18843701-24 2026-02-13T20:19:03.811 INFO:tasks.rados.rados.0.trial188.stdout:1838: finishing write tid 4 to trial18843701-24 2026-02-13T20:19:03.811 INFO:tasks.rados.rados.0.trial188.stdout:1834: finishing write tid 5 to trial18843701-19 2026-02-13T20:19:03.811 INFO:tasks.rados.rados.0.trial188.stdout:1834: oid 19 updating version 0 to 669 2026-02-13T20:19:03.811 INFO:tasks.rados.rados.0.trial188.stdout:1834: oid 19 version 669 is already newer than 667 2026-02-13T20:19:03.811 INFO:tasks.rados.rados.0.trial188.stdout:1834: oid 19 updating version 669 to 670 2026-02-13T20:19:03.811 INFO:tasks.rados.rados.0.trial188.stdout:1834: oid 19 version 670 is already newer than 668 2026-02-13T20:19:03.811 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 19 v 670 (ObjNum 670 snap 185 seq_num 670) dirty exists 2026-02-13T20:19:03.811 INFO:tasks.rados.rados.0.trial188.stdout:1834: left oid 19 (ObjNum 670 snap 185 seq_num 670) 2026-02-13T20:19:03.811 INFO:tasks.rados.rados.0.trial188.stdout:1838: finishing write tid 5 to trial18843701-24 2026-02-13T20:19:03.811 INFO:tasks.rados.rados.0.trial188.stdout:1838: oid 24 updating version 0 to 798 2026-02-13T20:19:03.811 INFO:tasks.rados.rados.0.trial188.stdout:1838: oid 24 updating version 798 to 801 2026-02-13T20:19:03.811 INFO:tasks.rados.rados.0.trial188.stdout:1838: oid 24 version 801 is already newer than 799 2026-02-13T20:19:03.811 INFO:tasks.rados.rados.0.trial188.stdout:1838: oid 24 version 801 is already newer than 800 2026-02-13T20:19:03.811 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 24 v 801 (ObjNum 671 snap 185 seq_num 671) dirty exists 2026-02-13T20:19:03.811 INFO:tasks.rados.rados.0.trial188.stdout:1838: left oid 24 (ObjNum 671 snap 185 seq_num 671) 2026-02-13T20:19:03.811 INFO:tasks.rados.rados.0.trial188.stdout:1835: finishing copy_from to trial18843701-26 2026-02-13T20:19:03.812 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 26 v 740 (ObjNum 653 snap 176 seq_num 653) dirty exists 2026-02-13T20:19:04.719 INFO:tasks.rados.rados.0.trial188.stdout:1834: done (5 left) 2026-02-13T20:19:04.720 INFO:tasks.rados.rados.0.trial188.stdout:1835: done (4 left) 2026-02-13T20:19:04.720 INFO:tasks.rados.rados.0.trial188.stdout:1836: done (3 left) 2026-02-13T20:19:04.720 INFO:tasks.rados.rados.0.trial188.stdout:1837: done (2 left) 2026-02-13T20:19:04.720 INFO:tasks.rados.rados.0.trial188.stdout:1838: done (1 left) 2026-02-13T20:19:04.720 INFO:tasks.rados.rados.0.trial188.stdout:1839: done (0 left) 2026-02-13T20:19:04.720 INFO:tasks.rados.rados.0.trial188.stdout:1840: read oid 23 snap -1 2026-02-13T20:19:04.720 INFO:tasks.rados.rados.0.trial188.stdout:1840: expect deleted 2026-02-13T20:19:04.720 INFO:tasks.rados.rados.0.trial188.stdout:1841: snap_create 2026-02-13T20:19:05.722 INFO:tasks.rados.rados.0.trial188.stdout:1840: done (1 left) 2026-02-13T20:19:05.722 INFO:tasks.rados.rados.0.trial188.stdout:1841: done (0 left) 2026-02-13T20:19:05.722 INFO:tasks.rados.rados.0.trial188.stdout:1842: read oid 48 snap 185 2026-02-13T20:19:05.722 INFO:tasks.rados.rados.0.trial188.stdout:1842: expect (ObjNum 578 snap 153 seq_num 578) 2026-02-13T20:19:05.722 INFO:tasks.rados.rados.0.trial188.stdout:1843: snap_remove snap 178 2026-02-13T20:19:06.723 INFO:tasks.rados.rados.0.trial188.stdout:1843: done (1 left) 2026-02-13T20:19:06.723 INFO:tasks.rados.rados.0.trial188.stdout:1844: write (excl) oid 26 current snap is 187 2026-02-13T20:19:06.723 INFO:tasks.rados.rados.0.trial188.stdout:1844: seq_num 672 ranges {494304=406392,1540723=774900,2770957=523347} 2026-02-13T20:19:06.727 INFO:tasks.rados.rados.0.trial188.stdout:1844: writing trial18843701-26 from 494304 to 900696 tid 1 2026-02-13T20:19:06.732 INFO:tasks.rados.rados.0.trial188.stdout:1844: writing trial18843701-26 from 1540723 to 2315623 tid 2 2026-02-13T20:19:06.736 INFO:tasks.rados.rados.0.trial188.stdout:1844: writing trial18843701-26 from 2770957 to 3294304 tid 3 2026-02-13T20:19:06.736 INFO:tasks.rados.rados.0.trial188.stdout:1845: read oid 41 snap -1 2026-02-13T20:19:06.736 INFO:tasks.rados.rados.0.trial188.stdout:1845: expect deleted 2026-02-13T20:19:06.736 INFO:tasks.rados.rados.0.trial188.stdout:1846: write oid 29 current snap is 187 2026-02-13T20:19:06.736 INFO:tasks.rados.rados.0.trial188.stdout:1846: seq_num 673 ranges {511111=481641,1599205=518558,2682027=489947} 2026-02-13T20:19:06.740 INFO:tasks.rados.rados.0.trial188.stdout:1846: writing trial18843701-29 from 511111 to 992752 tid 1 2026-02-13T20:19:06.744 INFO:tasks.rados.rados.0.trial188.stdout:1846: writing trial18843701-29 from 1599205 to 2117763 tid 2 2026-02-13T20:19:06.748 INFO:tasks.rados.rados.0.trial188.stdout:1846: writing trial18843701-29 from 2682027 to 3171974 tid 3 2026-02-13T20:19:06.748 INFO:tasks.rados.rados.0.trial188.stdout:1847: rollback oid 33 current snap is 187 2026-02-13T20:19:06.748 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 33 to 182 2026-02-13T20:19:06.748 INFO:tasks.rados.rados.0.trial188.stdout:1842: expect (ObjNum 578 snap 153 seq_num 578) 2026-02-13T20:19:06.790 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 795818 2026-02-13T20:19:06.828 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:19:06.872 INFO:tasks.rados.rados.0.trial188.stdout:1847: finishing rollback tid 0 to trial18843701-33 2026-02-13T20:19:06.872 INFO:tasks.rados.rados.0.trial188.stdout:1847: finishing rollback tid 1 to trial18843701-33 2026-02-13T20:19:06.872 INFO:tasks.rados.rados.0.trial188.stdout:1847: finishing rollback tid 2 to trial18843701-33 2026-02-13T20:19:06.872 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 33 v 653 (ObjNum 639 snap 169 seq_num 639) dirty exists 2026-02-13T20:19:06.872 INFO:tasks.rados.rados.0.trial188.stdout:1844: finishing write tid 1 to trial18843701-26 2026-02-13T20:19:06.872 INFO:tasks.rados.rados.0.trial188.stdout:1844: finishing write tid 2 to trial18843701-26 2026-02-13T20:19:06.872 INFO:tasks.rados.rados.0.trial188.stdout:1842: done (4 left) 2026-02-13T20:19:06.873 INFO:tasks.rados.rados.0.trial188.stdout:1845: done (3 left) 2026-02-13T20:19:06.873 INFO:tasks.rados.rados.0.trial188.stdout:1847: done (2 left) 2026-02-13T20:19:06.873 INFO:tasks.rados.rados.0.trial188.stdout:1848: snap_remove snap 182 2026-02-13T20:19:07.705 INFO:tasks.rados.rados.0.trial188.stdout:1848: done (2 left) 2026-02-13T20:19:07.706 INFO:tasks.rados.rados.0.trial188.stdout:1849: copy_from oid 48 from oid 10 current snap is 187 2026-02-13T20:19:07.706 INFO:tasks.rados.rados.0.trial188.stdout:1844: finishing write tid 3 to trial18843701-26 2026-02-13T20:19:07.706 INFO:tasks.rados.rados.0.trial188.stdout:1846: finishing write tid 1 to trial18843701-29 2026-02-13T20:19:07.706 INFO:tasks.rados.rados.0.trial188.stdout:1844: finishing write tid 4 to trial18843701-26 2026-02-13T20:19:07.706 INFO:tasks.rados.rados.0.trial188.stdout:1844: finishing write tid 5 to trial18843701-26 2026-02-13T20:19:07.706 INFO:tasks.rados.rados.0.trial188.stdout:1844: oid 26 updating version 0 to 744 2026-02-13T20:19:07.706 INFO:tasks.rados.rados.0.trial188.stdout:1844: oid 26 version 744 is already newer than 743 2026-02-13T20:19:07.706 INFO:tasks.rados.rados.0.trial188.stdout:1844: oid 26 version 744 is already newer than 741 2026-02-13T20:19:07.706 INFO:tasks.rados.rados.0.trial188.stdout:1844: oid 26 version 744 is already newer than 742 2026-02-13T20:19:07.707 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 26 v 744 (ObjNum 672 snap 187 seq_num 672) dirty exists 2026-02-13T20:19:07.707 INFO:tasks.rados.rados.0.trial188.stdout:1844: left oid 26 (ObjNum 672 snap 187 seq_num 672) 2026-02-13T20:19:07.707 INFO:tasks.rados.rados.0.trial188.stdout:1846: finishing write tid 2 to trial18843701-29 2026-02-13T20:19:07.707 INFO:tasks.rados.rados.0.trial188.stdout:1846: finishing write tid 3 to trial18843701-29 2026-02-13T20:19:07.707 INFO:tasks.rados.rados.0.trial188.stdout:1846: finishing write tid 4 to trial18843701-29 2026-02-13T20:19:07.707 INFO:tasks.rados.rados.0.trial188.stdout:1846: finishing write tid 5 to trial18843701-29 2026-02-13T20:19:07.707 INFO:tasks.rados.rados.0.trial188.stdout:1846: oid 29 updating version 0 to 676 2026-02-13T20:19:07.707 INFO:tasks.rados.rados.0.trial188.stdout:1846: oid 29 updating version 676 to 677 2026-02-13T20:19:07.707 INFO:tasks.rados.rados.0.trial188.stdout:1846: oid 29 updating version 677 to 678 2026-02-13T20:19:07.707 INFO:tasks.rados.rados.0.trial188.stdout:1846: oid 29 updating version 678 to 679 2026-02-13T20:19:07.707 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 29 v 679 (ObjNum 673 snap 187 seq_num 673) dirty exists 2026-02-13T20:19:07.707 INFO:tasks.rados.rados.0.trial188.stdout:1846: left oid 29 (ObjNum 673 snap 187 seq_num 673) 2026-02-13T20:19:07.708 INFO:tasks.rados.rados.0.trial188.stdout:1844: done (2 left) 2026-02-13T20:19:07.708 INFO:tasks.rados.rados.0.trial188.stdout:1846: done (1 left) 2026-02-13T20:19:07.708 INFO:tasks.rados.rados.0.trial188.stdout:1850: snap_create 2026-02-13T20:19:07.729 INFO:tasks.rados.rados.0.trial188.stdout:1849: finishing copy_from racing read to trial18843701-48 2026-02-13T20:19:07.730 INFO:tasks.rados.rados.0.trial188.stdout:1849: finishing copy_from to trial18843701-48 2026-02-13T20:19:07.730 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 48 v 468 (ObjNum 596 snap 158 seq_num 596) dirty exists 2026-02-13T20:19:08.039 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-13T20:19:08.039 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-13T20:19:08.039 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-13T20:19:08.040 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-13T20:19:08.054 INFO:tasks.ceph.mon.a:Started 2026-02-13T20:19:08.054 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.b 2026-02-13T20:19:08.054 INFO:tasks.mon_thrash:Sending STOP to mon b 2026-02-13T20:19:08.054 INFO:tasks.ceph.mon.b:Sent signal 19 2026-02-13T20:19:08.054 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-13T20:19:08.117 INFO:tasks.ceph.mon.a.trial110.stderr:2026-02-13T20:19:08.116+0000 7fec24a10c00 -1 mon.a@-1(???).log v0 log_external_backlog rewinding external_log_to from 254 -> 0 (sync_force? mon rebuild?) 2026-02-13T20:19:23.055 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.b 2026-02-13T20:19:23.055 INFO:tasks.mon_thrash:Sending CONT to mon b 2026-02-13T20:19:23.056 INFO:tasks.ceph.mon.b:Sent signal 18 2026-02-13T20:19:23.056 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-13T20:19:23.056 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T20:19:23.130 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.121+0000 7f73dd45b640 10 monclient: get_monmap_and_config 2026-02-13T20:19:23.131 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.121+0000 7f73dd45b640 10 monclient: build_initial_monmap 2026-02-13T20:19:23.131 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.121+0000 7f73dd45b640 10 monclient: monmap: 2026-02-13T20:19:23.131 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:19:23.131 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:23.131 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:19:23.123325+0000 2026-02-13T20:19:23.131 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:19:23.123325+0000 2026-02-13T20:19:23.131 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:19:23.131 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:23.131 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:19:23.132 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:19:23.132 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:19:23.132 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:23.132 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.122+0000 7f73dd45b640 1 Processor -- start 2026-02-13T20:19:23.132 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.122+0000 7f73dd45b640 1 -- start start 2026-02-13T20:19:23.132 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.122+0000 7f73dd45b640 10 monclient: init 2026-02-13T20:19:23.132 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.122+0000 7f73dd45b640 10 monclient: _reopen_session rank -1 2026-02-13T20:19:23.132 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.122+0000 7f73dd45b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:19:23.132 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.122+0000 7f73dd45b640 10 monclient(hunting): picked mon.noname-a con 0x7f73d81401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:19:23.132 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.122+0000 7f73dd45b640 10 monclient(hunting): picked mon.noname-b con 0x7f73d8092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:19:23.132 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.122+0000 7f73dd45b640 10 monclient(hunting): picked mon.noname-c con 0x7f73d8091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:19:23.132 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.122+0000 7f73dd45b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73d808b730 con 0x7f73d81401c0 2026-02-13T20:19:23.133 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.122+0000 7f73dd45b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73d805c5b0 con 0x7f73d8091950 2026-02-13T20:19:23.133 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.122+0000 7f73dd45b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73d808bcf0 con 0x7f73d8092020 2026-02-13T20:19:23.133 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.122+0000 7f73dd45b640 10 monclient(hunting): _renew_subs 2026-02-13T20:19:23.133 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.122+0000 7f73dd45b640 10 monclient(hunting): authenticate will time out at 1124.813701s 2026-02-13T20:19:23.133 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.122+0000 7f73d67fc640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f73d8092020 0x7f73d81812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:55600/0 (socket says 10.20.193.110:55600) 2026-02-13T20:19:23.133 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.122+0000 7f73d67fc640 1 -- 10.20.193.110:0/1338211781 learned_addr learned my addr 10.20.193.110:0/1338211781 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:19:23.133 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.122+0000 7f73d6ffd640 1 --1- 10.20.193.110:0/1338211781 >> v1:10.20.193.110:6789/0 conn(0x7f73d81401c0 0x7f73d8091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:39594/0 (socket says 10.20.193.110:39594) 2026-02-13T20:19:23.133 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.122+0000 7f73d5ffb640 1 -- 10.20.193.110:0/1338211781 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1356737745 0 0) 0x7f73d808bcf0 con 0x7f73d8092020 2026-02-13T20:19:23.133 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.122+0000 7f73d5ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:19:23.133 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.122+0000 7f73d5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:23.133 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.122+0000 7f73d5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:23.134 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.122+0000 7f73d5ffb640 10 monclient(hunting): my global_id is 94283 2026-02-13T20:19:23.134 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.122+0000 7f73d5ffb640 1 -- 10.20.193.110:0/1338211781 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73c40035e0 con 0x7f73d8092020 2026-02-13T20:19:23.134 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.123+0000 7f73d5ffb640 1 -- 10.20.193.110:0/1338211781 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3004972095 0 0) 0x7f73d808b730 con 0x7f73d81401c0 2026-02-13T20:19:23.134 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.123+0000 7f73d5ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:19:23.134 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.123+0000 7f73d5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:23.134 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.123+0000 7f73d5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:23.134 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.123+0000 7f73d5ffb640 10 monclient(hunting): my global_id is 114099 2026-02-13T20:19:23.134 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.123+0000 7f73d5ffb640 1 -- 10.20.193.110:0/1338211781 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73d808bcf0 con 0x7f73d81401c0 2026-02-13T20:19:23.134 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.123+0000 7f73d5ffb640 1 -- 10.20.193.110:0/1338211781 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3657646824 0 0) 0x7f73c40035e0 con 0x7f73d8092020 2026-02-13T20:19:23.134 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.123+0000 7f73d5ffb640 1 -- 10.20.193.110:0/1338211781 >> v1:10.20.193.188:6789/0 conn(0x7f73d8091950 legacy=0x7f73d81a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T20:19:23.134 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.123+0000 7f73d5ffb640 1 -- 10.20.193.110:0/1338211781 >> v1:10.20.193.110:6789/0 conn(0x7f73d81401c0 legacy=0x7f73d8091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:23.134 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.123+0000 7f73d5ffb640 10 monclient: _finish_hunting 0 2026-02-13T20:19:23.135 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.123+0000 7f73d5ffb640 1 monclient: found mon.noname-b 2026-02-13T20:19:23.135 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.123+0000 7f73d5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:19:23.135 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.123+0000 7f73d5ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:19:23.135 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.123+0000 7f73d5ffb640 1 -- 10.20.193.110:0/1338211781 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73d8140590 con 0x7f73d8092020 2026-02-13T20:19:23.135 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.123+0000 7f73d5ffb640 10 monclient: _finish_auth 0 2026-02-13T20:19:23.135 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.123+0000 7f73d5ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:19:23.135 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.123+0000 7f73d5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:19:23.135 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.123+0000 7f73d5ffb640 1 -- 10.20.193.110:0/1338211781 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f73c0002dd0 con 0x7f73d8092020 2026-02-13T20:19:23.135 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.123+0000 7f73d5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:23.135 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.123+0000 7f73d5ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:19:23.135 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.123+0000 7f73d5ffb640 10 monclient: dump: 2026-02-13T20:19:23.135 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:23.135 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:23.136 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:23.136 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:23.136 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:23.136 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:23.136 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:23.136 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:23.136 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:23.136 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:23.136 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.123+0000 7f73dd45b640 5 monclient: authenticate success, global_id 94283 2026-02-13T20:19:23.136 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.123+0000 7f73dd45b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:19:23.136 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.123+0000 7f73d5ffb640 1 -- 10.20.193.110:0/1338211781 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f73c0002fa0 con 0x7f73d8092020 2026-02-13T20:19:23.136 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.123+0000 7f73d5ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T20:19:23.137 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.123+0000 7f73dd45b640 10 monclient: get_monmap_and_config success 2026-02-13T20:19:23.137 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.123+0000 7f73dd45b640 4 set_mon_vals no callback set 2026-02-13T20:19:23.137 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.123+0000 7f73d5ffb640 1 -- 10.20.193.110:0/1338211781 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f73c00033b0 con 0x7f73d8092020 2026-02-13T20:19:23.137 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.123+0000 7f73d5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:23.137 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.123+0000 7f73d5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:19:23.137 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.123+0000 7f73d5ffb640 10 monclient: dump: 2026-02-13T20:19:23.137 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:23.137 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:23.137 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:23.137 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:23.137 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:23.137 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:23.137 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:23.138 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:23.138 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:23.138 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:23.138 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.123+0000 7f73dd45b640 10 monclient: shutdown 2026-02-13T20:19:23.138 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.123+0000 7f73dd45b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:19:23.138 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.123+0000 7f73dd45b640 1 -- 10.20.193.110:0/1338211781 >> v1:10.20.193.110:6790/0 conn(0x7f73d8092020 legacy=0x7f73d81812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:23.138 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.123+0000 7f73dd45b640 1 -- 10.20.193.110:0/1338211781 shutdown_connections 2026-02-13T20:19:23.138 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.123+0000 7f73dd45b640 1 -- 10.20.193.110:0/1338211781 >> 10.20.193.110:0/1338211781 conn(0x7f73d8054e90 msgr2=0x7f73d8058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:19:23.138 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.123+0000 7f73dd45b640 1 -- 10.20.193.110:0/1338211781 shutdown_connections 2026-02-13T20:19:23.138 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.123+0000 7f73dd45b640 1 -- 10.20.193.110:0/1338211781 wait complete. 2026-02-13T20:19:23.138 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.123+0000 7f73dd45b640 10 monclient: build_initial_monmap 2026-02-13T20:19:23.138 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.123+0000 7f73dd45b640 10 monclient: monmap: 2026-02-13T20:19:23.139 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:19:23.139 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:19:23.139 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:19:23.139 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:19:23.139 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:19:23.139 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:19:23.139 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:19:23.139 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:19:23.139 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:19:23.139 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:23.139 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73dd45b640 1 Processor -- start 2026-02-13T20:19:23.139 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73dd45b640 1 -- start start 2026-02-13T20:19:23.139 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73dd45b640 10 monclient: init 2026-02-13T20:19:23.140 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73dd45b640 10 monclient: _reopen_session rank -1 2026-02-13T20:19:23.140 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73dd45b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:19:23.140 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73dd45b640 10 monclient(hunting): picked mon.noname-c con 0x7f73d8091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:19:23.140 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73dd45b640 10 monclient(hunting): picked mon.noname-b con 0x7f73d81401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:19:23.140 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73dd45b640 10 monclient(hunting): picked mon.noname-a con 0x7f73d8130c20 addr v1:10.20.193.110:6789/0 2026-02-13T20:19:23.140 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73dd45b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73d8153150 con 0x7f73d8130c20 2026-02-13T20:19:23.140 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73dd45b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73d808c3c0 con 0x7f73d81401c0 2026-02-13T20:19:23.140 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73dd45b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73d805d320 con 0x7f73d8091950 2026-02-13T20:19:23.140 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73dd45b640 10 monclient(hunting): _renew_subs 2026-02-13T20:19:23.140 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73dd45b640 10 monclient(hunting): authenticate will time out at 1124.815425s 2026-02-13T20:19:23.140 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73d6ffd640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f73d8091950 0x7f73d813ea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:55614/0 (socket says 10.20.193.110:55614) 2026-02-13T20:19:23.140 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73d6ffd640 1 -- 10.20.193.110:0/1414025627 learned_addr learned my addr 10.20.193.110:0/1414025627 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:19:23.141 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73b77fe640 1 -- 10.20.193.110:0/1414025627 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3221954554 0 0) 0x7f73d805d320 con 0x7f73d8091950 2026-02-13T20:19:23.141 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73b77fe640 10 monclient(hunting): _negotiate 2026-02-13T20:19:23.141 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73b77fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:23.141 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73b77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:23.141 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73b77fe640 10 monclient(hunting): my global_id is 94286 2026-02-13T20:19:23.141 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73b77fe640 1 -- 10.20.193.110:0/1414025627 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73a40035e0 con 0x7f73d8091950 2026-02-13T20:19:23.141 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73b77fe640 1 -- 10.20.193.110:0/1414025627 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1786551211 0 0) 0x7f73d8153150 con 0x7f73d8130c20 2026-02-13T20:19:23.141 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73b77fe640 10 monclient(hunting): _negotiate 2026-02-13T20:19:23.141 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73b77fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:23.141 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73b77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:23.141 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73b77fe640 10 monclient(hunting): my global_id is 114102 2026-02-13T20:19:23.141 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73b77fe640 1 -- 10.20.193.110:0/1414025627 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73d805d320 con 0x7f73d8130c20 2026-02-13T20:19:23.141 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73b77fe640 1 -- 10.20.193.110:0/1414025627 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 520315492 0 0) 0x7f73a40035e0 con 0x7f73d8091950 2026-02-13T20:19:23.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73b77fe640 1 -- 10.20.193.110:0/1414025627 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f73d8153150 con 0x7f73d8091950 2026-02-13T20:19:23.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73b77fe640 1 -- 10.20.193.110:0/1414025627 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f73cc0030f0 con 0x7f73d8091950 2026-02-13T20:19:23.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73b77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:19:23.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73b77fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:19:23.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73b77fe640 10 monclient(hunting): dump: 2026-02-13T20:19:23.142 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:23.142 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:23.142 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:23.142 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:23.142 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:23.142 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:23.142 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:23.142 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:23.143 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:23.143 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:23.143 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73b77fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:19:23.143 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73b77fe640 1 -- 10.20.193.110:0/1414025627 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 774417258 0 0) 0x7f73d805d320 con 0x7f73d8130c20 2026-02-13T20:19:23.143 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73b77fe640 1 -- 10.20.193.110:0/1414025627 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f73a40035e0 con 0x7f73d8130c20 2026-02-13T20:19:23.143 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73b77fe640 1 -- 10.20.193.110:0/1414025627 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f73c8003d80 con 0x7f73d8130c20 2026-02-13T20:19:23.143 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73b77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:19:23.143 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73b77fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:19:23.143 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73b77fe640 10 monclient(hunting): dump: 2026-02-13T20:19:23.143 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:23.143 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:23.143 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:23.143 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:23.144 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:23.144 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:23.144 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:23.144 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:23.144 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:23.144 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:23.144 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73b77fe640 1 -- 10.20.193.110:0/1414025627 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2202310745 0 0) 0x7f73d8153150 con 0x7f73d8091950 2026-02-13T20:19:23.144 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73b77fe640 1 -- 10.20.193.110:0/1414025627 >> v1:10.20.193.188:6789/0 conn(0x7f73d81401c0 legacy=0x7f73d8193a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:23.144 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73b77fe640 1 -- 10.20.193.110:0/1414025627 >> v1:10.20.193.110:6789/0 conn(0x7f73d8130c20 legacy=0x7f73d8195160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:23.144 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73b77fe640 10 monclient: _finish_hunting 0 2026-02-13T20:19:23.144 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73b77fe640 1 monclient: found mon.c 2026-02-13T20:19:23.144 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73b77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:19:23.144 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73b77fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:19:23.144 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73b77fe640 1 -- 10.20.193.110:0/1414025627 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73d81300c0 con 0x7f73d8091950 2026-02-13T20:19:23.144 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73b77fe640 10 monclient: _finish_auth 0 2026-02-13T20:19:23.145 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73b77fe640 10 monclient: _check_auth_tickets 2026-02-13T20:19:23.145 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73b77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:19:23.145 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73dd45b640 5 monclient: authenticate success, global_id 94286 2026-02-13T20:19:23.145 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73dd45b640 10 monclient: _renew_subs 2026-02-13T20:19:23.145 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73dd45b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:19:23.145 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73dd45b640 1 -- 10.20.193.110:0/1414025627 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f73d8132420 con 0x7f73d8091950 2026-02-13T20:19:23.145 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73dd45b640 10 monclient: _renew_subs 2026-02-13T20:19:23.145 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73dd45b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:19:23.145 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73dd45b640 1 -- 10.20.193.110:0/1414025627 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f73d8131c30 con 0x7f73d8091950 2026-02-13T20:19:23.145 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73b77fe640 1 -- 10.20.193.110:0/1414025627 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f73cc003500 con 0x7f73d8091950 2026-02-13T20:19:23.145 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73b77fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:19:23.145 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.124+0000 7f73b77fe640 1 -- 10.20.193.110:0/1414025627 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f73cc004d00 con 0x7f73d8091950 2026-02-13T20:19:23.145 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.125+0000 7f73b77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:23.145 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.125+0000 7f73b77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:19:23.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.125+0000 7f73d57fa640 4 set_mon_vals no callback set 2026-02-13T20:19:23.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.125+0000 7f73b77fe640 10 monclient: dump: 2026-02-13T20:19:23.146 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:23.146 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:23.146 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:23.146 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:23.146 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:23.146 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:23.146 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:23.146 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:23.146 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:23.146 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:23.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.125+0000 7f73dd45b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:19:23.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.125+0000 7f73dd45b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:19:23.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.125+0000 7f73dd45b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:19:23.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.125+0000 7f73dd45b640 1 -- 10.20.193.110:0/1414025627 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73d80008d0 con 0x7f73d8091950 2026-02-13T20:19:23.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.125+0000 7f73b77fe640 1 -- 10.20.193.110:0/1414025627 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f73cc011970 con 0x7f73d8091950 2026-02-13T20:19:23.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.125+0000 7f73b77fe640 1 -- 10.20.193.110:0/1414025627 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(391..391 src has 1..391) ==== 3987+0+0 (unknown 3318256201 0 0) 0x7f73cc04eac0 con 0x7f73d8091950 2026-02-13T20:19:23.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.125+0000 7f73d67fc640 10 monclient: get_auth_request con 0x7f73a403faa0 auth_method 0 2026-02-13T20:19:23.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.127+0000 7f73b77fe640 1 -- 10.20.193.110:0/1414025627 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f73cc0171c0 con 0x7f73d8091950 2026-02-13T20:19:23.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.127+0000 7f73b77fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:19:23.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.127+0000 7f73b77fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:19:23.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.272+0000 7f73dd45b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T20:19:23.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.272+0000 7f73dd45b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T20:19:23.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.272+0000 7f73dd45b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:19:23.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.272+0000 7f73dd45b640 1 -- 10.20.193.110:0/1414025627 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f73d8058410 con 0x7f73d8091950 2026-02-13T20:19:23.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.272+0000 7f73b77fe640 1 -- 10.20.193.110:0/1414025627 <== mon.2 v1:10.20.193.110:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 3377111578) 0x7f73cc016970 con 0x7f73d8091950 2026-02-13T20:19:23.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.272+0000 7f73b77fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T20:19:23.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.272+0000 7f73b77fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:19:23.275 INFO:teuthology.orchestra.run.trial110.stdout:{"election_epoch":28,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"c","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","modified":"2026-02-13T20:11:07.161192Z","created":"2026-02-13T20:11:07.161192Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6789","nonce":0}]},"addr":"10.20.193.110:6789/0","public_addr":"10.20.193.110:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161241+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6789","nonce":0}]},"addr":"10.20.193.188:6789/0","public_addr":"10.20.193.188:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161242+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6790","nonce":0}]},"addr":"10.20.193.110:6790/0","public_addr":"10.20.193.110:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161243+0000","crush_location":[]}]}} 2026-02-13T20:19:23.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.273+0000 7f73dd45b640 1 -- 10.20.193.110:0/1414025627 >> v1:10.20.193.188:6812/1623052694 conn(0x7f73a403faa0 legacy=0x7f73a405ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:23.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.273+0000 7f73dd45b640 10 monclient: shutdown 2026-02-13T20:19:23.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.273+0000 7f73dd45b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:19:23.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.273+0000 7f73dd45b640 1 -- 10.20.193.110:0/1414025627 >> v1:10.20.193.110:6790/0 conn(0x7f73d8091950 legacy=0x7f73d813ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:23.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.273+0000 7f73dd45b640 1 -- 10.20.193.110:0/1414025627 shutdown_connections 2026-02-13T20:19:23.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.273+0000 7f73dd45b640 1 -- 10.20.193.110:0/1414025627 >> 10.20.193.110:0/1414025627 conn(0x7f73d8054e90 msgr2=0x7f73d8088e30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:19:23.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.273+0000 7f73dd45b640 1 -- 10.20.193.110:0/1414025627 shutdown_connections 2026-02-13T20:19:23.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:23.273+0000 7f73dd45b640 1 -- 10.20.193.110:0/1414025627 wait complete. 2026-02-13T20:19:26.283 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T20:19:26.357 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.350+0000 7fafeabb9640 10 monclient: get_monmap_and_config 2026-02-13T20:19:26.357 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.350+0000 7fafeabb9640 10 monclient: build_initial_monmap 2026-02-13T20:19:26.357 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.350+0000 7fafeabb9640 10 monclient: monmap: 2026-02-13T20:19:26.357 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:19:26.357 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:26.357 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:19:26.350456+0000 2026-02-13T20:19:26.357 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:19:26.350456+0000 2026-02-13T20:19:26.357 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:19:26.357 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:26.357 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:19:26.357 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:19:26.357 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:19:26.357 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:26.357 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.350+0000 7fafeabb9640 1 Processor -- start 2026-02-13T20:19:26.357 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.350+0000 7fafeabb9640 1 -- start start 2026-02-13T20:19:26.357 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.350+0000 7fafeabb9640 10 monclient: init 2026-02-13T20:19:26.357 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.350+0000 7fafeabb9640 10 monclient: _reopen_session rank -1 2026-02-13T20:19:26.357 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.350+0000 7fafeabb9640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:19:26.357 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.350+0000 7fafeabb9640 10 monclient(hunting): picked mon.noname-a con 0x7fafe41401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:19:26.357 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.350+0000 7fafeabb9640 10 monclient(hunting): picked mon.noname-b con 0x7fafe4092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:19:26.357 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.350+0000 7fafeabb9640 10 monclient(hunting): picked mon.noname-c con 0x7fafe4091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:19:26.357 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.350+0000 7fafeabb9640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafe408b730 con 0x7fafe41401c0 2026-02-13T20:19:26.357 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.350+0000 7fafeabb9640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafe405c5b0 con 0x7fafe4091950 2026-02-13T20:19:26.357 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.350+0000 7fafeabb9640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafe408bcf0 con 0x7fafe4092020 2026-02-13T20:19:26.357 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.350+0000 7fafeabb9640 10 monclient(hunting): _renew_subs 2026-02-13T20:19:26.357 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.350+0000 7fafeabb9640 10 monclient(hunting): authenticate will time out at 1128.040756s 2026-02-13T20:19:26.357 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.350+0000 7fafe892e640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fafe41401c0 0x7fafe4091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:39622/0 (socket says 10.20.193.110:39622) 2026-02-13T20:19:26.357 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.350+0000 7fafe892e640 1 -- 10.20.193.110:0/3219572324 learned_addr learned my addr 10.20.193.110:0/3219572324 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:19:26.357 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.351+0000 7fafdb7fe640 1 -- 10.20.193.110:0/3219572324 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 58332852 0 0) 0x7fafe408b730 con 0x7fafe41401c0 2026-02-13T20:19:26.357 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.351+0000 7fafdb7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:19:26.357 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.351+0000 7fafdb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:26.358 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.351+0000 7fafdb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:26.358 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.351+0000 7fafdb7fe640 10 monclient(hunting): my global_id is 114105 2026-02-13T20:19:26.358 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.351+0000 7fafdb7fe640 1 -- 10.20.193.110:0/3219572324 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafd00035e0 con 0x7fafe41401c0 2026-02-13T20:19:26.358 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.351+0000 7fafdb7fe640 1 -- 10.20.193.110:0/3219572324 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2726881897 0 0) 0x7fafe408bcf0 con 0x7fafe4092020 2026-02-13T20:19:26.358 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.351+0000 7fafdb7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:19:26.358 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.351+0000 7fafdb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:26.358 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.351+0000 7fafdb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:26.358 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.351+0000 7fafdb7fe640 10 monclient(hunting): my global_id is 94289 2026-02-13T20:19:26.358 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.351+0000 7fafdb7fe640 1 -- 10.20.193.110:0/3219572324 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafe408b730 con 0x7fafe4092020 2026-02-13T20:19:26.358 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.351+0000 7fafdb7fe640 1 -- 10.20.193.110:0/3219572324 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1640601280 0 0) 0x7fafd00035e0 con 0x7fafe41401c0 2026-02-13T20:19:26.358 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.351+0000 7fafdb7fe640 1 -- 10.20.193.110:0/3219572324 >> v1:10.20.193.110:6790/0 conn(0x7fafe4092020 legacy=0x7fafe41812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:26.358 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.351+0000 7fafdb7fe640 1 -- 10.20.193.110:0/3219572324 >> v1:10.20.193.188:6789/0 conn(0x7fafe4091950 legacy=0x7fafe41a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T20:19:26.358 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.351+0000 7fafdb7fe640 10 monclient: _finish_hunting 0 2026-02-13T20:19:26.358 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.351+0000 7fafdb7fe640 1 monclient: found mon.noname-a 2026-02-13T20:19:26.358 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.351+0000 7fafdb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:19:26.358 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.351+0000 7fafdb7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:19:26.358 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.351+0000 7fafdb7fe640 1 -- 10.20.193.110:0/3219572324 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafe4140590 con 0x7fafe41401c0 2026-02-13T20:19:26.358 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.351+0000 7fafdb7fe640 10 monclient: _finish_auth 0 2026-02-13T20:19:26.358 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.351+0000 7fafdb7fe640 10 monclient: _check_auth_tickets 2026-02-13T20:19:26.358 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.351+0000 7fafdb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:19:26.358 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.351+0000 7fafdb7fe640 1 -- 10.20.193.110:0/3219572324 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fafd4002dd0 con 0x7fafe41401c0 2026-02-13T20:19:26.358 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.351+0000 7fafdb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:26.358 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.351+0000 7fafdb7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:19:26.358 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.351+0000 7fafdb7fe640 10 monclient: dump: 2026-02-13T20:19:26.358 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:26.358 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:26.358 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:26.358 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:26.358 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:26.358 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:26.358 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:26.358 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:26.358 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:26.358 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:26.358 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.351+0000 7fafeabb9640 5 monclient: authenticate success, global_id 114105 2026-02-13T20:19:26.358 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.351+0000 7fafeabb9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:19:26.358 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.351+0000 7fafdb7fe640 1 -- 10.20.193.110:0/3219572324 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fafd4003020 con 0x7fafe41401c0 2026-02-13T20:19:26.358 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.351+0000 7fafdb7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:19:26.359 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.351+0000 7fafdb7fe640 1 -- 10.20.193.110:0/3219572324 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fafd4003430 con 0x7fafe41401c0 2026-02-13T20:19:26.359 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.351+0000 7fafdb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:26.359 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.351+0000 7fafdb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:19:26.359 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.351+0000 7fafdb7fe640 10 monclient: dump: 2026-02-13T20:19:26.359 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:26.359 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:26.359 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:26.359 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:26.359 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:26.359 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:26.359 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:26.359 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:26.359 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:26.359 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:26.359 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.351+0000 7fafeabb9640 10 monclient: get_monmap_and_config success 2026-02-13T20:19:26.359 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.351+0000 7fafeabb9640 4 set_mon_vals no callback set 2026-02-13T20:19:26.359 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.351+0000 7fafeabb9640 10 monclient: shutdown 2026-02-13T20:19:26.359 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.351+0000 7fafeabb9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:19:26.359 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.351+0000 7fafeabb9640 1 -- 10.20.193.110:0/3219572324 >> v1:10.20.193.110:6789/0 conn(0x7fafe41401c0 legacy=0x7fafe4091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:26.359 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.351+0000 7fafeabb9640 1 -- 10.20.193.110:0/3219572324 shutdown_connections 2026-02-13T20:19:26.359 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.351+0000 7fafeabb9640 1 -- 10.20.193.110:0/3219572324 >> 10.20.193.110:0/3219572324 conn(0x7fafe4054e90 msgr2=0x7fafe4058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:19:26.359 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.351+0000 7fafeabb9640 1 -- 10.20.193.110:0/3219572324 shutdown_connections 2026-02-13T20:19:26.359 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.351+0000 7fafeabb9640 1 -- 10.20.193.110:0/3219572324 wait complete. 2026-02-13T20:19:26.359 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.352+0000 7fafeabb9640 10 monclient: build_initial_monmap 2026-02-13T20:19:26.359 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.352+0000 7fafeabb9640 10 monclient: monmap: 2026-02-13T20:19:26.359 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:19:26.359 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:19:26.359 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:19:26.359 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:19:26.359 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:19:26.359 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:19:26.359 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:19:26.359 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:19:26.359 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:19:26.359 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:26.359 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.352+0000 7fafeabb9640 1 Processor -- start 2026-02-13T20:19:26.359 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.352+0000 7fafeabb9640 1 -- start start 2026-02-13T20:19:26.359 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.352+0000 7fafeabb9640 10 monclient: init 2026-02-13T20:19:26.359 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.352+0000 7fafeabb9640 10 monclient: _reopen_session rank -1 2026-02-13T20:19:26.360 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.352+0000 7fafeabb9640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:19:26.360 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.352+0000 7fafeabb9640 10 monclient(hunting): picked mon.noname-c con 0x7fafe4091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:19:26.360 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.352+0000 7fafeabb9640 10 monclient(hunting): picked mon.noname-b con 0x7fafe41401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:19:26.360 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.352+0000 7fafeabb9640 10 monclient(hunting): picked mon.noname-a con 0x7fafe4130bb0 addr v1:10.20.193.110:6789/0 2026-02-13T20:19:26.360 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.352+0000 7fafeabb9640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafe408c410 con 0x7fafe4130bb0 2026-02-13T20:19:26.360 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.352+0000 7fafeabb9640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafe41537c0 con 0x7fafe41401c0 2026-02-13T20:19:26.360 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.352+0000 7fafeabb9640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafe41323b0 con 0x7fafe4091950 2026-02-13T20:19:26.360 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.352+0000 7fafeabb9640 10 monclient(hunting): _renew_subs 2026-02-13T20:19:26.360 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.352+0000 7fafeabb9640 10 monclient(hunting): authenticate will time out at 1128.042707s 2026-02-13T20:19:26.360 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.352+0000 7fafe892e640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fafe4091950 0x7fafe413e990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:55638/0 (socket says 10.20.193.110:55638) 2026-02-13T20:19:26.360 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.352+0000 7fafe892e640 1 -- 10.20.193.110:0/3101008277 learned_addr learned my addr 10.20.193.110:0/3101008277 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:19:26.360 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.352+0000 7fafd97fa640 1 -- 10.20.193.110:0/3101008277 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4169922063 0 0) 0x7fafe41323b0 con 0x7fafe4091950 2026-02-13T20:19:26.360 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.352+0000 7fafd97fa640 10 monclient(hunting): _negotiate 2026-02-13T20:19:26.360 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.352+0000 7fafd97fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:26.360 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.352+0000 7fafd97fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:26.360 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.352+0000 7fafd97fa640 10 monclient(hunting): my global_id is 94292 2026-02-13T20:19:26.360 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.352+0000 7fafd97fa640 1 -- 10.20.193.110:0/3101008277 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafb40035e0 con 0x7fafe4091950 2026-02-13T20:19:26.360 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.352+0000 7fafd97fa640 1 -- 10.20.193.110:0/3101008277 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1860857436 0 0) 0x7fafe408c410 con 0x7fafe4130bb0 2026-02-13T20:19:26.360 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.352+0000 7fafd97fa640 10 monclient(hunting): _negotiate 2026-02-13T20:19:26.360 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.352+0000 7fafd97fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:26.360 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.352+0000 7fafd97fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:26.360 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.352+0000 7fafd97fa640 10 monclient(hunting): my global_id is 114108 2026-02-13T20:19:26.360 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.352+0000 7fafd97fa640 1 -- 10.20.193.110:0/3101008277 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafe41323b0 con 0x7fafe4130bb0 2026-02-13T20:19:26.360 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.353+0000 7fafd97fa640 1 -- 10.20.193.110:0/3101008277 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 437317550 0 0) 0x7fafb40035e0 con 0x7fafe4091950 2026-02-13T20:19:26.360 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.353+0000 7fafd97fa640 1 -- 10.20.193.110:0/3101008277 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fafe408c410 con 0x7fafe4091950 2026-02-13T20:19:26.360 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.353+0000 7fafd97fa640 1 -- 10.20.193.110:0/3101008277 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fafd4003340 con 0x7fafe4091950 2026-02-13T20:19:26.360 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.353+0000 7fafd97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:19:26.360 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.353+0000 7fafd97fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:19:26.360 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.353+0000 7fafd97fa640 10 monclient(hunting): dump: 2026-02-13T20:19:26.360 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:26.360 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:26.360 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:26.360 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:26.360 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:26.361 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:26.361 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:26.361 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:26.361 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:26.361 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:26.361 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.353+0000 7fafd97fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:19:26.361 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.353+0000 7fafd97fa640 1 -- 10.20.193.110:0/3101008277 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3391785746 0 0) 0x7fafe41323b0 con 0x7fafe4130bb0 2026-02-13T20:19:26.361 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.353+0000 7fafd97fa640 1 -- 10.20.193.110:0/3101008277 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fafb40035e0 con 0x7fafe4130bb0 2026-02-13T20:19:26.361 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.353+0000 7fafd97fa640 1 -- 10.20.193.110:0/3101008277 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fafe0003d80 con 0x7fafe4130bb0 2026-02-13T20:19:26.361 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.353+0000 7fafd97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:19:26.361 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.353+0000 7fafd97fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:19:26.361 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.353+0000 7fafd97fa640 10 monclient(hunting): dump: 2026-02-13T20:19:26.361 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:26.361 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:26.361 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:26.361 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:26.361 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:26.361 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:26.361 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:26.361 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:26.361 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:26.361 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:26.361 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.353+0000 7fafd97fa640 1 -- 10.20.193.110:0/3101008277 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2459568792 0 0) 0x7fafe408c410 con 0x7fafe4091950 2026-02-13T20:19:26.361 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.353+0000 7fafd97fa640 1 -- 10.20.193.110:0/3101008277 >> v1:10.20.193.188:6789/0 conn(0x7fafe41401c0 legacy=0x7fafe4193bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:26.361 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.353+0000 7fafd97fa640 1 -- 10.20.193.110:0/3101008277 >> v1:10.20.193.110:6789/0 conn(0x7fafe4130bb0 legacy=0x7fafe41952f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:26.361 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.353+0000 7fafd97fa640 10 monclient: _finish_hunting 0 2026-02-13T20:19:26.361 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.353+0000 7fafd97fa640 1 monclient: found mon.c 2026-02-13T20:19:26.361 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.353+0000 7fafd97fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:19:26.361 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.353+0000 7fafd97fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:19:26.361 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.353+0000 7fafd97fa640 1 -- 10.20.193.110:0/3101008277 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafe413f0a0 con 0x7fafe4091950 2026-02-13T20:19:26.361 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.353+0000 7fafd97fa640 10 monclient: _finish_auth 0 2026-02-13T20:19:26.361 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.353+0000 7fafd97fa640 10 monclient: _check_auth_tickets 2026-02-13T20:19:26.361 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.353+0000 7fafd97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:19:26.361 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.353+0000 7fafeabb9640 5 monclient: authenticate success, global_id 94292 2026-02-13T20:19:26.361 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.353+0000 7fafeabb9640 10 monclient: _renew_subs 2026-02-13T20:19:26.361 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.353+0000 7fafeabb9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:19:26.361 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.353+0000 7fafeabb9640 1 -- 10.20.193.110:0/3101008277 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fafe405d320 con 0x7fafe4091950 2026-02-13T20:19:26.361 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.353+0000 7fafeabb9640 10 monclient: _renew_subs 2026-02-13T20:19:26.361 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.353+0000 7fafeabb9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:19:26.362 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.353+0000 7fafeabb9640 1 -- 10.20.193.110:0/3101008277 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fafe41320d0 con 0x7fafe4091950 2026-02-13T20:19:26.362 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.353+0000 7fafd97fa640 1 -- 10.20.193.110:0/3101008277 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fafd4004b50 con 0x7fafe4091950 2026-02-13T20:19:26.362 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.353+0000 7fafd97fa640 10 monclient: handle_config config(0 keys) 2026-02-13T20:19:26.362 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.353+0000 7fafd97fa640 1 -- 10.20.193.110:0/3101008277 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fafd4004eb0 con 0x7fafe4091950 2026-02-13T20:19:26.362 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.353+0000 7fafd97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:26.362 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.353+0000 7fafd97fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:19:26.362 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.353+0000 7fafd97fa640 10 monclient: dump: 2026-02-13T20:19:26.362 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:26.362 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:26.362 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:26.362 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:26.362 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:26.362 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:26.362 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:26.362 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:26.362 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:26.362 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:26.362 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.353+0000 7fafdaffd640 4 set_mon_vals no callback set 2026-02-13T20:19:26.362 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.353+0000 7fafeabb9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:19:26.362 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.353+0000 7fafeabb9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:19:26.362 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.353+0000 7fafeabb9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:19:26.362 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.353+0000 7fafeabb9640 1 -- 10.20.193.110:0/3101008277 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafe4131c80 con 0x7fafe4091950 2026-02-13T20:19:26.362 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.353+0000 7fafd97fa640 1 -- 10.20.193.110:0/3101008277 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fafd4005010 con 0x7fafe4091950 2026-02-13T20:19:26.362 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.354+0000 7fafd97fa640 1 -- 10.20.193.110:0/3101008277 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(391..391 src has 1..391) ==== 3987+0+0 (unknown 3318256201 0 0) 0x7fafd404eb90 con 0x7fafe4091950 2026-02-13T20:19:26.362 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.354+0000 7fafdbfff640 10 monclient: get_auth_request con 0x7fafb403fae0 auth_method 0 2026-02-13T20:19:26.362 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.356+0000 7fafd97fa640 1 -- 10.20.193.110:0/3101008277 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fafd40172f0 con 0x7fafe4091950 2026-02-13T20:19:26.362 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.356+0000 7fafd97fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:19:26.362 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.356+0000 7fafd97fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:19:26.502 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.501+0000 7fafeabb9640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T20:19:26.502 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.501+0000 7fafeabb9640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T20:19:26.502 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.501+0000 7fafeabb9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:19:26.502 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.501+0000 7fafeabb9640 1 -- 10.20.193.110:0/3101008277 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fafe408cdf0 con 0x7fafe4091950 2026-02-13T20:19:26.503 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.501+0000 7fafd97fa640 1 -- 10.20.193.110:0/3101008277 <== mon.2 v1:10.20.193.110:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 4054592186) 0x7fafd4016aa0 con 0x7fafe4091950 2026-02-13T20:19:26.503 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.501+0000 7fafd97fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T20:19:26.503 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.501+0000 7fafd97fa640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:19:26.503 INFO:teuthology.orchestra.run.trial110.stdout:{"election_epoch":28,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"c","quorum_age":3,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","modified":"2026-02-13T20:11:07.161192Z","created":"2026-02-13T20:11:07.161192Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6789","nonce":0}]},"addr":"10.20.193.110:6789/0","public_addr":"10.20.193.110:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161241+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6789","nonce":0}]},"addr":"10.20.193.188:6789/0","public_addr":"10.20.193.188:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161242+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6790","nonce":0}]},"addr":"10.20.193.110:6790/0","public_addr":"10.20.193.110:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161243+0000","crush_location":[]}]}} 2026-02-13T20:19:26.504 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.502+0000 7fafeabb9640 1 -- 10.20.193.110:0/3101008277 >> v1:10.20.193.188:6812/1623052694 conn(0x7fafb403fae0 legacy=0x7fafb405ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:26.504 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.502+0000 7fafeabb9640 10 monclient: shutdown 2026-02-13T20:19:26.504 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.502+0000 7fafeabb9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:19:26.504 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.502+0000 7fafeabb9640 1 -- 10.20.193.110:0/3101008277 >> v1:10.20.193.110:6790/0 conn(0x7fafe4091950 legacy=0x7fafe413e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:26.504 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.502+0000 7fafeabb9640 1 -- 10.20.193.110:0/3101008277 shutdown_connections 2026-02-13T20:19:26.505 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.502+0000 7fafeabb9640 1 -- 10.20.193.110:0/3101008277 >> 10.20.193.110:0/3101008277 conn(0x7fafe4054e90 msgr2=0x7fafe4088e30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:19:26.505 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.502+0000 7fafeabb9640 1 -- 10.20.193.110:0/3101008277 shutdown_connections 2026-02-13T20:19:26.505 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:26.502+0000 7fafeabb9640 1 -- 10.20.193.110:0/3101008277 wait complete. 2026-02-13T20:19:29.511 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T20:19:29.580 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.579+0000 7f9fc850c640 10 monclient: get_monmap_and_config 2026-02-13T20:19:29.580 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.579+0000 7f9fc850c640 10 monclient: build_initial_monmap 2026-02-13T20:19:29.580 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.579+0000 7f9fc850c640 10 monclient: monmap: 2026-02-13T20:19:29.580 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:19:29.580 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:29.580 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:19:29.579937+0000 2026-02-13T20:19:29.580 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:19:29.579937+0000 2026-02-13T20:19:29.581 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:19:29.581 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:29.581 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:19:29.581 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:19:29.581 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:19:29.581 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:29.581 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.579+0000 7f9fc850c640 1 Processor -- start 2026-02-13T20:19:29.581 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.579+0000 7f9fc850c640 1 -- start start 2026-02-13T20:19:29.581 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.579+0000 7f9fc850c640 10 monclient: init 2026-02-13T20:19:29.586 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.580+0000 7f9fc850c640 10 monclient: _reopen_session rank -1 2026-02-13T20:19:29.587 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.580+0000 7f9fc850c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:19:29.587 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.580+0000 7f9fc850c640 10 monclient(hunting): picked mon.noname-a con 0x7f9fc01401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:19:29.587 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.580+0000 7f9fc850c640 10 monclient(hunting): picked mon.noname-c con 0x7f9fc0092020 addr v1:10.20.193.188:6789/0 2026-02-13T20:19:29.587 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.580+0000 7f9fc850c640 10 monclient(hunting): picked mon.noname-b con 0x7f9fc0091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:19:29.587 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.580+0000 7f9fc850c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fc008b730 con 0x7f9fc01401c0 2026-02-13T20:19:29.587 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.580+0000 7f9fc850c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fc005c5b0 con 0x7f9fc0092020 2026-02-13T20:19:29.587 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.580+0000 7f9fc850c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fc008bcf0 con 0x7f9fc0091950 2026-02-13T20:19:29.587 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.580+0000 7f9fc850c640 10 monclient(hunting): _renew_subs 2026-02-13T20:19:29.587 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.580+0000 7f9fc850c640 10 monclient(hunting): authenticate will time out at 1131.270258s 2026-02-13T20:19:29.587 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.580+0000 7f9fc6281640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f9fc01401c0 0x7f9fc0091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:39634/0 (socket says 10.20.193.110:39634) 2026-02-13T20:19:29.587 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.580+0000 7f9fc6281640 1 -- 10.20.193.110:0/2806339199 learned_addr learned my addr 10.20.193.110:0/2806339199 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:19:29.587 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.580+0000 7f9fc527f640 1 -- 10.20.193.110:0/2806339199 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1571802641 0 0) 0x7f9fc008b730 con 0x7f9fc01401c0 2026-02-13T20:19:29.587 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.580+0000 7f9fc527f640 10 monclient(hunting): _negotiate 2026-02-13T20:19:29.587 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.580+0000 7f9fc527f640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:29.587 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.580+0000 7f9fc527f640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:29.588 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.580+0000 7f9fc527f640 10 monclient(hunting): my global_id is 114111 2026-02-13T20:19:29.588 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.580+0000 7f9fc527f640 1 -- 10.20.193.110:0/2806339199 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9fa80035e0 con 0x7f9fc01401c0 2026-02-13T20:19:29.588 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.580+0000 7f9fc527f640 1 -- 10.20.193.110:0/2806339199 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 950672336 0 0) 0x7f9fa80035e0 con 0x7f9fc01401c0 2026-02-13T20:19:29.588 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.580+0000 7f9fc527f640 1 -- 10.20.193.110:0/2806339199 >> v1:10.20.193.110:6790/0 conn(0x7f9fc0091950 legacy=0x7f9fc01a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:29.588 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.580+0000 7f9fc527f640 1 -- 10.20.193.110:0/2806339199 >> v1:10.20.193.188:6789/0 conn(0x7f9fc0092020 legacy=0x7f9fc01812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T20:19:29.588 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.580+0000 7f9fc527f640 10 monclient: _finish_hunting 0 2026-02-13T20:19:29.588 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.580+0000 7f9fc527f640 1 monclient: found mon.noname-a 2026-02-13T20:19:29.588 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.580+0000 7f9fc527f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:19:29.588 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.580+0000 7f9fc527f640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:19:29.588 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.580+0000 7f9fc527f640 1 -- 10.20.193.110:0/2806339199 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fc0140590 con 0x7f9fc01401c0 2026-02-13T20:19:29.588 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.580+0000 7f9fc527f640 10 monclient: _finish_auth 0 2026-02-13T20:19:29.588 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.580+0000 7f9fc527f640 10 monclient: _check_auth_tickets 2026-02-13T20:19:29.588 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.580+0000 7f9fc527f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:19:29.588 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.580+0000 7f9fc527f640 1 -- 10.20.193.110:0/2806339199 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f9fb0002dd0 con 0x7f9fc01401c0 2026-02-13T20:19:29.588 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.580+0000 7f9fc850c640 5 monclient: authenticate success, global_id 114111 2026-02-13T20:19:29.588 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.580+0000 7f9fc850c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:19:29.589 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.580+0000 7f9fc527f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:29.589 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.580+0000 7f9fc527f640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:19:29.589 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.580+0000 7f9fc527f640 10 monclient: dump: 2026-02-13T20:19:29.589 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:29.589 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:29.589 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:29.589 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:29.589 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:29.589 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:29.589 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:29.589 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:29.589 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:29.589 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:29.589 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.580+0000 7f9fc850c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:19:29.589 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.580+0000 7f9fc527f640 1 -- 10.20.193.110:0/2806339199 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9fb0002fa0 con 0x7f9fc01401c0 2026-02-13T20:19:29.589 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.580+0000 7f9fc527f640 10 monclient: handle_config config(0 keys) 2026-02-13T20:19:29.589 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.580+0000 7f9fc527f640 1 -- 10.20.193.110:0/2806339199 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f9fb00033b0 con 0x7f9fc01401c0 2026-02-13T20:19:29.589 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.580+0000 7f9fc850c640 10 monclient: get_monmap_and_config success 2026-02-13T20:19:29.590 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.580+0000 7f9fc850c640 4 set_mon_vals no callback set 2026-02-13T20:19:29.590 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.580+0000 7f9fc527f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:29.590 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.580+0000 7f9fc527f640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:19:29.590 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.580+0000 7f9fc527f640 10 monclient: dump: 2026-02-13T20:19:29.590 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:29.590 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:29.590 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:29.590 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:29.590 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:29.590 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:29.590 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:29.590 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:29.590 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:29.590 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:29.590 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.580+0000 7f9fc850c640 10 monclient: shutdown 2026-02-13T20:19:29.590 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.580+0000 7f9fc850c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:19:29.590 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.580+0000 7f9fc850c640 1 -- 10.20.193.110:0/2806339199 >> v1:10.20.193.110:6789/0 conn(0x7f9fc01401c0 legacy=0x7f9fc0091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:29.590 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.581+0000 7f9fc850c640 1 -- 10.20.193.110:0/2806339199 shutdown_connections 2026-02-13T20:19:29.590 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.581+0000 7f9fc850c640 1 -- 10.20.193.110:0/2806339199 >> 10.20.193.110:0/2806339199 conn(0x7f9fc0054e90 msgr2=0x7f9fc0058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:19:29.591 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.581+0000 7f9fc850c640 1 -- 10.20.193.110:0/2806339199 shutdown_connections 2026-02-13T20:19:29.591 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.581+0000 7f9fc850c640 1 -- 10.20.193.110:0/2806339199 wait complete. 2026-02-13T20:19:29.591 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.581+0000 7f9fc850c640 10 monclient: build_initial_monmap 2026-02-13T20:19:29.591 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.581+0000 7f9fc850c640 10 monclient: monmap: 2026-02-13T20:19:29.591 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:19:29.591 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:19:29.591 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:19:29.591 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:19:29.591 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:19:29.591 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:19:29.591 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:19:29.591 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:19:29.591 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:19:29.591 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:29.591 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.581+0000 7f9fc850c640 1 Processor -- start 2026-02-13T20:19:29.591 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.581+0000 7f9fc850c640 1 -- start start 2026-02-13T20:19:29.591 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.581+0000 7f9fc850c640 10 monclient: init 2026-02-13T20:19:29.591 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.581+0000 7f9fc850c640 10 monclient: _reopen_session rank -1 2026-02-13T20:19:29.592 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.581+0000 7f9fc850c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:19:29.592 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.581+0000 7f9fc850c640 10 monclient(hunting): picked mon.noname-b con 0x7f9fc0091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:19:29.592 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.581+0000 7f9fc850c640 10 monclient(hunting): picked mon.noname-a con 0x7f9fc01401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:19:29.592 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.581+0000 7f9fc850c640 10 monclient(hunting): picked mon.noname-c con 0x7f9fc0089e80 addr v1:10.20.193.110:6790/0 2026-02-13T20:19:29.592 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.581+0000 7f9fc850c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fc008c410 con 0x7f9fc01401c0 2026-02-13T20:19:29.592 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.581+0000 7f9fc850c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fc005d320 con 0x7f9fc0091950 2026-02-13T20:19:29.592 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.581+0000 7f9fc850c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fc0131060 con 0x7f9fc0089e80 2026-02-13T20:19:29.592 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.581+0000 7f9fc850c640 10 monclient(hunting): _renew_subs 2026-02-13T20:19:29.592 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.581+0000 7f9fc850c640 10 monclient(hunting): authenticate will time out at 1131.271839s 2026-02-13T20:19:29.592 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.581+0000 7f9fc5a80640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f9fc01401c0 0x7f9fc0089770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:39636/0 (socket says 10.20.193.110:39636) 2026-02-13T20:19:29.592 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.581+0000 7f9fc5a80640 1 -- 10.20.193.110:0/820619019 learned_addr learned my addr 10.20.193.110:0/820619019 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:19:29.592 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.582+0000 7f9fa6ffd640 1 -- 10.20.193.110:0/820619019 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 919857138 0 0) 0x7f9fc008c410 con 0x7f9fc01401c0 2026-02-13T20:19:29.592 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.582+0000 7f9fa6ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:19:29.592 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.582+0000 7f9fa6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:29.592 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.582+0000 7f9fa6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:29.592 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.582+0000 7f9fa6ffd640 10 monclient(hunting): my global_id is 114114 2026-02-13T20:19:29.592 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.582+0000 7f9fa6ffd640 1 -- 10.20.193.110:0/820619019 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f900035e0 con 0x7f9fc01401c0 2026-02-13T20:19:29.592 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.582+0000 7f9fa6ffd640 1 -- 10.20.193.110:0/820619019 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1154975884 0 0) 0x7f9f900035e0 con 0x7f9fc01401c0 2026-02-13T20:19:29.593 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.582+0000 7f9fa6ffd640 1 -- 10.20.193.110:0/820619019 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9fc008c410 con 0x7f9fc01401c0 2026-02-13T20:19:29.593 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.582+0000 7f9fa6ffd640 1 -- 10.20.193.110:0/820619019 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f9fb40040b0 con 0x7f9fc01401c0 2026-02-13T20:19:29.593 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.582+0000 7f9fa6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:19:29.593 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.582+0000 7f9fa6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:19:29.593 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.582+0000 7f9fa6ffd640 10 monclient(hunting): dump: 2026-02-13T20:19:29.593 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:29.593 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:29.593 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:29.593 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:29.593 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:29.593 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:29.593 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:29.593 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:29.593 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:29.593 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:29.593 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.582+0000 7f9fa6ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:19:29.593 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.582+0000 7f9fa6ffd640 1 -- 10.20.193.110:0/820619019 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2235783557 0 0) 0x7f9fc008c410 con 0x7f9fc01401c0 2026-02-13T20:19:29.593 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.582+0000 7f9fa6ffd640 1 -- 10.20.193.110:0/820619019 >> v1:10.20.193.110:6790/0 conn(0x7f9fc0089e80 legacy=0x7f9fc0195170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:29.593 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.582+0000 7f9fa6ffd640 1 -- 10.20.193.110:0/820619019 >> v1:10.20.193.188:6789/0 conn(0x7f9fc0091950 legacy=0x7f9fc0089060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:29.594 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.582+0000 7f9fa6ffd640 10 monclient: _finish_hunting 0 2026-02-13T20:19:29.594 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.582+0000 7f9fa6ffd640 1 monclient: found mon.a 2026-02-13T20:19:29.594 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.582+0000 7f9fa6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:19:29.594 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.582+0000 7f9fa6ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:19:29.594 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.582+0000 7f9fa6ffd640 1 -- 10.20.193.110:0/820619019 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fc0131bd0 con 0x7f9fc01401c0 2026-02-13T20:19:29.594 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.582+0000 7f9fa6ffd640 10 monclient: _finish_auth 0 2026-02-13T20:19:29.594 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.582+0000 7f9fa6ffd640 10 monclient: _check_auth_tickets 2026-02-13T20:19:29.594 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.582+0000 7f9fa6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:19:29.594 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.582+0000 7f9fc850c640 5 monclient: authenticate success, global_id 114114 2026-02-13T20:19:29.594 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.582+0000 7f9fc850c640 10 monclient: _renew_subs 2026-02-13T20:19:29.594 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.582+0000 7f9fc850c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:19:29.594 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.582+0000 7f9fc850c640 1 -- 10.20.193.110:0/820619019 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9fc0131eb0 con 0x7f9fc01401c0 2026-02-13T20:19:29.594 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.582+0000 7f9fc850c640 10 monclient: _renew_subs 2026-02-13T20:19:29.594 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.582+0000 7f9fc850c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:19:29.594 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.582+0000 7f9fc850c640 1 -- 10.20.193.110:0/820619019 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9fc0090fa0 con 0x7f9fc01401c0 2026-02-13T20:19:29.594 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.582+0000 7f9fa6ffd640 1 -- 10.20.193.110:0/820619019 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9fb4004280 con 0x7f9fc01401c0 2026-02-13T20:19:29.594 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.582+0000 7f9fa6ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:19:29.594 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.582+0000 7f9fa6ffd640 1 -- 10.20.193.110:0/820619019 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f9fb4002910 con 0x7f9fc01401c0 2026-02-13T20:19:29.594 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.582+0000 7f9fa6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:29.595 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.582+0000 7f9fa6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:19:29.595 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.582+0000 7f9fc4a7e640 4 set_mon_vals no callback set 2026-02-13T20:19:29.595 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.582+0000 7f9fa6ffd640 10 monclient: dump: 2026-02-13T20:19:29.595 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:29.595 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:29.595 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:29.595 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:29.595 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:29.595 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:29.595 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:29.595 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:29.595 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:29.595 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:29.595 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.582+0000 7f9fa6ffd640 1 -- 10.20.193.110:0/820619019 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f9fb4002a70 con 0x7f9fc01401c0 2026-02-13T20:19:29.595 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.582+0000 7f9fc850c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:19:29.595 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.582+0000 7f9fc850c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:19:29.595 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.582+0000 7f9fc850c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:19:29.595 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.582+0000 7f9fc850c640 1 -- 10.20.193.110:0/820619019 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fc008cd70 con 0x7f9fc01401c0 2026-02-13T20:19:29.595 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.583+0000 7f9fa6ffd640 1 -- 10.20.193.110:0/820619019 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(391..391 src has 1..391) ==== 3987+0+0 (unknown 3318256201 0 0) 0x7f9fb404e970 con 0x7f9fc01401c0 2026-02-13T20:19:29.596 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.583+0000 7f9fc6281640 10 monclient: get_auth_request con 0x7f9f9003f6f0 auth_method 0 2026-02-13T20:19:29.596 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.585+0000 7f9fa6ffd640 1 -- 10.20.193.110:0/820619019 <== mon.0 v1:10.20.193.110:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f9fb4017010 con 0x7f9fc01401c0 2026-02-13T20:19:29.596 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.585+0000 7f9fa6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:19:29.596 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.585+0000 7f9fa6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:19:29.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.731+0000 7f9fc850c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T20:19:29.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.731+0000 7f9fc850c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T20:19:29.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.731+0000 7f9fc850c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:19:29.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.731+0000 7f9fc850c640 1 -- 10.20.193.110:0/820619019 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9fc0055bb0 con 0x7f9fc01401c0 2026-02-13T20:19:29.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.731+0000 7f9fa6ffd640 1 -- 10.20.193.110:0/820619019 <== mon.0 v1:10.20.193.110:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 2938489658) 0x7f9fb40167c0 con 0x7f9fc01401c0 2026-02-13T20:19:29.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.731+0000 7f9fa6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T20:19:29.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.731+0000 7f9fa6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:19:29.733 INFO:teuthology.orchestra.run.trial110.stdout:{"election_epoch":28,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"c","quorum_age":7,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","modified":"2026-02-13T20:11:07.161192Z","created":"2026-02-13T20:11:07.161192Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6789","nonce":0}]},"addr":"10.20.193.110:6789/0","public_addr":"10.20.193.110:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161241+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6789","nonce":0}]},"addr":"10.20.193.188:6789/0","public_addr":"10.20.193.188:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161242+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6790","nonce":0}]},"addr":"10.20.193.110:6790/0","public_addr":"10.20.193.110:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161243+0000","crush_location":[]}]}} 2026-02-13T20:19:29.734 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.732+0000 7f9fc850c640 1 -- 10.20.193.110:0/820619019 >> v1:10.20.193.188:6812/1623052694 conn(0x7f9f9003f6f0 legacy=0x7f9f9005fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:29.734 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.732+0000 7f9fc850c640 10 monclient: shutdown 2026-02-13T20:19:29.734 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.732+0000 7f9fc850c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:19:29.734 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.732+0000 7f9fc850c640 1 -- 10.20.193.110:0/820619019 >> v1:10.20.193.110:6789/0 conn(0x7f9fc01401c0 legacy=0x7f9fc0089770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:29.734 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.732+0000 7f9fc850c640 1 -- 10.20.193.110:0/820619019 shutdown_connections 2026-02-13T20:19:29.734 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.732+0000 7f9fc850c640 1 -- 10.20.193.110:0/820619019 >> 10.20.193.110:0/820619019 conn(0x7f9fc0054e90 msgr2=0x7f9fc008dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:19:29.734 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.732+0000 7f9fc850c640 1 -- 10.20.193.110:0/820619019 shutdown_connections 2026-02-13T20:19:29.734 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:29.732+0000 7f9fc850c640 1 -- 10.20.193.110:0/820619019 wait complete. 2026-02-13T20:19:32.741 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T20:19:32.807 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:32.807+0000 7f3be59c2640 10 monclient: get_monmap_and_config 2026-02-13T20:19:32.807 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:32.807+0000 7f3be59c2640 10 monclient: build_initial_monmap 2026-02-13T20:19:32.807 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:32.807+0000 7f3be59c2640 10 monclient: monmap: 2026-02-13T20:19:32.807 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:19:32.807 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:32.808 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:19:32.807649+0000 2026-02-13T20:19:32.808 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:19:32.807649+0000 2026-02-13T20:19:32.808 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:19:32.808 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:32.808 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:19:32.808 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:19:32.808 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:19:32.808 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:32.808 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:32.807+0000 7f3be59c2640 1 Processor -- start 2026-02-13T20:19:32.809 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:32.807+0000 7f3be59c2640 1 -- start start 2026-02-13T20:19:32.809 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:32.807+0000 7f3be59c2640 10 monclient: init 2026-02-13T20:19:32.809 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:32.807+0000 7f3be59c2640 10 monclient: _reopen_session rank -1 2026-02-13T20:19:32.809 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:32.807+0000 7f3be59c2640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:19:32.809 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:32.807+0000 7f3be59c2640 10 monclient(hunting): picked mon.noname-b con 0x7f3be01401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:19:32.809 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:32.807+0000 7f3be59c2640 10 monclient(hunting): picked mon.noname-a con 0x7f3be0092020 addr v1:10.20.193.110:6789/0 2026-02-13T20:19:32.809 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:32.807+0000 7f3be59c2640 10 monclient(hunting): picked mon.noname-c con 0x7f3be0091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:19:32.809 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:32.807+0000 7f3be59c2640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3be008b730 con 0x7f3be0092020 2026-02-13T20:19:32.809 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:32.808+0000 7f3be59c2640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3be005c5b0 con 0x7f3be0091950 2026-02-13T20:19:32.809 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:32.808+0000 7f3be59c2640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3be008bcf0 con 0x7f3be01401c0 2026-02-13T20:19:32.809 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:32.808+0000 7f3be59c2640 10 monclient(hunting): _renew_subs 2026-02-13T20:19:32.809 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:32.808+0000 7f3be59c2640 10 monclient(hunting): authenticate will time out at 1134.498012s 2026-02-13T20:19:32.809 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:32.808+0000 7f3bdeffd640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f3be01401c0 0x7f3be0091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:37628/0 (socket says 10.20.193.110:37628) 2026-02-13T20:19:32.809 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:32.808+0000 7f3bdeffd640 1 -- 10.20.193.110:0/3263947540 learned_addr learned my addr 10.20.193.110:0/3263947540 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:19:34.070 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.063+0000 7f3bddffb640 1 -- 10.20.193.110:0/3263947540 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 804191834 0 0) 0x7f3be008bcf0 con 0x7f3be01401c0 2026-02-13T20:19:34.070 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.063+0000 7f3bddffb640 10 monclient(hunting): _negotiate 2026-02-13T20:19:34.070 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.063+0000 7f3bddffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:34.070 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.063+0000 7f3bddffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:34.070 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.063+0000 7f3bddffb640 10 monclient(hunting): my global_id is 94295 2026-02-13T20:19:34.070 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.063+0000 7f3bddffb640 1 -- 10.20.193.110:0/3263947540 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3bcc0035e0 con 0x7f3be01401c0 2026-02-13T20:19:34.071 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.064+0000 7f3bddffb640 1 -- 10.20.193.110:0/3263947540 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 689376498 0 0) 0x7f3bcc0035e0 con 0x7f3be01401c0 2026-02-13T20:19:34.071 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.064+0000 7f3bddffb640 1 -- 10.20.193.110:0/3263947540 >> v1:10.20.193.188:6789/0 conn(0x7f3be0091950 legacy=0x7f3be01a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:34.071 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.064+0000 7f3bddffb640 1 -- 10.20.193.110:0/3263947540 >> v1:10.20.193.110:6789/0 conn(0x7f3be0092020 legacy=0x7f3be01812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:34.071 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.064+0000 7f3bddffb640 10 monclient: _finish_hunting 0 2026-02-13T20:19:34.071 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.064+0000 7f3bddffb640 1 monclient: found mon.noname-b 2026-02-13T20:19:34.071 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.064+0000 7f3bddffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:19:34.071 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.064+0000 7f3bddffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:19:34.071 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.064+0000 7f3bddffb640 1 -- 10.20.193.110:0/3263947540 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3be0140590 con 0x7f3be01401c0 2026-02-13T20:19:34.071 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.064+0000 7f3bddffb640 10 monclient: _finish_auth 0 2026-02-13T20:19:34.071 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.064+0000 7f3bddffb640 10 monclient: _check_auth_tickets 2026-02-13T20:19:34.071 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.064+0000 7f3bddffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:19:34.071 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.064+0000 7f3bddffb640 1 -- 10.20.193.110:0/3263947540 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f3bd4002dd0 con 0x7f3be01401c0 2026-02-13T20:19:34.072 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.064+0000 7f3bddffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:34.072 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.064+0000 7f3bddffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:19:34.072 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.064+0000 7f3bddffb640 10 monclient: dump: 2026-02-13T20:19:34.072 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:34.072 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:34.072 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:34.072 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:34.072 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:34.072 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:34.072 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:34.072 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:34.072 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:34.073 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:34.073 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.064+0000 7f3be59c2640 5 monclient: authenticate success, global_id 94295 2026-02-13T20:19:34.073 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.064+0000 7f3be59c2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:19:34.073 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.064+0000 7f3bddffb640 1 -- 10.20.193.110:0/3263947540 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3bd4003020 con 0x7f3be01401c0 2026-02-13T20:19:34.073 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.064+0000 7f3bddffb640 10 monclient: handle_config config(0 keys) 2026-02-13T20:19:34.073 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.064+0000 7f3bddffb640 1 -- 10.20.193.110:0/3263947540 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f3bd4003430 con 0x7f3be01401c0 2026-02-13T20:19:34.073 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.064+0000 7f3bddffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:34.073 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.064+0000 7f3bddffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:19:34.073 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.064+0000 7f3bddffb640 10 monclient: dump: 2026-02-13T20:19:34.073 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:34.073 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:34.074 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:34.074 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:34.074 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:34.074 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:34.074 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:34.074 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:34.074 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:34.074 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:34.074 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.064+0000 7f3be59c2640 10 monclient: get_monmap_and_config success 2026-02-13T20:19:34.074 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.064+0000 7f3be59c2640 4 set_mon_vals no callback set 2026-02-13T20:19:34.074 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.064+0000 7f3be59c2640 10 monclient: shutdown 2026-02-13T20:19:34.074 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.064+0000 7f3be59c2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:19:34.074 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.064+0000 7f3be59c2640 1 -- 10.20.193.110:0/3263947540 >> v1:10.20.193.110:6790/0 conn(0x7f3be01401c0 legacy=0x7f3be0091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:34.075 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.064+0000 7f3be59c2640 1 -- 10.20.193.110:0/3263947540 shutdown_connections 2026-02-13T20:19:34.075 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.064+0000 7f3be59c2640 1 -- 10.20.193.110:0/3263947540 >> 10.20.193.110:0/3263947540 conn(0x7f3be0054e90 msgr2=0x7f3be0058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:19:34.075 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.064+0000 7f3be59c2640 1 -- 10.20.193.110:0/3263947540 shutdown_connections 2026-02-13T20:19:34.075 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.064+0000 7f3be59c2640 1 -- 10.20.193.110:0/3263947540 wait complete. 2026-02-13T20:19:34.075 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.065+0000 7f3be59c2640 10 monclient: build_initial_monmap 2026-02-13T20:19:34.075 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.065+0000 7f3be59c2640 10 monclient: monmap: 2026-02-13T20:19:34.075 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:19:34.075 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:19:34.075 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:19:34.075 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:19:34.075 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:19:34.076 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:19:34.076 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:19:34.076 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:19:34.076 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:19:34.076 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:34.076 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.065+0000 7f3be59c2640 1 Processor -- start 2026-02-13T20:19:34.076 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.065+0000 7f3be59c2640 1 -- start start 2026-02-13T20:19:34.076 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.065+0000 7f3be59c2640 10 monclient: init 2026-02-13T20:19:34.076 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.065+0000 7f3be59c2640 10 monclient: _reopen_session rank -1 2026-02-13T20:19:34.076 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.065+0000 7f3be59c2640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:19:34.076 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.065+0000 7f3be59c2640 10 monclient(hunting): picked mon.noname-c con 0x7f3be0091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:19:34.076 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.065+0000 7f3be59c2640 10 monclient(hunting): picked mon.noname-a con 0x7f3be01401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:19:34.077 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.065+0000 7f3be59c2640 10 monclient(hunting): picked mon.noname-b con 0x7f3be013e9a0 addr v1:10.20.193.188:6789/0 2026-02-13T20:19:34.077 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.065+0000 7f3be59c2640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3be012f9b0 con 0x7f3be01401c0 2026-02-13T20:19:34.077 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.065+0000 7f3be59c2640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3be012e490 con 0x7f3be013e9a0 2026-02-13T20:19:34.077 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.065+0000 7f3be59c2640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3be012fc90 con 0x7f3be0091950 2026-02-13T20:19:34.077 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.065+0000 7f3be59c2640 10 monclient(hunting): _renew_subs 2026-02-13T20:19:34.077 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.065+0000 7f3be59c2640 10 monclient(hunting): authenticate will time out at 1135.755682s 2026-02-13T20:19:34.077 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.065+0000 7f3bdeffd640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f3be0091950 0x7f3be0150530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:37638/0 (socket says 10.20.193.110:37638) 2026-02-13T20:19:34.077 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.065+0000 7f3bdeffd640 1 -- 10.20.193.110:0/548266039 learned_addr learned my addr 10.20.193.110:0/548266039 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:19:34.077 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.066+0000 7f3bb7fff640 1 -- 10.20.193.110:0/548266039 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 390682513 0 0) 0x7f3be012e490 con 0x7f3be013e9a0 2026-02-13T20:19:34.077 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.066+0000 7f3bb7fff640 10 monclient(hunting): _negotiate 2026-02-13T20:19:34.077 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.066+0000 7f3bb7fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:34.077 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.066+0000 7f3bb7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:34.077 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.066+0000 7f3bb7fff640 10 monclient(hunting): my global_id is 4714 2026-02-13T20:19:34.078 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.066+0000 7f3bb7fff640 1 -- 10.20.193.110:0/548266039 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3bb00035e0 con 0x7f3be013e9a0 2026-02-13T20:19:34.078 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.066+0000 7f3bb7fff640 1 -- 10.20.193.110:0/548266039 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1053874991 0 0) 0x7f3bb00035e0 con 0x7f3be013e9a0 2026-02-13T20:19:34.078 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.066+0000 7f3bb7fff640 1 -- 10.20.193.110:0/548266039 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3be012e490 con 0x7f3be013e9a0 2026-02-13T20:19:34.078 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.066+0000 7f3bb7fff640 1 -- 10.20.193.110:0/548266039 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f3bd0004050 con 0x7f3be013e9a0 2026-02-13T20:19:34.078 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.066+0000 7f3bb7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:19:34.078 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.066+0000 7f3bb7fff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:19:34.078 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.066+0000 7f3bb7fff640 10 monclient(hunting): dump: 2026-02-13T20:19:34.078 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:34.078 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:34.078 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:34.078 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:34.079 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:34.079 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:34.079 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:34.079 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:34.079 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:34.079 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:34.079 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.066+0000 7f3bb7fff640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:19:34.079 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.067+0000 7f3bb7fff640 1 -- 10.20.193.110:0/548266039 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3555334402 0 0) 0x7f3be012e490 con 0x7f3be013e9a0 2026-02-13T20:19:34.079 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.067+0000 7f3bb7fff640 1 -- 10.20.193.110:0/548266039 >> v1:10.20.193.110:6790/0 conn(0x7f3be0091950 legacy=0x7f3be0150530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:34.079 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.067+0000 7f3bb7fff640 1 -- 10.20.193.110:0/548266039 >> v1:10.20.193.110:6789/0 conn(0x7f3be01401c0 legacy=0x7f3be013e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:34.079 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.067+0000 7f3bb7fff640 10 monclient: _finish_hunting 0 2026-02-13T20:19:34.080 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.067+0000 7f3bb7fff640 1 monclient: found mon.b 2026-02-13T20:19:34.080 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.067+0000 7f3bb7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:19:34.080 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.067+0000 7f3bb7fff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:19:34.080 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.067+0000 7f3bb7fff640 1 -- 10.20.193.110:0/548266039 --> v1:10.20.193.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3be012eb00 con 0x7f3be013e9a0 2026-02-13T20:19:34.080 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.067+0000 7f3bb7fff640 10 monclient: _finish_auth 0 2026-02-13T20:19:34.080 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.067+0000 7f3bb7fff640 10 monclient: _check_auth_tickets 2026-02-13T20:19:34.080 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.067+0000 7f3bb7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:19:34.080 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.067+0000 7f3be59c2640 5 monclient: authenticate success, global_id 4714 2026-02-13T20:19:34.080 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.067+0000 7f3be59c2640 10 monclient: _renew_subs 2026-02-13T20:19:34.080 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.067+0000 7f3be59c2640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:19:34.081 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.067+0000 7f3be59c2640 1 -- 10.20.193.110:0/548266039 --> v1:10.20.193.188:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3be012d930 con 0x7f3be013e9a0 2026-02-13T20:19:34.081 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.067+0000 7f3be59c2640 10 monclient: _renew_subs 2026-02-13T20:19:34.081 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.067+0000 7f3be59c2640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:19:34.081 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.067+0000 7f3be59c2640 1 -- 10.20.193.110:0/548266039 --> v1:10.20.193.188:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3be0193fc0 con 0x7f3be013e9a0 2026-02-13T20:19:34.081 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.067+0000 7f3bb7fff640 1 -- 10.20.193.110:0/548266039 <== mon.1 v1:10.20.193.188:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3bd0004220 con 0x7f3be013e9a0 2026-02-13T20:19:34.081 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.067+0000 7f3bb7fff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:19:34.081 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.067+0000 7f3bb7fff640 1 -- 10.20.193.110:0/548266039 <== mon.1 v1:10.20.193.188:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f3bd00045c0 con 0x7f3be013e9a0 2026-02-13T20:19:34.081 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.067+0000 7f3bb7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:34.081 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.067+0000 7f3bb7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:19:34.081 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.067+0000 7f3bdd7fa640 4 set_mon_vals no callback set 2026-02-13T20:19:34.081 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.067+0000 7f3bb7fff640 10 monclient: dump: 2026-02-13T20:19:34.082 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:34.082 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:34.082 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:34.082 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:34.082 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:34.082 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:34.082 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:34.082 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:34.082 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:34.082 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:34.082 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.067+0000 7f3be59c2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:19:34.083 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.067+0000 7f3be59c2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:19:34.083 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.067+0000 7f3be59c2640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:19:34.083 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.067+0000 7f3be59c2640 1 -- 10.20.193.110:0/548266039 --> v1:10.20.193.188:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3be012f590 con 0x7f3be013e9a0 2026-02-13T20:19:34.083 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.067+0000 7f3bb7fff640 1 -- 10.20.193.110:0/548266039 <== mon.1 v1:10.20.193.188:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f3bd0004720 con 0x7f3be013e9a0 2026-02-13T20:19:34.083 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.068+0000 7f3bb7fff640 1 -- 10.20.193.110:0/548266039 <== mon.1 v1:10.20.193.188:6789/0 8 ==== osd_map(391..391 src has 1..391) ==== 3987+0+0 (unknown 3318256201 0 0) 0x7f3bd004e640 con 0x7f3be013e9a0 2026-02-13T20:19:34.083 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.068+0000 7f3bdeffd640 10 monclient: get_auth_request con 0x7f3bb003f6f0 auth_method 0 2026-02-13T20:19:34.084 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.070+0000 7f3bb7fff640 1 -- 10.20.193.110:0/548266039 <== mon.1 v1:10.20.193.188:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f3bd0016d90 con 0x7f3be013e9a0 2026-02-13T20:19:34.084 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.070+0000 7f3bb7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:19:34.084 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.070+0000 7f3bb7fff640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:19:34.116 INFO:tasks.rados.rados.0.trial188.stdout:1849: done (1 left) 2026-02-13T20:19:34.117 INFO:tasks.rados.rados.0.trial188.stdout:1850: done (0 left) 2026-02-13T20:19:34.117 INFO:tasks.rados.rados.0.trial188.stdout:1851: snap_create 2026-02-13T20:19:34.213 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.212+0000 7f3be59c2640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T20:19:34.214 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.212+0000 7f3be59c2640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T20:19:34.214 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.212+0000 7f3be59c2640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:19:34.214 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.212+0000 7f3be59c2640 1 -- 10.20.193.110:0/548266039 --> v1:10.20.193.188:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3be0055bb0 con 0x7f3be013e9a0 2026-02-13T20:19:34.214 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.212+0000 7f3bb7fff640 1 -- 10.20.193.110:0/548266039 <== mon.1 v1:10.20.193.188:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 230157926) 0x7f3bd004b3b0 con 0x7f3be013e9a0 2026-02-13T20:19:34.214 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.212+0000 7f3bb7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T20:19:34.214 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.212+0000 7f3bb7fff640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:19:34.215 INFO:teuthology.orchestra.run.trial110.stdout:{"election_epoch":30,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","modified":"2026-02-13T20:11:07.161192Z","created":"2026-02-13T20:11:07.161192Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6789","nonce":0}]},"addr":"10.20.193.110:6789/0","public_addr":"10.20.193.110:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161241+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6789","nonce":0}]},"addr":"10.20.193.188:6789/0","public_addr":"10.20.193.188:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161242+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6790","nonce":0}]},"addr":"10.20.193.110:6790/0","public_addr":"10.20.193.110:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161243+0000","crush_location":[]}]}} 2026-02-13T20:19:34.216 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.213+0000 7f3be59c2640 1 -- 10.20.193.110:0/548266039 >> v1:10.20.193.188:6812/1623052694 conn(0x7f3bb003f6f0 legacy=0x7f3bb005fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:34.217 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.213+0000 7f3be59c2640 10 monclient: shutdown 2026-02-13T20:19:34.217 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.213+0000 7f3be59c2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:19:34.217 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.213+0000 7f3be59c2640 1 -- 10.20.193.110:0/548266039 >> v1:10.20.193.188:6789/0 conn(0x7f3be013e9a0 legacy=0x7f3be01928a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:34.217 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.213+0000 7f3be59c2640 1 -- 10.20.193.110:0/548266039 shutdown_connections 2026-02-13T20:19:34.217 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.213+0000 7f3be59c2640 1 -- 10.20.193.110:0/548266039 >> 10.20.193.110:0/548266039 conn(0x7f3be0054e90 msgr2=0x7f3be008d610 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:19:34.217 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.213+0000 7f3be59c2640 1 -- 10.20.193.110:0/548266039 shutdown_connections 2026-02-13T20:19:34.217 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:34.213+0000 7f3be59c2640 1 -- 10.20.193.110:0/548266039 wait complete. 2026-02-13T20:19:35.118 INFO:tasks.rados.rados.0.trial188.stdout:1851: done (0 left) 2026-02-13T20:19:35.118 INFO:tasks.rados.rados.0.trial188.stdout:1852: read oid 27 snap 183 2026-02-13T20:19:35.118 INFO:tasks.rados.rados.0.trial188.stdout:1852: expect (ObjNum 660 snap 178 seq_num 660) 2026-02-13T20:19:35.118 INFO:tasks.rados.rados.0.trial188.stdout:1853: snap_remove snap 188 2026-02-13T20:19:36.120 INFO:tasks.rados.rados.0.trial188.stdout:1853: done (1 left) 2026-02-13T20:19:36.120 INFO:tasks.rados.rados.0.trial188.stdout:1854: read oid 38 snap 181 2026-02-13T20:19:36.121 INFO:tasks.rados.rados.0.trial188.stdout:1854: expect (ObjNum 666 snap 180 seq_num 666) 2026-02-13T20:19:36.121 INFO:tasks.rados.rados.0.trial188.stdout:1855: read oid 30 snap -1 2026-02-13T20:19:36.121 INFO:tasks.rados.rados.0.trial188.stdout:1855: expect (ObjNum 635 snap 166 seq_num 635) 2026-02-13T20:19:36.121 INFO:tasks.rados.rados.0.trial188.stdout:1856: snap_remove snap 167 2026-02-13T20:19:37.121 INFO:tasks.rados.rados.0.trial188.stdout:1856: done (3 left) 2026-02-13T20:19:37.121 INFO:tasks.rados.rados.0.trial188.stdout:1857: read oid 32 snap -1 2026-02-13T20:19:37.121 INFO:tasks.rados.rados.0.trial188.stdout:1857: expect (ObjNum 653 snap 176 seq_num 653) 2026-02-13T20:19:37.121 INFO:tasks.rados.rados.0.trial188.stdout:1858: rollback oid 10 current snap is 189 2026-02-13T20:19:37.121 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 10 to 181 2026-02-13T20:19:37.121 INFO:tasks.rados.rados.0.trial188.stdout:1852: expect (ObjNum 660 snap 178 seq_num 660) 2026-02-13T20:19:37.145 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:19:37.172 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 921513 2026-02-13T20:19:37.187 INFO:tasks.rados.rados.0.trial188.stdout:1854: expect (ObjNum 666 snap 180 seq_num 666) 2026-02-13T20:19:37.223 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T20:19:37.239 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2138151 2026-02-13T20:19:37.251 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 90551 2026-02-13T20:19:37.289 INFO:tasks.rados.rados.0.trial188.stdout:1855: expect (ObjNum 635 snap 166 seq_num 635) 2026-02-13T20:19:37.296 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.288+0000 7fb0a97e5640 10 monclient: get_monmap_and_config 2026-02-13T20:19:37.296 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.288+0000 7fb0a97e5640 10 monclient: build_initial_monmap 2026-02-13T20:19:37.296 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.288+0000 7fb0a97e5640 10 monclient: monmap: 2026-02-13T20:19:37.297 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:19:37.297 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:37.297 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:19:37.288913+0000 2026-02-13T20:19:37.297 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:19:37.288913+0000 2026-02-13T20:19:37.297 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:19:37.297 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:37.297 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:19:37.297 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:19:37.297 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:19:37.297 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:37.297 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.288+0000 7fb0a97e5640 1 Processor -- start 2026-02-13T20:19:37.298 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.288+0000 7fb0a97e5640 1 -- start start 2026-02-13T20:19:37.298 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.288+0000 7fb0a97e5640 10 monclient: init 2026-02-13T20:19:37.298 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.289+0000 7fb0a97e5640 10 monclient: _reopen_session rank -1 2026-02-13T20:19:37.298 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.289+0000 7fb0a97e5640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:19:37.298 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.289+0000 7fb0a97e5640 10 monclient(hunting): picked mon.noname-b con 0x7fb0a41401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:19:37.298 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.289+0000 7fb0a97e5640 10 monclient(hunting): picked mon.noname-a con 0x7fb0a4092020 addr v1:10.20.193.110:6789/0 2026-02-13T20:19:37.298 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.289+0000 7fb0a97e5640 10 monclient(hunting): picked mon.noname-c con 0x7fb0a4091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:19:37.298 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.289+0000 7fb0a97e5640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0a408b730 con 0x7fb0a4092020 2026-02-13T20:19:37.298 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.289+0000 7fb0a97e5640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0a405c5b0 con 0x7fb0a4091950 2026-02-13T20:19:37.298 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.289+0000 7fb0a97e5640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0a408bcf0 con 0x7fb0a41401c0 2026-02-13T20:19:37.298 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.289+0000 7fb0a97e5640 10 monclient(hunting): _renew_subs 2026-02-13T20:19:37.298 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.289+0000 7fb0a97e5640 10 monclient(hunting): authenticate will time out at 1138.979290s 2026-02-13T20:19:37.299 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.289+0000 7fb0a2ffd640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fb0a41401c0 0x7fb0a4091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:37648/0 (socket says 10.20.193.110:37648) 2026-02-13T20:19:37.299 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.289+0000 7fb0a2ffd640 1 -- 10.20.193.110:0/2951655549 learned_addr learned my addr 10.20.193.110:0/2951655549 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:19:37.299 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.289+0000 7fb0a1ffb640 1 -- 10.20.193.110:0/2951655549 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 847014815 0 0) 0x7fb0a408b730 con 0x7fb0a4092020 2026-02-13T20:19:37.299 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.289+0000 7fb0a1ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:19:37.299 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.289+0000 7fb0a1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:37.299 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.289+0000 7fb0a1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:37.299 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.289+0000 7fb0a1ffb640 10 monclient(hunting): my global_id is 114117 2026-02-13T20:19:37.299 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.289+0000 7fb0a1ffb640 1 -- 10.20.193.110:0/2951655549 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0900035e0 con 0x7fb0a4092020 2026-02-13T20:19:37.299 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.289+0000 7fb0a1ffb640 1 -- 10.20.193.110:0/2951655549 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3981585558 0 0) 0x7fb0a408bcf0 con 0x7fb0a41401c0 2026-02-13T20:19:37.300 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.289+0000 7fb0a1ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:19:37.300 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.289+0000 7fb0a1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:37.300 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.289+0000 7fb0a1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:37.300 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.289+0000 7fb0a1ffb640 10 monclient(hunting): my global_id is 94298 2026-02-13T20:19:37.300 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.289+0000 7fb0a1ffb640 1 -- 10.20.193.110:0/2951655549 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0a408b730 con 0x7fb0a41401c0 2026-02-13T20:19:37.300 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.289+0000 7fb0a1ffb640 1 -- 10.20.193.110:0/2951655549 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3713278943 0 0) 0x7fb0900035e0 con 0x7fb0a4092020 2026-02-13T20:19:37.300 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.289+0000 7fb0a1ffb640 1 -- 10.20.193.110:0/2951655549 >> v1:10.20.193.110:6790/0 conn(0x7fb0a41401c0 legacy=0x7fb0a4091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:37.300 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.289+0000 7fb0a1ffb640 1 -- 10.20.193.110:0/2951655549 >> v1:10.20.193.188:6789/0 conn(0x7fb0a4091950 legacy=0x7fb0a41a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:37.300 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.289+0000 7fb0a1ffb640 10 monclient: _finish_hunting 0 2026-02-13T20:19:37.300 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.289+0000 7fb0a1ffb640 1 monclient: found mon.noname-a 2026-02-13T20:19:37.300 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.289+0000 7fb0a1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:19:37.301 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.289+0000 7fb0a1ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:19:37.301 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.289+0000 7fb0a1ffb640 1 -- 10.20.193.110:0/2951655549 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0a4140590 con 0x7fb0a4092020 2026-02-13T20:19:37.301 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.289+0000 7fb0a1ffb640 10 monclient: _finish_auth 0 2026-02-13T20:19:37.301 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.289+0000 7fb0a1ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:19:37.301 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.289+0000 7fb0a1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:19:37.301 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.289+0000 7fb0a1ffb640 1 -- 10.20.193.110:0/2951655549 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb08c002dd0 con 0x7fb0a4092020 2026-02-13T20:19:37.301 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.289+0000 7fb0a1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:37.301 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.289+0000 7fb0a1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:19:37.301 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.289+0000 7fb0a1ffb640 10 monclient: dump: 2026-02-13T20:19:37.301 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:37.301 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:37.301 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.302 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.302 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:37.302 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:37.302 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:37.302 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:37.302 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:37.302 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:37.302 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.289+0000 7fb0a97e5640 5 monclient: authenticate success, global_id 114117 2026-02-13T20:19:37.302 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.289+0000 7fb0a97e5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:19:37.302 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.289+0000 7fb0a1ffb640 1 -- 10.20.193.110:0/2951655549 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb08c002fe0 con 0x7fb0a4092020 2026-02-13T20:19:37.302 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.289+0000 7fb0a1ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T20:19:37.302 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.289+0000 7fb0a97e5640 10 monclient: get_monmap_and_config success 2026-02-13T20:19:37.303 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.289+0000 7fb0a97e5640 4 set_mon_vals no callback set 2026-02-13T20:19:37.303 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.289+0000 7fb0a1ffb640 1 -- 10.20.193.110:0/2951655549 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb08c0033b0 con 0x7fb0a4092020 2026-02-13T20:19:37.303 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.289+0000 7fb0a1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:37.303 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.289+0000 7fb0a1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:19:37.303 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.289+0000 7fb0a1ffb640 10 monclient: dump: 2026-02-13T20:19:37.303 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:37.303 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:37.303 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.303 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.303 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:37.303 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:37.303 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:37.303 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:37.304 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:37.304 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:37.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.290+0000 7fb0a97e5640 10 monclient: shutdown 2026-02-13T20:19:37.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.290+0000 7fb0a97e5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:19:37.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.290+0000 7fb0a97e5640 1 -- 10.20.193.110:0/2951655549 >> v1:10.20.193.110:6789/0 conn(0x7fb0a4092020 legacy=0x7fb0a41812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:37.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.290+0000 7fb0a97e5640 1 -- 10.20.193.110:0/2951655549 shutdown_connections 2026-02-13T20:19:37.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.290+0000 7fb0a97e5640 1 -- 10.20.193.110:0/2951655549 >> 10.20.193.110:0/2951655549 conn(0x7fb0a4054e90 msgr2=0x7fb0a4058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:19:37.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.290+0000 7fb0a97e5640 1 -- 10.20.193.110:0/2951655549 shutdown_connections 2026-02-13T20:19:37.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.290+0000 7fb0a97e5640 1 -- 10.20.193.110:0/2951655549 wait complete. 2026-02-13T20:19:37.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.290+0000 7fb0a97e5640 10 monclient: build_initial_monmap 2026-02-13T20:19:37.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.290+0000 7fb0a97e5640 10 monclient: monmap: 2026-02-13T20:19:37.305 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:19:37.305 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:19:37.305 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:19:37.305 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:19:37.305 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:19:37.305 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:19:37.305 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:19:37.305 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:19:37.305 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:19:37.305 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:37.305 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.290+0000 7fb0a97e5640 1 Processor -- start 2026-02-13T20:19:37.305 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.290+0000 7fb0a97e5640 1 -- start start 2026-02-13T20:19:37.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.290+0000 7fb0a97e5640 10 monclient: init 2026-02-13T20:19:37.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0a97e5640 10 monclient: _reopen_session rank -1 2026-02-13T20:19:37.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0a97e5640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:19:37.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0a97e5640 10 monclient(hunting): picked mon.noname-a con 0x7fb0a4091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:19:37.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0a97e5640 10 monclient(hunting): picked mon.noname-b con 0x7fb0a41401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:19:37.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0a97e5640 10 monclient(hunting): picked mon.noname-c con 0x7fb0a4114230 addr v1:10.20.193.110:6790/0 2026-02-13T20:19:37.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0a97e5640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0a408c310 con 0x7fb0a4091950 2026-02-13T20:19:37.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0a97e5640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0a405d320 con 0x7fb0a41401c0 2026-02-13T20:19:37.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0a97e5640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0a4114f60 con 0x7fb0a4114230 2026-02-13T20:19:37.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0a97e5640 10 monclient(hunting): _renew_subs 2026-02-13T20:19:37.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0a97e5640 10 monclient(hunting): authenticate will time out at 1138.981081s 2026-02-13T20:19:37.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0a2ffd640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fb0a4091950 0x7fb0a4114850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:52056/0 (socket says 10.20.193.110:52056) 2026-02-13T20:19:37.307 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0a2ffd640 1 -- 10.20.193.110:0/3815698027 learned_addr learned my addr 10.20.193.110:0/3815698027 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:19:37.307 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0a37fe640 1 --1- 10.20.193.110:0/3815698027 >> v1:10.20.193.110:6790/0 conn(0x7fb0a4114230 0x7fb0a41a2760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:37656/0 (socket says 10.20.193.110:37656) 2026-02-13T20:19:37.307 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0837fe640 1 -- 10.20.193.110:0/3815698027 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3239326332 0 0) 0x7fb0980029f0 con 0x7fb0a4091950 2026-02-13T20:19:37.307 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0837fe640 10 monclient(hunting): _negotiate 2026-02-13T20:19:37.307 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0837fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:37.307 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0837fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:37.307 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0837fe640 10 monclient(hunting): my global_id is 114120 2026-02-13T20:19:37.307 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0837fe640 1 -- 10.20.193.110:0/3815698027 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0700035e0 con 0x7fb0a4091950 2026-02-13T20:19:37.307 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0837fe640 1 -- 10.20.193.110:0/3815698027 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3183788680 0 0) 0x7fb0a4114f60 con 0x7fb0a4114230 2026-02-13T20:19:37.307 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0837fe640 10 monclient(hunting): _negotiate 2026-02-13T20:19:37.307 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0837fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:37.307 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0837fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:37.308 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0837fe640 10 monclient(hunting): my global_id is 94301 2026-02-13T20:19:37.308 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0837fe640 1 -- 10.20.193.110:0/3815698027 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0980029f0 con 0x7fb0a4114230 2026-02-13T20:19:37.308 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0837fe640 1 -- 10.20.193.110:0/3815698027 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4115342735 0 0) 0x7fb0700035e0 con 0x7fb0a4091950 2026-02-13T20:19:37.308 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0837fe640 1 -- 10.20.193.110:0/3815698027 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb0a4114f60 con 0x7fb0a4091950 2026-02-13T20:19:37.308 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0837fe640 1 -- 10.20.193.110:0/3815698027 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb098002c70 con 0x7fb0a4091950 2026-02-13T20:19:37.308 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0837fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:19:37.308 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0837fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:19:37.308 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0837fe640 10 monclient(hunting): dump: 2026-02-13T20:19:37.308 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:37.308 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:37.308 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.308 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.309 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:37.309 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:37.309 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:37.309 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:37.309 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:37.309 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:37.309 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0837fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:19:37.309 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0837fe640 1 -- 10.20.193.110:0/3815698027 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 542043200 0 0) 0x7fb0980029f0 con 0x7fb0a4114230 2026-02-13T20:19:37.309 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0837fe640 1 -- 10.20.193.110:0/3815698027 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb0700035e0 con 0x7fb0a4114230 2026-02-13T20:19:37.309 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0837fe640 1 -- 10.20.193.110:0/3815698027 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb094004110 con 0x7fb0a4114230 2026-02-13T20:19:37.309 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0837fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:19:37.310 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0837fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:19:37.310 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0837fe640 10 monclient(hunting): dump: 2026-02-13T20:19:37.310 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:37.310 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:37.310 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.310 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.310 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:37.310 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:37.310 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:37.311 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:37.311 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:37.311 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:37.311 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0837fe640 1 -- 10.20.193.110:0/3815698027 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2809099117 0 0) 0x7fb0a4114f60 con 0x7fb0a4091950 2026-02-13T20:19:37.311 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0837fe640 1 -- 10.20.193.110:0/3815698027 >> v1:10.20.193.110:6790/0 conn(0x7fb0a4114230 legacy=0x7fb0a41a2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:37.311 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0837fe640 1 -- 10.20.193.110:0/3815698027 >> v1:10.20.193.188:6789/0 conn(0x7fb0a41401c0 legacy=0x7fb0a41a1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:37.311 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0837fe640 10 monclient: _finish_hunting 0 2026-02-13T20:19:37.311 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0837fe640 1 monclient: found mon.a 2026-02-13T20:19:37.311 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0837fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:19:37.311 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0837fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:19:37.311 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0837fe640 1 -- 10.20.193.110:0/3815698027 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0a412d3d0 con 0x7fb0a4091950 2026-02-13T20:19:37.311 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0837fe640 10 monclient: _finish_auth 0 2026-02-13T20:19:37.312 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0837fe640 10 monclient: _check_auth_tickets 2026-02-13T20:19:37.312 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0837fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:19:37.312 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0a97e5640 5 monclient: authenticate success, global_id 114120 2026-02-13T20:19:37.312 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0a97e5640 10 monclient: _renew_subs 2026-02-13T20:19:37.312 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0a97e5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:19:37.312 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0a97e5640 1 -- 10.20.193.110:0/3815698027 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb0a412c1f0 con 0x7fb0a4091950 2026-02-13T20:19:37.312 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0a97e5640 10 monclient: _renew_subs 2026-02-13T20:19:37.312 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0a97e5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:19:37.312 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0a97e5640 1 -- 10.20.193.110:0/3815698027 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb0a41a3e80 con 0x7fb0a4091950 2026-02-13T20:19:37.312 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0837fe640 1 -- 10.20.193.110:0/3815698027 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb098002880 con 0x7fb0a4091950 2026-02-13T20:19:37.312 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0837fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:19:37.312 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0837fe640 1 -- 10.20.193.110:0/3815698027 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb098004d80 con 0x7fb0a4091950 2026-02-13T20:19:37.313 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0837fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:37.313 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0837fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:19:37.313 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0837fe640 10 monclient: dump: 2026-02-13T20:19:37.313 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:37.313 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:37.313 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.313 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.313 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:37.313 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:37.313 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:37.313 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:37.313 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:37.313 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:37.314 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.291+0000 7fb0a17fa640 4 set_mon_vals no callback set 2026-02-13T20:19:37.314 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.292+0000 7fb0a97e5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:19:37.314 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.292+0000 7fb0a97e5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:19:37.314 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.292+0000 7fb0a97e5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:19:37.314 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.292+0000 7fb0a97e5640 1 -- 10.20.193.110:0/3815698027 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0a412cce0 con 0x7fb0a4091950 2026-02-13T20:19:37.314 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.292+0000 7fb0837fe640 1 -- 10.20.193.110:0/3815698027 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fb0980119f0 con 0x7fb0a4091950 2026-02-13T20:19:37.314 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.292+0000 7fb0837fe640 1 -- 10.20.193.110:0/3815698027 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(395..395 src has 1..395) ==== 3975+0+0 (unknown 1949552152 0 0) 0x7fb09804e7d0 con 0x7fb0a4091950 2026-02-13T20:19:37.314 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.292+0000 7fb0a27fc640 10 monclient: get_auth_request con 0x7fb07003fac0 auth_method 0 2026-02-13T20:19:37.314 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.294+0000 7fb0837fe640 1 -- 10.20.193.110:0/3815698027 <== mon.0 v1:10.20.193.110:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fb098016f40 con 0x7fb0a4091950 2026-02-13T20:19:37.314 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.294+0000 7fb0837fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:19:37.314 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.294+0000 7fb0837fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:19:37.315 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2183154 2026-02-13T20:19:37.337 INFO:tasks.rados.rados.0.trial188.stdout:1858: finishing rollback tid 0 to trial18843701-10 2026-02-13T20:19:37.338 INFO:tasks.rados.rados.0.trial188.stdout:1857: expect (ObjNum 653 snap 176 seq_num 653) 2026-02-13T20:19:37.340 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 793446 2026-02-13T20:19:37.400 INFO:tasks.rados.rados.0.trial188.stdout:1858: finishing rollback tid 1 to trial18843701-10 2026-02-13T20:19:37.400 INFO:tasks.rados.rados.0.trial188.stdout:1858: finishing rollback tid 2 to trial18843701-10 2026-02-13T20:19:37.400 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 10 v 746 (ObjNum 596 snap 158 seq_num 596) dirty exists 2026-02-13T20:19:37.400 INFO:tasks.rados.rados.0.trial188.stdout:1852: done (4 left) 2026-02-13T20:19:37.401 INFO:tasks.rados.rados.0.trial188.stdout:1854: done (3 left) 2026-02-13T20:19:37.401 INFO:tasks.rados.rados.0.trial188.stdout:1855: done (2 left) 2026-02-13T20:19:37.401 INFO:tasks.rados.rados.0.trial188.stdout:1857: done (1 left) 2026-02-13T20:19:37.401 INFO:tasks.rados.rados.0.trial188.stdout:1858: done (0 left) 2026-02-13T20:19:37.401 INFO:tasks.rados.rados.0.trial188.stdout:1859: write oid 6 current snap is 189 2026-02-13T20:19:37.401 INFO:tasks.rados.rados.0.trial188.stdout:1859: seq_num 674 ranges {527918=556890,1657687=778569,3225803=102115} 2026-02-13T20:19:37.403 INFO:tasks.rados.rados.0.trial188.stdout:1859: writing trial18843701-6 from 527918 to 1084808 tid 1 2026-02-13T20:19:37.408 INFO:tasks.rados.rados.0.trial188.stdout:1859: writing trial18843701-6 from 1657687 to 2436256 tid 2 2026-02-13T20:19:37.412 INFO:tasks.rados.rados.0.trial188.stdout:1859: writing trial18843701-6 from 3225803 to 3327918 tid 3 2026-02-13T20:19:37.412 INFO:tasks.rados.rados.0.trial188.stdout:1860: read oid 50 snap -1 2026-02-13T20:19:37.412 INFO:tasks.rados.rados.0.trial188.stdout:1860: expect (ObjNum 564 snap 151 seq_num 564) 2026-02-13T20:19:37.413 INFO:tasks.rados.rados.0.trial188.stdout:1861: read oid 47 snap -1 2026-02-13T20:19:37.413 INFO:tasks.rados.rados.0.trial188.stdout:1861: expect (ObjNum 489 snap 127 seq_num 489) 2026-02-13T20:19:37.413 INFO:tasks.rados.rados.0.trial188.stdout:1862: copy_from oid 10 from oid 13 current snap is 189 2026-02-13T20:19:37.413 INFO:tasks.rados.rados.0.trial188.stdout:1863: snap_create 2026-02-13T20:19:37.413 INFO:tasks.rados.rados.0.trial188.stdout:1861: expect (ObjNum 489 snap 127 seq_num 489) 2026-02-13T20:19:37.442 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2025175 2026-02-13T20:19:37.444 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.443+0000 7fb0a97e5640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T20:19:37.444 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.443+0000 7fb0a97e5640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T20:19:37.444 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.443+0000 7fb0a97e5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:19:37.444 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.443+0000 7fb0a97e5640 1 -- 10.20.193.110:0/3815698027 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb0a408c310 con 0x7fb0a4091950 2026-02-13T20:19:37.444 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.443+0000 7fb0837fe640 1 -- 10.20.193.110:0/3815698027 <== mon.0 v1:10.20.193.110:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 2962582551) 0x7fb0a408c310 con 0x7fb0a4091950 2026-02-13T20:19:37.444 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.443+0000 7fb0837fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T20:19:37.444 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.443+0000 7fb0837fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:19:37.445 INFO:teuthology.orchestra.run.trial110.stdout:{"election_epoch":32,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","modified":"2026-02-13T20:11:07.161192Z","created":"2026-02-13T20:11:07.161192Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6789","nonce":0}]},"addr":"10.20.193.110:6789/0","public_addr":"10.20.193.110:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161241+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6789","nonce":0}]},"addr":"10.20.193.188:6789/0","public_addr":"10.20.193.188:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161242+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6790","nonce":0}]},"addr":"10.20.193.110:6790/0","public_addr":"10.20.193.110:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161243+0000","crush_location":[]}]}} 2026-02-13T20:19:37.446 INFO:tasks.rados.rados.0.trial188.stdout:1859: finishing write tid 1 to trial18843701-6 2026-02-13T20:19:37.446 INFO:tasks.rados.rados.0.trial188.stdout:1859: finishing write tid 2 to trial18843701-6 2026-02-13T20:19:37.447 INFO:tasks.rados.rados.0.trial188.stdout:1859: finishing write tid 3 to trial18843701-6 2026-02-13T20:19:37.447 INFO:tasks.rados.rados.0.trial188.stdout:1859: finishing write tid 4 to trial18843701-6 2026-02-13T20:19:37.447 INFO:tasks.rados.rados.0.trial188.stdout:1859: finishing write tid 5 to trial18843701-6 2026-02-13T20:19:37.447 INFO:tasks.rados.rados.0.trial188.stdout:1859: oid 6 updating version 0 to 808 2026-02-13T20:19:37.447 INFO:tasks.rados.rados.0.trial188.stdout:1859: oid 6 version 808 is already newer than 806 2026-02-13T20:19:37.447 INFO:tasks.rados.rados.0.trial188.stdout:1859: oid 6 version 808 is already newer than 807 2026-02-13T20:19:37.447 INFO:tasks.rados.rados.0.trial188.stdout:1859: oid 6 version 808 is already newer than 805 2026-02-13T20:19:37.447 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 6 v 808 (ObjNum 674 snap 189 seq_num 674) dirty exists 2026-02-13T20:19:37.447 INFO:tasks.rados.rados.0.trial188.stdout:1859: left oid 6 (ObjNum 674 snap 189 seq_num 674) 2026-02-13T20:19:37.448 INFO:tasks.rados.rados.0.trial188.stdout:1860: expect (ObjNum 564 snap 151 seq_num 564) 2026-02-13T20:19:37.448 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 72648 2026-02-13T20:19:37.448 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.445+0000 7fb0a97e5640 1 -- 10.20.193.110:0/3815698027 >> v1:10.20.193.188:6812/1623052694 conn(0x7fb07003fac0 legacy=0x7fb07005ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:37.448 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.445+0000 7fb0a97e5640 10 monclient: shutdown 2026-02-13T20:19:37.448 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.445+0000 7fb0a97e5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:19:37.448 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.445+0000 7fb0a97e5640 1 -- 10.20.193.110:0/3815698027 >> v1:10.20.193.110:6789/0 conn(0x7fb0a4091950 legacy=0x7fb0a4114850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:37.448 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.445+0000 7fb0a97e5640 1 -- 10.20.193.110:0/3815698027 shutdown_connections 2026-02-13T20:19:37.448 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.445+0000 7fb0a97e5640 1 -- 10.20.193.110:0/3815698027 >> 10.20.193.110:0/3815698027 conn(0x7fb0a4054e90 msgr2=0x7fb0a408dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:19:37.449 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.445+0000 7fb0a97e5640 1 -- 10.20.193.110:0/3815698027 shutdown_connections 2026-02-13T20:19:37.449 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.445+0000 7fb0a97e5640 1 -- 10.20.193.110:0/3815698027 wait complete. 2026-02-13T20:19:37.454 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-13T20:19:37.454 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-13T20:19:37.454 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T20:19:37.514 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1873871 2026-02-13T20:19:37.519 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.518+0000 7f518b683640 10 monclient: get_monmap_and_config 2026-02-13T20:19:37.519 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.518+0000 7f518b683640 10 monclient: build_initial_monmap 2026-02-13T20:19:37.519 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.518+0000 7f518b683640 10 monclient: monmap: 2026-02-13T20:19:37.519 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:19:37.519 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:37.519 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:19:37.519392+0000 2026-02-13T20:19:37.519 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:19:37.519392+0000 2026-02-13T20:19:37.519 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:19:37.519 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:37.519 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:19:37.519 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:19:37.519 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:19:37.519 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:37.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.519+0000 7f518b683640 1 Processor -- start 2026-02-13T20:19:37.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.519+0000 7f518b683640 1 -- start start 2026-02-13T20:19:37.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.519+0000 7f518b683640 10 monclient: init 2026-02-13T20:19:37.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.519+0000 7f518b683640 10 monclient: _reopen_session rank -1 2026-02-13T20:19:37.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.519+0000 7f518b683640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:19:37.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.519+0000 7f518b683640 10 monclient(hunting): picked mon.noname-c con 0x7f5184140180 addr v1:10.20.193.188:6789/0 2026-02-13T20:19:37.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.519+0000 7f518b683640 10 monclient(hunting): picked mon.noname-a con 0x7f518405ca00 addr v1:10.20.193.110:6789/0 2026-02-13T20:19:37.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.519+0000 7f518b683640 10 monclient(hunting): picked mon.noname-b con 0x7f518408be90 addr v1:10.20.193.110:6790/0 2026-02-13T20:19:37.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.519+0000 7f518b683640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f518408b160 con 0x7f518405ca00 2026-02-13T20:19:37.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.519+0000 7f518b683640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f518405bb90 con 0x7f5184140180 2026-02-13T20:19:37.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.519+0000 7f518b683640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f518408b440 con 0x7f518408be90 2026-02-13T20:19:37.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.519+0000 7f518b683640 10 monclient(hunting): _renew_subs 2026-02-13T20:19:37.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.519+0000 7f518b683640 10 monclient(hunting): authenticate will time out at 1139.209781s 2026-02-13T20:19:37.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.519+0000 7f5189e80640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f518405ca00 0x7f5184180f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:52072/0 (socket says 10.20.193.110:52072) 2026-02-13T20:19:37.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.519+0000 7f5189e80640 1 -- 10.20.193.110:0/1661293973 learned_addr learned my addr 10.20.193.110:0/1661293973 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:19:37.528 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.520+0000 7f518967f640 1 -- 10.20.193.110:0/1661293973 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4124193598 0 0) 0x7f518408b160 con 0x7f518405ca00 2026-02-13T20:19:37.528 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.520+0000 7f518967f640 10 monclient(hunting): _negotiate 2026-02-13T20:19:37.528 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.520+0000 7f518967f640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:37.528 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.520+0000 7f518967f640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:37.528 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.520+0000 7f518967f640 10 monclient(hunting): my global_id is 114123 2026-02-13T20:19:37.528 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.520+0000 7f518967f640 1 -- 10.20.193.110:0/1661293973 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51740035e0 con 0x7f518405ca00 2026-02-13T20:19:37.528 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.520+0000 7f518967f640 1 -- 10.20.193.110:0/1661293973 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2031569796 0 0) 0x7f518408b440 con 0x7f518408be90 2026-02-13T20:19:37.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.520+0000 7f518967f640 10 monclient(hunting): _negotiate 2026-02-13T20:19:37.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.520+0000 7f518967f640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:37.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.520+0000 7f518967f640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:37.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.520+0000 7f518967f640 10 monclient(hunting): my global_id is 94304 2026-02-13T20:19:37.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.520+0000 7f518967f640 1 -- 10.20.193.110:0/1661293973 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f518408b160 con 0x7f518408be90 2026-02-13T20:19:37.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.520+0000 7f518967f640 1 -- 10.20.193.110:0/1661293973 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3193202978 0 0) 0x7f51740035e0 con 0x7f518405ca00 2026-02-13T20:19:37.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.520+0000 7f518967f640 1 -- 10.20.193.110:0/1661293973 >> v1:10.20.193.110:6790/0 conn(0x7f518408be90 legacy=0x7f51841a26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:37.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.520+0000 7f518967f640 1 -- 10.20.193.110:0/1661293973 >> v1:10.20.193.188:6789/0 conn(0x7f5184140180 legacy=0x7f5184140550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T20:19:37.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.520+0000 7f518967f640 10 monclient: _finish_hunting 0 2026-02-13T20:19:37.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.520+0000 7f518967f640 1 monclient: found mon.noname-a 2026-02-13T20:19:37.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.520+0000 7f518967f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:19:37.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.520+0000 7f518967f640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:19:37.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.520+0000 7f518967f640 1 -- 10.20.193.110:0/1661293973 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f518405bfe0 con 0x7f518405ca00 2026-02-13T20:19:37.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.520+0000 7f518967f640 10 monclient: _finish_auth 0 2026-02-13T20:19:37.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.520+0000 7f518967f640 10 monclient: _check_auth_tickets 2026-02-13T20:19:37.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.520+0000 7f518967f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:19:37.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.520+0000 7f518967f640 1 -- 10.20.193.110:0/1661293973 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f5170002dd0 con 0x7f518405ca00 2026-02-13T20:19:37.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.520+0000 7f518967f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:37.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.520+0000 7f518967f640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:19:37.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.520+0000 7f518967f640 10 monclient: dump: 2026-02-13T20:19:37.530 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:37.530 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:37.531 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.531 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.531 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:37.531 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:37.531 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:37.531 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:37.531 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:37.531 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:37.531 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.520+0000 7f518b683640 5 monclient: authenticate success, global_id 114123 2026-02-13T20:19:37.531 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.520+0000 7f518b683640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:19:37.531 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.520+0000 7f518967f640 1 -- 10.20.193.110:0/1661293973 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5170003020 con 0x7f518405ca00 2026-02-13T20:19:37.531 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.520+0000 7f518967f640 10 monclient: handle_config config(0 keys) 2026-02-13T20:19:37.532 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.520+0000 7f518967f640 1 -- 10.20.193.110:0/1661293973 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f5170003430 con 0x7f518405ca00 2026-02-13T20:19:37.532 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.520+0000 7f518967f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:37.532 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.520+0000 7f518967f640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:19:37.532 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.520+0000 7f518967f640 10 monclient: dump: 2026-02-13T20:19:37.532 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:37.532 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:37.532 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.532 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.532 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:37.532 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:37.532 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:37.532 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:37.533 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:37.533 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:37.533 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.520+0000 7f518b683640 10 monclient: get_monmap_and_config success 2026-02-13T20:19:37.533 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.520+0000 7f518b683640 4 set_mon_vals no callback set 2026-02-13T20:19:37.533 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.520+0000 7f518b683640 10 monclient: shutdown 2026-02-13T20:19:37.533 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.520+0000 7f518b683640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:19:37.533 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.520+0000 7f518b683640 1 -- 10.20.193.110:0/1661293973 >> v1:10.20.193.110:6789/0 conn(0x7f518405ca00 legacy=0x7f5184180f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:37.533 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.520+0000 7f518b683640 1 -- 10.20.193.110:0/1661293973 shutdown_connections 2026-02-13T20:19:37.533 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.520+0000 7f518b683640 1 -- 10.20.193.110:0/1661293973 >> 10.20.193.110:0/1661293973 conn(0x7f5184054d30 msgr2=0x7f5184058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:19:37.533 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.520+0000 7f518b683640 1 -- 10.20.193.110:0/1661293973 shutdown_connections 2026-02-13T20:19:37.533 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.520+0000 7f518b683640 1 -- 10.20.193.110:0/1661293973 wait complete. 2026-02-13T20:19:37.533 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.521+0000 7f518b683640 10 monclient: build_initial_monmap 2026-02-13T20:19:37.534 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.521+0000 7f518b683640 10 monclient: monmap: 2026-02-13T20:19:37.534 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:19:37.534 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:19:37.534 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:19:37.534 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:19:37.534 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:19:37.534 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:19:37.534 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:19:37.534 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:19:37.534 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:19:37.534 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:37.534 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.521+0000 7f518b683640 1 Processor -- start 2026-02-13T20:19:37.534 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.521+0000 7f518b683640 1 -- start start 2026-02-13T20:19:37.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.521+0000 7f518b683640 10 monclient: init 2026-02-13T20:19:37.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.521+0000 7f518b683640 10 monclient: _reopen_session rank -1 2026-02-13T20:19:37.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.521+0000 7f518b683640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:19:37.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.521+0000 7f518b683640 10 monclient(hunting): picked mon.noname-b con 0x7f518408be90 addr v1:10.20.193.188:6789/0 2026-02-13T20:19:37.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.521+0000 7f518b683640 10 monclient(hunting): picked mon.noname-a con 0x7f5184140180 addr v1:10.20.193.110:6789/0 2026-02-13T20:19:37.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.521+0000 7f518b683640 10 monclient(hunting): picked mon.noname-c con 0x7f5184089e70 addr v1:10.20.193.110:6790/0 2026-02-13T20:19:37.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.521+0000 7f518b683640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f518413f5f0 con 0x7f5184140180 2026-02-13T20:19:37.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.521+0000 7f518b683640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f518408ac60 con 0x7f518408be90 2026-02-13T20:19:37.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.521+0000 7f518b683640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5184111320 con 0x7f5184089e70 2026-02-13T20:19:37.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.521+0000 7f518b683640 10 monclient(hunting): _renew_subs 2026-02-13T20:19:37.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.521+0000 7f518b683640 10 monclient(hunting): authenticate will time out at 1139.211595s 2026-02-13T20:19:37.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.521+0000 7f5189e80640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f5184140180 0x7f51841a0580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:52076/0 (socket says 10.20.193.110:52076) 2026-02-13T20:19:37.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.521+0000 7f5189e80640 1 -- 10.20.193.110:0/1946613712 learned_addr learned my addr 10.20.193.110:0/1946613712 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:19:37.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.521+0000 7f516effd640 1 -- 10.20.193.110:0/1946613712 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3159899816 0 0) 0x7f5184111320 con 0x7f5184089e70 2026-02-13T20:19:37.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.521+0000 7f516effd640 10 monclient(hunting): _negotiate 2026-02-13T20:19:37.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.521+0000 7f516effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:37.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.521+0000 7f516effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:37.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.521+0000 7f516effd640 10 monclient(hunting): my global_id is 94307 2026-02-13T20:19:37.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.521+0000 7f516effd640 1 -- 10.20.193.110:0/1946613712 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51540035e0 con 0x7f5184089e70 2026-02-13T20:19:37.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.521+0000 7f516effd640 1 -- 10.20.193.110:0/1946613712 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 709688384 0 0) 0x7f518413f5f0 con 0x7f5184140180 2026-02-13T20:19:37.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.521+0000 7f516effd640 10 monclient(hunting): _negotiate 2026-02-13T20:19:37.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.521+0000 7f516effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:37.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.521+0000 7f516effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:37.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.521+0000 7f516effd640 10 monclient(hunting): my global_id is 114126 2026-02-13T20:19:37.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.521+0000 7f516effd640 1 -- 10.20.193.110:0/1946613712 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5184111320 con 0x7f5184140180 2026-02-13T20:19:37.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.521+0000 7f516effd640 1 -- 10.20.193.110:0/1946613712 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3329109 0 0) 0x7f51540035e0 con 0x7f5184089e70 2026-02-13T20:19:37.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.521+0000 7f516effd640 1 -- 10.20.193.110:0/1946613712 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f518413f5f0 con 0x7f5184089e70 2026-02-13T20:19:37.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f516effd640 1 -- 10.20.193.110:0/1946613712 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f5178004170 con 0x7f5184089e70 2026-02-13T20:19:37.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f516effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:19:37.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f516effd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:19:37.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f516effd640 10 monclient(hunting): dump: 2026-02-13T20:19:37.537 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:37.537 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:37.538 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.538 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.538 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:37.538 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:37.538 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:37.538 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:37.538 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:37.538 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:37.538 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f516effd640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:19:37.538 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f516effd640 1 -- 10.20.193.110:0/1946613712 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 100155976 0 0) 0x7f518408ac60 con 0x7f518408be90 2026-02-13T20:19:37.538 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f516effd640 10 monclient(hunting): _negotiate 2026-02-13T20:19:37.538 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f516effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:37.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f516effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:37.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f516effd640 10 monclient(hunting): my global_id is 4723 2026-02-13T20:19:37.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f516effd640 1 -- 10.20.193.110:0/1946613712 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51540035e0 con 0x7f518408be90 2026-02-13T20:19:37.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f516effd640 1 -- 10.20.193.110:0/1946613712 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2823775520 0 0) 0x7f5184111320 con 0x7f5184140180 2026-02-13T20:19:37.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f516effd640 1 -- 10.20.193.110:0/1946613712 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f518408ac60 con 0x7f5184140180 2026-02-13T20:19:37.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f516effd640 1 -- 10.20.193.110:0/1946613712 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f5170003340 con 0x7f5184140180 2026-02-13T20:19:37.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f516effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:19:37.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f516effd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:19:37.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f516effd640 10 monclient(hunting): dump: 2026-02-13T20:19:37.539 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:37.539 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:37.540 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.540 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.540 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:37.540 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:37.540 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:37.540 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:37.540 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:37.540 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:37.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f516effd640 1 -- 10.20.193.110:0/1946613712 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1829083591 0 0) 0x7f518413f5f0 con 0x7f5184089e70 2026-02-13T20:19:37.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f516effd640 1 -- 10.20.193.110:0/1946613712 >> v1:10.20.193.188:6789/0 conn(0x7f518408be90 legacy=0x7f51841312f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:37.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f516effd640 1 -- 10.20.193.110:0/1946613712 >> v1:10.20.193.110:6789/0 conn(0x7f5184140180 legacy=0x7f51841a0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:37.541 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f516effd640 10 monclient: _finish_hunting 0 2026-02-13T20:19:37.541 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f516effd640 1 monclient: found mon.c 2026-02-13T20:19:37.541 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f516effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:19:37.541 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f516effd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:19:37.541 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f516effd640 1 -- 10.20.193.110:0/1946613712 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f518405d320 con 0x7f5184089e70 2026-02-13T20:19:37.541 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f516effd640 10 monclient: _finish_auth 0 2026-02-13T20:19:37.541 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f516effd640 10 monclient: _check_auth_tickets 2026-02-13T20:19:37.541 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f516effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:19:37.541 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f518b683640 5 monclient: authenticate success, global_id 94307 2026-02-13T20:19:37.541 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f518b683640 10 monclient: _renew_subs 2026-02-13T20:19:37.541 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f518b683640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:19:37.541 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f518b683640 1 -- 10.20.193.110:0/1946613712 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f518408a820 con 0x7f5184089e70 2026-02-13T20:19:37.541 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f518b683640 10 monclient: _renew_subs 2026-02-13T20:19:37.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f518b683640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:19:37.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f518b683640 1 -- 10.20.193.110:0/1946613712 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f518410fb20 con 0x7f5184089e70 2026-02-13T20:19:37.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f516effd640 1 -- 10.20.193.110:0/1946613712 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f51780047b0 con 0x7f5184089e70 2026-02-13T20:19:37.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f516effd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:19:37.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f516effd640 1 -- 10.20.193.110:0/1946613712 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f5178004ad0 con 0x7f5184089e70 2026-02-13T20:19:37.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f516effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:37.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f516effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:19:37.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f5188e7e640 4 set_mon_vals no callback set 2026-02-13T20:19:37.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f516effd640 10 monclient: dump: 2026-02-13T20:19:37.542 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:37.542 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:37.542 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.543 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.543 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:37.543 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:37.543 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:37.543 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:37.543 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:37.543 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:37.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f518b683640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:19:37.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f518b683640 1 -- 10.20.193.110:0/1946613712 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5184090550 con 0x7f518405ca00 2026-02-13T20:19:37.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f516effd640 1 -- 10.20.193.110:0/1946613712 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2670537633 0 0) 0x7f5184090550 con 0x7f518405ca00 2026-02-13T20:19:37.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f516effd640 10 monclient(hunting): _negotiate 2026-02-13T20:19:37.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f516effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:37.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f516effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:37.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f516effd640 10 monclient(hunting): my global_id is 114129 2026-02-13T20:19:37.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f516effd640 1 -- 10.20.193.110:0/1946613712 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f518413f5f0 con 0x7f518405ca00 2026-02-13T20:19:37.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.522+0000 7f516effd640 1 -- 10.20.193.110:0/1946613712 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f5178011740 con 0x7f5184089e70 2026-02-13T20:19:37.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.523+0000 7f516effd640 1 -- 10.20.193.110:0/1946613712 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(395..395 src has 1..395) ==== 3975+0+0 (unknown 1949552152 0 0) 0x7f517804e780 con 0x7f5184089e70 2026-02-13T20:19:37.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.523+0000 7f516effd640 1 -- 10.20.193.110:0/1946613712 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2348142919 0 0) 0x7f518413f5f0 con 0x7f518405ca00 2026-02-13T20:19:37.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.523+0000 7f516effd640 1 -- 10.20.193.110:0/1946613712 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5184090550 con 0x7f518405ca00 2026-02-13T20:19:37.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.523+0000 7f516effd640 1 -- 10.20.193.110:0/1946613712 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f517c002c00 con 0x7f518405ca00 2026-02-13T20:19:37.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.523+0000 7f516effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:37.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.523+0000 7f516effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:19:37.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.523+0000 7f516effd640 10 monclient: dump: 2026-02-13T20:19:37.545 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:37.545 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:37.545 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.545 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.545 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:37.545 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:37.545 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:37.545 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:37.545 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:37.545 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:37.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.523+0000 7f5189e80640 10 monclient: get_auth_request con 0x7f515403fcf0 auth_method 0 2026-02-13T20:19:37.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.523+0000 7f516effd640 1 -- 10.20.193.110:0/1946613712 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4042662969 0 0) 0x7f5184090550 con 0x7f518405ca00 2026-02-13T20:19:37.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.523+0000 7f516effd640 1 -- 10.20.193.110:0/1946613712 --> v1:10.20.193.110:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f518408a310 con 0x7f518405ca00 2026-02-13T20:19:37.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.523+0000 7f516effd640 1 -- 10.20.193.110:0/1946613712 <== mon.0 v1:10.20.193.110:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f517c0031a0 con 0x7f518405ca00 2026-02-13T20:19:37.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.523+0000 7f516effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:19:37.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.523+0000 7f516effd640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:19:37.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.523+0000 7f516effd640 1 -- 10.20.193.110:0/1946613712 >> v1:10.20.193.110:6789/0 conn(0x7f518405ca00 legacy=0x7f518408ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:37.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.523+0000 7f516effd640 1 -- 10.20.193.110:0/1946613712 >> v1:10.20.193.110:6789/0 conn(0x7f518405ca00 legacy=0x7f518408ee30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:19:37.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.526+0000 7f518b683640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:19:37.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.526+0000 7f518b683640 1 -- 10.20.193.110:0/1946613712 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5184055bb0 con 0x7f51841a3b80 2026-02-13T20:19:37.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.526+0000 7f516effd640 1 -- 10.20.193.110:0/1946613712 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2354956866 0 0) 0x7f5184055bb0 con 0x7f51841a3b80 2026-02-13T20:19:37.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.526+0000 7f516effd640 10 monclient(hunting): _negotiate 2026-02-13T20:19:37.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.526+0000 7f516effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:37.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.526+0000 7f516effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:37.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.526+0000 7f516effd640 10 monclient(hunting): my global_id is 114132 2026-02-13T20:19:37.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.526+0000 7f516effd640 1 -- 10.20.193.110:0/1946613712 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5184090550 con 0x7f51841a3b80 2026-02-13T20:19:37.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.527+0000 7f516effd640 1 -- 10.20.193.110:0/1946613712 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2698323832 0 0) 0x7f5184090550 con 0x7f51841a3b80 2026-02-13T20:19:37.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.527+0000 7f516effd640 1 -- 10.20.193.110:0/1946613712 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5184055bb0 con 0x7f51841a3b80 2026-02-13T20:19:37.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.527+0000 7f516effd640 1 -- 10.20.193.110:0/1946613712 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f517c003a40 con 0x7f51841a3b80 2026-02-13T20:19:37.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.527+0000 7f516effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:37.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.527+0000 7f516effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:19:37.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.527+0000 7f516effd640 10 monclient: dump: 2026-02-13T20:19:37.546 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:37.546 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:37.546 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.546 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.546 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:37.546 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:37.546 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:37.546 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:37.546 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:37.547 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:37.547 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.527+0000 7f516effd640 1 -- 10.20.193.110:0/1946613712 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 457254998 0 0) 0x7f5184055bb0 con 0x7f51841a3b80 2026-02-13T20:19:37.547 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.527+0000 7f516effd640 1 -- 10.20.193.110:0/1946613712 --> v1:10.20.193.110:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5184058410 con 0x7f51841a3b80 2026-02-13T20:19:37.547 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.527+0000 7f516effd640 1 -- 10.20.193.110:0/1946613712 <== mon.0 v1:10.20.193.110:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4346 (unknown 0 0 2082856393) 0x7f517c003e60 con 0x7f51841a3b80 2026-02-13T20:19:37.547 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.527+0000 7f516effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:19:37.547 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.527+0000 7f516effd640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:19:37.547 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.527+0000 7f516effd640 1 -- 10.20.193.110:0/1946613712 >> v1:10.20.193.110:6789/0 conn(0x7f51841a3b80 legacy=0x7f5184132390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:37.547 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.527+0000 7f516effd640 1 -- 10.20.193.110:0/1946613712 >> v1:10.20.193.110:6789/0 conn(0x7f51841a3b80 legacy=0x7f5184132390 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:19:37.547 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:19:37.547 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:19:37.547 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:19:37.547 INFO:teuthology.orchestra.run.trial110.stdout: "state": "peon", 2026-02-13T20:19:37.547 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 32, 2026-02-13T20:19:37.547 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 29414, 2026-02-13T20:19:37.547 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:19:37.547 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:19:37.547 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:19:37.548 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:19:37.548 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:19:37.548 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 0, 2026-02-13T20:19:37.548 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:19:37.548 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:19:37.548 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:19:37.548 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:19:37.548 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:19:37.548 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:19:37.548 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:19:37.548 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:19:37.548 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:19:37.548 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:19:37.548 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:19:37.548 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:19:37.548 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:19:37.548 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:19:37.548 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:19:37.548 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:19:37.548 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:19:37.548 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:19:37.548 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:19:37.548 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:19:37.548 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:19:37.548 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:19:37.548 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:19:37.549 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:19:37.549 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:19:37.549 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:19:37.549 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:19:37.549 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:19:37.549 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:19:37.549 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:19:37.549 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:19:37.549 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:19:37.549 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:19:37.549 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:37.549 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:19:37.549 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:19:37.549 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:19:37.549 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:19:37.549 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:19:37.549 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:19:37.549 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:19:37.549 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:19:37.549 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:19:37.549 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:19:37.549 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:19:37.549 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:19:37.549 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:19:37.549 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:19:37.549 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:19:37.549 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:19:37.550 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:19:37.550 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:19:37.550 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:19:37.550 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:19:37.550 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:19:37.550 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:19:37.550 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:19:37.550 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:19:37.550 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:19:37.550 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:19:37.550 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:19:37.550 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:19:37.550 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:19:37.550 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:19:37.550 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:19:37.550 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:19:37.550 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:37.550 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:19:37.550 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:37.550 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:19:37.550 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:19:37.550 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:19:37.550 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:19:37.550 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:37.550 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:19:37.550 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:19:37.550 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:19:37.550 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:37.551 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:19:37.551 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:37.551 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:19:37.551 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:19:37.551 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:19:37.551 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:19:37.551 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:19:37.551 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:19:37.551 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:37.551 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:37.551 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:19:37.551 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:19:37.551 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:19:37.551 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:19:37.551 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:37.551 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:19:37.551 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:19:37.551 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:19:37.551 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:37.551 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:19:37.551 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:37.551 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:19:37.551 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:19:37.551 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:19:37.551 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:19:37.551 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:19:37.552 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:19:37.552 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:37.552 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:37.552 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:19:37.552 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:19:37.552 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:19:37.552 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:19:37.552 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:37.552 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:19:37.552 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:19:37.552 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:19:37.552 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:37.552 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:19:37.552 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:37.552 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:19:37.552 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:19:37.552 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:19:37.553 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:19:37.553 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:19:37.553 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:19:37.553 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:37.553 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:19:37.553 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:37.553 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:19:37.553 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:19:37.553 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:37.553 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:19:37.553 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:19:37.553 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:19:37.554 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:37.554 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:19:37.554 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:19:37.554 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:37.554 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:19:37.554 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:19:37.554 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:19:37.554 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:37.554 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:19:37.554 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:37.554 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:19:37.554 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:19:37.556 INFO:tasks.rados.rados.0.trial188.stdout:1862: finishing copy_from racing read to trial18843701-10 2026-02-13T20:19:37.556 INFO:tasks.rados.rados.0.trial188.stdout:1862: finishing copy_from to trial18843701-10 2026-02-13T20:19:37.556 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 10 v 670 (ObjNum 618 snap 163 seq_num 618) dirty exists 2026-02-13T20:19:37.556 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.527+0000 7f518b683640 1 -- 10.20.193.110:0/1946613712 >> v1:10.20.193.188:6812/1623052694 conn(0x7f515403fcf0 legacy=0x7f51540601a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:37.556 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.527+0000 7f518b683640 10 monclient: shutdown 2026-02-13T20:19:37.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.527+0000 7f518b683640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:19:37.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.527+0000 7f518b683640 1 -- 10.20.193.110:0/1946613712 >> v1:10.20.193.110:6790/0 conn(0x7f5184089e70 legacy=0x7f51841a1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:37.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.527+0000 7f518ae82640 1 -- 10.20.193.110:0/1946613712 reap_dead start 2026-02-13T20:19:37.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.527+0000 7f518ae82640 1 -- 10.20.193.110:0/1946613712 reap_dead start 2026-02-13T20:19:37.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.527+0000 7f518b683640 1 -- 10.20.193.110:0/1946613712 shutdown_connections 2026-02-13T20:19:37.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.527+0000 7f518b683640 1 -- 10.20.193.110:0/1946613712 >> 10.20.193.110:0/1946613712 conn(0x7f5184054d30 msgr2=0x7f518408d710 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:19:37.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.527+0000 7f518b683640 1 -- 10.20.193.110:0/1946613712 shutdown_connections 2026-02-13T20:19:37.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.527+0000 7f518b683640 1 -- 10.20.193.110:0/1946613712 wait complete. 2026-02-13T20:19:37.557 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:19:37.557 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-13T20:19:37.558 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T20:19:37.627 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.621+0000 7fa74d01b640 10 monclient: get_monmap_and_config 2026-02-13T20:19:37.628 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.621+0000 7fa74d01b640 10 monclient: build_initial_monmap 2026-02-13T20:19:37.628 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.621+0000 7fa74d01b640 10 monclient: monmap: 2026-02-13T20:19:37.628 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:19:37.628 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:37.628 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:19:37.622103+0000 2026-02-13T20:19:37.628 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:19:37.622103+0000 2026-02-13T20:19:37.628 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:19:37.628 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:37.628 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:19:37.628 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:19:37.628 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:19:37.628 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:37.628 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.622+0000 7fa74d01b640 1 Processor -- start 2026-02-13T20:19:37.628 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.622+0000 7fa74d01b640 1 -- start start 2026-02-13T20:19:37.628 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.622+0000 7fa74d01b640 10 monclient: init 2026-02-13T20:19:37.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.622+0000 7fa74d01b640 10 monclient: _reopen_session rank -1 2026-02-13T20:19:37.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.622+0000 7fa74d01b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:19:37.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.622+0000 7fa74d01b640 10 monclient(hunting): picked mon.noname-c con 0x7fa7481401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:19:37.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.622+0000 7fa74d01b640 10 monclient(hunting): picked mon.noname-a con 0x7fa748092020 addr v1:10.20.193.110:6789/0 2026-02-13T20:19:37.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.622+0000 7fa74d01b640 10 monclient(hunting): picked mon.noname-b con 0x7fa748091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:19:37.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.622+0000 7fa74d01b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa74808b730 con 0x7fa748092020 2026-02-13T20:19:37.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.622+0000 7fa74d01b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa74805c5b0 con 0x7fa7481401c0 2026-02-13T20:19:37.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.622+0000 7fa74d01b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa74808bcf0 con 0x7fa748091950 2026-02-13T20:19:37.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.622+0000 7fa74d01b640 10 monclient(hunting): _renew_subs 2026-02-13T20:19:37.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.622+0000 7fa74d01b640 10 monclient(hunting): authenticate will time out at 1139.312489s 2026-02-13T20:19:37.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.622+0000 7fa747577640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fa748091950 0x7fa7481a2a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:37668/0 (socket says 10.20.193.110:37668) 2026-02-13T20:19:37.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.622+0000 7fa746575640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fa748092020 0x7fa7481812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:52106/0 (socket says 10.20.193.110:52106) 2026-02-13T20:19:37.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.622+0000 7fa747577640 1 -- 10.20.193.110:0/3017719108 learned_addr learned my addr 10.20.193.110:0/3017719108 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:19:37.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.622+0000 7fa745d74640 1 -- 10.20.193.110:0/3017719108 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1813226554 0 0) 0x7fa74808bcf0 con 0x7fa748091950 2026-02-13T20:19:37.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.622+0000 7fa745d74640 10 monclient(hunting): _negotiate 2026-02-13T20:19:37.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.622+0000 7fa745d74640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:37.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.622+0000 7fa745d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:37.630 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.622+0000 7fa745d74640 10 monclient(hunting): my global_id is 94310 2026-02-13T20:19:37.630 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.622+0000 7fa745d74640 1 -- 10.20.193.110:0/3017719108 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7340035e0 con 0x7fa748091950 2026-02-13T20:19:37.630 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.622+0000 7fa745d74640 1 -- 10.20.193.110:0/3017719108 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3854043540 0 0) 0x7fa74808b730 con 0x7fa748092020 2026-02-13T20:19:37.630 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.622+0000 7fa745d74640 10 monclient(hunting): _negotiate 2026-02-13T20:19:37.630 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.622+0000 7fa745d74640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:37.630 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.622+0000 7fa745d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:37.630 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.622+0000 7fa745d74640 10 monclient(hunting): my global_id is 114135 2026-02-13T20:19:37.630 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.622+0000 7fa745d74640 1 -- 10.20.193.110:0/3017719108 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa74808bcf0 con 0x7fa748092020 2026-02-13T20:19:37.630 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.622+0000 7fa745d74640 1 -- 10.20.193.110:0/3017719108 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 431323281 0 0) 0x7fa7340035e0 con 0x7fa748091950 2026-02-13T20:19:37.630 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.622+0000 7fa745d74640 1 -- 10.20.193.110:0/3017719108 >> v1:10.20.193.188:6789/0 conn(0x7fa7481401c0 legacy=0x7fa748091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T20:19:37.630 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.622+0000 7fa745d74640 1 -- 10.20.193.110:0/3017719108 >> v1:10.20.193.110:6789/0 conn(0x7fa748092020 legacy=0x7fa7481812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:37.630 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.622+0000 7fa745d74640 10 monclient: _finish_hunting 0 2026-02-13T20:19:37.630 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.622+0000 7fa745d74640 1 monclient: found mon.noname-b 2026-02-13T20:19:37.630 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.622+0000 7fa745d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:19:37.630 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.622+0000 7fa745d74640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:19:37.630 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.622+0000 7fa745d74640 1 -- 10.20.193.110:0/3017719108 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa748140590 con 0x7fa748091950 2026-02-13T20:19:37.630 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.623+0000 7fa745d74640 10 monclient: _finish_auth 0 2026-02-13T20:19:37.630 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.623+0000 7fa745d74640 10 monclient: _check_auth_tickets 2026-02-13T20:19:37.631 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.623+0000 7fa745d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:19:37.631 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.623+0000 7fa745d74640 1 -- 10.20.193.110:0/3017719108 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa738003eb0 con 0x7fa748091950 2026-02-13T20:19:37.631 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.623+0000 7fa74d01b640 5 monclient: authenticate success, global_id 94310 2026-02-13T20:19:37.631 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.623+0000 7fa74d01b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:19:37.631 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.623+0000 7fa745d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:37.631 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.623+0000 7fa745d74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:19:37.631 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.623+0000 7fa745d74640 10 monclient: dump: 2026-02-13T20:19:37.631 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:37.631 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:37.631 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.631 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.631 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:37.631 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:37.631 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:37.631 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:37.631 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:37.631 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:37.631 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.623+0000 7fa74d01b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:19:37.632 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.623+0000 7fa745d74640 1 -- 10.20.193.110:0/3017719108 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa738004100 con 0x7fa748091950 2026-02-13T20:19:37.632 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.623+0000 7fa745d74640 10 monclient: handle_config config(0 keys) 2026-02-13T20:19:37.632 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.623+0000 7fa745d74640 1 -- 10.20.193.110:0/3017719108 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa738004510 con 0x7fa748091950 2026-02-13T20:19:37.632 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.623+0000 7fa74d01b640 10 monclient: get_monmap_and_config success 2026-02-13T20:19:37.632 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.623+0000 7fa745d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:37.632 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.623+0000 7fa74d01b640 4 set_mon_vals no callback set 2026-02-13T20:19:37.632 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.623+0000 7fa745d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:19:37.632 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.623+0000 7fa745d74640 10 monclient: dump: 2026-02-13T20:19:37.632 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:37.632 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:37.632 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.632 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.632 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:37.632 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:37.632 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:37.632 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:37.632 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:37.632 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:37.633 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.623+0000 7fa74d01b640 10 monclient: shutdown 2026-02-13T20:19:37.633 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.623+0000 7fa74d01b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:19:37.633 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.623+0000 7fa74d01b640 1 -- 10.20.193.110:0/3017719108 >> v1:10.20.193.110:6790/0 conn(0x7fa748091950 legacy=0x7fa7481a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:37.633 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.623+0000 7fa74d01b640 1 -- 10.20.193.110:0/3017719108 shutdown_connections 2026-02-13T20:19:37.633 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.623+0000 7fa74d01b640 1 -- 10.20.193.110:0/3017719108 >> 10.20.193.110:0/3017719108 conn(0x7fa748054e90 msgr2=0x7fa748058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:19:37.633 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.623+0000 7fa74d01b640 1 -- 10.20.193.110:0/3017719108 shutdown_connections 2026-02-13T20:19:37.633 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.623+0000 7fa74d01b640 1 -- 10.20.193.110:0/3017719108 wait complete. 2026-02-13T20:19:37.633 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.623+0000 7fa74d01b640 10 monclient: build_initial_monmap 2026-02-13T20:19:37.633 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.623+0000 7fa74d01b640 10 monclient: monmap: 2026-02-13T20:19:37.633 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:19:37.633 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:19:37.633 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:19:37.633 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:19:37.633 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:19:37.633 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:19:37.633 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:19:37.633 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:19:37.633 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:19:37.634 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:37.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.623+0000 7fa74d01b640 1 Processor -- start 2026-02-13T20:19:37.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa74d01b640 1 -- start start 2026-02-13T20:19:37.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa74d01b640 10 monclient: init 2026-02-13T20:19:37.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa74d01b640 10 monclient: _reopen_session rank -1 2026-02-13T20:19:37.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa74d01b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:19:37.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa74d01b640 10 monclient(hunting): picked mon.noname-a con 0x7fa748091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:19:37.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa74d01b640 10 monclient(hunting): picked mon.noname-c con 0x7fa7481401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:19:37.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa74d01b640 10 monclient(hunting): picked mon.noname-b con 0x7fa748150860 addr v1:10.20.193.188:6789/0 2026-02-13T20:19:37.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa74d01b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa74808c430 con 0x7fa748091950 2026-02-13T20:19:37.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa74d01b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa74812ffb0 con 0x7fa748150860 2026-02-13T20:19:37.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa74d01b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa74805d320 con 0x7fa7481401c0 2026-02-13T20:19:37.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa74d01b640 10 monclient(hunting): _renew_subs 2026-02-13T20:19:37.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa74d01b640 10 monclient(hunting): authenticate will time out at 1139.314277s 2026-02-13T20:19:37.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa746575640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fa7481401c0 0x7fa7481919b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:37674/0 (socket says 10.20.193.110:37674) 2026-02-13T20:19:37.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa746d76640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fa748091950 0x7fa74813e590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:52112/0 (socket says 10.20.193.110:52112) 2026-02-13T20:19:37.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa746575640 1 -- 10.20.193.110:0/2826032147 learned_addr learned my addr 10.20.193.110:0/2826032147 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:19:37.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa7277fe640 1 -- 10.20.193.110:0/2826032147 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2285812635 0 0) 0x7fa74805d320 con 0x7fa7481401c0 2026-02-13T20:19:37.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa7277fe640 10 monclient(hunting): _negotiate 2026-02-13T20:19:37.635 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa7277fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:37.635 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa7277fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:37.635 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa7277fe640 10 monclient(hunting): my global_id is 94313 2026-02-13T20:19:37.635 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa7277fe640 1 -- 10.20.193.110:0/2826032147 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7140035e0 con 0x7fa7481401c0 2026-02-13T20:19:37.635 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa7277fe640 1 -- 10.20.193.110:0/2826032147 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3743388107 0 0) 0x7fa74808c430 con 0x7fa748091950 2026-02-13T20:19:37.635 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa7277fe640 10 monclient(hunting): _negotiate 2026-02-13T20:19:37.635 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa7277fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:37.635 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa7277fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:37.635 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa7277fe640 10 monclient(hunting): my global_id is 114138 2026-02-13T20:19:37.635 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa7277fe640 1 -- 10.20.193.110:0/2826032147 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa74805d320 con 0x7fa748091950 2026-02-13T20:19:37.635 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa7277fe640 1 -- 10.20.193.110:0/2826032147 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 150451701 0 0) 0x7fa7140035e0 con 0x7fa7481401c0 2026-02-13T20:19:37.635 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa7277fe640 1 -- 10.20.193.110:0/2826032147 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa74808c430 con 0x7fa7481401c0 2026-02-13T20:19:37.635 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa7277fe640 1 -- 10.20.193.110:0/2826032147 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa7300030f0 con 0x7fa7481401c0 2026-02-13T20:19:37.635 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa7277fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:19:37.635 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa7277fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:19:37.635 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa7277fe640 10 monclient(hunting): dump: 2026-02-13T20:19:37.635 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:37.635 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:37.636 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.636 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.636 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:37.636 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:37.636 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:37.636 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:37.636 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:37.636 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:37.636 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa7277fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:19:37.636 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa7277fe640 1 -- 10.20.193.110:0/2826032147 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3537843249 0 0) 0x7fa74805d320 con 0x7fa748091950 2026-02-13T20:19:37.636 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa7277fe640 1 -- 10.20.193.110:0/2826032147 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa7140035e0 con 0x7fa748091950 2026-02-13T20:19:37.636 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa7277fe640 1 -- 10.20.193.110:0/2826032147 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa73c003ff0 con 0x7fa748091950 2026-02-13T20:19:37.636 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa7277fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:19:37.636 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa7277fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:19:37.636 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa7277fe640 10 monclient(hunting): dump: 2026-02-13T20:19:37.636 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:37.636 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:37.636 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.636 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.637 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:37.637 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:37.637 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:37.637 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:37.637 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:37.637 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:37.637 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa7277fe640 1 -- 10.20.193.110:0/2826032147 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1431077995 0 0) 0x7fa74808c430 con 0x7fa7481401c0 2026-02-13T20:19:37.637 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa7277fe640 1 -- 10.20.193.110:0/2826032147 >> v1:10.20.193.188:6789/0 conn(0x7fa748150860 legacy=0x7fa7481930d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:37.637 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa7277fe640 1 -- 10.20.193.110:0/2826032147 >> v1:10.20.193.110:6789/0 conn(0x7fa748091950 legacy=0x7fa74813e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:37.637 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa7277fe640 10 monclient: _finish_hunting 0 2026-02-13T20:19:37.637 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa7277fe640 1 monclient: found mon.c 2026-02-13T20:19:37.637 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa7277fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:19:37.637 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa7277fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:19:37.637 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa7277fe640 1 -- 10.20.193.110:0/2826032147 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa748091010 con 0x7fa7481401c0 2026-02-13T20:19:37.637 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa7277fe640 10 monclient: _finish_auth 0 2026-02-13T20:19:37.637 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa7277fe640 10 monclient: _check_auth_tickets 2026-02-13T20:19:37.637 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa7277fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:19:37.637 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa74d01b640 5 monclient: authenticate success, global_id 94313 2026-02-13T20:19:37.638 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa74d01b640 10 monclient: _renew_subs 2026-02-13T20:19:37.638 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa74d01b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:19:37.638 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa74d01b640 1 -- 10.20.193.110:0/2826032147 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa74812dc50 con 0x7fa7481401c0 2026-02-13T20:19:37.638 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa74d01b640 10 monclient: _renew_subs 2026-02-13T20:19:37.638 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa74d01b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:19:37.638 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa74d01b640 1 -- 10.20.193.110:0/2826032147 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fa74812e9b0 con 0x7fa7481401c0 2026-02-13T20:19:37.638 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa7277fe640 1 -- 10.20.193.110:0/2826032147 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa730003480 con 0x7fa7481401c0 2026-02-13T20:19:37.638 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa7277fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:19:37.638 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa7277fe640 1 -- 10.20.193.110:0/2826032147 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa730004d00 con 0x7fa7481401c0 2026-02-13T20:19:37.638 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa7277fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:37.638 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa7277fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:19:37.638 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa7277fe640 10 monclient: dump: 2026-02-13T20:19:37.638 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:37.638 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:37.638 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.638 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.638 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:37.638 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:37.639 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:37.639 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:37.639 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:37.639 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:37.639 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.624+0000 7fa745573640 4 set_mon_vals no callback set 2026-02-13T20:19:37.639 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.625+0000 7fa74d01b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:19:37.639 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.625+0000 7fa74d01b640 1 -- 10.20.193.110:0/2826032147 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa74808d0c0 con 0x7fa748092020 2026-02-13T20:19:37.639 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.625+0000 7fa7277fe640 1 -- 10.20.193.110:0/2826032147 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fa730011970 con 0x7fa7481401c0 2026-02-13T20:19:37.639 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.625+0000 7fa7277fe640 1 -- 10.20.193.110:0/2826032147 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(395..395 src has 1..395) ==== 3975+0+0 (unknown 1949552152 0 0) 0x7fa73004e970 con 0x7fa7481401c0 2026-02-13T20:19:37.639 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.625+0000 7fa7277fe640 1 -- 10.20.193.110:0/2826032147 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3945432009 0 0) 0x7fa74808d0c0 con 0x7fa748092020 2026-02-13T20:19:37.639 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.625+0000 7fa7277fe640 10 monclient(hunting): _negotiate 2026-02-13T20:19:37.639 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.625+0000 7fa7277fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:37.639 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.625+0000 7fa7277fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:37.639 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.625+0000 7fa7277fe640 10 monclient(hunting): my global_id is 94316 2026-02-13T20:19:37.639 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.625+0000 7fa7277fe640 1 -- 10.20.193.110:0/2826032147 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa74808c430 con 0x7fa748092020 2026-02-13T20:19:37.639 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.625+0000 7fa747577640 10 monclient: get_auth_request con 0x7fa71403faa0 auth_method 0 2026-02-13T20:19:37.639 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.625+0000 7fa7277fe640 1 -- 10.20.193.110:0/2826032147 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1599838416 0 0) 0x7fa74808c430 con 0x7fa748092020 2026-02-13T20:19:37.639 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.625+0000 7fa7277fe640 1 -- 10.20.193.110:0/2826032147 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa74808d0c0 con 0x7fa748092020 2026-02-13T20:19:37.639 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.625+0000 7fa7277fe640 1 -- 10.20.193.110:0/2826032147 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa73c0026a0 con 0x7fa748092020 2026-02-13T20:19:37.640 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.625+0000 7fa7277fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:37.640 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.625+0000 7fa7277fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:19:37.640 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.625+0000 7fa7277fe640 10 monclient: dump: 2026-02-13T20:19:37.640 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:37.640 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:37.640 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.640 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.640 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:37.640 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:37.640 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:37.640 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:37.640 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:37.640 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:37.640 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.625+0000 7fa7277fe640 1 -- 10.20.193.110:0/2826032147 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3214439386 0 0) 0x7fa74808d0c0 con 0x7fa748092020 2026-02-13T20:19:37.640 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.625+0000 7fa7277fe640 1 -- 10.20.193.110:0/2826032147 --> v1:10.20.193.110:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa74808b450 con 0x7fa748092020 2026-02-13T20:19:37.640 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.626+0000 7fa7277fe640 1 -- 10.20.193.110:0/2826032147 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fa73c005880 con 0x7fa748092020 2026-02-13T20:19:37.641 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.626+0000 7fa7277fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:19:37.641 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.626+0000 7fa7277fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:19:37.641 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.626+0000 7fa7277fe640 1 -- 10.20.193.110:0/2826032147 >> v1:10.20.193.110:6790/0 conn(0x7fa748092020 legacy=0x7fa748127b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:37.641 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.626+0000 7fa7277fe640 1 -- 10.20.193.110:0/2826032147 >> v1:10.20.193.110:6790/0 conn(0x7fa748092020 legacy=0x7fa748127b20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:19:37.642 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.629+0000 7fa74d01b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:19:37.642 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.629+0000 7fa74d01b640 1 -- 10.20.193.110:0/2826032147 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa748055bb0 con 0x7fa748128230 2026-02-13T20:19:37.642 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.629+0000 7fa7277fe640 1 -- 10.20.193.110:0/2826032147 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1976177629 0 0) 0x7fa748055bb0 con 0x7fa748128230 2026-02-13T20:19:37.642 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.629+0000 7fa7277fe640 10 monclient(hunting): _negotiate 2026-02-13T20:19:37.642 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.629+0000 7fa7277fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:37.642 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.629+0000 7fa7277fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:37.642 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.629+0000 7fa7277fe640 10 monclient(hunting): my global_id is 94319 2026-02-13T20:19:37.642 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.629+0000 7fa7277fe640 1 -- 10.20.193.110:0/2826032147 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa74808d0c0 con 0x7fa748128230 2026-02-13T20:19:37.642 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.629+0000 7fa7277fe640 1 -- 10.20.193.110:0/2826032147 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 911961540 0 0) 0x7fa74808d0c0 con 0x7fa748128230 2026-02-13T20:19:37.642 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.629+0000 7fa7277fe640 1 -- 10.20.193.110:0/2826032147 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa748055bb0 con 0x7fa748128230 2026-02-13T20:19:37.642 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.629+0000 7fa7277fe640 1 -- 10.20.193.110:0/2826032147 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa73c002ea0 con 0x7fa748128230 2026-02-13T20:19:37.643 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.629+0000 7fa7277fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:37.643 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.629+0000 7fa7277fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:19:37.643 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.629+0000 7fa7277fe640 10 monclient: dump: 2026-02-13T20:19:37.643 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:37.643 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:37.643 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.643 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.643 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:37.643 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:37.643 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:37.643 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:37.643 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:37.643 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:37.643 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.629+0000 7fa7277fe640 1 -- 10.20.193.110:0/2826032147 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1600238153 0 0) 0x7fa748055bb0 con 0x7fa748128230 2026-02-13T20:19:37.643 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.629+0000 7fa7277fe640 1 -- 10.20.193.110:0/2826032147 --> v1:10.20.193.110:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa748058410 con 0x7fa748128230 2026-02-13T20:19:37.643 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.629+0000 7fa7277fe640 1 -- 10.20.193.110:0/2826032147 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4514 (unknown 0 0 3753313531) 0x7fa73c0032a0 con 0x7fa748128230 2026-02-13T20:19:37.643 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.629+0000 7fa7277fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:19:37.643 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.629+0000 7fa7277fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:19:37.644 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.629+0000 7fa7277fe640 1 -- 10.20.193.110:0/2826032147 >> v1:10.20.193.110:6790/0 conn(0x7fa748128230 legacy=0x7fa748195800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:37.644 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.629+0000 7fa7277fe640 1 -- 10.20.193.110:0/2826032147 >> v1:10.20.193.110:6790/0 conn(0x7fa748128230 legacy=0x7fa748195800 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:19:37.644 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:19:37.644 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:19:37.644 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:19:37.644 INFO:teuthology.orchestra.run.trial110.stdout: "state": "peon", 2026-02-13T20:19:37.644 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 32, 2026-02-13T20:19:37.644 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 249252, 2026-02-13T20:19:37.644 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:19:37.644 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:19:37.644 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:19:37.644 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:19:37.645 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:19:37.645 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 1, 2026-02-13T20:19:37.645 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:19:37.645 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:19:37.645 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:19:37.645 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:19:37.645 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:19:37.645 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:19:37.645 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:19:37.645 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:19:37.645 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:19:37.645 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:19:37.645 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:19:37.645 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:19:37.645 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:19:37.645 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:19:37.645 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:19:37.645 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:19:37.646 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:19:37.646 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:19:37.646 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:19:37.646 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:19:37.646 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:19:37.646 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:19:37.646 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:19:37.646 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:19:37.646 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:19:37.646 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:19:37.646 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:19:37.646 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:19:37.646 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:19:37.646 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:19:37.646 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:19:37.646 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:19:37.646 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:19:37.646 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:37.647 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:19:37.647 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:19:37.647 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:19:37.647 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:19:37.647 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:19:37.647 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:19:37.647 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:19:37.647 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:19:37.647 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:19:37.647 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:19:37.647 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:19:37.647 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:19:37.647 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:19:37.647 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:19:37.647 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:19:37.647 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:19:37.647 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:19:37.648 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:19:37.648 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:19:37.648 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:19:37.648 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:19:37.648 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:19:37.648 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:19:37.648 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:19:37.648 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:19:37.648 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:19:37.648 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:19:37.648 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:19:37.648 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:19:37.648 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:19:37.648 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:19:37.648 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:19:37.648 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:37.648 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:19:37.648 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:37.648 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:19:37.648 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:19:37.649 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:19:37.649 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:19:37.649 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:37.649 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:19:37.649 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:19:37.649 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:19:37.649 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:37.649 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:19:37.649 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:37.649 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:19:37.649 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:19:37.649 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:19:37.649 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:19:37.649 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:19:37.649 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:19:37.649 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:37.649 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:37.649 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:19:37.649 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:19:37.649 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:19:37.650 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:19:37.650 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:37.650 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:19:37.650 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:19:37.650 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:19:37.650 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:37.650 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:19:37.650 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:37.650 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:19:37.650 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:19:37.650 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:19:37.650 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:19:37.650 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:19:37.650 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:19:37.650 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:37.650 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:37.650 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:19:37.650 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:19:37.650 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:19:37.650 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:19:37.651 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:37.651 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:19:37.651 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:19:37.651 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:19:37.651 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:37.651 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:19:37.651 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:37.651 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:19:37.651 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:19:37.651 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:19:37.651 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:19:37.651 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:19:37.651 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:19:37.651 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:37.651 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:19:37.651 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:37.651 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:19:37.651 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:19:37.651 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:37.651 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:19:37.651 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:19:37.651 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:19:37.652 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:37.652 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:19:37.652 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:19:37.652 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:37.652 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:19:37.652 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:19:37.652 INFO:teuthology.orchestra.run.trial110.stdout: "num": 2 2026-02-13T20:19:37.652 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:37.652 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:19:37.652 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:19:37.652 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:37.652 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:19:37.652 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:19:37.652 INFO:teuthology.orchestra.run.trial110.stdout: "num": 2 2026-02-13T20:19:37.652 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:37.652 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:19:37.652 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:37.652 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:19:37.652 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:19:37.653 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.629+0000 7fa74d01b640 1 -- 10.20.193.110:0/2826032147 >> v1:10.20.193.188:6812/1623052694 conn(0x7fa71403faa0 legacy=0x7fa71405ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:37.653 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.629+0000 7fa74d01b640 10 monclient: shutdown 2026-02-13T20:19:37.653 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.629+0000 7fa74d01b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:19:37.653 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.629+0000 7fa74d01b640 1 -- 10.20.193.110:0/2826032147 >> v1:10.20.193.110:6790/0 conn(0x7fa7481401c0 legacy=0x7fa7481919b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:37.654 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.629+0000 7fa747577640 1 -- 10.20.193.110:0/2826032147 reap_dead start 2026-02-13T20:19:37.654 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.629+0000 7fa747577640 1 -- 10.20.193.110:0/2826032147 reap_dead start 2026-02-13T20:19:37.654 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.629+0000 7fa74d01b640 1 -- 10.20.193.110:0/2826032147 shutdown_connections 2026-02-13T20:19:37.654 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.629+0000 7fa74d01b640 1 -- 10.20.193.110:0/2826032147 >> 10.20.193.110:0/2826032147 conn(0x7fa748054e90 msgr2=0x7fa74808ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:19:37.654 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.629+0000 7fa74d01b640 1 -- 10.20.193.110:0/2826032147 shutdown_connections 2026-02-13T20:19:37.654 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.630+0000 7fa74d01b640 1 -- 10.20.193.110:0/2826032147 wait complete. 2026-02-13T20:19:37.654 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:19:37.654 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-13T20:19:37.654 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T20:19:37.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.720+0000 7efda2a1b640 10 monclient: get_monmap_and_config 2026-02-13T20:19:37.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.720+0000 7efda2a1b640 10 monclient: build_initial_monmap 2026-02-13T20:19:37.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.720+0000 7efda2a1b640 10 monclient: monmap: 2026-02-13T20:19:37.721 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:19:37.721 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:37.721 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:19:37.721015+0000 2026-02-13T20:19:37.721 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:19:37.721015+0000 2026-02-13T20:19:37.721 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:19:37.722 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:37.722 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:19:37.722 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:19:37.722 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:19:37.722 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:37.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.721+0000 7efda2a1b640 1 Processor -- start 2026-02-13T20:19:37.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.721+0000 7efda2a1b640 1 -- start start 2026-02-13T20:19:37.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.721+0000 7efda2a1b640 10 monclient: init 2026-02-13T20:19:37.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.721+0000 7efda2a1b640 10 monclient: _reopen_session rank -1 2026-02-13T20:19:37.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.721+0000 7efda2a1b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:19:37.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.721+0000 7efda2a1b640 10 monclient(hunting): picked mon.noname-c con 0x7efd9c089250 addr v1:10.20.193.188:6789/0 2026-02-13T20:19:37.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.721+0000 7efda2a1b640 10 monclient(hunting): picked mon.noname-b con 0x7efd9c057780 addr v1:10.20.193.110:6790/0 2026-02-13T20:19:37.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.721+0000 7efda2a1b640 10 monclient(hunting): picked mon.noname-a con 0x7efd9c184b60 addr v1:10.20.193.110:6789/0 2026-02-13T20:19:37.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.721+0000 7efda2a1b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd9c08a950 con 0x7efd9c184b60 2026-02-13T20:19:37.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.721+0000 7efda2a1b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd9c089620 con 0x7efd9c089250 2026-02-13T20:19:37.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.721+0000 7efda2a1b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd9c057c60 con 0x7efd9c057780 2026-02-13T20:19:37.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.721+0000 7efda2a1b640 10 monclient(hunting): _renew_subs 2026-02-13T20:19:37.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.721+0000 7efda2a1b640 10 monclient(hunting): authenticate will time out at 1139.411528s 2026-02-13T20:19:37.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.721+0000 7efd9b7fe640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7efd9c057780 0x7efd9c183440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:37692/0 (socket says 10.20.193.110:37692) 2026-02-13T20:19:37.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.721+0000 7efd9b7fe640 1 -- 10.20.193.110:0/2277852844 learned_addr learned my addr 10.20.193.110:0/2277852844 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:19:37.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.721+0000 7efd9affd640 1 -- 10.20.193.110:0/2277852844 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3820617991 0 0) 0x7efd9c057c60 con 0x7efd9c057780 2026-02-13T20:19:37.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.721+0000 7efd9affd640 10 monclient(hunting): _negotiate 2026-02-13T20:19:37.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.721+0000 7efd9affd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:37.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.721+0000 7efd9affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:37.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.721+0000 7efd9affd640 10 monclient(hunting): my global_id is 94322 2026-02-13T20:19:37.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.721+0000 7efd9affd640 1 -- 10.20.193.110:0/2277852844 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd800035e0 con 0x7efd9c057780 2026-02-13T20:19:37.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.721+0000 7efd9affd640 1 -- 10.20.193.110:0/2277852844 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2491276806 0 0) 0x7efd9c08a950 con 0x7efd9c184b60 2026-02-13T20:19:37.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.721+0000 7efd9affd640 10 monclient(hunting): _negotiate 2026-02-13T20:19:37.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.721+0000 7efd9affd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:37.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.721+0000 7efd9affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:37.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.721+0000 7efd9affd640 10 monclient(hunting): my global_id is 114141 2026-02-13T20:19:37.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.721+0000 7efd9affd640 1 -- 10.20.193.110:0/2277852844 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd9c057c60 con 0x7efd9c184b60 2026-02-13T20:19:37.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.721+0000 7efd9affd640 1 -- 10.20.193.110:0/2277852844 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1766405340 0 0) 0x7efd800035e0 con 0x7efd9c057780 2026-02-13T20:19:37.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.722+0000 7efd9affd640 1 -- 10.20.193.110:0/2277852844 >> v1:10.20.193.188:6789/0 conn(0x7efd9c089250 legacy=0x7efd9c0580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T20:19:37.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.722+0000 7efd9affd640 1 -- 10.20.193.110:0/2277852844 >> v1:10.20.193.110:6789/0 conn(0x7efd9c184b60 legacy=0x7efd9c1a4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:37.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.722+0000 7efd9affd640 10 monclient: _finish_hunting 0 2026-02-13T20:19:37.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.722+0000 7efd9affd640 1 monclient: found mon.noname-b 2026-02-13T20:19:37.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.722+0000 7efd9affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:19:37.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.722+0000 7efd9affd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:19:37.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.722+0000 7efd9affd640 1 -- 10.20.193.110:0/2277852844 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd9c089a50 con 0x7efd9c057780 2026-02-13T20:19:37.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.722+0000 7efd9affd640 10 monclient: _finish_auth 0 2026-02-13T20:19:37.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.722+0000 7efd9affd640 10 monclient: _check_auth_tickets 2026-02-13T20:19:37.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.722+0000 7efd9affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:19:37.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.722+0000 7efd9affd640 1 -- 10.20.193.110:0/2277852844 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7efd8c002dd0 con 0x7efd9c057780 2026-02-13T20:19:37.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.722+0000 7efd9affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:37.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.722+0000 7efd9affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:19:37.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.722+0000 7efd9affd640 10 monclient: dump: 2026-02-13T20:19:37.729 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:37.729 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:37.729 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.730 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.730 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:37.730 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:37.730 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:37.730 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:37.730 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:37.730 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:37.730 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.722+0000 7efda2a1b640 5 monclient: authenticate success, global_id 94322 2026-02-13T20:19:37.730 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.722+0000 7efda2a1b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:19:37.730 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.722+0000 7efd9affd640 1 -- 10.20.193.110:0/2277852844 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efd8c003010 con 0x7efd9c057780 2026-02-13T20:19:37.730 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.722+0000 7efd9affd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:19:37.730 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.722+0000 7efd9affd640 1 -- 10.20.193.110:0/2277852844 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7efd8c003420 con 0x7efd9c057780 2026-02-13T20:19:37.730 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.722+0000 7efd9affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:37.730 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.722+0000 7efd9affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:19:37.730 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.722+0000 7efd9affd640 10 monclient: dump: 2026-02-13T20:19:37.730 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:37.730 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:37.730 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.730 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.731 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:37.731 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:37.731 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:37.731 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:37.731 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:37.731 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:37.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.722+0000 7efda2a1b640 10 monclient: get_monmap_and_config success 2026-02-13T20:19:37.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.722+0000 7efda2a1b640 4 set_mon_vals no callback set 2026-02-13T20:19:37.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.722+0000 7efda2a1b640 10 monclient: shutdown 2026-02-13T20:19:37.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.722+0000 7efda2a1b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:19:37.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.722+0000 7efda2a1b640 1 -- 10.20.193.110:0/2277852844 >> v1:10.20.193.110:6790/0 conn(0x7efd9c057780 legacy=0x7efd9c183440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:37.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.722+0000 7efda2a1b640 1 -- 10.20.193.110:0/2277852844 shutdown_connections 2026-02-13T20:19:37.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.722+0000 7efda2a1b640 1 -- 10.20.193.110:0/2277852844 >> 10.20.193.110:0/2277852844 conn(0x7efd9c054330 msgr2=0x7efd9c054730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:19:37.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.722+0000 7efda2a1b640 1 -- 10.20.193.110:0/2277852844 shutdown_connections 2026-02-13T20:19:37.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.722+0000 7efda2a1b640 1 -- 10.20.193.110:0/2277852844 wait complete. 2026-02-13T20:19:37.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.722+0000 7efda2a1b640 10 monclient: build_initial_monmap 2026-02-13T20:19:37.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.722+0000 7efda2a1b640 10 monclient: monmap: 2026-02-13T20:19:37.732 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:19:37.732 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:19:37.732 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:19:37.732 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:19:37.732 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:19:37.732 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:19:37.732 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:19:37.732 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:19:37.732 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:19:37.732 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:37.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.722+0000 7efda2a1b640 1 Processor -- start 2026-02-13T20:19:37.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.722+0000 7efda2a1b640 1 -- start start 2026-02-13T20:19:37.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.722+0000 7efda2a1b640 10 monclient: init 2026-02-13T20:19:37.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efda2a1b640 10 monclient: _reopen_session rank -1 2026-02-13T20:19:37.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efda2a1b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:19:37.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efda2a1b640 10 monclient(hunting): picked mon.noname-c con 0x7efd9c057780 addr v1:10.20.193.110:6790/0 2026-02-13T20:19:37.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efda2a1b640 10 monclient(hunting): picked mon.noname-a con 0x7efd9c089250 addr v1:10.20.193.110:6789/0 2026-02-13T20:19:37.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efda2a1b640 10 monclient(hunting): picked mon.noname-b con 0x7efd9c184b60 addr v1:10.20.193.188:6789/0 2026-02-13T20:19:37.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efda2a1b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd9c12b140 con 0x7efd9c089250 2026-02-13T20:19:37.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efda2a1b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd9c062290 con 0x7efd9c184b60 2026-02-13T20:19:37.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efda2a1b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd9c111520 con 0x7efd9c057780 2026-02-13T20:19:37.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efda2a1b640 10 monclient(hunting): _renew_subs 2026-02-13T20:19:37.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efda2a1b640 10 monclient(hunting): authenticate will time out at 1139.413276s 2026-02-13T20:19:37.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efd9bfff640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7efd9c057780 0x7efd9c12aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:37694/0 (socket says 10.20.193.110:37694) 2026-02-13T20:19:37.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efd9bfff640 1 -- 10.20.193.110:0/3323101107 learned_addr learned my addr 10.20.193.110:0/3323101107 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:19:37.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efd98ff9640 1 -- 10.20.193.110:0/3323101107 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3274926486 0 0) 0x7efd9c111520 con 0x7efd9c057780 2026-02-13T20:19:37.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efd98ff9640 10 monclient(hunting): _negotiate 2026-02-13T20:19:37.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efd98ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:37.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efd98ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:37.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efd98ff9640 10 monclient(hunting): my global_id is 94325 2026-02-13T20:19:37.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efd98ff9640 1 -- 10.20.193.110:0/3323101107 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd6c0035e0 con 0x7efd9c057780 2026-02-13T20:19:37.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efd98ff9640 1 -- 10.20.193.110:0/3323101107 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2213814711 0 0) 0x7efd9c12b140 con 0x7efd9c089250 2026-02-13T20:19:37.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efd98ff9640 10 monclient(hunting): _negotiate 2026-02-13T20:19:37.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efd98ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:37.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efd98ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:37.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efd98ff9640 10 monclient(hunting): my global_id is 114144 2026-02-13T20:19:37.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efd98ff9640 1 -- 10.20.193.110:0/3323101107 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd9c111520 con 0x7efd9c089250 2026-02-13T20:19:37.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efd98ff9640 1 -- 10.20.193.110:0/3323101107 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1166332360 0 0) 0x7efd6c0035e0 con 0x7efd9c057780 2026-02-13T20:19:37.734 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efd98ff9640 1 -- 10.20.193.110:0/3323101107 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efd9c12b140 con 0x7efd9c057780 2026-02-13T20:19:37.734 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efd98ff9640 1 -- 10.20.193.110:0/3323101107 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7efd880040b0 con 0x7efd9c057780 2026-02-13T20:19:37.734 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efd98ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:19:37.734 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efd98ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:19:37.734 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efd98ff9640 10 monclient(hunting): dump: 2026-02-13T20:19:37.734 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:37.734 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:37.734 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.734 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.734 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:37.734 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:37.734 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:37.734 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:37.734 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:37.734 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:37.734 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efd98ff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:19:37.734 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efd98ff9640 1 -- 10.20.193.110:0/3323101107 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3551750066 0 0) 0x7efd9c111520 con 0x7efd9c089250 2026-02-13T20:19:37.734 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efd98ff9640 1 -- 10.20.193.110:0/3323101107 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efd6c0035e0 con 0x7efd9c089250 2026-02-13T20:19:37.735 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efd98ff9640 1 -- 10.20.193.110:0/3323101107 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7efd8c003330 con 0x7efd9c089250 2026-02-13T20:19:37.735 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efd98ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:19:37.735 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efd98ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:19:37.735 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efd98ff9640 10 monclient(hunting): dump: 2026-02-13T20:19:37.735 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:37.735 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:37.735 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.735 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.735 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:37.735 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:37.735 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:37.735 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:37.735 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:37.735 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:37.735 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efd98ff9640 1 -- 10.20.193.110:0/3323101107 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4069123243 0 0) 0x7efd9c12b140 con 0x7efd9c057780 2026-02-13T20:19:37.735 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efd98ff9640 1 -- 10.20.193.110:0/3323101107 >> v1:10.20.193.188:6789/0 conn(0x7efd9c184b60 legacy=0x7efd9c173510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:37.735 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efd98ff9640 1 -- 10.20.193.110:0/3323101107 >> v1:10.20.193.110:6789/0 conn(0x7efd9c089250 legacy=0x7efd9c171df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:37.735 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efd98ff9640 10 monclient: _finish_hunting 0 2026-02-13T20:19:37.735 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efd98ff9640 1 monclient: found mon.c 2026-02-13T20:19:37.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efd98ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:19:37.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efd98ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:19:37.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efd98ff9640 1 -- 10.20.193.110:0/3323101107 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd9c110030 con 0x7efd9c057780 2026-02-13T20:19:37.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efd98ff9640 10 monclient: _finish_auth 0 2026-02-13T20:19:37.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efd98ff9640 10 monclient: _check_auth_tickets 2026-02-13T20:19:37.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efd98ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:19:37.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efda2a1b640 5 monclient: authenticate success, global_id 94325 2026-02-13T20:19:37.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efda2a1b640 10 monclient: _renew_subs 2026-02-13T20:19:37.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efda2a1b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:19:37.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efda2a1b640 1 -- 10.20.193.110:0/3323101107 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7efd9c112390 con 0x7efd9c057780 2026-02-13T20:19:37.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efda2a1b640 10 monclient: _renew_subs 2026-02-13T20:19:37.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efda2a1b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:19:37.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efda2a1b640 1 -- 10.20.193.110:0/3323101107 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7efd9c110b90 con 0x7efd9c057780 2026-02-13T20:19:37.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efd98ff9640 1 -- 10.20.193.110:0/3323101107 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efd88004280 con 0x7efd9c057780 2026-02-13T20:19:37.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efd98ff9640 10 monclient: handle_config config(0 keys) 2026-02-13T20:19:37.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efd98ff9640 1 -- 10.20.193.110:0/3323101107 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7efd880028d0 con 0x7efd9c057780 2026-02-13T20:19:37.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efd98ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:37.737 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efd98ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:19:37.739 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efd98ff9640 10 monclient: dump: 2026-02-13T20:19:37.739 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:37.739 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:37.739 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.739 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.739 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:37.739 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:37.739 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:37.739 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:37.740 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:37.740 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:37.740 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.723+0000 7efd9a7fc640 4 set_mon_vals no callback set 2026-02-13T20:19:37.740 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.724+0000 7efda2a1b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:19:37.740 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.724+0000 7efda2a1b640 1 -- 10.20.193.110:0/3323101107 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7efd9c12ddc0 con 0x7efd9c12d9f0 2026-02-13T20:19:37.740 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.724+0000 7efd98ff9640 1 -- 10.20.193.110:0/3323101107 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7efd88002a30 con 0x7efd9c057780 2026-02-13T20:19:37.740 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.724+0000 7efd98ff9640 1 -- 10.20.193.110:0/3323101107 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(395..395 src has 1..395) ==== 3975+0+0 (unknown 1949552152 0 0) 0x7efd8804e8f0 con 0x7efd9c057780 2026-02-13T20:19:37.740 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.724+0000 7efd98ff9640 1 -- 10.20.193.110:0/3323101107 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3688074051 0 0) 0x7efd9c12ddc0 con 0x7efd9c12d9f0 2026-02-13T20:19:37.740 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.724+0000 7efd98ff9640 10 monclient(hunting): _negotiate 2026-02-13T20:19:37.740 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.724+0000 7efd98ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:37.740 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.724+0000 7efd98ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:37.740 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.724+0000 7efd98ff9640 10 monclient(hunting): my global_id is 4732 2026-02-13T20:19:37.741 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.724+0000 7efd98ff9640 1 -- 10.20.193.110:0/3323101107 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd9c12b140 con 0x7efd9c12d9f0 2026-02-13T20:19:37.741 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.724+0000 7efda0f91640 10 monclient: get_auth_request con 0x7efd6c03fb00 auth_method 0 2026-02-13T20:19:37.741 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.724+0000 7efd98ff9640 1 -- 10.20.193.110:0/3323101107 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1672082781 0 0) 0x7efd9c12b140 con 0x7efd9c12d9f0 2026-02-13T20:19:37.741 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.724+0000 7efd98ff9640 1 -- 10.20.193.110:0/3323101107 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efd9c12ddc0 con 0x7efd9c12d9f0 2026-02-13T20:19:37.741 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.724+0000 7efd98ff9640 1 -- 10.20.193.110:0/3323101107 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7efd8c004a90 con 0x7efd9c12d9f0 2026-02-13T20:19:37.741 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.724+0000 7efd98ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:37.741 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.724+0000 7efd98ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:19:37.741 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.724+0000 7efd98ff9640 10 monclient: dump: 2026-02-13T20:19:37.741 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:37.741 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:37.741 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.741 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.741 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:37.741 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:37.741 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:37.741 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:37.741 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:37.742 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:37.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.725+0000 7efd98ff9640 1 -- 10.20.193.110:0/3323101107 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 601045819 0 0) 0x7efd9c12ddc0 con 0x7efd9c12d9f0 2026-02-13T20:19:37.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.725+0000 7efd98ff9640 1 -- 10.20.193.110:0/3323101107 --> v1:10.20.193.188:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efd9c08a670 con 0x7efd9c12d9f0 2026-02-13T20:19:37.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.725+0000 7efd98ff9640 1 -- 10.20.193.110:0/3323101107 <== mon.1 v1:10.20.193.188:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7efd8c004ed0 con 0x7efd9c12d9f0 2026-02-13T20:19:37.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.725+0000 7efd98ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:19:37.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.725+0000 7efd98ff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:19:37.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.725+0000 7efd98ff9640 1 -- 10.20.193.110:0/3323101107 >> v1:10.20.193.188:6789/0 conn(0x7efd9c12d9f0 legacy=0x7efd9c08ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:37.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.725+0000 7efd98ff9640 1 -- 10.20.193.110:0/3323101107 >> v1:10.20.193.188:6789/0 conn(0x7efd9c12d9f0 legacy=0x7efd9c08ef00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:19:37.744 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.728+0000 7efda2a1b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:19:37.744 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.728+0000 7efda2a1b640 1 -- 10.20.193.110:0/3323101107 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7efd9c089030 con 0x7efd9c08f610 2026-02-13T20:19:37.744 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.729+0000 7efd98ff9640 1 -- 10.20.193.110:0/3323101107 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 814309597 0 0) 0x7efd9c089030 con 0x7efd9c08f610 2026-02-13T20:19:37.744 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.729+0000 7efd98ff9640 10 monclient(hunting): _negotiate 2026-02-13T20:19:37.745 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.729+0000 7efd98ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:37.745 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.729+0000 7efd98ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:37.745 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.729+0000 7efd98ff9640 10 monclient(hunting): my global_id is 4735 2026-02-13T20:19:37.745 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.729+0000 7efd98ff9640 1 -- 10.20.193.110:0/3323101107 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd9c12ddc0 con 0x7efd9c08f610 2026-02-13T20:19:37.745 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.729+0000 7efd98ff9640 1 -- 10.20.193.110:0/3323101107 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2634175734 0 0) 0x7efd9c12ddc0 con 0x7efd9c08f610 2026-02-13T20:19:37.745 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.729+0000 7efd98ff9640 1 -- 10.20.193.110:0/3323101107 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efd9c089030 con 0x7efd9c08f610 2026-02-13T20:19:37.745 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.729+0000 7efd98ff9640 1 -- 10.20.193.110:0/3323101107 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7efd8c0055b0 con 0x7efd9c08f610 2026-02-13T20:19:37.745 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.729+0000 7efd98ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:37.745 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.729+0000 7efd98ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:19:37.745 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.729+0000 7efd98ff9640 10 monclient: dump: 2026-02-13T20:19:37.745 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:37.745 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:37.745 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.745 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.745 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:37.745 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:37.745 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:37.745 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:37.746 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:37.746 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:37.746 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.729+0000 7efd98ff9640 1 -- 10.20.193.110:0/3323101107 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 621699565 0 0) 0x7efd9c089030 con 0x7efd9c08f610 2026-02-13T20:19:37.746 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.729+0000 7efd98ff9640 1 -- 10.20.193.110:0/3323101107 --> v1:10.20.193.188:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7efd9c055bb0 con 0x7efd9c08f610 2026-02-13T20:19:37.746 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.729+0000 7efd98ff9640 1 -- 10.20.193.110:0/3323101107 <== mon.1 v1:10.20.193.188:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4683 (unknown 0 0 1567545522) 0x7efd8c0058b0 con 0x7efd9c08f610 2026-02-13T20:19:37.746 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.729+0000 7efd98ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:19:37.746 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.729+0000 7efd98ff9640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:19:37.746 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.729+0000 7efd98ff9640 1 -- 10.20.193.110:0/3323101107 >> v1:10.20.193.188:6789/0 conn(0x7efd9c08f610 legacy=0x7efd9c175c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:37.746 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.729+0000 7efd98ff9640 1 -- 10.20.193.110:0/3323101107 >> v1:10.20.193.188:6789/0 conn(0x7efd9c08f610 legacy=0x7efd9c175c40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:19:37.747 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:19:37.747 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:19:37.747 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:19:37.747 INFO:teuthology.orchestra.run.trial110.stdout: "state": "leader", 2026-02-13T20:19:37.747 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 32, 2026-02-13T20:19:37.747 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 499875, 2026-02-13T20:19:37.747 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:19:37.747 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:19:37.748 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:19:37.748 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:19:37.748 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:19:37.748 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 1, 2026-02-13T20:19:37.748 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:19:37.748 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:19:37.748 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:19:37.748 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:19:37.748 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:19:37.748 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:19:37.748 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:19:37.748 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:19:37.748 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:19:37.748 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:19:37.748 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:19:37.748 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:19:37.748 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:19:37.749 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:19:37.749 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:19:37.749 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:19:37.749 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:19:37.749 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:19:37.749 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:19:37.749 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:19:37.749 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:19:37.749 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:19:37.749 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:19:37.749 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:19:37.749 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:19:37.749 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:19:37.749 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:19:37.749 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:19:37.749 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:19:37.749 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:19:37.750 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:19:37.750 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:19:37.750 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:19:37.750 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:37.750 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:19:37.750 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:19:37.750 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:19:37.750 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:19:37.750 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:19:37.750 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:19:37.750 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:19:37.750 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:19:37.750 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:19:37.750 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:19:37.750 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:19:37.750 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:19:37.750 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:19:37.751 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:19:37.751 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:19:37.751 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:19:37.751 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:19:37.751 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:19:37.751 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:19:37.751 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:19:37.751 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:19:37.751 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:19:37.751 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:19:37.751 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:19:37.751 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:19:37.751 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:19:37.751 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:19:37.751 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:19:37.751 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:19:37.751 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:19:37.751 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:19:37.752 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:19:37.752 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:37.752 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:19:37.752 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:37.752 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:19:37.752 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:19:37.752 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:19:37.752 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:19:37.752 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:37.752 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:19:37.752 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:19:37.752 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:19:37.752 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:37.752 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:19:37.752 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:37.752 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:19:37.752 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:19:37.752 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:19:37.753 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:19:37.753 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:19:37.753 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:19:37.753 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:37.753 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:37.753 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:19:37.753 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:19:37.753 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:19:37.753 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:19:37.753 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:37.753 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:19:37.753 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:19:37.753 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:19:37.753 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:37.753 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:19:37.753 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:37.753 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:19:37.753 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:19:37.753 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:19:37.753 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:19:37.753 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:19:37.754 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:19:37.754 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:37.754 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:37.754 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:19:37.754 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:19:37.754 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:19:37.754 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:19:37.754 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:37.754 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:19:37.754 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:19:37.754 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:19:37.754 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:37.754 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:19:37.754 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:37.754 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:19:37.754 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:19:37.754 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:19:37.754 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:19:37.754 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:19:37.754 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:19:37.755 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:37.755 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:19:37.755 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:37.755 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:19:37.755 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:19:37.755 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:37.755 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:19:37.755 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:19:37.755 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:19:37.755 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:37.755 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:19:37.755 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:19:37.755 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:37.755 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:19:37.755 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:19:37.755 INFO:teuthology.orchestra.run.trial110.stdout: "num": 4 2026-02-13T20:19:37.755 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:37.755 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:19:37.755 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:19:37.755 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:37.755 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:19:37.756 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:19:37.756 INFO:teuthology.orchestra.run.trial110.stdout: "num": 6 2026-02-13T20:19:37.756 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:37.756 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:19:37.756 INFO:teuthology.orchestra.run.trial110.stdout: "mgr": [ 2026-02-13T20:19:37.756 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:37.756 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:19:37.756 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:19:37.756 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:19:37.756 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:37.756 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:19:37.756 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:37.756 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:19:37.756 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:19:37.757 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.729+0000 7efda2a1b640 1 -- 10.20.193.110:0/3323101107 >> v1:10.20.193.188:6812/1623052694 conn(0x7efd6c03fb00 legacy=0x7efd6c05ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:37.757 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.729+0000 7efda2a1b640 10 monclient: shutdown 2026-02-13T20:19:37.757 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.729+0000 7efda2a1b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:19:37.757 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.729+0000 7efda2a1b640 1 -- 10.20.193.110:0/3323101107 >> v1:10.20.193.110:6790/0 conn(0x7efd9c057780 legacy=0x7efd9c12aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:37.757 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.729+0000 7efda0f91640 1 -- 10.20.193.110:0/3323101107 reap_dead start 2026-02-13T20:19:37.757 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.729+0000 7efda0f91640 1 -- 10.20.193.110:0/3323101107 reap_dead start 2026-02-13T20:19:37.757 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.729+0000 7efda2a1b640 1 -- 10.20.193.110:0/3323101107 shutdown_connections 2026-02-13T20:19:37.758 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.729+0000 7efda2a1b640 1 -- 10.20.193.110:0/3323101107 >> 10.20.193.110:0/3323101107 conn(0x7efd9c054330 msgr2=0x7efd9c08ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:19:37.758 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.729+0000 7efda2a1b640 1 -- 10.20.193.110:0/3323101107 shutdown_connections 2026-02-13T20:19:37.758 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.729+0000 7efda2a1b640 1 -- 10.20.193.110:0/3323101107 wait complete. 2026-02-13T20:19:37.758 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:19:37.758 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-13T20:19:37.758 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-13T20:19:37.823 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.822+0000 7f78ad43e640 10 monclient: get_monmap_and_config 2026-02-13T20:19:37.823 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.822+0000 7f78ad43e640 10 monclient: build_initial_monmap 2026-02-13T20:19:37.823 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.822+0000 7f78ad43e640 10 monclient: monmap: 2026-02-13T20:19:37.823 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:19:37.823 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:37.823 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:19:37.823334+0000 2026-02-13T20:19:37.823 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:19:37.823334+0000 2026-02-13T20:19:37.823 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:19:37.823 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:37.823 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:19:37.823 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:19:37.823 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:19:37.823 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:37.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.823+0000 7f78ad43e640 1 Processor -- start 2026-02-13T20:19:37.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.823+0000 7f78ad43e640 1 -- start start 2026-02-13T20:19:37.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.823+0000 7f78ad43e640 10 monclient: init 2026-02-13T20:19:37.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.823+0000 7f78ad43e640 10 monclient: _reopen_session rank -1 2026-02-13T20:19:37.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.823+0000 7f78ad43e640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:19:37.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.823+0000 7f78ad43e640 10 monclient(hunting): picked mon.noname-c con 0x7f78a81401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:19:37.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.823+0000 7f78ad43e640 10 monclient(hunting): picked mon.noname-a con 0x7f78a8092020 addr v1:10.20.193.110:6789/0 2026-02-13T20:19:37.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.823+0000 7f78ad43e640 10 monclient(hunting): picked mon.noname-b con 0x7f78a8091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:19:37.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.823+0000 7f78ad43e640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78a808b730 con 0x7f78a8092020 2026-02-13T20:19:37.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.823+0000 7f78ad43e640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78a805c5b0 con 0x7f78a81401c0 2026-02-13T20:19:37.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.823+0000 7f78ad43e640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78a808bcf0 con 0x7f78a8091950 2026-02-13T20:19:37.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.823+0000 7f78ad43e640 10 monclient(hunting): _renew_subs 2026-02-13T20:19:37.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.823+0000 7f78ad43e640 10 monclient(hunting): authenticate will time out at 1139.513680s 2026-02-13T20:19:37.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.823+0000 7f78a77fe640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f78a8091950 0x7f78a81a2a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:37700/0 (socket says 10.20.193.110:37700) 2026-02-13T20:19:37.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.823+0000 7f78a67fc640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f78a8092020 0x7f78a81812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:52126/0 (socket says 10.20.193.110:52126) 2026-02-13T20:19:37.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.823+0000 7f78a77fe640 1 -- 10.20.193.110:0/2641571607 learned_addr learned my addr 10.20.193.110:0/2641571607 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:19:37.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.824+0000 7f78a5ffb640 1 -- 10.20.193.110:0/2641571607 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2633152308 0 0) 0x7f78a808b730 con 0x7f78a8092020 2026-02-13T20:19:37.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.824+0000 7f78a5ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:19:37.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.824+0000 7f78a5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:37.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.824+0000 7f78a5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:37.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.824+0000 7f78a5ffb640 10 monclient(hunting): my global_id is 114147 2026-02-13T20:19:37.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.824+0000 7f78a5ffb640 1 -- 10.20.193.110:0/2641571607 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78940035e0 con 0x7f78a8092020 2026-02-13T20:19:37.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.824+0000 7f78a5ffb640 1 -- 10.20.193.110:0/2641571607 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2538467731 0 0) 0x7f78a808bcf0 con 0x7f78a8091950 2026-02-13T20:19:37.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.824+0000 7f78a5ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:19:37.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.824+0000 7f78a5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:37.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.824+0000 7f78a5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:37.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.824+0000 7f78a5ffb640 10 monclient(hunting): my global_id is 94328 2026-02-13T20:19:37.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.824+0000 7f78a5ffb640 1 -- 10.20.193.110:0/2641571607 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78a808b730 con 0x7f78a8091950 2026-02-13T20:19:37.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.824+0000 7f78a5ffb640 1 -- 10.20.193.110:0/2641571607 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2547606857 0 0) 0x7f78a808b730 con 0x7f78a8091950 2026-02-13T20:19:37.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.824+0000 7f78a5ffb640 1 -- 10.20.193.110:0/2641571607 >> v1:10.20.193.188:6789/0 conn(0x7f78a81401c0 legacy=0x7f78a8091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T20:19:37.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.824+0000 7f78a5ffb640 1 -- 10.20.193.110:0/2641571607 >> v1:10.20.193.110:6789/0 conn(0x7f78a8092020 legacy=0x7f78a81812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:37.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.824+0000 7f78a5ffb640 10 monclient: _finish_hunting 0 2026-02-13T20:19:37.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.824+0000 7f78a5ffb640 1 monclient: found mon.noname-b 2026-02-13T20:19:37.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.824+0000 7f78a5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:19:37.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.824+0000 7f78a5ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:19:37.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.824+0000 7f78a5ffb640 1 -- 10.20.193.110:0/2641571607 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78a8140590 con 0x7f78a8091950 2026-02-13T20:19:37.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.824+0000 7f78a5ffb640 10 monclient: _finish_auth 0 2026-02-13T20:19:37.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.824+0000 7f78a5ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:19:37.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.824+0000 7f78a5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:19:37.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.824+0000 7f78a5ffb640 1 -- 10.20.193.110:0/2641571607 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f7898003eb0 con 0x7f78a8091950 2026-02-13T20:19:37.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.824+0000 7f78a5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:37.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.824+0000 7f78a5ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:19:37.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.824+0000 7f78a5ffb640 10 monclient: dump: 2026-02-13T20:19:37.825 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:37.825 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:37.825 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.825 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.825 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:37.825 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:37.825 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:37.825 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:37.825 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:37.825 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:37.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.824+0000 7f78ad43e640 5 monclient: authenticate success, global_id 94328 2026-02-13T20:19:37.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.824+0000 7f78ad43e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:19:37.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.824+0000 7f78a5ffb640 1 -- 10.20.193.110:0/2641571607 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7898004040 con 0x7f78a8091950 2026-02-13T20:19:37.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.824+0000 7f78a5ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T20:19:37.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.824+0000 7f78a5ffb640 1 -- 10.20.193.110:0/2641571607 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f7898004450 con 0x7f78a8091950 2026-02-13T20:19:37.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.824+0000 7f78a5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:37.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.824+0000 7f78a5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:19:37.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.824+0000 7f78a5ffb640 10 monclient: dump: 2026-02-13T20:19:37.826 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:37.826 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:37.826 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.826 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.826 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:37.826 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:37.826 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:37.826 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:37.826 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:37.826 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:37.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.824+0000 7f78ad43e640 10 monclient: get_monmap_and_config success 2026-02-13T20:19:37.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.824+0000 7f78ad43e640 4 set_mon_vals no callback set 2026-02-13T20:19:37.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.824+0000 7f78ad43e640 10 monclient: shutdown 2026-02-13T20:19:37.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.824+0000 7f78ad43e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:19:37.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.824+0000 7f78ad43e640 1 -- 10.20.193.110:0/2641571607 >> v1:10.20.193.110:6790/0 conn(0x7f78a8091950 legacy=0x7f78a81a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:37.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.824+0000 7f78ad43e640 1 -- 10.20.193.110:0/2641571607 shutdown_connections 2026-02-13T20:19:37.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.824+0000 7f78ad43e640 1 -- 10.20.193.110:0/2641571607 >> 10.20.193.110:0/2641571607 conn(0x7f78a8054e90 msgr2=0x7f78a8058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:19:37.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.824+0000 7f78ad43e640 1 -- 10.20.193.110:0/2641571607 shutdown_connections 2026-02-13T20:19:37.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.824+0000 7f78ad43e640 1 -- 10.20.193.110:0/2641571607 wait complete. 2026-02-13T20:19:37.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78ad43e640 10 monclient: build_initial_monmap 2026-02-13T20:19:37.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78ad43e640 10 monclient: monmap: 2026-02-13T20:19:37.828 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:19:37.828 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:19:37.828 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:19:37.828 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:19:37.828 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:19:37.828 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:19:37.828 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:19:37.828 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:19:37.828 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:19:37.828 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:37.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78ad43e640 1 Processor -- start 2026-02-13T20:19:37.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78ad43e640 1 -- start start 2026-02-13T20:19:37.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78ad43e640 10 monclient: init 2026-02-13T20:19:37.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78ad43e640 10 monclient: _reopen_session rank -1 2026-02-13T20:19:37.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78ad43e640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:19:37.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78ad43e640 10 monclient(hunting): picked mon.noname-b con 0x7f78a8091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:19:37.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78ad43e640 10 monclient(hunting): picked mon.noname-a con 0x7f78a81401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:19:37.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78ad43e640 10 monclient(hunting): picked mon.noname-c con 0x7f78a8194830 addr v1:10.20.193.110:6790/0 2026-02-13T20:19:37.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78ad43e640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78a805d320 con 0x7f78a81401c0 2026-02-13T20:19:37.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78ad43e640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78a81322b0 con 0x7f78a8091950 2026-02-13T20:19:37.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78ad43e640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78a8089c50 con 0x7f78a8194830 2026-02-13T20:19:37.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78ad43e640 10 monclient(hunting): _renew_subs 2026-02-13T20:19:37.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78ad43e640 10 monclient(hunting): authenticate will time out at 1139.515511s 2026-02-13T20:19:37.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78a67fc640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f78a81401c0 0x7f78a8089540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:52134/0 (socket says 10.20.193.110:52134) 2026-02-13T20:19:37.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78a77fe640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f78a8194830 0x7f78a8194c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:37712/0 (socket says 10.20.193.110:37712) 2026-02-13T20:19:37.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78a67fc640 1 -- 10.20.193.110:0/3213292264 learned_addr learned my addr 10.20.193.110:0/3213292264 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:19:37.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78877fe640 1 -- 10.20.193.110:0/3213292264 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3302082548 0 0) 0x7f78a805d320 con 0x7f78a81401c0 2026-02-13T20:19:37.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78877fe640 10 monclient(hunting): _negotiate 2026-02-13T20:19:37.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78877fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:37.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78877fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:37.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78877fe640 10 monclient(hunting): my global_id is 114150 2026-02-13T20:19:37.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78877fe640 1 -- 10.20.193.110:0/3213292264 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78740035e0 con 0x7f78a81401c0 2026-02-13T20:19:37.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78877fe640 1 -- 10.20.193.110:0/3213292264 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1774997597 0 0) 0x7f78a8089c50 con 0x7f78a8194830 2026-02-13T20:19:37.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78877fe640 10 monclient(hunting): _negotiate 2026-02-13T20:19:37.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78877fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:37.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78877fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:37.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78877fe640 10 monclient(hunting): my global_id is 94331 2026-02-13T20:19:37.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78877fe640 1 -- 10.20.193.110:0/3213292264 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78a805d320 con 0x7f78a8194830 2026-02-13T20:19:37.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78877fe640 1 -- 10.20.193.110:0/3213292264 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 355790925 0 0) 0x7f78740035e0 con 0x7f78a81401c0 2026-02-13T20:19:37.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78877fe640 1 -- 10.20.193.110:0/3213292264 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f78a8089c50 con 0x7f78a81401c0 2026-02-13T20:19:37.829 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78877fe640 1 -- 10.20.193.110:0/3213292264 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f78900031f0 con 0x7f78a81401c0 2026-02-13T20:19:37.829 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78877fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:19:37.829 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78877fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:19:37.829 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78877fe640 10 monclient(hunting): dump: 2026-02-13T20:19:37.829 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:37.829 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:37.829 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.829 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.829 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:37.829 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:37.829 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:37.829 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:37.829 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:37.829 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:37.829 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78877fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:19:37.829 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78877fe640 1 -- 10.20.193.110:0/3213292264 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2147907062 0 0) 0x7f78a805d320 con 0x7f78a8194830 2026-02-13T20:19:37.829 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78877fe640 1 -- 10.20.193.110:0/3213292264 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f78740035e0 con 0x7f78a8194830 2026-02-13T20:19:37.829 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78877fe640 1 -- 10.20.193.110:0/3213292264 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f7898003890 con 0x7f78a8194830 2026-02-13T20:19:37.829 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78877fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:19:37.829 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78877fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:19:37.829 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78877fe640 10 monclient(hunting): dump: 2026-02-13T20:19:37.829 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:37.829 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:37.829 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.829 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.829 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:37.829 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:37.829 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:37.829 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:37.829 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:37.829 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:37.829 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78877fe640 1 -- 10.20.193.110:0/3213292264 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2986043556 0 0) 0x7f78a8089c50 con 0x7f78a81401c0 2026-02-13T20:19:37.829 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78877fe640 1 -- 10.20.193.110:0/3213292264 >> v1:10.20.193.110:6790/0 conn(0x7f78a8194830 legacy=0x7f78a8194c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:37.829 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78877fe640 1 -- 10.20.193.110:0/3213292264 >> v1:10.20.193.188:6789/0 conn(0x7f78a8091950 legacy=0x7f78a8088e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:37.829 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78877fe640 10 monclient: _finish_hunting 0 2026-02-13T20:19:37.829 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78877fe640 1 monclient: found mon.a 2026-02-13T20:19:37.829 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78877fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:19:37.829 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78877fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:19:37.829 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.825+0000 7f78877fe640 1 -- 10.20.193.110:0/3213292264 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78a813fa60 con 0x7f78a81401c0 2026-02-13T20:19:37.829 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.826+0000 7f78877fe640 10 monclient: _finish_auth 0 2026-02-13T20:19:37.829 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.826+0000 7f78877fe640 10 monclient: _check_auth_tickets 2026-02-13T20:19:37.829 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.826+0000 7f78877fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:19:37.829 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.826+0000 7f78ad43e640 5 monclient: authenticate success, global_id 114150 2026-02-13T20:19:37.829 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.826+0000 7f78ad43e640 10 monclient: _renew_subs 2026-02-13T20:19:37.829 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.826+0000 7f78ad43e640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:19:37.830 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.826+0000 7f78ad43e640 1 -- 10.20.193.110:0/3213292264 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f78a8090d80 con 0x7f78a81401c0 2026-02-13T20:19:37.830 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.826+0000 7f78ad43e640 10 monclient: _renew_subs 2026-02-13T20:19:37.830 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.826+0000 7f78ad43e640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:19:37.830 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.826+0000 7f78ad43e640 1 -- 10.20.193.110:0/3213292264 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f78a8131fd0 con 0x7f78a81401c0 2026-02-13T20:19:37.830 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.826+0000 7f78877fe640 1 -- 10.20.193.110:0/3213292264 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7890003440 con 0x7f78a81401c0 2026-02-13T20:19:37.830 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.826+0000 7f78877fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:19:37.830 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.826+0000 7f78877fe640 1 -- 10.20.193.110:0/3213292264 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f7890004d00 con 0x7f78a81401c0 2026-02-13T20:19:37.830 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.826+0000 7f78877fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:37.830 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.826+0000 7f78877fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:19:37.830 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.826+0000 7f78a57fa640 4 set_mon_vals no callback set 2026-02-13T20:19:37.830 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.826+0000 7f78877fe640 10 monclient: dump: 2026-02-13T20:19:37.830 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:37.830 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:37.830 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.830 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:37.830 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:37.830 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:37.830 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:37.830 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:37.830 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:37.830 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:37.830 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.826+0000 7f78ad43e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:19:37.830 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.826+0000 7f78ad43e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:19:37.830 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.826+0000 7f78ad43e640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:19:37.830 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.826+0000 7f78ad43e640 1 -- 10.20.193.110:0/3213292264 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78a8130790 con 0x7f78a81401c0 2026-02-13T20:19:37.830 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.826+0000 7f78877fe640 1 -- 10.20.193.110:0/3213292264 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f7890011970 con 0x7f78a81401c0 2026-02-13T20:19:37.830 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.826+0000 7f78877fe640 1 -- 10.20.193.110:0/3213292264 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(395..395 src has 1..395) ==== 3975+0+0 (unknown 1949552152 0 0) 0x7f789004e990 con 0x7f78a81401c0 2026-02-13T20:19:37.830 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.826+0000 7f78a6ffd640 10 monclient: get_auth_request con 0x7f787403fae0 auth_method 0 2026-02-13T20:19:37.830 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.828+0000 7f78877fe640 1 -- 10.20.193.110:0/3213292264 <== mon.0 v1:10.20.193.110:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f7890017050 con 0x7f78a81401c0 2026-02-13T20:19:37.830 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.828+0000 7f78877fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:19:37.830 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.828+0000 7f78877fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:19:37.972 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.971+0000 7f78ad43e640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-13T20:19:37.972 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.971+0000 7f78ad43e640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-13T20:19:37.973 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.971+0000 7f78ad43e640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:19:37.973 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.971+0000 7f78ad43e640 1 -- 10.20.193.110:0/3213292264 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f78a8055bb0 con 0x7f78a81401c0 2026-02-13T20:19:37.974 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.972+0000 7f78877fe640 1 -- 10.20.193.110:0/3213292264 <== mon.0 v1:10.20.193.110:6789/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7f7890016800 con 0x7f78a81401c0 2026-02-13T20:19:37.974 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.972+0000 7f78877fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-13T20:19:37.974 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.972+0000 7f78877fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:19:37.981 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.973+0000 7f78ad43e640 1 -- 10.20.193.110:0/3213292264 >> v1:10.20.193.188:6812/1623052694 conn(0x7f787403fae0 legacy=0x7f787405ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:37.981 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.973+0000 7f78ad43e640 10 monclient: shutdown 2026-02-13T20:19:37.981 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.973+0000 7f78ad43e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:19:37.981 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.973+0000 7f78ad43e640 1 -- 10.20.193.110:0/3213292264 >> v1:10.20.193.110:6789/0 conn(0x7f78a81401c0 legacy=0x7f78a8089540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:37.981 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.973+0000 7f78ad43e640 1 -- 10.20.193.110:0/3213292264 shutdown_connections 2026-02-13T20:19:37.981 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.973+0000 7f78ad43e640 1 -- 10.20.193.110:0/3213292264 >> 10.20.193.110:0/3213292264 conn(0x7f78a8054e90 msgr2=0x7f78a808dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:19:37.981 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.973+0000 7f78ad43e640 1 -- 10.20.193.110:0/3213292264 shutdown_connections 2026-02-13T20:19:37.982 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:37.973+0000 7f78ad43e640 1 -- 10.20.193.110:0/3213292264 wait complete. 2026-02-13T20:19:37.987 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-13T20:19:37.989 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.971+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:19:37.989 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.971+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=17,config=2,health=11,kv=11,logm=59} crc {auth=929031864,config=1618278320,health=691171149,kv=1564860261,logm=906898181}) 2026-02-13T20:19:37.989 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.971+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=2,health=12,kv=11,logm=56} crc {auth=490012896,config=1618278320,health=1361790972,kv=3235604908,logm=3276088276}) 2026-02-13T20:19:37.989 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.971+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:19:37.989 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.971+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=17,config=2,health=11,kv=11,logm=59} crc {auth=929031864,config=1618278320,health=691171149,kv=1564860261,logm=906898181}) 2026-02-13T20:19:37.989 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.971+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=17,config=2,health=12,kv=11,logm=58} crc {auth=2577739322,config=1618278320,health=3620689670,kv=1564860261,logm=610921658}) 2026-02-13T20:19:37.989 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.972+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:19:37.989 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.972+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1992096279}) 2026-02-13T20:19:37.989 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.972+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4064242950}) 2026-02-13T20:19:37.990 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.972+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:19:37.990 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.972+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1992096279}) 2026-02-13T20:19:37.990 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.972+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4038584590}) 2026-02-13T20:19:37.990 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.972+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:19:37.990 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.972+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1956875404}) 2026-02-13T20:19:37.990 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.972+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3001974180}) 2026-02-13T20:19:37.990 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.972+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:19:37.990 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.972+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1956875404}) 2026-02-13T20:19:37.990 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.972+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3294542319}) 2026-02-13T20:19:37.990 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.973+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:19:37.990 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.973+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4107978190}) 2026-02-13T20:19:37.990 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.973+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1922856427}) 2026-02-13T20:19:37.991 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.973+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:19:37.991 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.973+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4107978190}) 2026-02-13T20:19:37.991 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.973+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1823997633}) 2026-02-13T20:19:37.991 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.973+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:19:37.991 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.973+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4231426341}) 2026-02-13T20:19:37.991 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.973+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3334745521}) 2026-02-13T20:19:37.991 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.973+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:19:37.991 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.973+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4231426341}) 2026-02-13T20:19:37.991 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.973+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3137651766}) 2026-02-13T20:19:37.991 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.974+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:19:37.991 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.974+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=51757381}) 2026-02-13T20:19:37.991 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.974+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3718597501}) 2026-02-13T20:19:37.991 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.974+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:19:37.992 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.974+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=51757381}) 2026-02-13T20:19:37.992 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.974+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1887188952}) 2026-02-13T20:19:37.992 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.974+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:19:37.992 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.974+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2164659398}) 2026-02-13T20:19:37.992 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.974+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=539814449}) 2026-02-13T20:19:37.992 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.974+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:19:37.992 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.974+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2164659398}) 2026-02-13T20:19:37.992 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.974+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3571433170}) 2026-02-13T20:19:37.992 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.975+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:19:37.992 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.975+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=285341747}) 2026-02-13T20:19:37.992 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.975+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=645291461}) 2026-02-13T20:19:37.992 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.975+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:19:37.992 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.975+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=285341747}) 2026-02-13T20:19:37.993 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.975+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=66140232}) 2026-02-13T20:19:37.993 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.975+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:19:37.993 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.975+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2517743477}) 2026-02-13T20:19:37.993 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.975+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=91819186}) 2026-02-13T20:19:37.993 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.975+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:19:37.993 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.975+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2517743477}) 2026-02-13T20:19:37.993 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.975+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1996774889}) 2026-02-13T20:19:37.993 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.975+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:19:37.993 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.976+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3156655993}) 2026-02-13T20:19:37.993 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.976+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1369805865}) 2026-02-13T20:19:37.993 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.976+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:19:37.993 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.976+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3156655993}) 2026-02-13T20:19:37.994 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.976+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4123578098}) 2026-02-13T20:19:37.994 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.976+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:19:37.994 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.976+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2056006850}) 2026-02-13T20:19:37.994 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.976+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=848476900}) 2026-02-13T20:19:37.994 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.976+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:19:37.994 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.976+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2056006850}) 2026-02-13T20:19:37.994 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.976+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3750722635}) 2026-02-13T20:19:37.994 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.977+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:19:37.994 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.977+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1851081456}) 2026-02-13T20:19:37.994 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.977+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1063276157}) 2026-02-13T20:19:37.994 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.977+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:19:37.994 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.977+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1851081456}) 2026-02-13T20:19:37.995 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.977+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=281119043}) 2026-02-13T20:19:37.995 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.977+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:19:37.995 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.977+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2398508240}) 2026-02-13T20:19:37.995 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.977+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3997677752}) 2026-02-13T20:19:37.995 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.977+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:19:37.995 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.977+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2398508240}) 2026-02-13T20:19:37.995 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.977+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2797350296}) 2026-02-13T20:19:37.995 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.977+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:19:37.995 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.977+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=838661495}) 2026-02-13T20:19:37.995 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.977+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=969010059}) 2026-02-13T20:19:37.995 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.977+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:19:37.995 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.977+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=838661495}) 2026-02-13T20:19:37.996 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.977+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=195132795}) 2026-02-13T20:19:37.996 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.978+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:19:37.996 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.978+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1238678818}) 2026-02-13T20:19:37.996 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.978+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2486678327}) 2026-02-13T20:19:37.996 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.978+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:19:37.996 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.978+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1238678818}) 2026-02-13T20:19:37.996 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.978+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3279321759}) 2026-02-13T20:19:37.996 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.978+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:19:37.996 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.978+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1950549037}) 2026-02-13T20:19:37.996 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.978+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=530612587}) 2026-02-13T20:19:37.996 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.978+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:19:37.996 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.978+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1950549037}) 2026-02-13T20:19:37.996 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.978+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2270464503}) 2026-02-13T20:19:37.997 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.979+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:19:37.997 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.979+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=5,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=10,monmap=3,nvmeofgw=2,osd_metadata=6,osd_pg_creating=1,osd_snap=48} crc {logm=213538535,mdsmap=3740562891,mgr=2792164528,mgr_command_descs=714296370,mgr_metadata=2819730505,mgrstat=1683322791,mon_config_key=3557484700,monmap=207866895,nvmeofgw=935146538,osd_metadata=91123727,osd_pg_creating=897875103,osd_snap=137119604}) 2026-02-13T20:19:37.997 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.979+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=5,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=9,monmap=3,nvmeofgw=2,osd_metadata=5,osd_pg_creating=1,osd_snap=51} crc {logm=213538536,mdsmap=3740562891,mgr=2881591710,mgr_command_descs=714296370,mgr_metadata=2819730505,mgrstat=665019829,mon_config_key=2718569267,monmap=207866894,nvmeofgw=935146538,osd_metadata=2831885246,osd_pg_creating=897875103,osd_snap=2891803529}) 2026-02-13T20:19:37.997 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.979+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:19:37.997 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.979+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=5,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=10,monmap=3,nvmeofgw=2,osd_metadata=6,osd_pg_creating=1,osd_snap=48} crc {logm=213538535,mdsmap=3740562891,mgr=2792164528,mgr_command_descs=714296370,mgr_metadata=2819730505,mgrstat=1683322791,mon_config_key=3557484700,monmap=207866895,nvmeofgw=935146538,osd_metadata=91123727,osd_pg_creating=897875103,osd_snap=137119604}) 2026-02-13T20:19:37.997 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.979+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=5,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=10,monmap=2,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=49} crc {logm=213538535,mdsmap=3740562891,mgr=2881591710,mgr_command_descs=714296370,mgr_metadata=2819730505,mgrstat=1342609755,mon_config_key=2153718872,monmap=3140514009,nvmeofgw=3360707892,osd_metadata=3112185304,osd_pg_creating=897875103,osd_snap=3170137813}) 2026-02-13T20:19:37.997 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.980+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:19:37.997 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.980+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=23,osdmap=77} crc {osd_snap=1257519739,osdmap=3613439576}) 2026-02-13T20:19:37.997 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.980+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=23,osdmap=77} crc {osd_snap=446559078,osdmap=3489446961}) 2026-02-13T20:19:37.997 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.980+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:19:37.997 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.980+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=23,osdmap=77} crc {osd_snap=1257519739,osdmap=3613439576}) 2026-02-13T20:19:37.997 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.980+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=22,osdmap=78} crc {osd_snap=1435042598,osdmap=2433579263}) 2026-02-13T20:19:37.997 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.980+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:19:37.998 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.980+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1505717028}) 2026-02-13T20:19:37.998 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.980+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1669191672}) 2026-02-13T20:19:37.998 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.980+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:19:37.998 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.980+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1505717028}) 2026-02-13T20:19:37.998 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.980+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=4227310983}) 2026-02-13T20:19:37.998 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.981+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:19:37.998 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.981+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=118846327}) 2026-02-13T20:19:37.998 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.981+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=554325227}) 2026-02-13T20:19:37.998 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.981+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:19:37.998 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.981+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=118846327}) 2026-02-13T20:19:37.998 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.981+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=110153106}) 2026-02-13T20:19:37.998 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.981+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:19:37.998 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.981+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2759189301}) 2026-02-13T20:19:37.998 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.981+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3319384506}) 2026-02-13T20:19:37.999 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.981+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:19:37.999 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.981+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2759189301}) 2026-02-13T20:19:37.999 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.981+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1065182113}) 2026-02-13T20:19:37.999 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.982+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:19:37.999 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.982+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3439009700}) 2026-02-13T20:19:37.999 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.982+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3261624851}) 2026-02-13T20:19:37.999 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.982+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:19:37.999 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.982+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3439009700}) 2026-02-13T20:19:37.999 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.982+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1342760782}) 2026-02-13T20:19:37.999 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.982+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:19:37.999 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.982+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=812874603}) 2026-02-13T20:19:37.999 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.982+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1834320207}) 2026-02-13T20:19:37.999 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.982+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:19:37.999 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.982+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=812874603}) 2026-02-13T20:19:37.999 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.982+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3196592708}) 2026-02-13T20:19:38.000 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.984+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:19:38.000 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.984+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=4} crc {osdmap=3496608185}) 2026-02-13T20:19:38.000 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.984+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=5} crc {osdmap=778602233}) 2026-02-13T20:19:38.000 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.984+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:19:38.000 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.984+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=4} crc {osdmap=3496608185}) 2026-02-13T20:19:38.000 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:19:37.984+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=5} crc {osdmap=778602233}) 2026-02-13T20:19:38.062 INFO:tasks.rados.rados.0.trial188.stdout:1859: done (4 left) 2026-02-13T20:19:38.062 INFO:tasks.rados.rados.0.trial188.stdout:1860: done (3 left) 2026-02-13T20:19:38.062 INFO:tasks.rados.rados.0.trial188.stdout:1861: done (2 left) 2026-02-13T20:19:38.062 INFO:tasks.rados.rados.0.trial188.stdout:1862: done (1 left) 2026-02-13T20:19:38.062 INFO:tasks.rados.rados.0.trial188.stdout:1863: done (0 left) 2026-02-13T20:19:38.062 INFO:tasks.rados.rados.0.trial188.stdout:1864: read oid 23 snap -1 2026-02-13T20:19:38.062 INFO:tasks.rados.rados.0.trial188.stdout:1864: expect deleted 2026-02-13T20:19:38.062 INFO:tasks.rados.rados.0.trial188.stdout:1865: snap_create 2026-02-13T20:19:38.988 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-13T20:19:38.989 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T20:19:39.056 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.056+0000 7fef0a50c640 10 monclient: get_monmap_and_config 2026-02-13T20:19:39.056 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.056+0000 7fef0a50c640 10 monclient: build_initial_monmap 2026-02-13T20:19:39.056 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.056+0000 7fef0a50c640 10 monclient: monmap: 2026-02-13T20:19:39.056 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:19:39.056 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:39.056 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:19:39.056446+0000 2026-02-13T20:19:39.056 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:19:39.056446+0000 2026-02-13T20:19:39.056 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:19:39.056 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:39.056 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:19:39.056 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:19:39.056 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:19:39.056 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:39.058 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.056+0000 7fef0a50c640 1 Processor -- start 2026-02-13T20:19:39.058 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.056+0000 7fef0a50c640 1 -- start start 2026-02-13T20:19:39.058 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.056+0000 7fef0a50c640 10 monclient: init 2026-02-13T20:19:39.058 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.056+0000 7fef0a50c640 10 monclient: _reopen_session rank -1 2026-02-13T20:19:39.058 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.056+0000 7fef0a50c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:19:39.058 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.056+0000 7fef0a50c640 10 monclient(hunting): picked mon.noname-a con 0x7fef041401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:19:39.058 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.056+0000 7fef0a50c640 10 monclient(hunting): picked mon.noname-b con 0x7fef04092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:19:39.058 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.056+0000 7fef0a50c640 10 monclient(hunting): picked mon.noname-c con 0x7fef04091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:19:39.058 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.056+0000 7fef0a50c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef0408b730 con 0x7fef041401c0 2026-02-13T20:19:39.058 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.056+0000 7fef0a50c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef0405c5b0 con 0x7fef04091950 2026-02-13T20:19:39.058 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.056+0000 7fef0a50c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef0408bcf0 con 0x7fef04092020 2026-02-13T20:19:39.058 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.056+0000 7fef0a50c640 10 monclient(hunting): _renew_subs 2026-02-13T20:19:39.058 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.056+0000 7fef0a50c640 10 monclient(hunting): authenticate will time out at 1140.746782s 2026-02-13T20:19:39.058 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.056+0000 7fef03fff640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fef041401c0 0x7fef04091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:52146/0 (socket says 10.20.193.110:52146) 2026-02-13T20:19:39.058 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.056+0000 7fef03fff640 1 -- 10.20.193.110:0/2316636224 learned_addr learned my addr 10.20.193.110:0/2316636224 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:19:39.058 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.057+0000 7fef02ffd640 1 -- 10.20.193.110:0/2316636224 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2046558064 0 0) 0x7fef0408b730 con 0x7fef041401c0 2026-02-13T20:19:39.058 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.057+0000 7fef02ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:19:39.058 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.057+0000 7fef02ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:39.058 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.057+0000 7fef02ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:39.058 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.057+0000 7fef02ffd640 10 monclient(hunting): my global_id is 114153 2026-02-13T20:19:39.058 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.057+0000 7fef02ffd640 1 -- 10.20.193.110:0/2316636224 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feee80035e0 con 0x7fef041401c0 2026-02-13T20:19:39.058 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.057+0000 7fef02ffd640 1 -- 10.20.193.110:0/2316636224 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1132973590 0 0) 0x7fef0408bcf0 con 0x7fef04092020 2026-02-13T20:19:39.058 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.057+0000 7fef02ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:19:39.058 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.057+0000 7fef02ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:39.058 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.057+0000 7fef02ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:39.058 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.057+0000 7fef02ffd640 10 monclient(hunting): my global_id is 94334 2026-02-13T20:19:39.058 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.057+0000 7fef02ffd640 1 -- 10.20.193.110:0/2316636224 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef0408b730 con 0x7fef04092020 2026-02-13T20:19:39.058 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.057+0000 7fef02ffd640 1 -- 10.20.193.110:0/2316636224 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3570825934 0 0) 0x7feee80035e0 con 0x7fef041401c0 2026-02-13T20:19:39.058 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.057+0000 7fef02ffd640 1 -- 10.20.193.110:0/2316636224 >> v1:10.20.193.110:6790/0 conn(0x7fef04092020 legacy=0x7fef041812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:39.058 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.057+0000 7fef02ffd640 1 -- 10.20.193.110:0/2316636224 >> v1:10.20.193.188:6789/0 conn(0x7fef04091950 legacy=0x7fef041a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:39.058 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.057+0000 7fef02ffd640 10 monclient: _finish_hunting 0 2026-02-13T20:19:39.058 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.057+0000 7fef02ffd640 1 monclient: found mon.noname-a 2026-02-13T20:19:39.058 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.057+0000 7fef02ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:19:39.058 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.057+0000 7fef02ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:19:39.058 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.057+0000 7fef02ffd640 1 -- 10.20.193.110:0/2316636224 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef04140590 con 0x7fef041401c0 2026-02-13T20:19:39.059 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.057+0000 7fef02ffd640 10 monclient: _finish_auth 0 2026-02-13T20:19:39.059 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.057+0000 7fef02ffd640 10 monclient: _check_auth_tickets 2026-02-13T20:19:39.059 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.057+0000 7fef02ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:19:39.059 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.057+0000 7fef02ffd640 1 -- 10.20.193.110:0/2316636224 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7feef0002dd0 con 0x7fef041401c0 2026-02-13T20:19:39.059 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.057+0000 7fef02ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:39.059 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.057+0000 7fef02ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:19:39.059 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.057+0000 7fef02ffd640 10 monclient: dump: 2026-02-13T20:19:39.059 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:39.059 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:39.059 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.059 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.059 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:39.059 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:39.059 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:39.059 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:39.059 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:39.059 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:39.059 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.057+0000 7fef0a50c640 5 monclient: authenticate success, global_id 114153 2026-02-13T20:19:39.059 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.057+0000 7fef0a50c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:19:39.059 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.057+0000 7fef02ffd640 1 -- 10.20.193.110:0/2316636224 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feef0003020 con 0x7fef041401c0 2026-02-13T20:19:39.059 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.057+0000 7fef02ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:19:39.059 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.057+0000 7fef02ffd640 1 -- 10.20.193.110:0/2316636224 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7feef0003430 con 0x7fef041401c0 2026-02-13T20:19:39.059 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.057+0000 7fef0a50c640 10 monclient: get_monmap_and_config success 2026-02-13T20:19:39.059 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.057+0000 7fef0a50c640 4 set_mon_vals no callback set 2026-02-13T20:19:39.059 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.057+0000 7fef02ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:39.059 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.057+0000 7fef02ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:19:39.059 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.057+0000 7fef02ffd640 10 monclient: dump: 2026-02-13T20:19:39.059 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:39.059 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:39.059 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.059 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.059 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:39.059 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:39.059 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:39.059 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:39.059 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:39.059 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:39.059 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.057+0000 7fef0a50c640 10 monclient: shutdown 2026-02-13T20:19:39.059 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.057+0000 7fef0a50c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:19:39.059 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.057+0000 7fef0a50c640 1 -- 10.20.193.110:0/2316636224 >> v1:10.20.193.110:6789/0 conn(0x7fef041401c0 legacy=0x7fef04091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:39.059 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.057+0000 7fef0a50c640 1 -- 10.20.193.110:0/2316636224 shutdown_connections 2026-02-13T20:19:39.059 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.057+0000 7fef0a50c640 1 -- 10.20.193.110:0/2316636224 >> 10.20.193.110:0/2316636224 conn(0x7fef04054e90 msgr2=0x7fef04058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:19:39.060 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.057+0000 7fef0a50c640 1 -- 10.20.193.110:0/2316636224 shutdown_connections 2026-02-13T20:19:39.060 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.057+0000 7fef0a50c640 1 -- 10.20.193.110:0/2316636224 wait complete. 2026-02-13T20:19:39.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.058+0000 7fef0a50c640 10 monclient: build_initial_monmap 2026-02-13T20:19:39.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.058+0000 7fef0a50c640 10 monclient: monmap: 2026-02-13T20:19:39.061 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:19:39.061 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:19:39.061 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:19:39.061 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:19:39.061 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:19:39.061 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:19:39.061 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:19:39.061 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:19:39.061 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:19:39.061 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:39.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.058+0000 7fef0a50c640 1 Processor -- start 2026-02-13T20:19:39.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.058+0000 7fef0a50c640 1 -- start start 2026-02-13T20:19:39.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.058+0000 7fef0a50c640 10 monclient: init 2026-02-13T20:19:39.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.058+0000 7fef0a50c640 10 monclient: _reopen_session rank -1 2026-02-13T20:19:39.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.058+0000 7fef0a50c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:19:39.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.058+0000 7fef0a50c640 10 monclient(hunting): picked mon.noname-c con 0x7fef04091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:19:39.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.058+0000 7fef0a50c640 10 monclient(hunting): picked mon.noname-b con 0x7fef041401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:19:39.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.058+0000 7fef0a50c640 10 monclient(hunting): picked mon.noname-a con 0x7fef0413db40 addr v1:10.20.193.110:6789/0 2026-02-13T20:19:39.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.058+0000 7fef0a50c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef0412bfa0 con 0x7fef0413db40 2026-02-13T20:19:39.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.058+0000 7fef0a50c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef0412abb0 con 0x7fef041401c0 2026-02-13T20:19:39.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.058+0000 7fef0a50c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef0412c670 con 0x7fef04091950 2026-02-13T20:19:39.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.058+0000 7fef0a50c640 10 monclient(hunting): _renew_subs 2026-02-13T20:19:39.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.058+0000 7fef0a50c640 10 monclient(hunting): authenticate will time out at 1140.748608s 2026-02-13T20:19:39.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.058+0000 7fef03fff640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fef04091950 0x7fef0413d430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:37732/0 (socket says 10.20.193.110:37732) 2026-02-13T20:19:39.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.058+0000 7fef03fff640 1 -- 10.20.193.110:0/236492360 learned_addr learned my addr 10.20.193.110:0/236492360 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:19:39.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.058+0000 7fef00ff9640 1 -- 10.20.193.110:0/236492360 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2693730574 0 0) 0x7fef0412c670 con 0x7fef04091950 2026-02-13T20:19:39.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.058+0000 7fef00ff9640 10 monclient(hunting): _negotiate 2026-02-13T20:19:39.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.058+0000 7fef00ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:39.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.058+0000 7fef00ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:39.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.058+0000 7fef00ff9640 10 monclient(hunting): my global_id is 94337 2026-02-13T20:19:39.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.058+0000 7fef00ff9640 1 -- 10.20.193.110:0/236492360 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feed40035e0 con 0x7fef04091950 2026-02-13T20:19:39.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.058+0000 7fef00ff9640 1 -- 10.20.193.110:0/236492360 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1885400223 0 0) 0x7fef0412bfa0 con 0x7fef0413db40 2026-02-13T20:19:39.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.058+0000 7fef00ff9640 10 monclient(hunting): _negotiate 2026-02-13T20:19:39.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.058+0000 7fef00ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:39.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.058+0000 7fef00ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:39.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.058+0000 7fef00ff9640 10 monclient(hunting): my global_id is 114156 2026-02-13T20:19:39.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.058+0000 7fef00ff9640 1 -- 10.20.193.110:0/236492360 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef0412c670 con 0x7fef0413db40 2026-02-13T20:19:39.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.058+0000 7fef00ff9640 1 -- 10.20.193.110:0/236492360 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1360536040 0 0) 0x7fef0412c670 con 0x7fef0413db40 2026-02-13T20:19:39.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.058+0000 7fef00ff9640 1 -- 10.20.193.110:0/236492360 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fef0412bfa0 con 0x7fef0413db40 2026-02-13T20:19:39.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.058+0000 7fef00ff9640 1 -- 10.20.193.110:0/236492360 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7feef80040d0 con 0x7fef0413db40 2026-02-13T20:19:39.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.058+0000 7fef00ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:19:39.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.059+0000 7fef00ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:19:39.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.059+0000 7fef00ff9640 10 monclient(hunting): dump: 2026-02-13T20:19:39.062 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:39.062 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:39.062 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.062 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.062 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:39.062 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:39.062 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:39.062 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:39.062 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:39.062 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:39.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.059+0000 7fef00ff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:19:39.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.059+0000 7fef00ff9640 1 -- 10.20.193.110:0/236492360 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3774492999 0 0) 0x7feed40035e0 con 0x7fef04091950 2026-02-13T20:19:39.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.059+0000 7fef00ff9640 1 -- 10.20.193.110:0/236492360 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fef0412c670 con 0x7fef04091950 2026-02-13T20:19:39.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.059+0000 7fef00ff9640 1 -- 10.20.193.110:0/236492360 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7feef0003340 con 0x7fef04091950 2026-02-13T20:19:39.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.059+0000 7fef00ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:19:39.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.059+0000 7fef00ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:19:39.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.059+0000 7fef00ff9640 10 monclient(hunting): dump: 2026-02-13T20:19:39.062 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:39.062 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:39.062 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.062 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.062 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:39.062 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:39.062 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:39.062 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:39.062 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:39.062 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:39.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.059+0000 7fef00ff9640 1 -- 10.20.193.110:0/236492360 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3389373606 0 0) 0x7fef0412bfa0 con 0x7fef0413db40 2026-02-13T20:19:39.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.059+0000 7fef00ff9640 1 -- 10.20.193.110:0/236492360 >> v1:10.20.193.110:6790/0 conn(0x7fef04091950 legacy=0x7fef0413d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:39.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.059+0000 7fef00ff9640 1 -- 10.20.193.110:0/236492360 >> v1:10.20.193.188:6789/0 conn(0x7fef041401c0 legacy=0x7fef041d5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:39.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.059+0000 7fef00ff9640 10 monclient: _finish_hunting 0 2026-02-13T20:19:39.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.059+0000 7fef00ff9640 1 monclient: found mon.a 2026-02-13T20:19:39.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.059+0000 7fef00ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:19:39.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.059+0000 7fef00ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:19:39.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.059+0000 7fef00ff9640 1 -- 10.20.193.110:0/236492360 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef0412c950 con 0x7fef0413db40 2026-02-13T20:19:39.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.059+0000 7fef00ff9640 10 monclient: _finish_auth 0 2026-02-13T20:19:39.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.059+0000 7fef00ff9640 10 monclient: _check_auth_tickets 2026-02-13T20:19:39.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.059+0000 7fef00ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:19:39.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.059+0000 7fef0a50c640 5 monclient: authenticate success, global_id 114156 2026-02-13T20:19:39.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.059+0000 7fef0a50c640 10 monclient: _renew_subs 2026-02-13T20:19:39.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.059+0000 7fef0a50c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:19:39.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.059+0000 7fef0a50c640 1 -- 10.20.193.110:0/236492360 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fef041d5c20 con 0x7fef0413db40 2026-02-13T20:19:39.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.059+0000 7fef0a50c640 10 monclient: _renew_subs 2026-02-13T20:19:39.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.059+0000 7fef0a50c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:19:39.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.059+0000 7fef0a50c640 1 -- 10.20.193.110:0/236492360 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fef04238f40 con 0x7fef0413db40 2026-02-13T20:19:39.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.059+0000 7fef00ff9640 1 -- 10.20.193.110:0/236492360 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feef80042a0 con 0x7fef0413db40 2026-02-13T20:19:39.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.059+0000 7fef00ff9640 10 monclient: handle_config config(0 keys) 2026-02-13T20:19:39.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.059+0000 7fef00ff9640 1 -- 10.20.193.110:0/236492360 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7feef80049a0 con 0x7fef0413db40 2026-02-13T20:19:39.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.059+0000 7fef00ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:39.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.059+0000 7fef00ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:19:39.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.059+0000 7fef00ff9640 10 monclient: dump: 2026-02-13T20:19:39.063 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:39.063 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:39.063 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.063 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.063 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:39.063 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:39.063 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:39.063 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:39.063 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:39.063 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:39.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.059+0000 7fef027fc640 4 set_mon_vals no callback set 2026-02-13T20:19:39.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.059+0000 7fef0a50c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:19:39.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.059+0000 7fef0a50c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:19:39.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.059+0000 7fef0a50c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:19:39.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.059+0000 7fef0a50c640 1 -- 10.20.193.110:0/236492360 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef040008d0 con 0x7fef0413db40 2026-02-13T20:19:39.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.059+0000 7fef00ff9640 1 -- 10.20.193.110:0/236492360 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7feef8011610 con 0x7fef0413db40 2026-02-13T20:19:39.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.060+0000 7fef00ff9640 1 -- 10.20.193.110:0/236492360 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(396..396 src has 1..396) ==== 3959+0+0 (unknown 3455481903 0 0) 0x7feef804e720 con 0x7fef0413db40 2026-02-13T20:19:39.063 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.060+0000 7fef03fff640 10 monclient: get_auth_request con 0x7feed403fa50 auth_method 0 2026-02-13T20:19:39.064 INFO:tasks.rados.rados.0.trial188.stdout:1864: done (1 left) 2026-02-13T20:19:39.064 INFO:tasks.rados.rados.0.trial188.stdout:1865: done (0 left) 2026-02-13T20:19:39.064 INFO:tasks.rados.rados.0.trial188.stdout:1866: snap_create 2026-02-13T20:19:39.064 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.062+0000 7fef00ff9640 1 -- 10.20.193.110:0/236492360 <== mon.0 v1:10.20.193.110:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7feef8016ef0 con 0x7fef0413db40 2026-02-13T20:19:39.064 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.062+0000 7fef00ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:19:39.064 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.062+0000 7fef00ff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:19:39.212 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.211+0000 7fef0a50c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T20:19:39.212 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.211+0000 7fef0a50c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T20:19:39.212 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.211+0000 7fef0a50c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:19:39.212 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.211+0000 7fef0a50c640 1 -- 10.20.193.110:0/236492360 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fef04058410 con 0x7fef0413db40 2026-02-13T20:19:39.212 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.211+0000 7fef00ff9640 1 -- 10.20.193.110:0/236492360 <== mon.0 v1:10.20.193.110:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 2681314519) 0x7feef80166a0 con 0x7fef0413db40 2026-02-13T20:19:39.212 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.211+0000 7fef00ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T20:19:39.212 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.211+0000 7fef00ff9640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:19:39.212 INFO:teuthology.orchestra.run.trial110.stdout:{"election_epoch":32,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","modified":"2026-02-13T20:11:07.161192Z","created":"2026-02-13T20:11:07.161192Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6789","nonce":0}]},"addr":"10.20.193.110:6789/0","public_addr":"10.20.193.110:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161241+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6789","nonce":0}]},"addr":"10.20.193.188:6789/0","public_addr":"10.20.193.188:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161242+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6790","nonce":0}]},"addr":"10.20.193.110:6790/0","public_addr":"10.20.193.110:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161243+0000","crush_location":[]}]}} 2026-02-13T20:19:39.214 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.213+0000 7fef0a50c640 1 -- 10.20.193.110:0/236492360 >> v1:10.20.193.188:6812/1623052694 conn(0x7feed403fa50 legacy=0x7feed405ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:39.214 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.213+0000 7fef0a50c640 10 monclient: shutdown 2026-02-13T20:19:39.214 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.213+0000 7fef0a50c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:19:39.214 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.213+0000 7fef0a50c640 1 -- 10.20.193.110:0/236492360 >> v1:10.20.193.110:6789/0 conn(0x7fef0413db40 legacy=0x7fef04237680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:39.214 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.213+0000 7fef0a50c640 1 -- 10.20.193.110:0/236492360 shutdown_connections 2026-02-13T20:19:39.214 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.213+0000 7fef0a50c640 1 -- 10.20.193.110:0/236492360 >> 10.20.193.110:0/236492360 conn(0x7fef04054e90 msgr2=0x7fef040893e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:19:39.214 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.214+0000 7fef0a50c640 1 -- 10.20.193.110:0/236492360 shutdown_connections 2026-02-13T20:19:39.214 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.214+0000 7fef0a50c640 1 -- 10.20.193.110:0/236492360 wait complete. 2026-02-13T20:19:39.222 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-13T20:19:39.222 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-13T20:19:39.222 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-13T20:19:39.222 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T20:19:39.288 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.287+0000 7f51ffc12640 10 monclient: get_monmap_and_config 2026-02-13T20:19:39.288 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.287+0000 7f51ffc12640 10 monclient: build_initial_monmap 2026-02-13T20:19:39.288 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.287+0000 7f51ffc12640 10 monclient: monmap: 2026-02-13T20:19:39.288 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:19:39.288 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:39.288 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:19:39.288211+0000 2026-02-13T20:19:39.288 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:19:39.288211+0000 2026-02-13T20:19:39.288 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:19:39.289 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:39.289 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:19:39.289 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:19:39.289 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:19:39.289 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:39.293 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.288+0000 7f51ffc12640 1 Processor -- start 2026-02-13T20:19:39.293 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.288+0000 7f51ffc12640 1 -- start start 2026-02-13T20:19:39.293 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.288+0000 7f51ffc12640 10 monclient: init 2026-02-13T20:19:39.293 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.288+0000 7f51ffc12640 10 monclient: _reopen_session rank -1 2026-02-13T20:19:39.293 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.288+0000 7f51ffc12640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:19:39.293 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.288+0000 7f51ffc12640 10 monclient(hunting): picked mon.noname-a con 0x7f51f8091e20 addr v1:10.20.193.110:6789/0 2026-02-13T20:19:39.293 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.288+0000 7f51ffc12640 10 monclient(hunting): picked mon.noname-b con 0x7f51f8089540 addr v1:10.20.193.110:6790/0 2026-02-13T20:19:39.293 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.288+0000 7f51ffc12640 10 monclient(hunting): picked mon.noname-c con 0x7f51f8089980 addr v1:10.20.193.188:6789/0 2026-02-13T20:19:39.293 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.288+0000 7f51ffc12640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51f805b3d0 con 0x7f51f8091e20 2026-02-13T20:19:39.293 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.288+0000 7f51ffc12640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51f805b6b0 con 0x7f51f8089980 2026-02-13T20:19:39.293 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.288+0000 7f51ffc12640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51f805cd90 con 0x7f51f8089540 2026-02-13T20:19:39.293 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.288+0000 7f51ffc12640 10 monclient(hunting): _renew_subs 2026-02-13T20:19:39.293 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.288+0000 7f51ffc12640 10 monclient(hunting): authenticate will time out at 1140.978600s 2026-02-13T20:19:39.293 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.288+0000 7f51fd987640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f51f8091e20 0x7f51f8088e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:52156/0 (socket says 10.20.193.110:52156) 2026-02-13T20:19:39.293 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.288+0000 7f51fd987640 1 -- 10.20.193.110:0/3734133585 learned_addr learned my addr 10.20.193.110:0/3734133585 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:19:39.293 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.288+0000 7f51fc985640 1 -- 10.20.193.110:0/3734133585 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 595922950 0 0) 0x7f51f805cd90 con 0x7f51f8089540 2026-02-13T20:19:39.293 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.288+0000 7f51fc985640 10 monclient(hunting): _negotiate 2026-02-13T20:19:39.293 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.288+0000 7f51fc985640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:39.293 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.288+0000 7f51fc985640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:39.293 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.288+0000 7f51fc985640 10 monclient(hunting): my global_id is 94340 2026-02-13T20:19:39.293 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.288+0000 7f51fc985640 1 -- 10.20.193.110:0/3734133585 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51e00035e0 con 0x7f51f8089540 2026-02-13T20:19:39.293 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.288+0000 7f51fc985640 1 -- 10.20.193.110:0/3734133585 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 321405954 0 0) 0x7f51f805b3d0 con 0x7f51f8091e20 2026-02-13T20:19:39.293 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.288+0000 7f51fc985640 10 monclient(hunting): _negotiate 2026-02-13T20:19:39.293 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.288+0000 7f51fc985640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:39.293 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.288+0000 7f51fc985640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:39.294 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.288+0000 7f51fc985640 10 monclient(hunting): my global_id is 114159 2026-02-13T20:19:39.294 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.288+0000 7f51fc985640 1 -- 10.20.193.110:0/3734133585 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51f805cd90 con 0x7f51f8091e20 2026-02-13T20:19:39.294 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.289+0000 7f51fc985640 1 -- 10.20.193.110:0/3734133585 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 138257687 0 0) 0x7f51e00035e0 con 0x7f51f8089540 2026-02-13T20:19:39.294 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.289+0000 7f51fc985640 1 -- 10.20.193.110:0/3734133585 >> v1:10.20.193.188:6789/0 conn(0x7f51f8089980 legacy=0x7f51f81a5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:39.294 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.289+0000 7f51fc985640 1 -- 10.20.193.110:0/3734133585 >> v1:10.20.193.110:6789/0 conn(0x7f51f8091e20 legacy=0x7f51f8088e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:39.294 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.289+0000 7f51fc985640 10 monclient: _finish_hunting 0 2026-02-13T20:19:39.294 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.289+0000 7f51fc985640 1 monclient: found mon.noname-b 2026-02-13T20:19:39.294 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.289+0000 7f51fc985640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:19:39.294 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.289+0000 7f51fc985640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:19:39.294 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.289+0000 7f51fc985640 1 -- 10.20.193.110:0/3734133585 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51f808ad10 con 0x7f51f8089540 2026-02-13T20:19:39.294 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.289+0000 7f51fc985640 10 monclient: _finish_auth 0 2026-02-13T20:19:39.294 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.289+0000 7f51fc985640 10 monclient: _check_auth_tickets 2026-02-13T20:19:39.294 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.289+0000 7f51fc985640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:19:39.294 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.289+0000 7f51ffc12640 5 monclient: authenticate success, global_id 94340 2026-02-13T20:19:39.294 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.289+0000 7f51fc985640 1 -- 10.20.193.110:0/3734133585 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f51ec002dd0 con 0x7f51f8089540 2026-02-13T20:19:39.294 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.289+0000 7f51ffc12640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:19:39.294 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.289+0000 7f51fc985640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:39.294 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.289+0000 7f51fc985640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:19:39.294 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.289+0000 7f51fc985640 10 monclient: dump: 2026-02-13T20:19:39.294 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:39.294 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:39.294 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.294 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.294 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:39.294 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:39.294 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:39.294 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:39.294 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:39.294 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:39.294 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.289+0000 7f51ffc12640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:19:39.294 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.289+0000 7f51fc985640 1 -- 10.20.193.110:0/3734133585 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f51ec003050 con 0x7f51f8089540 2026-02-13T20:19:39.294 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.289+0000 7f51fc985640 10 monclient: handle_config config(0 keys) 2026-02-13T20:19:39.294 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.289+0000 7f51fc985640 1 -- 10.20.193.110:0/3734133585 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f51ec003460 con 0x7f51f8089540 2026-02-13T20:19:39.294 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.289+0000 7f51ffc12640 10 monclient: get_monmap_and_config success 2026-02-13T20:19:39.294 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.289+0000 7f51ffc12640 4 set_mon_vals no callback set 2026-02-13T20:19:39.294 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.289+0000 7f51fc985640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:39.294 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.289+0000 7f51fc985640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:19:39.294 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.289+0000 7f51fc985640 10 monclient: dump: 2026-02-13T20:19:39.294 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:39.294 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:39.294 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.294 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.294 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:39.295 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:39.295 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:39.295 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:39.295 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:39.295 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:39.295 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.289+0000 7f51ffc12640 10 monclient: shutdown 2026-02-13T20:19:39.295 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.289+0000 7f51ffc12640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:19:39.295 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.289+0000 7f51ffc12640 1 -- 10.20.193.110:0/3734133585 >> v1:10.20.193.110:6790/0 conn(0x7f51f8089540 legacy=0x7f51f8183d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:39.295 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.289+0000 7f51ffc12640 1 -- 10.20.193.110:0/3734133585 shutdown_connections 2026-02-13T20:19:39.295 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.289+0000 7f51ffc12640 1 -- 10.20.193.110:0/3734133585 >> 10.20.193.110:0/3734133585 conn(0x7f51f8054e90 msgr2=0x7f51f8058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:19:39.295 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.289+0000 7f51ffc12640 1 -- 10.20.193.110:0/3734133585 shutdown_connections 2026-02-13T20:19:39.295 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.289+0000 7f51ffc12640 1 -- 10.20.193.110:0/3734133585 wait complete. 2026-02-13T20:19:39.295 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.289+0000 7f51ffc12640 10 monclient: build_initial_monmap 2026-02-13T20:19:39.295 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.289+0000 7f51ffc12640 10 monclient: monmap: 2026-02-13T20:19:39.295 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:19:39.295 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:19:39.295 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:19:39.295 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:19:39.295 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:19:39.295 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:19:39.295 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:19:39.295 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:19:39.295 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:19:39.295 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:39.295 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.290+0000 7f51ffc12640 1 Processor -- start 2026-02-13T20:19:39.295 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.290+0000 7f51ffc12640 1 -- start start 2026-02-13T20:19:39.295 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.290+0000 7f51ffc12640 10 monclient: init 2026-02-13T20:19:39.295 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.290+0000 7f51ffc12640 10 monclient: _reopen_session rank -1 2026-02-13T20:19:39.295 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.290+0000 7f51ffc12640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:19:39.295 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.290+0000 7f51ffc12640 10 monclient(hunting): picked mon.noname-c con 0x7f51f8089540 addr v1:10.20.193.110:6790/0 2026-02-13T20:19:39.295 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.290+0000 7f51ffc12640 10 monclient(hunting): picked mon.noname-b con 0x7f51f8089980 addr v1:10.20.193.188:6789/0 2026-02-13T20:19:39.295 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.290+0000 7f51ffc12640 10 monclient(hunting): picked mon.noname-a con 0x7f51f8091e20 addr v1:10.20.193.110:6789/0 2026-02-13T20:19:39.295 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.290+0000 7f51ffc12640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51f8193a20 con 0x7f51f8091e20 2026-02-13T20:19:39.295 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.290+0000 7f51ffc12640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51f81abaa0 con 0x7f51f8089980 2026-02-13T20:19:39.295 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.290+0000 7f51ffc12640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51f8059410 con 0x7f51f8089540 2026-02-13T20:19:39.295 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.290+0000 7f51ffc12640 10 monclient(hunting): _renew_subs 2026-02-13T20:19:39.295 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.290+0000 7f51ffc12640 10 monclient(hunting): authenticate will time out at 1140.980406s 2026-02-13T20:19:39.295 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.290+0000 7f51fd987640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f51f8089540 0x7f51f81916a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:37752/0 (socket says 10.20.193.110:37752) 2026-02-13T20:19:39.295 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.290+0000 7f51fd987640 1 -- 10.20.193.110:0/3271765081 learned_addr learned my addr 10.20.193.110:0/3271765081 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:19:39.295 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.290+0000 7f51e67fc640 1 -- 10.20.193.110:0/3271765081 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3660648658 0 0) 0x7f51f8193a20 con 0x7f51f8091e20 2026-02-13T20:19:39.295 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.290+0000 7f51e67fc640 10 monclient(hunting): _negotiate 2026-02-13T20:19:39.295 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.290+0000 7f51e67fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:39.296 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.290+0000 7f51e67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:39.296 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.290+0000 7f51e67fc640 10 monclient(hunting): my global_id is 114162 2026-02-13T20:19:39.296 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.290+0000 7f51e67fc640 1 -- 10.20.193.110:0/3271765081 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51c80035e0 con 0x7f51f8091e20 2026-02-13T20:19:39.296 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.290+0000 7f51e67fc640 1 -- 10.20.193.110:0/3271765081 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 511602817 0 0) 0x7f51f8059410 con 0x7f51f8089540 2026-02-13T20:19:39.296 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.290+0000 7f51e67fc640 10 monclient(hunting): _negotiate 2026-02-13T20:19:39.296 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.290+0000 7f51e67fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:39.296 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.290+0000 7f51e67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:39.296 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.290+0000 7f51e67fc640 10 monclient(hunting): my global_id is 94343 2026-02-13T20:19:39.296 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.290+0000 7f51e67fc640 1 -- 10.20.193.110:0/3271765081 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51f8193a20 con 0x7f51f8089540 2026-02-13T20:19:39.296 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.290+0000 7f51e67fc640 1 -- 10.20.193.110:0/3271765081 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3333246823 0 0) 0x7f51c80035e0 con 0x7f51f8091e20 2026-02-13T20:19:39.296 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.290+0000 7f51e67fc640 1 -- 10.20.193.110:0/3271765081 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f51f8059410 con 0x7f51f8091e20 2026-02-13T20:19:39.296 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.290+0000 7f51e67fc640 1 -- 10.20.193.110:0/3271765081 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f51f40040d0 con 0x7f51f8091e20 2026-02-13T20:19:39.296 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.290+0000 7f51e67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:19:39.296 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.290+0000 7f51e67fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:19:39.296 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.290+0000 7f51e67fc640 10 monclient(hunting): dump: 2026-02-13T20:19:39.296 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:39.296 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:39.296 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.296 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.296 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:39.296 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:39.296 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:39.296 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:39.296 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:39.296 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:39.296 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.290+0000 7f51e67fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:19:39.296 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.290+0000 7f51e67fc640 1 -- 10.20.193.110:0/3271765081 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2736425988 0 0) 0x7f51f81abaa0 con 0x7f51f8089980 2026-02-13T20:19:39.296 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.290+0000 7f51e67fc640 10 monclient(hunting): _negotiate 2026-02-13T20:19:39.296 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.290+0000 7f51e67fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:39.296 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.290+0000 7f51e67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:39.296 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.290+0000 7f51e67fc640 10 monclient(hunting): my global_id is 4747 2026-02-13T20:19:39.296 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.290+0000 7f51e67fc640 1 -- 10.20.193.110:0/3271765081 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51c80035e0 con 0x7f51f8089980 2026-02-13T20:19:39.296 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.290+0000 7f51e67fc640 1 -- 10.20.193.110:0/3271765081 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2307370281 0 0) 0x7f51f8193a20 con 0x7f51f8089540 2026-02-13T20:19:39.296 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.290+0000 7f51e67fc640 1 -- 10.20.193.110:0/3271765081 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f51f81abaa0 con 0x7f51f8089540 2026-02-13T20:19:39.296 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.290+0000 7f51e67fc640 1 -- 10.20.193.110:0/3271765081 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f51e8002f40 con 0x7f51f8089540 2026-02-13T20:19:39.296 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.290+0000 7f51e67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:19:39.296 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.290+0000 7f51e67fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:19:39.296 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.290+0000 7f51e67fc640 10 monclient(hunting): dump: 2026-02-13T20:19:39.296 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:39.296 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:39.296 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.296 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.296 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:39.296 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:39.297 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:39.297 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:39.297 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:39.297 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:39.297 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.291+0000 7f51e67fc640 1 -- 10.20.193.110:0/3271765081 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2327225267 0 0) 0x7f51f8059410 con 0x7f51f8091e20 2026-02-13T20:19:39.297 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.291+0000 7f51e67fc640 1 -- 10.20.193.110:0/3271765081 >> v1:10.20.193.110:6790/0 conn(0x7f51f8089540 legacy=0x7f51f81916a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:39.297 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.291+0000 7f51e67fc640 1 -- 10.20.193.110:0/3271765081 >> v1:10.20.193.188:6789/0 conn(0x7f51f8089980 legacy=0x7f51f8191db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:39.297 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.291+0000 7f51e67fc640 10 monclient: _finish_hunting 0 2026-02-13T20:19:39.297 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.291+0000 7f51e67fc640 1 monclient: found mon.a 2026-02-13T20:19:39.297 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.291+0000 7f51e67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:19:39.297 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.291+0000 7f51e67fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:19:39.297 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.291+0000 7f51e67fc640 1 -- 10.20.193.110:0/3271765081 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51f8194f40 con 0x7f51f8091e20 2026-02-13T20:19:39.297 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.291+0000 7f51e67fc640 10 monclient: _finish_auth 0 2026-02-13T20:19:39.297 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.291+0000 7f51e67fc640 10 monclient: _check_auth_tickets 2026-02-13T20:19:39.297 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.291+0000 7f51e67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:19:39.297 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.291+0000 7f51ffc12640 5 monclient: authenticate success, global_id 114162 2026-02-13T20:19:39.297 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.291+0000 7f51ffc12640 10 monclient: _renew_subs 2026-02-13T20:19:39.297 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.291+0000 7f51ffc12640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:19:39.297 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.291+0000 7f51ffc12640 1 -- 10.20.193.110:0/3271765081 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f51f8195220 con 0x7f51f8091e20 2026-02-13T20:19:39.297 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.291+0000 7f51ffc12640 10 monclient: _renew_subs 2026-02-13T20:19:39.297 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.291+0000 7f51ffc12640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:19:39.297 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.291+0000 7f51ffc12640 1 -- 10.20.193.110:0/3271765081 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f51f8194c60 con 0x7f51f8091e20 2026-02-13T20:19:39.297 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.291+0000 7f51e67fc640 1 -- 10.20.193.110:0/3271765081 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f51f40042a0 con 0x7f51f8091e20 2026-02-13T20:19:39.297 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.291+0000 7f51e67fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:19:39.297 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.291+0000 7f51e67fc640 1 -- 10.20.193.110:0/3271765081 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f51f40048e0 con 0x7f51f8091e20 2026-02-13T20:19:39.297 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.291+0000 7f51e67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:39.297 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.291+0000 7f51e67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:19:39.297 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.291+0000 7f51e67fc640 10 monclient: dump: 2026-02-13T20:19:39.297 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:39.297 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:39.297 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.297 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.297 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:39.297 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:39.297 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:39.297 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:39.297 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:39.297 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:39.297 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.291+0000 7f51e7fff640 4 set_mon_vals no callback set 2026-02-13T20:19:39.297 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.291+0000 7f51ffc12640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:19:39.297 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.291+0000 7f51ffc12640 1 -- 10.20.193.110:0/3271765081 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f51f81a8ec0 con 0x7f51f81a8af0 2026-02-13T20:19:39.297 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.291+0000 7f51e67fc640 1 -- 10.20.193.110:0/3271765081 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1806535211 0 0) 0x7f51f81a8ec0 con 0x7f51f81a8af0 2026-02-13T20:19:39.297 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.291+0000 7f51e67fc640 10 monclient(hunting): _negotiate 2026-02-13T20:19:39.297 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.291+0000 7f51e67fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:39.298 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.291+0000 7f51e67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:39.298 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.291+0000 7f51e67fc640 10 monclient(hunting): my global_id is 114165 2026-02-13T20:19:39.298 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.291+0000 7f51e67fc640 1 -- 10.20.193.110:0/3271765081 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51f8059410 con 0x7f51f81a8af0 2026-02-13T20:19:39.298 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.291+0000 7f51e67fc640 1 -- 10.20.193.110:0/3271765081 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f51f4004a40 con 0x7f51f8091e20 2026-02-13T20:19:39.298 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.292+0000 7f51e67fc640 1 -- 10.20.193.110:0/3271765081 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(397..397 src has 1..397) ==== 3915+0+0 (unknown 4076817378 0 0) 0x7f51f404e6c0 con 0x7f51f8091e20 2026-02-13T20:19:39.298 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.292+0000 7f51e67fc640 1 -- 10.20.193.110:0/3271765081 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 613327408 0 0) 0x7f51f8059410 con 0x7f51f81a8af0 2026-02-13T20:19:39.298 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.292+0000 7f51e67fc640 1 -- 10.20.193.110:0/3271765081 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f51f81a8ec0 con 0x7f51f81a8af0 2026-02-13T20:19:39.298 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.292+0000 7f51e67fc640 1 -- 10.20.193.110:0/3271765081 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f51e8003480 con 0x7f51f81a8af0 2026-02-13T20:19:39.298 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.292+0000 7f51e67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:39.298 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.292+0000 7f51e67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:19:39.298 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.292+0000 7f51e67fc640 10 monclient: dump: 2026-02-13T20:19:39.298 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:39.298 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:39.298 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.298 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.298 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:39.298 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:39.298 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:39.298 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:39.298 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:39.298 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:39.298 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.292+0000 7f51fd186640 10 monclient: get_auth_request con 0x7f51c803fc70 auth_method 0 2026-02-13T20:19:39.298 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.292+0000 7f51e67fc640 1 -- 10.20.193.110:0/3271765081 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 857991299 0 0) 0x7f51f81a8ec0 con 0x7f51f81a8af0 2026-02-13T20:19:39.298 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.292+0000 7f51e67fc640 1 -- 10.20.193.110:0/3271765081 --> v1:10.20.193.110:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f51f805a3e0 con 0x7f51f81a8af0 2026-02-13T20:19:39.298 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.292+0000 7f51e67fc640 1 -- 10.20.193.110:0/3271765081 <== mon.0 v1:10.20.193.110:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f51e8006a80 con 0x7f51f81a8af0 2026-02-13T20:19:39.298 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.292+0000 7f51e67fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:19:39.298 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.292+0000 7f51e67fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:19:39.298 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.292+0000 7f51e67fc640 1 -- 10.20.193.110:0/3271765081 >> v1:10.20.193.110:6789/0 conn(0x7f51f81a8af0 legacy=0x7f51f81abcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:39.298 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.292+0000 7f51e67fc640 1 -- 10.20.193.110:0/3271765081 >> v1:10.20.193.110:6789/0 conn(0x7f51f81a8af0 legacy=0x7f51f81abcd0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:19:39.299 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.295+0000 7f51ffc12640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:19:39.299 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.295+0000 7f51ffc12640 1 -- 10.20.193.110:0/3271765081 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f51f805bd00 con 0x7f51f81ac3e0 2026-02-13T20:19:39.299 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.295+0000 7f51e67fc640 1 -- 10.20.193.110:0/3271765081 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 587637937 0 0) 0x7f51f805bd00 con 0x7f51f81ac3e0 2026-02-13T20:19:39.299 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.295+0000 7f51e67fc640 10 monclient(hunting): _negotiate 2026-02-13T20:19:39.299 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.295+0000 7f51e67fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:39.299 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.295+0000 7f51e67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:39.299 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.295+0000 7f51e67fc640 10 monclient(hunting): my global_id is 114168 2026-02-13T20:19:39.299 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.296+0000 7f51e67fc640 1 -- 10.20.193.110:0/3271765081 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51f81a8ec0 con 0x7f51f81ac3e0 2026-02-13T20:19:39.299 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.296+0000 7f51e67fc640 1 -- 10.20.193.110:0/3271765081 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3855258664 0 0) 0x7f51f81a8ec0 con 0x7f51f81ac3e0 2026-02-13T20:19:39.299 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.296+0000 7f51e67fc640 1 -- 10.20.193.110:0/3271765081 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f51f805bd00 con 0x7f51f81ac3e0 2026-02-13T20:19:39.299 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.296+0000 7f51e67fc640 1 -- 10.20.193.110:0/3271765081 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f51e80050b0 con 0x7f51f81ac3e0 2026-02-13T20:19:39.299 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.296+0000 7f51e67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:39.299 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.296+0000 7f51e67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:19:39.299 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.296+0000 7f51e67fc640 10 monclient: dump: 2026-02-13T20:19:39.299 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:39.299 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:39.299 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.299 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.299 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:39.299 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:39.299 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:39.299 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:39.299 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:39.299 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:39.299 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.296+0000 7f51e67fc640 1 -- 10.20.193.110:0/3271765081 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3801891902 0 0) 0x7f51f805bd00 con 0x7f51f81ac3e0 2026-02-13T20:19:39.299 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.296+0000 7f51e67fc640 1 -- 10.20.193.110:0/3271765081 --> v1:10.20.193.110:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f51f80921f0 con 0x7f51f81ac3e0 2026-02-13T20:19:39.299 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.296+0000 7f51e67fc640 1 -- 10.20.193.110:0/3271765081 <== mon.0 v1:10.20.193.110:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4346 (unknown 0 0 15257902) 0x7f51e8005450 con 0x7f51f81ac3e0 2026-02-13T20:19:39.299 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.296+0000 7f51e67fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:19:39.299 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.296+0000 7f51e67fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:19:39.299 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.296+0000 7f51e67fc640 1 -- 10.20.193.110:0/3271765081 >> v1:10.20.193.110:6789/0 conn(0x7f51f81ac3e0 legacy=0x7f51f825e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:39.299 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.296+0000 7f51e67fc640 1 -- 10.20.193.110:0/3271765081 >> v1:10.20.193.110:6789/0 conn(0x7f51f81ac3e0 legacy=0x7f51f825e870 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:19:39.299 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:19:39.300 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:19:39.300 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:19:39.300 INFO:teuthology.orchestra.run.trial110.stdout: "state": "peon", 2026-02-13T20:19:39.300 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 32, 2026-02-13T20:19:39.300 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 31183, 2026-02-13T20:19:39.300 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:19:39.300 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:19:39.300 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:19:39.300 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:19:39.300 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:19:39.300 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 2, 2026-02-13T20:19:39.300 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:19:39.300 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:19:39.300 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:19:39.300 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:19:39.300 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:19:39.300 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:19:39.300 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:19:39.300 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:19:39.300 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:19:39.300 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:19:39.300 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:19:39.300 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:19:39.300 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:19:39.300 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:19:39.300 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:19:39.300 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:19:39.300 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:19:39.300 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:19:39.300 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:19:39.300 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:19:39.300 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:19:39.300 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:19:39.300 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:19:39.300 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:19:39.300 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:19:39.300 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:19:39.300 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:19:39.300 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:19:39.300 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:19:39.300 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:19:39.301 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:19:39.301 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:19:39.301 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:19:39.301 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:39.301 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:19:39.301 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:19:39.301 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:19:39.301 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:19:39.301 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:19:39.301 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:19:39.301 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:19:39.301 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:19:39.301 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:19:39.301 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:19:39.301 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:19:39.301 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:19:39.301 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:19:39.301 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:19:39.301 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:19:39.301 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:19:39.301 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:19:39.301 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:19:39.301 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:19:39.301 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:19:39.301 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:19:39.301 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:19:39.301 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:19:39.301 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:19:39.301 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:19:39.301 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:19:39.301 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:19:39.301 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:19:39.301 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:19:39.301 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:19:39.301 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:19:39.301 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:19:39.301 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:39.301 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:19:39.301 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:39.301 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:19:39.302 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:19:39.302 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:19:39.302 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:19:39.302 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:39.302 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:19:39.302 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:19:39.302 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:19:39.302 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:39.302 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:19:39.302 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:39.302 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:19:39.302 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:19:39.302 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:19:39.302 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:19:39.302 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:19:39.302 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:19:39.302 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:39.302 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:39.302 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:19:39.302 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:19:39.302 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:19:39.302 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:19:39.302 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:39.302 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:19:39.302 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:19:39.302 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:19:39.302 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:39.302 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:19:39.302 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:39.302 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:19:39.302 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:19:39.302 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:19:39.302 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:19:39.302 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:19:39.302 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:19:39.302 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:39.302 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:39.302 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:19:39.302 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:19:39.302 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:19:39.302 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:19:39.302 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:39.302 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:19:39.302 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:19:39.303 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:19:39.303 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:39.303 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:19:39.303 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:39.303 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:19:39.303 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:19:39.303 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:19:39.303 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:19:39.303 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:19:39.303 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:19:39.303 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:39.303 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:19:39.303 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:39.303 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:19:39.303 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:19:39.303 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:39.303 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:19:39.303 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:19:39.303 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:19:39.303 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:39.303 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:19:39.303 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:19:39.303 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:39.303 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:19:39.303 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:19:39.303 INFO:teuthology.orchestra.run.trial110.stdout: "num": 2 2026-02-13T20:19:39.303 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:39.303 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:19:39.303 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:39.303 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:19:39.303 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:19:39.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.296+0000 7f51ffc12640 1 -- 10.20.193.110:0/3271765081 >> v1:10.20.193.188:6812/1623052694 conn(0x7f51c803fc70 legacy=0x7f51c8060120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:39.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.296+0000 7f51ffc12640 10 monclient: shutdown 2026-02-13T20:19:39.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.296+0000 7f51ffc12640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:19:39.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.296+0000 7f51ffc12640 1 -- 10.20.193.110:0/3271765081 >> v1:10.20.193.110:6789/0 conn(0x7f51f8091e20 legacy=0x7f51f823c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:39.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.296+0000 7f51fe188640 1 -- 10.20.193.110:0/3271765081 reap_dead start 2026-02-13T20:19:39.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.296+0000 7f51fe188640 1 -- 10.20.193.110:0/3271765081 reap_dead start 2026-02-13T20:19:39.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.296+0000 7f51ffc12640 1 -- 10.20.193.110:0/3271765081 shutdown_connections 2026-02-13T20:19:39.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.296+0000 7f51ffc12640 1 -- 10.20.193.110:0/3271765081 >> 10.20.193.110:0/3271765081 conn(0x7f51f8054e90 msgr2=0x7f51f818e760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:19:39.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.296+0000 7f51ffc12640 1 -- 10.20.193.110:0/3271765081 shutdown_connections 2026-02-13T20:19:39.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.296+0000 7f51ffc12640 1 -- 10.20.193.110:0/3271765081 wait complete. 2026-02-13T20:19:39.304 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:19:39.304 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-13T20:19:39.304 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T20:19:39.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.372+0000 7f9d763a5640 10 monclient: get_monmap_and_config 2026-02-13T20:19:39.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.372+0000 7f9d763a5640 10 monclient: build_initial_monmap 2026-02-13T20:19:39.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.372+0000 7f9d763a5640 10 monclient: monmap: 2026-02-13T20:19:39.384 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:19:39.384 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:39.384 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:19:39.372787+0000 2026-02-13T20:19:39.384 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:19:39.372787+0000 2026-02-13T20:19:39.384 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:19:39.384 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:39.384 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:19:39.384 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:19:39.384 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:19:39.384 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:39.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.372+0000 7f9d763a5640 1 Processor -- start 2026-02-13T20:19:39.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.372+0000 7f9d763a5640 1 -- start start 2026-02-13T20:19:39.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.372+0000 7f9d763a5640 10 monclient: init 2026-02-13T20:19:39.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d763a5640 10 monclient: _reopen_session rank -1 2026-02-13T20:19:39.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d763a5640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:19:39.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d763a5640 10 monclient(hunting): picked mon.noname-c con 0x7f9d701401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:19:39.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d763a5640 10 monclient(hunting): picked mon.noname-b con 0x7f9d70092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:19:39.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d763a5640 10 monclient(hunting): picked mon.noname-a con 0x7f9d70091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:19:39.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d763a5640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d7008b730 con 0x7f9d70091950 2026-02-13T20:19:39.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d763a5640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d7005c5b0 con 0x7f9d701401c0 2026-02-13T20:19:39.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d763a5640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d7008bcf0 con 0x7f9d70092020 2026-02-13T20:19:39.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d763a5640 10 monclient(hunting): _renew_subs 2026-02-13T20:19:39.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d763a5640 10 monclient(hunting): authenticate will time out at 1141.063199s 2026-02-13T20:19:39.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d6f7fe640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f9d70092020 0x7f9d701812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:37764/0 (socket says 10.20.193.110:37764) 2026-02-13T20:19:39.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d6f7fe640 1 -- 10.20.193.110:0/944458223 learned_addr learned my addr 10.20.193.110:0/944458223 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:19:39.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d7491b640 1 --1- 10.20.193.110:0/944458223 >> v1:10.20.193.110:6789/0 conn(0x7f9d70091950 0x7f9d701a2a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:52200/0 (socket says 10.20.193.110:52200) 2026-02-13T20:19:39.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d6effd640 1 -- 10.20.193.110:0/944458223 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1857328182 0 0) 0x7f9d7008bcf0 con 0x7f9d70092020 2026-02-13T20:19:39.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d6effd640 10 monclient(hunting): _negotiate 2026-02-13T20:19:39.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d6effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:39.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d6effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:39.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d6effd640 10 monclient(hunting): my global_id is 94346 2026-02-13T20:19:39.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d6effd640 1 -- 10.20.193.110:0/944458223 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d540035e0 con 0x7f9d70092020 2026-02-13T20:19:39.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d6effd640 1 -- 10.20.193.110:0/944458223 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3495005074 0 0) 0x7f9d7008b730 con 0x7f9d70091950 2026-02-13T20:19:39.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d6effd640 10 monclient(hunting): _negotiate 2026-02-13T20:19:39.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d6effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:39.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d6effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:39.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d6effd640 10 monclient(hunting): my global_id is 114171 2026-02-13T20:19:39.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d6effd640 1 -- 10.20.193.110:0/944458223 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d7008bcf0 con 0x7f9d70091950 2026-02-13T20:19:39.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d6effd640 1 -- 10.20.193.110:0/944458223 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 472329548 0 0) 0x7f9d7005c5b0 con 0x7f9d701401c0 2026-02-13T20:19:39.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d6effd640 10 monclient(hunting): _negotiate 2026-02-13T20:19:39.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d6effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:39.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d6effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:39.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d6effd640 10 monclient(hunting): my global_id is 4750 2026-02-13T20:19:39.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d6effd640 1 -- 10.20.193.110:0/944458223 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d7008b730 con 0x7f9d701401c0 2026-02-13T20:19:39.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d6effd640 1 -- 10.20.193.110:0/944458223 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2754268516 0 0) 0x7f9d7008bcf0 con 0x7f9d70091950 2026-02-13T20:19:39.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d6effd640 1 -- 10.20.193.110:0/944458223 >> v1:10.20.193.110:6790/0 conn(0x7f9d70092020 legacy=0x7f9d701812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:39.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d6effd640 1 -- 10.20.193.110:0/944458223 >> v1:10.20.193.188:6789/0 conn(0x7f9d701401c0 legacy=0x7f9d70091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:39.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d6effd640 10 monclient: _finish_hunting 0 2026-02-13T20:19:39.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d6effd640 1 monclient: found mon.noname-a 2026-02-13T20:19:39.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d6effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:19:39.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d6effd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:19:39.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d6effd640 1 -- 10.20.193.110:0/944458223 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d70140590 con 0x7f9d70091950 2026-02-13T20:19:39.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d6effd640 10 monclient: _finish_auth 0 2026-02-13T20:19:39.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d6effd640 10 monclient: _check_auth_tickets 2026-02-13T20:19:39.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d6effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:19:39.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d6effd640 1 -- 10.20.193.110:0/944458223 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f9d64003eb0 con 0x7f9d70091950 2026-02-13T20:19:39.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d763a5640 5 monclient: authenticate success, global_id 114171 2026-02-13T20:19:39.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d763a5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:19:39.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d6effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:39.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d6effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:19:39.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d6effd640 10 monclient: dump: 2026-02-13T20:19:39.387 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:39.387 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:39.387 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.387 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.388 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:39.388 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:39.388 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:39.388 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:39.388 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:39.388 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:39.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d763a5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:19:39.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d6effd640 1 -- 10.20.193.110:0/944458223 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9d64004010 con 0x7f9d70091950 2026-02-13T20:19:39.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d6effd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:19:39.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d6effd640 1 -- 10.20.193.110:0/944458223 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f9d64004420 con 0x7f9d70091950 2026-02-13T20:19:39.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d6effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:39.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d6effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:19:39.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d6effd640 10 monclient: dump: 2026-02-13T20:19:39.388 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:39.388 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:39.388 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.388 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.389 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:39.389 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:39.389 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:39.389 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:39.389 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:39.389 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:39.389 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d763a5640 10 monclient: get_monmap_and_config success 2026-02-13T20:19:39.389 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.373+0000 7f9d763a5640 4 set_mon_vals no callback set 2026-02-13T20:19:39.389 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.374+0000 7f9d763a5640 10 monclient: shutdown 2026-02-13T20:19:39.389 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.374+0000 7f9d763a5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:19:39.389 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.374+0000 7f9d763a5640 1 -- 10.20.193.110:0/944458223 >> v1:10.20.193.110:6789/0 conn(0x7f9d70091950 legacy=0x7f9d701a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:39.389 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.374+0000 7f9d763a5640 1 -- 10.20.193.110:0/944458223 shutdown_connections 2026-02-13T20:19:39.389 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.374+0000 7f9d763a5640 1 -- 10.20.193.110:0/944458223 >> 10.20.193.110:0/944458223 conn(0x7f9d70054e90 msgr2=0x7f9d70058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:19:39.389 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.374+0000 7f9d763a5640 1 -- 10.20.193.110:0/944458223 shutdown_connections 2026-02-13T20:19:39.389 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.374+0000 7f9d763a5640 1 -- 10.20.193.110:0/944458223 wait complete. 2026-02-13T20:19:39.390 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.374+0000 7f9d763a5640 10 monclient: build_initial_monmap 2026-02-13T20:19:39.390 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.374+0000 7f9d763a5640 10 monclient: monmap: 2026-02-13T20:19:39.390 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:19:39.390 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:19:39.390 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:19:39.390 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:19:39.390 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:19:39.390 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:19:39.390 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:19:39.390 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:19:39.390 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:19:39.390 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:39.390 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.374+0000 7f9d763a5640 1 Processor -- start 2026-02-13T20:19:39.390 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.374+0000 7f9d763a5640 1 -- start start 2026-02-13T20:19:39.390 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.374+0000 7f9d763a5640 10 monclient: init 2026-02-13T20:19:39.390 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d763a5640 10 monclient: _reopen_session rank -1 2026-02-13T20:19:39.390 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d763a5640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:19:39.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d763a5640 10 monclient(hunting): picked mon.noname-b con 0x7f9d70091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:19:39.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d763a5640 10 monclient(hunting): picked mon.noname-a con 0x7f9d701401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:19:39.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d763a5640 10 monclient(hunting): picked mon.noname-c con 0x7f9d70130af0 addr v1:10.20.193.110:6790/0 2026-02-13T20:19:39.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d763a5640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d7005d320 con 0x7f9d701401c0 2026-02-13T20:19:39.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d763a5640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d70132010 con 0x7f9d70091950 2026-02-13T20:19:39.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d763a5640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d701322f0 con 0x7f9d70130af0 2026-02-13T20:19:39.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d763a5640 10 monclient(hunting): _renew_subs 2026-02-13T20:19:39.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d763a5640 10 monclient(hunting): authenticate will time out at 1141.065105s 2026-02-13T20:19:39.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d6f7fe640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f9d701401c0 0x7f9d70193940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:52216/0 (socket says 10.20.193.110:52216) 2026-02-13T20:19:39.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d7491b640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f9d70130af0 0x7f9d70195060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:37778/0 (socket says 10.20.193.110:37778) 2026-02-13T20:19:39.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d6f7fe640 1 -- 10.20.193.110:0/812721409 learned_addr learned my addr 10.20.193.110:0/812721409 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:19:39.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d6cff9640 1 -- 10.20.193.110:0/812721409 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 44261633 0 0) 0x7f9d701322f0 con 0x7f9d70130af0 2026-02-13T20:19:39.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d6cff9640 10 monclient(hunting): _negotiate 2026-02-13T20:19:39.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d6cff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:39.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d6cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:39.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d6cff9640 10 monclient(hunting): my global_id is 94349 2026-02-13T20:19:39.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d6cff9640 1 -- 10.20.193.110:0/812721409 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d400035e0 con 0x7f9d70130af0 2026-02-13T20:19:39.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d6cff9640 1 -- 10.20.193.110:0/812721409 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1041001180 0 0) 0x7f9d7005d320 con 0x7f9d701401c0 2026-02-13T20:19:39.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d6cff9640 10 monclient(hunting): _negotiate 2026-02-13T20:19:39.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d6cff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:39.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d6cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:39.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d6cff9640 10 monclient(hunting): my global_id is 114174 2026-02-13T20:19:39.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d6cff9640 1 -- 10.20.193.110:0/812721409 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d701322f0 con 0x7f9d701401c0 2026-02-13T20:19:39.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d6cff9640 1 -- 10.20.193.110:0/812721409 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3081536997 0 0) 0x7f9d400035e0 con 0x7f9d70130af0 2026-02-13T20:19:39.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d6cff9640 1 -- 10.20.193.110:0/812721409 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9d7005d320 con 0x7f9d70130af0 2026-02-13T20:19:39.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d6cff9640 1 -- 10.20.193.110:0/812721409 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f9d64004330 con 0x7f9d70130af0 2026-02-13T20:19:39.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d6cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:19:39.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d6cff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:19:39.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d6cff9640 10 monclient(hunting): dump: 2026-02-13T20:19:39.392 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:39.392 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:39.392 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.392 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.392 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:39.392 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:39.392 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:39.392 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:39.392 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:39.392 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:39.393 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d6cff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:19:39.393 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d6cff9640 1 -- 10.20.193.110:0/812721409 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1614420439 0 0) 0x7f9d701322f0 con 0x7f9d701401c0 2026-02-13T20:19:39.393 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d6cff9640 1 -- 10.20.193.110:0/812721409 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9d400035e0 con 0x7f9d701401c0 2026-02-13T20:19:39.393 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d6cff9640 1 -- 10.20.193.110:0/812721409 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f9d60003170 con 0x7f9d701401c0 2026-02-13T20:19:39.393 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d6cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:19:39.393 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d6cff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:19:39.393 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d6cff9640 10 monclient(hunting): dump: 2026-02-13T20:19:39.393 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:39.393 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:39.393 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.393 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.393 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:39.393 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:39.393 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:39.393 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:39.393 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:39.393 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:39.393 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d6cff9640 1 -- 10.20.193.110:0/812721409 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4188704655 0 0) 0x7f9d7005d320 con 0x7f9d70130af0 2026-02-13T20:19:39.394 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d6cff9640 1 -- 10.20.193.110:0/812721409 >> v1:10.20.193.188:6789/0 conn(0x7f9d70091950 legacy=0x7f9d7013e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:39.394 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d6cff9640 1 -- 10.20.193.110:0/812721409 >> v1:10.20.193.110:6789/0 conn(0x7f9d701401c0 legacy=0x7f9d70193940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:39.394 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d6cff9640 10 monclient: _finish_hunting 0 2026-02-13T20:19:39.394 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d6cff9640 1 monclient: found mon.c 2026-02-13T20:19:39.394 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d6cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:19:39.394 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d6cff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:19:39.394 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d6cff9640 1 -- 10.20.193.110:0/812721409 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d7008a8d0 con 0x7f9d70130af0 2026-02-13T20:19:39.394 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d6cff9640 10 monclient: _finish_auth 0 2026-02-13T20:19:39.394 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d6cff9640 10 monclient: _check_auth_tickets 2026-02-13T20:19:39.394 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d6cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:19:39.394 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d763a5640 5 monclient: authenticate success, global_id 94349 2026-02-13T20:19:39.394 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d763a5640 10 monclient: _renew_subs 2026-02-13T20:19:39.394 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d763a5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:19:39.394 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d763a5640 1 -- 10.20.193.110:0/812721409 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9d70131a50 con 0x7f9d70130af0 2026-02-13T20:19:39.394 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d763a5640 10 monclient: _renew_subs 2026-02-13T20:19:39.394 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d763a5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:19:39.394 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d763a5640 1 -- 10.20.193.110:0/812721409 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f9d7013f240 con 0x7f9d70130af0 2026-02-13T20:19:39.394 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d6cff9640 1 -- 10.20.193.110:0/812721409 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9d64005c30 con 0x7f9d70130af0 2026-02-13T20:19:39.395 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d6cff9640 10 monclient: handle_config config(0 keys) 2026-02-13T20:19:39.395 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d6cff9640 1 -- 10.20.193.110:0/812721409 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f9d64005f50 con 0x7f9d70130af0 2026-02-13T20:19:39.395 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d6cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:39.395 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d6cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:19:39.395 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d6e7fc640 4 set_mon_vals no callback set 2026-02-13T20:19:39.395 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.375+0000 7f9d6cff9640 10 monclient: dump: 2026-02-13T20:19:39.395 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:39.395 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:39.395 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.395 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.395 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:39.395 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:39.395 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:39.395 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:39.395 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:39.395 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:39.395 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.376+0000 7f9d763a5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:19:39.396 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.376+0000 7f9d763a5640 1 -- 10.20.193.110:0/812721409 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9d700008d0 con 0x7f9d70092020 2026-02-13T20:19:39.396 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.376+0000 7f9d6cff9640 1 -- 10.20.193.110:0/812721409 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f9d64012bc0 con 0x7f9d70130af0 2026-02-13T20:19:39.396 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.376+0000 7f9d6cff9640 1 -- 10.20.193.110:0/812721409 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(397..397 src has 1..397) ==== 3915+0+0 (unknown 4076817378 0 0) 0x7f9d6404f9b0 con 0x7f9d70130af0 2026-02-13T20:19:39.396 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.376+0000 7f9d6cff9640 1 -- 10.20.193.110:0/812721409 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3843230679 0 0) 0x7f9d700008d0 con 0x7f9d70092020 2026-02-13T20:19:39.396 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.376+0000 7f9d6cff9640 10 monclient(hunting): _negotiate 2026-02-13T20:19:39.396 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.376+0000 7f9d6cff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:39.396 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.376+0000 7f9d6cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:39.396 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.376+0000 7f9d6cff9640 10 monclient(hunting): my global_id is 94352 2026-02-13T20:19:39.396 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.376+0000 7f9d6cff9640 1 -- 10.20.193.110:0/812721409 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d7005d320 con 0x7f9d70092020 2026-02-13T20:19:39.396 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.376+0000 7f9d6f7fe640 10 monclient: get_auth_request con 0x7f9d4003fa50 auth_method 0 2026-02-13T20:19:39.396 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.376+0000 7f9d6cff9640 1 -- 10.20.193.110:0/812721409 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1031050690 0 0) 0x7f9d7005d320 con 0x7f9d70092020 2026-02-13T20:19:39.396 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.376+0000 7f9d6cff9640 1 -- 10.20.193.110:0/812721409 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9d700008d0 con 0x7f9d70092020 2026-02-13T20:19:39.396 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.376+0000 7f9d6cff9640 1 -- 10.20.193.110:0/812721409 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f9d5c002f00 con 0x7f9d70092020 2026-02-13T20:19:39.396 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.376+0000 7f9d6cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:39.396 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.376+0000 7f9d6cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:19:39.396 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.376+0000 7f9d6cff9640 10 monclient: dump: 2026-02-13T20:19:39.396 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:39.396 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:39.396 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.397 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.397 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:39.397 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:39.397 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:39.397 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:39.397 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:39.397 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:39.397 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.376+0000 7f9d6f7fe640 1 -- 10.20.193.110:0/812721409 >> v1:10.20.193.188:6812/1623052694 conn(0x7f9d4003fa50 legacy=0x7f9d4005ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-13T20:19:39.397 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.376+0000 7f9d6f7fe640 1 -- 10.20.193.110:0/812721409 >> v1:10.20.193.188:6812/1623052694 conn(0x7f9d4003fa50 legacy=0x7f9d4005ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T20:19:39.397 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.376+0000 7f9d6f7fe640 1 --1- 10.20.193.110:0/812721409 >> v1:10.20.193.188:6812/1623052694 conn(0x7f9d4003fa50 0x7f9d4005ff00 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 gs=5 cs=0 l=1).handle_connect_reply_1 read connect reply failed 2026-02-13T20:19:39.397 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.376+0000 7f9d6f7fe640 1 --1- 10.20.193.110:0/812721409 >> v1:10.20.193.188:6812/1623052694 conn(0x7f9d4003fa50 0x7f9d4005ff00 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 gs=5 cs=0 l=1).fault on lossy channel, failing 2026-02-13T20:19:39.397 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.376+0000 7f9d6cff9640 1 -- 10.20.193.110:0/812721409 >> v1:10.20.193.188:6812/1623052694 conn(0x7f9d4003fa50 legacy=0x7f9d4005ff00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:19:39.397 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.376+0000 7f9d6cff9640 1 -- 10.20.193.110:0/812721409 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3031326724 0 0) 0x7f9d700008d0 con 0x7f9d70092020 2026-02-13T20:19:39.397 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.376+0000 7f9d6cff9640 1 -- 10.20.193.110:0/812721409 --> v1:10.20.193.110:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9d7008b450 con 0x7f9d70092020 2026-02-13T20:19:39.397 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.377+0000 7f9d6cff9640 1 -- 10.20.193.110:0/812721409 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f9d5c003360 con 0x7f9d70092020 2026-02-13T20:19:39.397 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.377+0000 7f9d6cff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:19:39.397 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.377+0000 7f9d6cff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:19:39.397 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.377+0000 7f9d6cff9640 1 -- 10.20.193.110:0/812721409 >> v1:10.20.193.110:6790/0 conn(0x7f9d70092020 legacy=0x7f9d70127b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:39.397 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.377+0000 7f9d6cff9640 1 -- 10.20.193.110:0/812721409 >> v1:10.20.193.110:6790/0 conn(0x7f9d70092020 legacy=0x7f9d70127b20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:19:39.397 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.380+0000 7f9d763a5640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:19:39.398 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.380+0000 7f9d763a5640 1 -- 10.20.193.110:0/812721409 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9d70152ad0 con 0x7f9d70152700 2026-02-13T20:19:39.398 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.380+0000 7f9d6cff9640 1 -- 10.20.193.110:0/812721409 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1586774243 0 0) 0x7f9d70152ad0 con 0x7f9d70152700 2026-02-13T20:19:39.398 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.380+0000 7f9d6cff9640 10 monclient(hunting): _negotiate 2026-02-13T20:19:39.398 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.380+0000 7f9d6cff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:39.398 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.380+0000 7f9d6cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:39.398 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.380+0000 7f9d6cff9640 10 monclient(hunting): my global_id is 94355 2026-02-13T20:19:39.398 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.380+0000 7f9d6cff9640 1 -- 10.20.193.110:0/812721409 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d700008d0 con 0x7f9d70152700 2026-02-13T20:19:39.398 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.380+0000 7f9d6ffff640 1 -- 10.20.193.110:0/812721409 >> v1:10.20.193.110:6790/0 conn(0x7f9d70152700 legacy=0x7f9d70128230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-13T20:19:39.398 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.380+0000 7f9d6ffff640 1 -- 10.20.193.110:0/812721409 >> v1:10.20.193.110:6790/0 conn(0x7f9d70152700 legacy=0x7f9d70128230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T20:19:39.398 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.380+0000 7f9d6ffff640 1 --1- 10.20.193.110:0/812721409 >> v1:10.20.193.110:6790/0 conn(0x7f9d70152700 0x7f9d70128230 :-1 s=OPENED pgs=308 gs=6 cs=1 l=1).handle_message read tag failed 2026-02-13T20:19:39.398 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.380+0000 7f9d6ffff640 1 --1- 10.20.193.110:0/812721409 >> v1:10.20.193.110:6790/0 conn(0x7f9d70152700 0x7f9d70128230 :-1 s=OPENED pgs=308 gs=6 cs=1 l=1).fault on lossy channel, failing 2026-02-13T20:19:39.398 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.380+0000 7f9d7491b640 1 -- 10.20.193.110:0/812721409 reap_dead start 2026-02-13T20:19:39.398 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.380+0000 7f9d6cff9640 1 -- 10.20.193.110:0/812721409 >> v1:10.20.193.110:6790/0 conn(0x7f9d70152700 legacy=0x7f9d70128230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:19:39.398 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.380+0000 7f9d6cff9640 1 -- 10.20.193.110:0/812721409 >> v1:10.20.193.110:6790/0 conn(0x7f9d70152700 legacy=0x7f9d70128230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:19:39.398 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.381+0000 7f9d6cff9640 1 -- 10.20.193.110:0/812721409 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9d70152ad0 con 0x7f9d40065f30 2026-02-13T20:19:39.398 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.381+0000 7f9d6cff9640 1 -- 10.20.193.110:0/812721409 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 156073488 0 0) 0x7f9d70152ad0 con 0x7f9d40065f30 2026-02-13T20:19:39.398 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.381+0000 7f9d6cff9640 10 monclient(hunting): _negotiate 2026-02-13T20:19:39.398 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.381+0000 7f9d6cff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:39.398 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.381+0000 7f9d6cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:39.398 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.381+0000 7f9d6cff9640 10 monclient(hunting): my global_id is 94358 2026-02-13T20:19:39.399 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.381+0000 7f9d6cff9640 1 -- 10.20.193.110:0/812721409 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d7005d320 con 0x7f9d40065f30 2026-02-13T20:19:39.399 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.381+0000 7f9d6cff9640 1 -- 10.20.193.110:0/812721409 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4228892767 0 0) 0x7f9d7005d320 con 0x7f9d40065f30 2026-02-13T20:19:39.399 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.381+0000 7f9d6cff9640 1 -- 10.20.193.110:0/812721409 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9d70152ad0 con 0x7f9d40065f30 2026-02-13T20:19:39.399 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.381+0000 7f9d6cff9640 1 -- 10.20.193.110:0/812721409 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f9d5c003a90 con 0x7f9d40065f30 2026-02-13T20:19:39.399 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.381+0000 7f9d6cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:39.399 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.381+0000 7f9d6cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:19:39.399 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.381+0000 7f9d6cff9640 10 monclient: dump: 2026-02-13T20:19:39.399 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:39.399 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:39.399 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.399 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.399 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:39.399 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:39.399 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:39.399 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:39.399 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:39.399 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:39.399 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.381+0000 7f9d6cff9640 1 -- 10.20.193.110:0/812721409 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 421873200 0 0) 0x7f9d70152ad0 con 0x7f9d40065f30 2026-02-13T20:19:39.399 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.381+0000 7f9d6cff9640 1 -- 10.20.193.110:0/812721409 --> v1:10.20.193.110:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9d5c003360 con 0x7f9d40065f30 2026-02-13T20:19:39.399 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.381+0000 7f9d6cff9640 1 -- 10.20.193.110:0/812721409 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4514 (unknown 0 0 2881375490) 0x7f9d5c005880 con 0x7f9d40065f30 2026-02-13T20:19:39.399 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.381+0000 7f9d6cff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:19:39.400 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.381+0000 7f9d6cff9640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:19:39.400 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.381+0000 7f9d6cff9640 1 -- 10.20.193.110:0/812721409 >> v1:10.20.193.110:6790/0 conn(0x7f9d40065f30 legacy=0x7f9d40064880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:39.400 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.381+0000 7f9d6cff9640 1 -- 10.20.193.110:0/812721409 >> v1:10.20.193.110:6790/0 conn(0x7f9d40065f30 legacy=0x7f9d40064880 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:19:39.400 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:19:39.400 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:19:39.400 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:19:39.400 INFO:teuthology.orchestra.run.trial110.stdout: "state": "peon", 2026-02-13T20:19:39.400 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 32, 2026-02-13T20:19:39.400 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 251004, 2026-02-13T20:19:39.400 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:19:39.400 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:19:39.400 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:19:39.401 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:19:39.401 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:19:39.401 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 2, 2026-02-13T20:19:39.401 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:19:39.401 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:19:39.401 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:19:39.401 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:19:39.401 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:19:39.401 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:19:39.401 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:19:39.401 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:19:39.401 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:19:39.401 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:19:39.401 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:19:39.401 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:19:39.401 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:19:39.401 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:19:39.401 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:19:39.401 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:19:39.401 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:19:39.401 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:19:39.402 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:19:39.402 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:19:39.402 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:19:39.402 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:19:39.402 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:19:39.402 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:19:39.402 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:19:39.402 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:19:39.402 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:19:39.402 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:19:39.402 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:19:39.402 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:19:39.402 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:19:39.402 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:19:39.402 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:19:39.402 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:39.402 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:19:39.402 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:19:39.402 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:19:39.402 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:19:39.402 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:19:39.403 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:19:39.403 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:19:39.403 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:19:39.403 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:19:39.403 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:19:39.403 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:19:39.403 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:19:39.403 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:19:39.403 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:19:39.403 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:19:39.403 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:19:39.403 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:19:39.403 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:19:39.403 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:19:39.403 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:19:39.403 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:19:39.403 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:19:39.403 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:19:39.403 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:19:39.403 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:19:39.403 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:19:39.403 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:19:39.403 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:19:39.404 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:19:39.404 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:19:39.404 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:19:39.404 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:19:39.404 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:39.404 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:19:39.404 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:39.404 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:19:39.404 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:19:39.404 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:19:39.404 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:19:39.404 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:39.404 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:19:39.404 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:19:39.404 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:19:39.404 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:39.404 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:19:39.404 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:39.404 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:19:39.404 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:19:39.404 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:19:39.404 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:19:39.404 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:19:39.405 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:19:39.405 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:39.405 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:39.405 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:19:39.405 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:19:39.405 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:19:39.405 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:19:39.405 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:39.405 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:19:39.405 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:19:39.405 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:19:39.405 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:39.405 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:19:39.405 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:39.405 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:19:39.405 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:19:39.405 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:19:39.405 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:19:39.405 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:19:39.405 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:19:39.405 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:39.405 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:39.405 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:19:39.405 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:19:39.405 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:19:39.406 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:19:39.406 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:39.406 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:19:39.406 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:19:39.406 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:19:39.406 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:39.406 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:19:39.406 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:39.406 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:19:39.406 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:19:39.406 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:19:39.406 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:19:39.406 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:19:39.406 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:19:39.406 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:39.406 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:19:39.406 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:39.406 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:19:39.406 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:19:39.406 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:39.406 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:19:39.406 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:19:39.406 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:19:39.406 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:39.406 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:19:39.406 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:19:39.407 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:39.407 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:19:39.407 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:19:39.407 INFO:teuthology.orchestra.run.trial110.stdout: "num": 2 2026-02-13T20:19:39.407 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:39.407 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:19:39.407 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:19:39.407 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:39.407 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:19:39.407 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:19:39.407 INFO:teuthology.orchestra.run.trial110.stdout: "num": 2 2026-02-13T20:19:39.407 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:39.407 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:19:39.407 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:39.407 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:19:39.407 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:19:39.408 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.381+0000 7f9d763a5640 10 monclient: shutdown 2026-02-13T20:19:39.408 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.381+0000 7f9d763a5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:19:39.408 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.381+0000 7f9d763a5640 1 -- 10.20.193.110:0/812721409 >> v1:10.20.193.110:6790/0 conn(0x7f9d70130af0 legacy=0x7f9d70195060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:39.408 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.382+0000 7f9d763a5640 1 -- 10.20.193.110:0/812721409 shutdown_connections 2026-02-13T20:19:39.408 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.382+0000 7f9d763a5640 1 -- 10.20.193.110:0/812721409 >> 10.20.193.110:0/812721409 conn(0x7f9d70054e90 msgr2=0x7f9d7008dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:19:39.408 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.382+0000 7f9d763a5640 1 -- 10.20.193.110:0/812721409 shutdown_connections 2026-02-13T20:19:39.408 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.382+0000 7f9d763a5640 1 -- 10.20.193.110:0/812721409 wait complete. 2026-02-13T20:19:39.408 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:19:39.409 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-13T20:19:39.409 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T20:19:39.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.473+0000 7f3bfc407640 10 monclient: get_monmap_and_config 2026-02-13T20:19:39.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.473+0000 7f3bfc407640 10 monclient: build_initial_monmap 2026-02-13T20:19:39.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.473+0000 7f3bfc407640 10 monclient: monmap: 2026-02-13T20:19:39.474 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:19:39.474 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:39.474 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:19:39.474151+0000 2026-02-13T20:19:39.474 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:19:39.474151+0000 2026-02-13T20:19:39.474 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:19:39.474 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:39.474 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:19:39.474 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:19:39.474 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:19:39.474 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:39.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.474+0000 7f3bfc407640 1 Processor -- start 2026-02-13T20:19:39.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.474+0000 7f3bfc407640 1 -- start start 2026-02-13T20:19:39.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.474+0000 7f3bfc407640 10 monclient: init 2026-02-13T20:19:39.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.474+0000 7f3bfc407640 10 monclient: _reopen_session rank -1 2026-02-13T20:19:39.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.474+0000 7f3bfc407640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:19:39.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.474+0000 7f3bfc407640 10 monclient(hunting): picked mon.noname-c con 0x7f3bf41401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:19:39.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.474+0000 7f3bfc407640 10 monclient(hunting): picked mon.noname-b con 0x7f3bf4092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:19:39.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.474+0000 7f3bfc407640 10 monclient(hunting): picked mon.noname-a con 0x7f3bf4091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:19:39.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.474+0000 7f3bfc407640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bf408b730 con 0x7f3bf4091950 2026-02-13T20:19:39.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.474+0000 7f3bfc407640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bf405c5b0 con 0x7f3bf41401c0 2026-02-13T20:19:39.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.474+0000 7f3bfc407640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bf408bcf0 con 0x7f3bf4092020 2026-02-13T20:19:39.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.474+0000 7f3bfc407640 10 monclient(hunting): _renew_subs 2026-02-13T20:19:39.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.474+0000 7f3bfc407640 10 monclient(hunting): authenticate will time out at 1141.164509s 2026-02-13T20:19:39.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.474+0000 7f3bfa97d640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f3bf4091950 0x7f3bf41a2a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:52226/0 (socket says 10.20.193.110:52226) 2026-02-13T20:19:39.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.474+0000 7f3bfa97d640 1 -- 10.20.193.110:0/2945815106 learned_addr learned my addr 10.20.193.110:0/2945815106 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:19:39.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.474+0000 7f3bf997b640 1 --1- 10.20.193.110:0/2945815106 >> v1:10.20.193.110:6790/0 conn(0x7f3bf4092020 0x7f3bf41812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:37812/0 (socket says 10.20.193.110:37812) 2026-02-13T20:19:39.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.474+0000 7f3bf917a640 1 -- 10.20.193.110:0/2945815106 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 702882936 0 0) 0x7f3bf408b730 con 0x7f3bf4091950 2026-02-13T20:19:39.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.474+0000 7f3bf917a640 10 monclient(hunting): _negotiate 2026-02-13T20:19:39.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.474+0000 7f3bf917a640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:39.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.474+0000 7f3bf917a640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:39.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.474+0000 7f3bf917a640 10 monclient(hunting): my global_id is 114177 2026-02-13T20:19:39.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.474+0000 7f3bf917a640 1 -- 10.20.193.110:0/2945815106 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3bdc0035e0 con 0x7f3bf4091950 2026-02-13T20:19:39.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.474+0000 7f3bf917a640 1 -- 10.20.193.110:0/2945815106 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2256637725 0 0) 0x7f3bf408bcf0 con 0x7f3bf4092020 2026-02-13T20:19:39.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.474+0000 7f3bf917a640 10 monclient(hunting): _negotiate 2026-02-13T20:19:39.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.474+0000 7f3bf917a640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:39.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.474+0000 7f3bf917a640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:39.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.474+0000 7f3bf917a640 10 monclient(hunting): my global_id is 94361 2026-02-13T20:19:39.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.474+0000 7f3bf917a640 1 -- 10.20.193.110:0/2945815106 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3bf408b730 con 0x7f3bf4092020 2026-02-13T20:19:39.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.474+0000 7f3bf917a640 1 -- 10.20.193.110:0/2945815106 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1656594668 0 0) 0x7f3bdc0035e0 con 0x7f3bf4091950 2026-02-13T20:19:39.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.474+0000 7f3bf917a640 1 -- 10.20.193.110:0/2945815106 >> v1:10.20.193.110:6790/0 conn(0x7f3bf4092020 legacy=0x7f3bf41812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:39.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.474+0000 7f3bf917a640 1 -- 10.20.193.110:0/2945815106 >> v1:10.20.193.188:6789/0 conn(0x7f3bf41401c0 legacy=0x7f3bf4091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:39.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.474+0000 7f3bf917a640 10 monclient: _finish_hunting 0 2026-02-13T20:19:39.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.474+0000 7f3bf917a640 1 monclient: found mon.noname-a 2026-02-13T20:19:39.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.474+0000 7f3bf917a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:19:39.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.474+0000 7f3bf917a640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:19:39.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.474+0000 7f3bf917a640 1 -- 10.20.193.110:0/2945815106 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bf4140590 con 0x7f3bf4091950 2026-02-13T20:19:39.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.474+0000 7f3bf917a640 10 monclient: _finish_auth 0 2026-02-13T20:19:39.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.474+0000 7f3bf917a640 10 monclient: _check_auth_tickets 2026-02-13T20:19:39.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.474+0000 7f3bf917a640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:19:39.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.474+0000 7f3bf917a640 1 -- 10.20.193.110:0/2945815106 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f3bf0003eb0 con 0x7f3bf4091950 2026-02-13T20:19:39.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.474+0000 7f3bfc407640 5 monclient: authenticate success, global_id 114177 2026-02-13T20:19:39.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.474+0000 7f3bfc407640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:19:39.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.474+0000 7f3bf917a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:39.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.474+0000 7f3bf917a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:19:39.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.474+0000 7f3bf917a640 10 monclient: dump: 2026-02-13T20:19:39.476 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:39.476 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:39.476 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.476 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.476 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:39.476 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:39.476 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:39.476 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:39.476 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:39.477 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:39.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.474+0000 7f3bfc407640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:19:39.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.475+0000 7f3bf917a640 1 -- 10.20.193.110:0/2945815106 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3bf0004080 con 0x7f3bf4091950 2026-02-13T20:19:39.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.475+0000 7f3bf917a640 10 monclient: handle_config config(0 keys) 2026-02-13T20:19:39.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.475+0000 7f3bf917a640 1 -- 10.20.193.110:0/2945815106 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f3bf0004490 con 0x7f3bf4091950 2026-02-13T20:19:39.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.475+0000 7f3bf917a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:39.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.475+0000 7f3bf917a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:19:39.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.475+0000 7f3bf917a640 10 monclient: dump: 2026-02-13T20:19:39.477 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:39.477 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:39.477 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.477 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.477 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:39.477 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:39.477 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:39.477 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:39.477 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:39.477 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:39.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.475+0000 7f3bfc407640 10 monclient: get_monmap_and_config success 2026-02-13T20:19:39.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.475+0000 7f3bfc407640 4 set_mon_vals no callback set 2026-02-13T20:19:39.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.475+0000 7f3bfc407640 10 monclient: shutdown 2026-02-13T20:19:39.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.475+0000 7f3bfc407640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:19:39.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.475+0000 7f3bfc407640 1 -- 10.20.193.110:0/2945815106 >> v1:10.20.193.110:6789/0 conn(0x7f3bf4091950 legacy=0x7f3bf41a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:39.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.475+0000 7f3bfc407640 1 -- 10.20.193.110:0/2945815106 shutdown_connections 2026-02-13T20:19:39.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.475+0000 7f3bfc407640 1 -- 10.20.193.110:0/2945815106 >> 10.20.193.110:0/2945815106 conn(0x7f3bf4054e90 msgr2=0x7f3bf4058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:19:39.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.475+0000 7f3bfc407640 1 -- 10.20.193.110:0/2945815106 shutdown_connections 2026-02-13T20:19:39.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.475+0000 7f3bfc407640 1 -- 10.20.193.110:0/2945815106 wait complete. 2026-02-13T20:19:39.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.475+0000 7f3bfc407640 10 monclient: build_initial_monmap 2026-02-13T20:19:39.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.475+0000 7f3bfc407640 10 monclient: monmap: 2026-02-13T20:19:39.479 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:19:39.479 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:19:39.479 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:19:39.479 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:19:39.479 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:19:39.479 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:19:39.479 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:19:39.479 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:19:39.479 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:19:39.479 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:39.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.475+0000 7f3bfc407640 1 Processor -- start 2026-02-13T20:19:39.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.475+0000 7f3bfc407640 1 -- start start 2026-02-13T20:19:39.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.475+0000 7f3bfc407640 10 monclient: init 2026-02-13T20:19:39.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bfc407640 10 monclient: _reopen_session rank -1 2026-02-13T20:19:39.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bfc407640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:19:39.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bfc407640 10 monclient(hunting): picked mon.noname-b con 0x7f3bf4091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:19:39.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bfc407640 10 monclient(hunting): picked mon.noname-c con 0x7f3bf41401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:19:39.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bfc407640 10 monclient(hunting): picked mon.noname-a con 0x7f3bf4114190 addr v1:10.20.193.110:6789/0 2026-02-13T20:19:39.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bfc407640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bf412c3c0 con 0x7f3bf4114190 2026-02-13T20:19:39.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bfc407640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bf405d320 con 0x7f3bf4091950 2026-02-13T20:19:39.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bfc407640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bf412b080 con 0x7f3bf41401c0 2026-02-13T20:19:39.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bfc407640 10 monclient(hunting): _renew_subs 2026-02-13T20:19:39.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bfc407640 10 monclient(hunting): authenticate will time out at 1141.166201s 2026-02-13T20:19:39.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bf997b640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f3bf41401c0 0x7f3bf41a1040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:37816/0 (socket says 10.20.193.110:37816) 2026-02-13T20:19:39.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bf997b640 1 -- 10.20.193.110:0/2162277035 learned_addr learned my addr 10.20.193.110:0/2162277035 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:19:39.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bdaffd640 1 -- 10.20.193.110:0/2162277035 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 484030257 0 0) 0x7f3bf412b080 con 0x7f3bf41401c0 2026-02-13T20:19:39.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bdaffd640 10 monclient(hunting): _negotiate 2026-02-13T20:19:39.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bdaffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:39.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bdaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:39.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bdaffd640 10 monclient(hunting): my global_id is 94364 2026-02-13T20:19:39.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bdaffd640 1 -- 10.20.193.110:0/2162277035 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3bc40035e0 con 0x7f3bf41401c0 2026-02-13T20:19:39.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bdaffd640 1 -- 10.20.193.110:0/2162277035 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 165338414 0 0) 0x7f3bf412c3c0 con 0x7f3bf4114190 2026-02-13T20:19:39.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bdaffd640 10 monclient(hunting): _negotiate 2026-02-13T20:19:39.480 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bdaffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:39.480 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bdaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:39.480 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bdaffd640 10 monclient(hunting): my global_id is 114180 2026-02-13T20:19:39.480 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bdaffd640 1 -- 10.20.193.110:0/2162277035 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3bf412b080 con 0x7f3bf4114190 2026-02-13T20:19:39.480 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bdaffd640 1 -- 10.20.193.110:0/2162277035 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3013534799 0 0) 0x7f3bc40035e0 con 0x7f3bf41401c0 2026-02-13T20:19:39.480 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bdaffd640 1 -- 10.20.193.110:0/2162277035 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3bf412c3c0 con 0x7f3bf41401c0 2026-02-13T20:19:39.480 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bdaffd640 1 -- 10.20.193.110:0/2162277035 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f3be80030f0 con 0x7f3bf41401c0 2026-02-13T20:19:39.480 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bdaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:19:39.480 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bdaffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:19:39.480 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bdaffd640 10 monclient(hunting): dump: 2026-02-13T20:19:39.480 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:39.480 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:39.480 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.480 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.480 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:39.480 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:39.480 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:39.480 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:39.480 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:39.480 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:39.480 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bdaffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:19:39.480 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bdaffd640 1 -- 10.20.193.110:0/2162277035 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2431167908 0 0) 0x7f3bf412b080 con 0x7f3bf4114190 2026-02-13T20:19:39.480 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bdaffd640 1 -- 10.20.193.110:0/2162277035 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3bc40035e0 con 0x7f3bf4114190 2026-02-13T20:19:39.480 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bdaffd640 1 -- 10.20.193.110:0/2162277035 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f3bf0003c10 con 0x7f3bf4114190 2026-02-13T20:19:39.480 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bdaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:19:39.480 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bdaffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:19:39.480 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bdaffd640 10 monclient(hunting): dump: 2026-02-13T20:19:39.480 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:39.480 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:39.480 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.480 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.480 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:39.480 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:39.480 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:39.480 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:39.480 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:39.480 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:39.480 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bdaffd640 1 -- 10.20.193.110:0/2162277035 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2656915628 0 0) 0x7f3bf412c3c0 con 0x7f3bf41401c0 2026-02-13T20:19:39.480 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bdaffd640 1 -- 10.20.193.110:0/2162277035 >> v1:10.20.193.188:6789/0 conn(0x7f3bf4091950 legacy=0x7f3bf41245c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:39.480 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bdaffd640 1 -- 10.20.193.110:0/2162277035 >> v1:10.20.193.110:6789/0 conn(0x7f3bf4114190 legacy=0x7f3bf41a2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:39.480 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bdaffd640 10 monclient: _finish_hunting 0 2026-02-13T20:19:39.480 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bdaffd640 1 monclient: found mon.c 2026-02-13T20:19:39.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bdaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:19:39.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bdaffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:19:39.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bdaffd640 1 -- 10.20.193.110:0/2162277035 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bf412d3e0 con 0x7f3bf41401c0 2026-02-13T20:19:39.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bdaffd640 10 monclient: _finish_auth 0 2026-02-13T20:19:39.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bdaffd640 10 monclient: _check_auth_tickets 2026-02-13T20:19:39.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bdaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:19:39.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bfc407640 5 monclient: authenticate success, global_id 94364 2026-02-13T20:19:39.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bfc407640 10 monclient: _renew_subs 2026-02-13T20:19:39.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bfc407640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:19:39.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bfc407640 1 -- 10.20.193.110:0/2162277035 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3bf412cb40 con 0x7f3bf41401c0 2026-02-13T20:19:39.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bfc407640 10 monclient: _renew_subs 2026-02-13T20:19:39.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bfc407640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:19:39.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bfc407640 1 -- 10.20.193.110:0/2162277035 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f3bf412bbe0 con 0x7f3bf41401c0 2026-02-13T20:19:39.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bdaffd640 1 -- 10.20.193.110:0/2162277035 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3be8003480 con 0x7f3bf41401c0 2026-02-13T20:19:39.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bdaffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:19:39.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bdaffd640 1 -- 10.20.193.110:0/2162277035 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f3be8004d00 con 0x7f3bf41401c0 2026-02-13T20:19:39.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bdaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:39.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bdaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:19:39.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bdaffd640 10 monclient: dump: 2026-02-13T20:19:39.481 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:39.481 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:39.481 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.481 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.481 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:39.481 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:39.481 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:39.481 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:39.481 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:39.481 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:39.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.476+0000 7f3bf8979640 4 set_mon_vals no callback set 2026-02-13T20:19:39.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.477+0000 7f3bfc407640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:19:39.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.477+0000 7f3bfc407640 1 -- 10.20.193.110:0/2162277035 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3bf412d1e0 con 0x7f3bf4092020 2026-02-13T20:19:39.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.477+0000 7f3bdaffd640 1 -- 10.20.193.110:0/2162277035 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f3be8011970 con 0x7f3bf41401c0 2026-02-13T20:19:39.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.477+0000 7f3bdaffd640 1 -- 10.20.193.110:0/2162277035 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(397..397 src has 1..397) ==== 3915+0+0 (unknown 4076817378 0 0) 0x7f3be804e930 con 0x7f3bf41401c0 2026-02-13T20:19:39.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.477+0000 7f3bdaffd640 1 -- 10.20.193.110:0/2162277035 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 323943434 0 0) 0x7f3bf412d1e0 con 0x7f3bf4092020 2026-02-13T20:19:39.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.477+0000 7f3bdaffd640 10 monclient(hunting): _negotiate 2026-02-13T20:19:39.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.477+0000 7f3bdaffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:39.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.477+0000 7f3bdaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:39.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.477+0000 7f3bdaffd640 10 monclient(hunting): my global_id is 4762 2026-02-13T20:19:39.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.477+0000 7f3bdaffd640 1 -- 10.20.193.110:0/2162277035 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3bf412c3c0 con 0x7f3bf4092020 2026-02-13T20:19:39.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.477+0000 7f3bfa97d640 10 monclient: get_auth_request con 0x7f3bc403fa50 auth_method 0 2026-02-13T20:19:39.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.477+0000 7f3bdaffd640 1 -- 10.20.193.110:0/2162277035 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1111359316 0 0) 0x7f3bf412c3c0 con 0x7f3bf4092020 2026-02-13T20:19:39.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.477+0000 7f3bdaffd640 1 -- 10.20.193.110:0/2162277035 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3bf412d1e0 con 0x7f3bf4092020 2026-02-13T20:19:39.482 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.477+0000 7f3bdaffd640 1 -- 10.20.193.110:0/2162277035 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f3be4002e40 con 0x7f3bf4092020 2026-02-13T20:19:39.482 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.477+0000 7f3bdaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:39.482 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.477+0000 7f3bdaffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:19:39.482 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.477+0000 7f3bdaffd640 10 monclient: dump: 2026-02-13T20:19:39.482 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:39.482 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:39.482 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.482 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.482 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:39.482 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:39.482 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:39.482 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:39.482 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:39.482 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:39.482 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.478+0000 7f3bdaffd640 1 -- 10.20.193.110:0/2162277035 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2848831945 0 0) 0x7f3bf412d1e0 con 0x7f3bf4092020 2026-02-13T20:19:39.482 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.478+0000 7f3bdaffd640 1 -- 10.20.193.110:0/2162277035 --> v1:10.20.193.188:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3bf408b450 con 0x7f3bf4092020 2026-02-13T20:19:39.482 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.478+0000 7f3bdaffd640 1 -- 10.20.193.110:0/2162277035 <== mon.1 v1:10.20.193.188:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f3be40033a0 con 0x7f3bf4092020 2026-02-13T20:19:39.482 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.478+0000 7f3bdaffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:19:39.482 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.478+0000 7f3bdaffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:19:39.482 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.478+0000 7f3bdaffd640 1 -- 10.20.193.110:0/2162277035 >> v1:10.20.193.188:6789/0 conn(0x7f3bf4092020 legacy=0x7f3bf4124ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:39.482 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.478+0000 7f3bdaffd640 1 -- 10.20.193.110:0/2162277035 >> v1:10.20.193.188:6789/0 conn(0x7f3bf4092020 legacy=0x7f3bf4124ef0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:19:39.483 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.481+0000 7f3bfc407640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:19:39.484 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.481+0000 7f3bfc407640 1 -- 10.20.193.110:0/2162277035 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3bf4055bb0 con 0x7f3bf41a4020 2026-02-13T20:19:39.484 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.482+0000 7f3bdaffd640 1 -- 10.20.193.110:0/2162277035 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4207568929 0 0) 0x7f3bf4055bb0 con 0x7f3bf41a4020 2026-02-13T20:19:39.484 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.482+0000 7f3bdaffd640 10 monclient(hunting): _negotiate 2026-02-13T20:19:39.484 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.482+0000 7f3bdaffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:39.484 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.482+0000 7f3bdaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:39.484 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.482+0000 7f3bdaffd640 10 monclient(hunting): my global_id is 4765 2026-02-13T20:19:39.484 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.482+0000 7f3bdaffd640 1 -- 10.20.193.110:0/2162277035 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3bf412d1e0 con 0x7f3bf41a4020 2026-02-13T20:19:39.484 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.482+0000 7f3bdaffd640 1 -- 10.20.193.110:0/2162277035 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1204791634 0 0) 0x7f3bf412d1e0 con 0x7f3bf41a4020 2026-02-13T20:19:39.484 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.482+0000 7f3bdaffd640 1 -- 10.20.193.110:0/2162277035 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3bf4055bb0 con 0x7f3bf41a4020 2026-02-13T20:19:39.484 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.482+0000 7f3bdaffd640 1 -- 10.20.193.110:0/2162277035 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f3be4003b20 con 0x7f3bf41a4020 2026-02-13T20:19:39.484 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.482+0000 7f3bdaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:39.484 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.482+0000 7f3bdaffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:19:39.484 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.482+0000 7f3bdaffd640 10 monclient: dump: 2026-02-13T20:19:39.485 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:39.485 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:39.485 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.485 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.485 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:39.485 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:39.485 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:39.485 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:39.485 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:39.485 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:39.485 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.482+0000 7f3bdaffd640 1 -- 10.20.193.110:0/2162277035 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 397783337 0 0) 0x7f3bf4055bb0 con 0x7f3bf41a4020 2026-02-13T20:19:39.485 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.482+0000 7f3bdaffd640 1 -- 10.20.193.110:0/2162277035 --> v1:10.20.193.188:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3bf41145b0 con 0x7f3bf41a4020 2026-02-13T20:19:39.485 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.482+0000 7f3bdaffd640 1 -- 10.20.193.110:0/2162277035 <== mon.1 v1:10.20.193.188:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4683 (unknown 0 0 1978063687) 0x7f3be4003e20 con 0x7f3bf41a4020 2026-02-13T20:19:39.485 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.482+0000 7f3bdaffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:19:39.485 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.482+0000 7f3bdaffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:19:39.485 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.482+0000 7f3bdaffd640 1 -- 10.20.193.110:0/2162277035 >> v1:10.20.193.188:6789/0 conn(0x7f3bf41a4020 legacy=0x7f3bf4125600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:39.485 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.482+0000 7f3bdaffd640 1 -- 10.20.193.110:0/2162277035 >> v1:10.20.193.188:6789/0 conn(0x7f3bf41a4020 legacy=0x7f3bf4125600 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:19:39.486 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:19:39.486 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:19:39.486 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:19:39.486 INFO:teuthology.orchestra.run.trial110.stdout: "state": "leader", 2026-02-13T20:19:39.486 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 32, 2026-02-13T20:19:39.486 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 501628, 2026-02-13T20:19:39.486 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:19:39.486 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:19:39.486 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:19:39.486 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:19:39.486 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:19:39.486 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 2, 2026-02-13T20:19:39.486 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:19:39.487 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:19:39.487 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:19:39.487 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:19:39.487 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:19:39.487 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:19:39.487 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:19:39.487 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:19:39.487 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:19:39.487 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:19:39.487 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:19:39.487 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:19:39.487 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:19:39.487 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:19:39.487 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:19:39.487 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:19:39.487 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:19:39.487 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:19:39.487 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:19:39.488 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:19:39.488 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:19:39.488 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:19:39.488 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:19:39.488 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:19:39.488 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:19:39.488 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:19:39.488 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:19:39.488 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:19:39.488 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:19:39.488 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:19:39.488 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:19:39.488 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:19:39.488 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:19:39.488 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:39.488 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:19:39.488 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:19:39.488 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:19:39.488 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:19:39.489 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:19:39.489 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:19:39.489 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:19:39.489 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:19:39.489 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:19:39.489 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:19:39.489 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:19:39.489 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:19:39.489 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:19:39.489 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:19:39.489 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:19:39.489 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:19:39.489 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:19:39.489 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:19:39.489 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:19:39.489 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:19:39.489 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:19:39.489 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:19:39.489 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:19:39.489 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:19:39.490 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:19:39.490 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:19:39.490 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:19:39.490 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:19:39.490 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:19:39.490 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:19:39.490 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:19:39.490 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:19:39.490 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:39.490 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:19:39.490 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:39.490 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:19:39.490 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:19:39.490 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:19:39.490 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:19:39.490 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:39.490 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:19:39.490 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:19:39.490 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:19:39.490 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:39.490 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:19:39.491 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:39.491 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:19:39.491 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:19:39.491 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:19:39.491 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:19:39.491 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:19:39.491 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:19:39.491 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:39.491 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:39.491 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:19:39.491 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:19:39.491 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:19:39.491 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:19:39.491 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:39.491 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:19:39.491 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:19:39.491 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:19:39.491 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:39.491 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:19:39.491 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:39.491 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:19:39.491 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:19:39.492 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:19:39.492 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:19:39.492 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:19:39.492 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:19:39.492 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:39.492 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:39.492 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:19:39.492 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:19:39.492 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:19:39.492 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:19:39.492 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:39.492 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:19:39.492 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:19:39.492 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:19:39.492 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:39.492 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:19:39.492 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:39.492 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:19:39.492 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:19:39.492 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:19:39.492 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:19:39.492 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:19:39.493 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:19:39.493 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:39.493 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:19:39.493 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:39.493 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:19:39.493 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:19:39.493 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:39.493 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:19:39.493 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:19:39.493 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:19:39.493 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:39.493 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:19:39.493 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:19:39.493 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:39.493 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:19:39.493 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:19:39.493 INFO:teuthology.orchestra.run.trial110.stdout: "num": 4 2026-02-13T20:19:39.493 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:39.493 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:19:39.493 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:19:39.493 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:39.493 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:19:39.493 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:19:39.494 INFO:teuthology.orchestra.run.trial110.stdout: "num": 6 2026-02-13T20:19:39.494 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:39.494 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:19:39.494 INFO:teuthology.orchestra.run.trial110.stdout: "mgr": [ 2026-02-13T20:19:39.494 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:39.494 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:19:39.494 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:19:39.494 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:19:39.494 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:39.494 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:19:39.494 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:39.494 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:19:39.494 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:19:39.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.483+0000 7f3bfc407640 1 -- 10.20.193.110:0/2162277035 >> v1:10.20.193.188:6812/1623052694 conn(0x7f3bc403fa50 legacy=0x7f3bc405ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:39.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.483+0000 7f3bfc407640 10 monclient: shutdown 2026-02-13T20:19:39.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.483+0000 7f3bfc407640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:19:39.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.483+0000 7f3bfc407640 1 -- 10.20.193.110:0/2162277035 >> v1:10.20.193.110:6790/0 conn(0x7f3bf41401c0 legacy=0x7f3bf41a1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:39.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.483+0000 7f3bfa97d640 1 -- 10.20.193.110:0/2162277035 reap_dead start 2026-02-13T20:19:39.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.483+0000 7f3bfa97d640 1 -- 10.20.193.110:0/2162277035 reap_dead start 2026-02-13T20:19:39.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.483+0000 7f3bfc407640 1 -- 10.20.193.110:0/2162277035 shutdown_connections 2026-02-13T20:19:39.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.483+0000 7f3bfc407640 1 -- 10.20.193.110:0/2162277035 >> 10.20.193.110:0/2162277035 conn(0x7f3bf4054e90 msgr2=0x7f3bf408dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:19:39.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.483+0000 7f3bfc407640 1 -- 10.20.193.110:0/2162277035 shutdown_connections 2026-02-13T20:19:39.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.483+0000 7f3bfc407640 1 -- 10.20.193.110:0/2162277035 wait complete. 2026-02-13T20:19:39.496 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:19:39.496 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2026-02-13T20:19:39.496 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-13T20:19:39.496 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2026-02-13T20:19:39.496 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a store 2026-02-13T20:19:39.496 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a sync_force --yes-i-really-mean-it 2026-02-13T20:19:39.573 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.562+0000 7f97fcb75640 10 monclient: get_monmap_and_config 2026-02-13T20:19:39.574 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.562+0000 7f97fcb75640 10 monclient: build_initial_monmap 2026-02-13T20:19:39.574 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.562+0000 7f97fcb75640 10 monclient: monmap: 2026-02-13T20:19:39.574 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:19:39.574 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:39.574 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:19:39.563261+0000 2026-02-13T20:19:39.574 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:19:39.563261+0000 2026-02-13T20:19:39.574 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:19:39.574 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:39.575 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:19:39.575 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:19:39.575 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:19:39.575 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:39.575 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.563+0000 7f97fcb75640 1 Processor -- start 2026-02-13T20:19:39.575 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.563+0000 7f97fcb75640 1 -- start start 2026-02-13T20:19:39.575 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.563+0000 7f97fcb75640 10 monclient: init 2026-02-13T20:19:39.575 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.563+0000 7f97fcb75640 10 monclient: _reopen_session rank -1 2026-02-13T20:19:39.575 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.563+0000 7f97fcb75640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:19:39.575 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.563+0000 7f97fcb75640 10 monclient(hunting): picked mon.noname-a con 0x7f97f81401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:19:39.575 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.563+0000 7f97fcb75640 10 monclient(hunting): picked mon.noname-b con 0x7f97f8092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:19:39.576 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.563+0000 7f97fcb75640 10 monclient(hunting): picked mon.noname-c con 0x7f97f8091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:19:39.576 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.563+0000 7f97fcb75640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97f808b730 con 0x7f97f81401c0 2026-02-13T20:19:39.576 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.563+0000 7f97fcb75640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97f805c5b0 con 0x7f97f8091950 2026-02-13T20:19:39.576 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.563+0000 7f97fcb75640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97f808bcf0 con 0x7f97f8092020 2026-02-13T20:19:39.576 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.563+0000 7f97fcb75640 10 monclient(hunting): _renew_subs 2026-02-13T20:19:39.576 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.563+0000 7f97fcb75640 10 monclient(hunting): authenticate will time out at 1141.253606s 2026-02-13T20:19:39.576 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.563+0000 7f97f5d74640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f97f8092020 0x7f97f81812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:37832/0 (socket says 10.20.193.110:37832) 2026-02-13T20:19:39.576 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.563+0000 7f97f5d74640 1 -- 10.20.193.110:0/3770056463 learned_addr learned my addr 10.20.193.110:0/3770056463 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:19:39.576 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.563+0000 7f97f5573640 1 -- 10.20.193.110:0/3770056463 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 928104443 0 0) 0x7f97f808bcf0 con 0x7f97f8092020 2026-02-13T20:19:39.576 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.563+0000 7f97f5573640 10 monclient(hunting): _negotiate 2026-02-13T20:19:39.576 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.563+0000 7f97f5573640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:39.576 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.563+0000 7f97f5573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:39.577 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.563+0000 7f97f5573640 10 monclient(hunting): my global_id is 94367 2026-02-13T20:19:39.577 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.563+0000 7f97f5573640 1 -- 10.20.193.110:0/3770056463 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97e40035e0 con 0x7f97f8092020 2026-02-13T20:19:39.577 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.563+0000 7f97f5573640 1 -- 10.20.193.110:0/3770056463 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1864658239 0 0) 0x7f97f808b730 con 0x7f97f81401c0 2026-02-13T20:19:39.577 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.563+0000 7f97f5573640 10 monclient(hunting): _negotiate 2026-02-13T20:19:39.577 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.563+0000 7f97f5573640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:39.577 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.563+0000 7f97f5573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:39.577 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.563+0000 7f97f5573640 10 monclient(hunting): my global_id is 114183 2026-02-13T20:19:39.577 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.563+0000 7f97f5573640 1 -- 10.20.193.110:0/3770056463 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97f808bcf0 con 0x7f97f81401c0 2026-02-13T20:19:39.577 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.564+0000 7f97f5573640 1 -- 10.20.193.110:0/3770056463 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 713162439 0 0) 0x7f97e40035e0 con 0x7f97f8092020 2026-02-13T20:19:39.577 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.564+0000 7f97f5573640 1 -- 10.20.193.110:0/3770056463 >> v1:10.20.193.188:6789/0 conn(0x7f97f8091950 legacy=0x7f97f81a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:39.577 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.564+0000 7f97f5573640 1 -- 10.20.193.110:0/3770056463 >> v1:10.20.193.110:6789/0 conn(0x7f97f81401c0 legacy=0x7f97f8091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:39.577 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.564+0000 7f97f5573640 10 monclient: _finish_hunting 0 2026-02-13T20:19:39.578 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.564+0000 7f97f5573640 1 monclient: found mon.noname-b 2026-02-13T20:19:39.578 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.564+0000 7f97f5573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:19:39.578 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.564+0000 7f97f5573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:19:39.578 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.564+0000 7f97f5573640 1 -- 10.20.193.110:0/3770056463 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97f8140590 con 0x7f97f8092020 2026-02-13T20:19:39.578 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.564+0000 7f97f5573640 10 monclient: _finish_auth 0 2026-02-13T20:19:39.578 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.564+0000 7f97f5573640 10 monclient: _check_auth_tickets 2026-02-13T20:19:39.578 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.564+0000 7f97f5573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:19:39.578 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.564+0000 7f97f5573640 1 -- 10.20.193.110:0/3770056463 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f97e0002dd0 con 0x7f97f8092020 2026-02-13T20:19:39.578 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.564+0000 7f97fcb75640 5 monclient: authenticate success, global_id 94367 2026-02-13T20:19:39.578 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.564+0000 7f97fcb75640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:19:39.578 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.564+0000 7f97f5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:39.578 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.564+0000 7f97f5573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:19:39.579 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.564+0000 7f97f5573640 10 monclient: dump: 2026-02-13T20:19:39.579 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:39.579 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:39.579 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.579 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.579 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:39.579 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:39.579 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:39.579 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:39.579 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:39.579 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:39.579 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.564+0000 7f97fcb75640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:19:39.579 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.564+0000 7f97f5573640 1 -- 10.20.193.110:0/3770056463 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f97e0002fa0 con 0x7f97f8092020 2026-02-13T20:19:39.579 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.564+0000 7f97f5573640 10 monclient: handle_config config(0 keys) 2026-02-13T20:19:39.579 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.564+0000 7f97f5573640 1 -- 10.20.193.110:0/3770056463 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f97e00033b0 con 0x7f97f8092020 2026-02-13T20:19:39.579 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.564+0000 7f97f5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:39.579 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.564+0000 7f97f5573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:19:39.580 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.564+0000 7f97f5573640 10 monclient: dump: 2026-02-13T20:19:39.580 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:39.580 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:39.580 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.580 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.580 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:39.580 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:39.580 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:39.580 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:39.580 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:39.580 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:39.580 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.564+0000 7f97fcb75640 10 monclient: get_monmap_and_config success 2026-02-13T20:19:39.580 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.564+0000 7f97fcb75640 4 set_mon_vals no callback set 2026-02-13T20:19:39.580 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.564+0000 7f97fcb75640 10 monclient: shutdown 2026-02-13T20:19:39.580 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.564+0000 7f97fcb75640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:19:39.580 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.564+0000 7f97fcb75640 1 -- 10.20.193.110:0/3770056463 >> v1:10.20.193.110:6790/0 conn(0x7f97f8092020 legacy=0x7f97f81812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:39.580 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.564+0000 7f97fcb75640 1 -- 10.20.193.110:0/3770056463 shutdown_connections 2026-02-13T20:19:39.580 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.564+0000 7f97fcb75640 1 -- 10.20.193.110:0/3770056463 >> 10.20.193.110:0/3770056463 conn(0x7f97f8054e90 msgr2=0x7f97f8058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:19:39.580 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.564+0000 7f97fcb75640 1 -- 10.20.193.110:0/3770056463 shutdown_connections 2026-02-13T20:19:39.580 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.564+0000 7f97fcb75640 1 -- 10.20.193.110:0/3770056463 wait complete. 2026-02-13T20:19:39.580 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.564+0000 7f97fcb75640 10 monclient: build_initial_monmap 2026-02-13T20:19:39.580 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.564+0000 7f97fcb75640 10 monclient: monmap: 2026-02-13T20:19:39.581 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:19:39.581 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:19:39.581 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:19:39.581 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:19:39.581 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:19:39.581 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:19:39.581 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:19:39.581 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:19:39.581 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:19:39.581 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:39.581 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97fcb75640 1 Processor -- start 2026-02-13T20:19:39.581 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97fcb75640 1 -- start start 2026-02-13T20:19:39.581 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97fcb75640 10 monclient: init 2026-02-13T20:19:39.581 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97fcb75640 10 monclient: _reopen_session rank -1 2026-02-13T20:19:39.581 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97fcb75640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:19:39.581 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97fcb75640 10 monclient(hunting): picked mon.noname-b con 0x7f97f8091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:19:39.581 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97fcb75640 10 monclient(hunting): picked mon.noname-a con 0x7f97f81401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:19:39.581 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97fcb75640 10 monclient(hunting): picked mon.noname-c con 0x7f97f813f110 addr v1:10.20.193.110:6790/0 2026-02-13T20:19:39.581 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97fcb75640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97f808c570 con 0x7f97f81401c0 2026-02-13T20:19:39.581 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97fcb75640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97f805d320 con 0x7f97f8091950 2026-02-13T20:19:39.581 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97fcb75640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97f8132520 con 0x7f97f813f110 2026-02-13T20:19:39.581 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97fcb75640 10 monclient(hunting): _renew_subs 2026-02-13T20:19:39.581 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97fcb75640 10 monclient(hunting): authenticate will time out at 1141.255390s 2026-02-13T20:19:39.581 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97f6d76640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f97f813f110 0x7f97f8194a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:37842/0 (socket says 10.20.193.110:37842) 2026-02-13T20:19:39.582 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97f5d74640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f97f81401c0 0x7f97f813ea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:52244/0 (socket says 10.20.193.110:52244) 2026-02-13T20:19:39.582 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97f6d76640 1 -- 10.20.193.110:0/2473399517 learned_addr learned my addr 10.20.193.110:0/2473399517 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:19:39.582 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97deffd640 1 -- 10.20.193.110:0/2473399517 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 502750900 0 0) 0x7f97f8132520 con 0x7f97f813f110 2026-02-13T20:19:39.582 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97deffd640 10 monclient(hunting): _negotiate 2026-02-13T20:19:39.582 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97deffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:39.582 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97deffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:39.582 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97deffd640 10 monclient(hunting): my global_id is 94370 2026-02-13T20:19:39.582 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97deffd640 1 -- 10.20.193.110:0/2473399517 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97c40035e0 con 0x7f97f813f110 2026-02-13T20:19:39.582 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97deffd640 1 -- 10.20.193.110:0/2473399517 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2094086022 0 0) 0x7f97f808c570 con 0x7f97f81401c0 2026-02-13T20:19:39.582 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97deffd640 10 monclient(hunting): _negotiate 2026-02-13T20:19:39.582 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97deffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:39.582 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97deffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:39.582 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97deffd640 10 monclient(hunting): my global_id is 114186 2026-02-13T20:19:39.582 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97deffd640 1 -- 10.20.193.110:0/2473399517 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97f8132520 con 0x7f97f81401c0 2026-02-13T20:19:39.582 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97deffd640 1 -- 10.20.193.110:0/2473399517 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2071535681 0 0) 0x7f97c40035e0 con 0x7f97f813f110 2026-02-13T20:19:39.582 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97deffd640 1 -- 10.20.193.110:0/2473399517 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f97f808c570 con 0x7f97f813f110 2026-02-13T20:19:39.582 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97deffd640 1 -- 10.20.193.110:0/2473399517 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f97e80041d0 con 0x7f97f813f110 2026-02-13T20:19:39.582 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97deffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:19:39.582 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97deffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:19:39.582 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97deffd640 10 monclient(hunting): dump: 2026-02-13T20:19:39.582 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:39.582 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:39.582 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.583 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.583 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:39.583 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:39.583 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:39.583 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:39.583 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:39.583 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:39.583 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97deffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:19:39.583 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97deffd640 1 -- 10.20.193.110:0/2473399517 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1149412399 0 0) 0x7f97f8132520 con 0x7f97f81401c0 2026-02-13T20:19:39.583 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97deffd640 1 -- 10.20.193.110:0/2473399517 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f97c40035e0 con 0x7f97f81401c0 2026-02-13T20:19:39.583 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97deffd640 1 -- 10.20.193.110:0/2473399517 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f97e0002ce0 con 0x7f97f81401c0 2026-02-13T20:19:39.583 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97deffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:19:39.583 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97deffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:19:39.583 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97deffd640 10 monclient(hunting): dump: 2026-02-13T20:19:39.583 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:39.583 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:39.583 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.583 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.583 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:39.583 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:39.583 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:39.583 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:39.583 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:39.583 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:39.584 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97deffd640 1 -- 10.20.193.110:0/2473399517 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2973990321 0 0) 0x7f97f808c570 con 0x7f97f813f110 2026-02-13T20:19:39.584 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97deffd640 1 -- 10.20.193.110:0/2473399517 >> v1:10.20.193.188:6789/0 conn(0x7f97f8091950 legacy=0x7f97f8152670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:39.584 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97deffd640 1 -- 10.20.193.110:0/2473399517 >> v1:10.20.193.110:6789/0 conn(0x7f97f81401c0 legacy=0x7f97f813ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:39.584 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97deffd640 10 monclient: _finish_hunting 0 2026-02-13T20:19:39.584 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97deffd640 1 monclient: found mon.c 2026-02-13T20:19:39.584 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97deffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:19:39.584 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97deffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:19:39.584 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97deffd640 1 -- 10.20.193.110:0/2473399517 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97f808a890 con 0x7f97f813f110 2026-02-13T20:19:39.584 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97deffd640 10 monclient: _finish_auth 0 2026-02-13T20:19:39.584 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97deffd640 10 monclient: _check_auth_tickets 2026-02-13T20:19:39.584 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97deffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:19:39.584 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97fcb75640 5 monclient: authenticate success, global_id 94370 2026-02-13T20:19:39.584 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97fcb75640 10 monclient: _renew_subs 2026-02-13T20:19:39.584 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97fcb75640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:19:39.584 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97fcb75640 1 -- 10.20.193.110:0/2473399517 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f97f8132240 con 0x7f97f813f110 2026-02-13T20:19:39.584 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97fcb75640 10 monclient: _renew_subs 2026-02-13T20:19:39.584 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97fcb75640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:19:39.584 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.565+0000 7f97fcb75640 1 -- 10.20.193.110:0/2473399517 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f97f81962c0 con 0x7f97f813f110 2026-02-13T20:19:39.584 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.566+0000 7f97deffd640 1 -- 10.20.193.110:0/2473399517 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f97e8004540 con 0x7f97f813f110 2026-02-13T20:19:39.584 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.566+0000 7f97deffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:19:39.584 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.566+0000 7f97deffd640 1 -- 10.20.193.110:0/2473399517 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f97e8004c10 con 0x7f97f813f110 2026-02-13T20:19:39.584 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.566+0000 7f97deffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:39.584 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.566+0000 7f97deffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:19:39.584 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.566+0000 7f97deffd640 10 monclient: dump: 2026-02-13T20:19:39.585 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:39.585 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:39.585 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.585 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.585 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:39.585 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:39.585 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:39.585 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:39.585 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:39.585 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:39.585 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.566+0000 7f97f4d72640 4 set_mon_vals no callback set 2026-02-13T20:19:39.585 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.566+0000 7f97fcb75640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:19:39.585 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.566+0000 7f97fcb75640 1 -- 10.20.193.110:0/2473399517 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f97f80008d0 con 0x7f97f8092020 2026-02-13T20:19:39.585 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.566+0000 7f97deffd640 1 -- 10.20.193.110:0/2473399517 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f97e8004d70 con 0x7f97f813f110 2026-02-13T20:19:39.585 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.566+0000 7f97deffd640 1 -- 10.20.193.110:0/2473399517 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 174255810 0 0) 0x7f97f80008d0 con 0x7f97f8092020 2026-02-13T20:19:39.585 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.566+0000 7f97deffd640 10 monclient(hunting): _negotiate 2026-02-13T20:19:39.585 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.566+0000 7f97deffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:39.585 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.566+0000 7f97deffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:39.585 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.566+0000 7f97deffd640 10 monclient(hunting): my global_id is 114189 2026-02-13T20:19:39.585 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.566+0000 7f97deffd640 1 -- 10.20.193.110:0/2473399517 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97f808c570 con 0x7f97f8092020 2026-02-13T20:19:39.585 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.566+0000 7f97deffd640 1 -- 10.20.193.110:0/2473399517 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(397..397 src has 1..397) ==== 3915+0+0 (unknown 4076817378 0 0) 0x7f97e804f990 con 0x7f97f813f110 2026-02-13T20:19:39.585 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.567+0000 7f97f5d74640 10 monclient: get_auth_request con 0x7f97c403faa0 auth_method 0 2026-02-13T20:19:39.585 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.567+0000 7f97deffd640 1 -- 10.20.193.110:0/2473399517 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1894021536 0 0) 0x7f97f808c570 con 0x7f97f8092020 2026-02-13T20:19:39.585 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.567+0000 7f97deffd640 1 -- 10.20.193.110:0/2473399517 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f97f80008d0 con 0x7f97f8092020 2026-02-13T20:19:39.586 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.567+0000 7f97deffd640 1 -- 10.20.193.110:0/2473399517 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f97ec002f20 con 0x7f97f8092020 2026-02-13T20:19:39.586 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.567+0000 7f97deffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:39.586 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.567+0000 7f97deffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:19:39.586 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.567+0000 7f97deffd640 10 monclient: dump: 2026-02-13T20:19:39.586 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:39.586 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:39.586 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.586 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.586 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:39.586 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:39.586 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:39.586 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:39.586 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:39.586 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:39.586 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.567+0000 7f97deffd640 1 -- 10.20.193.110:0/2473399517 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1864174267 0 0) 0x7f97f80008d0 con 0x7f97f8092020 2026-02-13T20:19:39.586 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.567+0000 7f97deffd640 1 -- 10.20.193.110:0/2473399517 --> v1:10.20.193.110:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f97f808b450 con 0x7f97f8092020 2026-02-13T20:19:39.586 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.567+0000 7f97deffd640 1 -- 10.20.193.110:0/2473399517 <== mon.0 v1:10.20.193.110:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f97ec003320 con 0x7f97f8092020 2026-02-13T20:19:39.586 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.567+0000 7f97deffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:19:39.586 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.567+0000 7f97deffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:19:39.586 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.567+0000 7f97deffd640 1 -- 10.20.193.110:0/2473399517 >> v1:10.20.193.110:6789/0 conn(0x7f97f8092020 legacy=0x7f97f8127b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:39.586 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.567+0000 7f97deffd640 1 -- 10.20.193.110:0/2473399517 >> v1:10.20.193.110:6789/0 conn(0x7f97f8092020 legacy=0x7f97f8127b20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:19:39.586 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.571+0000 7f97fcb75640 10 start_mon_command cmd=[{"prefix": "sync_force", "yes_i_really_mean_it": true}] 2026-02-13T20:19:39.586 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.571+0000 7f97fcb75640 1 -- 10.20.193.110:0/2473399517 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f97f8058410 con 0x7f97f8128230 2026-02-13T20:19:39.586 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.571+0000 7f97deffd640 1 -- 10.20.193.110:0/2473399517 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2721656169 0 0) 0x7f97f8058410 con 0x7f97f8128230 2026-02-13T20:19:39.587 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.571+0000 7f97deffd640 10 monclient(hunting): _negotiate 2026-02-13T20:19:39.587 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.571+0000 7f97deffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:39.587 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.571+0000 7f97deffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:39.587 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.571+0000 7f97deffd640 10 monclient(hunting): my global_id is 114192 2026-02-13T20:19:39.587 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.571+0000 7f97deffd640 1 -- 10.20.193.110:0/2473399517 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97f80008d0 con 0x7f97f8128230 2026-02-13T20:19:39.587 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.572+0000 7f97deffd640 1 -- 10.20.193.110:0/2473399517 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 747089011 0 0) 0x7f97f80008d0 con 0x7f97f8128230 2026-02-13T20:19:39.587 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.572+0000 7f97deffd640 1 -- 10.20.193.110:0/2473399517 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f97f8058410 con 0x7f97f8128230 2026-02-13T20:19:39.587 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.572+0000 7f97deffd640 1 -- 10.20.193.110:0/2473399517 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f97ec003b30 con 0x7f97f8128230 2026-02-13T20:19:39.587 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.572+0000 7f97deffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:39.587 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.572+0000 7f97deffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:19:39.587 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.572+0000 7f97deffd640 10 monclient: dump: 2026-02-13T20:19:39.587 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:39.587 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:39.587 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.587 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.587 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:39.587 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:39.587 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:39.587 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:39.587 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:39.587 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:39.587 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.572+0000 7f97deffd640 1 -- 10.20.193.110:0/2473399517 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4131018094 0 0) 0x7f97f8058410 con 0x7f97f8128230 2026-02-13T20:19:39.587 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.572+0000 7f97deffd640 1 -- 10.20.193.110:0/2473399517 --> v1:10.20.193.110:6789/0 -- command(tid 2: {"prefix": "sync_force", "yes_i_really_mean_it": true}) -- 0x7f97f80561b0 con 0x7f97f8128230 2026-02-13T20:19:39.588 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.572+0000 7f97deffd640 1 -- 10.20.193.110:0/2473399517 <== mon.0 v1:10.20.193.110:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+83 (unknown 0 0 2946029456) 0x7f97ec003e30 con 0x7f97f8128230 2026-02-13T20:19:39.588 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.572+0000 7f97deffd640 10 monclient: handle_command_reply 2 [{"prefix": "sync_force", "yes_i_really_mean_it": true}] 2026-02-13T20:19:39.588 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.572+0000 7f97deffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:19:39.588 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.572+0000 7f97deffd640 1 -- 10.20.193.110:0/2473399517 >> v1:10.20.193.110:6789/0 conn(0x7f97f8128230 legacy=0x7f97f81975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:39.588 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.572+0000 7f97deffd640 1 -- 10.20.193.110:0/2473399517 >> v1:10.20.193.110:6789/0 conn(0x7f97f8128230 legacy=0x7f97f81975d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:19:39.588 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:19:39.588 INFO:teuthology.orchestra.run.trial110.stdout: "ret": 0, 2026-02-13T20:19:39.588 INFO:teuthology.orchestra.run.trial110.stdout: "msg": "forcing store sync the next time the monitor starts" 2026-02-13T20:19:39.588 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:19:39.589 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.572+0000 7f97fcb75640 1 -- 10.20.193.110:0/2473399517 >> v1:10.20.193.188:6812/1623052694 conn(0x7f97c403faa0 legacy=0x7f97c405ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:39.589 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.572+0000 7f97fcb75640 10 monclient: shutdown 2026-02-13T20:19:39.589 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.572+0000 7f97fcb75640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:19:39.589 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.572+0000 7f97fcb75640 1 -- 10.20.193.110:0/2473399517 >> v1:10.20.193.110:6790/0 conn(0x7f97f813f110 legacy=0x7f97f8194a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:39.589 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.572+0000 7f97f6d76640 1 -- 10.20.193.110:0/2473399517 reap_dead start 2026-02-13T20:19:39.589 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.572+0000 7f97f6d76640 1 -- 10.20.193.110:0/2473399517 reap_dead start 2026-02-13T20:19:39.589 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.572+0000 7f97fcb75640 1 -- 10.20.193.110:0/2473399517 shutdown_connections 2026-02-13T20:19:39.589 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.572+0000 7f97fcb75640 1 -- 10.20.193.110:0/2473399517 >> 10.20.193.110:0/2473399517 conn(0x7f97f8054e90 msgr2=0x7f97f808de90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:19:39.590 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.572+0000 7f97fcb75640 1 -- 10.20.193.110:0/2473399517 shutdown_connections 2026-02-13T20:19:39.590 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.572+0000 7f97fcb75640 1 -- 10.20.193.110:0/2473399517 wait complete. 2026-02-13T20:19:39.590 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2026-02-13T20:19:39.590 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-13T20:19:39.590 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T20:19:39.598 INFO:tasks.ceph.mon.a:Stopped 2026-02-13T20:19:39.598 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-13T20:19:39.598 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T20:19:39.703 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.702+0000 7f34c5c07640 10 monclient: get_monmap_and_config 2026-02-13T20:19:39.703 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.702+0000 7f34c5c07640 10 monclient: build_initial_monmap 2026-02-13T20:19:39.703 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.702+0000 7f34c5c07640 10 monclient: monmap: 2026-02-13T20:19:39.703 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:19:39.703 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:39.703 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:19:39.703042+0000 2026-02-13T20:19:39.703 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:19:39.703042+0000 2026-02-13T20:19:39.703 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:19:39.703 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:39.703 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:19:39.703 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:19:39.703 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:19:39.703 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:39.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.703+0000 7f34c5c07640 1 Processor -- start 2026-02-13T20:19:39.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.703+0000 7f34c5c07640 1 -- start start 2026-02-13T20:19:39.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.703+0000 7f34c5c07640 10 monclient: init 2026-02-13T20:19:39.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.703+0000 7f34c5c07640 10 monclient: _reopen_session rank -1 2026-02-13T20:19:39.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.703+0000 7f34c5c07640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:19:39.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.703+0000 7f34c5c07640 10 monclient(hunting): picked mon.noname-c con 0x7f34c01401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:19:39.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.703+0000 7f34c5c07640 10 monclient(hunting): picked mon.noname-b con 0x7f34c0092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:19:39.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.703+0000 7f34c5c07640 10 monclient(hunting): picked mon.noname-a con 0x7f34c0091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:19:39.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.703+0000 7f34c5c07640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34c008b730 con 0x7f34c0091950 2026-02-13T20:19:39.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.703+0000 7f34c5c07640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34c005c5b0 con 0x7f34c01401c0 2026-02-13T20:19:39.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.703+0000 7f34c5c07640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34c008bcf0 con 0x7f34c0092020 2026-02-13T20:19:39.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.703+0000 7f34c5c07640 10 monclient(hunting): _renew_subs 2026-02-13T20:19:39.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.703+0000 7f34c5c07640 10 monclient(hunting): authenticate will time out at 1141.393404s 2026-02-13T20:19:39.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.703+0000 7f34bffff640 1 -- >> v1:10.20.193.110:6789/0 conn(0x7f34c0091950 legacy=0x7f34c01a2a20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:19:39.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.703+0000 7f34beffd640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f34c0092020 0x7f34c01812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:37844/0 (socket says 10.20.193.110:37844) 2026-02-13T20:19:39.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.703+0000 7f34beffd640 1 -- 10.20.193.110:0/1664778741 learned_addr learned my addr 10.20.193.110:0/1664778741 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:19:39.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.703+0000 7f34be7fc640 1 -- 10.20.193.110:0/1664778741 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 886689786 0 0) 0x7f34c008bcf0 con 0x7f34c0092020 2026-02-13T20:19:39.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.703+0000 7f34be7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:19:39.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.703+0000 7f34be7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:39.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.703+0000 7f34be7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:39.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.703+0000 7f34be7fc640 10 monclient(hunting): my global_id is 94373 2026-02-13T20:19:39.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.703+0000 7f34be7fc640 1 -- 10.20.193.110:0/1664778741 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34a40035e0 con 0x7f34c0092020 2026-02-13T20:19:39.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.703+0000 7f34be7fc640 1 -- 10.20.193.110:0/1664778741 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1727808696 0 0) 0x7f34c005c5b0 con 0x7f34c01401c0 2026-02-13T20:19:39.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.703+0000 7f34be7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:19:39.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.703+0000 7f34be7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:39.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.703+0000 7f34be7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:39.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.703+0000 7f34be7fc640 10 monclient(hunting): my global_id is 4774 2026-02-13T20:19:39.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.703+0000 7f34be7fc640 1 -- 10.20.193.110:0/1664778741 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34c008bcf0 con 0x7f34c01401c0 2026-02-13T20:19:39.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.703+0000 7f34be7fc640 1 -- 10.20.193.110:0/1664778741 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1573622231 0 0) 0x7f34a40035e0 con 0x7f34c0092020 2026-02-13T20:19:39.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.703+0000 7f34be7fc640 1 -- 10.20.193.110:0/1664778741 >> v1:10.20.193.188:6789/0 conn(0x7f34c01401c0 legacy=0x7f34c0091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:39.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.703+0000 7f34be7fc640 1 -- 10.20.193.110:0/1664778741 >> v1:10.20.193.110:6789/0 conn(0x7f34c0091950 legacy=0x7f34c01a2a20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:19:39.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.703+0000 7f34be7fc640 10 monclient: _finish_hunting 0 2026-02-13T20:19:39.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.703+0000 7f34be7fc640 1 monclient: found mon.noname-b 2026-02-13T20:19:39.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.703+0000 7f34be7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:19:39.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.703+0000 7f34be7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:19:39.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.703+0000 7f34be7fc640 1 -- 10.20.193.110:0/1664778741 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34c0140590 con 0x7f34c0092020 2026-02-13T20:19:39.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.703+0000 7f34be7fc640 10 monclient: _finish_auth 0 2026-02-13T20:19:39.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.703+0000 7f34be7fc640 10 monclient: _check_auth_tickets 2026-02-13T20:19:39.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.703+0000 7f34be7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:19:39.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.703+0000 7f34be7fc640 1 -- 10.20.193.110:0/1664778741 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f34b0002dd0 con 0x7f34c0092020 2026-02-13T20:19:39.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.703+0000 7f34be7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:39.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.703+0000 7f34be7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:19:39.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.703+0000 7f34be7fc640 10 monclient: dump: 2026-02-13T20:19:39.705 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:39.705 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:39.705 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.705 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.705 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:39.705 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:39.705 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:39.705 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:39.705 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:39.705 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:39.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.703+0000 7f34c5c07640 5 monclient: authenticate success, global_id 94373 2026-02-13T20:19:39.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.703+0000 7f34c5c07640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:19:39.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.704+0000 7f34be7fc640 1 -- 10.20.193.110:0/1664778741 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f34b0003020 con 0x7f34c0092020 2026-02-13T20:19:39.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.704+0000 7f34be7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:19:39.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.704+0000 7f34be7fc640 1 -- 10.20.193.110:0/1664778741 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f34b0003430 con 0x7f34c0092020 2026-02-13T20:19:39.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.704+0000 7f34be7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:39.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.704+0000 7f34be7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:19:39.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.704+0000 7f34be7fc640 10 monclient: dump: 2026-02-13T20:19:39.706 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:39.706 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:39.706 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.706 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.706 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:39.706 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:39.706 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:39.706 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:39.706 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:39.706 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:39.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.704+0000 7f34c5c07640 10 monclient: get_monmap_and_config success 2026-02-13T20:19:39.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.704+0000 7f34c5c07640 4 set_mon_vals no callback set 2026-02-13T20:19:39.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.704+0000 7f34c5c07640 10 monclient: shutdown 2026-02-13T20:19:39.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.704+0000 7f34c5c07640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:19:39.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.704+0000 7f34c5c07640 1 -- 10.20.193.110:0/1664778741 >> v1:10.20.193.110:6790/0 conn(0x7f34c0092020 legacy=0x7f34c01812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:39.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.704+0000 7f34c5c07640 1 -- 10.20.193.110:0/1664778741 shutdown_connections 2026-02-13T20:19:39.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.704+0000 7f34c5c07640 1 -- 10.20.193.110:0/1664778741 >> 10.20.193.110:0/1664778741 conn(0x7f34c0054e90 msgr2=0x7f34c0058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:19:39.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.704+0000 7f34c5c07640 1 -- 10.20.193.110:0/1664778741 shutdown_connections 2026-02-13T20:19:39.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.704+0000 7f34c5c07640 1 -- 10.20.193.110:0/1664778741 wait complete. 2026-02-13T20:19:39.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.704+0000 7f34c5c07640 10 monclient: build_initial_monmap 2026-02-13T20:19:39.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.704+0000 7f34c5c07640 10 monclient: monmap: 2026-02-13T20:19:39.707 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:19:39.707 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:19:39.707 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:19:39.707 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:19:39.707 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:19:39.707 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:19:39.707 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:19:39.707 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:19:39.707 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:19:39.707 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:39.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.704+0000 7f34c5c07640 1 Processor -- start 2026-02-13T20:19:39.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.704+0000 7f34c5c07640 1 -- start start 2026-02-13T20:19:39.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.704+0000 7f34c5c07640 10 monclient: init 2026-02-13T20:19:39.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f34c5c07640 10 monclient: _reopen_session rank -1 2026-02-13T20:19:39.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f34c5c07640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:19:39.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f34c5c07640 10 monclient(hunting): picked mon.noname-a con 0x7f34c0091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:19:39.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f34c5c07640 10 monclient(hunting): picked mon.noname-c con 0x7f34c01401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:19:39.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f34c5c07640 10 monclient(hunting): picked mon.noname-b con 0x7f34c013ed30 addr v1:10.20.193.188:6789/0 2026-02-13T20:19:39.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f34c5c07640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34c008c410 con 0x7f34c0091950 2026-02-13T20:19:39.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f34c5c07640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34c012f780 con 0x7f34c013ed30 2026-02-13T20:19:39.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f34c5c07640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34c005d320 con 0x7f34c01401c0 2026-02-13T20:19:39.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f34c5c07640 10 monclient(hunting): _renew_subs 2026-02-13T20:19:39.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f34c5c07640 10 monclient(hunting): authenticate will time out at 1141.395189s 2026-02-13T20:19:39.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f34bf7fe640 1 -- >> v1:10.20.193.110:6789/0 conn(0x7f34c0091950 legacy=0x7f34c013e620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:19:39.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f34beffd640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f34c01401c0 0x7f34c0191790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:37846/0 (socket says 10.20.193.110:37846) 2026-02-13T20:19:39.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f34beffd640 1 -- 10.20.193.110:0/3606794785 learned_addr learned my addr 10.20.193.110:0/3606794785 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:19:39.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f349bfff640 1 -- 10.20.193.110:0/3606794785 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4274122437 0 0) 0x7f34c005d320 con 0x7f34c01401c0 2026-02-13T20:19:39.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f349bfff640 10 monclient(hunting): _negotiate 2026-02-13T20:19:39.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f349bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:39.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f349bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:39.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f349bfff640 10 monclient(hunting): my global_id is 94376 2026-02-13T20:19:39.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f349bfff640 1 -- 10.20.193.110:0/3606794785 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34900035e0 con 0x7f34c01401c0 2026-02-13T20:19:39.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f349bfff640 1 -- 10.20.193.110:0/3606794785 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 254790429 0 0) 0x7f34c012f780 con 0x7f34c013ed30 2026-02-13T20:19:39.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f349bfff640 10 monclient(hunting): _negotiate 2026-02-13T20:19:39.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f349bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:39.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f349bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:39.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f349bfff640 10 monclient(hunting): my global_id is 4777 2026-02-13T20:19:39.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f349bfff640 1 -- 10.20.193.110:0/3606794785 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34c005d320 con 0x7f34c013ed30 2026-02-13T20:19:39.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f349bfff640 1 -- 10.20.193.110:0/3606794785 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 71926352 0 0) 0x7f34900035e0 con 0x7f34c01401c0 2026-02-13T20:19:39.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f349bfff640 1 -- 10.20.193.110:0/3606794785 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f34c012f780 con 0x7f34c01401c0 2026-02-13T20:19:39.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f349bfff640 1 -- 10.20.193.110:0/3606794785 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f34b0003340 con 0x7f34c01401c0 2026-02-13T20:19:39.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f349bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:19:39.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f349bfff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:19:39.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f349bfff640 10 monclient(hunting): dump: 2026-02-13T20:19:39.708 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:39.708 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:39.708 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.708 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.708 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:39.708 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:39.708 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:39.708 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:39.708 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:39.709 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:39.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f349bfff640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:19:39.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f349bfff640 1 -- 10.20.193.110:0/3606794785 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1678174550 0 0) 0x7f34c012f780 con 0x7f34c01401c0 2026-02-13T20:19:39.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f349bfff640 1 -- 10.20.193.110:0/3606794785 >> v1:10.20.193.188:6789/0 conn(0x7f34c013ed30 legacy=0x7f34c0192eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:39.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f349bfff640 1 -- 10.20.193.110:0/3606794785 >> v1:10.20.193.110:6789/0 conn(0x7f34c0091950 legacy=0x7f34c013e620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T20:19:39.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f349bfff640 10 monclient: _finish_hunting 0 2026-02-13T20:19:39.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f349bfff640 1 monclient: found mon.c 2026-02-13T20:19:39.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f349bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:19:39.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f349bfff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:19:39.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f349bfff640 1 -- 10.20.193.110:0/3606794785 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34c012dcc0 con 0x7f34c01401c0 2026-02-13T20:19:39.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f349bfff640 10 monclient: _finish_auth 0 2026-02-13T20:19:39.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f349bfff640 10 monclient: _check_auth_tickets 2026-02-13T20:19:39.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f349bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:19:39.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f34c5c07640 5 monclient: authenticate success, global_id 94376 2026-02-13T20:19:39.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f34c5c07640 10 monclient: _renew_subs 2026-02-13T20:19:39.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f34c5c07640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:19:39.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f34c5c07640 1 -- 10.20.193.110:0/3606794785 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f34c0130020 con 0x7f34c01401c0 2026-02-13T20:19:39.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f34c5c07640 10 monclient: _renew_subs 2026-02-13T20:19:39.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f34c5c07640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:19:39.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f34c5c07640 1 -- 10.20.193.110:0/3606794785 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f34c0150660 con 0x7f34c01401c0 2026-02-13T20:19:39.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f349bfff640 1 -- 10.20.193.110:0/3606794785 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f34b0004b50 con 0x7f34c01401c0 2026-02-13T20:19:39.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f349bfff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:19:39.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f349bfff640 1 -- 10.20.193.110:0/3606794785 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f34b0004eb0 con 0x7f34c01401c0 2026-02-13T20:19:39.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f349bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:39.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f349bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:19:39.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f349bfff640 10 monclient: dump: 2026-02-13T20:19:39.709 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:39.709 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:39.709 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.709 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:39.709 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:39.709 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:39.709 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:39.709 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:39.709 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:39.709 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:39.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.705+0000 7f34bdffb640 4 set_mon_vals no callback set 2026-02-13T20:19:39.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.706+0000 7f34c5c07640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:19:39.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.706+0000 7f34c5c07640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:19:39.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.706+0000 7f34c5c07640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:19:39.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.706+0000 7f34c5c07640 1 -- 10.20.193.110:0/3606794785 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34c00008d0 con 0x7f34c01401c0 2026-02-13T20:19:39.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.706+0000 7f349bfff640 1 -- 10.20.193.110:0/3606794785 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f34b0005010 con 0x7f34c01401c0 2026-02-13T20:19:39.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.706+0000 7f349bfff640 1 -- 10.20.193.110:0/3606794785 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(397..397 src has 1..397) ==== 3915+0+0 (unknown 4076817378 0 0) 0x7f34b004eae0 con 0x7f34c01401c0 2026-02-13T20:19:39.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.706+0000 7f34bf7fe640 10 monclient: get_auth_request con 0x7f349003f730 auth_method 0 2026-02-13T20:19:39.710 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.708+0000 7f349bfff640 1 -- 10.20.193.110:0/3606794785 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f34b00172f0 con 0x7f34c01401c0 2026-02-13T20:19:39.710 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.708+0000 7f349bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:19:39.710 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.708+0000 7f349bfff640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:19:39.855 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.853+0000 7f34c5c07640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T20:19:39.855 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.853+0000 7f34c5c07640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T20:19:39.855 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.853+0000 7f34c5c07640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:19:39.855 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.853+0000 7f34c5c07640 1 -- 10.20.193.110:0/3606794785 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f34c0058410 con 0x7f34c01401c0 2026-02-13T20:19:39.855 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.854+0000 7f349bfff640 1 -- 10.20.193.110:0/3606794785 <== mon.2 v1:10.20.193.110:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 2289296567) 0x7f34b0016aa0 con 0x7f34c01401c0 2026-02-13T20:19:39.855 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.854+0000 7f349bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T20:19:39.855 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.854+0000 7f349bfff640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:19:39.856 INFO:teuthology.orchestra.run.trial110.stdout:{"election_epoch":32,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":3,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","modified":"2026-02-13T20:11:07.161192Z","created":"2026-02-13T20:11:07.161192Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6789","nonce":0}]},"addr":"10.20.193.110:6789/0","public_addr":"10.20.193.110:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161241+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6789","nonce":0}]},"addr":"10.20.193.188:6789/0","public_addr":"10.20.193.188:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161242+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6790","nonce":0}]},"addr":"10.20.193.110:6790/0","public_addr":"10.20.193.110:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161243+0000","crush_location":[]}]}} 2026-02-13T20:19:39.857 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.855+0000 7f34c5c07640 1 -- 10.20.193.110:0/3606794785 >> v1:10.20.193.188:6812/1623052694 conn(0x7f349003f730 legacy=0x7f349005fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:39.857 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.855+0000 7f34c5c07640 10 monclient: shutdown 2026-02-13T20:19:39.857 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.855+0000 7f34c5c07640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:19:39.857 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.855+0000 7f34c5c07640 1 -- 10.20.193.110:0/3606794785 >> v1:10.20.193.110:6790/0 conn(0x7f34c01401c0 legacy=0x7f34c0191790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:39.857 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.855+0000 7f34c5c07640 1 -- 10.20.193.110:0/3606794785 shutdown_connections 2026-02-13T20:19:39.857 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.855+0000 7f34c5c07640 1 -- 10.20.193.110:0/3606794785 >> 10.20.193.110:0/3606794785 conn(0x7f34c0054e90 msgr2=0x7f34c008dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:19:39.857 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.855+0000 7f34c5c07640 1 -- 10.20.193.110:0/3606794785 shutdown_connections 2026-02-13T20:19:39.857 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:39.855+0000 7f34c5c07640 1 -- 10.20.193.110:0/3606794785 wait complete. 2026-02-13T20:19:42.863 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T20:19:42.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.931+0000 7fe0cf85b640 10 monclient: get_monmap_and_config 2026-02-13T20:19:42.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.931+0000 7fe0cf85b640 10 monclient: build_initial_monmap 2026-02-13T20:19:42.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.931+0000 7fe0cf85b640 10 monclient: monmap: 2026-02-13T20:19:42.940 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:19:42.940 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:42.940 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:19:42.932702+0000 2026-02-13T20:19:42.940 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:19:42.932702+0000 2026-02-13T20:19:42.940 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:19:42.940 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:42.941 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:19:42.941 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:19:42.941 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:19:42.941 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:42.941 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.931+0000 7fe0cf85b640 1 Processor -- start 2026-02-13T20:19:42.941 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.931+0000 7fe0cf85b640 1 -- start start 2026-02-13T20:19:42.941 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.931+0000 7fe0cf85b640 10 monclient: init 2026-02-13T20:19:42.941 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.931+0000 7fe0cf85b640 10 monclient: _reopen_session rank -1 2026-02-13T20:19:42.941 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.931+0000 7fe0cf85b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:19:42.941 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.932+0000 7fe0cf85b640 10 monclient(hunting): picked mon.noname-c con 0x7fe0c81401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:19:42.941 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.932+0000 7fe0cf85b640 10 monclient(hunting): picked mon.noname-a con 0x7fe0c8092020 addr v1:10.20.193.110:6789/0 2026-02-13T20:19:42.941 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.932+0000 7fe0cf85b640 10 monclient(hunting): picked mon.noname-b con 0x7fe0c8091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:19:42.942 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.932+0000 7fe0cf85b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0c808b730 con 0x7fe0c8092020 2026-02-13T20:19:42.942 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.932+0000 7fe0cf85b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0c805c5b0 con 0x7fe0c81401c0 2026-02-13T20:19:42.942 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.932+0000 7fe0cf85b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0c808bcf0 con 0x7fe0c8091950 2026-02-13T20:19:42.942 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.932+0000 7fe0cf85b640 10 monclient(hunting): _renew_subs 2026-02-13T20:19:42.942 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.932+0000 7fe0cf85b640 10 monclient(hunting): authenticate will time out at 1144.623060s 2026-02-13T20:19:42.942 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.932+0000 7fe0ccdcf640 1 -- >> v1:10.20.193.110:6789/0 conn(0x7fe0c8092020 legacy=0x7fe0c81812f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:19:42.942 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.932+0000 7fe0cddd1640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fe0c8091950 0x7fe0c81a2a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:59648/0 (socket says 10.20.193.110:59648) 2026-02-13T20:19:42.942 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.932+0000 7fe0cddd1640 1 -- 10.20.193.110:0/359144324 learned_addr learned my addr 10.20.193.110:0/359144324 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:19:42.942 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.932+0000 7fe0b7fff640 1 -- 10.20.193.110:0/359144324 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 862912835 0 0) 0x7fe0c805c5b0 con 0x7fe0c81401c0 2026-02-13T20:19:42.942 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.932+0000 7fe0b7fff640 10 monclient(hunting): _negotiate 2026-02-13T20:19:42.942 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.932+0000 7fe0b7fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:42.942 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.932+0000 7fe0b7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:42.943 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.932+0000 7fe0b7fff640 10 monclient(hunting): my global_id is 4780 2026-02-13T20:19:42.943 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.932+0000 7fe0b7fff640 1 -- 10.20.193.110:0/359144324 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0b00035e0 con 0x7fe0c81401c0 2026-02-13T20:19:42.943 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.933+0000 7fe0b7fff640 1 -- 10.20.193.110:0/359144324 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 194827100 0 0) 0x7fe0b00035e0 con 0x7fe0c81401c0 2026-02-13T20:19:42.943 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.933+0000 7fe0b7fff640 1 -- 10.20.193.110:0/359144324 >> v1:10.20.193.110:6790/0 conn(0x7fe0c8091950 legacy=0x7fe0c81a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:42.943 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.933+0000 7fe0b7fff640 1 -- 10.20.193.110:0/359144324 >> v1:10.20.193.110:6789/0 conn(0x7fe0c8092020 legacy=0x7fe0c81812f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:19:42.943 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.933+0000 7fe0b7fff640 10 monclient: _finish_hunting 0 2026-02-13T20:19:42.943 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.933+0000 7fe0b7fff640 1 monclient: found mon.noname-c 2026-02-13T20:19:42.943 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.933+0000 7fe0b7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:19:42.943 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.933+0000 7fe0b7fff640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.188:6789/0 2026-02-13T20:19:42.943 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.933+0000 7fe0b7fff640 1 -- 10.20.193.110:0/359144324 --> v1:10.20.193.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0c8140590 con 0x7fe0c81401c0 2026-02-13T20:19:42.943 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.933+0000 7fe0b7fff640 10 monclient: _finish_auth 0 2026-02-13T20:19:42.943 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.933+0000 7fe0b7fff640 10 monclient: _check_auth_tickets 2026-02-13T20:19:42.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.933+0000 7fe0b7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:19:42.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.933+0000 7fe0b7fff640 1 -- 10.20.193.110:0/359144324 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe0b8002dd0 con 0x7fe0c81401c0 2026-02-13T20:19:42.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.933+0000 7fe0cf85b640 5 monclient: authenticate success, global_id 4780 2026-02-13T20:19:42.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.933+0000 7fe0cf85b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:19:42.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.933+0000 7fe0b7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:42.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.933+0000 7fe0b7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:19:42.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.933+0000 7fe0b7fff640 10 monclient: dump: 2026-02-13T20:19:42.944 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:42.944 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:42.944 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:42.944 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:42.944 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:42.945 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:42.945 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:42.945 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:42.945 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:42.945 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:42.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.933+0000 7fe0cf85b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:19:42.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.933+0000 7fe0b7fff640 1 -- 10.20.193.110:0/359144324 <== mon.1 v1:10.20.193.188:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe0b8002fa0 con 0x7fe0c81401c0 2026-02-13T20:19:42.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.933+0000 7fe0b7fff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:19:42.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.933+0000 7fe0cf85b640 10 monclient: get_monmap_and_config success 2026-02-13T20:19:42.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.933+0000 7fe0cf85b640 4 set_mon_vals no callback set 2026-02-13T20:19:42.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.933+0000 7fe0b7fff640 1 -- 10.20.193.110:0/359144324 <== mon.1 v1:10.20.193.188:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe0b80033b0 con 0x7fe0c81401c0 2026-02-13T20:19:42.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.933+0000 7fe0b7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:42.946 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.933+0000 7fe0b7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:19:42.946 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.933+0000 7fe0b7fff640 10 monclient: dump: 2026-02-13T20:19:42.946 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:42.946 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:42.946 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:42.946 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:42.946 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:42.946 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:42.946 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:42.946 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:42.946 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:42.946 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:42.947 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.933+0000 7fe0cf85b640 10 monclient: shutdown 2026-02-13T20:19:42.947 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.933+0000 7fe0cf85b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:19:42.947 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.933+0000 7fe0cf85b640 1 -- 10.20.193.110:0/359144324 >> v1:10.20.193.188:6789/0 conn(0x7fe0c81401c0 legacy=0x7fe0c8091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:42.947 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.933+0000 7fe0cf85b640 1 -- 10.20.193.110:0/359144324 shutdown_connections 2026-02-13T20:19:42.947 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.933+0000 7fe0cf85b640 1 -- 10.20.193.110:0/359144324 >> 10.20.193.110:0/359144324 conn(0x7fe0c8054e90 msgr2=0x7fe0c8058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:19:42.947 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.933+0000 7fe0cf85b640 1 -- 10.20.193.110:0/359144324 shutdown_connections 2026-02-13T20:19:42.947 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.933+0000 7fe0cf85b640 1 -- 10.20.193.110:0/359144324 wait complete. 2026-02-13T20:19:42.947 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.933+0000 7fe0cf85b640 10 monclient: build_initial_monmap 2026-02-13T20:19:42.947 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.933+0000 7fe0cf85b640 10 monclient: monmap: 2026-02-13T20:19:42.947 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:19:42.947 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:19:42.947 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:19:42.947 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:19:42.948 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:19:42.948 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:19:42.948 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:19:42.948 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:19:42.948 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:19:42.948 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:42.948 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.934+0000 7fe0cf85b640 1 Processor -- start 2026-02-13T20:19:42.948 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.934+0000 7fe0cf85b640 1 -- start start 2026-02-13T20:19:42.948 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.934+0000 7fe0cf85b640 10 monclient: init 2026-02-13T20:19:42.948 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.934+0000 7fe0cf85b640 10 monclient: _reopen_session rank -1 2026-02-13T20:19:42.948 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.934+0000 7fe0cf85b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:19:42.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.934+0000 7fe0cf85b640 10 monclient(hunting): picked mon.noname-a con 0x7fe0c8091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:19:42.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.934+0000 7fe0cf85b640 10 monclient(hunting): picked mon.noname-b con 0x7fe0c81401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:19:42.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.934+0000 7fe0cf85b640 10 monclient(hunting): picked mon.noname-c con 0x7fe0c8152e40 addr v1:10.20.193.110:6790/0 2026-02-13T20:19:42.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.934+0000 7fe0cf85b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0c805d320 con 0x7fe0c8091950 2026-02-13T20:19:42.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.934+0000 7fe0cf85b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0c812e7e0 con 0x7fe0c81401c0 2026-02-13T20:19:42.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.934+0000 7fe0cd5d0640 1 -- >> v1:10.20.193.110:6789/0 conn(0x7fe0c8091950 legacy=0x7fe0c813d6e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:19:42.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.934+0000 7fe0cf85b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0c813e850 con 0x7fe0c8152e40 2026-02-13T20:19:42.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.934+0000 7fe0cf85b640 10 monclient(hunting): _renew_subs 2026-02-13T20:19:42.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.934+0000 7fe0cf85b640 10 monclient(hunting): authenticate will time out at 1144.625583s 2026-02-13T20:19:42.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.934+0000 7fe0cddd1640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fe0c8152e40 0x7fe0c8194aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:59660/0 (socket says 10.20.193.110:59660) 2026-02-13T20:19:42.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.934+0000 7fe0cddd1640 1 -- 10.20.193.110:0/2875220461 learned_addr learned my addr 10.20.193.110:0/2875220461 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:19:42.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.935+0000 7fe0b5ffb640 1 -- 10.20.193.110:0/2875220461 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1497664330 0 0) 0x7fe0bc003b00 con 0x7fe0c81401c0 2026-02-13T20:19:42.950 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.935+0000 7fe0b5ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:19:42.950 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.935+0000 7fe0b5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:42.950 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.935+0000 7fe0b5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:42.950 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.935+0000 7fe0b5ffb640 10 monclient(hunting): my global_id is 4783 2026-02-13T20:19:42.950 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.935+0000 7fe0b5ffb640 1 -- 10.20.193.110:0/2875220461 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0980035e0 con 0x7fe0c81401c0 2026-02-13T20:19:42.950 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.935+0000 7fe0b5ffb640 1 -- 10.20.193.110:0/2875220461 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1252199199 0 0) 0x7fe0980035e0 con 0x7fe0c81401c0 2026-02-13T20:19:42.950 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.935+0000 7fe0b5ffb640 1 -- 10.20.193.110:0/2875220461 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe0bc003b00 con 0x7fe0c81401c0 2026-02-13T20:19:42.950 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.935+0000 7fe0b5ffb640 1 -- 10.20.193.110:0/2875220461 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe0bc0042d0 con 0x7fe0c81401c0 2026-02-13T20:19:42.950 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.935+0000 7fe0b5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:19:42.950 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.935+0000 7fe0b5ffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:19:42.950 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.935+0000 7fe0b5ffb640 10 monclient(hunting): dump: 2026-02-13T20:19:42.950 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:42.951 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:42.951 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:42.951 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:42.951 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:42.951 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:42.951 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:42.951 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:42.951 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:42.951 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:42.951 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.935+0000 7fe0b5ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:19:42.952 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.935+0000 7fe0b5ffb640 1 -- 10.20.193.110:0/2875220461 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1340425294 0 0) 0x7fe0bc003b00 con 0x7fe0c81401c0 2026-02-13T20:19:42.952 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.935+0000 7fe0b5ffb640 1 -- 10.20.193.110:0/2875220461 >> v1:10.20.193.110:6790/0 conn(0x7fe0c8152e40 legacy=0x7fe0c8194aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:42.952 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.935+0000 7fe0b5ffb640 1 -- 10.20.193.110:0/2875220461 >> v1:10.20.193.110:6789/0 conn(0x7fe0c8091950 legacy=0x7fe0c813d6e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T20:19:42.952 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.935+0000 7fe0b5ffb640 10 monclient: _finish_hunting 0 2026-02-13T20:19:42.952 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.935+0000 7fe0b5ffb640 1 monclient: found mon.b 2026-02-13T20:19:42.952 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.935+0000 7fe0b5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:19:42.952 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.935+0000 7fe0b5ffb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:19:42.952 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.935+0000 7fe0b5ffb640 1 -- 10.20.193.110:0/2875220461 --> v1:10.20.193.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0c812eda0 con 0x7fe0c81401c0 2026-02-13T20:19:42.952 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.935+0000 7fe0b5ffb640 10 monclient: _finish_auth 0 2026-02-13T20:19:42.952 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.935+0000 7fe0b5ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:19:42.953 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.935+0000 7fe0b5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:19:42.953 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.935+0000 7fe0cf85b640 5 monclient: authenticate success, global_id 4783 2026-02-13T20:19:42.953 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.935+0000 7fe0cf85b640 10 monclient: _renew_subs 2026-02-13T20:19:42.953 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.935+0000 7fe0cf85b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:19:42.953 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.935+0000 7fe0cf85b640 1 -- 10.20.193.110:0/2875220461 --> v1:10.20.193.188:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe0c8131100 con 0x7fe0c81401c0 2026-02-13T20:19:42.953 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.935+0000 7fe0cf85b640 10 monclient: _renew_subs 2026-02-13T20:19:42.953 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.935+0000 7fe0cf85b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:19:42.953 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.935+0000 7fe0cf85b640 1 -- 10.20.193.110:0/2875220461 --> v1:10.20.193.188:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe0c81961c0 con 0x7fe0c81401c0 2026-02-13T20:19:42.953 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.935+0000 7fe0b5ffb640 1 -- 10.20.193.110:0/2875220461 <== mon.1 v1:10.20.193.188:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe0bc004510 con 0x7fe0c81401c0 2026-02-13T20:19:42.953 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.935+0000 7fe0b5ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T20:19:42.954 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.935+0000 7fe0b77fe640 4 set_mon_vals no callback set 2026-02-13T20:19:42.954 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.935+0000 7fe0b5ffb640 1 -- 10.20.193.110:0/2875220461 <== mon.1 v1:10.20.193.188:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe0bc0048f0 con 0x7fe0c81401c0 2026-02-13T20:19:42.954 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.935+0000 7fe0b5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:42.954 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.935+0000 7fe0b5ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:19:42.954 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.935+0000 7fe0b5ffb640 10 monclient: dump: 2026-02-13T20:19:42.954 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:42.954 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:42.954 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:42.954 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:42.954 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:42.954 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:42.955 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:42.955 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:42.955 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:42.955 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:42.955 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.935+0000 7fe0cf85b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:19:42.955 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.935+0000 7fe0cf85b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:19:42.955 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.935+0000 7fe0cf85b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:19:42.955 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.935+0000 7fe0cf85b640 1 -- 10.20.193.110:0/2875220461 --> v1:10.20.193.188:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0c80008d0 con 0x7fe0c81401c0 2026-02-13T20:19:42.955 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.936+0000 7fe0b5ffb640 1 -- 10.20.193.110:0/2875220461 <== mon.1 v1:10.20.193.188:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fe0bc004ad0 con 0x7fe0c81401c0 2026-02-13T20:19:42.955 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.936+0000 7fe0b5ffb640 1 -- 10.20.193.110:0/2875220461 <== mon.1 v1:10.20.193.188:6789/0 8 ==== osd_map(397..397 src has 1..397) ==== 3915+0+0 (unknown 4076817378 0 0) 0x7fe0bc04e870 con 0x7fe0c81401c0 2026-02-13T20:19:42.955 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.936+0000 7fe0cd5d0640 10 monclient: get_auth_request con 0x7fe09803f610 auth_method 0 2026-02-13T20:19:42.956 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.938+0000 7fe0b5ffb640 1 -- 10.20.193.110:0/2875220461 <== mon.1 v1:10.20.193.188:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fe0bc016f60 con 0x7fe0c81401c0 2026-02-13T20:19:42.956 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.938+0000 7fe0b5ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:19:42.956 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:42.938+0000 7fe0b5ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:19:43.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:43.090+0000 7fe0cf85b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T20:19:43.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:43.090+0000 7fe0cf85b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T20:19:43.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:43.090+0000 7fe0cf85b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:19:43.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:43.090+0000 7fe0cf85b640 1 -- 10.20.193.110:0/2875220461 --> v1:10.20.193.188:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe0c812e7e0 con 0x7fe0c81401c0 2026-02-13T20:19:43.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:43.090+0000 7fe0b5ffb640 1 -- 10.20.193.110:0/2875220461 <== mon.1 v1:10.20.193.188:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 3243801943) 0x7fe0bc04b630 con 0x7fe0c81401c0 2026-02-13T20:19:43.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:43.090+0000 7fe0b5ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T20:19:43.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:43.090+0000 7fe0b5ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:19:43.092 INFO:teuthology.orchestra.run.trial110.stdout:{"election_epoch":32,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":6,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","modified":"2026-02-13T20:11:07.161192Z","created":"2026-02-13T20:11:07.161192Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6789","nonce":0}]},"addr":"10.20.193.110:6789/0","public_addr":"10.20.193.110:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161241+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6789","nonce":0}]},"addr":"10.20.193.188:6789/0","public_addr":"10.20.193.188:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161242+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6790","nonce":0}]},"addr":"10.20.193.110:6790/0","public_addr":"10.20.193.110:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161243+0000","crush_location":[]}]}} 2026-02-13T20:19:43.093 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:43.091+0000 7fe0cf85b640 1 -- 10.20.193.110:0/2875220461 >> v1:10.20.193.188:6812/1623052694 conn(0x7fe09803f610 legacy=0x7fe09805fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:43.093 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:43.091+0000 7fe0cf85b640 10 monclient: shutdown 2026-02-13T20:19:43.093 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:43.091+0000 7fe0cf85b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:19:43.093 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:43.091+0000 7fe0cf85b640 1 -- 10.20.193.110:0/2875220461 >> v1:10.20.193.188:6789/0 conn(0x7fe0c81401c0 legacy=0x7fe0c8152730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:43.093 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:43.091+0000 7fe0cf85b640 1 -- 10.20.193.110:0/2875220461 shutdown_connections 2026-02-13T20:19:43.093 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:43.091+0000 7fe0cf85b640 1 -- 10.20.193.110:0/2875220461 >> 10.20.193.110:0/2875220461 conn(0x7fe0c8054e90 msgr2=0x7fe0c8090620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:19:43.093 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:43.091+0000 7fe0cf85b640 1 -- 10.20.193.110:0/2875220461 shutdown_connections 2026-02-13T20:19:43.093 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:43.092+0000 7fe0cf85b640 1 -- 10.20.193.110:0/2875220461 wait complete. 2026-02-13T20:19:46.101 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T20:19:46.168 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:46.165+0000 7fbd79fdd640 10 monclient: get_monmap_and_config 2026-02-13T20:19:46.168 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:46.165+0000 7fbd79fdd640 10 monclient: build_initial_monmap 2026-02-13T20:19:46.168 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:46.165+0000 7fbd79fdd640 10 monclient: monmap: 2026-02-13T20:19:46.169 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:19:46.169 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:46.169 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:19:46.166856+0000 2026-02-13T20:19:46.169 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:19:46.166856+0000 2026-02-13T20:19:46.169 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:19:46.169 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:46.169 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:19:46.169 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:19:46.169 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:19:46.169 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:46.169 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:46.165+0000 7fbd79fdd640 1 Processor -- start 2026-02-13T20:19:46.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:46.165+0000 7fbd79fdd640 1 -- start start 2026-02-13T20:19:46.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:46.165+0000 7fbd79fdd640 10 monclient: init 2026-02-13T20:19:46.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:46.166+0000 7fbd79fdd640 10 monclient: _reopen_session rank -1 2026-02-13T20:19:46.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:46.166+0000 7fbd79fdd640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:19:46.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:46.166+0000 7fbd79fdd640 10 monclient(hunting): picked mon.noname-a con 0x7fbd741401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:19:46.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:46.166+0000 7fbd79fdd640 10 monclient(hunting): picked mon.noname-c con 0x7fbd74092020 addr v1:10.20.193.188:6789/0 2026-02-13T20:19:46.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:46.166+0000 7fbd79fdd640 10 monclient(hunting): picked mon.noname-b con 0x7fbd74091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:19:46.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:46.166+0000 7fbd79fdd640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd7408b730 con 0x7fbd741401c0 2026-02-13T20:19:46.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:46.166+0000 7fbd79fdd640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd7405c5b0 con 0x7fbd74092020 2026-02-13T20:19:46.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:46.166+0000 7fbd79fdd640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd7408bcf0 con 0x7fbd74091950 2026-02-13T20:19:46.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:46.166+0000 7fbd79fdd640 10 monclient(hunting): _renew_subs 2026-02-13T20:19:46.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:46.166+0000 7fbd79fdd640 10 monclient(hunting): authenticate will time out at 1147.857187s 2026-02-13T20:19:46.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:46.166+0000 7fbd737fe640 1 -- >> v1:10.20.193.110:6789/0 conn(0x7fbd741401c0 legacy=0x7fbd74091240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:19:46.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:46.166+0000 7fbd73fff640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fbd74091950 0x7fbd741a2a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:59664/0 (socket says 10.20.193.110:59664) 2026-02-13T20:19:46.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:46.166+0000 7fbd73fff640 1 -- 10.20.193.110:0/2420112564 learned_addr learned my addr 10.20.193.110:0/2420112564 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:19:46.368 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:46.367+0000 7fbd737fe640 1 -- 10.20.193.110:0/2420112564 >> v1:10.20.193.110:6789/0 conn(0x7fbd741401c0 legacy=0x7fbd74091240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:19:46.769 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:46.768+0000 7fbd737fe640 1 -- 10.20.193.110:0/2420112564 >> v1:10.20.193.110:6789/0 conn(0x7fbd741401c0 legacy=0x7fbd74091240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:19:47.570 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:47.569+0000 7fbd737fe640 1 -- 10.20.193.110:0/2420112564 >> v1:10.20.193.110:6789/0 conn(0x7fbd741401c0 legacy=0x7fbd74091240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:19:49.169 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:49.166+0000 7fbd717fa640 10 monclient(hunting): tick 2026-02-13T20:19:49.169 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:49.166+0000 7fbd717fa640 10 monclient(hunting): _check_auth_tickets 2026-02-13T20:19:49.169 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:49.166+0000 7fbd717fa640 1 monclient(hunting): continuing hunt 2026-02-13T20:19:49.169 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:49.166+0000 7fbd717fa640 10 monclient(hunting): _reopen_session rank -1 2026-02-13T20:19:49.169 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:49.166+0000 7fbd717fa640 1 -- 10.20.193.110:0/2420112564 >> v1:10.20.193.110:6790/0 conn(0x7fbd74091950 legacy=0x7fbd741a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:49.169 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:49.166+0000 7fbd717fa640 1 -- 10.20.193.110:0/2420112564 >> v1:10.20.193.188:6789/0 conn(0x7fbd74092020 legacy=0x7fbd741812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:49.169 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:49.166+0000 7fbd717fa640 1 -- 10.20.193.110:0/2420112564 >> v1:10.20.193.110:6789/0 conn(0x7fbd741401c0 legacy=0x7fbd74091240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:19:49.169 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:49.166+0000 7fbd717fa640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:19:49.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:49.166+0000 7fbd717fa640 10 monclient(hunting): picked mon.noname-b con 0x7fbd74091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:19:49.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:49.166+0000 7fbd717fa640 10 monclient(hunting): picked mon.noname-a con 0x7fbd741401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:19:49.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:49.166+0000 7fbd717fa640 10 monclient(hunting): picked mon.noname-c con 0x7fbd500466a0 addr v1:10.20.193.188:6789/0 2026-02-13T20:19:49.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:49.166+0000 7fbd717fa640 1 -- 10.20.193.110:0/2420112564 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd74140590 con 0x7fbd741401c0 2026-02-13T20:19:49.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:49.166+0000 7fbd717fa640 1 -- 10.20.193.110:0/2420112564 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd7408b730 con 0x7fbd500466a0 2026-02-13T20:19:49.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:49.166+0000 7fbd72ffd640 1 -- 10.20.193.110:0/2420112564 >> v1:10.20.193.110:6789/0 conn(0x7fbd741401c0 legacy=0x7fbd50044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:19:49.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:49.166+0000 7fbd717fa640 1 -- 10.20.193.110:0/2420112564 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd5006a350 con 0x7fbd74091950 2026-02-13T20:19:49.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:49.166+0000 7fbd717fa640 10 monclient(hunting): _renew_subs 2026-02-13T20:19:49.369 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:49.368+0000 7fbd72ffd640 1 -- 10.20.193.110:0/2420112564 >> v1:10.20.193.110:6789/0 conn(0x7fbd741401c0 legacy=0x7fbd50044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:19:49.770 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:49.769+0000 7fbd72ffd640 1 -- 10.20.193.110:0/2420112564 >> v1:10.20.193.110:6789/0 conn(0x7fbd741401c0 legacy=0x7fbd50044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:19:50.571 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:50.570+0000 7fbd72ffd640 1 -- 10.20.193.110:0/2420112564 >> v1:10.20.193.110:6789/0 conn(0x7fbd741401c0 legacy=0x7fbd50044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:19:52.169 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:52.167+0000 7fbd717fa640 10 monclient(hunting): tick 2026-02-13T20:19:52.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:52.167+0000 7fbd717fa640 10 monclient(hunting): _check_auth_tickets 2026-02-13T20:19:52.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:52.167+0000 7fbd717fa640 1 monclient(hunting): continuing hunt 2026-02-13T20:19:52.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:52.167+0000 7fbd717fa640 10 monclient(hunting): _reopen_session rank -1 2026-02-13T20:19:52.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:52.167+0000 7fbd717fa640 1 -- 10.20.193.110:0/2420112564 >> v1:10.20.193.110:6790/0 conn(0x7fbd74091950 legacy=0x7fbd50023790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:52.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:52.167+0000 7fbd717fa640 1 -- 10.20.193.110:0/2420112564 >> v1:10.20.193.188:6789/0 conn(0x7fbd500466a0 legacy=0x7fbd50066b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:52.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:52.167+0000 7fbd717fa640 1 -- 10.20.193.110:0/2420112564 >> v1:10.20.193.110:6789/0 conn(0x7fbd741401c0 legacy=0x7fbd50044f60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:19:52.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:52.167+0000 7fbd717fa640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:19:52.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:52.167+0000 7fbd717fa640 10 monclient(hunting): picked mon.noname-b con 0x7fbd74091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:19:52.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:52.167+0000 7fbd717fa640 10 monclient(hunting): picked mon.noname-a con 0x7fbd741401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:19:52.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:52.167+0000 7fbd717fa640 10 monclient(hunting): picked mon.noname-c con 0x7fbd500466a0 addr v1:10.20.193.188:6789/0 2026-02-13T20:19:52.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:52.167+0000 7fbd717fa640 1 -- 10.20.193.110:0/2420112564 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd5006b610 con 0x7fbd741401c0 2026-02-13T20:19:52.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:52.167+0000 7fbd717fa640 1 -- 10.20.193.110:0/2420112564 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd74140590 con 0x7fbd500466a0 2026-02-13T20:19:52.172 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:52.167+0000 7fbd717fa640 1 -- 10.20.193.110:0/2420112564 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd50066c00 con 0x7fbd74091950 2026-02-13T20:19:52.172 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:52.167+0000 7fbd717fa640 10 monclient(hunting): _renew_subs 2026-02-13T20:19:52.172 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:52.167+0000 7fbd72ffd640 1 -- 10.20.193.110:0/2420112564 >> v1:10.20.193.110:6789/0 conn(0x7fbd741401c0 legacy=0x7fbd50044f00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:19:52.369 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:52.368+0000 7fbd72ffd640 1 -- 10.20.193.110:0/2420112564 >> v1:10.20.193.110:6789/0 conn(0x7fbd741401c0 legacy=0x7fbd50044f00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:19:52.770 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:52.769+0000 7fbd72ffd640 1 -- 10.20.193.110:0/2420112564 >> v1:10.20.193.110:6789/0 conn(0x7fbd741401c0 legacy=0x7fbd50044f00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:19:53.571 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:53.570+0000 7fbd72ffd640 1 -- 10.20.193.110:0/2420112564 >> v1:10.20.193.110:6789/0 conn(0x7fbd741401c0 legacy=0x7fbd50044f00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:19:54.131 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.129+0000 7fbd727fc640 1 -- 10.20.193.110:0/2420112564 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2355817162 0 0) 0x7fbd50066c00 con 0x7fbd74091950 2026-02-13T20:19:54.132 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.129+0000 7fbd727fc640 10 monclient(hunting): _negotiate 2026-02-13T20:19:54.132 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.129+0000 7fbd727fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:54.132 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.129+0000 7fbd727fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:54.132 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.129+0000 7fbd727fc640 10 monclient(hunting): my global_id is 94379 2026-02-13T20:19:54.132 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.129+0000 7fbd727fc640 1 -- 10.20.193.110:0/2420112564 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd580035e0 con 0x7fbd74091950 2026-02-13T20:19:54.133 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.131+0000 7fbd727fc640 1 -- 10.20.193.110:0/2420112564 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3497397623 0 0) 0x7fbd74140590 con 0x7fbd500466a0 2026-02-13T20:19:54.133 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.131+0000 7fbd727fc640 10 monclient(hunting): _negotiate 2026-02-13T20:19:54.133 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.131+0000 7fbd727fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:54.133 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.131+0000 7fbd727fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:54.133 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.131+0000 7fbd727fc640 10 monclient(hunting): my global_id is 4786 2026-02-13T20:19:54.133 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.131+0000 7fbd727fc640 1 -- 10.20.193.110:0/2420112564 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd50066c00 con 0x7fbd500466a0 2026-02-13T20:19:54.141 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.132+0000 7fbd727fc640 1 -- 10.20.193.110:0/2420112564 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4244702203 0 0) 0x7fbd50066c00 con 0x7fbd500466a0 2026-02-13T20:19:54.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.132+0000 7fbd727fc640 1 -- 10.20.193.110:0/2420112564 >> v1:10.20.193.110:6790/0 conn(0x7fbd74091950 legacy=0x7fbd50023750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:54.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.132+0000 7fbd727fc640 1 -- 10.20.193.110:0/2420112564 >> v1:10.20.193.110:6789/0 conn(0x7fbd741401c0 legacy=0x7fbd50044f00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:19:54.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.132+0000 7fbd727fc640 10 monclient: _finish_hunting 0 2026-02-13T20:19:54.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.132+0000 7fbd727fc640 1 monclient: found mon.noname-c 2026-02-13T20:19:54.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.132+0000 7fbd727fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:19:54.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.132+0000 7fbd727fc640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.188:6789/0 2026-02-13T20:19:54.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.132+0000 7fbd727fc640 1 -- 10.20.193.110:0/2420112564 --> v1:10.20.193.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd50066e30 con 0x7fbd500466a0 2026-02-13T20:19:54.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.132+0000 7fbd727fc640 10 monclient: _finish_auth 0 2026-02-13T20:19:54.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.132+0000 7fbd727fc640 10 monclient: _check_auth_tickets 2026-02-13T20:19:54.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.132+0000 7fbd727fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:19:54.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.132+0000 7fbd79fdd640 5 monclient: authenticate success, global_id 4786 2026-02-13T20:19:54.143 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.132+0000 7fbd79fdd640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:19:54.143 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.132+0000 7fbd727fc640 1 -- 10.20.193.110:0/2420112564 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fbd68003d80 con 0x7fbd500466a0 2026-02-13T20:19:54.143 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.132+0000 7fbd727fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:54.143 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.132+0000 7fbd727fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:19:54.143 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.132+0000 7fbd727fc640 10 monclient: dump: 2026-02-13T20:19:54.143 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:54.143 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:54.143 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:54.143 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:54.143 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:54.143 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:54.143 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:54.144 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:54.144 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:54.144 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:54.144 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.132+0000 7fbd79fdd640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:19:54.144 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.132+0000 7fbd727fc640 1 -- 10.20.193.110:0/2420112564 <== mon.1 v1:10.20.193.188:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbd68004000 con 0x7fbd500466a0 2026-02-13T20:19:54.144 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.132+0000 7fbd727fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:19:54.144 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.132+0000 7fbd727fc640 1 -- 10.20.193.110:0/2420112564 <== mon.1 v1:10.20.193.188:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fbd680043d0 con 0x7fbd500466a0 2026-02-13T20:19:54.144 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.132+0000 7fbd727fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:54.144 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.132+0000 7fbd727fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:19:54.144 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.132+0000 7fbd727fc640 10 monclient: dump: 2026-02-13T20:19:54.144 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:54.144 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:54.145 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:54.145 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:54.145 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:54.145 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:54.145 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:54.145 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:54.145 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:54.145 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:54.145 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.132+0000 7fbd79fdd640 10 monclient: get_monmap_and_config success 2026-02-13T20:19:54.145 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.132+0000 7fbd79fdd640 4 set_mon_vals no callback set 2026-02-13T20:19:54.145 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.133+0000 7fbd79fdd640 10 monclient: shutdown 2026-02-13T20:19:54.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.133+0000 7fbd79fdd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:19:54.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.133+0000 7fbd79fdd640 1 -- 10.20.193.110:0/2420112564 >> v1:10.20.193.188:6789/0 conn(0x7fbd500466a0 legacy=0x7fbd500693b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:54.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.133+0000 7fbd79fdd640 1 -- 10.20.193.110:0/2420112564 shutdown_connections 2026-02-13T20:19:54.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.133+0000 7fbd79fdd640 1 -- 10.20.193.110:0/2420112564 >> 10.20.193.110:0/2420112564 conn(0x7fbd74054e90 msgr2=0x7fbd74058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:19:54.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.133+0000 7fbd79fdd640 1 -- 10.20.193.110:0/2420112564 shutdown_connections 2026-02-13T20:19:54.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.133+0000 7fbd79fdd640 1 -- 10.20.193.110:0/2420112564 wait complete. 2026-02-13T20:19:54.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.133+0000 7fbd79fdd640 10 monclient: build_initial_monmap 2026-02-13T20:19:54.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.133+0000 7fbd79fdd640 10 monclient: monmap: 2026-02-13T20:19:54.146 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:19:54.146 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:19:54.146 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:19:54.146 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:19:54.147 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:19:54.147 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:19:54.147 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:19:54.147 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:19:54.147 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:19:54.147 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:54.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.133+0000 7fbd79fdd640 1 Processor -- start 2026-02-13T20:19:54.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.133+0000 7fbd79fdd640 1 -- start start 2026-02-13T20:19:54.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.133+0000 7fbd79fdd640 10 monclient: init 2026-02-13T20:19:54.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.133+0000 7fbd79fdd640 10 monclient: _reopen_session rank -1 2026-02-13T20:19:54.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.133+0000 7fbd79fdd640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:19:54.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd79fdd640 10 monclient(hunting): picked mon.noname-b con 0x7fbd500466a0 addr v1:10.20.193.188:6789/0 2026-02-13T20:19:54.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd79fdd640 10 monclient(hunting): picked mon.noname-c con 0x7fbd74091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:19:54.148 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd79fdd640 10 monclient(hunting): picked mon.noname-a con 0x7fbd741401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:19:54.148 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd79fdd640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd7413f9e0 con 0x7fbd741401c0 2026-02-13T20:19:54.148 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd79fdd640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd7405d320 con 0x7fbd500466a0 2026-02-13T20:19:54.148 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd79fdd640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd7408a7b0 con 0x7fbd74091950 2026-02-13T20:19:54.148 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd79fdd640 10 monclient(hunting): _renew_subs 2026-02-13T20:19:54.148 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd79fdd640 10 monclient(hunting): authenticate will time out at 1155.825052s 2026-02-13T20:19:54.148 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd73fff640 1 -- >> v1:10.20.193.110:6789/0 conn(0x7fbd741401c0 legacy=0x7fbd7423b4a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:19:54.148 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd72ffd640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fbd74091950 0x7fbd7413e2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:51250/0 (socket says 10.20.193.110:51250) 2026-02-13T20:19:54.148 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd72ffd640 1 -- 10.20.193.110:0/2439189325 learned_addr learned my addr 10.20.193.110:0/2439189325 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:19:54.148 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd4ffff640 1 -- 10.20.193.110:0/2439189325 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3802166630 0 0) 0x7fbd7408a7b0 con 0x7fbd74091950 2026-02-13T20:19:54.148 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd4ffff640 10 monclient(hunting): _negotiate 2026-02-13T20:19:54.148 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd4ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:54.148 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd4ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:54.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd4ffff640 10 monclient(hunting): my global_id is 94382 2026-02-13T20:19:54.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd4ffff640 1 -- 10.20.193.110:0/2439189325 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd440035e0 con 0x7fbd74091950 2026-02-13T20:19:54.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd4ffff640 1 -- 10.20.193.110:0/2439189325 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2950741580 0 0) 0x7fbd7405d320 con 0x7fbd500466a0 2026-02-13T20:19:54.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd4ffff640 10 monclient(hunting): _negotiate 2026-02-13T20:19:54.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd4ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:54.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd4ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:54.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd4ffff640 10 monclient(hunting): my global_id is 4789 2026-02-13T20:19:54.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd4ffff640 1 -- 10.20.193.110:0/2439189325 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd7408a7b0 con 0x7fbd500466a0 2026-02-13T20:19:54.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd4ffff640 1 -- 10.20.193.110:0/2439189325 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 559295739 0 0) 0x7fbd440035e0 con 0x7fbd74091950 2026-02-13T20:19:54.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd4ffff640 1 -- 10.20.193.110:0/2439189325 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbd7405d320 con 0x7fbd74091950 2026-02-13T20:19:54.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd4ffff640 1 -- 10.20.193.110:0/2439189325 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fbd640030f0 con 0x7fbd74091950 2026-02-13T20:19:54.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd4ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:19:54.150 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd4ffff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:19:54.150 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd4ffff640 10 monclient(hunting): dump: 2026-02-13T20:19:54.150 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:54.150 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:54.150 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:54.150 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:54.150 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:54.150 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:54.150 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:54.150 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:54.150 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:54.150 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:54.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd4ffff640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:19:54.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd4ffff640 1 -- 10.20.193.110:0/2439189325 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 416359881 0 0) 0x7fbd7408a7b0 con 0x7fbd500466a0 2026-02-13T20:19:54.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd4ffff640 1 -- 10.20.193.110:0/2439189325 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbd440035e0 con 0x7fbd500466a0 2026-02-13T20:19:54.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd4ffff640 1 -- 10.20.193.110:0/2439189325 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fbd600042b0 con 0x7fbd500466a0 2026-02-13T20:19:54.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd4ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:19:54.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd4ffff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-13T20:19:54.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd4ffff640 10 monclient(hunting): dump: 2026-02-13T20:19:54.151 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:54.151 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:54.151 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:54.151 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:54.151 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:54.151 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:54.152 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:54.152 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:54.152 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:54.152 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:54.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd4ffff640 1 -- 10.20.193.110:0/2439189325 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3919876848 0 0) 0x7fbd7405d320 con 0x7fbd74091950 2026-02-13T20:19:54.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd4ffff640 1 -- 10.20.193.110:0/2439189325 >> v1:10.20.193.188:6789/0 conn(0x7fbd500466a0 legacy=0x7fbd741d9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:54.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd4ffff640 1 -- 10.20.193.110:0/2439189325 >> v1:10.20.193.110:6789/0 conn(0x7fbd741401c0 legacy=0x7fbd7423b4a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T20:19:54.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd4ffff640 10 monclient: _finish_hunting 0 2026-02-13T20:19:54.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd4ffff640 1 monclient: found mon.c 2026-02-13T20:19:54.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd4ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:19:54.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd4ffff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:19:54.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd4ffff640 1 -- 10.20.193.110:0/2439189325 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd74130670 con 0x7fbd74091950 2026-02-13T20:19:54.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd4ffff640 10 monclient: _finish_auth 0 2026-02-13T20:19:54.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd4ffff640 10 monclient: _check_auth_tickets 2026-02-13T20:19:54.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd4ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:19:54.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd79fdd640 5 monclient: authenticate success, global_id 94382 2026-02-13T20:19:54.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd79fdd640 10 monclient: _renew_subs 2026-02-13T20:19:54.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd79fdd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:19:54.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd79fdd640 1 -- 10.20.193.110:0/2439189325 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbd74131e30 con 0x7fbd74091950 2026-02-13T20:19:54.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd79fdd640 10 monclient: _renew_subs 2026-02-13T20:19:54.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd79fdd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:19:54.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd79fdd640 1 -- 10.20.193.110:0/2439189325 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fbd7413eb60 con 0x7fbd74091950 2026-02-13T20:19:54.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd4ffff640 1 -- 10.20.193.110:0/2439189325 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbd640044b0 con 0x7fbd74091950 2026-02-13T20:19:54.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd4ffff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:19:54.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd4ffff640 1 -- 10.20.193.110:0/2439189325 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fbd64003720 con 0x7fbd74091950 2026-02-13T20:19:54.154 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd4ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:54.154 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd4ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:19:54.154 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd71ffb640 4 set_mon_vals no callback set 2026-02-13T20:19:54.154 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.134+0000 7fbd4ffff640 10 monclient: dump: 2026-02-13T20:19:54.154 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:54.154 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:54.154 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:54.154 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:54.154 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:54.154 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:54.154 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:54.154 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:54.154 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:54.155 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:54.155 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.135+0000 7fbd4ffff640 1 -- 10.20.193.110:0/2439189325 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fbd64003880 con 0x7fbd74091950 2026-02-13T20:19:54.155 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.135+0000 7fbd79fdd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:19:54.155 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.135+0000 7fbd79fdd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:19:54.155 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.135+0000 7fbd79fdd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:19:54.155 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.135+0000 7fbd79fdd640 1 -- 10.20.193.110:0/2439189325 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd740008d0 con 0x7fbd74091950 2026-02-13T20:19:54.155 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.135+0000 7fbd4ffff640 1 -- 10.20.193.110:0/2439189325 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(398..398 src has 1..398) ==== 3915+0+0 (unknown 1961584715 0 0) 0x7fbd6404e960 con 0x7fbd74091950 2026-02-13T20:19:54.155 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.135+0000 7fbd737fe640 10 monclient: get_auth_request con 0x7fbd4403fa50 auth_method 0 2026-02-13T20:19:54.155 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.137+0000 7fbd4ffff640 1 -- 10.20.193.110:0/2439189325 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fbd64003f80 con 0x7fbd74091950 2026-02-13T20:19:54.155 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.137+0000 7fbd4ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:19:54.155 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.137+0000 7fbd4ffff640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:19:54.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.287+0000 7fbd79fdd640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T20:19:54.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.287+0000 7fbd79fdd640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T20:19:54.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.287+0000 7fbd79fdd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:19:54.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.287+0000 7fbd79fdd640 1 -- 10.20.193.110:0/2439189325 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fbd74058410 con 0x7fbd74091950 2026-02-13T20:19:54.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.287+0000 7fbd4ffff640 1 -- 10.20.193.110:0/2439189325 <== mon.2 v1:10.20.193.110:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 1429112469) 0x7fbd64015040 con 0x7fbd74091950 2026-02-13T20:19:54.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.287+0000 7fbd4ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T20:19:54.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.287+0000 7fbd4ffff640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:19:54.289 INFO:teuthology.orchestra.run.trial110.stdout:{"election_epoch":36,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","modified":"2026-02-13T20:11:07.161192Z","created":"2026-02-13T20:11:07.161192Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6789","nonce":0}]},"addr":"10.20.193.110:6789/0","public_addr":"10.20.193.110:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161241+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6789","nonce":0}]},"addr":"10.20.193.188:6789/0","public_addr":"10.20.193.188:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161242+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6790","nonce":0}]},"addr":"10.20.193.110:6790/0","public_addr":"10.20.193.110:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161243+0000","crush_location":[]}]}} 2026-02-13T20:19:54.290 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.288+0000 7fbd79fdd640 1 -- 10.20.193.110:0/2439189325 >> v1:10.20.193.188:6812/1623052694 conn(0x7fbd4403fa50 legacy=0x7fbd4405ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:54.290 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.288+0000 7fbd79fdd640 10 monclient: shutdown 2026-02-13T20:19:54.290 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.288+0000 7fbd79fdd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:19:54.290 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.288+0000 7fbd79fdd640 1 -- 10.20.193.110:0/2439189325 >> v1:10.20.193.110:6790/0 conn(0x7fbd74091950 legacy=0x7fbd7413e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:54.290 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.288+0000 7fbd79fdd640 1 -- 10.20.193.110:0/2439189325 shutdown_connections 2026-02-13T20:19:54.290 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.288+0000 7fbd79fdd640 1 -- 10.20.193.110:0/2439189325 >> 10.20.193.110:0/2439189325 conn(0x7fbd74054e90 msgr2=0x7fbd7408ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:19:54.290 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.288+0000 7fbd79fdd640 1 -- 10.20.193.110:0/2439189325 shutdown_connections 2026-02-13T20:19:54.290 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.288+0000 7fbd79fdd640 1 -- 10.20.193.110:0/2439189325 wait complete. 2026-02-13T20:19:54.298 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-13T20:19:54.298 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-13T20:19:54.298 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T20:19:54.363 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.361+0000 7f122090c640 10 monclient: get_monmap_and_config 2026-02-13T20:19:54.363 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.361+0000 7f122090c640 10 monclient: build_initial_monmap 2026-02-13T20:19:54.363 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.361+0000 7f122090c640 10 monclient: monmap: 2026-02-13T20:19:54.364 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:19:54.364 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:54.364 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:19:54.363273+0000 2026-02-13T20:19:54.364 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:19:54.363273+0000 2026-02-13T20:19:54.364 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:19:54.364 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:54.364 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:19:54.364 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:19:54.364 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:19:54.364 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:54.374 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.362+0000 7f122090c640 1 Processor -- start 2026-02-13T20:19:54.374 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.362+0000 7f122090c640 1 -- start start 2026-02-13T20:19:54.374 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.362+0000 7f122090c640 10 monclient: init 2026-02-13T20:19:54.374 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.362+0000 7f122090c640 10 monclient: _reopen_session rank -1 2026-02-13T20:19:54.374 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.362+0000 7f122090c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:19:54.374 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.362+0000 7f122090c640 10 monclient(hunting): picked mon.noname-c con 0x7f12181401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:19:54.374 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.362+0000 7f122090c640 10 monclient(hunting): picked mon.noname-b con 0x7f1218092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:19:54.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.362+0000 7f122090c640 10 monclient(hunting): picked mon.noname-a con 0x7f1218091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:19:54.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.362+0000 7f122090c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f121808b730 con 0x7f1218091950 2026-02-13T20:19:54.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.362+0000 7f122090c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f121805c5b0 con 0x7f12181401c0 2026-02-13T20:19:54.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.362+0000 7f122090c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f121808bcf0 con 0x7f1218092020 2026-02-13T20:19:54.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.362+0000 7f122090c640 10 monclient(hunting): _renew_subs 2026-02-13T20:19:54.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.362+0000 7f122090c640 10 monclient(hunting): authenticate will time out at 1156.053712s 2026-02-13T20:19:54.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.362+0000 7f121ee82640 1 -- >> v1:10.20.193.110:6789/0 conn(0x7f1218091950 legacy=0x7f12181a2a20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:19:54.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.362+0000 7f121de80640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f1218092020 0x7f12181812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:51260/0 (socket says 10.20.193.110:51260) 2026-02-13T20:19:54.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.362+0000 7f121de80640 1 -- 10.20.193.110:0/322710784 learned_addr learned my addr 10.20.193.110:0/322710784 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:19:54.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.363+0000 7f121d67f640 1 -- 10.20.193.110:0/322710784 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1991069939 0 0) 0x7f121808bcf0 con 0x7f1218092020 2026-02-13T20:19:54.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.363+0000 7f121d67f640 10 monclient(hunting): _negotiate 2026-02-13T20:19:54.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.363+0000 7f121d67f640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:54.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.363+0000 7f121d67f640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:54.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.363+0000 7f121d67f640 10 monclient(hunting): my global_id is 94385 2026-02-13T20:19:54.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.363+0000 7f121d67f640 1 -- 10.20.193.110:0/322710784 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12080035e0 con 0x7f1218092020 2026-02-13T20:19:54.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.363+0000 7f121d67f640 1 -- 10.20.193.110:0/322710784 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 710832038 0 0) 0x7f121805c5b0 con 0x7f12181401c0 2026-02-13T20:19:54.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.363+0000 7f121d67f640 10 monclient(hunting): _negotiate 2026-02-13T20:19:54.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.363+0000 7f121d67f640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:54.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.363+0000 7f121d67f640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:54.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.363+0000 7f121d67f640 10 monclient(hunting): my global_id is 4792 2026-02-13T20:19:54.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.363+0000 7f121d67f640 1 -- 10.20.193.110:0/322710784 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f121808bcf0 con 0x7f12181401c0 2026-02-13T20:19:54.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.363+0000 7f121d67f640 1 -- 10.20.193.110:0/322710784 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 825642175 0 0) 0x7f12080035e0 con 0x7f1218092020 2026-02-13T20:19:54.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.363+0000 7f121d67f640 1 -- 10.20.193.110:0/322710784 >> v1:10.20.193.188:6789/0 conn(0x7f12181401c0 legacy=0x7f1218091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:54.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.363+0000 7f121d67f640 1 -- 10.20.193.110:0/322710784 >> v1:10.20.193.110:6789/0 conn(0x7f1218091950 legacy=0x7f12181a2a20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:19:54.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.363+0000 7f121d67f640 10 monclient: _finish_hunting 0 2026-02-13T20:19:54.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.363+0000 7f121d67f640 1 monclient: found mon.noname-b 2026-02-13T20:19:54.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.363+0000 7f121d67f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:19:54.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.363+0000 7f121d67f640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:19:54.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.363+0000 7f121d67f640 1 -- 10.20.193.110:0/322710784 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1218140590 con 0x7f1218092020 2026-02-13T20:19:54.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.363+0000 7f121d67f640 10 monclient: _finish_auth 0 2026-02-13T20:19:54.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.363+0000 7f121d67f640 10 monclient: _check_auth_tickets 2026-02-13T20:19:54.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.363+0000 7f121d67f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:19:54.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.363+0000 7f121d67f640 1 -- 10.20.193.110:0/322710784 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f1204002dd0 con 0x7f1218092020 2026-02-13T20:19:54.377 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.363+0000 7f122090c640 5 monclient: authenticate success, global_id 94385 2026-02-13T20:19:54.377 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.363+0000 7f122090c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:19:54.377 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.363+0000 7f121d67f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:54.377 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.363+0000 7f121d67f640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:19:54.377 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.363+0000 7f121d67f640 10 monclient: dump: 2026-02-13T20:19:54.377 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:54.377 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:54.377 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:54.377 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:54.377 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:54.377 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:54.377 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:54.377 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:54.377 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:54.377 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:54.377 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.363+0000 7f122090c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:19:54.377 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.363+0000 7f121d67f640 1 -- 10.20.193.110:0/322710784 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1204002f60 con 0x7f1218092020 2026-02-13T20:19:54.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.363+0000 7f121d67f640 10 monclient: handle_config config(0 keys) 2026-02-13T20:19:54.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.363+0000 7f122090c640 10 monclient: get_monmap_and_config success 2026-02-13T20:19:54.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.363+0000 7f122090c640 4 set_mon_vals no callback set 2026-02-13T20:19:54.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.363+0000 7f121d67f640 1 -- 10.20.193.110:0/322710784 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f1204003370 con 0x7f1218092020 2026-02-13T20:19:54.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.363+0000 7f121d67f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:54.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.363+0000 7f121d67f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:19:54.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.363+0000 7f121d67f640 10 monclient: dump: 2026-02-13T20:19:54.378 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:54.378 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:54.378 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:54.378 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:54.378 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:54.378 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:54.378 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:54.378 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:54.378 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:54.378 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:54.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.363+0000 7f122090c640 10 monclient: shutdown 2026-02-13T20:19:54.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.363+0000 7f122090c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:19:54.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.363+0000 7f122090c640 1 -- 10.20.193.110:0/322710784 >> v1:10.20.193.110:6790/0 conn(0x7f1218092020 legacy=0x7f12181812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:54.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.363+0000 7f122090c640 1 -- 10.20.193.110:0/322710784 shutdown_connections 2026-02-13T20:19:54.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.363+0000 7f122090c640 1 -- 10.20.193.110:0/322710784 >> 10.20.193.110:0/322710784 conn(0x7f1218054e90 msgr2=0x7f1218058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:19:54.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.363+0000 7f122090c640 1 -- 10.20.193.110:0/322710784 shutdown_connections 2026-02-13T20:19:54.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.363+0000 7f122090c640 1 -- 10.20.193.110:0/322710784 wait complete. 2026-02-13T20:19:54.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.364+0000 7f122090c640 10 monclient: build_initial_monmap 2026-02-13T20:19:54.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.364+0000 7f122090c640 10 monclient: monmap: 2026-02-13T20:19:54.379 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:19:54.379 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:19:54.379 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:19:54.379 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:19:54.379 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:19:54.379 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:19:54.379 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:19:54.379 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:19:54.379 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:19:54.380 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:54.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.364+0000 7f122090c640 1 Processor -- start 2026-02-13T20:19:54.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.364+0000 7f122090c640 1 -- start start 2026-02-13T20:19:54.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.364+0000 7f122090c640 10 monclient: init 2026-02-13T20:19:54.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.364+0000 7f122090c640 10 monclient: _reopen_session rank -1 2026-02-13T20:19:54.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.364+0000 7f122090c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:19:54.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.364+0000 7f122090c640 10 monclient(hunting): picked mon.noname-b con 0x7f1218091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:19:54.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.364+0000 7f122090c640 10 monclient(hunting): picked mon.noname-a con 0x7f12181401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:19:54.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.364+0000 7f122090c640 10 monclient(hunting): picked mon.noname-c con 0x7f12181505b0 addr v1:10.20.193.110:6790/0 2026-02-13T20:19:54.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.364+0000 7f122090c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f121808c310 con 0x7f12181401c0 2026-02-13T20:19:54.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.364+0000 7f122090c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f121805d320 con 0x7f1218091950 2026-02-13T20:19:54.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.364+0000 7f122090c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f121812dec0 con 0x7f12181505b0 2026-02-13T20:19:54.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.364+0000 7f122090c640 10 monclient(hunting): _renew_subs 2026-02-13T20:19:54.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.364+0000 7f122090c640 10 monclient(hunting): authenticate will time out at 1156.055584s 2026-02-13T20:19:54.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.364+0000 7f121de80640 1 -- >> v1:10.20.193.110:6789/0 conn(0x7f12181401c0 legacy=0x7f12181916e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:19:54.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.364+0000 7f121ee82640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f12181505b0 0x7f1218192e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:51274/0 (socket says 10.20.193.110:51274) 2026-02-13T20:19:54.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.364+0000 7f121ee82640 1 -- 10.20.193.110:0/1905820235 learned_addr learned my addr 10.20.193.110:0/1905820235 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:19:54.381 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.364+0000 7f1202ffd640 1 -- 10.20.193.110:0/1905820235 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3719637591 0 0) 0x7f121812dec0 con 0x7f12181505b0 2026-02-13T20:19:54.381 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.364+0000 7f1202ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:19:54.381 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.364+0000 7f1202ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:54.381 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.364+0000 7f1202ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:54.381 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.364+0000 7f1202ffd640 10 monclient(hunting): my global_id is 94388 2026-02-13T20:19:54.381 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.364+0000 7f1202ffd640 1 -- 10.20.193.110:0/1905820235 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11e80035e0 con 0x7f12181505b0 2026-02-13T20:19:54.381 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.365+0000 7f1202ffd640 1 -- 10.20.193.110:0/1905820235 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2766312901 0 0) 0x7f11e80035e0 con 0x7f12181505b0 2026-02-13T20:19:54.381 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.365+0000 7f1202ffd640 1 -- 10.20.193.110:0/1905820235 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f121812dec0 con 0x7f12181505b0 2026-02-13T20:19:54.381 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.365+0000 7f1202ffd640 1 -- 10.20.193.110:0/1905820235 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f120c0051c0 con 0x7f12181505b0 2026-02-13T20:19:54.381 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.365+0000 7f1202ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:19:54.381 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.365+0000 7f1202ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:19:54.381 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.365+0000 7f1202ffd640 10 monclient(hunting): dump: 2026-02-13T20:19:54.381 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:54.381 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:54.381 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:54.381 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:54.381 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:54.382 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:54.382 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:54.382 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:54.382 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:54.382 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:54.382 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.365+0000 7f1202ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:19:54.382 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.365+0000 7f1202ffd640 1 -- 10.20.193.110:0/1905820235 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3017667494 0 0) 0x7f121805d320 con 0x7f1218091950 2026-02-13T20:19:54.382 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.365+0000 7f1202ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:19:54.382 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.365+0000 7f1202ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:54.382 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.365+0000 7f1202ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:54.382 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.365+0000 7f1202ffd640 10 monclient(hunting): my global_id is 4795 2026-02-13T20:19:54.382 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.365+0000 7f1202ffd640 1 -- 10.20.193.110:0/1905820235 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11e80035e0 con 0x7f1218091950 2026-02-13T20:19:54.382 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.365+0000 7f1202ffd640 1 -- 10.20.193.110:0/1905820235 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2194256710 0 0) 0x7f121812dec0 con 0x7f12181505b0 2026-02-13T20:19:54.382 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.365+0000 7f1202ffd640 1 -- 10.20.193.110:0/1905820235 >> v1:10.20.193.188:6789/0 conn(0x7f1218091950 legacy=0x7f121813e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:54.382 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.365+0000 7f1202ffd640 1 -- 10.20.193.110:0/1905820235 >> v1:10.20.193.110:6789/0 conn(0x7f12181401c0 legacy=0x7f12181916e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T20:19:54.382 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.365+0000 7f1202ffd640 10 monclient: _finish_hunting 0 2026-02-13T20:19:54.382 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.365+0000 7f1202ffd640 1 monclient: found mon.c 2026-02-13T20:19:54.382 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.365+0000 7f1202ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:19:54.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.365+0000 7f1202ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:19:54.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.365+0000 7f1202ffd640 1 -- 10.20.193.110:0/1905820235 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f121812ff40 con 0x7f12181505b0 2026-02-13T20:19:54.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.365+0000 7f1202ffd640 10 monclient: _finish_auth 0 2026-02-13T20:19:54.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.365+0000 7f1202ffd640 10 monclient: _check_auth_tickets 2026-02-13T20:19:54.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.365+0000 7f1202ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:19:54.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.365+0000 7f122090c640 5 monclient: authenticate success, global_id 94388 2026-02-13T20:19:54.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.365+0000 7f122090c640 10 monclient: _renew_subs 2026-02-13T20:19:54.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.365+0000 7f122090c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:19:54.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.365+0000 7f122090c640 1 -- 10.20.193.110:0/1905820235 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1218130220 con 0x7f12181505b0 2026-02-13T20:19:54.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.365+0000 7f122090c640 10 monclient: _renew_subs 2026-02-13T20:19:54.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.365+0000 7f122090c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:19:54.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.365+0000 7f122090c640 1 -- 10.20.193.110:0/1905820235 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f121812ea20 con 0x7f12181505b0 2026-02-13T20:19:54.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.365+0000 7f1202ffd640 1 -- 10.20.193.110:0/1905820235 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f120c005400 con 0x7f12181505b0 2026-02-13T20:19:54.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.365+0000 7f1202ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:19:54.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.365+0000 7f1202ffd640 1 -- 10.20.193.110:0/1905820235 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f120c0057e0 con 0x7f12181505b0 2026-02-13T20:19:54.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.365+0000 7f1202ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:54.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.365+0000 7f1202ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:19:54.384 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.365+0000 7f121ce7e640 4 set_mon_vals no callback set 2026-02-13T20:19:54.384 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.365+0000 7f1202ffd640 10 monclient: dump: 2026-02-13T20:19:54.384 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:54.384 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:54.384 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:54.384 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:54.384 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:54.384 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:54.384 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:54.384 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:54.384 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:54.384 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:54.384 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.365+0000 7f122090c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:19:54.384 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.365+0000 7f122090c640 1 -- 10.20.193.110:0/1905820235 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f12180008d0 con 0x7f1218092020 2026-02-13T20:19:54.384 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.365+0000 7f1202ffd640 1 -- 10.20.193.110:0/1905820235 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f120c005940 con 0x7f12181505b0 2026-02-13T20:19:54.384 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.365+0000 7f1202ffd640 1 -- 10.20.193.110:0/1905820235 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(398..398 src has 1..398) ==== 3915+0+0 (unknown 1961584715 0 0) 0x7f120c04f810 con 0x7f12181505b0 2026-02-13T20:19:54.384 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.366+0000 7f1202ffd640 1 -- 10.20.193.110:0/1905820235 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3013756977 0 0) 0x7f12180008d0 con 0x7f1218092020 2026-02-13T20:19:54.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.366+0000 7f1202ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:19:54.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.366+0000 7f1202ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:54.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.366+0000 7f1202ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:54.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.366+0000 7f1202ffd640 10 monclient(hunting): my global_id is 94391 2026-02-13T20:19:54.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.366+0000 7f1202ffd640 1 -- 10.20.193.110:0/1905820235 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f121812dec0 con 0x7f1218092020 2026-02-13T20:19:54.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.366+0000 7f1202ffd640 1 -- 10.20.193.110:0/1905820235 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2982367793 0 0) 0x7f121812dec0 con 0x7f1218092020 2026-02-13T20:19:54.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.366+0000 7f1202ffd640 1 -- 10.20.193.110:0/1905820235 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f12180008d0 con 0x7f1218092020 2026-02-13T20:19:54.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.366+0000 7f1202ffd640 1 -- 10.20.193.110:0/1905820235 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f1210002fc0 con 0x7f1218092020 2026-02-13T20:19:54.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.366+0000 7f121de80640 10 monclient: get_auth_request con 0x7f11e803f570 auth_method 0 2026-02-13T20:19:54.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.366+0000 7f1202ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:54.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.366+0000 7f1202ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:19:54.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.366+0000 7f1202ffd640 10 monclient: dump: 2026-02-13T20:19:54.385 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:54.385 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:54.385 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:54.385 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:54.385 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:54.385 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:54.386 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:54.386 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:54.386 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:54.386 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:54.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.366+0000 7f1202ffd640 1 -- 10.20.193.110:0/1905820235 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1718292722 0 0) 0x7f12180008d0 con 0x7f1218092020 2026-02-13T20:19:54.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.366+0000 7f1202ffd640 1 -- 10.20.193.110:0/1905820235 --> v1:10.20.193.110:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f121808b450 con 0x7f1218092020 2026-02-13T20:19:54.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.366+0000 7f1202ffd640 1 -- 10.20.193.110:0/1905820235 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f1210005260 con 0x7f1218092020 2026-02-13T20:19:54.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.366+0000 7f1202ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:19:54.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.366+0000 7f1202ffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:19:54.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.366+0000 7f1202ffd640 1 -- 10.20.193.110:0/1905820235 >> v1:10.20.193.110:6790/0 conn(0x7f1218092020 legacy=0x7f1218127b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:54.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.366+0000 7f1202ffd640 1 -- 10.20.193.110:0/1905820235 >> v1:10.20.193.110:6790/0 conn(0x7f1218092020 legacy=0x7f1218127b20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:19:54.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.370+0000 7f122090c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:19:54.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.370+0000 7f122090c640 1 -- 10.20.193.110:0/1905820235 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1218058410 con 0x7f121813ef30 2026-02-13T20:19:54.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.370+0000 7f1202ffd640 1 -- 10.20.193.110:0/1905820235 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3877101951 0 0) 0x7f1218058410 con 0x7f121813ef30 2026-02-13T20:19:54.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.370+0000 7f1202ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:19:54.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.370+0000 7f1202ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:54.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.370+0000 7f1202ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:54.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.370+0000 7f1202ffd640 10 monclient(hunting): my global_id is 94394 2026-02-13T20:19:54.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.370+0000 7f1202ffd640 1 -- 10.20.193.110:0/1905820235 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12180008d0 con 0x7f121813ef30 2026-02-13T20:19:54.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.370+0000 7f1202ffd640 1 -- 10.20.193.110:0/1905820235 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1174533976 0 0) 0x7f12180008d0 con 0x7f121813ef30 2026-02-13T20:19:54.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.370+0000 7f1202ffd640 1 -- 10.20.193.110:0/1905820235 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1218058410 con 0x7f121813ef30 2026-02-13T20:19:54.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.370+0000 7f1202ffd640 1 -- 10.20.193.110:0/1905820235 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f1210003820 con 0x7f121813ef30 2026-02-13T20:19:54.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.370+0000 7f1202ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:54.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.370+0000 7f1202ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:19:54.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.370+0000 7f1202ffd640 10 monclient: dump: 2026-02-13T20:19:54.387 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:54.387 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:54.387 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:54.387 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:54.387 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:54.387 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:54.387 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:54.387 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:54.387 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:54.387 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:54.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.370+0000 7f1202ffd640 1 -- 10.20.193.110:0/1905820235 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3793412314 0 0) 0x7f1218058410 con 0x7f121813ef30 2026-02-13T20:19:54.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.370+0000 7f1202ffd640 1 -- 10.20.193.110:0/1905820235 --> v1:10.20.193.110:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f121812fbc0 con 0x7f121813ef30 2026-02-13T20:19:54.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.370+0000 7f1202ffd640 1 -- 10.20.193.110:0/1905820235 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4503 (unknown 0 0 1815643398) 0x7f1210004da0 con 0x7f121813ef30 2026-02-13T20:19:54.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.370+0000 7f1202ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:19:54.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.370+0000 7f1202ffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:19:54.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.370+0000 7f1202ffd640 1 -- 10.20.193.110:0/1905820235 >> v1:10.20.193.110:6790/0 conn(0x7f121813ef30 legacy=0x7f1218128230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:54.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.370+0000 7f1202ffd640 1 -- 10.20.193.110:0/1905820235 >> v1:10.20.193.110:6790/0 conn(0x7f121813ef30 legacy=0x7f1218128230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:19:54.388 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:19:54.388 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:19:54.388 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:19:54.389 INFO:teuthology.orchestra.run.trial110.stdout: "state": "peon", 2026-02-13T20:19:54.389 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 36, 2026-02-13T20:19:54.389 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 265994, 2026-02-13T20:19:54.389 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:19:54.389 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:19:54.389 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:19:54.389 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:19:54.389 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 0, 2026-02-13T20:19:54.389 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:19:54.389 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:19:54.389 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:19:54.389 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:19:54.389 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:19:54.389 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:19:54.389 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:19:54.389 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:19:54.390 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:19:54.390 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:19:54.390 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:19:54.390 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:19:54.390 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:19:54.390 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:19:54.390 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:19:54.390 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:19:54.390 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:19:54.390 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:19:54.390 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:19:54.390 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:19:54.390 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:19:54.390 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:19:54.390 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:19:54.390 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:19:54.390 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:19:54.391 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:19:54.391 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:19:54.391 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:19:54.391 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:19:54.391 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:19:54.391 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:19:54.391 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:19:54.391 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:19:54.391 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:54.391 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:19:54.391 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:19:54.391 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:19:54.391 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:19:54.391 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:19:54.391 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:19:54.391 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:19:54.392 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:19:54.392 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:19:54.392 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:19:54.392 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:19:54.392 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:19:54.392 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:19:54.392 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:19:54.392 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:19:54.392 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:19:54.392 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:19:54.392 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:19:54.392 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:19:54.392 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:19:54.392 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:19:54.392 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:19:54.392 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:19:54.392 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:19:54.392 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:19:54.393 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:19:54.393 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:19:54.393 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:19:54.393 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:19:54.393 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:19:54.393 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:19:54.393 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:19:54.393 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:54.393 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:19:54.393 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:54.393 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:19:54.393 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:19:54.393 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:19:54.393 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:19:54.393 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:54.393 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:19:54.393 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:19:54.394 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:19:54.394 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:54.394 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:19:54.394 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:54.394 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:19:54.394 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:19:54.394 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:19:54.394 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:19:54.394 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:19:54.394 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:19:54.394 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:54.394 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:54.394 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:19:54.394 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:19:54.394 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:19:54.394 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:19:54.394 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:54.395 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:19:54.395 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:19:54.395 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:19:54.395 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:54.395 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:19:54.395 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:54.395 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:19:54.395 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:19:54.395 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:19:54.395 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:19:54.395 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:19:54.395 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:19:54.395 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:54.395 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:54.395 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:19:54.395 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:19:54.395 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:19:54.396 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:19:54.396 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:54.396 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:19:54.396 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:19:54.396 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:19:54.396 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:54.396 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:19:54.396 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:54.396 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:19:54.396 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:19:54.396 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:19:54.396 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:19:54.396 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:19:54.396 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:19:54.396 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:54.396 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:19:54.396 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:54.397 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:19:54.397 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:19:54.397 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:54.397 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:19:54.397 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:19:54.397 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:19:54.397 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:54.397 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:19:54.397 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:19:54.397 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:54.397 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:19:54.397 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:19:54.397 INFO:teuthology.orchestra.run.trial110.stdout: "num": 2 2026-02-13T20:19:54.397 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:54.397 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:19:54.397 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:19:54.397 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:54.397 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:19:54.398 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:19:54.398 INFO:teuthology.orchestra.run.trial110.stdout: "num": 2 2026-02-13T20:19:54.398 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:54.398 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:19:54.398 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:54.398 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:19:54.398 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:19:54.399 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.370+0000 7f122090c640 1 -- 10.20.193.110:0/1905820235 >> v1:10.20.193.188:6812/1623052694 conn(0x7f11e803f570 legacy=0x7f11e805fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:54.399 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.370+0000 7f122090c640 10 monclient: shutdown 2026-02-13T20:19:54.399 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.370+0000 7f122090c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:19:54.399 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.370+0000 7f122090c640 1 -- 10.20.193.110:0/1905820235 >> v1:10.20.193.110:6790/0 conn(0x7f12181505b0 legacy=0x7f1218192e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:54.400 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.370+0000 7f121ee82640 1 -- 10.20.193.110:0/1905820235 reap_dead start 2026-02-13T20:19:54.400 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.370+0000 7f121ee82640 1 -- 10.20.193.110:0/1905820235 reap_dead start 2026-02-13T20:19:54.400 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.371+0000 7f122090c640 1 -- 10.20.193.110:0/1905820235 shutdown_connections 2026-02-13T20:19:54.400 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.371+0000 7f122090c640 1 -- 10.20.193.110:0/1905820235 >> 10.20.193.110:0/1905820235 conn(0x7f1218054e90 msgr2=0x7f121808dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:19:54.400 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.371+0000 7f122090c640 1 -- 10.20.193.110:0/1905820235 shutdown_connections 2026-02-13T20:19:54.400 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.371+0000 7f122090c640 1 -- 10.20.193.110:0/1905820235 wait complete. 2026-02-13T20:19:54.400 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-13T20:19:54.400 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-13T20:19:54.401 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T20:19:54.467 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.465+0000 7ff1088cc640 10 monclient: get_monmap_and_config 2026-02-13T20:19:54.467 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.465+0000 7ff1088cc640 10 monclient: build_initial_monmap 2026-02-13T20:19:54.467 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.465+0000 7ff1088cc640 10 monclient: monmap: 2026-02-13T20:19:54.467 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:19:54.467 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:54.467 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:19:54.466954+0000 2026-02-13T20:19:54.467 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:19:54.466954+0000 2026-02-13T20:19:54.467 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:19:54.468 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:54.468 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:19:54.468 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:19:54.468 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:19:54.468 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:54.468 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.465+0000 7ff1088cc640 1 Processor -- start 2026-02-13T20:19:54.468 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.465+0000 7ff1088cc640 1 -- start start 2026-02-13T20:19:54.468 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.465+0000 7ff1088cc640 10 monclient: init 2026-02-13T20:19:54.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.466+0000 7ff1088cc640 10 monclient: _reopen_session rank -1 2026-02-13T20:19:54.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.466+0000 7ff1088cc640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:19:54.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.466+0000 7ff1088cc640 10 monclient(hunting): picked mon.noname-c con 0x7ff10005a3e0 addr v1:10.20.193.188:6789/0 2026-02-13T20:19:54.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.466+0000 7ff1088cc640 10 monclient(hunting): picked mon.noname-a con 0x7ff10005cd40 addr v1:10.20.193.110:6789/0 2026-02-13T20:19:54.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.466+0000 7ff1088cc640 10 monclient(hunting): picked mon.noname-b con 0x7ff100188a90 addr v1:10.20.193.110:6790/0 2026-02-13T20:19:54.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.466+0000 7ff1088cc640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff10005c5b0 con 0x7ff10005cd40 2026-02-13T20:19:54.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.466+0000 7ff1088cc640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff10005b5d0 con 0x7ff10005a3e0 2026-02-13T20:19:54.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.466+0000 7ff1088cc640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff10005c330 con 0x7ff100188a90 2026-02-13T20:19:54.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.466+0000 7ff1088cc640 10 monclient(hunting): _renew_subs 2026-02-13T20:19:54.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.466+0000 7ff1088cc640 10 monclient(hunting): authenticate will time out at 1156.157399s 2026-02-13T20:19:54.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.466+0000 7ff105e40640 1 -- >> v1:10.20.193.110:6789/0 conn(0x7ff10005cd40 legacy=0x7ff10005aec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:19:54.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.466+0000 7ff106e42640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7ff100188a90 0x7ff1001a8e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:51306/0 (socket says 10.20.193.110:51306) 2026-02-13T20:19:54.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.466+0000 7ff106e42640 1 -- 10.20.193.110:0/543719716 learned_addr learned my addr 10.20.193.110:0/543719716 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:19:54.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.466+0000 7ff10563f640 1 -- 10.20.193.110:0/543719716 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1454102046 0 0) 0x7ff10005c330 con 0x7ff100188a90 2026-02-13T20:19:54.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.466+0000 7ff10563f640 10 monclient(hunting): _negotiate 2026-02-13T20:19:54.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.466+0000 7ff10563f640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:54.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.466+0000 7ff10563f640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:54.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.466+0000 7ff10563f640 10 monclient(hunting): my global_id is 94397 2026-02-13T20:19:54.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.466+0000 7ff10563f640 1 -- 10.20.193.110:0/543719716 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0f00035e0 con 0x7ff100188a90 2026-02-13T20:19:54.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.466+0000 7ff10563f640 1 -- 10.20.193.110:0/543719716 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1635672165 0 0) 0x7ff10005b5d0 con 0x7ff10005a3e0 2026-02-13T20:19:54.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.466+0000 7ff10563f640 10 monclient(hunting): _negotiate 2026-02-13T20:19:54.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.466+0000 7ff10563f640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:54.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.466+0000 7ff10563f640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:54.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.466+0000 7ff10563f640 10 monclient(hunting): my global_id is 4798 2026-02-13T20:19:54.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.466+0000 7ff10563f640 1 -- 10.20.193.110:0/543719716 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff10005c330 con 0x7ff10005a3e0 2026-02-13T20:19:54.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.466+0000 7ff10563f640 1 -- 10.20.193.110:0/543719716 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2245197421 0 0) 0x7ff0f00035e0 con 0x7ff100188a90 2026-02-13T20:19:54.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.466+0000 7ff10563f640 1 -- 10.20.193.110:0/543719716 >> v1:10.20.193.188:6789/0 conn(0x7ff10005a3e0 legacy=0x7ff10005a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:54.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.466+0000 7ff10563f640 1 -- 10.20.193.110:0/543719716 >> v1:10.20.193.110:6789/0 conn(0x7ff10005cd40 legacy=0x7ff10005aec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:19:54.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.466+0000 7ff10563f640 10 monclient: _finish_hunting 0 2026-02-13T20:19:54.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.466+0000 7ff10563f640 1 monclient: found mon.noname-b 2026-02-13T20:19:54.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.466+0000 7ff10563f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:19:54.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.466+0000 7ff10563f640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:19:54.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.466+0000 7ff10563f640 1 -- 10.20.193.110:0/543719716 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1000891c0 con 0x7ff100188a90 2026-02-13T20:19:54.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.466+0000 7ff10563f640 10 monclient: _finish_auth 0 2026-02-13T20:19:54.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.466+0000 7ff10563f640 10 monclient: _check_auth_tickets 2026-02-13T20:19:54.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.466+0000 7ff10563f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:19:54.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.466+0000 7ff10563f640 1 -- 10.20.193.110:0/543719716 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff0f4003eb0 con 0x7ff100188a90 2026-02-13T20:19:54.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.466+0000 7ff1088cc640 5 monclient: authenticate success, global_id 94397 2026-02-13T20:19:54.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.466+0000 7ff10563f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:54.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.466+0000 7ff10563f640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:19:54.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.466+0000 7ff10563f640 10 monclient: dump: 2026-02-13T20:19:54.477 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:54.477 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:54.477 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:54.477 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:54.478 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:54.478 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:54.478 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:54.478 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:54.478 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:54.478 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:54.478 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.466+0000 7ff1088cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:19:54.478 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.467+0000 7ff10563f640 1 -- 10.20.193.110:0/543719716 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff0f40040f0 con 0x7ff100188a90 2026-02-13T20:19:54.478 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.467+0000 7ff10563f640 10 monclient: handle_config config(0 keys) 2026-02-13T20:19:54.478 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.467+0000 7ff1088cc640 10 monclient: get_monmap_and_config success 2026-02-13T20:19:54.478 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.467+0000 7ff1088cc640 4 set_mon_vals no callback set 2026-02-13T20:19:54.478 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.467+0000 7ff10563f640 1 -- 10.20.193.110:0/543719716 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff0f4004500 con 0x7ff100188a90 2026-02-13T20:19:54.478 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.467+0000 7ff10563f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:54.478 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.467+0000 7ff10563f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:19:54.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.467+0000 7ff10563f640 10 monclient: dump: 2026-02-13T20:19:54.479 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:54.479 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:54.479 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:54.479 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:54.479 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:54.479 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:54.479 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:54.479 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:54.479 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:54.479 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:54.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.467+0000 7ff1088cc640 10 monclient: shutdown 2026-02-13T20:19:54.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.467+0000 7ff1088cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:19:54.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.467+0000 7ff1088cc640 1 -- 10.20.193.110:0/543719716 >> v1:10.20.193.110:6790/0 conn(0x7ff100188a90 legacy=0x7ff1001a8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:54.480 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.467+0000 7ff1088cc640 1 -- 10.20.193.110:0/543719716 shutdown_connections 2026-02-13T20:19:54.480 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.467+0000 7ff1088cc640 1 -- 10.20.193.110:0/543719716 >> 10.20.193.110:0/543719716 conn(0x7ff100054e90 msgr2=0x7ff100058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:19:54.480 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.467+0000 7ff1088cc640 1 -- 10.20.193.110:0/543719716 shutdown_connections 2026-02-13T20:19:54.480 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.467+0000 7ff1088cc640 1 -- 10.20.193.110:0/543719716 wait complete. 2026-02-13T20:19:54.480 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.467+0000 7ff1088cc640 10 monclient: build_initial_monmap 2026-02-13T20:19:54.480 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.467+0000 7ff1088cc640 10 monclient: monmap: 2026-02-13T20:19:54.480 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:19:54.480 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:19:54.480 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:19:54.480 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:19:54.480 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:19:54.480 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:19:54.480 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:19:54.481 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:19:54.481 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:19:54.481 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:54.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.467+0000 7ff1088cc640 1 Processor -- start 2026-02-13T20:19:54.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.467+0000 7ff1088cc640 1 -- start start 2026-02-13T20:19:54.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.467+0000 7ff1088cc640 10 monclient: init 2026-02-13T20:19:54.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff1088cc640 10 monclient: _reopen_session rank -1 2026-02-13T20:19:54.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff1088cc640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:19:54.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff1088cc640 10 monclient(hunting): picked mon.noname-a con 0x7ff10005a3e0 addr v1:10.20.193.110:6789/0 2026-02-13T20:19:54.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff1088cc640 10 monclient(hunting): picked mon.noname-b con 0x7ff100188a90 addr v1:10.20.193.188:6789/0 2026-02-13T20:19:54.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff1088cc640 10 monclient(hunting): picked mon.noname-c con 0x7ff100123e80 addr v1:10.20.193.110:6790/0 2026-02-13T20:19:54.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff1088cc640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1001250c0 con 0x7ff10005a3e0 2026-02-13T20:19:54.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff1088cc640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff100125680 con 0x7ff100188a90 2026-02-13T20:19:54.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff1088cc640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1000904f0 con 0x7ff100123e80 2026-02-13T20:19:54.482 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff106641640 1 -- >> v1:10.20.193.110:6789/0 conn(0x7ff10005a3e0 legacy=0x7ff10008f6d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.110:6789/0 2026-02-13T20:19:54.482 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff1088cc640 10 monclient(hunting): _renew_subs 2026-02-13T20:19:54.482 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff1088cc640 10 monclient(hunting): authenticate will time out at 1156.159217s 2026-02-13T20:19:54.482 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff106e42640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7ff100123e80 0x7ff1001775c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:51314/0 (socket says 10.20.193.110:51314) 2026-02-13T20:19:54.482 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff106e42640 1 -- 10.20.193.110:0/3036424524 learned_addr learned my addr 10.20.193.110:0/3036424524 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:19:54.482 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff0eaffd640 1 -- 10.20.193.110:0/3036424524 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3908682382 0 0) 0x7ff1000904f0 con 0x7ff100123e80 2026-02-13T20:19:54.482 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff0eaffd640 10 monclient(hunting): _negotiate 2026-02-13T20:19:54.482 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff0eaffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:54.482 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff0eaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:54.482 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff0eaffd640 10 monclient(hunting): my global_id is 94400 2026-02-13T20:19:54.482 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff0eaffd640 1 -- 10.20.193.110:0/3036424524 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0d00035e0 con 0x7ff100123e80 2026-02-13T20:19:54.482 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff0eaffd640 1 -- 10.20.193.110:0/3036424524 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3714415381 0 0) 0x7ff0d00035e0 con 0x7ff100123e80 2026-02-13T20:19:54.482 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff0eaffd640 1 -- 10.20.193.110:0/3036424524 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff1000904f0 con 0x7ff100123e80 2026-02-13T20:19:54.482 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff0eaffd640 1 -- 10.20.193.110:0/3036424524 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff0f4004410 con 0x7ff100123e80 2026-02-13T20:19:54.483 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff0eaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:19:54.483 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff0eaffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:19:54.483 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff0eaffd640 10 monclient(hunting): dump: 2026-02-13T20:19:54.483 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:54.483 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:54.483 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:54.483 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:54.483 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:54.483 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:54.483 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:54.483 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:54.483 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:54.483 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:54.483 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff0eaffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:19:54.484 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff0eaffd640 1 -- 10.20.193.110:0/3036424524 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4074970877 0 0) 0x7ff1000904f0 con 0x7ff100123e80 2026-02-13T20:19:54.484 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff0eaffd640 1 -- 10.20.193.110:0/3036424524 >> v1:10.20.193.188:6789/0 conn(0x7ff100188a90 legacy=0x7ff10008fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:54.484 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff0eaffd640 1 -- 10.20.193.110:0/3036424524 >> v1:10.20.193.110:6789/0 conn(0x7ff10005a3e0 legacy=0x7ff10008f6d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T20:19:54.484 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff0eaffd640 10 monclient: _finish_hunting 0 2026-02-13T20:19:54.484 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff0eaffd640 1 monclient: found mon.c 2026-02-13T20:19:54.484 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff0eaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:19:54.484 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff0eaffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:19:54.484 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff0eaffd640 1 -- 10.20.193.110:0/3036424524 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff100124810 con 0x7ff100123e80 2026-02-13T20:19:54.484 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff0eaffd640 10 monclient: _finish_auth 0 2026-02-13T20:19:54.484 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff0eaffd640 10 monclient: _check_auth_tickets 2026-02-13T20:19:54.484 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff0eaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:19:54.484 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff1088cc640 5 monclient: authenticate success, global_id 94400 2026-02-13T20:19:54.484 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff1088cc640 10 monclient: _renew_subs 2026-02-13T20:19:54.484 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff1088cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:19:54.485 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff1088cc640 1 -- 10.20.193.110:0/3036424524 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff100123320 con 0x7ff100123e80 2026-02-13T20:19:54.485 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff1088cc640 10 monclient: _renew_subs 2026-02-13T20:19:54.485 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff1088cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:19:54.485 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff1088cc640 1 -- 10.20.193.110:0/3036424524 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7ff100126ee0 con 0x7ff100123e80 2026-02-13T20:19:54.485 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff0eaffd640 1 -- 10.20.193.110:0/3036424524 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff0f4004600 con 0x7ff100123e80 2026-02-13T20:19:54.485 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff0eaffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:19:54.485 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff0eaffd640 1 -- 10.20.193.110:0/3036424524 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff0f4005f40 con 0x7ff100123e80 2026-02-13T20:19:54.485 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff0eaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:54.485 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff0eaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:19:54.485 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff0eaffd640 10 monclient: dump: 2026-02-13T20:19:54.485 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:54.485 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:54.485 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:54.485 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:54.486 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:54.486 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:54.486 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:54.486 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:54.486 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:54.486 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:54.486 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.468+0000 7ff104e3e640 4 set_mon_vals no callback set 2026-02-13T20:19:54.486 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.469+0000 7ff1088cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:19:54.486 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.469+0000 7ff1088cc640 1 -- 10.20.193.110:0/3036424524 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff100125270 con 0x7ff10005cd40 2026-02-13T20:19:54.486 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.469+0000 7ff0eaffd640 1 -- 10.20.193.110:0/3036424524 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7ff0f4012bb0 con 0x7ff100123e80 2026-02-13T20:19:54.486 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.469+0000 7ff0eaffd640 1 -- 10.20.193.110:0/3036424524 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(398..398 src has 1..398) ==== 3915+0+0 (unknown 1961584715 0 0) 0x7ff0f404f9f0 con 0x7ff100123e80 2026-02-13T20:19:54.486 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.469+0000 7ff0eaffd640 1 -- 10.20.193.110:0/3036424524 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2867642306 0 0) 0x7ff10005c330 con 0x7ff10005cd40 2026-02-13T20:19:54.486 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.469+0000 7ff0eaffd640 10 monclient(hunting): _negotiate 2026-02-13T20:19:54.486 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.469+0000 7ff0eaffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:54.487 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.469+0000 7ff0eaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:54.487 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.469+0000 7ff0eaffd640 10 monclient(hunting): my global_id is 4801 2026-02-13T20:19:54.487 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.469+0000 7ff0eaffd640 1 -- 10.20.193.110:0/3036424524 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1000904f0 con 0x7ff10005cd40 2026-02-13T20:19:54.487 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.470+0000 7ff105e40640 10 monclient: get_auth_request con 0x7ff0d003f570 auth_method 0 2026-02-13T20:19:54.487 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.470+0000 7ff0eaffd640 1 -- 10.20.193.110:0/3036424524 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3427563074 0 0) 0x7ff1000904f0 con 0x7ff10005cd40 2026-02-13T20:19:54.487 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.470+0000 7ff0eaffd640 1 -- 10.20.193.110:0/3036424524 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff10005c330 con 0x7ff10005cd40 2026-02-13T20:19:54.487 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.470+0000 7ff0eaffd640 1 -- 10.20.193.110:0/3036424524 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff0f8002f20 con 0x7ff10005cd40 2026-02-13T20:19:54.487 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.470+0000 7ff0eaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:54.487 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.470+0000 7ff0eaffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:19:54.487 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.470+0000 7ff0eaffd640 10 monclient: dump: 2026-02-13T20:19:54.487 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:54.487 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:54.487 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:54.487 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:54.488 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:54.488 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:54.488 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:54.488 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:54.488 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:54.488 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:54.488 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.470+0000 7ff0eaffd640 1 -- 10.20.193.110:0/3036424524 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 638715431 0 0) 0x7ff10005c330 con 0x7ff10005cd40 2026-02-13T20:19:54.488 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.470+0000 7ff0eaffd640 1 -- 10.20.193.110:0/3036424524 --> v1:10.20.193.188:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff100089af0 con 0x7ff10005cd40 2026-02-13T20:19:54.488 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.470+0000 7ff0eaffd640 1 -- 10.20.193.110:0/3036424524 <== mon.1 v1:10.20.193.188:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7ff0f80033e0 con 0x7ff10005cd40 2026-02-13T20:19:54.488 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.470+0000 7ff0eaffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:19:54.488 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.470+0000 7ff0eaffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:19:54.488 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.470+0000 7ff0eaffd640 1 -- 10.20.193.110:0/3036424524 >> v1:10.20.193.188:6789/0 conn(0x7ff10005cd40 legacy=0x7ff10011fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:54.488 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.470+0000 7ff0eaffd640 1 -- 10.20.193.110:0/3036424524 >> v1:10.20.193.188:6789/0 conn(0x7ff10005cd40 legacy=0x7ff10011fec0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:19:54.490 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.473+0000 7ff1088cc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:19:54.490 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.473+0000 7ff1088cc640 1 -- 10.20.193.110:0/3036424524 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff100055bb0 con 0x7ff1001205d0 2026-02-13T20:19:54.490 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.474+0000 7ff0eaffd640 1 -- 10.20.193.110:0/3036424524 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3345378258 0 0) 0x7ff100055bb0 con 0x7ff1001205d0 2026-02-13T20:19:54.490 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.474+0000 7ff0eaffd640 10 monclient(hunting): _negotiate 2026-02-13T20:19:54.490 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.474+0000 7ff0eaffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:19:54.491 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.474+0000 7ff0eaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:19:54.491 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.474+0000 7ff0eaffd640 10 monclient(hunting): my global_id is 4804 2026-02-13T20:19:54.491 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.474+0000 7ff0eaffd640 1 -- 10.20.193.110:0/3036424524 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff10005c330 con 0x7ff1001205d0 2026-02-13T20:19:54.491 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.474+0000 7ff0eaffd640 1 -- 10.20.193.110:0/3036424524 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1310964329 0 0) 0x7ff10005c330 con 0x7ff1001205d0 2026-02-13T20:19:54.491 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.474+0000 7ff0eaffd640 1 -- 10.20.193.110:0/3036424524 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff100055bb0 con 0x7ff1001205d0 2026-02-13T20:19:54.491 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.474+0000 7ff0eaffd640 1 -- 10.20.193.110:0/3036424524 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff0f8003af0 con 0x7ff1001205d0 2026-02-13T20:19:54.491 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.474+0000 7ff0eaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:19:54.491 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.474+0000 7ff0eaffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:19:54.491 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.474+0000 7ff0eaffd640 10 monclient: dump: 2026-02-13T20:19:54.491 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:19:54.491 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:19:54.491 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:54.491 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:19:54.491 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:19:54.492 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:19:54.492 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:19:54.492 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:19:54.492 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:19:54.492 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:19:54.492 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.474+0000 7ff0eaffd640 1 -- 10.20.193.110:0/3036424524 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2956762828 0 0) 0x7ff100055bb0 con 0x7ff1001205d0 2026-02-13T20:19:54.492 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.474+0000 7ff0eaffd640 1 -- 10.20.193.110:0/3036424524 --> v1:10.20.193.188:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff100058410 con 0x7ff1001205d0 2026-02-13T20:19:54.492 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.474+0000 7ff0eaffd640 1 -- 10.20.193.110:0/3036424524 <== mon.1 v1:10.20.193.188:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4672 (unknown 0 0 1299254217) 0x7ff0f8005880 con 0x7ff1001205d0 2026-02-13T20:19:54.492 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.474+0000 7ff0eaffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:19:54.492 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.474+0000 7ff0eaffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:19:54.492 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.474+0000 7ff0eaffd640 1 -- 10.20.193.110:0/3036424524 >> v1:10.20.193.188:6789/0 conn(0x7ff1001205d0 legacy=0x7ff100179cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:54.492 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.474+0000 7ff0eaffd640 1 -- 10.20.193.110:0/3036424524 >> v1:10.20.193.188:6789/0 conn(0x7ff1001205d0 legacy=0x7ff100179cf0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:19:54.493 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:19:54.493 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:19:54.493 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:19:54.493 INFO:teuthology.orchestra.run.trial110.stdout: "state": "leader", 2026-02-13T20:19:54.493 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 36, 2026-02-13T20:19:54.493 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 516621, 2026-02-13T20:19:54.493 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:19:54.493 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:19:54.493 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:19:54.493 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:19:54.494 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 0, 2026-02-13T20:19:54.494 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:19:54.494 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:19:54.494 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:19:54.494 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:19:54.494 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:19:54.494 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:19:54.494 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:19:54.494 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:19:54.494 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:19:54.494 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:19:54.494 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:19:54.495 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:19:54.495 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:19:54.495 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:19:54.495 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:19:54.495 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:19:54.495 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:19:54.495 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:19:54.495 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:19:54.495 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:19:54.495 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:19:54.495 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:19:54.495 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:19:54.496 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:19:54.496 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:19:54.496 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:19:54.496 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:19:54.496 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:19:54.496 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:19:54.496 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:19:54.496 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:19:54.496 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:19:54.496 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:19:54.496 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:54.496 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:19:54.496 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:19:54.497 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:19:54.497 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:19:54.497 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:19:54.497 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:19:54.497 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:19:54.497 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:19:54.497 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:19:54.497 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:19:54.497 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:19:54.497 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:19:54.497 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:19:54.497 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:19:54.497 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:19:54.498 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:19:54.498 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:19:54.498 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:19:54.498 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:19:54.498 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:19:54.498 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:19:54.498 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:19:54.498 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:19:54.498 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:19:54.498 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:19:54.498 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:19:54.498 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:19:54.498 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:19:54.498 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:19:54.498 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:19:54.499 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:19:54.499 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:19:54.499 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:54.499 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:19:54.499 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:54.499 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:19:54.499 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:19:54.499 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:19:54.499 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:19:54.499 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:54.499 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:19:54.499 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:19:54.499 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:19:54.499 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:54.499 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:19:54.499 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:54.500 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:19:54.500 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:19:54.500 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:19:54.500 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:19:54.500 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:19:54.500 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:19:54.500 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:54.500 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:54.500 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:19:54.500 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:19:54.500 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:19:54.500 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:19:54.500 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:54.500 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:19:54.500 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:19:54.500 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:19:54.501 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:54.501 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:19:54.501 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:54.501 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:19:54.501 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:19:54.501 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:19:54.501 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:19:54.501 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:19:54.501 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:19:54.501 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:54.501 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:54.501 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:19:54.501 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:19:54.501 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:19:54.501 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:19:54.501 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:54.501 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:19:54.502 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:19:54.502 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:19:54.502 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:54.502 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:19:54.502 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:54.502 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:19:54.502 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:19:54.502 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:19:54.502 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:19:54.502 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:19:54.502 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:19:54.502 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:54.502 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:19:54.502 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:54.502 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:19:54.502 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:19:54.503 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:54.503 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:19:54.503 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:19:54.503 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:19:54.503 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:54.503 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:19:54.503 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:19:54.503 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:54.503 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:19:54.503 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:19:54.503 INFO:teuthology.orchestra.run.trial110.stdout: "num": 4 2026-02-13T20:19:54.503 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:54.503 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:19:54.503 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:19:54.503 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:54.503 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:19:54.503 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:19:54.504 INFO:teuthology.orchestra.run.trial110.stdout: "num": 6 2026-02-13T20:19:54.504 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:54.504 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:19:54.504 INFO:teuthology.orchestra.run.trial110.stdout: "mgr": [ 2026-02-13T20:19:54.504 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:19:54.504 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:19:54.504 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:19:54.504 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:19:54.504 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:19:54.504 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:19:54.504 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:19:54.504 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:19:54.504 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:19:54.505 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.474+0000 7ff1088cc640 1 -- 10.20.193.110:0/3036424524 >> v1:10.20.193.188:6812/1623052694 conn(0x7ff0d003f570 legacy=0x7ff0d005fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:54.505 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.474+0000 7ff1088cc640 10 monclient: shutdown 2026-02-13T20:19:54.505 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.474+0000 7ff1088cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:19:54.506 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.474+0000 7ff1088cc640 1 -- 10.20.193.110:0/3036424524 >> v1:10.20.193.110:6790/0 conn(0x7ff100123e80 legacy=0x7ff1001775c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:19:54.506 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.474+0000 7ff106e42640 1 -- 10.20.193.110:0/3036424524 reap_dead start 2026-02-13T20:19:54.506 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.474+0000 7ff106e42640 1 -- 10.20.193.110:0/3036424524 reap_dead start 2026-02-13T20:19:54.506 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.474+0000 7ff1088cc640 1 -- 10.20.193.110:0/3036424524 shutdown_connections 2026-02-13T20:19:54.506 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.474+0000 7ff1088cc640 1 -- 10.20.193.110:0/3036424524 >> 10.20.193.110:0/3036424524 conn(0x7ff100054e90 msgr2=0x7ff100089f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:19:54.506 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.475+0000 7ff1088cc640 1 -- 10.20.193.110:0/3036424524 shutdown_connections 2026-02-13T20:19:54.506 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:19:54.475+0000 7ff1088cc640 1 -- 10.20.193.110:0/3036424524 wait complete. 2026-02-13T20:19:54.506 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-13T20:19:54.506 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-13T20:19:55.132 INFO:tasks.rados.rados.0.trial188.stdout:1866: done (0 left) 2026-02-13T20:19:55.133 INFO:tasks.rados.rados.0.trial188.stdout:1867: snap_create 2026-02-13T20:19:56.135 INFO:tasks.rados.rados.0.trial188.stdout:1867: done (0 left) 2026-02-13T20:19:56.135 INFO:tasks.rados.rados.0.trial188.stdout:1868: read oid 32 snap -1 2026-02-13T20:19:56.135 INFO:tasks.rados.rados.0.trial188.stdout:1868: expect (ObjNum 653 snap 176 seq_num 653) 2026-02-13T20:19:56.135 INFO:tasks.rados.rados.0.trial188.stdout:1869: write (excl) oid 16 current snap is 193 2026-02-13T20:19:56.135 INFO:tasks.rados.rados.0.trial188.stdout:1869: seq_num 675 ranges {544725=632139,1716169=522227,2736873=512491} 2026-02-13T20:19:56.139 INFO:tasks.rados.rados.0.trial188.stdout:1869: writing trial18843701-16 from 544725 to 1176864 tid 1 2026-02-13T20:19:56.143 INFO:tasks.rados.rados.0.trial188.stdout:1869: writing trial18843701-16 from 1716169 to 2238396 tid 2 2026-02-13T20:19:56.147 INFO:tasks.rados.rados.0.trial188.stdout:1869: writing trial18843701-16 from 2736873 to 3249364 tid 3 2026-02-13T20:19:56.147 INFO:tasks.rados.rados.0.trial188.stdout:1870: write (excl) oid 39 current snap is 193 2026-02-13T20:19:56.147 INFO:tasks.rados.rados.0.trial188.stdout:1870: seq_num 676 ranges {561532=707388,2058298=782238} 2026-02-13T20:19:56.152 INFO:tasks.rados.rados.0.trial188.stdout:1870: writing trial18843701-39 from 561532 to 1268920 tid 1 2026-02-13T20:19:56.158 INFO:tasks.rados.rados.0.trial188.stdout:1870: writing trial18843701-39 from 2058298 to 2840536 tid 2 2026-02-13T20:19:56.159 INFO:tasks.rados.rados.0.trial188.stdout:1871: snap_create 2026-02-13T20:19:56.159 INFO:tasks.rados.rados.0.trial188.stdout:1868: expect (ObjNum 653 snap 176 seq_num 653) 2026-02-13T20:19:56.171 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:19:56.193 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:19:56.215 INFO:tasks.rados.rados.0.trial188.stdout:1869: finishing write tid 1 to trial18843701-16 2026-02-13T20:19:56.216 INFO:tasks.rados.rados.0.trial188.stdout:1869: finishing write tid 2 to trial18843701-16 2026-02-13T20:19:56.216 INFO:tasks.rados.rados.0.trial188.stdout:1869: finishing write tid 3 to trial18843701-16 2026-02-13T20:19:56.216 INFO:tasks.rados.rados.0.trial188.stdout:1870: finishing write tid 1 to trial18843701-39 2026-02-13T20:19:56.216 INFO:tasks.rados.rados.0.trial188.stdout:1869: finishing write tid 4 to trial18843701-16 2026-02-13T20:19:56.216 INFO:tasks.rados.rados.0.trial188.stdout:1869: finishing write tid 5 to trial18843701-16 2026-02-13T20:19:56.216 INFO:tasks.rados.rados.0.trial188.stdout:1869: oid 16 updating version 0 to 810 2026-02-13T20:19:56.216 INFO:tasks.rados.rados.0.trial188.stdout:1869: oid 16 updating version 810 to 812 2026-02-13T20:19:56.216 INFO:tasks.rados.rados.0.trial188.stdout:1869: oid 16 updating version 812 to 813 2026-02-13T20:19:56.216 INFO:tasks.rados.rados.0.trial188.stdout:1869: oid 16 version 813 is already newer than 811 2026-02-13T20:19:56.216 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 16 v 813 (ObjNum 675 snap 193 seq_num 675) dirty exists 2026-02-13T20:19:56.216 INFO:tasks.rados.rados.0.trial188.stdout:1869: left oid 16 (ObjNum 675 snap 193 seq_num 675) 2026-02-13T20:19:56.217 INFO:tasks.rados.rados.0.trial188.stdout:1870: finishing write tid 2 to trial18843701-39 2026-02-13T20:19:56.217 INFO:tasks.rados.rados.0.trial188.stdout:1870: finishing write tid 3 to trial18843701-39 2026-02-13T20:19:56.217 INFO:tasks.rados.rados.0.trial188.stdout:1870: finishing write tid 4 to trial18843701-39 2026-02-13T20:19:56.217 INFO:tasks.rados.rados.0.trial188.stdout:1870: oid 39 updating version 0 to 694 2026-02-13T20:19:56.217 INFO:tasks.rados.rados.0.trial188.stdout:1870: oid 39 updating version 694 to 695 2026-02-13T20:19:56.217 INFO:tasks.rados.rados.0.trial188.stdout:1870: oid 39 version 695 is already newer than 693 2026-02-13T20:19:56.217 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 39 v 695 (ObjNum 676 snap 193 seq_num 676) dirty exists 2026-02-13T20:19:56.217 INFO:tasks.rados.rados.0.trial188.stdout:1870: left oid 39 (ObjNum 676 snap 193 seq_num 676) 2026-02-13T20:19:57.139 INFO:tasks.rados.rados.0.trial188.stdout:1868: done (3 left) 2026-02-13T20:19:57.140 INFO:tasks.rados.rados.0.trial188.stdout:1869: done (2 left) 2026-02-13T20:19:57.140 INFO:tasks.rados.rados.0.trial188.stdout:1870: done (1 left) 2026-02-13T20:19:57.140 INFO:tasks.rados.rados.0.trial188.stdout:1871: done (0 left) 2026-02-13T20:19:57.140 INFO:tasks.rados.rados.0.trial188.stdout:1872: rollback oid 19 current snap is 194 2026-02-13T20:19:57.140 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 19 to 181 2026-02-13T20:19:57.140 INFO:tasks.rados.rados.0.trial188.stdout:1873: snap_remove snap 190 2026-02-13T20:19:58.062 INFO:tasks.rados.rados.0.trial188.stdout:1873: done (1 left) 2026-02-13T20:19:58.062 INFO:tasks.rados.rados.0.trial188.stdout:1874: copy_from oid 2 from oid 33 current snap is 194 2026-02-13T20:19:58.062 INFO:tasks.rados.rados.0.trial188.stdout:1872: finishing rollback tid 0 to trial18843701-19 2026-02-13T20:19:58.062 INFO:tasks.rados.rados.0.trial188.stdout:1872: finishing rollback tid 1 to trial18843701-19 2026-02-13T20:19:58.062 INFO:tasks.rados.rados.0.trial188.stdout:1872: finishing rollback tid 2 to trial18843701-19 2026-02-13T20:19:58.062 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 19 v 699 (ObjNum 598 snap 159 seq_num 598) dirty exists 2026-02-13T20:19:58.062 INFO:tasks.rados.rados.0.trial188.stdout:1872: done (1 left) 2026-02-13T20:19:58.062 INFO:tasks.rados.rados.0.trial188.stdout:1875: write (excl) oid 38 current snap is 194 2026-02-13T20:19:58.062 INFO:tasks.rados.rados.0.trial188.stdout:1875: seq_num 677 ranges {578339=498990,1833133=525896,2791719=586620} 2026-02-13T20:19:58.065 INFO:tasks.rados.rados.0.trial188.stdout:1875: writing trial18843701-38 from 578339 to 1077329 tid 1 2026-02-13T20:19:58.070 INFO:tasks.rados.rados.0.trial188.stdout:1875: writing trial18843701-38 from 1833133 to 2359029 tid 2 2026-02-13T20:19:58.074 INFO:tasks.rados.rados.0.trial188.stdout:1875: writing trial18843701-38 from 2791719 to 3378339 tid 3 2026-02-13T20:19:58.075 INFO:tasks.rados.rados.0.trial188.stdout:1876: read oid 29 snap -1 2026-02-13T20:19:58.075 INFO:tasks.rados.rados.0.trial188.stdout:1876: expect (ObjNum 673 snap 187 seq_num 673) 2026-02-13T20:19:58.075 INFO:tasks.rados.rados.0.trial188.stdout:1877: write oid 7 current snap is 194 2026-02-13T20:19:58.075 INFO:tasks.rados.rados.0.trial188.stdout:1877: seq_num 678 ranges {595146=574239,1891615=669554,3219142=176004} 2026-02-13T20:19:58.079 INFO:tasks.rados.rados.0.trial188.stdout:1877: writing trial18843701-7 from 595146 to 1169385 tid 1 2026-02-13T20:19:58.084 INFO:tasks.rados.rados.0.trial188.stdout:1877: writing trial18843701-7 from 1891615 to 2561169 tid 2 2026-02-13T20:19:58.087 INFO:tasks.rados.rados.0.trial188.stdout:1877: writing trial18843701-7 from 3219142 to 3395146 tid 3 2026-02-13T20:19:58.088 INFO:tasks.rados.rados.0.trial188.stdout:1878: rollback oid 4 current snap is 194 2026-02-13T20:19:58.088 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 4 to 186 2026-02-13T20:19:58.088 INFO:tasks.rados.rados.0.trial188.stdout:1876: expect (ObjNum 673 snap 187 seq_num 673) 2026-02-13T20:19:58.115 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1837568 2026-02-13T20:19:58.131 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:19:58.180 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 118910 2026-02-13T20:19:58.229 INFO:tasks.rados.rados.0.trial188.stdout:1875: finishing write tid 1 to trial18843701-38 2026-02-13T20:19:58.230 INFO:tasks.rados.rados.0.trial188.stdout:1875: finishing write tid 2 to trial18843701-38 2026-02-13T20:19:58.230 INFO:tasks.rados.rados.0.trial188.stdout:1875: finishing write tid 3 to trial18843701-38 2026-02-13T20:19:58.230 INFO:tasks.rados.rados.0.trial188.stdout:1875: finishing write tid 4 to trial18843701-38 2026-02-13T20:19:58.230 INFO:tasks.rados.rados.0.trial188.stdout:1875: finishing write tid 5 to trial18843701-38 2026-02-13T20:19:58.230 INFO:tasks.rados.rados.0.trial188.stdout:1875: oid 38 updating version 0 to 806 2026-02-13T20:19:58.230 INFO:tasks.rados.rados.0.trial188.stdout:1875: oid 38 version 806 is already newer than 805 2026-02-13T20:19:58.230 INFO:tasks.rados.rados.0.trial188.stdout:1875: oid 38 version 806 is already newer than 803 2026-02-13T20:19:58.230 INFO:tasks.rados.rados.0.trial188.stdout:1875: oid 38 version 806 is already newer than 804 2026-02-13T20:19:58.230 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 38 v 806 (ObjNum 677 snap 194 seq_num 677) dirty exists 2026-02-13T20:19:58.230 INFO:tasks.rados.rados.0.trial188.stdout:1875: left oid 38 (ObjNum 677 snap 194 seq_num 677) 2026-02-13T20:19:58.231 INFO:tasks.rados.rados.0.trial188.stdout:1874: finishing copy_from racing read to trial18843701-2 2026-02-13T20:19:58.231 INFO:tasks.rados.rados.0.trial188.stdout:1874: finishing copy_from to trial18843701-2 2026-02-13T20:19:58.231 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 2 v 653 (ObjNum 639 snap 169 seq_num 639) dirty exists 2026-02-13T20:19:58.231 INFO:tasks.rados.rados.0.trial188.stdout:1877: finishing write tid 1 to trial18843701-7 2026-02-13T20:19:58.231 INFO:tasks.rados.rados.0.trial188.stdout:1877: finishing write tid 2 to trial18843701-7 2026-02-13T20:19:58.231 INFO:tasks.rados.rados.0.trial188.stdout:1874: done (4 left) 2026-02-13T20:19:58.231 INFO:tasks.rados.rados.0.trial188.stdout:1875: done (3 left) 2026-02-13T20:19:58.231 INFO:tasks.rados.rados.0.trial188.stdout:1876: done (2 left) 2026-02-13T20:19:58.231 INFO:tasks.rados.rados.0.trial188.stdout:1879: write oid 39 current snap is 194 2026-02-13T20:19:58.231 INFO:tasks.rados.rados.0.trial188.stdout:1877: finishing write tid 3 to trial18843701-7 2026-02-13T20:19:58.231 INFO:tasks.rados.rados.0.trial188.stdout:1879: seq_num 679 ranges {611953=649488,1950097=529565,3246565=165388} 2026-02-13T20:19:58.234 INFO:tasks.rados.rados.0.trial188.stdout:1879: writing trial18843701-39 from 611953 to 1261441 tid 1 2026-02-13T20:19:58.238 INFO:tasks.rados.rados.0.trial188.stdout:1879: writing trial18843701-39 from 1950097 to 2479662 tid 2 2026-02-13T20:19:58.242 INFO:tasks.rados.rados.0.trial188.stdout:1879: writing trial18843701-39 from 3246565 to 3411953 tid 3 2026-02-13T20:19:58.242 INFO:tasks.rados.rados.0.trial188.stdout:1880: write oid 41 current snap is 194 2026-02-13T20:19:58.242 INFO:tasks.rados.rados.0.trial188.stdout:1877: finishing write tid 4 to trial18843701-7 2026-02-13T20:19:58.242 INFO:tasks.rados.rados.0.trial188.stdout:1877: finishing write tid 5 to trial18843701-7 2026-02-13T20:19:58.243 INFO:tasks.rados.rados.0.trial188.stdout:1877: oid 7 updating version 0 to 705 2026-02-13T20:19:58.243 INFO:tasks.rados.rados.0.trial188.stdout:1877: oid 7 version 705 is already newer than 704 2026-02-13T20:19:58.243 INFO:tasks.rados.rados.0.trial188.stdout:1877: oid 7 updating version 705 to 707 2026-02-13T20:19:58.243 INFO:tasks.rados.rados.0.trial188.stdout:1877: oid 7 version 707 is already newer than 706 2026-02-13T20:19:58.243 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 7 v 707 (ObjNum 678 snap 194 seq_num 678) dirty exists 2026-02-13T20:19:58.243 INFO:tasks.rados.rados.0.trial188.stdout:1877: left oid 7 (ObjNum 678 snap 194 seq_num 678) 2026-02-13T20:19:58.243 INFO:tasks.rados.rados.0.trial188.stdout:1878: finishing rollback tid 0 to trial18843701-4 2026-02-13T20:19:58.243 INFO:tasks.rados.rados.0.trial188.stdout:1878: finishing rollback tid 1 to trial18843701-4 2026-02-13T20:19:58.243 INFO:tasks.rados.rados.0.trial188.stdout:1880: seq_num 680 ranges {628760=724737,1892226=673223,3157635=271125} 2026-02-13T20:19:58.247 INFO:tasks.rados.rados.0.trial188.stdout:1880: writing trial18843701-41 from 628760 to 1353497 tid 1 2026-02-13T20:19:58.251 INFO:tasks.rados.rados.0.trial188.stdout:1880: writing trial18843701-41 from 1892226 to 2565449 tid 2 2026-02-13T20:19:58.255 INFO:tasks.rados.rados.0.trial188.stdout:1880: writing trial18843701-41 from 3157635 to 3428760 tid 3 2026-02-13T20:19:58.255 INFO:tasks.rados.rados.0.trial188.stdout:1877: done (3 left) 2026-02-13T20:19:58.255 INFO:tasks.rados.rados.0.trial188.stdout:1881: snap_create 2026-02-13T20:19:58.255 INFO:tasks.rados.rados.0.trial188.stdout:1878: finishing rollback tid 2 to trial18843701-4 2026-02-13T20:19:58.255 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 4 v 749 (ObjNum 652 snap 176 seq_num 652) dirty exists 2026-02-13T20:19:58.255 INFO:tasks.rados.rados.0.trial188.stdout:1879: finishing write tid 1 to trial18843701-39 2026-02-13T20:19:58.255 INFO:tasks.rados.rados.0.trial188.stdout:1879: finishing write tid 2 to trial18843701-39 2026-02-13T20:19:58.255 INFO:tasks.rados.rados.0.trial188.stdout:1879: finishing write tid 3 to trial18843701-39 2026-02-13T20:19:58.255 INFO:tasks.rados.rados.0.trial188.stdout:1879: finishing write tid 4 to trial18843701-39 2026-02-13T20:19:58.255 INFO:tasks.rados.rados.0.trial188.stdout:1879: finishing write tid 5 to trial18843701-39 2026-02-13T20:19:58.255 INFO:tasks.rados.rados.0.trial188.stdout:1879: oid 39 updating version 0 to 712 2026-02-13T20:19:58.255 INFO:tasks.rados.rados.0.trial188.stdout:1879: oid 39 version 712 is already newer than 711 2026-02-13T20:19:58.255 INFO:tasks.rados.rados.0.trial188.stdout:1879: oid 39 version 712 is already newer than 710 2026-02-13T20:19:58.255 INFO:tasks.rados.rados.0.trial188.stdout:1879: oid 39 version 712 is already newer than 709 2026-02-13T20:19:58.255 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 39 v 712 (ObjNum 679 snap 194 seq_num 679) dirty exists 2026-02-13T20:19:58.255 INFO:tasks.rados.rados.0.trial188.stdout:1879: left oid 39 (ObjNum 679 snap 194 seq_num 679) 2026-02-13T20:19:58.271 INFO:tasks.rados.rados.0.trial188.stdout:1880: finishing write tid 1 to trial18843701-41 2026-02-13T20:19:58.271 INFO:tasks.rados.rados.0.trial188.stdout:1880: finishing write tid 2 to trial18843701-41 2026-02-13T20:19:58.272 INFO:tasks.rados.rados.0.trial188.stdout:1880: finishing write tid 3 to trial18843701-41 2026-02-13T20:19:58.272 INFO:tasks.rados.rados.0.trial188.stdout:1880: finishing write tid 4 to trial18843701-41 2026-02-13T20:19:58.272 INFO:tasks.rados.rados.0.trial188.stdout:1880: finishing write tid 5 to trial18843701-41 2026-02-13T20:19:58.272 INFO:tasks.rados.rados.0.trial188.stdout:1880: oid 41 updating version 0 to 746 2026-02-13T20:19:58.272 INFO:tasks.rados.rados.0.trial188.stdout:1880: oid 41 updating version 746 to 749 2026-02-13T20:19:58.272 INFO:tasks.rados.rados.0.trial188.stdout:1880: oid 41 version 749 is already newer than 747 2026-02-13T20:19:58.272 INFO:tasks.rados.rados.0.trial188.stdout:1880: oid 41 version 749 is already newer than 748 2026-02-13T20:19:58.272 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 41 v 749 (ObjNum 680 snap 194 seq_num 680) dirty exists 2026-02-13T20:19:58.272 INFO:tasks.rados.rados.0.trial188.stdout:1880: left oid 41 (ObjNum 680 snap 194 seq_num 680) 2026-02-13T20:19:59.142 INFO:tasks.rados.rados.0.trial188.stdout:1878: done (3 left) 2026-02-13T20:19:59.142 INFO:tasks.rados.rados.0.trial188.stdout:1879: done (2 left) 2026-02-13T20:19:59.143 INFO:tasks.rados.rados.0.trial188.stdout:1880: done (1 left) 2026-02-13T20:19:59.143 INFO:tasks.rados.rados.0.trial188.stdout:1881: done (0 left) 2026-02-13T20:19:59.143 INFO:tasks.rados.rados.0.trial188.stdout:1882: write (excl) oid 25 current snap is 195 2026-02-13T20:19:59.143 INFO:tasks.rados.rados.0.trial188.stdout:1882: seq_num 681 ranges {645567=799986,1950708=533234,3185058=260509} 2026-02-13T20:19:59.147 INFO:tasks.rados.rados.0.trial188.stdout:1882: writing trial18843701-25 from 645567 to 1445553 tid 1 2026-02-13T20:19:59.151 INFO:tasks.rados.rados.0.trial188.stdout:1882: writing trial18843701-25 from 1950708 to 2483942 tid 2 2026-02-13T20:19:59.155 INFO:tasks.rados.rados.0.trial188.stdout:1882: writing trial18843701-25 from 3185058 to 3445567 tid 3 2026-02-13T20:19:59.155 INFO:tasks.rados.rados.0.trial188.stdout:1883: read oid 20 snap -1 2026-02-13T20:19:59.155 INFO:tasks.rados.rados.0.trial188.stdout:1883: expect (ObjNum 634 snap 166 seq_num 634) 2026-02-13T20:19:59.156 INFO:tasks.rados.rados.0.trial188.stdout:1884: snap_remove snap 184 2026-02-13T20:20:00.149 INFO:tasks.rados.rados.0.trial188.stdout:1884: done (2 left) 2026-02-13T20:20:00.150 INFO:tasks.rados.rados.0.trial188.stdout:1885: write (excl) oid 13 current snap is 195 2026-02-13T20:20:00.150 INFO:tasks.rados.rados.0.trial188.stdout:1885: seq_num 682 ranges {662374=475235,1609190=676892,2812481=624101} 2026-02-13T20:20:00.153 INFO:tasks.rados.rados.0.trial188.stdout:1885: writing trial18843701-13 from 662374 to 1137609 tid 1 2026-02-13T20:20:00.158 INFO:tasks.rados.rados.0.trial188.stdout:1885: writing trial18843701-13 from 1609190 to 2286082 tid 2 2026-02-13T20:20:00.162 INFO:tasks.rados.rados.0.trial188.stdout:1885: writing trial18843701-13 from 2812481 to 3436582 tid 3 2026-02-13T20:20:00.162 INFO:tasks.rados.rados.0.trial188.stdout:1886: rollback oid 46 current snap is 195 2026-02-13T20:20:00.162 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 46 to 183 2026-02-13T20:20:00.162 INFO:tasks.rados.rados.0.trial188.stdout:1883: expect (ObjNum 634 snap 166 seq_num 634) 2026-02-13T20:20:00.162 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:20:00.328 INFO:tasks.rados.rados.0.trial188.stdout:1882: finishing write tid 1 to trial18843701-25 2026-02-13T20:20:00.329 INFO:tasks.rados.rados.0.trial188.stdout:1882: finishing write tid 2 to trial18843701-25 2026-02-13T20:20:00.329 INFO:tasks.rados.rados.0.trial188.stdout:1882: finishing write tid 3 to trial18843701-25 2026-02-13T20:20:00.329 INFO:tasks.rados.rados.0.trial188.stdout:1882: finishing write tid 4 to trial18843701-25 2026-02-13T20:20:00.329 INFO:tasks.rados.rados.0.trial188.stdout:1882: finishing write tid 5 to trial18843701-25 2026-02-13T20:20:00.329 INFO:tasks.rados.rados.0.trial188.stdout:1882: oid 25 updating version 0 to 808 2026-02-13T20:20:00.329 INFO:tasks.rados.rados.0.trial188.stdout:1882: oid 25 updating version 808 to 811 2026-02-13T20:20:00.329 INFO:tasks.rados.rados.0.trial188.stdout:1882: oid 25 version 811 is already newer than 809 2026-02-13T20:20:00.329 INFO:tasks.rados.rados.0.trial188.stdout:1882: oid 25 version 811 is already newer than 810 2026-02-13T20:20:00.329 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 25 v 811 (ObjNum 681 snap 195 seq_num 681) dirty exists 2026-02-13T20:20:00.330 INFO:tasks.rados.rados.0.trial188.stdout:1882: left oid 25 (ObjNum 681 snap 195 seq_num 681) 2026-02-13T20:20:00.330 INFO:tasks.rados.rados.0.trial188.stdout:1885: finishing write tid 1 to trial18843701-13 2026-02-13T20:20:00.330 INFO:tasks.rados.rados.0.trial188.stdout:1885: finishing write tid 2 to trial18843701-13 2026-02-13T20:20:00.330 INFO:tasks.rados.rados.0.trial188.stdout:1885: finishing write tid 3 to trial18843701-13 2026-02-13T20:20:00.330 INFO:tasks.rados.rados.0.trial188.stdout:1882: done (3 left) 2026-02-13T20:20:00.330 INFO:tasks.rados.rados.0.trial188.stdout:1883: done (2 left) 2026-02-13T20:20:00.330 INFO:tasks.rados.rados.0.trial188.stdout:1887: rollback oid 10 current snap is 195 2026-02-13T20:20:00.330 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 10 to 191 2026-02-13T20:20:00.330 INFO:tasks.rados.rados.0.trial188.stdout:1886: finishing rollback tid 0 to trial18843701-46 2026-02-13T20:20:00.330 INFO:tasks.rados.rados.0.trial188.stdout:1885: finishing write tid 4 to trial18843701-13 2026-02-13T20:20:00.330 INFO:tasks.rados.rados.0.trial188.stdout:1885: finishing write tid 5 to trial18843701-13 2026-02-13T20:20:00.330 INFO:tasks.rados.rados.0.trial188.stdout:1885: oid 13 updating version 0 to 775 2026-02-13T20:20:00.331 INFO:tasks.rados.rados.0.trial188.stdout:1885: oid 13 version 775 is already newer than 774 2026-02-13T20:20:00.331 INFO:tasks.rados.rados.0.trial188.stdout:1885: oid 13 version 775 is already newer than 773 2026-02-13T20:20:00.331 INFO:tasks.rados.rados.0.trial188.stdout:1885: oid 13 version 775 is already newer than 772 2026-02-13T20:20:00.331 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 13 v 775 (ObjNum 682 snap 195 seq_num 682) dirty exists 2026-02-13T20:20:00.331 INFO:tasks.rados.rados.0.trial188.stdout:1885: left oid 13 (ObjNum 682 snap 195 seq_num 682) 2026-02-13T20:20:00.331 INFO:tasks.rados.rados.0.trial188.stdout:1886: finishing rollback tid 1 to trial18843701-46 2026-02-13T20:20:00.331 INFO:tasks.rados.rados.0.trial188.stdout:1886: finishing rollback tid 2 to trial18843701-46 2026-02-13T20:20:00.331 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 46 v 752 (ObjNum 665 snap 179 seq_num 665) dirty exists 2026-02-13T20:20:00.331 INFO:tasks.rados.rados.0.trial188.stdout:1885: done (2 left) 2026-02-13T20:20:00.331 INFO:tasks.rados.rados.0.trial188.stdout:1886: done (1 left) 2026-02-13T20:20:00.331 INFO:tasks.rados.rados.0.trial188.stdout:1888: delete oid 48 current snap is 195 2026-02-13T20:20:00.332 INFO:tasks.rados.rados.0.trial188.stdout:1887: finishing rollback tid 0 to trial18843701-10 2026-02-13T20:20:00.332 INFO:tasks.rados.rados.0.trial188.stdout:1887: finishing rollback tid 1 to trial18843701-10 2026-02-13T20:20:00.333 INFO:tasks.rados.rados.0.trial188.stdout:1888: done (1 left) 2026-02-13T20:20:00.333 INFO:tasks.rados.rados.0.trial188.stdout:1889: copy_from oid 38 from oid 30 current snap is 195 2026-02-13T20:20:00.333 INFO:tasks.rados.rados.0.trial188.stdout:1890: snap_create 2026-02-13T20:20:00.333 INFO:tasks.rados.rados.0.trial188.stdout:1887: finishing rollback tid 2 to trial18843701-10 2026-02-13T20:20:00.333 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 10 v 752 (ObjNum 618 snap 163 seq_num 618) dirty exists 2026-02-13T20:20:00.351 INFO:tasks.rados.rados.0.trial188.stdout:1889: finishing copy_from racing read to trial18843701-38 2026-02-13T20:20:00.353 INFO:tasks.rados.rados.0.trial188.stdout:1889: finishing copy_from to trial18843701-38 2026-02-13T20:20:00.353 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 38 v 729 (ObjNum 635 snap 166 seq_num 635) dirty exists 2026-02-13T20:20:01.152 INFO:tasks.rados.rados.0.trial188.stdout:1887: done (2 left) 2026-02-13T20:20:01.152 INFO:tasks.rados.rados.0.trial188.stdout:1889: done (1 left) 2026-02-13T20:20:01.152 INFO:tasks.rados.rados.0.trial188.stdout:1890: done (0 left) 2026-02-13T20:20:01.152 INFO:tasks.rados.rados.0.trial188.stdout:1891: copy_from oid 43 from oid 17 current snap is 196 2026-02-13T20:20:01.152 INFO:tasks.rados.rados.0.trial188.stdout:1892: snap_create 2026-02-13T20:20:01.154 INFO:tasks.rados.rados.0.trial188.stdout:1891: finishing copy_from to trial18843701-43 2026-02-13T20:20:01.154 INFO:tasks.rados.rados.0.trial188.stdout:1891: got expected ENOENT (src dne) 2026-02-13T20:20:01.154 INFO:tasks.rados.rados.0.trial188.stdout:1891: finishing copy_from racing read to trial18843701-43 2026-02-13T20:20:02.152 INFO:tasks.rados.rados.0.trial188.stdout:1891: done (1 left) 2026-02-13T20:20:02.152 INFO:tasks.rados.rados.0.trial188.stdout:1892: done (0 left) 2026-02-13T20:20:02.152 INFO:tasks.rados.rados.0.trial188.stdout:1893: read oid 24 snap -1 2026-02-13T20:20:02.152 INFO:tasks.rados.rados.0.trial188.stdout:1893: expect (ObjNum 671 snap 185 seq_num 671) 2026-02-13T20:20:02.152 INFO:tasks.rados.rados.0.trial188.stdout:1894: write (excl) oid 48 current snap is 197 2026-02-13T20:20:02.152 INFO:tasks.rados.rados.0.trial188.stdout:1894: seq_num 684 ranges {695988=625733,2009801=680561,3150974=345014} 2026-02-13T20:20:02.158 INFO:tasks.rados.rados.0.trial188.stdout:1894: writing trial18843701-48 from 695988 to 1321721 tid 1 2026-02-13T20:20:02.163 INFO:tasks.rados.rados.0.trial188.stdout:1894: writing trial18843701-48 from 2009801 to 2690362 tid 2 2026-02-13T20:20:02.166 INFO:tasks.rados.rados.0.trial188.stdout:1894: writing trial18843701-48 from 3150974 to 3495988 tid 3 2026-02-13T20:20:02.166 INFO:tasks.rados.rados.0.trial188.stdout:1895: rollback oid 33 current snap is 197 2026-02-13T20:20:02.166 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 33 to 186 2026-02-13T20:20:02.166 INFO:tasks.rados.rados.0.trial188.stdout:1893: expect (ObjNum 671 snap 185 seq_num 671) 2026-02-13T20:20:02.166 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:20:02.192 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:20:02.240 INFO:tasks.rados.rados.0.trial188.stdout:1895: finishing rollback tid 0 to trial18843701-33 2026-02-13T20:20:02.240 INFO:tasks.rados.rados.0.trial188.stdout:1895: finishing rollback tid 1 to trial18843701-33 2026-02-13T20:20:02.241 INFO:tasks.rados.rados.0.trial188.stdout:1895: finishing rollback tid 2 to trial18843701-33 2026-02-13T20:20:02.241 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 33 v 656 (ObjNum 639 snap 169 seq_num 639) dirty exists 2026-02-13T20:20:02.241 INFO:tasks.rados.rados.0.trial188.stdout:1894: finishing write tid 1 to trial18843701-48 2026-02-13T20:20:02.241 INFO:tasks.rados.rados.0.trial188.stdout:1894: finishing write tid 2 to trial18843701-48 2026-02-13T20:20:02.241 INFO:tasks.rados.rados.0.trial188.stdout:1893: done (2 left) 2026-02-13T20:20:02.241 INFO:tasks.rados.rados.0.trial188.stdout:1895: done (1 left) 2026-02-13T20:20:02.241 INFO:tasks.rados.rados.0.trial188.stdout:1896: delete oid 40 current snap is 197 2026-02-13T20:20:02.241 INFO:tasks.rados.rados.0.trial188.stdout:1894: finishing write tid 3 to trial18843701-48 2026-02-13T20:20:02.241 INFO:tasks.rados.rados.0.trial188.stdout:1894: finishing write tid 4 to trial18843701-48 2026-02-13T20:20:02.241 INFO:tasks.rados.rados.0.trial188.stdout:1894: finishing write tid 5 to trial18843701-48 2026-02-13T20:20:02.241 INFO:tasks.rados.rados.0.trial188.stdout:1894: oid 48 updating version 0 to 470 2026-02-13T20:20:02.242 INFO:tasks.rados.rados.0.trial188.stdout:1894: oid 48 updating version 470 to 471 2026-02-13T20:20:02.242 INFO:tasks.rados.rados.0.trial188.stdout:1894: oid 48 updating version 471 to 473 2026-02-13T20:20:02.242 INFO:tasks.rados.rados.0.trial188.stdout:1894: oid 48 version 473 is already newer than 472 2026-02-13T20:20:02.242 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 48 v 473 (ObjNum 684 snap 197 seq_num 684) dirty exists 2026-02-13T20:20:02.242 INFO:tasks.rados.rados.0.trial188.stdout:1894: left oid 48 (ObjNum 684 snap 197 seq_num 684) 2026-02-13T20:20:02.243 INFO:tasks.rados.rados.0.trial188.stdout:1894: done (1 left) 2026-02-13T20:20:02.243 INFO:tasks.rados.rados.0.trial188.stdout:1896: done (0 left) 2026-02-13T20:20:02.243 INFO:tasks.rados.rados.0.trial188.stdout:1897: read oid 32 snap -1 2026-02-13T20:20:02.243 INFO:tasks.rados.rados.0.trial188.stdout:1897: expect (ObjNum 653 snap 176 seq_num 653) 2026-02-13T20:20:02.243 INFO:tasks.rados.rados.0.trial188.stdout:1898: snap_create 2026-02-13T20:20:02.243 INFO:tasks.rados.rados.0.trial188.stdout:1897: expect (ObjNum 653 snap 176 seq_num 653) 2026-02-13T20:20:02.275 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:20:03.063 INFO:tasks.rados.rados.0.trial188.stdout:1897: done (1 left) 2026-02-13T20:20:03.063 INFO:tasks.rados.rados.0.trial188.stdout:1898: done (0 left) 2026-02-13T20:20:03.063 INFO:tasks.rados.rados.0.trial188.stdout:1899: snap_remove snap 195 2026-02-13T20:20:04.062 INFO:tasks.rados.rados.0.trial188.stdout:1899: done (0 left) 2026-02-13T20:20:04.063 INFO:tasks.rados.rados.0.trial188.stdout:1900: read oid 43 snap -1 2026-02-13T20:20:04.063 INFO:tasks.rados.rados.0.trial188.stdout:1900: expect (ObjNum 598 snap 159 seq_num 598) 2026-02-13T20:20:04.063 INFO:tasks.rados.rados.0.trial188.stdout:1901: read oid 35 snap 191 2026-02-13T20:20:04.063 INFO:tasks.rados.rados.0.trial188.stdout:1901: expect (ObjNum 618 snap 163 seq_num 618) 2026-02-13T20:20:04.063 INFO:tasks.rados.rados.0.trial188.stdout:1902: delete oid 3 current snap is 198 2026-02-13T20:20:04.065 INFO:tasks.rados.rados.0.trial188.stdout:1901: expect (ObjNum 618 snap 163 seq_num 618) 2026-02-13T20:20:04.091 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:20:04.140 INFO:tasks.rados.rados.0.trial188.stdout:1900: expect (ObjNum 598 snap 159 seq_num 598) 2026-02-13T20:20:04.142 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 556717 2026-02-13T20:20:04.152 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:20:04.181 INFO:tasks.rados.rados.0.trial188.stdout:1900: done (2 left) 2026-02-13T20:20:04.181 INFO:tasks.rados.rados.0.trial188.stdout:1901: done (1 left) 2026-02-13T20:20:04.181 INFO:tasks.rados.rados.0.trial188.stdout:1902: done (0 left) 2026-02-13T20:20:04.181 INFO:tasks.rados.rados.0.trial188.stdout:1903: snap_create 2026-02-13T20:20:05.066 INFO:tasks.rados.rados.0.trial188.stdout:1903: done (0 left) 2026-02-13T20:20:05.066 INFO:tasks.rados.rados.0.trial188.stdout:1904: rollback oid 45 current snap is 199 2026-02-13T20:20:05.066 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 45 to 189 2026-02-13T20:20:05.067 INFO:tasks.rados.rados.0.trial188.stdout:1905: delete oid 50 current snap is 199 2026-02-13T20:20:05.067 INFO:tasks.rados.rados.0.trial188.stdout:1904: finishing rollback tid 1 to trial18843701-45 2026-02-13T20:20:05.067 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 45 v 0 (ObjNum 881 snap 0 seq_num 16197285) dirty dne 2026-02-13T20:20:05.069 INFO:tasks.rados.rados.0.trial188.stdout:1904: done (1 left) 2026-02-13T20:20:05.069 INFO:tasks.rados.rados.0.trial188.stdout:1905: done (0 left) 2026-02-13T20:20:05.069 INFO:tasks.rados.rados.0.trial188.stdout:1906: write oid 19 current snap is 199 2026-02-13T20:20:05.069 INFO:tasks.rados.rados.0.trial188.stdout:1906: seq_num 688 ranges {763216=643082,1843729=687899,3260666=302550} 2026-02-13T20:20:05.074 INFO:tasks.rados.rados.0.trial188.stdout:1906: writing trial18843701-19 from 763216 to 1406298 tid 1 2026-02-13T20:20:05.078 INFO:tasks.rados.rados.0.trial188.stdout:1906: writing trial18843701-19 from 1843729 to 2531628 tid 2 2026-02-13T20:20:05.082 INFO:tasks.rados.rados.0.trial188.stdout:1906: writing trial18843701-19 from 3260666 to 3563216 tid 3 2026-02-13T20:20:05.082 INFO:tasks.rados.rados.0.trial188.stdout:1907: delete oid 30 current snap is 199 2026-02-13T20:20:05.085 INFO:tasks.rados.rados.0.trial188.stdout:1907: done (1 left) 2026-02-13T20:20:05.085 INFO:tasks.rados.rados.0.trial188.stdout:1908: write oid 46 current snap is 199 2026-02-13T20:20:05.085 INFO:tasks.rados.rados.0.trial188.stdout:1908: seq_num 690 ranges {796830=793580,2360693=691568} 2026-02-13T20:20:05.090 INFO:tasks.rados.rados.0.trial188.stdout:1908: writing trial18843701-46 from 796830 to 1590410 tid 1 2026-02-13T20:20:05.096 INFO:tasks.rados.rados.0.trial188.stdout:1908: writing trial18843701-46 from 2360693 to 3052261 tid 2 2026-02-13T20:20:05.096 INFO:tasks.rados.rados.0.trial188.stdout:1909: read oid 29 snap -1 2026-02-13T20:20:05.097 INFO:tasks.rados.rados.0.trial188.stdout:1909: expect (ObjNum 673 snap 187 seq_num 673) 2026-02-13T20:20:05.097 INFO:tasks.rados.rados.0.trial188.stdout:1910: write (excl) oid 26 current snap is 199 2026-02-13T20:20:05.097 INFO:tasks.rados.rados.0.trial188.stdout:1910: seq_num 691 ranges {413637=468829,1619175=435226,2542935=758255} 2026-02-13T20:20:05.099 INFO:tasks.rados.rados.0.trial188.stdout:1910: writing trial18843701-26 from 413637 to 882466 tid 1 2026-02-13T20:20:05.103 INFO:tasks.rados.rados.0.trial188.stdout:1910: writing trial18843701-26 from 1619175 to 2054401 tid 2 2026-02-13T20:20:05.109 INFO:tasks.rados.rados.0.trial188.stdout:1910: writing trial18843701-26 from 2542935 to 3301190 tid 3 2026-02-13T20:20:05.109 INFO:tasks.rados.rados.0.trial188.stdout:1911: read oid 11 snap -1 2026-02-13T20:20:05.109 INFO:tasks.rados.rados.0.trial188.stdout:1911: expect deleted 2026-02-13T20:20:05.109 INFO:tasks.rados.rados.0.trial188.stdout:1912: snap_remove snap 187 2026-02-13T20:20:06.072 INFO:tasks.rados.rados.0.trial188.stdout:1912: done (5 left) 2026-02-13T20:20:06.072 INFO:tasks.rados.rados.0.trial188.stdout:1913: delete oid 17 current snap is 199 2026-02-13T20:20:06.072 INFO:tasks.rados.rados.0.trial188.stdout:1906: finishing write tid 1 to trial18843701-19 2026-02-13T20:20:06.072 INFO:tasks.rados.rados.0.trial188.stdout:1906: finishing write tid 2 to trial18843701-19 2026-02-13T20:20:06.072 INFO:tasks.rados.rados.0.trial188.stdout:1906: finishing write tid 3 to trial18843701-19 2026-02-13T20:20:06.072 INFO:tasks.rados.rados.0.trial188.stdout:1906: finishing write tid 4 to trial18843701-19 2026-02-13T20:20:06.072 INFO:tasks.rados.rados.0.trial188.stdout:1906: finishing write tid 5 to trial18843701-19 2026-02-13T20:20:06.072 INFO:tasks.rados.rados.0.trial188.stdout:1906: oid 19 updating version 0 to 720 2026-02-13T20:20:06.072 INFO:tasks.rados.rados.0.trial188.stdout:1906: oid 19 updating version 720 to 721 2026-02-13T20:20:06.072 INFO:tasks.rados.rados.0.trial188.stdout:1906: oid 19 updating version 721 to 723 2026-02-13T20:20:06.072 INFO:tasks.rados.rados.0.trial188.stdout:1906: oid 19 version 723 is already newer than 722 2026-02-13T20:20:06.072 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 19 v 723 (ObjNum 688 snap 199 seq_num 688) dirty exists 2026-02-13T20:20:06.072 INFO:tasks.rados.rados.0.trial188.stdout:1906: left oid 19 (ObjNum 688 snap 199 seq_num 688) 2026-02-13T20:20:06.072 INFO:tasks.rados.rados.0.trial188.stdout:1909: expect (ObjNum 673 snap 187 seq_num 673) 2026-02-13T20:20:06.218 INFO:tasks.rados.rados.0.trial188.stdout:1910: finishing write tid 1 to trial18843701-26 2026-02-13T20:20:06.218 INFO:tasks.rados.rados.0.trial188.stdout:1908: finishing write tid 1 to trial18843701-46 2026-02-13T20:20:06.218 INFO:tasks.rados.rados.0.trial188.stdout:1908: finishing write tid 2 to trial18843701-46 2026-02-13T20:20:06.218 INFO:tasks.rados.rados.0.trial188.stdout:1908: finishing write tid 3 to trial18843701-46 2026-02-13T20:20:06.218 INFO:tasks.rados.rados.0.trial188.stdout:1906: done (5 left) 2026-02-13T20:20:06.218 INFO:tasks.rados.rados.0.trial188.stdout:1909: done (4 left) 2026-02-13T20:20:06.218 INFO:tasks.rados.rados.0.trial188.stdout:1911: done (3 left) 2026-02-13T20:20:06.218 INFO:tasks.rados.rados.0.trial188.stdout:1913: done (2 left) 2026-02-13T20:20:06.218 INFO:tasks.rados.rados.0.trial188.stdout:1914: write (excl) oid 12 current snap is 199 2026-02-13T20:20:06.218 INFO:tasks.rados.rados.0.trial188.stdout:1914: seq_num 693 ranges {447251=735680,1736139=438895,2597781=780799} 2026-02-13T20:20:06.222 INFO:tasks.rados.rados.0.trial188.stdout:1914: writing trial18843701-12 from 447251 to 1182931 tid 1 2026-02-13T20:20:06.226 INFO:tasks.rados.rados.0.trial188.stdout:1914: writing trial18843701-12 from 1736139 to 2175034 tid 2 2026-02-13T20:20:06.231 INFO:tasks.rados.rados.0.trial188.stdout:1914: writing trial18843701-12 from 2597781 to 3378580 tid 3 2026-02-13T20:20:06.231 INFO:tasks.rados.rados.0.trial188.stdout:1915: write (excl) oid 10 current snap is 199 2026-02-13T20:20:06.231 INFO:tasks.rados.rados.0.trial188.stdout:1908: finishing write tid 4 to trial18843701-46 2026-02-13T20:20:06.231 INFO:tasks.rados.rados.0.trial188.stdout:1908: oid 46 updating version 0 to 754 2026-02-13T20:20:06.231 INFO:tasks.rados.rados.0.trial188.stdout:1908: oid 46 updating version 754 to 755 2026-02-13T20:20:06.231 INFO:tasks.rados.rados.0.trial188.stdout:1908: oid 46 version 755 is already newer than 753 2026-02-13T20:20:06.231 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 46 v 755 (ObjNum 690 snap 199 seq_num 690) dirty exists 2026-02-13T20:20:06.231 INFO:tasks.rados.rados.0.trial188.stdout:1908: left oid 46 (ObjNum 690 snap 199 seq_num 690) 2026-02-13T20:20:06.231 INFO:tasks.rados.rados.0.trial188.stdout:1910: finishing write tid 2 to trial18843701-26 2026-02-13T20:20:06.231 INFO:tasks.rados.rados.0.trial188.stdout:1915: seq_num 694 ranges {464058=410929,1394621=698906,2625204=592071,3656107=7951} 2026-02-13T20:20:06.234 INFO:tasks.rados.rados.0.trial188.stdout:1915: writing trial18843701-10 from 464058 to 874987 tid 1 2026-02-13T20:20:06.238 INFO:tasks.rados.rados.0.trial188.stdout:1915: writing trial18843701-10 from 1394621 to 2093527 tid 2 2026-02-13T20:20:06.242 INFO:tasks.rados.rados.0.trial188.stdout:1915: writing trial18843701-10 from 2625204 to 3217275 tid 3 2026-02-13T20:20:06.245 INFO:tasks.rados.rados.0.trial188.stdout:1915: writing trial18843701-10 from 3656107 to 3664058 tid 4 2026-02-13T20:20:06.245 INFO:tasks.rados.rados.0.trial188.stdout:1908: done (3 left) 2026-02-13T20:20:06.245 INFO:tasks.rados.rados.0.trial188.stdout:1916: read oid 39 snap -1 2026-02-13T20:20:06.245 INFO:tasks.rados.rados.0.trial188.stdout:1916: expect (ObjNum 679 snap 194 seq_num 679) 2026-02-13T20:20:06.245 INFO:tasks.rados.rados.0.trial188.stdout:1917: read oid 22 snap -1 2026-02-13T20:20:06.245 INFO:tasks.rados.rados.0.trial188.stdout:1917: expect deleted 2026-02-13T20:20:06.246 INFO:tasks.rados.rados.0.trial188.stdout:1918: read oid 8 snap 177 2026-02-13T20:20:06.246 INFO:tasks.rados.rados.0.trial188.stdout:1918: expect (ObjNum 623 snap 166 seq_num 623) 2026-02-13T20:20:06.246 INFO:tasks.rados.rados.0.trial188.stdout:1919: delete oid 48 current snap is 199 2026-02-13T20:20:06.246 INFO:tasks.rados.rados.0.trial188.stdout:1910: finishing write tid 3 to trial18843701-26 2026-02-13T20:20:06.246 INFO:tasks.rados.rados.0.trial188.stdout:1910: finishing write tid 4 to trial18843701-26 2026-02-13T20:20:06.246 INFO:tasks.rados.rados.0.trial188.stdout:1910: finishing write tid 5 to trial18843701-26 2026-02-13T20:20:06.246 INFO:tasks.rados.rados.0.trial188.stdout:1910: oid 26 updating version 0 to 746 2026-02-13T20:20:06.246 INFO:tasks.rados.rados.0.trial188.stdout:1910: oid 26 updating version 746 to 748 2026-02-13T20:20:06.246 INFO:tasks.rados.rados.0.trial188.stdout:1910: oid 26 updating version 748 to 749 2026-02-13T20:20:06.246 INFO:tasks.rados.rados.0.trial188.stdout:1910: oid 26 version 749 is already newer than 747 2026-02-13T20:20:06.246 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 26 v 749 (ObjNum 691 snap 199 seq_num 691) dirty exists 2026-02-13T20:20:06.246 INFO:tasks.rados.rados.0.trial188.stdout:1910: left oid 26 (ObjNum 691 snap 199 seq_num 691) 2026-02-13T20:20:06.251 INFO:tasks.rados.rados.0.trial188.stdout:1918: expect (ObjNum 623 snap 166 seq_num 623) 2026-02-13T20:20:06.270 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1304586 2026-02-13T20:20:06.307 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:20:06.366 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:20:06.425 INFO:tasks.rados.rados.0.trial188.stdout:1914: finishing write tid 1 to trial18843701-12 2026-02-13T20:20:06.425 INFO:tasks.rados.rados.0.trial188.stdout:1914: finishing write tid 2 to trial18843701-12 2026-02-13T20:20:06.425 INFO:tasks.rados.rados.0.trial188.stdout:1914: finishing write tid 3 to trial18843701-12 2026-02-13T20:20:06.425 INFO:tasks.rados.rados.0.trial188.stdout:1914: finishing write tid 4 to trial18843701-12 2026-02-13T20:20:06.425 INFO:tasks.rados.rados.0.trial188.stdout:1914: finishing write tid 5 to trial18843701-12 2026-02-13T20:20:06.425 INFO:tasks.rados.rados.0.trial188.stdout:1914: oid 12 updating version 0 to 588 2026-02-13T20:20:06.425 INFO:tasks.rados.rados.0.trial188.stdout:1914: oid 12 updating version 588 to 589 2026-02-13T20:20:06.425 INFO:tasks.rados.rados.0.trial188.stdout:1914: oid 12 version 589 is already newer than 587 2026-02-13T20:20:06.425 INFO:tasks.rados.rados.0.trial188.stdout:1914: oid 12 updating version 589 to 590 2026-02-13T20:20:06.425 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 12 v 590 (ObjNum 693 snap 199 seq_num 693) dirty exists 2026-02-13T20:20:06.425 INFO:tasks.rados.rados.0.trial188.stdout:1914: left oid 12 (ObjNum 693 snap 199 seq_num 693) 2026-02-13T20:20:06.425 INFO:tasks.rados.rados.0.trial188.stdout:1915: finishing write tid 1 to trial18843701-10 2026-02-13T20:20:06.425 INFO:tasks.rados.rados.0.trial188.stdout:1915: finishing write tid 2 to trial18843701-10 2026-02-13T20:20:06.425 INFO:tasks.rados.rados.0.trial188.stdout:1910: done (6 left) 2026-02-13T20:20:06.425 INFO:tasks.rados.rados.0.trial188.stdout:1914: done (5 left) 2026-02-13T20:20:06.425 INFO:tasks.rados.rados.0.trial188.stdout:1917: done (4 left) 2026-02-13T20:20:06.425 INFO:tasks.rados.rados.0.trial188.stdout:1918: done (3 left) 2026-02-13T20:20:06.426 INFO:tasks.rados.rados.0.trial188.stdout:1919: done (2 left) 2026-02-13T20:20:06.426 INFO:tasks.rados.rados.0.trial188.stdout:1920: delete oid 15 current snap is 199 2026-02-13T20:20:06.426 INFO:tasks.rados.rados.0.trial188.stdout:1915: finishing write tid 3 to trial18843701-10 2026-02-13T20:20:06.426 INFO:tasks.rados.rados.0.trial188.stdout:1915: finishing write tid 4 to trial18843701-10 2026-02-13T20:20:06.426 INFO:tasks.rados.rados.0.trial188.stdout:1915: finishing write tid 5 to trial18843701-10 2026-02-13T20:20:06.426 INFO:tasks.rados.rados.0.trial188.stdout:1915: finishing write tid 6 to trial18843701-10 2026-02-13T20:20:06.426 INFO:tasks.rados.rados.0.trial188.stdout:1915: oid 10 updating version 0 to 756 2026-02-13T20:20:06.426 INFO:tasks.rados.rados.0.trial188.stdout:1915: oid 10 updating version 756 to 757 2026-02-13T20:20:06.426 INFO:tasks.rados.rados.0.trial188.stdout:1915: oid 10 version 757 is already newer than 754 2026-02-13T20:20:06.426 INFO:tasks.rados.rados.0.trial188.stdout:1915: oid 10 version 757 is already newer than 753 2026-02-13T20:20:06.426 INFO:tasks.rados.rados.0.trial188.stdout:1915: oid 10 version 757 is already newer than 755 2026-02-13T20:20:06.426 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 10 v 757 (ObjNum 694 snap 199 seq_num 694) dirty exists 2026-02-13T20:20:06.426 INFO:tasks.rados.rados.0.trial188.stdout:1915: left oid 10 (ObjNum 694 snap 199 seq_num 694) 2026-02-13T20:20:06.426 INFO:tasks.rados.rados.0.trial188.stdout:1916: expect (ObjNum 679 snap 194 seq_num 679) 2026-02-13T20:20:06.573 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:20:06.647 INFO:tasks.rados.rados.0.trial188.stdout:1915: done (2 left) 2026-02-13T20:20:06.647 INFO:tasks.rados.rados.0.trial188.stdout:1916: done (1 left) 2026-02-13T20:20:06.647 INFO:tasks.rados.rados.0.trial188.stdout:1920: done (0 left) 2026-02-13T20:20:06.648 INFO:tasks.rados.rados.0.trial188.stdout:1921: delete oid 47 current snap is 199 2026-02-13T20:20:06.648 INFO:tasks.rados.rados.0.trial188.stdout:1921: done (0 left) 2026-02-13T20:20:06.649 INFO:tasks.rados.rados.0.trial188.stdout:1922: rollback oid 8 current snap is 199 2026-02-13T20:20:06.649 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 8 to 181 2026-02-13T20:20:06.649 INFO:tasks.rados.rados.0.trial188.stdout:1923: write (excl) oid 45 current snap is 199 2026-02-13T20:20:06.649 INFO:tasks.rados.rados.0.trial188.stdout:1923: seq_num 698 ranges {531286=711925,1912196=706244,3018543=712743} 2026-02-13T20:20:06.653 INFO:tasks.rados.rados.0.trial188.stdout:1923: writing trial18843701-45 from 531286 to 1243211 tid 1 2026-02-13T20:20:06.658 INFO:tasks.rados.rados.0.trial188.stdout:1923: writing trial18843701-45 from 1912196 to 2618440 tid 2 2026-02-13T20:20:06.663 INFO:tasks.rados.rados.0.trial188.stdout:1923: writing trial18843701-45 from 3018543 to 3731286 tid 3 2026-02-13T20:20:06.663 INFO:tasks.rados.rados.0.trial188.stdout:1924: read oid 1 snap -1 2026-02-13T20:20:06.663 INFO:tasks.rados.rados.0.trial188.stdout:1924: expect deleted 2026-02-13T20:20:06.663 INFO:tasks.rados.rados.0.trial188.stdout:1925: write (excl) oid 47 current snap is 199 2026-02-13T20:20:06.663 INFO:tasks.rados.rados.0.trial188.stdout:1922: finishing rollback tid 0 to trial18843701-8 2026-02-13T20:20:06.663 INFO:tasks.rados.rados.0.trial188.stdout:1922: finishing rollback tid 1 to trial18843701-8 2026-02-13T20:20:06.663 INFO:tasks.rados.rados.0.trial188.stdout:1922: finishing rollback tid 2 to trial18843701-8 2026-02-13T20:20:06.663 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 8 v 703 (ObjNum 623 snap 166 seq_num 623) dirty exists 2026-02-13T20:20:06.664 INFO:tasks.rados.rados.0.trial188.stdout:1925: seq_num 699 ranges {548093=787174,1970678=449902,3045966=681137} 2026-02-13T20:20:06.667 INFO:tasks.rados.rados.0.trial188.stdout:1925: writing trial18843701-47 from 548093 to 1335267 tid 1 2026-02-13T20:20:06.671 INFO:tasks.rados.rados.0.trial188.stdout:1925: writing trial18843701-47 from 1970678 to 2420580 tid 2 2026-02-13T20:20:06.676 INFO:tasks.rados.rados.0.trial188.stdout:1925: writing trial18843701-47 from 3045966 to 3727103 tid 3 2026-02-13T20:20:06.676 INFO:tasks.rados.rados.0.trial188.stdout:1922: done (3 left) 2026-02-13T20:20:06.676 INFO:tasks.rados.rados.0.trial188.stdout:1926: delete oid 7 current snap is 199 2026-02-13T20:20:06.682 INFO:tasks.rados.rados.0.trial188.stdout:1923: finishing write tid 1 to trial18843701-45 2026-02-13T20:20:06.682 INFO:tasks.rados.rados.0.trial188.stdout:1923: finishing write tid 2 to trial18843701-45 2026-02-13T20:20:06.683 INFO:tasks.rados.rados.0.trial188.stdout:1923: finishing write tid 3 to trial18843701-45 2026-02-13T20:20:06.683 INFO:tasks.rados.rados.0.trial188.stdout:1923: finishing write tid 4 to trial18843701-45 2026-02-13T20:20:06.683 INFO:tasks.rados.rados.0.trial188.stdout:1923: finishing write tid 5 to trial18843701-45 2026-02-13T20:20:06.683 INFO:tasks.rados.rados.0.trial188.stdout:1923: oid 45 updating version 0 to 706 2026-02-13T20:20:06.683 INFO:tasks.rados.rados.0.trial188.stdout:1923: oid 45 version 706 is already newer than 705 2026-02-13T20:20:06.683 INFO:tasks.rados.rados.0.trial188.stdout:1923: oid 45 updating version 706 to 707 2026-02-13T20:20:06.683 INFO:tasks.rados.rados.0.trial188.stdout:1923: oid 45 version 707 is already newer than 704 2026-02-13T20:20:06.683 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 45 v 707 (ObjNum 698 snap 199 seq_num 698) dirty exists 2026-02-13T20:20:06.683 INFO:tasks.rados.rados.0.trial188.stdout:1923: left oid 45 (ObjNum 698 snap 199 seq_num 698) 2026-02-13T20:20:06.683 INFO:tasks.rados.rados.0.trial188.stdout:1923: done (3 left) 2026-02-13T20:20:06.683 INFO:tasks.rados.rados.0.trial188.stdout:1924: done (2 left) 2026-02-13T20:20:06.683 INFO:tasks.rados.rados.0.trial188.stdout:1926: done (1 left) 2026-02-13T20:20:06.683 INFO:tasks.rados.rados.0.trial188.stdout:1927: snap_create 2026-02-13T20:20:06.694 INFO:tasks.rados.rados.0.trial188.stdout:1925: finishing write tid 1 to trial18843701-47 2026-02-13T20:20:06.694 INFO:tasks.rados.rados.0.trial188.stdout:1925: finishing write tid 2 to trial18843701-47 2026-02-13T20:20:06.694 INFO:tasks.rados.rados.0.trial188.stdout:1925: finishing write tid 3 to trial18843701-47 2026-02-13T20:20:06.694 INFO:tasks.rados.rados.0.trial188.stdout:1925: finishing write tid 4 to trial18843701-47 2026-02-13T20:20:06.695 INFO:tasks.rados.rados.0.trial188.stdout:1925: finishing write tid 5 to trial18843701-47 2026-02-13T20:20:06.695 INFO:tasks.rados.rados.0.trial188.stdout:1925: oid 47 updating version 0 to 661 2026-02-13T20:20:06.695 INFO:tasks.rados.rados.0.trial188.stdout:1925: oid 47 version 661 is already newer than 660 2026-02-13T20:20:06.695 INFO:tasks.rados.rados.0.trial188.stdout:1925: oid 47 version 661 is already newer than 659 2026-02-13T20:20:06.695 INFO:tasks.rados.rados.0.trial188.stdout:1925: oid 47 version 661 is already newer than 658 2026-02-13T20:20:06.695 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 47 v 661 (ObjNum 699 snap 199 seq_num 699) dirty exists 2026-02-13T20:20:06.695 INFO:tasks.rados.rados.0.trial188.stdout:1925: left oid 47 (ObjNum 699 snap 199 seq_num 699) 2026-02-13T20:20:07.075 INFO:tasks.rados.rados.0.trial188.stdout:1925: done (1 left) 2026-02-13T20:20:07.075 INFO:tasks.rados.rados.0.trial188.stdout:1927: done (0 left) 2026-02-13T20:20:07.076 INFO:tasks.rados.rados.0.trial188.stdout:1928: read oid 8 snap -1 2026-02-13T20:20:07.076 INFO:tasks.rados.rados.0.trial188.stdout:1928: expect (ObjNum 623 snap 166 seq_num 623) 2026-02-13T20:20:07.076 INFO:tasks.rados.rados.0.trial188.stdout:1929: snap_create 2026-02-13T20:20:07.081 INFO:tasks.rados.rados.0.trial188.stdout:1928: expect (ObjNum 623 snap 166 seq_num 623) 2026-02-13T20:20:07.081 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:20:07.141 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:20:08.064 INFO:tasks.rados.rados.0.trial188.stdout:1928: done (1 left) 2026-02-13T20:20:08.064 INFO:tasks.rados.rados.0.trial188.stdout:1929: done (0 left) 2026-02-13T20:20:08.064 INFO:tasks.rados.rados.0.trial188.stdout:1930: write oid 45 current snap is 201 2026-02-13T20:20:08.064 INFO:tasks.rados.rados.0.trial188.stdout:1930: seq_num 701 ranges {581707=654025,1687642=453571,2700812=703681} 2026-02-13T20:20:08.068 INFO:tasks.rados.rados.0.trial188.stdout:1930: writing trial18843701-45 from 581707 to 1235732 tid 1 2026-02-13T20:20:08.072 INFO:tasks.rados.rados.0.trial188.stdout:1930: writing trial18843701-45 from 1687642 to 2141213 tid 2 2026-02-13T20:20:08.077 INFO:tasks.rados.rados.0.trial188.stdout:1930: writing trial18843701-45 from 2700812 to 3404493 tid 3 2026-02-13T20:20:08.077 INFO:tasks.rados.rados.0.trial188.stdout:1931: snap_remove snap 199 2026-02-13T20:20:09.078 INFO:tasks.rados.rados.0.trial188.stdout:1931: done (1 left) 2026-02-13T20:20:09.078 INFO:tasks.rados.rados.0.trial188.stdout:1932: write (excl) oid 25 current snap is 201 2026-02-13T20:20:09.078 INFO:tasks.rados.rados.0.trial188.stdout:1932: seq_num 702 ranges {598514=729274,1746124=597229,3128235=514953} 2026-02-13T20:20:09.083 INFO:tasks.rados.rados.0.trial188.stdout:1932: writing trial18843701-25 from 598514 to 1327788 tid 1 2026-02-13T20:20:09.086 INFO:tasks.rados.rados.0.trial188.stdout:1932: writing trial18843701-25 from 1746124 to 2343353 tid 2 2026-02-13T20:20:09.091 INFO:tasks.rados.rados.0.trial188.stdout:1932: writing trial18843701-25 from 3128235 to 3643188 tid 3 2026-02-13T20:20:09.092 INFO:tasks.rados.rados.0.trial188.stdout:1933: write (excl) oid 22 current snap is 201 2026-02-13T20:20:09.092 INFO:tasks.rados.rados.0.trial188.stdout:1930: finishing write tid 1 to trial18843701-45 2026-02-13T20:20:09.092 INFO:tasks.rados.rados.0.trial188.stdout:1933: seq_num 703 ranges {615321=404523,1804606=457240,2755658=726225} 2026-02-13T20:20:09.095 INFO:tasks.rados.rados.0.trial188.stdout:1933: writing trial18843701-22 from 615321 to 1019844 tid 1 2026-02-13T20:20:09.100 INFO:tasks.rados.rados.0.trial188.stdout:1933: writing trial18843701-22 from 1804606 to 2261846 tid 2 2026-02-13T20:20:09.105 INFO:tasks.rados.rados.0.trial188.stdout:1933: writing trial18843701-22 from 2755658 to 3481883 tid 3 2026-02-13T20:20:09.105 INFO:tasks.rados.rados.0.trial188.stdout:1934: read oid 5 snap 196 2026-02-13T20:20:09.105 INFO:tasks.rados.rados.0.trial188.stdout:1934: expect deleted 2026-02-13T20:20:09.105 INFO:tasks.rados.rados.0.trial188.stdout:1935: read oid 29 snap 180 2026-02-13T20:20:09.105 INFO:tasks.rados.rados.0.trial188.stdout:1935: expect (ObjNum 664 snap 179 seq_num 664) 2026-02-13T20:20:09.105 INFO:tasks.rados.rados.0.trial188.stdout:1936: rollback oid 26 current snap is 201 2026-02-13T20:20:09.105 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 26 to 197 2026-02-13T20:20:09.105 INFO:tasks.rados.rados.0.trial188.stdout:1930: finishing write tid 2 to trial18843701-45 2026-02-13T20:20:09.105 INFO:tasks.rados.rados.0.trial188.stdout:1930: finishing write tid 3 to trial18843701-45 2026-02-13T20:20:09.105 INFO:tasks.rados.rados.0.trial188.stdout:1930: finishing write tid 4 to trial18843701-45 2026-02-13T20:20:09.105 INFO:tasks.rados.rados.0.trial188.stdout:1930: finishing write tid 5 to trial18843701-45 2026-02-13T20:20:09.106 INFO:tasks.rados.rados.0.trial188.stdout:1930: oid 45 updating version 0 to 712 2026-02-13T20:20:09.106 INFO:tasks.rados.rados.0.trial188.stdout:1930: oid 45 version 712 is already newer than 711 2026-02-13T20:20:09.106 INFO:tasks.rados.rados.0.trial188.stdout:1930: oid 45 version 712 is already newer than 709 2026-02-13T20:20:09.106 INFO:tasks.rados.rados.0.trial188.stdout:1930: oid 45 version 712 is already newer than 710 2026-02-13T20:20:09.106 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 45 v 712 (ObjNum 701 snap 201 seq_num 701) dirty exists 2026-02-13T20:20:09.106 INFO:tasks.rados.rados.0.trial188.stdout:1930: left oid 45 (ObjNum 701 snap 201 seq_num 701) 2026-02-13T20:20:09.106 INFO:tasks.rados.rados.0.trial188.stdout:1930: done (5 left) 2026-02-13T20:20:09.106 INFO:tasks.rados.rados.0.trial188.stdout:1937: write oid 15 current snap is 201 2026-02-13T20:20:09.106 INFO:tasks.rados.rados.0.trial188.stdout:1937: seq_num 704 ranges {632128=479772,1746735=600898,3066728=653850} 2026-02-13T20:20:09.109 INFO:tasks.rados.rados.0.trial188.stdout:1937: writing trial18843701-15 from 632128 to 1111900 tid 1 2026-02-13T20:20:09.113 INFO:tasks.rados.rados.0.trial188.stdout:1937: writing trial18843701-15 from 1746735 to 2347633 tid 2 2026-02-13T20:20:09.118 INFO:tasks.rados.rados.0.trial188.stdout:1937: writing trial18843701-15 from 3066728 to 3720578 tid 3 2026-02-13T20:20:09.118 INFO:tasks.rados.rados.0.trial188.stdout:1938: snap_create 2026-02-13T20:20:09.118 INFO:tasks.rados.rados.0.trial188.stdout:1935: expect (ObjNum 664 snap 179 seq_num 664) 2026-02-13T20:20:09.226 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 746776 2026-02-13T20:20:09.275 INFO:tasks.rados.rados.0.trial188.stdout:1932: finishing write tid 1 to trial18843701-25 2026-02-13T20:20:09.275 INFO:tasks.rados.rados.0.trial188.stdout:1932: finishing write tid 2 to trial18843701-25 2026-02-13T20:20:09.275 INFO:tasks.rados.rados.0.trial188.stdout:1932: finishing write tid 3 to trial18843701-25 2026-02-13T20:20:09.275 INFO:tasks.rados.rados.0.trial188.stdout:1932: finishing write tid 4 to trial18843701-25 2026-02-13T20:20:09.275 INFO:tasks.rados.rados.0.trial188.stdout:1932: finishing write tid 5 to trial18843701-25 2026-02-13T20:20:09.275 INFO:tasks.rados.rados.0.trial188.stdout:1932: oid 25 updating version 0 to 827 2026-02-13T20:20:09.276 INFO:tasks.rados.rados.0.trial188.stdout:1932: oid 25 updating version 827 to 828 2026-02-13T20:20:09.276 INFO:tasks.rados.rados.0.trial188.stdout:1932: oid 25 updating version 828 to 830 2026-02-13T20:20:09.276 INFO:tasks.rados.rados.0.trial188.stdout:1932: oid 25 version 830 is already newer than 829 2026-02-13T20:20:09.276 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 25 v 830 (ObjNum 702 snap 201 seq_num 702) dirty exists 2026-02-13T20:20:09.276 INFO:tasks.rados.rados.0.trial188.stdout:1932: left oid 25 (ObjNum 702 snap 201 seq_num 702) 2026-02-13T20:20:09.276 INFO:tasks.rados.rados.0.trial188.stdout:1936: finishing rollback tid 0 to trial18843701-26 2026-02-13T20:20:09.276 INFO:tasks.rados.rados.0.trial188.stdout:1936: finishing rollback tid 1 to trial18843701-26 2026-02-13T20:20:09.276 INFO:tasks.rados.rados.0.trial188.stdout:1936: finishing rollback tid 2 to trial18843701-26 2026-02-13T20:20:09.276 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 26 v 752 (ObjNum 672 snap 187 seq_num 672) dirty exists 2026-02-13T20:20:09.276 INFO:tasks.rados.rados.0.trial188.stdout:1933: finishing write tid 1 to trial18843701-22 2026-02-13T20:20:09.276 INFO:tasks.rados.rados.0.trial188.stdout:1933: finishing write tid 2 to trial18843701-22 2026-02-13T20:20:09.276 INFO:tasks.rados.rados.0.trial188.stdout:1933: finishing write tid 3 to trial18843701-22 2026-02-13T20:20:09.276 INFO:tasks.rados.rados.0.trial188.stdout:1933: finishing write tid 4 to trial18843701-22 2026-02-13T20:20:09.276 INFO:tasks.rados.rados.0.trial188.stdout:1933: finishing write tid 5 to trial18843701-22 2026-02-13T20:20:09.276 INFO:tasks.rados.rados.0.trial188.stdout:1933: oid 22 updating version 0 to 621 2026-02-13T20:20:09.276 INFO:tasks.rados.rados.0.trial188.stdout:1933: oid 22 version 621 is already newer than 620 2026-02-13T20:20:09.276 INFO:tasks.rados.rados.0.trial188.stdout:1933: oid 22 version 621 is already newer than 619 2026-02-13T20:20:09.276 INFO:tasks.rados.rados.0.trial188.stdout:1933: oid 22 updating version 621 to 622 2026-02-13T20:20:09.276 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 22 v 622 (ObjNum 703 snap 201 seq_num 703) dirty exists 2026-02-13T20:20:09.276 INFO:tasks.rados.rados.0.trial188.stdout:1933: left oid 22 (ObjNum 703 snap 201 seq_num 703) 2026-02-13T20:20:09.276 INFO:tasks.rados.rados.0.trial188.stdout:1937: finishing write tid 1 to trial18843701-15 2026-02-13T20:20:09.276 INFO:tasks.rados.rados.0.trial188.stdout:1937: finishing write tid 2 to trial18843701-15 2026-02-13T20:20:09.276 INFO:tasks.rados.rados.0.trial188.stdout:1937: finishing write tid 3 to trial18843701-15 2026-02-13T20:20:09.276 INFO:tasks.rados.rados.0.trial188.stdout:1937: finishing write tid 4 to trial18843701-15 2026-02-13T20:20:09.276 INFO:tasks.rados.rados.0.trial188.stdout:1937: finishing write tid 5 to trial18843701-15 2026-02-13T20:20:09.276 INFO:tasks.rados.rados.0.trial188.stdout:1937: oid 15 updating version 0 to 754 2026-02-13T20:20:09.276 INFO:tasks.rados.rados.0.trial188.stdout:1937: oid 15 updating version 754 to 756 2026-02-13T20:20:09.276 INFO:tasks.rados.rados.0.trial188.stdout:1937: oid 15 version 756 is already newer than 755 2026-02-13T20:20:09.277 INFO:tasks.rados.rados.0.trial188.stdout:1937: oid 15 version 756 is already newer than 753 2026-02-13T20:20:09.277 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 15 v 756 (ObjNum 704 snap 201 seq_num 704) dirty exists 2026-02-13T20:20:09.277 INFO:tasks.rados.rados.0.trial188.stdout:1937: left oid 15 (ObjNum 704 snap 201 seq_num 704) 2026-02-13T20:20:10.081 INFO:tasks.rados.rados.0.trial188.stdout:1932: done (6 left) 2026-02-13T20:20:10.081 INFO:tasks.rados.rados.0.trial188.stdout:1933: done (5 left) 2026-02-13T20:20:10.081 INFO:tasks.rados.rados.0.trial188.stdout:1934: done (4 left) 2026-02-13T20:20:10.081 INFO:tasks.rados.rados.0.trial188.stdout:1935: done (3 left) 2026-02-13T20:20:10.081 INFO:tasks.rados.rados.0.trial188.stdout:1936: done (2 left) 2026-02-13T20:20:10.081 INFO:tasks.rados.rados.0.trial188.stdout:1937: done (1 left) 2026-02-13T20:20:10.081 INFO:tasks.rados.rados.0.trial188.stdout:1938: done (0 left) 2026-02-13T20:20:10.082 INFO:tasks.rados.rados.0.trial188.stdout:1939: snap_remove snap 183 2026-02-13T20:20:11.084 INFO:tasks.rados.rados.0.trial188.stdout:1939: done (0 left) 2026-02-13T20:20:11.084 INFO:tasks.rados.rados.0.trial188.stdout:1940: rollback oid 30 current snap is 202 2026-02-13T20:20:11.085 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 30 to 197 2026-02-13T20:20:11.085 INFO:tasks.rados.rados.0.trial188.stdout:1941: write oid 27 current snap is 202 2026-02-13T20:20:11.085 INFO:tasks.rados.rados.0.trial188.stdout:1941: seq_num 705 ranges {648935=555021,1805217=460909,2694151=465122,3817442=31493} 2026-02-13T20:20:11.089 INFO:tasks.rados.rados.0.trial188.stdout:1941: writing trial18843701-27 from 648935 to 1203956 tid 1 2026-02-13T20:20:11.092 INFO:tasks.rados.rados.0.trial188.stdout:1941: writing trial18843701-27 from 1805217 to 2266126 tid 2 2026-02-13T20:20:11.096 INFO:tasks.rados.rados.0.trial188.stdout:1941: writing trial18843701-27 from 2694151 to 3159273 tid 3 2026-02-13T20:20:11.099 INFO:tasks.rados.rados.0.trial188.stdout:1941: writing trial18843701-27 from 3817442 to 3848935 tid 4 2026-02-13T20:20:11.099 INFO:tasks.rados.rados.0.trial188.stdout:1942: snap_create 2026-02-13T20:20:11.099 INFO:tasks.rados.rados.0.trial188.stdout:1940: finishing rollback tid 1 to trial18843701-30 2026-02-13T20:20:11.099 INFO:tasks.rados.rados.0.trial188.stdout:1940: finishing rollback tid 2 to trial18843701-30 2026-02-13T20:20:11.099 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 30 v 832 (ObjNum 635 snap 166 seq_num 635) dirty exists 2026-02-13T20:20:11.110 INFO:tasks.rados.rados.0.trial188.stdout:1941: finishing write tid 1 to trial18843701-27 2026-02-13T20:20:11.110 INFO:tasks.rados.rados.0.trial188.stdout:1941: finishing write tid 2 to trial18843701-27 2026-02-13T20:20:11.111 INFO:tasks.rados.rados.0.trial188.stdout:1941: finishing write tid 3 to trial18843701-27 2026-02-13T20:20:11.111 INFO:tasks.rados.rados.0.trial188.stdout:1941: finishing write tid 4 to trial18843701-27 2026-02-13T20:20:11.111 INFO:tasks.rados.rados.0.trial188.stdout:1941: finishing write tid 5 to trial18843701-27 2026-02-13T20:20:11.111 INFO:tasks.rados.rados.0.trial188.stdout:1941: finishing write tid 6 to trial18843701-27 2026-02-13T20:20:11.111 INFO:tasks.rados.rados.0.trial188.stdout:1941: oid 27 updating version 0 to 844 2026-02-13T20:20:11.111 INFO:tasks.rados.rados.0.trial188.stdout:1941: oid 27 version 844 is already newer than 842 2026-02-13T20:20:11.111 INFO:tasks.rados.rados.0.trial188.stdout:1941: oid 27 version 844 is already newer than 843 2026-02-13T20:20:11.111 INFO:tasks.rados.rados.0.trial188.stdout:1941: oid 27 version 844 is already newer than 840 2026-02-13T20:20:11.111 INFO:tasks.rados.rados.0.trial188.stdout:1941: oid 27 version 844 is already newer than 841 2026-02-13T20:20:11.112 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 27 v 844 (ObjNum 705 snap 202 seq_num 705) dirty exists 2026-02-13T20:20:11.112 INFO:tasks.rados.rados.0.trial188.stdout:1941: left oid 27 (ObjNum 705 snap 202 seq_num 705) 2026-02-13T20:20:12.086 INFO:tasks.rados.rados.0.trial188.stdout:1940: done (2 left) 2026-02-13T20:20:12.086 INFO:tasks.rados.rados.0.trial188.stdout:1941: done (1 left) 2026-02-13T20:20:12.087 INFO:tasks.rados.rados.0.trial188.stdout:1942: done (0 left) 2026-02-13T20:20:12.087 INFO:tasks.rados.rados.0.trial188.stdout:1943: delete oid 6 current snap is 203 2026-02-13T20:20:12.090 INFO:tasks.rados.rados.0.trial188.stdout:1943: done (0 left) 2026-02-13T20:20:12.090 INFO:tasks.rados.rados.0.trial188.stdout:1944: write oid 8 current snap is 203 2026-02-13T20:20:12.090 INFO:tasks.rados.rados.0.trial188.stdout:1944: seq_num 707 ranges {682549=705519,1922181=464578,3148997=487666} 2026-02-13T20:20:12.095 INFO:tasks.rados.rados.0.trial188.stdout:1944: writing trial18843701-8 from 682549 to 1388068 tid 1 2026-02-13T20:20:12.099 INFO:tasks.rados.rados.0.trial188.stdout:1944: writing trial18843701-8 from 1922181 to 2386759 tid 2 2026-02-13T20:20:12.104 INFO:tasks.rados.rados.0.trial188.stdout:1944: writing trial18843701-8 from 3148997 to 3636663 tid 3 2026-02-13T20:20:12.104 INFO:tasks.rados.rados.0.trial188.stdout:1945: write (excl) oid 21 current snap is 203 2026-02-13T20:20:12.104 INFO:tasks.rados.rados.0.trial188.stdout:1945: seq_num 708 ranges {699356=497121,1980663=608236,3176420=415291} 2026-02-13T20:20:12.109 INFO:tasks.rados.rados.0.trial188.stdout:1945: writing trial18843701-21 from 699356 to 1196477 tid 1 2026-02-13T20:20:12.114 INFO:tasks.rados.rados.0.trial188.stdout:1945: writing trial18843701-21 from 1980663 to 2588899 tid 2 2026-02-13T20:20:12.118 INFO:tasks.rados.rados.0.trial188.stdout:1945: writing trial18843701-21 from 3176420 to 3591711 tid 3 2026-02-13T20:20:12.118 INFO:tasks.rados.rados.0.trial188.stdout:1946: snap_remove snap 202 2026-02-13T20:20:13.065 INFO:tasks.rados.rados.0.trial188.stdout:1946: done (2 left) 2026-02-13T20:20:13.066 INFO:tasks.rados.rados.0.trial188.stdout:1947: copy_from oid 15 from oid 46 current snap is 203 2026-02-13T20:20:13.066 INFO:tasks.rados.rados.0.trial188.stdout:1944: finishing write tid 1 to trial18843701-8 2026-02-13T20:20:13.066 INFO:tasks.rados.rados.0.trial188.stdout:1944: finishing write tid 2 to trial18843701-8 2026-02-13T20:20:13.066 INFO:tasks.rados.rados.0.trial188.stdout:1944: finishing write tid 3 to trial18843701-8 2026-02-13T20:20:13.066 INFO:tasks.rados.rados.0.trial188.stdout:1944: finishing write tid 4 to trial18843701-8 2026-02-13T20:20:13.066 INFO:tasks.rados.rados.0.trial188.stdout:1944: finishing write tid 5 to trial18843701-8 2026-02-13T20:20:13.066 INFO:tasks.rados.rados.0.trial188.stdout:1944: oid 8 updating version 0 to 720 2026-02-13T20:20:13.066 INFO:tasks.rados.rados.0.trial188.stdout:1944: oid 8 version 720 is already newer than 718 2026-02-13T20:20:13.066 INFO:tasks.rados.rados.0.trial188.stdout:1944: oid 8 version 720 is already newer than 719 2026-02-13T20:20:13.066 INFO:tasks.rados.rados.0.trial188.stdout:1944: oid 8 updating version 720 to 721 2026-02-13T20:20:13.067 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 8 v 721 (ObjNum 707 snap 203 seq_num 707) dirty exists 2026-02-13T20:20:13.067 INFO:tasks.rados.rados.0.trial188.stdout:1944: left oid 8 (ObjNum 707 snap 203 seq_num 707) 2026-02-13T20:20:13.067 INFO:tasks.rados.rados.0.trial188.stdout:1945: finishing write tid 1 to trial18843701-21 2026-02-13T20:20:13.067 INFO:tasks.rados.rados.0.trial188.stdout:1945: finishing write tid 2 to trial18843701-21 2026-02-13T20:20:13.067 INFO:tasks.rados.rados.0.trial188.stdout:1945: finishing write tid 3 to trial18843701-21 2026-02-13T20:20:13.067 INFO:tasks.rados.rados.0.trial188.stdout:1945: finishing write tid 4 to trial18843701-21 2026-02-13T20:20:13.067 INFO:tasks.rados.rados.0.trial188.stdout:1945: finishing write tid 5 to trial18843701-21 2026-02-13T20:20:13.067 INFO:tasks.rados.rados.0.trial188.stdout:1945: oid 21 updating version 0 to 478 2026-02-13T20:20:13.067 INFO:tasks.rados.rados.0.trial188.stdout:1945: oid 21 version 478 is already newer than 476 2026-02-13T20:20:13.067 INFO:tasks.rados.rados.0.trial188.stdout:1945: oid 21 version 478 is already newer than 477 2026-02-13T20:20:13.067 INFO:tasks.rados.rados.0.trial188.stdout:1945: oid 21 version 478 is already newer than 475 2026-02-13T20:20:13.067 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 21 v 478 (ObjNum 708 snap 203 seq_num 708) dirty exists 2026-02-13T20:20:13.068 INFO:tasks.rados.rados.0.trial188.stdout:1945: left oid 21 (ObjNum 708 snap 203 seq_num 708) 2026-02-13T20:20:13.068 INFO:tasks.rados.rados.0.trial188.stdout:1944: done (2 left) 2026-02-13T20:20:13.068 INFO:tasks.rados.rados.0.trial188.stdout:1945: done (1 left) 2026-02-13T20:20:13.068 INFO:tasks.rados.rados.0.trial188.stdout:1948: read oid 21 snap -1 2026-02-13T20:20:13.068 INFO:tasks.rados.rados.0.trial188.stdout:1948: expect (ObjNum 708 snap 203 seq_num 708) 2026-02-13T20:20:13.068 INFO:tasks.rados.rados.0.trial188.stdout:1949: delete oid 44 current snap is 203 2026-02-13T20:20:13.069 INFO:tasks.rados.rados.0.trial188.stdout:1949: done (2 left) 2026-02-13T20:20:13.069 INFO:tasks.rados.rados.0.trial188.stdout:1950: delete oid 17 current snap is 203 2026-02-13T20:20:13.074 INFO:tasks.rados.rados.0.trial188.stdout:1948: expect (ObjNum 708 snap 203 seq_num 708) 2026-02-13T20:20:13.074 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 562599 2026-02-13T20:20:13.189 INFO:tasks.rados.rados.0.trial188.stdout:1947: finishing copy_from racing read to trial18843701-15 2026-02-13T20:20:13.189 INFO:tasks.rados.rados.0.trial188.stdout:1947: finishing copy_from to trial18843701-15 2026-02-13T20:20:13.190 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 15 v 755 (ObjNum 690 snap 199 seq_num 690) dirty exists 2026-02-13T20:20:13.190 INFO:tasks.rados.rados.0.trial188.stdout:1947: done (2 left) 2026-02-13T20:20:13.190 INFO:tasks.rados.rados.0.trial188.stdout:1948: done (1 left) 2026-02-13T20:20:13.190 INFO:tasks.rados.rados.0.trial188.stdout:1950: done (0 left) 2026-02-13T20:20:13.190 INFO:tasks.rados.rados.0.trial188.stdout:1951: delete oid 25 current snap is 203 2026-02-13T20:20:13.192 INFO:tasks.rados.rados.0.trial188.stdout:1951: done (0 left) 2026-02-13T20:20:13.192 INFO:tasks.rados.rados.0.trial188.stdout:1952: write oid 47 current snap is 203 2026-02-13T20:20:13.192 INFO:tasks.rados.rados.0.trial188.stdout:1952: seq_num 712 ranges {766584=798117,2098238=615574,3169759=460379} 2026-02-13T20:20:13.197 INFO:tasks.rados.rados.0.trial188.stdout:1952: writing trial18843701-47 from 766584 to 1564701 tid 1 2026-02-13T20:20:13.202 INFO:tasks.rados.rados.0.trial188.stdout:1952: writing trial18843701-47 from 2098238 to 2713812 tid 2 2026-02-13T20:20:13.205 INFO:tasks.rados.rados.0.trial188.stdout:1952: writing trial18843701-47 from 3169759 to 3630138 tid 3 2026-02-13T20:20:13.206 INFO:tasks.rados.rados.0.trial188.stdout:1953: rollback oid 12 current snap is 203 2026-02-13T20:20:13.206 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 12 to 193 2026-02-13T20:20:13.206 INFO:tasks.rados.rados.0.trial188.stdout:1954: read oid 18 snap -1 2026-02-13T20:20:13.206 INFO:tasks.rados.rados.0.trial188.stdout:1954: expect deleted 2026-02-13T20:20:13.206 INFO:tasks.rados.rados.0.trial188.stdout:1955: delete oid 6 current snap is 203 2026-02-13T20:20:13.208 INFO:tasks.rados.rados.0.trial188.stdout:1953: finishing rollback tid 0 to trial18843701-12 2026-02-13T20:20:13.208 INFO:tasks.rados.rados.0.trial188.stdout:1953: finishing rollback tid 1 to trial18843701-12 2026-02-13T20:20:13.208 INFO:tasks.rados.rados.0.trial188.stdout:1955: done (3 left) 2026-02-13T20:20:13.208 INFO:tasks.rados.rados.0.trial188.stdout:1956: rollback oid 45 current snap is 203 2026-02-13T20:20:13.208 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 45 to 193 2026-02-13T20:20:13.208 INFO:tasks.rados.rados.0.trial188.stdout:1957: snap_remove snap 192 2026-02-13T20:20:14.091 INFO:tasks.rados.rados.0.trial188.stdout:1957: done (4 left) 2026-02-13T20:20:14.091 INFO:tasks.rados.rados.0.trial188.stdout:1958: snap_create 2026-02-13T20:20:14.091 INFO:tasks.rados.rados.0.trial188.stdout:1953: finishing rollback tid 2 to trial18843701-12 2026-02-13T20:20:14.091 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 12 v 593 (ObjNum 622 snap 166 seq_num 622) dirty exists 2026-02-13T20:20:14.091 INFO:tasks.rados.rados.0.trial188.stdout:1956: finishing rollback tid 0 to trial18843701-45 2026-02-13T20:20:14.091 INFO:tasks.rados.rados.0.trial188.stdout:1956: finishing rollback tid 1 to trial18843701-45 2026-02-13T20:20:14.091 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 45 v 726 (ObjNum 65 snap 0 seq_num 4129271088) dirty dne 2026-02-13T20:20:14.092 INFO:tasks.rados.rados.0.trial188.stdout:1952: finishing write tid 1 to trial18843701-47 2026-02-13T20:20:14.092 INFO:tasks.rados.rados.0.trial188.stdout:1952: finishing write tid 2 to trial18843701-47 2026-02-13T20:20:14.092 INFO:tasks.rados.rados.0.trial188.stdout:1952: finishing write tid 3 to trial18843701-47 2026-02-13T20:20:14.092 INFO:tasks.rados.rados.0.trial188.stdout:1952: finishing write tid 4 to trial18843701-47 2026-02-13T20:20:14.092 INFO:tasks.rados.rados.0.trial188.stdout:1952: finishing write tid 5 to trial18843701-47 2026-02-13T20:20:14.092 INFO:tasks.rados.rados.0.trial188.stdout:1952: oid 47 updating version 0 to 664 2026-02-13T20:20:14.092 INFO:tasks.rados.rados.0.trial188.stdout:1952: oid 47 version 664 is already newer than 662 2026-02-13T20:20:14.092 INFO:tasks.rados.rados.0.trial188.stdout:1952: oid 47 version 664 is already newer than 663 2026-02-13T20:20:14.092 INFO:tasks.rados.rados.0.trial188.stdout:1952: oid 47 updating version 664 to 665 2026-02-13T20:20:14.092 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 47 v 665 (ObjNum 712 snap 203 seq_num 712) dirty exists 2026-02-13T20:20:14.092 INFO:tasks.rados.rados.0.trial188.stdout:1952: left oid 47 (ObjNum 712 snap 203 seq_num 712) 2026-02-13T20:20:15.091 INFO:tasks.rados.rados.0.trial188.stdout:1952: done (4 left) 2026-02-13T20:20:15.091 INFO:tasks.rados.rados.0.trial188.stdout:1953: done (3 left) 2026-02-13T20:20:15.091 INFO:tasks.rados.rados.0.trial188.stdout:1954: done (2 left) 2026-02-13T20:20:15.091 INFO:tasks.rados.rados.0.trial188.stdout:1956: done (1 left) 2026-02-13T20:20:15.091 INFO:tasks.rados.rados.0.trial188.stdout:1958: done (0 left) 2026-02-13T20:20:15.091 INFO:tasks.rados.rados.0.trial188.stdout:1959: rollback oid 29 current snap is 204 2026-02-13T20:20:15.091 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 29 to 177 2026-02-13T20:20:15.091 INFO:tasks.rados.rados.0.trial188.stdout:1960: write oid 12 current snap is 204 2026-02-13T20:20:15.091 INFO:tasks.rados.rados.0.trial188.stdout:1960: seq_num 714 ranges {400198=548615,1415202=584996} 2026-02-13T20:20:15.094 INFO:tasks.rados.rados.0.trial188.stdout:1960: writing trial18843701-12 from 400198 to 948813 tid 1 2026-02-13T20:20:15.098 INFO:tasks.rados.rados.0.trial188.stdout:1960: writing trial18843701-12 from 1415202 to 2000198 tid 2 2026-02-13T20:20:15.098 INFO:tasks.rados.rados.0.trial188.stdout:1961: read oid 47 snap -1 2026-02-13T20:20:15.098 INFO:tasks.rados.rados.0.trial188.stdout:1961: expect (ObjNum 712 snap 203 seq_num 712) 2026-02-13T20:20:15.098 INFO:tasks.rados.rados.0.trial188.stdout:1962: delete oid 43 current snap is 204 2026-02-13T20:20:15.098 INFO:tasks.rados.rados.0.trial188.stdout:1959: finishing rollback tid 0 to trial18843701-29 2026-02-13T20:20:15.098 INFO:tasks.rados.rados.0.trial188.stdout:1959: finishing rollback tid 1 to trial18843701-29 2026-02-13T20:20:15.098 INFO:tasks.rados.rados.0.trial188.stdout:1959: finishing rollback tid 2 to trial18843701-29 2026-02-13T20:20:15.098 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 29 v 743 (ObjNum 627 snap 166 seq_num 627) dirty exists 2026-02-13T20:20:15.103 INFO:tasks.rados.rados.0.trial188.stdout:1961: expect (ObjNum 712 snap 203 seq_num 712) 2026-02-13T20:20:15.103 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:20:15.225 INFO:tasks.rados.rados.0.trial188.stdout:1960: finishing write tid 1 to trial18843701-12 2026-02-13T20:20:15.226 INFO:tasks.rados.rados.0.trial188.stdout:1960: finishing write tid 2 to trial18843701-12 2026-02-13T20:20:15.226 INFO:tasks.rados.rados.0.trial188.stdout:1960: finishing write tid 3 to trial18843701-12 2026-02-13T20:20:15.226 INFO:tasks.rados.rados.0.trial188.stdout:1960: finishing write tid 4 to trial18843701-12 2026-02-13T20:20:15.226 INFO:tasks.rados.rados.0.trial188.stdout:1960: oid 12 updating version 0 to 594 2026-02-13T20:20:15.226 INFO:tasks.rados.rados.0.trial188.stdout:1960: oid 12 updating version 594 to 596 2026-02-13T20:20:15.226 INFO:tasks.rados.rados.0.trial188.stdout:1960: oid 12 version 596 is already newer than 595 2026-02-13T20:20:15.226 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 12 v 596 (ObjNum 714 snap 204 seq_num 714) dirty exists 2026-02-13T20:20:15.226 INFO:tasks.rados.rados.0.trial188.stdout:1960: left oid 12 (ObjNum 714 snap 204 seq_num 714) 2026-02-13T20:20:15.226 INFO:tasks.rados.rados.0.trial188.stdout:1959: done (3 left) 2026-02-13T20:20:15.227 INFO:tasks.rados.rados.0.trial188.stdout:1960: done (2 left) 2026-02-13T20:20:15.227 INFO:tasks.rados.rados.0.trial188.stdout:1961: done (1 left) 2026-02-13T20:20:15.227 INFO:tasks.rados.rados.0.trial188.stdout:1962: done (0 left) 2026-02-13T20:20:15.227 INFO:tasks.rados.rados.0.trial188.stdout:1963: rollback oid 2 current snap is 204 2026-02-13T20:20:15.227 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 2 to 197 2026-02-13T20:20:15.227 INFO:tasks.rados.rados.0.trial188.stdout:1964: snap_create 2026-02-13T20:20:15.228 INFO:tasks.rados.rados.0.trial188.stdout:1963: finishing rollback tid 0 to trial18843701-2 2026-02-13T20:20:15.228 INFO:tasks.rados.rados.0.trial188.stdout:1963: finishing rollback tid 1 to trial18843701-2 2026-02-13T20:20:15.228 INFO:tasks.rados.rados.0.trial188.stdout:1963: finishing rollback tid 2 to trial18843701-2 2026-02-13T20:20:15.228 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 2 v 789 (ObjNum 639 snap 169 seq_num 639) dirty exists 2026-02-13T20:20:16.100 INFO:tasks.rados.rados.0.trial188.stdout:1963: done (1 left) 2026-02-13T20:20:16.100 INFO:tasks.rados.rados.0.trial188.stdout:1964: done (0 left) 2026-02-13T20:20:16.100 INFO:tasks.rados.rados.0.trial188.stdout:1965: copy_from oid 16 from oid 5 current snap is 205 2026-02-13T20:20:16.100 INFO:tasks.rados.rados.0.trial188.stdout:1966: snap_remove snap 191 2026-02-13T20:20:17.101 INFO:tasks.rados.rados.0.trial188.stdout:1966: done (1 left) 2026-02-13T20:20:17.101 INFO:tasks.rados.rados.0.trial188.stdout:1967: copy_from oid 33 from oid 22 current snap is 205 2026-02-13T20:20:17.101 INFO:tasks.rados.rados.0.trial188.stdout:1965: finishing copy_from to trial18843701-16 2026-02-13T20:20:17.101 INFO:tasks.rados.rados.0.trial188.stdout:1965: got expected ENOENT (src dne) 2026-02-13T20:20:17.101 INFO:tasks.rados.rados.0.trial188.stdout:1965: finishing copy_from racing read to trial18843701-16 2026-02-13T20:20:17.101 INFO:tasks.rados.rados.0.trial188.stdout:1965: done (1 left) 2026-02-13T20:20:17.101 INFO:tasks.rados.rados.0.trial188.stdout:1968: rollback oid 13 current snap is 205 2026-02-13T20:20:17.101 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 13 to 194 2026-02-13T20:20:17.102 INFO:tasks.rados.rados.0.trial188.stdout:1969: write oid 34 current snap is 205 2026-02-13T20:20:17.102 INFO:tasks.rados.rados.0.trial188.stdout:1969: seq_num 716 ranges {433812=415466,1648519=385293} 2026-02-13T20:20:17.104 INFO:tasks.rados.rados.0.trial188.stdout:1969: writing trial18843701-34 from 433812 to 849278 tid 1 2026-02-13T20:20:17.109 INFO:tasks.rados.rados.0.trial188.stdout:1969: writing trial18843701-34 from 1648519 to 2033812 tid 2 2026-02-13T20:20:17.109 INFO:tasks.rados.rados.0.trial188.stdout:1970: rollback oid 25 current snap is 205 2026-02-13T20:20:17.109 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 25 to 185 2026-02-13T20:20:17.109 INFO:tasks.rados.rados.0.trial188.stdout:1968: finishing rollback tid 0 to trial18843701-13 2026-02-13T20:20:17.109 INFO:tasks.rados.rados.0.trial188.stdout:1968: finishing rollback tid 1 to trial18843701-13 2026-02-13T20:20:17.109 INFO:tasks.rados.rados.0.trial188.stdout:1968: finishing rollback tid 2 to trial18843701-13 2026-02-13T20:20:17.110 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 13 v 797 (ObjNum 618 snap 163 seq_num 618) dirty exists 2026-02-13T20:20:17.110 INFO:tasks.rados.rados.0.trial188.stdout:1968: done (3 left) 2026-02-13T20:20:17.110 INFO:tasks.rados.rados.0.trial188.stdout:1971: snap_remove snap 186 2026-02-13T20:20:18.066 INFO:tasks.rados.rados.0.trial188.stdout:1971: done (3 left) 2026-02-13T20:20:18.066 INFO:tasks.rados.rados.0.trial188.stdout:1972: snap_remove snap 193 2026-02-13T20:20:19.067 INFO:tasks.rados.rados.0.trial188.stdout:1972: done (3 left) 2026-02-13T20:20:19.067 INFO:tasks.rados.rados.0.trial188.stdout:1973: copy_from oid 3 from oid 18 current snap is 205 2026-02-13T20:20:19.067 INFO:tasks.rados.rados.0.trial188.stdout:1969: finishing write tid 1 to trial18843701-34 2026-02-13T20:20:19.067 INFO:tasks.rados.rados.0.trial188.stdout:1969: finishing write tid 2 to trial18843701-34 2026-02-13T20:20:19.067 INFO:tasks.rados.rados.0.trial188.stdout:1970: finishing rollback tid 1 to trial18843701-25 2026-02-13T20:20:19.068 INFO:tasks.rados.rados.0.trial188.stdout:1969: finishing write tid 3 to trial18843701-34 2026-02-13T20:20:19.068 INFO:tasks.rados.rados.0.trial188.stdout:1970: finishing rollback tid 2 to trial18843701-25 2026-02-13T20:20:19.068 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 25 v 864 (ObjNum 615 snap 162 seq_num 615) dirty exists 2026-02-13T20:20:19.068 INFO:tasks.rados.rados.0.trial188.stdout:1969: finishing write tid 4 to trial18843701-34 2026-02-13T20:20:19.068 INFO:tasks.rados.rados.0.trial188.stdout:1969: oid 34 updating version 0 to 734 2026-02-13T20:20:19.068 INFO:tasks.rados.rados.0.trial188.stdout:1969: oid 34 version 734 is already newer than 733 2026-02-13T20:20:19.068 INFO:tasks.rados.rados.0.trial188.stdout:1969: oid 34 version 734 is already newer than 732 2026-02-13T20:20:19.068 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 34 v 734 (ObjNum 716 snap 205 seq_num 716) dirty exists 2026-02-13T20:20:19.068 INFO:tasks.rados.rados.0.trial188.stdout:1969: left oid 34 (ObjNum 716 snap 205 seq_num 716) 2026-02-13T20:20:19.068 INFO:tasks.rados.rados.0.trial188.stdout:1969: done (3 left) 2026-02-13T20:20:19.068 INFO:tasks.rados.rados.0.trial188.stdout:1970: done (2 left) 2026-02-13T20:20:19.068 INFO:tasks.rados.rados.0.trial188.stdout:1974: read oid 28 snap 204 2026-02-13T20:20:19.069 INFO:tasks.rados.rados.0.trial188.stdout:1974: expect deleted 2026-02-13T20:20:19.069 INFO:tasks.rados.rados.0.trial188.stdout:1975: copy_from oid 16 from oid 7 current snap is 205 2026-02-13T20:20:19.069 INFO:tasks.rados.rados.0.trial188.stdout:1967: finishing copy_from racing read to trial18843701-33 2026-02-13T20:20:19.069 INFO:tasks.rados.rados.0.trial188.stdout:1967: finishing copy_from to trial18843701-33 2026-02-13T20:20:19.069 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 33 v 622 (ObjNum 703 snap 201 seq_num 703) dirty exists 2026-02-13T20:20:19.069 INFO:tasks.rados.rados.0.trial188.stdout:1967: done (3 left) 2026-02-13T20:20:19.069 INFO:tasks.rados.rados.0.trial188.stdout:1976: read oid 11 snap -1 2026-02-13T20:20:19.069 INFO:tasks.rados.rados.0.trial188.stdout:1976: expect deleted 2026-02-13T20:20:19.069 INFO:tasks.rados.rados.0.trial188.stdout:1977: snap_remove snap 196 2026-02-13T20:20:20.068 INFO:tasks.rados.rados.0.trial188.stdout:1977: done (4 left) 2026-02-13T20:20:20.069 INFO:tasks.rados.rados.0.trial188.stdout:1978: read oid 26 snap -1 2026-02-13T20:20:20.069 INFO:tasks.rados.rados.0.trial188.stdout:1978: expect (ObjNum 672 snap 187 seq_num 672) 2026-02-13T20:20:20.069 INFO:tasks.rados.rados.0.trial188.stdout:1979: rollback oid 20 current snap is 205 2026-02-13T20:20:20.069 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 20 to 185 2026-02-13T20:20:20.069 INFO:tasks.rados.rados.0.trial188.stdout:1973: finishing copy_from to trial18843701-3 2026-02-13T20:20:20.069 INFO:tasks.rados.rados.0.trial188.stdout:1973: got expected ENOENT (src dne) 2026-02-13T20:20:20.069 INFO:tasks.rados.rados.0.trial188.stdout:1975: finishing copy_from to trial18843701-16 2026-02-13T20:20:20.069 INFO:tasks.rados.rados.0.trial188.stdout:1975: got expected ENOENT (src dne) 2026-02-13T20:20:20.069 INFO:tasks.rados.rados.0.trial188.stdout:1975: finishing copy_from racing read to trial18843701-16 2026-02-13T20:20:20.070 INFO:tasks.rados.rados.0.trial188.stdout:1973: finishing copy_from racing read to trial18843701-3 2026-02-13T20:20:20.070 INFO:tasks.rados.rados.0.trial188.stdout:1973: done (5 left) 2026-02-13T20:20:20.070 INFO:tasks.rados.rados.0.trial188.stdout:1974: done (4 left) 2026-02-13T20:20:20.070 INFO:tasks.rados.rados.0.trial188.stdout:1975: done (3 left) 2026-02-13T20:20:20.070 INFO:tasks.rados.rados.0.trial188.stdout:1976: done (2 left) 2026-02-13T20:20:20.070 INFO:tasks.rados.rados.0.trial188.stdout:1980: snap_remove snap 189 2026-02-13T20:20:21.072 INFO:tasks.rados.rados.0.trial188.stdout:1980: done (2 left) 2026-02-13T20:20:21.072 INFO:tasks.rados.rados.0.trial188.stdout:1981: write oid 9 current snap is 205 2026-02-13T20:20:21.072 INFO:tasks.rados.rados.0.trial188.stdout:1981: seq_num 717 ranges {450619=490715,1590648=459971} 2026-02-13T20:20:21.075 INFO:tasks.rados.rados.0.trial188.stdout:1981: writing trial18843701-9 from 450619 to 941334 tid 1 2026-02-13T20:20:21.080 INFO:tasks.rados.rados.0.trial188.stdout:1981: writing trial18843701-9 from 1590648 to 2050619 tid 2 2026-02-13T20:20:21.080 INFO:tasks.rados.rados.0.trial188.stdout:1982: snap_create 2026-02-13T20:20:21.080 INFO:tasks.rados.rados.0.trial188.stdout:1979: finishing rollback tid 0 to trial18843701-20 2026-02-13T20:20:21.080 INFO:tasks.rados.rados.0.trial188.stdout:1979: finishing rollback tid 1 to trial18843701-20 2026-02-13T20:20:21.080 INFO:tasks.rados.rados.0.trial188.stdout:1979: finishing rollback tid 2 to trial18843701-20 2026-02-13T20:20:21.080 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 20 v 659 (ObjNum 634 snap 166 seq_num 634) dirty exists 2026-02-13T20:20:21.080 INFO:tasks.rados.rados.0.trial188.stdout:1978: expect (ObjNum 672 snap 187 seq_num 672) 2026-02-13T20:20:21.101 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 3174998 2026-02-13T20:20:21.157 INFO:tasks.rados.rados.0.trial188.stdout:1981: finishing write tid 1 to trial18843701-9 2026-02-13T20:20:21.157 INFO:tasks.rados.rados.0.trial188.stdout:1981: finishing write tid 2 to trial18843701-9 2026-02-13T20:20:21.157 INFO:tasks.rados.rados.0.trial188.stdout:1981: finishing write tid 3 to trial18843701-9 2026-02-13T20:20:21.157 INFO:tasks.rados.rados.0.trial188.stdout:1981: finishing write tid 4 to trial18843701-9 2026-02-13T20:20:21.158 INFO:tasks.rados.rados.0.trial188.stdout:1981: oid 9 updating version 0 to 680 2026-02-13T20:20:21.158 INFO:tasks.rados.rados.0.trial188.stdout:1981: oid 9 updating version 680 to 681 2026-02-13T20:20:21.158 INFO:tasks.rados.rados.0.trial188.stdout:1981: oid 9 version 681 is already newer than 679 2026-02-13T20:20:21.158 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 9 v 681 (ObjNum 717 snap 205 seq_num 717) dirty exists 2026-02-13T20:20:21.158 INFO:tasks.rados.rados.0.trial188.stdout:1981: left oid 9 (ObjNum 717 snap 205 seq_num 717) 2026-02-13T20:20:22.073 INFO:tasks.rados.rados.0.trial188.stdout:1978: done (3 left) 2026-02-13T20:20:22.073 INFO:tasks.rados.rados.0.trial188.stdout:1979: done (2 left) 2026-02-13T20:20:22.074 INFO:tasks.rados.rados.0.trial188.stdout:1981: done (1 left) 2026-02-13T20:20:22.074 INFO:tasks.rados.rados.0.trial188.stdout:1982: done (0 left) 2026-02-13T20:20:22.074 INFO:tasks.rados.rados.0.trial188.stdout:1983: copy_from oid 17 from oid 11 current snap is 206 2026-02-13T20:20:22.074 INFO:tasks.rados.rados.0.trial188.stdout:1984: snap_create 2026-02-13T20:20:22.074 INFO:tasks.rados.rados.0.trial188.stdout:1983: finishing copy_from to trial18843701-17 2026-02-13T20:20:22.074 INFO:tasks.rados.rados.0.trial188.stdout:1983: got expected ENOENT (src dne) 2026-02-13T20:20:22.074 INFO:tasks.rados.rados.0.trial188.stdout:1983: finishing copy_from racing read to trial18843701-17 2026-02-13T20:20:23.065 INFO:tasks.rados.rados.0.trial188.stdout:1983: done (1 left) 2026-02-13T20:20:23.065 INFO:tasks.rados.rados.0.trial188.stdout:1984: done (0 left) 2026-02-13T20:20:23.066 INFO:tasks.rados.rados.0.trial188.stdout:1985: read oid 16 snap -1 2026-02-13T20:20:23.066 INFO:tasks.rados.rados.0.trial188.stdout:1985: expect (ObjNum 675 snap 193 seq_num 675) 2026-02-13T20:20:23.066 INFO:tasks.rados.rados.0.trial188.stdout:1986: snap_create 2026-02-13T20:20:23.078 INFO:tasks.rados.rados.0.trial188.stdout:1985: expect (ObjNum 675 snap 193 seq_num 675) 2026-02-13T20:20:23.112 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:20:24.066 INFO:tasks.rados.rados.0.trial188.stdout:1985: done (1 left) 2026-02-13T20:20:24.066 INFO:tasks.rados.rados.0.trial188.stdout:1986: done (0 left) 2026-02-13T20:20:24.066 INFO:tasks.rados.rados.0.trial188.stdout:1987: copy_from oid 36 from oid 15 current snap is 208 2026-02-13T20:20:24.066 INFO:tasks.rados.rados.0.trial188.stdout:1988: read oid 44 snap -1 2026-02-13T20:20:24.066 INFO:tasks.rados.rados.0.trial188.stdout:1988: expect deleted 2026-02-13T20:20:24.066 INFO:tasks.rados.rados.0.trial188.stdout:1989: read oid 47 snap -1 2026-02-13T20:20:24.066 INFO:tasks.rados.rados.0.trial188.stdout:1989: expect (ObjNum 712 snap 203 seq_num 712) 2026-02-13T20:20:24.066 INFO:tasks.rados.rados.0.trial188.stdout:1990: copy_from oid 35 from oid 40 current snap is 208 2026-02-13T20:20:24.067 INFO:tasks.rados.rados.0.trial188.stdout:1991: snap_create 2026-02-13T20:20:24.068 INFO:tasks.rados.rados.0.trial188.stdout:1990: finishing copy_from to trial18843701-35 2026-02-13T20:20:24.068 INFO:tasks.rados.rados.0.trial188.stdout:1990: got expected ENOENT (src dne) 2026-02-13T20:20:24.069 INFO:tasks.rados.rados.0.trial188.stdout:1990: finishing copy_from racing read to trial18843701-35 2026-02-13T20:20:24.069 INFO:tasks.rados.rados.0.trial188.stdout:1989: expect (ObjNum 712 snap 203 seq_num 712) 2026-02-13T20:20:24.155 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 991718 2026-02-13T20:20:24.185 INFO:tasks.rados.rados.0.trial188.stdout:1987: finishing copy_from racing read to trial18843701-36 2026-02-13T20:20:24.185 INFO:tasks.rados.rados.0.trial188.stdout:1987: finishing copy_from to trial18843701-36 2026-02-13T20:20:24.185 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 36 v 755 (ObjNum 690 snap 199 seq_num 690) dirty exists 2026-02-13T20:20:25.067 INFO:tasks.rados.rados.0.trial188.stdout:1987: done (4 left) 2026-02-13T20:20:25.067 INFO:tasks.rados.rados.0.trial188.stdout:1988: done (3 left) 2026-02-13T20:20:25.067 INFO:tasks.rados.rados.0.trial188.stdout:1989: done (2 left) 2026-02-13T20:20:25.068 INFO:tasks.rados.rados.0.trial188.stdout:1990: done (1 left) 2026-02-13T20:20:25.068 INFO:tasks.rados.rados.0.trial188.stdout:1991: done (0 left) 2026-02-13T20:20:25.068 INFO:tasks.rados.rados.0.trial188.stdout:1992: snap_create 2026-02-13T20:20:26.068 INFO:tasks.rados.rados.0.trial188.stdout:1992: done (0 left) 2026-02-13T20:20:26.068 INFO:tasks.rados.rados.0.trial188.stdout:1993: snap_create 2026-02-13T20:20:27.069 INFO:tasks.rados.rados.0.trial188.stdout:1993: done (0 left) 2026-02-13T20:20:27.069 INFO:tasks.rados.rados.0.trial188.stdout:1994: snap_create 2026-02-13T20:20:28.066 INFO:tasks.rados.rados.0.trial188.stdout:1994: done (0 left) 2026-02-13T20:20:28.067 INFO:tasks.rados.rados.0.trial188.stdout:1995: write (excl) oid 34 current snap is 212 2026-02-13T20:20:28.067 INFO:tasks.rados.rados.0.trial188.stdout:1995: seq_num 718 ranges {467426=565964,1649130=418296} 2026-02-13T20:20:28.070 INFO:tasks.rados.rados.0.trial188.stdout:1995: writing trial18843701-34 from 467426 to 1033390 tid 1 2026-02-13T20:20:28.074 INFO:tasks.rados.rados.0.trial188.stdout:1995: writing trial18843701-34 from 1649130 to 2067426 tid 2 2026-02-13T20:20:28.074 INFO:tasks.rados.rados.0.trial188.stdout:1996: snap_remove snap 185 2026-02-13T20:20:29.076 INFO:tasks.rados.rados.0.trial188.stdout:1996: done (1 left) 2026-02-13T20:20:29.076 INFO:tasks.rados.rados.0.trial188.stdout:1997: rollback oid 46 current snap is 212 2026-02-13T20:20:29.076 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 46 to 203 2026-02-13T20:20:29.076 INFO:tasks.rados.rados.0.trial188.stdout:1995: finishing write tid 1 to trial18843701-34 2026-02-13T20:20:29.076 INFO:tasks.rados.rados.0.trial188.stdout:1995: finishing write tid 2 to trial18843701-34 2026-02-13T20:20:29.076 INFO:tasks.rados.rados.0.trial188.stdout:1995: finishing write tid 3 to trial18843701-34 2026-02-13T20:20:29.077 INFO:tasks.rados.rados.0.trial188.stdout:1995: finishing write tid 4 to trial18843701-34 2026-02-13T20:20:29.077 INFO:tasks.rados.rados.0.trial188.stdout:1995: oid 34 updating version 0 to 753 2026-02-13T20:20:29.077 INFO:tasks.rados.rados.0.trial188.stdout:1995: oid 34 updating version 753 to 754 2026-02-13T20:20:29.077 INFO:tasks.rados.rados.0.trial188.stdout:1995: oid 34 version 754 is already newer than 752 2026-02-13T20:20:29.077 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 34 v 754 (ObjNum 718 snap 212 seq_num 718) dirty exists 2026-02-13T20:20:29.077 INFO:tasks.rados.rados.0.trial188.stdout:1995: left oid 34 (ObjNum 718 snap 212 seq_num 718) 2026-02-13T20:20:29.077 INFO:tasks.rados.rados.0.trial188.stdout:1995: done (1 left) 2026-02-13T20:20:29.077 INFO:tasks.rados.rados.0.trial188.stdout:1998: copy_from oid 42 from oid 20 current snap is 212 2026-02-13T20:20:29.077 INFO:tasks.rados.rados.0.trial188.stdout:1999: rollback oid 4 current snap is 212 2026-02-13T20:20:29.077 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 4 to 205 2026-02-13T20:20:29.077 INFO:tasks.rados.rados.0.trial188.stdout:2000: snap_create 2026-02-13T20:20:29.078 INFO:tasks.rados.rados.0.trial188.stdout:1997: finishing rollback tid 0 to trial18843701-46 2026-02-13T20:20:29.078 INFO:tasks.rados.rados.0.trial188.stdout:1997: finishing rollback tid 1 to trial18843701-46 2026-02-13T20:20:29.078 INFO:tasks.rados.rados.0.trial188.stdout:1997: finishing rollback tid 2 to trial18843701-46 2026-02-13T20:20:29.078 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 46 v 758 (ObjNum 690 snap 199 seq_num 690) dirty exists 2026-02-13T20:20:29.079 INFO:tasks.rados.rados.0.trial188.stdout:1999: finishing rollback tid 0 to trial18843701-4 2026-02-13T20:20:29.079 INFO:tasks.rados.rados.0.trial188.stdout:1999: finishing rollback tid 1 to trial18843701-4 2026-02-13T20:20:29.079 INFO:tasks.rados.rados.0.trial188.stdout:1999: finishing rollback tid 2 to trial18843701-4 2026-02-13T20:20:29.079 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 4 v 760 (ObjNum 652 snap 176 seq_num 652) dirty exists 2026-02-13T20:20:29.107 INFO:tasks.rados.rados.0.trial188.stdout:1998: finishing copy_from racing read to trial18843701-42 2026-02-13T20:20:29.111 INFO:tasks.rados.rados.0.trial188.stdout:1998: finishing copy_from to trial18843701-42 2026-02-13T20:20:29.111 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 42 v 659 (ObjNum 634 snap 166 seq_num 634) dirty exists 2026-02-13T20:20:30.076 INFO:tasks.rados.rados.0.trial188.stdout:1997: done (3 left) 2026-02-13T20:20:30.077 INFO:tasks.rados.rados.0.trial188.stdout:1998: done (2 left) 2026-02-13T20:20:30.077 INFO:tasks.rados.rados.0.trial188.stdout:1999: done (1 left) 2026-02-13T20:20:30.077 INFO:tasks.rados.rados.0.trial188.stdout:2000: done (0 left) 2026-02-13T20:20:30.077 INFO:tasks.rados.rados.0.trial188.stdout:2001: write oid 21 current snap is 213 2026-02-13T20:20:30.077 INFO:tasks.rados.rados.0.trial188.stdout:2001: seq_num 719 ranges {484233=641213,1707612=376621} 2026-02-13T20:20:30.080 INFO:tasks.rados.rados.0.trial188.stdout:2001: writing trial18843701-21 from 484233 to 1125446 tid 1 2026-02-13T20:20:30.084 INFO:tasks.rados.rados.0.trial188.stdout:2001: writing trial18843701-21 from 1707612 to 2084233 tid 2 2026-02-13T20:20:30.084 INFO:tasks.rados.rados.0.trial188.stdout:2002: snap_remove snap 210 2026-02-13T20:20:31.081 INFO:tasks.rados.rados.0.trial188.stdout:2002: done (1 left) 2026-02-13T20:20:31.081 INFO:tasks.rados.rados.0.trial188.stdout:2003: write (excl) oid 31 current snap is 213 2026-02-13T20:20:31.081 INFO:tasks.rados.rados.0.trial188.stdout:2003: seq_num 720 ranges {501040=716462,1766094=334946} 2026-02-13T20:20:31.085 INFO:tasks.rados.rados.0.trial188.stdout:2003: writing trial18843701-31 from 501040 to 1217502 tid 1 2026-02-13T20:20:31.089 INFO:tasks.rados.rados.0.trial188.stdout:2003: writing trial18843701-31 from 1766094 to 2101040 tid 2 2026-02-13T20:20:31.089 INFO:tasks.rados.rados.0.trial188.stdout:2004: copy_from oid 8 from oid 20 current snap is 213 2026-02-13T20:20:31.089 INFO:tasks.rados.rados.0.trial188.stdout:2001: finishing write tid 1 to trial18843701-21 2026-02-13T20:20:31.089 INFO:tasks.rados.rados.0.trial188.stdout:2001: finishing write tid 2 to trial18843701-21 2026-02-13T20:20:31.089 INFO:tasks.rados.rados.0.trial188.stdout:2001: finishing write tid 3 to trial18843701-21 2026-02-13T20:20:31.089 INFO:tasks.rados.rados.0.trial188.stdout:2001: finishing write tid 4 to trial18843701-21 2026-02-13T20:20:31.089 INFO:tasks.rados.rados.0.trial188.stdout:2001: oid 21 updating version 0 to 481 2026-02-13T20:20:31.090 INFO:tasks.rados.rados.0.trial188.stdout:2001: oid 21 version 481 is already newer than 479 2026-02-13T20:20:31.090 INFO:tasks.rados.rados.0.trial188.stdout:2001: oid 21 version 481 is already newer than 480 2026-02-13T20:20:31.090 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 21 v 481 (ObjNum 719 snap 213 seq_num 719) dirty exists 2026-02-13T20:20:31.090 INFO:tasks.rados.rados.0.trial188.stdout:2001: left oid 21 (ObjNum 719 snap 213 seq_num 719) 2026-02-13T20:20:31.090 INFO:tasks.rados.rados.0.trial188.stdout:2001: done (2 left) 2026-02-13T20:20:31.090 INFO:tasks.rados.rados.0.trial188.stdout:2005: write oid 36 current snap is 213 2026-02-13T20:20:31.090 INFO:tasks.rados.rados.0.trial188.stdout:2005: seq_num 721 ranges {517847=791711,2108223=9624} 2026-02-13T20:20:31.093 INFO:tasks.rados.rados.0.trial188.stdout:2005: writing trial18843701-36 from 517847 to 1309558 tid 1 2026-02-13T20:20:31.097 INFO:tasks.rados.rados.0.trial188.stdout:2005: writing trial18843701-36 from 2108223 to 2117847 tid 2 2026-02-13T20:20:31.097 INFO:tasks.rados.rados.0.trial188.stdout:2006: read oid 39 snap 207 2026-02-13T20:20:31.097 INFO:tasks.rados.rados.0.trial188.stdout:2006: expect (ObjNum 679 snap 194 seq_num 679) 2026-02-13T20:20:31.097 INFO:tasks.rados.rados.0.trial188.stdout:2007: copy_from oid 44 from oid 5 current snap is 213 2026-02-13T20:20:31.097 INFO:tasks.rados.rados.0.trial188.stdout:2008: read oid 35 snap -1 2026-02-13T20:20:31.097 INFO:tasks.rados.rados.0.trial188.stdout:2008: expect (ObjNum 618 snap 163 seq_num 618) 2026-02-13T20:20:31.097 INFO:tasks.rados.rados.0.trial188.stdout:2009: delete oid 34 current snap is 213 2026-02-13T20:20:31.097 INFO:tasks.rados.rados.0.trial188.stdout:2007: finishing copy_from to trial18843701-44 2026-02-13T20:20:31.098 INFO:tasks.rados.rados.0.trial188.stdout:2007: got expected ENOENT (src dne) 2026-02-13T20:20:31.098 INFO:tasks.rados.rados.0.trial188.stdout:2007: finishing copy_from racing read to trial18843701-44 2026-02-13T20:20:31.098 INFO:tasks.rados.rados.0.trial188.stdout:2008: expect (ObjNum 618 snap 163 seq_num 618) 2026-02-13T20:20:31.098 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:20:31.126 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1728653 2026-02-13T20:20:31.166 INFO:tasks.rados.rados.0.trial188.stdout:2006: expect (ObjNum 679 snap 194 seq_num 679) 2026-02-13T20:20:31.167 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:20:31.372 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 3217363 2026-02-13T20:20:31.378 INFO:tasks.rados.rados.0.trial188.stdout:2004: finishing copy_from racing read to trial18843701-8 2026-02-13T20:20:31.378 INFO:tasks.rados.rados.0.trial188.stdout:2006: done (6 left) 2026-02-13T20:20:31.378 INFO:tasks.rados.rados.0.trial188.stdout:2007: done (5 left) 2026-02-13T20:20:31.378 INFO:tasks.rados.rados.0.trial188.stdout:2008: done (4 left) 2026-02-13T20:20:31.378 INFO:tasks.rados.rados.0.trial188.stdout:2009: done (3 left) 2026-02-13T20:20:31.378 INFO:tasks.rados.rados.0.trial188.stdout:2010: snap_create 2026-02-13T20:20:31.378 INFO:tasks.rados.rados.0.trial188.stdout:2005: finishing write tid 1 to trial18843701-36 2026-02-13T20:20:31.378 INFO:tasks.rados.rados.0.trial188.stdout:2003: finishing write tid 1 to trial18843701-31 2026-02-13T20:20:31.378 INFO:tasks.rados.rados.0.trial188.stdout:2004: finishing copy_from to trial18843701-8 2026-02-13T20:20:31.379 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 8 v 659 (ObjNum 634 snap 166 seq_num 634) dirty exists 2026-02-13T20:20:31.379 INFO:tasks.rados.rados.0.trial188.stdout:2003: finishing write tid 2 to trial18843701-31 2026-02-13T20:20:31.379 INFO:tasks.rados.rados.0.trial188.stdout:2005: finishing write tid 2 to trial18843701-36 2026-02-13T20:20:31.379 INFO:tasks.rados.rados.0.trial188.stdout:2003: finishing write tid 3 to trial18843701-31 2026-02-13T20:20:31.379 INFO:tasks.rados.rados.0.trial188.stdout:2003: finishing write tid 4 to trial18843701-31 2026-02-13T20:20:31.379 INFO:tasks.rados.rados.0.trial188.stdout:2003: oid 31 updating version 0 to 433 2026-02-13T20:20:31.379 INFO:tasks.rados.rados.0.trial188.stdout:2003: oid 31 version 433 is already newer than 432 2026-02-13T20:20:31.379 INFO:tasks.rados.rados.0.trial188.stdout:2003: oid 31 updating version 433 to 434 2026-02-13T20:20:31.379 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 31 v 434 (ObjNum 720 snap 213 seq_num 720) dirty exists 2026-02-13T20:20:31.379 INFO:tasks.rados.rados.0.trial188.stdout:2003: left oid 31 (ObjNum 720 snap 213 seq_num 720) 2026-02-13T20:20:31.379 INFO:tasks.rados.rados.0.trial188.stdout:2005: finishing write tid 3 to trial18843701-36 2026-02-13T20:20:31.379 INFO:tasks.rados.rados.0.trial188.stdout:2005: finishing write tid 4 to trial18843701-36 2026-02-13T20:20:31.379 INFO:tasks.rados.rados.0.trial188.stdout:2005: oid 36 updating version 0 to 883 2026-02-13T20:20:31.379 INFO:tasks.rados.rados.0.trial188.stdout:2005: oid 36 version 883 is already newer than 882 2026-02-13T20:20:31.379 INFO:tasks.rados.rados.0.trial188.stdout:2005: oid 36 updating version 883 to 884 2026-02-13T20:20:31.379 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 36 v 884 (ObjNum 721 snap 213 seq_num 721) dirty exists 2026-02-13T20:20:31.379 INFO:tasks.rados.rados.0.trial188.stdout:2005: left oid 36 (ObjNum 721 snap 213 seq_num 721) 2026-02-13T20:20:32.086 INFO:tasks.rados.rados.0.trial188.stdout:2003: done (3 left) 2026-02-13T20:20:32.086 INFO:tasks.rados.rados.0.trial188.stdout:2004: done (2 left) 2026-02-13T20:20:32.086 INFO:tasks.rados.rados.0.trial188.stdout:2005: done (1 left) 2026-02-13T20:20:32.086 INFO:tasks.rados.rados.0.trial188.stdout:2010: done (0 left) 2026-02-13T20:20:32.086 INFO:tasks.rados.rados.0.trial188.stdout:2011: rollback oid 25 current snap is 214 2026-02-13T20:20:32.087 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 25 to 198 2026-02-13T20:20:32.087 INFO:tasks.rados.rados.0.trial188.stdout:2012: read oid 22 snap 203 2026-02-13T20:20:32.087 INFO:tasks.rados.rados.0.trial188.stdout:2012: expect (ObjNum 703 snap 201 seq_num 703) 2026-02-13T20:20:32.087 INFO:tasks.rados.rados.0.trial188.stdout:2013: read oid 42 snap -1 2026-02-13T20:20:32.087 INFO:tasks.rados.rados.0.trial188.stdout:2013: expect (ObjNum 634 snap 166 seq_num 634) 2026-02-13T20:20:32.087 INFO:tasks.rados.rados.0.trial188.stdout:2014: snap_remove snap 204 2026-02-13T20:20:33.069 INFO:tasks.rados.rados.0.trial188.stdout:2014: done (3 left) 2026-02-13T20:20:33.069 INFO:tasks.rados.rados.0.trial188.stdout:2015: read oid 31 snap 211 2026-02-13T20:20:33.069 INFO:tasks.rados.rados.0.trial188.stdout:2015: expect (ObjNum 489 snap 127 seq_num 489) 2026-02-13T20:20:33.069 INFO:tasks.rados.rados.0.trial188.stdout:2016: rollback oid 43 current snap is 214 2026-02-13T20:20:33.070 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 43 to 181 2026-02-13T20:20:33.070 INFO:tasks.rados.rados.0.trial188.stdout:2012: expect (ObjNum 703 snap 201 seq_num 703) 2026-02-13T20:20:33.118 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:20:33.145 INFO:tasks.rados.rados.0.trial188.stdout:2011: finishing rollback tid 0 to trial18843701-25 2026-02-13T20:20:33.146 INFO:tasks.rados.rados.0.trial188.stdout:2011: finishing rollback tid 1 to trial18843701-25 2026-02-13T20:20:33.146 INFO:tasks.rados.rados.0.trial188.stdout:2011: finishing rollback tid 2 to trial18843701-25 2026-02-13T20:20:33.146 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 25 v 906 (ObjNum 681 snap 195 seq_num 681) dirty exists 2026-02-13T20:20:33.146 INFO:tasks.rados.rados.0.trial188.stdout:2013: expect (ObjNum 634 snap 166 seq_num 634) 2026-02-13T20:20:33.283 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1853086 2026-02-13T20:20:33.306 INFO:tasks.rados.rados.0.trial188.stdout:2016: finishing rollback tid 1 to trial18843701-43 2026-02-13T20:20:33.306 INFO:tasks.rados.rados.0.trial188.stdout:2016: finishing rollback tid 2 to trial18843701-43 2026-02-13T20:20:33.306 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 43 v 625 (ObjNum 598 snap 159 seq_num 598) dirty exists 2026-02-13T20:20:33.306 INFO:tasks.rados.rados.0.trial188.stdout:2015: expect (ObjNum 489 snap 127 seq_num 489) 2026-02-13T20:20:33.315 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:20:33.346 INFO:tasks.rados.rados.0.trial188.stdout:2011: done (4 left) 2026-02-13T20:20:33.346 INFO:tasks.rados.rados.0.trial188.stdout:2012: done (3 left) 2026-02-13T20:20:33.346 INFO:tasks.rados.rados.0.trial188.stdout:2013: done (2 left) 2026-02-13T20:20:33.346 INFO:tasks.rados.rados.0.trial188.stdout:2015: done (1 left) 2026-02-13T20:20:33.346 INFO:tasks.rados.rados.0.trial188.stdout:2016: done (0 left) 2026-02-13T20:20:33.346 INFO:tasks.rados.rados.0.trial188.stdout:2017: copy_from oid 2 from oid 36 current snap is 214 2026-02-13T20:20:33.346 INFO:tasks.rados.rados.0.trial188.stdout:2018: write oid 46 current snap is 214 2026-02-13T20:20:33.346 INFO:tasks.rados.rados.0.trial188.stdout:2018: seq_num 723 ranges {551461=658562,1941540=209921} 2026-02-13T20:20:33.350 INFO:tasks.rados.rados.0.trial188.stdout:2018: writing trial18843701-46 from 551461 to 1210023 tid 1 2026-02-13T20:20:33.354 INFO:tasks.rados.rados.0.trial188.stdout:2018: writing trial18843701-46 from 1941540 to 2151461 tid 2 2026-02-13T20:20:33.354 INFO:tasks.rados.rados.0.trial188.stdout:2019: rollback oid 25 current snap is 214 2026-02-13T20:20:33.354 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 25 to 198 2026-02-13T20:20:33.354 INFO:tasks.rados.rados.0.trial188.stdout:2020: read oid 3 snap -1 2026-02-13T20:20:33.354 INFO:tasks.rados.rados.0.trial188.stdout:2020: expect deleted 2026-02-13T20:20:33.354 INFO:tasks.rados.rados.0.trial188.stdout:2021: write oid 34 current snap is 214 2026-02-13T20:20:33.354 INFO:tasks.rados.rados.0.trial188.stdout:2021: seq_num 724 ranges {568268=733811,2000022=168246} 2026-02-13T20:20:33.359 INFO:tasks.rados.rados.0.trial188.stdout:2021: writing trial18843701-34 from 568268 to 1302079 tid 1 2026-02-13T20:20:33.362 INFO:tasks.rados.rados.0.trial188.stdout:2021: writing trial18843701-34 from 2000022 to 2168268 tid 2 2026-02-13T20:20:33.362 INFO:tasks.rados.rados.0.trial188.stdout:2022: copy_from oid 30 from oid 23 current snap is 214 2026-02-13T20:20:33.362 INFO:tasks.rados.rados.0.trial188.stdout:2019: finishing rollback tid 0 to trial18843701-25 2026-02-13T20:20:33.362 INFO:tasks.rados.rados.0.trial188.stdout:2019: finishing rollback tid 1 to trial18843701-25 2026-02-13T20:20:33.363 INFO:tasks.rados.rados.0.trial188.stdout:2019: finishing rollback tid 2 to trial18843701-25 2026-02-13T20:20:33.363 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 25 v 909 (ObjNum 681 snap 195 seq_num 681) dirty exists 2026-02-13T20:20:33.363 INFO:tasks.rados.rados.0.trial188.stdout:2019: done (5 left) 2026-02-13T20:20:33.363 INFO:tasks.rados.rados.0.trial188.stdout:2020: done (4 left) 2026-02-13T20:20:33.363 INFO:tasks.rados.rados.0.trial188.stdout:2023: delete oid 15 current snap is 214 2026-02-13T20:20:33.365 INFO:tasks.rados.rados.0.trial188.stdout:2018: finishing write tid 1 to trial18843701-46 2026-02-13T20:20:33.366 INFO:tasks.rados.rados.0.trial188.stdout:2018: finishing write tid 2 to trial18843701-46 2026-02-13T20:20:33.366 INFO:tasks.rados.rados.0.trial188.stdout:2018: finishing write tid 3 to trial18843701-46 2026-02-13T20:20:33.366 INFO:tasks.rados.rados.0.trial188.stdout:2018: finishing write tid 4 to trial18843701-46 2026-02-13T20:20:33.366 INFO:tasks.rados.rados.0.trial188.stdout:2018: oid 46 updating version 0 to 761 2026-02-13T20:20:33.366 INFO:tasks.rados.rados.0.trial188.stdout:2018: oid 46 version 761 is already newer than 759 2026-02-13T20:20:33.366 INFO:tasks.rados.rados.0.trial188.stdout:2018: oid 46 version 761 is already newer than 760 2026-02-13T20:20:33.366 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 46 v 761 (ObjNum 723 snap 214 seq_num 723) dirty exists 2026-02-13T20:20:33.366 INFO:tasks.rados.rados.0.trial188.stdout:2018: left oid 46 (ObjNum 723 snap 214 seq_num 723) 2026-02-13T20:20:33.369 INFO:tasks.rados.rados.0.trial188.stdout:2017: finishing copy_from racing read to trial18843701-2 2026-02-13T20:20:33.371 INFO:tasks.rados.rados.0.trial188.stdout:2022: finishing copy_from to trial18843701-30 2026-02-13T20:20:33.372 INFO:tasks.rados.rados.0.trial188.stdout:2022: got expected ENOENT (src dne) 2026-02-13T20:20:33.372 INFO:tasks.rados.rados.0.trial188.stdout:2022: finishing copy_from racing read to trial18843701-30 2026-02-13T20:20:33.373 INFO:tasks.rados.rados.0.trial188.stdout:2018: done (4 left) 2026-02-13T20:20:33.373 INFO:tasks.rados.rados.0.trial188.stdout:2022: done (3 left) 2026-02-13T20:20:33.374 INFO:tasks.rados.rados.0.trial188.stdout:2023: done (2 left) 2026-02-13T20:20:33.374 INFO:tasks.rados.rados.0.trial188.stdout:2024: delete oid 40 current snap is 214 2026-02-13T20:20:33.374 INFO:tasks.rados.rados.0.trial188.stdout:2021: finishing write tid 1 to trial18843701-34 2026-02-13T20:20:33.374 INFO:tasks.rados.rados.0.trial188.stdout:2017: finishing copy_from to trial18843701-2 2026-02-13T20:20:33.374 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 2 v 884 (ObjNum 721 snap 213 seq_num 721) dirty exists 2026-02-13T20:20:33.374 INFO:tasks.rados.rados.0.trial188.stdout:2021: finishing write tid 2 to trial18843701-34 2026-02-13T20:20:33.374 INFO:tasks.rados.rados.0.trial188.stdout:2021: finishing write tid 3 to trial18843701-34 2026-02-13T20:20:33.374 INFO:tasks.rados.rados.0.trial188.stdout:2021: finishing write tid 4 to trial18843701-34 2026-02-13T20:20:33.374 INFO:tasks.rados.rados.0.trial188.stdout:2021: oid 34 updating version 0 to 769 2026-02-13T20:20:33.374 INFO:tasks.rados.rados.0.trial188.stdout:2021: oid 34 updating version 769 to 771 2026-02-13T20:20:33.374 INFO:tasks.rados.rados.0.trial188.stdout:2021: oid 34 version 771 is already newer than 770 2026-02-13T20:20:33.374 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 34 v 771 (ObjNum 724 snap 214 seq_num 724) dirty exists 2026-02-13T20:20:33.374 INFO:tasks.rados.rados.0.trial188.stdout:2021: left oid 34 (ObjNum 724 snap 214 seq_num 724) 2026-02-13T20:20:33.375 INFO:tasks.rados.rados.0.trial188.stdout:2017: done (2 left) 2026-02-13T20:20:33.375 INFO:tasks.rados.rados.0.trial188.stdout:2021: done (1 left) 2026-02-13T20:20:33.375 INFO:tasks.rados.rados.0.trial188.stdout:2024: done (0 left) 2026-02-13T20:20:33.375 INFO:tasks.rados.rados.0.trial188.stdout:2025: read oid 34 snap -1 2026-02-13T20:20:33.375 INFO:tasks.rados.rados.0.trial188.stdout:2025: expect (ObjNum 724 snap 214 seq_num 724) 2026-02-13T20:20:33.375 INFO:tasks.rados.rados.0.trial188.stdout:2026: delete oid 27 current snap is 214 2026-02-13T20:20:33.375 INFO:tasks.rados.rados.0.trial188.stdout:2025: expect (ObjNum 724 snap 214 seq_num 724) 2026-02-13T20:20:33.408 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1077154 2026-02-13T20:20:33.416 INFO:tasks.rados.rados.0.trial188.stdout:2025: done (1 left) 2026-02-13T20:20:33.417 INFO:tasks.rados.rados.0.trial188.stdout:2026: done (0 left) 2026-02-13T20:20:33.417 INFO:tasks.rados.rados.0.trial188.stdout:2027: rollback oid 50 current snap is 214 2026-02-13T20:20:33.417 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 50 to 180 2026-02-13T20:20:33.417 INFO:tasks.rados.rados.0.trial188.stdout:2028: snap_remove snap 208 2026-02-13T20:20:34.092 INFO:tasks.rados.rados.0.trial188.stdout:2028: done (1 left) 2026-02-13T20:20:34.092 INFO:tasks.rados.rados.0.trial188.stdout:2029: write (excl) oid 15 current snap is 214 2026-02-13T20:20:34.092 INFO:tasks.rados.rados.0.trial188.stdout:2027: finishing rollback tid 1 to trial18843701-50 2026-02-13T20:20:34.092 INFO:tasks.rados.rados.0.trial188.stdout:2027: finishing rollback tid 2 to trial18843701-50 2026-02-13T20:20:34.092 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 50 v 888 (ObjNum 564 snap 151 seq_num 564) dirty exists 2026-02-13T20:20:34.092 INFO:tasks.rados.rados.0.trial188.stdout:2029: seq_num 728 ranges {635496=634807,1717597=517899} 2026-02-13T20:20:34.096 INFO:tasks.rados.rados.0.trial188.stdout:2029: writing trial18843701-15 from 635496 to 1270303 tid 1 2026-02-13T20:20:34.101 INFO:tasks.rados.rados.0.trial188.stdout:2029: writing trial18843701-15 from 1717597 to 2235496 tid 2 2026-02-13T20:20:34.101 INFO:tasks.rados.rados.0.trial188.stdout:2027: done (1 left) 2026-02-13T20:20:34.101 INFO:tasks.rados.rados.0.trial188.stdout:2030: read oid 33 snap -1 2026-02-13T20:20:34.101 INFO:tasks.rados.rados.0.trial188.stdout:2030: expect (ObjNum 703 snap 201 seq_num 703) 2026-02-13T20:20:34.101 INFO:tasks.rados.rados.0.trial188.stdout:2031: snap_create 2026-02-13T20:20:34.113 INFO:tasks.rados.rados.0.trial188.stdout:2030: expect (ObjNum 703 snap 201 seq_num 703) 2026-02-13T20:20:34.117 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1004043 2026-02-13T20:20:34.169 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 901002 2026-02-13T20:20:34.190 INFO:tasks.rados.rados.0.trial188.stdout:2029: finishing write tid 1 to trial18843701-15 2026-02-13T20:20:34.190 INFO:tasks.rados.rados.0.trial188.stdout:2029: finishing write tid 2 to trial18843701-15 2026-02-13T20:20:34.190 INFO:tasks.rados.rados.0.trial188.stdout:2029: finishing write tid 3 to trial18843701-15 2026-02-13T20:20:34.190 INFO:tasks.rados.rados.0.trial188.stdout:2029: finishing write tid 4 to trial18843701-15 2026-02-13T20:20:34.191 INFO:tasks.rados.rados.0.trial188.stdout:2029: oid 15 updating version 0 to 758 2026-02-13T20:20:34.191 INFO:tasks.rados.rados.0.trial188.stdout:2029: oid 15 updating version 758 to 760 2026-02-13T20:20:34.191 INFO:tasks.rados.rados.0.trial188.stdout:2029: oid 15 version 760 is already newer than 759 2026-02-13T20:20:34.191 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 15 v 760 (ObjNum 728 snap 214 seq_num 728) dirty exists 2026-02-13T20:20:34.191 INFO:tasks.rados.rados.0.trial188.stdout:2029: left oid 15 (ObjNum 728 snap 214 seq_num 728) 2026-02-13T20:20:35.096 INFO:tasks.rados.rados.0.trial188.stdout:2029: done (2 left) 2026-02-13T20:20:35.096 INFO:tasks.rados.rados.0.trial188.stdout:2030: done (1 left) 2026-02-13T20:20:35.096 INFO:tasks.rados.rados.0.trial188.stdout:2031: done (0 left) 2026-02-13T20:20:35.096 INFO:tasks.rados.rados.0.trial188.stdout:2032: snap_remove snap 213 2026-02-13T20:20:36.096 INFO:tasks.rados.rados.0.trial188.stdout:2032: done (0 left) 2026-02-13T20:20:36.096 INFO:tasks.rados.rados.0.trial188.stdout:2033: read oid 49 snap -1 2026-02-13T20:20:36.096 INFO:tasks.rados.rados.0.trial188.stdout:2033: expect deleted 2026-02-13T20:20:36.096 INFO:tasks.rados.rados.0.trial188.stdout:2034: read oid 23 snap -1 2026-02-13T20:20:36.097 INFO:tasks.rados.rados.0.trial188.stdout:2034: expect deleted 2026-02-13T20:20:36.097 INFO:tasks.rados.rados.0.trial188.stdout:2035: snap_create 2026-02-13T20:20:37.097 INFO:tasks.rados.rados.0.trial188.stdout:2033: done (2 left) 2026-02-13T20:20:37.097 INFO:tasks.rados.rados.0.trial188.stdout:2034: done (1 left) 2026-02-13T20:20:37.097 INFO:tasks.rados.rados.0.trial188.stdout:2035: done (0 left) 2026-02-13T20:20:37.097 INFO:tasks.rados.rados.0.trial188.stdout:2036: write oid 28 current snap is 216 2026-02-13T20:20:37.097 INFO:tasks.rados.rados.0.trial188.stdout:2036: seq_num 729 ranges {652303=710056,2059726=192577} 2026-02-13T20:20:37.102 INFO:tasks.rados.rados.0.trial188.stdout:2036: writing trial18843701-28 from 652303 to 1362359 tid 1 2026-02-13T20:20:37.106 INFO:tasks.rados.rados.0.trial188.stdout:2036: writing trial18843701-28 from 2059726 to 2252303 tid 2 2026-02-13T20:20:37.106 INFO:tasks.rados.rados.0.trial188.stdout:2037: read oid 12 snap 211 2026-02-13T20:20:37.106 INFO:tasks.rados.rados.0.trial188.stdout:2037: expect (ObjNum 714 snap 204 seq_num 714) 2026-02-13T20:20:37.106 INFO:tasks.rados.rados.0.trial188.stdout:2038: read oid 14 snap -1 2026-02-13T20:20:37.106 INFO:tasks.rados.rados.0.trial188.stdout:2038: expect (ObjNum 668 snap 182 seq_num 668) 2026-02-13T20:20:37.106 INFO:tasks.rados.rados.0.trial188.stdout:2039: copy_from oid 43 from oid 47 current snap is 216 2026-02-13T20:20:37.106 INFO:tasks.rados.rados.0.trial188.stdout:2040: delete oid 50 current snap is 216 2026-02-13T20:20:37.112 INFO:tasks.rados.rados.0.trial188.stdout:2038: expect (ObjNum 668 snap 182 seq_num 668) 2026-02-13T20:20:37.143 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2007156 2026-02-13T20:20:37.170 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 909372 2026-02-13T20:20:37.275 INFO:tasks.rados.rados.0.trial188.stdout:2037: expect (ObjNum 714 snap 204 seq_num 714) 2026-02-13T20:20:37.315 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:20:37.337 INFO:tasks.rados.rados.0.trial188.stdout:2036: finishing write tid 1 to trial18843701-28 2026-02-13T20:20:37.337 INFO:tasks.rados.rados.0.trial188.stdout:2036: finishing write tid 2 to trial18843701-28 2026-02-13T20:20:37.337 INFO:tasks.rados.rados.0.trial188.stdout:2036: finishing write tid 3 to trial18843701-28 2026-02-13T20:20:37.338 INFO:tasks.rados.rados.0.trial188.stdout:2036: finishing write tid 4 to trial18843701-28 2026-02-13T20:20:37.338 INFO:tasks.rados.rados.0.trial188.stdout:2036: oid 28 updating version 0 to 778 2026-02-13T20:20:37.338 INFO:tasks.rados.rados.0.trial188.stdout:2036: oid 28 version 778 is already newer than 776 2026-02-13T20:20:37.338 INFO:tasks.rados.rados.0.trial188.stdout:2036: oid 28 version 778 is already newer than 777 2026-02-13T20:20:37.338 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 28 v 778 (ObjNum 729 snap 216 seq_num 729) dirty exists 2026-02-13T20:20:37.338 INFO:tasks.rados.rados.0.trial188.stdout:2036: left oid 28 (ObjNum 729 snap 216 seq_num 729) 2026-02-13T20:20:37.338 INFO:tasks.rados.rados.0.trial188.stdout:2039: finishing copy_from racing read to trial18843701-43 2026-02-13T20:20:37.338 INFO:tasks.rados.rados.0.trial188.stdout:2039: finishing copy_from to trial18843701-43 2026-02-13T20:20:37.338 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 43 v 665 (ObjNum 712 snap 203 seq_num 712) dirty exists 2026-02-13T20:20:37.338 INFO:tasks.rados.rados.0.trial188.stdout:2036: done (4 left) 2026-02-13T20:20:37.338 INFO:tasks.rados.rados.0.trial188.stdout:2037: done (3 left) 2026-02-13T20:20:37.339 INFO:tasks.rados.rados.0.trial188.stdout:2038: done (2 left) 2026-02-13T20:20:37.339 INFO:tasks.rados.rados.0.trial188.stdout:2039: done (1 left) 2026-02-13T20:20:37.339 INFO:tasks.rados.rados.0.trial188.stdout:2040: done (0 left) 2026-02-13T20:20:37.339 INFO:tasks.rados.rados.0.trial188.stdout:2041: rollback oid 4 current snap is 216 2026-02-13T20:20:37.339 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 4 to 214 2026-02-13T20:20:37.339 INFO:tasks.rados.rados.0.trial188.stdout:2042: write (excl) oid 32 current snap is 216 2026-02-13T20:20:37.339 INFO:tasks.rados.rados.0.trial188.stdout:2042: seq_num 731 ranges {685917=576907,1893043=392874} 2026-02-13T20:20:37.341 INFO:tasks.rados.rados.0.trial188.stdout:2042: writing trial18843701-32 from 685917 to 1262824 tid 1 2026-02-13T20:20:37.345 INFO:tasks.rados.rados.0.trial188.stdout:2042: writing trial18843701-32 from 1893043 to 2285917 tid 2 2026-02-13T20:20:37.345 INFO:tasks.rados.rados.0.trial188.stdout:2043: snap_remove snap 203 2026-02-13T20:20:38.070 INFO:tasks.rados.rados.0.trial188.stdout:2043: done (2 left) 2026-02-13T20:20:38.070 INFO:tasks.rados.rados.0.trial188.stdout:2044: delete oid 18 current snap is 216 2026-02-13T20:20:38.071 INFO:tasks.rados.rados.0.trial188.stdout:2041: finishing rollback tid 0 to trial18843701-4 2026-02-13T20:20:38.071 INFO:tasks.rados.rados.0.trial188.stdout:2041: finishing rollback tid 1 to trial18843701-4 2026-02-13T20:20:38.071 INFO:tasks.rados.rados.0.trial188.stdout:2041: finishing rollback tid 2 to trial18843701-4 2026-02-13T20:20:38.071 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 4 v 763 (ObjNum 652 snap 176 seq_num 652) dirty exists 2026-02-13T20:20:38.071 INFO:tasks.rados.rados.0.trial188.stdout:2042: finishing write tid 1 to trial18843701-32 2026-02-13T20:20:38.071 INFO:tasks.rados.rados.0.trial188.stdout:2042: finishing write tid 2 to trial18843701-32 2026-02-13T20:20:38.071 INFO:tasks.rados.rados.0.trial188.stdout:2042: finishing write tid 3 to trial18843701-32 2026-02-13T20:20:38.071 INFO:tasks.rados.rados.0.trial188.stdout:2042: finishing write tid 4 to trial18843701-32 2026-02-13T20:20:38.071 INFO:tasks.rados.rados.0.trial188.stdout:2042: oid 32 updating version 0 to 764 2026-02-13T20:20:38.072 INFO:tasks.rados.rados.0.trial188.stdout:2042: oid 32 version 764 is already newer than 762 2026-02-13T20:20:38.072 INFO:tasks.rados.rados.0.trial188.stdout:2042: oid 32 version 764 is already newer than 763 2026-02-13T20:20:38.072 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 32 v 764 (ObjNum 731 snap 216 seq_num 731) dirty exists 2026-02-13T20:20:38.072 INFO:tasks.rados.rados.0.trial188.stdout:2042: left oid 32 (ObjNum 731 snap 216 seq_num 731) 2026-02-13T20:20:38.072 INFO:tasks.rados.rados.0.trial188.stdout:2041: done (2 left) 2026-02-13T20:20:38.072 INFO:tasks.rados.rados.0.trial188.stdout:2042: done (1 left) 2026-02-13T20:20:38.073 INFO:tasks.rados.rados.0.trial188.stdout:2044: done (0 left) 2026-02-13T20:20:38.073 INFO:tasks.rados.rados.0.trial188.stdout:2045: delete oid 42 current snap is 216 2026-02-13T20:20:38.075 INFO:tasks.rados.rados.0.trial188.stdout:2045: done (0 left) 2026-02-13T20:20:38.075 INFO:tasks.rados.rados.0.trial188.stdout:2046: delete oid 32 current snap is 216 2026-02-13T20:20:38.076 INFO:tasks.rados.rados.0.trial188.stdout:2046: done (0 left) 2026-02-13T20:20:38.076 INFO:tasks.rados.rados.0.trial188.stdout:2047: snap_create 2026-02-13T20:20:39.070 INFO:tasks.rados.rados.0.trial188.stdout:2047: done (0 left) 2026-02-13T20:20:39.070 INFO:tasks.rados.rados.0.trial188.stdout:2048: snap_create 2026-02-13T20:20:40.070 INFO:tasks.rados.rados.0.trial188.stdout:2048: done (0 left) 2026-02-13T20:20:40.070 INFO:tasks.rados.rados.0.trial188.stdout:2049: write (excl) oid 22 current snap is 218 2026-02-13T20:20:40.070 INFO:tasks.rados.rados.0.trial188.stdout:2049: seq_num 735 ranges {753145=477903,2010618=342527} 2026-02-13T20:20:40.075 INFO:tasks.rados.rados.0.trial188.stdout:2049: writing trial18843701-22 from 753145 to 1231048 tid 1 2026-02-13T20:20:40.079 INFO:tasks.rados.rados.0.trial188.stdout:2049: writing trial18843701-22 from 2010618 to 2353145 tid 2 2026-02-13T20:20:40.080 INFO:tasks.rados.rados.0.trial188.stdout:2050: read oid 19 snap -1 2026-02-13T20:20:40.080 INFO:tasks.rados.rados.0.trial188.stdout:2050: expect (ObjNum 688 snap 199 seq_num 688) 2026-02-13T20:20:40.080 INFO:tasks.rados.rados.0.trial188.stdout:2051: read oid 23 snap 215 2026-02-13T20:20:40.080 INFO:tasks.rados.rados.0.trial188.stdout:2051: expect deleted 2026-02-13T20:20:40.080 INFO:tasks.rados.rados.0.trial188.stdout:2052: write (excl) oid 30 current snap is 218 2026-02-13T20:20:40.080 INFO:tasks.rados.rados.0.trial188.stdout:2052: seq_num 736 ranges {769952=553152,2069100=300852} 2026-02-13T20:20:40.084 INFO:tasks.rados.rados.0.trial188.stdout:2052: writing trial18843701-30 from 769952 to 1323104 tid 1 2026-02-13T20:20:40.088 INFO:tasks.rados.rados.0.trial188.stdout:2052: writing trial18843701-30 from 2069100 to 2369952 tid 2 2026-02-13T20:20:40.088 INFO:tasks.rados.rados.0.trial188.stdout:2053: rollback oid 13 current snap is 218 2026-02-13T20:20:40.088 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 13 to 209 2026-02-13T20:20:40.088 INFO:tasks.rados.rados.0.trial188.stdout:2051: done (4 left) 2026-02-13T20:20:40.088 INFO:tasks.rados.rados.0.trial188.stdout:2054: read oid 1 snap -1 2026-02-13T20:20:40.088 INFO:tasks.rados.rados.0.trial188.stdout:2054: expect deleted 2026-02-13T20:20:40.088 INFO:tasks.rados.rados.0.trial188.stdout:2055: write (excl) oid 26 current snap is 218 2026-02-13T20:20:40.088 INFO:tasks.rados.rados.0.trial188.stdout:2055: seq_num 737 ranges {786759=628401,2011229=375530} 2026-02-13T20:20:40.093 INFO:tasks.rados.rados.0.trial188.stdout:2055: writing trial18843701-26 from 786759 to 1415160 tid 1 2026-02-13T20:20:40.097 INFO:tasks.rados.rados.0.trial188.stdout:2055: writing trial18843701-26 from 2011229 to 2386759 tid 2 2026-02-13T20:20:40.097 INFO:tasks.rados.rados.0.trial188.stdout:2056: write oid 5 current snap is 218 2026-02-13T20:20:40.097 INFO:tasks.rados.rados.0.trial188.stdout:2056: seq_num 738 ranges {403566=420003,1386064=546918} 2026-02-13T20:20:40.100 INFO:tasks.rados.rados.0.trial188.stdout:2056: writing trial18843701-5 from 403566 to 823569 tid 1 2026-02-13T20:20:40.104 INFO:tasks.rados.rados.0.trial188.stdout:2056: writing trial18843701-5 from 1386064 to 1932982 tid 2 2026-02-13T20:20:40.104 INFO:tasks.rados.rados.0.trial188.stdout:2057: read oid 49 snap -1 2026-02-13T20:20:40.104 INFO:tasks.rados.rados.0.trial188.stdout:2057: expect deleted 2026-02-13T20:20:40.104 INFO:tasks.rados.rados.0.trial188.stdout:2058: snap_create 2026-02-13T20:20:40.104 INFO:tasks.rados.rados.0.trial188.stdout:2049: finishing write tid 1 to trial18843701-22 2026-02-13T20:20:40.104 INFO:tasks.rados.rados.0.trial188.stdout:2050: expect (ObjNum 688 snap 199 seq_num 688) 2026-02-13T20:20:40.104 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:20:40.188 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2579555 2026-02-13T20:20:40.199 INFO:tasks.rados.rados.0.trial188.stdout:2049: finishing write tid 2 to trial18843701-22 2026-02-13T20:20:40.199 INFO:tasks.rados.rados.0.trial188.stdout:2049: finishing write tid 3 to trial18843701-22 2026-02-13T20:20:40.199 INFO:tasks.rados.rados.0.trial188.stdout:2049: finishing write tid 4 to trial18843701-22 2026-02-13T20:20:40.199 INFO:tasks.rados.rados.0.trial188.stdout:2049: oid 22 updating version 0 to 667 2026-02-13T20:20:40.200 INFO:tasks.rados.rados.0.trial188.stdout:2049: oid 22 version 667 is already newer than 666 2026-02-13T20:20:40.200 INFO:tasks.rados.rados.0.trial188.stdout:2049: oid 22 updating version 667 to 668 2026-02-13T20:20:40.200 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 22 v 668 (ObjNum 735 snap 218 seq_num 735) dirty exists 2026-02-13T20:20:40.200 INFO:tasks.rados.rados.0.trial188.stdout:2049: left oid 22 (ObjNum 735 snap 218 seq_num 735) 2026-02-13T20:20:40.200 INFO:tasks.rados.rados.0.trial188.stdout:2053: finishing rollback tid 0 to trial18843701-13 2026-02-13T20:20:40.200 INFO:tasks.rados.rados.0.trial188.stdout:2053: finishing rollback tid 1 to trial18843701-13 2026-02-13T20:20:40.200 INFO:tasks.rados.rados.0.trial188.stdout:2053: finishing rollback tid 2 to trial18843701-13 2026-02-13T20:20:40.200 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 13 v 887 (ObjNum 618 snap 163 seq_num 618) dirty exists 2026-02-13T20:20:40.200 INFO:tasks.rados.rados.0.trial188.stdout:2052: finishing write tid 1 to trial18843701-30 2026-02-13T20:20:40.200 INFO:tasks.rados.rados.0.trial188.stdout:2052: finishing write tid 2 to trial18843701-30 2026-02-13T20:20:40.200 INFO:tasks.rados.rados.0.trial188.stdout:2052: finishing write tid 3 to trial18843701-30 2026-02-13T20:20:40.200 INFO:tasks.rados.rados.0.trial188.stdout:2052: finishing write tid 4 to trial18843701-30 2026-02-13T20:20:40.200 INFO:tasks.rados.rados.0.trial188.stdout:2052: oid 30 updating version 0 to 925 2026-02-13T20:20:40.200 INFO:tasks.rados.rados.0.trial188.stdout:2052: oid 30 version 925 is already newer than 923 2026-02-13T20:20:40.200 INFO:tasks.rados.rados.0.trial188.stdout:2052: oid 30 version 925 is already newer than 924 2026-02-13T20:20:40.200 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 30 v 925 (ObjNum 736 snap 218 seq_num 736) dirty exists 2026-02-13T20:20:40.200 INFO:tasks.rados.rados.0.trial188.stdout:2052: left oid 30 (ObjNum 736 snap 218 seq_num 736) 2026-02-13T20:20:40.200 INFO:tasks.rados.rados.0.trial188.stdout:2055: finishing write tid 1 to trial18843701-26 2026-02-13T20:20:40.201 INFO:tasks.rados.rados.0.trial188.stdout:2055: finishing write tid 2 to trial18843701-26 2026-02-13T20:20:40.201 INFO:tasks.rados.rados.0.trial188.stdout:2055: finishing write tid 3 to trial18843701-26 2026-02-13T20:20:40.201 INFO:tasks.rados.rados.0.trial188.stdout:2056: finishing write tid 1 to trial18843701-5 2026-02-13T20:20:40.201 INFO:tasks.rados.rados.0.trial188.stdout:2055: finishing write tid 4 to trial18843701-26 2026-02-13T20:20:40.201 INFO:tasks.rados.rados.0.trial188.stdout:2055: oid 26 updating version 0 to 761 2026-02-13T20:20:40.201 INFO:tasks.rados.rados.0.trial188.stdout:2055: oid 26 updating version 761 to 762 2026-02-13T20:20:40.201 INFO:tasks.rados.rados.0.trial188.stdout:2055: oid 26 updating version 762 to 763 2026-02-13T20:20:40.201 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 26 v 763 (ObjNum 737 snap 218 seq_num 737) dirty exists 2026-02-13T20:20:40.201 INFO:tasks.rados.rados.0.trial188.stdout:2055: left oid 26 (ObjNum 737 snap 218 seq_num 737) 2026-02-13T20:20:40.201 INFO:tasks.rados.rados.0.trial188.stdout:2056: finishing write tid 2 to trial18843701-5 2026-02-13T20:20:40.201 INFO:tasks.rados.rados.0.trial188.stdout:2056: finishing write tid 3 to trial18843701-5 2026-02-13T20:20:40.201 INFO:tasks.rados.rados.0.trial188.stdout:2056: finishing write tid 4 to trial18843701-5 2026-02-13T20:20:40.201 INFO:tasks.rados.rados.0.trial188.stdout:2056: oid 5 updating version 0 to 889 2026-02-13T20:20:40.201 INFO:tasks.rados.rados.0.trial188.stdout:2056: oid 5 updating version 889 to 890 2026-02-13T20:20:40.201 INFO:tasks.rados.rados.0.trial188.stdout:2056: oid 5 version 890 is already newer than 888 2026-02-13T20:20:40.201 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 5 v 890 (ObjNum 738 snap 218 seq_num 738) dirty exists 2026-02-13T20:20:40.201 INFO:tasks.rados.rados.0.trial188.stdout:2056: left oid 5 (ObjNum 738 snap 218 seq_num 738) 2026-02-13T20:20:41.076 INFO:tasks.rados.rados.0.trial188.stdout:2049: done (8 left) 2026-02-13T20:20:41.076 INFO:tasks.rados.rados.0.trial188.stdout:2050: done (7 left) 2026-02-13T20:20:41.076 INFO:tasks.rados.rados.0.trial188.stdout:2052: done (6 left) 2026-02-13T20:20:41.076 INFO:tasks.rados.rados.0.trial188.stdout:2053: done (5 left) 2026-02-13T20:20:41.076 INFO:tasks.rados.rados.0.trial188.stdout:2054: done (4 left) 2026-02-13T20:20:41.076 INFO:tasks.rados.rados.0.trial188.stdout:2055: done (3 left) 2026-02-13T20:20:41.076 INFO:tasks.rados.rados.0.trial188.stdout:2056: done (2 left) 2026-02-13T20:20:41.076 INFO:tasks.rados.rados.0.trial188.stdout:2057: done (1 left) 2026-02-13T20:20:41.076 INFO:tasks.rados.rados.0.trial188.stdout:2058: done (0 left) 2026-02-13T20:20:41.076 INFO:tasks.rados.rados.0.trial188.stdout:2059: rollback oid 43 current snap is 219 2026-02-13T20:20:41.076 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 43 to 216 2026-02-13T20:20:41.076 INFO:tasks.rados.rados.0.trial188.stdout:2060: snap_create 2026-02-13T20:20:41.079 INFO:tasks.rados.rados.0.trial188.stdout:2059: finishing rollback tid 0 to trial18843701-43 2026-02-13T20:20:41.079 INFO:tasks.rados.rados.0.trial188.stdout:2059: finishing rollback tid 1 to trial18843701-43 2026-02-13T20:20:41.079 INFO:tasks.rados.rados.0.trial188.stdout:2059: finishing rollback tid 2 to trial18843701-43 2026-02-13T20:20:41.079 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 43 v 671 (ObjNum 712 snap 203 seq_num 712) dirty exists 2026-02-13T20:20:42.076 INFO:tasks.rados.rados.0.trial188.stdout:2059: done (1 left) 2026-02-13T20:20:42.076 INFO:tasks.rados.rados.0.trial188.stdout:2060: done (0 left) 2026-02-13T20:20:42.076 INFO:tasks.rados.rados.0.trial188.stdout:2061: write (excl) oid 32 current snap is 220 2026-02-13T20:20:42.076 INFO:tasks.rados.rados.0.trial188.stdout:2061: seq_num 739 ranges {420373=495252,1444546=690576} 2026-02-13T20:20:42.080 INFO:tasks.rados.rados.0.trial188.stdout:2061: writing trial18843701-32 from 420373 to 915625 tid 1 2026-02-13T20:20:42.084 INFO:tasks.rados.rados.0.trial188.stdout:2061: writing trial18843701-32 from 1444546 to 2135122 tid 2 2026-02-13T20:20:42.084 INFO:tasks.rados.rados.0.trial188.stdout:2062: rollback oid 25 current snap is 220 2026-02-13T20:20:42.084 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 25 to 205 2026-02-13T20:20:42.084 INFO:tasks.rados.rados.0.trial188.stdout:2063: copy_from oid 7 from oid 46 current snap is 220 2026-02-13T20:20:42.084 INFO:tasks.rados.rados.0.trial188.stdout:2064: snap_remove snap 200 2026-02-13T20:20:43.069 INFO:tasks.rados.rados.0.trial188.stdout:2064: done (3 left) 2026-02-13T20:20:43.069 INFO:tasks.rados.rados.0.trial188.stdout:2065: read oid 47 snap -1 2026-02-13T20:20:43.070 INFO:tasks.rados.rados.0.trial188.stdout:2065: expect (ObjNum 712 snap 203 seq_num 712) 2026-02-13T20:20:43.070 INFO:tasks.rados.rados.0.trial188.stdout:2066: read oid 8 snap -1 2026-02-13T20:20:43.070 INFO:tasks.rados.rados.0.trial188.stdout:2066: expect (ObjNum 634 snap 166 seq_num 634) 2026-02-13T20:20:43.070 INFO:tasks.rados.rados.0.trial188.stdout:2067: write oid 21 current snap is 220 2026-02-13T20:20:43.070 INFO:tasks.rados.rados.0.trial188.stdout:2062: finishing rollback tid 0 to trial18843701-25 2026-02-13T20:20:43.070 INFO:tasks.rados.rados.0.trial188.stdout:2062: finishing rollback tid 1 to trial18843701-25 2026-02-13T20:20:43.070 INFO:tasks.rados.rados.0.trial188.stdout:2062: finishing rollback tid 2 to trial18843701-25 2026-02-13T20:20:43.070 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 25 v 929 (ObjNum 615 snap 162 seq_num 615) dirty exists 2026-02-13T20:20:43.070 INFO:tasks.rados.rados.0.trial188.stdout:2061: finishing write tid 1 to trial18843701-32 2026-02-13T20:20:43.070 INFO:tasks.rados.rados.0.trial188.stdout:2061: finishing write tid 2 to trial18843701-32 2026-02-13T20:20:43.070 INFO:tasks.rados.rados.0.trial188.stdout:2061: finishing write tid 3 to trial18843701-32 2026-02-13T20:20:43.070 INFO:tasks.rados.rados.0.trial188.stdout:2061: finishing write tid 4 to trial18843701-32 2026-02-13T20:20:43.070 INFO:tasks.rados.rados.0.trial188.stdout:2061: oid 32 updating version 0 to 767 2026-02-13T20:20:43.070 INFO:tasks.rados.rados.0.trial188.stdout:2061: oid 32 version 767 is already newer than 766 2026-02-13T20:20:43.070 INFO:tasks.rados.rados.0.trial188.stdout:2061: oid 32 updating version 767 to 768 2026-02-13T20:20:43.070 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 32 v 768 (ObjNum 739 snap 220 seq_num 739) dirty exists 2026-02-13T20:20:43.070 INFO:tasks.rados.rados.0.trial188.stdout:2061: left oid 32 (ObjNum 739 snap 220 seq_num 739) 2026-02-13T20:20:43.070 INFO:tasks.rados.rados.0.trial188.stdout:2063: finishing copy_from racing read to trial18843701-7 2026-02-13T20:20:43.070 INFO:tasks.rados.rados.0.trial188.stdout:2063: finishing copy_from to trial18843701-7 2026-02-13T20:20:43.070 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 7 v 761 (ObjNum 723 snap 214 seq_num 723) dirty exists 2026-02-13T20:20:43.070 INFO:tasks.rados.rados.0.trial188.stdout:2067: seq_num 740 ranges {437180=570501,1503028=550587} 2026-02-13T20:20:43.073 INFO:tasks.rados.rados.0.trial188.stdout:2067: writing trial18843701-21 from 437180 to 1007681 tid 1 2026-02-13T20:20:43.078 INFO:tasks.rados.rados.0.trial188.stdout:2067: writing trial18843701-21 from 1503028 to 2053615 tid 2 2026-02-13T20:20:43.078 INFO:tasks.rados.rados.0.trial188.stdout:2061: done (5 left) 2026-02-13T20:20:43.078 INFO:tasks.rados.rados.0.trial188.stdout:2062: done (4 left) 2026-02-13T20:20:43.078 INFO:tasks.rados.rados.0.trial188.stdout:2063: done (3 left) 2026-02-13T20:20:43.078 INFO:tasks.rados.rados.0.trial188.stdout:2068: delete oid 37 current snap is 220 2026-02-13T20:20:43.078 INFO:tasks.rados.rados.0.trial188.stdout:2065: expect (ObjNum 712 snap 203 seq_num 712) 2026-02-13T20:20:43.142 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 3369594 2026-02-13T20:20:43.189 INFO:tasks.rados.rados.0.trial188.stdout:2066: expect (ObjNum 634 snap 166 seq_num 634) 2026-02-13T20:20:43.350 INFO:tasks.rados.rados.0.trial188.stdout:2067: finishing write tid 1 to trial18843701-21 2026-02-13T20:20:43.351 INFO:tasks.rados.rados.0.trial188.stdout:2067: finishing write tid 2 to trial18843701-21 2026-02-13T20:20:43.351 INFO:tasks.rados.rados.0.trial188.stdout:2067: finishing write tid 3 to trial18843701-21 2026-02-13T20:20:43.351 INFO:tasks.rados.rados.0.trial188.stdout:2067: finishing write tid 4 to trial18843701-21 2026-02-13T20:20:43.351 INFO:tasks.rados.rados.0.trial188.stdout:2067: oid 21 updating version 0 to 483 2026-02-13T20:20:43.351 INFO:tasks.rados.rados.0.trial188.stdout:2067: oid 21 updating version 483 to 484 2026-02-13T20:20:43.351 INFO:tasks.rados.rados.0.trial188.stdout:2067: oid 21 version 484 is already newer than 482 2026-02-13T20:20:43.351 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 21 v 484 (ObjNum 740 snap 220 seq_num 740) dirty exists 2026-02-13T20:20:43.351 INFO:tasks.rados.rados.0.trial188.stdout:2067: left oid 21 (ObjNum 740 snap 220 seq_num 740) 2026-02-13T20:20:43.352 INFO:tasks.rados.rados.0.trial188.stdout:2065: done (3 left) 2026-02-13T20:20:43.352 INFO:tasks.rados.rados.0.trial188.stdout:2066: done (2 left) 2026-02-13T20:20:43.352 INFO:tasks.rados.rados.0.trial188.stdout:2067: done (1 left) 2026-02-13T20:20:43.352 INFO:tasks.rados.rados.0.trial188.stdout:2068: done (0 left) 2026-02-13T20:20:43.352 INFO:tasks.rados.rados.0.trial188.stdout:2069: rollback oid 20 current snap is 220 2026-02-13T20:20:43.352 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 20 to 216 2026-02-13T20:20:43.352 INFO:tasks.rados.rados.0.trial188.stdout:2070: copy_from oid 16 from oid 35 current snap is 220 2026-02-13T20:20:43.352 INFO:tasks.rados.rados.0.trial188.stdout:2071: snap_remove snap 207 2026-02-13T20:20:44.083 INFO:tasks.rados.rados.0.trial188.stdout:2069: finishing rollback tid 0 to trial18843701-20 2026-02-13T20:20:44.083 INFO:tasks.rados.rados.0.trial188.stdout:2069: finishing rollback tid 1 to trial18843701-20 2026-02-13T20:20:44.084 INFO:tasks.rados.rados.0.trial188.stdout:2069: finishing rollback tid 2 to trial18843701-20 2026-02-13T20:20:44.084 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 20 v 662 (ObjNum 634 snap 166 seq_num 634) dirty exists 2026-02-13T20:20:44.084 INFO:tasks.rados.rados.0.trial188.stdout:2070: finishing copy_from racing read to trial18843701-16 2026-02-13T20:20:44.084 INFO:tasks.rados.rados.0.trial188.stdout:2070: finishing copy_from to trial18843701-16 2026-02-13T20:20:44.084 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 16 v 670 (ObjNum 618 snap 163 seq_num 618) dirty exists 2026-02-13T20:20:44.084 INFO:tasks.rados.rados.0.trial188.stdout:2069: done (2 left) 2026-02-13T20:20:44.084 INFO:tasks.rados.rados.0.trial188.stdout:2070: done (1 left) 2026-02-13T20:20:44.084 INFO:tasks.rados.rados.0.trial188.stdout:2071: done (0 left) 2026-02-13T20:20:44.084 INFO:tasks.rados.rados.0.trial188.stdout:2072: copy_from oid 2 from oid 15 current snap is 220 2026-02-13T20:20:44.084 INFO:tasks.rados.rados.0.trial188.stdout:2073: copy_from oid 37 from oid 19 current snap is 220 2026-02-13T20:20:44.084 INFO:tasks.rados.rados.0.trial188.stdout:2074: copy_from oid 29 from oid 23 current snap is 220 2026-02-13T20:20:44.084 INFO:tasks.rados.rados.0.trial188.stdout:2075: rollback oid 1 current snap is 220 2026-02-13T20:20:44.084 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 1 to 211 2026-02-13T20:20:44.084 INFO:tasks.rados.rados.0.trial188.stdout:2076: read oid 38 snap -1 2026-02-13T20:20:44.084 INFO:tasks.rados.rados.0.trial188.stdout:2076: expect (ObjNum 635 snap 166 seq_num 635) 2026-02-13T20:20:44.084 INFO:tasks.rados.rados.0.trial188.stdout:2077: copy_from oid 33 from oid 39 current snap is 220 2026-02-13T20:20:44.084 INFO:tasks.rados.rados.0.trial188.stdout:2078: read oid 4 snap -1 2026-02-13T20:20:44.084 INFO:tasks.rados.rados.0.trial188.stdout:2078: expect (ObjNum 652 snap 176 seq_num 652) 2026-02-13T20:20:44.084 INFO:tasks.rados.rados.0.trial188.stdout:2079: delete oid 41 current snap is 220 2026-02-13T20:20:44.086 INFO:tasks.rados.rados.0.trial188.stdout:2075: finishing rollback tid 1 to trial18843701-1 2026-02-13T20:20:44.086 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 1 v 0 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-13T20:20:44.086 INFO:tasks.rados.rados.0.trial188.stdout:2075: done (7 left) 2026-02-13T20:20:44.086 INFO:tasks.rados.rados.0.trial188.stdout:2079: done (6 left) 2026-02-13T20:20:44.086 INFO:tasks.rados.rados.0.trial188.stdout:2080: write oid 6 current snap is 220 2026-02-13T20:20:44.086 INFO:tasks.rados.rados.0.trial188.stdout:2080: seq_num 743 ranges {487601=796248,1962121=525480} 2026-02-13T20:20:44.091 INFO:tasks.rados.rados.0.trial188.stdout:2080: writing trial18843701-6 from 487601 to 1283849 tid 1 2026-02-13T20:20:44.096 INFO:tasks.rados.rados.0.trial188.stdout:2080: writing trial18843701-6 from 1962121 to 2487601 tid 2 2026-02-13T20:20:44.096 INFO:tasks.rados.rados.0.trial188.stdout:2081: delete oid 18 current snap is 220 2026-02-13T20:20:44.096 INFO:tasks.rados.rados.0.trial188.stdout:2074: finishing copy_from to trial18843701-29 2026-02-13T20:20:44.096 INFO:tasks.rados.rados.0.trial188.stdout:2074: got expected ENOENT (src dne) 2026-02-13T20:20:44.097 INFO:tasks.rados.rados.0.trial188.stdout:2074: finishing copy_from racing read to trial18843701-29 2026-02-13T20:20:44.097 INFO:tasks.rados.rados.0.trial188.stdout:2076: expect (ObjNum 635 snap 166 seq_num 635) 2026-02-13T20:20:44.139 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1308682 2026-02-13T20:20:44.149 INFO:tasks.rados.rados.0.trial188.stdout:2078: expect (ObjNum 652 snap 176 seq_num 652) 2026-02-13T20:20:44.153 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 951296 2026-02-13T20:20:44.196 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:20:44.225 INFO:tasks.rados.rados.0.trial188.stdout:2072: finishing copy_from racing read to trial18843701-2 2026-02-13T20:20:44.225 INFO:tasks.rados.rados.0.trial188.stdout:2073: finishing copy_from racing read to trial18843701-37 2026-02-13T20:20:44.225 INFO:tasks.rados.rados.0.trial188.stdout:2074: done (7 left) 2026-02-13T20:20:44.225 INFO:tasks.rados.rados.0.trial188.stdout:2076: done (6 left) 2026-02-13T20:20:44.225 INFO:tasks.rados.rados.0.trial188.stdout:2078: done (5 left) 2026-02-13T20:20:44.225 INFO:tasks.rados.rados.0.trial188.stdout:2081: done (4 left) 2026-02-13T20:20:44.225 INFO:tasks.rados.rados.0.trial188.stdout:2082: read oid 43 snap 201 2026-02-13T20:20:44.225 INFO:tasks.rados.rados.0.trial188.stdout:2082: expect (ObjNum 598 snap 159 seq_num 598) 2026-02-13T20:20:44.226 INFO:tasks.rados.rados.0.trial188.stdout:2083: read oid 4 snap -1 2026-02-13T20:20:44.226 INFO:tasks.rados.rados.0.trial188.stdout:2083: expect (ObjNum 652 snap 176 seq_num 652) 2026-02-13T20:20:44.226 INFO:tasks.rados.rados.0.trial188.stdout:2084: write (excl) oid 22 current snap is 220 2026-02-13T20:20:44.226 INFO:tasks.rados.rados.0.trial188.stdout:2072: finishing copy_from to trial18843701-2 2026-02-13T20:20:44.226 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 2 v 760 (ObjNum 728 snap 214 seq_num 728) dirty exists 2026-02-13T20:20:44.226 INFO:tasks.rados.rados.0.trial188.stdout:2073: finishing copy_from to trial18843701-37 2026-02-13T20:20:44.226 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 37 v 723 (ObjNum 688 snap 199 seq_num 688) dirty exists 2026-02-13T20:20:44.226 INFO:tasks.rados.rados.0.trial188.stdout:2080: finishing write tid 1 to trial18843701-6 2026-02-13T20:20:44.226 INFO:tasks.rados.rados.0.trial188.stdout:2080: finishing write tid 2 to trial18843701-6 2026-02-13T20:20:44.226 INFO:tasks.rados.rados.0.trial188.stdout:2080: finishing write tid 3 to trial18843701-6 2026-02-13T20:20:44.226 INFO:tasks.rados.rados.0.trial188.stdout:2080: finishing write tid 4 to trial18843701-6 2026-02-13T20:20:44.226 INFO:tasks.rados.rados.0.trial188.stdout:2080: oid 6 updating version 0 to 905 2026-02-13T20:20:44.226 INFO:tasks.rados.rados.0.trial188.stdout:2080: oid 6 updating version 905 to 906 2026-02-13T20:20:44.226 INFO:tasks.rados.rados.0.trial188.stdout:2080: oid 6 updating version 906 to 907 2026-02-13T20:20:44.226 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 6 v 907 (ObjNum 743 snap 220 seq_num 743) dirty exists 2026-02-13T20:20:44.226 INFO:tasks.rados.rados.0.trial188.stdout:2080: left oid 6 (ObjNum 743 snap 220 seq_num 743) 2026-02-13T20:20:44.226 INFO:tasks.rados.rados.0.trial188.stdout:2077: finishing copy_from racing read to trial18843701-33 2026-02-13T20:20:44.226 INFO:tasks.rados.rados.0.trial188.stdout:2077: finishing copy_from to trial18843701-33 2026-02-13T20:20:44.226 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 33 v 712 (ObjNum 679 snap 194 seq_num 679) dirty exists 2026-02-13T20:20:44.226 INFO:tasks.rados.rados.0.trial188.stdout:2084: seq_num 745 ranges {521215=546746,1562732=701583} 2026-02-13T20:20:44.229 INFO:tasks.rados.rados.0.trial188.stdout:2084: writing trial18843701-22 from 521215 to 1067961 tid 1 2026-02-13T20:20:44.234 INFO:tasks.rados.rados.0.trial188.stdout:2084: writing trial18843701-22 from 1562732 to 2264315 tid 2 2026-02-13T20:20:44.234 INFO:tasks.rados.rados.0.trial188.stdout:2072: done (6 left) 2026-02-13T20:20:44.234 INFO:tasks.rados.rados.0.trial188.stdout:2073: done (5 left) 2026-02-13T20:20:44.235 INFO:tasks.rados.rados.0.trial188.stdout:2077: done (4 left) 2026-02-13T20:20:44.235 INFO:tasks.rados.rados.0.trial188.stdout:2080: done (3 left) 2026-02-13T20:20:44.235 INFO:tasks.rados.rados.0.trial188.stdout:2085: read oid 19 snap -1 2026-02-13T20:20:44.235 INFO:tasks.rados.rados.0.trial188.stdout:2085: expect (ObjNum 688 snap 199 seq_num 688) 2026-02-13T20:20:44.235 INFO:tasks.rados.rados.0.trial188.stdout:2086: snap_create 2026-02-13T20:20:44.235 INFO:tasks.rados.rados.0.trial188.stdout:2083: expect (ObjNum 652 snap 176 seq_num 652) 2026-02-13T20:20:44.274 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2159991 2026-02-13T20:20:44.298 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2313136 2026-02-13T20:20:44.305 INFO:tasks.rados.rados.0.trial188.stdout:2082: expect (ObjNum 598 snap 159 seq_num 598) 2026-02-13T20:20:44.306 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:20:44.325 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1423991 2026-02-13T20:20:44.343 INFO:tasks.rados.rados.0.trial188.stdout:2085: expect (ObjNum 688 snap 199 seq_num 688) 2026-02-13T20:20:44.343 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:20:44.440 INFO:tasks.rados.rados.0.trial188.stdout:2084: finishing write tid 1 to trial18843701-22 2026-02-13T20:20:44.440 INFO:tasks.rados.rados.0.trial188.stdout:2084: finishing write tid 2 to trial18843701-22 2026-02-13T20:20:44.440 INFO:tasks.rados.rados.0.trial188.stdout:2084: finishing write tid 3 to trial18843701-22 2026-02-13T20:20:44.441 INFO:tasks.rados.rados.0.trial188.stdout:2084: finishing write tid 4 to trial18843701-22 2026-02-13T20:20:44.441 INFO:tasks.rados.rados.0.trial188.stdout:2084: oid 22 updating version 0 to 673 2026-02-13T20:20:44.441 INFO:tasks.rados.rados.0.trial188.stdout:2084: oid 22 updating version 673 to 674 2026-02-13T20:20:44.441 INFO:tasks.rados.rados.0.trial188.stdout:2084: oid 22 version 674 is already newer than 672 2026-02-13T20:20:44.441 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 22 v 674 (ObjNum 745 snap 220 seq_num 745) dirty exists 2026-02-13T20:20:44.441 INFO:tasks.rados.rados.0.trial188.stdout:2084: left oid 22 (ObjNum 745 snap 220 seq_num 745) 2026-02-13T20:20:45.092 INFO:tasks.rados.rados.0.trial188.stdout:2082: done (4 left) 2026-02-13T20:20:45.092 INFO:tasks.rados.rados.0.trial188.stdout:2083: done (3 left) 2026-02-13T20:20:45.092 INFO:tasks.rados.rados.0.trial188.stdout:2084: done (2 left) 2026-02-13T20:20:45.092 INFO:tasks.rados.rados.0.trial188.stdout:2085: done (1 left) 2026-02-13T20:20:45.092 INFO:tasks.rados.rados.0.trial188.stdout:2086: done (0 left) 2026-02-13T20:20:45.092 INFO:tasks.rados.rados.0.trial188.stdout:2087: delete oid 26 current snap is 221 2026-02-13T20:20:45.093 INFO:tasks.rados.rados.0.trial188.stdout:2087: done (0 left) 2026-02-13T20:20:45.094 INFO:tasks.rados.rados.0.trial188.stdout:2088: read oid 7 snap -1 2026-02-13T20:20:45.094 INFO:tasks.rados.rados.0.trial188.stdout:2088: expect (ObjNum 723 snap 214 seq_num 723) 2026-02-13T20:20:45.094 INFO:tasks.rados.rados.0.trial188.stdout:2089: snap_remove snap 217 2026-02-13T20:20:46.094 INFO:tasks.rados.rados.0.trial188.stdout:2089: done (1 left) 2026-02-13T20:20:46.094 INFO:tasks.rados.rados.0.trial188.stdout:2090: copy_from oid 37 from oid 12 current snap is 221 2026-02-13T20:20:46.094 INFO:tasks.rados.rados.0.trial188.stdout:2088: expect (ObjNum 723 snap 214 seq_num 723) 2026-02-13T20:20:46.128 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2032771 2026-02-13T20:20:46.149 INFO:tasks.rados.rados.0.trial188.stdout:2090: finishing copy_from racing read to trial18843701-37 2026-02-13T20:20:46.150 INFO:tasks.rados.rados.0.trial188.stdout:2088: done (1 left) 2026-02-13T20:20:46.150 INFO:tasks.rados.rados.0.trial188.stdout:2091: rollback oid 8 current snap is 221 2026-02-13T20:20:46.150 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 8 to 198 2026-02-13T20:20:46.150 INFO:tasks.rados.rados.0.trial188.stdout:2090: finishing copy_from to trial18843701-37 2026-02-13T20:20:46.150 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 37 v 596 (ObjNum 714 snap 204 seq_num 714) dirty exists 2026-02-13T20:20:46.150 INFO:tasks.rados.rados.0.trial188.stdout:2090: done (1 left) 2026-02-13T20:20:46.150 INFO:tasks.rados.rados.0.trial188.stdout:2092: write oid 22 current snap is 221 2026-02-13T20:20:46.150 INFO:tasks.rados.rados.0.trial188.stdout:2092: seq_num 747 ranges {554829=413597,1396049=705252} 2026-02-13T20:20:46.153 INFO:tasks.rados.rados.0.trial188.stdout:2092: writing trial18843701-22 from 554829 to 968426 tid 1 2026-02-13T20:20:46.158 INFO:tasks.rados.rados.0.trial188.stdout:2092: writing trial18843701-22 from 1396049 to 2101301 tid 2 2026-02-13T20:20:46.158 INFO:tasks.rados.rados.0.trial188.stdout:2093: delete oid 43 current snap is 221 2026-02-13T20:20:46.158 INFO:tasks.rados.rados.0.trial188.stdout:2091: finishing rollback tid 0 to trial18843701-8 2026-02-13T20:20:46.158 INFO:tasks.rados.rados.0.trial188.stdout:2091: finishing rollback tid 1 to trial18843701-8 2026-02-13T20:20:46.158 INFO:tasks.rados.rados.0.trial188.stdout:2091: finishing rollback tid 2 to trial18843701-8 2026-02-13T20:20:46.158 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 8 v 805 (ObjNum 623 snap 166 seq_num 623) dirty exists 2026-02-13T20:20:46.170 INFO:tasks.rados.rados.0.trial188.stdout:2092: finishing write tid 1 to trial18843701-22 2026-02-13T20:20:46.172 INFO:tasks.rados.rados.0.trial188.stdout:2092: finishing write tid 2 to trial18843701-22 2026-02-13T20:20:46.172 INFO:tasks.rados.rados.0.trial188.stdout:2092: finishing write tid 3 to trial18843701-22 2026-02-13T20:20:46.172 INFO:tasks.rados.rados.0.trial188.stdout:2092: finishing write tid 4 to trial18843701-22 2026-02-13T20:20:46.172 INFO:tasks.rados.rados.0.trial188.stdout:2092: oid 22 updating version 0 to 675 2026-02-13T20:20:46.173 INFO:tasks.rados.rados.0.trial188.stdout:2092: oid 22 updating version 675 to 676 2026-02-13T20:20:46.173 INFO:tasks.rados.rados.0.trial188.stdout:2092: oid 22 updating version 676 to 677 2026-02-13T20:20:46.173 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 22 v 677 (ObjNum 747 snap 221 seq_num 747) dirty exists 2026-02-13T20:20:46.173 INFO:tasks.rados.rados.0.trial188.stdout:2092: left oid 22 (ObjNum 747 snap 221 seq_num 747) 2026-02-13T20:20:46.173 INFO:tasks.rados.rados.0.trial188.stdout:2091: done (2 left) 2026-02-13T20:20:46.173 INFO:tasks.rados.rados.0.trial188.stdout:2092: done (1 left) 2026-02-13T20:20:46.173 INFO:tasks.rados.rados.0.trial188.stdout:2093: done (0 left) 2026-02-13T20:20:46.173 INFO:tasks.rados.rados.0.trial188.stdout:2094: delete oid 13 current snap is 221 2026-02-13T20:20:46.174 INFO:tasks.rados.rados.0.trial188.stdout:2094: done (0 left) 2026-02-13T20:20:46.174 INFO:tasks.rados.rados.0.trial188.stdout:2095: snap_remove snap 212 2026-02-13T20:20:47.096 INFO:tasks.rados.rados.0.trial188.stdout:2095: done (0 left) 2026-02-13T20:20:47.097 INFO:tasks.rados.rados.0.trial188.stdout:2096: copy_from oid 30 from oid 31 current snap is 221 2026-02-13T20:20:47.097 INFO:tasks.rados.rados.0.trial188.stdout:2097: snap_create 2026-02-13T20:20:47.122 INFO:tasks.rados.rados.0.trial188.stdout:2096: finishing copy_from racing read to trial18843701-30 2026-02-13T20:20:47.123 INFO:tasks.rados.rados.0.trial188.stdout:2096: finishing copy_from to trial18843701-30 2026-02-13T20:20:47.123 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 30 v 434 (ObjNum 720 snap 213 seq_num 720) dirty exists 2026-02-13T20:20:48.070 INFO:tasks.rados.rados.0.trial188.stdout:2096: done (1 left) 2026-02-13T20:20:48.070 INFO:tasks.rados.rados.0.trial188.stdout:2097: done (0 left) 2026-02-13T20:20:48.070 INFO:tasks.rados.rados.0.trial188.stdout:2098: write (excl) oid 13 current snap is 222 2026-02-13T20:20:48.070 INFO:tasks.rados.rados.0.trial188.stdout:2098: seq_num 750 ranges {605250=639344,1855142=452579} 2026-02-13T20:20:48.074 INFO:tasks.rados.rados.0.trial188.stdout:2098: writing trial18843701-13 from 605250 to 1244594 tid 1 2026-02-13T20:20:48.078 INFO:tasks.rados.rados.0.trial188.stdout:2098: writing trial18843701-13 from 1855142 to 2307721 tid 2 2026-02-13T20:20:48.078 INFO:tasks.rados.rados.0.trial188.stdout:2099: rollback oid 37 current snap is 222 2026-02-13T20:20:48.078 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 37 to 216 2026-02-13T20:20:48.078 INFO:tasks.rados.rados.0.trial188.stdout:2100: write oid 42 current snap is 222 2026-02-13T20:20:48.079 INFO:tasks.rados.rados.0.trial188.stdout:2100: seq_num 751 ranges {622057=714593,1913624=708433} 2026-02-13T20:20:48.083 INFO:tasks.rados.rados.0.trial188.stdout:2100: writing trial18843701-42 from 622057 to 1336650 tid 1 2026-02-13T20:20:48.089 INFO:tasks.rados.rados.0.trial188.stdout:2100: writing trial18843701-42 from 1913624 to 2622057 tid 2 2026-02-13T20:20:48.089 INFO:tasks.rados.rados.0.trial188.stdout:2101: read oid 23 snap 211 2026-02-13T20:20:48.089 INFO:tasks.rados.rados.0.trial188.stdout:2101: expect deleted 2026-02-13T20:20:48.089 INFO:tasks.rados.rados.0.trial188.stdout:2102: read oid 36 snap 220 2026-02-13T20:20:48.089 INFO:tasks.rados.rados.0.trial188.stdout:2102: expect (ObjNum 721 snap 213 seq_num 721) 2026-02-13T20:20:48.089 INFO:tasks.rados.rados.0.trial188.stdout:2103: write oid 45 current snap is 222 2026-02-13T20:20:48.089 INFO:tasks.rados.rados.0.trial188.stdout:2103: seq_num 752 ranges {638864=789842,1972106=456248} 2026-02-13T20:20:48.093 INFO:tasks.rados.rados.0.trial188.stdout:2103: writing trial18843701-45 from 638864 to 1428706 tid 1 2026-02-13T20:20:48.098 INFO:tasks.rados.rados.0.trial188.stdout:2103: writing trial18843701-45 from 1972106 to 2428354 tid 2 2026-02-13T20:20:48.098 INFO:tasks.rados.rados.0.trial188.stdout:2104: write oid 30 current snap is 222 2026-02-13T20:20:48.098 INFO:tasks.rados.rados.0.trial188.stdout:2104: seq_num 753 ranges {655671=581444,2030588=625083} 2026-02-13T20:20:48.102 INFO:tasks.rados.rados.0.trial188.stdout:2104: writing trial18843701-30 from 655671 to 1237115 tid 1 2026-02-13T20:20:48.108 INFO:tasks.rados.rados.0.trial188.stdout:2104: writing trial18843701-30 from 2030588 to 2655671 tid 2 2026-02-13T20:20:48.108 INFO:tasks.rados.rados.0.trial188.stdout:2105: write (excl) oid 24 current snap is 222 2026-02-13T20:20:48.108 INFO:tasks.rados.rados.0.trial188.stdout:2099: finishing rollback tid 0 to trial18843701-37 2026-02-13T20:20:48.108 INFO:tasks.rados.rados.0.trial188.stdout:2105: seq_num 754 ranges {672478=656693,2089070=459917} 2026-02-13T20:20:48.112 INFO:tasks.rados.rados.0.trial188.stdout:2105: writing trial18843701-24 from 672478 to 1329171 tid 1 2026-02-13T20:20:48.118 INFO:tasks.rados.rados.0.trial188.stdout:2105: writing trial18843701-24 from 2089070 to 2548987 tid 2 2026-02-13T20:20:48.118 INFO:tasks.rados.rados.0.trial188.stdout:2106: rollback oid 1 current snap is 222 2026-02-13T20:20:48.118 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 1 to 214 2026-02-13T20:20:48.118 INFO:tasks.rados.rados.0.trial188.stdout:2099: finishing rollback tid 1 to trial18843701-37 2026-02-13T20:20:48.118 INFO:tasks.rados.rados.0.trial188.stdout:2107: snap_create 2026-02-13T20:20:48.118 INFO:tasks.rados.rados.0.trial188.stdout:2099: finishing rollback tid 2 to trial18843701-37 2026-02-13T20:20:48.118 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 37 v 815 (ObjNum 662 snap 179 seq_num 662) dirty exists 2026-02-13T20:20:48.118 INFO:tasks.rados.rados.0.trial188.stdout:2098: finishing write tid 1 to trial18843701-13 2026-02-13T20:20:48.118 INFO:tasks.rados.rados.0.trial188.stdout:2098: finishing write tid 2 to trial18843701-13 2026-02-13T20:20:48.118 INFO:tasks.rados.rados.0.trial188.stdout:2098: finishing write tid 3 to trial18843701-13 2026-02-13T20:20:48.118 INFO:tasks.rados.rados.0.trial188.stdout:2098: finishing write tid 4 to trial18843701-13 2026-02-13T20:20:48.119 INFO:tasks.rados.rados.0.trial188.stdout:2098: oid 13 updating version 0 to 893 2026-02-13T20:20:48.119 INFO:tasks.rados.rados.0.trial188.stdout:2098: oid 13 updating version 893 to 894 2026-02-13T20:20:48.119 INFO:tasks.rados.rados.0.trial188.stdout:2098: oid 13 version 894 is already newer than 892 2026-02-13T20:20:48.119 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 13 v 894 (ObjNum 750 snap 222 seq_num 750) dirty exists 2026-02-13T20:20:48.119 INFO:tasks.rados.rados.0.trial188.stdout:2098: left oid 13 (ObjNum 750 snap 222 seq_num 750) 2026-02-13T20:20:48.119 INFO:tasks.rados.rados.0.trial188.stdout:2102: expect (ObjNum 721 snap 213 seq_num 721) 2026-02-13T20:20:48.145 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:20:48.174 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:20:48.202 INFO:tasks.rados.rados.0.trial188.stdout:2100: finishing write tid 1 to trial18843701-42 2026-02-13T20:20:48.202 INFO:tasks.rados.rados.0.trial188.stdout:2100: finishing write tid 2 to trial18843701-42 2026-02-13T20:20:48.203 INFO:tasks.rados.rados.0.trial188.stdout:2100: finishing write tid 3 to trial18843701-42 2026-02-13T20:20:48.203 INFO:tasks.rados.rados.0.trial188.stdout:2100: finishing write tid 4 to trial18843701-42 2026-02-13T20:20:48.203 INFO:tasks.rados.rados.0.trial188.stdout:2100: oid 42 updating version 0 to 685 2026-02-13T20:20:48.203 INFO:tasks.rados.rados.0.trial188.stdout:2100: oid 42 version 685 is already newer than 684 2026-02-13T20:20:48.203 INFO:tasks.rados.rados.0.trial188.stdout:2100: oid 42 version 685 is already newer than 683 2026-02-13T20:20:48.203 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 42 v 685 (ObjNum 751 snap 222 seq_num 751) dirty exists 2026-02-13T20:20:48.203 INFO:tasks.rados.rados.0.trial188.stdout:2100: left oid 42 (ObjNum 751 snap 222 seq_num 751) 2026-02-13T20:20:48.203 INFO:tasks.rados.rados.0.trial188.stdout:2103: finishing write tid 1 to trial18843701-45 2026-02-13T20:20:48.203 INFO:tasks.rados.rados.0.trial188.stdout:2103: finishing write tid 2 to trial18843701-45 2026-02-13T20:20:48.203 INFO:tasks.rados.rados.0.trial188.stdout:2103: finishing write tid 3 to trial18843701-45 2026-02-13T20:20:48.203 INFO:tasks.rados.rados.0.trial188.stdout:2103: finishing write tid 4 to trial18843701-45 2026-02-13T20:20:48.204 INFO:tasks.rados.rados.0.trial188.stdout:2103: oid 45 updating version 0 to 816 2026-02-13T20:20:48.204 INFO:tasks.rados.rados.0.trial188.stdout:2103: oid 45 updating version 816 to 817 2026-02-13T20:20:48.204 INFO:tasks.rados.rados.0.trial188.stdout:2103: oid 45 updating version 817 to 818 2026-02-13T20:20:48.204 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 45 v 818 (ObjNum 752 snap 222 seq_num 752) dirty exists 2026-02-13T20:20:48.204 INFO:tasks.rados.rados.0.trial188.stdout:2103: left oid 45 (ObjNum 752 snap 222 seq_num 752) 2026-02-13T20:20:48.204 INFO:tasks.rados.rados.0.trial188.stdout:2104: finishing write tid 1 to trial18843701-30 2026-02-13T20:20:48.204 INFO:tasks.rados.rados.0.trial188.stdout:2106: finishing rollback tid 1 to trial18843701-1 2026-02-13T20:20:48.204 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 1 v 0 (ObjNum 33 snap 0 seq_num 16252176) dirty dne 2026-02-13T20:20:48.204 INFO:tasks.rados.rados.0.trial188.stdout:2104: finishing write tid 2 to trial18843701-30 2026-02-13T20:20:48.204 INFO:tasks.rados.rados.0.trial188.stdout:2104: finishing write tid 3 to trial18843701-30 2026-02-13T20:20:48.204 INFO:tasks.rados.rados.0.trial188.stdout:2105: finishing write tid 1 to trial18843701-24 2026-02-13T20:20:48.204 INFO:tasks.rados.rados.0.trial188.stdout:2104: finishing write tid 4 to trial18843701-30 2026-02-13T20:20:48.205 INFO:tasks.rados.rados.0.trial188.stdout:2104: oid 30 updating version 0 to 955 2026-02-13T20:20:48.205 INFO:tasks.rados.rados.0.trial188.stdout:2104: oid 30 version 955 is already newer than 954 2026-02-13T20:20:48.205 INFO:tasks.rados.rados.0.trial188.stdout:2104: oid 30 version 955 is already newer than 953 2026-02-13T20:20:48.205 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 30 v 955 (ObjNum 753 snap 222 seq_num 753) dirty exists 2026-02-13T20:20:48.205 INFO:tasks.rados.rados.0.trial188.stdout:2104: left oid 30 (ObjNum 753 snap 222 seq_num 753) 2026-02-13T20:20:48.205 INFO:tasks.rados.rados.0.trial188.stdout:2105: finishing write tid 2 to trial18843701-24 2026-02-13T20:20:48.205 INFO:tasks.rados.rados.0.trial188.stdout:2105: finishing write tid 3 to trial18843701-24 2026-02-13T20:20:48.205 INFO:tasks.rados.rados.0.trial188.stdout:2105: finishing write tid 4 to trial18843701-24 2026-02-13T20:20:48.205 INFO:tasks.rados.rados.0.trial188.stdout:2105: oid 24 updating version 0 to 916 2026-02-13T20:20:48.205 INFO:tasks.rados.rados.0.trial188.stdout:2105: oid 24 updating version 916 to 917 2026-02-13T20:20:48.205 INFO:tasks.rados.rados.0.trial188.stdout:2105: oid 24 version 917 is already newer than 915 2026-02-13T20:20:48.205 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 24 v 917 (ObjNum 754 snap 222 seq_num 754) dirty exists 2026-02-13T20:20:48.206 INFO:tasks.rados.rados.0.trial188.stdout:2105: left oid 24 (ObjNum 754 snap 222 seq_num 754) 2026-02-13T20:20:49.101 INFO:tasks.rados.rados.0.trial188.stdout:2098: done (9 left) 2026-02-13T20:20:49.101 INFO:tasks.rados.rados.0.trial188.stdout:2099: done (8 left) 2026-02-13T20:20:49.101 INFO:tasks.rados.rados.0.trial188.stdout:2100: done (7 left) 2026-02-13T20:20:49.101 INFO:tasks.rados.rados.0.trial188.stdout:2101: done (6 left) 2026-02-13T20:20:49.101 INFO:tasks.rados.rados.0.trial188.stdout:2102: done (5 left) 2026-02-13T20:20:49.101 INFO:tasks.rados.rados.0.trial188.stdout:2103: done (4 left) 2026-02-13T20:20:49.101 INFO:tasks.rados.rados.0.trial188.stdout:2104: done (3 left) 2026-02-13T20:20:49.101 INFO:tasks.rados.rados.0.trial188.stdout:2105: done (2 left) 2026-02-13T20:20:49.101 INFO:tasks.rados.rados.0.trial188.stdout:2106: done (1 left) 2026-02-13T20:20:49.101 INFO:tasks.rados.rados.0.trial188.stdout:2107: done (0 left) 2026-02-13T20:20:49.101 INFO:tasks.rados.rados.0.trial188.stdout:2108: snap_remove snap 221 2026-02-13T20:20:50.102 INFO:tasks.rados.rados.0.trial188.stdout:2108: done (0 left) 2026-02-13T20:20:50.102 INFO:tasks.rados.rados.0.trial188.stdout:2109: write (excl) oid 20 current snap is 223 2026-02-13T20:20:50.102 INFO:tasks.rados.rados.0.trial188.stdout:2109: seq_num 755 ranges {689285=731942,2147552=541733} 2026-02-13T20:20:50.107 INFO:tasks.rados.rados.0.trial188.stdout:2109: writing trial18843701-20 from 689285 to 1421227 tid 1 2026-02-13T20:20:50.113 INFO:tasks.rados.rados.0.trial188.stdout:2109: writing trial18843701-20 from 2147552 to 2689285 tid 2 2026-02-13T20:20:50.113 INFO:tasks.rados.rados.0.trial188.stdout:2110: copy_from oid 13 from oid 29 current snap is 223 2026-02-13T20:20:50.113 INFO:tasks.rados.rados.0.trial188.stdout:2111: rollback oid 9 current snap is 223 2026-02-13T20:20:50.114 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 9 to 181 2026-02-13T20:20:50.114 INFO:tasks.rados.rados.0.trial188.stdout:2112: write (excl) oid 25 current snap is 223 2026-02-13T20:20:50.114 INFO:tasks.rados.rados.0.trial188.stdout:2112: seq_num 756 ranges {706092=407191,1806034=463586} 2026-02-13T20:20:50.117 INFO:tasks.rados.rados.0.trial188.stdout:2112: writing trial18843701-25 from 706092 to 1113283 tid 1 2026-02-13T20:20:50.122 INFO:tasks.rados.rados.0.trial188.stdout:2112: writing trial18843701-25 from 1806034 to 2269620 tid 2 2026-02-13T20:20:50.122 INFO:tasks.rados.rados.0.trial188.stdout:2113: snap_create 2026-02-13T20:20:50.122 INFO:tasks.rados.rados.0.trial188.stdout:2111: finishing rollback tid 0 to trial18843701-9 2026-02-13T20:20:50.122 INFO:tasks.rados.rados.0.trial188.stdout:2111: finishing rollback tid 1 to trial18843701-9 2026-02-13T20:20:50.122 INFO:tasks.rados.rados.0.trial188.stdout:2111: finishing rollback tid 2 to trial18843701-9 2026-02-13T20:20:50.122 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 9 v 688 (ObjNum 637 snap 166 seq_num 637) dirty exists 2026-02-13T20:20:50.122 INFO:tasks.rados.rados.0.trial188.stdout:2109: finishing write tid 1 to trial18843701-20 2026-02-13T20:20:50.134 INFO:tasks.rados.rados.0.trial188.stdout:2109: finishing write tid 2 to trial18843701-20 2026-02-13T20:20:50.134 INFO:tasks.rados.rados.0.trial188.stdout:2109: finishing write tid 3 to trial18843701-20 2026-02-13T20:20:50.134 INFO:tasks.rados.rados.0.trial188.stdout:2112: finishing write tid 1 to trial18843701-25 2026-02-13T20:20:50.134 INFO:tasks.rados.rados.0.trial188.stdout:2109: finishing write tid 4 to trial18843701-20 2026-02-13T20:20:50.134 INFO:tasks.rados.rados.0.trial188.stdout:2109: oid 20 updating version 0 to 665 2026-02-13T20:20:50.135 INFO:tasks.rados.rados.0.trial188.stdout:2109: oid 20 version 665 is already newer than 664 2026-02-13T20:20:50.135 INFO:tasks.rados.rados.0.trial188.stdout:2109: oid 20 version 665 is already newer than 663 2026-02-13T20:20:50.135 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 20 v 665 (ObjNum 755 snap 223 seq_num 755) dirty exists 2026-02-13T20:20:50.135 INFO:tasks.rados.rados.0.trial188.stdout:2109: left oid 20 (ObjNum 755 snap 223 seq_num 755) 2026-02-13T20:20:50.135 INFO:tasks.rados.rados.0.trial188.stdout:2112: finishing write tid 2 to trial18843701-25 2026-02-13T20:20:50.135 INFO:tasks.rados.rados.0.trial188.stdout:2112: finishing write tid 3 to trial18843701-25 2026-02-13T20:20:50.135 INFO:tasks.rados.rados.0.trial188.stdout:2112: finishing write tid 4 to trial18843701-25 2026-02-13T20:20:50.135 INFO:tasks.rados.rados.0.trial188.stdout:2112: oid 25 updating version 0 to 960 2026-02-13T20:20:50.135 INFO:tasks.rados.rados.0.trial188.stdout:2112: oid 25 version 960 is already newer than 959 2026-02-13T20:20:50.135 INFO:tasks.rados.rados.0.trial188.stdout:2112: oid 25 updating version 960 to 961 2026-02-13T20:20:50.135 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 25 v 961 (ObjNum 756 snap 223 seq_num 756) dirty exists 2026-02-13T20:20:50.135 INFO:tasks.rados.rados.0.trial188.stdout:2112: left oid 25 (ObjNum 756 snap 223 seq_num 756) 2026-02-13T20:20:50.152 INFO:tasks.rados.rados.0.trial188.stdout:2110: finishing copy_from racing read to trial18843701-13 2026-02-13T20:20:50.154 INFO:tasks.rados.rados.0.trial188.stdout:2110: finishing copy_from to trial18843701-13 2026-02-13T20:20:50.154 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 13 v 743 (ObjNum 627 snap 166 seq_num 627) dirty exists 2026-02-13T20:20:51.107 INFO:tasks.rados.rados.0.trial188.stdout:2109: done (4 left) 2026-02-13T20:20:51.108 INFO:tasks.rados.rados.0.trial188.stdout:2110: done (3 left) 2026-02-13T20:20:51.108 INFO:tasks.rados.rados.0.trial188.stdout:2111: done (2 left) 2026-02-13T20:20:51.108 INFO:tasks.rados.rados.0.trial188.stdout:2112: done (1 left) 2026-02-13T20:20:51.108 INFO:tasks.rados.rados.0.trial188.stdout:2113: done (0 left) 2026-02-13T20:20:51.108 INFO:tasks.rados.rados.0.trial188.stdout:2114: read oid 23 snap -1 2026-02-13T20:20:51.108 INFO:tasks.rados.rados.0.trial188.stdout:2114: expect deleted 2026-02-13T20:20:51.108 INFO:tasks.rados.rados.0.trial188.stdout:2115: delete oid 35 current snap is 224 2026-02-13T20:20:51.110 INFO:tasks.rados.rados.0.trial188.stdout:2114: done (1 left) 2026-02-13T20:20:51.110 INFO:tasks.rados.rados.0.trial188.stdout:2115: done (0 left) 2026-02-13T20:20:51.110 INFO:tasks.rados.rados.0.trial188.stdout:2116: delete oid 4 current snap is 224 2026-02-13T20:20:51.111 INFO:tasks.rados.rados.0.trial188.stdout:2116: done (0 left) 2026-02-13T20:20:51.112 INFO:tasks.rados.rados.0.trial188.stdout:2117: read oid 29 snap 206 2026-02-13T20:20:51.112 INFO:tasks.rados.rados.0.trial188.stdout:2117: expect (ObjNum 627 snap 166 seq_num 627) 2026-02-13T20:20:51.112 INFO:tasks.rados.rados.0.trial188.stdout:2118: copy_from oid 45 from oid 3 current snap is 224 2026-02-13T20:20:51.112 INFO:tasks.rados.rados.0.trial188.stdout:2119: snap_remove snap 201 2026-02-13T20:20:52.108 INFO:tasks.rados.rados.0.trial188.stdout:2119: done (2 left) 2026-02-13T20:20:52.108 INFO:tasks.rados.rados.0.trial188.stdout:2120: read oid 23 snap -1 2026-02-13T20:20:52.108 INFO:tasks.rados.rados.0.trial188.stdout:2120: expect deleted 2026-02-13T20:20:52.108 INFO:tasks.rados.rados.0.trial188.stdout:2121: snap_remove snap 220 2026-02-13T20:20:53.070 INFO:tasks.rados.rados.0.trial188.stdout:2121: done (3 left) 2026-02-13T20:20:53.070 INFO:tasks.rados.rados.0.trial188.stdout:2122: snap_create 2026-02-13T20:20:53.070 INFO:tasks.rados.rados.0.trial188.stdout:2118: finishing copy_from to trial18843701-45 2026-02-13T20:20:53.070 INFO:tasks.rados.rados.0.trial188.stdout:2118: got expected ENOENT (src dne) 2026-02-13T20:20:53.070 INFO:tasks.rados.rados.0.trial188.stdout:2118: finishing copy_from racing read to trial18843701-45 2026-02-13T20:20:53.070 INFO:tasks.rados.rados.0.trial188.stdout:2117: expect (ObjNum 627 snap 166 seq_num 627) 2026-02-13T20:20:53.075 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 800166 2026-02-13T20:20:53.110 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:20:53.150 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 285588 2026-02-13T20:20:54.071 INFO:tasks.rados.rados.0.trial188.stdout:2117: done (3 left) 2026-02-13T20:20:54.071 INFO:tasks.rados.rados.0.trial188.stdout:2118: done (2 left) 2026-02-13T20:20:54.071 INFO:tasks.rados.rados.0.trial188.stdout:2120: done (1 left) 2026-02-13T20:20:54.071 INFO:tasks.rados.rados.0.trial188.stdout:2122: done (0 left) 2026-02-13T20:20:54.071 INFO:tasks.rados.rados.0.trial188.stdout:2123: read oid 22 snap -1 2026-02-13T20:20:54.071 INFO:tasks.rados.rados.0.trial188.stdout:2123: expect (ObjNum 747 snap 221 seq_num 747) 2026-02-13T20:20:54.071 INFO:tasks.rados.rados.0.trial188.stdout:2124: write (excl) oid 28 current snap is 225 2026-02-13T20:20:54.071 INFO:tasks.rados.rados.0.trial188.stdout:2124: seq_num 759 ranges {756513=632938,1865127=727266} 2026-02-13T20:20:54.076 INFO:tasks.rados.rados.0.trial188.stdout:2124: writing trial18843701-28 from 756513 to 1389451 tid 1 2026-02-13T20:20:54.081 INFO:tasks.rados.rados.0.trial188.stdout:2124: writing trial18843701-28 from 1865127 to 2592393 tid 2 2026-02-13T20:20:54.081 INFO:tasks.rados.rados.0.trial188.stdout:2125: snap_remove snap 177 2026-02-13T20:20:55.073 INFO:tasks.rados.rados.0.trial188.stdout:2125: done (2 left) 2026-02-13T20:20:55.074 INFO:tasks.rados.rados.0.trial188.stdout:2126: write (excl) oid 47 current snap is 225 2026-02-13T20:20:55.074 INFO:tasks.rados.rados.0.trial188.stdout:2126: seq_num 760 ranges {773320=708187,1923609=470924} 2026-02-13T20:20:55.079 INFO:tasks.rados.rados.0.trial188.stdout:2126: writing trial18843701-47 from 773320 to 1481507 tid 1 2026-02-13T20:20:55.082 INFO:tasks.rados.rados.0.trial188.stdout:2126: writing trial18843701-47 from 1923609 to 2394533 tid 2 2026-02-13T20:20:55.083 INFO:tasks.rados.rados.0.trial188.stdout:2127: copy_from oid 17 from oid 19 current snap is 225 2026-02-13T20:20:55.083 INFO:tasks.rados.rados.0.trial188.stdout:2123: expect (ObjNum 747 snap 221 seq_num 747) 2026-02-13T20:20:55.117 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:20:55.185 INFO:tasks.rados.rados.0.trial188.stdout:2124: finishing write tid 1 to trial18843701-28 2026-02-13T20:20:55.185 INFO:tasks.rados.rados.0.trial188.stdout:2124: finishing write tid 2 to trial18843701-28 2026-02-13T20:20:55.185 INFO:tasks.rados.rados.0.trial188.stdout:2123: done (3 left) 2026-02-13T20:20:55.186 INFO:tasks.rados.rados.0.trial188.stdout:2128: delete oid 18 current snap is 225 2026-02-13T20:20:55.186 INFO:tasks.rados.rados.0.trial188.stdout:2124: finishing write tid 3 to trial18843701-28 2026-02-13T20:20:55.186 INFO:tasks.rados.rados.0.trial188.stdout:2124: finishing write tid 4 to trial18843701-28 2026-02-13T20:20:55.186 INFO:tasks.rados.rados.0.trial188.stdout:2124: oid 28 updating version 0 to 834 2026-02-13T20:20:55.186 INFO:tasks.rados.rados.0.trial188.stdout:2124: oid 28 updating version 834 to 836 2026-02-13T20:20:55.186 INFO:tasks.rados.rados.0.trial188.stdout:2124: oid 28 version 836 is already newer than 835 2026-02-13T20:20:55.186 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 28 v 836 (ObjNum 759 snap 225 seq_num 759) dirty exists 2026-02-13T20:20:55.186 INFO:tasks.rados.rados.0.trial188.stdout:2124: left oid 28 (ObjNum 759 snap 225 seq_num 759) 2026-02-13T20:20:55.186 INFO:tasks.rados.rados.0.trial188.stdout:2126: finishing write tid 1 to trial18843701-47 2026-02-13T20:20:55.186 INFO:tasks.rados.rados.0.trial188.stdout:2126: finishing write tid 2 to trial18843701-47 2026-02-13T20:20:55.186 INFO:tasks.rados.rados.0.trial188.stdout:2126: finishing write tid 3 to trial18843701-47 2026-02-13T20:20:55.187 INFO:tasks.rados.rados.0.trial188.stdout:2126: finishing write tid 4 to trial18843701-47 2026-02-13T20:20:55.187 INFO:tasks.rados.rados.0.trial188.stdout:2126: oid 47 updating version 0 to 713 2026-02-13T20:20:55.187 INFO:tasks.rados.rados.0.trial188.stdout:2126: oid 47 updating version 713 to 715 2026-02-13T20:20:55.187 INFO:tasks.rados.rados.0.trial188.stdout:2126: oid 47 version 715 is already newer than 714 2026-02-13T20:20:55.187 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 47 v 715 (ObjNum 760 snap 225 seq_num 760) dirty exists 2026-02-13T20:20:55.187 INFO:tasks.rados.rados.0.trial188.stdout:2126: left oid 47 (ObjNum 760 snap 225 seq_num 760) 2026-02-13T20:20:55.187 INFO:tasks.rados.rados.0.trial188.stdout:2127: finishing copy_from racing read to trial18843701-17 2026-02-13T20:20:55.187 INFO:tasks.rados.rados.0.trial188.stdout:2127: finishing copy_from to trial18843701-17 2026-02-13T20:20:55.187 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 17 v 723 (ObjNum 688 snap 199 seq_num 688) dirty exists 2026-02-13T20:20:55.187 INFO:tasks.rados.rados.0.trial188.stdout:2124: done (3 left) 2026-02-13T20:20:55.187 INFO:tasks.rados.rados.0.trial188.stdout:2126: done (2 left) 2026-02-13T20:20:55.187 INFO:tasks.rados.rados.0.trial188.stdout:2127: done (1 left) 2026-02-13T20:20:55.188 INFO:tasks.rados.rados.0.trial188.stdout:2128: done (0 left) 2026-02-13T20:20:55.188 INFO:tasks.rados.rados.0.trial188.stdout:2129: snap_create 2026-02-13T20:20:56.078 INFO:tasks.rados.rados.0.trial188.stdout:2129: done (0 left) 2026-02-13T20:20:56.078 INFO:tasks.rados.rados.0.trial188.stdout:2130: snap_remove snap 181 2026-02-13T20:20:57.080 INFO:tasks.rados.rados.0.trial188.stdout:2130: done (0 left) 2026-02-13T20:20:57.080 INFO:tasks.rados.rados.0.trial188.stdout:2131: write oid 10 current snap is 226 2026-02-13T20:20:57.080 INFO:tasks.rados.rados.0.trial188.stdout:2131: seq_num 762 ranges {406934=575038,1640573=474593,2642791=164143} 2026-02-13T20:20:57.084 INFO:tasks.rados.rados.0.trial188.stdout:2131: writing trial18843701-10 from 406934 to 981972 tid 1 2026-02-13T20:20:57.088 INFO:tasks.rados.rados.0.trial188.stdout:2131: writing trial18843701-10 from 1640573 to 2115166 tid 2 2026-02-13T20:20:57.091 INFO:tasks.rados.rados.0.trial188.stdout:2131: writing trial18843701-10 from 2642791 to 2806934 tid 3 2026-02-13T20:20:57.091 INFO:tasks.rados.rados.0.trial188.stdout:2132: write (excl) oid 15 current snap is 226 2026-02-13T20:20:57.091 INFO:tasks.rados.rados.0.trial188.stdout:2132: seq_num 763 ranges {423741=650287,1699055=618251} 2026-02-13T20:20:57.095 INFO:tasks.rados.rados.0.trial188.stdout:2132: writing trial18843701-15 from 423741 to 1074028 tid 1 2026-02-13T20:20:57.099 INFO:tasks.rados.rados.0.trial188.stdout:2132: writing trial18843701-15 from 1699055 to 2317306 tid 2 2026-02-13T20:20:57.099 INFO:tasks.rados.rados.0.trial188.stdout:2133: snap_create 2026-02-13T20:20:57.104 INFO:tasks.rados.rados.0.trial188.stdout:2131: finishing write tid 1 to trial18843701-10 2026-02-13T20:20:57.104 INFO:tasks.rados.rados.0.trial188.stdout:2131: finishing write tid 2 to trial18843701-10 2026-02-13T20:20:57.105 INFO:tasks.rados.rados.0.trial188.stdout:2131: finishing write tid 3 to trial18843701-10 2026-02-13T20:20:57.117 INFO:tasks.rados.rados.0.trial188.stdout:2131: finishing write tid 4 to trial18843701-10 2026-02-13T20:20:57.118 INFO:tasks.rados.rados.0.trial188.stdout:2132: finishing write tid 1 to trial18843701-15 2026-02-13T20:20:57.118 INFO:tasks.rados.rados.0.trial188.stdout:2132: finishing write tid 2 to trial18843701-15 2026-02-13T20:20:57.118 INFO:tasks.rados.rados.0.trial188.stdout:2131: finishing write tid 5 to trial18843701-10 2026-02-13T20:20:57.118 INFO:tasks.rados.rados.0.trial188.stdout:2131: oid 10 updating version 0 to 766 2026-02-13T20:20:57.118 INFO:tasks.rados.rados.0.trial188.stdout:2131: oid 10 updating version 766 to 768 2026-02-13T20:20:57.118 INFO:tasks.rados.rados.0.trial188.stdout:2131: oid 10 version 768 is already newer than 767 2026-02-13T20:20:57.118 INFO:tasks.rados.rados.0.trial188.stdout:2131: oid 10 version 768 is already newer than 765 2026-02-13T20:20:57.118 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 10 v 768 (ObjNum 762 snap 226 seq_num 762) dirty exists 2026-02-13T20:20:57.118 INFO:tasks.rados.rados.0.trial188.stdout:2131: left oid 10 (ObjNum 762 snap 226 seq_num 762) 2026-02-13T20:20:57.118 INFO:tasks.rados.rados.0.trial188.stdout:2132: finishing write tid 3 to trial18843701-15 2026-02-13T20:20:57.118 INFO:tasks.rados.rados.0.trial188.stdout:2132: finishing write tid 4 to trial18843701-15 2026-02-13T20:20:57.118 INFO:tasks.rados.rados.0.trial188.stdout:2132: oid 15 updating version 0 to 766 2026-02-13T20:20:57.118 INFO:tasks.rados.rados.0.trial188.stdout:2132: oid 15 version 766 is already newer than 765 2026-02-13T20:20:57.118 INFO:tasks.rados.rados.0.trial188.stdout:2132: oid 15 updating version 766 to 767 2026-02-13T20:20:57.118 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 15 v 767 (ObjNum 763 snap 226 seq_num 763) dirty exists 2026-02-13T20:20:57.119 INFO:tasks.rados.rados.0.trial188.stdout:2132: left oid 15 (ObjNum 763 snap 226 seq_num 763) 2026-02-13T20:20:58.071 INFO:tasks.rados.rados.0.trial188.stdout:2131: done (2 left) 2026-02-13T20:20:58.071 INFO:tasks.rados.rados.0.trial188.stdout:2132: done (1 left) 2026-02-13T20:20:58.071 INFO:tasks.rados.rados.0.trial188.stdout:2133: done (0 left) 2026-02-13T20:20:58.071 INFO:tasks.rados.rados.0.trial188.stdout:2134: write (excl) oid 37 current snap is 227 2026-02-13T20:20:58.071 INFO:tasks.rados.rados.0.trial188.stdout:2134: seq_num 764 ranges {440548=725536,1757537=478262,2813990=26558} 2026-02-13T20:20:58.075 INFO:tasks.rados.rados.0.trial188.stdout:2134: writing trial18843701-37 from 440548 to 1166084 tid 1 2026-02-13T20:20:58.079 INFO:tasks.rados.rados.0.trial188.stdout:2134: writing trial18843701-37 from 1757537 to 2235799 tid 2 2026-02-13T20:20:58.082 INFO:tasks.rados.rados.0.trial188.stdout:2134: writing trial18843701-37 from 2813990 to 2840548 tid 3 2026-02-13T20:20:58.082 INFO:tasks.rados.rados.0.trial188.stdout:2135: copy_from oid 12 from oid 23 current snap is 227 2026-02-13T20:20:58.082 INFO:tasks.rados.rados.0.trial188.stdout:2136: copy_from oid 34 from oid 14 current snap is 227 2026-02-13T20:20:58.082 INFO:tasks.rados.rados.0.trial188.stdout:2137: snap_create 2026-02-13T20:20:58.082 INFO:tasks.rados.rados.0.trial188.stdout:2135: finishing copy_from to trial18843701-12 2026-02-13T20:20:58.082 INFO:tasks.rados.rados.0.trial188.stdout:2135: got expected ENOENT (src dne) 2026-02-13T20:20:58.082 INFO:tasks.rados.rados.0.trial188.stdout:2135: finishing copy_from racing read to trial18843701-12 2026-02-13T20:20:58.094 INFO:tasks.rados.rados.0.trial188.stdout:2134: finishing write tid 1 to trial18843701-37 2026-02-13T20:20:58.095 INFO:tasks.rados.rados.0.trial188.stdout:2134: finishing write tid 2 to trial18843701-37 2026-02-13T20:20:58.095 INFO:tasks.rados.rados.0.trial188.stdout:2134: finishing write tid 3 to trial18843701-37 2026-02-13T20:20:58.097 INFO:tasks.rados.rados.0.trial188.stdout:2134: finishing write tid 4 to trial18843701-37 2026-02-13T20:20:58.097 INFO:tasks.rados.rados.0.trial188.stdout:2134: finishing write tid 5 to trial18843701-37 2026-02-13T20:20:58.097 INFO:tasks.rados.rados.0.trial188.stdout:2134: oid 37 updating version 0 to 850 2026-02-13T20:20:58.097 INFO:tasks.rados.rados.0.trial188.stdout:2134: oid 37 updating version 850 to 852 2026-02-13T20:20:58.097 INFO:tasks.rados.rados.0.trial188.stdout:2134: oid 37 updating version 852 to 853 2026-02-13T20:20:58.097 INFO:tasks.rados.rados.0.trial188.stdout:2134: oid 37 version 853 is already newer than 851 2026-02-13T20:20:58.097 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 37 v 853 (ObjNum 764 snap 227 seq_num 764) dirty exists 2026-02-13T20:20:58.097 INFO:tasks.rados.rados.0.trial188.stdout:2134: left oid 37 (ObjNum 764 snap 227 seq_num 764) 2026-02-13T20:20:58.132 INFO:tasks.rados.rados.0.trial188.stdout:2136: finishing copy_from racing read to trial18843701-34 2026-02-13T20:20:58.134 INFO:tasks.rados.rados.0.trial188.stdout:2136: finishing copy_from to trial18843701-34 2026-02-13T20:20:58.134 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 34 v 626 (ObjNum 668 snap 182 seq_num 668) dirty exists 2026-02-13T20:20:59.083 INFO:tasks.rados.rados.0.trial188.stdout:2134: done (3 left) 2026-02-13T20:20:59.084 INFO:tasks.rados.rados.0.trial188.stdout:2135: done (2 left) 2026-02-13T20:20:59.084 INFO:tasks.rados.rados.0.trial188.stdout:2136: done (1 left) 2026-02-13T20:20:59.084 INFO:tasks.rados.rados.0.trial188.stdout:2137: done (0 left) 2026-02-13T20:20:59.084 INFO:tasks.rados.rados.0.trial188.stdout:2138: read oid 30 snap -1 2026-02-13T20:20:59.084 INFO:tasks.rados.rados.0.trial188.stdout:2138: expect (ObjNum 753 snap 222 seq_num 753) 2026-02-13T20:20:59.084 INFO:tasks.rados.rados.0.trial188.stdout:2139: delete oid 35 current snap is 228 2026-02-13T20:20:59.085 INFO:tasks.rados.rados.0.trial188.stdout:2139: done (1 left) 2026-02-13T20:20:59.085 INFO:tasks.rados.rados.0.trial188.stdout:2140: write (excl) oid 44 current snap is 228 2026-02-13T20:20:59.085 INFO:tasks.rados.rados.0.trial188.stdout:2140: seq_num 766 ranges {474162=476034,1358148=481931,2352483=465303} 2026-02-13T20:20:59.089 INFO:tasks.rados.rados.0.trial188.stdout:2140: writing trial18843701-44 from 474162 to 950196 tid 1 2026-02-13T20:20:59.092 INFO:tasks.rados.rados.0.trial188.stdout:2140: writing trial18843701-44 from 1358148 to 1840079 tid 2 2026-02-13T20:20:59.096 INFO:tasks.rados.rados.0.trial188.stdout:2140: writing trial18843701-44 from 2352483 to 2817786 tid 3 2026-02-13T20:20:59.096 INFO:tasks.rados.rados.0.trial188.stdout:2141: snap_create 2026-02-13T20:20:59.096 INFO:tasks.rados.rados.0.trial188.stdout:2138: expect (ObjNum 753 snap 222 seq_num 753) 2026-02-13T20:20:59.142 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2402208 2026-02-13T20:20:59.144 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:20:59.176 INFO:tasks.rados.rados.0.trial188.stdout:2140: finishing write tid 1 to trial18843701-44 2026-02-13T20:20:59.176 INFO:tasks.rados.rados.0.trial188.stdout:2140: finishing write tid 2 to trial18843701-44 2026-02-13T20:20:59.176 INFO:tasks.rados.rados.0.trial188.stdout:2140: finishing write tid 3 to trial18843701-44 2026-02-13T20:20:59.176 INFO:tasks.rados.rados.0.trial188.stdout:2140: finishing write tid 4 to trial18843701-44 2026-02-13T20:20:59.176 INFO:tasks.rados.rados.0.trial188.stdout:2140: finishing write tid 5 to trial18843701-44 2026-02-13T20:20:59.176 INFO:tasks.rados.rados.0.trial188.stdout:2140: oid 44 updating version 0 to 895 2026-02-13T20:20:59.176 INFO:tasks.rados.rados.0.trial188.stdout:2140: oid 44 updating version 895 to 897 2026-02-13T20:20:59.176 INFO:tasks.rados.rados.0.trial188.stdout:2140: oid 44 updating version 897 to 898 2026-02-13T20:20:59.176 INFO:tasks.rados.rados.0.trial188.stdout:2140: oid 44 version 898 is already newer than 896 2026-02-13T20:20:59.176 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 44 v 898 (ObjNum 766 snap 228 seq_num 766) dirty exists 2026-02-13T20:20:59.177 INFO:tasks.rados.rados.0.trial188.stdout:2140: left oid 44 (ObjNum 766 snap 228 seq_num 766) 2026-02-13T20:21:00.087 INFO:tasks.rados.rados.0.trial188.stdout:2138: done (2 left) 2026-02-13T20:21:00.087 INFO:tasks.rados.rados.0.trial188.stdout:2140: done (1 left) 2026-02-13T20:21:00.087 INFO:tasks.rados.rados.0.trial188.stdout:2141: done (0 left) 2026-02-13T20:21:00.087 INFO:tasks.rados.rados.0.trial188.stdout:2142: read oid 40 snap -1 2026-02-13T20:21:00.088 INFO:tasks.rados.rados.0.trial188.stdout:2142: expect deleted 2026-02-13T20:21:00.088 INFO:tasks.rados.rados.0.trial188.stdout:2143: snap_remove snap 219 2026-02-13T20:21:01.089 INFO:tasks.rados.rados.0.trial188.stdout:2143: done (1 left) 2026-02-13T20:21:01.089 INFO:tasks.rados.rados.0.trial188.stdout:2144: copy_from oid 15 from oid 39 current snap is 229 2026-02-13T20:21:01.089 INFO:tasks.rados.rados.0.trial188.stdout:2142: done (1 left) 2026-02-13T20:21:01.089 INFO:tasks.rados.rados.0.trial188.stdout:2145: write oid 8 current snap is 229 2026-02-13T20:21:01.089 INFO:tasks.rados.rados.0.trial188.stdout:2145: seq_num 767 ranges {490969=551283,1816630=625589} 2026-02-13T20:21:01.093 INFO:tasks.rados.rados.0.trial188.stdout:2145: writing trial18843701-8 from 490969 to 1042252 tid 1 2026-02-13T20:21:01.098 INFO:tasks.rados.rados.0.trial188.stdout:2145: writing trial18843701-8 from 1816630 to 2442219 tid 2 2026-02-13T20:21:01.098 INFO:tasks.rados.rados.0.trial188.stdout:2146: copy_from oid 41 from oid 42 current snap is 229 2026-02-13T20:21:01.099 INFO:tasks.rados.rados.0.trial188.stdout:2147: write (excl) oid 34 current snap is 229 2026-02-13T20:21:01.099 INFO:tasks.rados.rados.0.trial188.stdout:2147: seq_num 768 ranges {507776=742885,1991465=485600} 2026-02-13T20:21:01.103 INFO:tasks.rados.rados.0.trial188.stdout:2147: writing trial18843701-34 from 507776 to 1250661 tid 1 2026-02-13T20:21:01.107 INFO:tasks.rados.rados.0.trial188.stdout:2147: writing trial18843701-34 from 1991465 to 2477065 tid 2 2026-02-13T20:21:01.108 INFO:tasks.rados.rados.0.trial188.stdout:2148: write oid 21 current snap is 229 2026-02-13T20:21:01.108 INFO:tasks.rados.rados.0.trial188.stdout:2148: seq_num 769 ranges {524583=418134,1649947=629258,2834752=89831} 2026-02-13T20:21:01.111 INFO:tasks.rados.rados.0.trial188.stdout:2148: writing trial18843701-21 from 524583 to 942717 tid 1 2026-02-13T20:21:01.116 INFO:tasks.rados.rados.0.trial188.stdout:2148: writing trial18843701-21 from 1649947 to 2279205 tid 2 2026-02-13T20:21:01.119 INFO:tasks.rados.rados.0.trial188.stdout:2148: writing trial18843701-21 from 2834752 to 2924583 tid 3 2026-02-13T20:21:01.119 INFO:tasks.rados.rados.0.trial188.stdout:2149: rollback oid 9 current snap is 229 2026-02-13T20:21:01.119 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 9 to 209 2026-02-13T20:21:01.119 INFO:tasks.rados.rados.0.trial188.stdout:2150: read oid 29 snap -1 2026-02-13T20:21:01.119 INFO:tasks.rados.rados.0.trial188.stdout:2150: expect (ObjNum 627 snap 166 seq_num 627) 2026-02-13T20:21:01.119 INFO:tasks.rados.rados.0.trial188.stdout:2151: read oid 40 snap -1 2026-02-13T20:21:01.119 INFO:tasks.rados.rados.0.trial188.stdout:2151: expect deleted 2026-02-13T20:21:01.119 INFO:tasks.rados.rados.0.trial188.stdout:2152: snap_remove snap 227 2026-02-13T20:21:02.093 INFO:tasks.rados.rados.0.trial188.stdout:2152: done (8 left) 2026-02-13T20:21:02.094 INFO:tasks.rados.rados.0.trial188.stdout:2153: write (excl) oid 2 current snap is 229 2026-02-13T20:21:02.094 INFO:tasks.rados.rados.0.trial188.stdout:2153: seq_num 770 ranges {541390=493383,1592076=489269,2862175=79215} 2026-02-13T20:21:02.097 INFO:tasks.rados.rados.0.trial188.stdout:2153: writing trial18843701-2 from 541390 to 1034773 tid 1 2026-02-13T20:21:02.101 INFO:tasks.rados.rados.0.trial188.stdout:2153: writing trial18843701-2 from 1592076 to 2081345 tid 2 2026-02-13T20:21:02.105 INFO:tasks.rados.rados.0.trial188.stdout:2153: writing trial18843701-2 from 2862175 to 2941390 tid 3 2026-02-13T20:21:02.105 INFO:tasks.rados.rados.0.trial188.stdout:2154: rollback oid 46 current snap is 229 2026-02-13T20:21:02.105 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 46 to 215 2026-02-13T20:21:02.105 INFO:tasks.rados.rados.0.trial188.stdout:2146: finishing copy_from racing read to trial18843701-41 2026-02-13T20:21:02.105 INFO:tasks.rados.rados.0.trial188.stdout:2146: finishing copy_from to trial18843701-41 2026-02-13T20:21:02.105 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 41 v 685 (ObjNum 751 snap 222 seq_num 751) dirty exists 2026-02-13T20:21:02.105 INFO:tasks.rados.rados.0.trial188.stdout:2148: finishing write tid 1 to trial18843701-21 2026-02-13T20:21:02.105 INFO:tasks.rados.rados.0.trial188.stdout:2144: finishing copy_from racing read to trial18843701-15 2026-02-13T20:21:02.105 INFO:tasks.rados.rados.0.trial188.stdout:2148: finishing write tid 2 to trial18843701-21 2026-02-13T20:21:02.106 INFO:tasks.rados.rados.0.trial188.stdout:2148: finishing write tid 3 to trial18843701-21 2026-02-13T20:21:02.106 INFO:tasks.rados.rados.0.trial188.stdout:2148: finishing write tid 4 to trial18843701-21 2026-02-13T20:21:02.106 INFO:tasks.rados.rados.0.trial188.stdout:2148: finishing write tid 5 to trial18843701-21 2026-02-13T20:21:02.106 INFO:tasks.rados.rados.0.trial188.stdout:2148: oid 21 updating version 0 to 487 2026-02-13T20:21:02.106 INFO:tasks.rados.rados.0.trial188.stdout:2148: oid 21 updating version 487 to 488 2026-02-13T20:21:02.106 INFO:tasks.rados.rados.0.trial188.stdout:2148: oid 21 version 488 is already newer than 485 2026-02-13T20:21:02.106 INFO:tasks.rados.rados.0.trial188.stdout:2148: oid 21 version 488 is already newer than 486 2026-02-13T20:21:02.106 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 21 v 488 (ObjNum 769 snap 229 seq_num 769) dirty exists 2026-02-13T20:21:02.106 INFO:tasks.rados.rados.0.trial188.stdout:2148: left oid 21 (ObjNum 769 snap 229 seq_num 769) 2026-02-13T20:21:02.106 INFO:tasks.rados.rados.0.trial188.stdout:2150: expect (ObjNum 627 snap 166 seq_num 627) 2026-02-13T20:21:02.149 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 700369 2026-02-13T20:21:02.183 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:21:02.225 INFO:tasks.rados.rados.0.trial188.stdout:2144: finishing copy_from to trial18843701-15 2026-02-13T20:21:02.225 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 15 v 712 (ObjNum 679 snap 194 seq_num 679) dirty exists 2026-02-13T20:21:02.226 INFO:tasks.rados.rados.0.trial188.stdout:2145: finishing write tid 1 to trial18843701-8 2026-02-13T20:21:02.226 INFO:tasks.rados.rados.0.trial188.stdout:2149: finishing rollback tid 0 to trial18843701-9 2026-02-13T20:21:02.226 INFO:tasks.rados.rados.0.trial188.stdout:2145: finishing write tid 2 to trial18843701-8 2026-02-13T20:21:02.226 INFO:tasks.rados.rados.0.trial188.stdout:2149: finishing rollback tid 1 to trial18843701-9 2026-02-13T20:21:02.226 INFO:tasks.rados.rados.0.trial188.stdout:2145: finishing write tid 3 to trial18843701-8 2026-02-13T20:21:02.226 INFO:tasks.rados.rados.0.trial188.stdout:2149: finishing rollback tid 2 to trial18843701-9 2026-02-13T20:21:02.226 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 9 v 692 (ObjNum 717 snap 205 seq_num 717) dirty exists 2026-02-13T20:21:02.226 INFO:tasks.rados.rados.0.trial188.stdout:2145: finishing write tid 4 to trial18843701-8 2026-02-13T20:21:02.227 INFO:tasks.rados.rados.0.trial188.stdout:2145: oid 8 updating version 0 to 866 2026-02-13T20:21:02.227 INFO:tasks.rados.rados.0.trial188.stdout:2145: oid 8 version 866 is already newer than 865 2026-02-13T20:21:02.227 INFO:tasks.rados.rados.0.trial188.stdout:2145: oid 8 updating version 866 to 867 2026-02-13T20:21:02.227 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 8 v 867 (ObjNum 767 snap 229 seq_num 767) dirty exists 2026-02-13T20:21:02.227 INFO:tasks.rados.rados.0.trial188.stdout:2145: left oid 8 (ObjNum 767 snap 229 seq_num 767) 2026-02-13T20:21:02.227 INFO:tasks.rados.rados.0.trial188.stdout:2147: finishing write tid 1 to trial18843701-34 2026-02-13T20:21:02.227 INFO:tasks.rados.rados.0.trial188.stdout:2147: finishing write tid 2 to trial18843701-34 2026-02-13T20:21:02.227 INFO:tasks.rados.rados.0.trial188.stdout:2144: done (9 left) 2026-02-13T20:21:02.227 INFO:tasks.rados.rados.0.trial188.stdout:2145: done (8 left) 2026-02-13T20:21:02.227 INFO:tasks.rados.rados.0.trial188.stdout:2146: done (7 left) 2026-02-13T20:21:02.227 INFO:tasks.rados.rados.0.trial188.stdout:2148: done (6 left) 2026-02-13T20:21:02.227 INFO:tasks.rados.rados.0.trial188.stdout:2149: done (5 left) 2026-02-13T20:21:02.228 INFO:tasks.rados.rados.0.trial188.stdout:2150: done (4 left) 2026-02-13T20:21:02.228 INFO:tasks.rados.rados.0.trial188.stdout:2151: done (3 left) 2026-02-13T20:21:02.228 INFO:tasks.rados.rados.0.trial188.stdout:2155: copy_from oid 41 from oid 42 current snap is 229 2026-02-13T20:21:02.228 INFO:tasks.rados.rados.0.trial188.stdout:2147: finishing write tid 3 to trial18843701-34 2026-02-13T20:21:02.228 INFO:tasks.rados.rados.0.trial188.stdout:2147: finishing write tid 4 to trial18843701-34 2026-02-13T20:21:02.228 INFO:tasks.rados.rados.0.trial188.stdout:2147: oid 34 updating version 0 to 869 2026-02-13T20:21:02.228 INFO:tasks.rados.rados.0.trial188.stdout:2147: oid 34 updating version 869 to 871 2026-02-13T20:21:02.228 INFO:tasks.rados.rados.0.trial188.stdout:2147: oid 34 version 871 is already newer than 870 2026-02-13T20:21:02.228 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 34 v 871 (ObjNum 768 snap 229 seq_num 768) dirty exists 2026-02-13T20:21:02.228 INFO:tasks.rados.rados.0.trial188.stdout:2147: left oid 34 (ObjNum 768 snap 229 seq_num 768) 2026-02-13T20:21:02.228 INFO:tasks.rados.rados.0.trial188.stdout:2154: finishing rollback tid 0 to trial18843701-46 2026-02-13T20:21:02.228 INFO:tasks.rados.rados.0.trial188.stdout:2154: finishing rollback tid 1 to trial18843701-46 2026-02-13T20:21:02.228 INFO:tasks.rados.rados.0.trial188.stdout:2153: finishing write tid 1 to trial18843701-2 2026-02-13T20:21:02.229 INFO:tasks.rados.rados.0.trial188.stdout:2153: finishing write tid 2 to trial18843701-2 2026-02-13T20:21:02.229 INFO:tasks.rados.rados.0.trial188.stdout:2153: finishing write tid 3 to trial18843701-2 2026-02-13T20:21:02.229 INFO:tasks.rados.rados.0.trial188.stdout:2154: finishing rollback tid 2 to trial18843701-46 2026-02-13T20:21:02.229 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 46 v 772 (ObjNum 723 snap 214 seq_num 723) dirty exists 2026-02-13T20:21:02.229 INFO:tasks.rados.rados.0.trial188.stdout:2153: finishing write tid 4 to trial18843701-2 2026-02-13T20:21:02.229 INFO:tasks.rados.rados.0.trial188.stdout:2153: finishing write tid 5 to trial18843701-2 2026-02-13T20:21:02.229 INFO:tasks.rados.rados.0.trial188.stdout:2153: oid 2 updating version 0 to 900 2026-02-13T20:21:02.229 INFO:tasks.rados.rados.0.trial188.stdout:2153: oid 2 version 900 is already newer than 899 2026-02-13T20:21:02.229 INFO:tasks.rados.rados.0.trial188.stdout:2153: oid 2 updating version 900 to 901 2026-02-13T20:21:02.229 INFO:tasks.rados.rados.0.trial188.stdout:2153: oid 2 updating version 901 to 902 2026-02-13T20:21:02.229 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 2 v 902 (ObjNum 770 snap 229 seq_num 770) dirty exists 2026-02-13T20:21:02.229 INFO:tasks.rados.rados.0.trial188.stdout:2153: left oid 2 (ObjNum 770 snap 229 seq_num 770) 2026-02-13T20:21:02.229 INFO:tasks.rados.rados.0.trial188.stdout:2147: done (3 left) 2026-02-13T20:21:02.229 INFO:tasks.rados.rados.0.trial188.stdout:2153: done (2 left) 2026-02-13T20:21:02.230 INFO:tasks.rados.rados.0.trial188.stdout:2154: done (1 left) 2026-02-13T20:21:02.230 INFO:tasks.rados.rados.0.trial188.stdout:2156: delete oid 27 current snap is 229 2026-02-13T20:21:02.230 INFO:tasks.rados.rados.0.trial188.stdout:2156: done (1 left) 2026-02-13T20:21:02.231 INFO:tasks.rados.rados.0.trial188.stdout:2157: copy_from oid 12 from oid 39 current snap is 229 2026-02-13T20:21:02.231 INFO:tasks.rados.rados.0.trial188.stdout:2158: delete oid 38 current snap is 229 2026-02-13T20:21:02.231 INFO:tasks.rados.rados.0.trial188.stdout:2158: done (2 left) 2026-02-13T20:21:02.231 INFO:tasks.rados.rados.0.trial188.stdout:2159: snap_create 2026-02-13T20:21:02.251 INFO:tasks.rados.rados.0.trial188.stdout:2155: finishing copy_from racing read to trial18843701-41 2026-02-13T20:21:02.252 INFO:tasks.rados.rados.0.trial188.stdout:2155: finishing copy_from to trial18843701-41 2026-02-13T20:21:02.252 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 41 v 685 (ObjNum 751 snap 222 seq_num 751) dirty exists 2026-02-13T20:21:02.268 INFO:tasks.rados.rados.0.trial188.stdout:2157: finishing copy_from racing read to trial18843701-12 2026-02-13T20:21:02.270 INFO:tasks.rados.rados.0.trial188.stdout:2157: finishing copy_from to trial18843701-12 2026-02-13T20:21:02.270 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 12 v 712 (ObjNum 679 snap 194 seq_num 679) dirty exists 2026-02-13T20:21:03.074 INFO:tasks.rados.rados.0.trial188.stdout:2155: done (2 left) 2026-02-13T20:21:03.074 INFO:tasks.rados.rados.0.trial188.stdout:2157: done (1 left) 2026-02-13T20:21:03.074 INFO:tasks.rados.rados.0.trial188.stdout:2159: done (0 left) 2026-02-13T20:21:03.074 INFO:tasks.rados.rados.0.trial188.stdout:2160: write oid 20 current snap is 230 2026-02-13T20:21:03.074 INFO:tasks.rados.rados.0.trial188.stdout:2160: seq_num 773 ranges {591811=719130,1767522=636596,2828091=163720} 2026-02-13T20:21:03.079 INFO:tasks.rados.rados.0.trial188.stdout:2160: writing trial18843701-20 from 591811 to 1310941 tid 1 2026-02-13T20:21:03.083 INFO:tasks.rados.rados.0.trial188.stdout:2160: writing trial18843701-20 from 1767522 to 2404118 tid 2 2026-02-13T20:21:03.085 INFO:tasks.rados.rados.0.trial188.stdout:2160: writing trial18843701-20 from 2828091 to 2991811 tid 3 2026-02-13T20:21:03.086 INFO:tasks.rados.rados.0.trial188.stdout:2161: delete oid 36 current snap is 230 2026-02-13T20:21:03.088 INFO:tasks.rados.rados.0.trial188.stdout:2161: done (1 left) 2026-02-13T20:21:03.088 INFO:tasks.rados.rados.0.trial188.stdout:2162: write oid 29 current snap is 230 2026-02-13T20:21:03.089 INFO:tasks.rados.rados.0.trial188.stdout:2162: seq_num 775 ranges {625425=469628,1768133=640265} 2026-02-13T20:21:03.093 INFO:tasks.rados.rados.0.trial188.stdout:2162: writing trial18843701-29 from 625425 to 1095053 tid 1 2026-02-13T20:21:03.098 INFO:tasks.rados.rados.0.trial188.stdout:2162: writing trial18843701-29 from 1768133 to 2408398 tid 2 2026-02-13T20:21:03.098 INFO:tasks.rados.rados.0.trial188.stdout:2163: read oid 9 snap -1 2026-02-13T20:21:03.098 INFO:tasks.rados.rados.0.trial188.stdout:2163: expect (ObjNum 717 snap 205 seq_num 717) 2026-02-13T20:21:03.098 INFO:tasks.rados.rados.0.trial188.stdout:2164: copy_from oid 11 from oid 16 current snap is 230 2026-02-13T20:21:03.098 INFO:tasks.rados.rados.0.trial188.stdout:2165: snap_remove snap 216 2026-02-13T20:21:04.097 INFO:tasks.rados.rados.0.trial188.stdout:2165: done (4 left) 2026-02-13T20:21:04.097 INFO:tasks.rados.rados.0.trial188.stdout:2166: rollback oid 45 current snap is 230 2026-02-13T20:21:04.097 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 45 to 226 2026-02-13T20:21:04.097 INFO:tasks.rados.rados.0.trial188.stdout:2163: expect (ObjNum 717 snap 205 seq_num 717) 2026-02-13T20:21:04.097 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:21:04.115 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:21:04.133 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:21:04.152 INFO:tasks.rados.rados.0.trial188.stdout:2160: finishing write tid 1 to trial18843701-20 2026-02-13T20:21:04.153 INFO:tasks.rados.rados.0.trial188.stdout:2160: finishing write tid 2 to trial18843701-20 2026-02-13T20:21:04.153 INFO:tasks.rados.rados.0.trial188.stdout:2160: finishing write tid 3 to trial18843701-20 2026-02-13T20:21:04.153 INFO:tasks.rados.rados.0.trial188.stdout:2160: finishing write tid 4 to trial18843701-20 2026-02-13T20:21:04.153 INFO:tasks.rados.rados.0.trial188.stdout:2160: finishing write tid 5 to trial18843701-20 2026-02-13T20:21:04.153 INFO:tasks.rados.rados.0.trial188.stdout:2160: oid 20 updating version 0 to 668 2026-02-13T20:21:04.153 INFO:tasks.rados.rados.0.trial188.stdout:2160: oid 20 version 668 is already newer than 666 2026-02-13T20:21:04.153 INFO:tasks.rados.rados.0.trial188.stdout:2160: oid 20 updating version 668 to 669 2026-02-13T20:21:04.153 INFO:tasks.rados.rados.0.trial188.stdout:2160: oid 20 version 669 is already newer than 667 2026-02-13T20:21:04.153 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 20 v 669 (ObjNum 773 snap 230 seq_num 773) dirty exists 2026-02-13T20:21:04.153 INFO:tasks.rados.rados.0.trial188.stdout:2160: left oid 20 (ObjNum 773 snap 230 seq_num 773) 2026-02-13T20:21:04.154 INFO:tasks.rados.rados.0.trial188.stdout:2162: finishing write tid 1 to trial18843701-29 2026-02-13T20:21:04.154 INFO:tasks.rados.rados.0.trial188.stdout:2162: finishing write tid 2 to trial18843701-29 2026-02-13T20:21:04.154 INFO:tasks.rados.rados.0.trial188.stdout:2160: done (4 left) 2026-02-13T20:21:04.154 INFO:tasks.rados.rados.0.trial188.stdout:2163: done (3 left) 2026-02-13T20:21:04.154 INFO:tasks.rados.rados.0.trial188.stdout:2167: read oid 28 snap -1 2026-02-13T20:21:04.154 INFO:tasks.rados.rados.0.trial188.stdout:2167: expect (ObjNum 759 snap 225 seq_num 759) 2026-02-13T20:21:04.154 INFO:tasks.rados.rados.0.trial188.stdout:2168: snap_create 2026-02-13T20:21:04.154 INFO:tasks.rados.rados.0.trial188.stdout:2162: finishing write tid 3 to trial18843701-29 2026-02-13T20:21:04.154 INFO:tasks.rados.rados.0.trial188.stdout:2162: finishing write tid 4 to trial18843701-29 2026-02-13T20:21:04.154 INFO:tasks.rados.rados.0.trial188.stdout:2162: oid 29 updating version 0 to 802 2026-02-13T20:21:04.154 INFO:tasks.rados.rados.0.trial188.stdout:2162: oid 29 version 802 is already newer than 801 2026-02-13T20:21:04.154 INFO:tasks.rados.rados.0.trial188.stdout:2162: oid 29 version 802 is already newer than 800 2026-02-13T20:21:04.154 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 29 v 802 (ObjNum 775 snap 230 seq_num 775) dirty exists 2026-02-13T20:21:04.155 INFO:tasks.rados.rados.0.trial188.stdout:2162: left oid 29 (ObjNum 775 snap 230 seq_num 775) 2026-02-13T20:21:04.155 INFO:tasks.rados.rados.0.trial188.stdout:2164: finishing copy_from racing read to trial18843701-11 2026-02-13T20:21:04.155 INFO:tasks.rados.rados.0.trial188.stdout:2164: finishing copy_from to trial18843701-11 2026-02-13T20:21:04.155 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 11 v 670 (ObjNum 618 snap 163 seq_num 618) dirty exists 2026-02-13T20:21:04.155 INFO:tasks.rados.rados.0.trial188.stdout:2166: finishing rollback tid 0 to trial18843701-45 2026-02-13T20:21:04.155 INFO:tasks.rados.rados.0.trial188.stdout:2166: finishing rollback tid 1 to trial18843701-45 2026-02-13T20:21:04.155 INFO:tasks.rados.rados.0.trial188.stdout:2166: finishing rollback tid 2 to trial18843701-45 2026-02-13T20:21:04.155 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 45 v 879 (ObjNum 752 snap 222 seq_num 752) dirty exists 2026-02-13T20:21:04.156 INFO:tasks.rados.rados.0.trial188.stdout:2167: expect (ObjNum 759 snap 225 seq_num 759) 2026-02-13T20:21:04.156 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:21:04.195 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2459494 2026-02-13T20:21:05.101 INFO:tasks.rados.rados.0.trial188.stdout:2162: done (4 left) 2026-02-13T20:21:05.101 INFO:tasks.rados.rados.0.trial188.stdout:2164: done (3 left) 2026-02-13T20:21:05.101 INFO:tasks.rados.rados.0.trial188.stdout:2166: done (2 left) 2026-02-13T20:21:05.101 INFO:tasks.rados.rados.0.trial188.stdout:2167: done (1 left) 2026-02-13T20:21:05.101 INFO:tasks.rados.rados.0.trial188.stdout:2168: done (0 left) 2026-02-13T20:21:05.101 INFO:tasks.rados.rados.0.trial188.stdout:2169: read oid 6 snap -1 2026-02-13T20:21:05.101 INFO:tasks.rados.rados.0.trial188.stdout:2169: expect (ObjNum 743 snap 220 seq_num 743) 2026-02-13T20:21:05.101 INFO:tasks.rados.rados.0.trial188.stdout:2170: rollback oid 41 current snap is 231 2026-02-13T20:21:05.101 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 41 to 206 2026-02-13T20:21:05.101 INFO:tasks.rados.rados.0.trial188.stdout:2171: delete oid 9 current snap is 231 2026-02-13T20:21:05.104 INFO:tasks.rados.rados.0.trial188.stdout:2170: finishing rollback tid 0 to trial18843701-41 2026-02-13T20:21:05.105 INFO:tasks.rados.rados.0.trial188.stdout:2170: finishing rollback tid 1 to trial18843701-41 2026-02-13T20:21:05.105 INFO:tasks.rados.rados.0.trial188.stdout:2170: finishing rollback tid 2 to trial18843701-41 2026-02-13T20:21:05.105 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 41 v 775 (ObjNum 680 snap 194 seq_num 680) dirty exists 2026-02-13T20:21:05.106 INFO:tasks.rados.rados.0.trial188.stdout:2170: done (2 left) 2026-02-13T20:21:05.106 INFO:tasks.rados.rados.0.trial188.stdout:2171: done (1 left) 2026-02-13T20:21:05.106 INFO:tasks.rados.rados.0.trial188.stdout:2172: copy_from oid 1 from oid 2 current snap is 231 2026-02-13T20:21:05.106 INFO:tasks.rados.rados.0.trial188.stdout:2173: rollback oid 24 current snap is 231 2026-02-13T20:21:05.107 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 24 to 209 2026-02-13T20:21:05.107 INFO:tasks.rados.rados.0.trial188.stdout:2174: write oid 39 current snap is 231 2026-02-13T20:21:05.107 INFO:tasks.rados.rados.0.trial188.stdout:2174: seq_num 777 ranges {659039=736479,2001450=643934} 2026-02-13T20:21:05.111 INFO:tasks.rados.rados.0.trial188.stdout:2174: writing trial18843701-39 from 659039 to 1395518 tid 1 2026-02-13T20:21:05.116 INFO:tasks.rados.rados.0.trial188.stdout:2174: writing trial18843701-39 from 2001450 to 2645384 tid 2 2026-02-13T20:21:05.116 INFO:tasks.rados.rados.0.trial188.stdout:2175: read oid 40 snap 206 2026-02-13T20:21:05.116 INFO:tasks.rados.rados.0.trial188.stdout:2175: expect deleted 2026-02-13T20:21:05.116 INFO:tasks.rados.rados.0.trial188.stdout:2176: read oid 47 snap -1 2026-02-13T20:21:05.116 INFO:tasks.rados.rados.0.trial188.stdout:2176: expect (ObjNum 760 snap 225 seq_num 760) 2026-02-13T20:21:05.117 INFO:tasks.rados.rados.0.trial188.stdout:2177: rollback oid 50 current snap is 231 2026-02-13T20:21:05.117 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 50 to 225 2026-02-13T20:21:05.117 INFO:tasks.rados.rados.0.trial188.stdout:2169: expect (ObjNum 743 snap 220 seq_num 743) 2026-02-13T20:21:05.148 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:21:05.165 INFO:tasks.rados.rados.0.trial188.stdout:2173: finishing rollback tid 0 to trial18843701-24 2026-02-13T20:21:05.165 INFO:tasks.rados.rados.0.trial188.stdout:2173: finishing rollback tid 1 to trial18843701-24 2026-02-13T20:21:05.165 INFO:tasks.rados.rados.0.trial188.stdout:2169: done (6 left) 2026-02-13T20:21:05.165 INFO:tasks.rados.rados.0.trial188.stdout:2178: rollback oid 27 current snap is 231 2026-02-13T20:21:05.166 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 27 to 180 2026-02-13T20:21:05.166 INFO:tasks.rados.rados.0.trial188.stdout:2173: finishing rollback tid 2 to trial18843701-24 2026-02-13T20:21:05.166 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 24 v 961 (ObjNum 671 snap 185 seq_num 671) dirty exists 2026-02-13T20:21:05.166 INFO:tasks.rados.rados.0.trial188.stdout:2176: expect (ObjNum 760 snap 225 seq_num 760) 2026-02-13T20:21:05.166 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:21:05.207 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1545791 2026-02-13T20:21:05.255 INFO:tasks.rados.rados.0.trial188.stdout:2172: finishing copy_from racing read to trial18843701-1 2026-02-13T20:21:05.255 INFO:tasks.rados.rados.0.trial188.stdout:2174: finishing write tid 1 to trial18843701-39 2026-02-13T20:21:05.255 INFO:tasks.rados.rados.0.trial188.stdout:2177: finishing rollback tid 1 to trial18843701-50 2026-02-13T20:21:05.255 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 50 v 892 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-13T20:21:05.255 INFO:tasks.rados.rados.0.trial188.stdout:2174: finishing write tid 2 to trial18843701-39 2026-02-13T20:21:05.255 INFO:tasks.rados.rados.0.trial188.stdout:2173: done (6 left) 2026-02-13T20:21:05.256 INFO:tasks.rados.rados.0.trial188.stdout:2175: done (5 left) 2026-02-13T20:21:05.256 INFO:tasks.rados.rados.0.trial188.stdout:2176: done (4 left) 2026-02-13T20:21:05.256 INFO:tasks.rados.rados.0.trial188.stdout:2177: done (3 left) 2026-02-13T20:21:05.256 INFO:tasks.rados.rados.0.trial188.stdout:2179: snap_create 2026-02-13T20:21:05.256 INFO:tasks.rados.rados.0.trial188.stdout:2174: finishing write tid 3 to trial18843701-39 2026-02-13T20:21:05.256 INFO:tasks.rados.rados.0.trial188.stdout:2174: finishing write tid 4 to trial18843701-39 2026-02-13T20:21:05.256 INFO:tasks.rados.rados.0.trial188.stdout:2174: oid 39 updating version 0 to 808 2026-02-13T20:21:05.256 INFO:tasks.rados.rados.0.trial188.stdout:2174: oid 39 version 808 is already newer than 807 2026-02-13T20:21:05.256 INFO:tasks.rados.rados.0.trial188.stdout:2174: oid 39 version 808 is already newer than 806 2026-02-13T20:21:05.256 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 39 v 808 (ObjNum 777 snap 231 seq_num 777) dirty exists 2026-02-13T20:21:05.257 INFO:tasks.rados.rados.0.trial188.stdout:2174: left oid 39 (ObjNum 777 snap 231 seq_num 777) 2026-02-13T20:21:05.257 INFO:tasks.rados.rados.0.trial188.stdout:2172: finishing copy_from to trial18843701-1 2026-02-13T20:21:05.257 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 1 v 902 (ObjNum 770 snap 229 seq_num 770) dirty exists 2026-02-13T20:21:05.257 INFO:tasks.rados.rados.0.trial188.stdout:2178: finishing rollback tid 1 to trial18843701-27 2026-02-13T20:21:05.257 INFO:tasks.rados.rados.0.trial188.stdout:2178: finishing rollback tid 2 to trial18843701-27 2026-02-13T20:21:05.257 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 27 v 998 (ObjNum 660 snap 178 seq_num 660) dirty exists 2026-02-13T20:21:06.105 INFO:tasks.rados.rados.0.trial188.stdout:2172: done (3 left) 2026-02-13T20:21:06.106 INFO:tasks.rados.rados.0.trial188.stdout:2174: done (2 left) 2026-02-13T20:21:06.106 INFO:tasks.rados.rados.0.trial188.stdout:2178: done (1 left) 2026-02-13T20:21:06.106 INFO:tasks.rados.rados.0.trial188.stdout:2179: done (0 left) 2026-02-13T20:21:06.106 INFO:tasks.rados.rados.0.trial188.stdout:2180: write oid 28 current snap is 232 2026-02-13T20:21:06.106 INFO:tasks.rados.rados.0.trial188.stdout:2180: seq_num 778 ranges {675846=411728,1543579=787592,2848853=226993} 2026-02-13T20:21:06.109 INFO:tasks.rados.rados.0.trial188.stdout:2180: writing trial18843701-28 from 675846 to 1087574 tid 1 2026-02-13T20:21:06.114 INFO:tasks.rados.rados.0.trial188.stdout:2180: writing trial18843701-28 from 1543579 to 2331171 tid 2 2026-02-13T20:21:06.118 INFO:tasks.rados.rados.0.trial188.stdout:2180: writing trial18843701-28 from 2848853 to 3075846 tid 3 2026-02-13T20:21:06.118 INFO:tasks.rados.rados.0.trial188.stdout:2181: read oid 49 snap -1 2026-02-13T20:21:06.118 INFO:tasks.rados.rados.0.trial188.stdout:2181: expect deleted 2026-02-13T20:21:06.118 INFO:tasks.rados.rados.0.trial188.stdout:2182: read oid 35 snap -1 2026-02-13T20:21:06.118 INFO:tasks.rados.rados.0.trial188.stdout:2182: expect deleted 2026-02-13T20:21:06.118 INFO:tasks.rados.rados.0.trial188.stdout:2183: copy_from oid 21 from oid 26 current snap is 232 2026-02-13T20:21:06.118 INFO:tasks.rados.rados.0.trial188.stdout:2184: copy_from oid 42 from oid 17 current snap is 232 2026-02-13T20:21:06.118 INFO:tasks.rados.rados.0.trial188.stdout:2185: read oid 4 snap -1 2026-02-13T20:21:06.119 INFO:tasks.rados.rados.0.trial188.stdout:2185: expect deleted 2026-02-13T20:21:06.119 INFO:tasks.rados.rados.0.trial188.stdout:2186: rollback oid 39 current snap is 232 2026-02-13T20:21:06.119 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 39 to 215 2026-02-13T20:21:06.119 INFO:tasks.rados.rados.0.trial188.stdout:2187: read oid 20 snap -1 2026-02-13T20:21:06.119 INFO:tasks.rados.rados.0.trial188.stdout:2187: expect (ObjNum 773 snap 230 seq_num 773) 2026-02-13T20:21:06.119 INFO:tasks.rados.rados.0.trial188.stdout:2188: read oid 19 snap 222 2026-02-13T20:21:06.119 INFO:tasks.rados.rados.0.trial188.stdout:2188: expect (ObjNum 688 snap 199 seq_num 688) 2026-02-13T20:21:06.119 INFO:tasks.rados.rados.0.trial188.stdout:2189: rollback oid 36 current snap is 232 2026-02-13T20:21:06.119 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 36 to 226 2026-02-13T20:21:06.119 INFO:tasks.rados.rados.0.trial188.stdout:2190: write oid 38 current snap is 232 2026-02-13T20:21:06.119 INFO:tasks.rados.rados.0.trial188.stdout:2190: seq_num 779 ranges {692653=486977,1602061=647603,2992629=100024} 2026-02-13T20:21:06.121 INFO:tasks.rados.rados.0.trial188.stdout:2190: writing trial18843701-38 from 692653 to 1179630 tid 1 2026-02-13T20:21:06.125 INFO:tasks.rados.rados.0.trial188.stdout:2190: writing trial18843701-38 from 1602061 to 2249664 tid 2 2026-02-13T20:21:06.128 INFO:tasks.rados.rados.0.trial188.stdout:2190: writing trial18843701-38 from 2992629 to 3092653 tid 3 2026-02-13T20:21:06.129 INFO:tasks.rados.rados.0.trial188.stdout:2191: snap_remove snap 209 2026-02-13T20:21:07.109 INFO:tasks.rados.rados.0.trial188.stdout:2191: done (11 left) 2026-02-13T20:21:07.109 INFO:tasks.rados.rados.0.trial188.stdout:2192: rollback oid 8 current snap is 232 2026-02-13T20:21:07.109 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 8 to 180 2026-02-13T20:21:07.109 INFO:tasks.rados.rados.0.trial188.stdout:2183: finishing copy_from to trial18843701-21 2026-02-13T20:21:07.109 INFO:tasks.rados.rados.0.trial188.stdout:2183: got expected ENOENT (src dne) 2026-02-13T20:21:07.109 INFO:tasks.rados.rados.0.trial188.stdout:2183: finishing copy_from racing read to trial18843701-21 2026-02-13T20:21:07.109 INFO:tasks.rados.rados.0.trial188.stdout:2188: expect (ObjNum 688 snap 199 seq_num 688) 2026-02-13T20:21:07.195 INFO:tasks.rados.rados.0.trial188.stdout:2189: finishing rollback tid 1 to trial18843701-36 2026-02-13T20:21:07.195 INFO:tasks.rados.rados.0.trial188.stdout:2189: finishing rollback tid 2 to trial18843701-36 2026-02-13T20:21:07.195 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 36 v 964 (ObjNum 721 snap 213 seq_num 721) dirty exists 2026-02-13T20:21:07.195 INFO:tasks.rados.rados.0.trial188.stdout:2186: finishing rollback tid 0 to trial18843701-39 2026-02-13T20:21:07.195 INFO:tasks.rados.rados.0.trial188.stdout:2186: finishing rollback tid 1 to trial18843701-39 2026-02-13T20:21:07.195 INFO:tasks.rados.rados.0.trial188.stdout:2186: finishing rollback tid 2 to trial18843701-39 2026-02-13T20:21:07.195 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 39 v 812 (ObjNum 679 snap 194 seq_num 679) dirty exists 2026-02-13T20:21:07.195 INFO:tasks.rados.rados.0.trial188.stdout:2180: finishing write tid 1 to trial18843701-28 2026-02-13T20:21:07.195 INFO:tasks.rados.rados.0.trial188.stdout:2180: finishing write tid 2 to trial18843701-28 2026-02-13T20:21:07.196 INFO:tasks.rados.rados.0.trial188.stdout:2180: finishing write tid 3 to trial18843701-28 2026-02-13T20:21:07.196 INFO:tasks.rados.rados.0.trial188.stdout:2181: done (11 left) 2026-02-13T20:21:07.196 INFO:tasks.rados.rados.0.trial188.stdout:2182: done (10 left) 2026-02-13T20:21:07.196 INFO:tasks.rados.rados.0.trial188.stdout:2183: done (9 left) 2026-02-13T20:21:07.196 INFO:tasks.rados.rados.0.trial188.stdout:2185: done (8 left) 2026-02-13T20:21:07.196 INFO:tasks.rados.rados.0.trial188.stdout:2186: done (7 left) 2026-02-13T20:21:07.196 INFO:tasks.rados.rados.0.trial188.stdout:2188: done (6 left) 2026-02-13T20:21:07.196 INFO:tasks.rados.rados.0.trial188.stdout:2189: done (5 left) 2026-02-13T20:21:07.196 INFO:tasks.rados.rados.0.trial188.stdout:2193: delete oid 50 current snap is 232 2026-02-13T20:21:07.196 INFO:tasks.rados.rados.0.trial188.stdout:2180: finishing write tid 4 to trial18843701-28 2026-02-13T20:21:07.196 INFO:tasks.rados.rados.0.trial188.stdout:2180: finishing write tid 5 to trial18843701-28 2026-02-13T20:21:07.196 INFO:tasks.rados.rados.0.trial188.stdout:2180: oid 28 updating version 0 to 889 2026-02-13T20:21:07.197 INFO:tasks.rados.rados.0.trial188.stdout:2180: oid 28 updating version 889 to 891 2026-02-13T20:21:07.197 INFO:tasks.rados.rados.0.trial188.stdout:2180: oid 28 updating version 891 to 892 2026-02-13T20:21:07.197 INFO:tasks.rados.rados.0.trial188.stdout:2180: oid 28 version 892 is already newer than 890 2026-02-13T20:21:07.197 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 28 v 892 (ObjNum 778 snap 232 seq_num 778) dirty exists 2026-02-13T20:21:07.197 INFO:tasks.rados.rados.0.trial188.stdout:2180: left oid 28 (ObjNum 778 snap 232 seq_num 778) 2026-02-13T20:21:07.197 INFO:tasks.rados.rados.0.trial188.stdout:2190: finishing write tid 1 to trial18843701-38 2026-02-13T20:21:07.197 INFO:tasks.rados.rados.0.trial188.stdout:2190: finishing write tid 2 to trial18843701-38 2026-02-13T20:21:07.197 INFO:tasks.rados.rados.0.trial188.stdout:2190: finishing write tid 3 to trial18843701-38 2026-02-13T20:21:07.197 INFO:tasks.rados.rados.0.trial188.stdout:2190: finishing write tid 4 to trial18843701-38 2026-02-13T20:21:07.197 INFO:tasks.rados.rados.0.trial188.stdout:2190: finishing write tid 5 to trial18843701-38 2026-02-13T20:21:07.197 INFO:tasks.rados.rados.0.trial188.stdout:2190: oid 38 updating version 0 to 1000 2026-02-13T20:21:07.197 INFO:tasks.rados.rados.0.trial188.stdout:2190: oid 38 updating version 1000 to 1001 2026-02-13T20:21:07.197 INFO:tasks.rados.rados.0.trial188.stdout:2190: oid 38 version 1001 is already newer than 999 2026-02-13T20:21:07.198 INFO:tasks.rados.rados.0.trial188.stdout:2190: oid 38 updating version 1001 to 1002 2026-02-13T20:21:07.198 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 38 v 1002 (ObjNum 779 snap 232 seq_num 779) dirty exists 2026-02-13T20:21:07.198 INFO:tasks.rados.rados.0.trial188.stdout:2190: left oid 38 (ObjNum 779 snap 232 seq_num 779) 2026-02-13T20:21:07.198 INFO:tasks.rados.rados.0.trial188.stdout:2187: expect (ObjNum 773 snap 230 seq_num 773) 2026-02-13T20:21:07.227 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2817604 2026-02-13T20:21:07.317 INFO:tasks.rados.rados.0.trial188.stdout:2184: finishing copy_from racing read to trial18843701-42 2026-02-13T20:21:07.317 INFO:tasks.rados.rados.0.trial188.stdout:2184: finishing copy_from to trial18843701-42 2026-02-13T20:21:07.317 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 42 v 723 (ObjNum 688 snap 199 seq_num 688) dirty exists 2026-02-13T20:21:07.317 INFO:tasks.rados.rados.0.trial188.stdout:2192: finishing rollback tid 0 to trial18843701-8 2026-02-13T20:21:07.317 INFO:tasks.rados.rados.0.trial188.stdout:2192: finishing rollback tid 1 to trial18843701-8 2026-02-13T20:21:07.318 INFO:tasks.rados.rados.0.trial188.stdout:2192: finishing rollback tid 2 to trial18843701-8 2026-02-13T20:21:07.318 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 8 v 896 (ObjNum 623 snap 166 seq_num 623) dirty exists 2026-02-13T20:21:07.318 INFO:tasks.rados.rados.0.trial188.stdout:2180: done (5 left) 2026-02-13T20:21:07.318 INFO:tasks.rados.rados.0.trial188.stdout:2184: done (4 left) 2026-02-13T20:21:07.318 INFO:tasks.rados.rados.0.trial188.stdout:2187: done (3 left) 2026-02-13T20:21:07.318 INFO:tasks.rados.rados.0.trial188.stdout:2190: done (2 left) 2026-02-13T20:21:07.318 INFO:tasks.rados.rados.0.trial188.stdout:2192: done (1 left) 2026-02-13T20:21:07.318 INFO:tasks.rados.rados.0.trial188.stdout:2193: done (0 left) 2026-02-13T20:21:07.318 INFO:tasks.rados.rados.0.trial188.stdout:2194: read oid 38 snap -1 2026-02-13T20:21:07.318 INFO:tasks.rados.rados.0.trial188.stdout:2194: expect (ObjNum 779 snap 232 seq_num 779) 2026-02-13T20:21:07.318 INFO:tasks.rados.rados.0.trial188.stdout:2195: copy_from oid 32 from oid 30 current snap is 232 2026-02-13T20:21:07.318 INFO:tasks.rados.rados.0.trial188.stdout:2196: rollback oid 28 current snap is 232 2026-02-13T20:21:07.318 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 28 to 223 2026-02-13T20:21:07.318 INFO:tasks.rados.rados.0.trial188.stdout:2197: write oid 27 current snap is 232 2026-02-13T20:21:07.318 INFO:tasks.rados.rados.0.trial188.stdout:2197: seq_num 781 ranges {726267=637475,2119025=651272} 2026-02-13T20:21:07.322 INFO:tasks.rados.rados.0.trial188.stdout:2197: writing trial18843701-27 from 726267 to 1363742 tid 1 2026-02-13T20:21:07.328 INFO:tasks.rados.rados.0.trial188.stdout:2197: writing trial18843701-27 from 2119025 to 2770297 tid 2 2026-02-13T20:21:07.328 INFO:tasks.rados.rados.0.trial188.stdout:2198: write (excl) oid 3 current snap is 232 2026-02-13T20:21:07.328 INFO:tasks.rados.rados.0.trial188.stdout:2198: seq_num 782 ranges {743074=712724,2061154=794930} 2026-02-13T20:21:07.333 INFO:tasks.rados.rados.0.trial188.stdout:2198: writing trial18843701-3 from 743074 to 1455798 tid 1 2026-02-13T20:21:07.338 INFO:tasks.rados.rados.0.trial188.stdout:2198: writing trial18843701-3 from 2061154 to 2856084 tid 2 2026-02-13T20:21:07.338 INFO:tasks.rados.rados.0.trial188.stdout:2199: rollback oid 1 current snap is 232 2026-02-13T20:21:07.338 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 1 to 230 2026-02-13T20:21:07.338 INFO:tasks.rados.rados.0.trial188.stdout:2196: finishing rollback tid 0 to trial18843701-28 2026-02-13T20:21:07.338 INFO:tasks.rados.rados.0.trial188.stdout:2196: finishing rollback tid 1 to trial18843701-28 2026-02-13T20:21:07.338 INFO:tasks.rados.rados.0.trial188.stdout:2196: finishing rollback tid 2 to trial18843701-28 2026-02-13T20:21:07.338 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 28 v 905 (ObjNum 729 snap 216 seq_num 729) dirty exists 2026-02-13T20:21:07.338 INFO:tasks.rados.rados.0.trial188.stdout:2196: done (5 left) 2026-02-13T20:21:07.338 INFO:tasks.rados.rados.0.trial188.stdout:2200: write oid 13 current snap is 232 2026-02-13T20:21:07.339 INFO:tasks.rados.rados.0.trial188.stdout:2200: seq_num 783 ranges {759881=787973,2119636=654941} 2026-02-13T20:21:07.344 INFO:tasks.rados.rados.0.trial188.stdout:2200: writing trial18843701-13 from 759881 to 1547854 tid 1 2026-02-13T20:21:07.349 INFO:tasks.rados.rados.0.trial188.stdout:2200: writing trial18843701-13 from 2119636 to 2774577 tid 2 2026-02-13T20:21:07.349 INFO:tasks.rados.rados.0.trial188.stdout:2201: read oid 18 snap -1 2026-02-13T20:21:07.349 INFO:tasks.rados.rados.0.trial188.stdout:2201: expect deleted 2026-02-13T20:21:07.349 INFO:tasks.rados.rados.0.trial188.stdout:2202: rollback oid 19 current snap is 232 2026-02-13T20:21:07.349 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 19 to 214 2026-02-13T20:21:07.349 INFO:tasks.rados.rados.0.trial188.stdout:2194: expect (ObjNum 779 snap 232 seq_num 779) 2026-02-13T20:21:07.349 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:21:07.392 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1187607 2026-02-13T20:21:07.408 INFO:tasks.rados.rados.0.trial188.stdout:2197: finishing write tid 1 to trial18843701-27 2026-02-13T20:21:07.409 INFO:tasks.rados.rados.0.trial188.stdout:2197: finishing write tid 2 to trial18843701-27 2026-02-13T20:21:07.409 INFO:tasks.rados.rados.0.trial188.stdout:2197: finishing write tid 3 to trial18843701-27 2026-02-13T20:21:07.409 INFO:tasks.rados.rados.0.trial188.stdout:2197: finishing write tid 4 to trial18843701-27 2026-02-13T20:21:07.409 INFO:tasks.rados.rados.0.trial188.stdout:2197: oid 27 updating version 0 to 1014 2026-02-13T20:21:07.409 INFO:tasks.rados.rados.0.trial188.stdout:2197: oid 27 version 1014 is already newer than 1013 2026-02-13T20:21:07.409 INFO:tasks.rados.rados.0.trial188.stdout:2197: oid 27 version 1014 is already newer than 1012 2026-02-13T20:21:07.409 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 27 v 1014 (ObjNum 781 snap 232 seq_num 781) dirty exists 2026-02-13T20:21:07.409 INFO:tasks.rados.rados.0.trial188.stdout:2197: left oid 27 (ObjNum 781 snap 232 seq_num 781) 2026-02-13T20:21:07.409 INFO:tasks.rados.rados.0.trial188.stdout:2195: finishing copy_from racing read to trial18843701-32 2026-02-13T20:21:07.409 INFO:tasks.rados.rados.0.trial188.stdout:2195: finishing copy_from to trial18843701-32 2026-02-13T20:21:07.409 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 32 v 955 (ObjNum 753 snap 222 seq_num 753) dirty exists 2026-02-13T20:21:07.409 INFO:tasks.rados.rados.0.trial188.stdout:2199: finishing rollback tid 0 to trial18843701-1 2026-02-13T20:21:07.409 INFO:tasks.rados.rados.0.trial188.stdout:2198: finishing write tid 1 to trial18843701-3 2026-02-13T20:21:07.409 INFO:tasks.rados.rados.0.trial188.stdout:2199: finishing rollback tid 1 to trial18843701-1 2026-02-13T20:21:07.409 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 1 v 908 (ObjNum 33 snap 0 seq_num 13781312) dirty dne 2026-02-13T20:21:07.409 INFO:tasks.rados.rados.0.trial188.stdout:2198: finishing write tid 2 to trial18843701-3 2026-02-13T20:21:07.409 INFO:tasks.rados.rados.0.trial188.stdout:2194: done (7 left) 2026-02-13T20:21:07.409 INFO:tasks.rados.rados.0.trial188.stdout:2195: done (6 left) 2026-02-13T20:21:07.409 INFO:tasks.rados.rados.0.trial188.stdout:2197: done (5 left) 2026-02-13T20:21:07.409 INFO:tasks.rados.rados.0.trial188.stdout:2199: done (4 left) 2026-02-13T20:21:07.409 INFO:tasks.rados.rados.0.trial188.stdout:2201: done (3 left) 2026-02-13T20:21:07.409 INFO:tasks.rados.rados.0.trial188.stdout:2203: write oid 7 current snap is 232 2026-02-13T20:21:07.409 INFO:tasks.rados.rados.0.trial188.stdout:2203: seq_num 784 ranges {776688=579575,1894471=798599} 2026-02-13T20:21:07.413 INFO:tasks.rados.rados.0.trial188.stdout:2203: writing trial18843701-7 from 776688 to 1356263 tid 1 2026-02-13T20:21:07.418 INFO:tasks.rados.rados.0.trial188.stdout:2203: writing trial18843701-7 from 1894471 to 2693070 tid 2 2026-02-13T20:21:07.418 INFO:tasks.rados.rados.0.trial188.stdout:2204: write oid 9 current snap is 232 2026-02-13T20:21:07.418 INFO:tasks.rados.rados.0.trial188.stdout:2198: finishing write tid 3 to trial18843701-3 2026-02-13T20:21:07.418 INFO:tasks.rados.rados.0.trial188.stdout:2200: finishing write tid 1 to trial18843701-13 2026-02-13T20:21:07.419 INFO:tasks.rados.rados.0.trial188.stdout:2198: finishing write tid 4 to trial18843701-3 2026-02-13T20:21:07.419 INFO:tasks.rados.rados.0.trial188.stdout:2198: oid 3 updating version 0 to 768 2026-02-13T20:21:07.419 INFO:tasks.rados.rados.0.trial188.stdout:2198: oid 3 updating version 768 to 770 2026-02-13T20:21:07.419 INFO:tasks.rados.rados.0.trial188.stdout:2198: oid 3 version 770 is already newer than 769 2026-02-13T20:21:07.419 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 3 v 770 (ObjNum 782 snap 232 seq_num 782) dirty exists 2026-02-13T20:21:07.419 INFO:tasks.rados.rados.0.trial188.stdout:2198: left oid 3 (ObjNum 782 snap 232 seq_num 782) 2026-02-13T20:21:07.419 INFO:tasks.rados.rados.0.trial188.stdout:2200: finishing write tid 2 to trial18843701-13 2026-02-13T20:21:07.419 INFO:tasks.rados.rados.0.trial188.stdout:2202: finishing rollback tid 0 to trial18843701-19 2026-02-13T20:21:07.419 INFO:tasks.rados.rados.0.trial188.stdout:2200: finishing write tid 3 to trial18843701-13 2026-02-13T20:21:07.419 INFO:tasks.rados.rados.0.trial188.stdout:2202: finishing rollback tid 1 to trial18843701-19 2026-02-13T20:21:07.419 INFO:tasks.rados.rados.0.trial188.stdout:2202: finishing rollback tid 2 to trial18843701-19 2026-02-13T20:21:07.419 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 19 v 820 (ObjNum 688 snap 199 seq_num 688) dirty exists 2026-02-13T20:21:07.419 INFO:tasks.rados.rados.0.trial188.stdout:2200: finishing write tid 4 to trial18843701-13 2026-02-13T20:21:07.419 INFO:tasks.rados.rados.0.trial188.stdout:2200: oid 13 updating version 0 to 911 2026-02-13T20:21:07.419 INFO:tasks.rados.rados.0.trial188.stdout:2200: oid 13 version 911 is already newer than 910 2026-02-13T20:21:07.419 INFO:tasks.rados.rados.0.trial188.stdout:2200: oid 13 updating version 911 to 912 2026-02-13T20:21:07.419 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 13 v 912 (ObjNum 783 snap 232 seq_num 783) dirty exists 2026-02-13T20:21:07.419 INFO:tasks.rados.rados.0.trial188.stdout:2200: left oid 13 (ObjNum 783 snap 232 seq_num 783) 2026-02-13T20:21:07.419 INFO:tasks.rados.rados.0.trial188.stdout:2204: seq_num 785 ranges {793495=654824,1952953=658610,3157167=36328} 2026-02-13T20:21:07.424 INFO:tasks.rados.rados.0.trial188.stdout:2204: writing trial18843701-9 from 793495 to 1448319 tid 1 2026-02-13T20:21:07.428 INFO:tasks.rados.rados.0.trial188.stdout:2204: writing trial18843701-9 from 1952953 to 2611563 tid 2 2026-02-13T20:21:07.430 INFO:tasks.rados.rados.0.trial188.stdout:2204: writing trial18843701-9 from 3157167 to 3193495 tid 3 2026-02-13T20:21:07.431 INFO:tasks.rados.rados.0.trial188.stdout:2198: done (4 left) 2026-02-13T20:21:07.431 INFO:tasks.rados.rados.0.trial188.stdout:2200: done (3 left) 2026-02-13T20:21:07.431 INFO:tasks.rados.rados.0.trial188.stdout:2202: done (2 left) 2026-02-13T20:21:07.431 INFO:tasks.rados.rados.0.trial188.stdout:2205: rollback oid 40 current snap is 232 2026-02-13T20:21:07.431 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 40 to 228 2026-02-13T20:21:07.431 INFO:tasks.rados.rados.0.trial188.stdout:2206: read oid 8 snap -1 2026-02-13T20:21:07.431 INFO:tasks.rados.rados.0.trial188.stdout:2206: expect (ObjNum 623 snap 166 seq_num 623) 2026-02-13T20:21:07.431 INFO:tasks.rados.rados.0.trial188.stdout:2207: read oid 14 snap -1 2026-02-13T20:21:07.431 INFO:tasks.rados.rados.0.trial188.stdout:2207: expect (ObjNum 668 snap 182 seq_num 668) 2026-02-13T20:21:07.431 INFO:tasks.rados.rados.0.trial188.stdout:2208: rollback oid 37 current snap is 232 2026-02-13T20:21:07.431 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 37 to 224 2026-02-13T20:21:07.431 INFO:tasks.rados.rados.0.trial188.stdout:2209: snap_create 2026-02-13T20:21:07.431 INFO:tasks.rados.rados.0.trial188.stdout:2205: finishing rollback tid 1 to trial18843701-40 2026-02-13T20:21:07.431 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 40 v 0 (ObjNum 129 snap 0 seq_num 16407504) dirty dne 2026-02-13T20:21:07.434 INFO:tasks.rados.rados.0.trial188.stdout:2203: finishing write tid 1 to trial18843701-7 2026-02-13T20:21:07.434 INFO:tasks.rados.rados.0.trial188.stdout:2206: expect (ObjNum 623 snap 166 seq_num 623) 2026-02-13T20:21:07.498 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 747501 2026-02-13T20:21:07.608 INFO:tasks.rados.rados.0.trial188.stdout:2204: finishing write tid 1 to trial18843701-9 2026-02-13T20:21:07.608 INFO:tasks.rados.rados.0.trial188.stdout:2203: finishing write tid 2 to trial18843701-7 2026-02-13T20:21:07.608 INFO:tasks.rados.rados.0.trial188.stdout:2203: finishing write tid 3 to trial18843701-7 2026-02-13T20:21:07.608 INFO:tasks.rados.rados.0.trial188.stdout:2204: finishing write tid 2 to trial18843701-9 2026-02-13T20:21:07.608 INFO:tasks.rados.rados.0.trial188.stdout:2203: finishing write tid 4 to trial18843701-7 2026-02-13T20:21:07.608 INFO:tasks.rados.rados.0.trial188.stdout:2203: oid 7 updating version 0 to 823 2026-02-13T20:21:07.609 INFO:tasks.rados.rados.0.trial188.stdout:2203: oid 7 version 823 is already newer than 822 2026-02-13T20:21:07.609 INFO:tasks.rados.rados.0.trial188.stdout:2203: oid 7 updating version 823 to 824 2026-02-13T20:21:07.609 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 7 v 824 (ObjNum 784 snap 232 seq_num 784) dirty exists 2026-02-13T20:21:07.609 INFO:tasks.rados.rados.0.trial188.stdout:2203: left oid 7 (ObjNum 784 snap 232 seq_num 784) 2026-02-13T20:21:07.609 INFO:tasks.rados.rados.0.trial188.stdout:2208: finishing rollback tid 0 to trial18843701-37 2026-02-13T20:21:07.609 INFO:tasks.rados.rados.0.trial188.stdout:2208: finishing rollback tid 1 to trial18843701-37 2026-02-13T20:21:07.609 INFO:tasks.rados.rados.0.trial188.stdout:2208: finishing rollback tid 2 to trial18843701-37 2026-02-13T20:21:07.609 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 37 v 909 (ObjNum 662 snap 179 seq_num 662) dirty exists 2026-02-13T20:21:07.609 INFO:tasks.rados.rados.0.trial188.stdout:2204: finishing write tid 3 to trial18843701-9 2026-02-13T20:21:07.609 INFO:tasks.rados.rados.0.trial188.stdout:2204: finishing write tid 4 to trial18843701-9 2026-02-13T20:21:07.609 INFO:tasks.rados.rados.0.trial188.stdout:2204: finishing write tid 5 to trial18843701-9 2026-02-13T20:21:07.610 INFO:tasks.rados.rados.0.trial188.stdout:2204: oid 9 updating version 0 to 724 2026-02-13T20:21:07.610 INFO:tasks.rados.rados.0.trial188.stdout:2204: oid 9 updating version 724 to 727 2026-02-13T20:21:07.610 INFO:tasks.rados.rados.0.trial188.stdout:2204: oid 9 version 727 is already newer than 725 2026-02-13T20:21:07.610 INFO:tasks.rados.rados.0.trial188.stdout:2204: oid 9 version 727 is already newer than 726 2026-02-13T20:21:07.610 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 9 v 727 (ObjNum 785 snap 232 seq_num 785) dirty exists 2026-02-13T20:21:07.610 INFO:tasks.rados.rados.0.trial188.stdout:2204: left oid 9 (ObjNum 785 snap 232 seq_num 785) 2026-02-13T20:21:07.610 INFO:tasks.rados.rados.0.trial188.stdout:2207: expect (ObjNum 668 snap 182 seq_num 668) 2026-02-13T20:21:07.727 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:21:08.075 INFO:tasks.rados.rados.0.trial188.stdout:2203: done (6 left) 2026-02-13T20:21:08.075 INFO:tasks.rados.rados.0.trial188.stdout:2204: done (5 left) 2026-02-13T20:21:08.075 INFO:tasks.rados.rados.0.trial188.stdout:2205: done (4 left) 2026-02-13T20:21:08.075 INFO:tasks.rados.rados.0.trial188.stdout:2206: done (3 left) 2026-02-13T20:21:08.075 INFO:tasks.rados.rados.0.trial188.stdout:2207: done (2 left) 2026-02-13T20:21:08.075 INFO:tasks.rados.rados.0.trial188.stdout:2208: done (1 left) 2026-02-13T20:21:08.075 INFO:tasks.rados.rados.0.trial188.stdout:2209: done (0 left) 2026-02-13T20:21:08.075 INFO:tasks.rados.rados.0.trial188.stdout:2210: copy_from oid 28 from oid 4 current snap is 233 2026-02-13T20:21:08.075 INFO:tasks.rados.rados.0.trial188.stdout:2211: read oid 43 snap -1 2026-02-13T20:21:08.075 INFO:tasks.rados.rados.0.trial188.stdout:2211: expect deleted 2026-02-13T20:21:08.075 INFO:tasks.rados.rados.0.trial188.stdout:2212: copy_from oid 21 from oid 23 current snap is 233 2026-02-13T20:21:08.075 INFO:tasks.rados.rados.0.trial188.stdout:2213: snap_remove snap 205 2026-02-13T20:21:09.075 INFO:tasks.rados.rados.0.trial188.stdout:2213: done (3 left) 2026-02-13T20:21:09.076 INFO:tasks.rados.rados.0.trial188.stdout:2214: rollback oid 17 current snap is 233 2026-02-13T20:21:09.076 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 17 to 223 2026-02-13T20:21:09.076 INFO:tasks.rados.rados.0.trial188.stdout:2212: finishing copy_from to trial18843701-21 2026-02-13T20:21:09.076 INFO:tasks.rados.rados.0.trial188.stdout:2212: got expected ENOENT (src dne) 2026-02-13T20:21:09.076 INFO:tasks.rados.rados.0.trial188.stdout:2212: finishing copy_from racing read to trial18843701-21 2026-02-13T20:21:09.076 INFO:tasks.rados.rados.0.trial188.stdout:2210: finishing copy_from to trial18843701-28 2026-02-13T20:21:09.076 INFO:tasks.rados.rados.0.trial188.stdout:2210: got expected ENOENT (src dne) 2026-02-13T20:21:09.076 INFO:tasks.rados.rados.0.trial188.stdout:2210: finishing copy_from racing read to trial18843701-28 2026-02-13T20:21:09.077 INFO:tasks.rados.rados.0.trial188.stdout:2210: done (3 left) 2026-02-13T20:21:09.077 INFO:tasks.rados.rados.0.trial188.stdout:2211: done (2 left) 2026-02-13T20:21:09.077 INFO:tasks.rados.rados.0.trial188.stdout:2212: done (1 left) 2026-02-13T20:21:09.077 INFO:tasks.rados.rados.0.trial188.stdout:2215: snap_create 2026-02-13T20:21:09.080 INFO:tasks.rados.rados.0.trial188.stdout:2214: finishing rollback tid 0 to trial18843701-17 2026-02-13T20:21:09.081 INFO:tasks.rados.rados.0.trial188.stdout:2214: finishing rollback tid 1 to trial18843701-17 2026-02-13T20:21:09.081 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 17 v 725 (ObjNum 289 snap 0 seq_num 16247060) dirty dne 2026-02-13T20:21:10.076 INFO:tasks.rados.rados.0.trial188.stdout:2214: done (1 left) 2026-02-13T20:21:10.076 INFO:tasks.rados.rados.0.trial188.stdout:2215: done (0 left) 2026-02-13T20:21:10.076 INFO:tasks.rados.rados.0.trial188.stdout:2216: read oid 36 snap -1 2026-02-13T20:21:10.076 INFO:tasks.rados.rados.0.trial188.stdout:2216: expect (ObjNum 721 snap 213 seq_num 721) 2026-02-13T20:21:10.076 INFO:tasks.rados.rados.0.trial188.stdout:2217: snap_remove snap 198 2026-02-13T20:21:11.078 INFO:tasks.rados.rados.0.trial188.stdout:2217: done (1 left) 2026-02-13T20:21:11.078 INFO:tasks.rados.rados.0.trial188.stdout:2218: read oid 48 snap -1 2026-02-13T20:21:11.078 INFO:tasks.rados.rados.0.trial188.stdout:2218: expect deleted 2026-02-13T20:21:11.078 INFO:tasks.rados.rados.0.trial188.stdout:2219: snap_remove snap 233 2026-02-13T20:21:12.077 INFO:tasks.rados.rados.0.trial188.stdout:2219: done (2 left) 2026-02-13T20:21:12.077 INFO:tasks.rados.rados.0.trial188.stdout:2220: rollback oid 39 current snap is 234 2026-02-13T20:21:12.077 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 39 to 218 2026-02-13T20:21:12.077 INFO:tasks.rados.rados.0.trial188.stdout:2216: expect (ObjNum 721 snap 213 seq_num 721) 2026-02-13T20:21:12.077 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:21:12.136 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 633275 2026-02-13T20:21:12.159 INFO:tasks.rados.rados.0.trial188.stdout:2220: finishing rollback tid 0 to trial18843701-39 2026-02-13T20:21:12.159 INFO:tasks.rados.rados.0.trial188.stdout:2220: finishing rollback tid 1 to trial18843701-39 2026-02-13T20:21:12.159 INFO:tasks.rados.rados.0.trial188.stdout:2220: finishing rollback tid 2 to trial18843701-39 2026-02-13T20:21:12.159 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 39 v 842 (ObjNum 679 snap 194 seq_num 679) dirty exists 2026-02-13T20:21:12.159 INFO:tasks.rados.rados.0.trial188.stdout:2216: done (2 left) 2026-02-13T20:21:12.159 INFO:tasks.rados.rados.0.trial188.stdout:2218: done (1 left) 2026-02-13T20:21:12.159 INFO:tasks.rados.rados.0.trial188.stdout:2220: done (0 left) 2026-02-13T20:21:12.159 INFO:tasks.rados.rados.0.trial188.stdout:2221: rollback oid 35 current snap is 234 2026-02-13T20:21:12.159 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 35 to 206 2026-02-13T20:21:12.159 INFO:tasks.rados.rados.0.trial188.stdout:2222: write (excl) oid 15 current snap is 234 2026-02-13T20:21:12.159 INFO:tasks.rados.rados.0.trial188.stdout:2222: seq_num 786 ranges {410302=730073,1895082=402268,2951884=258418} 2026-02-13T20:21:12.164 INFO:tasks.rados.rados.0.trial188.stdout:2222: writing trial18843701-15 from 410302 to 1140375 tid 1 2026-02-13T20:21:12.168 INFO:tasks.rados.rados.0.trial188.stdout:2222: writing trial18843701-15 from 1895082 to 2297350 tid 2 2026-02-13T20:21:12.171 INFO:tasks.rados.rados.0.trial188.stdout:2222: writing trial18843701-15 from 2951884 to 3210302 tid 3 2026-02-13T20:21:12.171 INFO:tasks.rados.rados.0.trial188.stdout:2223: write oid 33 current snap is 234 2026-02-13T20:21:12.172 INFO:tasks.rados.rados.0.trial188.stdout:2223: seq_num 787 ranges {427109=405322,1553564=545926,2579307=647802} 2026-02-13T20:21:12.174 INFO:tasks.rados.rados.0.trial188.stdout:2223: writing trial18843701-33 from 427109 to 832431 tid 1 2026-02-13T20:21:12.179 INFO:tasks.rados.rados.0.trial188.stdout:2223: writing trial18843701-33 from 1553564 to 2099490 tid 2 2026-02-13T20:21:12.183 INFO:tasks.rados.rados.0.trial188.stdout:2223: writing trial18843701-33 from 2579307 to 3227109 tid 3 2026-02-13T20:21:12.184 INFO:tasks.rados.rados.0.trial188.stdout:2224: write (excl) oid 22 current snap is 234 2026-02-13T20:21:12.184 INFO:tasks.rados.rados.0.trial188.stdout:2221: finishing rollback tid 1 to trial18843701-35 2026-02-13T20:21:12.184 INFO:tasks.rados.rados.0.trial188.stdout:2221: finishing rollback tid 2 to trial18843701-35 2026-02-13T20:21:12.184 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 35 v 729 (ObjNum 618 snap 163 seq_num 618) dirty exists 2026-02-13T20:21:12.184 INFO:tasks.rados.rados.0.trial188.stdout:2224: seq_num 788 ranges {443916=480571,1612046=405937,2606730=495052} 2026-02-13T20:21:12.187 INFO:tasks.rados.rados.0.trial188.stdout:2224: writing trial18843701-22 from 443916 to 924487 tid 1 2026-02-13T20:21:12.191 INFO:tasks.rados.rados.0.trial188.stdout:2224: writing trial18843701-22 from 1612046 to 2017983 tid 2 2026-02-13T20:21:12.195 INFO:tasks.rados.rados.0.trial188.stdout:2224: writing trial18843701-22 from 2606730 to 3101782 tid 3 2026-02-13T20:21:12.195 INFO:tasks.rados.rados.0.trial188.stdout:2221: done (3 left) 2026-02-13T20:21:12.195 INFO:tasks.rados.rados.0.trial188.stdout:2225: delete oid 7 current snap is 234 2026-02-13T20:21:12.196 INFO:tasks.rados.rados.0.trial188.stdout:2222: finishing write tid 1 to trial18843701-15 2026-02-13T20:21:12.196 INFO:tasks.rados.rados.0.trial188.stdout:2222: finishing write tid 2 to trial18843701-15 2026-02-13T20:21:12.196 INFO:tasks.rados.rados.0.trial188.stdout:2222: finishing write tid 3 to trial18843701-15 2026-02-13T20:21:12.196 INFO:tasks.rados.rados.0.trial188.stdout:2222: finishing write tid 4 to trial18843701-15 2026-02-13T20:21:12.196 INFO:tasks.rados.rados.0.trial188.stdout:2222: finishing write tid 5 to trial18843701-15 2026-02-13T20:21:12.196 INFO:tasks.rados.rados.0.trial188.stdout:2222: oid 15 updating version 0 to 772 2026-02-13T20:21:12.196 INFO:tasks.rados.rados.0.trial188.stdout:2222: oid 15 updating version 772 to 774 2026-02-13T20:21:12.196 INFO:tasks.rados.rados.0.trial188.stdout:2222: oid 15 version 774 is already newer than 773 2026-02-13T20:21:12.196 INFO:tasks.rados.rados.0.trial188.stdout:2222: oid 15 version 774 is already newer than 771 2026-02-13T20:21:12.196 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 15 v 774 (ObjNum 786 snap 234 seq_num 786) dirty exists 2026-02-13T20:21:12.196 INFO:tasks.rados.rados.0.trial188.stdout:2222: left oid 15 (ObjNum 786 snap 234 seq_num 786) 2026-02-13T20:21:12.197 INFO:tasks.rados.rados.0.trial188.stdout:2222: done (3 left) 2026-02-13T20:21:12.197 INFO:tasks.rados.rados.0.trial188.stdout:2225: done (2 left) 2026-02-13T20:21:12.197 INFO:tasks.rados.rados.0.trial188.stdout:2226: read oid 12 snap -1 2026-02-13T20:21:12.197 INFO:tasks.rados.rados.0.trial188.stdout:2226: expect (ObjNum 679 snap 194 seq_num 679) 2026-02-13T20:21:12.197 INFO:tasks.rados.rados.0.trial188.stdout:2227: read oid 44 snap -1 2026-02-13T20:21:12.197 INFO:tasks.rados.rados.0.trial188.stdout:2227: expect (ObjNum 766 snap 228 seq_num 766) 2026-02-13T20:21:12.197 INFO:tasks.rados.rados.0.trial188.stdout:2228: snap_create 2026-02-13T20:21:12.199 INFO:tasks.rados.rados.0.trial188.stdout:2223: finishing write tid 1 to trial18843701-33 2026-02-13T20:21:12.207 INFO:tasks.rados.rados.0.trial188.stdout:2223: finishing write tid 2 to trial18843701-33 2026-02-13T20:21:12.207 INFO:tasks.rados.rados.0.trial188.stdout:2226: expect (ObjNum 679 snap 194 seq_num 679) 2026-02-13T20:21:12.207 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:21:12.283 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:21:12.410 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2922844 2026-02-13T20:21:12.424 INFO:tasks.rados.rados.0.trial188.stdout:2224: finishing write tid 1 to trial18843701-22 2026-02-13T20:21:12.424 INFO:tasks.rados.rados.0.trial188.stdout:2223: finishing write tid 3 to trial18843701-33 2026-02-13T20:21:12.425 INFO:tasks.rados.rados.0.trial188.stdout:2223: finishing write tid 4 to trial18843701-33 2026-02-13T20:21:12.425 INFO:tasks.rados.rados.0.trial188.stdout:2223: finishing write tid 5 to trial18843701-33 2026-02-13T20:21:12.425 INFO:tasks.rados.rados.0.trial188.stdout:2223: oid 33 updating version 0 to 716 2026-02-13T20:21:12.425 INFO:tasks.rados.rados.0.trial188.stdout:2223: oid 33 updating version 716 to 717 2026-02-13T20:21:12.425 INFO:tasks.rados.rados.0.trial188.stdout:2223: oid 33 updating version 717 to 719 2026-02-13T20:21:12.425 INFO:tasks.rados.rados.0.trial188.stdout:2223: oid 33 version 719 is already newer than 718 2026-02-13T20:21:12.425 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 33 v 719 (ObjNum 787 snap 234 seq_num 787) dirty exists 2026-02-13T20:21:12.425 INFO:tasks.rados.rados.0.trial188.stdout:2223: left oid 33 (ObjNum 787 snap 234 seq_num 787) 2026-02-13T20:21:12.425 INFO:tasks.rados.rados.0.trial188.stdout:2224: finishing write tid 2 to trial18843701-22 2026-02-13T20:21:12.425 INFO:tasks.rados.rados.0.trial188.stdout:2224: finishing write tid 3 to trial18843701-22 2026-02-13T20:21:12.425 INFO:tasks.rados.rados.0.trial188.stdout:2224: finishing write tid 4 to trial18843701-22 2026-02-13T20:21:12.425 INFO:tasks.rados.rados.0.trial188.stdout:2224: finishing write tid 5 to trial18843701-22 2026-02-13T20:21:12.425 INFO:tasks.rados.rados.0.trial188.stdout:2224: oid 22 updating version 0 to 680 2026-02-13T20:21:12.425 INFO:tasks.rados.rados.0.trial188.stdout:2224: oid 22 version 680 is already newer than 679 2026-02-13T20:21:12.425 INFO:tasks.rados.rados.0.trial188.stdout:2224: oid 22 updating version 680 to 682 2026-02-13T20:21:12.425 INFO:tasks.rados.rados.0.trial188.stdout:2224: oid 22 version 682 is already newer than 681 2026-02-13T20:21:12.425 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 22 v 682 (ObjNum 788 snap 234 seq_num 788) dirty exists 2026-02-13T20:21:12.425 INFO:tasks.rados.rados.0.trial188.stdout:2224: left oid 22 (ObjNum 788 snap 234 seq_num 788) 2026-02-13T20:21:12.425 INFO:tasks.rados.rados.0.trial188.stdout:2227: expect (ObjNum 766 snap 228 seq_num 766) 2026-02-13T20:21:12.444 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:21:13.076 INFO:tasks.rados.rados.0.trial188.stdout:2223: done (4 left) 2026-02-13T20:21:13.076 INFO:tasks.rados.rados.0.trial188.stdout:2224: done (3 left) 2026-02-13T20:21:13.076 INFO:tasks.rados.rados.0.trial188.stdout:2226: done (2 left) 2026-02-13T20:21:13.076 INFO:tasks.rados.rados.0.trial188.stdout:2227: done (1 left) 2026-02-13T20:21:13.076 INFO:tasks.rados.rados.0.trial188.stdout:2228: done (0 left) 2026-02-13T20:21:13.076 INFO:tasks.rados.rados.0.trial188.stdout:2229: rollback oid 28 current snap is 235 2026-02-13T20:21:13.076 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 28 to 234 2026-02-13T20:21:13.076 INFO:tasks.rados.rados.0.trial188.stdout:2230: write oid 48 current snap is 235 2026-02-13T20:21:13.076 INFO:tasks.rados.rados.0.trial188.stdout:2230: seq_num 790 ranges {477530=631069,1612657=409606,2545223=517596} 2026-02-13T20:21:13.080 INFO:tasks.rados.rados.0.trial188.stdout:2230: writing trial18843701-48 from 477530 to 1108599 tid 1 2026-02-13T20:21:13.084 INFO:tasks.rados.rados.0.trial188.stdout:2230: writing trial18843701-48 from 1612657 to 2022263 tid 2 2026-02-13T20:21:13.088 INFO:tasks.rados.rados.0.trial188.stdout:2230: writing trial18843701-48 from 2545223 to 3062819 tid 3 2026-02-13T20:21:13.088 INFO:tasks.rados.rados.0.trial188.stdout:2231: write oid 31 current snap is 235 2026-02-13T20:21:13.088 INFO:tasks.rados.rados.0.trial188.stdout:2231: seq_num 791 ranges {494337=422671,1387492=553264,2688999=445221} 2026-02-13T20:21:13.091 INFO:tasks.rados.rados.0.trial188.stdout:2231: writing trial18843701-31 from 494337 to 917008 tid 1 2026-02-13T20:21:13.095 INFO:tasks.rados.rados.0.trial188.stdout:2231: writing trial18843701-31 from 1387492 to 1940756 tid 2 2026-02-13T20:21:13.099 INFO:tasks.rados.rados.0.trial188.stdout:2231: writing trial18843701-31 from 2688999 to 3134220 tid 3 2026-02-13T20:21:13.099 INFO:tasks.rados.rados.0.trial188.stdout:2232: snap_remove snap 231 2026-02-13T20:21:14.083 INFO:tasks.rados.rados.0.trial188.stdout:2232: done (3 left) 2026-02-13T20:21:14.083 INFO:tasks.rados.rados.0.trial188.stdout:2233: rollback oid 21 current snap is 235 2026-02-13T20:21:14.084 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 21 to 206 2026-02-13T20:21:14.084 INFO:tasks.rados.rados.0.trial188.stdout:2229: finishing rollback tid 0 to trial18843701-28 2026-02-13T20:21:14.084 INFO:tasks.rados.rados.0.trial188.stdout:2229: finishing rollback tid 1 to trial18843701-28 2026-02-13T20:21:14.084 INFO:tasks.rados.rados.0.trial188.stdout:2229: finishing rollback tid 2 to trial18843701-28 2026-02-13T20:21:14.084 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 28 v 925 (ObjNum 729 snap 216 seq_num 729) dirty exists 2026-02-13T20:21:14.084 INFO:tasks.rados.rados.0.trial188.stdout:2230: finishing write tid 1 to trial18843701-48 2026-02-13T20:21:14.084 INFO:tasks.rados.rados.0.trial188.stdout:2231: finishing write tid 1 to trial18843701-31 2026-02-13T20:21:14.084 INFO:tasks.rados.rados.0.trial188.stdout:2230: finishing write tid 2 to trial18843701-48 2026-02-13T20:21:14.084 INFO:tasks.rados.rados.0.trial188.stdout:2230: finishing write tid 3 to trial18843701-48 2026-02-13T20:21:14.084 INFO:tasks.rados.rados.0.trial188.stdout:2231: finishing write tid 2 to trial18843701-31 2026-02-13T20:21:14.084 INFO:tasks.rados.rados.0.trial188.stdout:2231: finishing write tid 3 to trial18843701-31 2026-02-13T20:21:14.084 INFO:tasks.rados.rados.0.trial188.stdout:2230: finishing write tid 4 to trial18843701-48 2026-02-13T20:21:14.084 INFO:tasks.rados.rados.0.trial188.stdout:2231: finishing write tid 4 to trial18843701-31 2026-02-13T20:21:14.084 INFO:tasks.rados.rados.0.trial188.stdout:2230: finishing write tid 5 to trial18843701-48 2026-02-13T20:21:14.084 INFO:tasks.rados.rados.0.trial188.stdout:2230: oid 48 updating version 0 to 490 2026-02-13T20:21:14.084 INFO:tasks.rados.rados.0.trial188.stdout:2230: oid 48 version 490 is already newer than 489 2026-02-13T20:21:14.085 INFO:tasks.rados.rados.0.trial188.stdout:2230: oid 48 updating version 490 to 492 2026-02-13T20:21:14.085 INFO:tasks.rados.rados.0.trial188.stdout:2230: oid 48 version 492 is already newer than 491 2026-02-13T20:21:14.085 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 48 v 492 (ObjNum 790 snap 235 seq_num 790) dirty exists 2026-02-13T20:21:14.085 INFO:tasks.rados.rados.0.trial188.stdout:2230: left oid 48 (ObjNum 790 snap 235 seq_num 790) 2026-02-13T20:21:14.085 INFO:tasks.rados.rados.0.trial188.stdout:2231: finishing write tid 5 to trial18843701-31 2026-02-13T20:21:14.085 INFO:tasks.rados.rados.0.trial188.stdout:2231: oid 31 updating version 0 to 435 2026-02-13T20:21:14.085 INFO:tasks.rados.rados.0.trial188.stdout:2231: oid 31 updating version 435 to 438 2026-02-13T20:21:14.085 INFO:tasks.rados.rados.0.trial188.stdout:2231: oid 31 version 438 is already newer than 436 2026-02-13T20:21:14.085 INFO:tasks.rados.rados.0.trial188.stdout:2231: oid 31 version 438 is already newer than 437 2026-02-13T20:21:14.085 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 31 v 438 (ObjNum 791 snap 235 seq_num 791) dirty exists 2026-02-13T20:21:14.085 INFO:tasks.rados.rados.0.trial188.stdout:2231: left oid 31 (ObjNum 791 snap 235 seq_num 791) 2026-02-13T20:21:14.085 INFO:tasks.rados.rados.0.trial188.stdout:2229: done (3 left) 2026-02-13T20:21:14.085 INFO:tasks.rados.rados.0.trial188.stdout:2230: done (2 left) 2026-02-13T20:21:14.085 INFO:tasks.rados.rados.0.trial188.stdout:2231: done (1 left) 2026-02-13T20:21:14.085 INFO:tasks.rados.rados.0.trial188.stdout:2234: snap_create 2026-02-13T20:21:14.086 INFO:tasks.rados.rados.0.trial188.stdout:2233: finishing rollback tid 0 to trial18843701-21 2026-02-13T20:21:14.086 INFO:tasks.rados.rados.0.trial188.stdout:2233: finishing rollback tid 1 to trial18843701-21 2026-02-13T20:21:14.086 INFO:tasks.rados.rados.0.trial188.stdout:2233: finishing rollback tid 2 to trial18843701-21 2026-02-13T20:21:14.086 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 21 v 495 (ObjNum 708 snap 203 seq_num 708) dirty exists 2026-02-13T20:21:15.085 INFO:tasks.rados.rados.0.trial188.stdout:2233: done (1 left) 2026-02-13T20:21:15.085 INFO:tasks.rados.rados.0.trial188.stdout:2234: done (0 left) 2026-02-13T20:21:15.085 INFO:tasks.rados.rados.0.trial188.stdout:2235: rollback oid 45 current snap is 236 2026-02-13T20:21:15.085 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 45 to 214 2026-02-13T20:21:15.085 INFO:tasks.rados.rados.0.trial188.stdout:2236: delete oid 40 current snap is 236 2026-02-13T20:21:15.087 INFO:tasks.rados.rados.0.trial188.stdout:2236: done (1 left) 2026-02-13T20:21:15.087 INFO:tasks.rados.rados.0.trial188.stdout:2237: write oid 28 current snap is 236 2026-02-13T20:21:15.087 INFO:tasks.rados.rados.0.trial188.stdout:2237: seq_num 793 ranges {527951=573169,1504456=556933,2743845=467765} 2026-02-13T20:21:15.091 INFO:tasks.rados.rados.0.trial188.stdout:2237: writing trial18843701-28 from 527951 to 1101120 tid 1 2026-02-13T20:21:15.094 INFO:tasks.rados.rados.0.trial188.stdout:2237: writing trial18843701-28 from 1504456 to 2061389 tid 2 2026-02-13T20:21:15.099 INFO:tasks.rados.rados.0.trial188.stdout:2237: writing trial18843701-28 from 2743845 to 3211610 tid 3 2026-02-13T20:21:15.099 INFO:tasks.rados.rados.0.trial188.stdout:2238: read oid 35 snap 206 2026-02-13T20:21:15.099 INFO:tasks.rados.rados.0.trial188.stdout:2238: expect (ObjNum 618 snap 163 seq_num 618) 2026-02-13T20:21:15.099 INFO:tasks.rados.rados.0.trial188.stdout:2239: read oid 11 snap -1 2026-02-13T20:21:15.099 INFO:tasks.rados.rados.0.trial188.stdout:2239: expect (ObjNum 618 snap 163 seq_num 618) 2026-02-13T20:21:15.099 INFO:tasks.rados.rados.0.trial188.stdout:2240: read oid 16 snap -1 2026-02-13T20:21:15.099 INFO:tasks.rados.rados.0.trial188.stdout:2240: expect (ObjNum 618 snap 163 seq_num 618) 2026-02-13T20:21:15.099 INFO:tasks.rados.rados.0.trial188.stdout:2241: delete oid 13 current snap is 236 2026-02-13T20:21:15.099 INFO:tasks.rados.rados.0.trial188.stdout:2235: finishing rollback tid 0 to trial18843701-45 2026-02-13T20:21:15.099 INFO:tasks.rados.rados.0.trial188.stdout:2235: finishing rollback tid 1 to trial18843701-45 2026-02-13T20:21:15.099 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 45 v 934 (ObjNum 289 snap 0 seq_num 1) dirty dne 2026-02-13T20:21:15.104 INFO:tasks.rados.rados.0.trial188.stdout:2238: expect (ObjNum 618 snap 163 seq_num 618) 2026-02-13T20:21:15.130 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:21:15.180 INFO:tasks.rados.rados.0.trial188.stdout:2239: expect (ObjNum 618 snap 163 seq_num 618) 2026-02-13T20:21:15.244 INFO:tasks.rados.rados.0.trial188.stdout:2237: finishing write tid 1 to trial18843701-28 2026-02-13T20:21:15.244 INFO:tasks.rados.rados.0.trial188.stdout:2237: finishing write tid 2 to trial18843701-28 2026-02-13T20:21:15.244 INFO:tasks.rados.rados.0.trial188.stdout:2237: finishing write tid 3 to trial18843701-28 2026-02-13T20:21:15.245 INFO:tasks.rados.rados.0.trial188.stdout:2237: finishing write tid 4 to trial18843701-28 2026-02-13T20:21:15.245 INFO:tasks.rados.rados.0.trial188.stdout:2235: done (5 left) 2026-02-13T20:21:15.245 INFO:tasks.rados.rados.0.trial188.stdout:2238: done (4 left) 2026-02-13T20:21:15.245 INFO:tasks.rados.rados.0.trial188.stdout:2239: done (3 left) 2026-02-13T20:21:15.245 INFO:tasks.rados.rados.0.trial188.stdout:2241: done (2 left) 2026-02-13T20:21:15.245 INFO:tasks.rados.rados.0.trial188.stdout:2242: snap_create 2026-02-13T20:21:15.245 INFO:tasks.rados.rados.0.trial188.stdout:2237: finishing write tid 5 to trial18843701-28 2026-02-13T20:21:15.245 INFO:tasks.rados.rados.0.trial188.stdout:2237: oid 28 updating version 0 to 936 2026-02-13T20:21:15.245 INFO:tasks.rados.rados.0.trial188.stdout:2237: oid 28 updating version 936 to 939 2026-02-13T20:21:15.245 INFO:tasks.rados.rados.0.trial188.stdout:2237: oid 28 version 939 is already newer than 937 2026-02-13T20:21:15.245 INFO:tasks.rados.rados.0.trial188.stdout:2237: oid 28 version 939 is already newer than 938 2026-02-13T20:21:15.245 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 28 v 939 (ObjNum 793 snap 236 seq_num 793) dirty exists 2026-02-13T20:21:15.245 INFO:tasks.rados.rados.0.trial188.stdout:2237: left oid 28 (ObjNum 793 snap 236 seq_num 793) 2026-02-13T20:21:15.245 INFO:tasks.rados.rados.0.trial188.stdout:2240: expect (ObjNum 618 snap 163 seq_num 618) 2026-02-13T20:21:15.294 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:21:16.090 INFO:tasks.rados.rados.0.trial188.stdout:2237: done (2 left) 2026-02-13T20:21:16.092 INFO:tasks.rados.rados.0.trial188.stdout:2240: done (1 left) 2026-02-13T20:21:16.092 INFO:tasks.rados.rados.0.trial188.stdout:2242: done (0 left) 2026-02-13T20:21:16.092 INFO:tasks.rados.rados.0.trial188.stdout:2243: read oid 49 snap -1 2026-02-13T20:21:16.092 INFO:tasks.rados.rados.0.trial188.stdout:2243: expect deleted 2026-02-13T20:21:16.092 INFO:tasks.rados.rados.0.trial188.stdout:2244: rollback oid 8 current snap is 237 2026-02-13T20:21:16.092 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 8 to 223 2026-02-13T20:21:16.092 INFO:tasks.rados.rados.0.trial188.stdout:2245: write oid 44 current snap is 237 2026-02-13T20:21:16.092 INFO:tasks.rados.rados.0.trial188.stdout:2245: seq_num 795 ranges {561565=723667,1905067=560602,3082338=279227} 2026-02-13T20:21:16.094 INFO:tasks.rados.rados.0.trial188.stdout:2245: writing trial18843701-44 from 561565 to 1285232 tid 1 2026-02-13T20:21:16.099 INFO:tasks.rados.rados.0.trial188.stdout:2245: writing trial18843701-44 from 1905067 to 2465669 tid 2 2026-02-13T20:21:16.102 INFO:tasks.rados.rados.0.trial188.stdout:2245: writing trial18843701-44 from 3082338 to 3361565 tid 3 2026-02-13T20:21:16.102 INFO:tasks.rados.rados.0.trial188.stdout:2246: delete oid 24 current snap is 237 2026-02-13T20:21:16.103 INFO:tasks.rados.rados.0.trial188.stdout:2244: finishing rollback tid 0 to trial18843701-8 2026-02-13T20:21:16.103 INFO:tasks.rados.rados.0.trial188.stdout:2244: finishing rollback tid 1 to trial18843701-8 2026-02-13T20:21:16.103 INFO:tasks.rados.rados.0.trial188.stdout:2244: finishing rollback tid 2 to trial18843701-8 2026-02-13T20:21:16.103 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 8 v 943 (ObjNum 623 snap 166 seq_num 623) dirty exists 2026-02-13T20:21:16.106 INFO:tasks.rados.rados.0.trial188.stdout:2243: done (3 left) 2026-02-13T20:21:16.106 INFO:tasks.rados.rados.0.trial188.stdout:2244: done (2 left) 2026-02-13T20:21:16.106 INFO:tasks.rados.rados.0.trial188.stdout:2246: done (1 left) 2026-02-13T20:21:16.107 INFO:tasks.rados.rados.0.trial188.stdout:2247: write oid 30 current snap is 237 2026-02-13T20:21:16.107 INFO:tasks.rados.rados.0.trial188.stdout:2247: seq_num 797 ranges {595179=474165,1622031=564271,2737184=629206} 2026-02-13T20:21:16.111 INFO:tasks.rados.rados.0.trial188.stdout:2247: writing trial18843701-30 from 595179 to 1069344 tid 1 2026-02-13T20:21:16.115 INFO:tasks.rados.rados.0.trial188.stdout:2247: writing trial18843701-30 from 1622031 to 2186302 tid 2 2026-02-13T20:21:16.120 INFO:tasks.rados.rados.0.trial188.stdout:2247: writing trial18843701-30 from 2737184 to 3366390 tid 3 2026-02-13T20:21:16.120 INFO:tasks.rados.rados.0.trial188.stdout:2248: read oid 8 snap -1 2026-02-13T20:21:16.120 INFO:tasks.rados.rados.0.trial188.stdout:2248: expect (ObjNum 623 snap 166 seq_num 623) 2026-02-13T20:21:16.120 INFO:tasks.rados.rados.0.trial188.stdout:2249: write oid 34 current snap is 237 2026-02-13T20:21:16.121 INFO:tasks.rados.rados.0.trial188.stdout:2249: seq_num 798 ranges {611986=549414,1564160=424282,2764607=440478} 2026-02-13T20:21:16.124 INFO:tasks.rados.rados.0.trial188.stdout:2249: writing trial18843701-34 from 611986 to 1161400 tid 1 2026-02-13T20:21:16.127 INFO:tasks.rados.rados.0.trial188.stdout:2249: writing trial18843701-34 from 1564160 to 1988442 tid 2 2026-02-13T20:21:16.132 INFO:tasks.rados.rados.0.trial188.stdout:2249: writing trial18843701-34 from 2764607 to 3205085 tid 3 2026-02-13T20:21:16.132 INFO:tasks.rados.rados.0.trial188.stdout:2250: rollback oid 16 current snap is 237 2026-02-13T20:21:16.132 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 16 to 236 2026-02-13T20:21:16.132 INFO:tasks.rados.rados.0.trial188.stdout:2245: finishing write tid 1 to trial18843701-44 2026-02-13T20:21:16.132 INFO:tasks.rados.rados.0.trial188.stdout:2245: finishing write tid 2 to trial18843701-44 2026-02-13T20:21:16.132 INFO:tasks.rados.rados.0.trial188.stdout:2245: finishing write tid 3 to trial18843701-44 2026-02-13T20:21:16.132 INFO:tasks.rados.rados.0.trial188.stdout:2245: finishing write tid 4 to trial18843701-44 2026-02-13T20:21:16.132 INFO:tasks.rados.rados.0.trial188.stdout:2245: finishing write tid 5 to trial18843701-44 2026-02-13T20:21:16.132 INFO:tasks.rados.rados.0.trial188.stdout:2245: oid 44 updating version 0 to 932 2026-02-13T20:21:16.132 INFO:tasks.rados.rados.0.trial188.stdout:2245: oid 44 version 932 is already newer than 930 2026-02-13T20:21:16.132 INFO:tasks.rados.rados.0.trial188.stdout:2245: oid 44 version 932 is already newer than 931 2026-02-13T20:21:16.132 INFO:tasks.rados.rados.0.trial188.stdout:2245: oid 44 updating version 932 to 933 2026-02-13T20:21:16.132 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 44 v 933 (ObjNum 795 snap 237 seq_num 795) dirty exists 2026-02-13T20:21:16.132 INFO:tasks.rados.rados.0.trial188.stdout:2245: left oid 44 (ObjNum 795 snap 237 seq_num 795) 2026-02-13T20:21:16.132 INFO:tasks.rados.rados.0.trial188.stdout:2248: expect (ObjNum 623 snap 166 seq_num 623) 2026-02-13T20:21:16.132 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:21:16.300 INFO:tasks.rados.rados.0.trial188.stdout:2247: finishing write tid 1 to trial18843701-30 2026-02-13T20:21:16.300 INFO:tasks.rados.rados.0.trial188.stdout:2250: finishing rollback tid 0 to trial18843701-16 2026-02-13T20:21:16.300 INFO:tasks.rados.rados.0.trial188.stdout:2247: finishing write tid 2 to trial18843701-30 2026-02-13T20:21:16.300 INFO:tasks.rados.rados.0.trial188.stdout:2250: finishing rollback tid 1 to trial18843701-16 2026-02-13T20:21:16.300 INFO:tasks.rados.rados.0.trial188.stdout:2250: finishing rollback tid 2 to trial18843701-16 2026-02-13T20:21:16.300 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 16 v 993 (ObjNum 618 snap 163 seq_num 618) dirty exists 2026-02-13T20:21:16.300 INFO:tasks.rados.rados.0.trial188.stdout:2249: finishing write tid 1 to trial18843701-34 2026-02-13T20:21:16.301 INFO:tasks.rados.rados.0.trial188.stdout:2249: finishing write tid 2 to trial18843701-34 2026-02-13T20:21:16.301 INFO:tasks.rados.rados.0.trial188.stdout:2245: done (4 left) 2026-02-13T20:21:16.301 INFO:tasks.rados.rados.0.trial188.stdout:2248: done (3 left) 2026-02-13T20:21:16.301 INFO:tasks.rados.rados.0.trial188.stdout:2250: done (2 left) 2026-02-13T20:21:16.301 INFO:tasks.rados.rados.0.trial188.stdout:2251: snap_remove snap 224 2026-02-13T20:21:17.094 INFO:tasks.rados.rados.0.trial188.stdout:2251: done (2 left) 2026-02-13T20:21:17.095 INFO:tasks.rados.rados.0.trial188.stdout:2252: copy_from oid 8 from oid 42 current snap is 237 2026-02-13T20:21:17.095 INFO:tasks.rados.rados.0.trial188.stdout:2249: finishing write tid 3 to trial18843701-34 2026-02-13T20:21:17.095 INFO:tasks.rados.rados.0.trial188.stdout:2247: finishing write tid 3 to trial18843701-30 2026-02-13T20:21:17.095 INFO:tasks.rados.rados.0.trial188.stdout:2247: finishing write tid 4 to trial18843701-30 2026-02-13T20:21:17.095 INFO:tasks.rados.rados.0.trial188.stdout:2249: finishing write tid 4 to trial18843701-34 2026-02-13T20:21:17.095 INFO:tasks.rados.rados.0.trial188.stdout:2249: finishing write tid 5 to trial18843701-34 2026-02-13T20:21:17.095 INFO:tasks.rados.rados.0.trial188.stdout:2249: oid 34 updating version 0 to 947 2026-02-13T20:21:17.095 INFO:tasks.rados.rados.0.trial188.stdout:2249: oid 34 updating version 947 to 948 2026-02-13T20:21:17.095 INFO:tasks.rados.rados.0.trial188.stdout:2249: oid 34 version 948 is already newer than 946 2026-02-13T20:21:17.096 INFO:tasks.rados.rados.0.trial188.stdout:2249: oid 34 version 948 is already newer than 945 2026-02-13T20:21:17.096 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 34 v 948 (ObjNum 798 snap 237 seq_num 798) dirty exists 2026-02-13T20:21:17.096 INFO:tasks.rados.rados.0.trial188.stdout:2249: left oid 34 (ObjNum 798 snap 237 seq_num 798) 2026-02-13T20:21:17.096 INFO:tasks.rados.rados.0.trial188.stdout:2247: finishing write tid 5 to trial18843701-30 2026-02-13T20:21:17.096 INFO:tasks.rados.rados.0.trial188.stdout:2247: oid 30 updating version 0 to 1035 2026-02-13T20:21:17.096 INFO:tasks.rados.rados.0.trial188.stdout:2247: oid 30 updating version 1035 to 1036 2026-02-13T20:21:17.096 INFO:tasks.rados.rados.0.trial188.stdout:2247: oid 30 version 1036 is already newer than 1034 2026-02-13T20:21:17.096 INFO:tasks.rados.rados.0.trial188.stdout:2247: oid 30 updating version 1036 to 1037 2026-02-13T20:21:17.096 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 30 v 1037 (ObjNum 797 snap 237 seq_num 797) dirty exists 2026-02-13T20:21:17.096 INFO:tasks.rados.rados.0.trial188.stdout:2247: left oid 30 (ObjNum 797 snap 237 seq_num 797) 2026-02-13T20:21:17.096 INFO:tasks.rados.rados.0.trial188.stdout:2247: done (2 left) 2026-02-13T20:21:17.096 INFO:tasks.rados.rados.0.trial188.stdout:2249: done (1 left) 2026-02-13T20:21:17.097 INFO:tasks.rados.rados.0.trial188.stdout:2253: snap_create 2026-02-13T20:21:17.135 INFO:tasks.rados.rados.0.trial188.stdout:2252: finishing copy_from racing read to trial18843701-8 2026-02-13T20:21:17.138 INFO:tasks.rados.rados.0.trial188.stdout:2252: finishing copy_from to trial18843701-8 2026-02-13T20:21:17.138 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 8 v 723 (ObjNum 688 snap 199 seq_num 688) dirty exists 2026-02-13T20:21:18.077 INFO:tasks.rados.rados.0.trial188.stdout:2252: done (1 left) 2026-02-13T20:21:18.078 INFO:tasks.rados.rados.0.trial188.stdout:2253: done (0 left) 2026-02-13T20:21:18.078 INFO:tasks.rados.rados.0.trial188.stdout:2254: snap_remove snap 223 2026-02-13T20:21:19.076 INFO:tasks.rados.rados.0.trial188.stdout:2254: done (0 left) 2026-02-13T20:21:19.077 INFO:tasks.rados.rados.0.trial188.stdout:2255: snap_remove snap 225 2026-02-13T20:21:20.078 INFO:tasks.rados.rados.0.trial188.stdout:2255: done (0 left) 2026-02-13T20:21:20.078 INFO:tasks.rados.rados.0.trial188.stdout:2256: write oid 12 current snap is 238 2026-02-13T20:21:20.078 INFO:tasks.rados.rados.0.trial188.stdout:2256: seq_num 799 ranges {628793=741016,2138995=567940,3192030=236763} 2026-02-13T20:21:20.083 INFO:tasks.rados.rados.0.trial188.stdout:2256: writing trial18843701-12 from 628793 to 1369809 tid 1 2026-02-13T20:21:20.088 INFO:tasks.rados.rados.0.trial188.stdout:2256: writing trial18843701-12 from 2138995 to 2706935 tid 2 2026-02-13T20:21:20.091 INFO:tasks.rados.rados.0.trial188.stdout:2256: writing trial18843701-12 from 3192030 to 3428793 tid 3 2026-02-13T20:21:20.091 INFO:tasks.rados.rados.0.trial188.stdout:2257: write (excl) oid 7 current snap is 238 2026-02-13T20:21:20.091 INFO:tasks.rados.rados.0.trial188.stdout:2257: seq_num 800 ranges {645600=416265,1797477=711598,3219453=226147} 2026-02-13T20:21:20.095 INFO:tasks.rados.rados.0.trial188.stdout:2257: writing trial18843701-7 from 645600 to 1061865 tid 1 2026-02-13T20:21:20.100 INFO:tasks.rados.rados.0.trial188.stdout:2257: writing trial18843701-7 from 1797477 to 2509075 tid 2 2026-02-13T20:21:20.104 INFO:tasks.rados.rados.0.trial188.stdout:2257: writing trial18843701-7 from 3219453 to 3445600 tid 3 2026-02-13T20:21:20.104 INFO:tasks.rados.rados.0.trial188.stdout:2258: snap_create 2026-02-13T20:21:20.106 INFO:tasks.rados.rados.0.trial188.stdout:2256: finishing write tid 1 to trial18843701-12 2026-02-13T20:21:20.112 INFO:tasks.rados.rados.0.trial188.stdout:2256: finishing write tid 2 to trial18843701-12 2026-02-13T20:21:20.113 INFO:tasks.rados.rados.0.trial188.stdout:2256: finishing write tid 3 to trial18843701-12 2026-02-13T20:21:20.113 INFO:tasks.rados.rados.0.trial188.stdout:2256: finishing write tid 4 to trial18843701-12 2026-02-13T20:21:20.113 INFO:tasks.rados.rados.0.trial188.stdout:2256: finishing write tid 5 to trial18843701-12 2026-02-13T20:21:20.113 INFO:tasks.rados.rados.0.trial188.stdout:2256: oid 12 updating version 0 to 726 2026-02-13T20:21:20.113 INFO:tasks.rados.rados.0.trial188.stdout:2256: oid 12 updating version 726 to 729 2026-02-13T20:21:20.113 INFO:tasks.rados.rados.0.trial188.stdout:2256: oid 12 version 729 is already newer than 727 2026-02-13T20:21:20.113 INFO:tasks.rados.rados.0.trial188.stdout:2256: oid 12 version 729 is already newer than 728 2026-02-13T20:21:20.113 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 12 v 729 (ObjNum 799 snap 238 seq_num 799) dirty exists 2026-02-13T20:21:20.113 INFO:tasks.rados.rados.0.trial188.stdout:2256: left oid 12 (ObjNum 799 snap 238 seq_num 799) 2026-02-13T20:21:20.121 INFO:tasks.rados.rados.0.trial188.stdout:2257: finishing write tid 1 to trial18843701-7 2026-02-13T20:21:20.125 INFO:tasks.rados.rados.0.trial188.stdout:2257: finishing write tid 2 to trial18843701-7 2026-02-13T20:21:20.125 INFO:tasks.rados.rados.0.trial188.stdout:2257: finishing write tid 3 to trial18843701-7 2026-02-13T20:21:20.125 INFO:tasks.rados.rados.0.trial188.stdout:2257: finishing write tid 4 to trial18843701-7 2026-02-13T20:21:20.126 INFO:tasks.rados.rados.0.trial188.stdout:2257: finishing write tid 5 to trial18843701-7 2026-02-13T20:21:20.126 INFO:tasks.rados.rados.0.trial188.stdout:2257: oid 7 updating version 0 to 878 2026-02-13T20:21:20.126 INFO:tasks.rados.rados.0.trial188.stdout:2257: oid 7 version 878 is already newer than 877 2026-02-13T20:21:20.126 INFO:tasks.rados.rados.0.trial188.stdout:2257: oid 7 version 878 is already newer than 876 2026-02-13T20:21:20.126 INFO:tasks.rados.rados.0.trial188.stdout:2257: oid 7 version 878 is already newer than 875 2026-02-13T20:21:20.126 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 7 v 878 (ObjNum 800 snap 238 seq_num 800) dirty exists 2026-02-13T20:21:20.126 INFO:tasks.rados.rados.0.trial188.stdout:2257: left oid 7 (ObjNum 800 snap 238 seq_num 800) 2026-02-13T20:21:21.083 INFO:tasks.rados.rados.0.trial188.stdout:2256: done (2 left) 2026-02-13T20:21:21.083 INFO:tasks.rados.rados.0.trial188.stdout:2257: done (1 left) 2026-02-13T20:21:21.083 INFO:tasks.rados.rados.0.trial188.stdout:2258: done (0 left) 2026-02-13T20:21:21.083 INFO:tasks.rados.rados.0.trial188.stdout:2259: write (excl) oid 42 current snap is 239 2026-02-13T20:21:21.083 INFO:tasks.rados.rados.0.trial188.stdout:2259: seq_num 801 ranges {662407=491514,1855959=571609,2846876=615531} 2026-02-13T20:21:21.087 INFO:tasks.rados.rados.0.trial188.stdout:2259: writing trial18843701-42 from 662407 to 1153921 tid 1 2026-02-13T20:21:21.091 INFO:tasks.rados.rados.0.trial188.stdout:2259: writing trial18843701-42 from 1855959 to 2427568 tid 2 2026-02-13T20:21:21.095 INFO:tasks.rados.rados.0.trial188.stdout:2259: writing trial18843701-42 from 2846876 to 3462407 tid 3 2026-02-13T20:21:21.096 INFO:tasks.rados.rados.0.trial188.stdout:2260: rollback oid 23 current snap is 239 2026-02-13T20:21:21.096 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 23 to 211 2026-02-13T20:21:21.096 INFO:tasks.rados.rados.0.trial188.stdout:2261: delete oid 37 current snap is 239 2026-02-13T20:21:21.097 INFO:tasks.rados.rados.0.trial188.stdout:2260: finishing rollback tid 1 to trial18843701-23 2026-02-13T20:21:21.097 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 23 v 0 (ObjNum 65 snap 0 seq_num 1) dirty dne 2026-02-13T20:21:21.113 INFO:tasks.rados.rados.0.trial188.stdout:2259: finishing write tid 1 to trial18843701-42 2026-02-13T20:21:21.113 INFO:tasks.rados.rados.0.trial188.stdout:2259: finishing write tid 2 to trial18843701-42 2026-02-13T20:21:21.113 INFO:tasks.rados.rados.0.trial188.stdout:2260: done (2 left) 2026-02-13T20:21:21.113 INFO:tasks.rados.rados.0.trial188.stdout:2261: done (1 left) 2026-02-13T20:21:21.113 INFO:tasks.rados.rados.0.trial188.stdout:2262: read oid 2 snap -1 2026-02-13T20:21:21.114 INFO:tasks.rados.rados.0.trial188.stdout:2262: expect (ObjNum 770 snap 229 seq_num 770) 2026-02-13T20:21:21.114 INFO:tasks.rados.rados.0.trial188.stdout:2263: snap_create 2026-02-13T20:21:21.114 INFO:tasks.rados.rados.0.trial188.stdout:2259: finishing write tid 3 to trial18843701-42 2026-02-13T20:21:21.114 INFO:tasks.rados.rados.0.trial188.stdout:2259: finishing write tid 4 to trial18843701-42 2026-02-13T20:21:21.114 INFO:tasks.rados.rados.0.trial188.stdout:2259: finishing write tid 5 to trial18843701-42 2026-02-13T20:21:21.114 INFO:tasks.rados.rados.0.trial188.stdout:2259: oid 42 updating version 0 to 733 2026-02-13T20:21:21.114 INFO:tasks.rados.rados.0.trial188.stdout:2259: oid 42 version 733 is already newer than 732 2026-02-13T20:21:21.114 INFO:tasks.rados.rados.0.trial188.stdout:2259: oid 42 version 733 is already newer than 731 2026-02-13T20:21:21.114 INFO:tasks.rados.rados.0.trial188.stdout:2259: oid 42 version 733 is already newer than 730 2026-02-13T20:21:21.114 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 42 v 733 (ObjNum 801 snap 239 seq_num 801) dirty exists 2026-02-13T20:21:21.114 INFO:tasks.rados.rados.0.trial188.stdout:2259: left oid 42 (ObjNum 801 snap 239 seq_num 801) 2026-02-13T20:21:21.117 INFO:tasks.rados.rados.0.trial188.stdout:2262: expect (ObjNum 770 snap 229 seq_num 770) 2026-02-13T20:21:21.188 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2704560 2026-02-13T20:21:22.085 INFO:tasks.rados.rados.0.trial188.stdout:2259: done (2 left) 2026-02-13T20:21:22.086 INFO:tasks.rados.rados.0.trial188.stdout:2262: done (1 left) 2026-02-13T20:21:22.086 INFO:tasks.rados.rados.0.trial188.stdout:2263: done (0 left) 2026-02-13T20:21:22.086 INFO:tasks.rados.rados.0.trial188.stdout:2264: read oid 29 snap -1 2026-02-13T20:21:22.086 INFO:tasks.rados.rados.0.trial188.stdout:2264: expect (ObjNum 775 snap 230 seq_num 775) 2026-02-13T20:21:22.086 INFO:tasks.rados.rados.0.trial188.stdout:2265: delete oid 39 current snap is 240 2026-02-13T20:21:22.093 INFO:tasks.rados.rados.0.trial188.stdout:2264: expect (ObjNum 775 snap 230 seq_num 775) 2026-02-13T20:21:22.093 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:21:22.219 INFO:tasks.rados.rados.0.trial188.stdout:2264: done (1 left) 2026-02-13T20:21:22.219 INFO:tasks.rados.rados.0.trial188.stdout:2265: done (0 left) 2026-02-13T20:21:22.219 INFO:tasks.rados.rados.0.trial188.stdout:2266: copy_from oid 14 from oid 41 current snap is 240 2026-02-13T20:21:22.220 INFO:tasks.rados.rados.0.trial188.stdout:2267: rollback oid 13 current snap is 240 2026-02-13T20:21:22.220 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 13 to 238 2026-02-13T20:21:22.220 INFO:tasks.rados.rados.0.trial188.stdout:2268: write oid 12 current snap is 240 2026-02-13T20:21:22.220 INFO:tasks.rados.rados.0.trial188.stdout:2268: seq_num 804 ranges {712828=717261,1915052=718936,3212792=300036} 2026-02-13T20:21:22.225 INFO:tasks.rados.rados.0.trial188.stdout:2268: writing trial18843701-12 from 712828 to 1430089 tid 1 2026-02-13T20:21:22.230 INFO:tasks.rados.rados.0.trial188.stdout:2268: writing trial18843701-12 from 1915052 to 2633988 tid 2 2026-02-13T20:21:22.233 INFO:tasks.rados.rados.0.trial188.stdout:2268: writing trial18843701-12 from 3212792 to 3512828 tid 3 2026-02-13T20:21:22.234 INFO:tasks.rados.rados.0.trial188.stdout:2269: read oid 22 snap -1 2026-02-13T20:21:22.234 INFO:tasks.rados.rados.0.trial188.stdout:2269: expect (ObjNum 788 snap 234 seq_num 788) 2026-02-13T20:21:22.234 INFO:tasks.rados.rados.0.trial188.stdout:2270: copy_from oid 2 from oid 15 current snap is 240 2026-02-13T20:21:22.234 INFO:tasks.rados.rados.0.trial188.stdout:2267: finishing rollback tid 1 to trial18843701-13 2026-02-13T20:21:22.234 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 13 v 928 (ObjNum 289 snap 0 seq_num 0) dirty dne 2026-02-13T20:21:22.234 INFO:tasks.rados.rados.0.trial188.stdout:2267: done (4 left) 2026-02-13T20:21:22.234 INFO:tasks.rados.rados.0.trial188.stdout:2271: snap_remove snap 238 2026-02-13T20:21:23.076 INFO:tasks.rados.rados.0.trial188.stdout:2271: done (4 left) 2026-02-13T20:21:23.077 INFO:tasks.rados.rados.0.trial188.stdout:2272: write oid 35 current snap is 240 2026-02-13T20:21:23.077 INFO:tasks.rados.rados.0.trial188.stdout:2272: seq_num 805 ranges {729635=792510,1973534=578947,3240215=289420} 2026-02-13T20:21:23.083 INFO:tasks.rados.rados.0.trial188.stdout:2272: writing trial18843701-35 from 729635 to 1522145 tid 1 2026-02-13T20:21:23.087 INFO:tasks.rados.rados.0.trial188.stdout:2272: writing trial18843701-35 from 1973534 to 2552481 tid 2 2026-02-13T20:21:23.091 INFO:tasks.rados.rados.0.trial188.stdout:2272: writing trial18843701-35 from 3240215 to 3529635 tid 3 2026-02-13T20:21:23.091 INFO:tasks.rados.rados.0.trial188.stdout:2273: copy_from oid 18 from oid 19 current snap is 240 2026-02-13T20:21:23.091 INFO:tasks.rados.rados.0.trial188.stdout:2269: expect (ObjNum 788 snap 234 seq_num 788) 2026-02-13T20:21:23.217 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2865217 2026-02-13T20:21:23.223 INFO:tasks.rados.rados.0.trial188.stdout:2266: finishing copy_from racing read to trial18843701-14 2026-02-13T20:21:23.223 INFO:tasks.rados.rados.0.trial188.stdout:2268: finishing write tid 1 to trial18843701-12 2026-02-13T20:21:23.223 INFO:tasks.rados.rados.0.trial188.stdout:2268: finishing write tid 2 to trial18843701-12 2026-02-13T20:21:23.223 INFO:tasks.rados.rados.0.trial188.stdout:2268: finishing write tid 3 to trial18843701-12 2026-02-13T20:21:23.223 INFO:tasks.rados.rados.0.trial188.stdout:2268: finishing write tid 4 to trial18843701-12 2026-02-13T20:21:23.223 INFO:tasks.rados.rados.0.trial188.stdout:2268: finishing write tid 5 to trial18843701-12 2026-02-13T20:21:23.223 INFO:tasks.rados.rados.0.trial188.stdout:2268: oid 12 updating version 0 to 730 2026-02-13T20:21:23.223 INFO:tasks.rados.rados.0.trial188.stdout:2268: oid 12 updating version 730 to 733 2026-02-13T20:21:23.223 INFO:tasks.rados.rados.0.trial188.stdout:2268: oid 12 version 733 is already newer than 731 2026-02-13T20:21:23.223 INFO:tasks.rados.rados.0.trial188.stdout:2268: oid 12 version 733 is already newer than 732 2026-02-13T20:21:23.223 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 12 v 733 (ObjNum 804 snap 240 seq_num 804) dirty exists 2026-02-13T20:21:23.223 INFO:tasks.rados.rados.0.trial188.stdout:2268: left oid 12 (ObjNum 804 snap 240 seq_num 804) 2026-02-13T20:21:23.223 INFO:tasks.rados.rados.0.trial188.stdout:2266: finishing copy_from to trial18843701-14 2026-02-13T20:21:23.224 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 14 v 775 (ObjNum 680 snap 194 seq_num 680) dirty exists 2026-02-13T20:21:23.224 INFO:tasks.rados.rados.0.trial188.stdout:2270: finishing copy_from racing read to trial18843701-2 2026-02-13T20:21:23.224 INFO:tasks.rados.rados.0.trial188.stdout:2270: finishing copy_from to trial18843701-2 2026-02-13T20:21:23.224 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 2 v 774 (ObjNum 786 snap 234 seq_num 786) dirty exists 2026-02-13T20:21:23.224 INFO:tasks.rados.rados.0.trial188.stdout:2272: finishing write tid 1 to trial18843701-35 2026-02-13T20:21:23.224 INFO:tasks.rados.rados.0.trial188.stdout:2272: finishing write tid 2 to trial18843701-35 2026-02-13T20:21:23.224 INFO:tasks.rados.rados.0.trial188.stdout:2272: finishing write tid 3 to trial18843701-35 2026-02-13T20:21:23.224 INFO:tasks.rados.rados.0.trial188.stdout:2272: finishing write tid 4 to trial18843701-35 2026-02-13T20:21:23.224 INFO:tasks.rados.rados.0.trial188.stdout:2266: done (5 left) 2026-02-13T20:21:23.224 INFO:tasks.rados.rados.0.trial188.stdout:2268: done (4 left) 2026-02-13T20:21:23.224 INFO:tasks.rados.rados.0.trial188.stdout:2269: done (3 left) 2026-02-13T20:21:23.224 INFO:tasks.rados.rados.0.trial188.stdout:2270: done (2 left) 2026-02-13T20:21:23.224 INFO:tasks.rados.rados.0.trial188.stdout:2274: delete oid 7 current snap is 240 2026-02-13T20:21:23.224 INFO:tasks.rados.rados.0.trial188.stdout:2272: finishing write tid 5 to trial18843701-35 2026-02-13T20:21:23.224 INFO:tasks.rados.rados.0.trial188.stdout:2272: oid 35 updating version 0 to 737 2026-02-13T20:21:23.224 INFO:tasks.rados.rados.0.trial188.stdout:2272: oid 35 version 737 is already newer than 736 2026-02-13T20:21:23.225 INFO:tasks.rados.rados.0.trial188.stdout:2272: oid 35 version 737 is already newer than 735 2026-02-13T20:21:23.225 INFO:tasks.rados.rados.0.trial188.stdout:2272: oid 35 version 737 is already newer than 734 2026-02-13T20:21:23.225 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 35 v 737 (ObjNum 805 snap 240 seq_num 805) dirty exists 2026-02-13T20:21:23.225 INFO:tasks.rados.rados.0.trial188.stdout:2272: left oid 35 (ObjNum 805 snap 240 seq_num 805) 2026-02-13T20:21:23.225 INFO:tasks.rados.rados.0.trial188.stdout:2273: finishing copy_from racing read to trial18843701-18 2026-02-13T20:21:23.225 INFO:tasks.rados.rados.0.trial188.stdout:2273: finishing copy_from to trial18843701-18 2026-02-13T20:21:23.225 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 18 v 820 (ObjNum 688 snap 199 seq_num 688) dirty exists 2026-02-13T20:21:23.226 INFO:tasks.rados.rados.0.trial188.stdout:2272: done (2 left) 2026-02-13T20:21:23.226 INFO:tasks.rados.rados.0.trial188.stdout:2273: done (1 left) 2026-02-13T20:21:23.226 INFO:tasks.rados.rados.0.trial188.stdout:2274: done (0 left) 2026-02-13T20:21:23.226 INFO:tasks.rados.rados.0.trial188.stdout:2275: read oid 4 snap -1 2026-02-13T20:21:23.226 INFO:tasks.rados.rados.0.trial188.stdout:2275: expect deleted 2026-02-13T20:21:23.226 INFO:tasks.rados.rados.0.trial188.stdout:2276: snap_remove snap 235 2026-02-13T20:21:24.093 INFO:tasks.rados.rados.0.trial188.stdout:2276: done (1 left) 2026-02-13T20:21:24.093 INFO:tasks.rados.rados.0.trial188.stdout:2277: write (excl) oid 16 current snap is 240 2026-02-13T20:21:24.093 INFO:tasks.rados.rados.0.trial188.stdout:2277: seq_num 807 ranges {763249=659361,2090498=582616,3295061=268188} 2026-02-13T20:21:24.098 INFO:tasks.rados.rados.0.trial188.stdout:2277: writing trial18843701-16 from 763249 to 1422610 tid 1 2026-02-13T20:21:24.102 INFO:tasks.rados.rados.0.trial188.stdout:2277: writing trial18843701-16 from 2090498 to 2673114 tid 2 2026-02-13T20:21:24.106 INFO:tasks.rados.rados.0.trial188.stdout:2277: writing trial18843701-16 from 3295061 to 3563249 tid 3 2026-02-13T20:21:24.106 INFO:tasks.rados.rados.0.trial188.stdout:2278: read oid 47 snap -1 2026-02-13T20:21:24.106 INFO:tasks.rados.rados.0.trial188.stdout:2278: expect (ObjNum 760 snap 225 seq_num 760) 2026-02-13T20:21:24.106 INFO:tasks.rados.rados.0.trial188.stdout:2279: snap_remove snap 206 2026-02-13T20:21:24.507 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-13T20:21:24.507 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-13T20:21:24.508 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-13T20:21:24.508 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-13T20:21:24.522 INFO:tasks.ceph.mon.a:Started 2026-02-13T20:21:24.523 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-13T20:21:24.523 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T20:21:24.588 INFO:tasks.ceph.mon.a.trial110.stderr:2026-02-13T20:21:24.586+0000 7f9bee683c00 -1 mon.a@-1(???).log v0 log_external_backlog rewinding external_log_to from 335 -> 0 (sync_force? mon rebuild?) 2026-02-13T20:21:24.589 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.588+0000 7eff73247640 10 monclient: get_monmap_and_config 2026-02-13T20:21:24.589 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.588+0000 7eff73247640 10 monclient: build_initial_monmap 2026-02-13T20:21:24.590 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.588+0000 7eff73247640 10 monclient: monmap: 2026-02-13T20:21:24.590 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:21:24.590 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:24.590 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:21:24.589691+0000 2026-02-13T20:21:24.590 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:21:24.589691+0000 2026-02-13T20:21:24.590 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:21:24.590 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:24.590 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:21:24.590 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:21:24.590 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:21:24.590 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:24.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.588+0000 7eff73247640 1 Processor -- start 2026-02-13T20:21:24.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.588+0000 7eff73247640 1 -- start start 2026-02-13T20:21:24.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.588+0000 7eff73247640 10 monclient: init 2026-02-13T20:21:24.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff73247640 10 monclient: _reopen_session rank -1 2026-02-13T20:21:24.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff73247640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:21:24.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff73247640 10 monclient(hunting): picked mon.noname-a con 0x7eff6c1401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:21:24.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff73247640 10 monclient(hunting): picked mon.noname-c con 0x7eff6c092020 addr v1:10.20.193.188:6789/0 2026-02-13T20:21:24.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff73247640 10 monclient(hunting): picked mon.noname-b con 0x7eff6c091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:21:24.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff73247640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff6c08b730 con 0x7eff6c1401c0 2026-02-13T20:21:24.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff73247640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff6c05c5b0 con 0x7eff6c092020 2026-02-13T20:21:24.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff73247640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff6c08bcf0 con 0x7eff6c091950 2026-02-13T20:21:24.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff73247640 10 monclient(hunting): _renew_subs 2026-02-13T20:21:24.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff73247640 10 monclient(hunting): authenticate will time out at 1246.280168s 2026-02-13T20:21:24.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff717bd640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7eff6c091950 0x7eff6c1a2a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:33600/0 (socket says 10.20.193.110:33600) 2026-02-13T20:21:24.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff717bd640 1 -- 10.20.193.110:0/3567635131 learned_addr learned my addr 10.20.193.110:0/3567635131 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:21:24.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff637fe640 1 -- 10.20.193.110:0/3567635131 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3213547474 0 0) 0x7eff6c08bcf0 con 0x7eff6c091950 2026-02-13T20:21:24.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff637fe640 10 monclient(hunting): _negotiate 2026-02-13T20:21:24.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff637fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:24.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff637fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:24.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff637fe640 10 monclient(hunting): my global_id is 94403 2026-02-13T20:21:24.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff637fe640 1 -- 10.20.193.110:0/3567635131 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff580035e0 con 0x7eff6c091950 2026-02-13T20:21:24.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff637fe640 1 -- 10.20.193.110:0/3567635131 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1527187081 0 0) 0x7eff580035e0 con 0x7eff6c091950 2026-02-13T20:21:24.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff637fe640 1 -- 10.20.193.110:0/3567635131 >> v1:10.20.193.188:6789/0 conn(0x7eff6c092020 legacy=0x7eff6c1812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:24.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff637fe640 1 -- 10.20.193.110:0/3567635131 >> v1:10.20.193.110:6789/0 conn(0x7eff6c1401c0 legacy=0x7eff6c091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:24.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff637fe640 10 monclient: _finish_hunting 0 2026-02-13T20:21:24.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff637fe640 1 monclient: found mon.noname-b 2026-02-13T20:21:24.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff637fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:21:24.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff637fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:21:24.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff637fe640 1 -- 10.20.193.110:0/3567635131 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff6c140590 con 0x7eff6c091950 2026-02-13T20:21:24.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff637fe640 10 monclient: _finish_auth 0 2026-02-13T20:21:24.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff637fe640 10 monclient: _check_auth_tickets 2026-02-13T20:21:24.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff637fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:21:24.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff637fe640 1 -- 10.20.193.110:0/3567635131 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7eff68003eb0 con 0x7eff6c091950 2026-02-13T20:21:24.603 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff73247640 5 monclient: authenticate success, global_id 94403 2026-02-13T20:21:24.603 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff73247640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:21:24.603 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff637fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:24.603 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff637fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:21:24.603 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff637fe640 10 monclient: dump: 2026-02-13T20:21:24.603 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:24.603 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:24.603 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:24.603 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:24.603 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:24.603 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:24.603 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:24.604 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:24.604 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:24.604 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:24.604 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff73247640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:21:24.604 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff637fe640 1 -- 10.20.193.110:0/3567635131 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7eff68004080 con 0x7eff6c091950 2026-02-13T20:21:24.604 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff637fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:21:24.604 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff637fe640 1 -- 10.20.193.110:0/3567635131 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7eff68004450 con 0x7eff6c091950 2026-02-13T20:21:24.604 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff73247640 10 monclient: get_monmap_and_config success 2026-02-13T20:21:24.604 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff73247640 4 set_mon_vals no callback set 2026-02-13T20:21:24.604 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff637fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:24.604 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff637fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:21:24.604 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff637fe640 10 monclient: dump: 2026-02-13T20:21:24.605 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:24.605 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:24.605 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:24.605 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:24.605 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:24.605 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:24.605 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:24.605 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:24.605 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:24.605 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:24.605 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff73247640 10 monclient: shutdown 2026-02-13T20:21:24.605 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff73247640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:21:24.605 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff73247640 1 -- 10.20.193.110:0/3567635131 >> v1:10.20.193.110:6790/0 conn(0x7eff6c091950 legacy=0x7eff6c1a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:24.606 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff73247640 1 -- 10.20.193.110:0/3567635131 shutdown_connections 2026-02-13T20:21:24.606 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff73247640 1 -- 10.20.193.110:0/3567635131 >> 10.20.193.110:0/3567635131 conn(0x7eff6c054e90 msgr2=0x7eff6c058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:21:24.606 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff73247640 1 -- 10.20.193.110:0/3567635131 shutdown_connections 2026-02-13T20:21:24.606 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.589+0000 7eff73247640 1 -- 10.20.193.110:0/3567635131 wait complete. 2026-02-13T20:21:24.606 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.590+0000 7eff73247640 10 monclient: build_initial_monmap 2026-02-13T20:21:24.606 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.590+0000 7eff73247640 10 monclient: monmap: 2026-02-13T20:21:24.606 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:21:24.606 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:21:24.606 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:21:24.606 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:21:24.606 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:21:24.607 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:21:24.607 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:21:24.607 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:21:24.607 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:21:24.607 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:24.607 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.590+0000 7eff73247640 1 Processor -- start 2026-02-13T20:21:24.607 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.590+0000 7eff73247640 1 -- start start 2026-02-13T20:21:24.607 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.590+0000 7eff73247640 10 monclient: init 2026-02-13T20:21:24.607 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.590+0000 7eff73247640 10 monclient: _reopen_session rank -1 2026-02-13T20:21:24.607 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.590+0000 7eff73247640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:21:24.607 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.590+0000 7eff73247640 10 monclient(hunting): picked mon.noname-c con 0x7eff6c091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:21:24.607 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.590+0000 7eff73247640 10 monclient(hunting): picked mon.noname-a con 0x7eff6c1401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:21:24.608 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.590+0000 7eff73247640 10 monclient(hunting): picked mon.noname-b con 0x7eff6c12ad20 addr v1:10.20.193.188:6789/0 2026-02-13T20:21:24.608 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.590+0000 7eff73247640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff6c08c4a0 con 0x7eff6c1401c0 2026-02-13T20:21:24.608 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.590+0000 7eff73247640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff6c12c520 con 0x7eff6c12ad20 2026-02-13T20:21:24.608 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.590+0000 7eff73247640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff6c114130 con 0x7eff6c091950 2026-02-13T20:21:24.608 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.590+0000 7eff73247640 10 monclient(hunting): _renew_subs 2026-02-13T20:21:24.608 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.590+0000 7eff73247640 10 monclient(hunting): authenticate will time out at 1246.281979s 2026-02-13T20:21:24.608 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.591+0000 7eff70fbc640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7eff6c091950 0x7eff6c113310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:33610/0 (socket says 10.20.193.110:33610) 2026-02-13T20:21:24.608 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.591+0000 7eff70fbc640 1 -- 10.20.193.110:0/2838793073 learned_addr learned my addr 10.20.193.110:0/2838793073 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:21:24.608 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.591+0000 7eff617fa640 1 -- 10.20.193.110:0/2838793073 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2861255512 0 0) 0x7eff6c114130 con 0x7eff6c091950 2026-02-13T20:21:24.608 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.591+0000 7eff617fa640 10 monclient(hunting): _negotiate 2026-02-13T20:21:24.608 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.591+0000 7eff617fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:24.608 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.591+0000 7eff617fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:24.609 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.591+0000 7eff617fa640 10 monclient(hunting): my global_id is 94406 2026-02-13T20:21:24.609 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.591+0000 7eff617fa640 1 -- 10.20.193.110:0/2838793073 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff3c0035e0 con 0x7eff6c091950 2026-02-13T20:21:24.609 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.591+0000 7eff617fa640 1 -- 10.20.193.110:0/2838793073 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 961740988 0 0) 0x7eff3c0035e0 con 0x7eff6c091950 2026-02-13T20:21:24.609 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.591+0000 7eff617fa640 1 -- 10.20.193.110:0/2838793073 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7eff6c114130 con 0x7eff6c091950 2026-02-13T20:21:24.609 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.591+0000 7eff617fa640 1 -- 10.20.193.110:0/2838793073 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7eff5c0030e0 con 0x7eff6c091950 2026-02-13T20:21:24.609 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.591+0000 7eff617fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:21:24.609 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.591+0000 7eff617fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:21:24.609 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.591+0000 7eff617fa640 10 monclient(hunting): dump: 2026-02-13T20:21:24.609 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:24.609 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:24.609 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:24.609 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:24.609 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:24.610 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:24.610 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:24.610 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:24.610 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:24.610 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:24.610 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.591+0000 7eff617fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:21:24.610 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.591+0000 7eff617fa640 1 -- 10.20.193.110:0/2838793073 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3816496544 0 0) 0x7eff6c114130 con 0x7eff6c091950 2026-02-13T20:21:24.610 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.591+0000 7eff617fa640 1 -- 10.20.193.110:0/2838793073 >> v1:10.20.193.188:6789/0 conn(0x7eff6c12ad20 legacy=0x7eff6c1a2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:24.610 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.591+0000 7eff617fa640 1 -- 10.20.193.110:0/2838793073 >> v1:10.20.193.110:6789/0 conn(0x7eff6c1401c0 legacy=0x7eff6c113a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:24.610 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.591+0000 7eff617fa640 10 monclient: _finish_hunting 0 2026-02-13T20:21:24.610 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.591+0000 7eff617fa640 1 monclient: found mon.c 2026-02-13T20:21:24.610 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.591+0000 7eff617fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:21:24.611 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.591+0000 7eff617fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:21:24.611 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.591+0000 7eff617fa640 1 -- 10.20.193.110:0/2838793073 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff6c05d320 con 0x7eff6c091950 2026-02-13T20:21:24.611 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.591+0000 7eff617fa640 10 monclient: _finish_auth 0 2026-02-13T20:21:24.611 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.591+0000 7eff617fa640 10 monclient: _check_auth_tickets 2026-02-13T20:21:24.611 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.591+0000 7eff617fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:21:24.611 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.591+0000 7eff73247640 5 monclient: authenticate success, global_id 94406 2026-02-13T20:21:24.611 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.591+0000 7eff73247640 10 monclient: _renew_subs 2026-02-13T20:21:24.611 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.591+0000 7eff73247640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:21:24.611 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.591+0000 7eff73247640 1 -- 10.20.193.110:0/2838793073 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7eff6c123ba0 con 0x7eff6c091950 2026-02-13T20:21:24.611 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.591+0000 7eff73247640 10 monclient: _renew_subs 2026-02-13T20:21:24.611 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.591+0000 7eff73247640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:21:24.611 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.591+0000 7eff73247640 1 -- 10.20.193.110:0/2838793073 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7eff6c12bf60 con 0x7eff6c091950 2026-02-13T20:21:24.612 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.591+0000 7eff617fa640 1 -- 10.20.193.110:0/2838793073 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7eff5c003450 con 0x7eff6c091950 2026-02-13T20:21:24.612 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.591+0000 7eff617fa640 10 monclient: handle_config config(0 keys) 2026-02-13T20:21:24.612 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.591+0000 7eff617fa640 1 -- 10.20.193.110:0/2838793073 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7eff5c003b70 con 0x7eff6c091950 2026-02-13T20:21:24.612 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.591+0000 7eff617fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:24.612 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.591+0000 7eff617fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:21:24.612 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.591+0000 7eff617fa640 10 monclient: dump: 2026-02-13T20:21:24.612 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:24.612 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:24.612 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:24.612 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:24.612 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:24.612 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:24.612 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:24.613 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:24.613 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:24.613 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:24.613 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.591+0000 7eff62ffd640 4 set_mon_vals no callback set 2026-02-13T20:21:24.613 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.592+0000 7eff73247640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:21:24.613 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.592+0000 7eff73247640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:21:24.613 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.592+0000 7eff73247640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:21:24.613 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.592+0000 7eff73247640 1 -- 10.20.193.110:0/2838793073 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff6c0008d0 con 0x7eff6c091950 2026-02-13T20:21:24.613 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.592+0000 7eff617fa640 1 -- 10.20.193.110:0/2838793073 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7eff5c003cd0 con 0x7eff6c091950 2026-02-13T20:21:24.613 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.592+0000 7eff617fa640 1 -- 10.20.193.110:0/2838793073 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(488..488 src has 1..488) ==== 3975+0+0 (unknown 3700913173 0 0) 0x7eff5c04e930 con 0x7eff6c091950 2026-02-13T20:21:24.613 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.592+0000 7eff63fff640 10 monclient: get_auth_request con 0x7eff3c03f6f0 auth_method 0 2026-02-13T20:21:24.613 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.594+0000 7eff617fa640 1 -- 10.20.193.110:0/2838793073 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7eff5c003fb0 con 0x7eff6c091950 2026-02-13T20:21:24.613 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.594+0000 7eff617fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:21:24.614 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.594+0000 7eff617fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:21:24.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.740+0000 7eff73247640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T20:21:24.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.740+0000 7eff73247640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T20:21:24.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.740+0000 7eff73247640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:21:24.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.740+0000 7eff73247640 1 -- 10.20.193.110:0/2838793073 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7eff6c058410 con 0x7eff6c091950 2026-02-13T20:21:24.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.740+0000 7eff617fa640 1 -- 10.20.193.110:0/2838793073 <== mon.2 v1:10.20.193.110:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 200798972) 0x7eff5c016850 con 0x7eff6c091950 2026-02-13T20:21:24.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.740+0000 7eff617fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T20:21:24.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.740+0000 7eff617fa640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:21:24.742 INFO:teuthology.orchestra.run.trial110.stdout:{"election_epoch":38,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","modified":"2026-02-13T20:11:07.161192Z","created":"2026-02-13T20:11:07.161192Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6789","nonce":0}]},"addr":"10.20.193.110:6789/0","public_addr":"10.20.193.110:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161241+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6789","nonce":0}]},"addr":"10.20.193.188:6789/0","public_addr":"10.20.193.188:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161242+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6790","nonce":0}]},"addr":"10.20.193.110:6790/0","public_addr":"10.20.193.110:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161243+0000","crush_location":[]}]}} 2026-02-13T20:21:24.743 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.742+0000 7eff73247640 1 -- 10.20.193.110:0/2838793073 >> v1:10.20.193.188:6812/1623052694 conn(0x7eff3c03f6f0 legacy=0x7eff3c05fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:24.743 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.742+0000 7eff73247640 10 monclient: shutdown 2026-02-13T20:21:24.743 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.742+0000 7eff73247640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:21:24.743 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.742+0000 7eff73247640 1 -- 10.20.193.110:0/2838793073 >> v1:10.20.193.110:6790/0 conn(0x7eff6c091950 legacy=0x7eff6c113310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:24.743 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.742+0000 7eff73247640 1 -- 10.20.193.110:0/2838793073 shutdown_connections 2026-02-13T20:21:24.743 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.742+0000 7eff73247640 1 -- 10.20.193.110:0/2838793073 >> 10.20.193.110:0/2838793073 conn(0x7eff6c054e90 msgr2=0x7eff6c08de60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:21:24.743 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.742+0000 7eff73247640 1 -- 10.20.193.110:0/2838793073 shutdown_connections 2026-02-13T20:21:24.743 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.742+0000 7eff73247640 1 -- 10.20.193.110:0/2838793073 wait complete. 2026-02-13T20:21:24.751 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-13T20:21:24.751 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-13T20:21:24.751 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T20:21:24.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.816+0000 7f161354c640 10 monclient: get_monmap_and_config 2026-02-13T20:21:24.829 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.816+0000 7f161354c640 10 monclient: build_initial_monmap 2026-02-13T20:21:24.829 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.816+0000 7f161354c640 10 monclient: monmap: 2026-02-13T20:21:24.829 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:21:24.829 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:24.829 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:21:24.817945+0000 2026-02-13T20:21:24.829 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:21:24.817945+0000 2026-02-13T20:21:24.829 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:21:24.829 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:24.829 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:21:24.829 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:21:24.830 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:21:24.830 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:24.830 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.816+0000 7f161354c640 1 Processor -- start 2026-02-13T20:21:24.830 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.816+0000 7f161354c640 1 -- start start 2026-02-13T20:21:24.830 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.816+0000 7f161354c640 10 monclient: init 2026-02-13T20:21:24.830 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.817+0000 7f161354c640 10 monclient: _reopen_session rank -1 2026-02-13T20:21:24.830 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.817+0000 7f161354c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:21:24.830 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.817+0000 7f161354c640 10 monclient(hunting): picked mon.noname-a con 0x7f160c1401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:21:24.830 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.817+0000 7f161354c640 10 monclient(hunting): picked mon.noname-c con 0x7f160c092020 addr v1:10.20.193.188:6789/0 2026-02-13T20:21:24.830 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.817+0000 7f161354c640 10 monclient(hunting): picked mon.noname-b con 0x7f160c091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:21:24.830 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.817+0000 7f161354c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f160c08b730 con 0x7f160c1401c0 2026-02-13T20:21:24.831 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.817+0000 7f161354c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f160c05c5b0 con 0x7f160c092020 2026-02-13T20:21:24.831 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.817+0000 7f161354c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f160c08bcf0 con 0x7f160c091950 2026-02-13T20:21:24.831 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.817+0000 7f161354c640 10 monclient(hunting): _renew_subs 2026-02-13T20:21:24.831 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.817+0000 7f161354c640 10 monclient(hunting): authenticate will time out at 1246.508273s 2026-02-13T20:21:24.831 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.817+0000 7f16112c1640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f160c1401c0 0x7f160c091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:43878/0 (socket says 10.20.193.110:43878) 2026-02-13T20:21:24.831 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.817+0000 7f16112c1640 1 -- 10.20.193.110:0/3567320291 learned_addr learned my addr 10.20.193.110:0/3567320291 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:21:24.831 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.817+0000 7f15fbfff640 1 -- 10.20.193.110:0/3567320291 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3336404618 0 0) 0x7f160c08bcf0 con 0x7f160c091950 2026-02-13T20:21:24.831 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.817+0000 7f15fbfff640 10 monclient(hunting): _negotiate 2026-02-13T20:21:24.831 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.817+0000 7f15fbfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:24.831 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.817+0000 7f15fbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:24.831 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.817+0000 7f15fbfff640 10 monclient(hunting): my global_id is 94409 2026-02-13T20:21:24.831 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.817+0000 7f15fbfff640 1 -- 10.20.193.110:0/3567320291 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15f40035e0 con 0x7f160c091950 2026-02-13T20:21:24.832 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.817+0000 7f15fbfff640 1 -- 10.20.193.110:0/3567320291 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3106729050 0 0) 0x7f15f40035e0 con 0x7f160c091950 2026-02-13T20:21:24.832 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.817+0000 7f15fbfff640 1 -- 10.20.193.110:0/3567320291 >> v1:10.20.193.188:6789/0 conn(0x7f160c092020 legacy=0x7f160c1812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:24.832 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.817+0000 7f15fbfff640 1 -- 10.20.193.110:0/3567320291 >> v1:10.20.193.110:6789/0 conn(0x7f160c1401c0 legacy=0x7f160c091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:24.832 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.817+0000 7f15fbfff640 10 monclient: _finish_hunting 0 2026-02-13T20:21:24.832 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.817+0000 7f15fbfff640 1 monclient: found mon.noname-b 2026-02-13T20:21:24.832 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.817+0000 7f15fbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:21:24.832 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.817+0000 7f15fbfff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:21:24.832 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.817+0000 7f15fbfff640 1 -- 10.20.193.110:0/3567320291 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f160c140590 con 0x7f160c091950 2026-02-13T20:21:24.832 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.817+0000 7f15fbfff640 10 monclient: _finish_auth 0 2026-02-13T20:21:24.832 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.817+0000 7f15fbfff640 10 monclient: _check_auth_tickets 2026-02-13T20:21:24.832 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.817+0000 7f15fbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:21:24.832 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.817+0000 7f15fbfff640 1 -- 10.20.193.110:0/3567320291 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f1608003eb0 con 0x7f160c091950 2026-02-13T20:21:24.833 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.817+0000 7f161354c640 5 monclient: authenticate success, global_id 94409 2026-02-13T20:21:24.833 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.817+0000 7f161354c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:21:24.833 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.817+0000 7f15fbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:24.833 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.817+0000 7f15fbfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:21:24.833 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.817+0000 7f15fbfff640 10 monclient: dump: 2026-02-13T20:21:24.833 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:24.833 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:24.833 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:24.833 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:24.833 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:24.833 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:24.833 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:24.834 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:24.834 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:24.834 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:24.834 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.817+0000 7f161354c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:21:24.834 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.817+0000 7f15fbfff640 1 -- 10.20.193.110:0/3567320291 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1608004100 con 0x7f160c091950 2026-02-13T20:21:24.834 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.817+0000 7f15fbfff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:21:24.834 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.817+0000 7f161354c640 10 monclient: get_monmap_and_config success 2026-02-13T20:21:24.834 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.817+0000 7f161354c640 4 set_mon_vals no callback set 2026-02-13T20:21:24.834 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.817+0000 7f15fbfff640 1 -- 10.20.193.110:0/3567320291 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f1608004510 con 0x7f160c091950 2026-02-13T20:21:24.834 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.817+0000 7f15fbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:24.834 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.817+0000 7f15fbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:21:24.834 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.817+0000 7f15fbfff640 10 monclient: dump: 2026-02-13T20:21:24.835 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:24.835 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:24.835 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:24.835 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:24.835 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:24.835 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:24.835 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:24.835 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:24.835 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:24.835 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:24.835 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.818+0000 7f161354c640 10 monclient: shutdown 2026-02-13T20:21:24.835 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.818+0000 7f161354c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:21:24.835 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.818+0000 7f161354c640 1 -- 10.20.193.110:0/3567320291 >> v1:10.20.193.110:6790/0 conn(0x7f160c091950 legacy=0x7f160c1a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:24.836 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.818+0000 7f161354c640 1 -- 10.20.193.110:0/3567320291 shutdown_connections 2026-02-13T20:21:24.836 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.818+0000 7f161354c640 1 -- 10.20.193.110:0/3567320291 >> 10.20.193.110:0/3567320291 conn(0x7f160c054e90 msgr2=0x7f160c058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:21:24.836 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.818+0000 7f161354c640 1 -- 10.20.193.110:0/3567320291 shutdown_connections 2026-02-13T20:21:24.836 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.818+0000 7f161354c640 1 -- 10.20.193.110:0/3567320291 wait complete. 2026-02-13T20:21:24.836 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.818+0000 7f161354c640 10 monclient: build_initial_monmap 2026-02-13T20:21:24.836 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.818+0000 7f161354c640 10 monclient: monmap: 2026-02-13T20:21:24.836 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:21:24.836 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:21:24.836 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:21:24.836 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:21:24.836 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:21:24.836 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:21:24.837 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:21:24.837 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:21:24.837 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:21:24.837 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:24.837 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.818+0000 7f161354c640 1 Processor -- start 2026-02-13T20:21:24.837 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.818+0000 7f161354c640 1 -- start start 2026-02-13T20:21:24.837 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.818+0000 7f161354c640 10 monclient: init 2026-02-13T20:21:24.837 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.819+0000 7f161354c640 10 monclient: _reopen_session rank -1 2026-02-13T20:21:24.837 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.819+0000 7f161354c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:21:24.837 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.819+0000 7f161354c640 10 monclient(hunting): picked mon.noname-b con 0x7f160c091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:21:24.837 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.819+0000 7f161354c640 10 monclient(hunting): picked mon.noname-c con 0x7f160c1401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:21:24.837 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.819+0000 7f161354c640 10 monclient(hunting): picked mon.noname-a con 0x7f160c130df0 addr v1:10.20.193.110:6789/0 2026-02-13T20:21:24.838 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.819+0000 7f161354c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f160c12fd20 con 0x7f160c130df0 2026-02-13T20:21:24.838 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.819+0000 7f161354c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f160c13f2e0 con 0x7f160c091950 2026-02-13T20:21:24.838 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.819+0000 7f161354c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f160c05d320 con 0x7f160c1401c0 2026-02-13T20:21:24.838 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.819+0000 7f161354c640 10 monclient(hunting): _renew_subs 2026-02-13T20:21:24.838 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.819+0000 7f161354c640 10 monclient(hunting): authenticate will time out at 1246.510185s 2026-02-13T20:21:24.838 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.819+0000 7f1610ac0640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f160c1401c0 0x7f160c193bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:33636/0 (socket says 10.20.193.110:33636) 2026-02-13T20:21:24.838 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.819+0000 7f1610ac0640 1 -- 10.20.193.110:0/1689362740 learned_addr learned my addr 10.20.193.110:0/1689362740 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:21:24.838 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.819+0000 7f15f9ffb640 1 -- 10.20.193.110:0/1689362740 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 10634190 0 0) 0x7f160c140590 con 0x7f160c130df0 2026-02-13T20:21:24.838 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.819+0000 7f15f9ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:21:24.838 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.819+0000 7f15f9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:24.838 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.819+0000 7f15f9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:24.838 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.819+0000 7f15f9ffb640 10 monclient(hunting): my global_id is 124098 2026-02-13T20:21:24.839 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.819+0000 7f15f9ffb640 1 -- 10.20.193.110:0/1689362740 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15dc0035e0 con 0x7f160c130df0 2026-02-13T20:21:24.839 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.819+0000 7f15f9ffb640 1 -- 10.20.193.110:0/1689362740 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3914822772 0 0) 0x7f160c05d320 con 0x7f160c1401c0 2026-02-13T20:21:24.839 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.819+0000 7f15f9ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:21:24.839 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.819+0000 7f15f9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:24.839 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.819+0000 7f15f9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:24.839 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.819+0000 7f15f9ffb640 10 monclient(hunting): my global_id is 94412 2026-02-13T20:21:24.839 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.819+0000 7f15f9ffb640 1 -- 10.20.193.110:0/1689362740 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f160c140590 con 0x7f160c1401c0 2026-02-13T20:21:24.839 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.820+0000 7f15f9ffb640 1 -- 10.20.193.110:0/1689362740 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3827544172 0 0) 0x7f15dc0035e0 con 0x7f160c130df0 2026-02-13T20:21:24.839 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.820+0000 7f15f9ffb640 1 -- 10.20.193.110:0/1689362740 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f160c05d320 con 0x7f160c130df0 2026-02-13T20:21:24.839 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.820+0000 7f15f9ffb640 1 -- 10.20.193.110:0/1689362740 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f1608004420 con 0x7f160c130df0 2026-02-13T20:21:24.839 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.820+0000 7f15f9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:21:24.839 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.820+0000 7f15f9ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:21:24.840 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.820+0000 7f15f9ffb640 10 monclient(hunting): dump: 2026-02-13T20:21:24.840 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:24.840 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:24.840 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:24.840 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:24.840 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:24.840 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:24.840 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:24.840 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:24.840 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:24.840 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:24.840 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.820+0000 7f15f9ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:21:24.840 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.820+0000 7f15f9ffb640 1 -- 10.20.193.110:0/1689362740 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 161266661 0 0) 0x7f160c140590 con 0x7f160c1401c0 2026-02-13T20:21:24.841 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.820+0000 7f15f9ffb640 1 -- 10.20.193.110:0/1689362740 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f15dc0035e0 con 0x7f160c1401c0 2026-02-13T20:21:24.841 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.820+0000 7f15f9ffb640 1 -- 10.20.193.110:0/1689362740 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f1600003170 con 0x7f160c1401c0 2026-02-13T20:21:24.841 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.820+0000 7f15f9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:21:24.841 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.820+0000 7f15f9ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:21:24.841 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.820+0000 7f15f9ffb640 10 monclient(hunting): dump: 2026-02-13T20:21:24.841 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:24.841 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:24.841 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:24.841 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:24.841 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:24.841 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:24.841 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:24.842 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:24.842 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:24.842 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:24.842 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.820+0000 7f15f9ffb640 1 -- 10.20.193.110:0/1689362740 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 582128860 0 0) 0x7f160c05d320 con 0x7f160c130df0 2026-02-13T20:21:24.842 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.820+0000 7f15f9ffb640 1 -- 10.20.193.110:0/1689362740 >> v1:10.20.193.110:6790/0 conn(0x7f160c1401c0 legacy=0x7f160c193bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:24.842 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.820+0000 7f15f9ffb640 1 -- 10.20.193.110:0/1689362740 >> v1:10.20.193.188:6789/0 conn(0x7f160c091950 legacy=0x7f160c13ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:24.842 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.820+0000 7f15f9ffb640 10 monclient: _finish_hunting 0 2026-02-13T20:21:24.842 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.820+0000 7f15f9ffb640 1 monclient: found mon.a 2026-02-13T20:21:24.842 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.820+0000 7f15f9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:21:24.842 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.820+0000 7f15f9ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:21:24.842 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.820+0000 7f15f9ffb640 1 -- 10.20.193.110:0/1689362740 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f160c131780 con 0x7f160c130df0 2026-02-13T20:21:24.842 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.820+0000 7f15f9ffb640 10 monclient: _finish_auth 0 2026-02-13T20:21:24.843 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.820+0000 7f15f9ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:21:24.843 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.820+0000 7f15f9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:21:24.843 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.820+0000 7f161354c640 5 monclient: authenticate success, global_id 124098 2026-02-13T20:21:24.843 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.820+0000 7f161354c640 10 monclient: _renew_subs 2026-02-13T20:21:24.843 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.820+0000 7f161354c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:21:24.843 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.820+0000 7f161354c640 1 -- 10.20.193.110:0/1689362740 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f160c130290 con 0x7f160c130df0 2026-02-13T20:21:24.843 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.820+0000 7f161354c640 10 monclient: _renew_subs 2026-02-13T20:21:24.843 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.820+0000 7f161354c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:21:24.843 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.820+0000 7f161354c640 1 -- 10.20.193.110:0/1689362740 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f160c14f7b0 con 0x7f160c130df0 2026-02-13T20:21:24.843 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.820+0000 7f15f9ffb640 1 -- 10.20.193.110:0/1689362740 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1608003960 con 0x7f160c130df0 2026-02-13T20:21:24.843 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.820+0000 7f15f9ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T20:21:24.843 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.820+0000 7f15f9ffb640 1 -- 10.20.193.110:0/1689362740 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f1608004cb0 con 0x7f160c130df0 2026-02-13T20:21:24.844 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.820+0000 7f15f9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:24.844 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.820+0000 7f15f9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:21:24.844 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.820+0000 7f15f9ffb640 10 monclient: dump: 2026-02-13T20:21:24.844 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:24.844 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:24.844 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:24.844 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:24.844 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:24.844 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:24.844 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:24.844 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:24.844 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:24.844 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:24.845 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.820+0000 7f15fb7fe640 4 set_mon_vals no callback set 2026-02-13T20:21:24.845 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.820+0000 7f161354c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:21:24.845 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.820+0000 7f161354c640 1 -- 10.20.193.110:0/1689362740 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f160c0008d0 con 0x7f160c092020 2026-02-13T20:21:24.845 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.820+0000 7f15f9ffb640 1 -- 10.20.193.110:0/1689362740 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f1608011920 con 0x7f160c130df0 2026-02-13T20:21:24.845 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.820+0000 7f15f9ffb640 1 -- 10.20.193.110:0/1689362740 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(488..488 src has 1..488) ==== 3975+0+0 (unknown 3700913173 0 0) 0x7f160804e630 con 0x7f160c130df0 2026-02-13T20:21:24.845 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.820+0000 7f15f9ffb640 1 -- 10.20.193.110:0/1689362740 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4035524603 0 0) 0x7f160c0008d0 con 0x7f160c092020 2026-02-13T20:21:24.845 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.820+0000 7f15f9ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:21:24.845 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.820+0000 7f15f9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:24.845 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.820+0000 7f15f9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:24.845 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.820+0000 7f15f9ffb640 10 monclient(hunting): my global_id is 124101 2026-02-13T20:21:24.845 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.820+0000 7f15f9ffb640 1 -- 10.20.193.110:0/1689362740 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f160c05d320 con 0x7f160c092020 2026-02-13T20:21:24.845 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.820+0000 7f1610ac0640 10 monclient: get_auth_request con 0x7f15dc03faa0 auth_method 0 2026-02-13T20:21:24.846 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.821+0000 7f15f9ffb640 1 -- 10.20.193.110:0/1689362740 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1943884623 0 0) 0x7f160c05d320 con 0x7f160c092020 2026-02-13T20:21:24.846 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.821+0000 7f15f9ffb640 1 -- 10.20.193.110:0/1689362740 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f160c0008d0 con 0x7f160c092020 2026-02-13T20:21:24.846 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.821+0000 7f15f9ffb640 1 -- 10.20.193.110:0/1689362740 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f15fc002e40 con 0x7f160c092020 2026-02-13T20:21:24.846 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.821+0000 7f15f9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:24.846 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.821+0000 7f15f9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:21:24.846 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.821+0000 7f15f9ffb640 10 monclient: dump: 2026-02-13T20:21:24.846 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:24.846 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:24.846 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:24.846 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:24.846 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:24.846 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:24.847 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:24.847 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:24.847 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:24.847 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:24.847 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.821+0000 7f15f9ffb640 1 -- 10.20.193.110:0/1689362740 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2358108703 0 0) 0x7f160c0008d0 con 0x7f160c092020 2026-02-13T20:21:24.847 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.821+0000 7f15f9ffb640 1 -- 10.20.193.110:0/1689362740 --> v1:10.20.193.110:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f160c131d50 con 0x7f160c092020 2026-02-13T20:21:24.847 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.821+0000 7f15f9ffb640 1 -- 10.20.193.110:0/1689362740 <== mon.0 v1:10.20.193.110:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f15fc003340 con 0x7f160c092020 2026-02-13T20:21:24.847 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.821+0000 7f15f9ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:21:24.847 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.821+0000 7f15f9ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:21:24.847 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.821+0000 7f15f9ffb640 1 -- 10.20.193.110:0/1689362740 >> v1:10.20.193.110:6789/0 conn(0x7f160c092020 legacy=0x7f160c08ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:24.847 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.821+0000 7f15f9ffb640 1 -- 10.20.193.110:0/1689362740 >> v1:10.20.193.110:6789/0 conn(0x7f160c092020 legacy=0x7f160c08ef60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:21:24.847 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.824+0000 7f161354c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:21:24.848 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.824+0000 7f161354c640 1 -- 10.20.193.110:0/1689362740 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f160c132030 con 0x7f160c04d1c0 2026-02-13T20:21:24.848 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.824+0000 7f15f9ffb640 1 -- 10.20.193.110:0/1689362740 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1073326936 0 0) 0x7f160c132030 con 0x7f160c04d1c0 2026-02-13T20:21:24.848 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.824+0000 7f15f9ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:21:24.848 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.824+0000 7f15f9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:24.848 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.824+0000 7f15f9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:24.848 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.824+0000 7f15f9ffb640 10 monclient(hunting): my global_id is 124104 2026-02-13T20:21:24.848 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.824+0000 7f15f9ffb640 1 -- 10.20.193.110:0/1689362740 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f160c0008d0 con 0x7f160c04d1c0 2026-02-13T20:21:24.848 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.824+0000 7f15f9ffb640 1 -- 10.20.193.110:0/1689362740 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1387502711 0 0) 0x7f160c0008d0 con 0x7f160c04d1c0 2026-02-13T20:21:24.848 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.824+0000 7f15f9ffb640 1 -- 10.20.193.110:0/1689362740 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f160c132030 con 0x7f160c04d1c0 2026-02-13T20:21:24.848 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.824+0000 7f15f9ffb640 1 -- 10.20.193.110:0/1689362740 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f15fc004cc0 con 0x7f160c04d1c0 2026-02-13T20:21:24.848 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.824+0000 7f15f9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:24.848 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.824+0000 7f15f9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:21:24.848 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.824+0000 7f15f9ffb640 10 monclient: dump: 2026-02-13T20:21:24.849 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:24.849 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:24.849 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:24.849 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:24.849 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:24.849 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:24.849 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:24.849 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:24.849 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:24.849 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:24.849 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.824+0000 7f15f9ffb640 1 -- 10.20.193.110:0/1689362740 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 97421107 0 0) 0x7f160c132030 con 0x7f160c04d1c0 2026-02-13T20:21:24.849 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.824+0000 7f15f9ffb640 1 -- 10.20.193.110:0/1689362740 --> v1:10.20.193.110:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f160c08b450 con 0x7f160c04d1c0 2026-02-13T20:21:24.849 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.825+0000 7f15f9ffb640 1 -- 10.20.193.110:0/1689362740 <== mon.0 v1:10.20.193.110:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4344 (unknown 0 0 554952451) 0x7f15fc005990 con 0x7f160c04d1c0 2026-02-13T20:21:24.850 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.825+0000 7f15f9ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:21:24.850 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.825+0000 7f15f9ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:21:24.850 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.825+0000 7f15f9ffb640 1 -- 10.20.193.110:0/1689362740 >> v1:10.20.193.110:6789/0 conn(0x7f160c04d1c0 legacy=0x7f160c197a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:24.850 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.825+0000 7f15f9ffb640 1 -- 10.20.193.110:0/1689362740 >> v1:10.20.193.110:6789/0 conn(0x7f160c04d1c0 legacy=0x7f160c197a00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:21:24.850 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:21:24.850 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:21:24.851 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:21:24.851 INFO:teuthology.orchestra.run.trial110.stdout: "state": "peon", 2026-02-13T20:21:24.851 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 38, 2026-02-13T20:21:24.851 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 242, 2026-02-13T20:21:24.851 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:21:24.851 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:21:24.851 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:21:24.851 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:21:24.851 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:21:24.851 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 0, 2026-02-13T20:21:24.851 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:21:24.851 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:21:24.851 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:21:24.852 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:21:24.852 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:21:24.852 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:21:24.852 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:21:24.852 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:21:24.852 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:21:24.852 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:21:24.852 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:21:24.852 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:21:24.852 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:21:24.852 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:21:24.852 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:21:24.852 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:21:24.852 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:21:24.853 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:21:24.853 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:21:24.853 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:21:24.853 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:21:24.853 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:21:24.853 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:21:24.853 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:21:24.853 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:21:24.853 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:21:24.853 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:21:24.853 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:21:24.853 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:21:24.853 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:21:24.853 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:21:24.854 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:21:24.854 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:21:24.854 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:24.854 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:21:24.854 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:21:24.854 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:21:24.854 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:21:24.854 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:21:24.854 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:21:24.854 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:21:24.854 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:21:24.854 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:21:24.854 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:21:24.854 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:21:24.855 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:21:24.855 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:21:24.855 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:21:24.855 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:21:24.855 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:21:24.855 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:21:24.855 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:21:24.855 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:21:24.855 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:21:24.855 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:21:24.855 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:21:24.855 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:21:24.855 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:21:24.855 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:21:24.855 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:21:24.855 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:21:24.856 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:21:24.856 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:21:24.856 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:21:24.856 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:21:24.856 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:21:24.856 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:24.856 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:21:24.856 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:24.856 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:21:24.856 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:21:24.856 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:21:24.856 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:21:24.856 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:24.856 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:21:24.856 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:21:24.857 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:21:24.857 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:24.857 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:21:24.857 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:24.857 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:21:24.857 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:21:24.857 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:21:24.857 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:21:24.857 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:21:24.857 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:21:24.857 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:24.857 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:24.857 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:21:24.857 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:21:24.857 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:21:24.857 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:21:24.858 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:24.858 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:21:24.858 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:21:24.858 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:21:24.858 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:24.858 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:21:24.858 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:24.858 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:21:24.858 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:21:24.858 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:21:24.858 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:21:24.858 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:21:24.858 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:21:24.858 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:24.858 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:24.858 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:21:24.858 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:21:24.859 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:21:24.859 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:21:24.859 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:24.859 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:21:24.859 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:21:24.859 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:21:24.859 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:24.859 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:21:24.859 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:24.859 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:21:24.859 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:21:24.859 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:21:24.859 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:21:24.859 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:21:24.859 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:21:24.859 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:24.859 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:21:24.859 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:24.860 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:21:24.860 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:21:24.860 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:24.860 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:21:24.860 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:21:24.860 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:21:24.860 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:24.860 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:21:24.860 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:21:24.860 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:24.860 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:21:24.860 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:21:24.860 INFO:teuthology.orchestra.run.trial110.stdout: "num": 2 2026-02-13T20:21:24.860 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:24.860 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:21:24.860 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:24.860 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:21:24.861 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:21:24.862 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.825+0000 7f161354c640 1 -- 10.20.193.110:0/1689362740 >> v1:10.20.193.188:6812/1623052694 conn(0x7f15dc03faa0 legacy=0x7f15dc05ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:24.862 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.825+0000 7f161354c640 10 monclient: shutdown 2026-02-13T20:21:24.862 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.825+0000 7f161354c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:21:24.862 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.825+0000 7f161354c640 1 -- 10.20.193.110:0/1689362740 >> v1:10.20.193.110:6789/0 conn(0x7f160c130df0 legacy=0x7f160c1952d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:24.862 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.825+0000 7f1611ac2640 1 -- 10.20.193.110:0/1689362740 reap_dead start 2026-02-13T20:21:24.862 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.825+0000 7f1611ac2640 1 -- 10.20.193.110:0/1689362740 reap_dead start 2026-02-13T20:21:24.862 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.825+0000 7f161354c640 1 -- 10.20.193.110:0/1689362740 shutdown_connections 2026-02-13T20:21:24.862 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.825+0000 7f161354c640 1 -- 10.20.193.110:0/1689362740 >> 10.20.193.110:0/1689362740 conn(0x7f160c054e90 msgr2=0x7f160c088e30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:21:24.862 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.825+0000 7f161354c640 1 -- 10.20.193.110:0/1689362740 shutdown_connections 2026-02-13T20:21:24.862 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.825+0000 7f161354c640 1 -- 10.20.193.110:0/1689362740 wait complete. 2026-02-13T20:21:24.863 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:21:24.863 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-13T20:21:24.863 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T20:21:24.927 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.925+0000 7f9522ecc640 10 monclient: get_monmap_and_config 2026-02-13T20:21:24.927 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.925+0000 7f9522ecc640 10 monclient: build_initial_monmap 2026-02-13T20:21:24.927 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.925+0000 7f9522ecc640 10 monclient: monmap: 2026-02-13T20:21:24.927 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:21:24.927 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:24.927 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:21:24.927332+0000 2026-02-13T20:21:24.927 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:21:24.927332+0000 2026-02-13T20:21:24.927 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:21:24.927 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:24.927 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:21:24.928 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:21:24.928 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:21:24.928 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:24.933 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.926+0000 7f9522ecc640 1 Processor -- start 2026-02-13T20:21:24.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.926+0000 7f9522ecc640 1 -- start start 2026-02-13T20:21:24.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.926+0000 7f9522ecc640 10 monclient: init 2026-02-13T20:21:24.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.926+0000 7f9522ecc640 10 monclient: _reopen_session rank -1 2026-02-13T20:21:24.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.926+0000 7f9522ecc640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:21:24.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.926+0000 7f9522ecc640 10 monclient(hunting): picked mon.noname-b con 0x7f951c1401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:21:24.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.926+0000 7f9522ecc640 10 monclient(hunting): picked mon.noname-a con 0x7f951c092020 addr v1:10.20.193.110:6789/0 2026-02-13T20:21:24.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.926+0000 7f9522ecc640 10 monclient(hunting): picked mon.noname-c con 0x7f951c091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:21:24.934 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.926+0000 7f9522ecc640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f951c08b730 con 0x7f951c092020 2026-02-13T20:21:24.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.926+0000 7f9522ecc640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f951c05c5b0 con 0x7f951c091950 2026-02-13T20:21:24.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.926+0000 7f9522ecc640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f951c08bcf0 con 0x7f951c1401c0 2026-02-13T20:21:24.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.926+0000 7f9522ecc640 10 monclient(hunting): _renew_subs 2026-02-13T20:21:24.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.926+0000 7f9522ecc640 10 monclient(hunting): authenticate will time out at 1246.617640s 2026-02-13T20:21:24.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.926+0000 7f9513fff640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f951c092020 0x7f951c1812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:43920/0 (socket says 10.20.193.110:43920) 2026-02-13T20:21:24.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.926+0000 7f9520c41640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f951c1401c0 0x7f951c091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:33652/0 (socket says 10.20.193.110:33652) 2026-02-13T20:21:24.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.926+0000 7f9513fff640 1 -- 10.20.193.110:0/593549897 learned_addr learned my addr 10.20.193.110:0/593549897 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:21:24.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.926+0000 7f95137fe640 1 -- 10.20.193.110:0/593549897 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2706052107 0 0) 0x7f951c08b730 con 0x7f951c092020 2026-02-13T20:21:24.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.926+0000 7f95137fe640 10 monclient(hunting): _negotiate 2026-02-13T20:21:24.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.926+0000 7f95137fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:24.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.926+0000 7f95137fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:24.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.926+0000 7f95137fe640 10 monclient(hunting): my global_id is 124107 2026-02-13T20:21:24.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.927+0000 7f95137fe640 1 -- 10.20.193.110:0/593549897 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95080035e0 con 0x7f951c092020 2026-02-13T20:21:24.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.927+0000 7f95137fe640 1 -- 10.20.193.110:0/593549897 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2950954761 0 0) 0x7f951c08bcf0 con 0x7f951c1401c0 2026-02-13T20:21:24.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.927+0000 7f95137fe640 10 monclient(hunting): _negotiate 2026-02-13T20:21:24.935 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.927+0000 7f95137fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:24.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.927+0000 7f95137fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:24.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.927+0000 7f95137fe640 10 monclient(hunting): my global_id is 94415 2026-02-13T20:21:24.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.927+0000 7f95137fe640 1 -- 10.20.193.110:0/593549897 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f951c08b730 con 0x7f951c1401c0 2026-02-13T20:21:24.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.927+0000 7f95137fe640 1 -- 10.20.193.110:0/593549897 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1961079518 0 0) 0x7f95080035e0 con 0x7f951c092020 2026-02-13T20:21:24.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.927+0000 7f95137fe640 1 -- 10.20.193.110:0/593549897 >> v1:10.20.193.110:6790/0 conn(0x7f951c1401c0 legacy=0x7f951c091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:24.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.927+0000 7f95137fe640 1 -- 10.20.193.110:0/593549897 >> v1:10.20.193.188:6789/0 conn(0x7f951c091950 legacy=0x7f951c1a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T20:21:24.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.927+0000 7f95137fe640 10 monclient: _finish_hunting 0 2026-02-13T20:21:24.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.927+0000 7f95137fe640 1 monclient: found mon.noname-a 2026-02-13T20:21:24.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.927+0000 7f95137fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:21:24.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.927+0000 7f95137fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:21:24.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.927+0000 7f95137fe640 1 -- 10.20.193.110:0/593549897 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f951c140590 con 0x7f951c092020 2026-02-13T20:21:24.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.927+0000 7f95137fe640 10 monclient: _finish_auth 0 2026-02-13T20:21:24.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.927+0000 7f95137fe640 10 monclient: _check_auth_tickets 2026-02-13T20:21:24.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.927+0000 7f95137fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:21:24.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.927+0000 7f95137fe640 1 -- 10.20.193.110:0/593549897 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f9504002dd0 con 0x7f951c092020 2026-02-13T20:21:24.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.927+0000 7f9522ecc640 5 monclient: authenticate success, global_id 124107 2026-02-13T20:21:24.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.927+0000 7f9522ecc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:21:24.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.927+0000 7f95137fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:24.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.927+0000 7f95137fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:21:24.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.927+0000 7f95137fe640 10 monclient: dump: 2026-02-13T20:21:24.937 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:24.937 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:24.937 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:24.937 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:24.937 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:24.937 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:24.937 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:24.937 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:24.937 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:24.937 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:24.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.927+0000 7f9522ecc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:21:24.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.927+0000 7f95137fe640 1 -- 10.20.193.110:0/593549897 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9504002fa0 con 0x7f951c092020 2026-02-13T20:21:24.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.927+0000 7f95137fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:21:24.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.927+0000 7f95137fe640 1 -- 10.20.193.110:0/593549897 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f95040033b0 con 0x7f951c092020 2026-02-13T20:21:24.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.927+0000 7f95137fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:24.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.927+0000 7f95137fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:21:24.938 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.927+0000 7f95137fe640 10 monclient: dump: 2026-02-13T20:21:24.938 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:24.938 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:24.938 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:24.938 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:24.938 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:24.938 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:24.938 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:24.938 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:24.938 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:24.939 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:24.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.927+0000 7f9522ecc640 10 monclient: get_monmap_and_config success 2026-02-13T20:21:24.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.927+0000 7f9522ecc640 4 set_mon_vals no callback set 2026-02-13T20:21:24.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.927+0000 7f9522ecc640 10 monclient: shutdown 2026-02-13T20:21:24.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.927+0000 7f9522ecc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:21:24.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.927+0000 7f9522ecc640 1 -- 10.20.193.110:0/593549897 >> v1:10.20.193.110:6789/0 conn(0x7f951c092020 legacy=0x7f951c1812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:24.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.927+0000 7f9522ecc640 1 -- 10.20.193.110:0/593549897 shutdown_connections 2026-02-13T20:21:24.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.927+0000 7f9522ecc640 1 -- 10.20.193.110:0/593549897 >> 10.20.193.110:0/593549897 conn(0x7f951c054e90 msgr2=0x7f951c058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:21:24.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.927+0000 7f9522ecc640 1 -- 10.20.193.110:0/593549897 shutdown_connections 2026-02-13T20:21:24.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.927+0000 7f9522ecc640 1 -- 10.20.193.110:0/593549897 wait complete. 2026-02-13T20:21:24.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.927+0000 7f9522ecc640 10 monclient: build_initial_monmap 2026-02-13T20:21:24.939 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.927+0000 7f9522ecc640 10 monclient: monmap: 2026-02-13T20:21:24.939 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:21:24.939 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:21:24.939 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:21:24.940 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:21:24.940 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:21:24.940 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:21:24.940 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:21:24.940 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:21:24.940 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:21:24.940 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:24.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f9522ecc640 1 Processor -- start 2026-02-13T20:21:24.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f9522ecc640 1 -- start start 2026-02-13T20:21:24.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f9522ecc640 10 monclient: init 2026-02-13T20:21:24.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f9522ecc640 10 monclient: _reopen_session rank -1 2026-02-13T20:21:24.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f9522ecc640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:21:24.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f9522ecc640 10 monclient(hunting): picked mon.noname-c con 0x7f951c091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:21:24.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f9522ecc640 10 monclient(hunting): picked mon.noname-a con 0x7f951c1401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:21:24.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f9522ecc640 10 monclient(hunting): picked mon.noname-b con 0x7f951c116300 addr v1:10.20.193.188:6789/0 2026-02-13T20:21:24.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f9522ecc640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f951c124b50 con 0x7f951c1401c0 2026-02-13T20:21:24.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f9522ecc640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f951c12f650 con 0x7f951c116300 2026-02-13T20:21:24.940 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f9522ecc640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f951c113bc0 con 0x7f951c091950 2026-02-13T20:21:24.941 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f9522ecc640 10 monclient(hunting): _renew_subs 2026-02-13T20:21:24.941 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f9522ecc640 10 monclient(hunting): authenticate will time out at 1246.619328s 2026-02-13T20:21:24.941 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f9520c41640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f951c091950 0x7f951c112da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:33668/0 (socket says 10.20.193.110:33668) 2026-02-13T20:21:24.941 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f9520c41640 1 -- 10.20.193.110:0/1396515369 learned_addr learned my addr 10.20.193.110:0/1396515369 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:21:24.941 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f95117fa640 1 -- 10.20.193.110:0/1396515369 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3988098734 0 0) 0x7f951c113bc0 con 0x7f951c091950 2026-02-13T20:21:24.941 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f95117fa640 10 monclient(hunting): _negotiate 2026-02-13T20:21:24.941 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f95117fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:24.941 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f95117fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:24.941 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f95117fa640 10 monclient(hunting): my global_id is 94418 2026-02-13T20:21:24.941 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f95117fa640 1 -- 10.20.193.110:0/1396515369 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94ec0035e0 con 0x7f951c091950 2026-02-13T20:21:24.941 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f95117fa640 1 -- 10.20.193.110:0/1396515369 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3766599926 0 0) 0x7f951c124b50 con 0x7f951c1401c0 2026-02-13T20:21:24.941 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f95117fa640 10 monclient(hunting): _negotiate 2026-02-13T20:21:24.941 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f95117fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:24.941 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f95117fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:24.941 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f95117fa640 10 monclient(hunting): my global_id is 124110 2026-02-13T20:21:24.941 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f95117fa640 1 -- 10.20.193.110:0/1396515369 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f951c113bc0 con 0x7f951c1401c0 2026-02-13T20:21:24.941 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f95117fa640 1 -- 10.20.193.110:0/1396515369 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2997002156 0 0) 0x7f94ec0035e0 con 0x7f951c091950 2026-02-13T20:21:24.942 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f95117fa640 1 -- 10.20.193.110:0/1396515369 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f951c124b50 con 0x7f951c091950 2026-02-13T20:21:24.942 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f95117fa640 1 -- 10.20.193.110:0/1396515369 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f950c0030f0 con 0x7f951c091950 2026-02-13T20:21:24.942 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f95117fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:21:24.942 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f95117fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:21:24.942 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f95117fa640 10 monclient(hunting): dump: 2026-02-13T20:21:24.942 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:24.942 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:24.942 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:24.942 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:24.942 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:24.942 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:24.942 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:24.942 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:24.942 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:24.942 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:24.942 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f95117fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:21:24.942 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f95117fa640 1 -- 10.20.193.110:0/1396515369 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 597329668 0 0) 0x7f951c113bc0 con 0x7f951c1401c0 2026-02-13T20:21:24.943 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f95117fa640 1 -- 10.20.193.110:0/1396515369 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f94ec0035e0 con 0x7f951c1401c0 2026-02-13T20:21:24.943 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f95117fa640 1 -- 10.20.193.110:0/1396515369 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f9504002ce0 con 0x7f951c1401c0 2026-02-13T20:21:24.943 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f95117fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:21:24.943 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f95117fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:21:24.943 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f95117fa640 10 monclient(hunting): dump: 2026-02-13T20:21:24.943 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:24.943 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:24.943 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:24.943 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:24.943 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:24.943 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:24.943 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:24.943 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:24.943 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:24.943 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:24.943 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f95117fa640 1 -- 10.20.193.110:0/1396515369 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3162432507 0 0) 0x7f951c124b50 con 0x7f951c091950 2026-02-13T20:21:24.943 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f95117fa640 1 -- 10.20.193.110:0/1396515369 >> v1:10.20.193.188:6789/0 conn(0x7f951c116300 legacy=0x7f951c1a2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:24.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f95117fa640 1 -- 10.20.193.110:0/1396515369 >> v1:10.20.193.110:6789/0 conn(0x7f951c1401c0 legacy=0x7f951c1134b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:24.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f95117fa640 10 monclient: _finish_hunting 0 2026-02-13T20:21:24.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f95117fa640 1 monclient: found mon.c 2026-02-13T20:21:24.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f95117fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:21:24.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f95117fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:21:24.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f95117fa640 1 -- 10.20.193.110:0/1396515369 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f951c08c2a0 con 0x7f951c091950 2026-02-13T20:21:24.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f95117fa640 10 monclient: _finish_auth 0 2026-02-13T20:21:24.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f95117fa640 10 monclient: _check_auth_tickets 2026-02-13T20:21:24.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f95117fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:21:24.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f9522ecc640 5 monclient: authenticate success, global_id 94418 2026-02-13T20:21:24.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f9522ecc640 10 monclient: _renew_subs 2026-02-13T20:21:24.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f9522ecc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:21:24.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f9522ecc640 1 -- 10.20.193.110:0/1396515369 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f951c05d320 con 0x7f951c091950 2026-02-13T20:21:24.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f9522ecc640 10 monclient: _renew_subs 2026-02-13T20:21:24.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f9522ecc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:21:24.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f9522ecc640 1 -- 10.20.193.110:0/1396515369 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f951c12e190 con 0x7f951c091950 2026-02-13T20:21:24.944 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f95117fa640 1 -- 10.20.193.110:0/1396515369 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f950c003340 con 0x7f951c091950 2026-02-13T20:21:24.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f95117fa640 10 monclient: handle_config config(0 keys) 2026-02-13T20:21:24.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f95117fa640 1 -- 10.20.193.110:0/1396515369 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f950c004d00 con 0x7f951c091950 2026-02-13T20:21:24.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f95117fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:24.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f95117fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:21:24.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f9512ffd640 4 set_mon_vals no callback set 2026-02-13T20:21:24.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.928+0000 7f95117fa640 10 monclient: dump: 2026-02-13T20:21:24.945 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:24.945 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:24.945 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:24.945 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:24.945 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:24.945 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:24.945 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:24.945 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:24.945 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:24.945 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:24.945 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.929+0000 7f9522ecc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:21:24.946 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.929+0000 7f9522ecc640 1 -- 10.20.193.110:0/1396515369 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f951c0008d0 con 0x7f951c092020 2026-02-13T20:21:24.946 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.929+0000 7f95117fa640 1 -- 10.20.193.110:0/1396515369 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f950c011970 con 0x7f951c091950 2026-02-13T20:21:24.946 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.929+0000 7f95117fa640 1 -- 10.20.193.110:0/1396515369 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(488..488 src has 1..488) ==== 3975+0+0 (unknown 3700913173 0 0) 0x7f950c04e9b0 con 0x7f951c091950 2026-02-13T20:21:24.946 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.929+0000 7f95117fa640 1 -- 10.20.193.110:0/1396515369 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 73919532 0 0) 0x7f951c0008d0 con 0x7f951c092020 2026-02-13T20:21:24.946 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.929+0000 7f95117fa640 10 monclient(hunting): _negotiate 2026-02-13T20:21:24.946 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.929+0000 7f95117fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:24.946 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.929+0000 7f95117fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:24.946 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.929+0000 7f95117fa640 10 monclient(hunting): my global_id is 94421 2026-02-13T20:21:24.946 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.929+0000 7f95117fa640 1 -- 10.20.193.110:0/1396515369 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f951c124b50 con 0x7f951c092020 2026-02-13T20:21:24.946 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.929+0000 7f9521442640 10 monclient: get_auth_request con 0x7f94ec03fa50 auth_method 0 2026-02-13T20:21:24.946 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.929+0000 7f95117fa640 1 -- 10.20.193.110:0/1396515369 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4079706338 0 0) 0x7f951c124b50 con 0x7f951c092020 2026-02-13T20:21:24.946 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.929+0000 7f95117fa640 1 -- 10.20.193.110:0/1396515369 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f951c0008d0 con 0x7f951c092020 2026-02-13T20:21:24.946 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.929+0000 7f95117fa640 1 -- 10.20.193.110:0/1396515369 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f9504002e40 con 0x7f951c092020 2026-02-13T20:21:24.946 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.929+0000 7f95117fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:24.946 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.929+0000 7f95117fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:21:24.946 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.929+0000 7f95117fa640 10 monclient: dump: 2026-02-13T20:21:24.946 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:24.946 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:24.947 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:24.947 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:24.947 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:24.947 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:24.947 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:24.947 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:24.947 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:24.947 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:24.947 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.930+0000 7f95117fa640 1 -- 10.20.193.110:0/1396515369 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2330178307 0 0) 0x7f951c0008d0 con 0x7f951c092020 2026-02-13T20:21:24.947 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.930+0000 7f95117fa640 1 -- 10.20.193.110:0/1396515369 --> v1:10.20.193.110:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f951c08a920 con 0x7f951c092020 2026-02-13T20:21:24.947 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.930+0000 7f95117fa640 1 -- 10.20.193.110:0/1396515369 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f9504007a20 con 0x7f951c092020 2026-02-13T20:21:24.947 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.930+0000 7f95117fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:21:24.947 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.930+0000 7f95117fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:21:24.947 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.930+0000 7f95117fa640 1 -- 10.20.193.110:0/1396515369 >> v1:10.20.193.110:6790/0 conn(0x7f951c092020 legacy=0x7f951c1a3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:24.947 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.930+0000 7f95117fa640 1 -- 10.20.193.110:0/1396515369 >> v1:10.20.193.110:6790/0 conn(0x7f951c092020 legacy=0x7f951c1a3770 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:21:24.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.933+0000 7f9522ecc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:21:24.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.933+0000 7f9522ecc640 1 -- 10.20.193.110:0/1396515369 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f951c1a4280 con 0x7f951c1a3e80 2026-02-13T20:21:24.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.933+0000 7f95117fa640 1 -- 10.20.193.110:0/1396515369 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2652068083 0 0) 0x7f951c1a4280 con 0x7f951c1a3e80 2026-02-13T20:21:24.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.933+0000 7f95117fa640 10 monclient(hunting): _negotiate 2026-02-13T20:21:24.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.933+0000 7f95117fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:24.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.933+0000 7f95117fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:24.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.933+0000 7f95117fa640 10 monclient(hunting): my global_id is 94424 2026-02-13T20:21:24.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.933+0000 7f95117fa640 1 -- 10.20.193.110:0/1396515369 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f951c0008d0 con 0x7f951c1a3e80 2026-02-13T20:21:24.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.933+0000 7f95117fa640 1 -- 10.20.193.110:0/1396515369 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 145384356 0 0) 0x7f951c0008d0 con 0x7f951c1a3e80 2026-02-13T20:21:24.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.933+0000 7f95117fa640 1 -- 10.20.193.110:0/1396515369 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f951c1a4280 con 0x7f951c1a3e80 2026-02-13T20:21:24.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.933+0000 7f95117fa640 1 -- 10.20.193.110:0/1396515369 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f9504005420 con 0x7f951c1a3e80 2026-02-13T20:21:24.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.933+0000 7f95117fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:24.950 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.933+0000 7f95117fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:21:24.950 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.933+0000 7f95117fa640 10 monclient: dump: 2026-02-13T20:21:24.950 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:24.950 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:24.950 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:24.950 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:24.950 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:24.950 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:24.950 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:24.950 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:24.950 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:24.950 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:24.950 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.933+0000 7f95117fa640 1 -- 10.20.193.110:0/1396515369 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3239526084 0 0) 0x7f951c1a4280 con 0x7f951c1a3e80 2026-02-13T20:21:24.950 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.933+0000 7f95117fa640 1 -- 10.20.193.110:0/1396515369 --> v1:10.20.193.110:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f951c125f00 con 0x7f951c1a3e80 2026-02-13T20:21:24.950 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.934+0000 7f95117fa640 1 -- 10.20.193.110:0/1396515369 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4514 (unknown 0 0 3468863521) 0x7f9504007b90 con 0x7f951c1a3e80 2026-02-13T20:21:24.950 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.934+0000 7f95117fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:21:24.951 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.934+0000 7f95117fa640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:21:24.951 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.934+0000 7f95117fa640 1 -- 10.20.193.110:0/1396515369 >> v1:10.20.193.110:6790/0 conn(0x7f951c1a3e80 legacy=0x7f951c132b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:24.951 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.934+0000 7f95117fa640 1 -- 10.20.193.110:0/1396515369 >> v1:10.20.193.110:6790/0 conn(0x7f951c1a3e80 legacy=0x7f951c132b80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:21:24.951 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:21:24.951 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:21:24.951 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:21:24.951 INFO:teuthology.orchestra.run.trial110.stdout: "state": "peon", 2026-02-13T20:21:24.951 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 38, 2026-02-13T20:21:24.951 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 356557, 2026-02-13T20:21:24.951 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:21:24.951 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:21:24.952 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:21:24.952 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:21:24.952 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:21:24.952 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 0, 2026-02-13T20:21:24.952 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:21:24.952 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:21:24.952 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:21:24.952 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:21:24.952 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:21:24.952 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:21:24.952 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:21:24.952 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:21:24.952 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:21:24.952 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:21:24.952 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:21:24.952 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:21:24.952 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:21:24.953 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:21:24.953 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:21:24.953 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:21:24.953 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:21:24.953 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:21:24.953 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:21:24.953 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:21:24.953 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:21:24.953 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:21:24.953 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:21:24.953 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:21:24.953 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:21:24.953 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:21:24.953 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:21:24.953 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:21:24.953 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:21:24.953 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:21:24.954 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:21:24.954 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:21:24.954 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:21:24.954 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:24.954 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:21:24.954 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:21:24.954 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:21:24.954 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:21:24.954 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:21:24.954 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:21:24.954 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:21:24.954 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:21:24.954 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:21:24.954 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:21:24.954 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:21:24.954 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:21:24.955 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:21:24.955 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:21:24.955 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:21:24.955 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:21:24.955 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:21:24.955 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:21:24.955 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:21:24.955 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:21:24.955 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:21:24.955 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:21:24.955 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:21:24.955 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:21:24.955 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:21:24.955 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:21:24.955 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:21:24.955 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:21:24.955 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:21:24.955 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:21:24.956 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:21:24.956 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:21:24.956 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:24.956 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:21:24.956 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:24.956 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:21:24.956 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:21:24.956 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:21:24.956 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:21:24.956 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:24.956 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:21:24.956 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:21:24.956 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:21:24.956 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:24.956 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:21:24.956 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:24.956 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:21:24.956 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:21:24.957 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:21:24.957 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:21:24.957 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:21:24.957 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:21:24.957 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:24.957 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:24.957 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:21:24.957 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:21:24.957 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:21:24.957 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:21:24.957 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:24.957 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:21:24.957 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:21:24.957 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:21:24.957 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:24.957 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:21:24.957 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:24.957 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:21:24.957 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:21:24.958 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:21:24.958 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:21:24.958 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:21:24.958 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:21:24.958 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:24.958 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:24.958 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:21:24.958 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:21:24.958 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:21:24.958 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:21:24.958 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:24.958 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:21:24.958 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:21:24.958 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:21:24.958 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:24.958 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:21:24.958 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:24.958 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:21:24.958 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:21:24.959 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:21:24.959 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:21:24.959 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:21:24.959 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:21:24.959 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:24.959 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:21:24.959 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:24.959 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:21:24.959 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:21:24.959 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:24.959 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:21:24.959 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:21:24.959 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:21:24.959 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:24.959 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:21:24.959 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:21:24.959 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:24.959 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:21:24.959 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:21:24.960 INFO:teuthology.orchestra.run.trial110.stdout: "num": 2 2026-02-13T20:21:24.960 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:24.960 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:21:24.960 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:21:24.960 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:24.960 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:21:24.960 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:21:24.960 INFO:teuthology.orchestra.run.trial110.stdout: "num": 2 2026-02-13T20:21:24.960 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:24.960 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:21:24.960 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:24.960 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:21:24.960 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:21:24.961 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.934+0000 7f9522ecc640 1 -- 10.20.193.110:0/1396515369 >> v1:10.20.193.188:6812/1623052694 conn(0x7f94ec03fa50 legacy=0x7f94ec05ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:24.961 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.934+0000 7f9522ecc640 10 monclient: shutdown 2026-02-13T20:21:24.961 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.934+0000 7f9522ecc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:21:24.961 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.934+0000 7f9522ecc640 1 -- 10.20.193.110:0/1396515369 >> v1:10.20.193.110:6790/0 conn(0x7f951c091950 legacy=0x7f951c112da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:24.961 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.934+0000 7f9521442640 1 -- 10.20.193.110:0/1396515369 reap_dead start 2026-02-13T20:21:24.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.934+0000 7f9521442640 1 -- 10.20.193.110:0/1396515369 reap_dead start 2026-02-13T20:21:24.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.934+0000 7f9522ecc640 1 -- 10.20.193.110:0/1396515369 shutdown_connections 2026-02-13T20:21:24.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.934+0000 7f9522ecc640 1 -- 10.20.193.110:0/1396515369 >> 10.20.193.110:0/1396515369 conn(0x7f951c054e90 msgr2=0x7f951c08dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:21:24.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.934+0000 7f9522ecc640 1 -- 10.20.193.110:0/1396515369 shutdown_connections 2026-02-13T20:21:24.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:24.934+0000 7f9522ecc640 1 -- 10.20.193.110:0/1396515369 wait complete. 2026-02-13T20:21:24.962 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:21:24.962 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-13T20:21:24.962 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T20:21:25.028 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.026+0000 7f7540f4c640 10 monclient: get_monmap_and_config 2026-02-13T20:21:25.028 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.026+0000 7f7540f4c640 10 monclient: build_initial_monmap 2026-02-13T20:21:25.028 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.026+0000 7f7540f4c640 10 monclient: monmap: 2026-02-13T20:21:25.028 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:21:25.028 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:25.028 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:21:25.028353+0000 2026-02-13T20:21:25.028 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:21:25.028353+0000 2026-02-13T20:21:25.028 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:21:25.028 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:25.029 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:21:25.029 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:21:25.029 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:21:25.029 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:25.036 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.027+0000 7f7540f4c640 1 Processor -- start 2026-02-13T20:21:25.037 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.027+0000 7f7540f4c640 1 -- start start 2026-02-13T20:21:25.037 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.027+0000 7f7540f4c640 10 monclient: init 2026-02-13T20:21:25.037 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.027+0000 7f7540f4c640 10 monclient: _reopen_session rank -1 2026-02-13T20:21:25.037 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.027+0000 7f7540f4c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:21:25.037 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.027+0000 7f7540f4c640 10 monclient(hunting): picked mon.noname-a con 0x7f753c1401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:21:25.037 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.027+0000 7f7540f4c640 10 monclient(hunting): picked mon.noname-b con 0x7f753c092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:21:25.037 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.027+0000 7f7540f4c640 10 monclient(hunting): picked mon.noname-c con 0x7f753c091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:21:25.037 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.027+0000 7f7540f4c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f753c08b730 con 0x7f753c1401c0 2026-02-13T20:21:25.037 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.027+0000 7f7540f4c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f753c05c5b0 con 0x7f753c091950 2026-02-13T20:21:25.037 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.027+0000 7f7540f4c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f753c08bcf0 con 0x7f753c092020 2026-02-13T20:21:25.037 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.027+0000 7f7540f4c640 10 monclient(hunting): _renew_subs 2026-02-13T20:21:25.037 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.027+0000 7f7540f4c640 10 monclient(hunting): authenticate will time out at 1246.718826s 2026-02-13T20:21:25.038 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.027+0000 7f753a575640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f753c1401c0 0x7f753c091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:43942/0 (socket says 10.20.193.110:43942) 2026-02-13T20:21:25.038 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.027+0000 7f753a575640 1 -- 10.20.193.110:0/510957007 learned_addr learned my addr 10.20.193.110:0/510957007 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:21:25.038 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.028+0000 7f7539573640 1 -- 10.20.193.110:0/510957007 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2288496643 0 0) 0x7f753c08bcf0 con 0x7f753c092020 2026-02-13T20:21:25.038 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.028+0000 7f7539573640 10 monclient(hunting): _negotiate 2026-02-13T20:21:25.038 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.028+0000 7f7539573640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:25.038 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.028+0000 7f7539573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:25.038 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.028+0000 7f7539573640 10 monclient(hunting): my global_id is 94427 2026-02-13T20:21:25.038 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.028+0000 7f7539573640 1 -- 10.20.193.110:0/510957007 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f75280035e0 con 0x7f753c092020 2026-02-13T20:21:25.038 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.028+0000 7f7539573640 1 -- 10.20.193.110:0/510957007 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2442083310 0 0) 0x7f753c08b730 con 0x7f753c1401c0 2026-02-13T20:21:25.038 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.028+0000 7f7539573640 10 monclient(hunting): _negotiate 2026-02-13T20:21:25.038 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.028+0000 7f7539573640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:25.039 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.028+0000 7f7539573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:25.039 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.028+0000 7f7539573640 10 monclient(hunting): my global_id is 124113 2026-02-13T20:21:25.039 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.028+0000 7f7539573640 1 -- 10.20.193.110:0/510957007 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f753c08bcf0 con 0x7f753c1401c0 2026-02-13T20:21:25.039 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.028+0000 7f7539573640 1 -- 10.20.193.110:0/510957007 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 201292596 0 0) 0x7f753c05c5b0 con 0x7f753c091950 2026-02-13T20:21:25.039 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.028+0000 7f7539573640 10 monclient(hunting): _negotiate 2026-02-13T20:21:25.039 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.028+0000 7f7539573640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:25.039 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.028+0000 7f7539573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:25.039 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.028+0000 7f7539573640 10 monclient(hunting): my global_id is 4819 2026-02-13T20:21:25.039 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.028+0000 7f7539573640 1 -- 10.20.193.110:0/510957007 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f753c08b730 con 0x7f753c091950 2026-02-13T20:21:25.039 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.028+0000 7f7539573640 1 -- 10.20.193.110:0/510957007 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 867954701 0 0) 0x7f753c08bcf0 con 0x7f753c1401c0 2026-02-13T20:21:25.039 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.028+0000 7f7539573640 1 -- 10.20.193.110:0/510957007 >> v1:10.20.193.110:6790/0 conn(0x7f753c092020 legacy=0x7f753c1812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:25.039 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.028+0000 7f7539573640 1 -- 10.20.193.110:0/510957007 >> v1:10.20.193.188:6789/0 conn(0x7f753c091950 legacy=0x7f753c1a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:25.040 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.028+0000 7f7539573640 10 monclient: _finish_hunting 0 2026-02-13T20:21:25.040 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.028+0000 7f7539573640 1 monclient: found mon.noname-a 2026-02-13T20:21:25.040 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.028+0000 7f7539573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:21:25.040 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.028+0000 7f7539573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:21:25.040 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.028+0000 7f7539573640 1 -- 10.20.193.110:0/510957007 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f753c140590 con 0x7f753c1401c0 2026-02-13T20:21:25.040 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.028+0000 7f7539573640 10 monclient: _finish_auth 0 2026-02-13T20:21:25.040 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.028+0000 7f7539573640 10 monclient: _check_auth_tickets 2026-02-13T20:21:25.040 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.028+0000 7f7539573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:21:25.040 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.028+0000 7f7539573640 1 -- 10.20.193.110:0/510957007 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f7530002dd0 con 0x7f753c1401c0 2026-02-13T20:21:25.040 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.028+0000 7f7539573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:25.040 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.028+0000 7f7539573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:21:25.040 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.028+0000 7f7539573640 10 monclient: dump: 2026-02-13T20:21:25.040 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:25.040 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:25.041 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:25.041 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:25.041 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:25.041 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:25.041 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:25.041 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:25.041 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:25.041 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:25.041 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.028+0000 7f7540f4c640 5 monclient: authenticate success, global_id 124113 2026-02-13T20:21:25.041 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.028+0000 7f7540f4c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:21:25.041 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.028+0000 7f7539573640 1 -- 10.20.193.110:0/510957007 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7530002fe0 con 0x7f753c1401c0 2026-02-13T20:21:25.041 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.028+0000 7f7539573640 10 monclient: handle_config config(0 keys) 2026-02-13T20:21:25.041 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.028+0000 7f7539573640 1 -- 10.20.193.110:0/510957007 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f75300033c0 con 0x7f753c1401c0 2026-02-13T20:21:25.042 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.028+0000 7f7539573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:25.042 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.028+0000 7f7539573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:21:25.042 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.028+0000 7f7539573640 10 monclient: dump: 2026-02-13T20:21:25.042 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:25.042 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:25.042 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:25.042 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:25.042 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:25.042 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:25.042 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:25.042 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:25.042 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:25.042 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:25.042 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.028+0000 7f7540f4c640 10 monclient: get_monmap_and_config success 2026-02-13T20:21:25.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.028+0000 7f7540f4c640 4 set_mon_vals no callback set 2026-02-13T20:21:25.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.028+0000 7f7540f4c640 10 monclient: shutdown 2026-02-13T20:21:25.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.028+0000 7f7540f4c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:21:25.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.028+0000 7f7540f4c640 1 -- 10.20.193.110:0/510957007 >> v1:10.20.193.110:6789/0 conn(0x7f753c1401c0 legacy=0x7f753c091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:25.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.028+0000 7f7540f4c640 1 -- 10.20.193.110:0/510957007 shutdown_connections 2026-02-13T20:21:25.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.028+0000 7f7540f4c640 1 -- 10.20.193.110:0/510957007 >> 10.20.193.110:0/510957007 conn(0x7f753c054e90 msgr2=0x7f753c058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:21:25.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.028+0000 7f7540f4c640 1 -- 10.20.193.110:0/510957007 shutdown_connections 2026-02-13T20:21:25.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.028+0000 7f7540f4c640 1 -- 10.20.193.110:0/510957007 wait complete. 2026-02-13T20:21:25.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.029+0000 7f7540f4c640 10 monclient: build_initial_monmap 2026-02-13T20:21:25.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.029+0000 7f7540f4c640 10 monclient: monmap: 2026-02-13T20:21:25.043 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:21:25.043 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:21:25.044 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:21:25.044 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:21:25.044 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:21:25.044 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:21:25.044 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:21:25.044 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:21:25.044 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:21:25.044 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:25.044 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.029+0000 7f7540f4c640 1 Processor -- start 2026-02-13T20:21:25.044 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.029+0000 7f7540f4c640 1 -- start start 2026-02-13T20:21:25.044 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.029+0000 7f7540f4c640 10 monclient: init 2026-02-13T20:21:25.044 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.029+0000 7f7540f4c640 10 monclient: _reopen_session rank -1 2026-02-13T20:21:25.044 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.029+0000 7f7540f4c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:21:25.044 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.029+0000 7f7540f4c640 10 monclient(hunting): picked mon.noname-b con 0x7f753c091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:21:25.045 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.029+0000 7f7540f4c640 10 monclient(hunting): picked mon.noname-c con 0x7f753c1401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:21:25.045 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.029+0000 7f7540f4c640 10 monclient(hunting): picked mon.noname-a con 0x7f753c13f030 addr v1:10.20.193.110:6789/0 2026-02-13T20:21:25.045 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.029+0000 7f7540f4c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f753c132080 con 0x7f753c13f030 2026-02-13T20:21:25.045 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.029+0000 7f7540f4c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f753c132360 con 0x7f753c091950 2026-02-13T20:21:25.045 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.029+0000 7f7540f4c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f753c130b60 con 0x7f753c1401c0 2026-02-13T20:21:25.045 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.029+0000 7f7540f4c640 10 monclient(hunting): _renew_subs 2026-02-13T20:21:25.045 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.029+0000 7f7540f4c640 10 monclient(hunting): authenticate will time out at 1246.720587s 2026-02-13T20:21:25.045 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.029+0000 7f753ad76640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f753c13f030 0x7f753c194ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:43944/0 (socket says 10.20.193.110:43944) 2026-02-13T20:21:25.045 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.029+0000 7f753ad76640 1 -- 10.20.193.110:0/2986793714 learned_addr learned my addr 10.20.193.110:0/2986793714 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:21:25.045 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.029+0000 7f7539d74640 1 --1- 10.20.193.110:0/2986793714 >> v1:10.20.193.110:6790/0 conn(0x7f753c1401c0 0x7f753c1938d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:33712/0 (socket says 10.20.193.110:33712) 2026-02-13T20:21:25.045 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.029+0000 7f7522ffd640 1 -- 10.20.193.110:0/2986793714 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2169224416 0 0) 0x7f753c132080 con 0x7f753c13f030 2026-02-13T20:21:25.045 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.029+0000 7f7522ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:21:25.045 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.029+0000 7f7522ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:25.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.029+0000 7f7522ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:25.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.029+0000 7f7522ffd640 10 monclient(hunting): my global_id is 124116 2026-02-13T20:21:25.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.029+0000 7f7522ffd640 1 -- 10.20.193.110:0/2986793714 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f75080035e0 con 0x7f753c13f030 2026-02-13T20:21:25.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.029+0000 7f7522ffd640 1 -- 10.20.193.110:0/2986793714 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2473263178 0 0) 0x7f753c130b60 con 0x7f753c1401c0 2026-02-13T20:21:25.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.029+0000 7f7522ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:21:25.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.029+0000 7f7522ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:25.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.029+0000 7f7522ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:25.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.029+0000 7f7522ffd640 10 monclient(hunting): my global_id is 94430 2026-02-13T20:21:25.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.029+0000 7f7522ffd640 1 -- 10.20.193.110:0/2986793714 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f753c132080 con 0x7f753c1401c0 2026-02-13T20:21:25.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.029+0000 7f7522ffd640 1 -- 10.20.193.110:0/2986793714 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2676773295 0 0) 0x7f75080035e0 con 0x7f753c13f030 2026-02-13T20:21:25.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.029+0000 7f7522ffd640 1 -- 10.20.193.110:0/2986793714 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f753c130b60 con 0x7f753c13f030 2026-02-13T20:21:25.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.029+0000 7f7522ffd640 1 -- 10.20.193.110:0/2986793714 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f752c004120 con 0x7f753c13f030 2026-02-13T20:21:25.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.029+0000 7f7522ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:21:25.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.029+0000 7f7522ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:21:25.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.029+0000 7f7522ffd640 10 monclient(hunting): dump: 2026-02-13T20:21:25.047 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:25.047 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:25.047 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:25.047 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:25.047 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:25.047 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:25.047 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:25.047 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:25.047 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:25.047 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:25.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.029+0000 7f7522ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:21:25.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.029+0000 7f7522ffd640 1 -- 10.20.193.110:0/2986793714 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 162264317 0 0) 0x7f753c132080 con 0x7f753c1401c0 2026-02-13T20:21:25.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.029+0000 7f7522ffd640 1 -- 10.20.193.110:0/2986793714 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f75080035e0 con 0x7f753c1401c0 2026-02-13T20:21:25.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.029+0000 7f7522ffd640 1 -- 10.20.193.110:0/2986793714 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f75240031f0 con 0x7f753c1401c0 2026-02-13T20:21:25.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.029+0000 7f7522ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:21:25.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.029+0000 7f7522ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:21:25.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.029+0000 7f7522ffd640 10 monclient(hunting): dump: 2026-02-13T20:21:25.048 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:25.048 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:25.048 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:25.048 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:25.048 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:25.048 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:25.048 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:25.048 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:25.048 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:25.048 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:25.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.030+0000 7f7522ffd640 1 -- 10.20.193.110:0/2986793714 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4101222356 0 0) 0x7f753c130b60 con 0x7f753c13f030 2026-02-13T20:21:25.049 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.030+0000 7f7522ffd640 1 -- 10.20.193.110:0/2986793714 >> v1:10.20.193.110:6790/0 conn(0x7f753c1401c0 legacy=0x7f753c1938d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:25.049 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.030+0000 7f7522ffd640 1 -- 10.20.193.110:0/2986793714 >> v1:10.20.193.188:6789/0 conn(0x7f753c091950 legacy=0x7f753c13e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:25.049 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.030+0000 7f7522ffd640 10 monclient: _finish_hunting 0 2026-02-13T20:21:25.049 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.030+0000 7f7522ffd640 1 monclient: found mon.a 2026-02-13T20:21:25.049 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.030+0000 7f7522ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:21:25.049 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.030+0000 7f7522ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:21:25.049 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.030+0000 7f7522ffd640 1 -- 10.20.193.110:0/2986793714 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f753c05d320 con 0x7f753c13f030 2026-02-13T20:21:25.049 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.030+0000 7f7522ffd640 10 monclient: _finish_auth 0 2026-02-13T20:21:25.049 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.030+0000 7f7522ffd640 10 monclient: _check_auth_tickets 2026-02-13T20:21:25.049 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.030+0000 7f7522ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:21:25.049 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.030+0000 7f7540f4c640 5 monclient: authenticate success, global_id 124116 2026-02-13T20:21:25.049 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.030+0000 7f7540f4c640 10 monclient: _renew_subs 2026-02-13T20:21:25.049 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.030+0000 7f7540f4c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:21:25.050 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.030+0000 7f7540f4c640 1 -- 10.20.193.110:0/2986793714 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f753c08c1e0 con 0x7f753c13f030 2026-02-13T20:21:25.050 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.030+0000 7f7540f4c640 10 monclient: _renew_subs 2026-02-13T20:21:25.050 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.030+0000 7f7540f4c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:21:25.050 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.030+0000 7f7540f4c640 1 -- 10.20.193.110:0/2986793714 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f753c131ac0 con 0x7f753c13f030 2026-02-13T20:21:25.050 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.030+0000 7f7522ffd640 1 -- 10.20.193.110:0/2986793714 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f752c0042f0 con 0x7f753c13f030 2026-02-13T20:21:25.050 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.030+0000 7f7522ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:21:25.050 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.030+0000 7f7522ffd640 1 -- 10.20.193.110:0/2986793714 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f752c0049e0 con 0x7f753c13f030 2026-02-13T20:21:25.050 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.030+0000 7f7522ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:25.050 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.030+0000 7f7522ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:21:25.050 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.030+0000 7f7522ffd640 10 monclient: dump: 2026-02-13T20:21:25.050 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:25.050 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:25.050 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:25.050 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:25.051 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:25.051 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:25.051 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:25.051 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:25.051 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:25.051 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:25.051 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.030+0000 7f7538d72640 4 set_mon_vals no callback set 2026-02-13T20:21:25.051 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.030+0000 7f7540f4c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:21:25.051 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.030+0000 7f7540f4c640 1 -- 10.20.193.110:0/2986793714 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f753c131cb0 con 0x7f753c092020 2026-02-13T20:21:25.051 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.030+0000 7f7522ffd640 1 -- 10.20.193.110:0/2986793714 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f752c004b40 con 0x7f753c13f030 2026-02-13T20:21:25.051 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.031+0000 7f7522ffd640 1 -- 10.20.193.110:0/2986793714 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(488..488 src has 1..488) ==== 3975+0+0 (unknown 3700913173 0 0) 0x7f752c04fa10 con 0x7f753c13f030 2026-02-13T20:21:25.051 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.031+0000 7f7522ffd640 1 -- 10.20.193.110:0/2986793714 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3238081858 0 0) 0x7f753c131cb0 con 0x7f753c092020 2026-02-13T20:21:25.051 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.031+0000 7f7522ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:21:25.051 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.031+0000 7f7522ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:25.052 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.031+0000 7f7522ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:25.052 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.031+0000 7f7522ffd640 10 monclient(hunting): my global_id is 4825 2026-02-13T20:21:25.052 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.031+0000 7f7522ffd640 1 -- 10.20.193.110:0/2986793714 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f753c130b60 con 0x7f753c092020 2026-02-13T20:21:25.052 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.031+0000 7f7539d74640 10 monclient: get_auth_request con 0x7f750803faa0 auth_method 0 2026-02-13T20:21:25.052 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.031+0000 7f7522ffd640 1 -- 10.20.193.110:0/2986793714 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3547271463 0 0) 0x7f753c130b60 con 0x7f753c092020 2026-02-13T20:21:25.052 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.031+0000 7f7522ffd640 1 -- 10.20.193.110:0/2986793714 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f753c131cb0 con 0x7f753c092020 2026-02-13T20:21:25.052 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.031+0000 7f7522ffd640 1 -- 10.20.193.110:0/2986793714 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f7530003300 con 0x7f753c092020 2026-02-13T20:21:25.052 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.031+0000 7f7522ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:25.052 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.031+0000 7f7522ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:21:25.052 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.031+0000 7f7522ffd640 10 monclient: dump: 2026-02-13T20:21:25.052 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:25.052 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:25.052 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:25.052 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:25.053 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:25.053 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:25.053 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:25.053 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:25.053 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:25.053 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:25.053 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.031+0000 7f7522ffd640 1 -- 10.20.193.110:0/2986793714 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 834416433 0 0) 0x7f753c131cb0 con 0x7f753c092020 2026-02-13T20:21:25.053 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.031+0000 7f7522ffd640 1 -- 10.20.193.110:0/2986793714 --> v1:10.20.193.188:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f753c08b450 con 0x7f753c092020 2026-02-13T20:21:25.053 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.031+0000 7f7522ffd640 1 -- 10.20.193.110:0/2986793714 <== mon.1 v1:10.20.193.188:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f7530002e50 con 0x7f753c092020 2026-02-13T20:21:25.053 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.031+0000 7f7522ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:21:25.053 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.031+0000 7f7522ffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:21:25.053 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.031+0000 7f7522ffd640 1 -- 10.20.193.110:0/2986793714 >> v1:10.20.193.188:6789/0 conn(0x7f753c092020 legacy=0x7f753c127b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:25.053 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.031+0000 7f7522ffd640 1 -- 10.20.193.110:0/2986793714 >> v1:10.20.193.188:6789/0 conn(0x7f753c092020 legacy=0x7f753c127b20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:21:25.054 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.035+0000 7f7540f4c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:21:25.054 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.035+0000 7f7540f4c640 1 -- 10.20.193.110:0/2986793714 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f753c055bb0 con 0x7f753c152840 2026-02-13T20:21:25.055 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.035+0000 7f7522ffd640 1 -- 10.20.193.110:0/2986793714 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 536661104 0 0) 0x7f753c055bb0 con 0x7f753c152840 2026-02-13T20:21:25.055 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.035+0000 7f7522ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:21:25.055 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.035+0000 7f7522ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:25.055 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.035+0000 7f7522ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:25.056 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.035+0000 7f7522ffd640 10 monclient(hunting): my global_id is 4828 2026-02-13T20:21:25.056 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.035+0000 7f7522ffd640 1 -- 10.20.193.110:0/2986793714 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f753c131cb0 con 0x7f753c152840 2026-02-13T20:21:25.056 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.036+0000 7f7522ffd640 1 -- 10.20.193.110:0/2986793714 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 428678921 0 0) 0x7f753c131cb0 con 0x7f753c152840 2026-02-13T20:21:25.056 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.036+0000 7f7522ffd640 1 -- 10.20.193.110:0/2986793714 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f753c055bb0 con 0x7f753c152840 2026-02-13T20:21:25.056 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.036+0000 7f7522ffd640 1 -- 10.20.193.110:0/2986793714 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f7530004d00 con 0x7f753c152840 2026-02-13T20:21:25.056 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.036+0000 7f7522ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:25.056 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.036+0000 7f7522ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:21:25.056 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.036+0000 7f7522ffd640 10 monclient: dump: 2026-02-13T20:21:25.056 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:25.056 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:25.056 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:25.056 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:25.056 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:25.056 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:25.056 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:25.057 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:25.057 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:25.057 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:25.057 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.036+0000 7f7522ffd640 1 -- 10.20.193.110:0/2986793714 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2676781805 0 0) 0x7f753c055bb0 con 0x7f753c152840 2026-02-13T20:21:25.057 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.036+0000 7f7522ffd640 1 -- 10.20.193.110:0/2986793714 --> v1:10.20.193.188:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f753c058410 con 0x7f753c152840 2026-02-13T20:21:25.057 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.036+0000 7f7522ffd640 1 -- 10.20.193.110:0/2986793714 <== mon.1 v1:10.20.193.188:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4683 (unknown 0 0 3241430863) 0x7f7530005990 con 0x7f753c152840 2026-02-13T20:21:25.057 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.036+0000 7f7522ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:21:25.057 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.036+0000 7f7522ffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:21:25.057 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.036+0000 7f7522ffd640 1 -- 10.20.193.110:0/2986793714 >> v1:10.20.193.188:6789/0 conn(0x7f753c152840 legacy=0x7f753c128230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:25.057 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.036+0000 7f7522ffd640 1 -- 10.20.193.110:0/2986793714 >> v1:10.20.193.188:6789/0 conn(0x7f753c152840 legacy=0x7f753c128230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:21:25.057 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:21:25.058 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:21:25.058 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:21:25.058 INFO:teuthology.orchestra.run.trial110.stdout: "state": "leader", 2026-02-13T20:21:25.058 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 38, 2026-02-13T20:21:25.058 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 607182, 2026-02-13T20:21:25.058 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:21:25.058 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:21:25.058 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:21:25.058 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:21:25.058 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:21:25.058 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 0, 2026-02-13T20:21:25.058 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:21:25.058 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:21:25.058 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:21:25.059 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:21:25.059 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:21:25.059 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:21:25.059 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:21:25.059 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:21:25.059 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:21:25.059 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:21:25.059 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:21:25.059 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:21:25.059 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:21:25.059 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:21:25.059 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:21:25.059 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:21:25.059 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:21:25.059 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:21:25.059 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:21:25.059 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:21:25.060 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:21:25.060 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:21:25.060 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:21:25.060 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:21:25.060 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:21:25.060 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:21:25.060 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:21:25.060 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:21:25.060 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:21:25.060 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:21:25.060 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:21:25.060 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:21:25.060 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:21:25.060 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:25.060 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:21:25.060 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:21:25.061 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:21:25.061 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:21:25.061 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:21:25.061 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:21:25.061 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:21:25.061 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:21:25.061 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:21:25.061 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:21:25.061 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:21:25.061 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:21:25.061 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:21:25.061 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:21:25.061 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:21:25.061 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:21:25.061 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:21:25.061 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:21:25.062 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:21:25.062 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:21:25.062 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:21:25.062 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:21:25.062 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:21:25.062 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:21:25.062 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:21:25.062 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:21:25.062 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:21:25.062 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:21:25.062 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:21:25.062 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:21:25.062 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:21:25.062 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:21:25.062 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:25.062 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:21:25.062 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:25.063 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:21:25.063 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:21:25.063 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:21:25.063 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:21:25.063 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:25.063 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:21:25.063 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:21:25.063 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:21:25.063 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:25.063 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:21:25.063 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:25.063 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:21:25.063 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:21:25.063 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:21:25.063 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:21:25.063 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:21:25.063 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:21:25.063 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:25.064 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:25.064 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:21:25.064 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:21:25.064 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:21:25.064 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:21:25.064 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:25.064 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:21:25.064 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:21:25.064 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:21:25.064 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:25.064 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:21:25.064 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:25.064 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:21:25.064 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:21:25.064 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:21:25.064 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:21:25.064 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:21:25.064 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:21:25.064 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:25.065 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:25.065 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:21:25.065 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:21:25.065 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:21:25.065 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:21:25.065 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:25.065 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:21:25.065 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:21:25.065 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:21:25.065 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:25.065 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:21:25.065 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:25.065 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:21:25.065 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:21:25.065 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:21:25.065 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:21:25.065 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:21:25.065 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:21:25.066 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:25.066 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:21:25.066 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:25.066 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:21:25.066 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:21:25.066 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:25.066 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:21:25.066 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:21:25.066 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:21:25.066 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:25.066 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:21:25.066 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:21:25.066 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:25.066 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:21:25.066 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:21:25.066 INFO:teuthology.orchestra.run.trial110.stdout: "num": 4 2026-02-13T20:21:25.066 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:25.066 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:21:25.066 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:21:25.066 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:25.067 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:21:25.067 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:21:25.067 INFO:teuthology.orchestra.run.trial110.stdout: "num": 6 2026-02-13T20:21:25.067 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:25.067 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:21:25.067 INFO:teuthology.orchestra.run.trial110.stdout: "mgr": [ 2026-02-13T20:21:25.067 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:25.067 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:21:25.067 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:21:25.067 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:21:25.067 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:25.067 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:21:25.067 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:25.067 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:21:25.067 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:21:25.068 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.036+0000 7f7540f4c640 1 -- 10.20.193.110:0/2986793714 >> v1:10.20.193.188:6812/1623052694 conn(0x7f750803faa0 legacy=0x7f750805ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:25.068 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.036+0000 7f7540f4c640 10 monclient: shutdown 2026-02-13T20:21:25.068 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.036+0000 7f7540f4c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:21:25.068 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.036+0000 7f7540f4c640 1 -- 10.20.193.110:0/2986793714 >> v1:10.20.193.110:6789/0 conn(0x7f753c13f030 legacy=0x7f753c194ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:25.068 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.036+0000 7f753ad76640 1 -- 10.20.193.110:0/2986793714 reap_dead start 2026-02-13T20:21:25.068 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.036+0000 7f7540f4c640 1 -- 10.20.193.110:0/2986793714 shutdown_connections 2026-02-13T20:21:25.069 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.036+0000 7f7540f4c640 1 -- 10.20.193.110:0/2986793714 >> 10.20.193.110:0/2986793714 conn(0x7f753c054e90 msgr2=0x7f753c08dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:21:25.069 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.036+0000 7f7540f4c640 1 -- 10.20.193.110:0/2986793714 shutdown_connections 2026-02-13T20:21:25.069 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.036+0000 7f7540f4c640 1 -- 10.20.193.110:0/2986793714 wait complete. 2026-02-13T20:21:25.069 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:21:25.069 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-13T20:21:25.069 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-13T20:21:25.095 INFO:tasks.rados.rados.0.trial188.stdout:2279: done (3 left) 2026-02-13T20:21:25.095 INFO:tasks.rados.rados.0.trial188.stdout:2280: write oid 37 current snap is 240 2026-02-13T20:21:25.095 INFO:tasks.rados.rados.0.trial188.stdout:2280: seq_num 808 ranges {780056=734610,2148980=726274,3322484=257572} 2026-02-13T20:21:25.101 INFO:tasks.rados.rados.0.trial188.stdout:2280: writing trial18843701-37 from 780056 to 1514666 tid 1 2026-02-13T20:21:25.106 INFO:tasks.rados.rados.0.trial188.stdout:2280: writing trial18843701-37 from 2148980 to 2875254 tid 2 2026-02-13T20:21:25.108 INFO:tasks.rados.rados.0.trial188.stdout:2280: writing trial18843701-37 from 3322484 to 3580056 tid 3 2026-02-13T20:21:25.108 INFO:tasks.rados.rados.0.trial188.stdout:2281: copy_from oid 7 from oid 34 current snap is 240 2026-02-13T20:21:25.108 INFO:tasks.rados.rados.0.trial188.stdout:2278: expect (ObjNum 760 snap 225 seq_num 760) 2026-02-13T20:21:25.108 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:21:25.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.132+0000 7fe38a94c640 10 monclient: get_monmap_and_config 2026-02-13T20:21:25.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.132+0000 7fe38a94c640 10 monclient: build_initial_monmap 2026-02-13T20:21:25.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.132+0000 7fe38a94c640 10 monclient: monmap: 2026-02-13T20:21:25.142 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:21:25.142 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:25.143 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:21:25.134217+0000 2026-02-13T20:21:25.143 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:21:25.134217+0000 2026-02-13T20:21:25.143 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:21:25.143 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:25.143 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:21:25.143 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:21:25.143 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:21:25.143 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:25.143 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.133+0000 7fe38a94c640 1 Processor -- start 2026-02-13T20:21:25.143 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.133+0000 7fe38a94c640 1 -- start start 2026-02-13T20:21:25.143 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.133+0000 7fe38a94c640 10 monclient: init 2026-02-13T20:21:25.144 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.133+0000 7fe38a94c640 10 monclient: _reopen_session rank -1 2026-02-13T20:21:25.144 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.133+0000 7fe38a94c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:21:25.144 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.133+0000 7fe38a94c640 10 monclient(hunting): picked mon.noname-a con 0x7fe38405cb60 addr v1:10.20.193.110:6789/0 2026-02-13T20:21:25.144 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.133+0000 7fe38a94c640 10 monclient(hunting): picked mon.noname-c con 0x7fe384162ce0 addr v1:10.20.193.188:6789/0 2026-02-13T20:21:25.144 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.133+0000 7fe38a94c640 10 monclient(hunting): picked mon.noname-b con 0x7fe3841847e0 addr v1:10.20.193.110:6790/0 2026-02-13T20:21:25.144 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.133+0000 7fe38a94c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe38408adf0 con 0x7fe38405cb60 2026-02-13T20:21:25.144 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.133+0000 7fe38a94c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe38408a900 con 0x7fe384162ce0 2026-02-13T20:21:25.144 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.133+0000 7fe38a94c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe38405bcb0 con 0x7fe3841847e0 2026-02-13T20:21:25.144 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.133+0000 7fe38a94c640 10 monclient(hunting): _renew_subs 2026-02-13T20:21:25.144 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.133+0000 7fe38a94c640 10 monclient(hunting): authenticate will time out at 1246.824622s 2026-02-13T20:21:25.144 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.133+0000 7fe383fff640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fe38405cb60 0x7fe384091dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:43948/0 (socket says 10.20.193.110:43948) 2026-02-13T20:21:25.145 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.133+0000 7fe383fff640 1 -- 10.20.193.110:0/3234306268 learned_addr learned my addr 10.20.193.110:0/3234306268 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:21:25.145 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.133+0000 7fe382ffd640 1 -- 10.20.193.110:0/3234306268 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3797219848 0 0) 0x7fe38405bcb0 con 0x7fe3841847e0 2026-02-13T20:21:25.145 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.133+0000 7fe382ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:21:25.145 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.133+0000 7fe382ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:25.145 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.133+0000 7fe382ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:25.145 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.133+0000 7fe382ffd640 10 monclient(hunting): my global_id is 94433 2026-02-13T20:21:25.145 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.133+0000 7fe382ffd640 1 -- 10.20.193.110:0/3234306268 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3680035e0 con 0x7fe3841847e0 2026-02-13T20:21:25.145 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.133+0000 7fe382ffd640 1 -- 10.20.193.110:0/3234306268 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2345120646 0 0) 0x7fe38408adf0 con 0x7fe38405cb60 2026-02-13T20:21:25.145 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.133+0000 7fe382ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:21:25.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.133+0000 7fe382ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:25.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.133+0000 7fe382ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:25.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.133+0000 7fe382ffd640 10 monclient(hunting): my global_id is 124119 2026-02-13T20:21:25.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.133+0000 7fe382ffd640 1 -- 10.20.193.110:0/3234306268 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe38405bcb0 con 0x7fe38405cb60 2026-02-13T20:21:25.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.134+0000 7fe382ffd640 1 -- 10.20.193.110:0/3234306268 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 182767197 0 0) 0x7fe3680035e0 con 0x7fe3841847e0 2026-02-13T20:21:25.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.134+0000 7fe382ffd640 1 -- 10.20.193.110:0/3234306268 >> v1:10.20.193.188:6789/0 conn(0x7fe384162ce0 legacy=0x7fe3841830c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:25.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.134+0000 7fe382ffd640 1 -- 10.20.193.110:0/3234306268 >> v1:10.20.193.110:6789/0 conn(0x7fe38405cb60 legacy=0x7fe384091dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:25.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.134+0000 7fe382ffd640 10 monclient: _finish_hunting 0 2026-02-13T20:21:25.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.134+0000 7fe382ffd640 1 monclient: found mon.noname-b 2026-02-13T20:21:25.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.134+0000 7fe382ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:21:25.146 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.134+0000 7fe382ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:21:25.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.134+0000 7fe382ffd640 1 -- 10.20.193.110:0/3234306268 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe38405a420 con 0x7fe3841847e0 2026-02-13T20:21:25.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.134+0000 7fe382ffd640 10 monclient: _finish_auth 0 2026-02-13T20:21:25.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.134+0000 7fe382ffd640 10 monclient: _check_auth_tickets 2026-02-13T20:21:25.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.134+0000 7fe382ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:21:25.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.134+0000 7fe382ffd640 1 -- 10.20.193.110:0/3234306268 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe378003eb0 con 0x7fe3841847e0 2026-02-13T20:21:25.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.134+0000 7fe382ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:25.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.134+0000 7fe382ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:21:25.147 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.134+0000 7fe382ffd640 10 monclient: dump: 2026-02-13T20:21:25.147 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:25.147 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:25.147 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:25.147 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:25.148 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:25.148 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:25.148 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:25.148 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:25.148 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:25.148 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:25.148 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.134+0000 7fe38a94c640 5 monclient: authenticate success, global_id 94433 2026-02-13T20:21:25.148 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.134+0000 7fe38a94c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:21:25.148 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.134+0000 7fe382ffd640 1 -- 10.20.193.110:0/3234306268 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe3780040b0 con 0x7fe3841847e0 2026-02-13T20:21:25.148 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.134+0000 7fe382ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:21:25.148 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.134+0000 7fe382ffd640 1 -- 10.20.193.110:0/3234306268 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe3780044c0 con 0x7fe3841847e0 2026-02-13T20:21:25.148 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.134+0000 7fe382ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:25.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.134+0000 7fe382ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:21:25.149 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.134+0000 7fe382ffd640 10 monclient: dump: 2026-02-13T20:21:25.149 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:25.149 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:25.149 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:25.149 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:25.149 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:25.149 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:25.149 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:25.149 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:25.150 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:25.150 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:25.150 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.134+0000 7fe38a94c640 10 monclient: get_monmap_and_config success 2026-02-13T20:21:25.150 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.134+0000 7fe38a94c640 4 set_mon_vals no callback set 2026-02-13T20:21:25.150 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.134+0000 7fe38a94c640 10 monclient: shutdown 2026-02-13T20:21:25.150 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.134+0000 7fe38a94c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:21:25.150 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.134+0000 7fe38a94c640 1 -- 10.20.193.110:0/3234306268 >> v1:10.20.193.110:6790/0 conn(0x7fe3841847e0 legacy=0x7fe3841a4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:25.150 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.134+0000 7fe38a94c640 1 -- 10.20.193.110:0/3234306268 shutdown_connections 2026-02-13T20:21:25.150 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.134+0000 7fe38a94c640 1 -- 10.20.193.110:0/3234306268 >> 10.20.193.110:0/3234306268 conn(0x7fe384054e90 msgr2=0x7fe384058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:21:25.150 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.134+0000 7fe38a94c640 1 -- 10.20.193.110:0/3234306268 shutdown_connections 2026-02-13T20:21:25.150 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.134+0000 7fe38a94c640 1 -- 10.20.193.110:0/3234306268 wait complete. 2026-02-13T20:21:25.150 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.134+0000 7fe38a94c640 10 monclient: build_initial_monmap 2026-02-13T20:21:25.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.134+0000 7fe38a94c640 10 monclient: monmap: 2026-02-13T20:21:25.151 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:21:25.151 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:21:25.151 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:21:25.151 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:21:25.151 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:21:25.151 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:21:25.151 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:21:25.151 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:21:25.151 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:21:25.151 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:25.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe38a94c640 1 Processor -- start 2026-02-13T20:21:25.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe38a94c640 1 -- start start 2026-02-13T20:21:25.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe38a94c640 10 monclient: init 2026-02-13T20:21:25.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe38a94c640 10 monclient: _reopen_session rank -1 2026-02-13T20:21:25.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe38a94c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:21:25.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe38a94c640 10 monclient(hunting): picked mon.noname-a con 0x7fe38405cb60 addr v1:10.20.193.110:6789/0 2026-02-13T20:21:25.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe38a94c640 10 monclient(hunting): picked mon.noname-c con 0x7fe384162ce0 addr v1:10.20.193.110:6790/0 2026-02-13T20:21:25.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe38a94c640 10 monclient(hunting): picked mon.noname-b con 0x7fe3841847e0 addr v1:10.20.193.188:6789/0 2026-02-13T20:21:25.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe38a94c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe38405d190 con 0x7fe38405cb60 2026-02-13T20:21:25.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe38a94c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3841684b0 con 0x7fe3841847e0 2026-02-13T20:21:25.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe38a94c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe384166150 con 0x7fe384162ce0 2026-02-13T20:21:25.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe38a94c640 10 monclient(hunting): _renew_subs 2026-02-13T20:21:25.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe38a94c640 10 monclient(hunting): authenticate will time out at 1246.826364s 2026-02-13T20:21:25.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe383fff640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fe38405cb60 0x7fe38417eb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:43964/0 (socket says 10.20.193.110:43964) 2026-02-13T20:21:25.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe383fff640 1 -- 10.20.193.110:0/3050110176 learned_addr learned my addr 10.20.193.110:0/3050110176 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:21:25.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe3837fe640 1 --1- 10.20.193.110:0/3050110176 >> v1:10.20.193.110:6790/0 conn(0x7fe384162ce0 0x7fe384150480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:33730/0 (socket says 10.20.193.110:33730) 2026-02-13T20:21:25.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe380ff9640 1 -- 10.20.193.110:0/3050110176 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2703642930 0 0) 0x7fe38405d190 con 0x7fe38405cb60 2026-02-13T20:21:25.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe380ff9640 10 monclient(hunting): _negotiate 2026-02-13T20:21:25.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe380ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:25.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe380ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:25.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe380ff9640 10 monclient(hunting): my global_id is 124122 2026-02-13T20:21:25.154 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe380ff9640 1 -- 10.20.193.110:0/3050110176 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3540035e0 con 0x7fe38405cb60 2026-02-13T20:21:25.154 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe380ff9640 1 -- 10.20.193.110:0/3050110176 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1349127673 0 0) 0x7fe384166150 con 0x7fe384162ce0 2026-02-13T20:21:25.154 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe380ff9640 10 monclient(hunting): _negotiate 2026-02-13T20:21:25.154 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe380ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:25.154 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe380ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:25.154 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe380ff9640 10 monclient(hunting): my global_id is 94436 2026-02-13T20:21:25.154 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe380ff9640 1 -- 10.20.193.110:0/3050110176 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe38405d190 con 0x7fe384162ce0 2026-02-13T20:21:25.154 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe380ff9640 1 -- 10.20.193.110:0/3050110176 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3785015331 0 0) 0x7fe38405d190 con 0x7fe384162ce0 2026-02-13T20:21:25.154 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe380ff9640 1 -- 10.20.193.110:0/3050110176 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe384166150 con 0x7fe384162ce0 2026-02-13T20:21:25.154 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe380ff9640 1 -- 10.20.193.110:0/3050110176 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1362037480 0 0) 0x7fe3540035e0 con 0x7fe38405cb60 2026-02-13T20:21:25.154 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe380ff9640 1 -- 10.20.193.110:0/3050110176 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe38405d190 con 0x7fe38405cb60 2026-02-13T20:21:25.154 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe380ff9640 1 -- 10.20.193.110:0/3050110176 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe374003020 con 0x7fe384162ce0 2026-02-13T20:21:25.154 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe380ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:21:25.155 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe380ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:21:25.155 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe380ff9640 10 monclient(hunting): dump: 2026-02-13T20:21:25.155 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:25.155 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:25.155 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:25.155 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:25.155 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:25.155 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:25.156 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:25.156 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:25.156 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:25.156 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:25.156 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe380ff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:21:25.156 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe380ff9640 1 -- 10.20.193.110:0/3050110176 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe3700031f0 con 0x7fe38405cb60 2026-02-13T20:21:25.156 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe380ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:21:25.156 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe380ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:21:25.156 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe380ff9640 10 monclient(hunting): dump: 2026-02-13T20:21:25.156 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:25.156 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:25.156 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:25.157 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:25.157 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:25.157 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:25.157 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:25.157 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:25.157 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:25.157 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:25.157 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe380ff9640 1 -- 10.20.193.110:0/3050110176 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3419458973 0 0) 0x7fe384166150 con 0x7fe384162ce0 2026-02-13T20:21:25.157 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe380ff9640 1 -- 10.20.193.110:0/3050110176 >> v1:10.20.193.188:6789/0 conn(0x7fe3841847e0 legacy=0x7fe384151ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:25.157 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe380ff9640 1 -- 10.20.193.110:0/3050110176 >> v1:10.20.193.110:6789/0 conn(0x7fe38405cb60 legacy=0x7fe38417eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:25.157 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe380ff9640 10 monclient: _finish_hunting 0 2026-02-13T20:21:25.157 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe380ff9640 1 monclient: found mon.c 2026-02-13T20:21:25.157 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe380ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:21:25.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe380ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:21:25.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe380ff9640 1 -- 10.20.193.110:0/3050110176 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe384167c10 con 0x7fe384162ce0 2026-02-13T20:21:25.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe380ff9640 10 monclient: _finish_auth 0 2026-02-13T20:21:25.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe380ff9640 10 monclient: _check_auth_tickets 2026-02-13T20:21:25.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe380ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:21:25.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe38a94c640 5 monclient: authenticate success, global_id 94436 2026-02-13T20:21:25.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe38a94c640 10 monclient: _renew_subs 2026-02-13T20:21:25.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe38a94c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:21:25.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe38a94c640 1 -- 10.20.193.110:0/3050110176 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe384167ef0 con 0x7fe384162ce0 2026-02-13T20:21:25.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe38a94c640 10 monclient: _renew_subs 2026-02-13T20:21:25.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe38a94c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:21:25.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.135+0000 7fe38a94c640 1 -- 10.20.193.110:0/3050110176 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fe384166cb0 con 0x7fe384162ce0 2026-02-13T20:21:25.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.136+0000 7fe380ff9640 1 -- 10.20.193.110:0/3050110176 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe374003180 con 0x7fe384162ce0 2026-02-13T20:21:25.159 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.136+0000 7fe380ff9640 10 monclient: handle_config config(0 keys) 2026-02-13T20:21:25.159 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.136+0000 7fe380ff9640 1 -- 10.20.193.110:0/3050110176 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe374003940 con 0x7fe384162ce0 2026-02-13T20:21:25.159 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.136+0000 7fe380ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:25.159 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.136+0000 7fe380ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:21:25.159 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.136+0000 7fe380ff9640 10 monclient: dump: 2026-02-13T20:21:25.159 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:25.159 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:25.159 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:25.159 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:25.159 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:25.159 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:25.159 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:25.159 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:25.160 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:25.160 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:25.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.136+0000 7fe3827fc640 4 set_mon_vals no callback set 2026-02-13T20:21:25.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.136+0000 7fe38a94c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:21:25.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.136+0000 7fe38a94c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:21:25.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.136+0000 7fe38a94c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:21:25.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.136+0000 7fe38a94c640 1 -- 10.20.193.110:0/3050110176 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3840008d0 con 0x7fe384162ce0 2026-02-13T20:21:25.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.136+0000 7fe380ff9640 1 -- 10.20.193.110:0/3050110176 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fe374003aa0 con 0x7fe384162ce0 2026-02-13T20:21:25.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.136+0000 7fe380ff9640 1 -- 10.20.193.110:0/3050110176 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(489..489 src has 1..489) ==== 3991+0+0 (unknown 4017973660 0 0) 0x7fe37404e8c0 con 0x7fe384162ce0 2026-02-13T20:21:25.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.136+0000 7fe383fff640 10 monclient: get_auth_request con 0x7fe35403fa80 auth_method 0 2026-02-13T20:21:25.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.138+0000 7fe380ff9640 1 -- 10.20.193.110:0/3050110176 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fe374004190 con 0x7fe384162ce0 2026-02-13T20:21:25.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.138+0000 7fe380ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:21:25.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.138+0000 7fe380ff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:21:25.161 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1007471 2026-02-13T20:21:25.167 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:21:25.198 INFO:tasks.rados.rados.0.trial188.stdout:2277: finishing write tid 1 to trial18843701-16 2026-02-13T20:21:25.198 INFO:tasks.rados.rados.0.trial188.stdout:2275: done (4 left) 2026-02-13T20:21:25.198 INFO:tasks.rados.rados.0.trial188.stdout:2278: done (3 left) 2026-02-13T20:21:25.198 INFO:tasks.rados.rados.0.trial188.stdout:2282: write oid 14 current snap is 240 2026-02-13T20:21:25.198 INFO:tasks.rados.rados.0.trial188.stdout:2277: finishing write tid 2 to trial18843701-16 2026-02-13T20:21:25.198 INFO:tasks.rados.rados.0.trial188.stdout:2277: finishing write tid 3 to trial18843701-16 2026-02-13T20:21:25.198 INFO:tasks.rados.rados.0.trial188.stdout:2282: seq_num 809 ranges {796863=409859,1807462=586285,3066260=530603} 2026-02-13T20:21:25.203 INFO:tasks.rados.rados.0.trial188.stdout:2282: writing trial18843701-14 from 796863 to 1206722 tid 1 2026-02-13T20:21:25.207 INFO:tasks.rados.rados.0.trial188.stdout:2282: writing trial18843701-14 from 1807462 to 2393747 tid 2 2026-02-13T20:21:25.212 INFO:tasks.rados.rados.0.trial188.stdout:2282: writing trial18843701-14 from 3066260 to 3596863 tid 3 2026-02-13T20:21:25.212 INFO:tasks.rados.rados.0.trial188.stdout:2283: snap_remove snap 229 2026-02-13T20:21:25.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.285+0000 7fe38a94c640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-13T20:21:25.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.285+0000 7fe38a94c640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-13T20:21:25.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.285+0000 7fe38a94c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:21:25.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.285+0000 7fe38a94c640 1 -- 10.20.193.110:0/3050110176 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fe384166fb0 con 0x7fe384162ce0 2026-02-13T20:21:25.288 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.286+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.288 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.286+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=19,config=2,health=12,kv=11,logm=56} crc {auth=2906928493,config=1618278320,health=2056113331,kv=1564860261,logm=834063624}) 2026-02-13T20:21:25.288 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.286+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=2,health=12,kv=9,logm=58} crc {auth=382089668,config=1618278320,health=2056113331,kv=783466703,logm=884206806}) 2026-02-13T20:21:25.288 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.286+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.288 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.286+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=19,config=2,health=12,kv=11,logm=56} crc {auth=2906928493,config=1618278320,health=2056113331,kv=1564860261,logm=834063624}) 2026-02-13T20:21:25.288 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.286+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=20,config=2,health=12,kv=10,logm=56} crc {auth=2163016417,config=1618278320,health=2319137676,kv=858650709,logm=4264780446}) 2026-02-13T20:21:25.288 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.286+0000 7fe380ff9640 1 -- 10.20.193.110:0/3050110176 <== mon.2 v1:10.20.193.110:6790/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7fe374016770 con 0x7fe384162ce0 2026-02-13T20:21:25.288 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.286+0000 7fe380ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-13T20:21:25.288 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.286+0000 7fe380ff9640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:21:25.289 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.286+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.289 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.286+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1059617479}) 2026-02-13T20:21:25.289 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.286+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2471708173}) 2026-02-13T20:21:25.289 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.286+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.289 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.287+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1059617479}) 2026-02-13T20:21:25.289 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.287+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2104215951}) 2026-02-13T20:21:25.289 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.287+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.289 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.287+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3626209803}) 2026-02-13T20:21:25.289 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.287+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1067637044}) 2026-02-13T20:21:25.289 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.287+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.290 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.287+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3626209803}) 2026-02-13T20:21:25.290 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.287+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1185679221}) 2026-02-13T20:21:25.290 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.288+0000 7fe38a94c640 1 -- 10.20.193.110:0/3050110176 >> v1:10.20.193.188:6812/1623052694 conn(0x7fe35403fa80 legacy=0x7fe35405ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:25.290 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.288+0000 7fe38a94c640 10 monclient: shutdown 2026-02-13T20:21:25.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.288+0000 7fe38a94c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:21:25.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.288+0000 7fe38a94c640 1 -- 10.20.193.110:0/3050110176 >> v1:10.20.193.110:6790/0 conn(0x7fe384162ce0 legacy=0x7fe384150480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:25.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.288+0000 7fe38a94c640 1 -- 10.20.193.110:0/3050110176 shutdown_connections 2026-02-13T20:21:25.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.288+0000 7fe38a94c640 1 -- 10.20.193.110:0/3050110176 >> 10.20.193.110:0/3050110176 conn(0x7fe384054e90 msgr2=0x7fe384180940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:21:25.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.288+0000 7fe38a94c640 1 -- 10.20.193.110:0/3050110176 shutdown_connections 2026-02-13T20:21:25.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:25.288+0000 7fe38a94c640 1 -- 10.20.193.110:0/3050110176 wait complete. 2026-02-13T20:21:25.292 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.288+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.292 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.288+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2300859962}) 2026-02-13T20:21:25.292 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.288+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1982497829}) 2026-02-13T20:21:25.292 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.288+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.292 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.288+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2300859962}) 2026-02-13T20:21:25.292 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.288+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1697879054}) 2026-02-13T20:21:25.292 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.288+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.292 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.288+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2105848804}) 2026-02-13T20:21:25.292 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.288+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4281798400}) 2026-02-13T20:21:25.293 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.288+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.293 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.288+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2105848804}) 2026-02-13T20:21:25.293 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.288+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1930584469}) 2026-02-13T20:21:25.293 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.289+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.293 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.289+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4220792321}) 2026-02-13T20:21:25.293 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.289+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2380344472}) 2026-02-13T20:21:25.293 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.289+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.293 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.289+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4220792321}) 2026-02-13T20:21:25.293 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.289+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3077257065}) 2026-02-13T20:21:25.293 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.289+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.293 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.289+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1377154685}) 2026-02-13T20:21:25.293 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.289+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2900302684}) 2026-02-13T20:21:25.293 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.289+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.293 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.289+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1377154685}) 2026-02-13T20:21:25.293 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.289+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2844454773}) 2026-02-13T20:21:25.293 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.289+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.293 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.289+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3585899547}) 2026-02-13T20:21:25.293 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.289+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3307937534}) 2026-02-13T20:21:25.293 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.290+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.293 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.290+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3585899547}) 2026-02-13T20:21:25.293 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.290+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4108146971}) 2026-02-13T20:21:25.293 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.290+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.293 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.290+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1250037204}) 2026-02-13T20:21:25.293 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.290+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=971773260}) 2026-02-13T20:21:25.293 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.290+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.293 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.290+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1250037204}) 2026-02-13T20:21:25.293 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.290+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2735999154}) 2026-02-13T20:21:25.293 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.290+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.293 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.290+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1525064588}) 2026-02-13T20:21:25.293 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.290+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3975573040}) 2026-02-13T20:21:25.293 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.290+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.293 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.290+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1525064588}) 2026-02-13T20:21:25.293 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.290+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1890042871}) 2026-02-13T20:21:25.294 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.291+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.294 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.291+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3342339593}) 2026-02-13T20:21:25.294 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.291+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=981539751}) 2026-02-13T20:21:25.294 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.291+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.294 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.291+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3342339593}) 2026-02-13T20:21:25.294 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.291+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=33236883}) 2026-02-13T20:21:25.294 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.291+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.294 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.291+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2991608848}) 2026-02-13T20:21:25.294 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.291+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3651281288}) 2026-02-13T20:21:25.294 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.291+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.294 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.291+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2991608848}) 2026-02-13T20:21:25.294 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.291+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=813773334}) 2026-02-13T20:21:25.294 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.292+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.294 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.292+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=56941719}) 2026-02-13T20:21:25.294 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.292+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1908777679}) 2026-02-13T20:21:25.294 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.292+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.294 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.292+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=56941719}) 2026-02-13T20:21:25.294 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.292+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2005164670}) 2026-02-13T20:21:25.294 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.292+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.294 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.292+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1165783260}) 2026-02-13T20:21:25.294 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.292+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=867805916}) 2026-02-13T20:21:25.295 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.292+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.295 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.292+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1165783260}) 2026-02-13T20:21:25.295 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.292+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1583147856}) 2026-02-13T20:21:25.295 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.292+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.295 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.292+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3312807677}) 2026-02-13T20:21:25.295 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.292+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3900523290}) 2026-02-13T20:21:25.295 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.292+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.295 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.292+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3312807677}) 2026-02-13T20:21:25.295 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.292+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3946631236}) 2026-02-13T20:21:25.295 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.293+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.295 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.293+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3654440443}) 2026-02-13T20:21:25.295 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.293+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=425556192}) 2026-02-13T20:21:25.295 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.293+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.295 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.293+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3654440443}) 2026-02-13T20:21:25.295 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.293+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1277487653}) 2026-02-13T20:21:25.295 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.293+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.295 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.293+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1344115009}) 2026-02-13T20:21:25.295 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.293+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2419222611}) 2026-02-13T20:21:25.295 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.293+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.295 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.293+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1344115009}) 2026-02-13T20:21:25.295 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.293+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2267273553}) 2026-02-13T20:21:25.296 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.294+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.296 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.294+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2082051514}) 2026-02-13T20:21:25.296 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.294+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1778366669}) 2026-02-13T20:21:25.296 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.294+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.296 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.294+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2082051514}) 2026-02-13T20:21:25.296 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.294+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=932956696}) 2026-02-13T20:21:25.296 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.294+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.296 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.294+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3541347212}) 2026-02-13T20:21:25.296 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.294+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2954238195}) 2026-02-13T20:21:25.296 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.294+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.296 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.294+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3541347212}) 2026-02-13T20:21:25.296 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.294+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=263905836}) 2026-02-13T20:21:25.296 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.295+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.296 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.295+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2066354862}) 2026-02-13T20:21:25.296 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.295+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=22016943}) 2026-02-13T20:21:25.297 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.295+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.297 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.295+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2066354862}) 2026-02-13T20:21:25.297 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.295+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4034096825}) 2026-02-13T20:21:25.297 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-13T20:21:25.297 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.295+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.297 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.295+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=17,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=39} crc {logm=2899756898,mdsmap=3740562891,mgr=2881591710,mgr_command_descs=714296370,mgr_metadata=2819730505,mgrstat=3664367256,mon_config_key=3557484700,monmap=207866894,nvmeofgw=3360707892,osd_metadata=91123727,osd_pg_creating=3333651956,osd_snap=3990326732}) 2026-02-13T20:21:25.298 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.295+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=16,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=41} crc {logm=3674999109,mdsmap=3740562891,mgr=2881591710,mgr_command_descs=714296370,mgr_metadata=2819730505,mgrstat=2791247512,mon_config_key=3557484700,monmap=207866894,nvmeofgw=3360707892,osd_metadata=1545036448,osd_pg_creating=3333651956,osd_snap=3659306592}) 2026-02-13T20:21:25.298 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.295+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.298 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.295+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=17,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=39} crc {logm=2899756898,mdsmap=3740562891,mgr=2881591710,mgr_command_descs=714296370,mgr_metadata=2819730505,mgrstat=3664367256,mon_config_key=3557484700,monmap=207866894,nvmeofgw=3360707892,osd_metadata=91123727,osd_pg_creating=3333651956,osd_snap=3990326732}) 2026-02-13T20:21:25.298 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.295+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=19,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=38} crc {logm=2600903757,mdsmap=3740562891,mgr=2881591710,mgr_command_descs=714296370,mgr_metadata=2819730505,mgrstat=3163040725,mon_config_key=2842513939,monmap=207866894,nvmeofgw=3360707892,osd_metadata=91123727,osd_pg_creating=3333651956,osd_snap=1688594254}) 2026-02-13T20:21:25.298 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.296+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.298 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.296+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=62,osdmap=38} crc {osd_snap=413230289,osdmap=3083693664}) 2026-02-13T20:21:25.298 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.296+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=61,osdmap=39} crc {osd_snap=199318146,osdmap=1892295874}) 2026-02-13T20:21:25.298 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.296+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.298 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.296+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=62,osdmap=38} crc {osd_snap=413230289,osdmap=3083693664}) 2026-02-13T20:21:25.298 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.296+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=56,osdmap=44} crc {osd_snap=1169417930,osdmap=1144893805}) 2026-02-13T20:21:25.298 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.296+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.298 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.296+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3055665569}) 2026-02-13T20:21:25.298 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.296+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1311289402}) 2026-02-13T20:21:25.298 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.296+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.298 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.296+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3055665569}) 2026-02-13T20:21:25.298 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.296+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1866896966}) 2026-02-13T20:21:25.298 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.297+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.298 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.297+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3056809375}) 2026-02-13T20:21:25.299 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.297+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3780779661}) 2026-02-13T20:21:25.299 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.297+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.299 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.297+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3056809375}) 2026-02-13T20:21:25.299 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.297+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=4159941871}) 2026-02-13T20:21:25.299 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.297+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.299 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.297+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2740825610}) 2026-02-13T20:21:25.299 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.297+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=307309759}) 2026-02-13T20:21:25.299 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.297+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.299 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.297+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2740825610}) 2026-02-13T20:21:25.299 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.297+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=158827847}) 2026-02-13T20:21:25.299 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.298+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.299 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.298+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3147870894}) 2026-02-13T20:21:25.299 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.298+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1013384934}) 2026-02-13T20:21:25.299 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.298+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.299 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.298+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3147870894}) 2026-02-13T20:21:25.299 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.298+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3103417028}) 2026-02-13T20:21:25.300 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.298+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.300 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.298+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1367560776}) 2026-02-13T20:21:25.300 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.298+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1095672617}) 2026-02-13T20:21:25.300 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.298+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.300 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.298+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1367560776}) 2026-02-13T20:21:25.300 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.298+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2177968932}) 2026-02-13T20:21:25.301 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.299+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.301 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.299+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3580656742}) 2026-02-13T20:21:25.301 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.299+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3894908596}) 2026-02-13T20:21:25.301 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.299+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.301 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.299+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3580656742}) 2026-02-13T20:21:25.301 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.299+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3220758375}) 2026-02-13T20:21:25.303 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.301+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.303 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.301+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=73} crc {osdmap=425852590}) 2026-02-13T20:21:25.303 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.301+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=73} crc {osdmap=1623758667}) 2026-02-13T20:21:25.303 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.301+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:21:25.303 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.301+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=73} crc {osdmap=425852590}) 2026-02-13T20:21:25.303 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:21:25.301+0000 7fd3ce1f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=72} crc {osdmap=3493911790}) 2026-02-13T20:21:26.104 INFO:tasks.rados.rados.0.trial188.stdout:2283: done (4 left) 2026-02-13T20:21:26.104 INFO:tasks.rados.rados.0.trial188.stdout:2284: read oid 15 snap -1 2026-02-13T20:21:26.105 INFO:tasks.rados.rados.0.trial188.stdout:2284: expect (ObjNum 786 snap 234 seq_num 786) 2026-02-13T20:21:26.105 INFO:tasks.rados.rados.0.trial188.stdout:2285: read oid 8 snap 236 2026-02-13T20:21:26.105 INFO:tasks.rados.rados.0.trial188.stdout:2285: expect (ObjNum 623 snap 166 seq_num 623) 2026-02-13T20:21:26.105 INFO:tasks.rados.rados.0.trial188.stdout:2286: rollback oid 21 current snap is 240 2026-02-13T20:21:26.105 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 21 to 239 2026-02-13T20:21:26.105 INFO:tasks.rados.rados.0.trial188.stdout:2277: finishing write tid 4 to trial18843701-16 2026-02-13T20:21:26.105 INFO:tasks.rados.rados.0.trial188.stdout:2277: finishing write tid 5 to trial18843701-16 2026-02-13T20:21:26.105 INFO:tasks.rados.rados.0.trial188.stdout:2277: oid 16 updating version 0 to 1021 2026-02-13T20:21:26.105 INFO:tasks.rados.rados.0.trial188.stdout:2277: oid 16 version 1021 is already newer than 1018 2026-02-13T20:21:26.105 INFO:tasks.rados.rados.0.trial188.stdout:2277: oid 16 version 1021 is already newer than 1020 2026-02-13T20:21:26.106 INFO:tasks.rados.rados.0.trial188.stdout:2277: oid 16 version 1021 is already newer than 1019 2026-02-13T20:21:26.106 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 16 v 1021 (ObjNum 807 snap 240 seq_num 807) dirty exists 2026-02-13T20:21:26.106 INFO:tasks.rados.rados.0.trial188.stdout:2277: left oid 16 (ObjNum 807 snap 240 seq_num 807) 2026-02-13T20:21:26.106 INFO:tasks.rados.rados.0.trial188.stdout:2277: done (6 left) 2026-02-13T20:21:26.106 INFO:tasks.rados.rados.0.trial188.stdout:2287: write oid 43 current snap is 240 2026-02-13T20:21:26.106 INFO:tasks.rados.rados.0.trial188.stdout:2280: finishing write tid 1 to trial18843701-37 2026-02-13T20:21:26.106 INFO:tasks.rados.rados.0.trial188.stdout:2280: finishing write tid 2 to trial18843701-37 2026-02-13T20:21:26.106 INFO:tasks.rados.rados.0.trial188.stdout:2280: finishing write tid 3 to trial18843701-37 2026-02-13T20:21:26.106 INFO:tasks.rados.rados.0.trial188.stdout:2280: finishing write tid 4 to trial18843701-37 2026-02-13T20:21:26.106 INFO:tasks.rados.rados.0.trial188.stdout:2280: finishing write tid 5 to trial18843701-37 2026-02-13T20:21:26.106 INFO:tasks.rados.rados.0.trial188.stdout:2280: oid 37 updating version 0 to 995 2026-02-13T20:21:26.107 INFO:tasks.rados.rados.0.trial188.stdout:2280: oid 37 version 995 is already newer than 994 2026-02-13T20:21:26.107 INFO:tasks.rados.rados.0.trial188.stdout:2280: oid 37 updating version 995 to 996 2026-02-13T20:21:26.107 INFO:tasks.rados.rados.0.trial188.stdout:2280: oid 37 updating version 996 to 997 2026-02-13T20:21:26.107 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 37 v 997 (ObjNum 808 snap 240 seq_num 808) dirty exists 2026-02-13T20:21:26.107 INFO:tasks.rados.rados.0.trial188.stdout:2280: left oid 37 (ObjNum 808 snap 240 seq_num 808) 2026-02-13T20:21:26.107 INFO:tasks.rados.rados.0.trial188.stdout:2281: finishing copy_from racing read to trial18843701-7 2026-02-13T20:21:26.107 INFO:tasks.rados.rados.0.trial188.stdout:2287: seq_num 810 ranges {413670=485108,1465944=729943,2977330=524801} 2026-02-13T20:21:26.107 INFO:tasks.rados.rados.0.trial188.stdout:2287: writing trial18843701-43 from 413670 to 898778 tid 1 2026-02-13T20:21:26.111 INFO:tasks.rados.rados.0.trial188.stdout:2287: writing trial18843701-43 from 1465944 to 2195887 tid 2 2026-02-13T20:21:26.117 INFO:tasks.rados.rados.0.trial188.stdout:2287: writing trial18843701-43 from 2977330 to 3502131 tid 3 2026-02-13T20:21:26.117 INFO:tasks.rados.rados.0.trial188.stdout:2280: done (6 left) 2026-02-13T20:21:26.117 INFO:tasks.rados.rados.0.trial188.stdout:2288: read oid 13 snap 215 2026-02-13T20:21:26.117 INFO:tasks.rados.rados.0.trial188.stdout:2288: expect (ObjNum 618 snap 163 seq_num 618) 2026-02-13T20:21:26.117 INFO:tasks.rados.rados.0.trial188.stdout:2289: read oid 46 snap -1 2026-02-13T20:21:26.117 INFO:tasks.rados.rados.0.trial188.stdout:2289: expect (ObjNum 723 snap 214 seq_num 723) 2026-02-13T20:21:26.117 INFO:tasks.rados.rados.0.trial188.stdout:2290: snap_remove snap 211 2026-02-13T20:21:26.298 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-13T20:21:26.298 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T20:21:26.369 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.362+0000 7ff8035dd640 10 monclient: get_monmap_and_config 2026-02-13T20:21:26.369 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.362+0000 7ff8035dd640 10 monclient: build_initial_monmap 2026-02-13T20:21:26.369 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.362+0000 7ff8035dd640 10 monclient: monmap: 2026-02-13T20:21:26.370 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:21:26.370 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:26.370 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:21:26.363924+0000 2026-02-13T20:21:26.370 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:21:26.363924+0000 2026-02-13T20:21:26.370 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:21:26.370 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:26.370 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:21:26.370 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:21:26.370 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:21:26.370 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:26.370 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.362+0000 7ff8035dd640 1 Processor -- start 2026-02-13T20:21:26.371 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.362+0000 7ff8035dd640 1 -- start start 2026-02-13T20:21:26.371 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.362+0000 7ff8035dd640 10 monclient: init 2026-02-13T20:21:26.371 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff8035dd640 10 monclient: _reopen_session rank -1 2026-02-13T20:21:26.371 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff8035dd640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:21:26.371 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff8035dd640 10 monclient(hunting): picked mon.noname-c con 0x7ff7fc1401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:21:26.371 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff8035dd640 10 monclient(hunting): picked mon.noname-b con 0x7ff7fc092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:21:26.371 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff8035dd640 10 monclient(hunting): picked mon.noname-a con 0x7ff7fc091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:21:26.371 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff8035dd640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7fc08b730 con 0x7ff7fc091950 2026-02-13T20:21:26.371 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff8035dd640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7fc05c5b0 con 0x7ff7fc1401c0 2026-02-13T20:21:26.371 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff8035dd640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7fc08bcf0 con 0x7ff7fc092020 2026-02-13T20:21:26.371 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff8035dd640 10 monclient(hunting): _renew_subs 2026-02-13T20:21:26.371 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff8035dd640 10 monclient(hunting): authenticate will time out at 1248.054273s 2026-02-13T20:21:26.372 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff800b51640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7ff7fc092020 0x7ff7fc1812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:33732/0 (socket says 10.20.193.110:33732) 2026-02-13T20:21:26.372 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff800b51640 1 -- 10.20.193.110:0/731367465 learned_addr learned my addr 10.20.193.110:0/731367465 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:21:26.372 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff7ebfff640 1 -- 10.20.193.110:0/731367465 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 489950815 0 0) 0x7ff7fc08bcf0 con 0x7ff7fc092020 2026-02-13T20:21:26.372 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff7ebfff640 10 monclient(hunting): _negotiate 2026-02-13T20:21:26.372 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff7ebfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:26.372 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff7ebfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:26.372 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff7ebfff640 10 monclient(hunting): my global_id is 94439 2026-02-13T20:21:26.372 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff7ebfff640 1 -- 10.20.193.110:0/731367465 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff7e40035e0 con 0x7ff7fc092020 2026-02-13T20:21:26.372 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff7ebfff640 1 -- 10.20.193.110:0/731367465 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2899724159 0 0) 0x7ff7fc08b730 con 0x7ff7fc091950 2026-02-13T20:21:26.372 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff7ebfff640 10 monclient(hunting): _negotiate 2026-02-13T20:21:26.372 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff7ebfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:26.372 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff7ebfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:26.373 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff7ebfff640 10 monclient(hunting): my global_id is 124125 2026-02-13T20:21:26.373 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff7ebfff640 1 -- 10.20.193.110:0/731367465 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff7fc08bcf0 con 0x7ff7fc091950 2026-02-13T20:21:26.373 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff7ebfff640 1 -- 10.20.193.110:0/731367465 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3315648141 0 0) 0x7ff7e40035e0 con 0x7ff7fc092020 2026-02-13T20:21:26.373 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff7ebfff640 1 -- 10.20.193.110:0/731367465 >> v1:10.20.193.188:6789/0 conn(0x7ff7fc1401c0 legacy=0x7ff7fc091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:26.373 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff7ebfff640 1 -- 10.20.193.110:0/731367465 >> v1:10.20.193.110:6789/0 conn(0x7ff7fc091950 legacy=0x7ff7fc1a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:26.373 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff7ebfff640 10 monclient: _finish_hunting 0 2026-02-13T20:21:26.373 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff7ebfff640 1 monclient: found mon.noname-b 2026-02-13T20:21:26.373 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff7ebfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:21:26.373 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff7ebfff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:21:26.373 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff7ebfff640 1 -- 10.20.193.110:0/731367465 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7fc140590 con 0x7ff7fc092020 2026-02-13T20:21:26.373 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff7ebfff640 10 monclient: _finish_auth 0 2026-02-13T20:21:26.373 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff7ebfff640 10 monclient: _check_auth_tickets 2026-02-13T20:21:26.374 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff7ebfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:21:26.374 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff7ebfff640 1 -- 10.20.193.110:0/731367465 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff7f0002dd0 con 0x7ff7fc092020 2026-02-13T20:21:26.374 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff7ebfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:26.374 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff7ebfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:21:26.374 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff7ebfff640 10 monclient: dump: 2026-02-13T20:21:26.374 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:26.374 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:26.374 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.374 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.374 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:26.374 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:26.374 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:26.375 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:26.375 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:26.375 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:26.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff8035dd640 5 monclient: authenticate success, global_id 94439 2026-02-13T20:21:26.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff8035dd640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:21:26.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff7ebfff640 1 -- 10.20.193.110:0/731367465 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff7f0003020 con 0x7ff7fc092020 2026-02-13T20:21:26.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff7ebfff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:21:26.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff8035dd640 10 monclient: get_monmap_and_config success 2026-02-13T20:21:26.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff7ebfff640 1 -- 10.20.193.110:0/731367465 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff7f0003430 con 0x7ff7fc092020 2026-02-13T20:21:26.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff8035dd640 4 set_mon_vals no callback set 2026-02-13T20:21:26.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff7ebfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:26.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff7ebfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:21:26.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff7ebfff640 10 monclient: dump: 2026-02-13T20:21:26.376 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:26.376 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:26.376 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.376 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.376 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:26.376 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:26.376 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:26.376 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:26.376 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:26.376 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:26.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff8035dd640 10 monclient: shutdown 2026-02-13T20:21:26.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff8035dd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:21:26.377 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.363+0000 7ff8035dd640 1 -- 10.20.193.110:0/731367465 >> v1:10.20.193.110:6790/0 conn(0x7ff7fc092020 legacy=0x7ff7fc1812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:26.377 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.364+0000 7ff8035dd640 1 -- 10.20.193.110:0/731367465 shutdown_connections 2026-02-13T20:21:26.377 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.364+0000 7ff8035dd640 1 -- 10.20.193.110:0/731367465 >> 10.20.193.110:0/731367465 conn(0x7ff7fc054e90 msgr2=0x7ff7fc058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:21:26.377 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.364+0000 7ff8035dd640 1 -- 10.20.193.110:0/731367465 shutdown_connections 2026-02-13T20:21:26.377 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.364+0000 7ff8035dd640 1 -- 10.20.193.110:0/731367465 wait complete. 2026-02-13T20:21:26.377 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.364+0000 7ff8035dd640 10 monclient: build_initial_monmap 2026-02-13T20:21:26.377 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.364+0000 7ff8035dd640 10 monclient: monmap: 2026-02-13T20:21:26.377 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:21:26.377 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:21:26.377 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:21:26.377 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:21:26.378 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:21:26.378 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:21:26.378 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:21:26.378 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:21:26.378 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:21:26.378 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:26.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.364+0000 7ff8035dd640 1 Processor -- start 2026-02-13T20:21:26.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.364+0000 7ff8035dd640 1 -- start start 2026-02-13T20:21:26.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.364+0000 7ff8035dd640 10 monclient: init 2026-02-13T20:21:26.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.364+0000 7ff8035dd640 10 monclient: _reopen_session rank -1 2026-02-13T20:21:26.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.364+0000 7ff8035dd640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:21:26.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.364+0000 7ff8035dd640 10 monclient(hunting): picked mon.noname-c con 0x7ff7fc091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:21:26.378 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.364+0000 7ff8035dd640 10 monclient(hunting): picked mon.noname-b con 0x7ff7fc1401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:21:26.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.364+0000 7ff8035dd640 10 monclient(hunting): picked mon.noname-a con 0x7ff7fc12c260 addr v1:10.20.193.110:6789/0 2026-02-13T20:21:26.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.364+0000 7ff8035dd640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7fc13f540 con 0x7ff7fc12c260 2026-02-13T20:21:26.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.364+0000 7ff8035dd640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7fc08c3f0 con 0x7ff7fc1401c0 2026-02-13T20:21:26.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.364+0000 7ff8035dd640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7fc12da60 con 0x7ff7fc091950 2026-02-13T20:21:26.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.364+0000 7ff8035dd640 10 monclient(hunting): _renew_subs 2026-02-13T20:21:26.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.364+0000 7ff8035dd640 10 monclient(hunting): authenticate will time out at 1248.055815s 2026-02-13T20:21:26.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.364+0000 7ff801352640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7ff7fc091950 0x7ff7fc129d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:33742/0 (socket says 10.20.193.110:33742) 2026-02-13T20:21:26.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.364+0000 7ff801352640 1 -- 10.20.193.110:0/3222637993 learned_addr learned my addr 10.20.193.110:0/3222637993 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:21:26.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff7e9ffb640 1 -- 10.20.193.110:0/3222637993 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4292751317 0 0) 0x7ff7fc12da60 con 0x7ff7fc091950 2026-02-13T20:21:26.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff7e9ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:21:26.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff7e9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:26.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff7e9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:26.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff7e9ffb640 10 monclient(hunting): my global_id is 94442 2026-02-13T20:21:26.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff7e9ffb640 1 -- 10.20.193.110:0/3222637993 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff7cc0035e0 con 0x7ff7fc091950 2026-02-13T20:21:26.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff7e9ffb640 1 -- 10.20.193.110:0/3222637993 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3204276976 0 0) 0x7ff7fc13f540 con 0x7ff7fc12c260 2026-02-13T20:21:26.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff7e9ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:21:26.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff7e9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:26.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff7e9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:26.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff7e9ffb640 10 monclient(hunting): my global_id is 124128 2026-02-13T20:21:26.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff7e9ffb640 1 -- 10.20.193.110:0/3222637993 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff7fc12da60 con 0x7ff7fc12c260 2026-02-13T20:21:26.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff7e9ffb640 1 -- 10.20.193.110:0/3222637993 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 7081326 0 0) 0x7ff7cc0035e0 con 0x7ff7fc091950 2026-02-13T20:21:26.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff7e9ffb640 1 -- 10.20.193.110:0/3222637993 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff7fc13f540 con 0x7ff7fc091950 2026-02-13T20:21:26.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff7e9ffb640 1 -- 10.20.193.110:0/3222637993 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff7ec003170 con 0x7ff7fc091950 2026-02-13T20:21:26.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff7e9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:21:26.381 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff7e9ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:21:26.381 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff7e9ffb640 10 monclient(hunting): dump: 2026-02-13T20:21:26.381 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:26.381 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:26.381 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.381 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.381 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:26.381 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:26.381 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:26.381 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:26.381 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:26.381 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:26.381 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff7e9ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:21:26.382 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff7e9ffb640 1 -- 10.20.193.110:0/3222637993 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4114055797 0 0) 0x7ff7fc12da60 con 0x7ff7fc12c260 2026-02-13T20:21:26.382 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff7e9ffb640 1 -- 10.20.193.110:0/3222637993 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff7cc0035e0 con 0x7ff7fc12c260 2026-02-13T20:21:26.382 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff7e9ffb640 1 -- 10.20.193.110:0/3222637993 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff7f8004170 con 0x7ff7fc12c260 2026-02-13T20:21:26.382 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff7e9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:21:26.382 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff7e9ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:21:26.382 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff7e9ffb640 10 monclient(hunting): dump: 2026-02-13T20:21:26.382 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:26.382 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:26.382 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.382 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.382 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:26.382 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:26.383 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:26.383 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:26.383 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:26.383 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:26.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff7e9ffb640 1 -- 10.20.193.110:0/3222637993 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 663797584 0 0) 0x7ff7fc13f540 con 0x7ff7fc091950 2026-02-13T20:21:26.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff7e9ffb640 1 -- 10.20.193.110:0/3222637993 >> v1:10.20.193.188:6789/0 conn(0x7ff7fc1401c0 legacy=0x7ff7fc12a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:26.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff7e9ffb640 1 -- 10.20.193.110:0/3222637993 >> v1:10.20.193.110:6789/0 conn(0x7ff7fc12c260 legacy=0x7ff7fc1a2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:26.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff7e9ffb640 10 monclient: _finish_hunting 0 2026-02-13T20:21:26.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff7e9ffb640 1 monclient: found mon.c 2026-02-13T20:21:26.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff7e9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:21:26.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff7e9ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:21:26.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff7e9ffb640 1 -- 10.20.193.110:0/3222637993 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7fc12aba0 con 0x7ff7fc091950 2026-02-13T20:21:26.384 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff7e9ffb640 10 monclient: _finish_auth 0 2026-02-13T20:21:26.384 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff7e9ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:21:26.384 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff7e9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:21:26.384 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff8035dd640 5 monclient: authenticate success, global_id 94442 2026-02-13T20:21:26.384 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff8035dd640 10 monclient: _renew_subs 2026-02-13T20:21:26.384 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff8035dd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:21:26.384 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff8035dd640 1 -- 10.20.193.110:0/3222637993 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff7fc05d320 con 0x7ff7fc091950 2026-02-13T20:21:26.384 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff8035dd640 10 monclient: _renew_subs 2026-02-13T20:21:26.384 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff8035dd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:21:26.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff8035dd640 1 -- 10.20.193.110:0/3222637993 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7ff7fc12b700 con 0x7ff7fc091950 2026-02-13T20:21:26.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff7e9ffb640 1 -- 10.20.193.110:0/3222637993 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff7ec0034e0 con 0x7ff7fc091950 2026-02-13T20:21:26.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff7e9ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T20:21:26.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff7e9ffb640 1 -- 10.20.193.110:0/3222637993 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff7ec003b30 con 0x7ff7fc091950 2026-02-13T20:21:26.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff7e9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:26.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff7e9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:21:26.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff7e9ffb640 10 monclient: dump: 2026-02-13T20:21:26.385 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:26.385 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:26.385 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.385 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.386 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:26.386 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:26.386 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:26.386 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:26.386 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:26.386 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:26.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff7eb7fe640 4 set_mon_vals no callback set 2026-02-13T20:21:26.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff8035dd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:21:26.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff8035dd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:21:26.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff8035dd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:21:26.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff8035dd640 1 -- 10.20.193.110:0/3222637993 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7fc0008d0 con 0x7ff7fc091950 2026-02-13T20:21:26.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.365+0000 7ff7e9ffb640 1 -- 10.20.193.110:0/3222637993 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7ff7ec003c90 con 0x7ff7fc091950 2026-02-13T20:21:26.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.366+0000 7ff7e9ffb640 1 -- 10.20.193.110:0/3222637993 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(490..490 src has 1..490) ==== 4007+0+0 (unknown 1132935119 0 0) 0x7ff7ec04ea60 con 0x7ff7fc091950 2026-02-13T20:21:26.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.366+0000 7ff800b51640 10 monclient: get_auth_request con 0x7ff7cc03fb20 auth_method 0 2026-02-13T20:21:26.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.368+0000 7ff7e9ffb640 1 -- 10.20.193.110:0/3222637993 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7ff7ec017150 con 0x7ff7fc091950 2026-02-13T20:21:26.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.368+0000 7ff7e9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:21:26.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.368+0000 7ff7e9ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:21:26.512 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.510+0000 7ff8035dd640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T20:21:26.513 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.510+0000 7ff8035dd640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T20:21:26.513 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.510+0000 7ff8035dd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:21:26.513 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.510+0000 7ff8035dd640 1 -- 10.20.193.110:0/3222637993 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7ff7fc058410 con 0x7ff7fc091950 2026-02-13T20:21:26.513 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.510+0000 7ff7e9ffb640 1 -- 10.20.193.110:0/3222637993 <== mon.2 v1:10.20.193.110:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 475368092) 0x7ff7ec016900 con 0x7ff7fc091950 2026-02-13T20:21:26.513 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.510+0000 7ff7e9ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T20:21:26.513 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.510+0000 7ff7e9ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:21:26.513 INFO:teuthology.orchestra.run.trial110.stdout:{"election_epoch":38,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","modified":"2026-02-13T20:11:07.161192Z","created":"2026-02-13T20:11:07.161192Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6789","nonce":0}]},"addr":"10.20.193.110:6789/0","public_addr":"10.20.193.110:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161241+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6789","nonce":0}]},"addr":"10.20.193.188:6789/0","public_addr":"10.20.193.188:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161242+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6790","nonce":0}]},"addr":"10.20.193.110:6790/0","public_addr":"10.20.193.110:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161243+0000","crush_location":[]}]}} 2026-02-13T20:21:26.514 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.511+0000 7ff8035dd640 1 -- 10.20.193.110:0/3222637993 >> v1:10.20.193.188:6812/1623052694 conn(0x7ff7cc03fb20 legacy=0x7ff7cc05ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:26.514 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.511+0000 7ff8035dd640 10 monclient: shutdown 2026-02-13T20:21:26.515 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.511+0000 7ff8035dd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:21:26.515 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.511+0000 7ff8035dd640 1 -- 10.20.193.110:0/3222637993 >> v1:10.20.193.110:6790/0 conn(0x7ff7fc091950 legacy=0x7ff7fc129d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:26.515 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.511+0000 7ff8035dd640 1 -- 10.20.193.110:0/3222637993 shutdown_connections 2026-02-13T20:21:26.515 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.511+0000 7ff8035dd640 1 -- 10.20.193.110:0/3222637993 >> 10.20.193.110:0/3222637993 conn(0x7ff7fc054e90 msgr2=0x7ff7fc08a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:21:26.515 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.511+0000 7ff8035dd640 1 -- 10.20.193.110:0/3222637993 shutdown_connections 2026-02-13T20:21:26.515 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.511+0000 7ff8035dd640 1 -- 10.20.193.110:0/3222637993 wait complete. 2026-02-13T20:21:26.520 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-13T20:21:26.521 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-13T20:21:26.521 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-13T20:21:26.521 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T20:21:26.588 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.586+0000 7ff57ffdd640 10 monclient: get_monmap_and_config 2026-02-13T20:21:26.588 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.586+0000 7ff57ffdd640 10 monclient: build_initial_monmap 2026-02-13T20:21:26.588 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.586+0000 7ff57ffdd640 10 monclient: monmap: 2026-02-13T20:21:26.588 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:21:26.588 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:26.588 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:21:26.588207+0000 2026-02-13T20:21:26.589 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:21:26.588207+0000 2026-02-13T20:21:26.589 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:21:26.589 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:26.589 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:21:26.589 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:21:26.589 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:21:26.589 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:26.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.587+0000 7ff57ffdd640 1 Processor -- start 2026-02-13T20:21:26.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.587+0000 7ff57ffdd640 1 -- start start 2026-02-13T20:21:26.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.587+0000 7ff57ffdd640 10 monclient: init 2026-02-13T20:21:26.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.587+0000 7ff57ffdd640 10 monclient: _reopen_session rank -1 2026-02-13T20:21:26.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.587+0000 7ff57ffdd640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:21:26.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.587+0000 7ff57ffdd640 10 monclient(hunting): picked mon.noname-a con 0x7ff578089250 addr v1:10.20.193.110:6789/0 2026-02-13T20:21:26.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.587+0000 7ff57ffdd640 10 monclient(hunting): picked mon.noname-b con 0x7ff578057780 addr v1:10.20.193.110:6790/0 2026-02-13T20:21:26.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.587+0000 7ff57ffdd640 10 monclient(hunting): picked mon.noname-c con 0x7ff578184b60 addr v1:10.20.193.188:6789/0 2026-02-13T20:21:26.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.587+0000 7ff57ffdd640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff57808a950 con 0x7ff578089250 2026-02-13T20:21:26.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.587+0000 7ff57ffdd640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff578089620 con 0x7ff578184b60 2026-02-13T20:21:26.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.587+0000 7ff57ffdd640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff578057c60 con 0x7ff578057780 2026-02-13T20:21:26.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.587+0000 7ff57ffdd640 10 monclient(hunting): _renew_subs 2026-02-13T20:21:26.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.587+0000 7ff57ffdd640 10 monclient(hunting): authenticate will time out at 1248.278771s 2026-02-13T20:21:26.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.587+0000 7ff57d551640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7ff578057780 0x7ff578183440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:33748/0 (socket says 10.20.193.110:33748) 2026-02-13T20:21:26.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.587+0000 7ff57d551640 1 -- 10.20.193.110:0/2049201864 learned_addr learned my addr 10.20.193.110:0/2049201864 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:21:26.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.588+0000 7ff57cd50640 1 -- 10.20.193.110:0/2049201864 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4207545911 0 0) 0x7ff578057c60 con 0x7ff578057780 2026-02-13T20:21:26.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.588+0000 7ff57cd50640 10 monclient(hunting): _negotiate 2026-02-13T20:21:26.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.588+0000 7ff57cd50640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:26.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.588+0000 7ff57cd50640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:26.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.588+0000 7ff57cd50640 10 monclient(hunting): my global_id is 94445 2026-02-13T20:21:26.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.588+0000 7ff57cd50640 1 -- 10.20.193.110:0/2049201864 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5600035e0 con 0x7ff578057780 2026-02-13T20:21:26.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.588+0000 7ff57cd50640 1 -- 10.20.193.110:0/2049201864 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 438931485 0 0) 0x7ff57808a950 con 0x7ff578089250 2026-02-13T20:21:26.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.588+0000 7ff57cd50640 10 monclient(hunting): _negotiate 2026-02-13T20:21:26.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.588+0000 7ff57cd50640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:26.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.588+0000 7ff57cd50640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:26.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.588+0000 7ff57cd50640 10 monclient(hunting): my global_id is 124131 2026-02-13T20:21:26.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.588+0000 7ff57cd50640 1 -- 10.20.193.110:0/2049201864 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff578057c60 con 0x7ff578089250 2026-02-13T20:21:26.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.588+0000 7ff57cd50640 1 -- 10.20.193.110:0/2049201864 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 994148641 0 0) 0x7ff578089620 con 0x7ff578184b60 2026-02-13T20:21:26.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.588+0000 7ff57cd50640 10 monclient(hunting): _negotiate 2026-02-13T20:21:26.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.588+0000 7ff57cd50640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:26.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.588+0000 7ff57cd50640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:26.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.588+0000 7ff57cd50640 10 monclient(hunting): my global_id is 4843 2026-02-13T20:21:26.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.588+0000 7ff57cd50640 1 -- 10.20.193.110:0/2049201864 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff57808a950 con 0x7ff578184b60 2026-02-13T20:21:26.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.588+0000 7ff57cd50640 1 -- 10.20.193.110:0/2049201864 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3745149634 0 0) 0x7ff5600035e0 con 0x7ff578057780 2026-02-13T20:21:26.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.588+0000 7ff57cd50640 1 -- 10.20.193.110:0/2049201864 >> v1:10.20.193.188:6789/0 conn(0x7ff578184b60 legacy=0x7ff5781a4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:26.603 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.588+0000 7ff57cd50640 1 -- 10.20.193.110:0/2049201864 >> v1:10.20.193.110:6789/0 conn(0x7ff578089250 legacy=0x7ff5780580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:26.603 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.588+0000 7ff57cd50640 10 monclient: _finish_hunting 0 2026-02-13T20:21:26.603 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.588+0000 7ff57cd50640 1 monclient: found mon.noname-b 2026-02-13T20:21:26.603 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.588+0000 7ff57cd50640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:21:26.603 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.588+0000 7ff57cd50640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:21:26.603 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.588+0000 7ff57cd50640 1 -- 10.20.193.110:0/2049201864 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff578089a50 con 0x7ff578057780 2026-02-13T20:21:26.603 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.588+0000 7ff57cd50640 10 monclient: _finish_auth 0 2026-02-13T20:21:26.603 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.588+0000 7ff57cd50640 10 monclient: _check_auth_tickets 2026-02-13T20:21:26.603 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.588+0000 7ff57cd50640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:21:26.603 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.588+0000 7ff57cd50640 1 -- 10.20.193.110:0/2049201864 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff56c002dd0 con 0x7ff578057780 2026-02-13T20:21:26.603 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.588+0000 7ff57cd50640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:26.603 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.588+0000 7ff57cd50640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:21:26.604 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.588+0000 7ff57cd50640 10 monclient: dump: 2026-02-13T20:21:26.604 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:26.604 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:26.604 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.604 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.604 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:26.604 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:26.604 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:26.604 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:26.604 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:26.604 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:26.604 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.588+0000 7ff57ffdd640 5 monclient: authenticate success, global_id 94445 2026-02-13T20:21:26.604 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.588+0000 7ff57ffdd640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:21:26.605 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.588+0000 7ff57cd50640 1 -- 10.20.193.110:0/2049201864 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff56c002fa0 con 0x7ff578057780 2026-02-13T20:21:26.605 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.588+0000 7ff57cd50640 10 monclient: handle_config config(0 keys) 2026-02-13T20:21:26.605 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.588+0000 7ff57cd50640 1 -- 10.20.193.110:0/2049201864 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff56c0033b0 con 0x7ff578057780 2026-02-13T20:21:26.605 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.588+0000 7ff57cd50640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:26.605 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.588+0000 7ff57cd50640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:21:26.605 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.588+0000 7ff57cd50640 10 monclient: dump: 2026-02-13T20:21:26.605 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:26.605 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:26.605 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.605 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.605 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:26.605 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:26.606 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:26.606 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:26.606 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:26.606 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:26.606 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.588+0000 7ff57ffdd640 10 monclient: get_monmap_and_config success 2026-02-13T20:21:26.606 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.588+0000 7ff57ffdd640 4 set_mon_vals no callback set 2026-02-13T20:21:26.606 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.588+0000 7ff57ffdd640 10 monclient: shutdown 2026-02-13T20:21:26.606 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.588+0000 7ff57ffdd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:21:26.606 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.588+0000 7ff57ffdd640 1 -- 10.20.193.110:0/2049201864 >> v1:10.20.193.110:6790/0 conn(0x7ff578057780 legacy=0x7ff578183440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:26.606 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.588+0000 7ff57ffdd640 1 -- 10.20.193.110:0/2049201864 shutdown_connections 2026-02-13T20:21:26.606 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.588+0000 7ff57ffdd640 1 -- 10.20.193.110:0/2049201864 >> 10.20.193.110:0/2049201864 conn(0x7ff578054330 msgr2=0x7ff578054730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:21:26.607 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.588+0000 7ff57ffdd640 1 -- 10.20.193.110:0/2049201864 shutdown_connections 2026-02-13T20:21:26.607 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.588+0000 7ff57ffdd640 1 -- 10.20.193.110:0/2049201864 wait complete. 2026-02-13T20:21:26.607 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.589+0000 7ff57ffdd640 10 monclient: build_initial_monmap 2026-02-13T20:21:26.607 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.589+0000 7ff57ffdd640 10 monclient: monmap: 2026-02-13T20:21:26.607 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:21:26.607 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:21:26.607 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:21:26.607 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:21:26.607 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:21:26.607 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:21:26.607 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:21:26.607 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:21:26.607 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:21:26.608 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:26.608 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.589+0000 7ff57ffdd640 1 Processor -- start 2026-02-13T20:21:26.608 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.589+0000 7ff57ffdd640 1 -- start start 2026-02-13T20:21:26.608 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.589+0000 7ff57ffdd640 10 monclient: init 2026-02-13T20:21:26.608 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.589+0000 7ff57ffdd640 10 monclient: _reopen_session rank -1 2026-02-13T20:21:26.608 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.589+0000 7ff57ffdd640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:21:26.608 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.589+0000 7ff57ffdd640 10 monclient(hunting): picked mon.noname-b con 0x7ff578057780 addr v1:10.20.193.188:6789/0 2026-02-13T20:21:26.608 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.589+0000 7ff57ffdd640 10 monclient(hunting): picked mon.noname-c con 0x7ff578089250 addr v1:10.20.193.110:6790/0 2026-02-13T20:21:26.608 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.589+0000 7ff57ffdd640 10 monclient(hunting): picked mon.noname-a con 0x7ff578184b60 addr v1:10.20.193.110:6789/0 2026-02-13T20:21:26.608 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.589+0000 7ff57ffdd640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff57808a160 con 0x7ff578184b60 2026-02-13T20:21:26.608 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.589+0000 7ff57ffdd640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff57812b3b0 con 0x7ff578057780 2026-02-13T20:21:26.608 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.589+0000 7ff57ffdd640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff578062290 con 0x7ff578089250 2026-02-13T20:21:26.609 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.589+0000 7ff57ffdd640 10 monclient(hunting): _renew_subs 2026-02-13T20:21:26.609 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.589+0000 7ff57ffdd640 10 monclient(hunting): authenticate will time out at 1248.280677s 2026-02-13T20:21:26.609 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.589+0000 7ff57d551640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7ff578089250 0x7ff578172060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:33758/0 (socket says 10.20.193.110:33758) 2026-02-13T20:21:26.609 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.589+0000 7ff57d551640 1 -- 10.20.193.110:0/240320927 learned_addr learned my addr 10.20.193.110:0/240320927 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:21:26.609 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.589+0000 7ff5667fc640 1 -- 10.20.193.110:0/240320927 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2115463453 0 0) 0x7ff578062290 con 0x7ff578089250 2026-02-13T20:21:26.609 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.589+0000 7ff5667fc640 10 monclient(hunting): _negotiate 2026-02-13T20:21:26.609 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.589+0000 7ff5667fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:26.609 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.589+0000 7ff5667fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:26.609 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.589+0000 7ff5667fc640 10 monclient(hunting): my global_id is 94448 2026-02-13T20:21:26.609 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.589+0000 7ff5667fc640 1 -- 10.20.193.110:0/240320927 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5480035e0 con 0x7ff578089250 2026-02-13T20:21:26.609 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.589+0000 7ff5667fc640 1 -- 10.20.193.110:0/240320927 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2009534275 0 0) 0x7ff57808a160 con 0x7ff578184b60 2026-02-13T20:21:26.609 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.589+0000 7ff5667fc640 10 monclient(hunting): _negotiate 2026-02-13T20:21:26.609 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.589+0000 7ff5667fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:26.610 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.589+0000 7ff5667fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:26.610 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.589+0000 7ff5667fc640 10 monclient(hunting): my global_id is 124134 2026-02-13T20:21:26.610 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.589+0000 7ff5667fc640 1 -- 10.20.193.110:0/240320927 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff578062290 con 0x7ff578184b60 2026-02-13T20:21:26.610 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff5667fc640 1 -- 10.20.193.110:0/240320927 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2735132404 0 0) 0x7ff57812b3b0 con 0x7ff578057780 2026-02-13T20:21:26.610 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff5667fc640 10 monclient(hunting): _negotiate 2026-02-13T20:21:26.610 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff5667fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:26.610 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff5667fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:26.610 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff5667fc640 10 monclient(hunting): my global_id is 4846 2026-02-13T20:21:26.610 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff5667fc640 1 -- 10.20.193.110:0/240320927 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff57808a160 con 0x7ff578057780 2026-02-13T20:21:26.610 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff5667fc640 1 -- 10.20.193.110:0/240320927 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3201074400 0 0) 0x7ff5480035e0 con 0x7ff578089250 2026-02-13T20:21:26.610 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff5667fc640 1 -- 10.20.193.110:0/240320927 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff57812b3b0 con 0x7ff578089250 2026-02-13T20:21:26.610 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff5667fc640 1 -- 10.20.193.110:0/240320927 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff56c003380 con 0x7ff578089250 2026-02-13T20:21:26.611 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff5667fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:21:26.611 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff5667fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:21:26.611 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff5667fc640 10 monclient(hunting): dump: 2026-02-13T20:21:26.611 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:26.611 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:26.611 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.611 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.611 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:26.611 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:26.611 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:26.611 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:26.611 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:26.611 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:26.612 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff5667fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:21:26.612 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff5667fc640 1 -- 10.20.193.110:0/240320927 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1136324334 0 0) 0x7ff578062290 con 0x7ff578184b60 2026-02-13T20:21:26.612 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff5667fc640 1 -- 10.20.193.110:0/240320927 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff5480035e0 con 0x7ff578184b60 2026-02-13T20:21:26.612 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff5667fc640 1 -- 10.20.193.110:0/240320927 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff574004150 con 0x7ff578184b60 2026-02-13T20:21:26.612 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff5667fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:21:26.612 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff5667fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:21:26.612 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff5667fc640 10 monclient(hunting): dump: 2026-02-13T20:21:26.612 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:26.612 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:26.613 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.613 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.613 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:26.613 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:26.613 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:26.613 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:26.613 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:26.614 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:26.614 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff5667fc640 1 -- 10.20.193.110:0/240320927 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1839382713 0 0) 0x7ff57808a160 con 0x7ff578057780 2026-02-13T20:21:26.614 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff5667fc640 1 -- 10.20.193.110:0/240320927 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff578062290 con 0x7ff578057780 2026-02-13T20:21:26.614 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff5667fc640 1 -- 10.20.193.110:0/240320927 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff568003040 con 0x7ff578057780 2026-02-13T20:21:26.614 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff5667fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:21:26.614 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff5667fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-13T20:21:26.614 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff5667fc640 10 monclient(hunting): dump: 2026-02-13T20:21:26.615 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:26.615 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:26.615 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.615 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.615 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:26.615 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:26.616 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:26.616 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:26.616 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:26.616 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:26.616 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff5667fc640 1 -- 10.20.193.110:0/240320927 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4198828750 0 0) 0x7ff57812b3b0 con 0x7ff578089250 2026-02-13T20:21:26.616 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff5667fc640 1 -- 10.20.193.110:0/240320927 >> v1:10.20.193.188:6789/0 conn(0x7ff578057780 legacy=0x7ff57812aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:26.617 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff5667fc640 1 -- 10.20.193.110:0/240320927 >> v1:10.20.193.110:6789/0 conn(0x7ff578184b60 legacy=0x7ff578173780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:26.617 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff5667fc640 10 monclient: _finish_hunting 0 2026-02-13T20:21:26.617 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff5667fc640 1 monclient: found mon.c 2026-02-13T20:21:26.617 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff5667fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:21:26.617 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff5667fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:21:26.617 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff5667fc640 1 -- 10.20.193.110:0/240320927 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff578111790 con 0x7ff578089250 2026-02-13T20:21:26.617 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff5667fc640 10 monclient: _finish_auth 0 2026-02-13T20:21:26.618 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff5667fc640 10 monclient: _check_auth_tickets 2026-02-13T20:21:26.618 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff5667fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:21:26.618 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff57ffdd640 5 monclient: authenticate success, global_id 94448 2026-02-13T20:21:26.618 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff57ffdd640 10 monclient: _renew_subs 2026-02-13T20:21:26.618 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff57ffdd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:21:26.618 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff57ffdd640 1 -- 10.20.193.110:0/240320927 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff5781102a0 con 0x7ff578089250 2026-02-13T20:21:26.619 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff57ffdd640 10 monclient: _renew_subs 2026-02-13T20:21:26.619 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff57ffdd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:21:26.619 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff57ffdd640 1 -- 10.20.193.110:0/240320927 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7ff578110e00 con 0x7ff578089250 2026-02-13T20:21:26.619 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff5667fc640 1 -- 10.20.193.110:0/240320927 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff56c0034e0 con 0x7ff578089250 2026-02-13T20:21:26.619 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff5667fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:21:26.619 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff5667fc640 1 -- 10.20.193.110:0/240320927 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff56c004d00 con 0x7ff578089250 2026-02-13T20:21:26.619 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff5667fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:26.620 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff5667fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:21:26.620 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff5667fc640 10 monclient: dump: 2026-02-13T20:21:26.620 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:26.620 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:26.620 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.620 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.621 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:26.621 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:26.621 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:26.621 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:26.621 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:26.621 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:26.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff567fff640 4 set_mon_vals no callback set 2026-02-13T20:21:26.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff57ffdd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:21:26.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff57ffdd640 1 -- 10.20.193.110:0/240320927 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff578112530 con 0x7ff57812dc60 2026-02-13T20:21:26.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.590+0000 7ff5667fc640 1 -- 10.20.193.110:0/240320927 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7ff56c011970 con 0x7ff578089250 2026-02-13T20:21:26.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.591+0000 7ff5667fc640 1 -- 10.20.193.110:0/240320927 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(490..490 src has 1..490) ==== 4007+0+0 (unknown 1132935119 0 0) 0x7ff56c04e910 con 0x7ff578089250 2026-02-13T20:21:26.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.591+0000 7ff5667fc640 1 -- 10.20.193.110:0/240320927 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 283392508 0 0) 0x7ff578112530 con 0x7ff57812dc60 2026-02-13T20:21:26.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.591+0000 7ff5667fc640 10 monclient(hunting): _negotiate 2026-02-13T20:21:26.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.591+0000 7ff5667fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:26.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.591+0000 7ff5667fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:26.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.591+0000 7ff5667fc640 10 monclient(hunting): my global_id is 124137 2026-02-13T20:21:26.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.591+0000 7ff5667fc640 1 -- 10.20.193.110:0/240320927 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff57812b3b0 con 0x7ff57812dc60 2026-02-13T20:21:26.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.591+0000 7ff57e553640 10 monclient: get_auth_request con 0x7ff54803fde0 auth_method 0 2026-02-13T20:21:26.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.591+0000 7ff5667fc640 1 -- 10.20.193.110:0/240320927 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2898324592 0 0) 0x7ff57812b3b0 con 0x7ff57812dc60 2026-02-13T20:21:26.624 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.591+0000 7ff5667fc640 1 -- 10.20.193.110:0/240320927 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff578112530 con 0x7ff57812dc60 2026-02-13T20:21:26.624 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.591+0000 7ff5667fc640 1 -- 10.20.193.110:0/240320927 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff568003540 con 0x7ff57812dc60 2026-02-13T20:21:26.624 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.591+0000 7ff5667fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:26.624 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.591+0000 7ff5667fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:21:26.624 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.591+0000 7ff5667fc640 10 monclient: dump: 2026-02-13T20:21:26.624 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:26.624 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:26.625 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.625 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.625 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:26.625 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:26.625 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:26.625 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:26.625 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:26.626 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:26.626 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.591+0000 7ff5667fc640 1 -- 10.20.193.110:0/240320927 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2789757502 0 0) 0x7ff578112530 con 0x7ff57812dc60 2026-02-13T20:21:26.626 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.591+0000 7ff5667fc640 1 -- 10.20.193.110:0/240320927 --> v1:10.20.193.110:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff57808a670 con 0x7ff57812dc60 2026-02-13T20:21:26.626 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.591+0000 7ff5667fc640 1 -- 10.20.193.110:0/240320927 <== mon.0 v1:10.20.193.110:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7ff568005860 con 0x7ff57812dc60 2026-02-13T20:21:26.626 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.591+0000 7ff5667fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:21:26.626 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.591+0000 7ff5667fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:21:26.626 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.591+0000 7ff5667fc640 1 -- 10.20.193.110:0/240320927 >> v1:10.20.193.110:6789/0 conn(0x7ff57812dc60 legacy=0x7ff57808ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:26.627 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.591+0000 7ff5667fc640 1 -- 10.20.193.110:0/240320927 >> v1:10.20.193.110:6789/0 conn(0x7ff57812dc60 legacy=0x7ff57808ef30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:21:26.627 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.595+0000 7ff57ffdd640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:21:26.627 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.595+0000 7ff57ffdd640 1 -- 10.20.193.110:0/240320927 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff578112710 con 0x7ff57808f640 2026-02-13T20:21:26.627 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.595+0000 7ff5667fc640 1 -- 10.20.193.110:0/240320927 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 825643277 0 0) 0x7ff578112710 con 0x7ff57808f640 2026-02-13T20:21:26.627 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.595+0000 7ff5667fc640 10 monclient(hunting): _negotiate 2026-02-13T20:21:26.627 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.595+0000 7ff5667fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:26.627 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.595+0000 7ff5667fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:26.627 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.595+0000 7ff5667fc640 10 monclient(hunting): my global_id is 124140 2026-02-13T20:21:26.628 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.595+0000 7ff5667fc640 1 -- 10.20.193.110:0/240320927 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff578112530 con 0x7ff57808f640 2026-02-13T20:21:26.628 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.595+0000 7ff5667fc640 1 -- 10.20.193.110:0/240320927 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1764257256 0 0) 0x7ff578112530 con 0x7ff57808f640 2026-02-13T20:21:26.628 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.595+0000 7ff5667fc640 1 -- 10.20.193.110:0/240320927 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff578112710 con 0x7ff57808f640 2026-02-13T20:21:26.628 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.595+0000 7ff5667fc640 1 -- 10.20.193.110:0/240320927 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff568003eb0 con 0x7ff57808f640 2026-02-13T20:21:26.628 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.595+0000 7ff5667fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:26.628 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.595+0000 7ff5667fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:21:26.628 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.595+0000 7ff5667fc640 10 monclient: dump: 2026-02-13T20:21:26.629 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:26.629 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:26.629 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.629 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.629 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:26.629 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:26.629 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:26.629 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:26.630 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:26.630 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:26.630 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.595+0000 7ff5667fc640 1 -- 10.20.193.110:0/240320927 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4264140670 0 0) 0x7ff578112710 con 0x7ff57808f640 2026-02-13T20:21:26.630 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.595+0000 7ff5667fc640 1 -- 10.20.193.110:0/240320927 --> v1:10.20.193.110:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff57812e030 con 0x7ff57808f640 2026-02-13T20:21:26.630 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.595+0000 7ff5667fc640 1 -- 10.20.193.110:0/240320927 <== mon.0 v1:10.20.193.110:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4345 (unknown 0 0 2828645625) 0x7ff568005450 con 0x7ff57808f640 2026-02-13T20:21:26.630 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.595+0000 7ff5667fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:21:26.630 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.595+0000 7ff5667fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:21:26.631 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.595+0000 7ff5667fc640 1 -- 10.20.193.110:0/240320927 >> v1:10.20.193.110:6789/0 conn(0x7ff57808f640 legacy=0x7ff578175eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:26.631 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.595+0000 7ff5667fc640 1 -- 10.20.193.110:0/240320927 >> v1:10.20.193.110:6789/0 conn(0x7ff57808f640 legacy=0x7ff578175eb0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:21:26.631 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:21:26.631 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:21:26.632 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:21:26.632 INFO:teuthology.orchestra.run.trial110.stdout: "state": "peon", 2026-02-13T20:21:26.632 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 38, 2026-02-13T20:21:26.632 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 2013, 2026-02-13T20:21:26.632 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:21:26.632 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:21:26.632 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:21:26.632 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:21:26.632 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:21:26.633 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 1, 2026-02-13T20:21:26.633 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:21:26.633 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:21:26.633 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:21:26.633 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:21:26.633 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:21:26.633 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:21:26.633 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:21:26.634 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:21:26.634 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:21:26.634 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:21:26.634 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:21:26.634 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:21:26.634 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:21:26.634 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:21:26.634 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:21:26.634 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:21:26.635 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:21:26.635 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:21:26.635 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:21:26.635 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:21:26.635 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:21:26.635 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:21:26.635 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:21:26.635 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:21:26.635 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:21:26.636 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:21:26.636 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:21:26.636 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:21:26.636 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:21:26.636 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:21:26.636 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:21:26.636 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:21:26.636 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:21:26.636 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:26.637 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:21:26.637 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:21:26.637 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:21:26.637 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:21:26.637 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:21:26.637 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:21:26.637 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:21:26.637 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:21:26.637 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:21:26.638 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:21:26.638 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:21:26.638 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:21:26.638 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:21:26.638 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:21:26.638 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:21:26.638 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:21:26.638 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:21:26.638 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:21:26.638 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:21:26.638 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:21:26.639 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:21:26.639 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:21:26.639 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:21:26.639 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:21:26.639 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:21:26.639 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:21:26.639 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:21:26.639 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:21:26.639 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:21:26.639 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:21:26.640 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:21:26.640 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:21:26.640 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:26.640 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:21:26.640 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:26.640 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:21:26.640 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:21:26.640 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:21:26.640 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:21:26.640 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:26.641 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:21:26.641 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:21:26.641 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:21:26.641 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:26.641 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:21:26.641 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:26.641 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:21:26.641 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:21:26.641 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:21:26.641 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:21:26.642 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:21:26.642 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:21:26.642 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:26.642 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:26.642 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:21:26.642 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:21:26.642 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:21:26.642 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:21:26.642 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:26.642 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:21:26.642 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:21:26.643 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:21:26.643 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:26.643 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:21:26.643 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:26.643 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:21:26.643 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:21:26.643 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:21:26.643 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:21:26.643 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:21:26.643 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:21:26.643 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:26.644 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:26.644 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:21:26.644 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:21:26.644 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:21:26.644 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:21:26.644 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:26.644 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:21:26.644 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:21:26.644 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:21:26.644 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:26.644 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:21:26.645 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:26.645 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:21:26.645 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:21:26.645 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:21:26.645 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:21:26.645 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:21:26.645 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:21:26.645 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:26.645 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:21:26.645 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:26.645 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:21:26.645 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:21:26.645 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:26.645 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:21:26.646 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:21:26.646 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:21:26.646 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:26.646 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:21:26.646 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:21:26.646 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:26.646 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:21:26.646 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:21:26.646 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:21:26.646 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:26.646 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:21:26.646 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:26.647 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:21:26.647 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:21:26.648 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.596+0000 7ff57ffdd640 1 -- 10.20.193.110:0/240320927 >> v1:10.20.193.188:6812/1623052694 conn(0x7ff54803fde0 legacy=0x7ff548060290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:26.648 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.596+0000 7ff57ffdd640 10 monclient: shutdown 2026-02-13T20:21:26.648 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.596+0000 7ff57ffdd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:21:26.648 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.596+0000 7ff57ffdd640 1 -- 10.20.193.110:0/240320927 >> v1:10.20.193.110:6790/0 conn(0x7ff578089250 legacy=0x7ff578172060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:26.648 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.596+0000 7ff57e553640 1 -- 10.20.193.110:0/240320927 reap_dead start 2026-02-13T20:21:26.648 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.596+0000 7ff57e553640 1 -- 10.20.193.110:0/240320927 reap_dead start 2026-02-13T20:21:26.648 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.596+0000 7ff57ffdd640 1 -- 10.20.193.110:0/240320927 shutdown_connections 2026-02-13T20:21:26.648 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.596+0000 7ff57ffdd640 1 -- 10.20.193.110:0/240320927 >> 10.20.193.110:0/240320927 conn(0x7ff578054330 msgr2=0x7ff57808d820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:21:26.648 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.596+0000 7ff57ffdd640 1 -- 10.20.193.110:0/240320927 shutdown_connections 2026-02-13T20:21:26.648 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.596+0000 7ff57ffdd640 1 -- 10.20.193.110:0/240320927 wait complete. 2026-02-13T20:21:26.648 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:21:26.648 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-13T20:21:26.649 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T20:21:26.716 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.714+0000 7fbfc8fb9640 10 monclient: get_monmap_and_config 2026-02-13T20:21:26.716 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.714+0000 7fbfc8fb9640 10 monclient: build_initial_monmap 2026-02-13T20:21:26.716 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.714+0000 7fbfc8fb9640 10 monclient: monmap: 2026-02-13T20:21:26.716 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:21:26.716 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:26.716 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:21:26.716167+0000 2026-02-13T20:21:26.716 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:21:26.716167+0000 2026-02-13T20:21:26.716 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:21:26.716 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:26.716 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:21:26.716 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:21:26.716 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:21:26.716 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:26.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.715+0000 7fbfc8fb9640 1 Processor -- start 2026-02-13T20:21:26.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.715+0000 7fbfc8fb9640 1 -- start start 2026-02-13T20:21:26.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.715+0000 7fbfc8fb9640 10 monclient: init 2026-02-13T20:21:26.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.715+0000 7fbfc8fb9640 10 monclient: _reopen_session rank -1 2026-02-13T20:21:26.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.715+0000 7fbfc8fb9640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:21:26.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.715+0000 7fbfc8fb9640 10 monclient(hunting): picked mon.noname-c con 0x7fbfc405c540 addr v1:10.20.193.188:6789/0 2026-02-13T20:21:26.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.715+0000 7fbfc8fb9640 10 monclient(hunting): picked mon.noname-a con 0x7fbfc405d050 addr v1:10.20.193.110:6789/0 2026-02-13T20:21:26.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.715+0000 7fbfc8fb9640 10 monclient(hunting): picked mon.noname-b con 0x7fbfc4142430 addr v1:10.20.193.110:6790/0 2026-02-13T20:21:26.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.715+0000 7fbfc8fb9640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfc408f370 con 0x7fbfc405d050 2026-02-13T20:21:26.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.715+0000 7fbfc8fb9640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfc408f540 con 0x7fbfc405c540 2026-02-13T20:21:26.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.715+0000 7fbfc8fb9640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfc40905e0 con 0x7fbfc4142430 2026-02-13T20:21:26.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.715+0000 7fbfc8fb9640 10 monclient(hunting): _renew_subs 2026-02-13T20:21:26.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.715+0000 7fbfc8fb9640 10 monclient(hunting): authenticate will time out at 1248.406812s 2026-02-13T20:21:26.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.715+0000 7fbfc1d74640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fbfc405d050 0x7fbfc4183540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:44030/0 (socket says 10.20.193.110:44030) 2026-02-13T20:21:26.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.715+0000 7fbfc1d74640 1 -- 10.20.193.110:0/383324842 learned_addr learned my addr 10.20.193.110:0/383324842 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:21:26.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.716+0000 7fbfc1573640 1 -- 10.20.193.110:0/383324842 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2654442406 0 0) 0x7fbfc40905e0 con 0x7fbfc4142430 2026-02-13T20:21:26.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.716+0000 7fbfc1573640 10 monclient(hunting): _negotiate 2026-02-13T20:21:26.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.716+0000 7fbfc1573640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:26.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.716+0000 7fbfc1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:26.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.716+0000 7fbfc1573640 10 monclient(hunting): my global_id is 94451 2026-02-13T20:21:26.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.716+0000 7fbfc1573640 1 -- 10.20.193.110:0/383324842 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbfb00035e0 con 0x7fbfc4142430 2026-02-13T20:21:26.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.716+0000 7fbfc1573640 1 -- 10.20.193.110:0/383324842 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1260029851 0 0) 0x7fbfc408f370 con 0x7fbfc405d050 2026-02-13T20:21:26.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.716+0000 7fbfc1573640 10 monclient(hunting): _negotiate 2026-02-13T20:21:26.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.716+0000 7fbfc1573640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:26.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.716+0000 7fbfc1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:26.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.716+0000 7fbfc1573640 10 monclient(hunting): my global_id is 124143 2026-02-13T20:21:26.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.716+0000 7fbfc1573640 1 -- 10.20.193.110:0/383324842 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbfc40905e0 con 0x7fbfc405d050 2026-02-13T20:21:26.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.716+0000 7fbfc1573640 1 -- 10.20.193.110:0/383324842 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3080544378 0 0) 0x7fbfc408f540 con 0x7fbfc405c540 2026-02-13T20:21:26.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.716+0000 7fbfc1573640 10 monclient(hunting): _negotiate 2026-02-13T20:21:26.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.716+0000 7fbfc1573640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:26.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.716+0000 7fbfc1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:26.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.716+0000 7fbfc1573640 10 monclient(hunting): my global_id is 4849 2026-02-13T20:21:26.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.716+0000 7fbfc1573640 1 -- 10.20.193.110:0/383324842 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbfc408f370 con 0x7fbfc405c540 2026-02-13T20:21:26.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.716+0000 7fbfc1573640 1 -- 10.20.193.110:0/383324842 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 32414070 0 0) 0x7fbfb00035e0 con 0x7fbfc4142430 2026-02-13T20:21:26.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.716+0000 7fbfc1573640 1 -- 10.20.193.110:0/383324842 >> v1:10.20.193.188:6789/0 conn(0x7fbfc405c540 legacy=0x7fbfc405c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:26.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.716+0000 7fbfc1573640 1 -- 10.20.193.110:0/383324842 >> v1:10.20.193.110:6789/0 conn(0x7fbfc405d050 legacy=0x7fbfc4183540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:26.724 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.716+0000 7fbfc1573640 10 monclient: _finish_hunting 0 2026-02-13T20:21:26.724 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.716+0000 7fbfc1573640 1 monclient: found mon.noname-b 2026-02-13T20:21:26.724 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.716+0000 7fbfc1573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:21:26.724 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.716+0000 7fbfc1573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:21:26.724 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.716+0000 7fbfc1573640 1 -- 10.20.193.110:0/383324842 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfc4142850 con 0x7fbfc4142430 2026-02-13T20:21:26.724 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.716+0000 7fbfc1573640 10 monclient: _finish_auth 0 2026-02-13T20:21:26.724 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.716+0000 7fbfc1573640 10 monclient: _check_auth_tickets 2026-02-13T20:21:26.724 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.716+0000 7fbfc1573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:21:26.724 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.716+0000 7fbfc1573640 1 -- 10.20.193.110:0/383324842 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fbfb4003eb0 con 0x7fbfc4142430 2026-02-13T20:21:26.724 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.716+0000 7fbfc1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:26.724 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.716+0000 7fbfc1573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:21:26.724 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.716+0000 7fbfc1573640 10 monclient: dump: 2026-02-13T20:21:26.724 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:26.724 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:26.724 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.724 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.724 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:26.724 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:26.724 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:26.724 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:26.724 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:26.724 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:26.724 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.716+0000 7fbfc8fb9640 5 monclient: authenticate success, global_id 94451 2026-02-13T20:21:26.725 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.716+0000 7fbfc8fb9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:21:26.725 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.716+0000 7fbfc1573640 1 -- 10.20.193.110:0/383324842 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbfb40040c0 con 0x7fbfc4142430 2026-02-13T20:21:26.725 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.716+0000 7fbfc1573640 10 monclient: handle_config config(0 keys) 2026-02-13T20:21:26.725 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.716+0000 7fbfc8fb9640 10 monclient: get_monmap_and_config success 2026-02-13T20:21:26.725 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.716+0000 7fbfc1573640 1 -- 10.20.193.110:0/383324842 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fbfb40044d0 con 0x7fbfc4142430 2026-02-13T20:21:26.725 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.716+0000 7fbfc8fb9640 4 set_mon_vals no callback set 2026-02-13T20:21:26.725 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.716+0000 7fbfc1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:26.725 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.716+0000 7fbfc1573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:21:26.725 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.716+0000 7fbfc1573640 10 monclient: dump: 2026-02-13T20:21:26.725 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:26.725 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:26.725 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.725 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.725 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:26.725 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:26.725 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:26.725 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:26.725 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:26.725 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:26.725 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.716+0000 7fbfc8fb9640 10 monclient: shutdown 2026-02-13T20:21:26.725 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.716+0000 7fbfc8fb9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:21:26.725 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.716+0000 7fbfc8fb9640 1 -- 10.20.193.110:0/383324842 >> v1:10.20.193.110:6790/0 conn(0x7fbfc4142430 legacy=0x7fbfc41a4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:26.725 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.716+0000 7fbfc8fb9640 1 -- 10.20.193.110:0/383324842 shutdown_connections 2026-02-13T20:21:26.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.716+0000 7fbfc8fb9640 1 -- 10.20.193.110:0/383324842 >> 10.20.193.110:0/383324842 conn(0x7fbfc4093270 msgr2=0x7fbfc4054330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:21:26.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.716+0000 7fbfc8fb9640 1 -- 10.20.193.110:0/383324842 shutdown_connections 2026-02-13T20:21:26.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.716+0000 7fbfc8fb9640 1 -- 10.20.193.110:0/383324842 wait complete. 2026-02-13T20:21:26.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.717+0000 7fbfc8fb9640 10 monclient: build_initial_monmap 2026-02-13T20:21:26.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.717+0000 7fbfc8fb9640 10 monclient: monmap: 2026-02-13T20:21:26.726 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:21:26.726 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:21:26.726 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:21:26.726 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:21:26.726 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:21:26.726 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:21:26.726 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:21:26.726 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:21:26.726 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:21:26.726 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:26.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.717+0000 7fbfc8fb9640 1 Processor -- start 2026-02-13T20:21:26.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.717+0000 7fbfc8fb9640 1 -- start start 2026-02-13T20:21:26.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.717+0000 7fbfc8fb9640 10 monclient: init 2026-02-13T20:21:26.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.717+0000 7fbfc8fb9640 10 monclient: _reopen_session rank -1 2026-02-13T20:21:26.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.717+0000 7fbfc8fb9640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:21:26.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.717+0000 7fbfc8fb9640 10 monclient(hunting): picked mon.noname-c con 0x7fbfc405c540 addr v1:10.20.193.110:6790/0 2026-02-13T20:21:26.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.717+0000 7fbfc8fb9640 10 monclient(hunting): picked mon.noname-b con 0x7fbfc405d050 addr v1:10.20.193.188:6789/0 2026-02-13T20:21:26.726 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.717+0000 7fbfc8fb9640 10 monclient(hunting): picked mon.noname-a con 0x7fbfc4142430 addr v1:10.20.193.110:6789/0 2026-02-13T20:21:26.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.717+0000 7fbfc8fb9640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfc405bec0 con 0x7fbfc4142430 2026-02-13T20:21:26.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.717+0000 7fbfc8fb9640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfc405d590 con 0x7fbfc405d050 2026-02-13T20:21:26.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.717+0000 7fbfc8fb9640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfc412fab0 con 0x7fbfc405c540 2026-02-13T20:21:26.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.717+0000 7fbfc8fb9640 10 monclient(hunting): _renew_subs 2026-02-13T20:21:26.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.717+0000 7fbfc8fb9640 10 monclient(hunting): authenticate will time out at 1248.408596s 2026-02-13T20:21:26.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.717+0000 7fbfc2575640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fbfc405c540 0x7fbfc4140410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:33766/0 (socket says 10.20.193.110:33766) 2026-02-13T20:21:26.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.717+0000 7fbfc2575640 1 -- 10.20.193.110:0/2076066061 learned_addr learned my addr 10.20.193.110:0/2076066061 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:21:26.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.717+0000 7fbfaaffd640 1 -- 10.20.193.110:0/2076066061 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 569801521 0 0) 0x7fbfc412fab0 con 0x7fbfc405c540 2026-02-13T20:21:26.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.717+0000 7fbfaaffd640 10 monclient(hunting): _negotiate 2026-02-13T20:21:26.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.717+0000 7fbfaaffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:26.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.717+0000 7fbfaaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:26.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.717+0000 7fbfaaffd640 10 monclient(hunting): my global_id is 94454 2026-02-13T20:21:26.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.717+0000 7fbfaaffd640 1 -- 10.20.193.110:0/2076066061 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf900035e0 con 0x7fbfc405c540 2026-02-13T20:21:26.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.717+0000 7fbfaaffd640 1 -- 10.20.193.110:0/2076066061 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1467440505 0 0) 0x7fbfc405bec0 con 0x7fbfc4142430 2026-02-13T20:21:26.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.717+0000 7fbfaaffd640 10 monclient(hunting): _negotiate 2026-02-13T20:21:26.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.717+0000 7fbfaaffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:26.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.717+0000 7fbfaaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:26.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.717+0000 7fbfaaffd640 10 monclient(hunting): my global_id is 124146 2026-02-13T20:21:26.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.717+0000 7fbfaaffd640 1 -- 10.20.193.110:0/2076066061 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbfc412fab0 con 0x7fbfc4142430 2026-02-13T20:21:26.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.717+0000 7fbfaaffd640 1 -- 10.20.193.110:0/2076066061 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3456270402 0 0) 0x7fbf900035e0 con 0x7fbfc405c540 2026-02-13T20:21:26.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.717+0000 7fbfaaffd640 1 -- 10.20.193.110:0/2076066061 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbfc405bec0 con 0x7fbfc405c540 2026-02-13T20:21:26.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.717+0000 7fbfaaffd640 1 -- 10.20.193.110:0/2076066061 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fbfb8003150 con 0x7fbfc405c540 2026-02-13T20:21:26.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.717+0000 7fbfaaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:21:26.727 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.717+0000 7fbfaaffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:21:26.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.717+0000 7fbfaaffd640 10 monclient(hunting): dump: 2026-02-13T20:21:26.728 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:26.728 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:26.728 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.728 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.728 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:26.728 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:26.728 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:26.728 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:26.728 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:26.728 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:26.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.717+0000 7fbfaaffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:21:26.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.717+0000 7fbfaaffd640 1 -- 10.20.193.110:0/2076066061 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1697163590 0 0) 0x7fbfc412fab0 con 0x7fbfc4142430 2026-02-13T20:21:26.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.717+0000 7fbfaaffd640 1 -- 10.20.193.110:0/2076066061 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbf900035e0 con 0x7fbfc4142430 2026-02-13T20:21:26.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.717+0000 7fbfaaffd640 1 -- 10.20.193.110:0/2076066061 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fbfb4003970 con 0x7fbfc4142430 2026-02-13T20:21:26.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.717+0000 7fbfaaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:21:26.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.717+0000 7fbfaaffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:21:26.728 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.717+0000 7fbfaaffd640 10 monclient(hunting): dump: 2026-02-13T20:21:26.728 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:26.728 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:26.728 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.728 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.728 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:26.729 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:26.729 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:26.729 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:26.729 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:26.729 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:26.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.717+0000 7fbfaaffd640 1 -- 10.20.193.110:0/2076066061 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 408819426 0 0) 0x7fbfc405d590 con 0x7fbfc405d050 2026-02-13T20:21:26.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.717+0000 7fbfaaffd640 10 monclient(hunting): _negotiate 2026-02-13T20:21:26.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.717+0000 7fbfaaffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:26.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.717+0000 7fbfaaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:26.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.717+0000 7fbfaaffd640 10 monclient(hunting): my global_id is 4852 2026-02-13T20:21:26.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.717+0000 7fbfaaffd640 1 -- 10.20.193.110:0/2076066061 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbfc412fab0 con 0x7fbfc405d050 2026-02-13T20:21:26.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.718+0000 7fbfaaffd640 1 -- 10.20.193.110:0/2076066061 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2835594324 0 0) 0x7fbfc405bec0 con 0x7fbfc405c540 2026-02-13T20:21:26.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.718+0000 7fbfaaffd640 1 -- 10.20.193.110:0/2076066061 >> v1:10.20.193.188:6789/0 conn(0x7fbfc405d050 legacy=0x7fbfc4193910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:26.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.718+0000 7fbfaaffd640 1 -- 10.20.193.110:0/2076066061 >> v1:10.20.193.110:6789/0 conn(0x7fbfc4142430 legacy=0x7fbfc4195030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:26.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.718+0000 7fbfaaffd640 10 monclient: _finish_hunting 0 2026-02-13T20:21:26.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.718+0000 7fbfaaffd640 1 monclient: found mon.c 2026-02-13T20:21:26.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.718+0000 7fbfaaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:21:26.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.718+0000 7fbfaaffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:21:26.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.718+0000 7fbfaaffd640 1 -- 10.20.193.110:0/2076066061 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfc4131b30 con 0x7fbfc405c540 2026-02-13T20:21:26.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.718+0000 7fbfaaffd640 10 monclient: _finish_auth 0 2026-02-13T20:21:26.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.718+0000 7fbfaaffd640 10 monclient: _check_auth_tickets 2026-02-13T20:21:26.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.718+0000 7fbfaaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:21:26.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.718+0000 7fbfc8fb9640 5 monclient: authenticate success, global_id 94454 2026-02-13T20:21:26.730 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.718+0000 7fbfc8fb9640 10 monclient: _renew_subs 2026-02-13T20:21:26.730 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.718+0000 7fbfc8fb9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:21:26.730 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.718+0000 7fbfc8fb9640 1 -- 10.20.193.110:0/2076066061 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbfc4131e10 con 0x7fbfc405c540 2026-02-13T20:21:26.730 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.718+0000 7fbfc8fb9640 10 monclient: _renew_subs 2026-02-13T20:21:26.730 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.718+0000 7fbfc8fb9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:21:26.730 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.718+0000 7fbfc8fb9640 1 -- 10.20.193.110:0/2076066061 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fbfc41527e0 con 0x7fbfc405c540 2026-02-13T20:21:26.730 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.718+0000 7fbfaaffd640 1 -- 10.20.193.110:0/2076066061 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbfb80034c0 con 0x7fbfc405c540 2026-02-13T20:21:26.730 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.718+0000 7fbfaaffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:21:26.730 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.718+0000 7fbfaaffd640 1 -- 10.20.193.110:0/2076066061 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fbfb8003b30 con 0x7fbfc405c540 2026-02-13T20:21:26.730 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.718+0000 7fbfaaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:26.730 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.718+0000 7fbfaaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:21:26.730 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.718+0000 7fbfc0d72640 4 set_mon_vals no callback set 2026-02-13T20:21:26.730 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.718+0000 7fbfaaffd640 10 monclient: dump: 2026-02-13T20:21:26.730 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:26.730 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:26.730 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.730 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.730 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:26.730 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:26.730 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:26.730 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:26.730 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:26.730 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:26.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.718+0000 7fbfc8fb9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:21:26.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.718+0000 7fbfc8fb9640 1 -- 10.20.193.110:0/2076066061 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fbfc4131770 con 0x7fbfc41a65a0 2026-02-13T20:21:26.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.718+0000 7fbfaaffd640 1 -- 10.20.193.110:0/2076066061 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1155669215 0 0) 0x7fbfc4131770 con 0x7fbfc41a65a0 2026-02-13T20:21:26.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.718+0000 7fbfaaffd640 10 monclient(hunting): _negotiate 2026-02-13T20:21:26.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.718+0000 7fbfaaffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:26.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.718+0000 7fbfaaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:26.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.718+0000 7fbfaaffd640 10 monclient(hunting): my global_id is 94457 2026-02-13T20:21:26.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.718+0000 7fbfaaffd640 1 -- 10.20.193.110:0/2076066061 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbfc405bec0 con 0x7fbfc41a65a0 2026-02-13T20:21:26.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.718+0000 7fbfaaffd640 1 -- 10.20.193.110:0/2076066061 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fbfb8003c90 con 0x7fbfc405c540 2026-02-13T20:21:26.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.718+0000 7fbfaaffd640 1 -- 10.20.193.110:0/2076066061 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(490..490 src has 1..490) ==== 4007+0+0 (unknown 1132935119 0 0) 0x7fbfb804e980 con 0x7fbfc405c540 2026-02-13T20:21:26.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.719+0000 7fbfaaffd640 1 -- 10.20.193.110:0/2076066061 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4161299678 0 0) 0x7fbfc405bec0 con 0x7fbfc41a65a0 2026-02-13T20:21:26.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.719+0000 7fbfaaffd640 1 -- 10.20.193.110:0/2076066061 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbfc4131770 con 0x7fbfc41a65a0 2026-02-13T20:21:26.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.719+0000 7fbfaaffd640 1 -- 10.20.193.110:0/2076066061 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fbfac002e30 con 0x7fbfc41a65a0 2026-02-13T20:21:26.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.719+0000 7fbfaaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:26.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.719+0000 7fbfaaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:21:26.731 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.719+0000 7fbfaaffd640 10 monclient: dump: 2026-02-13T20:21:26.731 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:26.731 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:26.731 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.731 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.731 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:26.731 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:26.731 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:26.731 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:26.732 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:26.732 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:26.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.719+0000 7fbfc2d76640 10 monclient: get_auth_request con 0x7fbf9003fce0 auth_method 0 2026-02-13T20:21:26.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.719+0000 7fbfaaffd640 1 -- 10.20.193.110:0/2076066061 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 144095341 0 0) 0x7fbfc4131770 con 0x7fbfc41a65a0 2026-02-13T20:21:26.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.719+0000 7fbfaaffd640 1 -- 10.20.193.110:0/2076066061 --> v1:10.20.193.110:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbfc4091630 con 0x7fbfc41a65a0 2026-02-13T20:21:26.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.719+0000 7fbfaaffd640 1 -- 10.20.193.110:0/2076066061 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fbfac0032a0 con 0x7fbfc41a65a0 2026-02-13T20:21:26.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.719+0000 7fbfaaffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:21:26.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.719+0000 7fbfaaffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:21:26.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.719+0000 7fbfaaffd640 1 -- 10.20.193.110:0/2076066061 >> v1:10.20.193.110:6790/0 conn(0x7fbfc41a65a0 legacy=0x7fbfc4129d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:26.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.719+0000 7fbfaaffd640 1 -- 10.20.193.110:0/2076066061 >> v1:10.20.193.110:6790/0 conn(0x7fbfc41a65a0 legacy=0x7fbfc4129d90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:21:26.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.722+0000 7fbfc8fb9640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:21:26.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.722+0000 7fbfc8fb9640 1 -- 10.20.193.110:0/2076066061 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fbfc4140f10 con 0x7fbfc4140b20 2026-02-13T20:21:26.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.722+0000 7fbfaaffd640 1 -- 10.20.193.110:0/2076066061 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2973404055 0 0) 0x7fbfc4140f10 con 0x7fbfc4140b20 2026-02-13T20:21:26.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.722+0000 7fbfaaffd640 10 monclient(hunting): _negotiate 2026-02-13T20:21:26.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.722+0000 7fbfaaffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:26.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.722+0000 7fbfaaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:26.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.722+0000 7fbfaaffd640 10 monclient(hunting): my global_id is 94460 2026-02-13T20:21:26.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.722+0000 7fbfaaffd640 1 -- 10.20.193.110:0/2076066061 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbfc4131770 con 0x7fbfc4140b20 2026-02-13T20:21:26.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.722+0000 7fbfaaffd640 1 -- 10.20.193.110:0/2076066061 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 912115649 0 0) 0x7fbfc4131770 con 0x7fbfc4140b20 2026-02-13T20:21:26.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.722+0000 7fbfaaffd640 1 -- 10.20.193.110:0/2076066061 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbfc4140f10 con 0x7fbfc4140b20 2026-02-13T20:21:26.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.722+0000 7fbfaaffd640 1 -- 10.20.193.110:0/2076066061 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fbfac004c40 con 0x7fbfc4140b20 2026-02-13T20:21:26.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.722+0000 7fbfaaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:26.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.722+0000 7fbfaaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:21:26.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.722+0000 7fbfaaffd640 10 monclient: dump: 2026-02-13T20:21:26.733 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:26.733 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:26.734 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.734 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.734 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:26.734 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:26.734 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:26.734 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:26.734 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:26.734 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:26.734 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.723+0000 7fbfaaffd640 1 -- 10.20.193.110:0/2076066061 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 315357824 0 0) 0x7fbfc4140f10 con 0x7fbfc4140b20 2026-02-13T20:21:26.734 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.723+0000 7fbfaaffd640 1 -- 10.20.193.110:0/2076066061 --> v1:10.20.193.110:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbfc4131570 con 0x7fbfc4140b20 2026-02-13T20:21:26.734 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.723+0000 7fbfaaffd640 1 -- 10.20.193.110:0/2076066061 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4514 (unknown 0 0 3483836094) 0x7fbfac004f80 con 0x7fbfc4140b20 2026-02-13T20:21:26.734 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.723+0000 7fbfaaffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:21:26.734 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.723+0000 7fbfaaffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:21:26.734 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.723+0000 7fbfaaffd640 1 -- 10.20.193.110:0/2076066061 >> v1:10.20.193.110:6790/0 conn(0x7fbfc4140b20 legacy=0x7fbfc412a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:26.734 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.723+0000 7fbfaaffd640 1 -- 10.20.193.110:0/2076066061 >> v1:10.20.193.110:6790/0 conn(0x7fbfc4140b20 legacy=0x7fbfc412a4a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:21:26.734 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:21:26.734 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:21:26.734 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:21:26.735 INFO:teuthology.orchestra.run.trial110.stdout: "state": "peon", 2026-02-13T20:21:26.735 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 38, 2026-02-13T20:21:26.735 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 358346, 2026-02-13T20:21:26.735 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:21:26.735 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:21:26.735 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:21:26.735 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:21:26.735 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:21:26.735 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 2, 2026-02-13T20:21:26.735 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:21:26.735 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:21:26.735 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:21:26.735 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:21:26.735 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:21:26.735 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:21:26.735 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:21:26.735 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:21:26.735 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:21:26.735 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:21:26.735 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:21:26.735 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:21:26.735 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:21:26.736 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:21:26.736 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:21:26.736 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:21:26.736 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:21:26.736 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:21:26.736 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:21:26.736 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:21:26.736 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:21:26.736 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:21:26.736 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:21:26.736 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:21:26.736 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:21:26.736 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:21:26.736 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:21:26.736 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:21:26.736 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:21:26.736 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:21:26.736 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:21:26.736 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:21:26.736 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:21:26.736 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:26.736 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:21:26.736 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:21:26.737 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:21:26.737 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:21:26.737 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:21:26.737 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:21:26.737 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:21:26.737 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:21:26.737 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:21:26.737 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:21:26.737 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:21:26.737 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:21:26.737 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:21:26.737 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:21:26.737 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:21:26.737 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:21:26.737 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:21:26.737 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:21:26.737 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:21:26.737 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:21:26.737 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:21:26.737 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:21:26.737 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:21:26.737 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:21:26.737 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:21:26.738 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:21:26.738 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:21:26.738 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:21:26.738 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:21:26.738 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:21:26.738 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:21:26.738 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:21:26.738 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:26.738 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:21:26.738 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:26.738 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:21:26.738 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:21:26.738 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:21:26.738 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:21:26.738 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:26.738 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:21:26.738 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:21:26.738 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:21:26.738 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:26.738 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:21:26.738 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:26.738 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:21:26.739 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:21:26.739 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:21:26.739 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:21:26.739 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:21:26.739 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:21:26.739 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:26.739 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:26.739 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:21:26.739 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:21:26.739 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:21:26.739 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:21:26.739 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:26.739 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:21:26.739 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:21:26.739 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:21:26.739 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:26.739 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:21:26.739 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:26.739 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:21:26.739 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:21:26.739 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:21:26.739 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:21:26.739 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:21:26.739 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:21:26.740 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:26.740 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:26.740 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:21:26.740 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:21:26.740 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:21:26.740 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:21:26.740 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:26.740 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:21:26.740 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:21:26.740 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:21:26.740 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:26.740 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:21:26.740 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:26.740 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:21:26.740 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:21:26.740 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:21:26.740 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:21:26.740 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:21:26.740 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:21:26.740 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:26.740 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:21:26.740 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:26.740 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:21:26.740 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:21:26.741 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:26.741 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:21:26.741 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:21:26.741 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:21:26.741 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:26.741 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:21:26.741 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:21:26.741 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:26.741 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:21:26.741 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:21:26.741 INFO:teuthology.orchestra.run.trial110.stdout: "num": 2 2026-02-13T20:21:26.741 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:26.741 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:21:26.741 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:21:26.741 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:26.741 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:21:26.741 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:21:26.741 INFO:teuthology.orchestra.run.trial110.stdout: "num": 2 2026-02-13T20:21:26.741 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:26.741 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:21:26.741 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:26.741 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:21:26.741 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:21:26.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.723+0000 7fbfc8fb9640 1 -- 10.20.193.110:0/2076066061 >> v1:10.20.193.188:6812/1623052694 conn(0x7fbf9003fce0 legacy=0x7fbf90060190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:26.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.723+0000 7fbfc8fb9640 10 monclient: shutdown 2026-02-13T20:21:26.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.723+0000 7fbfc8fb9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:21:26.743 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.723+0000 7fbfc8fb9640 1 -- 10.20.193.110:0/2076066061 >> v1:10.20.193.110:6790/0 conn(0x7fbfc405c540 legacy=0x7fbfc4140410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:26.743 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.723+0000 7fbfc2d76640 1 -- 10.20.193.110:0/2076066061 reap_dead start 2026-02-13T20:21:26.743 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.723+0000 7fbfc2d76640 1 -- 10.20.193.110:0/2076066061 reap_dead start 2026-02-13T20:21:26.743 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.723+0000 7fbfc8fb9640 1 -- 10.20.193.110:0/2076066061 shutdown_connections 2026-02-13T20:21:26.743 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.723+0000 7fbfc8fb9640 1 -- 10.20.193.110:0/2076066061 >> 10.20.193.110:0/2076066061 conn(0x7fbfc4093270 msgr2=0x7fbfc4058760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:21:26.743 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.723+0000 7fbfc8fb9640 1 -- 10.20.193.110:0/2076066061 shutdown_connections 2026-02-13T20:21:26.743 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.723+0000 7fbfc8fb9640 1 -- 10.20.193.110:0/2076066061 wait complete. 2026-02-13T20:21:26.743 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:21:26.743 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-13T20:21:26.743 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T20:21:26.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.808+0000 7f48c5b0c640 10 monclient: get_monmap_and_config 2026-02-13T20:21:26.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.808+0000 7f48c5b0c640 10 monclient: build_initial_monmap 2026-02-13T20:21:26.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.808+0000 7f48c5b0c640 10 monclient: monmap: 2026-02-13T20:21:26.815 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:21:26.815 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:26.816 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:21:26.809773+0000 2026-02-13T20:21:26.816 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:21:26.809773+0000 2026-02-13T20:21:26.816 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:21:26.816 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:26.816 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:21:26.816 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:21:26.816 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:21:26.816 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:26.816 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.808+0000 7f48c5b0c640 1 Processor -- start 2026-02-13T20:21:26.816 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.808+0000 7f48c5b0c640 1 -- start start 2026-02-13T20:21:26.816 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.808+0000 7f48c5b0c640 10 monclient: init 2026-02-13T20:21:26.816 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.809+0000 7f48c5b0c640 10 monclient: _reopen_session rank -1 2026-02-13T20:21:26.816 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.809+0000 7f48c5b0c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:21:26.816 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.809+0000 7f48c5b0c640 10 monclient(hunting): picked mon.noname-a con 0x7f48c01401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:21:26.816 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.809+0000 7f48c5b0c640 10 monclient(hunting): picked mon.noname-c con 0x7f48c0092020 addr v1:10.20.193.188:6789/0 2026-02-13T20:21:26.816 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.809+0000 7f48c5b0c640 10 monclient(hunting): picked mon.noname-b con 0x7f48c0091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:21:26.816 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.809+0000 7f48c5b0c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48c008b730 con 0x7f48c01401c0 2026-02-13T20:21:26.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.809+0000 7f48c5b0c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48c005c5b0 con 0x7f48c0092020 2026-02-13T20:21:26.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.809+0000 7f48c5b0c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48c008bcf0 con 0x7f48c0091950 2026-02-13T20:21:26.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.809+0000 7f48c5b0c640 10 monclient(hunting): _renew_subs 2026-02-13T20:21:26.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.809+0000 7f48c5b0c640 10 monclient(hunting): authenticate will time out at 1248.500107s 2026-02-13T20:21:26.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.809+0000 7f48bffff640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f48c0091950 0x7f48c01a2a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:33792/0 (socket says 10.20.193.110:33792) 2026-02-13T20:21:26.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.809+0000 7f48bffff640 1 -- 10.20.193.110:0/1890800921 learned_addr learned my addr 10.20.193.110:0/1890800921 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:21:26.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.809+0000 7f48bf7fe640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f48c01401c0 0x7f48c0091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:44058/0 (socket says 10.20.193.110:44058) 2026-02-13T20:21:26.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.809+0000 7f48be7fc640 1 -- 10.20.193.110:0/1890800921 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3890316807 0 0) 0x7f48c008bcf0 con 0x7f48c0091950 2026-02-13T20:21:26.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.809+0000 7f48be7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:21:26.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.809+0000 7f48be7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:26.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.809+0000 7f48be7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:26.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.809+0000 7f48be7fc640 10 monclient(hunting): my global_id is 94463 2026-02-13T20:21:26.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.809+0000 7f48be7fc640 1 -- 10.20.193.110:0/1890800921 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48a40035e0 con 0x7f48c0091950 2026-02-13T20:21:26.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.809+0000 7f48be7fc640 1 -- 10.20.193.110:0/1890800921 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 815115204 0 0) 0x7f48c008b730 con 0x7f48c01401c0 2026-02-13T20:21:26.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.809+0000 7f48be7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:21:26.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.809+0000 7f48be7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:26.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.809+0000 7f48be7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:26.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.809+0000 7f48be7fc640 10 monclient(hunting): my global_id is 124149 2026-02-13T20:21:26.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.809+0000 7f48be7fc640 1 -- 10.20.193.110:0/1890800921 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48c008bcf0 con 0x7f48c01401c0 2026-02-13T20:21:26.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.809+0000 7f48be7fc640 1 -- 10.20.193.110:0/1890800921 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1211570777 0 0) 0x7f48a40035e0 con 0x7f48c0091950 2026-02-13T20:21:26.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.809+0000 7f48be7fc640 1 -- 10.20.193.110:0/1890800921 >> v1:10.20.193.188:6789/0 conn(0x7f48c0092020 legacy=0x7f48c01812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T20:21:26.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.809+0000 7f48be7fc640 1 -- 10.20.193.110:0/1890800921 >> v1:10.20.193.110:6789/0 conn(0x7f48c01401c0 legacy=0x7f48c0091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:26.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.809+0000 7f48be7fc640 10 monclient: _finish_hunting 0 2026-02-13T20:21:26.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.809+0000 7f48be7fc640 1 monclient: found mon.noname-b 2026-02-13T20:21:26.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.809+0000 7f48be7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:21:26.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.809+0000 7f48be7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:21:26.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.809+0000 7f48be7fc640 1 -- 10.20.193.110:0/1890800921 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48c0140590 con 0x7f48c0091950 2026-02-13T20:21:26.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.809+0000 7f48be7fc640 10 monclient: _finish_auth 0 2026-02-13T20:21:26.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.809+0000 7f48be7fc640 10 monclient: _check_auth_tickets 2026-02-13T20:21:26.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.809+0000 7f48be7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:21:26.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.809+0000 7f48be7fc640 1 -- 10.20.193.110:0/1890800921 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f48b4003eb0 con 0x7f48c0091950 2026-02-13T20:21:26.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.809+0000 7f48be7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:26.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.809+0000 7f48be7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:21:26.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.809+0000 7f48be7fc640 10 monclient: dump: 2026-02-13T20:21:26.818 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:26.819 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:26.819 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.819 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.819 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:26.819 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:26.819 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:26.819 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:26.819 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:26.819 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:26.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.809+0000 7f48c5b0c640 5 monclient: authenticate success, global_id 94463 2026-02-13T20:21:26.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.809+0000 7f48c5b0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:21:26.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.809+0000 7f48be7fc640 1 -- 10.20.193.110:0/1890800921 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f48b4004100 con 0x7f48c0091950 2026-02-13T20:21:26.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.809+0000 7f48be7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:21:26.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.809+0000 7f48be7fc640 1 -- 10.20.193.110:0/1890800921 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f48b4004510 con 0x7f48c0091950 2026-02-13T20:21:26.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.809+0000 7f48be7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:26.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.809+0000 7f48be7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:21:26.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.809+0000 7f48be7fc640 10 monclient: dump: 2026-02-13T20:21:26.819 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:26.820 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:26.820 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.820 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.820 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:26.820 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:26.820 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:26.820 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:26.820 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:26.820 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:26.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.809+0000 7f48c5b0c640 10 monclient: get_monmap_and_config success 2026-02-13T20:21:26.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.809+0000 7f48c5b0c640 4 set_mon_vals no callback set 2026-02-13T20:21:26.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.810+0000 7f48c5b0c640 10 monclient: shutdown 2026-02-13T20:21:26.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.810+0000 7f48c5b0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:21:26.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.810+0000 7f48c5b0c640 1 -- 10.20.193.110:0/1890800921 >> v1:10.20.193.110:6790/0 conn(0x7f48c0091950 legacy=0x7f48c01a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:26.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.810+0000 7f48c5b0c640 1 -- 10.20.193.110:0/1890800921 shutdown_connections 2026-02-13T20:21:26.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.810+0000 7f48c5b0c640 1 -- 10.20.193.110:0/1890800921 >> 10.20.193.110:0/1890800921 conn(0x7f48c0054e90 msgr2=0x7f48c0058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:21:26.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.810+0000 7f48c5b0c640 1 -- 10.20.193.110:0/1890800921 shutdown_connections 2026-02-13T20:21:26.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.810+0000 7f48c5b0c640 1 -- 10.20.193.110:0/1890800921 wait complete. 2026-02-13T20:21:26.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.810+0000 7f48c5b0c640 10 monclient: build_initial_monmap 2026-02-13T20:21:26.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.810+0000 7f48c5b0c640 10 monclient: monmap: 2026-02-13T20:21:26.821 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:21:26.821 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:21:26.821 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:21:26.821 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:21:26.821 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:21:26.821 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:21:26.821 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:21:26.821 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:21:26.821 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:21:26.821 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:26.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.810+0000 7f48c5b0c640 1 Processor -- start 2026-02-13T20:21:26.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.810+0000 7f48c5b0c640 1 -- start start 2026-02-13T20:21:26.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.810+0000 7f48c5b0c640 10 monclient: init 2026-02-13T20:21:26.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f48c5b0c640 10 monclient: _reopen_session rank -1 2026-02-13T20:21:26.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f48c5b0c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:21:26.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f48c5b0c640 10 monclient(hunting): picked mon.noname-b con 0x7f48c0091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:21:26.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f48c5b0c640 10 monclient(hunting): picked mon.noname-c con 0x7f48c01401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:21:26.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f48c5b0c640 10 monclient(hunting): picked mon.noname-a con 0x7f48c012de80 addr v1:10.20.193.110:6789/0 2026-02-13T20:21:26.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f48c5b0c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48c0117120 con 0x7f48c012de80 2026-02-13T20:21:26.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f48c5b0c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48c008a880 con 0x7f48c0091950 2026-02-13T20:21:26.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f48c5b0c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48c012db60 con 0x7f48c01401c0 2026-02-13T20:21:26.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f48c5b0c640 10 monclient(hunting): _renew_subs 2026-02-13T20:21:26.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f48c5b0c640 10 monclient(hunting): authenticate will time out at 1248.502206s 2026-02-13T20:21:26.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f48beffd640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f48c01401c0 0x7f48c0116a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:33794/0 (socket says 10.20.193.110:33794) 2026-02-13T20:21:26.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f48beffd640 1 -- 10.20.193.110:0/3452423410 learned_addr learned my addr 10.20.193.110:0/3452423410 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:21:26.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f489bfff640 1 -- 10.20.193.110:0/3452423410 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 516482767 0 0) 0x7f48c012db60 con 0x7f48c01401c0 2026-02-13T20:21:26.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f489bfff640 10 monclient(hunting): _negotiate 2026-02-13T20:21:26.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f489bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:26.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f489bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:26.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f489bfff640 10 monclient(hunting): my global_id is 94466 2026-02-13T20:21:26.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f489bfff640 1 -- 10.20.193.110:0/3452423410 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48900035e0 con 0x7f48c01401c0 2026-02-13T20:21:26.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f489bfff640 1 -- 10.20.193.110:0/3452423410 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3165075427 0 0) 0x7f48c0117120 con 0x7f48c012de80 2026-02-13T20:21:26.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f489bfff640 10 monclient(hunting): _negotiate 2026-02-13T20:21:26.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f489bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:26.823 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f489bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:26.823 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f489bfff640 10 monclient(hunting): my global_id is 124152 2026-02-13T20:21:26.823 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f489bfff640 1 -- 10.20.193.110:0/3452423410 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48c012db60 con 0x7f48c012de80 2026-02-13T20:21:26.823 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f489bfff640 1 -- 10.20.193.110:0/3452423410 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1958105323 0 0) 0x7f48900035e0 con 0x7f48c01401c0 2026-02-13T20:21:26.823 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f489bfff640 1 -- 10.20.193.110:0/3452423410 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f48c0117120 con 0x7f48c01401c0 2026-02-13T20:21:26.823 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f489bfff640 1 -- 10.20.193.110:0/3452423410 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f48b00040b0 con 0x7f48c01401c0 2026-02-13T20:21:26.823 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f489bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:21:26.823 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f489bfff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:21:26.823 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f489bfff640 10 monclient(hunting): dump: 2026-02-13T20:21:26.823 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:26.823 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:26.823 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.823 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.823 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:26.823 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:26.823 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:26.823 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:26.823 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:26.823 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:26.823 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f489bfff640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:21:26.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f489bfff640 1 -- 10.20.193.110:0/3452423410 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4158801231 0 0) 0x7f48c008a880 con 0x7f48c0091950 2026-02-13T20:21:26.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f489bfff640 10 monclient(hunting): _negotiate 2026-02-13T20:21:26.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f489bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:26.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f489bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:26.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f489bfff640 10 monclient(hunting): my global_id is 4855 2026-02-13T20:21:26.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f489bfff640 1 -- 10.20.193.110:0/3452423410 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48900035e0 con 0x7f48c0091950 2026-02-13T20:21:26.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f489bfff640 1 -- 10.20.193.110:0/3452423410 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1283512520 0 0) 0x7f48c012db60 con 0x7f48c012de80 2026-02-13T20:21:26.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f489bfff640 1 -- 10.20.193.110:0/3452423410 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f48c008a880 con 0x7f48c012de80 2026-02-13T20:21:26.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f489bfff640 1 -- 10.20.193.110:0/3452423410 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f48b4004420 con 0x7f48c012de80 2026-02-13T20:21:26.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f489bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:21:26.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f489bfff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:21:26.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f489bfff640 10 monclient(hunting): dump: 2026-02-13T20:21:26.824 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:26.824 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:26.824 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.824 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.824 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:26.824 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:26.825 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:26.825 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:26.825 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:26.825 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:26.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f489bfff640 1 -- 10.20.193.110:0/3452423410 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3327115789 0 0) 0x7f48c0117120 con 0x7f48c01401c0 2026-02-13T20:21:26.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f489bfff640 1 -- 10.20.193.110:0/3452423410 >> v1:10.20.193.188:6789/0 conn(0x7f48c0091950 legacy=0x7f48c0116300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:26.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f489bfff640 1 -- 10.20.193.110:0/3452423410 >> v1:10.20.193.110:6789/0 conn(0x7f48c012de80 legacy=0x7f48c01a2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:26.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f489bfff640 10 monclient: _finish_hunting 0 2026-02-13T20:21:26.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f489bfff640 1 monclient: found mon.c 2026-02-13T20:21:26.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f489bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:21:26.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f489bfff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:21:26.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f489bfff640 1 -- 10.20.193.110:0/3452423410 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48c012ede0 con 0x7f48c01401c0 2026-02-13T20:21:26.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f489bfff640 10 monclient: _finish_auth 0 2026-02-13T20:21:26.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f489bfff640 10 monclient: _check_auth_tickets 2026-02-13T20:21:26.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f489bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:21:26.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f48c5b0c640 5 monclient: authenticate success, global_id 94466 2026-02-13T20:21:26.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f48c5b0c640 10 monclient: _renew_subs 2026-02-13T20:21:26.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f48c5b0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:21:26.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f48c5b0c640 1 -- 10.20.193.110:0/3452423410 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f48c012f0c0 con 0x7f48c01401c0 2026-02-13T20:21:26.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f48c5b0c640 10 monclient: _renew_subs 2026-02-13T20:21:26.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f48c5b0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:21:26.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f48c5b0c640 1 -- 10.20.193.110:0/3452423410 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f48c0089e40 con 0x7f48c01401c0 2026-02-13T20:21:26.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f489bfff640 1 -- 10.20.193.110:0/3452423410 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f48b0004300 con 0x7f48c01401c0 2026-02-13T20:21:26.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f489bfff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:21:26.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f489bfff640 1 -- 10.20.193.110:0/3452423410 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f48b0002950 con 0x7f48c01401c0 2026-02-13T20:21:26.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f489bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:26.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f489bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:21:26.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f48bdffb640 4 set_mon_vals no callback set 2026-02-13T20:21:26.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.811+0000 7f489bfff640 10 monclient: dump: 2026-02-13T20:21:26.826 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:26.826 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:26.826 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.826 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.826 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:26.826 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:26.826 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:26.826 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:26.827 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:26.827 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:26.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.812+0000 7f48c5b0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:21:26.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.812+0000 7f48c5b0c640 1 -- 10.20.193.110:0/3452423410 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f48c012f540 con 0x7f48c0092020 2026-02-13T20:21:26.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.812+0000 7f489bfff640 1 -- 10.20.193.110:0/3452423410 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f48b0002ab0 con 0x7f48c01401c0 2026-02-13T20:21:26.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.812+0000 7f489bfff640 1 -- 10.20.193.110:0/3452423410 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(490..490 src has 1..490) ==== 4007+0+0 (unknown 1132935119 0 0) 0x7f48b004e950 con 0x7f48c01401c0 2026-02-13T20:21:26.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.812+0000 7f48bffff640 10 monclient: get_auth_request con 0x7f489003fc70 auth_method 0 2026-02-13T20:21:26.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.812+0000 7f489bfff640 1 -- 10.20.193.110:0/3452423410 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2527185068 0 0) 0x7f48c012f540 con 0x7f48c0092020 2026-02-13T20:21:26.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.812+0000 7f489bfff640 10 monclient(hunting): _negotiate 2026-02-13T20:21:26.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.812+0000 7f489bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:26.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.812+0000 7f489bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:26.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.812+0000 7f489bfff640 10 monclient(hunting): my global_id is 4858 2026-02-13T20:21:26.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.812+0000 7f489bfff640 1 -- 10.20.193.110:0/3452423410 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48c0117120 con 0x7f48c0092020 2026-02-13T20:21:26.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.812+0000 7f489bfff640 1 -- 10.20.193.110:0/3452423410 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2689123194 0 0) 0x7f48c0117120 con 0x7f48c0092020 2026-02-13T20:21:26.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.812+0000 7f489bfff640 1 -- 10.20.193.110:0/3452423410 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f48c012f540 con 0x7f48c0092020 2026-02-13T20:21:26.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.812+0000 7f489bfff640 1 -- 10.20.193.110:0/3452423410 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f48ac002f90 con 0x7f48c0092020 2026-02-13T20:21:26.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.812+0000 7f489bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:26.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.812+0000 7f489bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:21:26.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.812+0000 7f489bfff640 10 monclient: dump: 2026-02-13T20:21:26.828 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:26.828 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:26.828 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.828 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.828 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:26.828 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:26.828 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:26.828 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:26.828 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:26.828 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:26.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.813+0000 7f489bfff640 1 -- 10.20.193.110:0/3452423410 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2595982446 0 0) 0x7f48c012f540 con 0x7f48c0092020 2026-02-13T20:21:26.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.813+0000 7f489bfff640 1 -- 10.20.193.110:0/3452423410 --> v1:10.20.193.188:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f48c0125f00 con 0x7f48c0092020 2026-02-13T20:21:26.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.813+0000 7f489bfff640 1 -- 10.20.193.110:0/3452423410 <== mon.1 v1:10.20.193.188:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f48ac003450 con 0x7f48c0092020 2026-02-13T20:21:26.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.813+0000 7f489bfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:21:26.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.813+0000 7f489bfff640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:21:26.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.813+0000 7f489bfff640 1 -- 10.20.193.110:0/3452423410 >> v1:10.20.193.188:6789/0 conn(0x7f48c0092020 legacy=0x7f48c01a3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:26.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.813+0000 7f489bfff640 1 -- 10.20.193.110:0/3452423410 >> v1:10.20.193.188:6789/0 conn(0x7f48c0092020 legacy=0x7f48c01a3770 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:21:26.830 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.816+0000 7f48c5b0c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:21:26.830 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.816+0000 7f48c5b0c640 1 -- 10.20.193.110:0/3452423410 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f48c0055bb0 con 0x7f48c008a130 2026-02-13T20:21:26.830 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.817+0000 7f489bfff640 1 -- 10.20.193.110:0/3452423410 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2342917325 0 0) 0x7f48c0055bb0 con 0x7f48c008a130 2026-02-13T20:21:26.830 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.817+0000 7f489bfff640 10 monclient(hunting): _negotiate 2026-02-13T20:21:26.830 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.817+0000 7f489bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:26.830 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.817+0000 7f489bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:26.830 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.817+0000 7f489bfff640 10 monclient(hunting): my global_id is 4861 2026-02-13T20:21:26.830 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.817+0000 7f489bfff640 1 -- 10.20.193.110:0/3452423410 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48c012f540 con 0x7f48c008a130 2026-02-13T20:21:26.830 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.817+0000 7f489bfff640 1 -- 10.20.193.110:0/3452423410 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3670459089 0 0) 0x7f48c012f540 con 0x7f48c008a130 2026-02-13T20:21:26.830 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.817+0000 7f489bfff640 1 -- 10.20.193.110:0/3452423410 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f48c0055bb0 con 0x7f48c008a130 2026-02-13T20:21:26.830 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.817+0000 7f489bfff640 1 -- 10.20.193.110:0/3452423410 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f48ac004c40 con 0x7f48c008a130 2026-02-13T20:21:26.830 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.817+0000 7f489bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:26.830 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.817+0000 7f489bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:21:26.830 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.817+0000 7f489bfff640 10 monclient: dump: 2026-02-13T20:21:26.830 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:26.830 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:26.831 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.831 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:26.831 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:26.831 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:26.831 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:26.831 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:26.831 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:26.831 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:26.831 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.817+0000 7f489bfff640 1 -- 10.20.193.110:0/3452423410 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 278997569 0 0) 0x7f48c0055bb0 con 0x7f48c008a130 2026-02-13T20:21:26.831 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.817+0000 7f489bfff640 1 -- 10.20.193.110:0/3452423410 --> v1:10.20.193.188:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f48c008b450 con 0x7f48c008a130 2026-02-13T20:21:26.831 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.817+0000 7f489bfff640 1 -- 10.20.193.110:0/3452423410 <== mon.1 v1:10.20.193.188:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4683 (unknown 0 0 1487229687) 0x7f48ac004ff0 con 0x7f48c008a130 2026-02-13T20:21:26.831 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.817+0000 7f489bfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:21:26.831 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.817+0000 7f489bfff640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:21:26.831 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.817+0000 7f489bfff640 1 -- 10.20.193.110:0/3452423410 >> v1:10.20.193.188:6789/0 conn(0x7f48c008a130 legacy=0x7f48c0132bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:26.831 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.817+0000 7f489bfff640 1 -- 10.20.193.110:0/3452423410 >> v1:10.20.193.188:6789/0 conn(0x7f48c008a130 legacy=0x7f48c0132bb0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:21:26.832 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:21:26.832 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:21:26.832 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:21:26.832 INFO:teuthology.orchestra.run.trial110.stdout: "state": "leader", 2026-02-13T20:21:26.832 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 38, 2026-02-13T20:21:26.832 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 608964, 2026-02-13T20:21:26.832 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:21:26.832 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:21:26.832 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:21:26.832 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:21:26.832 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:21:26.832 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 2, 2026-02-13T20:21:26.832 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:21:26.832 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:21:26.832 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:21:26.833 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:21:26.833 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:21:26.833 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:21:26.833 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:21:26.833 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:21:26.833 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:21:26.833 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:21:26.833 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:21:26.833 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:21:26.833 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:21:26.833 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:21:26.833 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:21:26.833 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:21:26.833 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:21:26.833 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:21:26.833 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:21:26.833 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:21:26.833 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:21:26.834 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:21:26.834 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:21:26.834 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:21:26.834 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:21:26.834 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:21:26.834 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:21:26.834 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:21:26.834 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:21:26.834 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:21:26.834 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:21:26.834 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:21:26.834 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:21:26.834 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:26.834 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:21:26.834 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:21:26.834 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:21:26.834 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:21:26.834 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:21:26.835 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:21:26.835 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:21:26.835 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:21:26.835 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:21:26.835 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:21:26.835 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:21:26.835 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:21:26.835 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:21:26.835 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:21:26.835 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:21:26.835 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:21:26.835 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:21:26.835 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:21:26.835 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:21:26.835 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:21:26.835 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:21:26.835 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:21:26.835 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:21:26.836 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:21:26.836 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:21:26.836 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:21:26.836 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:21:26.836 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:21:26.836 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:21:26.836 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:21:26.836 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:21:26.836 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:21:26.836 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:26.836 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:21:26.836 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:26.836 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:21:26.836 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:21:26.836 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:21:26.836 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:21:26.836 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:26.836 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:21:26.836 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:21:26.837 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:21:26.837 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:26.837 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:21:26.837 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:26.837 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:21:26.837 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:21:26.837 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:21:26.837 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:21:26.837 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:21:26.837 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:21:26.837 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:26.837 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:26.837 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:21:26.837 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:21:26.837 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:21:26.837 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:21:26.837 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:26.837 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:21:26.838 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:21:26.838 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:21:26.838 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:26.838 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:21:26.838 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:26.838 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:21:26.838 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:21:26.838 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:21:26.838 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:21:26.838 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:21:26.838 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:21:26.838 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:26.838 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:26.838 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:21:26.838 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:21:26.838 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:21:26.838 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:21:26.838 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:26.838 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:21:26.839 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:21:26.839 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:21:26.839 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:26.839 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:21:26.839 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:26.839 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:21:26.839 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:21:26.839 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:21:26.839 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:21:26.839 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:21:26.839 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:21:26.839 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:26.839 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:21:26.839 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:26.839 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:21:26.839 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:21:26.839 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:26.839 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:21:26.840 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:21:26.840 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:21:26.840 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:26.840 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:21:26.840 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:21:26.840 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:26.840 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:21:26.840 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:21:26.840 INFO:teuthology.orchestra.run.trial110.stdout: "num": 4 2026-02-13T20:21:26.840 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:26.840 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:21:26.840 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:21:26.840 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:26.840 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:21:26.840 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:21:26.840 INFO:teuthology.orchestra.run.trial110.stdout: "num": 6 2026-02-13T20:21:26.840 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:26.840 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:21:26.840 INFO:teuthology.orchestra.run.trial110.stdout: "mgr": [ 2026-02-13T20:21:26.841 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:26.841 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:21:26.841 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:21:26.841 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:21:26.841 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:26.841 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:21:26.841 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:26.841 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:21:26.841 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:21:26.842 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.817+0000 7f48c5b0c640 1 -- 10.20.193.110:0/3452423410 >> v1:10.20.193.188:6812/1623052694 conn(0x7f489003fc70 legacy=0x7f4890060120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:26.842 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.817+0000 7f48c5b0c640 10 monclient: shutdown 2026-02-13T20:21:26.842 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.817+0000 7f48c5b0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:21:26.842 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.817+0000 7f48c5b0c640 1 -- 10.20.193.110:0/3452423410 >> v1:10.20.193.110:6790/0 conn(0x7f48c01401c0 legacy=0x7f48c0116a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:26.842 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.817+0000 7f48bffff640 1 -- 10.20.193.110:0/3452423410 reap_dead start 2026-02-13T20:21:26.842 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.817+0000 7f48bffff640 1 -- 10.20.193.110:0/3452423410 reap_dead start 2026-02-13T20:21:26.842 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.818+0000 7f48c5b0c640 1 -- 10.20.193.110:0/3452423410 shutdown_connections 2026-02-13T20:21:26.842 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.818+0000 7f48c5b0c640 1 -- 10.20.193.110:0/3452423410 >> 10.20.193.110:0/3452423410 conn(0x7f48c0054e90 msgr2=0x7f48c008dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:21:26.842 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.818+0000 7f48c5b0c640 1 -- 10.20.193.110:0/3452423410 shutdown_connections 2026-02-13T20:21:26.842 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:26.818+0000 7f48c5b0c640 1 -- 10.20.193.110:0/3452423410 wait complete. 2026-02-13T20:21:26.843 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:21:26.843 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2026-02-13T20:21:26.843 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['c'] 2026-02-13T20:21:26.843 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2026-02-13T20:21:26.843 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2026-02-13T20:21:26.843 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-13T20:21:26.843 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T20:21:26.857 INFO:tasks.ceph.mon.b:Stopped 2026-02-13T20:21:26.857 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.c 2026-02-13T20:21:26.857 INFO:tasks.mon_thrash:Sending STOP to mon c 2026-02-13T20:21:26.857 INFO:tasks.ceph.mon.c:Sent signal 19 2026-02-13T20:21:26.857 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-13T20:21:41.858 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.c 2026-02-13T20:21:41.858 INFO:tasks.mon_thrash:Sending CONT to mon c 2026-02-13T20:21:41.859 INFO:tasks.ceph.mon.c:Sent signal 18 2026-02-13T20:21:41.859 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-13T20:21:41.859 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T20:21:41.927 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:41.926+0000 7f373bacc640 10 monclient: get_monmap_and_config 2026-02-13T20:21:41.927 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:41.926+0000 7f373bacc640 10 monclient: build_initial_monmap 2026-02-13T20:21:41.927 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:41.926+0000 7f373bacc640 10 monclient: monmap: 2026-02-13T20:21:41.927 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:21:41.927 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:41.927 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:21:41.927217+0000 2026-02-13T20:21:41.927 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:21:41.927217+0000 2026-02-13T20:21:41.927 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:21:41.927 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:41.927 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:21:41.928 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:21:41.928 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:21:41.928 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:41.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:41.927+0000 7f373bacc640 1 Processor -- start 2026-02-13T20:21:41.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:41.927+0000 7f373bacc640 1 -- start start 2026-02-13T20:21:41.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:41.927+0000 7f373bacc640 10 monclient: init 2026-02-13T20:21:41.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:41.927+0000 7f373bacc640 10 monclient: _reopen_session rank -1 2026-02-13T20:21:41.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:41.927+0000 7f373bacc640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:21:41.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:41.927+0000 7f373bacc640 10 monclient(hunting): picked mon.noname-c con 0x7f37341401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:21:41.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:41.927+0000 7f373bacc640 10 monclient(hunting): picked mon.noname-a con 0x7f3734092020 addr v1:10.20.193.110:6789/0 2026-02-13T20:21:41.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:41.927+0000 7f373bacc640 10 monclient(hunting): picked mon.noname-b con 0x7f3734091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:21:41.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:41.927+0000 7f373bacc640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f373408b730 con 0x7f3734092020 2026-02-13T20:21:41.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:41.927+0000 7f373bacc640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f373405c5b0 con 0x7f37341401c0 2026-02-13T20:21:41.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:41.927+0000 7f373bacc640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f373408bcf0 con 0x7f3734091950 2026-02-13T20:21:41.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:41.927+0000 7f373bacc640 10 monclient(hunting): _renew_subs 2026-02-13T20:21:41.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:41.927+0000 7f373bacc640 10 monclient(hunting): authenticate will time out at 1263.617539s 2026-02-13T20:21:41.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:41.927+0000 7f3739841640 1 -- >> v1:10.20.193.188:6789/0 conn(0x7f37341401c0 legacy=0x7f3734091240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:21:41.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:41.927+0000 7f3739040640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f3734092020 0x7f37341812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:48846/0 (socket says 10.20.193.110:48846) 2026-02-13T20:21:41.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:41.927+0000 7f373a042640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f3734091950 0x7f37341a2a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:57516/0 (socket says 10.20.193.110:57516) 2026-02-13T20:21:41.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:41.927+0000 7f3739040640 1 -- 10.20.193.110:0/2503023467 learned_addr learned my addr 10.20.193.110:0/2503023467 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:21:42.129 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:42.128+0000 7f3739841640 1 -- 10.20.193.110:0/2503023467 >> v1:10.20.193.188:6789/0 conn(0x7f37341401c0 legacy=0x7f3734091240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:21:42.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:42.529+0000 7f3739841640 1 -- 10.20.193.110:0/2503023467 >> v1:10.20.193.188:6789/0 conn(0x7f37341401c0 legacy=0x7f3734091240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:21:43.331 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:43.331+0000 7f3739841640 1 -- 10.20.193.110:0/2503023467 >> v1:10.20.193.188:6789/0 conn(0x7f37341401c0 legacy=0x7f3734091240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:21:44.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:44.927+0000 7f37237fe640 10 monclient(hunting): tick 2026-02-13T20:21:44.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:44.927+0000 7f37237fe640 10 monclient(hunting): _check_auth_tickets 2026-02-13T20:21:44.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:44.927+0000 7f37237fe640 1 monclient(hunting): continuing hunt 2026-02-13T20:21:44.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:44.927+0000 7f37237fe640 10 monclient(hunting): _reopen_session rank -1 2026-02-13T20:21:44.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:44.927+0000 7f37237fe640 1 -- 10.20.193.110:0/2503023467 >> v1:10.20.193.110:6790/0 conn(0x7f3734091950 legacy=0x7f37341a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:44.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:44.927+0000 7f37237fe640 1 -- 10.20.193.110:0/2503023467 >> v1:10.20.193.188:6789/0 conn(0x7f37341401c0 legacy=0x7f3734091240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:21:44.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:44.927+0000 7f37237fe640 1 -- 10.20.193.110:0/2503023467 >> v1:10.20.193.110:6789/0 conn(0x7f3734092020 legacy=0x7f37341812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:44.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:44.927+0000 7f37237fe640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:21:44.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:44.927+0000 7f37237fe640 10 monclient(hunting): picked mon.noname-b con 0x7f3734091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:21:44.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:44.927+0000 7f37237fe640 10 monclient(hunting): picked mon.noname-c con 0x7f37341401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:21:44.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:44.927+0000 7f37237fe640 10 monclient(hunting): picked mon.noname-a con 0x7f37180466a0 addr v1:10.20.193.110:6789/0 2026-02-13T20:21:44.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:44.927+0000 7f37237fe640 1 -- 10.20.193.110:0/2503023467 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3734140590 con 0x7f37180466a0 2026-02-13T20:21:44.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:44.927+0000 7f37237fe640 1 -- 10.20.193.110:0/2503023467 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f373405c5b0 con 0x7f37341401c0 2026-02-13T20:21:44.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:44.927+0000 7f37237fe640 1 -- 10.20.193.110:0/2503023467 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f371806a350 con 0x7f3734091950 2026-02-13T20:21:44.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:44.927+0000 7f37237fe640 10 monclient(hunting): _renew_subs 2026-02-13T20:21:44.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:44.927+0000 7f3739040640 1 -- 10.20.193.110:0/2503023467 >> v1:10.20.193.188:6789/0 conn(0x7f37341401c0 legacy=0x7f3718044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:21:45.128 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:45.128+0000 7f3739040640 1 -- 10.20.193.110:0/2503023467 >> v1:10.20.193.188:6789/0 conn(0x7f37341401c0 legacy=0x7f3718044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:21:45.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:45.529+0000 7f3739040640 1 -- 10.20.193.110:0/2503023467 >> v1:10.20.193.188:6789/0 conn(0x7f37341401c0 legacy=0x7f3718044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:21:46.331 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.330+0000 7f3739040640 1 -- 10.20.193.110:0/2503023467 >> v1:10.20.193.188:6789/0 conn(0x7f37341401c0 legacy=0x7f3718044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:21:46.865 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.864+0000 7f373883f640 1 -- 10.20.193.110:0/2503023467 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 543033655 0 0) 0x7f3734140590 con 0x7f37180466a0 2026-02-13T20:21:46.865 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.864+0000 7f373883f640 10 monclient(hunting): _negotiate 2026-02-13T20:21:46.865 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.864+0000 7f373883f640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:46.865 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.864+0000 7f373883f640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:46.865 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.864+0000 7f373883f640 10 monclient(hunting): my global_id is 124155 2026-02-13T20:21:46.865 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.864+0000 7f373883f640 1 -- 10.20.193.110:0/2503023467 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f371c0035e0 con 0x7f37180466a0 2026-02-13T20:21:46.865 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.864+0000 7f373883f640 1 -- 10.20.193.110:0/2503023467 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3634903252 0 0) 0x7f371c0035e0 con 0x7f37180466a0 2026-02-13T20:21:46.865 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.864+0000 7f373883f640 1 -- 10.20.193.110:0/2503023467 >> v1:10.20.193.110:6790/0 conn(0x7f3734091950 legacy=0x7f3718023790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:46.865 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.864+0000 7f373883f640 1 -- 10.20.193.110:0/2503023467 >> v1:10.20.193.188:6789/0 conn(0x7f37341401c0 legacy=0x7f3718044f60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:21:46.865 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.864+0000 7f373883f640 10 monclient: _finish_hunting 0 2026-02-13T20:21:46.865 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.864+0000 7f373883f640 1 monclient: found mon.noname-a 2026-02-13T20:21:46.865 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.864+0000 7f373883f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:21:46.865 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.864+0000 7f373883f640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:21:46.865 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.864+0000 7f373883f640 1 -- 10.20.193.110:0/2503023467 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f371806b610 con 0x7f37180466a0 2026-02-13T20:21:46.865 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.864+0000 7f373883f640 10 monclient: _finish_auth 0 2026-02-13T20:21:46.865 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.864+0000 7f373883f640 10 monclient: _check_auth_tickets 2026-02-13T20:21:46.865 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.864+0000 7f373883f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:21:46.865 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.864+0000 7f373883f640 1 -- 10.20.193.110:0/2503023467 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f3730003d30 con 0x7f37180466a0 2026-02-13T20:21:46.865 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.864+0000 7f373883f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:46.866 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.864+0000 7f373883f640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:21:46.866 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.864+0000 7f373883f640 10 monclient: dump: 2026-02-13T20:21:46.866 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:46.866 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:46.866 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:46.866 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:46.866 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:46.866 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:46.866 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:46.866 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:46.866 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:46.867 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:46.867 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.864+0000 7f373bacc640 5 monclient: authenticate success, global_id 124155 2026-02-13T20:21:46.867 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.864+0000 7f373bacc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:21:46.867 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.864+0000 7f373883f640 1 -- 10.20.193.110:0/2503023467 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3730003f70 con 0x7f37180466a0 2026-02-13T20:21:46.867 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.864+0000 7f373883f640 10 monclient: handle_config config(0 keys) 2026-02-13T20:21:46.867 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.864+0000 7f373883f640 1 -- 10.20.193.110:0/2503023467 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f3730004340 con 0x7f37180466a0 2026-02-13T20:21:46.867 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.864+0000 7f373883f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:46.867 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.864+0000 7f373883f640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:21:46.867 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.864+0000 7f373883f640 10 monclient: dump: 2026-02-13T20:21:46.867 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:46.867 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:46.867 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:46.868 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:46.868 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:46.868 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:46.868 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:46.868 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:46.868 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:46.868 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:46.868 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.864+0000 7f373bacc640 10 monclient: get_monmap_and_config success 2026-02-13T20:21:46.868 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.864+0000 7f373bacc640 4 set_mon_vals no callback set 2026-02-13T20:21:46.868 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.864+0000 7f373bacc640 10 monclient: shutdown 2026-02-13T20:21:46.868 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.865+0000 7f373bacc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:21:46.868 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.865+0000 7f373bacc640 1 -- 10.20.193.110:0/2503023467 >> v1:10.20.193.110:6789/0 conn(0x7f37180466a0 legacy=0x7f3718066b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:46.869 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.865+0000 7f373bacc640 1 -- 10.20.193.110:0/2503023467 shutdown_connections 2026-02-13T20:21:46.869 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.865+0000 7f373bacc640 1 -- 10.20.193.110:0/2503023467 >> 10.20.193.110:0/2503023467 conn(0x7f3734054e90 msgr2=0x7f3734058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:21:46.869 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.865+0000 7f373bacc640 1 -- 10.20.193.110:0/2503023467 shutdown_connections 2026-02-13T20:21:46.869 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.865+0000 7f373bacc640 1 -- 10.20.193.110:0/2503023467 wait complete. 2026-02-13T20:21:46.875 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.865+0000 7f373bacc640 10 monclient: build_initial_monmap 2026-02-13T20:21:46.876 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.865+0000 7f373bacc640 10 monclient: monmap: 2026-02-13T20:21:46.876 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:21:46.876 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:21:46.876 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:21:46.876 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:21:46.876 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:21:46.877 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:21:46.877 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:21:46.877 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:21:46.877 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:21:46.877 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:46.877 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.865+0000 7f373bacc640 1 Processor -- start 2026-02-13T20:21:46.878 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.866+0000 7f373bacc640 1 -- start start 2026-02-13T20:21:46.878 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.866+0000 7f373bacc640 10 monclient: init 2026-02-13T20:21:46.878 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.866+0000 7f373bacc640 10 monclient: _reopen_session rank -1 2026-02-13T20:21:46.878 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.866+0000 7f373bacc640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:21:46.878 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.866+0000 7f373bacc640 10 monclient(hunting): picked mon.noname-a con 0x7f37180466a0 addr v1:10.20.193.110:6789/0 2026-02-13T20:21:46.878 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.866+0000 7f373bacc640 10 monclient(hunting): picked mon.noname-b con 0x7f3734091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:21:46.879 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.866+0000 7f373bacc640 10 monclient(hunting): picked mon.noname-c con 0x7f37341401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:21:46.879 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.866+0000 7f373bacc640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f373413f750 con 0x7f37180466a0 2026-02-13T20:21:46.879 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.866+0000 7f373bacc640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f373405d320 con 0x7f3734091950 2026-02-13T20:21:46.879 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.866+0000 7f373bacc640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f373410ce40 con 0x7f37341401c0 2026-02-13T20:21:46.879 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.866+0000 7f373bacc640 10 monclient(hunting): _renew_subs 2026-02-13T20:21:46.879 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.866+0000 7f373bacc640 10 monclient(hunting): authenticate will time out at 1268.556367s 2026-02-13T20:21:46.880 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.866+0000 7f3739841640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f37180466a0 0x7f373410c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:48862/0 (socket says 10.20.193.110:48862) 2026-02-13T20:21:46.880 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.866+0000 7f3739841640 1 -- 10.20.193.110:0/199969817 learned_addr learned my addr 10.20.193.110:0/199969817 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:21:46.880 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.866+0000 7f3739040640 1 -- 10.20.193.110:0/199969817 >> v1:10.20.193.188:6789/0 conn(0x7f3734091950 legacy=0x7f373410c730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:21:46.880 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.866+0000 7f37227fc640 1 -- 10.20.193.110:0/199969817 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 322271623 0 0) 0x7f373413f750 con 0x7f37180466a0 2026-02-13T20:21:46.880 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.866+0000 7f37227fc640 10 monclient(hunting): _negotiate 2026-02-13T20:21:46.880 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.866+0000 7f37227fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:46.881 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.866+0000 7f37227fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:46.881 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.866+0000 7f37227fc640 10 monclient(hunting): my global_id is 124158 2026-02-13T20:21:46.881 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.866+0000 7f37227fc640 1 -- 10.20.193.110:0/199969817 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37040035e0 con 0x7f37180466a0 2026-02-13T20:21:46.881 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.866+0000 7f37227fc640 1 -- 10.20.193.110:0/199969817 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3493906969 0 0) 0x7f37040035e0 con 0x7f37180466a0 2026-02-13T20:21:46.881 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.866+0000 7f37227fc640 1 -- 10.20.193.110:0/199969817 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f373413f750 con 0x7f37180466a0 2026-02-13T20:21:46.881 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.866+0000 7f37227fc640 1 -- 10.20.193.110:0/199969817 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f3724004340 con 0x7f37180466a0 2026-02-13T20:21:46.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.866+0000 7f37227fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:21:46.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.866+0000 7f37227fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:21:46.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.866+0000 7f37227fc640 10 monclient(hunting): dump: 2026-02-13T20:21:46.882 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:46.882 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:46.882 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:46.882 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:46.882 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:46.883 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:46.883 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:46.883 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:46.883 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:46.883 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:46.883 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.866+0000 7f37227fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:21:46.883 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.867+0000 7f37227fc640 1 -- 10.20.193.110:0/199969817 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 494125475 0 0) 0x7f373410ce40 con 0x7f37341401c0 2026-02-13T20:21:46.884 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.867+0000 7f37227fc640 10 monclient(hunting): _negotiate 2026-02-13T20:21:46.884 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.867+0000 7f37227fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:46.884 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.867+0000 7f37227fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:46.884 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.867+0000 7f37227fc640 10 monclient(hunting): my global_id is 94469 2026-02-13T20:21:46.884 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.867+0000 7f37227fc640 1 -- 10.20.193.110:0/199969817 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37040035e0 con 0x7f37341401c0 2026-02-13T20:21:46.884 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.869+0000 7f37227fc640 1 -- 10.20.193.110:0/199969817 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 713869560 0 0) 0x7f373413f750 con 0x7f37180466a0 2026-02-13T20:21:46.885 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.869+0000 7f37227fc640 1 -- 10.20.193.110:0/199969817 >> v1:10.20.193.110:6790/0 conn(0x7f37341401c0 legacy=0x7f3734117270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:46.885 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.869+0000 7f37227fc640 1 -- 10.20.193.110:0/199969817 >> v1:10.20.193.188:6789/0 conn(0x7f3734091950 legacy=0x7f373410c730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T20:21:46.885 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.869+0000 7f37227fc640 10 monclient: _finish_hunting 0 2026-02-13T20:21:46.885 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.869+0000 7f37227fc640 1 monclient: found mon.a 2026-02-13T20:21:46.885 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.869+0000 7f37227fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:21:46.885 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.869+0000 7f37227fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:21:46.885 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.869+0000 7f37227fc640 1 -- 10.20.193.110:0/199969817 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f373408fcc0 con 0x7f37180466a0 2026-02-13T20:21:46.886 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.869+0000 7f37227fc640 10 monclient: _finish_auth 0 2026-02-13T20:21:46.886 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.869+0000 7f37227fc640 10 monclient: _check_auth_tickets 2026-02-13T20:21:46.886 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.869+0000 7f37227fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:21:46.886 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.869+0000 7f373bacc640 5 monclient: authenticate success, global_id 124158 2026-02-13T20:21:46.886 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.869+0000 7f373bacc640 10 monclient: _renew_subs 2026-02-13T20:21:46.886 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.869+0000 7f373bacc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:21:46.886 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.869+0000 7f373bacc640 1 -- 10.20.193.110:0/199969817 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f373410ecf0 con 0x7f37180466a0 2026-02-13T20:21:46.886 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.869+0000 7f373bacc640 10 monclient: _renew_subs 2026-02-13T20:21:46.887 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.869+0000 7f373bacc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:21:46.887 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.869+0000 7f373bacc640 1 -- 10.20.193.110:0/199969817 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f373410d690 con 0x7f37180466a0 2026-02-13T20:21:46.887 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.869+0000 7f37227fc640 1 -- 10.20.193.110:0/199969817 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3724004750 con 0x7f37180466a0 2026-02-13T20:21:46.887 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.869+0000 7f37227fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:21:46.887 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.869+0000 7f37227fc640 1 -- 10.20.193.110:0/199969817 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f3724004b30 con 0x7f37180466a0 2026-02-13T20:21:46.887 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.869+0000 7f37227fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:46.887 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.869+0000 7f37227fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:21:46.887 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.869+0000 7f3723fff640 4 set_mon_vals no callback set 2026-02-13T20:21:46.888 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.869+0000 7f37227fc640 10 monclient: dump: 2026-02-13T20:21:46.888 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:46.888 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:46.888 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:46.888 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:46.888 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:46.888 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:46.889 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:46.889 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:46.889 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:46.889 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:46.889 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.869+0000 7f37227fc640 1 -- 10.20.193.110:0/199969817 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f3724004c90 con 0x7f37180466a0 2026-02-13T20:21:46.889 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.869+0000 7f373bacc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:21:46.889 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.869+0000 7f373bacc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:21:46.889 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.869+0000 7f373bacc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:21:46.890 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.869+0000 7f373bacc640 1 -- 10.20.193.110:0/199969817 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f373410e8c0 con 0x7f37180466a0 2026-02-13T20:21:46.890 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.869+0000 7f37227fc640 1 -- 10.20.193.110:0/199969817 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(490..490 src has 1..490) ==== 4007+0+0 (unknown 1132935119 0 0) 0x7f372404e940 con 0x7f37180466a0 2026-02-13T20:21:46.890 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.870+0000 7f3739040640 10 monclient: get_auth_request con 0x7f370403f760 auth_method 0 2026-02-13T20:21:46.890 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.872+0000 7f37227fc640 1 -- 10.20.193.110:0/199969817 <== mon.0 v1:10.20.193.110:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f3724017030 con 0x7f37180466a0 2026-02-13T20:21:46.890 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.872+0000 7f37227fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:21:46.890 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:46.872+0000 7f37227fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:21:46.923 INFO:tasks.rados.rados.0.trial188.stdout:2290: done (8 left) 2026-02-13T20:21:46.923 INFO:tasks.rados.rados.0.trial188.stdout:2291: read oid 32 snap 222 2026-02-13T20:21:46.923 INFO:tasks.rados.rados.0.trial188.stdout:2291: expect (ObjNum 739 snap 220 seq_num 739) 2026-02-13T20:21:46.924 INFO:tasks.rados.rados.0.trial188.stdout:2292: write oid 27 current snap is 240 2026-02-13T20:21:46.924 INFO:tasks.rados.rados.0.trial188.stdout:2281: finishing copy_from to trial18843701-7 2026-02-13T20:21:46.924 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 7 v 948 (ObjNum 798 snap 237 seq_num 798) dirty exists 2026-02-13T20:21:46.924 INFO:tasks.rados.rados.0.trial188.stdout:2282: finishing write tid 1 to trial18843701-14 2026-02-13T20:21:46.924 INFO:tasks.rados.rados.0.trial188.stdout:2282: finishing write tid 2 to trial18843701-14 2026-02-13T20:21:46.924 INFO:tasks.rados.rados.0.trial188.stdout:2282: finishing write tid 3 to trial18843701-14 2026-02-13T20:21:46.924 INFO:tasks.rados.rados.0.trial188.stdout:2282: finishing write tid 4 to trial18843701-14 2026-02-13T20:21:46.924 INFO:tasks.rados.rados.0.trial188.stdout:2292: seq_num 811 ranges {430477=560357,1408073=473601,2488400=736073} 2026-02-13T20:21:46.926 INFO:tasks.rados.rados.0.trial188.stdout:2292: writing trial18843701-27 from 430477 to 990834 tid 1 2026-02-13T20:21:46.929 INFO:tasks.rados.rados.0.trial188.stdout:2292: writing trial18843701-27 from 1408073 to 1881674 tid 2 2026-02-13T20:21:46.936 INFO:tasks.rados.rados.0.trial188.stdout:2292: writing trial18843701-27 from 2488400 to 3224473 tid 3 2026-02-13T20:21:46.936 INFO:tasks.rados.rados.0.trial188.stdout:2281: done (9 left) 2026-02-13T20:21:46.936 INFO:tasks.rados.rados.0.trial188.stdout:2293: rollback oid 3 current snap is 240 2026-02-13T20:21:46.936 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 3 to 234 2026-02-13T20:21:46.936 INFO:tasks.rados.rados.0.trial188.stdout:2282: finishing write tid 5 to trial18843701-14 2026-02-13T20:21:46.936 INFO:tasks.rados.rados.0.trial188.stdout:2282: oid 14 updating version 0 to 778 2026-02-13T20:21:46.936 INFO:tasks.rados.rados.0.trial188.stdout:2282: oid 14 version 778 is already newer than 777 2026-02-13T20:21:46.936 INFO:tasks.rados.rados.0.trial188.stdout:2282: oid 14 updating version 778 to 779 2026-02-13T20:21:46.936 INFO:tasks.rados.rados.0.trial188.stdout:2282: oid 14 version 779 is already newer than 776 2026-02-13T20:21:46.937 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 14 v 779 (ObjNum 809 snap 240 seq_num 809) dirty exists 2026-02-13T20:21:46.937 INFO:tasks.rados.rados.0.trial188.stdout:2282: left oid 14 (ObjNum 809 snap 240 seq_num 809) 2026-02-13T20:21:46.937 INFO:tasks.rados.rados.0.trial188.stdout:2282: done (9 left) 2026-02-13T20:21:46.937 INFO:tasks.rados.rados.0.trial188.stdout:2294: rollback oid 16 current snap is 240 2026-02-13T20:21:46.937 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 16 to 180 2026-02-13T20:21:46.937 INFO:tasks.rados.rados.0.trial188.stdout:2295: write oid 7 current snap is 240 2026-02-13T20:21:46.937 INFO:tasks.rados.rados.0.trial188.stdout:2295: seq_num 812 ranges {447284=635606,1866555=733612,3315823=331461} 2026-02-13T20:21:46.939 INFO:tasks.rados.rados.0.trial188.stdout:2295: writing trial18843701-7 from 447284 to 1082890 tid 1 2026-02-13T20:21:46.946 INFO:tasks.rados.rados.0.trial188.stdout:2295: writing trial18843701-7 from 1866555 to 2600167 tid 2 2026-02-13T20:21:46.950 INFO:tasks.rados.rados.0.trial188.stdout:2295: writing trial18843701-7 from 3315823 to 3647284 tid 3 2026-02-13T20:21:46.951 INFO:tasks.rados.rados.0.trial188.stdout:2296: copy_from oid 1 from oid 23 current snap is 240 2026-02-13T20:21:46.951 INFO:tasks.rados.rados.0.trial188.stdout:2286: finishing rollback tid 0 to trial18843701-21 2026-02-13T20:21:46.951 INFO:tasks.rados.rados.0.trial188.stdout:2286: finishing rollback tid 1 to trial18843701-21 2026-02-13T20:21:46.951 INFO:tasks.rados.rados.0.trial188.stdout:2286: finishing rollback tid 2 to trial18843701-21 2026-02-13T20:21:46.951 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 21 v 498 (ObjNum 708 snap 203 seq_num 708) dirty exists 2026-02-13T20:21:46.951 INFO:tasks.rados.rados.0.trial188.stdout:2284: expect (ObjNum 786 snap 234 seq_num 786) 2026-02-13T20:21:47.021 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.021+0000 7f373bacc640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T20:21:47.021 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.021+0000 7f373bacc640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T20:21:47.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.021+0000 7f373bacc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:21:47.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.021+0000 7f373bacc640 1 -- 10.20.193.110:0/199969817 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f373410e690 con 0x7f37180466a0 2026-02-13T20:21:47.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.021+0000 7f37227fc640 1 -- 10.20.193.110:0/199969817 <== mon.0 v1:10.20.193.110:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 195816216) 0x7f37240167e0 con 0x7f37180466a0 2026-02-13T20:21:47.023 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.021+0000 7f37227fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T20:21:47.023 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.021+0000 7f37227fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:21:47.023 INFO:teuthology.orchestra.run.trial110.stdout:{"election_epoch":40,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"c","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","modified":"2026-02-13T20:11:07.161192Z","created":"2026-02-13T20:11:07.161192Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6789","nonce":0}]},"addr":"10.20.193.110:6789/0","public_addr":"10.20.193.110:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161241+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6789","nonce":0}]},"addr":"10.20.193.188:6789/0","public_addr":"10.20.193.188:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161242+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6790","nonce":0}]},"addr":"10.20.193.110:6790/0","public_addr":"10.20.193.110:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161243+0000","crush_location":[]}]}} 2026-02-13T20:21:47.024 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.023+0000 7f373bacc640 1 -- 10.20.193.110:0/199969817 >> v1:10.20.193.188:6812/1623052694 conn(0x7f370403f760 legacy=0x7f370405fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:47.024 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.023+0000 7f373bacc640 10 monclient: shutdown 2026-02-13T20:21:47.024 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.023+0000 7f373bacc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:21:47.024 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.023+0000 7f373bacc640 1 -- 10.20.193.110:0/199969817 >> v1:10.20.193.110:6789/0 conn(0x7f37180466a0 legacy=0x7f373410c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:47.024 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.023+0000 7f373bacc640 1 -- 10.20.193.110:0/199969817 shutdown_connections 2026-02-13T20:21:47.024 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.023+0000 7f373bacc640 1 -- 10.20.193.110:0/199969817 >> 10.20.193.110:0/199969817 conn(0x7f3734054e90 msgr2=0x7f37341255e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:21:47.024 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.023+0000 7f373bacc640 1 -- 10.20.193.110:0/199969817 shutdown_connections 2026-02-13T20:21:47.024 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.023+0000 7f373bacc640 1 -- 10.20.193.110:0/199969817 wait complete. 2026-02-13T20:21:47.032 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-13T20:21:47.032 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-13T20:21:47.033 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T20:21:47.084 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 675076 2026-02-13T20:21:47.110 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.099+0000 7fc1464cc640 10 monclient: get_monmap_and_config 2026-02-13T20:21:47.110 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.099+0000 7fc1464cc640 10 monclient: build_initial_monmap 2026-02-13T20:21:47.110 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.099+0000 7fc1464cc640 10 monclient: monmap: 2026-02-13T20:21:47.110 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:21:47.110 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:47.110 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:21:47.100178+0000 2026-02-13T20:21:47.111 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:21:47.100178+0000 2026-02-13T20:21:47.111 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:21:47.111 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:47.111 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:21:47.111 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:21:47.111 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:21:47.111 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:47.111 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.100+0000 7fc1464cc640 1 Processor -- start 2026-02-13T20:21:47.111 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.100+0000 7fc1464cc640 1 -- start start 2026-02-13T20:21:47.111 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.100+0000 7fc1464cc640 10 monclient: init 2026-02-13T20:21:47.111 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.100+0000 7fc1464cc640 10 monclient: _reopen_session rank -1 2026-02-13T20:21:47.111 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.100+0000 7fc1464cc640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:21:47.111 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.100+0000 7fc1464cc640 10 monclient(hunting): picked mon.noname-c con 0x7fc1401401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:21:47.112 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.100+0000 7fc1464cc640 10 monclient(hunting): picked mon.noname-b con 0x7fc140092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:21:47.112 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.100+0000 7fc1464cc640 10 monclient(hunting): picked mon.noname-a con 0x7fc140091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:21:47.112 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.100+0000 7fc1464cc640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc14008b730 con 0x7fc140091950 2026-02-13T20:21:47.112 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.100+0000 7fc1464cc640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc14005c5b0 con 0x7fc1401401c0 2026-02-13T20:21:47.112 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.100+0000 7fc1464cc640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc14008bcf0 con 0x7fc140092020 2026-02-13T20:21:47.112 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.100+0000 7fc1464cc640 10 monclient(hunting): _renew_subs 2026-02-13T20:21:47.112 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.100+0000 7fc1464cc640 10 monclient(hunting): authenticate will time out at 1268.790518s 2026-02-13T20:21:47.112 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.100+0000 7fc13ffff640 1 -- >> v1:10.20.193.188:6789/0 conn(0x7fc1401401c0 legacy=0x7fc140091240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:21:47.112 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.100+0000 7fc144a42640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fc140091950 0x7fc1401a2a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:48874/0 (socket says 10.20.193.110:48874) 2026-02-13T20:21:47.112 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.100+0000 7fc144a42640 1 -- 10.20.193.110:0/1712121166 learned_addr learned my addr 10.20.193.110:0/1712121166 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:21:47.112 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.100+0000 7fc13effd640 1 -- 10.20.193.110:0/1712121166 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1032070908 0 0) 0x7fc14008b730 con 0x7fc140091950 2026-02-13T20:21:47.112 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.100+0000 7fc13effd640 10 monclient(hunting): _negotiate 2026-02-13T20:21:47.112 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.100+0000 7fc13effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:47.113 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.100+0000 7fc13effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:47.113 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.100+0000 7fc13effd640 10 monclient(hunting): my global_id is 124161 2026-02-13T20:21:47.113 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.100+0000 7fc13effd640 1 -- 10.20.193.110:0/1712121166 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1240035e0 con 0x7fc140091950 2026-02-13T20:21:47.113 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.100+0000 7fc13effd640 1 -- 10.20.193.110:0/1712121166 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1175041632 0 0) 0x7fc14008bcf0 con 0x7fc140092020 2026-02-13T20:21:47.113 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.100+0000 7fc13effd640 10 monclient(hunting): _negotiate 2026-02-13T20:21:47.113 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.100+0000 7fc13effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:47.113 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.100+0000 7fc13effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:47.113 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.100+0000 7fc13effd640 10 monclient(hunting): my global_id is 94472 2026-02-13T20:21:47.113 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.100+0000 7fc13effd640 1 -- 10.20.193.110:0/1712121166 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc14008b730 con 0x7fc140092020 2026-02-13T20:21:47.113 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.100+0000 7fc13effd640 1 -- 10.20.193.110:0/1712121166 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1890599497 0 0) 0x7fc1240035e0 con 0x7fc140091950 2026-02-13T20:21:47.113 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.100+0000 7fc13effd640 1 -- 10.20.193.110:0/1712121166 >> v1:10.20.193.110:6790/0 conn(0x7fc140092020 legacy=0x7fc1401812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:47.113 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.100+0000 7fc13effd640 1 -- 10.20.193.110:0/1712121166 >> v1:10.20.193.188:6789/0 conn(0x7fc1401401c0 legacy=0x7fc140091240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:21:47.113 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.100+0000 7fc13effd640 10 monclient: _finish_hunting 0 2026-02-13T20:21:47.113 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.100+0000 7fc13effd640 1 monclient: found mon.noname-a 2026-02-13T20:21:47.114 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.100+0000 7fc13effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:21:47.114 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.100+0000 7fc13effd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:21:47.114 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.100+0000 7fc13effd640 1 -- 10.20.193.110:0/1712121166 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc140140590 con 0x7fc140091950 2026-02-13T20:21:47.114 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.100+0000 7fc13effd640 10 monclient: _finish_auth 0 2026-02-13T20:21:47.114 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.100+0000 7fc13effd640 10 monclient: _check_auth_tickets 2026-02-13T20:21:47.114 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.100+0000 7fc13effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:21:47.114 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.100+0000 7fc13effd640 1 -- 10.20.193.110:0/1712121166 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc134003eb0 con 0x7fc140091950 2026-02-13T20:21:47.114 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.100+0000 7fc13effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:47.114 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.100+0000 7fc13effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:21:47.114 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.100+0000 7fc13effd640 10 monclient: dump: 2026-02-13T20:21:47.114 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:47.114 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:47.114 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:47.115 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:47.115 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:47.115 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:47.115 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:47.115 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:47.115 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:47.115 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:47.115 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.100+0000 7fc1464cc640 5 monclient: authenticate success, global_id 124161 2026-02-13T20:21:47.115 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.100+0000 7fc1464cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:21:47.115 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.101+0000 7fc13effd640 1 -- 10.20.193.110:0/1712121166 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc134004100 con 0x7fc140091950 2026-02-13T20:21:47.115 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.101+0000 7fc13effd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:21:47.115 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.101+0000 7fc13effd640 1 -- 10.20.193.110:0/1712121166 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc134004510 con 0x7fc140091950 2026-02-13T20:21:47.115 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.101+0000 7fc13effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:47.115 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.101+0000 7fc13effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:21:47.116 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.101+0000 7fc13effd640 10 monclient: dump: 2026-02-13T20:21:47.116 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:47.116 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:47.116 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:47.116 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:47.116 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:47.116 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:47.116 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:47.116 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:47.116 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:47.116 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:47.116 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.101+0000 7fc1464cc640 10 monclient: get_monmap_and_config success 2026-02-13T20:21:47.116 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.101+0000 7fc1464cc640 4 set_mon_vals no callback set 2026-02-13T20:21:47.117 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.101+0000 7fc1464cc640 10 monclient: shutdown 2026-02-13T20:21:47.117 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.101+0000 7fc1464cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:21:47.117 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.101+0000 7fc1464cc640 1 -- 10.20.193.110:0/1712121166 >> v1:10.20.193.110:6789/0 conn(0x7fc140091950 legacy=0x7fc1401a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:47.117 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.101+0000 7fc1464cc640 1 -- 10.20.193.110:0/1712121166 shutdown_connections 2026-02-13T20:21:47.117 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.101+0000 7fc1464cc640 1 -- 10.20.193.110:0/1712121166 >> 10.20.193.110:0/1712121166 conn(0x7fc140054e90 msgr2=0x7fc140058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:21:47.117 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.101+0000 7fc1464cc640 1 -- 10.20.193.110:0/1712121166 shutdown_connections 2026-02-13T20:21:47.117 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.101+0000 7fc1464cc640 1 -- 10.20.193.110:0/1712121166 wait complete. 2026-02-13T20:21:47.117 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.101+0000 7fc1464cc640 10 monclient: build_initial_monmap 2026-02-13T20:21:47.117 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.101+0000 7fc1464cc640 10 monclient: monmap: 2026-02-13T20:21:47.117 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:21:47.117 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:21:47.117 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:21:47.117 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:21:47.118 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:21:47.118 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:21:47.118 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:21:47.118 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:21:47.118 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:21:47.118 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:47.118 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.101+0000 7fc1464cc640 1 Processor -- start 2026-02-13T20:21:47.118 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc1464cc640 1 -- start start 2026-02-13T20:21:47.118 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc1464cc640 10 monclient: init 2026-02-13T20:21:47.118 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc1464cc640 10 monclient: _reopen_session rank -1 2026-02-13T20:21:47.118 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc1464cc640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:21:47.118 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc1464cc640 10 monclient(hunting): picked mon.noname-b con 0x7fc140091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:21:47.118 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc1464cc640 10 monclient(hunting): picked mon.noname-c con 0x7fc1401401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:21:47.118 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc1464cc640 10 monclient(hunting): picked mon.noname-a con 0x7fc140152800 addr v1:10.20.193.110:6789/0 2026-02-13T20:21:47.119 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc1464cc640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc14013f040 con 0x7fc140152800 2026-02-13T20:21:47.119 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc1464cc640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc140132350 con 0x7fc140091950 2026-02-13T20:21:47.119 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc1464cc640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc14008a2a0 con 0x7fc1401401c0 2026-02-13T20:21:47.119 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc1464cc640 10 monclient(hunting): _renew_subs 2026-02-13T20:21:47.119 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc1464cc640 10 monclient(hunting): authenticate will time out at 1268.792282s 2026-02-13T20:21:47.119 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc13ffff640 1 -- >> v1:10.20.193.188:6789/0 conn(0x7fc140091950 legacy=0x7fc14013e930 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:21:47.119 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc13f7fe640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fc1401401c0 0x7fc140193b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:57546/0 (socket says 10.20.193.110:57546) 2026-02-13T20:21:47.119 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc13f7fe640 1 -- 10.20.193.110:0/3685753571 learned_addr learned my addr 10.20.193.110:0/3685753571 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:21:47.119 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc13cff9640 1 -- 10.20.193.110:0/3685753571 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3779498859 0 0) 0x7fc14013f040 con 0x7fc140152800 2026-02-13T20:21:47.119 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc13cff9640 10 monclient(hunting): _negotiate 2026-02-13T20:21:47.119 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc13cff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:47.119 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc13cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:47.119 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc13cff9640 10 monclient(hunting): my global_id is 124164 2026-02-13T20:21:47.119 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc13cff9640 1 -- 10.20.193.110:0/3685753571 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1100035e0 con 0x7fc140152800 2026-02-13T20:21:47.120 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc13cff9640 1 -- 10.20.193.110:0/3685753571 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 524544736 0 0) 0x7fc14008a2a0 con 0x7fc1401401c0 2026-02-13T20:21:47.120 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc13cff9640 10 monclient(hunting): _negotiate 2026-02-13T20:21:47.120 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc13cff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:47.120 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc13cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:47.120 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc13cff9640 10 monclient(hunting): my global_id is 94475 2026-02-13T20:21:47.120 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc13cff9640 1 -- 10.20.193.110:0/3685753571 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc14013f040 con 0x7fc1401401c0 2026-02-13T20:21:47.120 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc13cff9640 1 -- 10.20.193.110:0/3685753571 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1588084046 0 0) 0x7fc1100035e0 con 0x7fc140152800 2026-02-13T20:21:47.120 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc13cff9640 1 -- 10.20.193.110:0/3685753571 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc14008a2a0 con 0x7fc140152800 2026-02-13T20:21:47.120 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc13cff9640 1 -- 10.20.193.110:0/3685753571 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc134004420 con 0x7fc140152800 2026-02-13T20:21:47.120 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc13cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:21:47.120 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc13cff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:21:47.120 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc13cff9640 10 monclient(hunting): dump: 2026-02-13T20:21:47.120 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:47.120 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:47.121 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:47.121 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:47.121 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:47.121 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:47.121 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:47.121 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:47.121 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:47.121 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:47.121 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc13cff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:21:47.121 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc13cff9640 1 -- 10.20.193.110:0/3685753571 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2076863110 0 0) 0x7fc14013f040 con 0x7fc1401401c0 2026-02-13T20:21:47.121 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc13cff9640 1 -- 10.20.193.110:0/3685753571 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc1100035e0 con 0x7fc1401401c0 2026-02-13T20:21:47.121 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc13cff9640 1 -- 10.20.193.110:0/3685753571 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc130003150 con 0x7fc1401401c0 2026-02-13T20:21:47.121 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc13cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:21:47.122 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc13cff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:21:47.122 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc13cff9640 10 monclient(hunting): dump: 2026-02-13T20:21:47.122 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:47.122 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:47.122 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:47.122 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:47.122 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:47.122 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:47.122 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:47.122 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:47.122 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:47.122 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:47.122 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc13cff9640 1 -- 10.20.193.110:0/3685753571 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2419880955 0 0) 0x7fc14008a2a0 con 0x7fc140152800 2026-02-13T20:21:47.122 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc13cff9640 1 -- 10.20.193.110:0/3685753571 >> v1:10.20.193.110:6790/0 conn(0x7fc1401401c0 legacy=0x7fc140193b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:47.123 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc13cff9640 1 -- 10.20.193.110:0/3685753571 >> v1:10.20.193.188:6789/0 conn(0x7fc140091950 legacy=0x7fc14013e930 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T20:21:47.123 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc13cff9640 10 monclient: _finish_hunting 0 2026-02-13T20:21:47.123 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc13cff9640 1 monclient: found mon.a 2026-02-13T20:21:47.123 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc13cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:21:47.123 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc13cff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:21:47.123 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc13cff9640 1 -- 10.20.193.110:0/3685753571 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc14008c410 con 0x7fc140152800 2026-02-13T20:21:47.123 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc13cff9640 10 monclient: _finish_auth 0 2026-02-13T20:21:47.123 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc13cff9640 10 monclient: _check_auth_tickets 2026-02-13T20:21:47.123 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc13cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:21:47.123 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc1464cc640 5 monclient: authenticate success, global_id 124164 2026-02-13T20:21:47.123 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc1464cc640 10 monclient: _renew_subs 2026-02-13T20:21:47.123 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc1464cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:21:47.123 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc1464cc640 1 -- 10.20.193.110:0/3685753571 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc14005d320 con 0x7fc140152800 2026-02-13T20:21:47.123 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc1464cc640 10 monclient: _renew_subs 2026-02-13T20:21:47.124 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc1464cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:21:47.124 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc1464cc640 1 -- 10.20.193.110:0/3685753571 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc140132070 con 0x7fc140152800 2026-02-13T20:21:47.124 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc13cff9640 1 -- 10.20.193.110:0/3685753571 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc1340039f0 con 0x7fc140152800 2026-02-13T20:21:47.124 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc13cff9640 10 monclient: handle_config config(0 keys) 2026-02-13T20:21:47.124 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc13cff9640 1 -- 10.20.193.110:0/3685753571 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc134005de0 con 0x7fc140152800 2026-02-13T20:21:47.124 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc13cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:47.124 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc13cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:21:47.124 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc13cff9640 10 monclient: dump: 2026-02-13T20:21:47.124 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:47.124 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:47.124 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:47.124 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:47.124 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:47.124 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:47.125 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:47.125 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:47.125 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:47.125 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:47.125 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.102+0000 7fc13e7fc640 4 set_mon_vals no callback set 2026-02-13T20:21:47.125 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.103+0000 7fc1464cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:21:47.125 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.103+0000 7fc1464cc640 1 -- 10.20.193.110:0/3685753571 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc140130f60 con 0x7fc140092020 2026-02-13T20:21:47.125 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.103+0000 7fc13cff9640 1 -- 10.20.193.110:0/3685753571 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fc134012a50 con 0x7fc140152800 2026-02-13T20:21:47.125 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.103+0000 7fc13cff9640 1 -- 10.20.193.110:0/3685753571 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(491..491 src has 1..491) ==== 4023+0+0 (unknown 2685720963 0 0) 0x7fc13404fa90 con 0x7fc140152800 2026-02-13T20:21:47.125 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.103+0000 7fc13cff9640 1 -- 10.20.193.110:0/3685753571 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4202562108 0 0) 0x7fc140130f60 con 0x7fc140092020 2026-02-13T20:21:47.125 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.103+0000 7fc13cff9640 10 monclient(hunting): _negotiate 2026-02-13T20:21:47.125 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.103+0000 7fc13cff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:47.125 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.103+0000 7fc13cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:47.126 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.103+0000 7fc13cff9640 10 monclient(hunting): my global_id is 124167 2026-02-13T20:21:47.126 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.103+0000 7fc13cff9640 1 -- 10.20.193.110:0/3685753571 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc14008a2a0 con 0x7fc140092020 2026-02-13T20:21:47.126 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.103+0000 7fc13f7fe640 10 monclient: get_auth_request con 0x7fc11003f9b0 auth_method 0 2026-02-13T20:21:47.126 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.103+0000 7fc13cff9640 1 -- 10.20.193.110:0/3685753571 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2510456479 0 0) 0x7fc14008a2a0 con 0x7fc140092020 2026-02-13T20:21:47.126 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.103+0000 7fc13cff9640 1 -- 10.20.193.110:0/3685753571 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc140130f60 con 0x7fc140092020 2026-02-13T20:21:47.126 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.103+0000 7fc13cff9640 1 -- 10.20.193.110:0/3685753571 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc12c003f70 con 0x7fc140092020 2026-02-13T20:21:47.126 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.103+0000 7fc13cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:47.126 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.103+0000 7fc13cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:21:47.126 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.103+0000 7fc13cff9640 10 monclient: dump: 2026-02-13T20:21:47.126 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:47.126 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:47.126 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:47.126 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:47.126 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:47.127 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:47.127 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:47.127 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:47.127 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:47.127 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:47.127 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.103+0000 7fc13cff9640 1 -- 10.20.193.110:0/3685753571 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 904144594 0 0) 0x7fc140130f60 con 0x7fc140092020 2026-02-13T20:21:47.127 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.104+0000 7fc13cff9640 1 -- 10.20.193.110:0/3685753571 --> v1:10.20.193.110:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc14008b450 con 0x7fc140092020 2026-02-13T20:21:47.127 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.104+0000 7fc13cff9640 1 -- 10.20.193.110:0/3685753571 <== mon.0 v1:10.20.193.110:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fc12c0062a0 con 0x7fc140092020 2026-02-13T20:21:47.127 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.104+0000 7fc13cff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:21:47.127 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.104+0000 7fc13cff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:21:47.127 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.104+0000 7fc13cff9640 1 -- 10.20.193.110:0/3685753571 >> v1:10.20.193.110:6789/0 conn(0x7fc140092020 legacy=0x7fc140127b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:47.127 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.104+0000 7fc13cff9640 1 -- 10.20.193.110:0/3685753571 >> v1:10.20.193.110:6789/0 conn(0x7fc140092020 legacy=0x7fc140127b20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:21:47.127 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.107+0000 7fc1464cc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:21:47.128 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.107+0000 7fc1464cc640 1 -- 10.20.193.110:0/3685753571 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc140055bb0 con 0x7fc140128230 2026-02-13T20:21:47.128 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.107+0000 7fc13cff9640 1 -- 10.20.193.110:0/3685753571 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 161053735 0 0) 0x7fc140055bb0 con 0x7fc140128230 2026-02-13T20:21:47.128 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.107+0000 7fc13cff9640 10 monclient(hunting): _negotiate 2026-02-13T20:21:47.128 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.107+0000 7fc13cff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:47.128 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.107+0000 7fc13cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:47.128 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.107+0000 7fc13cff9640 10 monclient(hunting): my global_id is 124170 2026-02-13T20:21:47.128 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.107+0000 7fc13cff9640 1 -- 10.20.193.110:0/3685753571 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc140130f60 con 0x7fc140128230 2026-02-13T20:21:47.128 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.107+0000 7fc13cff9640 1 -- 10.20.193.110:0/3685753571 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2995006983 0 0) 0x7fc140130f60 con 0x7fc140128230 2026-02-13T20:21:47.128 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.107+0000 7fc13cff9640 1 -- 10.20.193.110:0/3685753571 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc140055bb0 con 0x7fc140128230 2026-02-13T20:21:47.128 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.107+0000 7fc13cff9640 1 -- 10.20.193.110:0/3685753571 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc12c0048d0 con 0x7fc140128230 2026-02-13T20:21:47.128 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.107+0000 7fc13cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:47.128 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.107+0000 7fc13cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:21:47.128 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.107+0000 7fc13cff9640 10 monclient: dump: 2026-02-13T20:21:47.128 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:47.128 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:47.129 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:47.129 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:47.129 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:47.129 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:47.129 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:47.129 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:47.129 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:47.129 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:47.129 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.107+0000 7fc13cff9640 1 -- 10.20.193.110:0/3685753571 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3556522539 0 0) 0x7fc140055bb0 con 0x7fc140128230 2026-02-13T20:21:47.129 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.107+0000 7fc13cff9640 1 -- 10.20.193.110:0/3685753571 --> v1:10.20.193.110:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc140058410 con 0x7fc140128230 2026-02-13T20:21:47.129 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.108+0000 7fc13cff9640 1 -- 10.20.193.110:0/3685753571 <== mon.0 v1:10.20.193.110:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4669 (unknown 0 0 2542830213) 0x7fc12c005e70 con 0x7fc140128230 2026-02-13T20:21:47.129 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.108+0000 7fc13cff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:21:47.129 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.108+0000 7fc13cff9640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:21:47.130 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.108+0000 7fc13cff9640 1 -- 10.20.193.110:0/3685753571 >> v1:10.20.193.110:6789/0 conn(0x7fc140128230 legacy=0x7fc1401979b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:47.130 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.108+0000 7fc13cff9640 1 -- 10.20.193.110:0/3685753571 >> v1:10.20.193.110:6789/0 conn(0x7fc140128230 legacy=0x7fc1401979b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:21:47.130 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:21:47.130 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:21:47.130 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:21:47.130 INFO:teuthology.orchestra.run.trial110.stdout: "state": "peon", 2026-02-13T20:21:47.130 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 40, 2026-02-13T20:21:47.131 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 22526, 2026-02-13T20:21:47.131 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:21:47.131 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:21:47.131 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:21:47.131 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:21:47.131 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 0, 2026-02-13T20:21:47.131 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:21:47.131 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:21:47.131 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:21:47.131 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:21:47.131 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:21:47.131 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:21:47.131 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:21:47.132 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:21:47.132 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:21:47.132 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:21:47.132 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:21:47.132 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:21:47.132 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:21:47.132 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:21:47.132 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:21:47.132 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:21:47.132 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:21:47.132 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:21:47.132 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:21:47.132 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:21:47.133 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:21:47.133 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:21:47.133 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:21:47.133 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:21:47.133 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:21:47.133 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:21:47.133 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:21:47.133 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:21:47.133 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:21:47.133 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:21:47.133 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:21:47.133 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:21:47.133 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:21:47.133 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:47.134 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:21:47.134 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:21:47.134 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:21:47.134 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:21:47.134 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:21:47.134 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:21:47.134 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:21:47.134 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:21:47.134 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:21:47.134 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:21:47.134 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:21:47.134 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:21:47.134 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:21:47.134 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:21:47.134 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:21:47.135 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:21:47.135 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:21:47.135 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:21:47.135 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:21:47.135 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:21:47.135 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:21:47.135 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:21:47.135 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:21:47.135 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:21:47.135 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:21:47.135 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:21:47.135 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:21:47.135 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:21:47.135 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:21:47.135 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:21:47.135 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:21:47.136 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:21:47.136 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:47.136 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:21:47.136 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:47.136 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:21:47.136 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:21:47.136 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:21:47.136 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:21:47.136 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:47.136 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:21:47.136 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:21:47.136 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:21:47.136 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:47.136 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:21:47.136 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:47.136 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:21:47.137 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:21:47.137 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:21:47.137 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:21:47.137 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:21:47.137 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:21:47.137 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:47.137 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:47.137 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:21:47.137 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:21:47.137 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:21:47.137 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:21:47.137 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:47.137 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:21:47.137 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:21:47.137 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:21:47.138 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:47.138 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:21:47.138 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:47.138 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:21:47.138 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:21:47.138 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:21:47.138 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:21:47.138 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:21:47.138 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:21:47.138 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:47.138 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:47.138 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:21:47.138 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:21:47.138 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:21:47.138 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:21:47.138 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:47.138 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:21:47.139 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:21:47.139 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:21:47.139 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:47.139 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:21:47.139 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:47.139 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:21:47.139 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:21:47.139 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:21:47.139 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:21:47.139 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:21:47.139 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:21:47.139 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:47.139 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:21:47.139 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:47.139 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:21:47.139 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:21:47.139 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:47.140 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:21:47.140 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:21:47.140 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:21:47.140 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:47.140 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:21:47.140 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:21:47.140 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:47.140 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:21:47.140 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:21:47.140 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:21:47.140 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:47.140 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:21:47.140 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:21:47.140 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:47.140 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:21:47.140 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:21:47.141 INFO:teuthology.orchestra.run.trial110.stdout: "num": 6 2026-02-13T20:21:47.141 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:47.141 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:21:47.141 INFO:teuthology.orchestra.run.trial110.stdout: "mgr": [ 2026-02-13T20:21:47.141 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:47.141 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:21:47.141 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:21:47.141 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:21:47.141 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:47.141 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:21:47.141 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:47.141 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:21:47.141 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:21:47.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.108+0000 7fc1464cc640 1 -- 10.20.193.110:0/3685753571 >> v1:10.20.193.188:6812/1623052694 conn(0x7fc11003f9b0 legacy=0x7fc11005fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:47.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.108+0000 7fc1464cc640 10 monclient: shutdown 2026-02-13T20:21:47.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.108+0000 7fc1464cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:21:47.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.108+0000 7fc1464cc640 1 -- 10.20.193.110:0/3685753571 >> v1:10.20.193.110:6789/0 conn(0x7fc140152800 legacy=0x7fc140195280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:47.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.108+0000 7fc144a42640 1 -- 10.20.193.110:0/3685753571 reap_dead start 2026-02-13T20:21:47.143 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.108+0000 7fc144a42640 1 -- 10.20.193.110:0/3685753571 reap_dead start 2026-02-13T20:21:47.143 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.108+0000 7fc1464cc640 1 -- 10.20.193.110:0/3685753571 shutdown_connections 2026-02-13T20:21:47.143 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.108+0000 7fc1464cc640 1 -- 10.20.193.110:0/3685753571 >> 10.20.193.110:0/3685753571 conn(0x7fc140054e90 msgr2=0x7fc14008dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:21:47.143 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.108+0000 7fc1464cc640 1 -- 10.20.193.110:0/3685753571 shutdown_connections 2026-02-13T20:21:47.143 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.108+0000 7fc1464cc640 1 -- 10.20.193.110:0/3685753571 wait complete. 2026-02-13T20:21:47.143 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-13T20:21:47.143 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-13T20:21:47.143 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T20:21:47.152 INFO:tasks.rados.rados.0.trial188.stdout:2285: expect (ObjNum 623 snap 166 seq_num 623) 2026-02-13T20:21:47.152 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:21:47.208 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.208+0000 7f73eeecc640 10 monclient: get_monmap_and_config 2026-02-13T20:21:47.209 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.208+0000 7f73eeecc640 10 monclient: build_initial_monmap 2026-02-13T20:21:47.209 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.208+0000 7f73eeecc640 10 monclient: monmap: 2026-02-13T20:21:47.209 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:21:47.209 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:47.209 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:21:47.208926+0000 2026-02-13T20:21:47.209 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:21:47.208926+0000 2026-02-13T20:21:47.209 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:21:47.209 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:47.209 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:21:47.209 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:21:47.209 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:21:47.209 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:47.210 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.208+0000 7f73eeecc640 1 Processor -- start 2026-02-13T20:21:47.210 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.208+0000 7f73eeecc640 1 -- start start 2026-02-13T20:21:47.210 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.208+0000 7f73eeecc640 10 monclient: init 2026-02-13T20:21:47.210 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73eeecc640 10 monclient: _reopen_session rank -1 2026-02-13T20:21:47.210 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73eeecc640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:21:47.210 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73eeecc640 10 monclient(hunting): picked mon.noname-c con 0x7f73e81401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:21:47.210 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73eeecc640 10 monclient(hunting): picked mon.noname-a con 0x7f73e8092020 addr v1:10.20.193.110:6789/0 2026-02-13T20:21:47.210 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73eeecc640 10 monclient(hunting): picked mon.noname-b con 0x7f73e8091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:21:47.210 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73eeecc640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73e808b730 con 0x7f73e8092020 2026-02-13T20:21:47.210 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73eeecc640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73e805c5b0 con 0x7f73e81401c0 2026-02-13T20:21:47.210 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73eeecc640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73e808bcf0 con 0x7f73e8091950 2026-02-13T20:21:47.210 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73eeecc640 10 monclient(hunting): _renew_subs 2026-02-13T20:21:47.210 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73eeecc640 10 monclient(hunting): authenticate will time out at 1268.899317s 2026-02-13T20:21:47.210 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73ecc41640 1 -- >> v1:10.20.193.188:6789/0 conn(0x7f73e81401c0 legacy=0x7f73e8091240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:21:47.210 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73ed442640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f73e8091950 0x7f73e81a2a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:57556/0 (socket says 10.20.193.110:57556) 2026-02-13T20:21:47.210 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73dffff640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f73e8092020 0x7f73e81812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:48922/0 (socket says 10.20.193.110:48922) 2026-02-13T20:21:47.210 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73ed442640 1 -- 10.20.193.110:0/3510299145 learned_addr learned my addr 10.20.193.110:0/3510299145 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:21:47.210 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73df7fe640 1 -- 10.20.193.110:0/3510299145 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4215473173 0 0) 0x7f73e808bcf0 con 0x7f73e8091950 2026-02-13T20:21:47.210 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73df7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:21:47.210 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73df7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:47.211 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73df7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:47.211 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73df7fe640 10 monclient(hunting): my global_id is 94478 2026-02-13T20:21:47.211 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73df7fe640 1 -- 10.20.193.110:0/3510299145 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73d40035e0 con 0x7f73e8091950 2026-02-13T20:21:47.211 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73df7fe640 1 -- 10.20.193.110:0/3510299145 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 93420003 0 0) 0x7f73e808b730 con 0x7f73e8092020 2026-02-13T20:21:47.211 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73df7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:21:47.211 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73df7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:47.211 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73df7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:47.211 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73df7fe640 10 monclient(hunting): my global_id is 124173 2026-02-13T20:21:47.211 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73df7fe640 1 -- 10.20.193.110:0/3510299145 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73e808bcf0 con 0x7f73e8092020 2026-02-13T20:21:47.211 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73df7fe640 1 -- 10.20.193.110:0/3510299145 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 988297150 0 0) 0x7f73d40035e0 con 0x7f73e8091950 2026-02-13T20:21:47.211 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73df7fe640 1 -- 10.20.193.110:0/3510299145 >> v1:10.20.193.188:6789/0 conn(0x7f73e81401c0 legacy=0x7f73e8091240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:21:47.211 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73df7fe640 1 -- 10.20.193.110:0/3510299145 >> v1:10.20.193.110:6789/0 conn(0x7f73e8092020 legacy=0x7f73e81812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:47.211 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73df7fe640 10 monclient: _finish_hunting 0 2026-02-13T20:21:47.211 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73df7fe640 1 monclient: found mon.noname-b 2026-02-13T20:21:47.211 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73df7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:21:47.211 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73df7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:21:47.211 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73df7fe640 1 -- 10.20.193.110:0/3510299145 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73e8140590 con 0x7f73e8091950 2026-02-13T20:21:47.211 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73df7fe640 10 monclient: _finish_auth 0 2026-02-13T20:21:47.211 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73df7fe640 10 monclient: _check_auth_tickets 2026-02-13T20:21:47.211 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73df7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:21:47.211 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73df7fe640 1 -- 10.20.193.110:0/3510299145 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f73e4003eb0 con 0x7f73e8091950 2026-02-13T20:21:47.211 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73df7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:47.211 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73df7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:21:47.211 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73df7fe640 10 monclient: dump: 2026-02-13T20:21:47.211 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:47.211 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:47.211 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:47.211 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:47.211 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:47.211 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:47.211 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:47.211 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:47.211 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:47.212 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:47.212 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73eeecc640 5 monclient: authenticate success, global_id 94478 2026-02-13T20:21:47.212 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73eeecc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:21:47.212 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73df7fe640 1 -- 10.20.193.110:0/3510299145 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f73e4004040 con 0x7f73e8091950 2026-02-13T20:21:47.212 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73df7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:21:47.212 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73df7fe640 1 -- 10.20.193.110:0/3510299145 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f73e4004450 con 0x7f73e8091950 2026-02-13T20:21:47.212 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73df7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:47.212 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73df7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:21:47.212 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73df7fe640 10 monclient: dump: 2026-02-13T20:21:47.212 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:47.212 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:47.212 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:47.212 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:47.212 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:47.212 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:47.212 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:47.212 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:47.212 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:47.212 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:47.212 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73eeecc640 10 monclient: get_monmap_and_config success 2026-02-13T20:21:47.212 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.209+0000 7f73eeecc640 4 set_mon_vals no callback set 2026-02-13T20:21:47.212 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.210+0000 7f73eeecc640 10 monclient: shutdown 2026-02-13T20:21:47.212 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.210+0000 7f73eeecc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:21:47.212 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.210+0000 7f73eeecc640 1 -- 10.20.193.110:0/3510299145 >> v1:10.20.193.110:6790/0 conn(0x7f73e8091950 legacy=0x7f73e81a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:47.212 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.210+0000 7f73eeecc640 1 -- 10.20.193.110:0/3510299145 shutdown_connections 2026-02-13T20:21:47.212 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.210+0000 7f73eeecc640 1 -- 10.20.193.110:0/3510299145 >> 10.20.193.110:0/3510299145 conn(0x7f73e8054e90 msgr2=0x7f73e8058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:21:47.212 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.210+0000 7f73eeecc640 1 -- 10.20.193.110:0/3510299145 shutdown_connections 2026-02-13T20:21:47.212 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.210+0000 7f73eeecc640 1 -- 10.20.193.110:0/3510299145 wait complete. 2026-02-13T20:21:47.212 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:21:47.214 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.210+0000 7f73eeecc640 10 monclient: build_initial_monmap 2026-02-13T20:21:47.214 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.210+0000 7f73eeecc640 10 monclient: monmap: 2026-02-13T20:21:47.214 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:21:47.214 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:21:47.214 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:21:47.214 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:21:47.214 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:21:47.214 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:21:47.214 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:21:47.214 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:21:47.214 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:21:47.214 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:47.214 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.210+0000 7f73eeecc640 1 Processor -- start 2026-02-13T20:21:47.214 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.210+0000 7f73eeecc640 1 -- start start 2026-02-13T20:21:47.214 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.210+0000 7f73eeecc640 10 monclient: init 2026-02-13T20:21:47.214 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73eeecc640 10 monclient: _reopen_session rank -1 2026-02-13T20:21:47.214 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73eeecc640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:21:47.214 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73eeecc640 10 monclient(hunting): picked mon.noname-a con 0x7f73e8091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:21:47.214 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73eeecc640 10 monclient(hunting): picked mon.noname-b con 0x7f73e81401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:21:47.214 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73eeecc640 10 monclient(hunting): picked mon.noname-c con 0x7f73e813ea40 addr v1:10.20.193.110:6790/0 2026-02-13T20:21:47.214 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73eeecc640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73e813f400 con 0x7f73e8091950 2026-02-13T20:21:47.214 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73eeecc640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73e805d320 con 0x7f73e81401c0 2026-02-13T20:21:47.214 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73eeecc640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73e812d9d0 con 0x7f73e813ea40 2026-02-13T20:21:47.214 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73eeecc640 10 monclient(hunting): _renew_subs 2026-02-13T20:21:47.214 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73eeecc640 10 monclient(hunting): authenticate will time out at 1268.901104s 2026-02-13T20:21:47.214 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73ecc41640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f73e8091950 0x7f73e813e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:48938/0 (socket says 10.20.193.110:48938) 2026-02-13T20:21:47.214 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73ecc41640 1 -- 10.20.193.110:0/1524309081 learned_addr learned my addr 10.20.193.110:0/1524309081 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:21:47.214 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73dffff640 1 -- 10.20.193.110:0/1524309081 >> v1:10.20.193.188:6789/0 conn(0x7f73e81401c0 legacy=0x7f73e8191660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:21:47.214 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73dd7fa640 1 -- 10.20.193.110:0/1524309081 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1498325573 0 0) 0x7f73e812d9d0 con 0x7f73e813ea40 2026-02-13T20:21:47.214 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73dd7fa640 10 monclient(hunting): _negotiate 2026-02-13T20:21:47.214 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73dd7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:47.215 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73dd7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:47.215 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73dd7fa640 10 monclient(hunting): my global_id is 94481 2026-02-13T20:21:47.215 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73dd7fa640 1 -- 10.20.193.110:0/1524309081 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73b80035e0 con 0x7f73e813ea40 2026-02-13T20:21:47.215 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73dd7fa640 1 -- 10.20.193.110:0/1524309081 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1301610815 0 0) 0x7f73e813f400 con 0x7f73e8091950 2026-02-13T20:21:47.215 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73dd7fa640 10 monclient(hunting): _negotiate 2026-02-13T20:21:47.215 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73dd7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:47.215 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73dd7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:47.215 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73dd7fa640 10 monclient(hunting): my global_id is 124176 2026-02-13T20:21:47.215 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73dd7fa640 1 -- 10.20.193.110:0/1524309081 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73e812d9d0 con 0x7f73e8091950 2026-02-13T20:21:47.215 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73dd7fa640 1 -- 10.20.193.110:0/1524309081 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4284236958 0 0) 0x7f73b80035e0 con 0x7f73e813ea40 2026-02-13T20:21:47.215 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73dd7fa640 1 -- 10.20.193.110:0/1524309081 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f73e813f400 con 0x7f73e813ea40 2026-02-13T20:21:47.215 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73dd7fa640 1 -- 10.20.193.110:0/1524309081 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f73e4004360 con 0x7f73e813ea40 2026-02-13T20:21:47.215 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73dd7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:21:47.215 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73dd7fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:21:47.215 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73dd7fa640 10 monclient(hunting): dump: 2026-02-13T20:21:47.215 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:47.215 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:47.215 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:47.215 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:47.215 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:47.215 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:47.215 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:47.215 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:47.215 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:47.215 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:47.215 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73dd7fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:21:47.215 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73dd7fa640 1 -- 10.20.193.110:0/1524309081 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2399608522 0 0) 0x7f73e812d9d0 con 0x7f73e8091950 2026-02-13T20:21:47.215 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73dd7fa640 1 -- 10.20.193.110:0/1524309081 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f73b80035e0 con 0x7f73e8091950 2026-02-13T20:21:47.215 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73dd7fa640 1 -- 10.20.193.110:0/1524309081 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f73d8004250 con 0x7f73e8091950 2026-02-13T20:21:47.215 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73dd7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:21:47.215 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73dd7fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:21:47.215 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73dd7fa640 10 monclient(hunting): dump: 2026-02-13T20:21:47.215 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:47.215 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:47.215 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:47.215 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:47.215 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:47.215 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:47.215 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:47.215 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:47.215 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:47.215 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:47.215 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73dd7fa640 1 -- 10.20.193.110:0/1524309081 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1321867817 0 0) 0x7f73e813f400 con 0x7f73e813ea40 2026-02-13T20:21:47.216 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73dd7fa640 1 -- 10.20.193.110:0/1524309081 >> v1:10.20.193.188:6789/0 conn(0x7f73e81401c0 legacy=0x7f73e8191660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T20:21:47.216 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73dd7fa640 1 -- 10.20.193.110:0/1524309081 >> v1:10.20.193.110:6789/0 conn(0x7f73e8091950 legacy=0x7f73e813e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:47.216 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73dd7fa640 10 monclient: _finish_hunting 0 2026-02-13T20:21:47.216 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73dd7fa640 1 monclient: found mon.c 2026-02-13T20:21:47.216 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73dd7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:21:47.216 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73dd7fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:21:47.216 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73dd7fa640 1 -- 10.20.193.110:0/1524309081 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73e81509b0 con 0x7f73e813ea40 2026-02-13T20:21:47.216 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73dd7fa640 10 monclient: _finish_auth 0 2026-02-13T20:21:47.216 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73dd7fa640 10 monclient: _check_auth_tickets 2026-02-13T20:21:47.216 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73dd7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:21:47.216 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73eeecc640 5 monclient: authenticate success, global_id 94481 2026-02-13T20:21:47.216 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73eeecc640 10 monclient: _renew_subs 2026-02-13T20:21:47.216 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73eeecc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:21:47.216 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73eeecc640 1 -- 10.20.193.110:0/1524309081 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f73e812fd30 con 0x7f73e813ea40 2026-02-13T20:21:47.216 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73eeecc640 10 monclient: _renew_subs 2026-02-13T20:21:47.216 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73eeecc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:21:47.216 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73eeecc640 1 -- 10.20.193.110:0/1524309081 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f73e8150300 con 0x7f73e813ea40 2026-02-13T20:21:47.216 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73dd7fa640 1 -- 10.20.193.110:0/1524309081 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f73e4005c30 con 0x7f73e813ea40 2026-02-13T20:21:47.216 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73dd7fa640 10 monclient: handle_config config(0 keys) 2026-02-13T20:21:47.216 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73dd7fa640 1 -- 10.20.193.110:0/1524309081 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f73e4005f50 con 0x7f73e813ea40 2026-02-13T20:21:47.216 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73dd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:47.216 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73dd7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:21:47.216 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73dd7fa640 10 monclient: dump: 2026-02-13T20:21:47.216 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:47.216 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:47.216 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:47.216 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:47.216 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:47.216 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:47.216 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:47.216 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:47.216 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:47.216 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:47.216 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73deffd640 4 set_mon_vals no callback set 2026-02-13T20:21:47.216 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.211+0000 7f73eeecc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:21:47.216 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.212+0000 7f73eeecc640 1 -- 10.20.193.110:0/1524309081 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f73e80008d0 con 0x7f73e8092020 2026-02-13T20:21:47.216 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.212+0000 7f73dd7fa640 1 -- 10.20.193.110:0/1524309081 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1640772434 0 0) 0x7f73e80008d0 con 0x7f73e8092020 2026-02-13T20:21:47.216 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.212+0000 7f73dd7fa640 10 monclient(hunting): _negotiate 2026-02-13T20:21:47.216 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.212+0000 7f73dd7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:47.216 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.212+0000 7f73dd7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:47.216 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.212+0000 7f73dd7fa640 10 monclient(hunting): my global_id is 94484 2026-02-13T20:21:47.217 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.212+0000 7f73dd7fa640 1 -- 10.20.193.110:0/1524309081 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73e813f400 con 0x7f73e8092020 2026-02-13T20:21:47.217 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.212+0000 7f73dd7fa640 1 -- 10.20.193.110:0/1524309081 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f73e4012bc0 con 0x7f73e813ea40 2026-02-13T20:21:47.217 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.212+0000 7f73dd7fa640 1 -- 10.20.193.110:0/1524309081 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(491..491 src has 1..491) ==== 4023+0+0 (unknown 2685720963 0 0) 0x7f73e404f8d0 con 0x7f73e813ea40 2026-02-13T20:21:47.217 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.212+0000 7f73dd7fa640 1 -- 10.20.193.110:0/1524309081 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1564456581 0 0) 0x7f73e813f400 con 0x7f73e8092020 2026-02-13T20:21:47.217 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.212+0000 7f73dd7fa640 1 -- 10.20.193.110:0/1524309081 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f73e80008d0 con 0x7f73e8092020 2026-02-13T20:21:47.217 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.212+0000 7f73dd7fa640 1 -- 10.20.193.110:0/1524309081 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f73d8004820 con 0x7f73e8092020 2026-02-13T20:21:47.217 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.212+0000 7f73dd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:47.217 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.212+0000 7f73dd7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:21:47.217 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.212+0000 7f73dd7fa640 10 monclient: dump: 2026-02-13T20:21:47.217 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:47.217 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:47.217 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:47.217 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:47.217 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:47.217 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:47.217 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:47.217 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:47.217 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:47.217 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:47.217 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.212+0000 7f73dffff640 10 monclient: get_auth_request con 0x7f73b803fa10 auth_method 0 2026-02-13T20:21:47.217 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.212+0000 7f73dd7fa640 1 -- 10.20.193.110:0/1524309081 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 391565183 0 0) 0x7f73e80008d0 con 0x7f73e8092020 2026-02-13T20:21:47.217 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.212+0000 7f73dd7fa640 1 -- 10.20.193.110:0/1524309081 --> v1:10.20.193.110:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f73e812f490 con 0x7f73e8092020 2026-02-13T20:21:47.217 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.212+0000 7f73dd7fa640 1 -- 10.20.193.110:0/1524309081 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f73d8005870 con 0x7f73e8092020 2026-02-13T20:21:47.217 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.212+0000 7f73dd7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:21:47.217 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.212+0000 7f73dd7fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:21:47.217 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.212+0000 7f73dd7fa640 1 -- 10.20.193.110:0/1524309081 >> v1:10.20.193.110:6790/0 conn(0x7f73e8092020 legacy=0x7f73e8127b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:47.217 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.212+0000 7f73dd7fa640 1 -- 10.20.193.110:0/1524309081 >> v1:10.20.193.110:6790/0 conn(0x7f73e8092020 legacy=0x7f73e8127b20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:21:47.218 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.216+0000 7f73eeecc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:21:47.218 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.216+0000 7f73eeecc640 1 -- 10.20.193.110:0/1524309081 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f73e812f900 con 0x7f73e8128230 2026-02-13T20:21:47.218 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.216+0000 7f73dd7fa640 1 -- 10.20.193.110:0/1524309081 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3471700542 0 0) 0x7f73e812f900 con 0x7f73e8128230 2026-02-13T20:21:47.218 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.216+0000 7f73dd7fa640 10 monclient(hunting): _negotiate 2026-02-13T20:21:47.218 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.216+0000 7f73dd7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:21:47.218 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.216+0000 7f73dd7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:21:47.218 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.216+0000 7f73dd7fa640 10 monclient(hunting): my global_id is 94487 2026-02-13T20:21:47.218 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.216+0000 7f73dd7fa640 1 -- 10.20.193.110:0/1524309081 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73e80008d0 con 0x7f73e8128230 2026-02-13T20:21:47.218 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.216+0000 7f73dd7fa640 1 -- 10.20.193.110:0/1524309081 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3133488760 0 0) 0x7f73e80008d0 con 0x7f73e8128230 2026-02-13T20:21:47.218 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.216+0000 7f73dd7fa640 1 -- 10.20.193.110:0/1524309081 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f73e812f900 con 0x7f73e8128230 2026-02-13T20:21:47.218 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.216+0000 7f73dd7fa640 1 -- 10.20.193.110:0/1524309081 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f73d80051f0 con 0x7f73e8128230 2026-02-13T20:21:47.218 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.216+0000 7f73dd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:21:47.218 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.216+0000 7f73dd7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:21:47.218 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.216+0000 7f73dd7fa640 10 monclient: dump: 2026-02-13T20:21:47.218 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:21:47.218 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:21:47.218 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:47.218 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:21:47.218 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:21:47.218 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:21:47.218 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:21:47.218 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:21:47.218 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:21:47.218 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:21:47.218 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.216+0000 7f73dd7fa640 1 -- 10.20.193.110:0/1524309081 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3526396741 0 0) 0x7f73e812f900 con 0x7f73e8128230 2026-02-13T20:21:47.218 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.216+0000 7f73dd7fa640 1 -- 10.20.193.110:0/1524309081 --> v1:10.20.193.110:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f73e808b450 con 0x7f73e8128230 2026-02-13T20:21:47.218 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.217+0000 7f73dd7fa640 1 -- 10.20.193.110:0/1524309081 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4505 (unknown 0 0 3227704648) 0x7f73d8005b00 con 0x7f73e8128230 2026-02-13T20:21:47.218 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.217+0000 7f73dd7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:21:47.218 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.217+0000 7f73dd7fa640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:21:47.218 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.217+0000 7f73dd7fa640 1 -- 10.20.193.110:0/1524309081 >> v1:10.20.193.110:6790/0 conn(0x7f73e8128230 legacy=0x7f73e81954b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:47.218 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.217+0000 7f73dd7fa640 1 -- 10.20.193.110:0/1524309081 >> v1:10.20.193.110:6790/0 conn(0x7f73e8128230 legacy=0x7f73e81954b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:21:47.219 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:21:47.219 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:21:47.219 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:21:47.219 INFO:teuthology.orchestra.run.trial110.stdout: "state": "leader", 2026-02-13T20:21:47.219 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 40, 2026-02-13T20:21:47.219 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 378839, 2026-02-13T20:21:47.219 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:21:47.219 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:21:47.219 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:21:47.219 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:21:47.219 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 0, 2026-02-13T20:21:47.219 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:21:47.219 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:21:47.219 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:21:47.219 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:21:47.219 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:21:47.219 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:21:47.219 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:21:47.219 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:21:47.219 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:21:47.219 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:21:47.219 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:21:47.219 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:21:47.219 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:21:47.219 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:21:47.219 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:21:47.219 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:21:47.219 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:21:47.219 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:21:47.219 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:21:47.219 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:21:47.219 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:21:47.219 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:21:47.219 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:21:47.219 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:21:47.219 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:21:47.219 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:21:47.219 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:21:47.219 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:21:47.219 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:21:47.220 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:21:47.220 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:21:47.220 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:21:47.220 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:21:47.220 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:47.220 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:21:47.220 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:21:47.220 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:21:47.220 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:21:47.220 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:21:47.220 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:21:47.220 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:21:47.220 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:21:47.220 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:21:47.220 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:21:47.220 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:21:47.220 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:21:47.220 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:21:47.220 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:21:47.220 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:21:47.220 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:21:47.220 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:21:47.220 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:21:47.220 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:21:47.220 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:21:47.220 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:21:47.220 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:21:47.220 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:21:47.220 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:21:47.220 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:21:47.220 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:21:47.220 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:21:47.220 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:21:47.220 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:21:47.220 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:21:47.220 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:21:47.220 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:21:47.220 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:47.220 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:21:47.220 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:47.221 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:21:47.221 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:21:47.221 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:21:47.221 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:21:47.221 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:47.221 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:21:47.221 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:21:47.221 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:21:47.221 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:47.221 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:21:47.221 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:47.221 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:21:47.221 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:21:47.221 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:21:47.221 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:21:47.221 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:21:47.221 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:21:47.221 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:47.221 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:47.221 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:21:47.221 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:21:47.221 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:21:47.221 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:21:47.221 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:47.221 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:21:47.221 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:21:47.221 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:21:47.221 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:47.221 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:21:47.221 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:47.221 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:21:47.221 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:21:47.221 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:21:47.221 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:21:47.221 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:21:47.221 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:21:47.221 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:47.221 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:47.221 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:21:47.221 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:21:47.221 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:21:47.222 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:21:47.222 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:47.222 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:21:47.222 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:21:47.222 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:21:47.222 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:47.222 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:21:47.222 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:47.222 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:21:47.222 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:21:47.222 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:21:47.222 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:21:47.222 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:21:47.222 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:21:47.222 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:47.222 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:21:47.222 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:47.222 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:21:47.222 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:21:47.222 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:47.222 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:21:47.222 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:21:47.222 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:21:47.222 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:47.222 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:21:47.222 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:21:47.222 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:47.222 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:21:47.222 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:21:47.222 INFO:teuthology.orchestra.run.trial110.stdout: "num": 5 2026-02-13T20:21:47.222 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:47.222 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:21:47.222 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:21:47.222 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:21:47.222 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:21:47.222 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:21:47.222 INFO:teuthology.orchestra.run.trial110.stdout: "num": 3 2026-02-13T20:21:47.222 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:21:47.222 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:21:47.222 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:21:47.222 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:21:47.222 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:21:47.223 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.217+0000 7f73eeecc640 1 -- 10.20.193.110:0/1524309081 >> v1:10.20.193.188:6812/1623052694 conn(0x7f73b803fa10 legacy=0x7f73b805fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:47.223 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.217+0000 7f73eeecc640 10 monclient: shutdown 2026-02-13T20:21:47.223 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.217+0000 7f73eeecc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:21:47.223 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.217+0000 7f73eeecc640 1 -- 10.20.193.110:0/1524309081 >> v1:10.20.193.110:6790/0 conn(0x7f73e813ea40 legacy=0x7f73e8192d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:21:47.223 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.217+0000 7f73ed442640 1 -- 10.20.193.110:0/1524309081 reap_dead start 2026-02-13T20:21:47.223 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.217+0000 7f73ed442640 1 -- 10.20.193.110:0/1524309081 reap_dead start 2026-02-13T20:21:47.223 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.217+0000 7f73eeecc640 1 -- 10.20.193.110:0/1524309081 shutdown_connections 2026-02-13T20:21:47.223 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.217+0000 7f73eeecc640 1 -- 10.20.193.110:0/1524309081 >> 10.20.193.110:0/1524309081 conn(0x7f73e8054e90 msgr2=0x7f73e808dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:21:47.223 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.217+0000 7f73eeecc640 1 -- 10.20.193.110:0/1524309081 shutdown_connections 2026-02-13T20:21:47.223 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:21:47.217+0000 7f73eeecc640 1 -- 10.20.193.110:0/1524309081 wait complete. 2026-02-13T20:21:47.223 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-13T20:21:47.223 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-13T20:21:47.275 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 619057 2026-02-13T20:21:47.326 INFO:tasks.rados.rados.0.trial188.stdout:2289: expect (ObjNum 723 snap 214 seq_num 723) 2026-02-13T20:21:47.338 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:21:47.359 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 32530 2026-02-13T20:21:47.379 INFO:tasks.rados.rados.0.trial188.stdout:2287: finishing write tid 1 to trial18843701-43 2026-02-13T20:21:47.380 INFO:tasks.rados.rados.0.trial188.stdout:2284: done (11 left) 2026-02-13T20:21:47.380 INFO:tasks.rados.rados.0.trial188.stdout:2285: done (10 left) 2026-02-13T20:21:47.380 INFO:tasks.rados.rados.0.trial188.stdout:2286: done (9 left) 2026-02-13T20:21:47.380 INFO:tasks.rados.rados.0.trial188.stdout:2289: done (8 left) 2026-02-13T20:21:47.380 INFO:tasks.rados.rados.0.trial188.stdout:2297: snap_remove snap 236 2026-02-13T20:21:47.927 INFO:tasks.rados.rados.0.trial188.stdout:2297: done (8 left) 2026-02-13T20:21:47.927 INFO:tasks.rados.rados.0.trial188.stdout:2298: write (excl) oid 17 current snap is 240 2026-02-13T20:21:47.927 INFO:tasks.rados.rados.0.trial188.stdout:2298: seq_num 813 ranges {464091=710855,1925037=477270,2943246=474970} 2026-02-13T20:21:47.931 INFO:tasks.rados.rados.0.trial188.stdout:2298: writing trial18843701-17 from 464091 to 1174946 tid 1 2026-02-13T20:21:47.936 INFO:tasks.rados.rados.0.trial188.stdout:2298: writing trial18843701-17 from 1925037 to 2402307 tid 2 2026-02-13T20:21:47.940 INFO:tasks.rados.rados.0.trial188.stdout:2298: writing trial18843701-17 from 2943246 to 3418216 tid 3 2026-02-13T20:21:47.940 INFO:tasks.rados.rados.0.trial188.stdout:2299: rollback oid 20 current snap is 240 2026-02-13T20:21:47.941 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 20 to 228 2026-02-13T20:21:47.941 INFO:tasks.rados.rados.0.trial188.stdout:2287: finishing write tid 2 to trial18843701-43 2026-02-13T20:21:47.941 INFO:tasks.rados.rados.0.trial188.stdout:2287: finishing write tid 3 to trial18843701-43 2026-02-13T20:21:47.941 INFO:tasks.rados.rados.0.trial188.stdout:2287: finishing write tid 4 to trial18843701-43 2026-02-13T20:21:47.941 INFO:tasks.rados.rados.0.trial188.stdout:2287: finishing write tid 5 to trial18843701-43 2026-02-13T20:21:47.941 INFO:tasks.rados.rados.0.trial188.stdout:2287: oid 43 updating version 0 to 685 2026-02-13T20:21:47.941 INFO:tasks.rados.rados.0.trial188.stdout:2287: oid 43 updating version 685 to 686 2026-02-13T20:21:47.941 INFO:tasks.rados.rados.0.trial188.stdout:2287: oid 43 version 686 is already newer than 683 2026-02-13T20:21:47.941 INFO:tasks.rados.rados.0.trial188.stdout:2287: oid 43 version 686 is already newer than 684 2026-02-13T20:21:47.941 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 43 v 686 (ObjNum 810 snap 240 seq_num 810) dirty exists 2026-02-13T20:21:47.941 INFO:tasks.rados.rados.0.trial188.stdout:2287: left oid 43 (ObjNum 810 snap 240 seq_num 810) 2026-02-13T20:21:47.941 INFO:tasks.rados.rados.0.trial188.stdout:2288: expect (ObjNum 618 snap 163 seq_num 618) 2026-02-13T20:21:47.942 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:21:47.989 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:21:48.014 INFO:tasks.rados.rados.0.trial188.stdout:2291: expect (ObjNum 739 snap 220 seq_num 739) 2026-02-13T20:21:48.028 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:21:48.045 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:21:48.064 INFO:tasks.rados.rados.0.trial188.stdout:2293: finishing rollback tid 0 to trial18843701-3 2026-02-13T20:21:48.064 INFO:tasks.rados.rados.0.trial188.stdout:2293: finishing rollback tid 1 to trial18843701-3 2026-02-13T20:21:48.064 INFO:tasks.rados.rados.0.trial188.stdout:2293: finishing rollback tid 2 to trial18843701-3 2026-02-13T20:21:48.064 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 3 v 782 (ObjNum 782 snap 232 seq_num 782) dirty exists 2026-02-13T20:21:48.064 INFO:tasks.rados.rados.0.trial188.stdout:2294: finishing rollback tid 0 to trial18843701-16 2026-02-13T20:21:48.064 INFO:tasks.rados.rados.0.trial188.stdout:2294: finishing rollback tid 1 to trial18843701-16 2026-02-13T20:21:48.064 INFO:tasks.rados.rados.0.trial188.stdout:2287: done (9 left) 2026-02-13T20:21:48.064 INFO:tasks.rados.rados.0.trial188.stdout:2288: done (8 left) 2026-02-13T20:21:48.064 INFO:tasks.rados.rados.0.trial188.stdout:2291: done (7 left) 2026-02-13T20:21:48.065 INFO:tasks.rados.rados.0.trial188.stdout:2293: done (6 left) 2026-02-13T20:21:48.065 INFO:tasks.rados.rados.0.trial188.stdout:2300: delete oid 18 current snap is 240 2026-02-13T20:21:48.065 INFO:tasks.rados.rados.0.trial188.stdout:2294: finishing rollback tid 2 to trial18843701-16 2026-02-13T20:21:48.065 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 16 v 1042 (ObjNum 645 snap 172 seq_num 645) dirty exists 2026-02-13T20:21:48.065 INFO:tasks.rados.rados.0.trial188.stdout:2296: finishing copy_from to trial18843701-1 2026-02-13T20:21:48.065 INFO:tasks.rados.rados.0.trial188.stdout:2296: got expected ENOENT (src dne) 2026-02-13T20:21:48.065 INFO:tasks.rados.rados.0.trial188.stdout:2296: finishing copy_from racing read to trial18843701-1 2026-02-13T20:21:48.065 INFO:tasks.rados.rados.0.trial188.stdout:2292: finishing write tid 1 to trial18843701-27 2026-02-13T20:21:48.065 INFO:tasks.rados.rados.0.trial188.stdout:2292: finishing write tid 2 to trial18843701-27 2026-02-13T20:21:48.065 INFO:tasks.rados.rados.0.trial188.stdout:2292: finishing write tid 3 to trial18843701-27 2026-02-13T20:21:48.065 INFO:tasks.rados.rados.0.trial188.stdout:2292: finishing write tid 4 to trial18843701-27 2026-02-13T20:21:48.065 INFO:tasks.rados.rados.0.trial188.stdout:2292: finishing write tid 5 to trial18843701-27 2026-02-13T20:21:48.066 INFO:tasks.rados.rados.0.trial188.stdout:2292: oid 27 updating version 0 to 1071 2026-02-13T20:21:48.066 INFO:tasks.rados.rados.0.trial188.stdout:2292: oid 27 updating version 1071 to 1072 2026-02-13T20:21:48.066 INFO:tasks.rados.rados.0.trial188.stdout:2292: oid 27 updating version 1072 to 1073 2026-02-13T20:21:48.066 INFO:tasks.rados.rados.0.trial188.stdout:2292: oid 27 updating version 1073 to 1074 2026-02-13T20:21:48.066 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 27 v 1074 (ObjNum 811 snap 240 seq_num 811) dirty exists 2026-02-13T20:21:48.066 INFO:tasks.rados.rados.0.trial188.stdout:2292: left oid 27 (ObjNum 811 snap 240 seq_num 811) 2026-02-13T20:21:48.066 INFO:tasks.rados.rados.0.trial188.stdout:2295: finishing write tid 1 to trial18843701-7 2026-02-13T20:21:48.066 INFO:tasks.rados.rados.0.trial188.stdout:2295: finishing write tid 2 to trial18843701-7 2026-02-13T20:21:48.066 INFO:tasks.rados.rados.0.trial188.stdout:2295: finishing write tid 3 to trial18843701-7 2026-02-13T20:21:48.066 INFO:tasks.rados.rados.0.trial188.stdout:2295: finishing write tid 4 to trial18843701-7 2026-02-13T20:21:48.066 INFO:tasks.rados.rados.0.trial188.stdout:2295: finishing write tid 5 to trial18843701-7 2026-02-13T20:21:48.066 INFO:tasks.rados.rados.0.trial188.stdout:2295: oid 7 updating version 0 to 952 2026-02-13T20:21:48.066 INFO:tasks.rados.rados.0.trial188.stdout:2295: oid 7 version 952 is already newer than 951 2026-02-13T20:21:48.066 INFO:tasks.rados.rados.0.trial188.stdout:2295: oid 7 version 952 is already newer than 950 2026-02-13T20:21:48.066 INFO:tasks.rados.rados.0.trial188.stdout:2295: oid 7 version 952 is already newer than 949 2026-02-13T20:21:48.067 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 7 v 952 (ObjNum 812 snap 240 seq_num 812) dirty exists 2026-02-13T20:21:48.067 INFO:tasks.rados.rados.0.trial188.stdout:2295: left oid 7 (ObjNum 812 snap 240 seq_num 812) 2026-02-13T20:21:48.067 INFO:tasks.rados.rados.0.trial188.stdout:2299: finishing rollback tid 0 to trial18843701-20 2026-02-13T20:21:48.067 INFO:tasks.rados.rados.0.trial188.stdout:2299: finishing rollback tid 1 to trial18843701-20 2026-02-13T20:21:48.067 INFO:tasks.rados.rados.0.trial188.stdout:2299: finishing rollback tid 2 to trial18843701-20 2026-02-13T20:21:48.067 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 20 v 672 (ObjNum 755 snap 223 seq_num 755) dirty exists 2026-02-13T20:21:48.067 INFO:tasks.rados.rados.0.trial188.stdout:2298: finishing write tid 1 to trial18843701-17 2026-02-13T20:21:48.067 INFO:tasks.rados.rados.0.trial188.stdout:2298: finishing write tid 2 to trial18843701-17 2026-02-13T20:21:48.067 INFO:tasks.rados.rados.0.trial188.stdout:2298: finishing write tid 3 to trial18843701-17 2026-02-13T20:21:48.067 INFO:tasks.rados.rados.0.trial188.stdout:2298: finishing write tid 4 to trial18843701-17 2026-02-13T20:21:48.067 INFO:tasks.rados.rados.0.trial188.stdout:2298: finishing write tid 5 to trial18843701-17 2026-02-13T20:21:48.067 INFO:tasks.rados.rados.0.trial188.stdout:2298: oid 17 updating version 0 to 822 2026-02-13T20:21:48.067 INFO:tasks.rados.rados.0.trial188.stdout:2298: oid 17 updating version 822 to 824 2026-02-13T20:21:48.067 INFO:tasks.rados.rados.0.trial188.stdout:2298: oid 17 version 824 is already newer than 823 2026-02-13T20:21:48.068 INFO:tasks.rados.rados.0.trial188.stdout:2298: oid 17 version 824 is already newer than 821 2026-02-13T20:21:48.068 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 17 v 824 (ObjNum 813 snap 240 seq_num 813) dirty exists 2026-02-13T20:21:48.068 INFO:tasks.rados.rados.0.trial188.stdout:2298: left oid 17 (ObjNum 813 snap 240 seq_num 813) 2026-02-13T20:21:48.068 INFO:tasks.rados.rados.0.trial188.stdout:2292: done (6 left) 2026-02-13T20:21:48.068 INFO:tasks.rados.rados.0.trial188.stdout:2294: done (5 left) 2026-02-13T20:21:48.068 INFO:tasks.rados.rados.0.trial188.stdout:2295: done (4 left) 2026-02-13T20:21:48.068 INFO:tasks.rados.rados.0.trial188.stdout:2296: done (3 left) 2026-02-13T20:21:48.068 INFO:tasks.rados.rados.0.trial188.stdout:2298: done (2 left) 2026-02-13T20:21:48.068 INFO:tasks.rados.rados.0.trial188.stdout:2299: done (1 left) 2026-02-13T20:21:48.068 INFO:tasks.rados.rados.0.trial188.stdout:2300: done (0 left) 2026-02-13T20:21:48.068 INFO:tasks.rados.rados.0.trial188.stdout:2301: copy_from oid 30 from oid 43 current snap is 240 2026-02-13T20:21:48.068 INFO:tasks.rados.rados.0.trial188.stdout:2302: rollback oid 31 current snap is 240 2026-02-13T20:21:48.068 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 31 to 180 2026-02-13T20:21:48.068 INFO:tasks.rados.rados.0.trial188.stdout:2303: delete oid 14 current snap is 240 2026-02-13T20:21:48.069 INFO:tasks.rados.rados.0.trial188.stdout:2303: done (2 left) 2026-02-13T20:21:48.069 INFO:tasks.rados.rados.0.trial188.stdout:2304: write (excl) oid 12 current snap is 240 2026-02-13T20:21:48.069 INFO:tasks.rados.rados.0.trial188.stdout:2304: seq_num 816 ranges {514512=652955,1700483=740950,3025515=688997} 2026-02-13T20:21:48.071 INFO:tasks.rados.rados.0.trial188.stdout:2304: writing trial18843701-12 from 514512 to 1167467 tid 1 2026-02-13T20:21:48.077 INFO:tasks.rados.rados.0.trial188.stdout:2304: writing trial18843701-12 from 1700483 to 2441433 tid 2 2026-02-13T20:21:48.084 INFO:tasks.rados.rados.0.trial188.stdout:2304: writing trial18843701-12 from 3025515 to 3714512 tid 3 2026-02-13T20:21:48.084 INFO:tasks.rados.rados.0.trial188.stdout:2305: write oid 45 current snap is 240 2026-02-13T20:21:48.085 INFO:tasks.rados.rados.0.trial188.stdout:2302: finishing rollback tid 0 to trial18843701-31 2026-02-13T20:21:48.085 INFO:tasks.rados.rados.0.trial188.stdout:2302: finishing rollback tid 1 to trial18843701-31 2026-02-13T20:21:48.085 INFO:tasks.rados.rados.0.trial188.stdout:2302: finishing rollback tid 2 to trial18843701-31 2026-02-13T20:21:48.085 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 31 v 441 (ObjNum 489 snap 127 seq_num 489) dirty exists 2026-02-13T20:21:48.085 INFO:tasks.rados.rados.0.trial188.stdout:2305: seq_num 817 ranges {531319=728204,1758965=484608,2652938=520058} 2026-02-13T20:21:48.090 INFO:tasks.rados.rados.0.trial188.stdout:2305: writing trial18843701-45 from 531319 to 1259523 tid 1 2026-02-13T20:21:48.095 INFO:tasks.rados.rados.0.trial188.stdout:2305: writing trial18843701-45 from 1758965 to 2243573 tid 2 2026-02-13T20:21:48.100 INFO:tasks.rados.rados.0.trial188.stdout:2305: writing trial18843701-45 from 2652938 to 3172996 tid 3 2026-02-13T20:21:48.101 INFO:tasks.rados.rados.0.trial188.stdout:2302: done (3 left) 2026-02-13T20:21:48.101 INFO:tasks.rados.rados.0.trial188.stdout:2306: delete oid 24 current snap is 240 2026-02-13T20:21:48.101 INFO:tasks.rados.rados.0.trial188.stdout:2301: finishing copy_from racing read to trial18843701-30 2026-02-13T20:21:48.101 INFO:tasks.rados.rados.0.trial188.stdout:2304: finishing write tid 1 to trial18843701-12 2026-02-13T20:21:48.103 INFO:tasks.rados.rados.0.trial188.stdout:2306: done (3 left) 2026-02-13T20:21:48.103 INFO:tasks.rados.rados.0.trial188.stdout:2307: read oid 10 snap 222 2026-02-13T20:21:48.103 INFO:tasks.rados.rados.0.trial188.stdout:2307: expect (ObjNum 694 snap 199 seq_num 694) 2026-02-13T20:21:48.103 INFO:tasks.rados.rados.0.trial188.stdout:2308: rollback oid 24 current snap is 240 2026-02-13T20:21:48.103 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 24 to 232 2026-02-13T20:21:48.103 INFO:tasks.rados.rados.0.trial188.stdout:2309: rollback oid 6 current snap is 240 2026-02-13T20:21:48.103 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 6 to 230 2026-02-13T20:21:48.103 INFO:tasks.rados.rados.0.trial188.stdout:2310: read oid 7 snap -1 2026-02-13T20:21:48.103 INFO:tasks.rados.rados.0.trial188.stdout:2310: expect (ObjNum 812 snap 240 seq_num 812) 2026-02-13T20:21:48.103 INFO:tasks.rados.rados.0.trial188.stdout:2311: snap_create 2026-02-13T20:21:48.108 INFO:tasks.rados.rados.0.trial188.stdout:2304: finishing write tid 2 to trial18843701-12 2026-02-13T20:21:48.109 INFO:tasks.rados.rados.0.trial188.stdout:2304: finishing write tid 3 to trial18843701-12 2026-02-13T20:21:48.109 INFO:tasks.rados.rados.0.trial188.stdout:2304: finishing write tid 4 to trial18843701-12 2026-02-13T20:21:48.109 INFO:tasks.rados.rados.0.trial188.stdout:2304: finishing write tid 5 to trial18843701-12 2026-02-13T20:21:48.109 INFO:tasks.rados.rados.0.trial188.stdout:2304: oid 12 updating version 0 to 829 2026-02-13T20:21:48.109 INFO:tasks.rados.rados.0.trial188.stdout:2304: oid 12 version 829 is already newer than 828 2026-02-13T20:21:48.109 INFO:tasks.rados.rados.0.trial188.stdout:2304: oid 12 version 829 is already newer than 826 2026-02-13T20:21:48.109 INFO:tasks.rados.rados.0.trial188.stdout:2304: oid 12 version 829 is already newer than 827 2026-02-13T20:21:48.109 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 12 v 829 (ObjNum 816 snap 240 seq_num 816) dirty exists 2026-02-13T20:21:48.109 INFO:tasks.rados.rados.0.trial188.stdout:2304: left oid 12 (ObjNum 816 snap 240 seq_num 816) 2026-02-13T20:21:48.111 INFO:tasks.rados.rados.0.trial188.stdout:2307: expect (ObjNum 694 snap 199 seq_num 694) 2026-02-13T20:21:48.111 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 299833 2026-02-13T20:21:48.154 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:21:48.238 INFO:tasks.rados.rados.0.trial188.stdout:2308: finishing rollback tid 1 to trial18843701-24 2026-02-13T20:21:48.238 INFO:tasks.rados.rados.0.trial188.stdout:2308: finishing rollback tid 2 to trial18843701-24 2026-02-13T20:21:48.238 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 24 v 1049 (ObjNum 671 snap 185 seq_num 671) dirty exists 2026-02-13T20:21:48.238 INFO:tasks.rados.rados.0.trial188.stdout:2301: finishing copy_from to trial18843701-30 2026-02-13T20:21:48.238 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 30 v 686 (ObjNum 810 snap 240 seq_num 810) dirty exists 2026-02-13T20:21:48.238 INFO:tasks.rados.rados.0.trial188.stdout:2309: finishing rollback tid 0 to trial18843701-6 2026-02-13T20:21:48.238 INFO:tasks.rados.rados.0.trial188.stdout:2305: finishing write tid 1 to trial18843701-45 2026-02-13T20:21:48.238 INFO:tasks.rados.rados.0.trial188.stdout:2309: finishing rollback tid 1 to trial18843701-6 2026-02-13T20:21:48.238 INFO:tasks.rados.rados.0.trial188.stdout:2309: finishing rollback tid 2 to trial18843701-6 2026-02-13T20:21:48.238 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 6 v 1053 (ObjNum 743 snap 220 seq_num 743) dirty exists 2026-02-13T20:21:48.238 INFO:tasks.rados.rados.0.trial188.stdout:2305: finishing write tid 2 to trial18843701-45 2026-02-13T20:21:48.238 INFO:tasks.rados.rados.0.trial188.stdout:2305: finishing write tid 3 to trial18843701-45 2026-02-13T20:21:48.238 INFO:tasks.rados.rados.0.trial188.stdout:2305: finishing write tid 4 to trial18843701-45 2026-02-13T20:21:48.238 INFO:tasks.rados.rados.0.trial188.stdout:2305: finishing write tid 5 to trial18843701-45 2026-02-13T20:21:48.238 INFO:tasks.rados.rados.0.trial188.stdout:2305: oid 45 updating version 0 to 1029 2026-02-13T20:21:48.239 INFO:tasks.rados.rados.0.trial188.stdout:2305: oid 45 version 1029 is already newer than 1027 2026-02-13T20:21:48.239 INFO:tasks.rados.rados.0.trial188.stdout:2305: oid 45 version 1029 is already newer than 1028 2026-02-13T20:21:48.239 INFO:tasks.rados.rados.0.trial188.stdout:2305: oid 45 version 1029 is already newer than 1026 2026-02-13T20:21:48.239 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 45 v 1029 (ObjNum 817 snap 240 seq_num 817) dirty exists 2026-02-13T20:21:48.239 INFO:tasks.rados.rados.0.trial188.stdout:2305: left oid 45 (ObjNum 817 snap 240 seq_num 817) 2026-02-13T20:21:48.239 INFO:tasks.rados.rados.0.trial188.stdout:2310: expect (ObjNum 812 snap 240 seq_num 812) 2026-02-13T20:21:48.931 INFO:tasks.rados.rados.0.trial188.stdout:2301: done (7 left) 2026-02-13T20:21:48.931 INFO:tasks.rados.rados.0.trial188.stdout:2304: done (6 left) 2026-02-13T20:21:48.931 INFO:tasks.rados.rados.0.trial188.stdout:2305: done (5 left) 2026-02-13T20:21:48.931 INFO:tasks.rados.rados.0.trial188.stdout:2307: done (4 left) 2026-02-13T20:21:48.931 INFO:tasks.rados.rados.0.trial188.stdout:2308: done (3 left) 2026-02-13T20:21:48.931 INFO:tasks.rados.rados.0.trial188.stdout:2309: done (2 left) 2026-02-13T20:21:48.931 INFO:tasks.rados.rados.0.trial188.stdout:2310: done (1 left) 2026-02-13T20:21:48.931 INFO:tasks.rados.rados.0.trial188.stdout:2311: done (0 left) 2026-02-13T20:21:48.931 INFO:tasks.rados.rados.0.trial188.stdout:2312: copy_from oid 42 from oid 43 current snap is 241 2026-02-13T20:21:48.931 INFO:tasks.rados.rados.0.trial188.stdout:2313: read oid 8 snap -1 2026-02-13T20:21:48.931 INFO:tasks.rados.rados.0.trial188.stdout:2313: expect (ObjNum 688 snap 199 seq_num 688) 2026-02-13T20:21:48.931 INFO:tasks.rados.rados.0.trial188.stdout:2314: write (excl) oid 44 current snap is 241 2026-02-13T20:21:48.931 INFO:tasks.rados.rados.0.trial188.stdout:2314: seq_num 819 ranges {564933=478702,1759576=488277,2991431=658955} 2026-02-13T20:21:48.936 INFO:tasks.rados.rados.0.trial188.stdout:2314: writing trial18843701-44 from 564933 to 1043635 tid 1 2026-02-13T20:21:48.941 INFO:tasks.rados.rados.0.trial188.stdout:2314: writing trial18843701-44 from 1759576 to 2247853 tid 2 2026-02-13T20:21:48.946 INFO:tasks.rados.rados.0.trial188.stdout:2314: writing trial18843701-44 from 2991431 to 3650386 tid 3 2026-02-13T20:21:48.946 INFO:tasks.rados.rados.0.trial188.stdout:2315: write (excl) oid 48 current snap is 241 2026-02-13T20:21:48.946 INFO:tasks.rados.rados.0.trial188.stdout:2315: seq_num 820 ranges {581740=553951,1818058=748288,3018854=470227} 2026-02-13T20:21:48.950 INFO:tasks.rados.rados.0.trial188.stdout:2315: writing trial18843701-48 from 581740 to 1135691 tid 1 2026-02-13T20:21:48.956 INFO:tasks.rados.rados.0.trial188.stdout:2315: writing trial18843701-48 from 1818058 to 2566346 tid 2 2026-02-13T20:21:48.959 INFO:tasks.rados.rados.0.trial188.stdout:2315: writing trial18843701-48 from 3018854 to 3489081 tid 3 2026-02-13T20:21:48.960 INFO:tasks.rados.rados.0.trial188.stdout:2316: write oid 15 current snap is 241 2026-02-13T20:21:48.960 INFO:tasks.rados.rados.0.trial188.stdout:2316: seq_num 821 ranges {598547=629200,1876540=491946,3046277=681499} 2026-02-13T20:21:48.964 INFO:tasks.rados.rados.0.trial188.stdout:2316: writing trial18843701-15 from 598547 to 1227747 tid 1 2026-02-13T20:21:48.969 INFO:tasks.rados.rados.0.trial188.stdout:2316: writing trial18843701-15 from 1876540 to 2368486 tid 2 2026-02-13T20:21:48.974 INFO:tasks.rados.rados.0.trial188.stdout:2316: writing trial18843701-15 from 3046277 to 3727776 tid 3 2026-02-13T20:21:48.975 INFO:tasks.rados.rados.0.trial188.stdout:2317: write oid 4 current snap is 241 2026-02-13T20:21:48.975 INFO:tasks.rados.rados.0.trial188.stdout:2317: seq_num 822 ranges {615354=420802,1651375=751957,3190053=492771} 2026-02-13T20:21:48.978 INFO:tasks.rados.rados.0.trial188.stdout:2317: writing trial18843701-4 from 615354 to 1036156 tid 1 2026-02-13T20:21:48.983 INFO:tasks.rados.rados.0.trial188.stdout:2317: writing trial18843701-4 from 1651375 to 2403332 tid 2 2026-02-13T20:21:48.988 INFO:tasks.rados.rados.0.trial188.stdout:2317: writing trial18843701-4 from 3190053 to 3682824 tid 3 2026-02-13T20:21:48.988 INFO:tasks.rados.rados.0.trial188.stdout:2318: read oid 24 snap -1 2026-02-13T20:21:48.988 INFO:tasks.rados.rados.0.trial188.stdout:2318: expect (ObjNum 671 snap 185 seq_num 671) 2026-02-13T20:21:48.988 INFO:tasks.rados.rados.0.trial188.stdout:2319: rollback oid 10 current snap is 241 2026-02-13T20:21:48.988 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 10 to 239 2026-02-13T20:21:48.988 INFO:tasks.rados.rados.0.trial188.stdout:2313: expect (ObjNum 688 snap 199 seq_num 688) 2026-02-13T20:21:48.988 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 60311 2026-02-13T20:21:49.082 INFO:tasks.rados.rados.0.trial188.stdout:2314: finishing write tid 1 to trial18843701-44 2026-02-13T20:21:49.082 INFO:tasks.rados.rados.0.trial188.stdout:2314: finishing write tid 2 to trial18843701-44 2026-02-13T20:21:49.082 INFO:tasks.rados.rados.0.trial188.stdout:2314: finishing write tid 3 to trial18843701-44 2026-02-13T20:21:49.082 INFO:tasks.rados.rados.0.trial188.stdout:2313: done (7 left) 2026-02-13T20:21:49.082 INFO:tasks.rados.rados.0.trial188.stdout:2320: read oid 20 snap -1 2026-02-13T20:21:49.082 INFO:tasks.rados.rados.0.trial188.stdout:2320: expect (ObjNum 755 snap 223 seq_num 755) 2026-02-13T20:21:49.082 INFO:tasks.rados.rados.0.trial188.stdout:2321: read oid 38 snap 232 2026-02-13T20:21:49.083 INFO:tasks.rados.rados.0.trial188.stdout:2321: expect (ObjNum 779 snap 232 seq_num 779) 2026-02-13T20:21:49.083 INFO:tasks.rados.rados.0.trial188.stdout:2322: read oid 45 snap -1 2026-02-13T20:21:49.083 INFO:tasks.rados.rados.0.trial188.stdout:2322: expect (ObjNum 817 snap 240 seq_num 817) 2026-02-13T20:21:49.083 INFO:tasks.rados.rados.0.trial188.stdout:2323: copy_from oid 2 from oid 19 current snap is 241 2026-02-13T20:21:49.083 INFO:tasks.rados.rados.0.trial188.stdout:2314: finishing write tid 4 to trial18843701-44 2026-02-13T20:21:49.083 INFO:tasks.rados.rados.0.trial188.stdout:2314: finishing write tid 5 to trial18843701-44 2026-02-13T20:21:49.083 INFO:tasks.rados.rados.0.trial188.stdout:2314: oid 44 updating version 0 to 977 2026-02-13T20:21:49.083 INFO:tasks.rados.rados.0.trial188.stdout:2314: oid 44 version 977 is already newer than 976 2026-02-13T20:21:49.083 INFO:tasks.rados.rados.0.trial188.stdout:2314: oid 44 updating version 977 to 979 2026-02-13T20:21:49.083 INFO:tasks.rados.rados.0.trial188.stdout:2314: oid 44 version 979 is already newer than 978 2026-02-13T20:21:49.083 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 44 v 979 (ObjNum 819 snap 241 seq_num 819) dirty exists 2026-02-13T20:21:49.084 INFO:tasks.rados.rados.0.trial188.stdout:2314: left oid 44 (ObjNum 819 snap 241 seq_num 819) 2026-02-13T20:21:49.084 INFO:tasks.rados.rados.0.trial188.stdout:2312: finishing copy_from racing read to trial18843701-42 2026-02-13T20:21:49.084 INFO:tasks.rados.rados.0.trial188.stdout:2315: finishing write tid 1 to trial18843701-48 2026-02-13T20:21:49.084 INFO:tasks.rados.rados.0.trial188.stdout:2315: finishing write tid 2 to trial18843701-48 2026-02-13T20:21:49.084 INFO:tasks.rados.rados.0.trial188.stdout:2316: finishing write tid 1 to trial18843701-15 2026-02-13T20:21:49.084 INFO:tasks.rados.rados.0.trial188.stdout:2312: finishing copy_from to trial18843701-42 2026-02-13T20:21:49.084 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 42 v 686 (ObjNum 810 snap 240 seq_num 810) dirty exists 2026-02-13T20:21:49.084 INFO:tasks.rados.rados.0.trial188.stdout:2315: finishing write tid 3 to trial18843701-48 2026-02-13T20:21:49.084 INFO:tasks.rados.rados.0.trial188.stdout:2315: finishing write tid 4 to trial18843701-48 2026-02-13T20:21:49.084 INFO:tasks.rados.rados.0.trial188.stdout:2318: expect (ObjNum 671 snap 185 seq_num 671) 2026-02-13T20:21:49.139 INFO:tasks.rados.rados.0.trial188.stdout:2316: finishing write tid 2 to trial18843701-15 2026-02-13T20:21:49.139 INFO:tasks.rados.rados.0.trial188.stdout:2315: finishing write tid 5 to trial18843701-48 2026-02-13T20:21:49.139 INFO:tasks.rados.rados.0.trial188.stdout:2315: oid 48 updating version 0 to 499 2026-02-13T20:21:49.139 INFO:tasks.rados.rados.0.trial188.stdout:2315: oid 48 updating version 499 to 502 2026-02-13T20:21:49.139 INFO:tasks.rados.rados.0.trial188.stdout:2315: oid 48 version 502 is already newer than 500 2026-02-13T20:21:49.139 INFO:tasks.rados.rados.0.trial188.stdout:2315: oid 48 version 502 is already newer than 501 2026-02-13T20:21:49.139 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 48 v 502 (ObjNum 820 snap 241 seq_num 820) dirty exists 2026-02-13T20:21:49.140 INFO:tasks.rados.rados.0.trial188.stdout:2315: left oid 48 (ObjNum 820 snap 241 seq_num 820) 2026-02-13T20:21:49.140 INFO:tasks.rados.rados.0.trial188.stdout:2317: finishing write tid 1 to trial18843701-4 2026-02-13T20:21:49.140 INFO:tasks.rados.rados.0.trial188.stdout:2316: finishing write tid 3 to trial18843701-15 2026-02-13T20:21:49.140 INFO:tasks.rados.rados.0.trial188.stdout:2316: finishing write tid 4 to trial18843701-15 2026-02-13T20:21:49.140 INFO:tasks.rados.rados.0.trial188.stdout:2316: finishing write tid 5 to trial18843701-15 2026-02-13T20:21:49.140 INFO:tasks.rados.rados.0.trial188.stdout:2316: oid 15 updating version 0 to 786 2026-02-13T20:21:49.140 INFO:tasks.rados.rados.0.trial188.stdout:2316: oid 15 version 786 is already newer than 784 2026-02-13T20:21:49.140 INFO:tasks.rados.rados.0.trial188.stdout:2316: oid 15 version 786 is already newer than 785 2026-02-13T20:21:49.140 INFO:tasks.rados.rados.0.trial188.stdout:2316: oid 15 updating version 786 to 787 2026-02-13T20:21:49.140 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 15 v 787 (ObjNum 821 snap 241 seq_num 821) dirty exists 2026-02-13T20:21:49.140 INFO:tasks.rados.rados.0.trial188.stdout:2316: left oid 15 (ObjNum 821 snap 241 seq_num 821) 2026-02-13T20:21:49.140 INFO:tasks.rados.rados.0.trial188.stdout:2317: finishing write tid 2 to trial18843701-4 2026-02-13T20:21:49.141 INFO:tasks.rados.rados.0.trial188.stdout:2312: done (10 left) 2026-02-13T20:21:49.141 INFO:tasks.rados.rados.0.trial188.stdout:2314: done (9 left) 2026-02-13T20:21:49.141 INFO:tasks.rados.rados.0.trial188.stdout:2315: done (8 left) 2026-02-13T20:21:49.141 INFO:tasks.rados.rados.0.trial188.stdout:2316: done (7 left) 2026-02-13T20:21:49.141 INFO:tasks.rados.rados.0.trial188.stdout:2318: done (6 left) 2026-02-13T20:21:49.141 INFO:tasks.rados.rados.0.trial188.stdout:2324: snap_create 2026-02-13T20:21:49.141 INFO:tasks.rados.rados.0.trial188.stdout:2317: finishing write tid 3 to trial18843701-4 2026-02-13T20:21:49.141 INFO:tasks.rados.rados.0.trial188.stdout:2317: finishing write tid 4 to trial18843701-4 2026-02-13T20:21:49.141 INFO:tasks.rados.rados.0.trial188.stdout:2317: finishing write tid 5 to trial18843701-4 2026-02-13T20:21:49.141 INFO:tasks.rados.rados.0.trial188.stdout:2317: oid 4 updating version 0 to 770 2026-02-13T20:21:49.141 INFO:tasks.rados.rados.0.trial188.stdout:2317: oid 4 updating version 770 to 772 2026-02-13T20:21:49.141 INFO:tasks.rados.rados.0.trial188.stdout:2317: oid 4 version 772 is already newer than 771 2026-02-13T20:21:49.142 INFO:tasks.rados.rados.0.trial188.stdout:2317: oid 4 version 772 is already newer than 769 2026-02-13T20:21:49.142 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 4 v 772 (ObjNum 822 snap 241 seq_num 822) dirty exists 2026-02-13T20:21:49.142 INFO:tasks.rados.rados.0.trial188.stdout:2317: left oid 4 (ObjNum 822 snap 241 seq_num 822) 2026-02-13T20:21:49.142 INFO:tasks.rados.rados.0.trial188.stdout:2319: finishing rollback tid 0 to trial18843701-10 2026-02-13T20:21:49.142 INFO:tasks.rados.rados.0.trial188.stdout:2319: finishing rollback tid 1 to trial18843701-10 2026-02-13T20:21:49.142 INFO:tasks.rados.rados.0.trial188.stdout:2319: finishing rollback tid 2 to trial18843701-10 2026-02-13T20:21:49.142 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 10 v 775 (ObjNum 762 snap 226 seq_num 762) dirty exists 2026-02-13T20:21:49.142 INFO:tasks.rados.rados.0.trial188.stdout:2321: expect (ObjNum 779 snap 232 seq_num 779) 2026-02-13T20:21:49.143 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 759218 2026-02-13T20:21:49.165 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2214276 2026-02-13T20:21:49.172 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 106208 2026-02-13T20:21:49.195 INFO:tasks.rados.rados.0.trial188.stdout:2320: expect (ObjNum 755 snap 223 seq_num 755) 2026-02-13T20:21:49.195 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:21:49.263 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1914601 2026-02-13T20:21:49.310 INFO:tasks.rados.rados.0.trial188.stdout:2322: expect (ObjNum 817 snap 240 seq_num 817) 2026-02-13T20:21:49.316 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2569812 2026-02-13T20:21:49.338 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2029495 2026-02-13T20:21:49.351 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:21:49.377 INFO:tasks.rados.rados.0.trial188.stdout:2323: finishing copy_from racing read to trial18843701-2 2026-02-13T20:21:49.377 INFO:tasks.rados.rados.0.trial188.stdout:2323: finishing copy_from to trial18843701-2 2026-02-13T20:21:49.378 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 2 v 820 (ObjNum 688 snap 199 seq_num 688) dirty exists 2026-02-13T20:21:49.933 INFO:tasks.rados.rados.0.trial188.stdout:2317: done (6 left) 2026-02-13T20:21:49.933 INFO:tasks.rados.rados.0.trial188.stdout:2319: done (5 left) 2026-02-13T20:21:49.933 INFO:tasks.rados.rados.0.trial188.stdout:2320: done (4 left) 2026-02-13T20:21:49.933 INFO:tasks.rados.rados.0.trial188.stdout:2321: done (3 left) 2026-02-13T20:21:49.933 INFO:tasks.rados.rados.0.trial188.stdout:2322: done (2 left) 2026-02-13T20:21:49.933 INFO:tasks.rados.rados.0.trial188.stdout:2323: done (1 left) 2026-02-13T20:21:49.933 INFO:tasks.rados.rados.0.trial188.stdout:2324: done (0 left) 2026-02-13T20:21:49.933 INFO:tasks.rados.rados.0.trial188.stdout:2325: copy_from oid 23 from oid 15 current snap is 242 2026-02-13T20:21:49.933 INFO:tasks.rados.rados.0.trial188.stdout:2326: delete oid 34 current snap is 242 2026-02-13T20:21:49.937 INFO:tasks.rados.rados.0.trial188.stdout:2326: done (1 left) 2026-02-13T20:21:49.937 INFO:tasks.rados.rados.0.trial188.stdout:2327: read oid 22 snap -1 2026-02-13T20:21:49.937 INFO:tasks.rados.rados.0.trial188.stdout:2327: expect (ObjNum 788 snap 234 seq_num 788) 2026-02-13T20:21:49.937 INFO:tasks.rados.rados.0.trial188.stdout:2328: copy_from oid 40 from oid 21 current snap is 242 2026-02-13T20:21:49.937 INFO:tasks.rados.rados.0.trial188.stdout:2329: write oid 12 current snap is 242 2026-02-13T20:21:49.937 INFO:tasks.rados.rados.0.trial188.stdout:2329: seq_num 824 ranges {648968=571300,1651986=639273,2728546=631668} 2026-02-13T20:21:49.942 INFO:tasks.rados.rados.0.trial188.stdout:2329: writing trial18843701-12 from 648968 to 1220268 tid 1 2026-02-13T20:21:49.946 INFO:tasks.rados.rados.0.trial188.stdout:2329: writing trial18843701-12 from 1651986 to 2291259 tid 2 2026-02-13T20:21:49.950 INFO:tasks.rados.rados.0.trial188.stdout:2329: writing trial18843701-12 from 2728546 to 3360214 tid 3 2026-02-13T20:21:49.951 INFO:tasks.rados.rados.0.trial188.stdout:2330: copy_from oid 10 from oid 4 current snap is 242 2026-02-13T20:21:49.951 INFO:tasks.rados.rados.0.trial188.stdout:2327: expect (ObjNum 788 snap 234 seq_num 788) 2026-02-13T20:21:49.951 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:21:50.051 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:21:50.102 INFO:tasks.rados.rados.0.trial188.stdout:2328: finishing copy_from racing read to trial18843701-40 2026-02-13T20:21:50.102 INFO:tasks.rados.rados.0.trial188.stdout:2328: finishing copy_from to trial18843701-40 2026-02-13T20:21:50.103 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 40 v 498 (ObjNum 708 snap 203 seq_num 708) dirty exists 2026-02-13T20:21:50.103 INFO:tasks.rados.rados.0.trial188.stdout:2329: finishing write tid 1 to trial18843701-12 2026-02-13T20:21:50.103 INFO:tasks.rados.rados.0.trial188.stdout:2329: finishing write tid 2 to trial18843701-12 2026-02-13T20:21:50.103 INFO:tasks.rados.rados.0.trial188.stdout:2329: finishing write tid 3 to trial18843701-12 2026-02-13T20:21:50.103 INFO:tasks.rados.rados.0.trial188.stdout:2329: finishing write tid 4 to trial18843701-12 2026-02-13T20:21:50.103 INFO:tasks.rados.rados.0.trial188.stdout:2329: finishing write tid 5 to trial18843701-12 2026-02-13T20:21:50.103 INFO:tasks.rados.rados.0.trial188.stdout:2329: oid 12 updating version 0 to 832 2026-02-13T20:21:50.103 INFO:tasks.rados.rados.0.trial188.stdout:2329: oid 12 updating version 832 to 833 2026-02-13T20:21:50.103 INFO:tasks.rados.rados.0.trial188.stdout:2329: oid 12 version 833 is already newer than 830 2026-02-13T20:21:50.103 INFO:tasks.rados.rados.0.trial188.stdout:2329: oid 12 version 833 is already newer than 831 2026-02-13T20:21:50.103 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 12 v 833 (ObjNum 824 snap 242 seq_num 824) dirty exists 2026-02-13T20:21:50.103 INFO:tasks.rados.rados.0.trial188.stdout:2329: left oid 12 (ObjNum 824 snap 242 seq_num 824) 2026-02-13T20:21:50.104 INFO:tasks.rados.rados.0.trial188.stdout:2325: finishing copy_from racing read to trial18843701-23 2026-02-13T20:21:50.104 INFO:tasks.rados.rados.0.trial188.stdout:2325: finishing copy_from to trial18843701-23 2026-02-13T20:21:50.104 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 23 v 787 (ObjNum 821 snap 241 seq_num 821) dirty exists 2026-02-13T20:21:50.104 INFO:tasks.rados.rados.0.trial188.stdout:2330: finishing copy_from racing read to trial18843701-10 2026-02-13T20:21:50.104 INFO:tasks.rados.rados.0.trial188.stdout:2330: finishing copy_from to trial18843701-10 2026-02-13T20:21:50.104 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 10 v 772 (ObjNum 822 snap 241 seq_num 822) dirty exists 2026-02-13T20:21:50.104 INFO:tasks.rados.rados.0.trial188.stdout:2325: done (4 left) 2026-02-13T20:21:50.104 INFO:tasks.rados.rados.0.trial188.stdout:2327: done (3 left) 2026-02-13T20:21:50.104 INFO:tasks.rados.rados.0.trial188.stdout:2328: done (2 left) 2026-02-13T20:21:50.104 INFO:tasks.rados.rados.0.trial188.stdout:2329: done (1 left) 2026-02-13T20:21:50.104 INFO:tasks.rados.rados.0.trial188.stdout:2330: done (0 left) 2026-02-13T20:21:50.105 INFO:tasks.rados.rados.0.trial188.stdout:2331: rollback oid 28 current snap is 242 2026-02-13T20:21:50.105 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 28 to 232 2026-02-13T20:21:50.105 INFO:tasks.rados.rados.0.trial188.stdout:2332: write (excl) oid 21 current snap is 242 2026-02-13T20:21:50.105 INFO:tasks.rados.rados.0.trial188.stdout:2332: seq_num 825 ranges {665775=646549,2110468=499284,3155969=442940} 2026-02-13T20:21:50.107 INFO:tasks.rados.rados.0.trial188.stdout:2332: writing trial18843701-21 from 665775 to 1312324 tid 1 2026-02-13T20:21:50.111 INFO:tasks.rados.rados.0.trial188.stdout:2332: writing trial18843701-21 from 2110468 to 2609752 tid 2 2026-02-13T20:21:50.115 INFO:tasks.rados.rados.0.trial188.stdout:2332: writing trial18843701-21 from 3155969 to 3598909 tid 3 2026-02-13T20:21:50.115 INFO:tasks.rados.rados.0.trial188.stdout:2333: delete oid 44 current snap is 242 2026-02-13T20:21:50.115 INFO:tasks.rados.rados.0.trial188.stdout:2331: finishing rollback tid 0 to trial18843701-28 2026-02-13T20:21:50.115 INFO:tasks.rados.rados.0.trial188.stdout:2331: finishing rollback tid 1 to trial18843701-28 2026-02-13T20:21:50.115 INFO:tasks.rados.rados.0.trial188.stdout:2331: finishing rollback tid 2 to trial18843701-28 2026-02-13T20:21:50.115 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 28 v 1035 (ObjNum 729 snap 216 seq_num 729) dirty exists 2026-02-13T20:21:50.117 INFO:tasks.rados.rados.0.trial188.stdout:2331: done (2 left) 2026-02-13T20:21:50.117 INFO:tasks.rados.rados.0.trial188.stdout:2333: done (1 left) 2026-02-13T20:21:50.117 INFO:tasks.rados.rados.0.trial188.stdout:2334: rollback oid 44 current snap is 242 2026-02-13T20:21:50.117 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 44 to 237 2026-02-13T20:21:50.117 INFO:tasks.rados.rados.0.trial188.stdout:2335: read oid 5 snap -1 2026-02-13T20:21:50.118 INFO:tasks.rados.rados.0.trial188.stdout:2335: expect (ObjNum 738 snap 218 seq_num 738) 2026-02-13T20:21:50.118 INFO:tasks.rados.rados.0.trial188.stdout:2336: snap_remove snap 197 2026-02-13T20:21:50.938 INFO:tasks.rados.rados.0.trial188.stdout:2336: done (3 left) 2026-02-13T20:21:50.938 INFO:tasks.rados.rados.0.trial188.stdout:2337: read oid 32 snap 228 2026-02-13T20:21:50.938 INFO:tasks.rados.rados.0.trial188.stdout:2337: expect (ObjNum 739 snap 220 seq_num 739) 2026-02-13T20:21:50.938 INFO:tasks.rados.rados.0.trial188.stdout:2338: read oid 19 snap -1 2026-02-13T20:21:50.938 INFO:tasks.rados.rados.0.trial188.stdout:2338: expect (ObjNum 688 snap 199 seq_num 688) 2026-02-13T20:21:50.938 INFO:tasks.rados.rados.0.trial188.stdout:2339: write (excl) oid 33 current snap is 242 2026-02-13T20:21:50.938 INFO:tasks.rados.rados.0.trial188.stdout:2339: seq_num 827 ranges {699389=797047,2111079=502953,3094462=581837} 2026-02-13T20:21:50.945 INFO:tasks.rados.rados.0.trial188.stdout:2339: writing trial18843701-33 from 699389 to 1496436 tid 1 2026-02-13T20:21:50.950 INFO:tasks.rados.rados.0.trial188.stdout:2339: writing trial18843701-33 from 2111079 to 2614032 tid 2 2026-02-13T20:21:50.954 INFO:tasks.rados.rados.0.trial188.stdout:2339: writing trial18843701-33 from 3094462 to 3676299 tid 3 2026-02-13T20:21:50.954 INFO:tasks.rados.rados.0.trial188.stdout:2340: copy_from oid 22 from oid 14 current snap is 242 2026-02-13T20:21:50.954 INFO:tasks.rados.rados.0.trial188.stdout:2334: finishing rollback tid 1 to trial18843701-44 2026-02-13T20:21:50.954 INFO:tasks.rados.rados.0.trial188.stdout:2335: expect (ObjNum 738 snap 218 seq_num 738) 2026-02-13T20:21:50.971 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:21:50.990 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:21:51.008 INFO:tasks.rados.rados.0.trial188.stdout:2334: finishing rollback tid 2 to trial18843701-44 2026-02-13T20:21:51.008 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 44 v 985 (ObjNum 795 snap 237 seq_num 795) dirty exists 2026-02-13T20:21:51.008 INFO:tasks.rados.rados.0.trial188.stdout:2332: finishing write tid 1 to trial18843701-21 2026-02-13T20:21:51.008 INFO:tasks.rados.rados.0.trial188.stdout:2332: finishing write tid 2 to trial18843701-21 2026-02-13T20:21:51.008 INFO:tasks.rados.rados.0.trial188.stdout:2332: finishing write tid 3 to trial18843701-21 2026-02-13T20:21:51.008 INFO:tasks.rados.rados.0.trial188.stdout:2334: done (6 left) 2026-02-13T20:21:51.008 INFO:tasks.rados.rados.0.trial188.stdout:2335: done (5 left) 2026-02-13T20:21:51.008 INFO:tasks.rados.rados.0.trial188.stdout:2341: read oid 39 snap -1 2026-02-13T20:21:51.008 INFO:tasks.rados.rados.0.trial188.stdout:2341: expect deleted 2026-02-13T20:21:51.008 INFO:tasks.rados.rados.0.trial188.stdout:2342: rollback oid 5 current snap is 242 2026-02-13T20:21:51.008 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 5 to 194 2026-02-13T20:21:51.008 INFO:tasks.rados.rados.0.trial188.stdout:2332: finishing write tid 4 to trial18843701-21 2026-02-13T20:21:51.008 INFO:tasks.rados.rados.0.trial188.stdout:2332: finishing write tid 5 to trial18843701-21 2026-02-13T20:21:51.008 INFO:tasks.rados.rados.0.trial188.stdout:2332: oid 21 updating version 0 to 506 2026-02-13T20:21:51.008 INFO:tasks.rados.rados.0.trial188.stdout:2332: oid 21 version 506 is already newer than 505 2026-02-13T20:21:51.008 INFO:tasks.rados.rados.0.trial188.stdout:2332: oid 21 version 506 is already newer than 503 2026-02-13T20:21:51.008 INFO:tasks.rados.rados.0.trial188.stdout:2332: oid 21 version 506 is already newer than 504 2026-02-13T20:21:51.008 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 21 v 506 (ObjNum 825 snap 242 seq_num 825) dirty exists 2026-02-13T20:21:51.008 INFO:tasks.rados.rados.0.trial188.stdout:2332: left oid 21 (ObjNum 825 snap 242 seq_num 825) 2026-02-13T20:21:51.008 INFO:tasks.rados.rados.0.trial188.stdout:2337: expect (ObjNum 739 snap 220 seq_num 739) 2026-02-13T20:21:51.008 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:21:51.025 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:21:51.057 INFO:tasks.rados.rados.0.trial188.stdout:2338: expect (ObjNum 688 snap 199 seq_num 688) 2026-02-13T20:21:51.058 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:21:51.099 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1828971 2026-02-13T20:21:51.147 INFO:tasks.rados.rados.0.trial188.stdout:2340: finishing copy_from to trial18843701-22 2026-02-13T20:21:51.147 INFO:tasks.rados.rados.0.trial188.stdout:2340: got expected ENOENT (src dne) 2026-02-13T20:21:51.147 INFO:tasks.rados.rados.0.trial188.stdout:2340: finishing copy_from racing read to trial18843701-22 2026-02-13T20:21:51.147 INFO:tasks.rados.rados.0.trial188.stdout:2339: finishing write tid 1 to trial18843701-33 2026-02-13T20:21:51.147 INFO:tasks.rados.rados.0.trial188.stdout:2339: finishing write tid 2 to trial18843701-33 2026-02-13T20:21:51.148 INFO:tasks.rados.rados.0.trial188.stdout:2339: finishing write tid 3 to trial18843701-33 2026-02-13T20:21:51.148 INFO:tasks.rados.rados.0.trial188.stdout:2339: finishing write tid 4 to trial18843701-33 2026-02-13T20:21:51.148 INFO:tasks.rados.rados.0.trial188.stdout:2339: finishing write tid 5 to trial18843701-33 2026-02-13T20:21:51.148 INFO:tasks.rados.rados.0.trial188.stdout:2339: oid 33 updating version 0 to 720 2026-02-13T20:21:51.148 INFO:tasks.rados.rados.0.trial188.stdout:2339: oid 33 updating version 720 to 722 2026-02-13T20:21:51.148 INFO:tasks.rados.rados.0.trial188.stdout:2339: oid 33 updating version 722 to 723 2026-02-13T20:21:51.148 INFO:tasks.rados.rados.0.trial188.stdout:2339: oid 33 version 723 is already newer than 721 2026-02-13T20:21:51.148 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 33 v 723 (ObjNum 827 snap 242 seq_num 827) dirty exists 2026-02-13T20:21:51.148 INFO:tasks.rados.rados.0.trial188.stdout:2339: left oid 33 (ObjNum 827 snap 242 seq_num 827) 2026-02-13T20:21:51.148 INFO:tasks.rados.rados.0.trial188.stdout:2342: finishing rollback tid 0 to trial18843701-5 2026-02-13T20:21:51.148 INFO:tasks.rados.rados.0.trial188.stdout:2332: done (6 left) 2026-02-13T20:21:51.148 INFO:tasks.rados.rados.0.trial188.stdout:2337: done (5 left) 2026-02-13T20:21:51.149 INFO:tasks.rados.rados.0.trial188.stdout:2338: done (4 left) 2026-02-13T20:21:51.149 INFO:tasks.rados.rados.0.trial188.stdout:2339: done (3 left) 2026-02-13T20:21:51.149 INFO:tasks.rados.rados.0.trial188.stdout:2340: done (2 left) 2026-02-13T20:21:51.149 INFO:tasks.rados.rados.0.trial188.stdout:2341: done (1 left) 2026-02-13T20:21:51.149 INFO:tasks.rados.rados.0.trial188.stdout:2343: snap_create 2026-02-13T20:21:51.149 INFO:tasks.rados.rados.0.trial188.stdout:2342: finishing rollback tid 1 to trial18843701-5 2026-02-13T20:21:51.149 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 5 v 994 (ObjNum 49 snap 0 seq_num 16354508) dirty dne 2026-02-13T20:21:51.865 INFO:tasks.rados.rados.0.trial188.stdout:2342: done (1 left) 2026-02-13T20:21:51.865 INFO:tasks.rados.rados.0.trial188.stdout:2343: done (0 left) 2026-02-13T20:21:51.865 INFO:tasks.rados.rados.0.trial188.stdout:2344: rollback oid 36 current snap is 243 2026-02-13T20:21:51.865 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 36 to 214 2026-02-13T20:21:51.865 INFO:tasks.rados.rados.0.trial188.stdout:2345: delete oid 4 current snap is 243 2026-02-13T20:21:51.866 INFO:tasks.rados.rados.0.trial188.stdout:2345: done (1 left) 2026-02-13T20:21:51.866 INFO:tasks.rados.rados.0.trial188.stdout:2346: write (excl) oid 44 current snap is 243 2026-02-13T20:21:51.866 INFO:tasks.rados.rados.0.trial188.stdout:2346: seq_num 829 ranges {733003=663898,1944396=506622,2865661=604381} 2026-02-13T20:21:51.872 INFO:tasks.rados.rados.0.trial188.stdout:2346: writing trial18843701-44 from 733003 to 1396901 tid 1 2026-02-13T20:21:51.876 INFO:tasks.rados.rados.0.trial188.stdout:2346: writing trial18843701-44 from 1944396 to 2451018 tid 2 2026-02-13T20:21:51.880 INFO:tasks.rados.rados.0.trial188.stdout:2346: writing trial18843701-44 from 2865661 to 3470042 tid 3 2026-02-13T20:21:51.880 INFO:tasks.rados.rados.0.trial188.stdout:2347: snap_create 2026-02-13T20:21:51.880 INFO:tasks.rados.rados.0.trial188.stdout:2344: finishing rollback tid 0 to trial18843701-36 2026-02-13T20:21:51.880 INFO:tasks.rados.rados.0.trial188.stdout:2344: finishing rollback tid 1 to trial18843701-36 2026-02-13T20:21:51.880 INFO:tasks.rados.rados.0.trial188.stdout:2344: finishing rollback tid 2 to trial18843701-36 2026-02-13T20:21:51.881 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 36 v 1068 (ObjNum 721 snap 213 seq_num 721) dirty exists 2026-02-13T20:21:51.896 INFO:tasks.rados.rados.0.trial188.stdout:2346: finishing write tid 1 to trial18843701-44 2026-02-13T20:21:51.898 INFO:tasks.rados.rados.0.trial188.stdout:2346: finishing write tid 2 to trial18843701-44 2026-02-13T20:21:51.898 INFO:tasks.rados.rados.0.trial188.stdout:2346: finishing write tid 3 to trial18843701-44 2026-02-13T20:21:51.899 INFO:tasks.rados.rados.0.trial188.stdout:2346: finishing write tid 4 to trial18843701-44 2026-02-13T20:21:51.899 INFO:tasks.rados.rados.0.trial188.stdout:2346: finishing write tid 5 to trial18843701-44 2026-02-13T20:21:51.899 INFO:tasks.rados.rados.0.trial188.stdout:2346: oid 44 updating version 0 to 997 2026-02-13T20:21:51.899 INFO:tasks.rados.rados.0.trial188.stdout:2346: oid 44 updating version 997 to 998 2026-02-13T20:21:51.899 INFO:tasks.rados.rados.0.trial188.stdout:2346: oid 44 version 998 is already newer than 996 2026-02-13T20:21:51.899 INFO:tasks.rados.rados.0.trial188.stdout:2346: oid 44 updating version 998 to 999 2026-02-13T20:21:51.899 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 44 v 999 (ObjNum 829 snap 243 seq_num 829) dirty exists 2026-02-13T20:21:51.899 INFO:tasks.rados.rados.0.trial188.stdout:2346: left oid 44 (ObjNum 829 snap 243 seq_num 829) 2026-02-13T20:21:52.867 INFO:tasks.rados.rados.0.trial188.stdout:2344: done (2 left) 2026-02-13T20:21:52.867 INFO:tasks.rados.rados.0.trial188.stdout:2346: done (1 left) 2026-02-13T20:21:52.867 INFO:tasks.rados.rados.0.trial188.stdout:2347: done (0 left) 2026-02-13T20:21:52.867 INFO:tasks.rados.rados.0.trial188.stdout:2348: snap_create 2026-02-13T20:21:53.868 INFO:tasks.rados.rados.0.trial188.stdout:2348: done (0 left) 2026-02-13T20:21:53.868 INFO:tasks.rados.rados.0.trial188.stdout:2349: write (excl) oid 23 current snap is 245 2026-02-13T20:21:53.868 INFO:tasks.rados.rados.0.trial188.stdout:2349: seq_num 830 ranges {749810=739147,2002878=650280,3293084=415653} 2026-02-13T20:21:53.873 INFO:tasks.rados.rados.0.trial188.stdout:2349: writing trial18843701-23 from 749810 to 1488957 tid 1 2026-02-13T20:21:53.878 INFO:tasks.rados.rados.0.trial188.stdout:2349: writing trial18843701-23 from 2002878 to 2653158 tid 2 2026-02-13T20:21:53.882 INFO:tasks.rados.rados.0.trial188.stdout:2349: writing trial18843701-23 from 3293084 to 3708737 tid 3 2026-02-13T20:21:53.882 INFO:tasks.rados.rados.0.trial188.stdout:2350: delete oid 20 current snap is 245 2026-02-13T20:21:53.884 INFO:tasks.rados.rados.0.trial188.stdout:2350: done (1 left) 2026-02-13T20:21:53.884 INFO:tasks.rados.rados.0.trial188.stdout:2351: snap_create 2026-02-13T20:21:53.903 INFO:tasks.rados.rados.0.trial188.stdout:2349: finishing write tid 1 to trial18843701-23 2026-02-13T20:21:53.903 INFO:tasks.rados.rados.0.trial188.stdout:2349: finishing write tid 2 to trial18843701-23 2026-02-13T20:21:53.903 INFO:tasks.rados.rados.0.trial188.stdout:2349: finishing write tid 3 to trial18843701-23 2026-02-13T20:21:53.904 INFO:tasks.rados.rados.0.trial188.stdout:2349: finishing write tid 4 to trial18843701-23 2026-02-13T20:21:53.904 INFO:tasks.rados.rados.0.trial188.stdout:2349: finishing write tid 5 to trial18843701-23 2026-02-13T20:21:53.904 INFO:tasks.rados.rados.0.trial188.stdout:2349: oid 23 updating version 0 to 1070 2026-02-13T20:21:53.904 INFO:tasks.rados.rados.0.trial188.stdout:2349: oid 23 updating version 1070 to 1073 2026-02-13T20:21:53.904 INFO:tasks.rados.rados.0.trial188.stdout:2349: oid 23 version 1073 is already newer than 1072 2026-02-13T20:21:53.904 INFO:tasks.rados.rados.0.trial188.stdout:2349: oid 23 version 1073 is already newer than 1071 2026-02-13T20:21:53.905 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 23 v 1073 (ObjNum 830 snap 245 seq_num 830) dirty exists 2026-02-13T20:21:53.905 INFO:tasks.rados.rados.0.trial188.stdout:2349: left oid 23 (ObjNum 830 snap 245 seq_num 830) 2026-02-13T20:21:54.871 INFO:tasks.rados.rados.0.trial188.stdout:2349: done (1 left) 2026-02-13T20:21:54.871 INFO:tasks.rados.rados.0.trial188.stdout:2351: done (0 left) 2026-02-13T20:21:54.871 INFO:tasks.rados.rados.0.trial188.stdout:2352: snap_create 2026-02-13T20:21:55.872 INFO:tasks.rados.rados.0.trial188.stdout:2352: done (0 left) 2026-02-13T20:21:55.873 INFO:tasks.rados.rados.0.trial188.stdout:2353: read oid 23 snap 241 2026-02-13T20:21:55.873 INFO:tasks.rados.rados.0.trial188.stdout:2353: expect deleted 2026-02-13T20:21:55.873 INFO:tasks.rados.rados.0.trial188.stdout:2354: write oid 42 current snap is 247 2026-02-13T20:21:55.873 INFO:tasks.rados.rados.0.trial188.stdout:2354: seq_num 832 ranges {783424=489645,2003489=653949,3231577=554550} 2026-02-13T20:21:55.878 INFO:tasks.rados.rados.0.trial188.stdout:2354: writing trial18843701-42 from 783424 to 1273069 tid 1 2026-02-13T20:21:55.883 INFO:tasks.rados.rados.0.trial188.stdout:2354: writing trial18843701-42 from 2003489 to 2657438 tid 2 2026-02-13T20:21:55.887 INFO:tasks.rados.rados.0.trial188.stdout:2354: writing trial18843701-42 from 3231577 to 3786127 tid 3 2026-02-13T20:21:55.887 INFO:tasks.rados.rados.0.trial188.stdout:2355: snap_remove snap 180 2026-02-13T20:21:56.865 INFO:tasks.rados.rados.0.trial188.stdout:2355: done (2 left) 2026-02-13T20:21:56.865 INFO:tasks.rados.rados.0.trial188.stdout:2356: read oid 43 snap -1 2026-02-13T20:21:56.865 INFO:tasks.rados.rados.0.trial188.stdout:2356: expect (ObjNum 810 snap 240 seq_num 810) 2026-02-13T20:21:56.865 INFO:tasks.rados.rados.0.trial188.stdout:2357: read oid 14 snap 222 2026-02-13T20:21:56.865 INFO:tasks.rados.rados.0.trial188.stdout:2357: expect (ObjNum 668 snap 182 seq_num 668) 2026-02-13T20:21:56.865 INFO:tasks.rados.rados.0.trial188.stdout:2358: write oid 7 current snap is 247 2026-02-13T20:21:56.865 INFO:tasks.rados.rados.0.trial188.stdout:2358: seq_num 833 ranges {400231=564894,1661971=338260} 2026-02-13T20:21:56.868 INFO:tasks.rados.rados.0.trial188.stdout:2358: writing trial18843701-7 from 400231 to 965125 tid 1 2026-02-13T20:21:56.873 INFO:tasks.rados.rados.0.trial188.stdout:2358: writing trial18843701-7 from 1661971 to 2000231 tid 2 2026-02-13T20:21:56.873 INFO:tasks.rados.rados.0.trial188.stdout:2359: delete oid 28 current snap is 247 2026-02-13T20:21:56.873 INFO:tasks.rados.rados.0.trial188.stdout:2354: finishing write tid 1 to trial18843701-42 2026-02-13T20:21:56.873 INFO:tasks.rados.rados.0.trial188.stdout:2354: finishing write tid 2 to trial18843701-42 2026-02-13T20:21:56.873 INFO:tasks.rados.rados.0.trial188.stdout:2354: finishing write tid 3 to trial18843701-42 2026-02-13T20:21:56.873 INFO:tasks.rados.rados.0.trial188.stdout:2354: finishing write tid 4 to trial18843701-42 2026-02-13T20:21:56.873 INFO:tasks.rados.rados.0.trial188.stdout:2354: finishing write tid 5 to trial18843701-42 2026-02-13T20:21:56.874 INFO:tasks.rados.rados.0.trial188.stdout:2354: oid 42 updating version 0 to 741 2026-02-13T20:21:56.874 INFO:tasks.rados.rados.0.trial188.stdout:2354: oid 42 version 741 is already newer than 739 2026-02-13T20:21:56.874 INFO:tasks.rados.rados.0.trial188.stdout:2354: oid 42 version 741 is already newer than 740 2026-02-13T20:21:56.874 INFO:tasks.rados.rados.0.trial188.stdout:2354: oid 42 version 741 is already newer than 738 2026-02-13T20:21:56.874 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 42 v 741 (ObjNum 832 snap 247 seq_num 832) dirty exists 2026-02-13T20:21:56.874 INFO:tasks.rados.rados.0.trial188.stdout:2354: left oid 42 (ObjNum 832 snap 247 seq_num 832) 2026-02-13T20:21:56.874 INFO:tasks.rados.rados.0.trial188.stdout:2356: expect (ObjNum 810 snap 240 seq_num 810) 2026-02-13T20:21:56.940 INFO:tasks.rados.rados.0.trial188.stdout:2357: expect (ObjNum 668 snap 182 seq_num 668) 2026-02-13T20:21:57.114 INFO:tasks.rados.rados.0.trial188.stdout:2358: finishing write tid 1 to trial18843701-7 2026-02-13T20:21:57.114 INFO:tasks.rados.rados.0.trial188.stdout:2353: done (5 left) 2026-02-13T20:21:57.115 INFO:tasks.rados.rados.0.trial188.stdout:2354: done (4 left) 2026-02-13T20:21:57.115 INFO:tasks.rados.rados.0.trial188.stdout:2356: done (3 left) 2026-02-13T20:21:57.115 INFO:tasks.rados.rados.0.trial188.stdout:2357: done (2 left) 2026-02-13T20:21:57.115 INFO:tasks.rados.rados.0.trial188.stdout:2359: done (1 left) 2026-02-13T20:21:57.115 INFO:tasks.rados.rados.0.trial188.stdout:2360: snap_create 2026-02-13T20:21:57.115 INFO:tasks.rados.rados.0.trial188.stdout:2358: finishing write tid 2 to trial18843701-7 2026-02-13T20:21:57.115 INFO:tasks.rados.rados.0.trial188.stdout:2358: finishing write tid 3 to trial18843701-7 2026-02-13T20:21:57.115 INFO:tasks.rados.rados.0.trial188.stdout:2358: finishing write tid 4 to trial18843701-7 2026-02-13T20:21:57.115 INFO:tasks.rados.rados.0.trial188.stdout:2358: oid 7 updating version 0 to 954 2026-02-13T20:21:57.115 INFO:tasks.rados.rados.0.trial188.stdout:2358: oid 7 updating version 954 to 955 2026-02-13T20:21:57.115 INFO:tasks.rados.rados.0.trial188.stdout:2358: oid 7 version 955 is already newer than 953 2026-02-13T20:21:57.115 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 7 v 955 (ObjNum 833 snap 247 seq_num 833) dirty exists 2026-02-13T20:21:57.115 INFO:tasks.rados.rados.0.trial188.stdout:2358: left oid 7 (ObjNum 833 snap 247 seq_num 833) 2026-02-13T20:21:57.879 INFO:tasks.rados.rados.0.trial188.stdout:2358: done (1 left) 2026-02-13T20:21:57.880 INFO:tasks.rados.rados.0.trial188.stdout:2360: done (0 left) 2026-02-13T20:21:57.880 INFO:tasks.rados.rados.0.trial188.stdout:2361: copy_from oid 47 from oid 4 current snap is 248 2026-02-13T20:21:57.880 INFO:tasks.rados.rados.0.trial188.stdout:2362: rollback oid 32 current snap is 248 2026-02-13T20:21:57.880 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 32 to 228 2026-02-13T20:21:57.880 INFO:tasks.rados.rados.0.trial188.stdout:2363: delete oid 13 current snap is 248 2026-02-13T20:21:57.881 INFO:tasks.rados.rados.0.trial188.stdout:2363: done (2 left) 2026-02-13T20:21:57.881 INFO:tasks.rados.rados.0.trial188.stdout:2364: write oid 28 current snap is 248 2026-02-13T20:21:57.881 INFO:tasks.rados.rados.0.trial188.stdout:2364: seq_num 836 ranges {450652=790641,1721064=329588} 2026-02-13T20:21:57.886 INFO:tasks.rados.rados.0.trial188.stdout:2364: writing trial18843701-28 from 450652 to 1241293 tid 1 2026-02-13T20:21:57.889 INFO:tasks.rados.rados.0.trial188.stdout:2364: writing trial18843701-28 from 1721064 to 2050652 tid 2 2026-02-13T20:21:57.890 INFO:tasks.rados.rados.0.trial188.stdout:2365: write (excl) oid 13 current snap is 248 2026-02-13T20:21:57.890 INFO:tasks.rados.rados.0.trial188.stdout:2361: finishing copy_from to trial18843701-47 2026-02-13T20:21:57.890 INFO:tasks.rados.rados.0.trial188.stdout:2361: got expected ENOENT (src dne) 2026-02-13T20:21:57.890 INFO:tasks.rados.rados.0.trial188.stdout:2361: finishing copy_from racing read to trial18843701-47 2026-02-13T20:21:57.890 INFO:tasks.rados.rados.0.trial188.stdout:2362: finishing rollback tid 0 to trial18843701-32 2026-02-13T20:21:57.890 INFO:tasks.rados.rados.0.trial188.stdout:2365: seq_num 837 ranges {467459=582243,1495899=404945} 2026-02-13T20:21:57.893 INFO:tasks.rados.rados.0.trial188.stdout:2365: writing trial18843701-13 from 467459 to 1049702 tid 1 2026-02-13T20:21:57.897 INFO:tasks.rados.rados.0.trial188.stdout:2365: writing trial18843701-13 from 1495899 to 1900844 tid 2 2026-02-13T20:21:57.897 INFO:tasks.rados.rados.0.trial188.stdout:2361: done (3 left) 2026-02-13T20:21:57.897 INFO:tasks.rados.rados.0.trial188.stdout:2366: read oid 9 snap 228 2026-02-13T20:21:57.897 INFO:tasks.rados.rados.0.trial188.stdout:2366: expect (ObjNum 637 snap 166 seq_num 637) 2026-02-13T20:21:57.897 INFO:tasks.rados.rados.0.trial188.stdout:2367: delete oid 49 current snap is 248 2026-02-13T20:21:57.897 INFO:tasks.rados.rados.0.trial188.stdout:2362: finishing rollback tid 1 to trial18843701-32 2026-02-13T20:21:57.897 INFO:tasks.rados.rados.0.trial188.stdout:2362: finishing rollback tid 2 to trial18843701-32 2026-02-13T20:21:57.897 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 32 v 958 (ObjNum 739 snap 220 seq_num 739) dirty exists 2026-02-13T20:21:57.900 INFO:tasks.rados.rados.0.trial188.stdout:2366: expect (ObjNum 637 snap 166 seq_num 637) 2026-02-13T20:21:57.900 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 280543 2026-02-13T20:21:57.919 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:21:57.955 INFO:tasks.rados.rados.0.trial188.stdout:2364: finishing write tid 1 to trial18843701-28 2026-02-13T20:21:57.955 INFO:tasks.rados.rados.0.trial188.stdout:2364: finishing write tid 2 to trial18843701-28 2026-02-13T20:21:57.955 INFO:tasks.rados.rados.0.trial188.stdout:2364: finishing write tid 3 to trial18843701-28 2026-02-13T20:21:57.955 INFO:tasks.rados.rados.0.trial188.stdout:2365: finishing write tid 1 to trial18843701-13 2026-02-13T20:21:57.955 INFO:tasks.rados.rados.0.trial188.stdout:2364: finishing write tid 4 to trial18843701-28 2026-02-13T20:21:57.955 INFO:tasks.rados.rados.0.trial188.stdout:2364: oid 28 updating version 0 to 1050 2026-02-13T20:21:57.955 INFO:tasks.rados.rados.0.trial188.stdout:2364: oid 28 updating version 1050 to 1051 2026-02-13T20:21:57.955 INFO:tasks.rados.rados.0.trial188.stdout:2364: oid 28 updating version 1051 to 1052 2026-02-13T20:21:57.955 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 28 v 1052 (ObjNum 836 snap 248 seq_num 836) dirty exists 2026-02-13T20:21:57.955 INFO:tasks.rados.rados.0.trial188.stdout:2364: left oid 28 (ObjNum 836 snap 248 seq_num 836) 2026-02-13T20:21:57.956 INFO:tasks.rados.rados.0.trial188.stdout:2365: finishing write tid 2 to trial18843701-13 2026-02-13T20:21:57.956 INFO:tasks.rados.rados.0.trial188.stdout:2365: finishing write tid 3 to trial18843701-13 2026-02-13T20:21:57.956 INFO:tasks.rados.rados.0.trial188.stdout:2365: finishing write tid 4 to trial18843701-13 2026-02-13T20:21:57.956 INFO:tasks.rados.rados.0.trial188.stdout:2365: oid 13 updating version 0 to 1005 2026-02-13T20:21:57.956 INFO:tasks.rados.rados.0.trial188.stdout:2365: oid 13 updating version 1005 to 1006 2026-02-13T20:21:57.956 INFO:tasks.rados.rados.0.trial188.stdout:2365: oid 13 updating version 1006 to 1007 2026-02-13T20:21:57.956 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 13 v 1007 (ObjNum 837 snap 248 seq_num 837) dirty exists 2026-02-13T20:21:57.956 INFO:tasks.rados.rados.0.trial188.stdout:2365: left oid 13 (ObjNum 837 snap 248 seq_num 837) 2026-02-13T20:21:57.956 INFO:tasks.rados.rados.0.trial188.stdout:2362: done (4 left) 2026-02-13T20:21:57.956 INFO:tasks.rados.rados.0.trial188.stdout:2364: done (3 left) 2026-02-13T20:21:57.956 INFO:tasks.rados.rados.0.trial188.stdout:2365: done (2 left) 2026-02-13T20:21:57.956 INFO:tasks.rados.rados.0.trial188.stdout:2366: done (1 left) 2026-02-13T20:21:57.957 INFO:tasks.rados.rados.0.trial188.stdout:2367: done (0 left) 2026-02-13T20:21:57.957 INFO:tasks.rados.rados.0.trial188.stdout:2368: read oid 7 snap -1 2026-02-13T20:21:57.957 INFO:tasks.rados.rados.0.trial188.stdout:2368: expect (ObjNum 833 snap 247 seq_num 833) 2026-02-13T20:21:57.957 INFO:tasks.rados.rados.0.trial188.stdout:2369: read oid 29 snap -1 2026-02-13T20:21:57.957 INFO:tasks.rados.rados.0.trial188.stdout:2369: expect (ObjNum 775 snap 230 seq_num 775) 2026-02-13T20:21:57.957 INFO:tasks.rados.rados.0.trial188.stdout:2370: rollback oid 33 current snap is 248 2026-02-13T20:21:57.957 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 33 to 222 2026-02-13T20:21:57.957 INFO:tasks.rados.rados.0.trial188.stdout:2371: delete oid 12 current snap is 248 2026-02-13T20:21:57.958 INFO:tasks.rados.rados.0.trial188.stdout:2370: finishing rollback tid 0 to trial18843701-33 2026-02-13T20:21:57.958 INFO:tasks.rados.rados.0.trial188.stdout:2370: finishing rollback tid 1 to trial18843701-33 2026-02-13T20:21:57.958 INFO:tasks.rados.rados.0.trial188.stdout:2370: finishing rollback tid 2 to trial18843701-33 2026-02-13T20:21:57.958 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 33 v 726 (ObjNum 679 snap 194 seq_num 679) dirty exists 2026-02-13T20:21:57.959 INFO:tasks.rados.rados.0.trial188.stdout:2368: expect (ObjNum 833 snap 247 seq_num 833) 2026-02-13T20:21:57.960 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:21:58.008 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:21:58.100 INFO:tasks.rados.rados.0.trial188.stdout:2369: expect (ObjNum 775 snap 230 seq_num 775) 2026-02-13T20:21:58.222 INFO:tasks.rados.rados.0.trial188.stdout:2368: done (3 left) 2026-02-13T20:21:58.222 INFO:tasks.rados.rados.0.trial188.stdout:2369: done (2 left) 2026-02-13T20:21:58.222 INFO:tasks.rados.rados.0.trial188.stdout:2370: done (1 left) 2026-02-13T20:21:58.222 INFO:tasks.rados.rados.0.trial188.stdout:2371: done (0 left) 2026-02-13T20:21:58.222 INFO:tasks.rados.rados.0.trial188.stdout:2372: write (excl) oid 9 current snap is 248 2026-02-13T20:21:58.222 INFO:tasks.rados.rados.0.trial188.stdout:2372: seq_num 840 ranges {517880=407990,1554992=562888} 2026-02-13T20:21:58.224 INFO:tasks.rados.rados.0.trial188.stdout:2372: writing trial18843701-9 from 517880 to 925870 tid 1 2026-02-13T20:21:58.229 INFO:tasks.rados.rados.0.trial188.stdout:2372: writing trial18843701-9 from 1554992 to 2117880 tid 2 2026-02-13T20:21:58.229 INFO:tasks.rados.rados.0.trial188.stdout:2373: rollback oid 50 current snap is 248 2026-02-13T20:21:58.229 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 50 to 240 2026-02-13T20:21:58.229 INFO:tasks.rados.rados.0.trial188.stdout:2374: write (excl) oid 47 current snap is 248 2026-02-13T20:21:58.230 INFO:tasks.rados.rados.0.trial188.stdout:2374: seq_num 841 ranges {534687=483239,1613474=412283} 2026-02-13T20:21:58.233 INFO:tasks.rados.rados.0.trial188.stdout:2374: writing trial18843701-47 from 534687 to 1017926 tid 1 2026-02-13T20:21:58.237 INFO:tasks.rados.rados.0.trial188.stdout:2374: writing trial18843701-47 from 1613474 to 2025757 tid 2 2026-02-13T20:21:58.237 INFO:tasks.rados.rados.0.trial188.stdout:2375: rollback oid 23 current snap is 248 2026-02-13T20:21:58.237 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 23 to 230 2026-02-13T20:21:58.237 INFO:tasks.rados.rados.0.trial188.stdout:2373: finishing rollback tid 1 to trial18843701-50 2026-02-13T20:21:58.237 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 50 v 892 (ObjNum 129 snap 0 seq_num 16253408) dirty dne 2026-02-13T20:21:58.237 INFO:tasks.rados.rados.0.trial188.stdout:2373: done (3 left) 2026-02-13T20:21:58.238 INFO:tasks.rados.rados.0.trial188.stdout:2376: rollback oid 41 current snap is 248 2026-02-13T20:21:58.238 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 41 to 244 2026-02-13T20:21:58.238 INFO:tasks.rados.rados.0.trial188.stdout:2377: delete oid 30 current snap is 248 2026-02-13T20:21:58.239 INFO:tasks.rados.rados.0.trial188.stdout:2376: finishing rollback tid 0 to trial18843701-41 2026-02-13T20:21:58.239 INFO:tasks.rados.rados.0.trial188.stdout:2376: finishing rollback tid 1 to trial18843701-41 2026-02-13T20:21:58.239 INFO:tasks.rados.rados.0.trial188.stdout:2372: finishing write tid 1 to trial18843701-9 2026-02-13T20:21:58.239 INFO:tasks.rados.rados.0.trial188.stdout:2376: finishing rollback tid 2 to trial18843701-41 2026-02-13T20:21:58.239 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 41 v 961 (ObjNum 680 snap 194 seq_num 680) dirty exists 2026-02-13T20:21:58.240 INFO:tasks.rados.rados.0.trial188.stdout:2375: finishing rollback tid 0 to trial18843701-23 2026-02-13T20:21:58.240 INFO:tasks.rados.rados.0.trial188.stdout:2375: finishing rollback tid 1 to trial18843701-23 2026-02-13T20:21:58.240 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 23 v 1085 (ObjNum 177 snap 0 seq_num 4129271040) dirty dne 2026-02-13T20:21:58.245 INFO:tasks.rados.rados.0.trial188.stdout:2372: finishing write tid 2 to trial18843701-9 2026-02-13T20:21:58.250 INFO:tasks.rados.rados.0.trial188.stdout:2372: finishing write tid 3 to trial18843701-9 2026-02-13T20:21:58.251 INFO:tasks.rados.rados.0.trial188.stdout:2372: finishing write tid 4 to trial18843701-9 2026-02-13T20:21:58.251 INFO:tasks.rados.rados.0.trial188.stdout:2372: oid 9 updating version 0 to 742 2026-02-13T20:21:58.251 INFO:tasks.rados.rados.0.trial188.stdout:2372: oid 9 updating version 742 to 744 2026-02-13T20:21:58.251 INFO:tasks.rados.rados.0.trial188.stdout:2372: oid 9 version 744 is already newer than 743 2026-02-13T20:21:58.251 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 9 v 744 (ObjNum 840 snap 248 seq_num 840) dirty exists 2026-02-13T20:21:58.251 INFO:tasks.rados.rados.0.trial188.stdout:2372: left oid 9 (ObjNum 840 snap 248 seq_num 840) 2026-02-13T20:21:58.252 INFO:tasks.rados.rados.0.trial188.stdout:2374: finishing write tid 1 to trial18843701-47 2026-02-13T20:21:58.252 INFO:tasks.rados.rados.0.trial188.stdout:2374: finishing write tid 2 to trial18843701-47 2026-02-13T20:21:58.252 INFO:tasks.rados.rados.0.trial188.stdout:2374: finishing write tid 3 to trial18843701-47 2026-02-13T20:21:58.253 INFO:tasks.rados.rados.0.trial188.stdout:2374: finishing write tid 4 to trial18843701-47 2026-02-13T20:21:58.253 INFO:tasks.rados.rados.0.trial188.stdout:2374: oid 47 updating version 0 to 727 2026-02-13T20:21:58.253 INFO:tasks.rados.rados.0.trial188.stdout:2374: oid 47 updating version 727 to 729 2026-02-13T20:21:58.253 INFO:tasks.rados.rados.0.trial188.stdout:2374: oid 47 version 729 is already newer than 728 2026-02-13T20:21:58.253 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 47 v 729 (ObjNum 841 snap 248 seq_num 841) dirty exists 2026-02-13T20:21:58.253 INFO:tasks.rados.rados.0.trial188.stdout:2374: left oid 47 (ObjNum 841 snap 248 seq_num 841) 2026-02-13T20:21:58.253 INFO:tasks.rados.rados.0.trial188.stdout:2372: done (4 left) 2026-02-13T20:21:58.253 INFO:tasks.rados.rados.0.trial188.stdout:2374: done (3 left) 2026-02-13T20:21:58.253 INFO:tasks.rados.rados.0.trial188.stdout:2375: done (2 left) 2026-02-13T20:21:58.253 INFO:tasks.rados.rados.0.trial188.stdout:2376: done (1 left) 2026-02-13T20:21:58.253 INFO:tasks.rados.rados.0.trial188.stdout:2377: done (0 left) 2026-02-13T20:21:58.254 INFO:tasks.rados.rados.0.trial188.stdout:2378: write (excl) oid 19 current snap is 248 2026-02-13T20:21:58.254 INFO:tasks.rados.rados.0.trial188.stdout:2378: seq_num 843 ranges {568301=633737,1614085=415952} 2026-02-13T20:21:58.257 INFO:tasks.rados.rados.0.trial188.stdout:2378: writing trial18843701-19 from 568301 to 1202038 tid 1 2026-02-13T20:21:58.260 INFO:tasks.rados.rados.0.trial188.stdout:2378: writing trial18843701-19 from 1614085 to 2030037 tid 2 2026-02-13T20:21:58.261 INFO:tasks.rados.rados.0.trial188.stdout:2379: copy_from oid 40 from oid 29 current snap is 248 2026-02-13T20:21:58.261 INFO:tasks.rados.rados.0.trial188.stdout:2380: read oid 7 snap -1 2026-02-13T20:21:58.261 INFO:tasks.rados.rados.0.trial188.stdout:2380: expect (ObjNum 833 snap 247 seq_num 833) 2026-02-13T20:21:58.261 INFO:tasks.rados.rados.0.trial188.stdout:2381: read oid 37 snap -1 2026-02-13T20:21:58.261 INFO:tasks.rados.rados.0.trial188.stdout:2381: expect (ObjNum 808 snap 240 seq_num 808) 2026-02-13T20:21:58.261 INFO:tasks.rados.rados.0.trial188.stdout:2382: delete oid 45 current snap is 248 2026-02-13T20:21:58.265 INFO:tasks.rados.rados.0.trial188.stdout:2381: expect (ObjNum 808 snap 240 seq_num 808) 2026-02-13T20:21:58.294 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2001386 2026-02-13T20:21:58.309 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:21:58.335 INFO:tasks.rados.rados.0.trial188.stdout:2378: finishing write tid 1 to trial18843701-19 2026-02-13T20:21:58.335 INFO:tasks.rados.rados.0.trial188.stdout:2378: finishing write tid 2 to trial18843701-19 2026-02-13T20:21:58.335 INFO:tasks.rados.rados.0.trial188.stdout:2378: finishing write tid 3 to trial18843701-19 2026-02-13T20:21:58.335 INFO:tasks.rados.rados.0.trial188.stdout:2378: finishing write tid 4 to trial18843701-19 2026-02-13T20:21:58.335 INFO:tasks.rados.rados.0.trial188.stdout:2378: oid 19 updating version 0 to 957 2026-02-13T20:21:58.336 INFO:tasks.rados.rados.0.trial188.stdout:2378: oid 19 version 957 is already newer than 956 2026-02-13T20:21:58.336 INFO:tasks.rados.rados.0.trial188.stdout:2378: oid 19 updating version 957 to 958 2026-02-13T20:21:58.336 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 19 v 958 (ObjNum 843 snap 248 seq_num 843) dirty exists 2026-02-13T20:21:58.336 INFO:tasks.rados.rados.0.trial188.stdout:2378: left oid 19 (ObjNum 843 snap 248 seq_num 843) 2026-02-13T20:21:58.336 INFO:tasks.rados.rados.0.trial188.stdout:2380: expect (ObjNum 833 snap 247 seq_num 833) 2026-02-13T20:21:58.420 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1730608 2026-02-13T20:21:58.427 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1070381 2026-02-13T20:21:58.467 INFO:tasks.rados.rados.0.trial188.stdout:2379: finishing copy_from racing read to trial18843701-40 2026-02-13T20:21:58.468 INFO:tasks.rados.rados.0.trial188.stdout:2379: finishing copy_from to trial18843701-40 2026-02-13T20:21:58.468 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 40 v 802 (ObjNum 775 snap 230 seq_num 775) dirty exists 2026-02-13T20:21:58.468 INFO:tasks.rados.rados.0.trial188.stdout:2378: done (4 left) 2026-02-13T20:21:58.468 INFO:tasks.rados.rados.0.trial188.stdout:2379: done (3 left) 2026-02-13T20:21:58.468 INFO:tasks.rados.rados.0.trial188.stdout:2380: done (2 left) 2026-02-13T20:21:58.468 INFO:tasks.rados.rados.0.trial188.stdout:2381: done (1 left) 2026-02-13T20:21:58.468 INFO:tasks.rados.rados.0.trial188.stdout:2382: done (0 left) 2026-02-13T20:21:58.468 INFO:tasks.rados.rados.0.trial188.stdout:2383: snap_remove snap 226 2026-02-13T20:21:58.886 INFO:tasks.rados.rados.0.trial188.stdout:2383: done (0 left) 2026-02-13T20:21:58.886 INFO:tasks.rados.rados.0.trial188.stdout:2384: write oid 33 current snap is 248 2026-02-13T20:21:58.886 INFO:tasks.rados.rados.0.trial188.stdout:2384: seq_num 845 ranges {601915=500588,1847402=354513} 2026-02-13T20:21:58.890 INFO:tasks.rados.rados.0.trial188.stdout:2384: writing trial18843701-33 from 601915 to 1102503 tid 1 2026-02-13T20:21:58.895 INFO:tasks.rados.rados.0.trial188.stdout:2384: writing trial18843701-33 from 1847402 to 2201915 tid 2 2026-02-13T20:21:58.895 INFO:tasks.rados.rados.0.trial188.stdout:2385: copy_from oid 42 from oid 5 current snap is 248 2026-02-13T20:21:58.895 INFO:tasks.rados.rados.0.trial188.stdout:2386: read oid 47 snap 241 2026-02-13T20:21:58.895 INFO:tasks.rados.rados.0.trial188.stdout:2386: expect (ObjNum 760 snap 225 seq_num 760) 2026-02-13T20:21:58.895 INFO:tasks.rados.rados.0.trial188.stdout:2387: write (excl) oid 8 current snap is 248 2026-02-13T20:21:58.895 INFO:tasks.rados.rados.0.trial188.stdout:2387: seq_num 846 ranges {618722=575837,1905884=312838} 2026-02-13T20:21:58.899 INFO:tasks.rados.rados.0.trial188.stdout:2387: writing trial18843701-8 from 618722 to 1194559 tid 1 2026-02-13T20:21:58.903 INFO:tasks.rados.rados.0.trial188.stdout:2387: writing trial18843701-8 from 1905884 to 2218722 tid 2 2026-02-13T20:21:58.903 INFO:tasks.rados.rados.0.trial188.stdout:2388: read oid 12 snap -1 2026-02-13T20:21:58.903 INFO:tasks.rados.rados.0.trial188.stdout:2388: expect deleted 2026-02-13T20:21:58.903 INFO:tasks.rados.rados.0.trial188.stdout:2389: rollback oid 41 current snap is 248 2026-02-13T20:21:58.903 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 41 to 240 2026-02-13T20:21:58.904 INFO:tasks.rados.rados.0.trial188.stdout:2390: snap_create 2026-02-13T20:21:58.904 INFO:tasks.rados.rados.0.trial188.stdout:2384: finishing write tid 1 to trial18843701-33 2026-02-13T20:21:58.905 INFO:tasks.rados.rados.0.trial188.stdout:2385: finishing copy_from to trial18843701-42 2026-02-13T20:21:58.905 INFO:tasks.rados.rados.0.trial188.stdout:2385: got expected ENOENT (src dne) 2026-02-13T20:21:58.905 INFO:tasks.rados.rados.0.trial188.stdout:2389: finishing rollback tid 0 to trial18843701-41 2026-02-13T20:21:58.906 INFO:tasks.rados.rados.0.trial188.stdout:2389: finishing rollback tid 1 to trial18843701-41 2026-02-13T20:21:58.906 INFO:tasks.rados.rados.0.trial188.stdout:2389: finishing rollback tid 2 to trial18843701-41 2026-02-13T20:21:58.906 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 41 v 964 (ObjNum 680 snap 194 seq_num 680) dirty exists 2026-02-13T20:21:58.908 INFO:tasks.rados.rados.0.trial188.stdout:2384: finishing write tid 2 to trial18843701-33 2026-02-13T20:21:58.908 INFO:tasks.rados.rados.0.trial188.stdout:2384: finishing write tid 3 to trial18843701-33 2026-02-13T20:21:58.908 INFO:tasks.rados.rados.0.trial188.stdout:2385: finishing copy_from racing read to trial18843701-42 2026-02-13T20:21:58.908 INFO:tasks.rados.rados.0.trial188.stdout:2384: finishing write tid 4 to trial18843701-33 2026-02-13T20:21:58.908 INFO:tasks.rados.rados.0.trial188.stdout:2384: oid 33 updating version 0 to 732 2026-02-13T20:21:58.908 INFO:tasks.rados.rados.0.trial188.stdout:2384: oid 33 version 732 is already newer than 731 2026-02-13T20:21:58.908 INFO:tasks.rados.rados.0.trial188.stdout:2384: oid 33 version 732 is already newer than 730 2026-02-13T20:21:58.908 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 33 v 732 (ObjNum 845 snap 248 seq_num 845) dirty exists 2026-02-13T20:21:58.908 INFO:tasks.rados.rados.0.trial188.stdout:2384: left oid 33 (ObjNum 845 snap 248 seq_num 845) 2026-02-13T20:21:58.909 INFO:tasks.rados.rados.0.trial188.stdout:2386: expect (ObjNum 760 snap 225 seq_num 760) 2026-02-13T20:21:58.942 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 849268 2026-02-13T20:21:58.961 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:21:58.992 INFO:tasks.rados.rados.0.trial188.stdout:2387: finishing write tid 1 to trial18843701-8 2026-02-13T20:21:58.992 INFO:tasks.rados.rados.0.trial188.stdout:2387: finishing write tid 2 to trial18843701-8 2026-02-13T20:21:58.992 INFO:tasks.rados.rados.0.trial188.stdout:2387: finishing write tid 3 to trial18843701-8 2026-02-13T20:21:58.993 INFO:tasks.rados.rados.0.trial188.stdout:2387: finishing write tid 4 to trial18843701-8 2026-02-13T20:21:58.993 INFO:tasks.rados.rados.0.trial188.stdout:2387: oid 8 updating version 0 to 1067 2026-02-13T20:21:58.993 INFO:tasks.rados.rados.0.trial188.stdout:2387: oid 8 updating version 1067 to 1068 2026-02-13T20:21:58.993 INFO:tasks.rados.rados.0.trial188.stdout:2387: oid 8 version 1068 is already newer than 1066 2026-02-13T20:21:58.993 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 8 v 1068 (ObjNum 846 snap 248 seq_num 846) dirty exists 2026-02-13T20:21:58.993 INFO:tasks.rados.rados.0.trial188.stdout:2387: left oid 8 (ObjNum 846 snap 248 seq_num 846) 2026-02-13T20:21:59.889 INFO:tasks.rados.rados.0.trial188.stdout:2384: done (6 left) 2026-02-13T20:21:59.889 INFO:tasks.rados.rados.0.trial188.stdout:2385: done (5 left) 2026-02-13T20:21:59.889 INFO:tasks.rados.rados.0.trial188.stdout:2386: done (4 left) 2026-02-13T20:21:59.889 INFO:tasks.rados.rados.0.trial188.stdout:2387: done (3 left) 2026-02-13T20:21:59.889 INFO:tasks.rados.rados.0.trial188.stdout:2388: done (2 left) 2026-02-13T20:21:59.889 INFO:tasks.rados.rados.0.trial188.stdout:2389: done (1 left) 2026-02-13T20:21:59.889 INFO:tasks.rados.rados.0.trial188.stdout:2390: done (0 left) 2026-02-13T20:21:59.889 INFO:tasks.rados.rados.0.trial188.stdout:2391: write oid 11 current snap is 249 2026-02-13T20:21:59.889 INFO:tasks.rados.rados.0.trial188.stdout:2391: seq_num 847 ranges {635529=651086,1848013=387516} 2026-02-13T20:21:59.893 INFO:tasks.rados.rados.0.trial188.stdout:2391: writing trial18843701-11 from 635529 to 1286615 tid 1 2026-02-13T20:21:59.897 INFO:tasks.rados.rados.0.trial188.stdout:2391: writing trial18843701-11 from 1848013 to 2235529 tid 2 2026-02-13T20:21:59.897 INFO:tasks.rados.rados.0.trial188.stdout:2392: copy_from oid 22 from oid 6 current snap is 249 2026-02-13T20:21:59.897 INFO:tasks.rados.rados.0.trial188.stdout:2393: copy_from oid 34 from oid 14 current snap is 249 2026-02-13T20:21:59.897 INFO:tasks.rados.rados.0.trial188.stdout:2394: snap_remove snap 237 2026-02-13T20:22:00.892 INFO:tasks.rados.rados.0.trial188.stdout:2394: done (3 left) 2026-02-13T20:22:00.892 INFO:tasks.rados.rados.0.trial188.stdout:2395: snap_remove snap 243 2026-02-13T20:22:01.865 INFO:tasks.rados.rados.0.trial188.stdout:2395: done (3 left) 2026-02-13T20:22:01.865 INFO:tasks.rados.rados.0.trial188.stdout:2396: snap_remove snap 246 2026-02-13T20:22:02.866 INFO:tasks.rados.rados.0.trial188.stdout:2396: done (3 left) 2026-02-13T20:22:02.866 INFO:tasks.rados.rados.0.trial188.stdout:2397: copy_from oid 13 from oid 23 current snap is 249 2026-02-13T20:22:02.867 INFO:tasks.rados.rados.0.trial188.stdout:2393: finishing copy_from to trial18843701-34 2026-02-13T20:22:02.867 INFO:tasks.rados.rados.0.trial188.stdout:2393: got expected ENOENT (src dne) 2026-02-13T20:22:02.867 INFO:tasks.rados.rados.0.trial188.stdout:2393: finishing copy_from racing read to trial18843701-34 2026-02-13T20:22:02.867 INFO:tasks.rados.rados.0.trial188.stdout:2391: finishing write tid 1 to trial18843701-11 2026-02-13T20:22:02.867 INFO:tasks.rados.rados.0.trial188.stdout:2391: finishing write tid 2 to trial18843701-11 2026-02-13T20:22:02.867 INFO:tasks.rados.rados.0.trial188.stdout:2391: finishing write tid 3 to trial18843701-11 2026-02-13T20:22:02.867 INFO:tasks.rados.rados.0.trial188.stdout:2391: finishing write tid 4 to trial18843701-11 2026-02-13T20:22:02.867 INFO:tasks.rados.rados.0.trial188.stdout:2391: oid 11 updating version 0 to 778 2026-02-13T20:22:02.867 INFO:tasks.rados.rados.0.trial188.stdout:2391: oid 11 updating version 778 to 779 2026-02-13T20:22:02.867 INFO:tasks.rados.rados.0.trial188.stdout:2391: oid 11 version 779 is already newer than 777 2026-02-13T20:22:02.867 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 11 v 779 (ObjNum 847 snap 249 seq_num 847) dirty exists 2026-02-13T20:22:02.868 INFO:tasks.rados.rados.0.trial188.stdout:2391: left oid 11 (ObjNum 847 snap 249 seq_num 847) 2026-02-13T20:22:02.868 INFO:tasks.rados.rados.0.trial188.stdout:2392: finishing copy_from racing read to trial18843701-22 2026-02-13T20:22:02.868 INFO:tasks.rados.rados.0.trial188.stdout:2392: finishing copy_from to trial18843701-22 2026-02-13T20:22:02.868 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 22 v 1053 (ObjNum 743 snap 220 seq_num 743) dirty exists 2026-02-13T20:22:02.868 INFO:tasks.rados.rados.0.trial188.stdout:2391: done (3 left) 2026-02-13T20:22:02.868 INFO:tasks.rados.rados.0.trial188.stdout:2392: done (2 left) 2026-02-13T20:22:02.868 INFO:tasks.rados.rados.0.trial188.stdout:2393: done (1 left) 2026-02-13T20:22:02.868 INFO:tasks.rados.rados.0.trial188.stdout:2398: copy_from oid 17 from oid 28 current snap is 249 2026-02-13T20:22:02.868 INFO:tasks.rados.rados.0.trial188.stdout:2399: delete oid 20 current snap is 249 2026-02-13T20:22:02.868 INFO:tasks.rados.rados.0.trial188.stdout:2399: done (2 left) 2026-02-13T20:22:02.868 INFO:tasks.rados.rados.0.trial188.stdout:2400: snap_remove snap 222 2026-02-13T20:22:03.866 INFO:tasks.rados.rados.0.trial188.stdout:2400: done (2 left) 2026-02-13T20:22:03.867 INFO:tasks.rados.rados.0.trial188.stdout:2401: write oid 41 current snap is 249 2026-02-13T20:22:03.867 INFO:tasks.rados.rados.0.trial188.stdout:2397: finishing copy_from to trial18843701-13 2026-02-13T20:22:03.867 INFO:tasks.rados.rados.0.trial188.stdout:2397: got expected ENOENT (src dne) 2026-02-13T20:22:03.867 INFO:tasks.rados.rados.0.trial188.stdout:2397: finishing copy_from racing read to trial18843701-13 2026-02-13T20:22:03.867 INFO:tasks.rados.rados.0.trial188.stdout:2398: finishing copy_from racing read to trial18843701-17 2026-02-13T20:22:03.867 INFO:tasks.rados.rados.0.trial188.stdout:2398: finishing copy_from to trial18843701-17 2026-02-13T20:22:03.867 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 17 v 1052 (ObjNum 836 snap 248 seq_num 836) dirty exists 2026-02-13T20:22:03.867 INFO:tasks.rados.rados.0.trial188.stdout:2401: seq_num 849 ranges {669143=401584,1564977=426959} 2026-02-13T20:22:03.871 INFO:tasks.rados.rados.0.trial188.stdout:2401: writing trial18843701-41 from 669143 to 1070727 tid 1 2026-02-13T20:22:03.875 INFO:tasks.rados.rados.0.trial188.stdout:2401: writing trial18843701-41 from 1564977 to 1991936 tid 2 2026-02-13T20:22:03.875 INFO:tasks.rados.rados.0.trial188.stdout:2397: done (2 left) 2026-02-13T20:22:03.875 INFO:tasks.rados.rados.0.trial188.stdout:2398: done (1 left) 2026-02-13T20:22:03.875 INFO:tasks.rados.rados.0.trial188.stdout:2402: rollback oid 47 current snap is 249 2026-02-13T20:22:03.875 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 47 to 215 2026-02-13T20:22:03.876 INFO:tasks.rados.rados.0.trial188.stdout:2403: write (excl) oid 20 current snap is 249 2026-02-13T20:22:03.876 INFO:tasks.rados.rados.0.trial188.stdout:2403: seq_num 850 ranges {685950=476833,1623459=570617} 2026-02-13T20:22:03.879 INFO:tasks.rados.rados.0.trial188.stdout:2403: writing trial18843701-20 from 685950 to 1162783 tid 1 2026-02-13T20:22:03.885 INFO:tasks.rados.rados.0.trial188.stdout:2403: writing trial18843701-20 from 1623459 to 2194076 tid 2 2026-02-13T20:22:03.885 INFO:tasks.rados.rados.0.trial188.stdout:2404: delete oid 50 current snap is 249 2026-02-13T20:22:03.885 INFO:tasks.rados.rados.0.trial188.stdout:2402: finishing rollback tid 0 to trial18843701-47 2026-02-13T20:22:03.885 INFO:tasks.rados.rados.0.trial188.stdout:2402: finishing rollback tid 1 to trial18843701-47 2026-02-13T20:22:03.885 INFO:tasks.rados.rados.0.trial188.stdout:2402: finishing rollback tid 2 to trial18843701-47 2026-02-13T20:22:03.885 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 47 v 735 (ObjNum 712 snap 203 seq_num 712) dirty exists 2026-02-13T20:22:03.885 INFO:tasks.rados.rados.0.trial188.stdout:2401: finishing write tid 1 to trial18843701-41 2026-02-13T20:22:03.885 INFO:tasks.rados.rados.0.trial188.stdout:2401: finishing write tid 2 to trial18843701-41 2026-02-13T20:22:03.886 INFO:tasks.rados.rados.0.trial188.stdout:2401: finishing write tid 3 to trial18843701-41 2026-02-13T20:22:03.886 INFO:tasks.rados.rados.0.trial188.stdout:2401: finishing write tid 4 to trial18843701-41 2026-02-13T20:22:03.886 INFO:tasks.rados.rados.0.trial188.stdout:2401: oid 41 updating version 0 to 966 2026-02-13T20:22:03.886 INFO:tasks.rados.rados.0.trial188.stdout:2401: oid 41 updating version 966 to 967 2026-02-13T20:22:03.886 INFO:tasks.rados.rados.0.trial188.stdout:2401: oid 41 version 967 is already newer than 965 2026-02-13T20:22:03.886 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 41 v 967 (ObjNum 849 snap 249 seq_num 849) dirty exists 2026-02-13T20:22:03.886 INFO:tasks.rados.rados.0.trial188.stdout:2401: left oid 41 (ObjNum 849 snap 249 seq_num 849) 2026-02-13T20:22:03.886 INFO:tasks.rados.rados.0.trial188.stdout:2401: done (3 left) 2026-02-13T20:22:03.887 INFO:tasks.rados.rados.0.trial188.stdout:2402: done (2 left) 2026-02-13T20:22:03.887 INFO:tasks.rados.rados.0.trial188.stdout:2404: done (1 left) 2026-02-13T20:22:03.887 INFO:tasks.rados.rados.0.trial188.stdout:2405: snap_remove snap 230 2026-02-13T20:22:04.871 INFO:tasks.rados.rados.0.trial188.stdout:2405: done (1 left) 2026-02-13T20:22:04.871 INFO:tasks.rados.rados.0.trial188.stdout:2406: copy_from oid 29 from oid 40 current snap is 249 2026-02-13T20:22:04.871 INFO:tasks.rados.rados.0.trial188.stdout:2403: finishing write tid 1 to trial18843701-20 2026-02-13T20:22:04.871 INFO:tasks.rados.rados.0.trial188.stdout:2403: finishing write tid 2 to trial18843701-20 2026-02-13T20:22:04.871 INFO:tasks.rados.rados.0.trial188.stdout:2403: finishing write tid 3 to trial18843701-20 2026-02-13T20:22:04.871 INFO:tasks.rados.rados.0.trial188.stdout:2403: finishing write tid 4 to trial18843701-20 2026-02-13T20:22:04.871 INFO:tasks.rados.rados.0.trial188.stdout:2403: oid 20 updating version 0 to 674 2026-02-13T20:22:04.871 INFO:tasks.rados.rados.0.trial188.stdout:2403: oid 20 updating version 674 to 675 2026-02-13T20:22:04.872 INFO:tasks.rados.rados.0.trial188.stdout:2403: oid 20 updating version 675 to 676 2026-02-13T20:22:04.872 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 20 v 676 (ObjNum 850 snap 249 seq_num 850) dirty exists 2026-02-13T20:22:04.872 INFO:tasks.rados.rados.0.trial188.stdout:2403: left oid 20 (ObjNum 850 snap 249 seq_num 850) 2026-02-13T20:22:04.872 INFO:tasks.rados.rados.0.trial188.stdout:2403: done (1 left) 2026-02-13T20:22:04.872 INFO:tasks.rados.rados.0.trial188.stdout:2407: read oid 37 snap -1 2026-02-13T20:22:04.872 INFO:tasks.rados.rados.0.trial188.stdout:2407: expect (ObjNum 808 snap 240 seq_num 808) 2026-02-13T20:22:04.872 INFO:tasks.rados.rados.0.trial188.stdout:2408: read oid 14 snap -1 2026-02-13T20:22:04.872 INFO:tasks.rados.rados.0.trial188.stdout:2408: expect deleted 2026-02-13T20:22:04.872 INFO:tasks.rados.rados.0.trial188.stdout:2409: snap_create 2026-02-13T20:22:04.878 INFO:tasks.rados.rados.0.trial188.stdout:2407: expect (ObjNum 808 snap 240 seq_num 808) 2026-02-13T20:22:04.878 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:22:04.914 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2458094 2026-02-13T20:22:04.921 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:22:04.947 INFO:tasks.rados.rados.0.trial188.stdout:2406: finishing copy_from racing read to trial18843701-29 2026-02-13T20:22:04.947 INFO:tasks.rados.rados.0.trial188.stdout:2406: finishing copy_from to trial18843701-29 2026-02-13T20:22:04.947 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 29 v 802 (ObjNum 775 snap 230 seq_num 775) dirty exists 2026-02-13T20:22:05.871 INFO:tasks.rados.rados.0.trial188.stdout:2406: done (3 left) 2026-02-13T20:22:05.871 INFO:tasks.rados.rados.0.trial188.stdout:2407: done (2 left) 2026-02-13T20:22:05.871 INFO:tasks.rados.rados.0.trial188.stdout:2408: done (1 left) 2026-02-13T20:22:05.871 INFO:tasks.rados.rados.0.trial188.stdout:2409: done (0 left) 2026-02-13T20:22:05.872 INFO:tasks.rados.rados.0.trial188.stdout:2410: delete oid 29 current snap is 250 2026-02-13T20:22:05.874 INFO:tasks.rados.rados.0.trial188.stdout:2410: done (0 left) 2026-02-13T20:22:05.874 INFO:tasks.rados.rados.0.trial188.stdout:2411: delete oid 43 current snap is 250 2026-02-13T20:22:05.876 INFO:tasks.rados.rados.0.trial188.stdout:2411: done (0 left) 2026-02-13T20:22:05.877 INFO:tasks.rados.rados.0.trial188.stdout:2412: read oid 4 snap -1 2026-02-13T20:22:05.877 INFO:tasks.rados.rados.0.trial188.stdout:2412: expect deleted 2026-02-13T20:22:05.877 INFO:tasks.rados.rados.0.trial188.stdout:2413: write (excl) oid 6 current snap is 250 2026-02-13T20:22:05.877 INFO:tasks.rados.rados.0.trial188.stdout:2413: seq_num 854 ranges {753178=494182,1857387=495791} 2026-02-13T20:22:05.881 INFO:tasks.rados.rados.0.trial188.stdout:2413: writing trial18843701-6 from 753178 to 1247360 tid 1 2026-02-13T20:22:05.886 INFO:tasks.rados.rados.0.trial188.stdout:2413: writing trial18843701-6 from 1857387 to 2353178 tid 2 2026-02-13T20:22:05.886 INFO:tasks.rados.rados.0.trial188.stdout:2414: rollback oid 22 current snap is 250 2026-02-13T20:22:05.886 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 22 to 218 2026-02-13T20:22:05.886 INFO:tasks.rados.rados.0.trial188.stdout:2412: done (2 left) 2026-02-13T20:22:05.887 INFO:tasks.rados.rados.0.trial188.stdout:2415: delete oid 3 current snap is 250 2026-02-13T20:22:05.888 INFO:tasks.rados.rados.0.trial188.stdout:2414: finishing rollback tid 0 to trial18843701-22 2026-02-13T20:22:05.888 INFO:tasks.rados.rados.0.trial188.stdout:2414: finishing rollback tid 1 to trial18843701-22 2026-02-13T20:22:05.888 INFO:tasks.rados.rados.0.trial188.stdout:2414: finishing rollback tid 2 to trial18843701-22 2026-02-13T20:22:05.888 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 22 v 1057 (ObjNum 735 snap 218 seq_num 735) dirty exists 2026-02-13T20:22:05.897 INFO:tasks.rados.rados.0.trial188.stdout:2413: finishing write tid 1 to trial18843701-6 2026-02-13T20:22:05.898 INFO:tasks.rados.rados.0.trial188.stdout:2413: finishing write tid 2 to trial18843701-6 2026-02-13T20:22:05.899 INFO:tasks.rados.rados.0.trial188.stdout:2413: finishing write tid 3 to trial18843701-6 2026-02-13T20:22:05.899 INFO:tasks.rados.rados.0.trial188.stdout:2413: finishing write tid 4 to trial18843701-6 2026-02-13T20:22:05.899 INFO:tasks.rados.rados.0.trial188.stdout:2413: oid 6 updating version 0 to 1121 2026-02-13T20:22:05.899 INFO:tasks.rados.rados.0.trial188.stdout:2413: oid 6 version 1121 is already newer than 1120 2026-02-13T20:22:05.899 INFO:tasks.rados.rados.0.trial188.stdout:2413: oid 6 updating version 1121 to 1122 2026-02-13T20:22:05.899 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 6 v 1122 (ObjNum 854 snap 250 seq_num 854) dirty exists 2026-02-13T20:22:05.899 INFO:tasks.rados.rados.0.trial188.stdout:2413: left oid 6 (ObjNum 854 snap 250 seq_num 854) 2026-02-13T20:22:05.899 INFO:tasks.rados.rados.0.trial188.stdout:2413: done (2 left) 2026-02-13T20:22:05.899 INFO:tasks.rados.rados.0.trial188.stdout:2414: done (1 left) 2026-02-13T20:22:05.899 INFO:tasks.rados.rados.0.trial188.stdout:2415: done (0 left) 2026-02-13T20:22:05.900 INFO:tasks.rados.rados.0.trial188.stdout:2416: snap_remove snap 240 2026-02-13T20:22:06.866 INFO:tasks.rados.rados.0.trial188.stdout:2416: done (0 left) 2026-02-13T20:22:06.867 INFO:tasks.rados.rados.0.trial188.stdout:2417: rollback oid 9 current snap is 250 2026-02-13T20:22:06.867 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 9 to 232 2026-02-13T20:22:06.867 INFO:tasks.rados.rados.0.trial188.stdout:2418: copy_from oid 4 from oid 3 current snap is 250 2026-02-13T20:22:06.867 INFO:tasks.rados.rados.0.trial188.stdout:2419: write (excl) oid 36 current snap is 250 2026-02-13T20:22:06.867 INFO:tasks.rados.rados.0.trial188.stdout:2419: seq_num 856 ranges {786792=644680,1857998=528794} 2026-02-13T20:22:06.872 INFO:tasks.rados.rados.0.trial188.stdout:2419: writing trial18843701-36 from 786792 to 1431472 tid 1 2026-02-13T20:22:06.876 INFO:tasks.rados.rados.0.trial188.stdout:2419: writing trial18843701-36 from 1857998 to 2386792 tid 2 2026-02-13T20:22:06.877 INFO:tasks.rados.rados.0.trial188.stdout:2420: delete oid 13 current snap is 250 2026-02-13T20:22:06.877 INFO:tasks.rados.rados.0.trial188.stdout:2417: finishing rollback tid 0 to trial18843701-9 2026-02-13T20:22:06.877 INFO:tasks.rados.rados.0.trial188.stdout:2417: finishing rollback tid 1 to trial18843701-9 2026-02-13T20:22:06.877 INFO:tasks.rados.rados.0.trial188.stdout:2417: finishing rollback tid 2 to trial18843701-9 2026-02-13T20:22:06.877 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 9 v 747 (ObjNum 785 snap 232 seq_num 785) dirty exists 2026-02-13T20:22:06.877 INFO:tasks.rados.rados.0.trial188.stdout:2418: finishing copy_from to trial18843701-4 2026-02-13T20:22:06.877 INFO:tasks.rados.rados.0.trial188.stdout:2418: got expected ENOENT (src dne) 2026-02-13T20:22:06.877 INFO:tasks.rados.rados.0.trial188.stdout:2418: finishing copy_from racing read to trial18843701-4 2026-02-13T20:22:06.890 INFO:tasks.rados.rados.0.trial188.stdout:2417: done (3 left) 2026-02-13T20:22:06.890 INFO:tasks.rados.rados.0.trial188.stdout:2418: done (2 left) 2026-02-13T20:22:06.890 INFO:tasks.rados.rados.0.trial188.stdout:2420: done (1 left) 2026-02-13T20:22:06.890 INFO:tasks.rados.rados.0.trial188.stdout:2421: read oid 32 snap -1 2026-02-13T20:22:06.890 INFO:tasks.rados.rados.0.trial188.stdout:2421: expect (ObjNum 739 snap 220 seq_num 739) 2026-02-13T20:22:06.890 INFO:tasks.rados.rados.0.trial188.stdout:2422: read oid 19 snap -1 2026-02-13T20:22:06.890 INFO:tasks.rados.rados.0.trial188.stdout:2422: expect (ObjNum 843 snap 248 seq_num 843) 2026-02-13T20:22:06.890 INFO:tasks.rados.rados.0.trial188.stdout:2423: read oid 30 snap 218 2026-02-13T20:22:06.890 INFO:tasks.rados.rados.0.trial188.stdout:2423: expect (ObjNum 736 snap 218 seq_num 736) 2026-02-13T20:22:06.890 INFO:tasks.rados.rados.0.trial188.stdout:2424: delete oid 8 current snap is 250 2026-02-13T20:22:06.892 INFO:tasks.rados.rados.0.trial188.stdout:2424: done (4 left) 2026-02-13T20:22:06.892 INFO:tasks.rados.rados.0.trial188.stdout:2425: rollback oid 15 current snap is 250 2026-02-13T20:22:06.892 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 15 to 249 2026-02-13T20:22:06.892 INFO:tasks.rados.rados.0.trial188.stdout:2426: read oid 23 snap -1 2026-02-13T20:22:06.892 INFO:tasks.rados.rados.0.trial188.stdout:2426: expect deleted 2026-02-13T20:22:06.892 INFO:tasks.rados.rados.0.trial188.stdout:2427: copy_from oid 44 from oid 47 current snap is 250 2026-02-13T20:22:06.892 INFO:tasks.rados.rados.0.trial188.stdout:2428: write oid 26 current snap is 250 2026-02-13T20:22:06.892 INFO:tasks.rados.rados.0.trial188.stdout:2428: seq_num 859 ranges {437213=470427,1633444=728951} 2026-02-13T20:22:06.895 INFO:tasks.rados.rados.0.trial188.stdout:2428: writing trial18843701-26 from 437213 to 907640 tid 1 2026-02-13T20:22:06.901 INFO:tasks.rados.rados.0.trial188.stdout:2428: writing trial18843701-26 from 1633444 to 2362395 tid 2 2026-02-13T20:22:06.901 INFO:tasks.rados.rados.0.trial188.stdout:2429: copy_from oid 41 from oid 33 current snap is 250 2026-02-13T20:22:06.901 INFO:tasks.rados.rados.0.trial188.stdout:2423: expect (ObjNum 736 snap 218 seq_num 736) 2026-02-13T20:22:06.901 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 172630 2026-02-13T20:22:06.950 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:22:06.975 INFO:tasks.rados.rados.0.trial188.stdout:2419: finishing write tid 1 to trial18843701-36 2026-02-13T20:22:06.975 INFO:tasks.rados.rados.0.trial188.stdout:2419: finishing write tid 2 to trial18843701-36 2026-02-13T20:22:06.976 INFO:tasks.rados.rados.0.trial188.stdout:2419: finishing write tid 3 to trial18843701-36 2026-02-13T20:22:06.976 INFO:tasks.rados.rados.0.trial188.stdout:2419: finishing write tid 4 to trial18843701-36 2026-02-13T20:22:06.976 INFO:tasks.rados.rados.0.trial188.stdout:2419: oid 36 updating version 0 to 1129 2026-02-13T20:22:06.976 INFO:tasks.rados.rados.0.trial188.stdout:2419: oid 36 updating version 1129 to 1130 2026-02-13T20:22:06.976 INFO:tasks.rados.rados.0.trial188.stdout:2419: oid 36 version 1130 is already newer than 1128 2026-02-13T20:22:06.976 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 36 v 1130 (ObjNum 856 snap 250 seq_num 856) dirty exists 2026-02-13T20:22:06.976 INFO:tasks.rados.rados.0.trial188.stdout:2419: left oid 36 (ObjNum 856 snap 250 seq_num 856) 2026-02-13T20:22:06.976 INFO:tasks.rados.rados.0.trial188.stdout:2425: finishing rollback tid 0 to trial18843701-15 2026-02-13T20:22:06.977 INFO:tasks.rados.rados.0.trial188.stdout:2421: expect (ObjNum 739 snap 220 seq_num 739) 2026-02-13T20:22:06.977 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 311644 2026-02-13T20:22:06.989 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 379226 2026-02-13T20:22:07.016 INFO:tasks.rados.rados.0.trial188.stdout:2422: expect (ObjNum 843 snap 248 seq_num 843) 2026-02-13T20:22:07.021 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 988897 2026-02-13T20:22:07.039 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:22:07.068 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 510257 2026-02-13T20:22:07.091 INFO:tasks.rados.rados.0.trial188.stdout:2425: finishing rollback tid 1 to trial18843701-15 2026-02-13T20:22:07.091 INFO:tasks.rados.rados.0.trial188.stdout:2425: finishing rollback tid 2 to trial18843701-15 2026-02-13T20:22:07.092 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 15 v 791 (ObjNum 821 snap 241 seq_num 821) dirty exists 2026-02-13T20:22:07.092 INFO:tasks.rados.rados.0.trial188.stdout:2428: finishing write tid 1 to trial18843701-26 2026-02-13T20:22:07.092 INFO:tasks.rados.rados.0.trial188.stdout:2428: finishing write tid 2 to trial18843701-26 2026-02-13T20:22:07.092 INFO:tasks.rados.rados.0.trial188.stdout:2428: finishing write tid 3 to trial18843701-26 2026-02-13T20:22:07.092 INFO:tasks.rados.rados.0.trial188.stdout:2419: done (8 left) 2026-02-13T20:22:07.092 INFO:tasks.rados.rados.0.trial188.stdout:2421: done (7 left) 2026-02-13T20:22:07.092 INFO:tasks.rados.rados.0.trial188.stdout:2422: done (6 left) 2026-02-13T20:22:07.092 INFO:tasks.rados.rados.0.trial188.stdout:2423: done (5 left) 2026-02-13T20:22:07.092 INFO:tasks.rados.rados.0.trial188.stdout:2425: done (4 left) 2026-02-13T20:22:07.092 INFO:tasks.rados.rados.0.trial188.stdout:2426: done (3 left) 2026-02-13T20:22:07.092 INFO:tasks.rados.rados.0.trial188.stdout:2430: write (excl) oid 35 current snap is 250 2026-02-13T20:22:07.093 INFO:tasks.rados.rados.0.trial188.stdout:2428: finishing write tid 4 to trial18843701-26 2026-02-13T20:22:07.093 INFO:tasks.rados.rados.0.trial188.stdout:2428: oid 26 updating version 0 to 792 2026-02-13T20:22:07.093 INFO:tasks.rados.rados.0.trial188.stdout:2428: oid 26 updating version 792 to 794 2026-02-13T20:22:07.093 INFO:tasks.rados.rados.0.trial188.stdout:2428: oid 26 version 794 is already newer than 793 2026-02-13T20:22:07.093 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 26 v 794 (ObjNum 859 snap 250 seq_num 859) dirty exists 2026-02-13T20:22:07.093 INFO:tasks.rados.rados.0.trial188.stdout:2428: left oid 26 (ObjNum 859 snap 250 seq_num 859) 2026-02-13T20:22:07.093 INFO:tasks.rados.rados.0.trial188.stdout:2429: finishing copy_from racing read to trial18843701-41 2026-02-13T20:22:07.093 INFO:tasks.rados.rados.0.trial188.stdout:2429: finishing copy_from to trial18843701-41 2026-02-13T20:22:07.093 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 41 v 732 (ObjNum 845 snap 248 seq_num 845) dirty exists 2026-02-13T20:22:07.093 INFO:tasks.rados.rados.0.trial188.stdout:2427: finishing copy_from racing read to trial18843701-44 2026-02-13T20:22:07.093 INFO:tasks.rados.rados.0.trial188.stdout:2427: finishing copy_from to trial18843701-44 2026-02-13T20:22:07.093 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 44 v 735 (ObjNum 712 snap 203 seq_num 712) dirty exists 2026-02-13T20:22:07.094 INFO:tasks.rados.rados.0.trial188.stdout:2430: seq_num 860 ranges {454020=662029,1691926=588962} 2026-02-13T20:22:07.095 INFO:tasks.rados.rados.0.trial188.stdout:2430: writing trial18843701-35 from 454020 to 1116049 tid 1 2026-02-13T20:22:07.100 INFO:tasks.rados.rados.0.trial188.stdout:2430: writing trial18843701-35 from 1691926 to 2280888 tid 2 2026-02-13T20:22:07.100 INFO:tasks.rados.rados.0.trial188.stdout:2427: done (3 left) 2026-02-13T20:22:07.100 INFO:tasks.rados.rados.0.trial188.stdout:2428: done (2 left) 2026-02-13T20:22:07.100 INFO:tasks.rados.rados.0.trial188.stdout:2429: done (1 left) 2026-02-13T20:22:07.100 INFO:tasks.rados.rados.0.trial188.stdout:2431: snap_remove snap 247 2026-02-13T20:22:07.878 INFO:tasks.rados.rados.0.trial188.stdout:2431: done (1 left) 2026-02-13T20:22:07.878 INFO:tasks.rados.rados.0.trial188.stdout:2432: delete oid 46 current snap is 250 2026-02-13T20:22:07.878 INFO:tasks.rados.rados.0.trial188.stdout:2430: finishing write tid 1 to trial18843701-35 2026-02-13T20:22:07.878 INFO:tasks.rados.rados.0.trial188.stdout:2430: finishing write tid 2 to trial18843701-35 2026-02-13T20:22:07.878 INFO:tasks.rados.rados.0.trial188.stdout:2430: finishing write tid 3 to trial18843701-35 2026-02-13T20:22:07.878 INFO:tasks.rados.rados.0.trial188.stdout:2430: finishing write tid 4 to trial18843701-35 2026-02-13T20:22:07.879 INFO:tasks.rados.rados.0.trial188.stdout:2430: oid 35 updating version 0 to 750 2026-02-13T20:22:07.879 INFO:tasks.rados.rados.0.trial188.stdout:2430: oid 35 version 750 is already newer than 749 2026-02-13T20:22:07.879 INFO:tasks.rados.rados.0.trial188.stdout:2430: oid 35 version 750 is already newer than 748 2026-02-13T20:22:07.879 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 35 v 750 (ObjNum 860 snap 250 seq_num 860) dirty exists 2026-02-13T20:22:07.879 INFO:tasks.rados.rados.0.trial188.stdout:2430: left oid 35 (ObjNum 860 snap 250 seq_num 860) 2026-02-13T20:22:07.882 INFO:tasks.rados.rados.0.trial188.stdout:2430: done (1 left) 2026-02-13T20:22:07.882 INFO:tasks.rados.rados.0.trial188.stdout:2432: done (0 left) 2026-02-13T20:22:07.882 INFO:tasks.rados.rados.0.trial188.stdout:2433: read oid 34 snap 241 2026-02-13T20:22:07.882 INFO:tasks.rados.rados.0.trial188.stdout:2433: expect (ObjNum 798 snap 237 seq_num 798) 2026-02-13T20:22:07.883 INFO:tasks.rados.rados.0.trial188.stdout:2434: read oid 39 snap -1 2026-02-13T20:22:07.883 INFO:tasks.rados.rados.0.trial188.stdout:2434: expect deleted 2026-02-13T20:22:07.883 INFO:tasks.rados.rados.0.trial188.stdout:2435: read oid 22 snap -1 2026-02-13T20:22:07.883 INFO:tasks.rados.rados.0.trial188.stdout:2435: expect (ObjNum 735 snap 218 seq_num 735) 2026-02-13T20:22:07.883 INFO:tasks.rados.rados.0.trial188.stdout:2436: write oid 36 current snap is 250 2026-02-13T20:22:07.883 INFO:tasks.rados.rados.0.trial188.stdout:2436: seq_num 862 ranges {487634=412527,1408890=592631} 2026-02-13T20:22:07.886 INFO:tasks.rados.rados.0.trial188.stdout:2436: writing trial18843701-36 from 487634 to 900161 tid 1 2026-02-13T20:22:07.890 INFO:tasks.rados.rados.0.trial188.stdout:2436: writing trial18843701-36 from 1408890 to 2001521 tid 2 2026-02-13T20:22:07.891 INFO:tasks.rados.rados.0.trial188.stdout:2437: snap_remove snap 194 2026-02-13T20:22:08.881 INFO:tasks.rados.rados.0.trial188.stdout:2437: done (4 left) 2026-02-13T20:22:08.881 INFO:tasks.rados.rados.0.trial188.stdout:2438: write (excl) oid 19 current snap is 250 2026-02-13T20:22:08.881 INFO:tasks.rados.rados.0.trial188.stdout:2435: expect (ObjNum 735 snap 218 seq_num 735) 2026-02-13T20:22:08.926 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 784226 2026-02-13T20:22:08.941 INFO:tasks.rados.rados.0.trial188.stdout:2433: expect (ObjNum 798 snap 237 seq_num 798) 2026-02-13T20:22:08.941 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:22:09.075 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2679565 2026-02-13T20:22:09.097 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 824199 2026-02-13T20:22:09.163 INFO:tasks.rados.rados.0.trial188.stdout:2436: finishing write tid 1 to trial18843701-36 2026-02-13T20:22:09.163 INFO:tasks.rados.rados.0.trial188.stdout:2436: finishing write tid 2 to trial18843701-36 2026-02-13T20:22:09.163 INFO:tasks.rados.rados.0.trial188.stdout:2436: finishing write tid 3 to trial18843701-36 2026-02-13T20:22:09.163 INFO:tasks.rados.rados.0.trial188.stdout:2436: finishing write tid 4 to trial18843701-36 2026-02-13T20:22:09.163 INFO:tasks.rados.rados.0.trial188.stdout:2436: oid 36 updating version 0 to 1138 2026-02-13T20:22:09.163 INFO:tasks.rados.rados.0.trial188.stdout:2436: oid 36 updating version 1138 to 1139 2026-02-13T20:22:09.163 INFO:tasks.rados.rados.0.trial188.stdout:2436: oid 36 version 1139 is already newer than 1137 2026-02-13T20:22:09.163 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 36 v 1139 (ObjNum 862 snap 250 seq_num 862) dirty exists 2026-02-13T20:22:09.163 INFO:tasks.rados.rados.0.trial188.stdout:2436: left oid 36 (ObjNum 862 snap 250 seq_num 862) 2026-02-13T20:22:09.163 INFO:tasks.rados.rados.0.trial188.stdout:2438: seq_num 863 ranges {504441=487776,1467372=736289} 2026-02-13T20:22:09.167 INFO:tasks.rados.rados.0.trial188.stdout:2438: writing trial18843701-19 from 504441 to 992217 tid 1 2026-02-13T20:22:09.171 INFO:tasks.rados.rados.0.trial188.stdout:2438: writing trial18843701-19 from 1467372 to 2203661 tid 2 2026-02-13T20:22:09.171 INFO:tasks.rados.rados.0.trial188.stdout:2433: done (4 left) 2026-02-13T20:22:09.171 INFO:tasks.rados.rados.0.trial188.stdout:2434: done (3 left) 2026-02-13T20:22:09.171 INFO:tasks.rados.rados.0.trial188.stdout:2435: done (2 left) 2026-02-13T20:22:09.171 INFO:tasks.rados.rados.0.trial188.stdout:2436: done (1 left) 2026-02-13T20:22:09.171 INFO:tasks.rados.rados.0.trial188.stdout:2439: write oid 26 current snap is 250 2026-02-13T20:22:09.172 INFO:tasks.rados.rados.0.trial188.stdout:2439: seq_num 864 ranges {521248=563025,1809501=596300} 2026-02-13T20:22:09.175 INFO:tasks.rados.rados.0.trial188.stdout:2439: writing trial18843701-26 from 521248 to 1084273 tid 1 2026-02-13T20:22:09.181 INFO:tasks.rados.rados.0.trial188.stdout:2439: writing trial18843701-26 from 1809501 to 2405801 tid 2 2026-02-13T20:22:09.181 INFO:tasks.rados.rados.0.trial188.stdout:2440: read oid 39 snap -1 2026-02-13T20:22:09.181 INFO:tasks.rados.rados.0.trial188.stdout:2440: expect deleted 2026-02-13T20:22:09.181 INFO:tasks.rados.rados.0.trial188.stdout:2441: write (excl) oid 15 current snap is 250 2026-02-13T20:22:09.181 INFO:tasks.rados.rados.0.trial188.stdout:2441: seq_num 865 ranges {538055=638274,1867983=670072} 2026-02-13T20:22:09.185 INFO:tasks.rados.rados.0.trial188.stdout:2441: writing trial18843701-15 from 538055 to 1176329 tid 1 2026-02-13T20:22:09.190 INFO:tasks.rados.rados.0.trial188.stdout:2441: writing trial18843701-15 from 1867983 to 2538055 tid 2 2026-02-13T20:22:09.190 INFO:tasks.rados.rados.0.trial188.stdout:2442: rollback oid 4 current snap is 250 2026-02-13T20:22:09.190 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 4 to 232 2026-02-13T20:22:09.190 INFO:tasks.rados.rados.0.trial188.stdout:2438: finishing write tid 1 to trial18843701-19 2026-02-13T20:22:09.191 INFO:tasks.rados.rados.0.trial188.stdout:2440: done (4 left) 2026-02-13T20:22:09.191 INFO:tasks.rados.rados.0.trial188.stdout:2443: snap_create 2026-02-13T20:22:09.191 INFO:tasks.rados.rados.0.trial188.stdout:2442: finishing rollback tid 1 to trial18843701-4 2026-02-13T20:22:09.191 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 4 v 776 (ObjNum 353 snap 0 seq_num 4129271376) dirty dne 2026-02-13T20:22:09.206 INFO:tasks.rados.rados.0.trial188.stdout:2438: finishing write tid 2 to trial18843701-19 2026-02-13T20:22:09.206 INFO:tasks.rados.rados.0.trial188.stdout:2438: finishing write tid 3 to trial18843701-19 2026-02-13T20:22:09.206 INFO:tasks.rados.rados.0.trial188.stdout:2438: finishing write tid 4 to trial18843701-19 2026-02-13T20:22:09.206 INFO:tasks.rados.rados.0.trial188.stdout:2438: oid 19 updating version 0 to 995 2026-02-13T20:22:09.206 INFO:tasks.rados.rados.0.trial188.stdout:2438: oid 19 version 995 is already newer than 993 2026-02-13T20:22:09.206 INFO:tasks.rados.rados.0.trial188.stdout:2438: oid 19 version 995 is already newer than 994 2026-02-13T20:22:09.206 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 19 v 995 (ObjNum 863 snap 250 seq_num 863) dirty exists 2026-02-13T20:22:09.207 INFO:tasks.rados.rados.0.trial188.stdout:2438: left oid 19 (ObjNum 863 snap 250 seq_num 863) 2026-02-13T20:22:09.213 INFO:tasks.rados.rados.0.trial188.stdout:2439: finishing write tid 1 to trial18843701-26 2026-02-13T20:22:09.223 INFO:tasks.rados.rados.0.trial188.stdout:2439: finishing write tid 2 to trial18843701-26 2026-02-13T20:22:09.223 INFO:tasks.rados.rados.0.trial188.stdout:2439: finishing write tid 3 to trial18843701-26 2026-02-13T20:22:09.223 INFO:tasks.rados.rados.0.trial188.stdout:2439: finishing write tid 4 to trial18843701-26 2026-02-13T20:22:09.223 INFO:tasks.rados.rados.0.trial188.stdout:2439: oid 26 updating version 0 to 805 2026-02-13T20:22:09.223 INFO:tasks.rados.rados.0.trial188.stdout:2439: oid 26 updating version 805 to 807 2026-02-13T20:22:09.224 INFO:tasks.rados.rados.0.trial188.stdout:2439: oid 26 version 807 is already newer than 806 2026-02-13T20:22:09.224 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 26 v 807 (ObjNum 864 snap 250 seq_num 864) dirty exists 2026-02-13T20:22:09.224 INFO:tasks.rados.rados.0.trial188.stdout:2439: left oid 26 (ObjNum 864 snap 250 seq_num 864) 2026-02-13T20:22:09.224 INFO:tasks.rados.rados.0.trial188.stdout:2441: finishing write tid 1 to trial18843701-15 2026-02-13T20:22:09.225 INFO:tasks.rados.rados.0.trial188.stdout:2441: finishing write tid 2 to trial18843701-15 2026-02-13T20:22:09.225 INFO:tasks.rados.rados.0.trial188.stdout:2441: finishing write tid 3 to trial18843701-15 2026-02-13T20:22:09.225 INFO:tasks.rados.rados.0.trial188.stdout:2441: finishing write tid 4 to trial18843701-15 2026-02-13T20:22:09.225 INFO:tasks.rados.rados.0.trial188.stdout:2441: oid 15 updating version 0 to 808 2026-02-13T20:22:09.225 INFO:tasks.rados.rados.0.trial188.stdout:2441: oid 15 updating version 808 to 809 2026-02-13T20:22:09.225 INFO:tasks.rados.rados.0.trial188.stdout:2441: oid 15 updating version 809 to 810 2026-02-13T20:22:09.225 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 15 v 810 (ObjNum 865 snap 250 seq_num 865) dirty exists 2026-02-13T20:22:09.225 INFO:tasks.rados.rados.0.trial188.stdout:2441: left oid 15 (ObjNum 865 snap 250 seq_num 865) 2026-02-13T20:22:09.883 INFO:tasks.rados.rados.0.trial188.stdout:2438: done (4 left) 2026-02-13T20:22:09.883 INFO:tasks.rados.rados.0.trial188.stdout:2439: done (3 left) 2026-02-13T20:22:09.884 INFO:tasks.rados.rados.0.trial188.stdout:2441: done (2 left) 2026-02-13T20:22:09.884 INFO:tasks.rados.rados.0.trial188.stdout:2442: done (1 left) 2026-02-13T20:22:09.884 INFO:tasks.rados.rados.0.trial188.stdout:2443: done (0 left) 2026-02-13T20:22:09.884 INFO:tasks.rados.rados.0.trial188.stdout:2444: copy_from oid 37 from oid 36 current snap is 251 2026-02-13T20:22:09.884 INFO:tasks.rados.rados.0.trial188.stdout:2445: copy_from oid 14 from oid 50 current snap is 251 2026-02-13T20:22:09.884 INFO:tasks.rados.rados.0.trial188.stdout:2446: copy_from oid 40 from oid 33 current snap is 251 2026-02-13T20:22:09.884 INFO:tasks.rados.rados.0.trial188.stdout:2447: snap_create 2026-02-13T20:22:09.886 INFO:tasks.rados.rados.0.trial188.stdout:2445: finishing copy_from to trial18843701-14 2026-02-13T20:22:09.886 INFO:tasks.rados.rados.0.trial188.stdout:2445: got expected ENOENT (src dne) 2026-02-13T20:22:09.886 INFO:tasks.rados.rados.0.trial188.stdout:2445: finishing copy_from racing read to trial18843701-14 2026-02-13T20:22:09.910 INFO:tasks.rados.rados.0.trial188.stdout:2446: finishing copy_from racing read to trial18843701-40 2026-02-13T20:22:09.911 INFO:tasks.rados.rados.0.trial188.stdout:2446: finishing copy_from to trial18843701-40 2026-02-13T20:22:09.912 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 40 v 732 (ObjNum 845 snap 248 seq_num 845) dirty exists 2026-02-13T20:22:09.917 INFO:tasks.rados.rados.0.trial188.stdout:2444: finishing copy_from racing read to trial18843701-37 2026-02-13T20:22:09.919 INFO:tasks.rados.rados.0.trial188.stdout:2444: finishing copy_from to trial18843701-37 2026-02-13T20:22:09.919 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 37 v 1139 (ObjNum 862 snap 250 seq_num 862) dirty exists 2026-02-13T20:22:10.889 INFO:tasks.rados.rados.0.trial188.stdout:2444: done (3 left) 2026-02-13T20:22:10.889 INFO:tasks.rados.rados.0.trial188.stdout:2445: done (2 left) 2026-02-13T20:22:10.889 INFO:tasks.rados.rados.0.trial188.stdout:2446: done (1 left) 2026-02-13T20:22:10.889 INFO:tasks.rados.rados.0.trial188.stdout:2447: done (0 left) 2026-02-13T20:22:10.889 INFO:tasks.rados.rados.0.trial188.stdout:2448: read oid 42 snap -1 2026-02-13T20:22:10.890 INFO:tasks.rados.rados.0.trial188.stdout:2448: expect (ObjNum 832 snap 247 seq_num 832) 2026-02-13T20:22:10.890 INFO:tasks.rados.rados.0.trial188.stdout:2449: write oid 33 current snap is 252 2026-02-13T20:22:10.890 INFO:tasks.rados.rados.0.trial188.stdout:2449: seq_num 866 ranges {554862=713523,1926465=599969} 2026-02-13T20:22:10.893 INFO:tasks.rados.rados.0.trial188.stdout:2449: writing trial18843701-33 from 554862 to 1268385 tid 1 2026-02-13T20:22:10.899 INFO:tasks.rados.rados.0.trial188.stdout:2449: writing trial18843701-33 from 1926465 to 2526434 tid 2 2026-02-13T20:22:10.899 INFO:tasks.rados.rados.0.trial188.stdout:2450: read oid 24 snap 241 2026-02-13T20:22:10.899 INFO:tasks.rados.rados.0.trial188.stdout:2450: expect (ObjNum 671 snap 185 seq_num 671) 2026-02-13T20:22:10.899 INFO:tasks.rados.rados.0.trial188.stdout:2451: read oid 45 snap -1 2026-02-13T20:22:10.899 INFO:tasks.rados.rados.0.trial188.stdout:2451: expect deleted 2026-02-13T20:22:10.899 INFO:tasks.rados.rados.0.trial188.stdout:2452: read oid 43 snap -1 2026-02-13T20:22:10.899 INFO:tasks.rados.rados.0.trial188.stdout:2452: expect deleted 2026-02-13T20:22:10.900 INFO:tasks.rados.rados.0.trial188.stdout:2453: read oid 15 snap -1 2026-02-13T20:22:10.900 INFO:tasks.rados.rados.0.trial188.stdout:2453: expect (ObjNum 865 snap 250 seq_num 865) 2026-02-13T20:22:10.900 INFO:tasks.rados.rados.0.trial188.stdout:2454: rollback oid 34 current snap is 252 2026-02-13T20:22:10.900 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 34 to 218 2026-02-13T20:22:10.900 INFO:tasks.rados.rados.0.trial188.stdout:2455: write oid 29 current snap is 252 2026-02-13T20:22:10.900 INFO:tasks.rados.rados.0.trial188.stdout:2455: seq_num 867 ranges {571669=505125,1701300=743627} 2026-02-13T20:22:10.903 INFO:tasks.rados.rados.0.trial188.stdout:2455: writing trial18843701-29 from 571669 to 1076794 tid 1 2026-02-13T20:22:10.908 INFO:tasks.rados.rados.0.trial188.stdout:2455: writing trial18843701-29 from 1701300 to 2444927 tid 2 2026-02-13T20:22:10.908 INFO:tasks.rados.rados.0.trial188.stdout:2456: read oid 49 snap -1 2026-02-13T20:22:10.908 INFO:tasks.rados.rados.0.trial188.stdout:2456: expect deleted 2026-02-13T20:22:10.908 INFO:tasks.rados.rados.0.trial188.stdout:2457: snap_remove snap 242 2026-02-13T20:22:11.867 INFO:tasks.rados.rados.0.trial188.stdout:2457: done (9 left) 2026-02-13T20:22:11.868 INFO:tasks.rados.rados.0.trial188.stdout:2458: write (excl) oid 9 current snap is 252 2026-02-13T20:22:11.868 INFO:tasks.rados.rados.0.trial188.stdout:2458: seq_num 868 ranges {588476=580374,1643429=603638} 2026-02-13T20:22:11.872 INFO:tasks.rados.rados.0.trial188.stdout:2458: writing trial18843701-9 from 588476 to 1168850 tid 1 2026-02-13T20:22:11.877 INFO:tasks.rados.rados.0.trial188.stdout:2458: writing trial18843701-9 from 1643429 to 2247067 tid 2 2026-02-13T20:22:11.877 INFO:tasks.rados.rados.0.trial188.stdout:2459: copy_from oid 1 from oid 12 current snap is 252 2026-02-13T20:22:11.877 INFO:tasks.rados.rados.0.trial188.stdout:2448: expect (ObjNum 832 snap 247 seq_num 832) 2026-02-13T20:22:11.877 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:22:11.979 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 3266520 2026-02-13T20:22:11.986 INFO:tasks.rados.rados.0.trial188.stdout:2454: finishing rollback tid 1 to trial18843701-34 2026-02-13T20:22:11.987 INFO:tasks.rados.rados.0.trial188.stdout:2448: done (10 left) 2026-02-13T20:22:11.987 INFO:tasks.rados.rados.0.trial188.stdout:2451: done (9 left) 2026-02-13T20:22:11.987 INFO:tasks.rados.rados.0.trial188.stdout:2452: done (8 left) 2026-02-13T20:22:11.987 INFO:tasks.rados.rados.0.trial188.stdout:2460: write (excl) oid 13 current snap is 252 2026-02-13T20:22:11.987 INFO:tasks.rados.rados.0.trial188.stdout:2460: seq_num 869 ranges {605283=655623,1701911=747296} 2026-02-13T20:22:11.992 INFO:tasks.rados.rados.0.trial188.stdout:2460: writing trial18843701-13 from 605283 to 1260906 tid 1 2026-02-13T20:22:11.996 INFO:tasks.rados.rados.0.trial188.stdout:2460: writing trial18843701-13 from 1701911 to 2449207 tid 2 2026-02-13T20:22:11.996 INFO:tasks.rados.rados.0.trial188.stdout:2461: snap_remove snap 239 2026-02-13T20:22:12.891 INFO:tasks.rados.rados.0.trial188.stdout:2461: done (9 left) 2026-02-13T20:22:12.891 INFO:tasks.rados.rados.0.trial188.stdout:2462: snap_remove snap 248 2026-02-13T20:22:13.892 INFO:tasks.rados.rados.0.trial188.stdout:2462: done (9 left) 2026-02-13T20:22:13.892 INFO:tasks.rados.rados.0.trial188.stdout:2463: read oid 2 snap 241 2026-02-13T20:22:13.892 INFO:tasks.rados.rados.0.trial188.stdout:2463: expect (ObjNum 688 snap 199 seq_num 688) 2026-02-13T20:22:13.892 INFO:tasks.rados.rados.0.trial188.stdout:2464: read oid 47 snap -1 2026-02-13T20:22:13.892 INFO:tasks.rados.rados.0.trial188.stdout:2464: expect (ObjNum 712 snap 203 seq_num 712) 2026-02-13T20:22:13.892 INFO:tasks.rados.rados.0.trial188.stdout:2465: copy_from oid 31 from oid 25 current snap is 252 2026-02-13T20:22:13.892 INFO:tasks.rados.rados.0.trial188.stdout:2454: finishing rollback tid 2 to trial18843701-34 2026-02-13T20:22:13.892 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 34 v 1141 (ObjNum 724 snap 214 seq_num 724) dirty exists 2026-02-13T20:22:13.892 INFO:tasks.rados.rados.0.trial188.stdout:2453: expect (ObjNum 865 snap 250 seq_num 865) 2026-02-13T20:22:13.892 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:22:13.989 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:22:14.039 INFO:tasks.rados.rados.0.trial188.stdout:2450: expect (ObjNum 671 snap 185 seq_num 671) 2026-02-13T20:22:14.041 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1993749 2026-02-13T20:22:14.059 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1030894 2026-02-13T20:22:14.076 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:22:14.101 INFO:tasks.rados.rados.0.trial188.stdout:2450: done (11 left) 2026-02-13T20:22:14.102 INFO:tasks.rados.rados.0.trial188.stdout:2453: done (10 left) 2026-02-13T20:22:14.102 INFO:tasks.rados.rados.0.trial188.stdout:2454: done (9 left) 2026-02-13T20:22:14.102 INFO:tasks.rados.rados.0.trial188.stdout:2456: done (8 left) 2026-02-13T20:22:14.102 INFO:tasks.rados.rados.0.trial188.stdout:2466: snap_create 2026-02-13T20:22:14.102 INFO:tasks.rados.rados.0.trial188.stdout:2449: finishing write tid 1 to trial18843701-33 2026-02-13T20:22:14.102 INFO:tasks.rados.rados.0.trial188.stdout:2449: finishing write tid 2 to trial18843701-33 2026-02-13T20:22:14.102 INFO:tasks.rados.rados.0.trial188.stdout:2449: finishing write tid 3 to trial18843701-33 2026-02-13T20:22:14.102 INFO:tasks.rados.rados.0.trial188.stdout:2449: finishing write tid 4 to trial18843701-33 2026-02-13T20:22:14.102 INFO:tasks.rados.rados.0.trial188.stdout:2449: oid 33 updating version 0 to 738 2026-02-13T20:22:14.102 INFO:tasks.rados.rados.0.trial188.stdout:2449: oid 33 version 738 is already newer than 736 2026-02-13T20:22:14.103 INFO:tasks.rados.rados.0.trial188.stdout:2449: oid 33 version 738 is already newer than 737 2026-02-13T20:22:14.103 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 33 v 738 (ObjNum 866 snap 252 seq_num 866) dirty exists 2026-02-13T20:22:14.103 INFO:tasks.rados.rados.0.trial188.stdout:2449: left oid 33 (ObjNum 866 snap 252 seq_num 866) 2026-02-13T20:22:14.103 INFO:tasks.rados.rados.0.trial188.stdout:2455: finishing write tid 1 to trial18843701-29 2026-02-13T20:22:14.103 INFO:tasks.rados.rados.0.trial188.stdout:2455: finishing write tid 2 to trial18843701-29 2026-02-13T20:22:14.103 INFO:tasks.rados.rados.0.trial188.stdout:2455: finishing write tid 3 to trial18843701-29 2026-02-13T20:22:14.103 INFO:tasks.rados.rados.0.trial188.stdout:2455: finishing write tid 4 to trial18843701-29 2026-02-13T20:22:14.103 INFO:tasks.rados.rados.0.trial188.stdout:2455: oid 29 updating version 0 to 998 2026-02-13T20:22:14.103 INFO:tasks.rados.rados.0.trial188.stdout:2455: oid 29 version 998 is already newer than 996 2026-02-13T20:22:14.103 INFO:tasks.rados.rados.0.trial188.stdout:2455: oid 29 version 998 is already newer than 997 2026-02-13T20:22:14.103 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 29 v 998 (ObjNum 867 snap 252 seq_num 867) dirty exists 2026-02-13T20:22:14.103 INFO:tasks.rados.rados.0.trial188.stdout:2455: left oid 29 (ObjNum 867 snap 252 seq_num 867) 2026-02-13T20:22:14.104 INFO:tasks.rados.rados.0.trial188.stdout:2459: finishing copy_from to trial18843701-1 2026-02-13T20:22:14.104 INFO:tasks.rados.rados.0.trial188.stdout:2459: got expected ENOENT (src dne) 2026-02-13T20:22:14.104 INFO:tasks.rados.rados.0.trial188.stdout:2459: finishing copy_from racing read to trial18843701-1 2026-02-13T20:22:14.104 INFO:tasks.rados.rados.0.trial188.stdout:2458: finishing write tid 1 to trial18843701-9 2026-02-13T20:22:14.104 INFO:tasks.rados.rados.0.trial188.stdout:2458: finishing write tid 2 to trial18843701-9 2026-02-13T20:22:14.104 INFO:tasks.rados.rados.0.trial188.stdout:2458: finishing write tid 3 to trial18843701-9 2026-02-13T20:22:14.104 INFO:tasks.rados.rados.0.trial188.stdout:2458: finishing write tid 4 to trial18843701-9 2026-02-13T20:22:14.104 INFO:tasks.rados.rados.0.trial188.stdout:2458: oid 9 updating version 0 to 752 2026-02-13T20:22:14.104 INFO:tasks.rados.rados.0.trial188.stdout:2458: oid 9 updating version 752 to 753 2026-02-13T20:22:14.104 INFO:tasks.rados.rados.0.trial188.stdout:2458: oid 9 version 753 is already newer than 751 2026-02-13T20:22:14.104 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 9 v 753 (ObjNum 868 snap 252 seq_num 868) dirty exists 2026-02-13T20:22:14.104 INFO:tasks.rados.rados.0.trial188.stdout:2458: left oid 9 (ObjNum 868 snap 252 seq_num 868) 2026-02-13T20:22:14.105 INFO:tasks.rados.rados.0.trial188.stdout:2460: finishing write tid 1 to trial18843701-13 2026-02-13T20:22:14.105 INFO:tasks.rados.rados.0.trial188.stdout:2460: finishing write tid 2 to trial18843701-13 2026-02-13T20:22:14.105 INFO:tasks.rados.rados.0.trial188.stdout:2460: finishing write tid 3 to trial18843701-13 2026-02-13T20:22:14.105 INFO:tasks.rados.rados.0.trial188.stdout:2460: finishing write tid 4 to trial18843701-13 2026-02-13T20:22:14.105 INFO:tasks.rados.rados.0.trial188.stdout:2460: oid 13 updating version 0 to 1054 2026-02-13T20:22:14.105 INFO:tasks.rados.rados.0.trial188.stdout:2460: oid 13 updating version 1054 to 1055 2026-02-13T20:22:14.105 INFO:tasks.rados.rados.0.trial188.stdout:2460: oid 13 updating version 1055 to 1056 2026-02-13T20:22:14.105 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 13 v 1056 (ObjNum 869 snap 252 seq_num 869) dirty exists 2026-02-13T20:22:14.105 INFO:tasks.rados.rados.0.trial188.stdout:2460: left oid 13 (ObjNum 869 snap 252 seq_num 869) 2026-02-13T20:22:14.105 INFO:tasks.rados.rados.0.trial188.stdout:2464: expect (ObjNum 712 snap 203 seq_num 712) 2026-02-13T20:22:14.105 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 518907 2026-02-13T20:22:14.138 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:22:14.209 INFO:tasks.rados.rados.0.trial188.stdout:2463: expect (ObjNum 688 snap 199 seq_num 688) 2026-02-13T20:22:14.218 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1558025 2026-02-13T20:22:14.270 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:22:14.302 INFO:tasks.rados.rados.0.trial188.stdout:2465: finishing copy_from racing read to trial18843701-31 2026-02-13T20:22:14.303 INFO:tasks.rados.rados.0.trial188.stdout:2465: finishing copy_from to trial18843701-31 2026-02-13T20:22:14.303 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 31 v 961 (ObjNum 756 snap 223 seq_num 756) dirty exists 2026-02-13T20:22:14.897 INFO:tasks.rados.rados.0.trial188.stdout:2449: done (8 left) 2026-02-13T20:22:14.897 INFO:tasks.rados.rados.0.trial188.stdout:2455: done (7 left) 2026-02-13T20:22:14.897 INFO:tasks.rados.rados.0.trial188.stdout:2458: done (6 left) 2026-02-13T20:22:14.897 INFO:tasks.rados.rados.0.trial188.stdout:2459: done (5 left) 2026-02-13T20:22:14.898 INFO:tasks.rados.rados.0.trial188.stdout:2460: done (4 left) 2026-02-13T20:22:14.898 INFO:tasks.rados.rados.0.trial188.stdout:2463: done (3 left) 2026-02-13T20:22:14.898 INFO:tasks.rados.rados.0.trial188.stdout:2464: done (2 left) 2026-02-13T20:22:14.898 INFO:tasks.rados.rados.0.trial188.stdout:2465: done (1 left) 2026-02-13T20:22:14.898 INFO:tasks.rados.rados.0.trial188.stdout:2466: done (0 left) 2026-02-13T20:22:14.898 INFO:tasks.rados.rados.0.trial188.stdout:2467: copy_from oid 2 from oid 30 current snap is 253 2026-02-13T20:22:14.898 INFO:tasks.rados.rados.0.trial188.stdout:2468: rollback oid 42 current snap is 253 2026-02-13T20:22:14.898 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 42 to 228 2026-02-13T20:22:14.898 INFO:tasks.rados.rados.0.trial188.stdout:2469: read oid 5 snap -1 2026-02-13T20:22:14.898 INFO:tasks.rados.rados.0.trial188.stdout:2469: expect deleted 2026-02-13T20:22:14.898 INFO:tasks.rados.rados.0.trial188.stdout:2470: write (excl) oid 21 current snap is 253 2026-02-13T20:22:14.898 INFO:tasks.rados.rados.0.trial188.stdout:2470: seq_num 870 ranges {622090=730872,1760393=607307} 2026-02-13T20:22:14.903 INFO:tasks.rados.rados.0.trial188.stdout:2470: writing trial18843701-21 from 622090 to 1352962 tid 1 2026-02-13T20:22:14.907 INFO:tasks.rados.rados.0.trial188.stdout:2470: writing trial18843701-21 from 1760393 to 2367700 tid 2 2026-02-13T20:22:14.907 INFO:tasks.rados.rados.0.trial188.stdout:2471: copy_from oid 50 from oid 34 current snap is 253 2026-02-13T20:22:14.907 INFO:tasks.rados.rados.0.trial188.stdout:2467: finishing copy_from to trial18843701-2 2026-02-13T20:22:14.907 INFO:tasks.rados.rados.0.trial188.stdout:2467: got expected ENOENT (src dne) 2026-02-13T20:22:14.907 INFO:tasks.rados.rados.0.trial188.stdout:2467: finishing copy_from racing read to trial18843701-2 2026-02-13T20:22:14.907 INFO:tasks.rados.rados.0.trial188.stdout:2468: finishing rollback tid 0 to trial18843701-42 2026-02-13T20:22:14.907 INFO:tasks.rados.rados.0.trial188.stdout:2468: finishing rollback tid 1 to trial18843701-42 2026-02-13T20:22:14.907 INFO:tasks.rados.rados.0.trial188.stdout:2468: finishing rollback tid 2 to trial18843701-42 2026-02-13T20:22:14.907 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 42 v 756 (ObjNum 751 snap 222 seq_num 751) dirty exists 2026-02-13T20:22:14.907 INFO:tasks.rados.rados.0.trial188.stdout:2467: done (4 left) 2026-02-13T20:22:14.907 INFO:tasks.rados.rados.0.trial188.stdout:2468: done (3 left) 2026-02-13T20:22:14.907 INFO:tasks.rados.rados.0.trial188.stdout:2469: done (2 left) 2026-02-13T20:22:14.907 INFO:tasks.rados.rados.0.trial188.stdout:2472: write oid 17 current snap is 253 2026-02-13T20:22:14.908 INFO:tasks.rados.rados.0.trial188.stdout:2472: seq_num 871 ranges {638897=406121,1818875=750965} 2026-02-13T20:22:14.911 INFO:tasks.rados.rados.0.trial188.stdout:2472: writing trial18843701-17 from 638897 to 1045018 tid 1 2026-02-13T20:22:14.917 INFO:tasks.rados.rados.0.trial188.stdout:2472: writing trial18843701-17 from 1818875 to 2569840 tid 2 2026-02-13T20:22:14.917 INFO:tasks.rados.rados.0.trial188.stdout:2473: snap_create 2026-02-13T20:22:14.928 INFO:tasks.rados.rados.0.trial188.stdout:2471: finishing copy_from racing read to trial18843701-50 2026-02-13T20:22:14.931 INFO:tasks.rados.rados.0.trial188.stdout:2470: finishing write tid 1 to trial18843701-21 2026-02-13T20:22:14.940 INFO:tasks.rados.rados.0.trial188.stdout:2471: finishing copy_from to trial18843701-50 2026-02-13T20:22:14.940 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 50 v 1141 (ObjNum 724 snap 214 seq_num 724) dirty exists 2026-02-13T20:22:14.941 INFO:tasks.rados.rados.0.trial188.stdout:2470: finishing write tid 2 to trial18843701-21 2026-02-13T20:22:14.942 INFO:tasks.rados.rados.0.trial188.stdout:2470: finishing write tid 3 to trial18843701-21 2026-02-13T20:22:14.942 INFO:tasks.rados.rados.0.trial188.stdout:2472: finishing write tid 1 to trial18843701-17 2026-02-13T20:22:14.942 INFO:tasks.rados.rados.0.trial188.stdout:2472: finishing write tid 2 to trial18843701-17 2026-02-13T20:22:14.942 INFO:tasks.rados.rados.0.trial188.stdout:2470: finishing write tid 4 to trial18843701-21 2026-02-13T20:22:14.942 INFO:tasks.rados.rados.0.trial188.stdout:2470: oid 21 updating version 0 to 531 2026-02-13T20:22:14.942 INFO:tasks.rados.rados.0.trial188.stdout:2470: oid 21 updating version 531 to 532 2026-02-13T20:22:14.942 INFO:tasks.rados.rados.0.trial188.stdout:2470: oid 21 version 532 is already newer than 530 2026-02-13T20:22:14.943 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 21 v 532 (ObjNum 870 snap 253 seq_num 870) dirty exists 2026-02-13T20:22:14.943 INFO:tasks.rados.rados.0.trial188.stdout:2470: left oid 21 (ObjNum 870 snap 253 seq_num 870) 2026-02-13T20:22:14.943 INFO:tasks.rados.rados.0.trial188.stdout:2472: finishing write tid 3 to trial18843701-17 2026-02-13T20:22:14.943 INFO:tasks.rados.rados.0.trial188.stdout:2472: finishing write tid 4 to trial18843701-17 2026-02-13T20:22:14.943 INFO:tasks.rados.rados.0.trial188.stdout:2472: oid 17 updating version 0 to 1053 2026-02-13T20:22:14.943 INFO:tasks.rados.rados.0.trial188.stdout:2472: oid 17 updating version 1053 to 1054 2026-02-13T20:22:14.943 INFO:tasks.rados.rados.0.trial188.stdout:2472: oid 17 updating version 1054 to 1055 2026-02-13T20:22:14.943 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 17 v 1055 (ObjNum 871 snap 253 seq_num 871) dirty exists 2026-02-13T20:22:14.943 INFO:tasks.rados.rados.0.trial188.stdout:2472: left oid 17 (ObjNum 871 snap 253 seq_num 871) 2026-02-13T20:22:15.902 INFO:tasks.rados.rados.0.trial188.stdout:2470: done (3 left) 2026-02-13T20:22:15.902 INFO:tasks.rados.rados.0.trial188.stdout:2471: done (2 left) 2026-02-13T20:22:15.902 INFO:tasks.rados.rados.0.trial188.stdout:2472: done (1 left) 2026-02-13T20:22:15.903 INFO:tasks.rados.rados.0.trial188.stdout:2473: done (0 left) 2026-02-13T20:22:15.903 INFO:tasks.rados.rados.0.trial188.stdout:2474: read oid 49 snap -1 2026-02-13T20:22:15.903 INFO:tasks.rados.rados.0.trial188.stdout:2474: expect deleted 2026-02-13T20:22:15.903 INFO:tasks.rados.rados.0.trial188.stdout:2475: copy_from oid 34 from oid 40 current snap is 254 2026-02-13T20:22:15.903 INFO:tasks.rados.rados.0.trial188.stdout:2476: snap_create 2026-02-13T20:22:15.929 INFO:tasks.rados.rados.0.trial188.stdout:2475: finishing copy_from racing read to trial18843701-34 2026-02-13T20:22:15.931 INFO:tasks.rados.rados.0.trial188.stdout:2475: finishing copy_from to trial18843701-34 2026-02-13T20:22:15.931 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 34 v 732 (ObjNum 845 snap 248 seq_num 845) dirty exists 2026-02-13T20:22:16.868 INFO:tasks.rados.rados.0.trial188.stdout:2474: done (2 left) 2026-02-13T20:22:16.868 INFO:tasks.rados.rados.0.trial188.stdout:2475: done (1 left) 2026-02-13T20:22:16.868 INFO:tasks.rados.rados.0.trial188.stdout:2476: done (0 left) 2026-02-13T20:22:16.868 INFO:tasks.rados.rados.0.trial188.stdout:2477: read oid 39 snap -1 2026-02-13T20:22:16.868 INFO:tasks.rados.rados.0.trial188.stdout:2477: expect deleted 2026-02-13T20:22:16.868 INFO:tasks.rados.rados.0.trial188.stdout:2478: write (excl) oid 46 current snap is 255 2026-02-13T20:22:16.868 INFO:tasks.rados.rados.0.trial188.stdout:2478: seq_num 872 ranges {655704=481370,1761004=494623} 2026-02-13T20:22:16.871 INFO:tasks.rados.rados.0.trial188.stdout:2478: writing trial18843701-46 from 655704 to 1137074 tid 1 2026-02-13T20:22:16.876 INFO:tasks.rados.rados.0.trial188.stdout:2478: writing trial18843701-46 from 1761004 to 2255627 tid 2 2026-02-13T20:22:16.876 INFO:tasks.rados.rados.0.trial188.stdout:2479: snap_remove snap 218 2026-02-13T20:22:17.870 INFO:tasks.rados.rados.0.trial188.stdout:2479: done (2 left) 2026-02-13T20:22:17.871 INFO:tasks.rados.rados.0.trial188.stdout:2480: copy_from oid 42 from oid 3 current snap is 255 2026-02-13T20:22:17.871 INFO:tasks.rados.rados.0.trial188.stdout:2478: finishing write tid 1 to trial18843701-46 2026-02-13T20:22:17.871 INFO:tasks.rados.rados.0.trial188.stdout:2478: finishing write tid 2 to trial18843701-46 2026-02-13T20:22:17.871 INFO:tasks.rados.rados.0.trial188.stdout:2478: finishing write tid 3 to trial18843701-46 2026-02-13T20:22:17.871 INFO:tasks.rados.rados.0.trial188.stdout:2478: finishing write tid 4 to trial18843701-46 2026-02-13T20:22:17.871 INFO:tasks.rados.rados.0.trial188.stdout:2478: oid 46 updating version 0 to 969 2026-02-13T20:22:17.871 INFO:tasks.rados.rados.0.trial188.stdout:2478: oid 46 updating version 969 to 971 2026-02-13T20:22:17.871 INFO:tasks.rados.rados.0.trial188.stdout:2478: oid 46 version 971 is already newer than 970 2026-02-13T20:22:17.872 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 46 v 971 (ObjNum 872 snap 255 seq_num 872) dirty exists 2026-02-13T20:22:17.872 INFO:tasks.rados.rados.0.trial188.stdout:2478: left oid 46 (ObjNum 872 snap 255 seq_num 872) 2026-02-13T20:22:17.872 INFO:tasks.rados.rados.0.trial188.stdout:2477: done (2 left) 2026-02-13T20:22:17.872 INFO:tasks.rados.rados.0.trial188.stdout:2478: done (1 left) 2026-02-13T20:22:17.872 INFO:tasks.rados.rados.0.trial188.stdout:2481: read oid 6 snap -1 2026-02-13T20:22:17.872 INFO:tasks.rados.rados.0.trial188.stdout:2481: expect (ObjNum 854 snap 250 seq_num 854) 2026-02-13T20:22:17.872 INFO:tasks.rados.rados.0.trial188.stdout:2482: copy_from oid 44 from oid 5 current snap is 255 2026-02-13T20:22:17.872 INFO:tasks.rados.rados.0.trial188.stdout:2483: copy_from oid 47 from oid 29 current snap is 255 2026-02-13T20:22:17.872 INFO:tasks.rados.rados.0.trial188.stdout:2484: snap_remove snap 254 2026-02-13T20:22:18.871 INFO:tasks.rados.rados.0.trial188.stdout:2484: done (4 left) 2026-02-13T20:22:18.871 INFO:tasks.rados.rados.0.trial188.stdout:2485: copy_from oid 20 from oid 7 current snap is 255 2026-02-13T20:22:18.871 INFO:tasks.rados.rados.0.trial188.stdout:2482: finishing copy_from to trial18843701-44 2026-02-13T20:22:18.871 INFO:tasks.rados.rados.0.trial188.stdout:2482: got expected ENOENT (src dne) 2026-02-13T20:22:18.871 INFO:tasks.rados.rados.0.trial188.stdout:2482: finishing copy_from racing read to trial18843701-44 2026-02-13T20:22:18.871 INFO:tasks.rados.rados.0.trial188.stdout:2480: finishing copy_from to trial18843701-42 2026-02-13T20:22:18.872 INFO:tasks.rados.rados.0.trial188.stdout:2480: got expected ENOENT (src dne) 2026-02-13T20:22:18.872 INFO:tasks.rados.rados.0.trial188.stdout:2481: expect (ObjNum 854 snap 250 seq_num 854) 2026-02-13T20:22:18.930 INFO:tasks.rados.rados.0.trial188.stdout:2480: finishing copy_from racing read to trial18843701-42 2026-02-13T20:22:18.930 INFO:tasks.rados.rados.0.trial188.stdout:2483: finishing copy_from racing read to trial18843701-47 2026-02-13T20:22:18.930 INFO:tasks.rados.rados.0.trial188.stdout:2483: finishing copy_from to trial18843701-47 2026-02-13T20:22:18.931 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 47 v 998 (ObjNum 867 snap 252 seq_num 867) dirty exists 2026-02-13T20:22:18.931 INFO:tasks.rados.rados.0.trial188.stdout:2485: finishing copy_from racing read to trial18843701-20 2026-02-13T20:22:18.931 INFO:tasks.rados.rados.0.trial188.stdout:2485: finishing copy_from to trial18843701-20 2026-02-13T20:22:18.931 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 20 v 955 (ObjNum 833 snap 247 seq_num 833) dirty exists 2026-02-13T20:22:18.931 INFO:tasks.rados.rados.0.trial188.stdout:2480: done (4 left) 2026-02-13T20:22:18.931 INFO:tasks.rados.rados.0.trial188.stdout:2481: done (3 left) 2026-02-13T20:22:18.931 INFO:tasks.rados.rados.0.trial188.stdout:2482: done (2 left) 2026-02-13T20:22:18.931 INFO:tasks.rados.rados.0.trial188.stdout:2483: done (1 left) 2026-02-13T20:22:18.931 INFO:tasks.rados.rados.0.trial188.stdout:2485: done (0 left) 2026-02-13T20:22:18.931 INFO:tasks.rados.rados.0.trial188.stdout:2486: write (excl) oid 1 current snap is 255 2026-02-13T20:22:18.931 INFO:tasks.rados.rados.0.trial188.stdout:2486: seq_num 873 ranges {672511=556619,1819486=754634} 2026-02-13T20:22:18.934 INFO:tasks.rados.rados.0.trial188.stdout:2486: writing trial18843701-1 from 672511 to 1229130 tid 1 2026-02-13T20:22:18.940 INFO:tasks.rados.rados.0.trial188.stdout:2486: writing trial18843701-1 from 1819486 to 2574120 tid 2 2026-02-13T20:22:18.940 INFO:tasks.rados.rados.0.trial188.stdout:2487: snap_create 2026-02-13T20:22:18.953 INFO:tasks.rados.rados.0.trial188.stdout:2486: finishing write tid 1 to trial18843701-1 2026-02-13T20:22:18.954 INFO:tasks.rados.rados.0.trial188.stdout:2486: finishing write tid 2 to trial18843701-1 2026-02-13T20:22:18.955 INFO:tasks.rados.rados.0.trial188.stdout:2486: finishing write tid 3 to trial18843701-1 2026-02-13T20:22:18.955 INFO:tasks.rados.rados.0.trial188.stdout:2486: finishing write tid 4 to trial18843701-1 2026-02-13T20:22:18.955 INFO:tasks.rados.rados.0.trial188.stdout:2486: oid 1 updating version 0 to 1074 2026-02-13T20:22:18.955 INFO:tasks.rados.rados.0.trial188.stdout:2486: oid 1 version 1074 is already newer than 1073 2026-02-13T20:22:18.955 INFO:tasks.rados.rados.0.trial188.stdout:2486: oid 1 updating version 1074 to 1075 2026-02-13T20:22:18.955 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 1 v 1075 (ObjNum 873 snap 255 seq_num 873) dirty exists 2026-02-13T20:22:18.955 INFO:tasks.rados.rados.0.trial188.stdout:2486: left oid 1 (ObjNum 873 snap 255 seq_num 873) 2026-02-13T20:22:19.905 INFO:tasks.rados.rados.0.trial188.stdout:2486: done (1 left) 2026-02-13T20:22:19.905 INFO:tasks.rados.rados.0.trial188.stdout:2487: done (0 left) 2026-02-13T20:22:19.905 INFO:tasks.rados.rados.0.trial188.stdout:2488: snap_create 2026-02-13T20:22:20.906 INFO:tasks.rados.rados.0.trial188.stdout:2488: done (0 left) 2026-02-13T20:22:20.906 INFO:tasks.rados.rados.0.trial188.stdout:2489: snap_remove snap 250 2026-02-13T20:22:21.868 INFO:tasks.rados.rados.0.trial188.stdout:2489: done (0 left) 2026-02-13T20:22:21.868 INFO:tasks.rados.rados.0.trial188.stdout:2490: copy_from oid 26 from oid 32 current snap is 257 2026-02-13T20:22:21.868 INFO:tasks.rados.rados.0.trial188.stdout:2491: snap_remove snap 214 2026-02-13T20:22:22.868 INFO:tasks.rados.rados.0.trial188.stdout:2491: done (1 left) 2026-02-13T20:22:22.868 INFO:tasks.rados.rados.0.trial188.stdout:2492: read oid 8 snap 244 2026-02-13T20:22:22.868 INFO:tasks.rados.rados.0.trial188.stdout:2492: expect (ObjNum 688 snap 199 seq_num 688) 2026-02-13T20:22:22.868 INFO:tasks.rados.rados.0.trial188.stdout:2493: snap_create 2026-02-13T20:22:22.868 INFO:tasks.rados.rados.0.trial188.stdout:2490: finishing copy_from racing read to trial18843701-26 2026-02-13T20:22:22.868 INFO:tasks.rados.rados.0.trial188.stdout:2490: finishing copy_from to trial18843701-26 2026-02-13T20:22:22.868 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 26 v 958 (ObjNum 739 snap 220 seq_num 739) dirty exists 2026-02-13T20:22:22.882 INFO:tasks.rados.rados.0.trial188.stdout:2492: expect (ObjNum 688 snap 199 seq_num 688) 2026-02-13T20:22:22.882 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:22:22.960 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2919585 2026-02-13T20:22:23.869 INFO:tasks.rados.rados.0.trial188.stdout:2490: done (2 left) 2026-02-13T20:22:23.869 INFO:tasks.rados.rados.0.trial188.stdout:2492: done (1 left) 2026-02-13T20:22:23.869 INFO:tasks.rados.rados.0.trial188.stdout:2493: done (0 left) 2026-02-13T20:22:23.869 INFO:tasks.rados.rados.0.trial188.stdout:2494: delete oid 13 current snap is 258 2026-02-13T20:22:23.870 INFO:tasks.rados.rados.0.trial188.stdout:2494: done (0 left) 2026-02-13T20:22:23.871 INFO:tasks.rados.rados.0.trial188.stdout:2495: write oid 19 current snap is 258 2026-02-13T20:22:23.871 INFO:tasks.rados.rados.0.trial188.stdout:2495: seq_num 875 ranges {706125=423470,1652803=758303} 2026-02-13T20:22:23.874 INFO:tasks.rados.rados.0.trial188.stdout:2495: writing trial18843701-19 from 706125 to 1129595 tid 1 2026-02-13T20:22:23.879 INFO:tasks.rados.rados.0.trial188.stdout:2495: writing trial18843701-19 from 1652803 to 2411106 tid 2 2026-02-13T20:22:23.879 INFO:tasks.rados.rados.0.trial188.stdout:2496: snap_create 2026-02-13T20:22:23.893 INFO:tasks.rados.rados.0.trial188.stdout:2495: finishing write tid 1 to trial18843701-19 2026-02-13T20:22:23.893 INFO:tasks.rados.rados.0.trial188.stdout:2495: finishing write tid 2 to trial18843701-19 2026-02-13T20:22:23.893 INFO:tasks.rados.rados.0.trial188.stdout:2495: finishing write tid 3 to trial18843701-19 2026-02-13T20:22:23.894 INFO:tasks.rados.rados.0.trial188.stdout:2495: finishing write tid 4 to trial18843701-19 2026-02-13T20:22:23.894 INFO:tasks.rados.rados.0.trial188.stdout:2495: oid 19 updating version 0 to 1031 2026-02-13T20:22:23.894 INFO:tasks.rados.rados.0.trial188.stdout:2495: oid 19 updating version 1031 to 1032 2026-02-13T20:22:23.894 INFO:tasks.rados.rados.0.trial188.stdout:2495: oid 19 version 1032 is already newer than 1030 2026-02-13T20:22:23.894 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 19 v 1032 (ObjNum 875 snap 258 seq_num 875) dirty exists 2026-02-13T20:22:23.894 INFO:tasks.rados.rados.0.trial188.stdout:2495: left oid 19 (ObjNum 875 snap 258 seq_num 875) 2026-02-13T20:22:24.872 INFO:tasks.rados.rados.0.trial188.stdout:2495: done (1 left) 2026-02-13T20:22:24.872 INFO:tasks.rados.rados.0.trial188.stdout:2496: done (0 left) 2026-02-13T20:22:24.872 INFO:tasks.rados.rados.0.trial188.stdout:2497: read oid 48 snap -1 2026-02-13T20:22:24.872 INFO:tasks.rados.rados.0.trial188.stdout:2497: expect (ObjNum 820 snap 241 seq_num 820) 2026-02-13T20:22:24.872 INFO:tasks.rados.rados.0.trial188.stdout:2498: snap_create 2026-02-13T20:22:24.881 INFO:tasks.rados.rados.0.trial188.stdout:2497: expect (ObjNum 820 snap 241 seq_num 820) 2026-02-13T20:22:24.927 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2463979 2026-02-13T20:22:24.942 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:22:25.873 INFO:tasks.rados.rados.0.trial188.stdout:2497: done (1 left) 2026-02-13T20:22:25.873 INFO:tasks.rados.rados.0.trial188.stdout:2498: done (0 left) 2026-02-13T20:22:25.874 INFO:tasks.rados.rados.0.trial188.stdout:2499: snap_create 2026-02-13T20:22:26.868 INFO:tasks.rados.rados.0.trial188.stdout:2499: done (0 left) 2026-02-13T20:22:26.869 INFO:tasks.rados.rados.0.trial188.stdout:2500: snap_create 2026-02-13T20:22:27.871 INFO:tasks.rados.rados.0.trial188.stdout:2500: done (0 left) 2026-02-13T20:22:27.872 INFO:tasks.rados.rados.0.trial188.stdout:2501: rollback oid 42 current snap is 262 2026-02-13T20:22:27.872 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 42 to 258 2026-02-13T20:22:27.872 INFO:tasks.rados.rados.0.trial188.stdout:2502: read oid 39 snap -1 2026-02-13T20:22:27.872 INFO:tasks.rados.rados.0.trial188.stdout:2502: expect deleted 2026-02-13T20:22:27.872 INFO:tasks.rados.rados.0.trial188.stdout:2503: snap_remove snap 232 2026-02-13T20:22:28.872 INFO:tasks.rados.rados.0.trial188.stdout:2503: done (2 left) 2026-02-13T20:22:28.872 INFO:tasks.rados.rados.0.trial188.stdout:2504: read oid 25 snap -1 2026-02-13T20:22:28.872 INFO:tasks.rados.rados.0.trial188.stdout:2504: expect (ObjNum 756 snap 223 seq_num 756) 2026-02-13T20:22:28.872 INFO:tasks.rados.rados.0.trial188.stdout:2505: read oid 3 snap 249 2026-02-13T20:22:28.872 INFO:tasks.rados.rados.0.trial188.stdout:2505: expect (ObjNum 782 snap 232 seq_num 782) 2026-02-13T20:22:28.872 INFO:tasks.rados.rados.0.trial188.stdout:2506: read oid 33 snap -1 2026-02-13T20:22:28.872 INFO:tasks.rados.rados.0.trial188.stdout:2506: expect (ObjNum 866 snap 252 seq_num 866) 2026-02-13T20:22:28.873 INFO:tasks.rados.rados.0.trial188.stdout:2507: write (excl) oid 18 current snap is 262 2026-02-13T20:22:28.873 INFO:tasks.rados.rados.0.trial188.stdout:2507: seq_num 876 ranges {722932=498719,1994932=501961} 2026-02-13T20:22:28.877 INFO:tasks.rados.rados.0.trial188.stdout:2507: writing trial18843701-18 from 722932 to 1221651 tid 1 2026-02-13T20:22:28.882 INFO:tasks.rados.rados.0.trial188.stdout:2507: writing trial18843701-18 from 1994932 to 2496893 tid 2 2026-02-13T20:22:28.882 INFO:tasks.rados.rados.0.trial188.stdout:2508: read oid 7 snap 258 2026-02-13T20:22:28.882 INFO:tasks.rados.rados.0.trial188.stdout:2508: expect (ObjNum 833 snap 247 seq_num 833) 2026-02-13T20:22:28.882 INFO:tasks.rados.rados.0.trial188.stdout:2509: snap_remove snap 234 2026-02-13T20:22:29.881 INFO:tasks.rados.rados.0.trial188.stdout:2509: done (7 left) 2026-02-13T20:22:29.881 INFO:tasks.rados.rados.0.trial188.stdout:2510: write (excl) oid 37 current snap is 262 2026-02-13T20:22:29.881 INFO:tasks.rados.rados.0.trial188.stdout:2501: finishing rollback tid 0 to trial18843701-42 2026-02-13T20:22:29.881 INFO:tasks.rados.rados.0.trial188.stdout:2501: finishing rollback tid 1 to trial18843701-42 2026-02-13T20:22:29.881 INFO:tasks.rados.rados.0.trial188.stdout:2510: seq_num 877 ranges {739739=573968,2053414=686325} 2026-02-13T20:22:29.886 INFO:tasks.rados.rados.0.trial188.stdout:2510: writing trial18843701-37 from 739739 to 1313707 tid 1 2026-02-13T20:22:29.892 INFO:tasks.rados.rados.0.trial188.stdout:2510: writing trial18843701-37 from 2053414 to 2739739 tid 2 2026-02-13T20:22:29.893 INFO:tasks.rados.rados.0.trial188.stdout:2502: done (7 left) 2026-02-13T20:22:29.893 INFO:tasks.rados.rados.0.trial188.stdout:2511: snap_create 2026-02-13T20:22:29.893 INFO:tasks.rados.rados.0.trial188.stdout:2501: finishing rollback tid 2 to trial18843701-42 2026-02-13T20:22:29.893 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 42 v 759 (ObjNum 751 snap 222 seq_num 751) dirty exists 2026-02-13T20:22:29.893 INFO:tasks.rados.rados.0.trial188.stdout:2506: expect (ObjNum 866 snap 252 seq_num 866) 2026-02-13T20:22:30.020 INFO:tasks.rados.rados.0.trial188.stdout:2504: expect (ObjNum 756 snap 223 seq_num 756) 2026-02-13T20:22:30.066 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1670947 2026-02-13T20:22:30.081 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 370801 2026-02-13T20:22:30.112 INFO:tasks.rados.rados.0.trial188.stdout:2505: expect (ObjNum 782 snap 232 seq_num 782) 2026-02-13T20:22:30.117 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1406144 2026-02-13T20:22:30.129 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:22:30.174 INFO:tasks.rados.rados.0.trial188.stdout:2507: finishing write tid 1 to trial18843701-18 2026-02-13T20:22:30.174 INFO:tasks.rados.rados.0.trial188.stdout:2507: finishing write tid 2 to trial18843701-18 2026-02-13T20:22:30.174 INFO:tasks.rados.rados.0.trial188.stdout:2507: finishing write tid 3 to trial18843701-18 2026-02-13T20:22:30.174 INFO:tasks.rados.rados.0.trial188.stdout:2507: finishing write tid 4 to trial18843701-18 2026-02-13T20:22:30.174 INFO:tasks.rados.rados.0.trial188.stdout:2507: oid 18 updating version 0 to 1058 2026-02-13T20:22:30.174 INFO:tasks.rados.rados.0.trial188.stdout:2507: oid 18 version 1058 is already newer than 1056 2026-02-13T20:22:30.174 INFO:tasks.rados.rados.0.trial188.stdout:2507: oid 18 version 1058 is already newer than 1057 2026-02-13T20:22:30.175 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 18 v 1058 (ObjNum 876 snap 262 seq_num 876) dirty exists 2026-02-13T20:22:30.175 INFO:tasks.rados.rados.0.trial188.stdout:2507: left oid 18 (ObjNum 876 snap 262 seq_num 876) 2026-02-13T20:22:30.175 INFO:tasks.rados.rados.0.trial188.stdout:2508: expect (ObjNum 833 snap 247 seq_num 833) 2026-02-13T20:22:30.175 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:22:30.279 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1156080 2026-02-13T20:22:30.314 INFO:tasks.rados.rados.0.trial188.stdout:2510: finishing write tid 1 to trial18843701-37 2026-02-13T20:22:30.314 INFO:tasks.rados.rados.0.trial188.stdout:2510: finishing write tid 2 to trial18843701-37 2026-02-13T20:22:30.315 INFO:tasks.rados.rados.0.trial188.stdout:2510: finishing write tid 3 to trial18843701-37 2026-02-13T20:22:30.315 INFO:tasks.rados.rados.0.trial188.stdout:2510: finishing write tid 4 to trial18843701-37 2026-02-13T20:22:30.315 INFO:tasks.rados.rados.0.trial188.stdout:2510: oid 37 updating version 0 to 1188 2026-02-13T20:22:30.315 INFO:tasks.rados.rados.0.trial188.stdout:2510: oid 37 updating version 1188 to 1190 2026-02-13T20:22:30.315 INFO:tasks.rados.rados.0.trial188.stdout:2510: oid 37 version 1190 is already newer than 1189 2026-02-13T20:22:30.315 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 37 v 1190 (ObjNum 877 snap 262 seq_num 877) dirty exists 2026-02-13T20:22:30.315 INFO:tasks.rados.rados.0.trial188.stdout:2510: left oid 37 (ObjNum 877 snap 262 seq_num 877) 2026-02-13T20:22:30.885 INFO:tasks.rados.rados.0.trial188.stdout:2501: done (7 left) 2026-02-13T20:22:30.886 INFO:tasks.rados.rados.0.trial188.stdout:2504: done (6 left) 2026-02-13T20:22:30.886 INFO:tasks.rados.rados.0.trial188.stdout:2505: done (5 left) 2026-02-13T20:22:30.886 INFO:tasks.rados.rados.0.trial188.stdout:2506: done (4 left) 2026-02-13T20:22:30.886 INFO:tasks.rados.rados.0.trial188.stdout:2507: done (3 left) 2026-02-13T20:22:30.886 INFO:tasks.rados.rados.0.trial188.stdout:2508: done (2 left) 2026-02-13T20:22:30.886 INFO:tasks.rados.rados.0.trial188.stdout:2510: done (1 left) 2026-02-13T20:22:30.886 INFO:tasks.rados.rados.0.trial188.stdout:2511: done (0 left) 2026-02-13T20:22:30.886 INFO:tasks.rados.rados.0.trial188.stdout:2512: snap_remove snap 253 2026-02-13T20:22:31.869 INFO:tasks.rados.rados.0.trial188.stdout:2512: done (0 left) 2026-02-13T20:22:31.869 INFO:tasks.rados.rados.0.trial188.stdout:2513: write oid 8 current snap is 263 2026-02-13T20:22:31.869 INFO:tasks.rados.rados.0.trial188.stdout:2513: seq_num 878 ranges {756546=649217,2111896=505630} 2026-02-13T20:22:31.874 INFO:tasks.rados.rados.0.trial188.stdout:2513: writing trial18843701-8 from 756546 to 1405763 tid 1 2026-02-13T20:22:31.879 INFO:tasks.rados.rados.0.trial188.stdout:2513: writing trial18843701-8 from 2111896 to 2617526 tid 2 2026-02-13T20:22:31.879 INFO:tasks.rados.rados.0.trial188.stdout:2514: snap_remove snap 261 2026-02-13T20:22:32.871 INFO:tasks.rados.rados.0.trial188.stdout:2514: done (1 left) 2026-02-13T20:22:32.871 INFO:tasks.rados.rados.0.trial188.stdout:2515: copy_from oid 26 from oid 48 current snap is 263 2026-02-13T20:22:32.871 INFO:tasks.rados.rados.0.trial188.stdout:2513: finishing write tid 1 to trial18843701-8 2026-02-13T20:22:32.871 INFO:tasks.rados.rados.0.trial188.stdout:2513: finishing write tid 2 to trial18843701-8 2026-02-13T20:22:32.871 INFO:tasks.rados.rados.0.trial188.stdout:2513: finishing write tid 3 to trial18843701-8 2026-02-13T20:22:32.872 INFO:tasks.rados.rados.0.trial188.stdout:2513: finishing write tid 4 to trial18843701-8 2026-02-13T20:22:32.872 INFO:tasks.rados.rados.0.trial188.stdout:2513: oid 8 updating version 0 to 1199 2026-02-13T20:22:32.872 INFO:tasks.rados.rados.0.trial188.stdout:2513: oid 8 version 1199 is already newer than 1198 2026-02-13T20:22:32.872 INFO:tasks.rados.rados.0.trial188.stdout:2513: oid 8 version 1199 is already newer than 1193 2026-02-13T20:22:32.872 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 8 v 1199 (ObjNum 878 snap 263 seq_num 878) dirty exists 2026-02-13T20:22:32.872 INFO:tasks.rados.rados.0.trial188.stdout:2513: left oid 8 (ObjNum 878 snap 263 seq_num 878) 2026-02-13T20:22:32.872 INFO:tasks.rados.rados.0.trial188.stdout:2513: done (1 left) 2026-02-13T20:22:32.872 INFO:tasks.rados.rados.0.trial188.stdout:2516: rollback oid 9 current snap is 263 2026-02-13T20:22:32.872 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 9 to 255 2026-02-13T20:22:32.873 INFO:tasks.rados.rados.0.trial188.stdout:2517: rollback oid 27 current snap is 263 2026-02-13T20:22:32.873 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 27 to 252 2026-02-13T20:22:32.873 INFO:tasks.rados.rados.0.trial188.stdout:2518: rollback oid 34 current snap is 263 2026-02-13T20:22:32.873 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 34 to 260 2026-02-13T20:22:32.873 INFO:tasks.rados.rados.0.trial188.stdout:2519: snap_create 2026-02-13T20:22:32.873 INFO:tasks.rados.rados.0.trial188.stdout:2516: finishing rollback tid 0 to trial18843701-9 2026-02-13T20:22:32.876 INFO:tasks.rados.rados.0.trial188.stdout:2516: finishing rollback tid 1 to trial18843701-9 2026-02-13T20:22:32.876 INFO:tasks.rados.rados.0.trial188.stdout:2518: finishing rollback tid 0 to trial18843701-34 2026-02-13T20:22:32.876 INFO:tasks.rados.rados.0.trial188.stdout:2518: finishing rollback tid 1 to trial18843701-34 2026-02-13T20:22:32.876 INFO:tasks.rados.rados.0.trial188.stdout:2518: finishing rollback tid 2 to trial18843701-34 2026-02-13T20:22:32.876 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 34 v 1203 (ObjNum 845 snap 248 seq_num 845) dirty exists 2026-02-13T20:22:32.876 INFO:tasks.rados.rados.0.trial188.stdout:2516: finishing rollback tid 2 to trial18843701-9 2026-02-13T20:22:32.876 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 9 v 762 (ObjNum 868 snap 252 seq_num 868) dirty exists 2026-02-13T20:22:32.877 INFO:tasks.rados.rados.0.trial188.stdout:2517: finishing rollback tid 0 to trial18843701-27 2026-02-13T20:22:32.877 INFO:tasks.rados.rados.0.trial188.stdout:2517: finishing rollback tid 1 to trial18843701-27 2026-02-13T20:22:32.877 INFO:tasks.rados.rados.0.trial188.stdout:2517: finishing rollback tid 2 to trial18843701-27 2026-02-13T20:22:32.877 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 27 v 1161 (ObjNum 811 snap 240 seq_num 811) dirty exists 2026-02-13T20:22:32.910 INFO:tasks.rados.rados.0.trial188.stdout:2515: finishing copy_from racing read to trial18843701-26 2026-02-13T20:22:32.911 INFO:tasks.rados.rados.0.trial188.stdout:2515: finishing copy_from to trial18843701-26 2026-02-13T20:22:32.911 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 26 v 502 (ObjNum 820 snap 241 seq_num 820) dirty exists 2026-02-13T20:22:33.873 INFO:tasks.rados.rados.0.trial188.stdout:2515: done (4 left) 2026-02-13T20:22:33.873 INFO:tasks.rados.rados.0.trial188.stdout:2516: done (3 left) 2026-02-13T20:22:33.873 INFO:tasks.rados.rados.0.trial188.stdout:2517: done (2 left) 2026-02-13T20:22:33.873 INFO:tasks.rados.rados.0.trial188.stdout:2518: done (1 left) 2026-02-13T20:22:33.873 INFO:tasks.rados.rados.0.trial188.stdout:2519: done (0 left) 2026-02-13T20:22:33.873 INFO:tasks.rados.rados.0.trial188.stdout:2520: read oid 36 snap -1 2026-02-13T20:22:33.874 INFO:tasks.rados.rados.0.trial188.stdout:2520: expect (ObjNum 862 snap 250 seq_num 862) 2026-02-13T20:22:33.874 INFO:tasks.rados.rados.0.trial188.stdout:2521: rollback oid 29 current snap is 264 2026-02-13T20:22:33.874 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 29 to 259 2026-02-13T20:22:33.874 INFO:tasks.rados.rados.0.trial188.stdout:2522: copy_from oid 2 from oid 24 current snap is 264 2026-02-13T20:22:33.874 INFO:tasks.rados.rados.0.trial188.stdout:2523: read oid 9 snap -1 2026-02-13T20:22:33.874 INFO:tasks.rados.rados.0.trial188.stdout:2523: expect (ObjNum 868 snap 252 seq_num 868) 2026-02-13T20:22:33.874 INFO:tasks.rados.rados.0.trial188.stdout:2524: copy_from oid 49 from oid 39 current snap is 264 2026-02-13T20:22:33.874 INFO:tasks.rados.rados.0.trial188.stdout:2525: snap_create 2026-02-13T20:22:33.876 INFO:tasks.rados.rados.0.trial188.stdout:2521: finishing rollback tid 0 to trial18843701-29 2026-02-13T20:22:33.877 INFO:tasks.rados.rados.0.trial188.stdout:2523: expect (ObjNum 868 snap 252 seq_num 868) 2026-02-13T20:22:33.903 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 961281 2026-02-13T20:22:33.933 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1799739 2026-02-13T20:22:33.942 INFO:tasks.rados.rados.0.trial188.stdout:2524: finishing copy_from to trial18843701-49 2026-02-13T20:22:33.943 INFO:tasks.rados.rados.0.trial188.stdout:2524: got expected ENOENT (src dne) 2026-02-13T20:22:33.943 INFO:tasks.rados.rados.0.trial188.stdout:2524: finishing copy_from racing read to trial18843701-49 2026-02-13T20:22:33.943 INFO:tasks.rados.rados.0.trial188.stdout:2521: finishing rollback tid 1 to trial18843701-29 2026-02-13T20:22:33.943 INFO:tasks.rados.rados.0.trial188.stdout:2521: finishing rollback tid 2 to trial18843701-29 2026-02-13T20:22:33.943 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 29 v 1052 (ObjNum 867 snap 252 seq_num 867) dirty exists 2026-02-13T20:22:33.943 INFO:tasks.rados.rados.0.trial188.stdout:2520: expect (ObjNum 862 snap 250 seq_num 862) 2026-02-13T20:22:33.993 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1020514 2026-02-13T20:22:34.008 INFO:tasks.rados.rados.0.trial188.stdout:2522: finishing copy_from racing read to trial18843701-2 2026-02-13T20:22:34.008 INFO:tasks.rados.rados.0.trial188.stdout:2522: finishing copy_from to trial18843701-2 2026-02-13T20:22:34.008 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 2 v 1049 (ObjNum 671 snap 185 seq_num 671) dirty exists 2026-02-13T20:22:34.876 INFO:tasks.rados.rados.0.trial188.stdout:2520: done (5 left) 2026-02-13T20:22:34.876 INFO:tasks.rados.rados.0.trial188.stdout:2521: done (4 left) 2026-02-13T20:22:34.876 INFO:tasks.rados.rados.0.trial188.stdout:2522: done (3 left) 2026-02-13T20:22:34.876 INFO:tasks.rados.rados.0.trial188.stdout:2523: done (2 left) 2026-02-13T20:22:34.876 INFO:tasks.rados.rados.0.trial188.stdout:2524: done (1 left) 2026-02-13T20:22:34.876 INFO:tasks.rados.rados.0.trial188.stdout:2525: done (0 left) 2026-02-13T20:22:34.877 INFO:tasks.rados.rados.0.trial188.stdout:2526: write oid 25 current snap is 265 2026-02-13T20:22:34.877 INFO:tasks.rados.rados.0.trial188.stdout:2526: seq_num 879 ranges {773353=724466,2170378=602975} 2026-02-13T20:22:34.881 INFO:tasks.rados.rados.0.trial188.stdout:2526: writing trial18843701-25 from 773353 to 1497819 tid 1 2026-02-13T20:22:34.886 INFO:tasks.rados.rados.0.trial188.stdout:2526: writing trial18843701-25 from 2170378 to 2773353 tid 2 2026-02-13T20:22:34.886 INFO:tasks.rados.rados.0.trial188.stdout:2527: delete oid 29 current snap is 265 2026-02-13T20:22:34.889 INFO:tasks.rados.rados.0.trial188.stdout:2527: done (1 left) 2026-02-13T20:22:34.889 INFO:tasks.rados.rados.0.trial188.stdout:2528: delete oid 31 current snap is 265 2026-02-13T20:22:34.890 INFO:tasks.rados.rados.0.trial188.stdout:2528: done (1 left) 2026-02-13T20:22:34.891 INFO:tasks.rados.rados.0.trial188.stdout:2529: write (excl) oid 10 current snap is 265 2026-02-13T20:22:34.891 INFO:tasks.rados.rados.0.trial188.stdout:2529: seq_num 882 ranges {423774=666566,1545824=512968,2704609=119165} 2026-02-13T20:22:34.895 INFO:tasks.rados.rados.0.trial188.stdout:2529: writing trial18843701-10 from 423774 to 1090340 tid 1 2026-02-13T20:22:34.898 INFO:tasks.rados.rados.0.trial188.stdout:2529: writing trial18843701-10 from 1545824 to 2058792 tid 2 2026-02-13T20:22:34.901 INFO:tasks.rados.rados.0.trial188.stdout:2529: writing trial18843701-10 from 2704609 to 2823774 tid 3 2026-02-13T20:22:34.901 INFO:tasks.rados.rados.0.trial188.stdout:2530: delete oid 37 current snap is 265 2026-02-13T20:22:34.902 INFO:tasks.rados.rados.0.trial188.stdout:2526: finishing write tid 1 to trial18843701-25 2026-02-13T20:22:34.903 INFO:tasks.rados.rados.0.trial188.stdout:2526: finishing write tid 2 to trial18843701-25 2026-02-13T20:22:34.904 INFO:tasks.rados.rados.0.trial188.stdout:2526: finishing write tid 3 to trial18843701-25 2026-02-13T20:22:34.904 INFO:tasks.rados.rados.0.trial188.stdout:2530: done (2 left) 2026-02-13T20:22:34.904 INFO:tasks.rados.rados.0.trial188.stdout:2531: rollback oid 21 current snap is 265 2026-02-13T20:22:34.904 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 21 to 252 2026-02-13T20:22:34.904 INFO:tasks.rados.rados.0.trial188.stdout:2532: read oid 3 snap -1 2026-02-13T20:22:34.904 INFO:tasks.rados.rados.0.trial188.stdout:2532: expect deleted 2026-02-13T20:22:34.905 INFO:tasks.rados.rados.0.trial188.stdout:2533: read oid 7 snap -1 2026-02-13T20:22:34.905 INFO:tasks.rados.rados.0.trial188.stdout:2533: expect (ObjNum 833 snap 247 seq_num 833) 2026-02-13T20:22:34.905 INFO:tasks.rados.rados.0.trial188.stdout:2534: copy_from oid 27 from oid 32 current snap is 265 2026-02-13T20:22:34.905 INFO:tasks.rados.rados.0.trial188.stdout:2526: finishing write tid 4 to trial18843701-25 2026-02-13T20:22:34.905 INFO:tasks.rados.rados.0.trial188.stdout:2526: oid 25 updating version 0 to 1165 2026-02-13T20:22:34.905 INFO:tasks.rados.rados.0.trial188.stdout:2526: oid 25 version 1165 is already newer than 1164 2026-02-13T20:22:34.905 INFO:tasks.rados.rados.0.trial188.stdout:2526: oid 25 version 1165 is already newer than 1163 2026-02-13T20:22:34.905 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 25 v 1165 (ObjNum 879 snap 265 seq_num 879) dirty exists 2026-02-13T20:22:34.905 INFO:tasks.rados.rados.0.trial188.stdout:2526: left oid 25 (ObjNum 879 snap 265 seq_num 879) 2026-02-13T20:22:34.905 INFO:tasks.rados.rados.0.trial188.stdout:2526: done (5 left) 2026-02-13T20:22:34.905 INFO:tasks.rados.rados.0.trial188.stdout:2535: snap_remove snap 245 2026-02-13T20:22:35.879 INFO:tasks.rados.rados.0.trial188.stdout:2535: done (5 left) 2026-02-13T20:22:35.879 INFO:tasks.rados.rados.0.trial188.stdout:2536: write (excl) oid 26 current snap is 265 2026-02-13T20:22:35.879 INFO:tasks.rados.rados.0.trial188.stdout:2536: seq_num 884 ranges {457388=417064,1546435=516637,2643102=214286} 2026-02-13T20:22:35.882 INFO:tasks.rados.rados.0.trial188.stdout:2536: writing trial18843701-26 from 457388 to 874452 tid 1 2026-02-13T20:22:35.887 INFO:tasks.rados.rados.0.trial188.stdout:2536: writing trial18843701-26 from 1546435 to 2063072 tid 2 2026-02-13T20:22:35.890 INFO:tasks.rados.rados.0.trial188.stdout:2536: writing trial18843701-26 from 2643102 to 2857388 tid 3 2026-02-13T20:22:35.890 INFO:tasks.rados.rados.0.trial188.stdout:2537: rollback oid 40 current snap is 265 2026-02-13T20:22:35.890 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 40 to 260 2026-02-13T20:22:35.890 INFO:tasks.rados.rados.0.trial188.stdout:2531: finishing rollback tid 0 to trial18843701-21 2026-02-13T20:22:35.890 INFO:tasks.rados.rados.0.trial188.stdout:2531: finishing rollback tid 1 to trial18843701-21 2026-02-13T20:22:35.891 INFO:tasks.rados.rados.0.trial188.stdout:2531: finishing rollback tid 2 to trial18843701-21 2026-02-13T20:22:35.891 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 21 v 546 (ObjNum 825 snap 242 seq_num 825) dirty exists 2026-02-13T20:22:35.891 INFO:tasks.rados.rados.0.trial188.stdout:2533: expect (ObjNum 833 snap 247 seq_num 833) 2026-02-13T20:22:35.903 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1166123 2026-02-13T20:22:35.934 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:22:35.982 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:22:36.032 INFO:tasks.rados.rados.0.trial188.stdout:2529: finishing write tid 1 to trial18843701-10 2026-02-13T20:22:36.032 INFO:tasks.rados.rados.0.trial188.stdout:2529: finishing write tid 2 to trial18843701-10 2026-02-13T20:22:36.032 INFO:tasks.rados.rados.0.trial188.stdout:2531: done (6 left) 2026-02-13T20:22:36.033 INFO:tasks.rados.rados.0.trial188.stdout:2532: done (5 left) 2026-02-13T20:22:36.033 INFO:tasks.rados.rados.0.trial188.stdout:2533: done (4 left) 2026-02-13T20:22:36.033 INFO:tasks.rados.rados.0.trial188.stdout:2538: read oid 4 snap -1 2026-02-13T20:22:36.033 INFO:tasks.rados.rados.0.trial188.stdout:2538: expect deleted 2026-02-13T20:22:36.033 INFO:tasks.rados.rados.0.trial188.stdout:2539: rollback oid 21 current snap is 265 2026-02-13T20:22:36.033 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 21 to 258 2026-02-13T20:22:36.033 INFO:tasks.rados.rados.0.trial188.stdout:2529: finishing write tid 3 to trial18843701-10 2026-02-13T20:22:36.033 INFO:tasks.rados.rados.0.trial188.stdout:2529: finishing write tid 4 to trial18843701-10 2026-02-13T20:22:36.033 INFO:tasks.rados.rados.0.trial188.stdout:2529: finishing write tid 5 to trial18843701-10 2026-02-13T20:22:36.034 INFO:tasks.rados.rados.0.trial188.stdout:2529: oid 10 updating version 0 to 782 2026-02-13T20:22:36.034 INFO:tasks.rados.rados.0.trial188.stdout:2529: oid 10 version 782 is already newer than 781 2026-02-13T20:22:36.034 INFO:tasks.rados.rados.0.trial188.stdout:2529: oid 10 updating version 782 to 783 2026-02-13T20:22:36.034 INFO:tasks.rados.rados.0.trial188.stdout:2529: oid 10 version 783 is already newer than 780 2026-02-13T20:22:36.034 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 10 v 783 (ObjNum 882 snap 265 seq_num 882) dirty exists 2026-02-13T20:22:36.034 INFO:tasks.rados.rados.0.trial188.stdout:2529: left oid 10 (ObjNum 882 snap 265 seq_num 882) 2026-02-13T20:22:36.034 INFO:tasks.rados.rados.0.trial188.stdout:2534: finishing copy_from racing read to trial18843701-27 2026-02-13T20:22:36.034 INFO:tasks.rados.rados.0.trial188.stdout:2534: finishing copy_from to trial18843701-27 2026-02-13T20:22:36.034 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 27 v 958 (ObjNum 739 snap 220 seq_num 739) dirty exists 2026-02-13T20:22:36.034 INFO:tasks.rados.rados.0.trial188.stdout:2537: finishing rollback tid 0 to trial18843701-40 2026-02-13T20:22:36.034 INFO:tasks.rados.rados.0.trial188.stdout:2537: finishing rollback tid 1 to trial18843701-40 2026-02-13T20:22:36.035 INFO:tasks.rados.rados.0.trial188.stdout:2537: finishing rollback tid 2 to trial18843701-40 2026-02-13T20:22:36.035 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 40 v 974 (ObjNum 845 snap 248 seq_num 845) dirty exists 2026-02-13T20:22:36.035 INFO:tasks.rados.rados.0.trial188.stdout:2536: finishing write tid 1 to trial18843701-26 2026-02-13T20:22:36.035 INFO:tasks.rados.rados.0.trial188.stdout:2536: finishing write tid 2 to trial18843701-26 2026-02-13T20:22:36.035 INFO:tasks.rados.rados.0.trial188.stdout:2536: finishing write tid 3 to trial18843701-26 2026-02-13T20:22:36.035 INFO:tasks.rados.rados.0.trial188.stdout:2536: finishing write tid 4 to trial18843701-26 2026-02-13T20:22:36.035 INFO:tasks.rados.rados.0.trial188.stdout:2536: finishing write tid 5 to trial18843701-26 2026-02-13T20:22:36.035 INFO:tasks.rados.rados.0.trial188.stdout:2536: oid 26 updating version 0 to 961 2026-02-13T20:22:36.035 INFO:tasks.rados.rados.0.trial188.stdout:2536: oid 26 version 961 is already newer than 959 2026-02-13T20:22:36.036 INFO:tasks.rados.rados.0.trial188.stdout:2536: oid 26 updating version 961 to 962 2026-02-13T20:22:36.036 INFO:tasks.rados.rados.0.trial188.stdout:2536: oid 26 version 962 is already newer than 960 2026-02-13T20:22:36.036 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 26 v 962 (ObjNum 884 snap 265 seq_num 884) dirty exists 2026-02-13T20:22:36.036 INFO:tasks.rados.rados.0.trial188.stdout:2536: left oid 26 (ObjNum 884 snap 265 seq_num 884) 2026-02-13T20:22:36.036 INFO:tasks.rados.rados.0.trial188.stdout:2529: done (5 left) 2026-02-13T20:22:36.036 INFO:tasks.rados.rados.0.trial188.stdout:2534: done (4 left) 2026-02-13T20:22:36.036 INFO:tasks.rados.rados.0.trial188.stdout:2536: done (3 left) 2026-02-13T20:22:36.036 INFO:tasks.rados.rados.0.trial188.stdout:2537: done (2 left) 2026-02-13T20:22:36.036 INFO:tasks.rados.rados.0.trial188.stdout:2540: copy_from oid 8 from oid 26 current snap is 265 2026-02-13T20:22:36.036 INFO:tasks.rados.rados.0.trial188.stdout:2541: snap_remove snap 215 2026-02-13T20:22:36.871 INFO:tasks.rados.rados.0.trial188.stdout:2541: done (3 left) 2026-02-13T20:22:36.871 INFO:tasks.rados.rados.0.trial188.stdout:2542: snap_remove snap 249 2026-02-13T20:22:37.874 INFO:tasks.rados.rados.0.trial188.stdout:2542: done (3 left) 2026-02-13T20:22:37.874 INFO:tasks.rados.rados.0.trial188.stdout:2543: copy_from oid 36 from oid 47 current snap is 265 2026-02-13T20:22:37.875 INFO:tasks.rados.rados.0.trial188.stdout:2539: finishing rollback tid 0 to trial18843701-21 2026-02-13T20:22:37.875 INFO:tasks.rados.rados.0.trial188.stdout:2539: finishing rollback tid 1 to trial18843701-21 2026-02-13T20:22:37.875 INFO:tasks.rados.rados.0.trial188.stdout:2539: finishing rollback tid 2 to trial18843701-21 2026-02-13T20:22:37.875 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 21 v 551 (ObjNum 870 snap 253 seq_num 870) dirty exists 2026-02-13T20:22:37.875 INFO:tasks.rados.rados.0.trial188.stdout:2540: finishing copy_from racing read to trial18843701-8 2026-02-13T20:22:37.875 INFO:tasks.rados.rados.0.trial188.stdout:2540: finishing copy_from to trial18843701-8 2026-02-13T20:22:37.875 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 8 v 962 (ObjNum 884 snap 265 seq_num 884) dirty exists 2026-02-13T20:22:37.875 INFO:tasks.rados.rados.0.trial188.stdout:2538: done (3 left) 2026-02-13T20:22:37.875 INFO:tasks.rados.rados.0.trial188.stdout:2539: done (2 left) 2026-02-13T20:22:37.875 INFO:tasks.rados.rados.0.trial188.stdout:2540: done (1 left) 2026-02-13T20:22:37.875 INFO:tasks.rados.rados.0.trial188.stdout:2544: snap_remove snap 260 2026-02-13T20:22:38.874 INFO:tasks.rados.rados.0.trial188.stdout:2544: done (1 left) 2026-02-13T20:22:38.875 INFO:tasks.rados.rados.0.trial188.stdout:2545: snap_create 2026-02-13T20:22:38.875 INFO:tasks.rados.rados.0.trial188.stdout:2543: finishing copy_from racing read to trial18843701-36 2026-02-13T20:22:38.875 INFO:tasks.rados.rados.0.trial188.stdout:2543: finishing copy_from to trial18843701-36 2026-02-13T20:22:38.875 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 36 v 998 (ObjNum 867 snap 252 seq_num 867) dirty exists 2026-02-13T20:22:39.877 INFO:tasks.rados.rados.0.trial188.stdout:2543: done (1 left) 2026-02-13T20:22:39.877 INFO:tasks.rados.rados.0.trial188.stdout:2545: done (0 left) 2026-02-13T20:22:39.877 INFO:tasks.rados.rados.0.trial188.stdout:2546: snap_remove snap 256 2026-02-13T20:22:40.880 INFO:tasks.rados.rados.0.trial188.stdout:2546: done (0 left) 2026-02-13T20:22:40.880 INFO:tasks.rados.rados.0.trial188.stdout:2547: read oid 9 snap -1 2026-02-13T20:22:40.881 INFO:tasks.rados.rados.0.trial188.stdout:2547: expect (ObjNum 868 snap 252 seq_num 868) 2026-02-13T20:22:40.881 INFO:tasks.rados.rados.0.trial188.stdout:2548: read oid 38 snap 255 2026-02-13T20:22:40.881 INFO:tasks.rados.rados.0.trial188.stdout:2548: expect (ObjNum 779 snap 232 seq_num 779) 2026-02-13T20:22:40.881 INFO:tasks.rados.rados.0.trial188.stdout:2549: delete oid 22 current snap is 266 2026-02-13T20:22:40.882 INFO:tasks.rados.rados.0.trial188.stdout:2549: done (2 left) 2026-02-13T20:22:40.883 INFO:tasks.rados.rados.0.trial188.stdout:2550: read oid 10 snap -1 2026-02-13T20:22:40.883 INFO:tasks.rados.rados.0.trial188.stdout:2550: expect (ObjNum 882 snap 265 seq_num 882) 2026-02-13T20:22:40.883 INFO:tasks.rados.rados.0.trial188.stdout:2551: read oid 1 snap 257 2026-02-13T20:22:40.883 INFO:tasks.rados.rados.0.trial188.stdout:2551: expect (ObjNum 873 snap 255 seq_num 873) 2026-02-13T20:22:40.883 INFO:tasks.rados.rados.0.trial188.stdout:2552: rollback oid 45 current snap is 266 2026-02-13T20:22:40.883 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 45 to 228 2026-02-13T20:22:40.883 INFO:tasks.rados.rados.0.trial188.stdout:2553: rollback oid 29 current snap is 266 2026-02-13T20:22:40.883 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 29 to 264 2026-02-13T20:22:40.883 INFO:tasks.rados.rados.0.trial188.stdout:2554: write (excl) oid 21 current snap is 266 2026-02-13T20:22:40.884 INFO:tasks.rados.rados.0.trial188.stdout:2554: seq_num 886 ranges {491002=567562,1663399=520306,2814301=76701} 2026-02-13T20:22:40.885 INFO:tasks.rados.rados.0.trial188.stdout:2554: writing trial18843701-21 from 491002 to 1058564 tid 1 2026-02-13T20:22:40.890 INFO:tasks.rados.rados.0.trial188.stdout:2554: writing trial18843701-21 from 1663399 to 2183705 tid 2 2026-02-13T20:22:40.893 INFO:tasks.rados.rados.0.trial188.stdout:2554: writing trial18843701-21 from 2814301 to 2891002 tid 3 2026-02-13T20:22:40.893 INFO:tasks.rados.rados.0.trial188.stdout:2555: snap_create 2026-02-13T20:22:40.893 INFO:tasks.rados.rados.0.trial188.stdout:2547: expect (ObjNum 868 snap 252 seq_num 868) 2026-02-13T20:22:40.900 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1381319 2026-02-13T20:22:40.916 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:22:40.954 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1733466 2026-02-13T20:22:40.964 INFO:tasks.rados.rados.0.trial188.stdout:2551: expect (ObjNum 873 snap 255 seq_num 873) 2026-02-13T20:22:41.012 INFO:tasks.rados.rados.0.trial188.stdout:2552: finishing rollback tid 1 to trial18843701-45 2026-02-13T20:22:41.012 INFO:tasks.rados.rados.0.trial188.stdout:2552: finishing rollback tid 2 to trial18843701-45 2026-02-13T20:22:41.012 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 45 v 1233 (ObjNum 752 snap 222 seq_num 752) dirty exists 2026-02-13T20:22:41.012 INFO:tasks.rados.rados.0.trial188.stdout:2548: expect (ObjNum 779 snap 232 seq_num 779) 2026-02-13T20:22:41.035 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:22:41.085 INFO:tasks.rados.rados.0.trial188.stdout:2550: expect (ObjNum 882 snap 265 seq_num 882) 2026-02-13T20:22:41.085 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:22:41.169 INFO:tasks.rados.rados.0.trial188.stdout:2553: finishing rollback tid 1 to trial18843701-29 2026-02-13T20:22:41.170 INFO:tasks.rados.rados.0.trial188.stdout:2553: finishing rollback tid 2 to trial18843701-29 2026-02-13T20:22:41.170 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 29 v 1078 (ObjNum 867 snap 252 seq_num 867) dirty exists 2026-02-13T20:22:41.170 INFO:tasks.rados.rados.0.trial188.stdout:2554: finishing write tid 1 to trial18843701-21 2026-02-13T20:22:41.170 INFO:tasks.rados.rados.0.trial188.stdout:2554: finishing write tid 2 to trial18843701-21 2026-02-13T20:22:41.170 INFO:tasks.rados.rados.0.trial188.stdout:2554: finishing write tid 3 to trial18843701-21 2026-02-13T20:22:41.170 INFO:tasks.rados.rados.0.trial188.stdout:2554: finishing write tid 4 to trial18843701-21 2026-02-13T20:22:41.170 INFO:tasks.rados.rados.0.trial188.stdout:2554: finishing write tid 5 to trial18843701-21 2026-02-13T20:22:41.170 INFO:tasks.rados.rados.0.trial188.stdout:2554: oid 21 updating version 0 to 562 2026-02-13T20:22:41.171 INFO:tasks.rados.rados.0.trial188.stdout:2554: oid 21 version 562 is already newer than 561 2026-02-13T20:22:41.171 INFO:tasks.rados.rados.0.trial188.stdout:2554: oid 21 updating version 562 to 564 2026-02-13T20:22:41.171 INFO:tasks.rados.rados.0.trial188.stdout:2554: oid 21 version 564 is already newer than 563 2026-02-13T20:22:41.171 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 21 v 564 (ObjNum 886 snap 266 seq_num 886) dirty exists 2026-02-13T20:22:41.171 INFO:tasks.rados.rados.0.trial188.stdout:2554: left oid 21 (ObjNum 886 snap 266 seq_num 886) 2026-02-13T20:22:41.871 INFO:tasks.rados.rados.0.trial188.stdout:2547: done (7 left) 2026-02-13T20:22:41.871 INFO:tasks.rados.rados.0.trial188.stdout:2548: done (6 left) 2026-02-13T20:22:41.872 INFO:tasks.rados.rados.0.trial188.stdout:2550: done (5 left) 2026-02-13T20:22:41.872 INFO:tasks.rados.rados.0.trial188.stdout:2551: done (4 left) 2026-02-13T20:22:41.872 INFO:tasks.rados.rados.0.trial188.stdout:2552: done (3 left) 2026-02-13T20:22:41.872 INFO:tasks.rados.rados.0.trial188.stdout:2553: done (2 left) 2026-02-13T20:22:41.872 INFO:tasks.rados.rados.0.trial188.stdout:2554: done (1 left) 2026-02-13T20:22:41.872 INFO:tasks.rados.rados.0.trial188.stdout:2555: done (0 left) 2026-02-13T20:22:41.872 INFO:tasks.rados.rados.0.trial188.stdout:2556: delete oid 20 current snap is 267 2026-02-13T20:22:41.873 INFO:tasks.rados.rados.0.trial188.stdout:2556: done (0 left) 2026-02-13T20:22:41.873 INFO:tasks.rados.rados.0.trial188.stdout:2557: delete oid 10 current snap is 267 2026-02-13T20:22:41.875 INFO:tasks.rados.rados.0.trial188.stdout:2557: done (0 left) 2026-02-13T20:22:41.875 INFO:tasks.rados.rados.0.trial188.stdout:2558: snap_remove snap 264 2026-02-13T20:22:42.872 INFO:tasks.rados.rados.0.trial188.stdout:2558: done (0 left) 2026-02-13T20:22:42.872 INFO:tasks.rados.rados.0.trial188.stdout:2559: read oid 2 snap -1 2026-02-13T20:22:42.872 INFO:tasks.rados.rados.0.trial188.stdout:2559: expect (ObjNum 671 snap 185 seq_num 671) 2026-02-13T20:22:42.872 INFO:tasks.rados.rados.0.trial188.stdout:2560: read oid 15 snap -1 2026-02-13T20:22:42.872 INFO:tasks.rados.rados.0.trial188.stdout:2560: expect (ObjNum 865 snap 250 seq_num 865) 2026-02-13T20:22:42.873 INFO:tasks.rados.rados.0.trial188.stdout:2561: read oid 47 snap -1 2026-02-13T20:22:42.873 INFO:tasks.rados.rados.0.trial188.stdout:2561: expect (ObjNum 867 snap 252 seq_num 867) 2026-02-13T20:22:42.873 INFO:tasks.rados.rados.0.trial188.stdout:2562: read oid 50 snap -1 2026-02-13T20:22:42.873 INFO:tasks.rados.rados.0.trial188.stdout:2562: expect (ObjNum 724 snap 214 seq_num 724) 2026-02-13T20:22:42.873 INFO:tasks.rados.rados.0.trial188.stdout:2563: copy_from oid 29 from oid 9 current snap is 267 2026-02-13T20:22:42.873 INFO:tasks.rados.rados.0.trial188.stdout:2564: read oid 45 snap -1 2026-02-13T20:22:42.873 INFO:tasks.rados.rados.0.trial188.stdout:2564: expect (ObjNum 752 snap 222 seq_num 752) 2026-02-13T20:22:42.873 INFO:tasks.rados.rados.0.trial188.stdout:2565: snap_remove snap 258 2026-02-13T20:22:43.874 INFO:tasks.rados.rados.0.trial188.stdout:2565: done (6 left) 2026-02-13T20:22:43.874 INFO:tasks.rados.rados.0.trial188.stdout:2566: delete oid 31 current snap is 267 2026-02-13T20:22:43.874 INFO:tasks.rados.rados.0.trial188.stdout:2564: expect (ObjNum 752 snap 222 seq_num 752) 2026-02-13T20:22:43.881 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2616902 2026-02-13T20:22:43.887 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 757679 2026-02-13T20:22:43.919 INFO:tasks.rados.rados.0.trial188.stdout:2561: expect (ObjNum 867 snap 252 seq_num 867) 2026-02-13T20:22:43.927 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2284580 2026-02-13T20:22:43.944 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:22:43.962 INFO:tasks.rados.rados.0.trial188.stdout:2560: expect (ObjNum 865 snap 250 seq_num 865) 2026-02-13T20:22:44.107 INFO:tasks.rados.rados.0.trial188.stdout:2562: expect (ObjNum 724 snap 214 seq_num 724) 2026-02-13T20:22:44.141 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 856282 2026-02-13T20:22:44.150 INFO:tasks.rados.rados.0.trial188.stdout:2559: expect (ObjNum 671 snap 185 seq_num 671) 2026-02-13T20:22:44.178 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1150342 2026-02-13T20:22:44.194 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:22:44.218 INFO:tasks.rados.rados.0.trial188.stdout:2563: finishing copy_from racing read to trial18843701-29 2026-02-13T20:22:44.219 INFO:tasks.rados.rados.0.trial188.stdout:2563: finishing copy_from to trial18843701-29 2026-02-13T20:22:44.219 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 29 v 762 (ObjNum 868 snap 252 seq_num 868) dirty exists 2026-02-13T20:22:44.219 INFO:tasks.rados.rados.0.trial188.stdout:2559: done (6 left) 2026-02-13T20:22:44.219 INFO:tasks.rados.rados.0.trial188.stdout:2560: done (5 left) 2026-02-13T20:22:44.219 INFO:tasks.rados.rados.0.trial188.stdout:2561: done (4 left) 2026-02-13T20:22:44.219 INFO:tasks.rados.rados.0.trial188.stdout:2562: done (3 left) 2026-02-13T20:22:44.219 INFO:tasks.rados.rados.0.trial188.stdout:2563: done (2 left) 2026-02-13T20:22:44.219 INFO:tasks.rados.rados.0.trial188.stdout:2564: done (1 left) 2026-02-13T20:22:44.219 INFO:tasks.rados.rados.0.trial188.stdout:2566: done (0 left) 2026-02-13T20:22:44.219 INFO:tasks.rados.rados.0.trial188.stdout:2567: snap_create 2026-02-13T20:22:44.875 INFO:tasks.rados.rados.0.trial188.stdout:2567: done (0 left) 2026-02-13T20:22:44.875 INFO:tasks.rados.rados.0.trial188.stdout:2568: rollback oid 3 current snap is 268 2026-02-13T20:22:44.876 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 3 to 228 2026-02-13T20:22:44.876 INFO:tasks.rados.rados.0.trial188.stdout:2569: write (excl) oid 27 current snap is 268 2026-02-13T20:22:44.876 INFO:tasks.rados.rados.0.trial188.stdout:2569: seq_num 890 ranges {558230=584911,1897327=527644,2923993=34237} 2026-02-13T20:22:44.880 INFO:tasks.rados.rados.0.trial188.stdout:2569: writing trial18843701-27 from 558230 to 1143141 tid 1 2026-02-13T20:22:44.885 INFO:tasks.rados.rados.0.trial188.stdout:2569: writing trial18843701-27 from 1897327 to 2424971 tid 2 2026-02-13T20:22:44.887 INFO:tasks.rados.rados.0.trial188.stdout:2569: writing trial18843701-27 from 2923993 to 2958230 tid 3 2026-02-13T20:22:44.887 INFO:tasks.rados.rados.0.trial188.stdout:2570: rollback oid 24 current snap is 268 2026-02-13T20:22:44.888 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 24 to 262 2026-02-13T20:22:44.888 INFO:tasks.rados.rados.0.trial188.stdout:2568: finishing rollback tid 1 to trial18843701-3 2026-02-13T20:22:44.888 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 3 v 788 (ObjNum 81 snap 0 seq_num 0) dirty dne 2026-02-13T20:22:44.888 INFO:tasks.rados.rados.0.trial188.stdout:2568: done (2 left) 2026-02-13T20:22:44.888 INFO:tasks.rados.rados.0.trial188.stdout:2571: snap_create 2026-02-13T20:22:44.890 INFO:tasks.rados.rados.0.trial188.stdout:2570: finishing rollback tid 0 to trial18843701-24 2026-02-13T20:22:44.890 INFO:tasks.rados.rados.0.trial188.stdout:2570: finishing rollback tid 1 to trial18843701-24 2026-02-13T20:22:44.890 INFO:tasks.rados.rados.0.trial188.stdout:2570: finishing rollback tid 2 to trial18843701-24 2026-02-13T20:22:44.890 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 24 v 1228 (ObjNum 671 snap 185 seq_num 671) dirty exists 2026-02-13T20:22:44.900 INFO:tasks.rados.rados.0.trial188.stdout:2569: finishing write tid 1 to trial18843701-27 2026-02-13T20:22:44.900 INFO:tasks.rados.rados.0.trial188.stdout:2569: finishing write tid 2 to trial18843701-27 2026-02-13T20:22:44.900 INFO:tasks.rados.rados.0.trial188.stdout:2569: finishing write tid 3 to trial18843701-27 2026-02-13T20:22:44.900 INFO:tasks.rados.rados.0.trial188.stdout:2569: finishing write tid 4 to trial18843701-27 2026-02-13T20:22:44.900 INFO:tasks.rados.rados.0.trial188.stdout:2569: finishing write tid 5 to trial18843701-27 2026-02-13T20:22:44.900 INFO:tasks.rados.rados.0.trial188.stdout:2569: oid 27 updating version 0 to 1201 2026-02-13T20:22:44.900 INFO:tasks.rados.rados.0.trial188.stdout:2569: oid 27 updating version 1201 to 1203 2026-02-13T20:22:44.900 INFO:tasks.rados.rados.0.trial188.stdout:2569: oid 27 version 1203 is already newer than 1202 2026-02-13T20:22:44.900 INFO:tasks.rados.rados.0.trial188.stdout:2569: oid 27 updating version 1203 to 1204 2026-02-13T20:22:44.901 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 27 v 1204 (ObjNum 890 snap 268 seq_num 890) dirty exists 2026-02-13T20:22:44.901 INFO:tasks.rados.rados.0.trial188.stdout:2569: left oid 27 (ObjNum 890 snap 268 seq_num 890) 2026-02-13T20:22:45.879 INFO:tasks.rados.rados.0.trial188.stdout:2569: done (2 left) 2026-02-13T20:22:45.879 INFO:tasks.rados.rados.0.trial188.stdout:2570: done (1 left) 2026-02-13T20:22:45.879 INFO:tasks.rados.rados.0.trial188.stdout:2571: done (0 left) 2026-02-13T20:22:45.879 INFO:tasks.rados.rados.0.trial188.stdout:2572: write (excl) oid 19 current snap is 269 2026-02-13T20:22:45.879 INFO:tasks.rados.rados.0.trial188.stdout:2572: seq_num 891 ranges {575037=660160,1955809=671302} 2026-02-13T20:22:45.884 INFO:tasks.rados.rados.0.trial188.stdout:2572: writing trial18843701-19 from 575037 to 1235197 tid 1 2026-02-13T20:22:45.890 INFO:tasks.rados.rados.0.trial188.stdout:2572: writing trial18843701-19 from 1955809 to 2627111 tid 2 2026-02-13T20:22:45.890 INFO:tasks.rados.rados.0.trial188.stdout:2573: read oid 5 snap -1 2026-02-13T20:22:45.890 INFO:tasks.rados.rados.0.trial188.stdout:2573: expect deleted 2026-02-13T20:22:45.890 INFO:tasks.rados.rados.0.trial188.stdout:2574: read oid 46 snap 259 2026-02-13T20:22:45.890 INFO:tasks.rados.rados.0.trial188.stdout:2574: expect (ObjNum 872 snap 255 seq_num 872) 2026-02-13T20:22:45.890 INFO:tasks.rados.rados.0.trial188.stdout:2575: write oid 3 current snap is 269 2026-02-13T20:22:45.891 INFO:tasks.rados.rados.0.trial188.stdout:2575: seq_num 892 ranges {591844=735409,1897938=531313,2862486=129358} 2026-02-13T20:22:45.895 INFO:tasks.rados.rados.0.trial188.stdout:2575: writing trial18843701-3 from 591844 to 1327253 tid 1 2026-02-13T20:22:45.899 INFO:tasks.rados.rados.0.trial188.stdout:2575: writing trial18843701-3 from 1897938 to 2429251 tid 2 2026-02-13T20:22:45.901 INFO:tasks.rados.rados.0.trial188.stdout:2575: writing trial18843701-3 from 2862486 to 2991844 tid 3 2026-02-13T20:22:45.901 INFO:tasks.rados.rados.0.trial188.stdout:2576: delete oid 11 current snap is 269 2026-02-13T20:22:45.901 INFO:tasks.rados.rados.0.trial188.stdout:2574: expect (ObjNum 872 snap 255 seq_num 872) 2026-02-13T20:22:45.901 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:22:45.921 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:22:45.961 INFO:tasks.rados.rados.0.trial188.stdout:2572: finishing write tid 1 to trial18843701-19 2026-02-13T20:22:45.961 INFO:tasks.rados.rados.0.trial188.stdout:2572: finishing write tid 2 to trial18843701-19 2026-02-13T20:22:45.962 INFO:tasks.rados.rados.0.trial188.stdout:2575: finishing write tid 1 to trial18843701-3 2026-02-13T20:22:45.962 INFO:tasks.rados.rados.0.trial188.stdout:2572: finishing write tid 3 to trial18843701-19 2026-02-13T20:22:45.962 INFO:tasks.rados.rados.0.trial188.stdout:2572: finishing write tid 4 to trial18843701-19 2026-02-13T20:22:45.962 INFO:tasks.rados.rados.0.trial188.stdout:2572: oid 19 updating version 0 to 1087 2026-02-13T20:22:45.962 INFO:tasks.rados.rados.0.trial188.stdout:2572: oid 19 updating version 1087 to 1088 2026-02-13T20:22:45.962 INFO:tasks.rados.rados.0.trial188.stdout:2572: oid 19 version 1088 is already newer than 1086 2026-02-13T20:22:45.962 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 19 v 1088 (ObjNum 891 snap 269 seq_num 891) dirty exists 2026-02-13T20:22:45.962 INFO:tasks.rados.rados.0.trial188.stdout:2572: left oid 19 (ObjNum 891 snap 269 seq_num 891) 2026-02-13T20:22:45.962 INFO:tasks.rados.rados.0.trial188.stdout:2575: finishing write tid 2 to trial18843701-3 2026-02-13T20:22:45.962 INFO:tasks.rados.rados.0.trial188.stdout:2575: finishing write tid 3 to trial18843701-3 2026-02-13T20:22:45.962 INFO:tasks.rados.rados.0.trial188.stdout:2575: finishing write tid 4 to trial18843701-3 2026-02-13T20:22:45.963 INFO:tasks.rados.rados.0.trial188.stdout:2572: done (4 left) 2026-02-13T20:22:45.963 INFO:tasks.rados.rados.0.trial188.stdout:2573: done (3 left) 2026-02-13T20:22:45.963 INFO:tasks.rados.rados.0.trial188.stdout:2574: done (2 left) 2026-02-13T20:22:45.963 INFO:tasks.rados.rados.0.trial188.stdout:2576: done (1 left) 2026-02-13T20:22:45.963 INFO:tasks.rados.rados.0.trial188.stdout:2577: copy_from oid 46 from oid 31 current snap is 269 2026-02-13T20:22:45.963 INFO:tasks.rados.rados.0.trial188.stdout:2575: finishing write tid 5 to trial18843701-3 2026-02-13T20:22:45.963 INFO:tasks.rados.rados.0.trial188.stdout:2575: oid 3 updating version 0 to 964 2026-02-13T20:22:45.963 INFO:tasks.rados.rados.0.trial188.stdout:2575: oid 3 updating version 964 to 965 2026-02-13T20:22:45.963 INFO:tasks.rados.rados.0.trial188.stdout:2575: oid 3 updating version 965 to 966 2026-02-13T20:22:45.963 INFO:tasks.rados.rados.0.trial188.stdout:2575: oid 3 version 966 is already newer than 963 2026-02-13T20:22:45.963 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 3 v 966 (ObjNum 892 snap 269 seq_num 892) dirty exists 2026-02-13T20:22:45.963 INFO:tasks.rados.rados.0.trial188.stdout:2575: left oid 3 (ObjNum 892 snap 269 seq_num 892) 2026-02-13T20:22:45.964 INFO:tasks.rados.rados.0.trial188.stdout:2575: done (1 left) 2026-02-13T20:22:45.964 INFO:tasks.rados.rados.0.trial188.stdout:2578: snap_create 2026-02-13T20:22:45.964 INFO:tasks.rados.rados.0.trial188.stdout:2577: finishing copy_from to trial18843701-46 2026-02-13T20:22:45.964 INFO:tasks.rados.rados.0.trial188.stdout:2577: got expected ENOENT (src dne) 2026-02-13T20:22:45.964 INFO:tasks.rados.rados.0.trial188.stdout:2577: finishing copy_from racing read to trial18843701-46 2026-02-13T20:22:46.873 INFO:tasks.rados.rados.0.trial188.stdout:2577: done (1 left) 2026-02-13T20:22:46.873 INFO:tasks.rados.rados.0.trial188.stdout:2578: done (0 left) 2026-02-13T20:22:46.873 INFO:tasks.rados.rados.0.trial188.stdout:2579: write oid 11 current snap is 270 2026-02-13T20:22:46.873 INFO:tasks.rados.rados.0.trial188.stdout:2579: seq_num 894 ranges {625458=485907,1614902=534982,2917332=108126} 2026-02-13T20:22:46.877 INFO:tasks.rados.rados.0.trial188.stdout:2579: writing trial18843701-11 from 625458 to 1111365 tid 1 2026-02-13T20:22:46.881 INFO:tasks.rados.rados.0.trial188.stdout:2579: writing trial18843701-11 from 1614902 to 2149884 tid 2 2026-02-13T20:22:46.884 INFO:tasks.rados.rados.0.trial188.stdout:2579: writing trial18843701-11 from 2917332 to 3025458 tid 3 2026-02-13T20:22:46.885 INFO:tasks.rados.rados.0.trial188.stdout:2580: snap_remove snap 269 2026-02-13T20:22:47.884 INFO:tasks.rados.rados.0.trial188.stdout:2580: done (1 left) 2026-02-13T20:22:47.884 INFO:tasks.rados.rados.0.trial188.stdout:2581: write oid 49 current snap is 270 2026-02-13T20:22:47.885 INFO:tasks.rados.rados.0.trial188.stdout:2581: seq_num 895 ranges {642265=561156,1673384=678640,2828402=213863} 2026-02-13T20:22:47.890 INFO:tasks.rados.rados.0.trial188.stdout:2581: writing trial18843701-49 from 642265 to 1203421 tid 1 2026-02-13T20:22:47.894 INFO:tasks.rados.rados.0.trial188.stdout:2581: writing trial18843701-49 from 1673384 to 2352024 tid 2 2026-02-13T20:22:47.898 INFO:tasks.rados.rados.0.trial188.stdout:2581: writing trial18843701-49 from 2828402 to 3042265 tid 3 2026-02-13T20:22:47.898 INFO:tasks.rados.rados.0.trial188.stdout:2582: read oid 19 snap -1 2026-02-13T20:22:47.898 INFO:tasks.rados.rados.0.trial188.stdout:2582: expect (ObjNum 891 snap 269 seq_num 891) 2026-02-13T20:22:47.898 INFO:tasks.rados.rados.0.trial188.stdout:2583: read oid 17 snap -1 2026-02-13T20:22:47.898 INFO:tasks.rados.rados.0.trial188.stdout:2583: expect (ObjNum 871 snap 253 seq_num 871) 2026-02-13T20:22:47.898 INFO:tasks.rados.rados.0.trial188.stdout:2584: write (excl) oid 34 current snap is 270 2026-02-13T20:22:47.898 INFO:tasks.rados.rados.0.trial188.stdout:2579: finishing write tid 1 to trial18843701-11 2026-02-13T20:22:47.898 INFO:tasks.rados.rados.0.trial188.stdout:2579: finishing write tid 2 to trial18843701-11 2026-02-13T20:22:47.898 INFO:tasks.rados.rados.0.trial188.stdout:2579: finishing write tid 3 to trial18843701-11 2026-02-13T20:22:47.899 INFO:tasks.rados.rados.0.trial188.stdout:2579: finishing write tid 4 to trial18843701-11 2026-02-13T20:22:47.899 INFO:tasks.rados.rados.0.trial188.stdout:2579: finishing write tid 5 to trial18843701-11 2026-02-13T20:22:47.899 INFO:tasks.rados.rados.0.trial188.stdout:2579: oid 11 updating version 0 to 786 2026-02-13T20:22:47.899 INFO:tasks.rados.rados.0.trial188.stdout:2579: oid 11 updating version 786 to 789 2026-02-13T20:22:47.899 INFO:tasks.rados.rados.0.trial188.stdout:2579: oid 11 version 789 is already newer than 787 2026-02-13T20:22:47.899 INFO:tasks.rados.rados.0.trial188.stdout:2579: oid 11 version 789 is already newer than 788 2026-02-13T20:22:47.899 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 11 v 789 (ObjNum 894 snap 270 seq_num 894) dirty exists 2026-02-13T20:22:47.899 INFO:tasks.rados.rados.0.trial188.stdout:2579: left oid 11 (ObjNum 894 snap 270 seq_num 894) 2026-02-13T20:22:47.899 INFO:tasks.rados.rados.0.trial188.stdout:2584: seq_num 896 ranges {659072=636405,1731866=422298,2855825=203247} 2026-02-13T20:22:47.902 INFO:tasks.rados.rados.0.trial188.stdout:2584: writing trial18843701-34 from 659072 to 1295477 tid 1 2026-02-13T20:22:47.905 INFO:tasks.rados.rados.0.trial188.stdout:2584: writing trial18843701-34 from 1731866 to 2154164 tid 2 2026-02-13T20:22:47.908 INFO:tasks.rados.rados.0.trial188.stdout:2584: writing trial18843701-34 from 2855825 to 3059072 tid 3 2026-02-13T20:22:47.908 INFO:tasks.rados.rados.0.trial188.stdout:2579: done (4 left) 2026-02-13T20:22:47.908 INFO:tasks.rados.rados.0.trial188.stdout:2585: copy_from oid 41 from oid 24 current snap is 270 2026-02-13T20:22:47.908 INFO:tasks.rados.rados.0.trial188.stdout:2582: expect (ObjNum 891 snap 269 seq_num 891) 2026-02-13T20:22:47.967 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1154898 2026-02-13T20:22:48.054 INFO:tasks.rados.rados.0.trial188.stdout:2583: expect (ObjNum 871 snap 253 seq_num 871) 2026-02-13T20:22:48.079 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:22:48.133 INFO:tasks.rados.rados.0.trial188.stdout:2581: finishing write tid 1 to trial18843701-49 2026-02-13T20:22:48.133 INFO:tasks.rados.rados.0.trial188.stdout:2582: done (4 left) 2026-02-13T20:22:48.133 INFO:tasks.rados.rados.0.trial188.stdout:2583: done (3 left) 2026-02-13T20:22:48.133 INFO:tasks.rados.rados.0.trial188.stdout:2586: write (excl) oid 21 current snap is 270 2026-02-13T20:22:48.133 INFO:tasks.rados.rados.0.trial188.stdout:2581: finishing write tid 2 to trial18843701-49 2026-02-13T20:22:48.134 INFO:tasks.rados.rados.0.trial188.stdout:2581: finishing write tid 3 to trial18843701-49 2026-02-13T20:22:48.134 INFO:tasks.rados.rados.0.trial188.stdout:2586: seq_num 897 ranges {675879=711654,2073995=682309} 2026-02-13T20:22:48.138 INFO:tasks.rados.rados.0.trial188.stdout:2586: writing trial18843701-21 from 675879 to 1387533 tid 1 2026-02-13T20:22:48.145 INFO:tasks.rados.rados.0.trial188.stdout:2586: writing trial18843701-21 from 2073995 to 2756304 tid 2 2026-02-13T20:22:48.145 INFO:tasks.rados.rados.0.trial188.stdout:2587: read oid 11 snap -1 2026-02-13T20:22:48.145 INFO:tasks.rados.rados.0.trial188.stdout:2587: expect (ObjNum 894 snap 270 seq_num 894) 2026-02-13T20:22:48.145 INFO:tasks.rados.rados.0.trial188.stdout:2588: write oid 30 current snap is 270 2026-02-13T20:22:48.145 INFO:tasks.rados.rados.0.trial188.stdout:2584: finishing write tid 1 to trial18843701-34 2026-02-13T20:22:48.145 INFO:tasks.rados.rados.0.trial188.stdout:2584: finishing write tid 2 to trial18843701-34 2026-02-13T20:22:48.145 INFO:tasks.rados.rados.0.trial188.stdout:2584: finishing write tid 3 to trial18843701-34 2026-02-13T20:22:48.146 INFO:tasks.rados.rados.0.trial188.stdout:2584: finishing write tid 4 to trial18843701-34 2026-02-13T20:22:48.146 INFO:tasks.rados.rados.0.trial188.stdout:2581: finishing write tid 4 to trial18843701-49 2026-02-13T20:22:48.146 INFO:tasks.rados.rados.0.trial188.stdout:2581: finishing write tid 5 to trial18843701-49 2026-02-13T20:22:48.146 INFO:tasks.rados.rados.0.trial188.stdout:2581: oid 49 updating version 0 to 1206 2026-02-13T20:22:48.146 INFO:tasks.rados.rados.0.trial188.stdout:2581: oid 49 version 1206 is already newer than 1205 2026-02-13T20:22:48.146 INFO:tasks.rados.rados.0.trial188.stdout:2581: oid 49 updating version 1206 to 1207 2026-02-13T20:22:48.146 INFO:tasks.rados.rados.0.trial188.stdout:2581: oid 49 updating version 1207 to 1208 2026-02-13T20:22:48.146 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 49 v 1208 (ObjNum 895 snap 270 seq_num 895) dirty exists 2026-02-13T20:22:48.146 INFO:tasks.rados.rados.0.trial188.stdout:2581: left oid 49 (ObjNum 895 snap 270 seq_num 895) 2026-02-13T20:22:48.146 INFO:tasks.rados.rados.0.trial188.stdout:2584: finishing write tid 5 to trial18843701-34 2026-02-13T20:22:48.146 INFO:tasks.rados.rados.0.trial188.stdout:2584: oid 34 updating version 0 to 1249 2026-02-13T20:22:48.146 INFO:tasks.rados.rados.0.trial188.stdout:2584: oid 34 updating version 1249 to 1250 2026-02-13T20:22:48.147 INFO:tasks.rados.rados.0.trial188.stdout:2584: oid 34 version 1250 is already newer than 1247 2026-02-13T20:22:48.147 INFO:tasks.rados.rados.0.trial188.stdout:2584: oid 34 version 1250 is already newer than 1248 2026-02-13T20:22:48.147 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 34 v 1250 (ObjNum 896 snap 270 seq_num 896) dirty exists 2026-02-13T20:22:48.147 INFO:tasks.rados.rados.0.trial188.stdout:2584: left oid 34 (ObjNum 896 snap 270 seq_num 896) 2026-02-13T20:22:48.147 INFO:tasks.rados.rados.0.trial188.stdout:2585: finishing copy_from racing read to trial18843701-41 2026-02-13T20:22:48.147 INFO:tasks.rados.rados.0.trial188.stdout:2585: finishing copy_from to trial18843701-41 2026-02-13T20:22:48.147 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 41 v 1228 (ObjNum 671 snap 185 seq_num 671) dirty exists 2026-02-13T20:22:48.147 INFO:tasks.rados.rados.0.trial188.stdout:2588: seq_num 898 ranges {692686=503256,1848830=425967,2910671=182015} 2026-02-13T20:22:48.148 INFO:tasks.rados.rados.0.trial188.stdout:2588: writing trial18843701-30 from 692686 to 1195942 tid 1 2026-02-13T20:22:48.152 INFO:tasks.rados.rados.0.trial188.stdout:2588: writing trial18843701-30 from 1848830 to 2274797 tid 2 2026-02-13T20:22:48.156 INFO:tasks.rados.rados.0.trial188.stdout:2588: writing trial18843701-30 from 2910671 to 3092686 tid 3 2026-02-13T20:22:48.156 INFO:tasks.rados.rados.0.trial188.stdout:2581: done (5 left) 2026-02-13T20:22:48.156 INFO:tasks.rados.rados.0.trial188.stdout:2584: done (4 left) 2026-02-13T20:22:48.156 INFO:tasks.rados.rados.0.trial188.stdout:2585: done (3 left) 2026-02-13T20:22:48.156 INFO:tasks.rados.rados.0.trial188.stdout:2589: snap_create 2026-02-13T20:22:48.156 INFO:tasks.rados.rados.0.trial188.stdout:2587: expect (ObjNum 894 snap 270 seq_num 894) 2026-02-13T20:22:48.173 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:22:48.195 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:22:48.218 INFO:tasks.rados.rados.0.trial188.stdout:2586: finishing write tid 1 to trial18843701-21 2026-02-13T20:22:48.218 INFO:tasks.rados.rados.0.trial188.stdout:2586: finishing write tid 2 to trial18843701-21 2026-02-13T20:22:48.218 INFO:tasks.rados.rados.0.trial188.stdout:2586: finishing write tid 3 to trial18843701-21 2026-02-13T20:22:48.218 INFO:tasks.rados.rados.0.trial188.stdout:2586: finishing write tid 4 to trial18843701-21 2026-02-13T20:22:48.218 INFO:tasks.rados.rados.0.trial188.stdout:2586: oid 21 updating version 0 to 570 2026-02-13T20:22:48.218 INFO:tasks.rados.rados.0.trial188.stdout:2586: oid 21 updating version 570 to 572 2026-02-13T20:22:48.218 INFO:tasks.rados.rados.0.trial188.stdout:2586: oid 21 version 572 is already newer than 571 2026-02-13T20:22:48.218 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 21 v 572 (ObjNum 897 snap 270 seq_num 897) dirty exists 2026-02-13T20:22:48.218 INFO:tasks.rados.rados.0.trial188.stdout:2586: left oid 21 (ObjNum 897 snap 270 seq_num 897) 2026-02-13T20:22:48.219 INFO:tasks.rados.rados.0.trial188.stdout:2588: finishing write tid 1 to trial18843701-30 2026-02-13T20:22:48.219 INFO:tasks.rados.rados.0.trial188.stdout:2588: finishing write tid 2 to trial18843701-30 2026-02-13T20:22:48.219 INFO:tasks.rados.rados.0.trial188.stdout:2588: finishing write tid 3 to trial18843701-30 2026-02-13T20:22:48.219 INFO:tasks.rados.rados.0.trial188.stdout:2588: finishing write tid 4 to trial18843701-30 2026-02-13T20:22:48.219 INFO:tasks.rados.rados.0.trial188.stdout:2588: finishing write tid 5 to trial18843701-30 2026-02-13T20:22:48.219 INFO:tasks.rados.rados.0.trial188.stdout:2588: oid 30 updating version 0 to 1212 2026-02-13T20:22:48.219 INFO:tasks.rados.rados.0.trial188.stdout:2588: oid 30 version 1212 is already newer than 1210 2026-02-13T20:22:48.219 INFO:tasks.rados.rados.0.trial188.stdout:2588: oid 30 version 1212 is already newer than 1211 2026-02-13T20:22:48.219 INFO:tasks.rados.rados.0.trial188.stdout:2588: oid 30 version 1212 is already newer than 1209 2026-02-13T20:22:48.219 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 30 v 1212 (ObjNum 898 snap 270 seq_num 898) dirty exists 2026-02-13T20:22:48.219 INFO:tasks.rados.rados.0.trial188.stdout:2588: left oid 30 (ObjNum 898 snap 270 seq_num 898) 2026-02-13T20:22:48.888 INFO:tasks.rados.rados.0.trial188.stdout:2586: done (3 left) 2026-02-13T20:22:48.888 INFO:tasks.rados.rados.0.trial188.stdout:2587: done (2 left) 2026-02-13T20:22:48.888 INFO:tasks.rados.rados.0.trial188.stdout:2588: done (1 left) 2026-02-13T20:22:48.889 INFO:tasks.rados.rados.0.trial188.stdout:2589: done (0 left) 2026-02-13T20:22:48.889 INFO:tasks.rados.rados.0.trial188.stdout:2590: snap_remove snap 252 2026-02-13T20:22:49.890 INFO:tasks.rados.rados.0.trial188.stdout:2590: done (0 left) 2026-02-13T20:22:49.890 INFO:tasks.rados.rados.0.trial188.stdout:2591: read oid 30 snap -1 2026-02-13T20:22:49.890 INFO:tasks.rados.rados.0.trial188.stdout:2591: expect (ObjNum 898 snap 270 seq_num 898) 2026-02-13T20:22:49.890 INFO:tasks.rados.rados.0.trial188.stdout:2592: snap_remove snap 257 2026-02-13T20:22:50.893 INFO:tasks.rados.rados.0.trial188.stdout:2592: done (1 left) 2026-02-13T20:22:50.893 INFO:tasks.rados.rados.0.trial188.stdout:2593: read oid 33 snap -1 2026-02-13T20:22:50.893 INFO:tasks.rados.rados.0.trial188.stdout:2593: expect (ObjNum 866 snap 252 seq_num 866) 2026-02-13T20:22:50.893 INFO:tasks.rados.rados.0.trial188.stdout:2594: write oid 22 current snap is 271 2026-02-13T20:22:50.894 INFO:tasks.rados.rados.0.trial188.stdout:2591: expect (ObjNum 898 snap 270 seq_num 898) 2026-02-13T20:22:50.932 INFO:tasks.rados.rados.0.trial188.stdout:2593: expect (ObjNum 866 snap 252 seq_num 866) 2026-02-13T20:22:51.064 INFO:tasks.rados.rados.0.trial188.stdout:2594: seq_num 899 ranges {709493=578505,1907312=685978} 2026-02-13T20:22:51.069 INFO:tasks.rados.rados.0.trial188.stdout:2594: writing trial18843701-22 from 709493 to 1287998 tid 1 2026-02-13T20:22:51.075 INFO:tasks.rados.rados.0.trial188.stdout:2594: writing trial18843701-22 from 1907312 to 2593290 tid 2 2026-02-13T20:22:51.075 INFO:tasks.rados.rados.0.trial188.stdout:2591: done (2 left) 2026-02-13T20:22:51.075 INFO:tasks.rados.rados.0.trial188.stdout:2593: done (1 left) 2026-02-13T20:22:51.075 INFO:tasks.rados.rados.0.trial188.stdout:2595: copy_from oid 12 from oid 32 current snap is 271 2026-02-13T20:22:51.075 INFO:tasks.rados.rados.0.trial188.stdout:2596: rollback oid 41 current snap is 271 2026-02-13T20:22:51.075 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 41 to 270 2026-02-13T20:22:51.075 INFO:tasks.rados.rados.0.trial188.stdout:2597: read oid 40 snap 244 2026-02-13T20:22:51.076 INFO:tasks.rados.rados.0.trial188.stdout:2597: expect (ObjNum 708 snap 203 seq_num 708) 2026-02-13T20:22:51.076 INFO:tasks.rados.rados.0.trial188.stdout:2598: copy_from oid 4 from oid 3 current snap is 271 2026-02-13T20:22:51.076 INFO:tasks.rados.rados.0.trial188.stdout:2599: read oid 20 snap -1 2026-02-13T20:22:51.076 INFO:tasks.rados.rados.0.trial188.stdout:2599: expect deleted 2026-02-13T20:22:51.076 INFO:tasks.rados.rados.0.trial188.stdout:2600: copy_from oid 13 from oid 34 current snap is 271 2026-02-13T20:22:51.076 INFO:tasks.rados.rados.0.trial188.stdout:2601: delete oid 14 current snap is 271 2026-02-13T20:22:51.077 INFO:tasks.rados.rados.0.trial188.stdout:2599: done (7 left) 2026-02-13T20:22:51.078 INFO:tasks.rados.rados.0.trial188.stdout:2601: done (6 left) 2026-02-13T20:22:51.078 INFO:tasks.rados.rados.0.trial188.stdout:2602: read oid 5 snap -1 2026-02-13T20:22:51.078 INFO:tasks.rados.rados.0.trial188.stdout:2602: expect deleted 2026-02-13T20:22:51.078 INFO:tasks.rados.rados.0.trial188.stdout:2603: delete oid 9 current snap is 271 2026-02-13T20:22:51.079 INFO:tasks.rados.rados.0.trial188.stdout:2603: done (7 left) 2026-02-13T20:22:51.080 INFO:tasks.rados.rados.0.trial188.stdout:2604: write (excl) oid 7 current snap is 271 2026-02-13T20:22:51.080 INFO:tasks.rados.rados.0.trial188.stdout:2604: seq_num 902 ranges {759914=404252,1566405=433305,2504010=655904} 2026-02-13T20:22:51.084 INFO:tasks.rados.rados.0.trial188.stdout:2604: writing trial18843701-7 from 759914 to 1164166 tid 1 2026-02-13T20:22:51.087 INFO:tasks.rados.rados.0.trial188.stdout:2604: writing trial18843701-7 from 1566405 to 1999710 tid 2 2026-02-13T20:22:51.092 INFO:tasks.rados.rados.0.trial188.stdout:2604: writing trial18843701-7 from 2504010 to 3159914 tid 3 2026-02-13T20:22:51.092 INFO:tasks.rados.rados.0.trial188.stdout:2605: rollback oid 37 current snap is 271 2026-02-13T20:22:51.092 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 37 to 268 2026-02-13T20:22:51.092 INFO:tasks.rados.rados.0.trial188.stdout:2597: expect (ObjNum 708 snap 203 seq_num 708) 2026-02-13T20:22:51.098 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 845488 2026-02-13T20:22:51.199 INFO:tasks.rados.rados.0.trial188.stdout:2596: finishing rollback tid 0 to trial18843701-41 2026-02-13T20:22:51.199 INFO:tasks.rados.rados.0.trial188.stdout:2597: done (8 left) 2026-02-13T20:22:51.199 INFO:tasks.rados.rados.0.trial188.stdout:2602: done (7 left) 2026-02-13T20:22:51.199 INFO:tasks.rados.rados.0.trial188.stdout:2606: read oid 46 snap 270 2026-02-13T20:22:51.199 INFO:tasks.rados.rados.0.trial188.stdout:2606: expect (ObjNum 872 snap 255 seq_num 872) 2026-02-13T20:22:51.199 INFO:tasks.rados.rados.0.trial188.stdout:2607: read oid 18 snap -1 2026-02-13T20:22:51.199 INFO:tasks.rados.rados.0.trial188.stdout:2607: expect (ObjNum 876 snap 262 seq_num 876) 2026-02-13T20:22:51.199 INFO:tasks.rados.rados.0.trial188.stdout:2608: delete oid 15 current snap is 271 2026-02-13T20:22:51.199 INFO:tasks.rados.rados.0.trial188.stdout:2594: finishing write tid 1 to trial18843701-22 2026-02-13T20:22:51.199 INFO:tasks.rados.rados.0.trial188.stdout:2596: finishing rollback tid 1 to trial18843701-41 2026-02-13T20:22:51.199 INFO:tasks.rados.rados.0.trial188.stdout:2596: finishing rollback tid 2 to trial18843701-41 2026-02-13T20:22:51.199 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 41 v 1231 (ObjNum 671 snap 185 seq_num 671) dirty exists 2026-02-13T20:22:51.199 INFO:tasks.rados.rados.0.trial188.stdout:2594: finishing write tid 2 to trial18843701-22 2026-02-13T20:22:51.199 INFO:tasks.rados.rados.0.trial188.stdout:2594: finishing write tid 3 to trial18843701-22 2026-02-13T20:22:51.199 INFO:tasks.rados.rados.0.trial188.stdout:2594: finishing write tid 4 to trial18843701-22 2026-02-13T20:22:51.199 INFO:tasks.rados.rados.0.trial188.stdout:2594: oid 22 updating version 0 to 1059 2026-02-13T20:22:51.199 INFO:tasks.rados.rados.0.trial188.stdout:2594: oid 22 updating version 1059 to 1061 2026-02-13T20:22:51.199 INFO:tasks.rados.rados.0.trial188.stdout:2594: oid 22 version 1061 is already newer than 1060 2026-02-13T20:22:51.199 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 22 v 1061 (ObjNum 899 snap 271 seq_num 899) dirty exists 2026-02-13T20:22:51.199 INFO:tasks.rados.rados.0.trial188.stdout:2594: left oid 22 (ObjNum 899 snap 271 seq_num 899) 2026-02-13T20:22:51.199 INFO:tasks.rados.rados.0.trial188.stdout:2605: finishing rollback tid 1 to trial18843701-37 2026-02-13T20:22:51.199 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 37 v 1207 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-13T20:22:51.199 INFO:tasks.rados.rados.0.trial188.stdout:2604: finishing write tid 1 to trial18843701-7 2026-02-13T20:22:51.199 INFO:tasks.rados.rados.0.trial188.stdout:2598: finishing copy_from racing read to trial18843701-4 2026-02-13T20:22:51.199 INFO:tasks.rados.rados.0.trial188.stdout:2598: finishing copy_from to trial18843701-4 2026-02-13T20:22:51.199 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 4 v 966 (ObjNum 892 snap 269 seq_num 892) dirty exists 2026-02-13T20:22:51.199 INFO:tasks.rados.rados.0.trial188.stdout:2600: finishing copy_from racing read to trial18843701-13 2026-02-13T20:22:51.199 INFO:tasks.rados.rados.0.trial188.stdout:2595: finishing copy_from racing read to trial18843701-12 2026-02-13T20:22:51.200 INFO:tasks.rados.rados.0.trial188.stdout:2604: finishing write tid 2 to trial18843701-7 2026-02-13T20:22:51.200 INFO:tasks.rados.rados.0.trial188.stdout:2604: finishing write tid 3 to trial18843701-7 2026-02-13T20:22:51.200 INFO:tasks.rados.rados.0.trial188.stdout:2604: finishing write tid 4 to trial18843701-7 2026-02-13T20:22:51.200 INFO:tasks.rados.rados.0.trial188.stdout:2595: finishing copy_from to trial18843701-12 2026-02-13T20:22:51.200 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 12 v 958 (ObjNum 739 snap 220 seq_num 739) dirty exists 2026-02-13T20:22:51.200 INFO:tasks.rados.rados.0.trial188.stdout:2600: finishing copy_from to trial18843701-13 2026-02-13T20:22:51.200 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 13 v 1250 (ObjNum 896 snap 270 seq_num 896) dirty exists 2026-02-13T20:22:51.200 INFO:tasks.rados.rados.0.trial188.stdout:2604: finishing write tid 5 to trial18843701-7 2026-02-13T20:22:51.200 INFO:tasks.rados.rados.0.trial188.stdout:2604: oid 7 updating version 0 to 1101 2026-02-13T20:22:51.200 INFO:tasks.rados.rados.0.trial188.stdout:2604: oid 7 version 1101 is already newer than 1099 2026-02-13T20:22:51.200 INFO:tasks.rados.rados.0.trial188.stdout:2604: oid 7 version 1101 is already newer than 1098 2026-02-13T20:22:51.200 INFO:tasks.rados.rados.0.trial188.stdout:2604: oid 7 version 1101 is already newer than 1100 2026-02-13T20:22:51.200 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 7 v 1101 (ObjNum 902 snap 271 seq_num 902) dirty exists 2026-02-13T20:22:51.200 INFO:tasks.rados.rados.0.trial188.stdout:2604: left oid 7 (ObjNum 902 snap 271 seq_num 902) 2026-02-13T20:22:51.200 INFO:tasks.rados.rados.0.trial188.stdout:2594: done (9 left) 2026-02-13T20:22:51.201 INFO:tasks.rados.rados.0.trial188.stdout:2595: done (8 left) 2026-02-13T20:22:51.201 INFO:tasks.rados.rados.0.trial188.stdout:2596: done (7 left) 2026-02-13T20:22:51.201 INFO:tasks.rados.rados.0.trial188.stdout:2598: done (6 left) 2026-02-13T20:22:51.201 INFO:tasks.rados.rados.0.trial188.stdout:2600: done (5 left) 2026-02-13T20:22:51.201 INFO:tasks.rados.rados.0.trial188.stdout:2604: done (4 left) 2026-02-13T20:22:51.201 INFO:tasks.rados.rados.0.trial188.stdout:2605: done (3 left) 2026-02-13T20:22:51.201 INFO:tasks.rados.rados.0.trial188.stdout:2608: done (2 left) 2026-02-13T20:22:51.201 INFO:tasks.rados.rados.0.trial188.stdout:2609: read oid 3 snap 255 2026-02-13T20:22:51.201 INFO:tasks.rados.rados.0.trial188.stdout:2609: expect deleted 2026-02-13T20:22:51.201 INFO:tasks.rados.rados.0.trial188.stdout:2610: snap_remove snap 266 2026-02-13T20:22:51.874 INFO:tasks.rados.rados.0.trial188.stdout:2610: done (3 left) 2026-02-13T20:22:51.875 INFO:tasks.rados.rados.0.trial188.stdout:2611: write (excl) oid 5 current snap is 271 2026-02-13T20:22:51.875 INFO:tasks.rados.rados.0.trial188.stdout:2611: seq_num 904 ranges {793528=554750,2083369=436974,2958856=234672} 2026-02-13T20:22:51.880 INFO:tasks.rados.rados.0.trial188.stdout:2611: writing trial18843701-5 from 793528 to 1348278 tid 1 2026-02-13T20:22:51.884 INFO:tasks.rados.rados.0.trial188.stdout:2611: writing trial18843701-5 from 2083369 to 2520343 tid 2 2026-02-13T20:22:51.887 INFO:tasks.rados.rados.0.trial188.stdout:2611: writing trial18843701-5 from 2958856 to 3193528 tid 3 2026-02-13T20:22:51.888 INFO:tasks.rados.rados.0.trial188.stdout:2612: write oid 32 current snap is 271 2026-02-13T20:22:51.888 INFO:tasks.rados.rados.0.trial188.stdout:2612: seq_num 905 ranges {410335=746352,1741851=696985,3102632=107703} 2026-02-13T20:22:51.892 INFO:tasks.rados.rados.0.trial188.stdout:2612: writing trial18843701-32 from 410335 to 1156687 tid 1 2026-02-13T20:22:51.896 INFO:tasks.rados.rados.0.trial188.stdout:2612: writing trial18843701-32 from 1741851 to 2438836 tid 2 2026-02-13T20:22:51.899 INFO:tasks.rados.rados.0.trial188.stdout:2612: writing trial18843701-32 from 3102632 to 3210335 tid 3 2026-02-13T20:22:51.899 INFO:tasks.rados.rados.0.trial188.stdout:2613: snap_remove snap 268 2026-02-13T20:22:52.896 INFO:tasks.rados.rados.0.trial188.stdout:2613: done (5 left) 2026-02-13T20:22:52.896 INFO:tasks.rados.rados.0.trial188.stdout:2614: read oid 40 snap 241 2026-02-13T20:22:52.896 INFO:tasks.rados.rados.0.trial188.stdout:2614: expect deleted 2026-02-13T20:22:52.896 INFO:tasks.rados.rados.0.trial188.stdout:2615: copy_from oid 41 from oid 33 current snap is 271 2026-02-13T20:22:52.896 INFO:tasks.rados.rados.0.trial188.stdout:2606: expect (ObjNum 872 snap 255 seq_num 872) 2026-02-13T20:22:52.957 INFO:tasks.rados.rados.0.trial188.stdout:2607: expect (ObjNum 876 snap 262 seq_num 876) 2026-02-13T20:22:53.013 INFO:tasks.rados.rados.0.trial188.stdout:2606: done (6 left) 2026-02-13T20:22:53.013 INFO:tasks.rados.rados.0.trial188.stdout:2607: done (5 left) 2026-02-13T20:22:53.013 INFO:tasks.rados.rados.0.trial188.stdout:2609: done (4 left) 2026-02-13T20:22:53.013 INFO:tasks.rados.rados.0.trial188.stdout:2616: read oid 2 snap 228 2026-02-13T20:22:53.013 INFO:tasks.rados.rados.0.trial188.stdout:2616: expect (ObjNum 728 snap 214 seq_num 728) 2026-02-13T20:22:53.013 INFO:tasks.rados.rados.0.trial188.stdout:2617: write oid 25 current snap is 271 2026-02-13T20:22:53.013 INFO:tasks.rados.rados.0.trial188.stdout:2611: finishing write tid 1 to trial18843701-5 2026-02-13T20:22:53.013 INFO:tasks.rados.rados.0.trial188.stdout:2611: finishing write tid 2 to trial18843701-5 2026-02-13T20:22:53.014 INFO:tasks.rados.rados.0.trial188.stdout:2611: finishing write tid 3 to trial18843701-5 2026-02-13T20:22:53.014 INFO:tasks.rados.rados.0.trial188.stdout:2611: finishing write tid 4 to trial18843701-5 2026-02-13T20:22:53.014 INFO:tasks.rados.rados.0.trial188.stdout:2611: finishing write tid 5 to trial18843701-5 2026-02-13T20:22:53.014 INFO:tasks.rados.rados.0.trial188.stdout:2611: oid 5 updating version 0 to 1252 2026-02-13T20:22:53.014 INFO:tasks.rados.rados.0.trial188.stdout:2611: oid 5 updating version 1252 to 1254 2026-02-13T20:22:53.014 INFO:tasks.rados.rados.0.trial188.stdout:2611: oid 5 version 1254 is already newer than 1251 2026-02-13T20:22:53.014 INFO:tasks.rados.rados.0.trial188.stdout:2611: oid 5 version 1254 is already newer than 1253 2026-02-13T20:22:53.014 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 5 v 1254 (ObjNum 904 snap 271 seq_num 904) dirty exists 2026-02-13T20:22:53.014 INFO:tasks.rados.rados.0.trial188.stdout:2611: left oid 5 (ObjNum 904 snap 271 seq_num 904) 2026-02-13T20:22:53.014 INFO:tasks.rados.rados.0.trial188.stdout:2612: finishing write tid 1 to trial18843701-32 2026-02-13T20:22:53.014 INFO:tasks.rados.rados.0.trial188.stdout:2612: finishing write tid 2 to trial18843701-32 2026-02-13T20:22:53.014 INFO:tasks.rados.rados.0.trial188.stdout:2612: finishing write tid 3 to trial18843701-32 2026-02-13T20:22:53.014 INFO:tasks.rados.rados.0.trial188.stdout:2612: finishing write tid 4 to trial18843701-32 2026-02-13T20:22:53.015 INFO:tasks.rados.rados.0.trial188.stdout:2612: finishing write tid 5 to trial18843701-32 2026-02-13T20:22:53.015 INFO:tasks.rados.rados.0.trial188.stdout:2612: oid 32 updating version 0 to 1235 2026-02-13T20:22:53.015 INFO:tasks.rados.rados.0.trial188.stdout:2612: oid 32 version 1235 is already newer than 1233 2026-02-13T20:22:53.015 INFO:tasks.rados.rados.0.trial188.stdout:2612: oid 32 version 1235 is already newer than 1234 2026-02-13T20:22:53.015 INFO:tasks.rados.rados.0.trial188.stdout:2612: oid 32 version 1235 is already newer than 1232 2026-02-13T20:22:53.015 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 32 v 1235 (ObjNum 905 snap 271 seq_num 905) dirty exists 2026-02-13T20:22:53.015 INFO:tasks.rados.rados.0.trial188.stdout:2612: left oid 32 (ObjNum 905 snap 271 seq_num 905) 2026-02-13T20:22:53.015 INFO:tasks.rados.rados.0.trial188.stdout:2615: finishing copy_from racing read to trial18843701-41 2026-02-13T20:22:53.015 INFO:tasks.rados.rados.0.trial188.stdout:2617: seq_num 906 ranges {427142=421601,1400333=440643,2613702=450326} 2026-02-13T20:22:53.016 INFO:tasks.rados.rados.0.trial188.stdout:2617: writing trial18843701-25 from 427142 to 848743 tid 1 2026-02-13T20:22:53.019 INFO:tasks.rados.rados.0.trial188.stdout:2617: writing trial18843701-25 from 1400333 to 1840976 tid 2 2026-02-13T20:22:53.024 INFO:tasks.rados.rados.0.trial188.stdout:2617: writing trial18843701-25 from 2613702 to 3064028 tid 3 2026-02-13T20:22:53.024 INFO:tasks.rados.rados.0.trial188.stdout:2611: done (5 left) 2026-02-13T20:22:53.024 INFO:tasks.rados.rados.0.trial188.stdout:2612: done (4 left) 2026-02-13T20:22:53.024 INFO:tasks.rados.rados.0.trial188.stdout:2614: done (3 left) 2026-02-13T20:22:53.024 INFO:tasks.rados.rados.0.trial188.stdout:2618: snap_create 2026-02-13T20:22:53.025 INFO:tasks.rados.rados.0.trial188.stdout:2615: finishing copy_from to trial18843701-41 2026-02-13T20:22:53.025 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 41 v 738 (ObjNum 866 snap 252 seq_num 866) dirty exists 2026-02-13T20:22:53.025 INFO:tasks.rados.rados.0.trial188.stdout:2616: expect (ObjNum 728 snap 214 seq_num 728) 2026-02-13T20:22:53.048 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:22:53.064 INFO:tasks.rados.rados.0.trial188.stdout:2617: finishing write tid 1 to trial18843701-25 2026-02-13T20:22:53.064 INFO:tasks.rados.rados.0.trial188.stdout:2617: finishing write tid 2 to trial18843701-25 2026-02-13T20:22:53.064 INFO:tasks.rados.rados.0.trial188.stdout:2617: finishing write tid 3 to trial18843701-25 2026-02-13T20:22:53.064 INFO:tasks.rados.rados.0.trial188.stdout:2617: finishing write tid 4 to trial18843701-25 2026-02-13T20:22:53.064 INFO:tasks.rados.rados.0.trial188.stdout:2617: finishing write tid 5 to trial18843701-25 2026-02-13T20:22:53.064 INFO:tasks.rados.rados.0.trial188.stdout:2617: oid 25 updating version 0 to 1225 2026-02-13T20:22:53.064 INFO:tasks.rados.rados.0.trial188.stdout:2617: oid 25 updating version 1225 to 1227 2026-02-13T20:22:53.065 INFO:tasks.rados.rados.0.trial188.stdout:2617: oid 25 version 1227 is already newer than 1226 2026-02-13T20:22:53.065 INFO:tasks.rados.rados.0.trial188.stdout:2617: oid 25 version 1227 is already newer than 1224 2026-02-13T20:22:53.065 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 25 v 1227 (ObjNum 906 snap 271 seq_num 906) dirty exists 2026-02-13T20:22:53.065 INFO:tasks.rados.rados.0.trial188.stdout:2617: left oid 25 (ObjNum 906 snap 271 seq_num 906) 2026-02-13T20:22:53.898 INFO:tasks.rados.rados.0.trial188.stdout:2615: done (3 left) 2026-02-13T20:22:53.899 INFO:tasks.rados.rados.0.trial188.stdout:2616: done (2 left) 2026-02-13T20:22:53.899 INFO:tasks.rados.rados.0.trial188.stdout:2617: done (1 left) 2026-02-13T20:22:53.899 INFO:tasks.rados.rados.0.trial188.stdout:2618: done (0 left) 2026-02-13T20:22:53.899 INFO:tasks.rados.rados.0.trial188.stdout:2619: read oid 11 snap 241 2026-02-13T20:22:53.899 INFO:tasks.rados.rados.0.trial188.stdout:2619: expect (ObjNum 618 snap 163 seq_num 618) 2026-02-13T20:22:53.899 INFO:tasks.rados.rados.0.trial188.stdout:2620: delete oid 15 current snap is 272 2026-02-13T20:22:53.904 INFO:tasks.rados.rados.0.trial188.stdout:2620: done (1 left) 2026-02-13T20:22:53.905 INFO:tasks.rados.rados.0.trial188.stdout:2621: snap_create 2026-02-13T20:22:53.908 INFO:tasks.rados.rados.0.trial188.stdout:2619: expect (ObjNum 618 snap 163 seq_num 618) 2026-02-13T20:22:54.901 INFO:tasks.rados.rados.0.trial188.stdout:2619: done (1 left) 2026-02-13T20:22:54.901 INFO:tasks.rados.rados.0.trial188.stdout:2621: done (0 left) 2026-02-13T20:22:54.901 INFO:tasks.rados.rados.0.trial188.stdout:2622: copy_from oid 39 from oid 45 current snap is 273 2026-02-13T20:22:54.901 INFO:tasks.rados.rados.0.trial188.stdout:2623: copy_from oid 10 from oid 23 current snap is 273 2026-02-13T20:22:54.901 INFO:tasks.rados.rados.0.trial188.stdout:2624: rollback oid 5 current snap is 273 2026-02-13T20:22:54.902 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 5 to 267 2026-02-13T20:22:54.902 INFO:tasks.rados.rados.0.trial188.stdout:2625: snap_create 2026-02-13T20:22:54.902 INFO:tasks.rados.rados.0.trial188.stdout:2623: finishing copy_from to trial18843701-10 2026-02-13T20:22:54.903 INFO:tasks.rados.rados.0.trial188.stdout:2623: got expected ENOENT (src dne) 2026-02-13T20:22:54.903 INFO:tasks.rados.rados.0.trial188.stdout:2624: finishing rollback tid 0 to trial18843701-5 2026-02-13T20:22:54.903 INFO:tasks.rados.rados.0.trial188.stdout:2623: finishing copy_from racing read to trial18843701-10 2026-02-13T20:22:54.903 INFO:tasks.rados.rados.0.trial188.stdout:2624: finishing rollback tid 1 to trial18843701-5 2026-02-13T20:22:54.903 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 5 v 1256 (ObjNum 1 snap 0 seq_num 304) dirty dne 2026-02-13T20:22:54.926 INFO:tasks.rados.rados.0.trial188.stdout:2622: finishing copy_from racing read to trial18843701-39 2026-02-13T20:22:54.927 INFO:tasks.rados.rados.0.trial188.stdout:2622: finishing copy_from to trial18843701-39 2026-02-13T20:22:54.927 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 39 v 1233 (ObjNum 752 snap 222 seq_num 752) dirty exists 2026-02-13T20:22:55.902 INFO:tasks.rados.rados.0.trial188.stdout:2622: done (3 left) 2026-02-13T20:22:55.902 INFO:tasks.rados.rados.0.trial188.stdout:2623: done (2 left) 2026-02-13T20:22:55.902 INFO:tasks.rados.rados.0.trial188.stdout:2624: done (1 left) 2026-02-13T20:22:55.902 INFO:tasks.rados.rados.0.trial188.stdout:2625: done (0 left) 2026-02-13T20:22:55.902 INFO:tasks.rados.rados.0.trial188.stdout:2626: delete oid 25 current snap is 274 2026-02-13T20:22:55.904 INFO:tasks.rados.rados.0.trial188.stdout:2626: done (0 left) 2026-02-13T20:22:55.904 INFO:tasks.rados.rados.0.trial188.stdout:2627: read oid 22 snap -1 2026-02-13T20:22:55.904 INFO:tasks.rados.rados.0.trial188.stdout:2627: expect (ObjNum 899 snap 271 seq_num 899) 2026-02-13T20:22:55.904 INFO:tasks.rados.rados.0.trial188.stdout:2628: read oid 47 snap -1 2026-02-13T20:22:55.904 INFO:tasks.rados.rados.0.trial188.stdout:2628: expect (ObjNum 867 snap 252 seq_num 867) 2026-02-13T20:22:55.904 INFO:tasks.rados.rados.0.trial188.stdout:2629: snap_remove snap 265 2026-02-13T20:22:56.874 INFO:tasks.rados.rados.0.trial188.stdout:2629: done (2 left) 2026-02-13T20:22:56.875 INFO:tasks.rados.rados.0.trial188.stdout:2630: copy_from oid 2 from oid 36 current snap is 274 2026-02-13T20:22:56.875 INFO:tasks.rados.rados.0.trial188.stdout:2627: expect (ObjNum 899 snap 271 seq_num 899) 2026-02-13T20:22:56.875 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 445871 2026-02-13T20:22:56.900 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1612750 2026-02-13T20:22:56.935 INFO:tasks.rados.rados.0.trial188.stdout:2628: expect (ObjNum 867 snap 252 seq_num 867) 2026-02-13T20:22:56.935 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:22:56.981 INFO:tasks.rados.rados.0.trial188.stdout:2630: finishing copy_from racing read to trial18843701-2 2026-02-13T20:22:56.982 INFO:tasks.rados.rados.0.trial188.stdout:2630: finishing copy_from to trial18843701-2 2026-02-13T20:22:56.982 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 2 v 998 (ObjNum 867 snap 252 seq_num 867) dirty exists 2026-02-13T20:22:56.982 INFO:tasks.rados.rados.0.trial188.stdout:2627: done (2 left) 2026-02-13T20:22:56.982 INFO:tasks.rados.rados.0.trial188.stdout:2628: done (1 left) 2026-02-13T20:22:56.982 INFO:tasks.rados.rados.0.trial188.stdout:2630: done (0 left) 2026-02-13T20:22:56.982 INFO:tasks.rados.rados.0.trial188.stdout:2631: delete oid 43 current snap is 274 2026-02-13T20:22:56.983 INFO:tasks.rados.rados.0.trial188.stdout:2631: done (0 left) 2026-02-13T20:22:56.983 INFO:tasks.rados.rados.0.trial188.stdout:2632: snap_create 2026-02-13T20:22:57.909 INFO:tasks.rados.rados.0.trial188.stdout:2632: done (0 left) 2026-02-13T20:22:57.909 INFO:tasks.rados.rados.0.trial188.stdout:2633: delete oid 27 current snap is 275 2026-02-13T20:22:57.911 INFO:tasks.rados.rados.0.trial188.stdout:2633: done (0 left) 2026-02-13T20:22:57.911 INFO:tasks.rados.rados.0.trial188.stdout:2634: write oid 47 current snap is 275 2026-02-13T20:22:57.911 INFO:tasks.rados.rados.0.trial188.stdout:2634: seq_num 911 ranges {511177=797846,1976390=591639,3034464=276713} 2026-02-13T20:22:57.916 INFO:tasks.rados.rados.0.trial188.stdout:2634: writing trial18843701-47 from 511177 to 1309023 tid 1 2026-02-13T20:22:57.921 INFO:tasks.rados.rados.0.trial188.stdout:2634: writing trial18843701-47 from 1976390 to 2568029 tid 2 2026-02-13T20:22:57.925 INFO:tasks.rados.rados.0.trial188.stdout:2634: writing trial18843701-47 from 3034464 to 3311177 tid 3 2026-02-13T20:22:57.925 INFO:tasks.rados.rados.0.trial188.stdout:2635: read oid 16 snap -1 2026-02-13T20:22:57.925 INFO:tasks.rados.rados.0.trial188.stdout:2635: expect (ObjNum 645 snap 172 seq_num 645) 2026-02-13T20:22:57.925 INFO:tasks.rados.rados.0.trial188.stdout:2636: snap_create 2026-02-13T20:22:57.931 INFO:tasks.rados.rados.0.trial188.stdout:2635: expect (ObjNum 645 snap 172 seq_num 645) 2026-02-13T20:22:57.934 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 580354 2026-02-13T20:22:57.950 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:22:57.989 INFO:tasks.rados.rados.0.trial188.stdout:2634: finishing write tid 1 to trial18843701-47 2026-02-13T20:22:57.989 INFO:tasks.rados.rados.0.trial188.stdout:2634: finishing write tid 2 to trial18843701-47 2026-02-13T20:22:57.989 INFO:tasks.rados.rados.0.trial188.stdout:2634: finishing write tid 3 to trial18843701-47 2026-02-13T20:22:57.989 INFO:tasks.rados.rados.0.trial188.stdout:2634: finishing write tid 4 to trial18843701-47 2026-02-13T20:22:57.989 INFO:tasks.rados.rados.0.trial188.stdout:2634: finishing write tid 5 to trial18843701-47 2026-02-13T20:22:57.989 INFO:tasks.rados.rados.0.trial188.stdout:2634: oid 47 updating version 0 to 999 2026-02-13T20:22:57.990 INFO:tasks.rados.rados.0.trial188.stdout:2634: oid 47 updating version 999 to 1002 2026-02-13T20:22:57.990 INFO:tasks.rados.rados.0.trial188.stdout:2634: oid 47 version 1002 is already newer than 1000 2026-02-13T20:22:57.990 INFO:tasks.rados.rados.0.trial188.stdout:2634: oid 47 version 1002 is already newer than 1001 2026-02-13T20:22:57.990 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 47 v 1002 (ObjNum 911 snap 275 seq_num 911) dirty exists 2026-02-13T20:22:57.990 INFO:tasks.rados.rados.0.trial188.stdout:2634: left oid 47 (ObjNum 911 snap 275 seq_num 911) 2026-02-13T20:22:58.911 INFO:tasks.rados.rados.0.trial188.stdout:2634: done (2 left) 2026-02-13T20:22:58.911 INFO:tasks.rados.rados.0.trial188.stdout:2635: done (1 left) 2026-02-13T20:22:58.911 INFO:tasks.rados.rados.0.trial188.stdout:2636: done (0 left) 2026-02-13T20:22:58.911 INFO:tasks.rados.rados.0.trial188.stdout:2637: write (excl) oid 24 current snap is 276 2026-02-13T20:22:58.911 INFO:tasks.rados.rados.0.trial188.stdout:2637: seq_num 912 ranges {527984=473095,1634872=451650,2661887=634311} 2026-02-13T20:22:58.915 INFO:tasks.rados.rados.0.trial188.stdout:2637: writing trial18843701-24 from 527984 to 1001079 tid 1 2026-02-13T20:22:58.919 INFO:tasks.rados.rados.0.trial188.stdout:2637: writing trial18843701-24 from 1634872 to 2086522 tid 2 2026-02-13T20:22:58.924 INFO:tasks.rados.rados.0.trial188.stdout:2637: writing trial18843701-24 from 2661887 to 3296198 tid 3 2026-02-13T20:22:58.924 INFO:tasks.rados.rados.0.trial188.stdout:2638: copy_from oid 9 from oid 14 current snap is 276 2026-02-13T20:22:58.924 INFO:tasks.rados.rados.0.trial188.stdout:2639: write (excl) oid 31 current snap is 276 2026-02-13T20:22:58.924 INFO:tasks.rados.rados.0.trial188.stdout:2639: seq_num 913 ranges {544791=664697,1693354=595308,2689310=445583} 2026-02-13T20:22:58.928 INFO:tasks.rados.rados.0.trial188.stdout:2639: writing trial18843701-31 from 544791 to 1209488 tid 1 2026-02-13T20:22:58.932 INFO:tasks.rados.rados.0.trial188.stdout:2639: writing trial18843701-31 from 1693354 to 2288662 tid 2 2026-02-13T20:22:58.936 INFO:tasks.rados.rados.0.trial188.stdout:2639: writing trial18843701-31 from 2689310 to 3134893 tid 3 2026-02-13T20:22:58.936 INFO:tasks.rados.rados.0.trial188.stdout:2640: rollback oid 2 current snap is 276 2026-02-13T20:22:58.936 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 2 to 262 2026-02-13T20:22:58.936 INFO:tasks.rados.rados.0.trial188.stdout:2638: finishing copy_from to trial18843701-9 2026-02-13T20:22:58.936 INFO:tasks.rados.rados.0.trial188.stdout:2638: got expected ENOENT (src dne) 2026-02-13T20:22:58.937 INFO:tasks.rados.rados.0.trial188.stdout:2638: finishing copy_from racing read to trial18843701-9 2026-02-13T20:22:58.937 INFO:tasks.rados.rados.0.trial188.stdout:2638: done (3 left) 2026-02-13T20:22:58.937 INFO:tasks.rados.rados.0.trial188.stdout:2641: snap_remove snap 272 2026-02-13T20:22:59.917 INFO:tasks.rados.rados.0.trial188.stdout:2641: done (3 left) 2026-02-13T20:22:59.917 INFO:tasks.rados.rados.0.trial188.stdout:2642: delete oid 48 current snap is 276 2026-02-13T20:22:59.917 INFO:tasks.rados.rados.0.trial188.stdout:2637: finishing write tid 1 to trial18843701-24 2026-02-13T20:22:59.917 INFO:tasks.rados.rados.0.trial188.stdout:2640: finishing rollback tid 0 to trial18843701-2 2026-02-13T20:22:59.917 INFO:tasks.rados.rados.0.trial188.stdout:2640: finishing rollback tid 1 to trial18843701-2 2026-02-13T20:22:59.917 INFO:tasks.rados.rados.0.trial188.stdout:2640: finishing rollback tid 2 to trial18843701-2 2026-02-13T20:22:59.917 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 2 v 1259 (ObjNum 688 snap 199 seq_num 688) dirty exists 2026-02-13T20:22:59.917 INFO:tasks.rados.rados.0.trial188.stdout:2639: finishing write tid 1 to trial18843701-31 2026-02-13T20:22:59.917 INFO:tasks.rados.rados.0.trial188.stdout:2637: finishing write tid 2 to trial18843701-24 2026-02-13T20:22:59.917 INFO:tasks.rados.rados.0.trial188.stdout:2639: finishing write tid 2 to trial18843701-31 2026-02-13T20:22:59.917 INFO:tasks.rados.rados.0.trial188.stdout:2637: finishing write tid 3 to trial18843701-24 2026-02-13T20:22:59.917 INFO:tasks.rados.rados.0.trial188.stdout:2637: finishing write tid 4 to trial18843701-24 2026-02-13T20:22:59.917 INFO:tasks.rados.rados.0.trial188.stdout:2637: finishing write tid 5 to trial18843701-24 2026-02-13T20:22:59.917 INFO:tasks.rados.rados.0.trial188.stdout:2637: oid 24 updating version 0 to 1243 2026-02-13T20:22:59.918 INFO:tasks.rados.rados.0.trial188.stdout:2637: oid 24 updating version 1243 to 1244 2026-02-13T20:22:59.918 INFO:tasks.rados.rados.0.trial188.stdout:2637: oid 24 updating version 1244 to 1245 2026-02-13T20:22:59.918 INFO:tasks.rados.rados.0.trial188.stdout:2637: oid 24 version 1245 is already newer than 1242 2026-02-13T20:22:59.918 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 24 v 1245 (ObjNum 912 snap 276 seq_num 912) dirty exists 2026-02-13T20:22:59.918 INFO:tasks.rados.rados.0.trial188.stdout:2637: left oid 24 (ObjNum 912 snap 276 seq_num 912) 2026-02-13T20:22:59.918 INFO:tasks.rados.rados.0.trial188.stdout:2639: finishing write tid 3 to trial18843701-31 2026-02-13T20:22:59.918 INFO:tasks.rados.rados.0.trial188.stdout:2639: finishing write tid 4 to trial18843701-31 2026-02-13T20:22:59.918 INFO:tasks.rados.rados.0.trial188.stdout:2639: finishing write tid 5 to trial18843701-31 2026-02-13T20:22:59.918 INFO:tasks.rados.rados.0.trial188.stdout:2639: oid 31 updating version 0 to 964 2026-02-13T20:22:59.918 INFO:tasks.rados.rados.0.trial188.stdout:2639: oid 31 updating version 964 to 965 2026-02-13T20:22:59.918 INFO:tasks.rados.rados.0.trial188.stdout:2639: oid 31 updating version 965 to 966 2026-02-13T20:22:59.918 INFO:tasks.rados.rados.0.trial188.stdout:2639: oid 31 version 966 is already newer than 963 2026-02-13T20:22:59.918 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 31 v 966 (ObjNum 913 snap 276 seq_num 913) dirty exists 2026-02-13T20:22:59.918 INFO:tasks.rados.rados.0.trial188.stdout:2639: left oid 31 (ObjNum 913 snap 276 seq_num 913) 2026-02-13T20:22:59.919 INFO:tasks.rados.rados.0.trial188.stdout:2637: done (3 left) 2026-02-13T20:22:59.919 INFO:tasks.rados.rados.0.trial188.stdout:2639: done (2 left) 2026-02-13T20:22:59.919 INFO:tasks.rados.rados.0.trial188.stdout:2640: done (1 left) 2026-02-13T20:22:59.919 INFO:tasks.rados.rados.0.trial188.stdout:2642: done (0 left) 2026-02-13T20:22:59.919 INFO:tasks.rados.rados.0.trial188.stdout:2643: read oid 30 snap -1 2026-02-13T20:22:59.919 INFO:tasks.rados.rados.0.trial188.stdout:2643: expect (ObjNum 898 snap 270 seq_num 898) 2026-02-13T20:22:59.919 INFO:tasks.rados.rados.0.trial188.stdout:2644: delete oid 38 current snap is 276 2026-02-13T20:22:59.924 INFO:tasks.rados.rados.0.trial188.stdout:2643: expect (ObjNum 898 snap 270 seq_num 898) 2026-02-13T20:22:59.952 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1101176 2026-02-13T20:22:59.967 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:22:59.991 INFO:tasks.rados.rados.0.trial188.stdout:2643: done (1 left) 2026-02-13T20:22:59.991 INFO:tasks.rados.rados.0.trial188.stdout:2644: done (0 left) 2026-02-13T20:22:59.992 INFO:tasks.rados.rados.0.trial188.stdout:2645: read oid 29 snap -1 2026-02-13T20:22:59.992 INFO:tasks.rados.rados.0.trial188.stdout:2645: expect (ObjNum 868 snap 252 seq_num 868) 2026-02-13T20:22:59.992 INFO:tasks.rados.rados.0.trial188.stdout:2646: read oid 49 snap -1 2026-02-13T20:22:59.992 INFO:tasks.rados.rados.0.trial188.stdout:2646: expect (ObjNum 895 snap 270 seq_num 895) 2026-02-13T20:22:59.992 INFO:tasks.rados.rados.0.trial188.stdout:2647: delete oid 10 current snap is 276 2026-02-13T20:22:59.993 INFO:tasks.rados.rados.0.trial188.stdout:2646: expect (ObjNum 895 snap 270 seq_num 895) 2026-02-13T20:22:59.993 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:23:00.058 INFO:tasks.rados.rados.0.trial188.stdout:2645: expect (ObjNum 868 snap 252 seq_num 868) 2026-02-13T20:23:00.064 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1461488 2026-02-13T20:23:00.128 INFO:tasks.rados.rados.0.trial188.stdout:2645: done (2 left) 2026-02-13T20:23:00.128 INFO:tasks.rados.rados.0.trial188.stdout:2646: done (1 left) 2026-02-13T20:23:00.128 INFO:tasks.rados.rados.0.trial188.stdout:2647: done (0 left) 2026-02-13T20:23:00.128 INFO:tasks.rados.rados.0.trial188.stdout:2648: write (excl) oid 49 current snap is 276 2026-02-13T20:23:00.128 INFO:tasks.rados.rados.0.trial188.stdout:2648: seq_num 917 ranges {612019=565693,1810929=602646,3082649=329370} 2026-02-13T20:23:00.132 INFO:tasks.rados.rados.0.trial188.stdout:2648: writing trial18843701-49 from 612019 to 1177712 tid 1 2026-02-13T20:23:00.137 INFO:tasks.rados.rados.0.trial188.stdout:2648: writing trial18843701-49 from 1810929 to 2413575 tid 2 2026-02-13T20:23:00.141 INFO:tasks.rados.rados.0.trial188.stdout:2648: writing trial18843701-49 from 3082649 to 3412019 tid 3 2026-02-13T20:23:00.141 INFO:tasks.rados.rados.0.trial188.stdout:2649: snap_remove snap 274 2026-02-13T20:23:00.920 INFO:tasks.rados.rados.0.trial188.stdout:2649: done (1 left) 2026-02-13T20:23:00.920 INFO:tasks.rados.rados.0.trial188.stdout:2650: copy_from oid 40 from oid 11 current snap is 276 2026-02-13T20:23:00.920 INFO:tasks.rados.rados.0.trial188.stdout:2648: finishing write tid 1 to trial18843701-49 2026-02-13T20:23:00.921 INFO:tasks.rados.rados.0.trial188.stdout:2648: finishing write tid 2 to trial18843701-49 2026-02-13T20:23:00.921 INFO:tasks.rados.rados.0.trial188.stdout:2648: finishing write tid 3 to trial18843701-49 2026-02-13T20:23:00.921 INFO:tasks.rados.rados.0.trial188.stdout:2648: finishing write tid 4 to trial18843701-49 2026-02-13T20:23:00.921 INFO:tasks.rados.rados.0.trial188.stdout:2648: finishing write tid 5 to trial18843701-49 2026-02-13T20:23:00.921 INFO:tasks.rados.rados.0.trial188.stdout:2648: oid 49 updating version 0 to 1244 2026-02-13T20:23:00.921 INFO:tasks.rados.rados.0.trial188.stdout:2648: oid 49 updating version 1244 to 1246 2026-02-13T20:23:00.921 INFO:tasks.rados.rados.0.trial188.stdout:2648: oid 49 version 1246 is already newer than 1243 2026-02-13T20:23:00.921 INFO:tasks.rados.rados.0.trial188.stdout:2648: oid 49 version 1246 is already newer than 1245 2026-02-13T20:23:00.921 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 49 v 1246 (ObjNum 917 snap 276 seq_num 917) dirty exists 2026-02-13T20:23:00.921 INFO:tasks.rados.rados.0.trial188.stdout:2648: left oid 49 (ObjNum 917 snap 276 seq_num 917) 2026-02-13T20:23:00.921 INFO:tasks.rados.rados.0.trial188.stdout:2648: done (1 left) 2026-02-13T20:23:00.922 INFO:tasks.rados.rados.0.trial188.stdout:2651: copy_from oid 10 from oid 16 current snap is 276 2026-02-13T20:23:00.922 INFO:tasks.rados.rados.0.trial188.stdout:2652: snap_create 2026-02-13T20:23:00.944 INFO:tasks.rados.rados.0.trial188.stdout:2650: finishing copy_from racing read to trial18843701-40 2026-02-13T20:23:00.945 INFO:tasks.rados.rados.0.trial188.stdout:2651: finishing copy_from racing read to trial18843701-10 2026-02-13T20:23:00.945 INFO:tasks.rados.rados.0.trial188.stdout:2651: finishing copy_from to trial18843701-10 2026-02-13T20:23:00.945 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 10 v 1042 (ObjNum 645 snap 172 seq_num 645) dirty exists 2026-02-13T20:23:00.947 INFO:tasks.rados.rados.0.trial188.stdout:2650: finishing copy_from to trial18843701-40 2026-02-13T20:23:00.947 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 40 v 789 (ObjNum 894 snap 270 seq_num 894) dirty exists 2026-02-13T20:23:01.876 INFO:tasks.rados.rados.0.trial188.stdout:2650: done (2 left) 2026-02-13T20:23:01.876 INFO:tasks.rados.rados.0.trial188.stdout:2651: done (1 left) 2026-02-13T20:23:01.876 INFO:tasks.rados.rados.0.trial188.stdout:2652: done (0 left) 2026-02-13T20:23:01.876 INFO:tasks.rados.rados.0.trial188.stdout:2653: copy_from oid 38 from oid 29 current snap is 277 2026-02-13T20:23:01.876 INFO:tasks.rados.rados.0.trial188.stdout:2654: read oid 49 snap -1 2026-02-13T20:23:01.877 INFO:tasks.rados.rados.0.trial188.stdout:2654: expect (ObjNum 917 snap 276 seq_num 917) 2026-02-13T20:23:01.877 INFO:tasks.rados.rados.0.trial188.stdout:2655: snap_create 2026-02-13T20:23:01.880 INFO:tasks.rados.rados.0.trial188.stdout:2654: expect (ObjNum 917 snap 276 seq_num 917) 2026-02-13T20:23:01.950 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:23:01.984 INFO:tasks.rados.rados.0.trial188.stdout:2653: finishing copy_from racing read to trial18843701-38 2026-02-13T20:23:01.984 INFO:tasks.rados.rados.0.trial188.stdout:2653: finishing copy_from to trial18843701-38 2026-02-13T20:23:01.985 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 38 v 762 (ObjNum 868 snap 252 seq_num 868) dirty exists 2026-02-13T20:23:02.875 INFO:tasks.rados.rados.0.trial188.stdout:2653: done (2 left) 2026-02-13T20:23:02.875 INFO:tasks.rados.rados.0.trial188.stdout:2654: done (1 left) 2026-02-13T20:23:02.875 INFO:tasks.rados.rados.0.trial188.stdout:2655: done (0 left) 2026-02-13T20:23:02.875 INFO:tasks.rados.rados.0.trial188.stdout:2656: write oid 30 current snap is 278 2026-02-13T20:23:02.875 INFO:tasks.rados.rados.0.trial188.stdout:2656: seq_num 918 ranges {628826=640942,1869411=462657,2826425=534649} 2026-02-13T20:23:02.879 INFO:tasks.rados.rados.0.trial188.stdout:2656: writing trial18843701-30 from 628826 to 1269768 tid 1 2026-02-13T20:23:02.884 INFO:tasks.rados.rados.0.trial188.stdout:2656: writing trial18843701-30 from 1869411 to 2332068 tid 2 2026-02-13T20:23:02.889 INFO:tasks.rados.rados.0.trial188.stdout:2656: writing trial18843701-30 from 2826425 to 3361074 tid 3 2026-02-13T20:23:02.889 INFO:tasks.rados.rados.0.trial188.stdout:2657: copy_from oid 11 from oid 17 current snap is 278 2026-02-13T20:23:02.889 INFO:tasks.rados.rados.0.trial188.stdout:2658: snap_create 2026-02-13T20:23:02.904 INFO:tasks.rados.rados.0.trial188.stdout:2656: finishing write tid 1 to trial18843701-30 2026-02-13T20:23:02.904 INFO:tasks.rados.rados.0.trial188.stdout:2656: finishing write tid 2 to trial18843701-30 2026-02-13T20:23:02.915 INFO:tasks.rados.rados.0.trial188.stdout:2657: finishing copy_from racing read to trial18843701-11 2026-02-13T20:23:02.926 INFO:tasks.rados.rados.0.trial188.stdout:2656: finishing write tid 3 to trial18843701-30 2026-02-13T20:23:02.926 INFO:tasks.rados.rados.0.trial188.stdout:2656: finishing write tid 4 to trial18843701-30 2026-02-13T20:23:02.927 INFO:tasks.rados.rados.0.trial188.stdout:2656: finishing write tid 5 to trial18843701-30 2026-02-13T20:23:02.927 INFO:tasks.rados.rados.0.trial188.stdout:2656: oid 30 updating version 0 to 1258 2026-02-13T20:23:02.927 INFO:tasks.rados.rados.0.trial188.stdout:2656: oid 30 version 1258 is already newer than 1255 2026-02-13T20:23:02.927 INFO:tasks.rados.rados.0.trial188.stdout:2656: oid 30 version 1258 is already newer than 1256 2026-02-13T20:23:02.927 INFO:tasks.rados.rados.0.trial188.stdout:2656: oid 30 version 1258 is already newer than 1257 2026-02-13T20:23:02.927 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 30 v 1258 (ObjNum 918 snap 278 seq_num 918) dirty exists 2026-02-13T20:23:02.927 INFO:tasks.rados.rados.0.trial188.stdout:2656: left oid 30 (ObjNum 918 snap 278 seq_num 918) 2026-02-13T20:23:02.928 INFO:tasks.rados.rados.0.trial188.stdout:2657: finishing copy_from to trial18843701-11 2026-02-13T20:23:02.928 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 11 v 1055 (ObjNum 871 snap 253 seq_num 871) dirty exists 2026-02-13T20:23:03.876 INFO:tasks.rados.rados.0.trial188.stdout:2656: done (2 left) 2026-02-13T20:23:03.876 INFO:tasks.rados.rados.0.trial188.stdout:2657: done (1 left) 2026-02-13T20:23:03.876 INFO:tasks.rados.rados.0.trial188.stdout:2658: done (0 left) 2026-02-13T20:23:03.876 INFO:tasks.rados.rados.0.trial188.stdout:2659: read oid 22 snap -1 2026-02-13T20:23:03.876 INFO:tasks.rados.rados.0.trial188.stdout:2659: expect (ObjNum 899 snap 271 seq_num 899) 2026-02-13T20:23:03.876 INFO:tasks.rados.rados.0.trial188.stdout:2660: copy_from oid 33 from oid 20 current snap is 279 2026-02-13T20:23:03.876 INFO:tasks.rados.rados.0.trial188.stdout:2661: write oid 36 current snap is 279 2026-02-13T20:23:03.876 INFO:tasks.rados.rados.0.trial188.stdout:2661: seq_num 919 ranges {645633=716191,1927893=606315,3137495=308138} 2026-02-13T20:23:03.882 INFO:tasks.rados.rados.0.trial188.stdout:2661: writing trial18843701-36 from 645633 to 1361824 tid 1 2026-02-13T20:23:03.886 INFO:tasks.rados.rados.0.trial188.stdout:2661: writing trial18843701-36 from 1927893 to 2534208 tid 2 2026-02-13T20:23:03.890 INFO:tasks.rados.rados.0.trial188.stdout:2661: writing trial18843701-36 from 3137495 to 3445633 tid 3 2026-02-13T20:23:03.890 INFO:tasks.rados.rados.0.trial188.stdout:2662: copy_from oid 7 from oid 35 current snap is 279 2026-02-13T20:23:03.890 INFO:tasks.rados.rados.0.trial188.stdout:2660: finishing copy_from to trial18843701-33 2026-02-13T20:23:03.891 INFO:tasks.rados.rados.0.trial188.stdout:2660: got expected ENOENT (src dne) 2026-02-13T20:23:03.891 INFO:tasks.rados.rados.0.trial188.stdout:2660: finishing copy_from racing read to trial18843701-33 2026-02-13T20:23:03.891 INFO:tasks.rados.rados.0.trial188.stdout:2659: expect (ObjNum 899 snap 271 seq_num 899) 2026-02-13T20:23:03.936 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:23:03.959 INFO:tasks.rados.rados.0.trial188.stdout:2661: finishing write tid 1 to trial18843701-36 2026-02-13T20:23:03.959 INFO:tasks.rados.rados.0.trial188.stdout:2661: finishing write tid 2 to trial18843701-36 2026-02-13T20:23:03.959 INFO:tasks.rados.rados.0.trial188.stdout:2659: done (3 left) 2026-02-13T20:23:03.959 INFO:tasks.rados.rados.0.trial188.stdout:2660: done (2 left) 2026-02-13T20:23:03.959 INFO:tasks.rados.rados.0.trial188.stdout:2663: delete oid 39 current snap is 279 2026-02-13T20:23:03.959 INFO:tasks.rados.rados.0.trial188.stdout:2661: finishing write tid 3 to trial18843701-36 2026-02-13T20:23:03.959 INFO:tasks.rados.rados.0.trial188.stdout:2661: finishing write tid 4 to trial18843701-36 2026-02-13T20:23:03.960 INFO:tasks.rados.rados.0.trial188.stdout:2661: finishing write tid 5 to trial18843701-36 2026-02-13T20:23:03.960 INFO:tasks.rados.rados.0.trial188.stdout:2661: oid 36 updating version 0 to 1253 2026-02-13T20:23:03.960 INFO:tasks.rados.rados.0.trial188.stdout:2661: oid 36 updating version 1253 to 1254 2026-02-13T20:23:03.960 INFO:tasks.rados.rados.0.trial188.stdout:2661: oid 36 version 1254 is already newer than 1251 2026-02-13T20:23:03.960 INFO:tasks.rados.rados.0.trial188.stdout:2661: oid 36 version 1254 is already newer than 1252 2026-02-13T20:23:03.960 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 36 v 1254 (ObjNum 919 snap 279 seq_num 919) dirty exists 2026-02-13T20:23:03.960 INFO:tasks.rados.rados.0.trial188.stdout:2661: left oid 36 (ObjNum 919 snap 279 seq_num 919) 2026-02-13T20:23:03.960 INFO:tasks.rados.rados.0.trial188.stdout:2662: finishing copy_from racing read to trial18843701-7 2026-02-13T20:23:03.960 INFO:tasks.rados.rados.0.trial188.stdout:2662: finishing copy_from to trial18843701-7 2026-02-13T20:23:03.960 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 7 v 750 (ObjNum 860 snap 250 seq_num 860) dirty exists 2026-02-13T20:23:03.961 INFO:tasks.rados.rados.0.trial188.stdout:2661: done (2 left) 2026-02-13T20:23:03.961 INFO:tasks.rados.rados.0.trial188.stdout:2662: done (1 left) 2026-02-13T20:23:03.961 INFO:tasks.rados.rados.0.trial188.stdout:2663: done (0 left) 2026-02-13T20:23:03.961 INFO:tasks.rados.rados.0.trial188.stdout:2664: rollback oid 32 current snap is 279 2026-02-13T20:23:03.961 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 32 to 263 2026-02-13T20:23:03.962 INFO:tasks.rados.rados.0.trial188.stdout:2665: delete oid 18 current snap is 279 2026-02-13T20:23:03.963 INFO:tasks.rados.rados.0.trial188.stdout:2665: done (1 left) 2026-02-13T20:23:03.963 INFO:tasks.rados.rados.0.trial188.stdout:2666: rollback oid 20 current snap is 279 2026-02-13T20:23:03.963 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 20 to 244 2026-02-13T20:23:03.963 INFO:tasks.rados.rados.0.trial188.stdout:2667: snap_remove snap 275 2026-02-13T20:23:04.881 INFO:tasks.rados.rados.0.trial188.stdout:2667: done (2 left) 2026-02-13T20:23:04.881 INFO:tasks.rados.rados.0.trial188.stdout:2668: copy_from oid 30 from oid 28 current snap is 279 2026-02-13T20:23:04.881 INFO:tasks.rados.rados.0.trial188.stdout:2664: finishing rollback tid 0 to trial18843701-32 2026-02-13T20:23:04.881 INFO:tasks.rados.rados.0.trial188.stdout:2664: finishing rollback tid 1 to trial18843701-32 2026-02-13T20:23:04.881 INFO:tasks.rados.rados.0.trial188.stdout:2664: finishing rollback tid 2 to trial18843701-32 2026-02-13T20:23:04.881 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 32 v 1238 (ObjNum 739 snap 220 seq_num 739) dirty exists 2026-02-13T20:23:04.882 INFO:tasks.rados.rados.0.trial188.stdout:2666: finishing rollback tid 1 to trial18843701-20 2026-02-13T20:23:04.882 INFO:tasks.rados.rados.0.trial188.stdout:2666: finishing rollback tid 2 to trial18843701-20 2026-02-13T20:23:04.882 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 20 v 958 (ObjNum 755 snap 223 seq_num 755) dirty exists 2026-02-13T20:23:04.882 INFO:tasks.rados.rados.0.trial188.stdout:2664: done (2 left) 2026-02-13T20:23:04.882 INFO:tasks.rados.rados.0.trial188.stdout:2666: done (1 left) 2026-02-13T20:23:04.882 INFO:tasks.rados.rados.0.trial188.stdout:2669: read oid 45 snap 255 2026-02-13T20:23:04.882 INFO:tasks.rados.rados.0.trial188.stdout:2669: expect deleted 2026-02-13T20:23:04.882 INFO:tasks.rados.rados.0.trial188.stdout:2670: read oid 37 snap -1 2026-02-13T20:23:04.882 INFO:tasks.rados.rados.0.trial188.stdout:2670: expect deleted 2026-02-13T20:23:04.882 INFO:tasks.rados.rados.0.trial188.stdout:2671: read oid 44 snap -1 2026-02-13T20:23:04.883 INFO:tasks.rados.rados.0.trial188.stdout:2671: expect (ObjNum 712 snap 203 seq_num 712) 2026-02-13T20:23:04.883 INFO:tasks.rados.rados.0.trial188.stdout:2672: write oid 35 current snap is 279 2026-02-13T20:23:04.883 INFO:tasks.rados.rados.0.trial188.stdout:2672: seq_num 922 ranges {696054=658291,2103339=753642} 2026-02-13T20:23:04.885 INFO:tasks.rados.rados.0.trial188.stdout:2672: writing trial18843701-35 from 696054 to 1354345 tid 1 2026-02-13T20:23:04.891 INFO:tasks.rados.rados.0.trial188.stdout:2672: writing trial18843701-35 from 2103339 to 2856981 tid 2 2026-02-13T20:23:04.891 INFO:tasks.rados.rados.0.trial188.stdout:2673: snap_remove snap 278 2026-02-13T20:23:05.884 INFO:tasks.rados.rados.0.trial188.stdout:2673: done (5 left) 2026-02-13T20:23:05.884 INFO:tasks.rados.rados.0.trial188.stdout:2674: write oid 9 current snap is 279 2026-02-13T20:23:05.884 INFO:tasks.rados.rados.0.trial188.stdout:2674: seq_num 923 ranges {712861=733540,2161821=613653,3247187=265674} 2026-02-13T20:23:05.890 INFO:tasks.rados.rados.0.trial188.stdout:2674: writing trial18843701-9 from 712861 to 1446401 tid 1 2026-02-13T20:23:05.894 INFO:tasks.rados.rados.0.trial188.stdout:2674: writing trial18843701-9 from 2161821 to 2775474 tid 2 2026-02-13T20:23:05.897 INFO:tasks.rados.rados.0.trial188.stdout:2674: writing trial18843701-9 from 3247187 to 3512861 tid 3 2026-02-13T20:23:05.898 INFO:tasks.rados.rados.0.trial188.stdout:2675: read oid 24 snap -1 2026-02-13T20:23:05.898 INFO:tasks.rados.rados.0.trial188.stdout:2675: expect (ObjNum 912 snap 276 seq_num 912) 2026-02-13T20:23:05.898 INFO:tasks.rados.rados.0.trial188.stdout:2676: snap_create 2026-02-13T20:23:05.898 INFO:tasks.rados.rados.0.trial188.stdout:2671: expect (ObjNum 712 snap 203 seq_num 712) 2026-02-13T20:23:06.011 INFO:tasks.rados.rados.0.trial188.stdout:2668: finishing copy_from racing read to trial18843701-30 2026-02-13T20:23:06.011 INFO:tasks.rados.rados.0.trial188.stdout:2672: finishing write tid 1 to trial18843701-35 2026-02-13T20:23:06.011 INFO:tasks.rados.rados.0.trial188.stdout:2668: finishing copy_from to trial18843701-30 2026-02-13T20:23:06.011 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 30 v 1052 (ObjNum 836 snap 248 seq_num 836) dirty exists 2026-02-13T20:23:06.011 INFO:tasks.rados.rados.0.trial188.stdout:2672: finishing write tid 2 to trial18843701-35 2026-02-13T20:23:06.011 INFO:tasks.rados.rados.0.trial188.stdout:2672: finishing write tid 3 to trial18843701-35 2026-02-13T20:23:06.011 INFO:tasks.rados.rados.0.trial188.stdout:2672: finishing write tid 4 to trial18843701-35 2026-02-13T20:23:06.011 INFO:tasks.rados.rados.0.trial188.stdout:2672: oid 35 updating version 0 to 765 2026-02-13T20:23:06.012 INFO:tasks.rados.rados.0.trial188.stdout:2672: oid 35 version 765 is already newer than 764 2026-02-13T20:23:06.012 INFO:tasks.rados.rados.0.trial188.stdout:2672: oid 35 updating version 765 to 766 2026-02-13T20:23:06.012 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 35 v 766 (ObjNum 922 snap 279 seq_num 922) dirty exists 2026-02-13T20:23:06.012 INFO:tasks.rados.rados.0.trial188.stdout:2672: left oid 35 (ObjNum 922 snap 279 seq_num 922) 2026-02-13T20:23:06.012 INFO:tasks.rados.rados.0.trial188.stdout:2675: expect (ObjNum 912 snap 276 seq_num 912) 2026-02-13T20:23:06.079 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1110231 2026-02-13T20:23:06.103 INFO:tasks.rados.rados.0.trial188.stdout:2674: finishing write tid 1 to trial18843701-9 2026-02-13T20:23:06.103 INFO:tasks.rados.rados.0.trial188.stdout:2674: finishing write tid 2 to trial18843701-9 2026-02-13T20:23:06.104 INFO:tasks.rados.rados.0.trial188.stdout:2674: finishing write tid 3 to trial18843701-9 2026-02-13T20:23:06.104 INFO:tasks.rados.rados.0.trial188.stdout:2674: finishing write tid 4 to trial18843701-9 2026-02-13T20:23:06.104 INFO:tasks.rados.rados.0.trial188.stdout:2674: finishing write tid 5 to trial18843701-9 2026-02-13T20:23:06.104 INFO:tasks.rados.rados.0.trial188.stdout:2674: oid 9 updating version 0 to 770 2026-02-13T20:23:06.104 INFO:tasks.rados.rados.0.trial188.stdout:2674: oid 9 version 770 is already newer than 767 2026-02-13T20:23:06.104 INFO:tasks.rados.rados.0.trial188.stdout:2674: oid 9 version 770 is already newer than 769 2026-02-13T20:23:06.104 INFO:tasks.rados.rados.0.trial188.stdout:2674: oid 9 version 770 is already newer than 768 2026-02-13T20:23:06.104 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 9 v 770 (ObjNum 923 snap 279 seq_num 923) dirty exists 2026-02-13T20:23:06.104 INFO:tasks.rados.rados.0.trial188.stdout:2674: left oid 9 (ObjNum 923 snap 279 seq_num 923) 2026-02-13T20:23:06.876 INFO:tasks.rados.rados.0.trial188.stdout:2668: done (7 left) 2026-02-13T20:23:06.877 INFO:tasks.rados.rados.0.trial188.stdout:2669: done (6 left) 2026-02-13T20:23:06.877 INFO:tasks.rados.rados.0.trial188.stdout:2670: done (5 left) 2026-02-13T20:23:06.877 INFO:tasks.rados.rados.0.trial188.stdout:2671: done (4 left) 2026-02-13T20:23:06.877 INFO:tasks.rados.rados.0.trial188.stdout:2672: done (3 left) 2026-02-13T20:23:06.877 INFO:tasks.rados.rados.0.trial188.stdout:2674: done (2 left) 2026-02-13T20:23:06.877 INFO:tasks.rados.rados.0.trial188.stdout:2675: done (1 left) 2026-02-13T20:23:06.877 INFO:tasks.rados.rados.0.trial188.stdout:2676: done (0 left) 2026-02-13T20:23:06.877 INFO:tasks.rados.rados.0.trial188.stdout:2677: delete oid 7 current snap is 280 2026-02-13T20:23:06.879 INFO:tasks.rados.rados.0.trial188.stdout:2677: done (0 left) 2026-02-13T20:23:06.879 INFO:tasks.rados.rados.0.trial188.stdout:2678: snap_remove snap 276 2026-02-13T20:23:07.879 INFO:tasks.rados.rados.0.trial188.stdout:2678: done (0 left) 2026-02-13T20:23:07.879 INFO:tasks.rados.rados.0.trial188.stdout:2679: write oid 7 current snap is 280 2026-02-13T20:23:07.879 INFO:tasks.rados.rados.0.trial188.stdout:2679: seq_num 925 ranges {746475=484038,1762432=617322,2785680=529906} 2026-02-13T20:23:07.883 INFO:tasks.rados.rados.0.trial188.stdout:2679: writing trial18843701-7 from 746475 to 1230513 tid 1 2026-02-13T20:23:07.887 INFO:tasks.rados.rados.0.trial188.stdout:2679: writing trial18843701-7 from 1762432 to 2379754 tid 2 2026-02-13T20:23:07.891 INFO:tasks.rados.rados.0.trial188.stdout:2679: writing trial18843701-7 from 2785680 to 3315586 tid 3 2026-02-13T20:23:07.891 INFO:tasks.rados.rados.0.trial188.stdout:2680: snap_remove snap 277 2026-02-13T20:23:08.893 INFO:tasks.rados.rados.0.trial188.stdout:2680: done (1 left) 2026-02-13T20:23:08.893 INFO:tasks.rados.rados.0.trial188.stdout:2681: read oid 43 snap 228 2026-02-13T20:23:08.893 INFO:tasks.rados.rados.0.trial188.stdout:2681: expect deleted 2026-02-13T20:23:08.893 INFO:tasks.rados.rados.0.trial188.stdout:2682: delete oid 5 current snap is 280 2026-02-13T20:23:08.893 INFO:tasks.rados.rados.0.trial188.stdout:2679: finishing write tid 1 to trial18843701-7 2026-02-13T20:23:08.893 INFO:tasks.rados.rados.0.trial188.stdout:2679: finishing write tid 2 to trial18843701-7 2026-02-13T20:23:08.893 INFO:tasks.rados.rados.0.trial188.stdout:2679: finishing write tid 3 to trial18843701-7 2026-02-13T20:23:08.893 INFO:tasks.rados.rados.0.trial188.stdout:2679: finishing write tid 4 to trial18843701-7 2026-02-13T20:23:08.894 INFO:tasks.rados.rados.0.trial188.stdout:2679: finishing write tid 5 to trial18843701-7 2026-02-13T20:23:08.894 INFO:tasks.rados.rados.0.trial188.stdout:2679: oid 7 updating version 0 to 1238 2026-02-13T20:23:08.894 INFO:tasks.rados.rados.0.trial188.stdout:2679: oid 7 updating version 1238 to 1239 2026-02-13T20:23:08.894 INFO:tasks.rados.rados.0.trial188.stdout:2679: oid 7 version 1239 is already newer than 1236 2026-02-13T20:23:08.894 INFO:tasks.rados.rados.0.trial188.stdout:2679: oid 7 version 1239 is already newer than 1237 2026-02-13T20:23:08.894 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 7 v 1239 (ObjNum 925 snap 280 seq_num 925) dirty exists 2026-02-13T20:23:08.894 INFO:tasks.rados.rados.0.trial188.stdout:2679: left oid 7 (ObjNum 925 snap 280 seq_num 925) 2026-02-13T20:23:08.895 INFO:tasks.rados.rados.0.trial188.stdout:2679: done (2 left) 2026-02-13T20:23:08.895 INFO:tasks.rados.rados.0.trial188.stdout:2681: done (1 left) 2026-02-13T20:23:08.895 INFO:tasks.rados.rados.0.trial188.stdout:2682: done (0 left) 2026-02-13T20:23:08.895 INFO:tasks.rados.rados.0.trial188.stdout:2683: write oid 36 current snap is 280 2026-02-13T20:23:08.895 INFO:tasks.rados.rados.0.trial188.stdout:2683: seq_num 927 ranges {780089=634536,1879396=620991,3240526=339563} 2026-02-13T20:23:08.900 INFO:tasks.rados.rados.0.trial188.stdout:2683: writing trial18843701-36 from 780089 to 1414625 tid 1 2026-02-13T20:23:08.904 INFO:tasks.rados.rados.0.trial188.stdout:2683: writing trial18843701-36 from 1879396 to 2500387 tid 2 2026-02-13T20:23:08.908 INFO:tasks.rados.rados.0.trial188.stdout:2683: writing trial18843701-36 from 3240526 to 3580089 tid 3 2026-02-13T20:23:08.908 INFO:tasks.rados.rados.0.trial188.stdout:2684: write oid 45 current snap is 280 2026-02-13T20:23:08.908 INFO:tasks.rados.rados.0.trial188.stdout:2684: seq_num 928 ranges {796896=426138,1654231=764649,2984302=480075} 2026-02-13T20:23:08.913 INFO:tasks.rados.rados.0.trial188.stdout:2684: writing trial18843701-45 from 796896 to 1223034 tid 1 2026-02-13T20:23:08.917 INFO:tasks.rados.rados.0.trial188.stdout:2684: writing trial18843701-45 from 1654231 to 2418880 tid 2 2026-02-13T20:23:08.921 INFO:tasks.rados.rados.0.trial188.stdout:2684: writing trial18843701-45 from 2984302 to 3464377 tid 3 2026-02-13T20:23:08.922 INFO:tasks.rados.rados.0.trial188.stdout:2685: write (excl) oid 47 current snap is 280 2026-02-13T20:23:08.922 INFO:tasks.rados.rados.0.trial188.stdout:2685: seq_num 929 ranges {413703=501387,1596360=624660,2895372=691347} 2026-02-13T20:23:08.924 INFO:tasks.rados.rados.0.trial188.stdout:2685: writing trial18843701-47 from 413703 to 915090 tid 1 2026-02-13T20:23:08.929 INFO:tasks.rados.rados.0.trial188.stdout:2685: writing trial18843701-47 from 1596360 to 2221020 tid 2 2026-02-13T20:23:08.935 INFO:tasks.rados.rados.0.trial188.stdout:2685: writing trial18843701-47 from 2895372 to 3586719 tid 3 2026-02-13T20:23:08.935 INFO:tasks.rados.rados.0.trial188.stdout:2686: write oid 49 current snap is 280 2026-02-13T20:23:08.935 INFO:tasks.rados.rados.0.trial188.stdout:2686: seq_num 930 ranges {430510=576636,1654842=768318,2922795=502619} 2026-02-13T20:23:08.939 INFO:tasks.rados.rados.0.trial188.stdout:2686: writing trial18843701-49 from 430510 to 1007146 tid 1 2026-02-13T20:23:08.945 INFO:tasks.rados.rados.0.trial188.stdout:2686: writing trial18843701-49 from 1654842 to 2423160 tid 2 2026-02-13T20:23:08.950 INFO:tasks.rados.rados.0.trial188.stdout:2686: writing trial18843701-49 from 2922795 to 3425414 tid 3 2026-02-13T20:23:08.950 INFO:tasks.rados.rados.0.trial188.stdout:2687: copy_from oid 20 from oid 24 current snap is 280 2026-02-13T20:23:08.950 INFO:tasks.rados.rados.0.trial188.stdout:2683: finishing write tid 1 to trial18843701-36 2026-02-13T20:23:08.950 INFO:tasks.rados.rados.0.trial188.stdout:2683: finishing write tid 2 to trial18843701-36 2026-02-13T20:23:08.950 INFO:tasks.rados.rados.0.trial188.stdout:2683: finishing write tid 3 to trial18843701-36 2026-02-13T20:23:08.950 INFO:tasks.rados.rados.0.trial188.stdout:2683: finishing write tid 4 to trial18843701-36 2026-02-13T20:23:08.950 INFO:tasks.rados.rados.0.trial188.stdout:2683: finishing write tid 5 to trial18843701-36 2026-02-13T20:23:08.950 INFO:tasks.rados.rados.0.trial188.stdout:2683: oid 36 updating version 0 to 1267 2026-02-13T20:23:08.950 INFO:tasks.rados.rados.0.trial188.stdout:2683: oid 36 updating version 1267 to 1268 2026-02-13T20:23:08.950 INFO:tasks.rados.rados.0.trial188.stdout:2683: oid 36 version 1268 is already newer than 1266 2026-02-13T20:23:08.951 INFO:tasks.rados.rados.0.trial188.stdout:2683: oid 36 updating version 1268 to 1269 2026-02-13T20:23:08.951 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 36 v 1269 (ObjNum 927 snap 280 seq_num 927) dirty exists 2026-02-13T20:23:08.951 INFO:tasks.rados.rados.0.trial188.stdout:2683: left oid 36 (ObjNum 927 snap 280 seq_num 927) 2026-02-13T20:23:08.951 INFO:tasks.rados.rados.0.trial188.stdout:2684: finishing write tid 1 to trial18843701-45 2026-02-13T20:23:08.951 INFO:tasks.rados.rados.0.trial188.stdout:2684: finishing write tid 2 to trial18843701-45 2026-02-13T20:23:08.951 INFO:tasks.rados.rados.0.trial188.stdout:2684: finishing write tid 3 to trial18843701-45 2026-02-13T20:23:08.951 INFO:tasks.rados.rados.0.trial188.stdout:2684: finishing write tid 4 to trial18843701-45 2026-02-13T20:23:08.951 INFO:tasks.rados.rados.0.trial188.stdout:2684: finishing write tid 5 to trial18843701-45 2026-02-13T20:23:08.951 INFO:tasks.rados.rados.0.trial188.stdout:2684: oid 45 updating version 0 to 1267 2026-02-13T20:23:08.951 INFO:tasks.rados.rados.0.trial188.stdout:2684: oid 45 updating version 1267 to 1268 2026-02-13T20:23:08.951 INFO:tasks.rados.rados.0.trial188.stdout:2684: oid 45 updating version 1268 to 1270 2026-02-13T20:23:08.951 INFO:tasks.rados.rados.0.trial188.stdout:2684: oid 45 version 1270 is already newer than 1269 2026-02-13T20:23:08.952 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 45 v 1270 (ObjNum 928 snap 280 seq_num 928) dirty exists 2026-02-13T20:23:08.952 INFO:tasks.rados.rados.0.trial188.stdout:2684: left oid 45 (ObjNum 928 snap 280 seq_num 928) 2026-02-13T20:23:08.952 INFO:tasks.rados.rados.0.trial188.stdout:2683: done (4 left) 2026-02-13T20:23:08.952 INFO:tasks.rados.rados.0.trial188.stdout:2684: done (3 left) 2026-02-13T20:23:08.952 INFO:tasks.rados.rados.0.trial188.stdout:2688: write (excl) oid 9 current snap is 280 2026-02-13T20:23:08.952 INFO:tasks.rados.rados.0.trial188.stdout:2688: seq_num 931 ranges {447317=651885,1713324=628329,3066571=580746} 2026-02-13T20:23:08.953 INFO:tasks.rados.rados.0.trial188.stdout:2688: writing trial18843701-9 from 447317 to 1099202 tid 1 2026-02-13T20:23:08.962 INFO:tasks.rados.rados.0.trial188.stdout:2688: writing trial18843701-9 from 1713324 to 2341653 tid 2 2026-02-13T20:23:08.967 INFO:tasks.rados.rados.0.trial188.stdout:2688: writing trial18843701-9 from 3066571 to 3647317 tid 3 2026-02-13T20:23:08.967 INFO:tasks.rados.rados.0.trial188.stdout:2689: delete oid 30 current snap is 280 2026-02-13T20:23:08.967 INFO:tasks.rados.rados.0.trial188.stdout:2685: finishing write tid 1 to trial18843701-47 2026-02-13T20:23:08.967 INFO:tasks.rados.rados.0.trial188.stdout:2685: finishing write tid 2 to trial18843701-47 2026-02-13T20:23:08.968 INFO:tasks.rados.rados.0.trial188.stdout:2685: finishing write tid 3 to trial18843701-47 2026-02-13T20:23:08.968 INFO:tasks.rados.rados.0.trial188.stdout:2685: finishing write tid 4 to trial18843701-47 2026-02-13T20:23:08.968 INFO:tasks.rados.rados.0.trial188.stdout:2685: finishing write tid 5 to trial18843701-47 2026-02-13T20:23:08.968 INFO:tasks.rados.rados.0.trial188.stdout:2685: oid 47 updating version 0 to 1003 2026-02-13T20:23:08.968 INFO:tasks.rados.rados.0.trial188.stdout:2685: oid 47 updating version 1003 to 1006 2026-02-13T20:23:08.968 INFO:tasks.rados.rados.0.trial188.stdout:2685: oid 47 version 1006 is already newer than 1004 2026-02-13T20:23:08.968 INFO:tasks.rados.rados.0.trial188.stdout:2685: oid 47 version 1006 is already newer than 1005 2026-02-13T20:23:08.968 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 47 v 1006 (ObjNum 929 snap 280 seq_num 929) dirty exists 2026-02-13T20:23:08.968 INFO:tasks.rados.rados.0.trial188.stdout:2685: left oid 47 (ObjNum 929 snap 280 seq_num 929) 2026-02-13T20:23:08.986 INFO:tasks.rados.rados.0.trial188.stdout:2686: finishing write tid 1 to trial18843701-49 2026-02-13T20:23:08.986 INFO:tasks.rados.rados.0.trial188.stdout:2686: finishing write tid 2 to trial18843701-49 2026-02-13T20:23:08.986 INFO:tasks.rados.rados.0.trial188.stdout:2686: finishing write tid 3 to trial18843701-49 2026-02-13T20:23:08.986 INFO:tasks.rados.rados.0.trial188.stdout:2687: finishing copy_from racing read to trial18843701-20 2026-02-13T20:23:08.987 INFO:tasks.rados.rados.0.trial188.stdout:2686: finishing write tid 4 to trial18843701-49 2026-02-13T20:23:08.987 INFO:tasks.rados.rados.0.trial188.stdout:2686: finishing write tid 5 to trial18843701-49 2026-02-13T20:23:08.987 INFO:tasks.rados.rados.0.trial188.stdout:2686: oid 49 updating version 0 to 1275 2026-02-13T20:23:08.987 INFO:tasks.rados.rados.0.trial188.stdout:2686: oid 49 updating version 1275 to 1277 2026-02-13T20:23:08.987 INFO:tasks.rados.rados.0.trial188.stdout:2686: oid 49 version 1277 is already newer than 1276 2026-02-13T20:23:08.987 INFO:tasks.rados.rados.0.trial188.stdout:2686: oid 49 version 1277 is already newer than 1274 2026-02-13T20:23:08.987 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 49 v 1277 (ObjNum 930 snap 280 seq_num 930) dirty exists 2026-02-13T20:23:08.987 INFO:tasks.rados.rados.0.trial188.stdout:2686: left oid 49 (ObjNum 930 snap 280 seq_num 930) 2026-02-13T20:23:08.987 INFO:tasks.rados.rados.0.trial188.stdout:2687: finishing copy_from to trial18843701-20 2026-02-13T20:23:08.987 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 20 v 1245 (ObjNum 912 snap 276 seq_num 912) dirty exists 2026-02-13T20:23:09.001 INFO:tasks.rados.rados.0.trial188.stdout:2688: finishing write tid 1 to trial18843701-9 2026-02-13T20:23:09.001 INFO:tasks.rados.rados.0.trial188.stdout:2688: finishing write tid 2 to trial18843701-9 2026-02-13T20:23:09.001 INFO:tasks.rados.rados.0.trial188.stdout:2688: finishing write tid 3 to trial18843701-9 2026-02-13T20:23:09.001 INFO:tasks.rados.rados.0.trial188.stdout:2688: finishing write tid 4 to trial18843701-9 2026-02-13T20:23:09.001 INFO:tasks.rados.rados.0.trial188.stdout:2688: finishing write tid 5 to trial18843701-9 2026-02-13T20:23:09.001 INFO:tasks.rados.rados.0.trial188.stdout:2688: oid 9 updating version 0 to 771 2026-02-13T20:23:09.001 INFO:tasks.rados.rados.0.trial188.stdout:2688: oid 9 updating version 771 to 772 2026-02-13T20:23:09.002 INFO:tasks.rados.rados.0.trial188.stdout:2688: oid 9 updating version 772 to 774 2026-02-13T20:23:09.002 INFO:tasks.rados.rados.0.trial188.stdout:2688: oid 9 version 774 is already newer than 773 2026-02-13T20:23:09.002 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 9 v 774 (ObjNum 931 snap 280 seq_num 931) dirty exists 2026-02-13T20:23:09.002 INFO:tasks.rados.rados.0.trial188.stdout:2688: left oid 9 (ObjNum 931 snap 280 seq_num 931) 2026-02-13T20:23:09.002 INFO:tasks.rados.rados.0.trial188.stdout:2685: done (4 left) 2026-02-13T20:23:09.002 INFO:tasks.rados.rados.0.trial188.stdout:2686: done (3 left) 2026-02-13T20:23:09.003 INFO:tasks.rados.rados.0.trial188.stdout:2687: done (2 left) 2026-02-13T20:23:09.003 INFO:tasks.rados.rados.0.trial188.stdout:2688: done (1 left) 2026-02-13T20:23:09.003 INFO:tasks.rados.rados.0.trial188.stdout:2689: done (0 left) 2026-02-13T20:23:09.003 INFO:tasks.rados.rados.0.trial188.stdout:2690: write (excl) oid 33 current snap is 280 2026-02-13T20:23:09.003 INFO:tasks.rados.rados.0.trial188.stdout:2690: seq_num 933 ranges {480931=402383,1313935=515645,2488711=452788,3443230=237701} 2026-02-13T20:23:09.005 INFO:tasks.rados.rados.0.trial188.stdout:2690: writing trial18843701-33 from 480931 to 883314 tid 1 2026-02-13T20:23:09.008 INFO:tasks.rados.rados.0.trial188.stdout:2690: writing trial18843701-33 from 1313935 to 1829580 tid 2 2026-02-13T20:23:09.013 INFO:tasks.rados.rados.0.trial188.stdout:2690: writing trial18843701-33 from 2488711 to 2941499 tid 3 2026-02-13T20:23:09.016 INFO:tasks.rados.rados.0.trial188.stdout:2690: writing trial18843701-33 from 3443230 to 3680931 tid 4 2026-02-13T20:23:09.016 INFO:tasks.rados.rados.0.trial188.stdout:2691: copy_from oid 19 from oid 30 current snap is 280 2026-02-13T20:23:09.016 INFO:tasks.rados.rados.0.trial188.stdout:2692: read oid 4 snap -1 2026-02-13T20:23:09.016 INFO:tasks.rados.rados.0.trial188.stdout:2692: expect (ObjNum 892 snap 269 seq_num 892) 2026-02-13T20:23:09.016 INFO:tasks.rados.rados.0.trial188.stdout:2693: read oid 16 snap -1 2026-02-13T20:23:09.017 INFO:tasks.rados.rados.0.trial188.stdout:2693: expect (ObjNum 645 snap 172 seq_num 645) 2026-02-13T20:23:09.017 INFO:tasks.rados.rados.0.trial188.stdout:2694: write (excl) oid 24 current snap is 280 2026-02-13T20:23:09.017 INFO:tasks.rados.rados.0.trial188.stdout:2694: seq_num 934 ranges {497738=477632,1772417=775656,3316134=381604} 2026-02-13T20:23:09.019 INFO:tasks.rados.rados.0.trial188.stdout:2694: writing trial18843701-24 from 497738 to 975370 tid 1 2026-02-13T20:23:09.025 INFO:tasks.rados.rados.0.trial188.stdout:2694: writing trial18843701-24 from 1772417 to 2548073 tid 2 2026-02-13T20:23:09.030 INFO:tasks.rados.rados.0.trial188.stdout:2694: writing trial18843701-24 from 3316134 to 3697738 tid 3 2026-02-13T20:23:09.030 INFO:tasks.rados.rados.0.trial188.stdout:2695: delete oid 5 current snap is 280 2026-02-13T20:23:09.031 INFO:tasks.rados.rados.0.trial188.stdout:2690: finishing write tid 1 to trial18843701-33 2026-02-13T20:23:09.031 INFO:tasks.rados.rados.0.trial188.stdout:2691: finishing copy_from to trial18843701-19 2026-02-13T20:23:09.031 INFO:tasks.rados.rados.0.trial188.stdout:2691: got expected ENOENT (src dne) 2026-02-13T20:23:09.031 INFO:tasks.rados.rados.0.trial188.stdout:2693: expect (ObjNum 645 snap 172 seq_num 645) 2026-02-13T20:23:09.032 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1755275 2026-02-13T20:23:09.044 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:23:09.073 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2207971 2026-02-13T20:23:09.077 INFO:tasks.rados.rados.0.trial188.stdout:2691: finishing copy_from racing read to trial18843701-19 2026-02-13T20:23:09.077 INFO:tasks.rados.rados.0.trial188.stdout:2692: expect (ObjNum 892 snap 269 seq_num 892) 2026-02-13T20:23:09.084 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2683924 2026-02-13T20:23:09.094 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1257958 2026-02-13T20:23:09.125 INFO:tasks.rados.rados.0.trial188.stdout:2690: finishing write tid 2 to trial18843701-33 2026-02-13T20:23:09.125 INFO:tasks.rados.rados.0.trial188.stdout:2690: finishing write tid 3 to trial18843701-33 2026-02-13T20:23:09.125 INFO:tasks.rados.rados.0.trial188.stdout:2690: finishing write tid 4 to trial18843701-33 2026-02-13T20:23:09.125 INFO:tasks.rados.rados.0.trial188.stdout:2691: done (5 left) 2026-02-13T20:23:09.125 INFO:tasks.rados.rados.0.trial188.stdout:2692: done (4 left) 2026-02-13T20:23:09.125 INFO:tasks.rados.rados.0.trial188.stdout:2693: done (3 left) 2026-02-13T20:23:09.125 INFO:tasks.rados.rados.0.trial188.stdout:2695: done (2 left) 2026-02-13T20:23:09.125 INFO:tasks.rados.rados.0.trial188.stdout:2696: snap_remove snap 270 2026-02-13T20:23:09.896 INFO:tasks.rados.rados.0.trial188.stdout:2696: done (2 left) 2026-02-13T20:23:09.896 INFO:tasks.rados.rados.0.trial188.stdout:2697: write oid 13 current snap is 280 2026-02-13T20:23:09.897 INFO:tasks.rados.rados.0.trial188.stdout:2697: seq_num 936 ranges {531352=744483,2005734=779325,3487333=244019} 2026-02-13T20:23:09.902 INFO:tasks.rados.rados.0.trial188.stdout:2697: writing trial18843701-13 from 531352 to 1275835 tid 1 2026-02-13T20:23:09.908 INFO:tasks.rados.rados.0.trial188.stdout:2697: writing trial18843701-13 from 2005734 to 2785059 tid 2 2026-02-13T20:23:09.912 INFO:tasks.rados.rados.0.trial188.stdout:2697: writing trial18843701-13 from 3487333 to 3731352 tid 3 2026-02-13T20:23:09.913 INFO:tasks.rados.rados.0.trial188.stdout:2698: delete oid 32 current snap is 280 2026-02-13T20:23:09.913 INFO:tasks.rados.rados.0.trial188.stdout:2690: finishing write tid 5 to trial18843701-33 2026-02-13T20:23:09.913 INFO:tasks.rados.rados.0.trial188.stdout:2690: finishing write tid 6 to trial18843701-33 2026-02-13T20:23:09.913 INFO:tasks.rados.rados.0.trial188.stdout:2690: oid 33 updating version 0 to 1008 2026-02-13T20:23:09.913 INFO:tasks.rados.rados.0.trial188.stdout:2690: oid 33 updating version 1008 to 1010 2026-02-13T20:23:09.913 INFO:tasks.rados.rados.0.trial188.stdout:2690: oid 33 version 1010 is already newer than 1009 2026-02-13T20:23:09.913 INFO:tasks.rados.rados.0.trial188.stdout:2690: oid 33 updating version 1010 to 1011 2026-02-13T20:23:09.913 INFO:tasks.rados.rados.0.trial188.stdout:2690: oid 33 version 1011 is already newer than 1007 2026-02-13T20:23:09.913 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 33 v 1011 (ObjNum 933 snap 280 seq_num 933) dirty exists 2026-02-13T20:23:09.914 INFO:tasks.rados.rados.0.trial188.stdout:2690: left oid 33 (ObjNum 933 snap 280 seq_num 933) 2026-02-13T20:23:09.914 INFO:tasks.rados.rados.0.trial188.stdout:2694: finishing write tid 1 to trial18843701-24 2026-02-13T20:23:09.914 INFO:tasks.rados.rados.0.trial188.stdout:2694: finishing write tid 2 to trial18843701-24 2026-02-13T20:23:09.914 INFO:tasks.rados.rados.0.trial188.stdout:2694: finishing write tid 3 to trial18843701-24 2026-02-13T20:23:09.914 INFO:tasks.rados.rados.0.trial188.stdout:2694: finishing write tid 4 to trial18843701-24 2026-02-13T20:23:09.914 INFO:tasks.rados.rados.0.trial188.stdout:2694: finishing write tid 5 to trial18843701-24 2026-02-13T20:23:09.914 INFO:tasks.rados.rados.0.trial188.stdout:2694: oid 24 updating version 0 to 1274 2026-02-13T20:23:09.914 INFO:tasks.rados.rados.0.trial188.stdout:2694: oid 24 version 1274 is already newer than 1273 2026-02-13T20:23:09.914 INFO:tasks.rados.rados.0.trial188.stdout:2694: oid 24 version 1274 is already newer than 1272 2026-02-13T20:23:09.914 INFO:tasks.rados.rados.0.trial188.stdout:2694: oid 24 version 1274 is already newer than 1271 2026-02-13T20:23:09.914 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 24 v 1274 (ObjNum 934 snap 280 seq_num 934) dirty exists 2026-02-13T20:23:09.914 INFO:tasks.rados.rados.0.trial188.stdout:2694: left oid 24 (ObjNum 934 snap 280 seq_num 934) 2026-02-13T20:23:09.929 INFO:tasks.rados.rados.0.trial188.stdout:2697: finishing write tid 1 to trial18843701-13 2026-02-13T20:23:09.929 INFO:tasks.rados.rados.0.trial188.stdout:2690: done (3 left) 2026-02-13T20:23:09.929 INFO:tasks.rados.rados.0.trial188.stdout:2694: done (2 left) 2026-02-13T20:23:09.929 INFO:tasks.rados.rados.0.trial188.stdout:2698: done (1 left) 2026-02-13T20:23:09.929 INFO:tasks.rados.rados.0.trial188.stdout:2699: write (excl) oid 28 current snap is 280 2026-02-13T20:23:09.929 INFO:tasks.rados.rados.0.trial188.stdout:2699: seq_num 938 ranges {564966=494981,1606345=782994,3025826=425501} 2026-02-13T20:23:09.933 INFO:tasks.rados.rados.0.trial188.stdout:2699: writing trial18843701-28 from 564966 to 1059947 tid 1 2026-02-13T20:23:09.938 INFO:tasks.rados.rados.0.trial188.stdout:2699: writing trial18843701-28 from 1606345 to 2389339 tid 2 2026-02-13T20:23:09.943 INFO:tasks.rados.rados.0.trial188.stdout:2699: writing trial18843701-28 from 3025826 to 3451327 tid 3 2026-02-13T20:23:09.943 INFO:tasks.rados.rados.0.trial188.stdout:2700: read oid 29 snap -1 2026-02-13T20:23:09.943 INFO:tasks.rados.rados.0.trial188.stdout:2700: expect (ObjNum 868 snap 252 seq_num 868) 2026-02-13T20:23:09.943 INFO:tasks.rados.rados.0.trial188.stdout:2701: delete oid 43 current snap is 280 2026-02-13T20:23:09.943 INFO:tasks.rados.rados.0.trial188.stdout:2697: finishing write tid 2 to trial18843701-13 2026-02-13T20:23:09.943 INFO:tasks.rados.rados.0.trial188.stdout:2697: finishing write tid 3 to trial18843701-13 2026-02-13T20:23:09.943 INFO:tasks.rados.rados.0.trial188.stdout:2697: finishing write tid 4 to trial18843701-13 2026-02-13T20:23:09.944 INFO:tasks.rados.rados.0.trial188.stdout:2697: finishing write tid 5 to trial18843701-13 2026-02-13T20:23:09.944 INFO:tasks.rados.rados.0.trial188.stdout:2697: oid 13 updating version 0 to 1263 2026-02-13T20:23:09.944 INFO:tasks.rados.rados.0.trial188.stdout:2697: oid 13 version 1263 is already newer than 1261 2026-02-13T20:23:09.944 INFO:tasks.rados.rados.0.trial188.stdout:2697: oid 13 version 1263 is already newer than 1260 2026-02-13T20:23:09.944 INFO:tasks.rados.rados.0.trial188.stdout:2697: oid 13 version 1263 is already newer than 1262 2026-02-13T20:23:09.944 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 13 v 1263 (ObjNum 936 snap 280 seq_num 936) dirty exists 2026-02-13T20:23:09.944 INFO:tasks.rados.rados.0.trial188.stdout:2697: left oid 13 (ObjNum 936 snap 280 seq_num 936) 2026-02-13T20:23:09.945 INFO:tasks.rados.rados.0.trial188.stdout:2697: done (3 left) 2026-02-13T20:23:09.945 INFO:tasks.rados.rados.0.trial188.stdout:2701: done (2 left) 2026-02-13T20:23:09.945 INFO:tasks.rados.rados.0.trial188.stdout:2702: read oid 50 snap -1 2026-02-13T20:23:09.945 INFO:tasks.rados.rados.0.trial188.stdout:2702: expect (ObjNum 724 snap 214 seq_num 724) 2026-02-13T20:23:09.945 INFO:tasks.rados.rados.0.trial188.stdout:2703: snap_remove snap 273 2026-02-13T20:23:10.899 INFO:tasks.rados.rados.0.trial188.stdout:2703: done (3 left) 2026-02-13T20:23:10.899 INFO:tasks.rados.rados.0.trial188.stdout:2704: write (excl) oid 11 current snap is 280 2026-02-13T20:23:10.899 INFO:tasks.rados.rados.0.trial188.stdout:2704: seq_num 940 ranges {598580=645479,1723309=786663,3080672=448045} 2026-02-13T20:23:10.904 INFO:tasks.rados.rados.0.trial188.stdout:2704: writing trial18843701-11 from 598580 to 1244059 tid 1 2026-02-13T20:23:10.909 INFO:tasks.rados.rados.0.trial188.stdout:2704: writing trial18843701-11 from 1723309 to 2509972 tid 2 2026-02-13T20:23:10.914 INFO:tasks.rados.rados.0.trial188.stdout:2704: writing trial18843701-11 from 3080672 to 3528717 tid 3 2026-02-13T20:23:10.914 INFO:tasks.rados.rados.0.trial188.stdout:2705: read oid 20 snap -1 2026-02-13T20:23:10.915 INFO:tasks.rados.rados.0.trial188.stdout:2705: expect (ObjNum 912 snap 276 seq_num 912) 2026-02-13T20:23:10.915 INFO:tasks.rados.rados.0.trial188.stdout:2706: write oid 40 current snap is 280 2026-02-13T20:23:10.915 INFO:tasks.rados.rados.0.trial188.stdout:2706: seq_num 941 ranges {615387=720728,1781791=530321,3108095=707292} 2026-02-13T20:23:10.919 INFO:tasks.rados.rados.0.trial188.stdout:2706: writing trial18843701-40 from 615387 to 1336115 tid 1 2026-02-13T20:23:10.922 INFO:tasks.rados.rados.0.trial188.stdout:2706: writing trial18843701-40 from 1781791 to 2312112 tid 2 2026-02-13T20:23:10.929 INFO:tasks.rados.rados.0.trial188.stdout:2706: writing trial18843701-40 from 3108095 to 3815387 tid 3 2026-02-13T20:23:10.929 INFO:tasks.rados.rados.0.trial188.stdout:2707: delete oid 27 current snap is 280 2026-02-13T20:23:10.929 INFO:tasks.rados.rados.0.trial188.stdout:2700: expect (ObjNum 868 snap 252 seq_num 868) 2026-02-13T20:23:10.999 INFO:tasks.rados.rados.0.trial188.stdout:2702: expect (ObjNum 724 snap 214 seq_num 724) 2026-02-13T20:23:11.045 INFO:tasks.rados.rados.0.trial188.stdout:2699: finishing write tid 1 to trial18843701-28 2026-02-13T20:23:11.045 INFO:tasks.rados.rados.0.trial188.stdout:2699: finishing write tid 2 to trial18843701-28 2026-02-13T20:23:11.046 INFO:tasks.rados.rados.0.trial188.stdout:2700: done (6 left) 2026-02-13T20:23:11.046 INFO:tasks.rados.rados.0.trial188.stdout:2702: done (5 left) 2026-02-13T20:23:11.046 INFO:tasks.rados.rados.0.trial188.stdout:2707: done (4 left) 2026-02-13T20:23:11.046 INFO:tasks.rados.rados.0.trial188.stdout:2708: write oid 23 current snap is 280 2026-02-13T20:23:11.046 INFO:tasks.rados.rados.0.trial188.stdout:2708: seq_num 943 ranges {649001=587579,1898755=533990,3162941=686060} 2026-02-13T20:23:11.050 INFO:tasks.rados.rados.0.trial188.stdout:2708: writing trial18843701-23 from 649001 to 1236580 tid 1 2026-02-13T20:23:11.054 INFO:tasks.rados.rados.0.trial188.stdout:2708: writing trial18843701-23 from 1898755 to 2432745 tid 2 2026-02-13T20:23:11.060 INFO:tasks.rados.rados.0.trial188.stdout:2708: writing trial18843701-23 from 3162941 to 3849001 tid 3 2026-02-13T20:23:11.060 INFO:tasks.rados.rados.0.trial188.stdout:2709: snap_remove snap 267 2026-02-13T20:23:11.878 INFO:tasks.rados.rados.0.trial188.stdout:2709: done (5 left) 2026-02-13T20:23:11.878 INFO:tasks.rados.rados.0.trial188.stdout:2710: rollback oid 1 current snap is 280 2026-02-13T20:23:11.879 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 1 to 263 2026-02-13T20:23:11.879 INFO:tasks.rados.rados.0.trial188.stdout:2699: finishing write tid 3 to trial18843701-28 2026-02-13T20:23:11.879 INFO:tasks.rados.rados.0.trial188.stdout:2699: finishing write tid 4 to trial18843701-28 2026-02-13T20:23:11.879 INFO:tasks.rados.rados.0.trial188.stdout:2699: finishing write tid 5 to trial18843701-28 2026-02-13T20:23:11.879 INFO:tasks.rados.rados.0.trial188.stdout:2699: oid 28 updating version 0 to 1275 2026-02-13T20:23:11.879 INFO:tasks.rados.rados.0.trial188.stdout:2699: oid 28 version 1275 is already newer than 1274 2026-02-13T20:23:11.879 INFO:tasks.rados.rados.0.trial188.stdout:2699: oid 28 updating version 1275 to 1276 2026-02-13T20:23:11.879 INFO:tasks.rados.rados.0.trial188.stdout:2699: oid 28 updating version 1276 to 1277 2026-02-13T20:23:11.879 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 28 v 1277 (ObjNum 938 snap 280 seq_num 938) dirty exists 2026-02-13T20:23:11.879 INFO:tasks.rados.rados.0.trial188.stdout:2699: left oid 28 (ObjNum 938 snap 280 seq_num 938) 2026-02-13T20:23:11.879 INFO:tasks.rados.rados.0.trial188.stdout:2705: expect (ObjNum 912 snap 276 seq_num 912) 2026-02-13T20:23:11.912 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:23:11.956 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1943125 2026-02-13T20:23:11.974 INFO:tasks.rados.rados.0.trial188.stdout:2704: finishing write tid 1 to trial18843701-11 2026-02-13T20:23:11.974 INFO:tasks.rados.rados.0.trial188.stdout:2704: finishing write tid 2 to trial18843701-11 2026-02-13T20:23:11.974 INFO:tasks.rados.rados.0.trial188.stdout:2704: finishing write tid 3 to trial18843701-11 2026-02-13T20:23:11.974 INFO:tasks.rados.rados.0.trial188.stdout:2704: finishing write tid 4 to trial18843701-11 2026-02-13T20:23:11.974 INFO:tasks.rados.rados.0.trial188.stdout:2704: finishing write tid 5 to trial18843701-11 2026-02-13T20:23:11.974 INFO:tasks.rados.rados.0.trial188.stdout:2704: oid 11 updating version 0 to 1058 2026-02-13T20:23:11.974 INFO:tasks.rados.rados.0.trial188.stdout:2704: oid 11 updating version 1058 to 1059 2026-02-13T20:23:11.975 INFO:tasks.rados.rados.0.trial188.stdout:2704: oid 11 version 1059 is already newer than 1056 2026-02-13T20:23:11.975 INFO:tasks.rados.rados.0.trial188.stdout:2704: oid 11 version 1059 is already newer than 1057 2026-02-13T20:23:11.975 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 11 v 1059 (ObjNum 940 snap 280 seq_num 940) dirty exists 2026-02-13T20:23:11.975 INFO:tasks.rados.rados.0.trial188.stdout:2704: left oid 11 (ObjNum 940 snap 280 seq_num 940) 2026-02-13T20:23:11.975 INFO:tasks.rados.rados.0.trial188.stdout:2706: finishing write tid 1 to trial18843701-40 2026-02-13T20:23:11.975 INFO:tasks.rados.rados.0.trial188.stdout:2706: finishing write tid 2 to trial18843701-40 2026-02-13T20:23:11.975 INFO:tasks.rados.rados.0.trial188.stdout:2699: done (5 left) 2026-02-13T20:23:11.975 INFO:tasks.rados.rados.0.trial188.stdout:2704: done (4 left) 2026-02-13T20:23:11.975 INFO:tasks.rados.rados.0.trial188.stdout:2705: done (3 left) 2026-02-13T20:23:11.975 INFO:tasks.rados.rados.0.trial188.stdout:2711: snap_create 2026-02-13T20:23:11.975 INFO:tasks.rados.rados.0.trial188.stdout:2706: finishing write tid 3 to trial18843701-40 2026-02-13T20:23:11.976 INFO:tasks.rados.rados.0.trial188.stdout:2706: finishing write tid 4 to trial18843701-40 2026-02-13T20:23:11.976 INFO:tasks.rados.rados.0.trial188.stdout:2706: finishing write tid 5 to trial18843701-40 2026-02-13T20:23:11.976 INFO:tasks.rados.rados.0.trial188.stdout:2706: oid 40 updating version 0 to 1243 2026-02-13T20:23:11.976 INFO:tasks.rados.rados.0.trial188.stdout:2706: oid 40 version 1243 is already newer than 1241 2026-02-13T20:23:11.976 INFO:tasks.rados.rados.0.trial188.stdout:2706: oid 40 version 1243 is already newer than 1242 2026-02-13T20:23:11.976 INFO:tasks.rados.rados.0.trial188.stdout:2706: oid 40 version 1243 is already newer than 1240 2026-02-13T20:23:11.976 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 40 v 1243 (ObjNum 941 snap 280 seq_num 941) dirty exists 2026-02-13T20:23:11.976 INFO:tasks.rados.rados.0.trial188.stdout:2706: left oid 40 (ObjNum 941 snap 280 seq_num 941) 2026-02-13T20:23:11.976 INFO:tasks.rados.rados.0.trial188.stdout:2708: finishing write tid 1 to trial18843701-23 2026-02-13T20:23:11.976 INFO:tasks.rados.rados.0.trial188.stdout:2708: finishing write tid 2 to trial18843701-23 2026-02-13T20:23:11.976 INFO:tasks.rados.rados.0.trial188.stdout:2708: finishing write tid 3 to trial18843701-23 2026-02-13T20:23:11.976 INFO:tasks.rados.rados.0.trial188.stdout:2708: finishing write tid 4 to trial18843701-23 2026-02-13T20:23:11.976 INFO:tasks.rados.rados.0.trial188.stdout:2708: finishing write tid 5 to trial18843701-23 2026-02-13T20:23:11.977 INFO:tasks.rados.rados.0.trial188.stdout:2708: oid 23 updating version 0 to 1285 2026-02-13T20:23:11.977 INFO:tasks.rados.rados.0.trial188.stdout:2708: oid 23 updating version 1285 to 1286 2026-02-13T20:23:11.977 INFO:tasks.rados.rados.0.trial188.stdout:2708: oid 23 version 1286 is already newer than 1284 2026-02-13T20:23:11.977 INFO:tasks.rados.rados.0.trial188.stdout:2708: oid 23 version 1286 is already newer than 1283 2026-02-13T20:23:11.977 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 23 v 1286 (ObjNum 943 snap 280 seq_num 943) dirty exists 2026-02-13T20:23:11.977 INFO:tasks.rados.rados.0.trial188.stdout:2708: left oid 23 (ObjNum 943 snap 280 seq_num 943) 2026-02-13T20:23:11.977 INFO:tasks.rados.rados.0.trial188.stdout:2710: finishing rollback tid 0 to trial18843701-1 2026-02-13T20:23:11.977 INFO:tasks.rados.rados.0.trial188.stdout:2710: finishing rollback tid 1 to trial18843701-1 2026-02-13T20:23:11.977 INFO:tasks.rados.rados.0.trial188.stdout:2710: finishing rollback tid 2 to trial18843701-1 2026-02-13T20:23:11.977 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 1 v 1266 (ObjNum 873 snap 255 seq_num 873) dirty exists 2026-02-13T20:23:12.901 INFO:tasks.rados.rados.0.trial188.stdout:2706: done (3 left) 2026-02-13T20:23:12.902 INFO:tasks.rados.rados.0.trial188.stdout:2708: done (2 left) 2026-02-13T20:23:12.902 INFO:tasks.rados.rados.0.trial188.stdout:2710: done (1 left) 2026-02-13T20:23:12.902 INFO:tasks.rados.rados.0.trial188.stdout:2711: done (0 left) 2026-02-13T20:23:12.902 INFO:tasks.rados.rados.0.trial188.stdout:2712: read oid 11 snap -1 2026-02-13T20:23:12.902 INFO:tasks.rados.rados.0.trial188.stdout:2712: expect (ObjNum 940 snap 280 seq_num 940) 2026-02-13T20:23:12.902 INFO:tasks.rados.rados.0.trial188.stdout:2713: copy_from oid 23 from oid 13 current snap is 281 2026-02-13T20:23:12.902 INFO:tasks.rados.rados.0.trial188.stdout:2714: rollback oid 32 current snap is 281 2026-02-13T20:23:12.902 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 32 to 262 2026-02-13T20:23:12.902 INFO:tasks.rados.rados.0.trial188.stdout:2715: write oid 26 current snap is 281 2026-02-13T20:23:12.903 INFO:tasks.rados.rados.0.trial188.stdout:2715: seq_num 944 ranges {665808=662828,1957237=677648,3074011=609486} 2026-02-13T20:23:12.906 INFO:tasks.rados.rados.0.trial188.stdout:2715: writing trial18843701-26 from 665808 to 1328636 tid 1 2026-02-13T20:23:12.911 INFO:tasks.rados.rados.0.trial188.stdout:2715: writing trial18843701-26 from 1957237 to 2634885 tid 2 2026-02-13T20:23:12.915 INFO:tasks.rados.rados.0.trial188.stdout:2715: writing trial18843701-26 from 3074011 to 3683497 tid 3 2026-02-13T20:23:12.915 INFO:tasks.rados.rados.0.trial188.stdout:2716: read oid 31 snap -1 2026-02-13T20:23:12.915 INFO:tasks.rados.rados.0.trial188.stdout:2716: expect (ObjNum 913 snap 276 seq_num 913) 2026-02-13T20:23:12.916 INFO:tasks.rados.rados.0.trial188.stdout:2717: write (excl) oid 16 current snap is 281 2026-02-13T20:23:12.916 INFO:tasks.rados.rados.0.trial188.stdout:2714: finishing rollback tid 1 to trial18843701-32 2026-02-13T20:23:12.916 INFO:tasks.rados.rados.0.trial188.stdout:2714: finishing rollback tid 2 to trial18843701-32 2026-02-13T20:23:12.916 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 32 v 1245 (ObjNum 739 snap 220 seq_num 739) dirty exists 2026-02-13T20:23:12.916 INFO:tasks.rados.rados.0.trial188.stdout:2712: expect (ObjNum 940 snap 280 seq_num 940) 2026-02-13T20:23:12.946 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 3303859 2026-02-13T20:23:12.953 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:23:13.001 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:23:13.050 INFO:tasks.rados.rados.0.trial188.stdout:2716: expect (ObjNum 913 snap 276 seq_num 913) 2026-02-13T20:23:13.117 INFO:tasks.rados.rados.0.trial188.stdout:2713: finishing copy_from racing read to trial18843701-23 2026-02-13T20:23:13.117 INFO:tasks.rados.rados.0.trial188.stdout:2717: seq_num 945 ranges {682615=738077,2015719=537659,3217787=420758} 2026-02-13T20:23:13.122 INFO:tasks.rados.rados.0.trial188.stdout:2717: writing trial18843701-16 from 682615 to 1420692 tid 1 2026-02-13T20:23:13.126 INFO:tasks.rados.rados.0.trial188.stdout:2717: writing trial18843701-16 from 2015719 to 2553378 tid 2 2026-02-13T20:23:13.131 INFO:tasks.rados.rados.0.trial188.stdout:2717: writing trial18843701-16 from 3217787 to 3638545 tid 3 2026-02-13T20:23:13.131 INFO:tasks.rados.rados.0.trial188.stdout:2712: done (5 left) 2026-02-13T20:23:13.131 INFO:tasks.rados.rados.0.trial188.stdout:2714: done (4 left) 2026-02-13T20:23:13.131 INFO:tasks.rados.rados.0.trial188.stdout:2716: done (3 left) 2026-02-13T20:23:13.131 INFO:tasks.rados.rados.0.trial188.stdout:2718: copy_from oid 14 from oid 42 current snap is 281 2026-02-13T20:23:13.132 INFO:tasks.rados.rados.0.trial188.stdout:2715: finishing write tid 1 to trial18843701-26 2026-02-13T20:23:13.132 INFO:tasks.rados.rados.0.trial188.stdout:2715: finishing write tid 2 to trial18843701-26 2026-02-13T20:23:13.132 INFO:tasks.rados.rados.0.trial188.stdout:2715: finishing write tid 3 to trial18843701-26 2026-02-13T20:23:13.132 INFO:tasks.rados.rados.0.trial188.stdout:2715: finishing write tid 4 to trial18843701-26 2026-02-13T20:23:13.132 INFO:tasks.rados.rados.0.trial188.stdout:2713: finishing copy_from to trial18843701-23 2026-02-13T20:23:13.132 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 23 v 1263 (ObjNum 936 snap 280 seq_num 936) dirty exists 2026-02-13T20:23:13.132 INFO:tasks.rados.rados.0.trial188.stdout:2715: finishing write tid 5 to trial18843701-26 2026-02-13T20:23:13.132 INFO:tasks.rados.rados.0.trial188.stdout:2715: oid 26 updating version 0 to 969 2026-02-13T20:23:13.132 INFO:tasks.rados.rados.0.trial188.stdout:2715: oid 26 updating version 969 to 970 2026-02-13T20:23:13.132 INFO:tasks.rados.rados.0.trial188.stdout:2715: oid 26 version 970 is already newer than 968 2026-02-13T20:23:13.132 INFO:tasks.rados.rados.0.trial188.stdout:2715: oid 26 updating version 970 to 971 2026-02-13T20:23:13.133 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 26 v 971 (ObjNum 944 snap 281 seq_num 944) dirty exists 2026-02-13T20:23:13.133 INFO:tasks.rados.rados.0.trial188.stdout:2715: left oid 26 (ObjNum 944 snap 281 seq_num 944) 2026-02-13T20:23:13.133 INFO:tasks.rados.rados.0.trial188.stdout:2713: done (3 left) 2026-02-13T20:23:13.133 INFO:tasks.rados.rados.0.trial188.stdout:2715: done (2 left) 2026-02-13T20:23:13.133 INFO:tasks.rados.rados.0.trial188.stdout:2719: snap_create 2026-02-13T20:23:13.146 INFO:tasks.rados.rados.0.trial188.stdout:2717: finishing write tid 1 to trial18843701-16 2026-02-13T20:23:13.146 INFO:tasks.rados.rados.0.trial188.stdout:2717: finishing write tid 2 to trial18843701-16 2026-02-13T20:23:13.146 INFO:tasks.rados.rados.0.trial188.stdout:2717: finishing write tid 3 to trial18843701-16 2026-02-13T20:23:13.146 INFO:tasks.rados.rados.0.trial188.stdout:2717: finishing write tid 4 to trial18843701-16 2026-02-13T20:23:13.147 INFO:tasks.rados.rados.0.trial188.stdout:2717: finishing write tid 5 to trial18843701-16 2026-02-13T20:23:13.147 INFO:tasks.rados.rados.0.trial188.stdout:2717: oid 16 updating version 0 to 1294 2026-02-13T20:23:13.147 INFO:tasks.rados.rados.0.trial188.stdout:2717: oid 16 updating version 1294 to 1295 2026-02-13T20:23:13.147 INFO:tasks.rados.rados.0.trial188.stdout:2717: oid 16 updating version 1295 to 1296 2026-02-13T20:23:13.147 INFO:tasks.rados.rados.0.trial188.stdout:2717: oid 16 updating version 1296 to 1297 2026-02-13T20:23:13.147 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 16 v 1297 (ObjNum 945 snap 281 seq_num 945) dirty exists 2026-02-13T20:23:13.147 INFO:tasks.rados.rados.0.trial188.stdout:2717: left oid 16 (ObjNum 945 snap 281 seq_num 945) 2026-02-13T20:23:13.171 INFO:tasks.rados.rados.0.trial188.stdout:2718: finishing copy_from racing read to trial18843701-14 2026-02-13T20:23:13.172 INFO:tasks.rados.rados.0.trial188.stdout:2718: finishing copy_from to trial18843701-14 2026-02-13T20:23:13.172 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 14 v 759 (ObjNum 751 snap 222 seq_num 751) dirty exists 2026-02-13T20:23:13.903 INFO:tasks.rados.rados.0.trial188.stdout:2717: done (2 left) 2026-02-13T20:23:13.904 INFO:tasks.rados.rados.0.trial188.stdout:2718: done (1 left) 2026-02-13T20:23:13.904 INFO:tasks.rados.rados.0.trial188.stdout:2719: done (0 left) 2026-02-13T20:23:13.904 INFO:tasks.rados.rados.0.trial188.stdout:2720: snap_remove snap 281 2026-02-13T20:23:14.907 INFO:tasks.rados.rados.0.trial188.stdout:2720: done (0 left) 2026-02-13T20:23:14.907 INFO:tasks.rados.rados.0.trial188.stdout:2721: copy_from oid 37 from oid 35 current snap is 282 2026-02-13T20:23:14.907 INFO:tasks.rados.rados.0.trial188.stdout:2722: read oid 48 snap -1 2026-02-13T20:23:14.907 INFO:tasks.rados.rados.0.trial188.stdout:2722: expect deleted 2026-02-13T20:23:14.907 INFO:tasks.rados.rados.0.trial188.stdout:2723: rollback oid 42 current snap is 282 2026-02-13T20:23:14.908 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 42 to 241 2026-02-13T20:23:14.908 INFO:tasks.rados.rados.0.trial188.stdout:2724: delete oid 3 current snap is 282 2026-02-13T20:23:14.910 INFO:tasks.rados.rados.0.trial188.stdout:2722: done (3 left) 2026-02-13T20:23:14.910 INFO:tasks.rados.rados.0.trial188.stdout:2724: done (2 left) 2026-02-13T20:23:14.910 INFO:tasks.rados.rados.0.trial188.stdout:2725: snap_remove snap 271 2026-02-13T20:23:15.909 INFO:tasks.rados.rados.0.trial188.stdout:2725: done (2 left) 2026-02-13T20:23:15.909 INFO:tasks.rados.rados.0.trial188.stdout:2726: snap_remove snap 251 2026-02-13T20:23:16.877 INFO:tasks.rados.rados.0.trial188.stdout:2726: done (2 left) 2026-02-13T20:23:16.877 INFO:tasks.rados.rados.0.trial188.stdout:2727: write oid 15 current snap is 282 2026-02-13T20:23:16.877 INFO:tasks.rados.rados.0.trial188.stdout:2727: seq_num 947 ranges {716229=488575,1616330=541328,2756280=559655} 2026-02-13T20:23:16.882 INFO:tasks.rados.rados.0.trial188.stdout:2727: writing trial18843701-15 from 716229 to 1204804 tid 1 2026-02-13T20:23:16.885 INFO:tasks.rados.rados.0.trial188.stdout:2727: writing trial18843701-15 from 1616330 to 2157658 tid 2 2026-02-13T20:23:16.890 INFO:tasks.rados.rados.0.trial188.stdout:2727: writing trial18843701-15 from 2756280 to 3315935 tid 3 2026-02-13T20:23:16.890 INFO:tasks.rados.rados.0.trial188.stdout:2728: write oid 21 current snap is 282 2026-02-13T20:23:16.890 INFO:tasks.rados.rados.0.trial188.stdout:2728: seq_num 948 ranges {733036=563824,2074812=684986,3183703=749333} 2026-02-13T20:23:16.895 INFO:tasks.rados.rados.0.trial188.stdout:2728: writing trial18843701-21 from 733036 to 1296860 tid 1 2026-02-13T20:23:16.900 INFO:tasks.rados.rados.0.trial188.stdout:2728: writing trial18843701-21 from 2074812 to 2759798 tid 2 2026-02-13T20:23:16.904 INFO:tasks.rados.rados.0.trial188.stdout:2728: writing trial18843701-21 from 3183703 to 3933036 tid 3 2026-02-13T20:23:16.905 INFO:tasks.rados.rados.0.trial188.stdout:2729: write oid 2 current snap is 282 2026-02-13T20:23:16.905 INFO:tasks.rados.rados.0.trial188.stdout:2729: seq_num 949 ranges {749843=639073,2133294=544997,3211126=582199} 2026-02-13T20:23:16.909 INFO:tasks.rados.rados.0.trial188.stdout:2729: writing trial18843701-2 from 749843 to 1388916 tid 1 2026-02-13T20:23:16.914 INFO:tasks.rados.rados.0.trial188.stdout:2729: writing trial18843701-2 from 2133294 to 2678291 tid 2 2026-02-13T20:23:16.919 INFO:tasks.rados.rados.0.trial188.stdout:2729: writing trial18843701-2 from 3211126 to 3793325 tid 3 2026-02-13T20:23:16.919 INFO:tasks.rados.rados.0.trial188.stdout:2730: rollback oid 3 current snap is 282 2026-02-13T20:23:16.919 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 3 to 280 2026-02-13T20:23:16.919 INFO:tasks.rados.rados.0.trial188.stdout:2723: finishing rollback tid 0 to trial18843701-42 2026-02-13T20:23:16.919 INFO:tasks.rados.rados.0.trial188.stdout:2731: write (excl) oid 26 current snap is 282 2026-02-13T20:23:16.919 INFO:tasks.rados.rados.0.trial188.stdout:2731: seq_num 950 ranges {766650=714322,2075423=688655,3522196=444454} 2026-02-13T20:23:16.924 INFO:tasks.rados.rados.0.trial188.stdout:2731: writing trial18843701-26 from 766650 to 1480972 tid 1 2026-02-13T20:23:16.929 INFO:tasks.rados.rados.0.trial188.stdout:2731: writing trial18843701-26 from 2075423 to 2764078 tid 2 2026-02-13T20:23:16.936 INFO:tasks.rados.rados.0.trial188.stdout:2731: writing trial18843701-26 from 3522196 to 3966650 tid 3 2026-02-13T20:23:16.936 INFO:tasks.rados.rados.0.trial188.stdout:2732: read oid 16 snap 241 2026-02-13T20:23:16.936 INFO:tasks.rados.rados.0.trial188.stdout:2732: expect (ObjNum 645 snap 172 seq_num 645) 2026-02-13T20:23:16.936 INFO:tasks.rados.rados.0.trial188.stdout:2733: rollback oid 25 current snap is 282 2026-02-13T20:23:16.936 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 25 to 262 2026-02-13T20:23:16.936 INFO:tasks.rados.rados.0.trial188.stdout:2723: finishing rollback tid 1 to trial18843701-42 2026-02-13T20:23:16.936 INFO:tasks.rados.rados.0.trial188.stdout:2723: finishing rollback tid 2 to trial18843701-42 2026-02-13T20:23:16.937 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 42 v 777 (ObjNum 810 snap 240 seq_num 810) dirty exists 2026-02-13T20:23:16.937 INFO:tasks.rados.rados.0.trial188.stdout:2721: finishing copy_from racing read to trial18843701-37 2026-02-13T20:23:16.937 INFO:tasks.rados.rados.0.trial188.stdout:2723: done (8 left) 2026-02-13T20:23:16.937 INFO:tasks.rados.rados.0.trial188.stdout:2734: copy_from oid 24 from oid 6 current snap is 282 2026-02-13T20:23:16.937 INFO:tasks.rados.rados.0.trial188.stdout:2721: finishing copy_from to trial18843701-37 2026-02-13T20:23:16.937 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 37 v 766 (ObjNum 922 snap 279 seq_num 922) dirty exists 2026-02-13T20:23:16.937 INFO:tasks.rados.rados.0.trial188.stdout:2727: finishing write tid 1 to trial18843701-15 2026-02-13T20:23:16.937 INFO:tasks.rados.rados.0.trial188.stdout:2727: finishing write tid 2 to trial18843701-15 2026-02-13T20:23:16.937 INFO:tasks.rados.rados.0.trial188.stdout:2727: finishing write tid 3 to trial18843701-15 2026-02-13T20:23:16.937 INFO:tasks.rados.rados.0.trial188.stdout:2727: finishing write tid 4 to trial18843701-15 2026-02-13T20:23:16.937 INFO:tasks.rados.rados.0.trial188.stdout:2721: done (8 left) 2026-02-13T20:23:16.937 INFO:tasks.rados.rados.0.trial188.stdout:2735: copy_from oid 44 from oid 4 current snap is 282 2026-02-13T20:23:16.937 INFO:tasks.rados.rados.0.trial188.stdout:2727: finishing write tid 5 to trial18843701-15 2026-02-13T20:23:16.938 INFO:tasks.rados.rados.0.trial188.stdout:2727: oid 15 updating version 0 to 976 2026-02-13T20:23:16.938 INFO:tasks.rados.rados.0.trial188.stdout:2727: oid 15 version 976 is already newer than 973 2026-02-13T20:23:16.938 INFO:tasks.rados.rados.0.trial188.stdout:2727: oid 15 version 976 is already newer than 975 2026-02-13T20:23:16.938 INFO:tasks.rados.rados.0.trial188.stdout:2727: oid 15 version 976 is already newer than 974 2026-02-13T20:23:16.938 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 15 v 976 (ObjNum 947 snap 282 seq_num 947) dirty exists 2026-02-13T20:23:16.938 INFO:tasks.rados.rados.0.trial188.stdout:2727: left oid 15 (ObjNum 947 snap 282 seq_num 947) 2026-02-13T20:23:16.938 INFO:tasks.rados.rados.0.trial188.stdout:2728: finishing write tid 1 to trial18843701-21 2026-02-13T20:23:16.938 INFO:tasks.rados.rados.0.trial188.stdout:2727: done (8 left) 2026-02-13T20:23:16.938 INFO:tasks.rados.rados.0.trial188.stdout:2736: read oid 18 snap 228 2026-02-13T20:23:16.938 INFO:tasks.rados.rados.0.trial188.stdout:2736: expect deleted 2026-02-13T20:23:16.938 INFO:tasks.rados.rados.0.trial188.stdout:2737: read oid 15 snap -1 2026-02-13T20:23:16.938 INFO:tasks.rados.rados.0.trial188.stdout:2737: expect (ObjNum 947 snap 282 seq_num 947) 2026-02-13T20:23:16.939 INFO:tasks.rados.rados.0.trial188.stdout:2738: read oid 10 snap -1 2026-02-13T20:23:16.939 INFO:tasks.rados.rados.0.trial188.stdout:2738: expect (ObjNum 645 snap 172 seq_num 645) 2026-02-13T20:23:16.939 INFO:tasks.rados.rados.0.trial188.stdout:2739: read oid 49 snap -1 2026-02-13T20:23:16.939 INFO:tasks.rados.rados.0.trial188.stdout:2739: expect (ObjNum 930 snap 280 seq_num 930) 2026-02-13T20:23:16.939 INFO:tasks.rados.rados.0.trial188.stdout:2740: snap_create 2026-02-13T20:23:16.939 INFO:tasks.rados.rados.0.trial188.stdout:2730: finishing rollback tid 1 to trial18843701-3 2026-02-13T20:23:16.939 INFO:tasks.rados.rados.0.trial188.stdout:2730: finishing rollback tid 2 to trial18843701-3 2026-02-13T20:23:16.939 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 3 v 978 (ObjNum 892 snap 269 seq_num 892) dirty exists 2026-02-13T20:23:16.939 INFO:tasks.rados.rados.0.trial188.stdout:2728: finishing write tid 2 to trial18843701-21 2026-02-13T20:23:16.939 INFO:tasks.rados.rados.0.trial188.stdout:2728: finishing write tid 3 to trial18843701-21 2026-02-13T20:23:16.940 INFO:tasks.rados.rados.0.trial188.stdout:2728: finishing write tid 4 to trial18843701-21 2026-02-13T20:23:16.940 INFO:tasks.rados.rados.0.trial188.stdout:2728: finishing write tid 5 to trial18843701-21 2026-02-13T20:23:16.940 INFO:tasks.rados.rados.0.trial188.stdout:2728: oid 21 updating version 0 to 606 2026-02-13T20:23:16.940 INFO:tasks.rados.rados.0.trial188.stdout:2728: oid 21 version 606 is already newer than 605 2026-02-13T20:23:16.940 INFO:tasks.rados.rados.0.trial188.stdout:2728: oid 21 updating version 606 to 607 2026-02-13T20:23:16.940 INFO:tasks.rados.rados.0.trial188.stdout:2728: oid 21 version 607 is already newer than 604 2026-02-13T20:23:16.940 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 21 v 607 (ObjNum 948 snap 282 seq_num 948) dirty exists 2026-02-13T20:23:16.940 INFO:tasks.rados.rados.0.trial188.stdout:2728: left oid 21 (ObjNum 948 snap 282 seq_num 948) 2026-02-13T20:23:16.941 INFO:tasks.rados.rados.0.trial188.stdout:2729: finishing write tid 1 to trial18843701-2 2026-02-13T20:23:16.941 INFO:tasks.rados.rados.0.trial188.stdout:2733: finishing rollback tid 1 to trial18843701-25 2026-02-13T20:23:16.941 INFO:tasks.rados.rados.0.trial188.stdout:2733: finishing rollback tid 2 to trial18843701-25 2026-02-13T20:23:16.941 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 25 v 1324 (ObjNum 756 snap 223 seq_num 756) dirty exists 2026-02-13T20:23:16.941 INFO:tasks.rados.rados.0.trial188.stdout:2739: expect (ObjNum 930 snap 280 seq_num 930) 2026-02-13T20:23:16.966 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2928946 2026-02-13T20:23:16.980 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:23:17.033 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1050791 2026-02-13T20:23:17.072 INFO:tasks.rados.rados.0.trial188.stdout:2738: expect (ObjNum 645 snap 172 seq_num 645) 2026-02-13T20:23:17.096 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 770992 2026-02-13T20:23:17.128 INFO:tasks.rados.rados.0.trial188.stdout:2731: finishing write tid 1 to trial18843701-26 2026-02-13T20:23:17.128 INFO:tasks.rados.rados.0.trial188.stdout:2732: expect (ObjNum 645 snap 172 seq_num 645) 2026-02-13T20:23:17.176 INFO:tasks.rados.rados.0.trial188.stdout:2737: expect (ObjNum 947 snap 282 seq_num 947) 2026-02-13T20:23:17.179 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1055730 2026-02-13T20:23:17.224 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2026-02-13T20:23:17.225 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2026-02-13T20:23:17.225 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-13T20:23:17.225 DEBUG:teuthology.orchestra.run.trial188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-13T20:23:17.228 INFO:tasks.ceph.mon.b:Started 2026-02-13T20:23:17.228 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.c 2026-02-13T20:23:17.228 INFO:tasks.mon_thrash:Sending STOP to mon c 2026-02-13T20:23:17.229 INFO:tasks.ceph.mon.c:Sent signal 19 2026-02-13T20:23:17.229 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-13T20:23:17.229 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:23:17.258 INFO:tasks.rados.rados.0.trial188.stdout:2735: finishing copy_from racing read to trial18843701-44 2026-02-13T20:23:17.258 INFO:tasks.rados.rados.0.trial188.stdout:2729: finishing write tid 2 to trial18843701-2 2026-02-13T20:23:17.259 INFO:tasks.rados.rados.0.trial188.stdout:2729: finishing write tid 3 to trial18843701-2 2026-02-13T20:23:17.259 INFO:tasks.rados.rados.0.trial188.stdout:2731: finishing write tid 2 to trial18843701-26 2026-02-13T20:23:17.259 INFO:tasks.rados.rados.0.trial188.stdout:2731: finishing write tid 3 to trial18843701-26 2026-02-13T20:23:17.259 INFO:tasks.rados.rados.0.trial188.stdout:2731: finishing write tid 4 to trial18843701-26 2026-02-13T20:23:17.259 INFO:tasks.rados.rados.0.trial188.stdout:2729: finishing write tid 4 to trial18843701-2 2026-02-13T20:23:17.259 INFO:tasks.rados.rados.0.trial188.stdout:2731: finishing write tid 5 to trial18843701-26 2026-02-13T20:23:17.259 INFO:tasks.rados.rados.0.trial188.stdout:2731: oid 26 updating version 0 to 979 2026-02-13T20:23:17.259 INFO:tasks.rados.rados.0.trial188.stdout:2731: oid 26 updating version 979 to 981 2026-02-13T20:23:17.259 INFO:tasks.rados.rados.0.trial188.stdout:2731: oid 26 updating version 981 to 982 2026-02-13T20:23:17.259 INFO:tasks.rados.rados.0.trial188.stdout:2731: oid 26 version 982 is already newer than 980 2026-02-13T20:23:17.259 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 26 v 982 (ObjNum 950 snap 282 seq_num 950) dirty exists 2026-02-13T20:23:17.259 INFO:tasks.rados.rados.0.trial188.stdout:2731: left oid 26 (ObjNum 950 snap 282 seq_num 950) 2026-02-13T20:23:17.260 INFO:tasks.rados.rados.0.trial188.stdout:2729: finishing write tid 5 to trial18843701-2 2026-02-13T20:23:17.260 INFO:tasks.rados.rados.0.trial188.stdout:2729: oid 2 updating version 0 to 1268 2026-02-13T20:23:17.260 INFO:tasks.rados.rados.0.trial188.stdout:2729: oid 2 updating version 1268 to 1270 2026-02-13T20:23:17.260 INFO:tasks.rados.rados.0.trial188.stdout:2729: oid 2 version 1270 is already newer than 1269 2026-02-13T20:23:17.260 INFO:tasks.rados.rados.0.trial188.stdout:2729: oid 2 version 1270 is already newer than 1267 2026-02-13T20:23:17.260 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 2 v 1270 (ObjNum 949 snap 282 seq_num 949) dirty exists 2026-02-13T20:23:17.260 INFO:tasks.rados.rados.0.trial188.stdout:2729: left oid 2 (ObjNum 949 snap 282 seq_num 949) 2026-02-13T20:23:17.260 INFO:tasks.rados.rados.0.trial188.stdout:2735: finishing copy_from to trial18843701-44 2026-02-13T20:23:17.260 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 44 v 966 (ObjNum 892 snap 269 seq_num 892) dirty exists 2026-02-13T20:23:17.260 INFO:tasks.rados.rados.0.trial188.stdout:2734: finishing copy_from racing read to trial18843701-24 2026-02-13T20:23:17.260 INFO:tasks.rados.rados.0.trial188.stdout:2734: finishing copy_from to trial18843701-24 2026-02-13T20:23:17.260 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 24 v 1122 (ObjNum 854 snap 250 seq_num 854) dirty exists 2026-02-13T20:23:32.229 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.c 2026-02-13T20:23:32.230 INFO:tasks.mon_thrash:Sending CONT to mon c 2026-02-13T20:23:32.230 INFO:tasks.ceph.mon.c:Sent signal 18 2026-02-13T20:23:32.230 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-13T20:23:32.230 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T20:23:32.303 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.296+0000 7f4730a5b640 10 monclient: get_monmap_and_config 2026-02-13T20:23:32.303 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.296+0000 7f4730a5b640 10 monclient: build_initial_monmap 2026-02-13T20:23:32.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.296+0000 7f4730a5b640 10 monclient: monmap: 2026-02-13T20:23:32.304 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:23:32.304 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:32.304 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:23:32.297628+0000 2026-02-13T20:23:32.304 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:23:32.297628+0000 2026-02-13T20:23:32.304 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:23:32.304 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:32.304 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:23:32.304 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:23:32.304 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:23:32.304 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:32.305 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.296+0000 7f4730a5b640 1 Processor -- start 2026-02-13T20:23:32.305 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.296+0000 7f4730a5b640 1 -- start start 2026-02-13T20:23:32.305 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.296+0000 7f4730a5b640 10 monclient: init 2026-02-13T20:23:32.305 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.296+0000 7f4730a5b640 10 monclient: _reopen_session rank -1 2026-02-13T20:23:32.305 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.296+0000 7f4730a5b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:23:32.305 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.296+0000 7f4730a5b640 10 monclient(hunting): picked mon.noname-b con 0x7f472c1401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:23:32.305 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.296+0000 7f4730a5b640 10 monclient(hunting): picked mon.noname-c con 0x7f472c092020 addr v1:10.20.193.188:6789/0 2026-02-13T20:23:32.305 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.296+0000 7f4730a5b640 10 monclient(hunting): picked mon.noname-a con 0x7f472c091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:23:32.305 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.296+0000 7f4730a5b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f472c08b730 con 0x7f472c091950 2026-02-13T20:23:32.305 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.296+0000 7f4730a5b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f472c05c5b0 con 0x7f472c092020 2026-02-13T20:23:32.305 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.296+0000 7f4730a5b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f472c08bcf0 con 0x7f472c1401c0 2026-02-13T20:23:32.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.296+0000 7f4730a5b640 10 monclient(hunting): _renew_subs 2026-02-13T20:23:32.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.296+0000 7f4730a5b640 10 monclient(hunting): authenticate will time out at 1373.987972s 2026-02-13T20:23:32.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.297+0000 7f472a575640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f472c1401c0 0x7f472c091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:50116/0 (socket says 10.20.193.110:50116) 2026-02-13T20:23:32.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.297+0000 7f472a575640 1 -- 10.20.193.110:0/1065175319 learned_addr learned my addr 10.20.193.110:0/1065175319 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:23:32.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.297+0000 7f472ad76640 1 --1- 10.20.193.110:0/1065175319 >> v1:10.20.193.110:6789/0 conn(0x7f472c091950 0x7f472c1a2a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:37470/0 (socket says 10.20.193.110:37470) 2026-02-13T20:23:32.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.297+0000 7f4729573640 1 -- 10.20.193.110:0/1065175319 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3640235703 0 0) 0x7f472c08b730 con 0x7f472c091950 2026-02-13T20:23:32.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.297+0000 7f4729573640 10 monclient(hunting): _negotiate 2026-02-13T20:23:32.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.297+0000 7f4729573640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:32.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.297+0000 7f4729573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:32.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.297+0000 7f4729573640 10 monclient(hunting): my global_id is 124179 2026-02-13T20:23:32.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.297+0000 7f4729573640 1 -- 10.20.193.110:0/1065175319 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47180035e0 con 0x7f472c091950 2026-02-13T20:23:32.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.297+0000 7f4729573640 1 -- 10.20.193.110:0/1065175319 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4102649308 0 0) 0x7f47180035e0 con 0x7f472c091950 2026-02-13T20:23:32.307 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.297+0000 7f4729573640 1 -- 10.20.193.110:0/1065175319 >> v1:10.20.193.110:6790/0 conn(0x7f472c1401c0 legacy=0x7f472c091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:32.307 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.297+0000 7f4729573640 1 -- 10.20.193.110:0/1065175319 >> v1:10.20.193.188:6789/0 conn(0x7f472c092020 legacy=0x7f472c1812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:32.307 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.297+0000 7f4729573640 10 monclient: _finish_hunting 0 2026-02-13T20:23:32.307 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.297+0000 7f4729573640 1 monclient: found mon.noname-a 2026-02-13T20:23:32.307 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.297+0000 7f4729573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:23:32.307 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.297+0000 7f4729573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:23:32.307 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.297+0000 7f4729573640 1 -- 10.20.193.110:0/1065175319 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f472c140590 con 0x7f472c091950 2026-02-13T20:23:32.307 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.297+0000 7f4729573640 10 monclient: _finish_auth 0 2026-02-13T20:23:32.307 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.297+0000 7f4729573640 10 monclient: _check_auth_tickets 2026-02-13T20:23:32.307 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.297+0000 7f4729573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:23:32.307 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.297+0000 7f4729573640 1 -- 10.20.193.110:0/1065175319 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f471c003eb0 con 0x7f472c091950 2026-02-13T20:23:32.307 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.297+0000 7f4729573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:32.308 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.297+0000 7f4729573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:23:32.308 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.297+0000 7f4729573640 10 monclient: dump: 2026-02-13T20:23:32.308 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:32.308 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:32.308 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:32.308 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:32.308 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:32.308 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:32.308 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:32.308 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:32.308 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:32.308 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:32.308 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.297+0000 7f4730a5b640 5 monclient: authenticate success, global_id 124179 2026-02-13T20:23:32.309 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.297+0000 7f4730a5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:23:32.309 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.297+0000 7f4729573640 1 -- 10.20.193.110:0/1065175319 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f471c004080 con 0x7f472c091950 2026-02-13T20:23:32.309 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.297+0000 7f4729573640 10 monclient: handle_config config(0 keys) 2026-02-13T20:23:32.309 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.297+0000 7f4729573640 1 -- 10.20.193.110:0/1065175319 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f471c004450 con 0x7f472c091950 2026-02-13T20:23:32.309 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.297+0000 7f4729573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:32.309 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.297+0000 7f4729573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:23:32.309 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.297+0000 7f4729573640 10 monclient: dump: 2026-02-13T20:23:32.309 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:32.309 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:32.309 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:32.309 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:32.309 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:32.310 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:32.310 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:32.310 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:32.310 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:32.310 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:32.310 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.297+0000 7f4730a5b640 10 monclient: get_monmap_and_config success 2026-02-13T20:23:32.310 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.297+0000 7f4730a5b640 4 set_mon_vals no callback set 2026-02-13T20:23:32.310 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.297+0000 7f4730a5b640 10 monclient: shutdown 2026-02-13T20:23:32.310 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.297+0000 7f4730a5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:23:32.310 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.297+0000 7f4730a5b640 1 -- 10.20.193.110:0/1065175319 >> v1:10.20.193.110:6789/0 conn(0x7f472c091950 legacy=0x7f472c1a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:32.310 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.297+0000 7f4730a5b640 1 -- 10.20.193.110:0/1065175319 shutdown_connections 2026-02-13T20:23:32.310 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.297+0000 7f4730a5b640 1 -- 10.20.193.110:0/1065175319 >> 10.20.193.110:0/1065175319 conn(0x7f472c054e90 msgr2=0x7f472c058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:23:32.311 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.297+0000 7f4730a5b640 1 -- 10.20.193.110:0/1065175319 shutdown_connections 2026-02-13T20:23:32.311 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.297+0000 7f4730a5b640 1 -- 10.20.193.110:0/1065175319 wait complete. 2026-02-13T20:23:32.311 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.298+0000 7f4730a5b640 10 monclient: build_initial_monmap 2026-02-13T20:23:32.311 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.298+0000 7f4730a5b640 10 monclient: monmap: 2026-02-13T20:23:32.311 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:23:32.311 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:23:32.311 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:23:32.311 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:23:32.311 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:23:32.311 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:23:32.311 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:23:32.311 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:23:32.312 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:23:32.312 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:32.312 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.298+0000 7f4730a5b640 1 Processor -- start 2026-02-13T20:23:32.312 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.298+0000 7f4730a5b640 1 -- start start 2026-02-13T20:23:32.312 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.298+0000 7f4730a5b640 10 monclient: init 2026-02-13T20:23:32.312 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.298+0000 7f4730a5b640 10 monclient: _reopen_session rank -1 2026-02-13T20:23:32.312 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.298+0000 7f4730a5b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:23:32.312 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.298+0000 7f4730a5b640 10 monclient(hunting): picked mon.noname-a con 0x7f472c091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:23:32.312 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.298+0000 7f4730a5b640 10 monclient(hunting): picked mon.noname-c con 0x7f472c1401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:23:32.312 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.298+0000 7f4730a5b640 10 monclient(hunting): picked mon.noname-b con 0x7f472c1a2050 addr v1:10.20.193.188:6789/0 2026-02-13T20:23:32.312 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.298+0000 7f4730a5b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f472c05d320 con 0x7f472c091950 2026-02-13T20:23:32.312 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.298+0000 7f4730a5b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f472c12e100 con 0x7f472c1a2050 2026-02-13T20:23:32.313 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.298+0000 7f4730a5b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f472c091030 con 0x7f472c1401c0 2026-02-13T20:23:32.313 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.298+0000 7f4730a5b640 10 monclient(hunting): _renew_subs 2026-02-13T20:23:32.313 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.298+0000 7f4730a5b640 10 monclient(hunting): authenticate will time out at 1373.989707s 2026-02-13T20:23:32.313 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.298+0000 7f472a575640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f472c091950 0x7f472c129e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:37478/0 (socket says 10.20.193.110:37478) 2026-02-13T20:23:32.313 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.298+0000 7f472a575640 1 -- 10.20.193.110:0/3282896460 learned_addr learned my addr 10.20.193.110:0/3282896460 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:23:32.313 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.298+0000 7f4712ffd640 1 -- 10.20.193.110:0/3282896460 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1827900843 0 0) 0x7f472c05d320 con 0x7f472c091950 2026-02-13T20:23:32.313 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.298+0000 7f4712ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:23:32.313 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.298+0000 7f4712ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:32.313 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.298+0000 7f4712ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:32.313 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.298+0000 7f4712ffd640 10 monclient(hunting): my global_id is 124182 2026-02-13T20:23:32.313 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.298+0000 7f4712ffd640 1 -- 10.20.193.110:0/3282896460 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46f80035e0 con 0x7f472c091950 2026-02-13T20:23:32.313 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.299+0000 7f4712ffd640 1 -- 10.20.193.110:0/3282896460 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2305895184 0 0) 0x7f46f80035e0 con 0x7f472c091950 2026-02-13T20:23:32.314 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.299+0000 7f4712ffd640 1 -- 10.20.193.110:0/3282896460 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f472c05d320 con 0x7f472c091950 2026-02-13T20:23:32.314 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.299+0000 7f4712ffd640 1 -- 10.20.193.110:0/3282896460 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f4720002ff0 con 0x7f472c091950 2026-02-13T20:23:32.314 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.299+0000 7f4712ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:23:32.314 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.299+0000 7f4712ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:23:32.314 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.299+0000 7f4712ffd640 10 monclient(hunting): dump: 2026-02-13T20:23:32.314 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:32.314 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:32.314 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:32.314 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:32.314 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:32.314 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:32.314 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:32.314 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:32.315 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:32.315 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:32.315 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.299+0000 7f4712ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:23:32.315 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.299+0000 7f4712ffd640 1 -- 10.20.193.110:0/3282896460 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3348566653 0 0) 0x7f472c05d320 con 0x7f472c091950 2026-02-13T20:23:32.315 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.299+0000 7f4712ffd640 1 -- 10.20.193.110:0/3282896460 >> v1:10.20.193.110:6790/0 conn(0x7f472c1401c0 legacy=0x7f472c12a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:32.315 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.299+0000 7f4712ffd640 1 -- 10.20.193.110:0/3282896460 >> v1:10.20.193.188:6789/0 conn(0x7f472c1a2050 legacy=0x7f472c1a24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:32.315 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.299+0000 7f4712ffd640 10 monclient: _finish_hunting 0 2026-02-13T20:23:32.315 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.299+0000 7f4712ffd640 1 monclient: found mon.a 2026-02-13T20:23:32.315 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.299+0000 7f4712ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:23:32.315 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.299+0000 7f4712ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:23:32.315 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.299+0000 7f4712ffd640 1 -- 10.20.193.110:0/3282896460 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f472c12ac40 con 0x7f472c091950 2026-02-13T20:23:32.315 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.299+0000 7f4712ffd640 10 monclient: _finish_auth 0 2026-02-13T20:23:32.316 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.299+0000 7f4712ffd640 10 monclient: _check_auth_tickets 2026-02-13T20:23:32.316 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.299+0000 7f4712ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:23:32.316 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.299+0000 7f4730a5b640 5 monclient: authenticate success, global_id 124182 2026-02-13T20:23:32.316 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.299+0000 7f4730a5b640 10 monclient: _renew_subs 2026-02-13T20:23:32.316 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.299+0000 7f4730a5b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:23:32.316 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.299+0000 7f4730a5b640 1 -- 10.20.193.110:0/3282896460 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f472c12dc00 con 0x7f472c091950 2026-02-13T20:23:32.316 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.299+0000 7f4730a5b640 10 monclient: _renew_subs 2026-02-13T20:23:32.316 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.299+0000 7f4730a5b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:23:32.316 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.299+0000 7f4730a5b640 1 -- 10.20.193.110:0/3282896460 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f472c12cd90 con 0x7f472c091950 2026-02-13T20:23:32.316 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.299+0000 7f4712ffd640 1 -- 10.20.193.110:0/3282896460 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f47200031c0 con 0x7f472c091950 2026-02-13T20:23:32.316 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.299+0000 7f4712ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:23:32.316 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.299+0000 7f4712ffd640 1 -- 10.20.193.110:0/3282896460 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f4720004b10 con 0x7f472c091950 2026-02-13T20:23:32.316 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.299+0000 7f4712ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:32.317 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.299+0000 7f4712ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:23:32.317 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.299+0000 7f4728d72640 4 set_mon_vals no callback set 2026-02-13T20:23:32.317 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.299+0000 7f4712ffd640 10 monclient: dump: 2026-02-13T20:23:32.317 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:32.317 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:32.317 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:32.317 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:32.317 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:32.317 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:32.317 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:32.317 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:32.317 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:32.318 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:32.318 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.299+0000 7f4730a5b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:23:32.318 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.299+0000 7f4730a5b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:23:32.318 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.299+0000 7f4730a5b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:23:32.318 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.299+0000 7f4730a5b640 1 -- 10.20.193.110:0/3282896460 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f472c08d170 con 0x7f472c091950 2026-02-13T20:23:32.318 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.299+0000 7f4712ffd640 1 -- 10.20.193.110:0/3282896460 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f4720004c70 con 0x7f472c091950 2026-02-13T20:23:32.318 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.300+0000 7f4712ffd640 1 -- 10.20.193.110:0/3282896460 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(581..581 src has 1..581) ==== 4035+0+0 (unknown 623511240 0 0) 0x7f472004e970 con 0x7f472c091950 2026-02-13T20:23:32.318 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.300+0000 7f4729d74640 10 monclient: get_auth_request con 0x7f46f803f720 auth_method 0 2026-02-13T20:23:32.318 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.302+0000 7f4712ffd640 1 -- 10.20.193.110:0/3282896460 <== mon.0 v1:10.20.193.110:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f4720016a30 con 0x7f472c091950 2026-02-13T20:23:32.318 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.302+0000 7f4712ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:23:32.318 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.302+0000 7f4712ffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:23:32.455 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.453+0000 7f4730a5b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T20:23:32.455 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.453+0000 7f4730a5b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T20:23:32.455 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.453+0000 7f4730a5b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:23:32.455 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.453+0000 7f4730a5b640 1 -- 10.20.193.110:0/3282896460 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f472c055bb0 con 0x7f472c091950 2026-02-13T20:23:32.455 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.453+0000 7f4712ffd640 1 -- 10.20.193.110:0/3282896460 <== mon.0 v1:10.20.193.110:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 2515337613) 0x7f4720016850 con 0x7f472c091950 2026-02-13T20:23:32.455 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.453+0000 7f4712ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T20:23:32.455 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.453+0000 7f4712ffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:23:32.456 INFO:teuthology.orchestra.run.trial110.stdout:{"election_epoch":42,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","modified":"2026-02-13T20:11:07.161192Z","created":"2026-02-13T20:11:07.161192Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6789","nonce":0}]},"addr":"10.20.193.110:6789/0","public_addr":"10.20.193.110:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161241+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6789","nonce":0}]},"addr":"10.20.193.188:6789/0","public_addr":"10.20.193.188:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161242+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6790","nonce":0}]},"addr":"10.20.193.110:6790/0","public_addr":"10.20.193.110:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161243+0000","crush_location":[]}]}} 2026-02-13T20:23:32.457 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.454+0000 7f4730a5b640 1 -- 10.20.193.110:0/3282896460 >> v1:10.20.193.188:6812/1623052694 conn(0x7f46f803f720 legacy=0x7f46f805fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:32.457 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.454+0000 7f4730a5b640 10 monclient: shutdown 2026-02-13T20:23:32.457 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.454+0000 7f4730a5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:23:32.457 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.454+0000 7f4730a5b640 1 -- 10.20.193.110:0/3282896460 >> v1:10.20.193.110:6789/0 conn(0x7f472c091950 legacy=0x7f472c129e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:32.457 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.454+0000 7f4730a5b640 1 -- 10.20.193.110:0/3282896460 shutdown_connections 2026-02-13T20:23:32.457 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.454+0000 7f4730a5b640 1 -- 10.20.193.110:0/3282896460 >> 10.20.193.110:0/3282896460 conn(0x7f472c054e90 msgr2=0x7f472c08a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:23:32.457 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.454+0000 7f4730a5b640 1 -- 10.20.193.110:0/3282896460 shutdown_connections 2026-02-13T20:23:32.457 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:32.454+0000 7f4730a5b640 1 -- 10.20.193.110:0/3282896460 wait complete. 2026-02-13T20:23:35.464 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T20:23:35.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.532+0000 7f1340252640 10 monclient: get_monmap_and_config 2026-02-13T20:23:35.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.532+0000 7f1340252640 10 monclient: build_initial_monmap 2026-02-13T20:23:35.541 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.532+0000 7f1340252640 10 monclient: monmap: 2026-02-13T20:23:35.541 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:23:35.541 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:35.541 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:23:35.533685+0000 2026-02-13T20:23:35.541 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:23:35.533685+0000 2026-02-13T20:23:35.541 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:23:35.541 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:35.541 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:23:35.541 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:23:35.541 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:23:35.541 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:35.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.532+0000 7f1340252640 1 Processor -- start 2026-02-13T20:23:35.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.532+0000 7f1340252640 1 -- start start 2026-02-13T20:23:35.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.532+0000 7f1340252640 10 monclient: init 2026-02-13T20:23:35.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.532+0000 7f1340252640 10 monclient: _reopen_session rank -1 2026-02-13T20:23:35.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.533+0000 7f1340252640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:23:35.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.533+0000 7f1340252640 10 monclient(hunting): picked mon.noname-a con 0x7f13381401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:23:35.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.533+0000 7f1340252640 10 monclient(hunting): picked mon.noname-c con 0x7f1338092020 addr v1:10.20.193.188:6789/0 2026-02-13T20:23:35.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.533+0000 7f1340252640 10 monclient(hunting): picked mon.noname-b con 0x7f1338091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:23:35.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.533+0000 7f1340252640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f133808b730 con 0x7f13381401c0 2026-02-13T20:23:35.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.533+0000 7f1340252640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f133805c5b0 con 0x7f1338092020 2026-02-13T20:23:35.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.533+0000 7f1340252640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f133808bcf0 con 0x7f1338091950 2026-02-13T20:23:35.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.533+0000 7f1340252640 10 monclient(hunting): _renew_subs 2026-02-13T20:23:35.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.533+0000 7f1340252640 10 monclient(hunting): authenticate will time out at 1377.224085s 2026-02-13T20:23:35.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.533+0000 7f133dfc7640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f13381401c0 0x7f1338091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:37482/0 (socket says 10.20.193.110:37482) 2026-02-13T20:23:35.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.533+0000 7f133dfc7640 1 -- 10.20.193.110:0/3631827693 learned_addr learned my addr 10.20.193.110:0/3631827693 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:23:35.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.533+0000 7f133cfc5640 1 -- 10.20.193.110:0/3631827693 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2408422709 0 0) 0x7f133808b730 con 0x7f13381401c0 2026-02-13T20:23:35.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.533+0000 7f133cfc5640 10 monclient(hunting): _negotiate 2026-02-13T20:23:35.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.533+0000 7f133cfc5640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:35.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.533+0000 7f133cfc5640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:35.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.533+0000 7f133cfc5640 10 monclient(hunting): my global_id is 124185 2026-02-13T20:23:35.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.533+0000 7f133cfc5640 1 -- 10.20.193.110:0/3631827693 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13200035e0 con 0x7f13381401c0 2026-02-13T20:23:35.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.533+0000 7f133cfc5640 1 -- 10.20.193.110:0/3631827693 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4170457743 0 0) 0x7f13200035e0 con 0x7f13381401c0 2026-02-13T20:23:35.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.533+0000 7f133cfc5640 1 -- 10.20.193.110:0/3631827693 >> v1:10.20.193.110:6790/0 conn(0x7f1338091950 legacy=0x7f13381a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:35.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.533+0000 7f133cfc5640 1 -- 10.20.193.110:0/3631827693 >> v1:10.20.193.188:6789/0 conn(0x7f1338092020 legacy=0x7f13381812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:35.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.533+0000 7f133cfc5640 10 monclient: _finish_hunting 0 2026-02-13T20:23:35.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.533+0000 7f133cfc5640 1 monclient: found mon.noname-a 2026-02-13T20:23:35.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.533+0000 7f133cfc5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:23:35.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.533+0000 7f133cfc5640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:23:35.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.533+0000 7f133cfc5640 1 -- 10.20.193.110:0/3631827693 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1338140590 con 0x7f13381401c0 2026-02-13T20:23:35.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.533+0000 7f133cfc5640 10 monclient: _finish_auth 0 2026-02-13T20:23:35.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.533+0000 7f133cfc5640 10 monclient: _check_auth_tickets 2026-02-13T20:23:35.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.533+0000 7f133cfc5640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:23:35.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.533+0000 7f133cfc5640 1 -- 10.20.193.110:0/3631827693 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f1328002dd0 con 0x7f13381401c0 2026-02-13T20:23:35.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.533+0000 7f1340252640 5 monclient: authenticate success, global_id 124185 2026-02-13T20:23:35.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.533+0000 7f133cfc5640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:35.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.533+0000 7f133cfc5640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:23:35.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.533+0000 7f133cfc5640 10 monclient: dump: 2026-02-13T20:23:35.545 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:35.545 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:35.545 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:35.545 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:35.545 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:35.545 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:35.546 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:35.546 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:35.546 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:35.546 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:35.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.533+0000 7f1340252640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:23:35.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.533+0000 7f133cfc5640 1 -- 10.20.193.110:0/3631827693 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1328002fa0 con 0x7f13381401c0 2026-02-13T20:23:35.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.533+0000 7f133cfc5640 10 monclient: handle_config config(0 keys) 2026-02-13T20:23:35.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.533+0000 7f133cfc5640 1 -- 10.20.193.110:0/3631827693 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f13280033b0 con 0x7f13381401c0 2026-02-13T20:23:35.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.533+0000 7f133cfc5640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:35.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.533+0000 7f133cfc5640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:23:35.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.533+0000 7f133cfc5640 10 monclient: dump: 2026-02-13T20:23:35.546 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:35.547 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:35.547 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:35.547 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:35.547 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:35.547 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:35.547 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:35.547 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:35.547 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:35.547 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:35.547 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.533+0000 7f1340252640 10 monclient: get_monmap_and_config success 2026-02-13T20:23:35.547 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.533+0000 7f1340252640 4 set_mon_vals no callback set 2026-02-13T20:23:35.547 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.534+0000 7f1340252640 10 monclient: shutdown 2026-02-13T20:23:35.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.534+0000 7f1340252640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:23:35.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.534+0000 7f1340252640 1 -- 10.20.193.110:0/3631827693 >> v1:10.20.193.110:6789/0 conn(0x7f13381401c0 legacy=0x7f1338091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:35.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.534+0000 7f1340252640 1 -- 10.20.193.110:0/3631827693 shutdown_connections 2026-02-13T20:23:35.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.534+0000 7f1340252640 1 -- 10.20.193.110:0/3631827693 >> 10.20.193.110:0/3631827693 conn(0x7f1338054e90 msgr2=0x7f1338058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:23:35.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.534+0000 7f1340252640 1 -- 10.20.193.110:0/3631827693 shutdown_connections 2026-02-13T20:23:35.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.534+0000 7f1340252640 1 -- 10.20.193.110:0/3631827693 wait complete. 2026-02-13T20:23:35.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.534+0000 7f1340252640 10 monclient: build_initial_monmap 2026-02-13T20:23:35.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.534+0000 7f1340252640 10 monclient: monmap: 2026-02-13T20:23:35.548 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:23:35.548 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:23:35.548 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:23:35.548 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:23:35.549 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:23:35.549 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:23:35.549 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:23:35.549 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:23:35.549 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:23:35.549 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:35.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.534+0000 7f1340252640 1 Processor -- start 2026-02-13T20:23:35.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.534+0000 7f1340252640 1 -- start start 2026-02-13T20:23:35.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.534+0000 7f1340252640 10 monclient: init 2026-02-13T20:23:35.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.534+0000 7f1340252640 10 monclient: _reopen_session rank -1 2026-02-13T20:23:35.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.534+0000 7f1340252640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:23:35.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.534+0000 7f1340252640 10 monclient(hunting): picked mon.noname-b con 0x7f1338091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:23:35.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.534+0000 7f1340252640 10 monclient(hunting): picked mon.noname-a con 0x7f13381401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:23:35.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.534+0000 7f1340252640 10 monclient(hunting): picked mon.noname-c con 0x7f13381307d0 addr v1:10.20.193.110:6790/0 2026-02-13T20:23:35.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.534+0000 7f1340252640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f133813ecc0 con 0x7f13381401c0 2026-02-13T20:23:35.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.534+0000 7f1340252640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13381501f0 con 0x7f1338091950 2026-02-13T20:23:35.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.534+0000 7f1340252640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f133808c470 con 0x7f13381307d0 2026-02-13T20:23:35.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.534+0000 7f1340252640 10 monclient(hunting): _renew_subs 2026-02-13T20:23:35.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.534+0000 7f1340252640 10 monclient(hunting): authenticate will time out at 1377.225989s 2026-02-13T20:23:35.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.535+0000 7f133d7c6640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f13381401c0 0x7f1338193bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:37484/0 (socket says 10.20.193.110:37484) 2026-02-13T20:23:35.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.535+0000 7f133d7c6640 1 -- 10.20.193.110:0/1224185947 learned_addr learned my addr 10.20.193.110:0/1224185947 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:23:35.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.535+0000 7f13267fc640 1 -- 10.20.193.110:0/1224185947 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4227244584 0 0) 0x7f133813ecc0 con 0x7f13381401c0 2026-02-13T20:23:35.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.535+0000 7f13267fc640 10 monclient(hunting): _negotiate 2026-02-13T20:23:35.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.535+0000 7f13267fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:35.551 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.535+0000 7f13267fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:35.551 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.535+0000 7f13267fc640 10 monclient(hunting): my global_id is 124188 2026-02-13T20:23:35.551 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.535+0000 7f13267fc640 1 -- 10.20.193.110:0/1224185947 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13080035e0 con 0x7f13381401c0 2026-02-13T20:23:35.551 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.535+0000 7f13267fc640 1 -- 10.20.193.110:0/1224185947 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4040871868 0 0) 0x7f13080035e0 con 0x7f13381401c0 2026-02-13T20:23:35.551 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.535+0000 7f13267fc640 1 -- 10.20.193.110:0/1224185947 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f133813ecc0 con 0x7f13381401c0 2026-02-13T20:23:35.551 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.535+0000 7f13267fc640 1 -- 10.20.193.110:0/1224185947 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f132c0030f0 con 0x7f13381401c0 2026-02-13T20:23:35.551 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.535+0000 7f13267fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:23:35.551 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.535+0000 7f13267fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:23:35.551 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.535+0000 7f13267fc640 10 monclient(hunting): dump: 2026-02-13T20:23:35.551 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:35.551 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:35.551 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:35.552 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:35.552 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:35.552 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:35.552 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:35.552 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:35.552 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:35.552 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:35.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.535+0000 7f13267fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:23:35.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.535+0000 7f13267fc640 1 -- 10.20.193.110:0/1224185947 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2644907683 0 0) 0x7f133813ecc0 con 0x7f13381401c0 2026-02-13T20:23:35.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.535+0000 7f13267fc640 1 -- 10.20.193.110:0/1224185947 >> v1:10.20.193.110:6790/0 conn(0x7f13381307d0 legacy=0x7f13381952f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:35.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.535+0000 7f13267fc640 1 -- 10.20.193.110:0/1224185947 >> v1:10.20.193.188:6789/0 conn(0x7f1338091950 legacy=0x7f133813e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:35.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.535+0000 7f13267fc640 10 monclient: _finish_hunting 0 2026-02-13T20:23:35.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.535+0000 7f13267fc640 1 monclient: found mon.a 2026-02-13T20:23:35.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.535+0000 7f13267fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:23:35.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.535+0000 7f13267fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:23:35.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.535+0000 7f13267fc640 1 -- 10.20.193.110:0/1224185947 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f133805d320 con 0x7f13381401c0 2026-02-13T20:23:35.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.535+0000 7f13267fc640 10 monclient: _finish_auth 0 2026-02-13T20:23:35.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.535+0000 7f13267fc640 10 monclient: _check_auth_tickets 2026-02-13T20:23:35.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.535+0000 7f13267fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:23:35.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.535+0000 7f1340252640 5 monclient: authenticate success, global_id 124188 2026-02-13T20:23:35.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.535+0000 7f1340252640 10 monclient: _renew_subs 2026-02-13T20:23:35.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.535+0000 7f1340252640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:23:35.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.535+0000 7f1340252640 1 -- 10.20.193.110:0/1224185947 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f133808a8d0 con 0x7f13381401c0 2026-02-13T20:23:35.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.535+0000 7f1340252640 10 monclient: _renew_subs 2026-02-13T20:23:35.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.535+0000 7f1340252640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:23:35.554 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.535+0000 7f1340252640 1 -- 10.20.193.110:0/1224185947 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1338132080 con 0x7f13381401c0 2026-02-13T20:23:35.554 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.535+0000 7f13267fc640 1 -- 10.20.193.110:0/1224185947 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f132c003460 con 0x7f13381401c0 2026-02-13T20:23:35.554 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.535+0000 7f13267fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:23:35.554 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.535+0000 7f13267fc640 1 -- 10.20.193.110:0/1224185947 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f132c003b70 con 0x7f13381401c0 2026-02-13T20:23:35.554 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.535+0000 7f13267fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:35.554 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.535+0000 7f13267fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:23:35.554 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.535+0000 7f1327fff640 4 set_mon_vals no callback set 2026-02-13T20:23:35.554 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.535+0000 7f13267fc640 10 monclient: dump: 2026-02-13T20:23:35.554 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:35.554 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:35.554 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:35.554 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:35.555 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:35.555 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:35.555 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:35.555 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:35.555 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:35.555 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:35.555 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.536+0000 7f1340252640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:23:35.555 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.536+0000 7f1340252640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:23:35.555 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.536+0000 7f1340252640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:23:35.555 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.536+0000 7f1340252640 1 -- 10.20.193.110:0/1224185947 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13380008d0 con 0x7f13381401c0 2026-02-13T20:23:35.555 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.536+0000 7f13267fc640 1 -- 10.20.193.110:0/1224185947 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f132c003cd0 con 0x7f13381401c0 2026-02-13T20:23:35.555 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.536+0000 7f13267fc640 1 -- 10.20.193.110:0/1224185947 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(582..582 src has 1..582) ==== 3931+0+0 (unknown 1315023635 0 0) 0x7f132c04e9c0 con 0x7f13381401c0 2026-02-13T20:23:35.556 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.536+0000 7f133dfc7640 10 monclient: get_auth_request con 0x7f130803f740 auth_method 0 2026-02-13T20:23:35.556 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.538+0000 7f13267fc640 1 -- 10.20.193.110:0/1224185947 <== mon.0 v1:10.20.193.110:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f132c004560 con 0x7f13381401c0 2026-02-13T20:23:35.556 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.538+0000 7f13267fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:23:35.556 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.538+0000 7f13267fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:23:35.685 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.683+0000 7f1340252640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T20:23:35.685 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.683+0000 7f1340252640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T20:23:35.685 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.683+0000 7f1340252640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:23:35.685 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.683+0000 7f1340252640 1 -- 10.20.193.110:0/1224185947 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1338058410 con 0x7f13381401c0 2026-02-13T20:23:35.685 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.683+0000 7f13267fc640 1 -- 10.20.193.110:0/1224185947 <== mon.0 v1:10.20.193.110:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 2903214381) 0x7f132c0168b0 con 0x7f13381401c0 2026-02-13T20:23:35.685 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.683+0000 7f13267fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T20:23:35.685 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.683+0000 7f13267fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:23:35.686 INFO:teuthology.orchestra.run.trial110.stdout:{"election_epoch":42,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","modified":"2026-02-13T20:11:07.161192Z","created":"2026-02-13T20:11:07.161192Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6789","nonce":0}]},"addr":"10.20.193.110:6789/0","public_addr":"10.20.193.110:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161241+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6789","nonce":0}]},"addr":"10.20.193.188:6789/0","public_addr":"10.20.193.188:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161242+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6790","nonce":0}]},"addr":"10.20.193.110:6790/0","public_addr":"10.20.193.110:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161243+0000","crush_location":[]}]}} 2026-02-13T20:23:35.687 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.684+0000 7f1340252640 1 -- 10.20.193.110:0/1224185947 >> v1:10.20.193.188:6812/1623052694 conn(0x7f130803f740 legacy=0x7f130805fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:35.687 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.684+0000 7f1340252640 10 monclient: shutdown 2026-02-13T20:23:35.687 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.684+0000 7f1340252640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:23:35.687 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.684+0000 7f1340252640 1 -- 10.20.193.110:0/1224185947 >> v1:10.20.193.110:6789/0 conn(0x7f13381401c0 legacy=0x7f1338193bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:35.687 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.684+0000 7f1340252640 1 -- 10.20.193.110:0/1224185947 shutdown_connections 2026-02-13T20:23:35.687 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.684+0000 7f1340252640 1 -- 10.20.193.110:0/1224185947 >> 10.20.193.110:0/1224185947 conn(0x7f1338054e90 msgr2=0x7f133808de50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:23:35.687 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.684+0000 7f1340252640 1 -- 10.20.193.110:0/1224185947 shutdown_connections 2026-02-13T20:23:35.688 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:35.684+0000 7f1340252640 1 -- 10.20.193.110:0/1224185947 wait complete. 2026-02-13T20:23:38.694 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T20:23:38.762 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.760+0000 7f050c01b640 10 monclient: get_monmap_and_config 2026-02-13T20:23:38.762 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.760+0000 7f050c01b640 10 monclient: build_initial_monmap 2026-02-13T20:23:38.762 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.760+0000 7f050c01b640 10 monclient: monmap: 2026-02-13T20:23:38.762 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:23:38.762 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:38.762 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:23:38.762153+0000 2026-02-13T20:23:38.763 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:23:38.762153+0000 2026-02-13T20:23:38.763 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:23:38.763 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:38.763 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:23:38.763 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:23:38.763 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:23:38.763 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:38.770 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.761+0000 7f050c01b640 1 Processor -- start 2026-02-13T20:23:38.770 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.761+0000 7f050c01b640 1 -- start start 2026-02-13T20:23:38.770 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.761+0000 7f050c01b640 10 monclient: init 2026-02-13T20:23:38.770 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.761+0000 7f050c01b640 10 monclient: _reopen_session rank -1 2026-02-13T20:23:38.770 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.761+0000 7f050c01b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:23:38.770 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.761+0000 7f050c01b640 10 monclient(hunting): picked mon.noname-b con 0x7f050413f280 addr v1:10.20.193.110:6790/0 2026-02-13T20:23:38.770 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.761+0000 7f050c01b640 10 monclient(hunting): picked mon.noname-c con 0x7f050413ee70 addr v1:10.20.193.188:6789/0 2026-02-13T20:23:38.771 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.761+0000 7f050c01b640 10 monclient(hunting): picked mon.noname-a con 0x7f0504089a90 addr v1:10.20.193.110:6789/0 2026-02-13T20:23:38.771 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.761+0000 7f050c01b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f050408a310 con 0x7f0504089a90 2026-02-13T20:23:38.771 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.761+0000 7f050c01b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f050408a5f0 con 0x7f050413ee70 2026-02-13T20:23:38.771 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.761+0000 7f050c01b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f050408a8d0 con 0x7f050413f280 2026-02-13T20:23:38.771 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.761+0000 7f050c01b640 10 monclient(hunting): _renew_subs 2026-02-13T20:23:38.771 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.761+0000 7f050c01b640 10 monclient(hunting): authenticate will time out at 1380.452706s 2026-02-13T20:23:38.771 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.761+0000 7f0509d90640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f050413f280 0x7f050413f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:50156/0 (socket says 10.20.193.110:50156) 2026-02-13T20:23:38.771 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.761+0000 7f050a591640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f0504089a90 0x7f05041a18c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:37490/0 (socket says 10.20.193.110:37490) 2026-02-13T20:23:38.771 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.761+0000 7f0509d90640 1 -- 10.20.193.110:0/3366335839 learned_addr learned my addr 10.20.193.110:0/3366335839 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:23:38.771 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.762+0000 7f0508d8e640 1 -- 10.20.193.110:0/3366335839 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1625629852 0 0) 0x7f050408a5f0 con 0x7f050413ee70 2026-02-13T20:23:38.771 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.762+0000 7f0508d8e640 10 monclient(hunting): _negotiate 2026-02-13T20:23:38.771 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.762+0000 7f0508d8e640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:38.772 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.762+0000 7f0508d8e640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:38.772 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.762+0000 7f0508d8e640 10 monclient(hunting): my global_id is 134110 2026-02-13T20:23:38.772 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.762+0000 7f0508d8e640 1 -- 10.20.193.110:0/3366335839 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04ec005870 con 0x7f050413ee70 2026-02-13T20:23:38.772 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.763+0000 7f0508d8e640 1 -- 10.20.193.110:0/3366335839 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2993013130 0 0) 0x7f04ec005870 con 0x7f050413ee70 2026-02-13T20:23:38.772 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.763+0000 7f0508d8e640 1 -- 10.20.193.110:0/3366335839 >> v1:10.20.193.110:6790/0 conn(0x7f050413f280 legacy=0x7f050413f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:38.772 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.763+0000 7f0508d8e640 1 -- 10.20.193.110:0/3366335839 >> v1:10.20.193.110:6789/0 conn(0x7f0504089a90 legacy=0x7f05041a18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:38.772 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.763+0000 7f0508d8e640 10 monclient: _finish_hunting 0 2026-02-13T20:23:38.772 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.763+0000 7f0508d8e640 1 monclient: found mon.noname-c 2026-02-13T20:23:38.772 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.763+0000 7f0508d8e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:23:38.772 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.763+0000 7f0508d8e640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.188:6789/0 2026-02-13T20:23:38.772 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.763+0000 7f0508d8e640 1 -- 10.20.193.110:0/3366335839 --> v1:10.20.193.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f050408abb0 con 0x7f050413ee70 2026-02-13T20:23:38.772 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.763+0000 7f0508d8e640 10 monclient: _finish_auth 0 2026-02-13T20:23:38.773 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.763+0000 7f0508d8e640 10 monclient: _check_auth_tickets 2026-02-13T20:23:38.773 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.763+0000 7f0508d8e640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:23:38.773 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.763+0000 7f050c01b640 5 monclient: authenticate success, global_id 134110 2026-02-13T20:23:38.773 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.763+0000 7f050c01b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:23:38.773 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.763+0000 7f0508d8e640 1 -- 10.20.193.110:0/3366335839 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f04f8002dd0 con 0x7f050413ee70 2026-02-13T20:23:38.773 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.763+0000 7f0508d8e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:38.773 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.763+0000 7f0508d8e640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:23:38.773 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.763+0000 7f0508d8e640 10 monclient: dump: 2026-02-13T20:23:38.773 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:38.773 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:38.773 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:38.773 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:38.774 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:38.774 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:38.774 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:38.774 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:38.774 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:38.774 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:38.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.763+0000 7f050c01b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:23:38.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.763+0000 7f0508d8e640 1 -- 10.20.193.110:0/3366335839 <== mon.1 v1:10.20.193.188:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f04f8003010 con 0x7f050413ee70 2026-02-13T20:23:38.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.763+0000 7f0508d8e640 10 monclient: handle_config config(0 keys) 2026-02-13T20:23:38.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.763+0000 7f0508d8e640 1 -- 10.20.193.110:0/3366335839 <== mon.1 v1:10.20.193.188:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f04f80033e0 con 0x7f050413ee70 2026-02-13T20:23:38.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.763+0000 7f050c01b640 10 monclient: get_monmap_and_config success 2026-02-13T20:23:38.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.763+0000 7f0508d8e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:38.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.763+0000 7f050c01b640 4 set_mon_vals no callback set 2026-02-13T20:23:38.775 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.763+0000 7f0508d8e640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:23:38.775 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.763+0000 7f0508d8e640 10 monclient: dump: 2026-02-13T20:23:38.775 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:38.775 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:38.775 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:38.775 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:38.775 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:38.775 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:38.775 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:38.775 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:38.775 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:38.775 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:38.776 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.763+0000 7f050c01b640 10 monclient: shutdown 2026-02-13T20:23:38.776 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.763+0000 7f050c01b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:23:38.776 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.763+0000 7f050c01b640 1 -- 10.20.193.110:0/3366335839 >> v1:10.20.193.188:6789/0 conn(0x7f050413ee70 legacy=0x7f0504180190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:38.776 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.763+0000 7f050c01b640 1 -- 10.20.193.110:0/3366335839 shutdown_connections 2026-02-13T20:23:38.776 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.763+0000 7f050c01b640 1 -- 10.20.193.110:0/3366335839 >> 10.20.193.110:0/3366335839 conn(0x7f0504054e90 msgr2=0x7f0504058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:23:38.776 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.763+0000 7f050c01b640 1 -- 10.20.193.110:0/3366335839 shutdown_connections 2026-02-13T20:23:38.776 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.763+0000 7f050c01b640 1 -- 10.20.193.110:0/3366335839 wait complete. 2026-02-13T20:23:38.776 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.764+0000 7f050c01b640 10 monclient: build_initial_monmap 2026-02-13T20:23:38.776 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.764+0000 7f050c01b640 10 monclient: monmap: 2026-02-13T20:23:38.776 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:23:38.776 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:23:38.776 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:23:38.777 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:23:38.777 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:23:38.777 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:23:38.777 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:23:38.777 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:23:38.777 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:23:38.777 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:38.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.764+0000 7f050c01b640 1 Processor -- start 2026-02-13T20:23:38.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.764+0000 7f050c01b640 1 -- start start 2026-02-13T20:23:38.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.764+0000 7f050c01b640 10 monclient: init 2026-02-13T20:23:38.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.764+0000 7f050c01b640 10 monclient: _reopen_session rank -1 2026-02-13T20:23:38.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.764+0000 7f050c01b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:23:38.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.764+0000 7f050c01b640 10 monclient(hunting): picked mon.noname-b con 0x7f0504089a90 addr v1:10.20.193.188:6789/0 2026-02-13T20:23:38.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.764+0000 7f050c01b640 10 monclient(hunting): picked mon.noname-c con 0x7f050413ee70 addr v1:10.20.193.110:6790/0 2026-02-13T20:23:38.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.764+0000 7f050c01b640 10 monclient(hunting): picked mon.noname-a con 0x7f050413f280 addr v1:10.20.193.110:6789/0 2026-02-13T20:23:38.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.764+0000 7f050c01b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f050410dd20 con 0x7f050413f280 2026-02-13T20:23:38.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.764+0000 7f050c01b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f050410e000 con 0x7f0504089a90 2026-02-13T20:23:38.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.764+0000 7f050c01b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f050405d320 con 0x7f050413ee70 2026-02-13T20:23:38.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.764+0000 7f050c01b640 10 monclient(hunting): _renew_subs 2026-02-13T20:23:38.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.764+0000 7f050c01b640 10 monclient(hunting): authenticate will time out at 1380.455569s 2026-02-13T20:23:38.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.764+0000 7f050a591640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f050413f280 0x7f05041300b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:37500/0 (socket says 10.20.193.110:37500) 2026-02-13T20:23:38.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.764+0000 7f050a591640 1 -- 10.20.193.110:0/380144635 learned_addr learned my addr 10.20.193.110:0/380144635 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:23:38.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.764+0000 7f050958f640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f050413ee70 0x7f050410a940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:50170/0 (socket says 10.20.193.110:50170) 2026-02-13T20:23:38.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.765+0000 7f04f27fc640 1 -- 10.20.193.110:0/380144635 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1927549078 0 0) 0x7f050410e000 con 0x7f0504089a90 2026-02-13T20:23:38.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.765+0000 7f04f27fc640 10 monclient(hunting): _negotiate 2026-02-13T20:23:38.779 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.765+0000 7f04f27fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:38.779 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.765+0000 7f04f27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:38.779 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.765+0000 7f04f27fc640 10 monclient(hunting): my global_id is 134113 2026-02-13T20:23:38.779 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.765+0000 7f04f27fc640 1 -- 10.20.193.110:0/380144635 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04d40035e0 con 0x7f0504089a90 2026-02-13T20:23:38.779 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.765+0000 7f04f27fc640 1 -- 10.20.193.110:0/380144635 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 485161387 0 0) 0x7f04d40035e0 con 0x7f0504089a90 2026-02-13T20:23:38.779 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.765+0000 7f04f27fc640 1 -- 10.20.193.110:0/380144635 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f050410e000 con 0x7f0504089a90 2026-02-13T20:23:38.779 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.765+0000 7f04f27fc640 1 -- 10.20.193.110:0/380144635 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f04f4002fa0 con 0x7f0504089a90 2026-02-13T20:23:38.779 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.765+0000 7f04f27fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:23:38.779 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.765+0000 7f04f27fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:23:38.779 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.765+0000 7f04f27fc640 10 monclient(hunting): dump: 2026-02-13T20:23:38.779 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:38.779 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:38.780 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:38.780 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:38.780 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:38.780 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:38.780 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:38.780 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:38.780 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:38.780 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:38.780 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.765+0000 7f04f27fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:23:38.780 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.765+0000 7f04f27fc640 1 -- 10.20.193.110:0/380144635 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2285401903 0 0) 0x7f050410e000 con 0x7f0504089a90 2026-02-13T20:23:38.780 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.765+0000 7f04f27fc640 1 -- 10.20.193.110:0/380144635 >> v1:10.20.193.110:6790/0 conn(0x7f050413ee70 legacy=0x7f050410a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:38.780 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.765+0000 7f04f27fc640 1 -- 10.20.193.110:0/380144635 >> v1:10.20.193.110:6789/0 conn(0x7f050413f280 legacy=0x7f05041300b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:38.781 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.765+0000 7f04f27fc640 10 monclient: _finish_hunting 0 2026-02-13T20:23:38.781 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.765+0000 7f04f27fc640 1 monclient: found mon.b 2026-02-13T20:23:38.781 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.765+0000 7f04f27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:23:38.781 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.765+0000 7f04f27fc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:23:38.781 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.765+0000 7f04f27fc640 1 -- 10.20.193.110:0/380144635 --> v1:10.20.193.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f050410d190 con 0x7f0504089a90 2026-02-13T20:23:38.781 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.765+0000 7f04f27fc640 10 monclient: _finish_auth 0 2026-02-13T20:23:38.781 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.765+0000 7f04f27fc640 10 monclient: _check_auth_tickets 2026-02-13T20:23:38.781 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.765+0000 7f04f27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:23:38.781 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.765+0000 7f050c01b640 5 monclient: authenticate success, global_id 134113 2026-02-13T20:23:38.781 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.765+0000 7f050c01b640 10 monclient: _renew_subs 2026-02-13T20:23:38.781 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.765+0000 7f050c01b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:23:38.781 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.765+0000 7f050c01b640 1 -- 10.20.193.110:0/380144635 --> v1:10.20.193.188:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f050410bca0 con 0x7f0504089a90 2026-02-13T20:23:38.781 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.765+0000 7f050c01b640 10 monclient: _renew_subs 2026-02-13T20:23:38.782 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.765+0000 7f050c01b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:23:38.782 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.765+0000 7f050c01b640 1 -- 10.20.193.110:0/380144635 --> v1:10.20.193.188:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f050410ca30 con 0x7f0504089a90 2026-02-13T20:23:38.782 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.765+0000 7f04f27fc640 1 -- 10.20.193.110:0/380144635 <== mon.1 v1:10.20.193.188:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f04f4003540 con 0x7f0504089a90 2026-02-13T20:23:38.782 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.765+0000 7f04f27fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:23:38.782 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.765+0000 7f04f27fc640 1 -- 10.20.193.110:0/380144635 <== mon.1 v1:10.20.193.188:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f04f4004a50 con 0x7f0504089a90 2026-02-13T20:23:38.782 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.765+0000 7f04f27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:38.782 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.765+0000 7f04f27fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:23:38.782 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.765+0000 7f04f27fc640 10 monclient: dump: 2026-02-13T20:23:38.782 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:38.782 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:38.782 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:38.782 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:38.783 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:38.783 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:38.783 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:38.783 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:38.783 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:38.783 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:38.783 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.765+0000 7f04f3fff640 4 set_mon_vals no callback set 2026-02-13T20:23:38.783 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.766+0000 7f050c01b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:23:38.783 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.766+0000 7f050c01b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:23:38.783 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.766+0000 7f050c01b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:23:38.783 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.766+0000 7f050c01b640 1 -- 10.20.193.110:0/380144635 --> v1:10.20.193.188:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05040008d0 con 0x7f0504089a90 2026-02-13T20:23:38.783 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.767+0000 7f04f27fc640 1 -- 10.20.193.110:0/380144635 <== mon.1 v1:10.20.193.188:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f04f4004bb0 con 0x7f0504089a90 2026-02-13T20:23:38.783 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.767+0000 7f04f27fc640 1 -- 10.20.193.110:0/380144635 <== mon.1 v1:10.20.193.188:6789/0 8 ==== osd_map(582..582 src has 1..582) ==== 3931+0+0 (unknown 1315023635 0 0) 0x7f04f404e870 con 0x7f0504089a90 2026-02-13T20:23:38.784 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.767+0000 7f050958f640 10 monclient: get_auth_request con 0x7f04d403f6f0 auth_method 0 2026-02-13T20:23:38.784 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.769+0000 7f04f27fc640 1 -- 10.20.193.110:0/380144635 <== mon.1 v1:10.20.193.188:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f04f4004e90 con 0x7f0504089a90 2026-02-13T20:23:38.784 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.769+0000 7f04f27fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:23:38.784 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.769+0000 7f04f27fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:23:38.914 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.912+0000 7f050c01b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T20:23:38.915 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.912+0000 7f050c01b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T20:23:38.915 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.912+0000 7f050c01b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.188:6789/0 2026-02-13T20:23:38.915 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.912+0000 7f050c01b640 1 -- 10.20.193.110:0/380144635 --> v1:10.20.193.188:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f0504058410 con 0x7f0504089a90 2026-02-13T20:23:38.915 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.913+0000 7f04f27fc640 1 -- 10.20.193.110:0/380144635 <== mon.1 v1:10.20.193.188:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 3827306701) 0x7f04f404b620 con 0x7f0504089a90 2026-02-13T20:23:38.915 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.913+0000 7f04f27fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T20:23:38.915 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.913+0000 7f04f27fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:23:38.915 INFO:teuthology.orchestra.run.trial110.stdout:{"election_epoch":42,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":6,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","modified":"2026-02-13T20:11:07.161192Z","created":"2026-02-13T20:11:07.161192Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6789","nonce":0}]},"addr":"10.20.193.110:6789/0","public_addr":"10.20.193.110:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161241+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6789","nonce":0}]},"addr":"10.20.193.188:6789/0","public_addr":"10.20.193.188:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161242+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6790","nonce":0}]},"addr":"10.20.193.110:6790/0","public_addr":"10.20.193.110:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161243+0000","crush_location":[]}]}} 2026-02-13T20:23:38.916 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.914+0000 7f050c01b640 1 -- 10.20.193.110:0/380144635 >> v1:10.20.193.188:6812/1623052694 conn(0x7f04d403f6f0 legacy=0x7f04d405fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:38.917 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.914+0000 7f050c01b640 10 monclient: shutdown 2026-02-13T20:23:38.917 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.914+0000 7f050c01b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:23:38.917 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.914+0000 7f050c01b640 1 -- 10.20.193.110:0/380144635 >> v1:10.20.193.188:6789/0 conn(0x7f0504089a90 legacy=0x7f050410a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:38.917 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.914+0000 7f050c01b640 1 -- 10.20.193.110:0/380144635 shutdown_connections 2026-02-13T20:23:38.917 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.914+0000 7f050c01b640 1 -- 10.20.193.110:0/380144635 >> 10.20.193.110:0/380144635 conn(0x7f0504054e90 msgr2=0x7f05041226a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:23:38.917 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.914+0000 7f050c01b640 1 -- 10.20.193.110:0/380144635 shutdown_connections 2026-02-13T20:23:38.917 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:38.914+0000 7f050c01b640 1 -- 10.20.193.110:0/380144635 wait complete. 2026-02-13T20:23:41.926 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T20:23:41.992 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:41.991+0000 7f8f3b5c2640 10 monclient: get_monmap_and_config 2026-02-13T20:23:41.992 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:41.991+0000 7f8f3b5c2640 10 monclient: build_initial_monmap 2026-02-13T20:23:41.992 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:41.991+0000 7f8f3b5c2640 10 monclient: monmap: 2026-02-13T20:23:41.993 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:23:41.993 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:41.993 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:23:41.992450+0000 2026-02-13T20:23:41.993 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:23:41.992450+0000 2026-02-13T20:23:41.993 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:23:41.993 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:41.993 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:23:41.993 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:23:41.993 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:23:41.993 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:41.995 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:41.991+0000 7f8f3b5c2640 1 Processor -- start 2026-02-13T20:23:41.995 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:41.991+0000 7f8f3b5c2640 1 -- start start 2026-02-13T20:23:41.995 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:41.991+0000 7f8f3b5c2640 10 monclient: init 2026-02-13T20:23:41.995 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:41.991+0000 7f8f3b5c2640 10 monclient: _reopen_session rank -1 2026-02-13T20:23:41.995 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:41.991+0000 7f8f3b5c2640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:23:41.995 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:41.991+0000 7f8f3b5c2640 10 monclient(hunting): picked mon.noname-a con 0x7f8f34091470 addr v1:10.20.193.110:6789/0 2026-02-13T20:23:41.996 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:41.991+0000 7f8f3b5c2640 10 monclient(hunting): picked mon.noname-b con 0x7f8f34092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:23:41.996 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:41.991+0000 7f8f3b5c2640 10 monclient(hunting): picked mon.noname-c con 0x7f8f341401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:23:41.996 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:41.991+0000 7f8f3b5c2640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f3405c5b0 con 0x7f8f34091470 2026-02-13T20:23:41.996 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:41.991+0000 7f8f3b5c2640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f34140620 con 0x7f8f341401c0 2026-02-13T20:23:41.996 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:41.991+0000 7f8f3b5c2640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f3408b450 con 0x7f8f34092020 2026-02-13T20:23:41.996 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:41.991+0000 7f8f3b5c2640 10 monclient(hunting): _renew_subs 2026-02-13T20:23:41.996 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:41.991+0000 7f8f3b5c2640 10 monclient(hunting): authenticate will time out at 1383.682876s 2026-02-13T20:23:41.996 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:41.991+0000 7f8f38b36640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f8f34092020 0x7f8f341812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:44156/0 (socket says 10.20.193.110:44156) 2026-02-13T20:23:41.996 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:41.991+0000 7f8f38b36640 1 -- 10.20.193.110:0/494385449 learned_addr learned my addr 10.20.193.110:0/494385449 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:23:43.241 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.235+0000 7f8f23fff640 1 -- 10.20.193.110:0/494385449 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1825936797 0 0) 0x7f8f3405c5b0 con 0x7f8f34091470 2026-02-13T20:23:43.241 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.235+0000 7f8f23fff640 10 monclient(hunting): _negotiate 2026-02-13T20:23:43.242 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.235+0000 7f8f23fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:43.242 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.235+0000 7f8f23fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:43.242 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.235+0000 7f8f23fff640 10 monclient(hunting): my global_id is 124191 2026-02-13T20:23:43.242 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.235+0000 7f8f23fff640 1 -- 10.20.193.110:0/494385449 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f1c0035e0 con 0x7f8f34091470 2026-02-13T20:23:43.242 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.236+0000 7f8f23fff640 1 -- 10.20.193.110:0/494385449 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2580595070 0 0) 0x7f8f1c0035e0 con 0x7f8f34091470 2026-02-13T20:23:43.242 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.236+0000 7f8f23fff640 1 -- 10.20.193.110:0/494385449 >> v1:10.20.193.110:6790/0 conn(0x7f8f34092020 legacy=0x7f8f341812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:43.242 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.236+0000 7f8f23fff640 1 -- 10.20.193.110:0/494385449 >> v1:10.20.193.188:6789/0 conn(0x7f8f341401c0 legacy=0x7f8f341a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:43.242 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.236+0000 7f8f23fff640 10 monclient: _finish_hunting 0 2026-02-13T20:23:43.242 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.236+0000 7f8f23fff640 1 monclient: found mon.noname-a 2026-02-13T20:23:43.242 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.236+0000 7f8f23fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:23:43.242 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.236+0000 7f8f23fff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:23:43.243 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.236+0000 7f8f23fff640 1 -- 10.20.193.110:0/494385449 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f3408b730 con 0x7f8f34091470 2026-02-13T20:23:43.243 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.236+0000 7f8f23fff640 10 monclient: _finish_auth 0 2026-02-13T20:23:43.243 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.236+0000 7f8f23fff640 10 monclient: _check_auth_tickets 2026-02-13T20:23:43.243 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.236+0000 7f8f23fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:23:43.243 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.236+0000 7f8f23fff640 1 -- 10.20.193.110:0/494385449 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f8f24002dd0 con 0x7f8f34091470 2026-02-13T20:23:43.243 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.236+0000 7f8f23fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:43.243 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.236+0000 7f8f23fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:23:43.243 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.236+0000 7f8f23fff640 10 monclient: dump: 2026-02-13T20:23:43.243 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:43.243 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:43.243 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:43.243 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:43.244 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:43.244 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:43.244 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:43.244 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:43.244 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:43.244 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:43.244 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.236+0000 7f8f3b5c2640 5 monclient: authenticate success, global_id 124191 2026-02-13T20:23:43.244 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.236+0000 7f8f3b5c2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:23:43.244 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.236+0000 7f8f23fff640 1 -- 10.20.193.110:0/494385449 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8f24003010 con 0x7f8f34091470 2026-02-13T20:23:43.244 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.236+0000 7f8f23fff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:23:43.244 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.236+0000 7f8f23fff640 1 -- 10.20.193.110:0/494385449 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f8f24003420 con 0x7f8f34091470 2026-02-13T20:23:43.244 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.236+0000 7f8f23fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:43.245 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.236+0000 7f8f23fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:23:43.245 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.236+0000 7f8f23fff640 10 monclient: dump: 2026-02-13T20:23:43.245 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:43.245 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:43.245 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:43.245 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:43.245 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:43.245 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:43.245 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:43.245 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:43.245 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:43.246 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:43.246 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.236+0000 7f8f3b5c2640 10 monclient: get_monmap_and_config success 2026-02-13T20:23:43.246 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.236+0000 7f8f3b5c2640 4 set_mon_vals no callback set 2026-02-13T20:23:43.246 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.236+0000 7f8f3b5c2640 10 monclient: shutdown 2026-02-13T20:23:43.246 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.236+0000 7f8f3b5c2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:23:43.246 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.236+0000 7f8f3b5c2640 1 -- 10.20.193.110:0/494385449 >> v1:10.20.193.110:6789/0 conn(0x7f8f34091470 legacy=0x7f8f34091840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:43.246 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.236+0000 7f8f3b5c2640 1 -- 10.20.193.110:0/494385449 shutdown_connections 2026-02-13T20:23:43.246 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.236+0000 7f8f3b5c2640 1 -- 10.20.193.110:0/494385449 >> 10.20.193.110:0/494385449 conn(0x7f8f34054e90 msgr2=0x7f8f34058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:23:43.246 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.236+0000 7f8f3b5c2640 1 -- 10.20.193.110:0/494385449 shutdown_connections 2026-02-13T20:23:43.246 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.237+0000 7f8f3b5c2640 1 -- 10.20.193.110:0/494385449 wait complete. 2026-02-13T20:23:43.246 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.237+0000 7f8f3b5c2640 10 monclient: build_initial_monmap 2026-02-13T20:23:43.246 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.237+0000 7f8f3b5c2640 10 monclient: monmap: 2026-02-13T20:23:43.246 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:23:43.247 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:23:43.247 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:23:43.247 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:23:43.247 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:23:43.247 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:23:43.247 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:23:43.247 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:23:43.247 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:23:43.247 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:43.247 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.237+0000 7f8f3b5c2640 1 Processor -- start 2026-02-13T20:23:43.247 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.237+0000 7f8f3b5c2640 1 -- start start 2026-02-13T20:23:43.247 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.237+0000 7f8f3b5c2640 10 monclient: init 2026-02-13T20:23:43.248 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.237+0000 7f8f3b5c2640 10 monclient: _reopen_session rank -1 2026-02-13T20:23:43.248 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.237+0000 7f8f3b5c2640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:23:43.248 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.237+0000 7f8f3b5c2640 10 monclient(hunting): picked mon.noname-b con 0x7f8f34091470 addr v1:10.20.193.188:6789/0 2026-02-13T20:23:43.248 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.237+0000 7f8f3b5c2640 10 monclient(hunting): picked mon.noname-c con 0x7f8f341401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:23:43.248 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.237+0000 7f8f3b5c2640 10 monclient(hunting): picked mon.noname-a con 0x7f8f34150750 addr v1:10.20.193.110:6789/0 2026-02-13T20:23:43.248 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.237+0000 7f8f3b5c2640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f3405d320 con 0x7f8f34150750 2026-02-13T20:23:43.248 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.237+0000 7f8f3b5c2640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f3412fe30 con 0x7f8f34091470 2026-02-13T20:23:43.248 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.237+0000 7f8f3b5c2640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f3413f690 con 0x7f8f341401c0 2026-02-13T20:23:43.248 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.237+0000 7f8f3b5c2640 10 monclient(hunting): _renew_subs 2026-02-13T20:23:43.248 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.237+0000 7f8f3b5c2640 10 monclient(hunting): authenticate will time out at 1384.927985s 2026-02-13T20:23:43.248 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.238+0000 7f8f38b36640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f8f341401c0 0x7f8f34191ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:44172/0 (socket says 10.20.193.110:44172) 2026-02-13T20:23:43.248 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.238+0000 7f8f38b36640 1 -- 10.20.193.110:0/1459716084 learned_addr learned my addr 10.20.193.110:0/1459716084 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:23:43.249 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.238+0000 7f8f39b38640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f8f34150750 0x7f8f341931d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:49172/0 (socket says 10.20.193.110:49172) 2026-02-13T20:23:43.249 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.238+0000 7f8f21ffb640 1 -- 10.20.193.110:0/1459716084 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2917239336 0 0) 0x7f8f3405d320 con 0x7f8f34150750 2026-02-13T20:23:43.249 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.238+0000 7f8f21ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:23:43.249 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.238+0000 7f8f21ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:43.249 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.238+0000 7f8f21ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:43.249 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.238+0000 7f8f21ffb640 10 monclient(hunting): my global_id is 124194 2026-02-13T20:23:43.249 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.238+0000 7f8f21ffb640 1 -- 10.20.193.110:0/1459716084 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f040035e0 con 0x7f8f34150750 2026-02-13T20:23:43.249 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.238+0000 7f8f21ffb640 1 -- 10.20.193.110:0/1459716084 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1799281357 0 0) 0x7f8f040035e0 con 0x7f8f34150750 2026-02-13T20:23:43.249 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.238+0000 7f8f21ffb640 1 -- 10.20.193.110:0/1459716084 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8f3405d320 con 0x7f8f34150750 2026-02-13T20:23:43.249 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.238+0000 7f8f21ffb640 1 -- 10.20.193.110:0/1459716084 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f8f30004110 con 0x7f8f34150750 2026-02-13T20:23:43.249 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.238+0000 7f8f21ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:23:43.250 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.238+0000 7f8f21ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:23:43.250 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.238+0000 7f8f21ffb640 10 monclient(hunting): dump: 2026-02-13T20:23:43.250 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:43.250 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:43.250 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:43.250 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:43.250 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:43.250 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:43.250 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:43.250 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:43.250 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:43.250 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:43.250 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.238+0000 7f8f21ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:23:43.251 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.238+0000 7f8f21ffb640 1 -- 10.20.193.110:0/1459716084 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3599836794 0 0) 0x7f8f3405d320 con 0x7f8f34150750 2026-02-13T20:23:43.251 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.238+0000 7f8f21ffb640 1 -- 10.20.193.110:0/1459716084 >> v1:10.20.193.110:6790/0 conn(0x7f8f341401c0 legacy=0x7f8f34191ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:43.251 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.238+0000 7f8f21ffb640 1 -- 10.20.193.110:0/1459716084 >> v1:10.20.193.188:6789/0 conn(0x7f8f34091470 legacy=0x7f8f3413e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:43.251 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.238+0000 7f8f21ffb640 10 monclient: _finish_hunting 0 2026-02-13T20:23:43.251 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.238+0000 7f8f21ffb640 1 monclient: found mon.a 2026-02-13T20:23:43.251 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.238+0000 7f8f21ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:23:43.251 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.238+0000 7f8f21ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:23:43.251 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.238+0000 7f8f21ffb640 1 -- 10.20.193.110:0/1459716084 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f34090e20 con 0x7f8f34150750 2026-02-13T20:23:43.251 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.238+0000 7f8f21ffb640 10 monclient: _finish_auth 0 2026-02-13T20:23:43.251 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.238+0000 7f8f21ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:23:43.251 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.238+0000 7f8f21ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:23:43.251 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.238+0000 7f8f3b5c2640 5 monclient: authenticate success, global_id 124194 2026-02-13T20:23:43.252 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.238+0000 7f8f3b5c2640 10 monclient: _renew_subs 2026-02-13T20:23:43.252 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.238+0000 7f8f3b5c2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:23:43.252 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.238+0000 7f8f3b5c2640 1 -- 10.20.193.110:0/1459716084 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8f3412fb50 con 0x7f8f34150750 2026-02-13T20:23:43.252 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.238+0000 7f8f3b5c2640 10 monclient: _renew_subs 2026-02-13T20:23:43.252 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.238+0000 7f8f3b5c2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:23:43.252 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.238+0000 7f8f3b5c2640 1 -- 10.20.193.110:0/1459716084 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8f3413eb40 con 0x7f8f34150750 2026-02-13T20:23:43.252 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.238+0000 7f8f21ffb640 1 -- 10.20.193.110:0/1459716084 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8f300047b0 con 0x7f8f34150750 2026-02-13T20:23:43.252 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.238+0000 7f8f21ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T20:23:43.252 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.238+0000 7f8f21ffb640 1 -- 10.20.193.110:0/1459716084 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f8f30004b50 con 0x7f8f34150750 2026-02-13T20:23:43.252 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.238+0000 7f8f21ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:43.252 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.238+0000 7f8f21ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:23:43.252 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.238+0000 7f8f237fe640 4 set_mon_vals no callback set 2026-02-13T20:23:43.253 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.238+0000 7f8f21ffb640 10 monclient: dump: 2026-02-13T20:23:43.253 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:43.253 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:43.253 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:43.253 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:43.253 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:43.253 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:43.253 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:43.253 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:43.253 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:43.253 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:43.253 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.239+0000 7f8f3b5c2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:23:43.253 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.239+0000 7f8f3b5c2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:23:43.254 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.239+0000 7f8f3b5c2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:23:43.254 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.239+0000 7f8f3b5c2640 1 -- 10.20.193.110:0/1459716084 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f3412f720 con 0x7f8f34150750 2026-02-13T20:23:43.254 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.239+0000 7f8f21ffb640 1 -- 10.20.193.110:0/1459716084 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f8f30004cb0 con 0x7f8f34150750 2026-02-13T20:23:43.254 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.239+0000 7f8f21ffb640 1 -- 10.20.193.110:0/1459716084 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(582..582 src has 1..582) ==== 3931+0+0 (unknown 1315023635 0 0) 0x7f8f3004f8e0 con 0x7f8f34150750 2026-02-13T20:23:43.254 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.239+0000 7f8f39337640 10 monclient: get_auth_request con 0x7f8f0403f6f0 auth_method 0 2026-02-13T20:23:43.254 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.241+0000 7f8f21ffb640 1 -- 10.20.193.110:0/1459716084 <== mon.0 v1:10.20.193.110:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f8f300180d0 con 0x7f8f34150750 2026-02-13T20:23:43.254 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.241+0000 7f8f21ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:23:43.255 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.241+0000 7f8f21ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:23:43.292 INFO:tasks.rados.rados.0.trial188.stdout:2728: done (12 left) 2026-02-13T20:23:43.292 INFO:tasks.rados.rados.0.trial188.stdout:2729: done (11 left) 2026-02-13T20:23:43.292 INFO:tasks.rados.rados.0.trial188.stdout:2730: done (10 left) 2026-02-13T20:23:43.292 INFO:tasks.rados.rados.0.trial188.stdout:2731: done (9 left) 2026-02-13T20:23:43.292 INFO:tasks.rados.rados.0.trial188.stdout:2732: done (8 left) 2026-02-13T20:23:43.292 INFO:tasks.rados.rados.0.trial188.stdout:2733: done (7 left) 2026-02-13T20:23:43.292 INFO:tasks.rados.rados.0.trial188.stdout:2734: done (6 left) 2026-02-13T20:23:43.292 INFO:tasks.rados.rados.0.trial188.stdout:2735: done (5 left) 2026-02-13T20:23:43.292 INFO:tasks.rados.rados.0.trial188.stdout:2736: done (4 left) 2026-02-13T20:23:43.293 INFO:tasks.rados.rados.0.trial188.stdout:2737: done (3 left) 2026-02-13T20:23:43.293 INFO:tasks.rados.rados.0.trial188.stdout:2738: done (2 left) 2026-02-13T20:23:43.293 INFO:tasks.rados.rados.0.trial188.stdout:2739: done (1 left) 2026-02-13T20:23:43.293 INFO:tasks.rados.rados.0.trial188.stdout:2740: done (0 left) 2026-02-13T20:23:43.293 INFO:tasks.rados.rados.0.trial188.stdout:2741: write oid 43 current snap is 283 2026-02-13T20:23:43.293 INFO:tasks.rados.rados.0.trial188.stdout:2741: seq_num 951 ranges {783457=505924,1850258=548666,2865972=721096} 2026-02-13T20:23:43.296 INFO:tasks.rados.rados.0.trial188.stdout:2741: writing trial18843701-43 from 783457 to 1289381 tid 1 2026-02-13T20:23:43.300 INFO:tasks.rados.rados.0.trial188.stdout:2741: writing trial18843701-43 from 1850258 to 2398924 tid 2 2026-02-13T20:23:43.305 INFO:tasks.rados.rados.0.trial188.stdout:2741: writing trial18843701-43 from 2865972 to 3587068 tid 3 2026-02-13T20:23:43.305 INFO:tasks.rados.rados.0.trial188.stdout:2742: write oid 7 current snap is 283 2026-02-13T20:23:43.305 INFO:tasks.rados.rados.0.trial188.stdout:2742: seq_num 952 ranges {400264=581173,1508740=491524} 2026-02-13T20:23:43.309 INFO:tasks.rados.rados.0.trial188.stdout:2742: writing trial18843701-7 from 400264 to 981437 tid 1 2026-02-13T20:23:43.312 INFO:tasks.rados.rados.0.trial188.stdout:2742: writing trial18843701-7 from 1508740 to 2000264 tid 2 2026-02-13T20:23:43.312 INFO:tasks.rados.rados.0.trial188.stdout:2743: read oid 37 snap -1 2026-02-13T20:23:43.312 INFO:tasks.rados.rados.0.trial188.stdout:2743: expect (ObjNum 922 snap 279 seq_num 922) 2026-02-13T20:23:43.312 INFO:tasks.rados.rados.0.trial188.stdout:2744: snap_create 2026-02-13T20:23:43.321 INFO:tasks.rados.rados.0.trial188.stdout:2741: finishing write tid 1 to trial18843701-43 2026-02-13T20:23:43.321 INFO:tasks.rados.rados.0.trial188.stdout:2741: finishing write tid 2 to trial18843701-43 2026-02-13T20:23:43.321 INFO:tasks.rados.rados.0.trial188.stdout:2741: finishing write tid 3 to trial18843701-43 2026-02-13T20:23:43.321 INFO:tasks.rados.rados.0.trial188.stdout:2741: finishing write tid 4 to trial18843701-43 2026-02-13T20:23:43.321 INFO:tasks.rados.rados.0.trial188.stdout:2741: finishing write tid 5 to trial18843701-43 2026-02-13T20:23:43.321 INFO:tasks.rados.rados.0.trial188.stdout:2741: oid 43 updating version 0 to 1065 2026-02-13T20:23:43.321 INFO:tasks.rados.rados.0.trial188.stdout:2741: oid 43 version 1065 is already newer than 1064 2026-02-13T20:23:43.321 INFO:tasks.rados.rados.0.trial188.stdout:2741: oid 43 version 1065 is already newer than 1063 2026-02-13T20:23:43.321 INFO:tasks.rados.rados.0.trial188.stdout:2741: oid 43 version 1065 is already newer than 1062 2026-02-13T20:23:43.321 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 43 v 1065 (ObjNum 951 snap 283 seq_num 951) dirty exists 2026-02-13T20:23:43.321 INFO:tasks.rados.rados.0.trial188.stdout:2741: left oid 43 (ObjNum 951 snap 283 seq_num 951) 2026-02-13T20:23:43.323 INFO:tasks.rados.rados.0.trial188.stdout:2743: expect (ObjNum 922 snap 279 seq_num 922) 2026-02-13T20:23:43.323 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 297882 2026-02-13T20:23:43.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.388+0000 7f8f3b5c2640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T20:23:43.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.388+0000 7f8f3b5c2640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T20:23:43.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.388+0000 7f8f3b5c2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:23:43.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.388+0000 7f8f3b5c2640 1 -- 10.20.193.110:0/1459716084 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f8f34055bb0 con 0x7f8f34150750 2026-02-13T20:23:43.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.388+0000 7f8f21ffb640 1 -- 10.20.193.110:0/1459716084 <== mon.0 v1:10.20.193.110:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 2552133141) 0x7f8f30017880 con 0x7f8f34150750 2026-02-13T20:23:43.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.388+0000 7f8f21ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T20:23:43.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.388+0000 7f8f21ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:23:43.388 INFO:teuthology.orchestra.run.trial110.stdout:{"election_epoch":44,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"c","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","modified":"2026-02-13T20:11:07.161192Z","created":"2026-02-13T20:11:07.161192Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6789","nonce":0}]},"addr":"10.20.193.110:6789/0","public_addr":"10.20.193.110:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161241+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6789","nonce":0}]},"addr":"10.20.193.188:6789/0","public_addr":"10.20.193.188:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161242+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6790","nonce":0}]},"addr":"10.20.193.110:6790/0","public_addr":"10.20.193.110:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161243+0000","crush_location":[]}]}} 2026-02-13T20:23:43.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.390+0000 7f8f3b5c2640 1 -- 10.20.193.110:0/1459716084 >> v1:10.20.193.188:6812/1623052694 conn(0x7f8f0403f6f0 legacy=0x7f8f0405fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:43.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.390+0000 7f8f3b5c2640 10 monclient: shutdown 2026-02-13T20:23:43.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.390+0000 7f8f3b5c2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:23:43.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.390+0000 7f8f3b5c2640 1 -- 10.20.193.110:0/1459716084 >> v1:10.20.193.110:6789/0 conn(0x7f8f34150750 legacy=0x7f8f341931d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:43.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.390+0000 7f8f3b5c2640 1 -- 10.20.193.110:0/1459716084 shutdown_connections 2026-02-13T20:23:43.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.390+0000 7f8f3b5c2640 1 -- 10.20.193.110:0/1459716084 >> 10.20.193.110:0/1459716084 conn(0x7f8f34054e90 msgr2=0x7f8f3408d780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:23:43.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.390+0000 7f8f3b5c2640 1 -- 10.20.193.110:0/1459716084 shutdown_connections 2026-02-13T20:23:43.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:43.390+0000 7f8f3b5c2640 1 -- 10.20.193.110:0/1459716084 wait complete. 2026-02-13T20:23:43.415 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1938532 2026-02-13T20:23:43.434 INFO:tasks.rados.rados.0.trial188.stdout:2742: finishing write tid 1 to trial18843701-7 2026-02-13T20:23:43.434 INFO:tasks.rados.rados.0.trial188.stdout:2742: finishing write tid 2 to trial18843701-7 2026-02-13T20:23:43.434 INFO:tasks.rados.rados.0.trial188.stdout:2742: finishing write tid 3 to trial18843701-7 2026-02-13T20:23:43.434 INFO:tasks.rados.rados.0.trial188.stdout:2742: finishing write tid 4 to trial18843701-7 2026-02-13T20:23:43.434 INFO:tasks.rados.rados.0.trial188.stdout:2742: oid 7 updating version 0 to 1242 2026-02-13T20:23:43.435 INFO:tasks.rados.rados.0.trial188.stdout:2742: oid 7 version 1242 is already newer than 1241 2026-02-13T20:23:43.435 INFO:tasks.rados.rados.0.trial188.stdout:2742: oid 7 version 1242 is already newer than 1240 2026-02-13T20:23:43.435 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 7 v 1242 (ObjNum 952 snap 283 seq_num 952) dirty exists 2026-02-13T20:23:43.435 INFO:tasks.rados.rados.0.trial188.stdout:2742: left oid 7 (ObjNum 952 snap 283 seq_num 952) 2026-02-13T20:23:44.297 INFO:tasks.rados.rados.0.trial188.stdout:2741: done (3 left) 2026-02-13T20:23:44.297 INFO:tasks.rados.rados.0.trial188.stdout:2742: done (2 left) 2026-02-13T20:23:44.297 INFO:tasks.rados.rados.0.trial188.stdout:2743: done (1 left) 2026-02-13T20:23:44.297 INFO:tasks.rados.rados.0.trial188.stdout:2744: done (0 left) 2026-02-13T20:23:44.297 INFO:tasks.rados.rados.0.trial188.stdout:2745: write oid 22 current snap is 284 2026-02-13T20:23:44.297 INFO:tasks.rados.rados.0.trial188.stdout:2745: seq_num 953 ranges {417071=656422,1567222=449849} 2026-02-13T20:23:44.300 INFO:tasks.rados.rados.0.trial188.stdout:2745: writing trial18843701-22 from 417071 to 1073493 tid 1 2026-02-13T20:23:44.304 INFO:tasks.rados.rados.0.trial188.stdout:2745: writing trial18843701-22 from 1567222 to 2017071 tid 2 2026-02-13T20:23:44.304 INFO:tasks.rados.rados.0.trial188.stdout:2746: snap_create 2026-02-13T20:23:44.317 INFO:tasks.rados.rados.0.trial188.stdout:2745: finishing write tid 1 to trial18843701-22 2026-02-13T20:23:44.317 INFO:tasks.rados.rados.0.trial188.stdout:2745: finishing write tid 2 to trial18843701-22 2026-02-13T20:23:44.318 INFO:tasks.rados.rados.0.trial188.stdout:2745: finishing write tid 3 to trial18843701-22 2026-02-13T20:23:44.318 INFO:tasks.rados.rados.0.trial188.stdout:2745: finishing write tid 4 to trial18843701-22 2026-02-13T20:23:44.318 INFO:tasks.rados.rados.0.trial188.stdout:2745: oid 22 updating version 0 to 1068 2026-02-13T20:23:44.318 INFO:tasks.rados.rados.0.trial188.stdout:2745: oid 22 version 1068 is already newer than 1067 2026-02-13T20:23:44.318 INFO:tasks.rados.rados.0.trial188.stdout:2745: oid 22 version 1068 is already newer than 1066 2026-02-13T20:23:44.318 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 22 v 1068 (ObjNum 953 snap 284 seq_num 953) dirty exists 2026-02-13T20:23:44.318 INFO:tasks.rados.rados.0.trial188.stdout:2745: left oid 22 (ObjNum 953 snap 284 seq_num 953) 2026-02-13T20:23:45.298 INFO:tasks.rados.rados.0.trial188.stdout:2745: done (1 left) 2026-02-13T20:23:45.298 INFO:tasks.rados.rados.0.trial188.stdout:2746: done (0 left) 2026-02-13T20:23:45.298 INFO:tasks.rados.rados.0.trial188.stdout:2747: read oid 12 snap -1 2026-02-13T20:23:45.298 INFO:tasks.rados.rados.0.trial188.stdout:2747: expect (ObjNum 739 snap 220 seq_num 739) 2026-02-13T20:23:45.298 INFO:tasks.rados.rados.0.trial188.stdout:2748: read oid 48 snap 262 2026-02-13T20:23:45.298 INFO:tasks.rados.rados.0.trial188.stdout:2748: expect (ObjNum 820 snap 241 seq_num 820) 2026-02-13T20:23:45.299 INFO:tasks.rados.rados.0.trial188.stdout:2749: read oid 2 snap 244 2026-02-13T20:23:45.299 INFO:tasks.rados.rados.0.trial188.stdout:2749: expect (ObjNum 688 snap 199 seq_num 688) 2026-02-13T20:23:45.299 INFO:tasks.rados.rados.0.trial188.stdout:2750: write oid 9 current snap is 285 2026-02-13T20:23:45.299 INFO:tasks.rados.rados.0.trial188.stdout:2750: seq_num 954 ranges {433878=731671,1909351=124527} 2026-02-13T20:23:45.301 INFO:tasks.rados.rados.0.trial188.stdout:2750: writing trial18843701-9 from 433878 to 1165549 tid 1 2026-02-13T20:23:45.305 INFO:tasks.rados.rados.0.trial188.stdout:2750: writing trial18843701-9 from 1909351 to 2033878 tid 2 2026-02-13T20:23:45.305 INFO:tasks.rados.rados.0.trial188.stdout:2751: write (excl) oid 41 current snap is 285 2026-02-13T20:23:45.305 INFO:tasks.rados.rados.0.trial188.stdout:2751: seq_num 955 ranges {450685=406920,1567833=482852} 2026-02-13T20:23:45.308 INFO:tasks.rados.rados.0.trial188.stdout:2751: writing trial18843701-41 from 450685 to 857605 tid 1 2026-02-13T20:23:45.313 INFO:tasks.rados.rados.0.trial188.stdout:2751: writing trial18843701-41 from 1567833 to 2050685 tid 2 2026-02-13T20:23:45.313 INFO:tasks.rados.rados.0.trial188.stdout:2752: read oid 36 snap -1 2026-02-13T20:23:45.313 INFO:tasks.rados.rados.0.trial188.stdout:2752: expect (ObjNum 927 snap 280 seq_num 927) 2026-02-13T20:23:45.313 INFO:tasks.rados.rados.0.trial188.stdout:2753: read oid 21 snap -1 2026-02-13T20:23:45.313 INFO:tasks.rados.rados.0.trial188.stdout:2753: expect (ObjNum 948 snap 282 seq_num 948) 2026-02-13T20:23:45.313 INFO:tasks.rados.rados.0.trial188.stdout:2754: copy_from oid 28 from oid 33 current snap is 285 2026-02-13T20:23:45.314 INFO:tasks.rados.rados.0.trial188.stdout:2747: expect (ObjNum 739 snap 220 seq_num 739) 2026-02-13T20:23:45.354 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1582416 2026-02-13T20:23:45.359 INFO:tasks.rados.rados.0.trial188.stdout:2748: expect (ObjNum 820 snap 241 seq_num 820) 2026-02-13T20:23:45.359 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:23:45.464 INFO:tasks.rados.rados.0.trial188.stdout:2749: expect (ObjNum 688 snap 199 seq_num 688) 2026-02-13T20:23:45.464 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:23:45.555 INFO:tasks.rados.rados.0.trial188.stdout:2750: finishing write tid 1 to trial18843701-9 2026-02-13T20:23:45.555 INFO:tasks.rados.rados.0.trial188.stdout:2750: finishing write tid 2 to trial18843701-9 2026-02-13T20:23:45.555 INFO:tasks.rados.rados.0.trial188.stdout:2750: finishing write tid 3 to trial18843701-9 2026-02-13T20:23:45.555 INFO:tasks.rados.rados.0.trial188.stdout:2750: finishing write tid 4 to trial18843701-9 2026-02-13T20:23:45.555 INFO:tasks.rados.rados.0.trial188.stdout:2750: oid 9 updating version 0 to 790 2026-02-13T20:23:45.555 INFO:tasks.rados.rados.0.trial188.stdout:2750: oid 9 version 790 is already newer than 789 2026-02-13T20:23:45.555 INFO:tasks.rados.rados.0.trial188.stdout:2750: oid 9 version 790 is already newer than 788 2026-02-13T20:23:45.556 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 9 v 790 (ObjNum 954 snap 285 seq_num 954) dirty exists 2026-02-13T20:23:45.556 INFO:tasks.rados.rados.0.trial188.stdout:2750: left oid 9 (ObjNum 954 snap 285 seq_num 954) 2026-02-13T20:23:45.556 INFO:tasks.rados.rados.0.trial188.stdout:2752: expect (ObjNum 927 snap 280 seq_num 927) 2026-02-13T20:23:45.562 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 784839 2026-02-13T20:23:45.623 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2628839 2026-02-13T20:23:45.682 INFO:tasks.rados.rados.0.trial188.stdout:2751: finishing write tid 1 to trial18843701-41 2026-02-13T20:23:45.682 INFO:tasks.rados.rados.0.trial188.stdout:2747: done (7 left) 2026-02-13T20:23:45.682 INFO:tasks.rados.rados.0.trial188.stdout:2748: done (6 left) 2026-02-13T20:23:45.682 INFO:tasks.rados.rados.0.trial188.stdout:2749: done (5 left) 2026-02-13T20:23:45.682 INFO:tasks.rados.rados.0.trial188.stdout:2750: done (4 left) 2026-02-13T20:23:45.682 INFO:tasks.rados.rados.0.trial188.stdout:2752: done (3 left) 2026-02-13T20:23:45.682 INFO:tasks.rados.rados.0.trial188.stdout:2755: delete oid 42 current snap is 285 2026-02-13T20:23:45.682 INFO:tasks.rados.rados.0.trial188.stdout:2751: finishing write tid 2 to trial18843701-41 2026-02-13T20:23:45.682 INFO:tasks.rados.rados.0.trial188.stdout:2751: finishing write tid 3 to trial18843701-41 2026-02-13T20:23:45.683 INFO:tasks.rados.rados.0.trial188.stdout:2753: expect (ObjNum 948 snap 282 seq_num 948) 2026-02-13T20:23:45.824 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 3673795 2026-02-13T20:23:45.826 INFO:tasks.rados.rados.0.trial188.stdout:2751: finishing write tid 4 to trial18843701-41 2026-02-13T20:23:45.826 INFO:tasks.rados.rados.0.trial188.stdout:2751: oid 41 updating version 0 to 1246 2026-02-13T20:23:45.826 INFO:tasks.rados.rados.0.trial188.stdout:2751: oid 41 updating version 1246 to 1247 2026-02-13T20:23:45.826 INFO:tasks.rados.rados.0.trial188.stdout:2751: oid 41 updating version 1247 to 1248 2026-02-13T20:23:45.826 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 41 v 1248 (ObjNum 955 snap 285 seq_num 955) dirty exists 2026-02-13T20:23:45.826 INFO:tasks.rados.rados.0.trial188.stdout:2751: left oid 41 (ObjNum 955 snap 285 seq_num 955) 2026-02-13T20:23:45.826 INFO:tasks.rados.rados.0.trial188.stdout:2754: finishing copy_from racing read to trial18843701-28 2026-02-13T20:23:45.826 INFO:tasks.rados.rados.0.trial188.stdout:2754: finishing copy_from to trial18843701-28 2026-02-13T20:23:45.826 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 28 v 1011 (ObjNum 933 snap 280 seq_num 933) dirty exists 2026-02-13T20:23:45.826 INFO:tasks.rados.rados.0.trial188.stdout:2751: done (3 left) 2026-02-13T20:23:45.826 INFO:tasks.rados.rados.0.trial188.stdout:2753: done (2 left) 2026-02-13T20:23:45.826 INFO:tasks.rados.rados.0.trial188.stdout:2754: done (1 left) 2026-02-13T20:23:45.826 INFO:tasks.rados.rados.0.trial188.stdout:2755: done (0 left) 2026-02-13T20:23:45.826 INFO:tasks.rados.rados.0.trial188.stdout:2756: read oid 39 snap 282 2026-02-13T20:23:45.826 INFO:tasks.rados.rados.0.trial188.stdout:2756: expect deleted 2026-02-13T20:23:45.826 INFO:tasks.rados.rados.0.trial188.stdout:2757: write (excl) oid 48 current snap is 285 2026-02-13T20:23:45.826 INFO:tasks.rados.rados.0.trial188.stdout:2757: seq_num 957 ranges {484299=557418,1684797=399502} 2026-02-13T20:23:45.830 INFO:tasks.rados.rados.0.trial188.stdout:2757: writing trial18843701-48 from 484299 to 1041717 tid 1 2026-02-13T20:23:45.834 INFO:tasks.rados.rados.0.trial188.stdout:2757: writing trial18843701-48 from 1684797 to 2084299 tid 2 2026-02-13T20:23:45.834 INFO:tasks.rados.rados.0.trial188.stdout:2758: read oid 25 snap 280 2026-02-13T20:23:45.834 INFO:tasks.rados.rados.0.trial188.stdout:2758: expect deleted 2026-02-13T20:23:45.834 INFO:tasks.rados.rados.0.trial188.stdout:2759: copy_from oid 8 from oid 5 current snap is 285 2026-02-13T20:23:45.834 INFO:tasks.rados.rados.0.trial188.stdout:2756: done (3 left) 2026-02-13T20:23:45.834 INFO:tasks.rados.rados.0.trial188.stdout:2760: snap_create 2026-02-13T20:23:45.834 INFO:tasks.rados.rados.0.trial188.stdout:2759: finishing copy_from to trial18843701-8 2026-02-13T20:23:45.834 INFO:tasks.rados.rados.0.trial188.stdout:2759: got expected ENOENT (src dne) 2026-02-13T20:23:45.834 INFO:tasks.rados.rados.0.trial188.stdout:2759: finishing copy_from racing read to trial18843701-8 2026-02-13T20:23:45.845 INFO:tasks.rados.rados.0.trial188.stdout:2757: finishing write tid 1 to trial18843701-48 2026-02-13T20:23:45.845 INFO:tasks.rados.rados.0.trial188.stdout:2757: finishing write tid 2 to trial18843701-48 2026-02-13T20:23:45.845 INFO:tasks.rados.rados.0.trial188.stdout:2757: finishing write tid 3 to trial18843701-48 2026-02-13T20:23:45.845 INFO:tasks.rados.rados.0.trial188.stdout:2757: finishing write tid 4 to trial18843701-48 2026-02-13T20:23:45.845 INFO:tasks.rados.rados.0.trial188.stdout:2757: oid 48 updating version 0 to 609 2026-02-13T20:23:45.846 INFO:tasks.rados.rados.0.trial188.stdout:2757: oid 48 version 609 is already newer than 608 2026-02-13T20:23:45.846 INFO:tasks.rados.rados.0.trial188.stdout:2757: oid 48 updating version 609 to 610 2026-02-13T20:23:45.846 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 48 v 610 (ObjNum 957 snap 285 seq_num 957) dirty exists 2026-02-13T20:23:45.846 INFO:tasks.rados.rados.0.trial188.stdout:2757: left oid 48 (ObjNum 957 snap 285 seq_num 957) 2026-02-13T20:23:46.302 INFO:tasks.rados.rados.0.trial188.stdout:2757: done (3 left) 2026-02-13T20:23:46.303 INFO:tasks.rados.rados.0.trial188.stdout:2758: done (2 left) 2026-02-13T20:23:46.303 INFO:tasks.rados.rados.0.trial188.stdout:2759: done (1 left) 2026-02-13T20:23:46.303 INFO:tasks.rados.rados.0.trial188.stdout:2760: done (0 left) 2026-02-13T20:23:46.303 INFO:tasks.rados.rados.0.trial188.stdout:2761: snap_create 2026-02-13T20:23:46.400 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T20:23:46.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.466+0000 7f24065e5640 10 monclient: get_monmap_and_config 2026-02-13T20:23:46.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.466+0000 7f24065e5640 10 monclient: build_initial_monmap 2026-02-13T20:23:46.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.466+0000 7f24065e5640 10 monclient: monmap: 2026-02-13T20:23:46.475 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:23:46.475 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:46.475 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:23:46.467283+0000 2026-02-13T20:23:46.475 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:23:46.467283+0000 2026-02-13T20:23:46.475 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:23:46.476 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:46.476 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:23:46.476 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:23:46.476 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:23:46.476 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:46.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.467+0000 7f24065e5640 1 Processor -- start 2026-02-13T20:23:46.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.467+0000 7f24065e5640 1 -- start start 2026-02-13T20:23:46.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.467+0000 7f24065e5640 10 monclient: init 2026-02-13T20:23:46.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.467+0000 7f24065e5640 10 monclient: _reopen_session rank -1 2026-02-13T20:23:46.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.467+0000 7f24065e5640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:23:46.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.467+0000 7f24065e5640 10 monclient(hunting): picked mon.noname-c con 0x7f24001401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:23:46.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.467+0000 7f24065e5640 10 monclient(hunting): picked mon.noname-b con 0x7f2400092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:23:46.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.467+0000 7f24065e5640 10 monclient(hunting): picked mon.noname-a con 0x7f2400091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:23:46.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.467+0000 7f24065e5640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f240008b730 con 0x7f2400091950 2026-02-13T20:23:46.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.467+0000 7f24065e5640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f240005c5b0 con 0x7f24001401c0 2026-02-13T20:23:46.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.467+0000 7f24065e5640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f240008bcf0 con 0x7f2400092020 2026-02-13T20:23:46.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.467+0000 7f24065e5640 10 monclient(hunting): _renew_subs 2026-02-13T20:23:46.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.467+0000 7f24065e5640 10 monclient(hunting): authenticate will time out at 1388.157632s 2026-02-13T20:23:46.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.467+0000 7f2404b5b640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f2400091950 0x7f24001a2a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:49180/0 (socket says 10.20.193.110:49180) 2026-02-13T20:23:46.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.467+0000 7f23ff7fe640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f2400092020 0x7f24001812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:44176/0 (socket says 10.20.193.110:44176) 2026-02-13T20:23:46.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.467+0000 7f2404b5b640 1 -- 10.20.193.110:0/1026642043 learned_addr learned my addr 10.20.193.110:0/1026642043 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:23:46.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.467+0000 7f23feffd640 1 -- 10.20.193.110:0/1026642043 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2150520711 0 0) 0x7f240008bcf0 con 0x7f2400092020 2026-02-13T20:23:46.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.467+0000 7f23feffd640 10 monclient(hunting): _negotiate 2026-02-13T20:23:46.478 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.467+0000 7f23feffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:46.478 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.467+0000 7f23feffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:46.478 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.467+0000 7f23feffd640 10 monclient(hunting): my global_id is 94490 2026-02-13T20:23:46.478 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.467+0000 7f23feffd640 1 -- 10.20.193.110:0/1026642043 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23e40035e0 con 0x7f2400092020 2026-02-13T20:23:46.478 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.467+0000 7f23feffd640 1 -- 10.20.193.110:0/1026642043 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 247221746 0 0) 0x7f240008b730 con 0x7f2400091950 2026-02-13T20:23:46.478 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.467+0000 7f23feffd640 10 monclient(hunting): _negotiate 2026-02-13T20:23:46.478 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.467+0000 7f23feffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:46.478 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.467+0000 7f23feffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:46.478 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.467+0000 7f23feffd640 10 monclient(hunting): my global_id is 124197 2026-02-13T20:23:46.478 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.468+0000 7f23feffd640 1 -- 10.20.193.110:0/1026642043 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f240008bcf0 con 0x7f2400091950 2026-02-13T20:23:46.478 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.468+0000 7f23feffd640 1 -- 10.20.193.110:0/1026642043 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1587025378 0 0) 0x7f240008bcf0 con 0x7f2400091950 2026-02-13T20:23:46.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.468+0000 7f23feffd640 1 -- 10.20.193.110:0/1026642043 >> v1:10.20.193.110:6790/0 conn(0x7f2400092020 legacy=0x7f24001812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:46.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.468+0000 7f23feffd640 1 -- 10.20.193.110:0/1026642043 >> v1:10.20.193.188:6789/0 conn(0x7f24001401c0 legacy=0x7f2400091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:46.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.468+0000 7f23feffd640 10 monclient: _finish_hunting 0 2026-02-13T20:23:46.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.468+0000 7f23feffd640 1 monclient: found mon.noname-a 2026-02-13T20:23:46.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.468+0000 7f23feffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:23:46.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.468+0000 7f23feffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:23:46.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.468+0000 7f23feffd640 1 -- 10.20.193.110:0/1026642043 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2400140590 con 0x7f2400091950 2026-02-13T20:23:46.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.468+0000 7f23feffd640 10 monclient: _finish_auth 0 2026-02-13T20:23:46.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.468+0000 7f23feffd640 10 monclient: _check_auth_tickets 2026-02-13T20:23:46.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.468+0000 7f23feffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:23:46.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.468+0000 7f23feffd640 1 -- 10.20.193.110:0/1026642043 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f23f4003eb0 con 0x7f2400091950 2026-02-13T20:23:46.479 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.468+0000 7f23feffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:46.480 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.468+0000 7f23feffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:23:46.480 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.468+0000 7f23feffd640 10 monclient: dump: 2026-02-13T20:23:46.480 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:46.480 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:46.480 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.480 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.480 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:46.480 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:46.480 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:46.480 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:46.480 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:46.481 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:46.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.468+0000 7f24065e5640 5 monclient: authenticate success, global_id 124197 2026-02-13T20:23:46.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.468+0000 7f24065e5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:23:46.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.468+0000 7f23feffd640 1 -- 10.20.193.110:0/1026642043 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f23f40040c0 con 0x7f2400091950 2026-02-13T20:23:46.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.468+0000 7f23feffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:23:46.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.468+0000 7f24065e5640 10 monclient: get_monmap_and_config success 2026-02-13T20:23:46.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.468+0000 7f24065e5640 4 set_mon_vals no callback set 2026-02-13T20:23:46.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.468+0000 7f23feffd640 1 -- 10.20.193.110:0/1026642043 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f23f40044d0 con 0x7f2400091950 2026-02-13T20:23:46.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.468+0000 7f23feffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:46.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.468+0000 7f23feffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:23:46.481 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.468+0000 7f23feffd640 10 monclient: dump: 2026-02-13T20:23:46.481 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:46.482 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:46.482 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.482 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.482 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:46.482 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:46.482 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:46.482 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:46.482 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:46.482 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:46.482 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.468+0000 7f24065e5640 10 monclient: shutdown 2026-02-13T20:23:46.482 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.468+0000 7f24065e5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:23:46.482 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.468+0000 7f24065e5640 1 -- 10.20.193.110:0/1026642043 >> v1:10.20.193.110:6789/0 conn(0x7f2400091950 legacy=0x7f24001a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:46.483 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.468+0000 7f24065e5640 1 -- 10.20.193.110:0/1026642043 shutdown_connections 2026-02-13T20:23:46.483 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.468+0000 7f24065e5640 1 -- 10.20.193.110:0/1026642043 >> 10.20.193.110:0/1026642043 conn(0x7f2400054e90 msgr2=0x7f2400058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:23:46.483 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.468+0000 7f24065e5640 1 -- 10.20.193.110:0/1026642043 shutdown_connections 2026-02-13T20:23:46.483 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.468+0000 7f24065e5640 1 -- 10.20.193.110:0/1026642043 wait complete. 2026-02-13T20:23:46.483 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.468+0000 7f24065e5640 10 monclient: build_initial_monmap 2026-02-13T20:23:46.483 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.468+0000 7f24065e5640 10 monclient: monmap: 2026-02-13T20:23:46.483 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:23:46.483 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:23:46.483 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:23:46.483 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:23:46.483 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:23:46.484 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:23:46.484 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:23:46.484 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:23:46.484 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:23:46.484 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:46.484 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.469+0000 7f24065e5640 1 Processor -- start 2026-02-13T20:23:46.484 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.469+0000 7f24065e5640 1 -- start start 2026-02-13T20:23:46.484 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.469+0000 7f24065e5640 10 monclient: init 2026-02-13T20:23:46.484 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.469+0000 7f24065e5640 10 monclient: _reopen_session rank -1 2026-02-13T20:23:46.484 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.469+0000 7f24065e5640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:23:46.484 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.469+0000 7f24065e5640 10 monclient(hunting): picked mon.noname-a con 0x7f2400091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:23:46.484 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.469+0000 7f24065e5640 10 monclient(hunting): picked mon.noname-b con 0x7f24001401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:23:46.485 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.469+0000 7f24065e5640 10 monclient(hunting): picked mon.noname-c con 0x7f240013ef70 addr v1:10.20.193.110:6790/0 2026-02-13T20:23:46.485 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.469+0000 7f24065e5640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f240008a920 con 0x7f2400091950 2026-02-13T20:23:46.485 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.469+0000 7f24065e5640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2400090fa0 con 0x7f24001401c0 2026-02-13T20:23:46.485 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.469+0000 7f24065e5640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f240008c4a0 con 0x7f240013ef70 2026-02-13T20:23:46.485 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.469+0000 7f24065e5640 10 monclient(hunting): _renew_subs 2026-02-13T20:23:46.485 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.469+0000 7f24065e5640 10 monclient(hunting): authenticate will time out at 1388.159637s 2026-02-13T20:23:46.485 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.469+0000 7f23fffff640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f2400091950 0x7f2400152670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:49194/0 (socket says 10.20.193.110:49194) 2026-02-13T20:23:46.485 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.469+0000 7f23fffff640 1 -- 10.20.193.110:0/4132567799 learned_addr learned my addr 10.20.193.110:0/4132567799 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:23:46.485 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.469+0000 7f23fcff9640 1 -- 10.20.193.110:0/4132567799 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3400177009 0 0) 0x7f240008a920 con 0x7f2400091950 2026-02-13T20:23:46.485 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.469+0000 7f23fcff9640 10 monclient(hunting): _negotiate 2026-02-13T20:23:46.485 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.469+0000 7f23fcff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:46.486 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.469+0000 7f23fcff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:46.486 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.469+0000 7f23fcff9640 10 monclient(hunting): my global_id is 124200 2026-02-13T20:23:46.486 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.469+0000 7f23fcff9640 1 -- 10.20.193.110:0/4132567799 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23d00035e0 con 0x7f2400091950 2026-02-13T20:23:46.486 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.469+0000 7f23fcff9640 1 -- 10.20.193.110:0/4132567799 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3090218024 0 0) 0x7f240008c4a0 con 0x7f240013ef70 2026-02-13T20:23:46.486 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.469+0000 7f23fcff9640 10 monclient(hunting): _negotiate 2026-02-13T20:23:46.486 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.469+0000 7f23fcff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:46.486 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.469+0000 7f23fcff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:46.486 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.469+0000 7f23fcff9640 10 monclient(hunting): my global_id is 94493 2026-02-13T20:23:46.486 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.469+0000 7f23fcff9640 1 -- 10.20.193.110:0/4132567799 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f240008a920 con 0x7f240013ef70 2026-02-13T20:23:46.486 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.470+0000 7f23fcff9640 1 -- 10.20.193.110:0/4132567799 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2581752753 0 0) 0x7f23d00035e0 con 0x7f2400091950 2026-02-13T20:23:46.486 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.470+0000 7f23fcff9640 1 -- 10.20.193.110:0/4132567799 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f240008c4a0 con 0x7f2400091950 2026-02-13T20:23:46.486 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.470+0000 7f23fcff9640 1 -- 10.20.193.110:0/4132567799 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f23ec0030e0 con 0x7f2400091950 2026-02-13T20:23:46.486 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.470+0000 7f23fcff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:23:46.487 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.470+0000 7f23fcff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:23:46.487 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.470+0000 7f23fcff9640 10 monclient(hunting): dump: 2026-02-13T20:23:46.487 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:46.487 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:46.487 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.487 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.487 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:46.487 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:46.487 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:46.487 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:46.487 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:46.487 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:46.488 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.470+0000 7f23fcff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:23:46.488 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.470+0000 7f23fcff9640 1 -- 10.20.193.110:0/4132567799 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3608582232 0 0) 0x7f240008a920 con 0x7f240013ef70 2026-02-13T20:23:46.488 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.470+0000 7f23fcff9640 1 -- 10.20.193.110:0/4132567799 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f23d00035e0 con 0x7f240013ef70 2026-02-13T20:23:46.488 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.470+0000 7f23fcff9640 1 -- 10.20.193.110:0/4132567799 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f23f40043e0 con 0x7f240013ef70 2026-02-13T20:23:46.488 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.470+0000 7f23fcff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:23:46.488 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.470+0000 7f23fcff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:23:46.488 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.470+0000 7f23fcff9640 10 monclient(hunting): dump: 2026-02-13T20:23:46.488 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:46.488 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:46.488 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.488 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.488 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:46.489 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:46.489 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:46.489 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:46.489 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:46.489 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:46.489 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.470+0000 7f23fcff9640 1 -- 10.20.193.110:0/4132567799 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 704751412 0 0) 0x7f240008c4a0 con 0x7f2400091950 2026-02-13T20:23:46.489 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.470+0000 7f23fcff9640 1 -- 10.20.193.110:0/4132567799 >> v1:10.20.193.110:6790/0 conn(0x7f240013ef70 legacy=0x7f2400194a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:46.489 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.470+0000 7f23fcff9640 1 -- 10.20.193.110:0/4132567799 >> v1:10.20.193.188:6789/0 conn(0x7f24001401c0 legacy=0x7f240013e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:46.489 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.470+0000 7f23fcff9640 10 monclient: _finish_hunting 0 2026-02-13T20:23:46.489 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.470+0000 7f23fcff9640 1 monclient: found mon.a 2026-02-13T20:23:46.489 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.470+0000 7f23fcff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:23:46.490 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.470+0000 7f23fcff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:23:46.490 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.470+0000 7f23fcff9640 1 -- 10.20.193.110:0/4132567799 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24001322a0 con 0x7f2400091950 2026-02-13T20:23:46.490 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.470+0000 7f23fcff9640 10 monclient: _finish_auth 0 2026-02-13T20:23:46.490 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.470+0000 7f23fcff9640 10 monclient: _check_auth_tickets 2026-02-13T20:23:46.490 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.470+0000 7f23fcff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:23:46.490 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.470+0000 7f24065e5640 5 monclient: authenticate success, global_id 124200 2026-02-13T20:23:46.490 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.470+0000 7f24065e5640 10 monclient: _renew_subs 2026-02-13T20:23:46.490 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.470+0000 7f24065e5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:23:46.490 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.470+0000 7f24065e5640 1 -- 10.20.193.110:0/4132567799 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f240005d320 con 0x7f2400091950 2026-02-13T20:23:46.490 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.470+0000 7f24065e5640 10 monclient: _renew_subs 2026-02-13T20:23:46.490 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.470+0000 7f24065e5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:23:46.490 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.470+0000 7f24065e5640 1 -- 10.20.193.110:0/4132567799 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2400196120 con 0x7f2400091950 2026-02-13T20:23:46.491 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.470+0000 7f23fcff9640 1 -- 10.20.193.110:0/4132567799 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f23ec0032b0 con 0x7f2400091950 2026-02-13T20:23:46.491 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.470+0000 7f23fcff9640 10 monclient: handle_config config(0 keys) 2026-02-13T20:23:46.491 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.470+0000 7f23fcff9640 1 -- 10.20.193.110:0/4132567799 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f23ec003b30 con 0x7f2400091950 2026-02-13T20:23:46.491 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.470+0000 7f23fcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:46.491 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.470+0000 7f23fcff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:23:46.491 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.470+0000 7f23fe7fc640 4 set_mon_vals no callback set 2026-02-13T20:23:46.491 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.470+0000 7f23fcff9640 10 monclient: dump: 2026-02-13T20:23:46.491 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:46.491 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:46.491 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.491 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.491 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:46.492 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:46.492 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:46.492 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:46.492 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:46.492 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:46.492 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.470+0000 7f24065e5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:23:46.492 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.470+0000 7f24065e5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:23:46.492 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.470+0000 7f24065e5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:23:46.492 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.470+0000 7f24065e5640 1 -- 10.20.193.110:0/4132567799 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24000008d0 con 0x7f2400091950 2026-02-13T20:23:46.492 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.470+0000 7f23fcff9640 1 -- 10.20.193.110:0/4132567799 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f23ec003c90 con 0x7f2400091950 2026-02-13T20:23:46.492 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.471+0000 7f23fcff9640 1 -- 10.20.193.110:0/4132567799 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(586..586 src has 1..586) ==== 3871+0+0 (unknown 1033153499 0 0) 0x7f23ec04e900 con 0x7f2400091950 2026-02-13T20:23:46.492 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.471+0000 7f23ff7fe640 10 monclient: get_auth_request con 0x7f23d003faa0 auth_method 0 2026-02-13T20:23:46.493 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.473+0000 7f23fcff9640 1 -- 10.20.193.110:0/4132567799 <== mon.0 v1:10.20.193.110:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f23ec0041b0 con 0x7f2400091950 2026-02-13T20:23:46.493 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.473+0000 7f23fcff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:23:46.493 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.473+0000 7f23fcff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:23:46.617 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.616+0000 7f24065e5640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T20:23:46.617 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.616+0000 7f24065e5640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T20:23:46.617 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.616+0000 7f24065e5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:23:46.617 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.616+0000 7f24065e5640 1 -- 10.20.193.110:0/4132567799 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f2400058410 con 0x7f2400091950 2026-02-13T20:23:46.617 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.617+0000 7f23fcff9640 1 -- 10.20.193.110:0/4132567799 <== mon.0 v1:10.20.193.110:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 586417235) 0x7f23ec016830 con 0x7f2400091950 2026-02-13T20:23:46.617 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.617+0000 7f23fcff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T20:23:46.617 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.617+0000 7f23fcff9640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:23:46.617 INFO:teuthology.orchestra.run.trial110.stdout:{"election_epoch":46,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","modified":"2026-02-13T20:11:07.161192Z","created":"2026-02-13T20:11:07.161192Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6789","nonce":0}]},"addr":"10.20.193.110:6789/0","public_addr":"10.20.193.110:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161241+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6789","nonce":0}]},"addr":"10.20.193.188:6789/0","public_addr":"10.20.193.188:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161242+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6790","nonce":0}]},"addr":"10.20.193.110:6790/0","public_addr":"10.20.193.110:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161243+0000","crush_location":[]}]}} 2026-02-13T20:23:46.618 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.618+0000 7f24065e5640 1 -- 10.20.193.110:0/4132567799 >> v1:10.20.193.188:6812/1623052694 conn(0x7f23d003faa0 legacy=0x7f23d005ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:46.618 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.618+0000 7f24065e5640 10 monclient: shutdown 2026-02-13T20:23:46.618 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.618+0000 7f24065e5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:23:46.618 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.618+0000 7f24065e5640 1 -- 10.20.193.110:0/4132567799 >> v1:10.20.193.110:6789/0 conn(0x7f2400091950 legacy=0x7f2400152670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:46.618 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.618+0000 7f24065e5640 1 -- 10.20.193.110:0/4132567799 shutdown_connections 2026-02-13T20:23:46.618 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.618+0000 7f24065e5640 1 -- 10.20.193.110:0/4132567799 >> 10.20.193.110:0/4132567799 conn(0x7f2400054e90 msgr2=0x7f240008dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:23:46.619 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.618+0000 7f24065e5640 1 -- 10.20.193.110:0/4132567799 shutdown_connections 2026-02-13T20:23:46.619 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.618+0000 7f24065e5640 1 -- 10.20.193.110:0/4132567799 wait complete. 2026-02-13T20:23:46.626 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-13T20:23:46.626 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-13T20:23:46.626 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T20:23:46.690 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.689+0000 7f77cd34b640 10 monclient: get_monmap_and_config 2026-02-13T20:23:46.690 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.689+0000 7f77cd34b640 10 monclient: build_initial_monmap 2026-02-13T20:23:46.690 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.690+0000 7f77cd34b640 10 monclient: monmap: 2026-02-13T20:23:46.690 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:23:46.690 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:46.690 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:23:46.690409+0000 2026-02-13T20:23:46.690 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:23:46.690409+0000 2026-02-13T20:23:46.690 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:23:46.690 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:46.690 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:23:46.690 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:23:46.690 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:23:46.690 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:46.691 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.690+0000 7f77cd34b640 1 Processor -- start 2026-02-13T20:23:46.691 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.690+0000 7f77cd34b640 1 -- start start 2026-02-13T20:23:46.691 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.690+0000 7f77cd34b640 10 monclient: init 2026-02-13T20:23:46.691 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.690+0000 7f77cd34b640 10 monclient: _reopen_session rank -1 2026-02-13T20:23:46.691 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.690+0000 7f77cd34b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:23:46.692 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.690+0000 7f77cd34b640 10 monclient(hunting): picked mon.noname-a con 0x7f77c8140180 addr v1:10.20.193.110:6789/0 2026-02-13T20:23:46.692 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.690+0000 7f77cd34b640 10 monclient(hunting): picked mon.noname-c con 0x7f77c805ca00 addr v1:10.20.193.188:6789/0 2026-02-13T20:23:46.692 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.690+0000 7f77cd34b640 10 monclient(hunting): picked mon.noname-b con 0x7f77c808be90 addr v1:10.20.193.110:6790/0 2026-02-13T20:23:46.692 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.690+0000 7f77cd34b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77c808b160 con 0x7f77c8140180 2026-02-13T20:23:46.692 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.690+0000 7f77cd34b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77c805bb90 con 0x7f77c805ca00 2026-02-13T20:23:46.692 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.690+0000 7f77cd34b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77c808b440 con 0x7f77c808be90 2026-02-13T20:23:46.692 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.690+0000 7f77cd34b640 10 monclient(hunting): _renew_subs 2026-02-13T20:23:46.692 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.690+0000 7f77cd34b640 10 monclient(hunting): authenticate will time out at 1388.380752s 2026-02-13T20:23:46.692 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.690+0000 7f77c7fff640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f77c8140180 0x7f77c8140550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:49196/0 (socket says 10.20.193.110:49196) 2026-02-13T20:23:46.693 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.690+0000 7f77c7fff640 1 -- 10.20.193.110:0/624834473 learned_addr learned my addr 10.20.193.110:0/624834473 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:23:46.693 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.691+0000 7f77c6ffd640 1 -- 10.20.193.110:0/624834473 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1629452983 0 0) 0x7f77c808b160 con 0x7f77c8140180 2026-02-13T20:23:46.693 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.691+0000 7f77c6ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:23:46.693 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.691+0000 7f77c6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:46.693 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.691+0000 7f77c6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:46.693 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.691+0000 7f77c6ffd640 10 monclient(hunting): my global_id is 124203 2026-02-13T20:23:46.703 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.691+0000 7f77c6ffd640 1 -- 10.20.193.110:0/624834473 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77ac0035e0 con 0x7f77c8140180 2026-02-13T20:23:46.703 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.691+0000 7f77c6ffd640 1 -- 10.20.193.110:0/624834473 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4073901324 0 0) 0x7f77c808b440 con 0x7f77c808be90 2026-02-13T20:23:46.703 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.691+0000 7f77c6ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:23:46.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.691+0000 7f77c6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:46.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.691+0000 7f77c6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:46.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.691+0000 7f77c6ffd640 10 monclient(hunting): my global_id is 94496 2026-02-13T20:23:46.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.691+0000 7f77c6ffd640 1 -- 10.20.193.110:0/624834473 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77c808b160 con 0x7f77c808be90 2026-02-13T20:23:46.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.691+0000 7f77c6ffd640 1 -- 10.20.193.110:0/624834473 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2959734651 0 0) 0x7f77c805bb90 con 0x7f77c805ca00 2026-02-13T20:23:46.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.691+0000 7f77c6ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:23:46.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.691+0000 7f77c6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:46.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.691+0000 7f77c6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:46.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.691+0000 7f77c6ffd640 10 monclient(hunting): my global_id is 134116 2026-02-13T20:23:46.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.691+0000 7f77c6ffd640 1 -- 10.20.193.110:0/624834473 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77c808b440 con 0x7f77c805ca00 2026-02-13T20:23:46.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.691+0000 7f77c6ffd640 1 -- 10.20.193.110:0/624834473 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 555563571 0 0) 0x7f77c808b160 con 0x7f77c808be90 2026-02-13T20:23:46.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.691+0000 7f77c6ffd640 1 -- 10.20.193.110:0/624834473 >> v1:10.20.193.188:6789/0 conn(0x7f77c805ca00 legacy=0x7f77c8180f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:46.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.691+0000 7f77c6ffd640 1 -- 10.20.193.110:0/624834473 >> v1:10.20.193.110:6789/0 conn(0x7f77c8140180 legacy=0x7f77c8140550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:46.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.691+0000 7f77c6ffd640 10 monclient: _finish_hunting 0 2026-02-13T20:23:46.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.691+0000 7f77c6ffd640 1 monclient: found mon.noname-b 2026-02-13T20:23:46.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.691+0000 7f77c6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:23:46.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.691+0000 7f77c6ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:23:46.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.691+0000 7f77c6ffd640 1 -- 10.20.193.110:0/624834473 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77c805bfe0 con 0x7f77c808be90 2026-02-13T20:23:46.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.691+0000 7f77c6ffd640 10 monclient: _finish_auth 0 2026-02-13T20:23:46.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.691+0000 7f77c6ffd640 10 monclient: _check_auth_tickets 2026-02-13T20:23:46.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.691+0000 7f77c6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:23:46.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.691+0000 7f77c6ffd640 1 -- 10.20.193.110:0/624834473 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f77bc003e30 con 0x7f77c808be90 2026-02-13T20:23:46.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.691+0000 7f77cd34b640 5 monclient: authenticate success, global_id 94496 2026-02-13T20:23:46.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.691+0000 7f77c6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:46.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.691+0000 7f77c6ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:23:46.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.691+0000 7f77c6ffd640 10 monclient: dump: 2026-02-13T20:23:46.706 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:46.706 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:46.706 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.706 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.706 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:46.706 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:46.706 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:46.706 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:46.706 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:46.707 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:46.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.691+0000 7f77cd34b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:23:46.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.691+0000 7f77c6ffd640 1 -- 10.20.193.110:0/624834473 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f77bc003f90 con 0x7f77c808be90 2026-02-13T20:23:46.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.691+0000 7f77c6ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:23:46.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.691+0000 7f77c6ffd640 1 -- 10.20.193.110:0/624834473 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f77bc0043a0 con 0x7f77c808be90 2026-02-13T20:23:46.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.691+0000 7f77cd34b640 10 monclient: get_monmap_and_config success 2026-02-13T20:23:46.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.691+0000 7f77cd34b640 4 set_mon_vals no callback set 2026-02-13T20:23:46.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.691+0000 7f77c6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:46.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.691+0000 7f77c6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:23:46.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.691+0000 7f77c6ffd640 10 monclient: dump: 2026-02-13T20:23:46.707 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:46.707 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:46.707 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.708 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.708 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:46.708 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:46.708 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:46.708 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:46.708 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:46.708 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:46.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.691+0000 7f77cd34b640 10 monclient: shutdown 2026-02-13T20:23:46.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.691+0000 7f77cd34b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:23:46.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.691+0000 7f77cd34b640 1 -- 10.20.193.110:0/624834473 >> v1:10.20.193.110:6790/0 conn(0x7f77c808be90 legacy=0x7f77c81a26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:46.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.691+0000 7f77cd34b640 1 -- 10.20.193.110:0/624834473 shutdown_connections 2026-02-13T20:23:46.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.691+0000 7f77cd34b640 1 -- 10.20.193.110:0/624834473 >> 10.20.193.110:0/624834473 conn(0x7f77c8054d30 msgr2=0x7f77c8058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:23:46.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.691+0000 7f77cd34b640 1 -- 10.20.193.110:0/624834473 shutdown_connections 2026-02-13T20:23:46.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.691+0000 7f77cd34b640 1 -- 10.20.193.110:0/624834473 wait complete. 2026-02-13T20:23:46.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.692+0000 7f77cd34b640 10 monclient: build_initial_monmap 2026-02-13T20:23:46.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.692+0000 7f77cd34b640 10 monclient: monmap: 2026-02-13T20:23:46.709 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:23:46.709 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:23:46.709 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:23:46.709 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:23:46.709 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:23:46.709 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:23:46.709 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:23:46.709 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:23:46.710 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:23:46.710 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:46.710 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.692+0000 7f77cd34b640 1 Processor -- start 2026-02-13T20:23:46.710 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.692+0000 7f77cd34b640 1 -- start start 2026-02-13T20:23:46.710 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.692+0000 7f77cd34b640 10 monclient: init 2026-02-13T20:23:46.710 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.692+0000 7f77cd34b640 10 monclient: _reopen_session rank -1 2026-02-13T20:23:46.710 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.692+0000 7f77cd34b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:23:46.710 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.692+0000 7f77cd34b640 10 monclient(hunting): picked mon.noname-a con 0x7f77c808be90 addr v1:10.20.193.110:6789/0 2026-02-13T20:23:46.710 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.692+0000 7f77cd34b640 10 monclient(hunting): picked mon.noname-c con 0x7f77c8140180 addr v1:10.20.193.110:6790/0 2026-02-13T20:23:46.710 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.692+0000 7f77cd34b640 10 monclient(hunting): picked mon.noname-b con 0x7f77c8089c80 addr v1:10.20.193.188:6789/0 2026-02-13T20:23:46.710 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.692+0000 7f77cd34b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77c808c3c0 con 0x7f77c808be90 2026-02-13T20:23:46.710 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.692+0000 7f77cd34b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77c805d320 con 0x7f77c8089c80 2026-02-13T20:23:46.710 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.692+0000 7f77cd34b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77c81114b0 con 0x7f77c8140180 2026-02-13T20:23:46.711 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.692+0000 7f77cd34b640 10 monclient(hunting): _renew_subs 2026-02-13T20:23:46.711 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.692+0000 7f77cd34b640 10 monclient(hunting): authenticate will time out at 1388.382638s 2026-02-13T20:23:46.711 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.692+0000 7f77c7fff640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f77c808be90 0x7f77c8088e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:49200/0 (socket says 10.20.193.110:49200) 2026-02-13T20:23:46.711 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.692+0000 7f77c7fff640 1 -- 10.20.193.110:0/3674890596 learned_addr learned my addr 10.20.193.110:0/3674890596 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:23:46.711 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.692+0000 7f77c4ff9640 1 -- 10.20.193.110:0/3674890596 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1670600275 0 0) 0x7f77c81114b0 con 0x7f77c8140180 2026-02-13T20:23:46.711 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.692+0000 7f77c4ff9640 10 monclient(hunting): _negotiate 2026-02-13T20:23:46.711 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.692+0000 7f77c4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:46.711 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.692+0000 7f77c4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:46.711 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.692+0000 7f77c4ff9640 10 monclient(hunting): my global_id is 94499 2026-02-13T20:23:46.711 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.692+0000 7f77c4ff9640 1 -- 10.20.193.110:0/3674890596 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77980035e0 con 0x7f77c8140180 2026-02-13T20:23:46.711 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.692+0000 7f77c4ff9640 1 -- 10.20.193.110:0/3674890596 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1250802253 0 0) 0x7f77c808c3c0 con 0x7f77c808be90 2026-02-13T20:23:46.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.692+0000 7f77c4ff9640 10 monclient(hunting): _negotiate 2026-02-13T20:23:46.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.692+0000 7f77c4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:46.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.692+0000 7f77c4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:46.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.692+0000 7f77c4ff9640 10 monclient(hunting): my global_id is 124206 2026-02-13T20:23:46.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.692+0000 7f77c4ff9640 1 -- 10.20.193.110:0/3674890596 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77c81114b0 con 0x7f77c808be90 2026-02-13T20:23:46.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.693+0000 7f77c4ff9640 1 -- 10.20.193.110:0/3674890596 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1163729269 0 0) 0x7f77980035e0 con 0x7f77c8140180 2026-02-13T20:23:46.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.693+0000 7f77c4ff9640 1 -- 10.20.193.110:0/3674890596 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f77c808c3c0 con 0x7f77c8140180 2026-02-13T20:23:46.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.693+0000 7f77c4ff9640 1 -- 10.20.193.110:0/3674890596 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f77b8002fc0 con 0x7f77c8140180 2026-02-13T20:23:46.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.693+0000 7f77c4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:23:46.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.693+0000 7f77c4ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:23:46.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.693+0000 7f77c4ff9640 10 monclient(hunting): dump: 2026-02-13T20:23:46.713 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:46.713 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:46.713 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.713 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.713 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:46.713 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:46.713 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:46.713 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:46.713 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:46.713 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:46.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.693+0000 7f77c4ff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:23:46.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.693+0000 7f77c4ff9640 1 -- 10.20.193.110:0/3674890596 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 313265827 0 0) 0x7f77c81114b0 con 0x7f77c808be90 2026-02-13T20:23:46.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.693+0000 7f77c4ff9640 1 -- 10.20.193.110:0/3674890596 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f77980035e0 con 0x7f77c808be90 2026-02-13T20:23:46.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.693+0000 7f77c4ff9640 1 -- 10.20.193.110:0/3674890596 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f77b40031f0 con 0x7f77c808be90 2026-02-13T20:23:46.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.693+0000 7f77c4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:23:46.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.693+0000 7f77c4ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:23:46.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.693+0000 7f77c4ff9640 10 monclient(hunting): dump: 2026-02-13T20:23:46.714 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:46.714 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:46.714 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.714 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.714 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:46.714 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:46.714 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:46.714 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:46.715 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:46.715 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:46.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.693+0000 7f77c4ff9640 1 -- 10.20.193.110:0/3674890596 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 684769117 0 0) 0x7f77c808c3c0 con 0x7f77c8140180 2026-02-13T20:23:46.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.693+0000 7f77c4ff9640 1 -- 10.20.193.110:0/3674890596 >> v1:10.20.193.188:6789/0 conn(0x7f77c8089c80 legacy=0x7f77c81a1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:46.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.693+0000 7f77c4ff9640 1 -- 10.20.193.110:0/3674890596 >> v1:10.20.193.110:6789/0 conn(0x7f77c808be90 legacy=0x7f77c8088e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:46.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.693+0000 7f77c4ff9640 10 monclient: _finish_hunting 0 2026-02-13T20:23:46.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.693+0000 7f77c4ff9640 1 monclient: found mon.c 2026-02-13T20:23:46.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.693+0000 7f77c4ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:23:46.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.693+0000 7f77c4ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:23:46.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.693+0000 7f77c4ff9640 1 -- 10.20.193.110:0/3674890596 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77c808c8d0 con 0x7f77c8140180 2026-02-13T20:23:46.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.693+0000 7f77c4ff9640 10 monclient: _finish_auth 0 2026-02-13T20:23:46.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.693+0000 7f77c4ff9640 10 monclient: _check_auth_tickets 2026-02-13T20:23:46.716 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.693+0000 7f77c4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:23:46.716 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.693+0000 7f77cd34b640 5 monclient: authenticate success, global_id 94499 2026-02-13T20:23:46.716 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.693+0000 7f77cd34b640 10 monclient: _renew_subs 2026-02-13T20:23:46.716 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.693+0000 7f77cd34b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:23:46.716 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.693+0000 7f77cd34b640 1 -- 10.20.193.110:0/3674890596 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f77c808a920 con 0x7f77c8140180 2026-02-13T20:23:46.716 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.693+0000 7f77cd34b640 10 monclient: _renew_subs 2026-02-13T20:23:46.716 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.693+0000 7f77cd34b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:23:46.716 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.693+0000 7f77cd34b640 1 -- 10.20.193.110:0/3674890596 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f77c81108c0 con 0x7f77c8140180 2026-02-13T20:23:46.716 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.693+0000 7f77c4ff9640 1 -- 10.20.193.110:0/3674890596 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f77b80036d0 con 0x7f77c8140180 2026-02-13T20:23:46.716 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.693+0000 7f77c4ff9640 10 monclient: handle_config config(0 keys) 2026-02-13T20:23:46.716 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.693+0000 7f77c4ff9640 1 -- 10.20.193.110:0/3674890596 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f77b80039f0 con 0x7f77c8140180 2026-02-13T20:23:46.716 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.693+0000 7f77c4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:46.716 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.693+0000 7f77c4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:23:46.717 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.693+0000 7f77c4ff9640 10 monclient: dump: 2026-02-13T20:23:46.717 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:46.717 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:46.717 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.717 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.717 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:46.717 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:46.717 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:46.717 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:46.717 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:46.717 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:46.717 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.693+0000 7f77c67fc640 4 set_mon_vals no callback set 2026-02-13T20:23:46.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.693+0000 7f77cd34b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:23:46.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.693+0000 7f77cd34b640 1 -- 10.20.193.110:0/3674890596 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f77c80008d0 con 0x7f77c805ca00 2026-02-13T20:23:46.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.693+0000 7f77c4ff9640 1 -- 10.20.193.110:0/3674890596 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f77b8010660 con 0x7f77c8140180 2026-02-13T20:23:46.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.693+0000 7f77c4ff9640 1 -- 10.20.193.110:0/3674890596 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(586..586 src has 1..586) ==== 3871+0+0 (unknown 1033153499 0 0) 0x7f77b804d710 con 0x7f77c8140180 2026-02-13T20:23:46.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.693+0000 7f77c4ff9640 1 -- 10.20.193.110:0/3674890596 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2797024593 0 0) 0x7f77c80008d0 con 0x7f77c805ca00 2026-02-13T20:23:46.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.694+0000 7f77c4ff9640 10 monclient(hunting): _negotiate 2026-02-13T20:23:46.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.694+0000 7f77c4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:46.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.694+0000 7f77c4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:46.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.694+0000 7f77c4ff9640 10 monclient(hunting): my global_id is 124209 2026-02-13T20:23:46.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.694+0000 7f77c4ff9640 1 -- 10.20.193.110:0/3674890596 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77c808c3c0 con 0x7f77c805ca00 2026-02-13T20:23:46.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.694+0000 7f77ccb4a640 10 monclient: get_auth_request con 0x7f779803fad0 auth_method 0 2026-02-13T20:23:46.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.694+0000 7f77c4ff9640 1 -- 10.20.193.110:0/3674890596 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2417211529 0 0) 0x7f77c808c3c0 con 0x7f77c805ca00 2026-02-13T20:23:46.719 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.694+0000 7f77c4ff9640 1 -- 10.20.193.110:0/3674890596 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f77c80008d0 con 0x7f77c805ca00 2026-02-13T20:23:46.719 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.694+0000 7f77c4ff9640 1 -- 10.20.193.110:0/3674890596 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f77b4004a50 con 0x7f77c805ca00 2026-02-13T20:23:46.719 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.694+0000 7f77c4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:46.719 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.694+0000 7f77c4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:23:46.719 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.694+0000 7f77c4ff9640 10 monclient: dump: 2026-02-13T20:23:46.719 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:46.719 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:46.719 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.719 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.719 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:46.719 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:46.719 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:46.719 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:46.720 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:46.720 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:46.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.694+0000 7f77c4ff9640 1 -- 10.20.193.110:0/3674890596 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1932720596 0 0) 0x7f77c80008d0 con 0x7f77c805ca00 2026-02-13T20:23:46.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.694+0000 7f77c4ff9640 1 -- 10.20.193.110:0/3674890596 --> v1:10.20.193.110:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f77c8058410 con 0x7f77c805ca00 2026-02-13T20:23:46.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.694+0000 7f77c4ff9640 1 -- 10.20.193.110:0/3674890596 <== mon.0 v1:10.20.193.110:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f77b4007a20 con 0x7f77c805ca00 2026-02-13T20:23:46.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.694+0000 7f77c4ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:23:46.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.694+0000 7f77c4ff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:23:46.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.694+0000 7f77c4ff9640 1 -- 10.20.193.110:0/3674890596 >> v1:10.20.193.110:6789/0 conn(0x7f77c805ca00 legacy=0x7f77c8107aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:46.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.694+0000 7f77c4ff9640 1 -- 10.20.193.110:0/3674890596 >> v1:10.20.193.110:6789/0 conn(0x7f77c805ca00 legacy=0x7f77c8107aa0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:23:46.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.697+0000 7f77cd34b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:23:46.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.697+0000 7f77cd34b640 1 -- 10.20.193.110:0/3674890596 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f77c81088c0 con 0x7f77c81a3cc0 2026-02-13T20:23:46.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.698+0000 7f77c4ff9640 1 -- 10.20.193.110:0/3674890596 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 972369904 0 0) 0x7f77c81088c0 con 0x7f77c81a3cc0 2026-02-13T20:23:46.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.698+0000 7f77c4ff9640 10 monclient(hunting): _negotiate 2026-02-13T20:23:46.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.698+0000 7f77c4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:46.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.698+0000 7f77c4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:46.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.698+0000 7f77c4ff9640 10 monclient(hunting): my global_id is 124212 2026-02-13T20:23:46.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.698+0000 7f77c4ff9640 1 -- 10.20.193.110:0/3674890596 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77c80008d0 con 0x7f77c81a3cc0 2026-02-13T20:23:46.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.698+0000 7f77c4ff9640 1 -- 10.20.193.110:0/3674890596 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3980572653 0 0) 0x7f77c80008d0 con 0x7f77c81a3cc0 2026-02-13T20:23:46.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.698+0000 7f77c4ff9640 1 -- 10.20.193.110:0/3674890596 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f77c81088c0 con 0x7f77c81a3cc0 2026-02-13T20:23:46.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.698+0000 7f77c4ff9640 1 -- 10.20.193.110:0/3674890596 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f77b40054b0 con 0x7f77c81a3cc0 2026-02-13T20:23:46.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.698+0000 7f77c4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:46.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.698+0000 7f77c4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:23:46.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.698+0000 7f77c4ff9640 10 monclient: dump: 2026-02-13T20:23:46.721 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:46.722 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:46.722 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.722 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.722 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:46.722 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:46.722 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:46.722 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:46.722 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:46.722 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:46.722 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.698+0000 7f77c4ff9640 1 -- 10.20.193.110:0/3674890596 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2050754311 0 0) 0x7f77c81088c0 con 0x7f77c81a3cc0 2026-02-13T20:23:46.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.698+0000 7f77c4ff9640 1 -- 10.20.193.110:0/3674890596 --> v1:10.20.193.110:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f77c8058580 con 0x7f77c81a3cc0 2026-02-13T20:23:46.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.698+0000 7f77c4ff9640 1 -- 10.20.193.110:0/3674890596 <== mon.0 v1:10.20.193.110:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4514 (unknown 0 0 1354371059) 0x7f77b4005610 con 0x7f77c81a3cc0 2026-02-13T20:23:46.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.698+0000 7f77c4ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:23:46.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.698+0000 7f77c4ff9640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:23:46.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.698+0000 7f77c4ff9640 1 -- 10.20.193.110:0/3674890596 >> v1:10.20.193.110:6789/0 conn(0x7f77c81a3cc0 legacy=0x7f77c81081b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:46.723 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.698+0000 7f77c4ff9640 1 -- 10.20.193.110:0/3674890596 >> v1:10.20.193.110:6789/0 conn(0x7f77c81a3cc0 legacy=0x7f77c81081b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:23:46.723 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:23:46.724 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:23:46.724 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:23:46.724 INFO:teuthology.orchestra.run.trial110.stdout: "state": "peon", 2026-02-13T20:23:46.724 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 46, 2026-02-13T20:23:46.724 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 142116, 2026-02-13T20:23:46.724 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:23:46.724 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:23:46.724 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:23:46.724 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:23:46.724 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:23:46.724 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 0, 2026-02-13T20:23:46.725 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:23:46.725 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:23:46.725 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:23:46.725 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:23:46.725 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:23:46.725 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:23:46.725 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:23:46.725 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:23:46.725 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:23:46.725 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:23:46.725 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:23:46.725 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:23:46.725 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:23:46.726 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:23:46.726 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:23:46.726 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:23:46.726 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:23:46.726 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:23:46.726 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:23:46.726 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:23:46.726 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:23:46.726 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:23:46.726 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:23:46.726 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:23:46.726 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:23:46.726 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:23:46.727 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:23:46.727 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:23:46.727 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:23:46.727 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:23:46.727 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:23:46.727 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:23:46.727 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:23:46.727 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:46.727 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:23:46.727 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:23:46.727 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:23:46.727 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:23:46.727 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:23:46.728 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:23:46.728 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:23:46.728 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:23:46.728 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:23:46.728 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:23:46.728 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:23:46.728 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:23:46.728 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:23:46.728 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:23:46.728 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:23:46.728 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:23:46.728 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:23:46.728 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:23:46.728 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:23:46.728 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:23:46.729 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:23:46.729 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:23:46.729 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:23:46.729 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:23:46.729 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:23:46.729 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:23:46.729 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:23:46.729 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:23:46.729 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:23:46.729 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:23:46.729 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:23:46.729 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:23:46.729 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:46.729 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:23:46.729 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:46.729 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:23:46.730 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:23:46.730 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:23:46.730 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:23:46.730 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:46.730 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:23:46.730 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:23:46.730 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:23:46.730 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:23:46.730 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:23:46.730 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:46.730 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:23:46.730 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:23:46.730 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:23:46.730 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:23:46.730 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:23:46.731 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:23:46.731 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:46.731 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:46.731 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:23:46.731 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:23:46.731 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:23:46.731 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:23:46.731 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:46.731 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:23:46.731 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:23:46.731 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:23:46.731 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:23:46.731 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:23:46.731 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:46.731 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:23:46.731 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:23:46.732 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:23:46.732 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:23:46.732 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:23:46.732 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:23:46.732 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:46.732 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:46.732 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:23:46.732 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:23:46.732 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:23:46.732 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:23:46.732 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:46.732 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:23:46.732 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:23:46.732 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:23:46.732 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:23:46.733 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:23:46.733 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:46.733 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:23:46.733 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:23:46.733 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:23:46.733 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:23:46.733 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:23:46.733 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:23:46.733 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:23:46.733 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:23:46.733 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:46.733 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:23:46.733 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:23:46.733 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:46.733 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:23:46.733 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:23:46.734 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:23:46.734 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:23:46.734 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:23:46.734 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:23:46.734 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:46.734 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:23:46.734 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:23:46.734 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:23:46.734 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:23:46.734 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:23:46.734 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:23:46.734 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:46.734 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:23:46.734 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:23:46.734 INFO:teuthology.orchestra.run.trial110.stdout: "num": 4 2026-02-13T20:23:46.734 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:23:46.735 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:23:46.735 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:46.735 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:23:46.735 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:23:46.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.698+0000 7f77cd34b640 1 -- 10.20.193.110:0/3674890596 >> v1:10.20.193.188:6812/1623052694 conn(0x7f779803fad0 legacy=0x7f779805ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:46.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.698+0000 7f77cd34b640 10 monclient: shutdown 2026-02-13T20:23:46.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.698+0000 7f77cd34b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:23:46.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.698+0000 7f77cd34b640 1 -- 10.20.193.110:0/3674890596 >> v1:10.20.193.110:6790/0 conn(0x7f77c8140180 legacy=0x7f77c8089570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:46.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.698+0000 7f77ccb4a640 1 -- 10.20.193.110:0/3674890596 reap_dead start 2026-02-13T20:23:46.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.698+0000 7f77ccb4a640 1 -- 10.20.193.110:0/3674890596 reap_dead start 2026-02-13T20:23:46.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.698+0000 7f77cd34b640 1 -- 10.20.193.110:0/3674890596 shutdown_connections 2026-02-13T20:23:46.736 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.698+0000 7f77cd34b640 1 -- 10.20.193.110:0/3674890596 >> 10.20.193.110:0/3674890596 conn(0x7f77c8054d30 msgr2=0x7f77c808d770 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:23:46.737 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.698+0000 7f77cd34b640 1 -- 10.20.193.110:0/3674890596 shutdown_connections 2026-02-13T20:23:46.737 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.698+0000 7f77cd34b640 1 -- 10.20.193.110:0/3674890596 wait complete. 2026-02-13T20:23:46.737 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:23:46.737 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-13T20:23:46.737 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T20:23:46.803 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.802+0000 7f531288c640 10 monclient: get_monmap_and_config 2026-02-13T20:23:46.803 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.802+0000 7f531288c640 10 monclient: build_initial_monmap 2026-02-13T20:23:46.803 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.802+0000 7f531288c640 10 monclient: monmap: 2026-02-13T20:23:46.803 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:23:46.803 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:46.803 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:23:46.803311+0000 2026-02-13T20:23:46.803 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:23:46.803311+0000 2026-02-13T20:23:46.803 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:23:46.803 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:46.804 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:23:46.804 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:23:46.804 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:23:46.804 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:46.811 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.803+0000 7f531288c640 1 Processor -- start 2026-02-13T20:23:46.811 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.803+0000 7f531288c640 1 -- start start 2026-02-13T20:23:46.811 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.803+0000 7f531288c640 10 monclient: init 2026-02-13T20:23:46.811 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.803+0000 7f531288c640 10 monclient: _reopen_session rank -1 2026-02-13T20:23:46.811 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.803+0000 7f531288c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:23:46.811 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.803+0000 7f531288c640 10 monclient(hunting): picked mon.noname-c con 0x7f530c13f280 addr v1:10.20.193.188:6789/0 2026-02-13T20:23:46.811 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.803+0000 7f531288c640 10 monclient(hunting): picked mon.noname-a con 0x7f530c13ee70 addr v1:10.20.193.110:6789/0 2026-02-13T20:23:46.811 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.803+0000 7f531288c640 10 monclient(hunting): picked mon.noname-b con 0x7f530c089a90 addr v1:10.20.193.110:6790/0 2026-02-13T20:23:46.811 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.803+0000 7f531288c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f530c08a310 con 0x7f530c13ee70 2026-02-13T20:23:46.811 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.803+0000 7f531288c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f530c08a5f0 con 0x7f530c13f280 2026-02-13T20:23:46.811 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.803+0000 7f531288c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f530c08a8d0 con 0x7f530c089a90 2026-02-13T20:23:46.811 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.803+0000 7f531288c640 10 monclient(hunting): _renew_subs 2026-02-13T20:23:46.812 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.803+0000 7f531288c640 10 monclient(hunting): authenticate will time out at 1388.493856s 2026-02-13T20:23:46.812 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.803+0000 7f5310e02640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f530c089a90 0x7f530c1a18c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:44216/0 (socket says 10.20.193.110:44216) 2026-02-13T20:23:46.812 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.803+0000 7f5310e02640 1 -- 10.20.193.110:0/2960386383 learned_addr learned my addr 10.20.193.110:0/2960386383 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:23:46.812 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.804+0000 7f530affd640 1 -- 10.20.193.110:0/2960386383 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 883531438 0 0) 0x7f530c08a8d0 con 0x7f530c089a90 2026-02-13T20:23:46.812 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.804+0000 7f530affd640 10 monclient(hunting): _negotiate 2026-02-13T20:23:46.812 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.804+0000 7f530affd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:46.812 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.804+0000 7f530affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:46.812 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.804+0000 7f530affd640 10 monclient(hunting): my global_id is 94502 2026-02-13T20:23:46.812 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.804+0000 7f530affd640 1 -- 10.20.193.110:0/2960386383 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52f00035e0 con 0x7f530c089a90 2026-02-13T20:23:46.812 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.804+0000 7f530affd640 1 -- 10.20.193.110:0/2960386383 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3914317563 0 0) 0x7f530c08a310 con 0x7f530c13ee70 2026-02-13T20:23:46.812 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.804+0000 7f530affd640 10 monclient(hunting): _negotiate 2026-02-13T20:23:46.812 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.804+0000 7f530affd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:46.812 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.804+0000 7f530affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:46.812 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.804+0000 7f530affd640 10 monclient(hunting): my global_id is 124215 2026-02-13T20:23:46.813 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.804+0000 7f530affd640 1 -- 10.20.193.110:0/2960386383 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f530c08a8d0 con 0x7f530c13ee70 2026-02-13T20:23:46.813 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.804+0000 7f530affd640 1 -- 10.20.193.110:0/2960386383 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2205595833 0 0) 0x7f52f00035e0 con 0x7f530c089a90 2026-02-13T20:23:46.813 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.804+0000 7f530affd640 1 -- 10.20.193.110:0/2960386383 >> v1:10.20.193.188:6789/0 conn(0x7f530c13f280 legacy=0x7f530c13f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:46.813 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.804+0000 7f530affd640 1 -- 10.20.193.110:0/2960386383 >> v1:10.20.193.110:6789/0 conn(0x7f530c13ee70 legacy=0x7f530c180190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:46.813 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.804+0000 7f530affd640 10 monclient: _finish_hunting 0 2026-02-13T20:23:46.813 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.804+0000 7f530affd640 1 monclient: found mon.noname-b 2026-02-13T20:23:46.813 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.804+0000 7f530affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:23:46.813 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.804+0000 7f530affd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:23:46.813 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.804+0000 7f530affd640 1 -- 10.20.193.110:0/2960386383 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f530c08abb0 con 0x7f530c089a90 2026-02-13T20:23:46.813 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.804+0000 7f530affd640 10 monclient: _finish_auth 0 2026-02-13T20:23:46.813 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.804+0000 7f530affd640 10 monclient: _check_auth_tickets 2026-02-13T20:23:46.813 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.804+0000 7f530affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:23:46.813 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.804+0000 7f530affd640 1 -- 10.20.193.110:0/2960386383 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f5300003eb0 con 0x7f530c089a90 2026-02-13T20:23:46.814 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.804+0000 7f531288c640 5 monclient: authenticate success, global_id 94502 2026-02-13T20:23:46.814 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.804+0000 7f531288c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:23:46.814 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.804+0000 7f530affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:46.814 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.804+0000 7f530affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:23:46.814 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.804+0000 7f530affd640 10 monclient: dump: 2026-02-13T20:23:46.814 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:46.814 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:46.814 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.814 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.814 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:46.814 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:46.814 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:46.814 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:46.814 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:46.814 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:46.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.804+0000 7f531288c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:23:46.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.804+0000 7f530affd640 1 -- 10.20.193.110:0/2960386383 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f53000040b0 con 0x7f530c089a90 2026-02-13T20:23:46.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.804+0000 7f530affd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:23:46.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.804+0000 7f530affd640 1 -- 10.20.193.110:0/2960386383 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f53000044c0 con 0x7f530c089a90 2026-02-13T20:23:46.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.804+0000 7f530affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:46.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.804+0000 7f530affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:23:46.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.804+0000 7f530affd640 10 monclient: dump: 2026-02-13T20:23:46.815 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:46.815 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:46.815 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.815 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.815 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:46.815 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:46.815 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:46.815 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:46.816 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:46.816 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:46.816 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.804+0000 7f531288c640 10 monclient: get_monmap_and_config success 2026-02-13T20:23:46.816 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.804+0000 7f531288c640 4 set_mon_vals no callback set 2026-02-13T20:23:46.816 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.804+0000 7f531288c640 10 monclient: shutdown 2026-02-13T20:23:46.816 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.804+0000 7f531288c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:23:46.816 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.804+0000 7f531288c640 1 -- 10.20.193.110:0/2960386383 >> v1:10.20.193.110:6790/0 conn(0x7f530c089a90 legacy=0x7f530c1a18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:46.816 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.804+0000 7f531288c640 1 -- 10.20.193.110:0/2960386383 shutdown_connections 2026-02-13T20:23:46.816 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.804+0000 7f531288c640 1 -- 10.20.193.110:0/2960386383 >> 10.20.193.110:0/2960386383 conn(0x7f530c054e90 msgr2=0x7f530c058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:23:46.816 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.804+0000 7f531288c640 1 -- 10.20.193.110:0/2960386383 shutdown_connections 2026-02-13T20:23:46.816 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.804+0000 7f531288c640 1 -- 10.20.193.110:0/2960386383 wait complete. 2026-02-13T20:23:46.816 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.805+0000 7f531288c640 10 monclient: build_initial_monmap 2026-02-13T20:23:46.816 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.805+0000 7f531288c640 10 monclient: monmap: 2026-02-13T20:23:46.816 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:23:46.816 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:23:46.817 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:23:46.817 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:23:46.817 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:23:46.817 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:23:46.817 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:23:46.817 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:23:46.817 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:23:46.817 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:46.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.805+0000 7f531288c640 1 Processor -- start 2026-02-13T20:23:46.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.805+0000 7f531288c640 1 -- start start 2026-02-13T20:23:46.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.805+0000 7f531288c640 10 monclient: init 2026-02-13T20:23:46.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.805+0000 7f531288c640 10 monclient: _reopen_session rank -1 2026-02-13T20:23:46.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.805+0000 7f531288c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:23:46.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.805+0000 7f531288c640 10 monclient(hunting): picked mon.noname-c con 0x7f530c089a90 addr v1:10.20.193.110:6790/0 2026-02-13T20:23:46.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.805+0000 7f531288c640 10 monclient(hunting): picked mon.noname-a con 0x7f530c13ee70 addr v1:10.20.193.110:6789/0 2026-02-13T20:23:46.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.805+0000 7f531288c640 10 monclient(hunting): picked mon.noname-b con 0x7f530c13f280 addr v1:10.20.193.188:6789/0 2026-02-13T20:23:46.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.805+0000 7f531288c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f530c1329a0 con 0x7f530c13ee70 2026-02-13T20:23:46.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.805+0000 7f531288c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f530c132f60 con 0x7f530c13f280 2026-02-13T20:23:46.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.805+0000 7f531288c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f530c1320f0 con 0x7f530c089a90 2026-02-13T20:23:46.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.805+0000 7f531288c640 10 monclient(hunting): _renew_subs 2026-02-13T20:23:46.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.805+0000 7f531288c640 10 monclient(hunting): authenticate will time out at 1388.495831s 2026-02-13T20:23:46.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.805+0000 7f530bfff640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f530c089a90 0x7f530c13e530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:44224/0 (socket says 10.20.193.110:44224) 2026-02-13T20:23:46.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.805+0000 7f530bfff640 1 -- 10.20.193.110:0/459869156 learned_addr learned my addr 10.20.193.110:0/459869156 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:23:46.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f5308ff9640 1 -- 10.20.193.110:0/459869156 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3928268545 0 0) 0x7f530c1320f0 con 0x7f530c089a90 2026-02-13T20:23:46.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f5308ff9640 10 monclient(hunting): _negotiate 2026-02-13T20:23:46.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f5308ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:46.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f5308ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:46.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f5308ff9640 10 monclient(hunting): my global_id is 94505 2026-02-13T20:23:46.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f5308ff9640 1 -- 10.20.193.110:0/459869156 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52dc0035e0 con 0x7f530c089a90 2026-02-13T20:23:46.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f5308ff9640 1 -- 10.20.193.110:0/459869156 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1391944136 0 0) 0x7f530c1329a0 con 0x7f530c13ee70 2026-02-13T20:23:46.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f5308ff9640 10 monclient(hunting): _negotiate 2026-02-13T20:23:46.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f5308ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:46.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f5308ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:46.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f5308ff9640 10 monclient(hunting): my global_id is 124218 2026-02-13T20:23:46.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f5308ff9640 1 -- 10.20.193.110:0/459869156 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f530c1320f0 con 0x7f530c13ee70 2026-02-13T20:23:46.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f5308ff9640 1 -- 10.20.193.110:0/459869156 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 974114448 0 0) 0x7f52dc0035e0 con 0x7f530c089a90 2026-02-13T20:23:46.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f5308ff9640 1 -- 10.20.193.110:0/459869156 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f530c1329a0 con 0x7f530c089a90 2026-02-13T20:23:46.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f5308ff9640 1 -- 10.20.193.110:0/459869156 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f52f8003170 con 0x7f530c089a90 2026-02-13T20:23:46.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f5308ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:23:46.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f5308ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:23:46.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f5308ff9640 10 monclient(hunting): dump: 2026-02-13T20:23:46.819 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:46.819 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:46.819 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.820 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.820 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:46.820 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:46.820 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:46.820 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:46.820 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:46.820 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:46.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f5308ff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:23:46.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f5308ff9640 1 -- 10.20.193.110:0/459869156 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3389173806 0 0) 0x7f530c1320f0 con 0x7f530c13ee70 2026-02-13T20:23:46.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f5308ff9640 1 -- 10.20.193.110:0/459869156 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f52dc0035e0 con 0x7f530c13ee70 2026-02-13T20:23:46.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f5308ff9640 1 -- 10.20.193.110:0/459869156 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f52fc002fc0 con 0x7f530c13ee70 2026-02-13T20:23:46.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f5308ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:23:46.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f5308ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:23:46.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f5308ff9640 10 monclient(hunting): dump: 2026-02-13T20:23:46.820 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:46.821 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:46.821 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.821 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.821 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:46.821 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:46.821 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:46.821 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:46.821 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:46.821 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:46.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f5308ff9640 1 -- 10.20.193.110:0/459869156 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4107918620 0 0) 0x7f530c1329a0 con 0x7f530c089a90 2026-02-13T20:23:46.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f5308ff9640 1 -- 10.20.193.110:0/459869156 >> v1:10.20.193.188:6789/0 conn(0x7f530c13f280 legacy=0x7f530c195230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:46.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f5308ff9640 1 -- 10.20.193.110:0/459869156 >> v1:10.20.193.110:6789/0 conn(0x7f530c13ee70 legacy=0x7f530c193b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:46.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f5308ff9640 10 monclient: _finish_hunting 0 2026-02-13T20:23:46.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f5308ff9640 1 monclient: found mon.c 2026-02-13T20:23:46.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f5308ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:23:46.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f5308ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:23:46.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f5308ff9640 1 -- 10.20.193.110:0/459869156 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f530c130c00 con 0x7f530c089a90 2026-02-13T20:23:46.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f5308ff9640 10 monclient: _finish_auth 0 2026-02-13T20:23:46.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f5308ff9640 10 monclient: _check_auth_tickets 2026-02-13T20:23:46.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f5308ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:23:46.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f531288c640 5 monclient: authenticate success, global_id 94505 2026-02-13T20:23:46.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f531288c640 10 monclient: _renew_subs 2026-02-13T20:23:46.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f531288c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:23:46.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f531288c640 1 -- 10.20.193.110:0/459869156 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f530c132720 con 0x7f530c089a90 2026-02-13T20:23:46.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f531288c640 10 monclient: _renew_subs 2026-02-13T20:23:46.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f531288c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:23:46.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f531288c640 1 -- 10.20.193.110:0/459869156 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f530c131760 con 0x7f530c089a90 2026-02-13T20:23:46.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f5308ff9640 1 -- 10.20.193.110:0/459869156 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f52f80034c0 con 0x7f530c089a90 2026-02-13T20:23:46.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f5308ff9640 10 monclient: handle_config config(0 keys) 2026-02-13T20:23:46.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f5308ff9640 1 -- 10.20.193.110:0/459869156 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f52f8003b30 con 0x7f530c089a90 2026-02-13T20:23:46.823 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f5308ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:46.823 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f5308ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:23:46.823 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f5308ff9640 10 monclient: dump: 2026-02-13T20:23:46.823 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:46.823 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:46.823 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.823 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.823 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:46.823 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:46.823 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:46.823 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:46.823 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:46.823 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:46.823 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f530a7fc640 4 set_mon_vals no callback set 2026-02-13T20:23:46.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f531288c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:23:46.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.806+0000 7f531288c640 1 -- 10.20.193.110:0/459869156 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f530c0008d0 con 0x7f530c058410 2026-02-13T20:23:46.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.807+0000 7f5308ff9640 1 -- 10.20.193.110:0/459869156 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3688485122 0 0) 0x7f530c0008d0 con 0x7f530c058410 2026-02-13T20:23:46.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.807+0000 7f5308ff9640 10 monclient(hunting): _negotiate 2026-02-13T20:23:46.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.807+0000 7f5308ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:46.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.807+0000 7f5308ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:46.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.807+0000 7f5308ff9640 10 monclient(hunting): my global_id is 94508 2026-02-13T20:23:46.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.807+0000 7f5308ff9640 1 -- 10.20.193.110:0/459869156 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f530c1329a0 con 0x7f530c058410 2026-02-13T20:23:46.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.807+0000 7f5308ff9640 1 -- 10.20.193.110:0/459869156 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f52f8003c90 con 0x7f530c089a90 2026-02-13T20:23:46.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.807+0000 7f5308ff9640 1 -- 10.20.193.110:0/459869156 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(586..586 src has 1..586) ==== 3871+0+0 (unknown 1033153499 0 0) 0x7f52f804e9b0 con 0x7f530c089a90 2026-02-13T20:23:46.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.807+0000 7f5308ff9640 1 -- 10.20.193.110:0/459869156 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 112544850 0 0) 0x7f530c1329a0 con 0x7f530c058410 2026-02-13T20:23:46.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.807+0000 7f5308ff9640 1 -- 10.20.193.110:0/459869156 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f530c0008d0 con 0x7f530c058410 2026-02-13T20:23:46.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.807+0000 7f5308ff9640 1 -- 10.20.193.110:0/459869156 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f52fc003530 con 0x7f530c058410 2026-02-13T20:23:46.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.807+0000 7f5308ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:46.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.807+0000 7f5308ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:23:46.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.807+0000 7f5308ff9640 10 monclient: dump: 2026-02-13T20:23:46.825 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:46.825 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:46.825 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.825 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.825 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:46.825 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:46.825 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:46.825 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:46.825 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:46.825 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:46.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.807+0000 7f5310e02640 10 monclient: get_auth_request con 0x7f52dc03fab0 auth_method 0 2026-02-13T20:23:46.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.807+0000 7f5308ff9640 1 -- 10.20.193.110:0/459869156 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 882174348 0 0) 0x7f530c0008d0 con 0x7f530c058410 2026-02-13T20:23:46.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.807+0000 7f5308ff9640 1 -- 10.20.193.110:0/459869156 --> v1:10.20.193.110:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f530c131a60 con 0x7f530c058410 2026-02-13T20:23:46.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.807+0000 7f5308ff9640 1 -- 10.20.193.110:0/459869156 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f52fc003a70 con 0x7f530c058410 2026-02-13T20:23:46.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.807+0000 7f5308ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:23:46.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.807+0000 7f5308ff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:23:46.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.807+0000 7f5308ff9640 1 -- 10.20.193.110:0/459869156 >> v1:10.20.193.110:6790/0 conn(0x7f530c058410 legacy=0x7f530c08f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:46.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.807+0000 7f5308ff9640 1 -- 10.20.193.110:0/459869156 >> v1:10.20.193.110:6790/0 conn(0x7f530c058410 legacy=0x7f530c08f5c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:23:46.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.811+0000 7f531288c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:23:46.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.811+0000 7f531288c640 1 -- 10.20.193.110:0/459869156 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f530c131bd0 con 0x7f530c14f6f0 2026-02-13T20:23:46.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.811+0000 7f5308ff9640 1 -- 10.20.193.110:0/459869156 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1243103193 0 0) 0x7f52dc0035e0 con 0x7f530c14f6f0 2026-02-13T20:23:46.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.811+0000 7f5308ff9640 10 monclient(hunting): _negotiate 2026-02-13T20:23:46.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.811+0000 7f5308ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:46.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.811+0000 7f5308ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:46.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.811+0000 7f5308ff9640 10 monclient(hunting): my global_id is 94511 2026-02-13T20:23:46.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.811+0000 7f5308ff9640 1 -- 10.20.193.110:0/459869156 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f530c0008d0 con 0x7f530c14f6f0 2026-02-13T20:23:46.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.811+0000 7f5308ff9640 1 -- 10.20.193.110:0/459869156 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3447965654 0 0) 0x7f530c0008d0 con 0x7f530c14f6f0 2026-02-13T20:23:46.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.811+0000 7f5308ff9640 1 -- 10.20.193.110:0/459869156 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f52dc0035e0 con 0x7f530c14f6f0 2026-02-13T20:23:46.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.811+0000 7f5308ff9640 1 -- 10.20.193.110:0/459869156 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f52fc004150 con 0x7f530c14f6f0 2026-02-13T20:23:46.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.811+0000 7f5308ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:46.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.811+0000 7f5308ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:23:46.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.811+0000 7f5308ff9640 10 monclient: dump: 2026-02-13T20:23:46.828 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:46.828 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:46.828 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.828 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.828 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:46.828 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:46.828 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:46.829 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:46.829 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:46.829 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:46.829 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.811+0000 7f5308ff9640 1 -- 10.20.193.110:0/459869156 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2490979703 0 0) 0x7f52dc0035e0 con 0x7f530c14f6f0 2026-02-13T20:23:46.829 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.811+0000 7f5308ff9640 1 -- 10.20.193.110:0/459869156 --> v1:10.20.193.110:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f530c130810 con 0x7f530c14f6f0 2026-02-13T20:23:46.829 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.812+0000 7f5308ff9640 1 -- 10.20.193.110:0/459869156 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4516 (unknown 0 0 2381560414) 0x7f52fc006410 con 0x7f530c14f6f0 2026-02-13T20:23:46.829 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.812+0000 7f5308ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:23:46.829 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.812+0000 7f5308ff9640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:23:46.829 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.812+0000 7f5308ff9640 1 -- 10.20.193.110:0/459869156 >> v1:10.20.193.110:6790/0 conn(0x7f530c14f6f0 legacy=0x7f530c04d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:46.829 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.812+0000 7f5308ff9640 1 -- 10.20.193.110:0/459869156 >> v1:10.20.193.110:6790/0 conn(0x7f530c14f6f0 legacy=0x7f530c04d1c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:23:46.829 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:23:46.830 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:23:46.830 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:23:46.830 INFO:teuthology.orchestra.run.trial110.stdout: "state": "leader", 2026-02-13T20:23:46.830 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 46, 2026-02-13T20:23:46.830 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 498435, 2026-02-13T20:23:46.830 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:23:46.830 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:23:46.830 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:23:46.830 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:23:46.830 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:23:46.830 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 0, 2026-02-13T20:23:46.830 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:23:46.830 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:23:46.831 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:23:46.831 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:23:46.831 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:23:46.831 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:23:46.831 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:23:46.831 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:23:46.831 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:23:46.831 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:23:46.831 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:23:46.831 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:23:46.831 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:23:46.831 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:23:46.831 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:23:46.831 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:23:46.831 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:23:46.832 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:23:46.832 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:23:46.832 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:23:46.832 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:23:46.832 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:23:46.832 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:23:46.832 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:23:46.832 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:23:46.832 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:23:46.832 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:23:46.832 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:23:46.832 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:23:46.832 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:23:46.832 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:23:46.832 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:23:46.832 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:23:46.833 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:46.833 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:23:46.833 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:23:46.833 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:23:46.833 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:23:46.833 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:23:46.833 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:23:46.833 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:23:46.833 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:23:46.833 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:23:46.833 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:23:46.833 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:23:46.833 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:23:46.833 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:23:46.833 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:23:46.833 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:23:46.834 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:23:46.834 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:23:46.834 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:23:46.834 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:23:46.834 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:23:46.834 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:23:46.834 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:23:46.834 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:23:46.834 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:23:46.834 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:23:46.834 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:23:46.834 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:23:46.834 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:23:46.834 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:23:46.834 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:23:46.835 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:23:46.835 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:23:46.835 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:46.835 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:23:46.835 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:46.835 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:23:46.835 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:23:46.835 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:23:46.835 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:23:46.835 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:46.835 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:23:46.835 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:23:46.835 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:23:46.835 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:23:46.835 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:23:46.835 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:46.835 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:23:46.836 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:23:46.836 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:23:46.836 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:23:46.836 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:23:46.836 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:23:46.836 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:46.836 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:46.836 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:23:46.836 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:23:46.836 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:23:46.836 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:23:46.836 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:46.836 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:23:46.836 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:23:46.836 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:23:46.836 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:23:46.836 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:23:46.836 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:46.836 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:23:46.837 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:23:46.837 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:23:46.837 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:23:46.837 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:23:46.837 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:23:46.837 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:46.837 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:46.837 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:23:46.837 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:23:46.837 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:23:46.837 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:23:46.837 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:46.837 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:23:46.837 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:23:46.837 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:23:46.837 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:23:46.837 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:23:46.837 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:46.838 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:23:46.838 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:23:46.838 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:23:46.838 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:23:46.838 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:23:46.838 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:23:46.838 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:23:46.838 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:23:46.838 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:46.838 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:23:46.838 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:23:46.838 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:46.838 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:23:46.838 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:23:46.838 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:23:46.838 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:23:46.838 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:23:46.838 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:23:46.839 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:46.839 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:23:46.839 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:23:46.839 INFO:teuthology.orchestra.run.trial110.stdout: "num": 5 2026-02-13T20:23:46.839 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:23:46.839 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:23:46.839 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:23:46.839 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:46.839 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:23:46.839 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:23:46.839 INFO:teuthology.orchestra.run.trial110.stdout: "num": 4 2026-02-13T20:23:46.839 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:23:46.839 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:23:46.839 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:46.839 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:23:46.839 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:23:46.840 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.812+0000 7f531288c640 1 -- 10.20.193.110:0/459869156 >> v1:10.20.193.188:6812/1623052694 conn(0x7f52dc03fab0 legacy=0x7f52dc05ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:46.841 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.812+0000 7f531288c640 10 monclient: shutdown 2026-02-13T20:23:46.841 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.812+0000 7f531288c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:23:46.841 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.812+0000 7f531288c640 1 -- 10.20.193.110:0/459869156 >> v1:10.20.193.110:6790/0 conn(0x7f530c089a90 legacy=0x7f530c13e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:46.841 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.812+0000 7f5310e02640 1 -- 10.20.193.110:0/459869156 reap_dead start 2026-02-13T20:23:46.841 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.812+0000 7f5310e02640 1 -- 10.20.193.110:0/459869156 reap_dead start 2026-02-13T20:23:46.841 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.812+0000 7f531288c640 1 -- 10.20.193.110:0/459869156 shutdown_connections 2026-02-13T20:23:46.841 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.812+0000 7f531288c640 1 -- 10.20.193.110:0/459869156 >> 10.20.193.110:0/459869156 conn(0x7f530c054e90 msgr2=0x7f530c08cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:23:46.841 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.812+0000 7f531288c640 1 -- 10.20.193.110:0/459869156 shutdown_connections 2026-02-13T20:23:46.841 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.812+0000 7f531288c640 1 -- 10.20.193.110:0/459869156 wait complete. 2026-02-13T20:23:46.841 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:23:46.841 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-13T20:23:46.842 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T20:23:46.916 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.907+0000 7f256ae5b640 10 monclient: get_monmap_and_config 2026-02-13T20:23:46.916 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.907+0000 7f256ae5b640 10 monclient: build_initial_monmap 2026-02-13T20:23:46.916 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.907+0000 7f256ae5b640 10 monclient: monmap: 2026-02-13T20:23:46.916 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:23:46.917 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:46.917 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:23:46.907799+0000 2026-02-13T20:23:46.917 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:23:46.907799+0000 2026-02-13T20:23:46.917 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:23:46.917 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:46.917 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:23:46.917 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:23:46.917 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:23:46.917 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:46.917 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.907+0000 7f256ae5b640 1 Processor -- start 2026-02-13T20:23:46.917 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.907+0000 7f256ae5b640 1 -- start start 2026-02-13T20:23:46.917 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.907+0000 7f256ae5b640 10 monclient: init 2026-02-13T20:23:46.917 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.908+0000 7f256ae5b640 10 monclient: _reopen_session rank -1 2026-02-13T20:23:46.917 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.908+0000 7f256ae5b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:23:46.917 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.908+0000 7f256ae5b640 10 monclient(hunting): picked mon.noname-b con 0x7f25641401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:23:46.917 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.908+0000 7f256ae5b640 10 monclient(hunting): picked mon.noname-a con 0x7f2564092020 addr v1:10.20.193.110:6789/0 2026-02-13T20:23:46.917 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.908+0000 7f256ae5b640 10 monclient(hunting): picked mon.noname-c con 0x7f2564091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:23:46.918 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.908+0000 7f256ae5b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f256408b730 con 0x7f2564092020 2026-02-13T20:23:46.918 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.908+0000 7f256ae5b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f256405c5b0 con 0x7f2564091950 2026-02-13T20:23:46.918 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.908+0000 7f256ae5b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f256408bcf0 con 0x7f25641401c0 2026-02-13T20:23:46.918 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.908+0000 7f256ae5b640 10 monclient(hunting): _renew_subs 2026-02-13T20:23:46.918 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.908+0000 7f256ae5b640 10 monclient(hunting): authenticate will time out at 1388.598175s 2026-02-13T20:23:46.918 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.908+0000 7f2568bd0640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f25641401c0 0x7f2564091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:44238/0 (socket says 10.20.193.110:44238) 2026-02-13T20:23:46.918 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.908+0000 7f2568bd0640 1 -- 10.20.193.110:0/1305611946 learned_addr learned my addr 10.20.193.110:0/1305611946 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:23:46.918 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.908+0000 7f255b7fe640 1 -- 10.20.193.110:0/1305611946 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2154483804 0 0) 0x7f256408b730 con 0x7f2564092020 2026-02-13T20:23:46.918 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.908+0000 7f255b7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:23:46.918 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.908+0000 7f255b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:46.918 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.908+0000 7f255b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:46.918 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.908+0000 7f255b7fe640 10 monclient(hunting): my global_id is 124221 2026-02-13T20:23:46.918 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.908+0000 7f255b7fe640 1 -- 10.20.193.110:0/1305611946 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f25500035e0 con 0x7f2564092020 2026-02-13T20:23:46.918 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.908+0000 7f255b7fe640 1 -- 10.20.193.110:0/1305611946 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 640435406 0 0) 0x7f256408bcf0 con 0x7f25641401c0 2026-02-13T20:23:46.918 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.908+0000 7f255b7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:23:46.918 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.908+0000 7f255b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:46.918 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.908+0000 7f255b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:46.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.908+0000 7f255b7fe640 10 monclient(hunting): my global_id is 94514 2026-02-13T20:23:46.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.908+0000 7f255b7fe640 1 -- 10.20.193.110:0/1305611946 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f256408b730 con 0x7f25641401c0 2026-02-13T20:23:46.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.908+0000 7f255b7fe640 1 -- 10.20.193.110:0/1305611946 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4187985479 0 0) 0x7f25500035e0 con 0x7f2564092020 2026-02-13T20:23:46.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.908+0000 7f255b7fe640 1 -- 10.20.193.110:0/1305611946 >> v1:10.20.193.110:6790/0 conn(0x7f25641401c0 legacy=0x7f2564091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:46.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.908+0000 7f255b7fe640 1 -- 10.20.193.110:0/1305611946 >> v1:10.20.193.188:6789/0 conn(0x7f2564091950 legacy=0x7f25641a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T20:23:46.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.908+0000 7f255b7fe640 10 monclient: _finish_hunting 0 2026-02-13T20:23:46.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.908+0000 7f255b7fe640 1 monclient: found mon.noname-a 2026-02-13T20:23:46.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.908+0000 7f255b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:23:46.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.908+0000 7f255b7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:23:46.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.908+0000 7f255b7fe640 1 -- 10.20.193.110:0/1305611946 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2564140590 con 0x7f2564092020 2026-02-13T20:23:46.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.908+0000 7f255b7fe640 10 monclient: _finish_auth 0 2026-02-13T20:23:46.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.908+0000 7f255b7fe640 10 monclient: _check_auth_tickets 2026-02-13T20:23:46.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.908+0000 7f255b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:23:46.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.908+0000 7f255b7fe640 1 -- 10.20.193.110:0/1305611946 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f254c002dd0 con 0x7f2564092020 2026-02-13T20:23:46.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.908+0000 7f255b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:46.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.908+0000 7f255b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:23:46.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.908+0000 7f255b7fe640 10 monclient: dump: 2026-02-13T20:23:46.919 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:46.920 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:46.920 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.920 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.920 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:46.920 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:46.920 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:46.920 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:46.920 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:46.920 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:46.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.908+0000 7f256ae5b640 5 monclient: authenticate success, global_id 124221 2026-02-13T20:23:46.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.908+0000 7f256ae5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:23:46.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.908+0000 7f255b7fe640 1 -- 10.20.193.110:0/1305611946 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f254c003020 con 0x7f2564092020 2026-02-13T20:23:46.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.908+0000 7f255b7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:23:46.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.908+0000 7f255b7fe640 1 -- 10.20.193.110:0/1305611946 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f254c003430 con 0x7f2564092020 2026-02-13T20:23:46.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.908+0000 7f255b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:46.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.908+0000 7f255b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:23:46.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.908+0000 7f255b7fe640 10 monclient: dump: 2026-02-13T20:23:46.920 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:46.921 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:46.921 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.921 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.921 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:46.921 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:46.921 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:46.921 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:46.921 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:46.921 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:46.921 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.908+0000 7f256ae5b640 10 monclient: get_monmap_and_config success 2026-02-13T20:23:46.921 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.908+0000 7f256ae5b640 4 set_mon_vals no callback set 2026-02-13T20:23:46.921 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.909+0000 7f256ae5b640 10 monclient: shutdown 2026-02-13T20:23:46.921 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.909+0000 7f256ae5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:23:46.921 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.909+0000 7f256ae5b640 1 -- 10.20.193.110:0/1305611946 >> v1:10.20.193.110:6789/0 conn(0x7f2564092020 legacy=0x7f25641812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:46.921 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.909+0000 7f256ae5b640 1 -- 10.20.193.110:0/1305611946 shutdown_connections 2026-02-13T20:23:46.921 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.909+0000 7f256ae5b640 1 -- 10.20.193.110:0/1305611946 >> 10.20.193.110:0/1305611946 conn(0x7f2564054e90 msgr2=0x7f2564058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:23:46.921 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.909+0000 7f256ae5b640 1 -- 10.20.193.110:0/1305611946 shutdown_connections 2026-02-13T20:23:46.921 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.909+0000 7f256ae5b640 1 -- 10.20.193.110:0/1305611946 wait complete. 2026-02-13T20:23:46.922 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.909+0000 7f256ae5b640 10 monclient: build_initial_monmap 2026-02-13T20:23:46.922 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.909+0000 7f256ae5b640 10 monclient: monmap: 2026-02-13T20:23:46.922 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:23:46.922 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:23:46.922 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:23:46.922 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:23:46.922 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:23:46.922 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:23:46.922 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:23:46.922 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:23:46.922 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:23:46.922 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:46.922 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.909+0000 7f256ae5b640 1 Processor -- start 2026-02-13T20:23:46.922 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.909+0000 7f256ae5b640 1 -- start start 2026-02-13T20:23:46.922 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.909+0000 7f256ae5b640 10 monclient: init 2026-02-13T20:23:46.922 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f256ae5b640 10 monclient: _reopen_session rank -1 2026-02-13T20:23:46.922 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f256ae5b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:23:46.922 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f256ae5b640 10 monclient(hunting): picked mon.noname-b con 0x7f2564091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:23:46.923 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f256ae5b640 10 monclient(hunting): picked mon.noname-a con 0x7f25641401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:23:46.923 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f256ae5b640 10 monclient(hunting): picked mon.noname-c con 0x7f25641527c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:23:46.923 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f256ae5b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f256408a2a0 con 0x7f25641401c0 2026-02-13T20:23:46.923 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f256ae5b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f256405d320 con 0x7f2564091950 2026-02-13T20:23:46.923 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f256ae5b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f256408c350 con 0x7f25641527c0 2026-02-13T20:23:46.923 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f256ae5b640 10 monclient(hunting): _renew_subs 2026-02-13T20:23:46.923 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f256ae5b640 10 monclient(hunting): authenticate will time out at 1388.600128s 2026-02-13T20:23:46.923 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f255bfff640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f25641401c0 0x7f2564193b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:49238/0 (socket says 10.20.193.110:49238) 2026-02-13T20:23:46.923 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f255bfff640 1 -- 10.20.193.110:0/1160800418 learned_addr learned my addr 10.20.193.110:0/1160800418 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:23:46.923 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f25597fa640 1 -- 10.20.193.110:0/1160800418 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4193204296 0 0) 0x7f256408a2a0 con 0x7f25641401c0 2026-02-13T20:23:46.923 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f25597fa640 10 monclient(hunting): _negotiate 2026-02-13T20:23:46.923 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f25597fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:46.923 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f25597fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:46.923 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f25597fa640 10 monclient(hunting): my global_id is 124224 2026-02-13T20:23:46.923 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f25597fa640 1 -- 10.20.193.110:0/1160800418 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f25340035e0 con 0x7f25641401c0 2026-02-13T20:23:46.923 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f25597fa640 1 -- 10.20.193.110:0/1160800418 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 470552670 0 0) 0x7f256408c350 con 0x7f25641527c0 2026-02-13T20:23:46.923 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f25597fa640 10 monclient(hunting): _negotiate 2026-02-13T20:23:46.923 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f25597fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:46.924 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f25597fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:46.924 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f25597fa640 10 monclient(hunting): my global_id is 94517 2026-02-13T20:23:46.924 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f25597fa640 1 -- 10.20.193.110:0/1160800418 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f256408a2a0 con 0x7f25641527c0 2026-02-13T20:23:46.924 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f25597fa640 1 -- 10.20.193.110:0/1160800418 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 132162440 0 0) 0x7f256405d320 con 0x7f2564091950 2026-02-13T20:23:46.924 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f25597fa640 10 monclient(hunting): _negotiate 2026-02-13T20:23:46.924 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f25597fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:46.924 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f25597fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:46.924 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f25597fa640 10 monclient(hunting): my global_id is 134128 2026-02-13T20:23:46.924 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f25597fa640 1 -- 10.20.193.110:0/1160800418 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f256408c350 con 0x7f2564091950 2026-02-13T20:23:46.924 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f25597fa640 1 -- 10.20.193.110:0/1160800418 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4177310987 0 0) 0x7f25340035e0 con 0x7f25641401c0 2026-02-13T20:23:46.924 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f25597fa640 1 -- 10.20.193.110:0/1160800418 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f256405d320 con 0x7f25641401c0 2026-02-13T20:23:46.924 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f25597fa640 1 -- 10.20.193.110:0/1160800418 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f254c003380 con 0x7f25641401c0 2026-02-13T20:23:46.924 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f25597fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:23:46.924 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f25597fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:23:46.924 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f25597fa640 10 monclient(hunting): dump: 2026-02-13T20:23:46.924 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:46.924 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:46.924 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.924 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.925 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:46.925 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:46.925 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:46.925 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:46.925 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:46.925 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:46.925 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f25597fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:23:46.925 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f25597fa640 1 -- 10.20.193.110:0/1160800418 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4212369645 0 0) 0x7f256408a2a0 con 0x7f25641527c0 2026-02-13T20:23:46.925 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f25597fa640 1 -- 10.20.193.110:0/1160800418 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f25340035e0 con 0x7f25641527c0 2026-02-13T20:23:46.925 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f25597fa640 1 -- 10.20.193.110:0/1160800418 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f2560003d80 con 0x7f25641527c0 2026-02-13T20:23:46.925 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f25597fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:23:46.925 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f25597fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:23:46.925 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f25597fa640 10 monclient(hunting): dump: 2026-02-13T20:23:46.925 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:46.925 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:46.925 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.926 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.926 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:46.926 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:46.926 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:46.926 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:46.926 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:46.926 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:46.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f25597fa640 1 -- 10.20.193.110:0/1160800418 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2099745680 0 0) 0x7f256405d320 con 0x7f25641401c0 2026-02-13T20:23:46.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f25597fa640 1 -- 10.20.193.110:0/1160800418 >> v1:10.20.193.110:6790/0 conn(0x7f25641527c0 legacy=0x7f2564195220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:46.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f25597fa640 1 -- 10.20.193.110:0/1160800418 >> v1:10.20.193.188:6789/0 conn(0x7f2564091950 legacy=0x7f256413ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:46.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f25597fa640 10 monclient: _finish_hunting 0 2026-02-13T20:23:46.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f25597fa640 1 monclient: found mon.a 2026-02-13T20:23:46.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f25597fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:23:46.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f25597fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:23:46.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f25597fa640 1 -- 10.20.193.110:0/1160800418 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f256408a880 con 0x7f25641401c0 2026-02-13T20:23:46.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f25597fa640 10 monclient: _finish_auth 0 2026-02-13T20:23:46.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f25597fa640 10 monclient: _check_auth_tickets 2026-02-13T20:23:46.926 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f25597fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:23:46.927 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f256ae5b640 5 monclient: authenticate success, global_id 124224 2026-02-13T20:23:46.927 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f256ae5b640 10 monclient: _renew_subs 2026-02-13T20:23:46.927 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f256ae5b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:23:46.927 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f256ae5b640 1 -- 10.20.193.110:0/1160800418 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2564131be0 con 0x7f25641401c0 2026-02-13T20:23:46.927 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f256ae5b640 10 monclient: _renew_subs 2026-02-13T20:23:46.927 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f256ae5b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:23:46.927 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f256ae5b640 1 -- 10.20.193.110:0/1160800418 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2564130960 con 0x7f25641401c0 2026-02-13T20:23:46.927 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f25597fa640 1 -- 10.20.193.110:0/1160800418 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f254c0029b0 con 0x7f25641401c0 2026-02-13T20:23:46.927 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f25597fa640 10 monclient: handle_config config(0 keys) 2026-02-13T20:23:46.927 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f25597fa640 1 -- 10.20.193.110:0/1160800418 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f254c003b10 con 0x7f25641401c0 2026-02-13T20:23:46.927 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f25597fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:46.927 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f25597fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:23:46.927 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f25597fa640 10 monclient: dump: 2026-02-13T20:23:46.927 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:46.927 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:46.927 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.927 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.927 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:46.927 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:46.928 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:46.928 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:46.928 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:46.928 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:46.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.910+0000 7f255affd640 4 set_mon_vals no callback set 2026-02-13T20:23:46.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.911+0000 7f256ae5b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:23:46.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.911+0000 7f256ae5b640 1 -- 10.20.193.110:0/1160800418 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f25640008d0 con 0x7f2564092020 2026-02-13T20:23:46.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.911+0000 7f25597fa640 1 -- 10.20.193.110:0/1160800418 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f254c003c70 con 0x7f25641401c0 2026-02-13T20:23:46.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.911+0000 7f25597fa640 1 -- 10.20.193.110:0/1160800418 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(586..586 src has 1..586) ==== 3871+0+0 (unknown 1033153499 0 0) 0x7f254c04ea60 con 0x7f25641401c0 2026-02-13T20:23:46.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.911+0000 7f25597fa640 1 -- 10.20.193.110:0/1160800418 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3756107248 0 0) 0x7f25640008d0 con 0x7f2564092020 2026-02-13T20:23:46.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.911+0000 7f25597fa640 10 monclient(hunting): _negotiate 2026-02-13T20:23:46.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.911+0000 7f25597fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:46.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.911+0000 7f25597fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:46.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.911+0000 7f25597fa640 10 monclient(hunting): my global_id is 134131 2026-02-13T20:23:46.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.911+0000 7f25597fa640 1 -- 10.20.193.110:0/1160800418 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f256405d320 con 0x7f2564092020 2026-02-13T20:23:46.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.911+0000 7f25693d1640 10 monclient: get_auth_request con 0x7f253403fc40 auth_method 0 2026-02-13T20:23:46.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.911+0000 7f25597fa640 1 -- 10.20.193.110:0/1160800418 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2192567839 0 0) 0x7f256405d320 con 0x7f2564092020 2026-02-13T20:23:46.928 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.911+0000 7f25597fa640 1 -- 10.20.193.110:0/1160800418 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f25640008d0 con 0x7f2564092020 2026-02-13T20:23:46.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.911+0000 7f25597fa640 1 -- 10.20.193.110:0/1160800418 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f2554003060 con 0x7f2564092020 2026-02-13T20:23:46.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.911+0000 7f25597fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:46.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.911+0000 7f25597fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:23:46.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.911+0000 7f25597fa640 10 monclient: dump: 2026-02-13T20:23:46.929 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:46.929 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:46.929 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.929 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.929 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:46.929 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:46.929 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:46.929 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:46.929 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:46.929 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:46.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.911+0000 7f25597fa640 1 -- 10.20.193.110:0/1160800418 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3240387629 0 0) 0x7f25640008d0 con 0x7f2564092020 2026-02-13T20:23:46.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.911+0000 7f25597fa640 1 -- 10.20.193.110:0/1160800418 --> v1:10.20.193.188:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f256408b450 con 0x7f2564092020 2026-02-13T20:23:46.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.912+0000 7f25597fa640 1 -- 10.20.193.110:0/1160800418 <== mon.1 v1:10.20.193.188:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f25540034e0 con 0x7f2564092020 2026-02-13T20:23:46.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.912+0000 7f25597fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:23:46.929 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.912+0000 7f25597fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:23:46.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.912+0000 7f25597fa640 1 -- 10.20.193.110:0/1160800418 >> v1:10.20.193.188:6789/0 conn(0x7f2564092020 legacy=0x7f2564127b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:46.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.912+0000 7f25597fa640 1 -- 10.20.193.110:0/1160800418 >> v1:10.20.193.188:6789/0 conn(0x7f2564092020 legacy=0x7f2564127b20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:23:46.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.915+0000 7f256ae5b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:23:46.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.915+0000 7f256ae5b640 1 -- 10.20.193.110:0/1160800418 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2564058410 con 0x7f2564128230 2026-02-13T20:23:46.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.915+0000 7f25597fa640 1 -- 10.20.193.110:0/1160800418 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 861661712 0 0) 0x7f2564058410 con 0x7f2564128230 2026-02-13T20:23:46.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.915+0000 7f25597fa640 10 monclient(hunting): _negotiate 2026-02-13T20:23:46.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.915+0000 7f25597fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:46.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.915+0000 7f25597fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:46.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.915+0000 7f25597fa640 10 monclient(hunting): my global_id is 134134 2026-02-13T20:23:46.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.915+0000 7f25597fa640 1 -- 10.20.193.110:0/1160800418 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f25640008d0 con 0x7f2564128230 2026-02-13T20:23:46.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.916+0000 7f25597fa640 1 -- 10.20.193.110:0/1160800418 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4118936967 0 0) 0x7f25640008d0 con 0x7f2564128230 2026-02-13T20:23:46.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.916+0000 7f25597fa640 1 -- 10.20.193.110:0/1160800418 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2564058410 con 0x7f2564128230 2026-02-13T20:23:46.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.916+0000 7f25597fa640 1 -- 10.20.193.110:0/1160800418 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f2554004dd0 con 0x7f2564128230 2026-02-13T20:23:46.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.916+0000 7f25597fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:46.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.916+0000 7f25597fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:23:46.930 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.916+0000 7f25597fa640 10 monclient: dump: 2026-02-13T20:23:46.930 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:46.930 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:46.930 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.931 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:46.931 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:46.931 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:46.931 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:46.931 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:46.931 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:46.931 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:46.931 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.916+0000 7f25597fa640 1 -- 10.20.193.110:0/1160800418 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2959565571 0 0) 0x7f2564058410 con 0x7f2564128230 2026-02-13T20:23:46.931 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.916+0000 7f25597fa640 1 -- 10.20.193.110:0/1160800418 --> v1:10.20.193.188:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f256413f150 con 0x7f2564128230 2026-02-13T20:23:46.932 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.916+0000 7f25597fa640 1 -- 10.20.193.110:0/1160800418 <== mon.1 v1:10.20.193.188:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4513 (unknown 0 0 1717870102) 0x7f2554007010 con 0x7f2564128230 2026-02-13T20:23:46.932 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.916+0000 7f25597fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:23:46.932 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.916+0000 7f25597fa640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:23:46.932 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.916+0000 7f25597fa640 1 -- 10.20.193.110:0/1160800418 >> v1:10.20.193.188:6789/0 conn(0x7f2564128230 legacy=0x7f2564197950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:46.932 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.916+0000 7f25597fa640 1 -- 10.20.193.110:0/1160800418 >> v1:10.20.193.188:6789/0 conn(0x7f2564128230 legacy=0x7f2564197950 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:23:46.932 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:23:46.932 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:23:46.932 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:23:46.932 INFO:teuthology.orchestra.run.trial110.stdout: "state": "peon", 2026-02-13T20:23:46.932 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 46, 2026-02-13T20:23:46.932 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 29629, 2026-02-13T20:23:46.932 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:23:46.933 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:23:46.933 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:23:46.933 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:23:46.933 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:23:46.933 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 0, 2026-02-13T20:23:46.933 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:23:46.933 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:23:46.933 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:23:46.933 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:23:46.933 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:23:46.933 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:23:46.933 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:23:46.933 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:23:46.933 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:23:46.933 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:23:46.933 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:23:46.933 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:23:46.934 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:23:46.934 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:23:46.934 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:23:46.934 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:23:46.934 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:23:46.934 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:23:46.934 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:23:46.934 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:23:46.934 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:23:46.934 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:23:46.934 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:23:46.934 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:23:46.934 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:23:46.934 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:23:46.934 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:23:46.934 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:23:46.934 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:23:46.934 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:23:46.935 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:23:46.935 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:23:46.935 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:23:46.935 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:46.935 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:23:46.935 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:23:46.935 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:23:46.935 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:23:46.935 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:23:46.935 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:23:46.935 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:23:46.935 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:23:46.935 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:23:46.935 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:23:46.935 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:23:46.936 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:23:46.936 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:23:46.936 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:23:46.936 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:23:46.936 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:23:46.936 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:23:46.936 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:23:46.936 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:23:46.936 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:23:46.936 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:23:46.936 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:23:46.936 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:23:46.936 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:23:46.936 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:23:46.936 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:23:46.936 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:23:46.936 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:23:46.936 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:23:46.937 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:23:46.937 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:23:46.937 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:23:46.937 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:46.937 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:23:46.937 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:46.937 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:23:46.937 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:23:46.937 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:23:46.937 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:23:46.937 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:46.937 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:23:46.937 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:23:46.937 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:23:46.937 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:23:46.937 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:23:46.937 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:46.937 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:23:46.938 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:23:46.938 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:23:46.938 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:23:46.938 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:23:46.938 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:23:46.938 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:46.938 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:46.938 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:23:46.938 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:23:46.938 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:23:46.938 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:23:46.938 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:46.938 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:23:46.938 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:23:46.938 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:23:46.938 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:23:46.938 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:23:46.938 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:46.939 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:23:46.939 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:23:46.939 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:23:46.939 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:23:46.939 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:23:46.939 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:23:46.939 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:46.939 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:46.939 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:23:46.939 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:23:46.939 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:23:46.939 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:23:46.939 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:46.939 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:23:46.939 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:23:46.939 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:23:46.939 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:23:46.939 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:23:46.940 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:46.940 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:23:46.940 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:23:46.940 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:23:46.940 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:23:46.940 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:23:46.940 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:23:46.940 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:23:46.940 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:23:46.940 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:46.940 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:23:46.940 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:23:46.940 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:46.940 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:23:46.940 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:23:46.940 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:23:46.940 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:23:46.940 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:23:46.940 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:23:46.941 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:46.941 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:23:46.941 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:23:46.941 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:23:46.941 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:23:46.941 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:23:46.941 INFO:teuthology.orchestra.run.trial110.stdout: "mgr": [ 2026-02-13T20:23:46.941 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:46.941 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:23:46.941 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:23:46.941 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:23:46.941 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:23:46.941 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:23:46.941 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:46.941 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:23:46.941 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:23:46.942 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.916+0000 7f256ae5b640 1 -- 10.20.193.110:0/1160800418 >> v1:10.20.193.188:6812/1623052694 conn(0x7f253403fc40 legacy=0x7f25340600f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:46.942 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.916+0000 7f256ae5b640 10 monclient: shutdown 2026-02-13T20:23:46.942 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.916+0000 7f256ae5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:23:46.943 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.916+0000 7f256ae5b640 1 -- 10.20.193.110:0/1160800418 >> v1:10.20.193.110:6789/0 conn(0x7f25641401c0 legacy=0x7f2564193b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:46.943 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.916+0000 7f25693d1640 1 -- 10.20.193.110:0/1160800418 reap_dead start 2026-02-13T20:23:46.943 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.916+0000 7f25693d1640 1 -- 10.20.193.110:0/1160800418 reap_dead start 2026-02-13T20:23:46.943 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.916+0000 7f256ae5b640 1 -- 10.20.193.110:0/1160800418 shutdown_connections 2026-02-13T20:23:46.943 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.916+0000 7f256ae5b640 1 -- 10.20.193.110:0/1160800418 >> 10.20.193.110:0/1160800418 conn(0x7f2564054e90 msgr2=0x7f256408dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:23:46.943 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.916+0000 7f256ae5b640 1 -- 10.20.193.110:0/1160800418 shutdown_connections 2026-02-13T20:23:46.943 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:46.916+0000 7f256ae5b640 1 -- 10.20.193.110:0/1160800418 wait complete. 2026-02-13T20:23:46.943 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:23:46.943 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-13T20:23:46.943 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-13T20:23:47.012 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.007+0000 7ff9b161b640 10 monclient: get_monmap_and_config 2026-02-13T20:23:47.013 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.007+0000 7ff9b161b640 10 monclient: build_initial_monmap 2026-02-13T20:23:47.013 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.007+0000 7ff9b161b640 10 monclient: monmap: 2026-02-13T20:23:47.013 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:23:47.013 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:47.013 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:23:47.007713+0000 2026-02-13T20:23:47.013 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:23:47.007713+0000 2026-02-13T20:23:47.013 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:23:47.013 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:47.013 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:23:47.013 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:23:47.013 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:23:47.013 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:47.013 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.007+0000 7ff9b161b640 1 Processor -- start 2026-02-13T20:23:47.013 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.007+0000 7ff9b161b640 1 -- start start 2026-02-13T20:23:47.013 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.007+0000 7ff9b161b640 10 monclient: init 2026-02-13T20:23:47.013 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.008+0000 7ff9b161b640 10 monclient: _reopen_session rank -1 2026-02-13T20:23:47.013 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.008+0000 7ff9b161b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:23:47.014 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.008+0000 7ff9b161b640 10 monclient(hunting): picked mon.noname-a con 0x7ff9ac1401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:23:47.014 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.008+0000 7ff9b161b640 10 monclient(hunting): picked mon.noname-b con 0x7ff9ac092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:23:47.014 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.008+0000 7ff9b161b640 10 monclient(hunting): picked mon.noname-c con 0x7ff9ac091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:23:47.014 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.008+0000 7ff9b161b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9ac08b730 con 0x7ff9ac1401c0 2026-02-13T20:23:47.014 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.008+0000 7ff9b161b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9ac05c5b0 con 0x7ff9ac091950 2026-02-13T20:23:47.014 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.008+0000 7ff9b161b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9ac08bcf0 con 0x7ff9ac092020 2026-02-13T20:23:47.014 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.008+0000 7ff9b161b640 10 monclient(hunting): _renew_subs 2026-02-13T20:23:47.014 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.008+0000 7ff9b161b640 10 monclient(hunting): authenticate will time out at 1388.698119s 2026-02-13T20:23:47.014 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.008+0000 7ff9aa7fc640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7ff9ac092020 0x7ff9ac1812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:44260/0 (socket says 10.20.193.110:44260) 2026-02-13T20:23:47.014 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.008+0000 7ff9aa7fc640 1 -- 10.20.193.110:0/3621804557 learned_addr learned my addr 10.20.193.110:0/3621804557 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:23:47.014 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.008+0000 7ff9aaffd640 1 --1- 10.20.193.110:0/3621804557 >> v1:10.20.193.110:6789/0 conn(0x7ff9ac1401c0 0x7ff9ac091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:49252/0 (socket says 10.20.193.110:49252) 2026-02-13T20:23:47.014 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.008+0000 7ff9a9ffb640 1 -- 10.20.193.110:0/3621804557 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3865288372 0 0) 0x7ff9ac08bcf0 con 0x7ff9ac092020 2026-02-13T20:23:47.014 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.008+0000 7ff9a9ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:23:47.014 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.008+0000 7ff9a9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:47.014 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.008+0000 7ff9a9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:47.014 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.008+0000 7ff9a9ffb640 10 monclient(hunting): my global_id is 94520 2026-02-13T20:23:47.014 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.008+0000 7ff9a9ffb640 1 -- 10.20.193.110:0/3621804557 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9980035e0 con 0x7ff9ac092020 2026-02-13T20:23:47.014 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.008+0000 7ff9a9ffb640 1 -- 10.20.193.110:0/3621804557 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3094846861 0 0) 0x7ff9ac08b730 con 0x7ff9ac1401c0 2026-02-13T20:23:47.015 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.008+0000 7ff9a9ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:23:47.015 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.008+0000 7ff9a9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:47.015 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.008+0000 7ff9a9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:47.015 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.008+0000 7ff9a9ffb640 10 monclient(hunting): my global_id is 124227 2026-02-13T20:23:47.015 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.008+0000 7ff9a9ffb640 1 -- 10.20.193.110:0/3621804557 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9ac08bcf0 con 0x7ff9ac1401c0 2026-02-13T20:23:47.015 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.008+0000 7ff9a9ffb640 1 -- 10.20.193.110:0/3621804557 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 389014955 0 0) 0x7ff9980035e0 con 0x7ff9ac092020 2026-02-13T20:23:47.015 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.008+0000 7ff9a9ffb640 1 -- 10.20.193.110:0/3621804557 >> v1:10.20.193.188:6789/0 conn(0x7ff9ac091950 legacy=0x7ff9ac1a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:47.015 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.008+0000 7ff9a9ffb640 1 -- 10.20.193.110:0/3621804557 >> v1:10.20.193.110:6789/0 conn(0x7ff9ac1401c0 legacy=0x7ff9ac091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:47.015 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.008+0000 7ff9a9ffb640 10 monclient: _finish_hunting 0 2026-02-13T20:23:47.015 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.008+0000 7ff9a9ffb640 1 monclient: found mon.noname-b 2026-02-13T20:23:47.015 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.008+0000 7ff9a9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:23:47.015 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.008+0000 7ff9a9ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:23:47.015 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.008+0000 7ff9a9ffb640 1 -- 10.20.193.110:0/3621804557 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9ac140590 con 0x7ff9ac092020 2026-02-13T20:23:47.015 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.008+0000 7ff9a9ffb640 10 monclient: _finish_auth 0 2026-02-13T20:23:47.015 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.008+0000 7ff9a9ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:23:47.015 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.008+0000 7ff9a9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:23:47.015 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.008+0000 7ff9a9ffb640 1 -- 10.20.193.110:0/3621804557 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff994002dd0 con 0x7ff9ac092020 2026-02-13T20:23:47.015 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.008+0000 7ff9a9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:47.015 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.008+0000 7ff9a9ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:23:47.016 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.008+0000 7ff9a9ffb640 10 monclient: dump: 2026-02-13T20:23:47.016 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:47.016 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:47.016 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:47.016 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:47.016 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:47.016 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:47.016 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:47.016 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:47.016 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:47.016 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:47.016 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.008+0000 7ff9b161b640 5 monclient: authenticate success, global_id 94520 2026-02-13T20:23:47.016 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.008+0000 7ff9b161b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:23:47.016 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.008+0000 7ff9a9ffb640 1 -- 10.20.193.110:0/3621804557 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff994002fe0 con 0x7ff9ac092020 2026-02-13T20:23:47.016 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.008+0000 7ff9a9ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T20:23:47.016 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.008+0000 7ff9a9ffb640 1 -- 10.20.193.110:0/3621804557 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff9940033f0 con 0x7ff9ac092020 2026-02-13T20:23:47.016 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.008+0000 7ff9a9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:47.016 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.008+0000 7ff9a9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:23:47.016 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.008+0000 7ff9a9ffb640 10 monclient: dump: 2026-02-13T20:23:47.017 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:47.017 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:47.017 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:47.017 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:47.017 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:47.017 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:47.017 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:47.017 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:47.017 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:47.017 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:47.017 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.008+0000 7ff9b161b640 10 monclient: get_monmap_and_config success 2026-02-13T20:23:47.017 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.008+0000 7ff9b161b640 4 set_mon_vals no callback set 2026-02-13T20:23:47.017 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.009+0000 7ff9b161b640 10 monclient: shutdown 2026-02-13T20:23:47.017 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.009+0000 7ff9b161b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:23:47.017 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.009+0000 7ff9b161b640 1 -- 10.20.193.110:0/3621804557 >> v1:10.20.193.110:6790/0 conn(0x7ff9ac092020 legacy=0x7ff9ac1812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:47.017 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.009+0000 7ff9b161b640 1 -- 10.20.193.110:0/3621804557 shutdown_connections 2026-02-13T20:23:47.017 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.009+0000 7ff9b161b640 1 -- 10.20.193.110:0/3621804557 >> 10.20.193.110:0/3621804557 conn(0x7ff9ac054e90 msgr2=0x7ff9ac058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:23:47.017 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.009+0000 7ff9b161b640 1 -- 10.20.193.110:0/3621804557 shutdown_connections 2026-02-13T20:23:47.017 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.009+0000 7ff9b161b640 1 -- 10.20.193.110:0/3621804557 wait complete. 2026-02-13T20:23:47.017 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.009+0000 7ff9b161b640 10 monclient: build_initial_monmap 2026-02-13T20:23:47.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.009+0000 7ff9b161b640 10 monclient: monmap: 2026-02-13T20:23:47.018 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:23:47.018 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:23:47.018 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:23:47.018 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:23:47.018 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:23:47.018 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:23:47.018 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:23:47.018 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:23:47.018 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:23:47.018 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:47.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.009+0000 7ff9b161b640 1 Processor -- start 2026-02-13T20:23:47.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.009+0000 7ff9b161b640 1 -- start start 2026-02-13T20:23:47.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.009+0000 7ff9b161b640 10 monclient: init 2026-02-13T20:23:47.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff9b161b640 10 monclient: _reopen_session rank -1 2026-02-13T20:23:47.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff9b161b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:23:47.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff9b161b640 10 monclient(hunting): picked mon.noname-c con 0x7ff9ac091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:23:47.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff9b161b640 10 monclient(hunting): picked mon.noname-b con 0x7ff9ac1401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:23:47.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff9b161b640 10 monclient(hunting): picked mon.noname-a con 0x7ff9ac1a2760 addr v1:10.20.193.110:6789/0 2026-02-13T20:23:47.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff9b161b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9ac117370 con 0x7ff9ac1a2760 2026-02-13T20:23:47.019 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff9b161b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9ac12e000 con 0x7ff9ac1401c0 2026-02-13T20:23:47.019 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff9b161b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9ac091010 con 0x7ff9ac091950 2026-02-13T20:23:47.019 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff9b161b640 10 monclient(hunting): _renew_subs 2026-02-13T20:23:47.019 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff9b161b640 10 monclient(hunting): authenticate will time out at 1388.700097s 2026-02-13T20:23:47.019 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff9aaffd640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7ff9ac091950 0x7ff9ac116c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:44270/0 (socket says 10.20.193.110:44270) 2026-02-13T20:23:47.019 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff9aaffd640 1 -- 10.20.193.110:0/37704388 learned_addr learned my addr 10.20.193.110:0/37704388 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:23:47.019 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff98b7fe640 1 -- 10.20.193.110:0/37704388 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3903472838 0 0) 0x7ff9ac091010 con 0x7ff9ac091950 2026-02-13T20:23:47.019 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff98b7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:23:47.019 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff98b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:47.019 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff98b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:47.019 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff98b7fe640 10 monclient(hunting): my global_id is 94523 2026-02-13T20:23:47.019 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff98b7fe640 1 -- 10.20.193.110:0/37704388 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9780035e0 con 0x7ff9ac091950 2026-02-13T20:23:47.019 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff98b7fe640 1 -- 10.20.193.110:0/37704388 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1711464028 0 0) 0x7ff9ac117370 con 0x7ff9ac1a2760 2026-02-13T20:23:47.019 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff98b7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:23:47.019 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff98b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:47.019 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff98b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:47.019 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff98b7fe640 10 monclient(hunting): my global_id is 124230 2026-02-13T20:23:47.020 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff98b7fe640 1 -- 10.20.193.110:0/37704388 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9ac091010 con 0x7ff9ac1a2760 2026-02-13T20:23:47.020 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff98b7fe640 1 -- 10.20.193.110:0/37704388 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 136424839 0 0) 0x7ff9ac091010 con 0x7ff9ac1a2760 2026-02-13T20:23:47.020 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff98b7fe640 1 -- 10.20.193.110:0/37704388 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff9ac117370 con 0x7ff9ac1a2760 2026-02-13T20:23:47.020 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff98b7fe640 1 -- 10.20.193.110:0/37704388 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff99c004150 con 0x7ff9ac1a2760 2026-02-13T20:23:47.020 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff98b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:23:47.020 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff98b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:23:47.020 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff98b7fe640 10 monclient(hunting): dump: 2026-02-13T20:23:47.020 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:47.020 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:47.020 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:47.020 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:47.020 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:47.020 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:47.020 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:47.020 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:47.020 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:47.020 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:47.020 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff98b7fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:23:47.020 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff98b7fe640 1 -- 10.20.193.110:0/37704388 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 330454738 0 0) 0x7ff9780035e0 con 0x7ff9ac091950 2026-02-13T20:23:47.020 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff98b7fe640 1 -- 10.20.193.110:0/37704388 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff9ac091010 con 0x7ff9ac091950 2026-02-13T20:23:47.021 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff98b7fe640 1 -- 10.20.193.110:0/37704388 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff9a0003010 con 0x7ff9ac091950 2026-02-13T20:23:47.021 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff98b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:23:47.021 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff98b7fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:23:47.021 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff98b7fe640 10 monclient(hunting): dump: 2026-02-13T20:23:47.021 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:47.021 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:47.021 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:47.021 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:47.021 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:47.021 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:47.021 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:47.021 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:47.021 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:47.021 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:47.021 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff98b7fe640 1 -- 10.20.193.110:0/37704388 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1798979424 0 0) 0x7ff9ac117370 con 0x7ff9ac1a2760 2026-02-13T20:23:47.021 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff98b7fe640 1 -- 10.20.193.110:0/37704388 >> v1:10.20.193.110:6790/0 conn(0x7ff9ac091950 legacy=0x7ff9ac116c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:47.021 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff98b7fe640 1 -- 10.20.193.110:0/37704388 >> v1:10.20.193.188:6789/0 conn(0x7ff9ac1401c0 legacy=0x7ff9ac1a1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:47.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff98b7fe640 10 monclient: _finish_hunting 0 2026-02-13T20:23:47.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff98b7fe640 1 monclient: found mon.a 2026-02-13T20:23:47.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff98b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:23:47.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff98b7fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:23:47.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff98b7fe640 1 -- 10.20.193.110:0/37704388 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9ac08c430 con 0x7ff9ac1a2760 2026-02-13T20:23:47.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff98b7fe640 10 monclient: _finish_auth 0 2026-02-13T20:23:47.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff98b7fe640 10 monclient: _check_auth_tickets 2026-02-13T20:23:47.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff98b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:23:47.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff9b161b640 5 monclient: authenticate success, global_id 124230 2026-02-13T20:23:47.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff9b161b640 10 monclient: _renew_subs 2026-02-13T20:23:47.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff9b161b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:23:47.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff9b161b640 1 -- 10.20.193.110:0/37704388 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff9ac05d320 con 0x7ff9ac1a2760 2026-02-13T20:23:47.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff9b161b640 10 monclient: _renew_subs 2026-02-13T20:23:47.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff9b161b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:23:47.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff9b161b640 1 -- 10.20.193.110:0/37704388 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff9ac12f350 con 0x7ff9ac1a2760 2026-02-13T20:23:47.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff98b7fe640 1 -- 10.20.193.110:0/37704388 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff99c0047b0 con 0x7ff9ac1a2760 2026-02-13T20:23:47.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff98b7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:23:47.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff98b7fe640 1 -- 10.20.193.110:0/37704388 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff99c004ad0 con 0x7ff9ac1a2760 2026-02-13T20:23:47.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff98b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:47.023 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff98b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:23:47.023 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff98b7fe640 10 monclient: dump: 2026-02-13T20:23:47.023 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:47.023 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:47.023 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:47.023 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:47.023 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:47.023 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:47.023 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:47.023 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:47.023 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:47.023 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:47.023 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.010+0000 7ff9a97fa640 4 set_mon_vals no callback set 2026-02-13T20:23:47.023 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.011+0000 7ff9b161b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:23:47.023 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.011+0000 7ff9b161b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:23:47.023 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.011+0000 7ff9b161b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:23:47.023 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.011+0000 7ff9b161b640 1 -- 10.20.193.110:0/37704388 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9ac12eb90 con 0x7ff9ac1a2760 2026-02-13T20:23:47.023 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.011+0000 7ff98b7fe640 1 -- 10.20.193.110:0/37704388 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7ff99c011740 con 0x7ff9ac1a2760 2026-02-13T20:23:47.023 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.011+0000 7ff98b7fe640 1 -- 10.20.193.110:0/37704388 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(586..586 src has 1..586) ==== 3871+0+0 (unknown 1033153499 0 0) 0x7ff99c04e640 con 0x7ff9ac1a2760 2026-02-13T20:23:47.023 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.011+0000 7ff9aaffd640 10 monclient: get_auth_request con 0x7ff97803fae0 auth_method 0 2026-02-13T20:23:47.024 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.013+0000 7ff98b7fe640 1 -- 10.20.193.110:0/37704388 <== mon.0 v1:10.20.193.110:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7ff99c016ed0 con 0x7ff9ac1a2760 2026-02-13T20:23:47.024 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.013+0000 7ff98b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:23:47.024 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.013+0000 7ff98b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:23:47.159 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.158+0000 7ff9b161b640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-13T20:23:47.159 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.158+0000 7ff9b161b640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-13T20:23:47.159 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.158+0000 7ff9b161b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:23:47.159 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.158+0000 7ff9b161b640 1 -- 10.20.193.110:0/37704388 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7ff9ac055bb0 con 0x7ff9ac1a2760 2026-02-13T20:23:47.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.159+0000 7ff98b7fe640 1 -- 10.20.193.110:0/37704388 <== mon.0 v1:10.20.193.110:6789/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7ff99c016680 con 0x7ff9ac1a2760 2026-02-13T20:23:47.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.159+0000 7ff98b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-13T20:23:47.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.159+0000 7ff98b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:23:47.161 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.159+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.161 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.159+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=21,config=2,health=11,kv=11,logm=55} crc {auth=4292512862,config=1618278320,health=1237974618,kv=1564860261,logm=2561382628}) 2026-02-13T20:23:47.162 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.159+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=22,config=2,health=12,kv=9,logm=55} crc {auth=1431568147,config=1618278320,health=2677522725,kv=1043073389,logm=1261517418}) 2026-02-13T20:23:47.162 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.159+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.162 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.159+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=21,config=2,health=11,kv=11,logm=55} crc {auth=4292512862,config=1618278320,health=1237974618,kv=1564860261,logm=2561382628}) 2026-02-13T20:23:47.162 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.159+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=21,config=2,health=13,kv=10,logm=54} crc {auth=3767999845,config=1618278320,health=2766741626,kv=3424536448,logm=4244156347}) 2026-02-13T20:23:47.162 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.160+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.162 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.160+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3641728028}) 2026-02-13T20:23:47.162 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.160+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=260428823}) 2026-02-13T20:23:47.162 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.160+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.162 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.160+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3641728028}) 2026-02-13T20:23:47.162 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.160+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3553348512}) 2026-02-13T20:23:47.163 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.160+0000 7ff9b161b640 1 -- 10.20.193.110:0/37704388 >> v1:10.20.193.188:6812/1623052694 conn(0x7ff97803fae0 legacy=0x7ff97805ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:47.163 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.160+0000 7ff9b161b640 10 monclient: shutdown 2026-02-13T20:23:47.164 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.160+0000 7ff9b161b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:23:47.164 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.160+0000 7ff9b161b640 1 -- 10.20.193.110:0/37704388 >> v1:10.20.193.110:6789/0 conn(0x7ff9ac1a2760 legacy=0x7ff9ac1a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:47.164 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.160+0000 7ff9b161b640 1 -- 10.20.193.110:0/37704388 shutdown_connections 2026-02-13T20:23:47.164 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.160+0000 7ff9b161b640 1 -- 10.20.193.110:0/37704388 >> 10.20.193.110:0/37704388 conn(0x7ff9ac054e90 msgr2=0x7ff9ac08dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:23:47.164 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.160+0000 7ff9b161b640 1 -- 10.20.193.110:0/37704388 shutdown_connections 2026-02-13T20:23:47.164 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:47.160+0000 7ff9b161b640 1 -- 10.20.193.110:0/37704388 wait complete. 2026-02-13T20:23:47.173 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.160+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.173 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.160+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2173929717}) 2026-02-13T20:23:47.173 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.160+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1485730700}) 2026-02-13T20:23:47.174 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.160+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.174 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.160+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2173929717}) 2026-02-13T20:23:47.174 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.160+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3249566848}) 2026-02-13T20:23:47.174 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.161+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.174 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.161+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=608454272}) 2026-02-13T20:23:47.174 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.161+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2437555178}) 2026-02-13T20:23:47.174 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.161+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.174 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.161+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=608454272}) 2026-02-13T20:23:47.174 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.161+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2321729016}) 2026-02-13T20:23:47.174 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.162+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.174 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.162+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2612818222}) 2026-02-13T20:23:47.175 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.162+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1830662046}) 2026-02-13T20:23:47.175 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.162+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.175 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.162+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2612818222}) 2026-02-13T20:23:47.175 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.162+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3990463734}) 2026-02-13T20:23:47.175 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.162+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.175 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.162+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3210208997}) 2026-02-13T20:23:47.175 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.162+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3028429143}) 2026-02-13T20:23:47.175 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.162+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.175 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.162+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3210208997}) 2026-02-13T20:23:47.175 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.162+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3375479990}) 2026-02-13T20:23:47.175 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.163+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.175 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.163+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3018860922}) 2026-02-13T20:23:47.176 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.163+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1818143104}) 2026-02-13T20:23:47.176 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.163+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.176 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.163+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3018860922}) 2026-02-13T20:23:47.176 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.163+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2371458918}) 2026-02-13T20:23:47.176 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.163+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.176 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.163+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2702134674}) 2026-02-13T20:23:47.176 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.163+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1215285386}) 2026-02-13T20:23:47.176 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.163+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.176 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.163+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2702134674}) 2026-02-13T20:23:47.176 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.163+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2267163777}) 2026-02-13T20:23:47.176 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.164+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.176 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.164+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3800630020}) 2026-02-13T20:23:47.176 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.164+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=74558347}) 2026-02-13T20:23:47.177 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.164+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.177 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.164+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3800630020}) 2026-02-13T20:23:47.177 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.164+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1272028394}) 2026-02-13T20:23:47.177 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.164+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.177 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.164+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3626331695}) 2026-02-13T20:23:47.177 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.164+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3435763724}) 2026-02-13T20:23:47.177 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.164+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.177 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.164+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3626331695}) 2026-02-13T20:23:47.177 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.164+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3344280133}) 2026-02-13T20:23:47.177 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.165+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.177 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.165+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4247442106}) 2026-02-13T20:23:47.177 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.165+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2217191843}) 2026-02-13T20:23:47.177 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.165+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.178 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.165+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4247442106}) 2026-02-13T20:23:47.178 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.165+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1524264112}) 2026-02-13T20:23:47.178 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.165+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.178 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.165+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1258323632}) 2026-02-13T20:23:47.178 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.165+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1630910559}) 2026-02-13T20:23:47.178 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.165+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.178 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.165+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1258323632}) 2026-02-13T20:23:47.178 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.165+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1883391186}) 2026-02-13T20:23:47.178 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.166+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.178 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.166+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=143565205}) 2026-02-13T20:23:47.179 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.166+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2240273973}) 2026-02-13T20:23:47.179 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.166+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.179 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.166+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=143565205}) 2026-02-13T20:23:47.179 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.166+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2356617391}) 2026-02-13T20:23:47.179 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.166+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.179 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.166+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=287710398}) 2026-02-13T20:23:47.179 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.166+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3790288605}) 2026-02-13T20:23:47.180 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.166+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.180 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.166+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=287710398}) 2026-02-13T20:23:47.180 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.166+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3813721073}) 2026-02-13T20:23:47.180 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.167+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.180 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.167+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=239051366}) 2026-02-13T20:23:47.180 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.167+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3295548584}) 2026-02-13T20:23:47.180 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.167+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.180 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.167+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=239051366}) 2026-02-13T20:23:47.180 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.167+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3363110337}) 2026-02-13T20:23:47.180 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.167+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.180 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.167+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4003093547}) 2026-02-13T20:23:47.180 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.167+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3830658938}) 2026-02-13T20:23:47.181 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.167+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.181 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.167+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4003093547}) 2026-02-13T20:23:47.181 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.167+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1323923876}) 2026-02-13T20:23:47.181 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.168+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.181 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.168+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=402988938}) 2026-02-13T20:23:47.181 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.168+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=360840329}) 2026-02-13T20:23:47.181 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.168+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.181 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.168+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=402988938}) 2026-02-13T20:23:47.181 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.168+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=707351790}) 2026-02-13T20:23:47.182 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-13T20:23:47.193 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.168+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.194 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.168+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2081691714}) 2026-02-13T20:23:47.194 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.168+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1202618006}) 2026-02-13T20:23:47.194 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.169+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.194 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.169+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2081691714}) 2026-02-13T20:23:47.194 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.169+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=355582072}) 2026-02-13T20:23:47.194 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.169+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.194 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.169+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=251086357}) 2026-02-13T20:23:47.194 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.169+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3477931540}) 2026-02-13T20:23:47.194 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.169+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.194 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.169+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=251086357}) 2026-02-13T20:23:47.194 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.169+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2036496407}) 2026-02-13T20:23:47.194 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.170+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.194 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.170+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3675765743}) 2026-02-13T20:23:47.195 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.170+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2689151867}) 2026-02-13T20:23:47.195 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.170+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.195 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.170+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3675765743}) 2026-02-13T20:23:47.195 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.170+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1911281279}) 2026-02-13T20:23:47.195 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.170+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.195 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.170+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2797870868}) 2026-02-13T20:23:47.195 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.170+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=108637863}) 2026-02-13T20:23:47.195 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.170+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.195 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.170+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2797870868}) 2026-02-13T20:23:47.195 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.170+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2770367854}) 2026-02-13T20:23:47.195 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.171+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.195 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.171+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3760268385}) 2026-02-13T20:23:47.195 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.171+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=787411619}) 2026-02-13T20:23:47.195 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.171+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.195 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.171+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3760268385}) 2026-02-13T20:23:47.195 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.171+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=569361719}) 2026-02-13T20:23:47.196 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.171+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.196 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.171+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=457808668}) 2026-02-13T20:23:47.196 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.171+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1806863683}) 2026-02-13T20:23:47.196 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.171+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.196 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.171+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=457808668}) 2026-02-13T20:23:47.196 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.171+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1511490061}) 2026-02-13T20:23:47.196 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.172+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.196 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.172+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1371915832}) 2026-02-13T20:23:47.196 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.172+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1894720780}) 2026-02-13T20:23:47.196 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.172+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.196 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.172+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1371915832}) 2026-02-13T20:23:47.196 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.172+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2408162828}) 2026-02-13T20:23:47.196 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.172+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.196 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.172+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1855845878}) 2026-02-13T20:23:47.196 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.172+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2082241931}) 2026-02-13T20:23:47.197 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.172+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.197 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.172+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1855845878}) 2026-02-13T20:23:47.197 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.172+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=248994600}) 2026-02-13T20:23:47.197 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.173+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.197 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.173+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=5,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=47} crc {logm=3826323313,mdsmap=3740562891,mgr=2881591710,mgr_command_descs=714296370,mgr_metadata=2819730505,mgrstat=970501240,mon_config_key=3424313430,monmap=207866894,nvmeofgw=2188353204,osd_metadata=91123727,osd_pg_creating=2912718089,osd_snap=1517955499}) 2026-02-13T20:23:47.197 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.173+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=5,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=4,osd_pg_creating=1,osd_snap=50} crc {logm=3826323313,mdsmap=3740562891,mgr=2881591710,mgr_command_descs=714296370,mgr_metadata=2819730505,mgrstat=2589741719,mon_config_key=2718569267,monmap=207866894,nvmeofgw=3360707892,osd_metadata=195386143,osd_pg_creating=2912718089,osd_snap=3193686170}) 2026-02-13T20:23:47.197 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.173+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.197 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.173+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=5,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=47} crc {logm=3826323313,mdsmap=3740562891,mgr=2881591710,mgr_command_descs=714296370,mgr_metadata=2819730505,mgrstat=970501240,mon_config_key=3424313430,monmap=207866894,nvmeofgw=2188353204,osd_metadata=91123727,osd_pg_creating=2912718089,osd_snap=1517955499}) 2026-02-13T20:23:47.198 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.173+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=5,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=48} crc {logm=3826323313,mdsmap=3827184867,mgr=1506645088,mgr_command_descs=714296370,mgr_metadata=2819730505,mgrstat=3890484741,mon_config_key=3557484700,monmap=207866894,nvmeofgw=3360707892,osd_metadata=91123727,osd_pg_creating=2912718089,osd_snap=3625057052}) 2026-02-13T20:23:47.198 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.173+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.198 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.173+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=73,osdmap=27} crc {osd_snap=321518565,osdmap=2599339553}) 2026-02-13T20:23:47.198 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.173+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=72,osdmap=28} crc {osd_snap=2523138312,osdmap=4284541942}) 2026-02-13T20:23:47.198 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.173+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.198 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.173+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=73,osdmap=27} crc {osd_snap=321518565,osdmap=2599339553}) 2026-02-13T20:23:47.198 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.173+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=71,osdmap=29} crc {osd_snap=19405058,osdmap=3861454218}) 2026-02-13T20:23:47.198 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.174+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.198 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.174+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3815639270}) 2026-02-13T20:23:47.198 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.174+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=482090825}) 2026-02-13T20:23:47.198 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.174+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.198 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.174+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3815639270}) 2026-02-13T20:23:47.199 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.174+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3215124851}) 2026-02-13T20:23:47.199 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.174+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.199 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.174+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3682364931}) 2026-02-13T20:23:47.199 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.174+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=563083750}) 2026-02-13T20:23:47.199 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.174+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.199 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.174+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3682364931}) 2026-02-13T20:23:47.199 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.174+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3380018405}) 2026-02-13T20:23:47.199 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.175+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.199 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.175+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3322444473}) 2026-02-13T20:23:47.199 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.175+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1328281960}) 2026-02-13T20:23:47.199 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.175+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.199 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.175+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3322444473}) 2026-02-13T20:23:47.199 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.175+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1507305904}) 2026-02-13T20:23:47.199 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.176+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.199 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.176+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3447748253}) 2026-02-13T20:23:47.199 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.176+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2479797726}) 2026-02-13T20:23:47.200 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.176+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.200 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.176+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3447748253}) 2026-02-13T20:23:47.200 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.176+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1625957654}) 2026-02-13T20:23:47.200 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.176+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.200 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.176+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2890311126}) 2026-02-13T20:23:47.200 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.176+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1602139135}) 2026-02-13T20:23:47.200 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.176+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.200 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.176+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2890311126}) 2026-02-13T20:23:47.200 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.176+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=4208799675}) 2026-02-13T20:23:47.200 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.177+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.200 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.177+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=505711583}) 2026-02-13T20:23:47.200 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.177+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2674075543}) 2026-02-13T20:23:47.200 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.177+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.200 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.177+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=505711583}) 2026-02-13T20:23:47.200 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.177+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=379548230}) 2026-02-13T20:23:47.200 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.178+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.200 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.178+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=4216306314}) 2026-02-13T20:23:47.200 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.178+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2549892713}) 2026-02-13T20:23:47.201 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.178+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.201 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.178+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=4216306314}) 2026-02-13T20:23:47.201 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.178+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2801696641}) 2026-02-13T20:23:47.201 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.179+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.201 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.179+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=794850165}) 2026-02-13T20:23:47.201 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.179+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2465762308}) 2026-02-13T20:23:47.201 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.179+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.201 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.179+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=794850165}) 2026-02-13T20:23:47.201 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.179+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2894940442}) 2026-02-13T20:23:47.201 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.181+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.201 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.181+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=39} crc {osdmap=2403028283}) 2026-02-13T20:23:47.201 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.181+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=36} crc {osdmap=1380768851}) 2026-02-13T20:23:47.201 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.181+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:23:47.201 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.181+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=39} crc {osdmap=2403028283}) 2026-02-13T20:23:47.201 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:23:47.181+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=38} crc {osdmap=2498014653}) 2026-02-13T20:23:47.235 INFO:tasks.rados.rados.0.trial188.stdout:2761: done (0 left) 2026-02-13T20:23:47.235 INFO:tasks.rados.rados.0.trial188.stdout:2762: delete oid 9 current snap is 287 2026-02-13T20:23:47.236 INFO:tasks.rados.rados.0.trial188.stdout:2762: done (0 left) 2026-02-13T20:23:47.236 INFO:tasks.rados.rados.0.trial188.stdout:2763: snap_create 2026-02-13T20:23:48.184 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-13T20:23:48.184 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T20:23:48.238 INFO:tasks.rados.rados.0.trial188.stdout:2763: done (0 left) 2026-02-13T20:23:48.238 INFO:tasks.rados.rados.0.trial188.stdout:2764: snap_remove snap 241 2026-02-13T20:23:48.259 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.251+0000 7f0f6ad9d640 10 monclient: get_monmap_and_config 2026-02-13T20:23:48.259 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.251+0000 7f0f6ad9d640 10 monclient: build_initial_monmap 2026-02-13T20:23:48.260 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.251+0000 7f0f6ad9d640 10 monclient: monmap: 2026-02-13T20:23:48.260 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:23:48.260 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:48.260 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:23:48.251653+0000 2026-02-13T20:23:48.260 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:23:48.251653+0000 2026-02-13T20:23:48.260 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:23:48.260 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:48.260 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:23:48.260 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:23:48.260 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:23:48.261 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:48.261 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.251+0000 7f0f6ad9d640 1 Processor -- start 2026-02-13T20:23:48.261 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.251+0000 7f0f6ad9d640 1 -- start start 2026-02-13T20:23:48.261 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.251+0000 7f0f6ad9d640 10 monclient: init 2026-02-13T20:23:48.261 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.251+0000 7f0f6ad9d640 10 monclient: _reopen_session rank -1 2026-02-13T20:23:48.261 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.251+0000 7f0f6ad9d640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:23:48.261 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.251+0000 7f0f6ad9d640 10 monclient(hunting): picked mon.noname-a con 0x7f0f641401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:23:48.262 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.251+0000 7f0f6ad9d640 10 monclient(hunting): picked mon.noname-c con 0x7f0f64092020 addr v1:10.20.193.188:6789/0 2026-02-13T20:23:48.262 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.251+0000 7f0f6ad9d640 10 monclient(hunting): picked mon.noname-b con 0x7f0f64091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:23:48.262 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.251+0000 7f0f6ad9d640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f6408b730 con 0x7f0f641401c0 2026-02-13T20:23:48.262 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.251+0000 7f0f6ad9d640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f6405c5b0 con 0x7f0f64092020 2026-02-13T20:23:48.262 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.251+0000 7f0f6ad9d640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f6408bcf0 con 0x7f0f64091950 2026-02-13T20:23:48.262 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.251+0000 7f0f6ad9d640 10 monclient(hunting): _renew_subs 2026-02-13T20:23:48.263 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.251+0000 7f0f6ad9d640 10 monclient(hunting): authenticate will time out at 1389.941973s 2026-02-13T20:23:48.263 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.252+0000 7f0f68b12640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f0f641401c0 0x7f0f64091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:49270/0 (socket says 10.20.193.110:49270) 2026-02-13T20:23:48.263 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.252+0000 7f0f68b12640 1 -- 10.20.193.110:0/4120409175 learned_addr learned my addr 10.20.193.110:0/4120409175 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:23:48.263 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.252+0000 7f0f5b7fe640 1 -- 10.20.193.110:0/4120409175 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2130063020 0 0) 0x7f0f6408b730 con 0x7f0f641401c0 2026-02-13T20:23:48.263 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.252+0000 7f0f5b7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:23:48.263 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.252+0000 7f0f5b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:48.264 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.252+0000 7f0f5b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:48.264 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.252+0000 7f0f5b7fe640 10 monclient(hunting): my global_id is 124233 2026-02-13T20:23:48.264 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.252+0000 7f0f5b7fe640 1 -- 10.20.193.110:0/4120409175 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f500035e0 con 0x7f0f641401c0 2026-02-13T20:23:48.264 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.252+0000 7f0f5b7fe640 1 -- 10.20.193.110:0/4120409175 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 278750582 0 0) 0x7f0f6408bcf0 con 0x7f0f64091950 2026-02-13T20:23:48.264 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.252+0000 7f0f5b7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:23:48.264 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.252+0000 7f0f5b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:48.264 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.252+0000 7f0f5b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:48.265 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.252+0000 7f0f5b7fe640 10 monclient(hunting): my global_id is 94526 2026-02-13T20:23:48.265 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.252+0000 7f0f5b7fe640 1 -- 10.20.193.110:0/4120409175 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f6408b730 con 0x7f0f64091950 2026-02-13T20:23:48.265 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.252+0000 7f0f5b7fe640 1 -- 10.20.193.110:0/4120409175 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1676421118 0 0) 0x7f0f500035e0 con 0x7f0f641401c0 2026-02-13T20:23:48.265 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.252+0000 7f0f5b7fe640 1 -- 10.20.193.110:0/4120409175 >> v1:10.20.193.110:6790/0 conn(0x7f0f64091950 legacy=0x7f0f641a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:48.265 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.252+0000 7f0f5b7fe640 1 -- 10.20.193.110:0/4120409175 >> v1:10.20.193.188:6789/0 conn(0x7f0f64092020 legacy=0x7f0f641812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T20:23:48.265 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.252+0000 7f0f5b7fe640 10 monclient: _finish_hunting 0 2026-02-13T20:23:48.266 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.252+0000 7f0f5b7fe640 1 monclient: found mon.noname-a 2026-02-13T20:23:48.266 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.252+0000 7f0f5b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:23:48.266 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.252+0000 7f0f5b7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:23:48.266 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.252+0000 7f0f5b7fe640 1 -- 10.20.193.110:0/4120409175 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f64140590 con 0x7f0f641401c0 2026-02-13T20:23:48.266 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.252+0000 7f0f5b7fe640 10 monclient: _finish_auth 0 2026-02-13T20:23:48.266 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.252+0000 7f0f5b7fe640 10 monclient: _check_auth_tickets 2026-02-13T20:23:48.267 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.252+0000 7f0f5b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:23:48.267 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.252+0000 7f0f5b7fe640 1 -- 10.20.193.110:0/4120409175 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f0f54002dd0 con 0x7f0f641401c0 2026-02-13T20:23:48.267 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.252+0000 7f0f6ad9d640 5 monclient: authenticate success, global_id 124233 2026-02-13T20:23:48.267 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.252+0000 7f0f6ad9d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:23:48.267 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.252+0000 7f0f5b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:48.267 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.252+0000 7f0f5b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:23:48.268 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.252+0000 7f0f5b7fe640 10 monclient: dump: 2026-02-13T20:23:48.268 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:48.268 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:48.268 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.268 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.268 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:48.269 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:48.269 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:48.269 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:48.269 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:48.269 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:48.269 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.252+0000 7f0f6ad9d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:23:48.269 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.252+0000 7f0f5b7fe640 1 -- 10.20.193.110:0/4120409175 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0f54003020 con 0x7f0f641401c0 2026-02-13T20:23:48.270 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.252+0000 7f0f5b7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:23:48.270 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.252+0000 7f0f5b7fe640 1 -- 10.20.193.110:0/4120409175 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f0f54003430 con 0x7f0f641401c0 2026-02-13T20:23:48.270 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.252+0000 7f0f5b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:48.270 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.252+0000 7f0f5b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:23:48.270 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.252+0000 7f0f5b7fe640 10 monclient: dump: 2026-02-13T20:23:48.271 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:48.271 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:48.271 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.271 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.271 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:48.271 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:48.271 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:48.272 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:48.272 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:48.272 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:48.272 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.252+0000 7f0f6ad9d640 10 monclient: get_monmap_and_config success 2026-02-13T20:23:48.272 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.252+0000 7f0f6ad9d640 4 set_mon_vals no callback set 2026-02-13T20:23:48.272 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.252+0000 7f0f6ad9d640 10 monclient: shutdown 2026-02-13T20:23:48.272 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.252+0000 7f0f6ad9d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:23:48.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.252+0000 7f0f6ad9d640 1 -- 10.20.193.110:0/4120409175 >> v1:10.20.193.110:6789/0 conn(0x7f0f641401c0 legacy=0x7f0f64091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:48.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.252+0000 7f0f6ad9d640 1 -- 10.20.193.110:0/4120409175 shutdown_connections 2026-02-13T20:23:48.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.252+0000 7f0f6ad9d640 1 -- 10.20.193.110:0/4120409175 >> 10.20.193.110:0/4120409175 conn(0x7f0f64054e90 msgr2=0x7f0f64058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:23:48.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.252+0000 7f0f6ad9d640 1 -- 10.20.193.110:0/4120409175 shutdown_connections 2026-02-13T20:23:48.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.252+0000 7f0f6ad9d640 1 -- 10.20.193.110:0/4120409175 wait complete. 2026-02-13T20:23:48.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.253+0000 7f0f6ad9d640 10 monclient: build_initial_monmap 2026-02-13T20:23:48.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.253+0000 7f0f6ad9d640 10 monclient: monmap: 2026-02-13T20:23:48.274 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:23:48.274 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:23:48.274 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:23:48.274 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:23:48.274 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:23:48.275 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:23:48.275 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:23:48.275 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:23:48.275 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:23:48.275 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:48.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.253+0000 7f0f6ad9d640 1 Processor -- start 2026-02-13T20:23:48.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.253+0000 7f0f6ad9d640 1 -- start start 2026-02-13T20:23:48.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.253+0000 7f0f6ad9d640 10 monclient: init 2026-02-13T20:23:48.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.253+0000 7f0f6ad9d640 10 monclient: _reopen_session rank -1 2026-02-13T20:23:48.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.253+0000 7f0f6ad9d640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:23:48.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.253+0000 7f0f6ad9d640 10 monclient(hunting): picked mon.noname-c con 0x7f0f64091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:23:48.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.253+0000 7f0f6ad9d640 10 monclient(hunting): picked mon.noname-b con 0x7f0f641401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:23:48.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.253+0000 7f0f6ad9d640 10 monclient(hunting): picked mon.noname-a con 0x7f0f64116450 addr v1:10.20.193.110:6789/0 2026-02-13T20:23:48.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.253+0000 7f0f6ad9d640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f6412dba0 con 0x7f0f64116450 2026-02-13T20:23:48.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.253+0000 7f0f6ad9d640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f64090df0 con 0x7f0f641401c0 2026-02-13T20:23:48.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.253+0000 7f0f6ad9d640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f6405d320 con 0x7f0f64091950 2026-02-13T20:23:48.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.253+0000 7f0f6ad9d640 10 monclient(hunting): _renew_subs 2026-02-13T20:23:48.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.253+0000 7f0f6ad9d640 10 monclient(hunting): authenticate will time out at 1389.943886s 2026-02-13T20:23:48.278 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.253+0000 7f0f68b12640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f0f64091950 0x7f0f64116a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:44286/0 (socket says 10.20.193.110:44286) 2026-02-13T20:23:48.278 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.253+0000 7f0f68b12640 1 -- 10.20.193.110:0/255020048 learned_addr learned my addr 10.20.193.110:0/255020048 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:23:48.278 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f597fa640 1 -- 10.20.193.110:0/255020048 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2753979781 0 0) 0x7f0f6412dba0 con 0x7f0f64116450 2026-02-13T20:23:48.278 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f597fa640 10 monclient(hunting): _negotiate 2026-02-13T20:23:48.278 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f597fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:48.278 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f597fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:48.279 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f597fa640 10 monclient(hunting): my global_id is 124236 2026-02-13T20:23:48.279 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f597fa640 1 -- 10.20.193.110:0/255020048 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f340035e0 con 0x7f0f64116450 2026-02-13T20:23:48.279 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f597fa640 1 -- 10.20.193.110:0/255020048 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2409939176 0 0) 0x7f0f6405d320 con 0x7f0f64091950 2026-02-13T20:23:48.279 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f597fa640 10 monclient(hunting): _negotiate 2026-02-13T20:23:48.279 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f597fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:48.279 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f597fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:48.280 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f597fa640 10 monclient(hunting): my global_id is 94529 2026-02-13T20:23:48.280 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f597fa640 1 -- 10.20.193.110:0/255020048 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f6412dba0 con 0x7f0f64091950 2026-02-13T20:23:48.280 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f597fa640 1 -- 10.20.193.110:0/255020048 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3052829092 0 0) 0x7f0f340035e0 con 0x7f0f64116450 2026-02-13T20:23:48.280 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f597fa640 1 -- 10.20.193.110:0/255020048 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0f6405d320 con 0x7f0f64116450 2026-02-13T20:23:48.280 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f597fa640 1 -- 10.20.193.110:0/255020048 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f0f60004170 con 0x7f0f64116450 2026-02-13T20:23:48.280 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f597fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:23:48.281 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f597fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:23:48.281 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f597fa640 10 monclient(hunting): dump: 2026-02-13T20:23:48.281 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:48.281 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:48.281 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.281 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.282 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:48.282 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:48.282 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:48.282 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:48.282 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:48.282 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:48.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f597fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:23:48.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f597fa640 1 -- 10.20.193.110:0/255020048 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3448115671 0 0) 0x7f0f64090df0 con 0x7f0f641401c0 2026-02-13T20:23:48.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f597fa640 10 monclient(hunting): _negotiate 2026-02-13T20:23:48.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f597fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:48.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f597fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:48.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f597fa640 10 monclient(hunting): my global_id is 134143 2026-02-13T20:23:48.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f597fa640 1 -- 10.20.193.110:0/255020048 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f340035e0 con 0x7f0f641401c0 2026-02-13T20:23:48.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f597fa640 1 -- 10.20.193.110:0/255020048 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 624014928 0 0) 0x7f0f6412dba0 con 0x7f0f64091950 2026-02-13T20:23:48.284 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f597fa640 1 -- 10.20.193.110:0/255020048 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0f64090df0 con 0x7f0f64091950 2026-02-13T20:23:48.284 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f597fa640 1 -- 10.20.193.110:0/255020048 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f0f54003340 con 0x7f0f64091950 2026-02-13T20:23:48.284 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f597fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:23:48.284 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f597fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:23:48.284 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f597fa640 10 monclient(hunting): dump: 2026-02-13T20:23:48.285 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:48.285 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:48.285 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.285 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.285 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:48.285 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:48.286 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:48.286 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:48.286 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:48.286 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:48.286 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f597fa640 1 -- 10.20.193.110:0/255020048 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2561469047 0 0) 0x7f0f6405d320 con 0x7f0f64116450 2026-02-13T20:23:48.286 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f597fa640 1 -- 10.20.193.110:0/255020048 >> v1:10.20.193.110:6790/0 conn(0x7f0f64091950 legacy=0x7f0f64116a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:48.286 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f597fa640 1 -- 10.20.193.110:0/255020048 >> v1:10.20.193.188:6789/0 conn(0x7f0f641401c0 legacy=0x7f0f641a1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:48.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f597fa640 10 monclient: _finish_hunting 0 2026-02-13T20:23:48.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f597fa640 1 monclient: found mon.a 2026-02-13T20:23:48.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f597fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:23:48.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f597fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:23:48.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f597fa640 1 -- 10.20.193.110:0/255020048 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f64117190 con 0x7f0f64116450 2026-02-13T20:23:48.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f597fa640 10 monclient: _finish_auth 0 2026-02-13T20:23:48.288 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f597fa640 10 monclient: _check_auth_tickets 2026-02-13T20:23:48.288 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f597fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:23:48.288 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f6ad9d640 5 monclient: authenticate success, global_id 124236 2026-02-13T20:23:48.288 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f6ad9d640 10 monclient: _renew_subs 2026-02-13T20:23:48.288 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f6ad9d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:23:48.288 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f6ad9d640 1 -- 10.20.193.110:0/255020048 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0f6412f290 con 0x7f0f64116450 2026-02-13T20:23:48.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f6ad9d640 10 monclient: _renew_subs 2026-02-13T20:23:48.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f6ad9d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:23:48.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f6ad9d640 1 -- 10.20.193.110:0/255020048 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f0f6412ecd0 con 0x7f0f64116450 2026-02-13T20:23:48.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f597fa640 1 -- 10.20.193.110:0/255020048 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0f600047b0 con 0x7f0f64116450 2026-02-13T20:23:48.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f597fa640 10 monclient: handle_config config(0 keys) 2026-02-13T20:23:48.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f597fa640 1 -- 10.20.193.110:0/255020048 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f0f60004ad0 con 0x7f0f64116450 2026-02-13T20:23:48.290 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f597fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:48.290 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f597fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:23:48.290 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f597fa640 10 monclient: dump: 2026-02-13T20:23:48.290 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:48.290 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:48.290 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.291 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.291 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:48.291 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:48.291 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:48.291 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:48.291 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:48.291 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:48.292 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f5affd640 4 set_mon_vals no callback set 2026-02-13T20:23:48.292 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f6ad9d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:23:48.292 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f6ad9d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:23:48.292 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f6ad9d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:23:48.292 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f6ad9d640 1 -- 10.20.193.110:0/255020048 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f640008d0 con 0x7f0f64116450 2026-02-13T20:23:48.292 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.254+0000 7f0f597fa640 1 -- 10.20.193.110:0/255020048 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f0f60011740 con 0x7f0f64116450 2026-02-13T20:23:48.292 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.255+0000 7f0f597fa640 1 -- 10.20.193.110:0/255020048 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(588..588 src has 1..588) ==== 3871+0+0 (unknown 1980572098 0 0) 0x7f0f6004e630 con 0x7f0f64116450 2026-02-13T20:23:48.293 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.255+0000 7f0f68b12640 10 monclient: get_auth_request con 0x7f0f3403fc20 auth_method 0 2026-02-13T20:23:48.293 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.257+0000 7f0f597fa640 1 -- 10.20.193.110:0/255020048 <== mon.0 v1:10.20.193.110:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f0f60016ec0 con 0x7f0f64116450 2026-02-13T20:23:48.293 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.257+0000 7f0f597fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:23:48.293 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.257+0000 7f0f597fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:23:48.409 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.408+0000 7f0f6ad9d640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T20:23:48.409 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.408+0000 7f0f6ad9d640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T20:23:48.409 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.408+0000 7f0f6ad9d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:23:48.409 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.408+0000 7f0f6ad9d640 1 -- 10.20.193.110:0/255020048 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f0f64058410 con 0x7f0f64116450 2026-02-13T20:23:48.410 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.409+0000 7f0f597fa640 1 -- 10.20.193.110:0/255020048 <== mon.0 v1:10.20.193.110:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 894860339) 0x7f0f60016670 con 0x7f0f64116450 2026-02-13T20:23:48.410 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.409+0000 7f0f597fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T20:23:48.410 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.409+0000 7f0f597fa640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:23:48.410 INFO:teuthology.orchestra.run.trial110.stdout:{"election_epoch":46,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","modified":"2026-02-13T20:11:07.161192Z","created":"2026-02-13T20:11:07.161192Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6789","nonce":0}]},"addr":"10.20.193.110:6789/0","public_addr":"10.20.193.110:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161241+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6789","nonce":0}]},"addr":"10.20.193.188:6789/0","public_addr":"10.20.193.188:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161242+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6790","nonce":0}]},"addr":"10.20.193.110:6790/0","public_addr":"10.20.193.110:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161243+0000","crush_location":[]}]}} 2026-02-13T20:23:48.411 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.410+0000 7f0f6ad9d640 1 -- 10.20.193.110:0/255020048 >> v1:10.20.193.188:6812/1623052694 conn(0x7f0f3403fc20 legacy=0x7f0f340600d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:48.411 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.410+0000 7f0f6ad9d640 10 monclient: shutdown 2026-02-13T20:23:48.411 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.410+0000 7f0f6ad9d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:23:48.411 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.410+0000 7f0f6ad9d640 1 -- 10.20.193.110:0/255020048 >> v1:10.20.193.110:6789/0 conn(0x7f0f64116450 legacy=0x7f0f641a2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:48.411 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.410+0000 7f0f6ad9d640 1 -- 10.20.193.110:0/255020048 shutdown_connections 2026-02-13T20:23:48.411 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.410+0000 7f0f6ad9d640 1 -- 10.20.193.110:0/255020048 >> 10.20.193.110:0/255020048 conn(0x7f0f64054e90 msgr2=0x7f0f6408dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:23:48.411 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.410+0000 7f0f6ad9d640 1 -- 10.20.193.110:0/255020048 shutdown_connections 2026-02-13T20:23:48.411 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.410+0000 7f0f6ad9d640 1 -- 10.20.193.110:0/255020048 wait complete. 2026-02-13T20:23:48.418 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-13T20:23:48.418 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-13T20:23:48.418 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-13T20:23:48.418 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T20:23:48.492 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.481+0000 7fd5fc8cc640 10 monclient: get_monmap_and_config 2026-02-13T20:23:48.492 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.481+0000 7fd5fc8cc640 10 monclient: build_initial_monmap 2026-02-13T20:23:48.493 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.481+0000 7fd5fc8cc640 10 monclient: monmap: 2026-02-13T20:23:48.493 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:23:48.493 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:48.493 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:23:48.482129+0000 2026-02-13T20:23:48.493 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:23:48.482129+0000 2026-02-13T20:23:48.493 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:23:48.493 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:48.493 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:23:48.493 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:23:48.493 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:23:48.493 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:48.493 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.482+0000 7fd5fc8cc640 1 Processor -- start 2026-02-13T20:23:48.493 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.482+0000 7fd5fc8cc640 1 -- start start 2026-02-13T20:23:48.494 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.482+0000 7fd5fc8cc640 10 monclient: init 2026-02-13T20:23:48.494 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.482+0000 7fd5fc8cc640 10 monclient: _reopen_session rank -1 2026-02-13T20:23:48.494 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.482+0000 7fd5fc8cc640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:23:48.494 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.482+0000 7fd5fc8cc640 10 monclient(hunting): picked mon.noname-b con 0x7fd5f41401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:23:48.494 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.482+0000 7fd5fc8cc640 10 monclient(hunting): picked mon.noname-c con 0x7fd5f4092020 addr v1:10.20.193.188:6789/0 2026-02-13T20:23:48.494 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.482+0000 7fd5fc8cc640 10 monclient(hunting): picked mon.noname-a con 0x7fd5f4091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:23:48.494 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.482+0000 7fd5fc8cc640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5f408b730 con 0x7fd5f4091950 2026-02-13T20:23:48.494 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.482+0000 7fd5fc8cc640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5f405c5b0 con 0x7fd5f4092020 2026-02-13T20:23:48.494 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.482+0000 7fd5fc8cc640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5f408bcf0 con 0x7fd5f41401c0 2026-02-13T20:23:48.494 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.482+0000 7fd5fc8cc640 10 monclient(hunting): _renew_subs 2026-02-13T20:23:48.494 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.482+0000 7fd5fc8cc640 10 monclient(hunting): authenticate will time out at 1390.172470s 2026-02-13T20:23:48.494 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.482+0000 7fd5fa641640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fd5f41401c0 0x7fd5f4091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:44292/0 (socket says 10.20.193.110:44292) 2026-02-13T20:23:48.494 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.482+0000 7fd5fa641640 1 -- 10.20.193.110:0/4177352636 learned_addr learned my addr 10.20.193.110:0/4177352636 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:23:48.494 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.482+0000 7fd5f963f640 1 -- 10.20.193.110:0/4177352636 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3854088658 0 0) 0x7fd5f408bcf0 con 0x7fd5f41401c0 2026-02-13T20:23:48.494 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.482+0000 7fd5f963f640 10 monclient(hunting): _negotiate 2026-02-13T20:23:48.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.482+0000 7fd5f963f640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:48.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.482+0000 7fd5f963f640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:48.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.482+0000 7fd5f963f640 10 monclient(hunting): my global_id is 94532 2026-02-13T20:23:48.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.482+0000 7fd5f963f640 1 -- 10.20.193.110:0/4177352636 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5e40035e0 con 0x7fd5f41401c0 2026-02-13T20:23:48.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.482+0000 7fd5f963f640 1 -- 10.20.193.110:0/4177352636 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3591223281 0 0) 0x7fd5f408b730 con 0x7fd5f4091950 2026-02-13T20:23:48.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.482+0000 7fd5f963f640 10 monclient(hunting): _negotiate 2026-02-13T20:23:48.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.482+0000 7fd5f963f640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:48.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.482+0000 7fd5f963f640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:48.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.482+0000 7fd5f963f640 10 monclient(hunting): my global_id is 124239 2026-02-13T20:23:48.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.482+0000 7fd5f963f640 1 -- 10.20.193.110:0/4177352636 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5f408bcf0 con 0x7fd5f4091950 2026-02-13T20:23:48.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.482+0000 7fd5f963f640 1 -- 10.20.193.110:0/4177352636 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1315204477 0 0) 0x7fd5e40035e0 con 0x7fd5f41401c0 2026-02-13T20:23:48.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.483+0000 7fd5f963f640 1 -- 10.20.193.110:0/4177352636 >> v1:10.20.193.188:6789/0 conn(0x7fd5f4092020 legacy=0x7fd5f41812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:48.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.483+0000 7fd5f963f640 1 -- 10.20.193.110:0/4177352636 >> v1:10.20.193.110:6789/0 conn(0x7fd5f4091950 legacy=0x7fd5f41a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:48.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.483+0000 7fd5f963f640 10 monclient: _finish_hunting 0 2026-02-13T20:23:48.495 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.483+0000 7fd5f963f640 1 monclient: found mon.noname-b 2026-02-13T20:23:48.496 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.483+0000 7fd5f963f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:23:48.496 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.483+0000 7fd5f963f640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:23:48.496 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.483+0000 7fd5f963f640 1 -- 10.20.193.110:0/4177352636 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5f4140590 con 0x7fd5f41401c0 2026-02-13T20:23:48.496 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.483+0000 7fd5f963f640 10 monclient: _finish_auth 0 2026-02-13T20:23:48.496 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.483+0000 7fd5f963f640 10 monclient: _check_auth_tickets 2026-02-13T20:23:48.496 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.483+0000 7fd5f963f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:23:48.496 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.483+0000 7fd5f963f640 1 -- 10.20.193.110:0/4177352636 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fd5ec002dd0 con 0x7fd5f41401c0 2026-02-13T20:23:48.496 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.483+0000 7fd5fc8cc640 5 monclient: authenticate success, global_id 94532 2026-02-13T20:23:48.496 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.483+0000 7fd5fc8cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:23:48.496 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.483+0000 7fd5f963f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:48.496 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.483+0000 7fd5f963f640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:23:48.496 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.483+0000 7fd5f963f640 10 monclient: dump: 2026-02-13T20:23:48.496 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:48.496 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:48.496 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.496 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.497 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:48.497 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:48.497 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:48.497 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:48.497 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:48.497 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:48.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.483+0000 7fd5fc8cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:23:48.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.483+0000 7fd5f963f640 1 -- 10.20.193.110:0/4177352636 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd5ec002f60 con 0x7fd5f41401c0 2026-02-13T20:23:48.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.483+0000 7fd5f963f640 10 monclient: handle_config config(0 keys) 2026-02-13T20:23:48.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.483+0000 7fd5f963f640 1 -- 10.20.193.110:0/4177352636 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fd5ec003370 con 0x7fd5f41401c0 2026-02-13T20:23:48.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.483+0000 7fd5f963f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:48.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.483+0000 7fd5f963f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:23:48.497 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.483+0000 7fd5f963f640 10 monclient: dump: 2026-02-13T20:23:48.497 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:48.498 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:48.498 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.498 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.498 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:48.498 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:48.498 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:48.498 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:48.498 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:48.498 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:48.498 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.483+0000 7fd5fc8cc640 10 monclient: get_monmap_and_config success 2026-02-13T20:23:48.498 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.483+0000 7fd5fc8cc640 4 set_mon_vals no callback set 2026-02-13T20:23:48.498 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.483+0000 7fd5fc8cc640 10 monclient: shutdown 2026-02-13T20:23:48.498 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.483+0000 7fd5fc8cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:23:48.498 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.483+0000 7fd5fc8cc640 1 -- 10.20.193.110:0/4177352636 >> v1:10.20.193.110:6790/0 conn(0x7fd5f41401c0 legacy=0x7fd5f4091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:48.498 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.483+0000 7fd5fc8cc640 1 -- 10.20.193.110:0/4177352636 shutdown_connections 2026-02-13T20:23:48.498 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.483+0000 7fd5fc8cc640 1 -- 10.20.193.110:0/4177352636 >> 10.20.193.110:0/4177352636 conn(0x7fd5f4054e90 msgr2=0x7fd5f4058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:23:48.499 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.483+0000 7fd5fc8cc640 1 -- 10.20.193.110:0/4177352636 shutdown_connections 2026-02-13T20:23:48.499 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.483+0000 7fd5fc8cc640 1 -- 10.20.193.110:0/4177352636 wait complete. 2026-02-13T20:23:48.499 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.483+0000 7fd5fc8cc640 10 monclient: build_initial_monmap 2026-02-13T20:23:48.499 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.483+0000 7fd5fc8cc640 10 monclient: monmap: 2026-02-13T20:23:48.499 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:23:48.499 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:23:48.499 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:23:48.499 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:23:48.499 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:23:48.499 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:23:48.499 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:23:48.499 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:23:48.499 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:23:48.499 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:48.500 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.483+0000 7fd5fc8cc640 1 Processor -- start 2026-02-13T20:23:48.500 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.484+0000 7fd5fc8cc640 1 -- start start 2026-02-13T20:23:48.500 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.484+0000 7fd5fc8cc640 10 monclient: init 2026-02-13T20:23:48.500 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.484+0000 7fd5fc8cc640 10 monclient: _reopen_session rank -1 2026-02-13T20:23:48.500 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.484+0000 7fd5fc8cc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:23:48.500 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.484+0000 7fd5fc8cc640 10 monclient(hunting): picked mon.noname-a con 0x7fd5f4091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:23:48.500 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.484+0000 7fd5fc8cc640 10 monclient(hunting): picked mon.noname-c con 0x7fd5f41401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:23:48.500 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.484+0000 7fd5fc8cc640 10 monclient(hunting): picked mon.noname-b con 0x7fd5f4152780 addr v1:10.20.193.188:6789/0 2026-02-13T20:23:48.500 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.484+0000 7fd5fc8cc640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5f405d320 con 0x7fd5f4091950 2026-02-13T20:23:48.500 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.484+0000 7fd5fc8cc640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5f4132290 con 0x7fd5f4152780 2026-02-13T20:23:48.500 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.484+0000 7fd5fc8cc640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5f4131fb0 con 0x7fd5f41401c0 2026-02-13T20:23:48.500 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.484+0000 7fd5fc8cc640 10 monclient(hunting): _renew_subs 2026-02-13T20:23:48.500 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.484+0000 7fd5fc8cc640 10 monclient(hunting): authenticate will time out at 1390.174438s 2026-02-13T20:23:48.500 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.484+0000 7fd5fa641640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fd5f4091950 0x7fd5f413e770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:49292/0 (socket says 10.20.193.110:49292) 2026-02-13T20:23:48.500 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.484+0000 7fd5fa641640 1 -- 10.20.193.110:0/338903210 learned_addr learned my addr 10.20.193.110:0/338903210 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:23:48.500 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.484+0000 7fd5f9e40640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fd5f41401c0 0x7fd5f41938d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:44306/0 (socket says 10.20.193.110:44306) 2026-02-13T20:23:48.501 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.484+0000 7fd5deffd640 1 -- 10.20.193.110:0/338903210 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3858737728 0 0) 0x7fd5f4131fb0 con 0x7fd5f41401c0 2026-02-13T20:23:48.501 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.484+0000 7fd5deffd640 10 monclient(hunting): _negotiate 2026-02-13T20:23:48.501 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.484+0000 7fd5deffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:48.501 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.484+0000 7fd5deffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:48.501 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.484+0000 7fd5deffd640 10 monclient(hunting): my global_id is 94535 2026-02-13T20:23:48.501 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.484+0000 7fd5deffd640 1 -- 10.20.193.110:0/338903210 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5c40035e0 con 0x7fd5f41401c0 2026-02-13T20:23:48.501 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.484+0000 7fd5deffd640 1 -- 10.20.193.110:0/338903210 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2564046159 0 0) 0x7fd5f405d320 con 0x7fd5f4091950 2026-02-13T20:23:48.501 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.484+0000 7fd5deffd640 10 monclient(hunting): _negotiate 2026-02-13T20:23:48.501 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.484+0000 7fd5deffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:48.501 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.484+0000 7fd5deffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:48.501 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.484+0000 7fd5deffd640 10 monclient(hunting): my global_id is 124242 2026-02-13T20:23:48.501 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.484+0000 7fd5deffd640 1 -- 10.20.193.110:0/338903210 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5f4131fb0 con 0x7fd5f4091950 2026-02-13T20:23:48.501 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.484+0000 7fd5deffd640 1 -- 10.20.193.110:0/338903210 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 200572251 0 0) 0x7fd5c40035e0 con 0x7fd5f41401c0 2026-02-13T20:23:48.501 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.484+0000 7fd5deffd640 1 -- 10.20.193.110:0/338903210 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd5f405d320 con 0x7fd5f41401c0 2026-02-13T20:23:48.501 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.484+0000 7fd5deffd640 1 -- 10.20.193.110:0/338903210 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fd5e00030b0 con 0x7fd5f41401c0 2026-02-13T20:23:48.502 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.484+0000 7fd5deffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:23:48.502 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.484+0000 7fd5deffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:23:48.502 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.484+0000 7fd5deffd640 10 monclient(hunting): dump: 2026-02-13T20:23:48.502 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:48.502 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:48.502 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.502 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.502 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:48.502 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:48.502 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:48.502 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:48.502 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:48.502 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:48.502 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.484+0000 7fd5deffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:23:48.502 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.484+0000 7fd5deffd640 1 -- 10.20.193.110:0/338903210 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 98073710 0 0) 0x7fd5f4131fb0 con 0x7fd5f4091950 2026-02-13T20:23:48.502 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.484+0000 7fd5deffd640 1 -- 10.20.193.110:0/338903210 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd5c40035e0 con 0x7fd5f4091950 2026-02-13T20:23:48.503 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.484+0000 7fd5deffd640 1 -- 10.20.193.110:0/338903210 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fd5ec003280 con 0x7fd5f4091950 2026-02-13T20:23:48.503 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.484+0000 7fd5deffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:23:48.503 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.484+0000 7fd5deffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:23:48.503 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.484+0000 7fd5deffd640 10 monclient(hunting): dump: 2026-02-13T20:23:48.503 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:48.503 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:48.503 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.503 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.503 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:48.503 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:48.503 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:48.503 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:48.503 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:48.503 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:48.503 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.485+0000 7fd5deffd640 1 -- 10.20.193.110:0/338903210 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4159927516 0 0) 0x7fd5f405d320 con 0x7fd5f41401c0 2026-02-13T20:23:48.504 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.485+0000 7fd5deffd640 1 -- 10.20.193.110:0/338903210 >> v1:10.20.193.188:6789/0 conn(0x7fd5f4152780 legacy=0x7fd5f4194ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:48.504 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.485+0000 7fd5deffd640 1 -- 10.20.193.110:0/338903210 >> v1:10.20.193.110:6789/0 conn(0x7fd5f4091950 legacy=0x7fd5f413e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:48.504 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.485+0000 7fd5deffd640 10 monclient: _finish_hunting 0 2026-02-13T20:23:48.504 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.485+0000 7fd5deffd640 1 monclient: found mon.c 2026-02-13T20:23:48.504 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.485+0000 7fd5deffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:23:48.504 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.485+0000 7fd5deffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:23:48.504 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.485+0000 7fd5deffd640 1 -- 10.20.193.110:0/338903210 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5f4130800 con 0x7fd5f41401c0 2026-02-13T20:23:48.504 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.485+0000 7fd5deffd640 10 monclient: _finish_auth 0 2026-02-13T20:23:48.504 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.485+0000 7fd5deffd640 10 monclient: _check_auth_tickets 2026-02-13T20:23:48.504 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.485+0000 7fd5deffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:23:48.504 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.485+0000 7fd5fc8cc640 5 monclient: authenticate success, global_id 94535 2026-02-13T20:23:48.504 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.485+0000 7fd5fc8cc640 10 monclient: _renew_subs 2026-02-13T20:23:48.504 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.485+0000 7fd5fc8cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:23:48.504 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.485+0000 7fd5fc8cc640 1 -- 10.20.193.110:0/338903210 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd5f408a880 con 0x7fd5f41401c0 2026-02-13T20:23:48.504 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.485+0000 7fd5fc8cc640 10 monclient: _renew_subs 2026-02-13T20:23:48.505 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.485+0000 7fd5fc8cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:23:48.505 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.485+0000 7fd5fc8cc640 1 -- 10.20.193.110:0/338903210 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fd5f413ee80 con 0x7fd5f41401c0 2026-02-13T20:23:48.505 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.485+0000 7fd5deffd640 1 -- 10.20.193.110:0/338903210 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd5e0003280 con 0x7fd5f41401c0 2026-02-13T20:23:48.505 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.485+0000 7fd5deffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:23:48.505 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.485+0000 7fd5deffd640 1 -- 10.20.193.110:0/338903210 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fd5e0003980 con 0x7fd5f41401c0 2026-02-13T20:23:48.505 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.485+0000 7fd5deffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:48.505 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.485+0000 7fd5deffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:23:48.505 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.485+0000 7fd5deffd640 10 monclient: dump: 2026-02-13T20:23:48.505 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:48.505 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:48.505 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.505 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.505 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:48.505 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:48.505 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:48.505 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:48.506 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:48.506 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:48.506 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.485+0000 7fd5f8e3e640 4 set_mon_vals no callback set 2026-02-13T20:23:48.506 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.485+0000 7fd5fc8cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:23:48.506 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.485+0000 7fd5fc8cc640 1 -- 10.20.193.110:0/338903210 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd5f4131b50 con 0x7fd5f4092020 2026-02-13T20:23:48.506 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.485+0000 7fd5deffd640 1 -- 10.20.193.110:0/338903210 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3972692277 0 0) 0x7fd5f4131b50 con 0x7fd5f4092020 2026-02-13T20:23:48.506 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.485+0000 7fd5deffd640 10 monclient(hunting): _negotiate 2026-02-13T20:23:48.506 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.485+0000 7fd5deffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:48.506 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.485+0000 7fd5deffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:48.506 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.485+0000 7fd5deffd640 10 monclient(hunting): my global_id is 124245 2026-02-13T20:23:48.506 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.485+0000 7fd5deffd640 1 -- 10.20.193.110:0/338903210 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5f405d320 con 0x7fd5f4092020 2026-02-13T20:23:48.506 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.485+0000 7fd5deffd640 1 -- 10.20.193.110:0/338903210 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fd5e0003ae0 con 0x7fd5f41401c0 2026-02-13T20:23:48.506 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.485+0000 7fd5deffd640 1 -- 10.20.193.110:0/338903210 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(588..588 src has 1..588) ==== 3871+0+0 (unknown 1980572098 0 0) 0x7fd5e004e7f0 con 0x7fd5f41401c0 2026-02-13T20:23:48.506 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.486+0000 7fd5deffd640 1 -- 10.20.193.110:0/338903210 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1207519325 0 0) 0x7fd5f405d320 con 0x7fd5f4092020 2026-02-13T20:23:48.506 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.486+0000 7fd5deffd640 1 -- 10.20.193.110:0/338903210 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd5f4131b50 con 0x7fd5f4092020 2026-02-13T20:23:48.507 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.486+0000 7fd5deffd640 1 -- 10.20.193.110:0/338903210 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fd5ec0033e0 con 0x7fd5f4092020 2026-02-13T20:23:48.507 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.486+0000 7fd5deffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:48.507 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.486+0000 7fd5deffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:23:48.507 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.486+0000 7fd5deffd640 10 monclient: dump: 2026-02-13T20:23:48.507 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:48.507 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:48.507 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.507 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.507 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:48.507 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:48.507 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:48.507 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:48.507 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:48.507 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:48.507 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.486+0000 7fd5deffd640 1 -- 10.20.193.110:0/338903210 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3942337691 0 0) 0x7fd5f4131b50 con 0x7fd5f4092020 2026-02-13T20:23:48.508 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.486+0000 7fd5deffd640 1 -- 10.20.193.110:0/338903210 --> v1:10.20.193.110:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd5f408b450 con 0x7fd5f4092020 2026-02-13T20:23:48.508 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.486+0000 7fd5fae42640 10 monclient: get_auth_request con 0x7fd5c403fb20 auth_method 0 2026-02-13T20:23:48.508 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.486+0000 7fd5deffd640 1 -- 10.20.193.110:0/338903210 <== mon.0 v1:10.20.193.110:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fd5ec005090 con 0x7fd5f4092020 2026-02-13T20:23:48.508 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.486+0000 7fd5deffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:23:48.508 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.486+0000 7fd5deffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:23:48.508 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.486+0000 7fd5deffd640 1 -- 10.20.193.110:0/338903210 >> v1:10.20.193.110:6789/0 conn(0x7fd5f4092020 legacy=0x7fd5f4127b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:48.508 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.486+0000 7fd5deffd640 1 -- 10.20.193.110:0/338903210 >> v1:10.20.193.110:6789/0 conn(0x7fd5f4092020 legacy=0x7fd5f4127b20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:23:48.508 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.489+0000 7fd5fc8cc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:23:48.508 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.489+0000 7fd5fc8cc640 1 -- 10.20.193.110:0/338903210 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd5f413f1d0 con 0x7fd5f4128230 2026-02-13T20:23:48.508 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.489+0000 7fd5deffd640 1 -- 10.20.193.110:0/338903210 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 279031619 0 0) 0x7fd5f413f1d0 con 0x7fd5f4128230 2026-02-13T20:23:48.508 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.489+0000 7fd5deffd640 10 monclient(hunting): _negotiate 2026-02-13T20:23:48.508 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.489+0000 7fd5deffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:48.508 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.489+0000 7fd5deffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:48.508 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.489+0000 7fd5deffd640 10 monclient(hunting): my global_id is 124248 2026-02-13T20:23:48.508 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.489+0000 7fd5deffd640 1 -- 10.20.193.110:0/338903210 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5f4131b50 con 0x7fd5f4128230 2026-02-13T20:23:48.508 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.489+0000 7fd5deffd640 1 -- 10.20.193.110:0/338903210 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3203760806 0 0) 0x7fd5f4131b50 con 0x7fd5f4128230 2026-02-13T20:23:48.509 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.489+0000 7fd5deffd640 1 -- 10.20.193.110:0/338903210 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd5f413f1d0 con 0x7fd5f4128230 2026-02-13T20:23:48.509 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.489+0000 7fd5deffd640 1 -- 10.20.193.110:0/338903210 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fd5ec007750 con 0x7fd5f4128230 2026-02-13T20:23:48.509 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.489+0000 7fd5deffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:48.509 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.489+0000 7fd5deffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:23:48.509 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.489+0000 7fd5deffd640 10 monclient: dump: 2026-02-13T20:23:48.509 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:48.509 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:48.509 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.509 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.509 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:48.509 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:48.509 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:48.509 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:48.509 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:48.509 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:48.509 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.490+0000 7fd5deffd640 1 -- 10.20.193.110:0/338903210 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1129442833 0 0) 0x7fd5f413f1d0 con 0x7fd5f4128230 2026-02-13T20:23:48.510 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.490+0000 7fd5deffd640 1 -- 10.20.193.110:0/338903210 --> v1:10.20.193.110:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd5f4055bb0 con 0x7fd5f4128230 2026-02-13T20:23:48.510 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.490+0000 7fd5deffd640 1 -- 10.20.193.110:0/338903210 <== mon.0 v1:10.20.193.110:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4514 (unknown 0 0 2735454421) 0x7fd5ec008ae0 con 0x7fd5f4128230 2026-02-13T20:23:48.510 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.490+0000 7fd5deffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:23:48.510 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.490+0000 7fd5deffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:23:48.510 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.490+0000 7fd5deffd640 1 -- 10.20.193.110:0/338903210 >> v1:10.20.193.110:6789/0 conn(0x7fd5f4128230 legacy=0x7fd5f4197720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:48.510 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.490+0000 7fd5deffd640 1 -- 10.20.193.110:0/338903210 >> v1:10.20.193.110:6789/0 conn(0x7fd5f4128230 legacy=0x7fd5f4197720 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:23:48.510 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:23:48.510 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:23:48.510 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:23:48.511 INFO:teuthology.orchestra.run.trial110.stdout: "state": "peon", 2026-02-13T20:23:48.511 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 46, 2026-02-13T20:23:48.511 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 143908, 2026-02-13T20:23:48.511 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:23:48.511 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:23:48.511 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:23:48.511 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:23:48.511 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:23:48.511 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 1, 2026-02-13T20:23:48.511 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:23:48.511 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:23:48.511 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:23:48.511 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:23:48.511 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:23:48.512 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:23:48.512 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:23:48.512 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:23:48.512 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:23:48.512 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:23:48.512 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:23:48.512 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:23:48.512 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:23:48.512 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:23:48.512 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:23:48.512 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:23:48.512 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:23:48.512 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:23:48.512 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:23:48.512 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:23:48.513 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:23:48.513 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:23:48.513 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:23:48.513 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:23:48.513 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:23:48.513 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:23:48.513 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:23:48.513 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:23:48.513 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:23:48.513 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:23:48.513 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:23:48.513 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:23:48.513 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:23:48.513 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:48.513 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:23:48.514 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:23:48.514 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:23:48.514 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:23:48.514 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:23:48.514 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:23:48.514 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:23:48.514 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:23:48.514 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:23:48.514 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:23:48.514 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:23:48.514 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:23:48.514 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:23:48.514 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:23:48.514 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:23:48.514 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:23:48.515 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:23:48.515 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:23:48.515 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:23:48.515 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:23:48.515 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:23:48.515 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:23:48.515 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:23:48.515 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:23:48.515 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:23:48.515 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:23:48.515 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:23:48.515 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:23:48.515 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:23:48.515 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:23:48.515 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:23:48.516 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:23:48.516 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:48.516 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:23:48.516 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:48.516 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:23:48.516 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:23:48.516 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:23:48.516 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:23:48.516 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:48.516 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:23:48.516 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:23:48.516 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:23:48.516 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:23:48.516 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:23:48.516 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:48.517 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:23:48.517 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:23:48.517 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:23:48.517 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:23:48.517 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:23:48.517 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:23:48.517 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:48.517 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:48.517 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:23:48.517 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:23:48.517 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:23:48.517 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:23:48.517 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:48.517 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:23:48.517 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:23:48.518 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:23:48.518 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:23:48.518 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:23:48.518 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:48.518 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:23:48.518 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:23:48.518 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:23:48.518 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:23:48.518 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:23:48.518 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:23:48.518 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:48.518 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:48.518 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:23:48.518 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:23:48.518 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:23:48.518 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:23:48.519 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:48.519 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:23:48.519 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:23:48.519 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:23:48.519 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:23:48.519 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:23:48.519 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:48.519 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:23:48.519 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:23:48.519 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:23:48.519 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:23:48.519 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:23:48.519 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:23:48.519 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:23:48.519 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:23:48.520 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:48.520 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:23:48.520 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:23:48.520 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:48.520 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:23:48.520 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:23:48.520 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:23:48.520 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:23:48.520 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:23:48.520 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:23:48.520 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:48.520 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:23:48.520 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:23:48.520 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:23:48.520 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:23:48.520 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:23:48.521 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:23:48.521 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:48.521 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:23:48.521 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:23:48.521 INFO:teuthology.orchestra.run.trial110.stdout: "num": 4 2026-02-13T20:23:48.521 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:23:48.521 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:23:48.521 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:48.521 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:23:48.521 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:23:48.522 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.490+0000 7fd5fc8cc640 1 -- 10.20.193.110:0/338903210 >> v1:10.20.193.188:6812/1623052694 conn(0x7fd5c403fb20 legacy=0x7fd5c405ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:48.522 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.490+0000 7fd5fc8cc640 10 monclient: shutdown 2026-02-13T20:23:48.522 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.490+0000 7fd5fc8cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:23:48.522 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.490+0000 7fd5fc8cc640 1 -- 10.20.193.110:0/338903210 >> v1:10.20.193.110:6790/0 conn(0x7fd5f41401c0 legacy=0x7fd5f41938d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:48.523 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.490+0000 7fd5fae42640 1 -- 10.20.193.110:0/338903210 reap_dead start 2026-02-13T20:23:48.523 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.490+0000 7fd5fae42640 1 -- 10.20.193.110:0/338903210 reap_dead start 2026-02-13T20:23:48.523 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.490+0000 7fd5fc8cc640 1 -- 10.20.193.110:0/338903210 shutdown_connections 2026-02-13T20:23:48.523 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.490+0000 7fd5fc8cc640 1 -- 10.20.193.110:0/338903210 >> 10.20.193.110:0/338903210 conn(0x7fd5f4054e90 msgr2=0x7fd5f408dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:23:48.523 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.490+0000 7fd5fc8cc640 1 -- 10.20.193.110:0/338903210 shutdown_connections 2026-02-13T20:23:48.523 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.490+0000 7fd5fc8cc640 1 -- 10.20.193.110:0/338903210 wait complete. 2026-02-13T20:23:48.523 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:23:48.523 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-13T20:23:48.523 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T20:23:48.588 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.588+0000 7f1e62dee640 10 monclient: get_monmap_and_config 2026-02-13T20:23:48.589 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.588+0000 7f1e62dee640 10 monclient: build_initial_monmap 2026-02-13T20:23:48.589 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.588+0000 7f1e62dee640 10 monclient: monmap: 2026-02-13T20:23:48.589 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:23:48.589 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:48.589 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:23:48.588829+0000 2026-02-13T20:23:48.589 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:23:48.588829+0000 2026-02-13T20:23:48.589 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:23:48.589 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:48.589 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:23:48.589 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:23:48.589 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:23:48.589 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:48.598 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.588+0000 7f1e62dee640 1 Processor -- start 2026-02-13T20:23:48.598 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.588+0000 7f1e62dee640 1 -- start start 2026-02-13T20:23:48.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.588+0000 7f1e62dee640 10 monclient: init 2026-02-13T20:23:48.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e62dee640 10 monclient: _reopen_session rank -1 2026-02-13T20:23:48.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e62dee640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:23:48.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e62dee640 10 monclient(hunting): picked mon.noname-b con 0x7f1e5c1401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:23:48.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e62dee640 10 monclient(hunting): picked mon.noname-c con 0x7f1e5c092020 addr v1:10.20.193.188:6789/0 2026-02-13T20:23:48.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e62dee640 10 monclient(hunting): picked mon.noname-a con 0x7f1e5c091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:23:48.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e62dee640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e5c08b730 con 0x7f1e5c091950 2026-02-13T20:23:48.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e62dee640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e5c05c5b0 con 0x7f1e5c092020 2026-02-13T20:23:48.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e62dee640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e5c08bcf0 con 0x7f1e5c1401c0 2026-02-13T20:23:48.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e62dee640 10 monclient(hunting): _renew_subs 2026-02-13T20:23:48.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e62dee640 10 monclient(hunting): authenticate will time out at 1390.279140s 2026-02-13T20:23:48.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e60b63640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f1e5c1401c0 0x7f1e5c091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:44314/0 (socket says 10.20.193.110:44314) 2026-02-13T20:23:48.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e60b63640 1 -- 10.20.193.110:0/2085558945 learned_addr learned my addr 10.20.193.110:0/2085558945 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:23:48.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e537fe640 1 -- 10.20.193.110:0/2085558945 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1847148094 0 0) 0x7f1e5c08bcf0 con 0x7f1e5c1401c0 2026-02-13T20:23:48.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e537fe640 10 monclient(hunting): _negotiate 2026-02-13T20:23:48.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e537fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:48.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e537fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:48.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e537fe640 10 monclient(hunting): my global_id is 94538 2026-02-13T20:23:48.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e537fe640 1 -- 10.20.193.110:0/2085558945 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e480035e0 con 0x7f1e5c1401c0 2026-02-13T20:23:48.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e537fe640 1 -- 10.20.193.110:0/2085558945 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1700209184 0 0) 0x7f1e5c08b730 con 0x7f1e5c091950 2026-02-13T20:23:48.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e537fe640 10 monclient(hunting): _negotiate 2026-02-13T20:23:48.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e537fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:48.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e537fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:48.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e537fe640 10 monclient(hunting): my global_id is 124251 2026-02-13T20:23:48.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e537fe640 1 -- 10.20.193.110:0/2085558945 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e5c08bcf0 con 0x7f1e5c091950 2026-02-13T20:23:48.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e537fe640 1 -- 10.20.193.110:0/2085558945 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2032329268 0 0) 0x7f1e5c05c5b0 con 0x7f1e5c092020 2026-02-13T20:23:48.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e537fe640 10 monclient(hunting): _negotiate 2026-02-13T20:23:48.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e537fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:48.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e537fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:48.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e537fe640 10 monclient(hunting): my global_id is 134152 2026-02-13T20:23:48.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e537fe640 1 -- 10.20.193.110:0/2085558945 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e5c08b730 con 0x7f1e5c092020 2026-02-13T20:23:48.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e537fe640 1 -- 10.20.193.110:0/2085558945 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3992323337 0 0) 0x7f1e480035e0 con 0x7f1e5c1401c0 2026-02-13T20:23:48.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e537fe640 1 -- 10.20.193.110:0/2085558945 >> v1:10.20.193.188:6789/0 conn(0x7f1e5c092020 legacy=0x7f1e5c1812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:48.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e537fe640 1 -- 10.20.193.110:0/2085558945 >> v1:10.20.193.110:6789/0 conn(0x7f1e5c091950 legacy=0x7f1e5c1a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:48.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e537fe640 10 monclient: _finish_hunting 0 2026-02-13T20:23:48.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e537fe640 1 monclient: found mon.noname-b 2026-02-13T20:23:48.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e537fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:23:48.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e537fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:23:48.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e537fe640 1 -- 10.20.193.110:0/2085558945 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e5c140590 con 0x7f1e5c1401c0 2026-02-13T20:23:48.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e537fe640 10 monclient: _finish_auth 0 2026-02-13T20:23:48.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e537fe640 10 monclient: _check_auth_tickets 2026-02-13T20:23:48.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e537fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:23:48.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e537fe640 1 -- 10.20.193.110:0/2085558945 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f1e4c002dd0 con 0x7f1e5c1401c0 2026-02-13T20:23:48.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e62dee640 5 monclient: authenticate success, global_id 94538 2026-02-13T20:23:48.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e62dee640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:23:48.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e537fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:48.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e537fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:23:48.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e537fe640 10 monclient: dump: 2026-02-13T20:23:48.602 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:48.602 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:48.602 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.602 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.602 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:48.603 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:48.603 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:48.603 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:48.603 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:48.603 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:48.603 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e62dee640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:23:48.603 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e537fe640 1 -- 10.20.193.110:0/2085558945 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1e4c002fe0 con 0x7f1e5c1401c0 2026-02-13T20:23:48.603 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e537fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:23:48.603 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e537fe640 1 -- 10.20.193.110:0/2085558945 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f1e4c0033c0 con 0x7f1e5c1401c0 2026-02-13T20:23:48.603 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e62dee640 10 monclient: get_monmap_and_config success 2026-02-13T20:23:48.603 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e62dee640 4 set_mon_vals no callback set 2026-02-13T20:23:48.603 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e537fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:48.603 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e537fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:23:48.603 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e537fe640 10 monclient: dump: 2026-02-13T20:23:48.604 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:48.604 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:48.604 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.604 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.604 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:48.604 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:48.604 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:48.604 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:48.604 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:48.604 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:48.604 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.589+0000 7f1e62dee640 10 monclient: shutdown 2026-02-13T20:23:48.604 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.590+0000 7f1e62dee640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:23:48.604 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.590+0000 7f1e62dee640 1 -- 10.20.193.110:0/2085558945 >> v1:10.20.193.110:6790/0 conn(0x7f1e5c1401c0 legacy=0x7f1e5c091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:48.604 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.590+0000 7f1e62dee640 1 -- 10.20.193.110:0/2085558945 shutdown_connections 2026-02-13T20:23:48.605 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.590+0000 7f1e62dee640 1 -- 10.20.193.110:0/2085558945 >> 10.20.193.110:0/2085558945 conn(0x7f1e5c054e90 msgr2=0x7f1e5c058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:23:48.605 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.590+0000 7f1e62dee640 1 -- 10.20.193.110:0/2085558945 shutdown_connections 2026-02-13T20:23:48.605 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.590+0000 7f1e62dee640 1 -- 10.20.193.110:0/2085558945 wait complete. 2026-02-13T20:23:48.605 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.590+0000 7f1e62dee640 10 monclient: build_initial_monmap 2026-02-13T20:23:48.605 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.590+0000 7f1e62dee640 10 monclient: monmap: 2026-02-13T20:23:48.605 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:23:48.605 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:23:48.605 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:23:48.605 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:23:48.605 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:23:48.605 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:23:48.605 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:23:48.605 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:23:48.606 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:23:48.606 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:48.606 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.590+0000 7f1e62dee640 1 Processor -- start 2026-02-13T20:23:48.606 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.590+0000 7f1e62dee640 1 -- start start 2026-02-13T20:23:48.606 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.590+0000 7f1e62dee640 10 monclient: init 2026-02-13T20:23:48.606 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.590+0000 7f1e62dee640 10 monclient: _reopen_session rank -1 2026-02-13T20:23:48.606 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.590+0000 7f1e62dee640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:23:48.606 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.590+0000 7f1e62dee640 10 monclient(hunting): picked mon.noname-c con 0x7f1e5c091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:23:48.606 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.590+0000 7f1e62dee640 10 monclient(hunting): picked mon.noname-b con 0x7f1e5c1401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:23:48.606 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.590+0000 7f1e62dee640 10 monclient(hunting): picked mon.noname-a con 0x7f1e5c13f020 addr v1:10.20.193.110:6789/0 2026-02-13T20:23:48.606 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.590+0000 7f1e62dee640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e5c05d320 con 0x7f1e5c13f020 2026-02-13T20:23:48.606 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.590+0000 7f1e62dee640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e5c08c3a0 con 0x7f1e5c1401c0 2026-02-13T20:23:48.606 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.590+0000 7f1e62dee640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e5c12ffd0 con 0x7f1e5c091950 2026-02-13T20:23:48.606 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.590+0000 7f1e62dee640 10 monclient(hunting): _renew_subs 2026-02-13T20:23:48.607 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.590+0000 7f1e62dee640 10 monclient(hunting): authenticate will time out at 1390.280874s 2026-02-13T20:23:48.607 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.590+0000 7f1e60b63640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f1e5c091950 0x7f1e5c13e910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:44320/0 (socket says 10.20.193.110:44320) 2026-02-13T20:23:48.607 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.590+0000 7f1e60b63640 1 -- 10.20.193.110:0/653310336 learned_addr learned my addr 10.20.193.110:0/653310336 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:23:48.607 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e517fa640 1 -- 10.20.193.110:0/653310336 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3644481163 0 0) 0x7f1e5c12ffd0 con 0x7f1e5c091950 2026-02-13T20:23:48.607 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e517fa640 10 monclient(hunting): _negotiate 2026-02-13T20:23:48.607 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e517fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:48.607 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e517fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:48.607 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e517fa640 10 monclient(hunting): my global_id is 94541 2026-02-13T20:23:48.607 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e517fa640 1 -- 10.20.193.110:0/653310336 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e2c0035e0 con 0x7f1e5c091950 2026-02-13T20:23:48.607 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e517fa640 1 -- 10.20.193.110:0/653310336 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1788765960 0 0) 0x7f1e5c05d320 con 0x7f1e5c13f020 2026-02-13T20:23:48.607 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e517fa640 10 monclient(hunting): _negotiate 2026-02-13T20:23:48.607 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e517fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:48.607 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e517fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:48.607 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e517fa640 10 monclient(hunting): my global_id is 124254 2026-02-13T20:23:48.608 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e517fa640 1 -- 10.20.193.110:0/653310336 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e5c12ffd0 con 0x7f1e5c13f020 2026-02-13T20:23:48.608 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e517fa640 1 -- 10.20.193.110:0/653310336 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3015654859 0 0) 0x7f1e5c12ffd0 con 0x7f1e5c13f020 2026-02-13T20:23:48.608 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e517fa640 1 -- 10.20.193.110:0/653310336 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1e5c05d320 con 0x7f1e5c13f020 2026-02-13T20:23:48.608 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e517fa640 1 -- 10.20.193.110:0/653310336 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f1e580040a0 con 0x7f1e5c13f020 2026-02-13T20:23:48.608 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e517fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:23:48.608 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e517fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:23:48.608 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e517fa640 10 monclient(hunting): dump: 2026-02-13T20:23:48.608 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:48.608 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:48.608 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.608 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.608 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:48.608 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:48.608 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:48.609 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:48.609 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:48.609 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:48.609 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e517fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:23:48.609 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e517fa640 1 -- 10.20.193.110:0/653310336 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3772019140 0 0) 0x7f1e2c0035e0 con 0x7f1e5c091950 2026-02-13T20:23:48.609 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e517fa640 1 -- 10.20.193.110:0/653310336 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1e5c12ffd0 con 0x7f1e5c091950 2026-02-13T20:23:48.609 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e517fa640 1 -- 10.20.193.110:0/653310336 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f1e4c003300 con 0x7f1e5c091950 2026-02-13T20:23:48.609 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e517fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:23:48.609 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e517fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:23:48.609 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e517fa640 10 monclient(hunting): dump: 2026-02-13T20:23:48.609 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:48.609 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:48.609 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.609 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.610 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:48.610 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:48.610 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:48.610 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:48.610 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:48.610 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:48.610 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e517fa640 1 -- 10.20.193.110:0/653310336 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 975570211 0 0) 0x7f1e5c05d320 con 0x7f1e5c13f020 2026-02-13T20:23:48.610 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e517fa640 1 -- 10.20.193.110:0/653310336 >> v1:10.20.193.110:6790/0 conn(0x7f1e5c091950 legacy=0x7f1e5c13e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:48.610 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e517fa640 1 -- 10.20.193.110:0/653310336 >> v1:10.20.193.188:6789/0 conn(0x7f1e5c1401c0 legacy=0x7f1e5c193a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:48.610 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e517fa640 10 monclient: _finish_hunting 0 2026-02-13T20:23:48.610 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e517fa640 1 monclient: found mon.a 2026-02-13T20:23:48.610 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e517fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:23:48.610 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e517fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:23:48.610 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e517fa640 1 -- 10.20.193.110:0/653310336 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e5c131a90 con 0x7f1e5c13f020 2026-02-13T20:23:48.611 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e517fa640 10 monclient: _finish_auth 0 2026-02-13T20:23:48.611 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e517fa640 10 monclient: _check_auth_tickets 2026-02-13T20:23:48.611 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e517fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:23:48.611 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e62dee640 5 monclient: authenticate success, global_id 124254 2026-02-13T20:23:48.611 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e62dee640 10 monclient: _renew_subs 2026-02-13T20:23:48.611 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e62dee640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:23:48.611 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e62dee640 1 -- 10.20.193.110:0/653310336 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1e5c132330 con 0x7f1e5c13f020 2026-02-13T20:23:48.611 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e62dee640 10 monclient: _renew_subs 2026-02-13T20:23:48.611 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e62dee640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:23:48.611 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e62dee640 1 -- 10.20.193.110:0/653310336 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1e5c130cd0 con 0x7f1e5c13f020 2026-02-13T20:23:48.611 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e517fa640 1 -- 10.20.193.110:0/653310336 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1e580044f0 con 0x7f1e5c13f020 2026-02-13T20:23:48.611 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e517fa640 10 monclient: handle_config config(0 keys) 2026-02-13T20:23:48.611 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e517fa640 1 -- 10.20.193.110:0/653310336 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f1e580048d0 con 0x7f1e5c13f020 2026-02-13T20:23:48.611 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e517fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:48.612 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e517fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:23:48.612 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e52ffd640 4 set_mon_vals no callback set 2026-02-13T20:23:48.612 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e517fa640 10 monclient: dump: 2026-02-13T20:23:48.612 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:48.612 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:48.612 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.612 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.612 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:48.612 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:48.612 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:48.612 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:48.612 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:48.612 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:48.612 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e62dee640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:23:48.613 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.591+0000 7f1e62dee640 1 -- 10.20.193.110:0/653310336 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1e5c0008d0 con 0x7f1e5c092020 2026-02-13T20:23:48.613 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.592+0000 7f1e517fa640 1 -- 10.20.193.110:0/653310336 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f1e58004a30 con 0x7f1e5c13f020 2026-02-13T20:23:48.613 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.592+0000 7f1e517fa640 1 -- 10.20.193.110:0/653310336 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(588..588 src has 1..588) ==== 3871+0+0 (unknown 1980572098 0 0) 0x7f1e5804e660 con 0x7f1e5c13f020 2026-02-13T20:23:48.613 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.592+0000 7f1e517fa640 1 -- 10.20.193.110:0/653310336 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 420405611 0 0) 0x7f1e5c0008d0 con 0x7f1e5c092020 2026-02-13T20:23:48.613 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.592+0000 7f1e517fa640 10 monclient(hunting): _negotiate 2026-02-13T20:23:48.613 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.592+0000 7f1e517fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:48.613 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.592+0000 7f1e517fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:48.613 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.592+0000 7f1e517fa640 10 monclient(hunting): my global_id is 94544 2026-02-13T20:23:48.613 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.592+0000 7f1e517fa640 1 -- 10.20.193.110:0/653310336 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e5c05d320 con 0x7f1e5c092020 2026-02-13T20:23:48.613 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.592+0000 7f1e517fa640 1 -- 10.20.193.110:0/653310336 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2869837425 0 0) 0x7f1e5c05d320 con 0x7f1e5c092020 2026-02-13T20:23:48.613 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.592+0000 7f1e53fff640 10 monclient: get_auth_request con 0x7f1e2c03fa50 auth_method 0 2026-02-13T20:23:48.613 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.592+0000 7f1e517fa640 1 -- 10.20.193.110:0/653310336 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1e5c0008d0 con 0x7f1e5c092020 2026-02-13T20:23:48.613 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.592+0000 7f1e517fa640 1 -- 10.20.193.110:0/653310336 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f1e4c004a90 con 0x7f1e5c092020 2026-02-13T20:23:48.613 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.592+0000 7f1e517fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:48.614 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.592+0000 7f1e517fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:23:48.614 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.592+0000 7f1e517fa640 10 monclient: dump: 2026-02-13T20:23:48.614 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:48.614 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:48.614 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.614 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.614 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:48.614 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:48.614 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:48.614 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:48.614 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:48.614 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:48.614 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.592+0000 7f1e517fa640 1 -- 10.20.193.110:0/653310336 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 386613820 0 0) 0x7f1e5c0008d0 con 0x7f1e5c092020 2026-02-13T20:23:48.614 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.592+0000 7f1e517fa640 1 -- 10.20.193.110:0/653310336 --> v1:10.20.193.110:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1e5c08b450 con 0x7f1e5c092020 2026-02-13T20:23:48.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.592+0000 7f1e517fa640 1 -- 10.20.193.110:0/653310336 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f1e4c004ed0 con 0x7f1e5c092020 2026-02-13T20:23:48.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.592+0000 7f1e517fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:23:48.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.592+0000 7f1e517fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:23:48.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.592+0000 7f1e517fa640 1 -- 10.20.193.110:0/653310336 >> v1:10.20.193.110:6790/0 conn(0x7f1e5c092020 legacy=0x7f1e5c08eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:48.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.592+0000 7f1e517fa640 1 -- 10.20.193.110:0/653310336 >> v1:10.20.193.110:6790/0 conn(0x7f1e5c092020 legacy=0x7f1e5c08eca0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:23:48.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.596+0000 7f1e62dee640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:23:48.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.596+0000 7f1e62dee640 1 -- 10.20.193.110:0/653310336 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1e5c152ab0 con 0x7f1e5c1526e0 2026-02-13T20:23:48.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.596+0000 7f1e517fa640 1 -- 10.20.193.110:0/653310336 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1242003215 0 0) 0x7f1e5c152ab0 con 0x7f1e5c1526e0 2026-02-13T20:23:48.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.596+0000 7f1e517fa640 10 monclient(hunting): _negotiate 2026-02-13T20:23:48.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.596+0000 7f1e517fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:48.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.596+0000 7f1e517fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:48.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.596+0000 7f1e517fa640 10 monclient(hunting): my global_id is 94547 2026-02-13T20:23:48.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.596+0000 7f1e517fa640 1 -- 10.20.193.110:0/653310336 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e5c0008d0 con 0x7f1e5c1526e0 2026-02-13T20:23:48.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.596+0000 7f1e517fa640 1 -- 10.20.193.110:0/653310336 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1781137664 0 0) 0x7f1e5c0008d0 con 0x7f1e5c1526e0 2026-02-13T20:23:48.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.596+0000 7f1e517fa640 1 -- 10.20.193.110:0/653310336 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1e5c152ab0 con 0x7f1e5c1526e0 2026-02-13T20:23:48.615 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.596+0000 7f1e517fa640 1 -- 10.20.193.110:0/653310336 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f1e4c005630 con 0x7f1e5c1526e0 2026-02-13T20:23:48.616 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.596+0000 7f1e517fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:48.616 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.596+0000 7f1e517fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:23:48.616 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.596+0000 7f1e517fa640 10 monclient: dump: 2026-02-13T20:23:48.616 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:48.616 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:48.616 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.616 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.616 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:48.616 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:48.616 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:48.616 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:48.616 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:48.616 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:48.616 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.596+0000 7f1e517fa640 1 -- 10.20.193.110:0/653310336 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 190878619 0 0) 0x7f1e5c152ab0 con 0x7f1e5c1526e0 2026-02-13T20:23:48.616 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.596+0000 7f1e517fa640 1 -- 10.20.193.110:0/653310336 --> v1:10.20.193.110:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1e5c058410 con 0x7f1e5c1526e0 2026-02-13T20:23:48.617 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.597+0000 7f1e517fa640 1 -- 10.20.193.110:0/653310336 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4516 (unknown 0 0 344457177) 0x7f1e4c006af0 con 0x7f1e5c1526e0 2026-02-13T20:23:48.617 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.597+0000 7f1e517fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:23:48.617 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.597+0000 7f1e517fa640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:23:48.617 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.597+0000 7f1e517fa640 1 -- 10.20.193.110:0/653310336 >> v1:10.20.193.110:6790/0 conn(0x7f1e5c1526e0 legacy=0x7f1e5c08f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:48.617 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.597+0000 7f1e517fa640 1 -- 10.20.193.110:0/653310336 >> v1:10.20.193.110:6790/0 conn(0x7f1e5c1526e0 legacy=0x7f1e5c08f3b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:23:48.617 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:23:48.617 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:23:48.617 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:23:48.617 INFO:teuthology.orchestra.run.trial110.stdout: "state": "leader", 2026-02-13T20:23:48.617 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 46, 2026-02-13T20:23:48.618 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 500219, 2026-02-13T20:23:48.618 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:23:48.618 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:23:48.618 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:23:48.618 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:23:48.618 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:23:48.618 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 1, 2026-02-13T20:23:48.618 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:23:48.618 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:23:48.618 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:23:48.618 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:23:48.618 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:23:48.618 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:23:48.618 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:23:48.618 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:23:48.619 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:23:48.619 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:23:48.619 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:23:48.619 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:23:48.619 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:23:48.619 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:23:48.619 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:23:48.619 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:23:48.619 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:23:48.619 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:23:48.619 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:23:48.619 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:23:48.619 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:23:48.619 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:23:48.619 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:23:48.620 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:23:48.620 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:23:48.620 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:23:48.620 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:23:48.620 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:23:48.620 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:23:48.620 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:23:48.620 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:23:48.620 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:23:48.620 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:23:48.620 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:48.620 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:23:48.620 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:23:48.620 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:23:48.620 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:23:48.621 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:23:48.621 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:23:48.621 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:23:48.621 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:23:48.621 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:23:48.621 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:23:48.621 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:23:48.621 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:23:48.621 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:23:48.621 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:23:48.621 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:23:48.621 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:23:48.621 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:23:48.621 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:23:48.621 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:23:48.622 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:23:48.622 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:23:48.622 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:23:48.622 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:23:48.622 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:23:48.622 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:23:48.622 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:23:48.622 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:23:48.622 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:23:48.622 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:23:48.622 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:23:48.622 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:23:48.622 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:23:48.622 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:48.622 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:23:48.622 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:48.623 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:23:48.623 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:23:48.623 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:23:48.623 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:23:48.623 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:48.623 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:23:48.623 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:23:48.623 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:23:48.623 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:23:48.623 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:23:48.623 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:48.623 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:23:48.623 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:23:48.623 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:23:48.623 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:23:48.623 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:23:48.623 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:23:48.624 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:48.624 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:48.624 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:23:48.624 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:23:48.624 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:23:48.624 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:23:48.624 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:48.624 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:23:48.624 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:23:48.624 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:23:48.624 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:23:48.624 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:23:48.624 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:48.624 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:23:48.624 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:23:48.624 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:23:48.624 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:23:48.624 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:23:48.625 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:23:48.625 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:48.625 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:48.625 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:23:48.625 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:23:48.625 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:23:48.625 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:23:48.625 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:48.625 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:23:48.625 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:23:48.625 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:23:48.625 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:23:48.625 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:23:48.625 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:48.625 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:23:48.625 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:23:48.625 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:23:48.625 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:23:48.625 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:23:48.626 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:23:48.626 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:23:48.626 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:23:48.626 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:48.626 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:23:48.626 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:23:48.626 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:48.626 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:23:48.626 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:23:48.626 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:23:48.626 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:23:48.626 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:23:48.626 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:23:48.626 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:48.626 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:23:48.626 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:23:48.626 INFO:teuthology.orchestra.run.trial110.stdout: "num": 5 2026-02-13T20:23:48.626 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:23:48.627 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:23:48.627 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:23:48.627 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:48.627 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:23:48.627 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:23:48.627 INFO:teuthology.orchestra.run.trial110.stdout: "num": 3 2026-02-13T20:23:48.627 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:23:48.627 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:23:48.627 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:48.627 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:23:48.627 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:23:48.628 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.597+0000 7f1e62dee640 1 -- 10.20.193.110:0/653310336 >> v1:10.20.193.188:6812/1623052694 conn(0x7f1e2c03fa50 legacy=0x7f1e2c05ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:48.628 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.597+0000 7f1e62dee640 10 monclient: shutdown 2026-02-13T20:23:48.628 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.597+0000 7f1e62dee640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:23:48.628 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.597+0000 7f1e62dee640 1 -- 10.20.193.110:0/653310336 >> v1:10.20.193.110:6789/0 conn(0x7f1e5c13f020 legacy=0x7f1e5c195160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:48.628 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.597+0000 7f1e61364640 1 -- 10.20.193.110:0/653310336 reap_dead start 2026-02-13T20:23:48.628 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.597+0000 7f1e61364640 1 -- 10.20.193.110:0/653310336 reap_dead start 2026-02-13T20:23:48.628 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.597+0000 7f1e62dee640 1 -- 10.20.193.110:0/653310336 shutdown_connections 2026-02-13T20:23:48.628 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.597+0000 7f1e62dee640 1 -- 10.20.193.110:0/653310336 >> 10.20.193.110:0/653310336 conn(0x7f1e5c054e90 msgr2=0x7f1e5c088e30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:23:48.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.597+0000 7f1e62dee640 1 -- 10.20.193.110:0/653310336 shutdown_connections 2026-02-13T20:23:48.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.597+0000 7f1e62dee640 1 -- 10.20.193.110:0/653310336 wait complete. 2026-02-13T20:23:48.629 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:23:48.629 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-13T20:23:48.629 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T20:23:48.695 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.695+0000 7fb76cc5b640 10 monclient: get_monmap_and_config 2026-02-13T20:23:48.696 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.695+0000 7fb76cc5b640 10 monclient: build_initial_monmap 2026-02-13T20:23:48.696 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.695+0000 7fb76cc5b640 10 monclient: monmap: 2026-02-13T20:23:48.696 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:23:48.696 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:48.696 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:23:48.695831+0000 2026-02-13T20:23:48.696 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:23:48.695831+0000 2026-02-13T20:23:48.696 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:23:48.696 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:48.696 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:23:48.696 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:23:48.697 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:23:48.697 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:48.703 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.695+0000 7fb76cc5b640 1 Processor -- start 2026-02-13T20:23:48.703 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.695+0000 7fb76cc5b640 1 -- start start 2026-02-13T20:23:48.703 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.695+0000 7fb76cc5b640 10 monclient: init 2026-02-13T20:23:48.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb76cc5b640 10 monclient: _reopen_session rank -1 2026-02-13T20:23:48.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb76cc5b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:23:48.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb76cc5b640 10 monclient(hunting): picked mon.noname-c con 0x7fb7681401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:23:48.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb76cc5b640 10 monclient(hunting): picked mon.noname-b con 0x7fb768092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:23:48.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb76cc5b640 10 monclient(hunting): picked mon.noname-a con 0x7fb768091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:23:48.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb76cc5b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb76808b730 con 0x7fb768091950 2026-02-13T20:23:48.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb76cc5b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb76805c5b0 con 0x7fb7681401c0 2026-02-13T20:23:48.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb76cc5b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb76808bcf0 con 0x7fb768092020 2026-02-13T20:23:48.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb76cc5b640 10 monclient(hunting): _renew_subs 2026-02-13T20:23:48.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb76cc5b640 10 monclient(hunting): authenticate will time out at 1390.386278s 2026-02-13T20:23:48.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb766d76640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fb768091950 0x7fb7681a2a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:49332/0 (socket says 10.20.193.110:49332) 2026-02-13T20:23:48.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb766d76640 1 -- 10.20.193.110:0/2001927813 learned_addr learned my addr 10.20.193.110:0/2001927813 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:23:48.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb765573640 1 -- 10.20.193.110:0/2001927813 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 899194371 0 0) 0x7fb76808bcf0 con 0x7fb768092020 2026-02-13T20:23:48.704 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb765573640 10 monclient(hunting): _negotiate 2026-02-13T20:23:48.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb765573640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:48.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb765573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:48.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb765573640 10 monclient(hunting): my global_id is 94550 2026-02-13T20:23:48.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb765573640 1 -- 10.20.193.110:0/2001927813 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7540035e0 con 0x7fb768092020 2026-02-13T20:23:48.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb765573640 1 -- 10.20.193.110:0/2001927813 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1584639131 0 0) 0x7fb76808b730 con 0x7fb768091950 2026-02-13T20:23:48.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb765573640 10 monclient(hunting): _negotiate 2026-02-13T20:23:48.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb765573640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:48.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb765573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:48.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb765573640 10 monclient(hunting): my global_id is 124257 2026-02-13T20:23:48.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb765573640 1 -- 10.20.193.110:0/2001927813 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb76808bcf0 con 0x7fb768091950 2026-02-13T20:23:48.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb765573640 1 -- 10.20.193.110:0/2001927813 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2111177052 0 0) 0x7fb76805c5b0 con 0x7fb7681401c0 2026-02-13T20:23:48.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb765573640 10 monclient(hunting): _negotiate 2026-02-13T20:23:48.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb765573640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:48.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb765573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:48.705 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb765573640 10 monclient(hunting): my global_id is 134158 2026-02-13T20:23:48.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb765573640 1 -- 10.20.193.110:0/2001927813 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb76808b730 con 0x7fb7681401c0 2026-02-13T20:23:48.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb765573640 1 -- 10.20.193.110:0/2001927813 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4133446057 0 0) 0x7fb7540035e0 con 0x7fb768092020 2026-02-13T20:23:48.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb765573640 1 -- 10.20.193.110:0/2001927813 >> v1:10.20.193.188:6789/0 conn(0x7fb7681401c0 legacy=0x7fb768091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:48.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb765573640 1 -- 10.20.193.110:0/2001927813 >> v1:10.20.193.110:6789/0 conn(0x7fb768091950 legacy=0x7fb7681a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:48.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb765573640 10 monclient: _finish_hunting 0 2026-02-13T20:23:48.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb765573640 1 monclient: found mon.noname-b 2026-02-13T20:23:48.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb765573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:23:48.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb765573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:23:48.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb765573640 1 -- 10.20.193.110:0/2001927813 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb768140590 con 0x7fb768092020 2026-02-13T20:23:48.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb765573640 10 monclient: _finish_auth 0 2026-02-13T20:23:48.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb765573640 10 monclient: _check_auth_tickets 2026-02-13T20:23:48.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb765573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:23:48.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb765573640 1 -- 10.20.193.110:0/2001927813 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb750002dd0 con 0x7fb768092020 2026-02-13T20:23:48.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb765573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:48.706 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb765573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:23:48.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb765573640 10 monclient: dump: 2026-02-13T20:23:48.707 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:48.707 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:48.707 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.707 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.707 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:48.707 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:48.707 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:48.707 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:48.707 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:48.707 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:48.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb76cc5b640 5 monclient: authenticate success, global_id 94550 2026-02-13T20:23:48.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb76cc5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:23:48.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb765573640 1 -- 10.20.193.110:0/2001927813 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb750002f30 con 0x7fb768092020 2026-02-13T20:23:48.707 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb765573640 10 monclient: handle_config config(0 keys) 2026-02-13T20:23:48.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb76cc5b640 10 monclient: get_monmap_and_config success 2026-02-13T20:23:48.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb76cc5b640 4 set_mon_vals no callback set 2026-02-13T20:23:48.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb765573640 1 -- 10.20.193.110:0/2001927813 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb750003340 con 0x7fb768092020 2026-02-13T20:23:48.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb765573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:48.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb765573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:23:48.708 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.696+0000 7fb765573640 10 monclient: dump: 2026-02-13T20:23:48.708 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:48.708 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:48.708 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.708 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.708 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:48.708 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:48.708 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:48.708 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:48.708 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:48.708 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:48.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.697+0000 7fb76cc5b640 10 monclient: shutdown 2026-02-13T20:23:48.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.697+0000 7fb76cc5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:23:48.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.697+0000 7fb76cc5b640 1 -- 10.20.193.110:0/2001927813 >> v1:10.20.193.110:6790/0 conn(0x7fb768092020 legacy=0x7fb7681812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:48.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.697+0000 7fb76cc5b640 1 -- 10.20.193.110:0/2001927813 shutdown_connections 2026-02-13T20:23:48.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.697+0000 7fb76cc5b640 1 -- 10.20.193.110:0/2001927813 >> 10.20.193.110:0/2001927813 conn(0x7fb768054e90 msgr2=0x7fb768058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:23:48.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.697+0000 7fb76cc5b640 1 -- 10.20.193.110:0/2001927813 shutdown_connections 2026-02-13T20:23:48.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.697+0000 7fb76cc5b640 1 -- 10.20.193.110:0/2001927813 wait complete. 2026-02-13T20:23:48.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.697+0000 7fb76cc5b640 10 monclient: build_initial_monmap 2026-02-13T20:23:48.709 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.697+0000 7fb76cc5b640 10 monclient: monmap: 2026-02-13T20:23:48.709 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:23:48.709 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:23:48.709 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:23:48.709 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:23:48.709 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:23:48.710 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:23:48.710 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:23:48.710 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:23:48.710 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:23:48.710 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:48.710 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.697+0000 7fb76cc5b640 1 Processor -- start 2026-02-13T20:23:48.710 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.697+0000 7fb76cc5b640 1 -- start start 2026-02-13T20:23:48.710 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.697+0000 7fb76cc5b640 10 monclient: init 2026-02-13T20:23:48.710 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.697+0000 7fb76cc5b640 10 monclient: _reopen_session rank -1 2026-02-13T20:23:48.710 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.697+0000 7fb76cc5b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:23:48.710 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.697+0000 7fb76cc5b640 10 monclient(hunting): picked mon.noname-b con 0x7fb768091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:23:48.710 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.697+0000 7fb76cc5b640 10 monclient(hunting): picked mon.noname-c con 0x7fb7681401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:23:48.710 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.697+0000 7fb76cc5b640 10 monclient(hunting): picked mon.noname-a con 0x7fb768152e60 addr v1:10.20.193.110:6789/0 2026-02-13T20:23:48.710 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.697+0000 7fb76cc5b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb76812fad0 con 0x7fb768152e60 2026-02-13T20:23:48.710 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.697+0000 7fb76cc5b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7681323f0 con 0x7fb768091950 2026-02-13T20:23:48.711 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.697+0000 7fb76cc5b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb768131480 con 0x7fb7681401c0 2026-02-13T20:23:48.711 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.697+0000 7fb76cc5b640 10 monclient(hunting): _renew_subs 2026-02-13T20:23:48.711 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.697+0000 7fb76cc5b640 10 monclient(hunting): authenticate will time out at 1390.387977s 2026-02-13T20:23:48.711 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb766d76640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fb768152e60 0x7fb768194ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:49348/0 (socket says 10.20.193.110:49348) 2026-02-13T20:23:48.711 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb765d74640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fb7681401c0 0x7fb768152750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:44352/0 (socket says 10.20.193.110:44352) 2026-02-13T20:23:48.711 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb766d76640 1 -- 10.20.193.110:0/1903201503 learned_addr learned my addr 10.20.193.110:0/1903201503 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:23:48.711 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb74effd640 1 -- 10.20.193.110:0/1903201503 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2887449292 0 0) 0x7fb758003ad0 con 0x7fb768152e60 2026-02-13T20:23:48.711 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb74effd640 10 monclient(hunting): _negotiate 2026-02-13T20:23:48.711 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb74effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:48.711 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb74effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:48.711 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb74effd640 10 monclient(hunting): my global_id is 124260 2026-02-13T20:23:48.711 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb74effd640 1 -- 10.20.193.110:0/1903201503 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7340035e0 con 0x7fb768152e60 2026-02-13T20:23:48.711 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb74effd640 1 -- 10.20.193.110:0/1903201503 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3558471103 0 0) 0x7fb768131480 con 0x7fb7681401c0 2026-02-13T20:23:48.711 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb74effd640 10 monclient(hunting): _negotiate 2026-02-13T20:23:48.711 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb74effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:48.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb74effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:48.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb74effd640 10 monclient(hunting): my global_id is 94553 2026-02-13T20:23:48.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb74effd640 1 -- 10.20.193.110:0/1903201503 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb758003ad0 con 0x7fb7681401c0 2026-02-13T20:23:48.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb74effd640 1 -- 10.20.193.110:0/1903201503 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2758894439 0 0) 0x7fb7340035e0 con 0x7fb768152e60 2026-02-13T20:23:48.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb74effd640 1 -- 10.20.193.110:0/1903201503 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb768131480 con 0x7fb768152e60 2026-02-13T20:23:48.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb74effd640 1 -- 10.20.193.110:0/1903201503 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb758003cd0 con 0x7fb768152e60 2026-02-13T20:23:48.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb74effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:23:48.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb74effd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:23:48.712 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb74effd640 10 monclient(hunting): dump: 2026-02-13T20:23:48.712 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:48.712 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:48.712 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.712 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.712 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:48.712 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:48.713 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:48.713 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:48.713 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:48.713 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:48.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb74effd640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:23:48.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb74effd640 1 -- 10.20.193.110:0/1903201503 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2739310995 0 0) 0x7fb758003ad0 con 0x7fb7681401c0 2026-02-13T20:23:48.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb74effd640 1 -- 10.20.193.110:0/1903201503 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb7340035e0 con 0x7fb7681401c0 2026-02-13T20:23:48.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb74effd640 1 -- 10.20.193.110:0/1903201503 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb750003250 con 0x7fb7681401c0 2026-02-13T20:23:48.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb74effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:23:48.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb74effd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:23:48.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb74effd640 10 monclient(hunting): dump: 2026-02-13T20:23:48.713 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:48.713 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:48.713 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.713 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.713 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:48.714 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:48.714 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:48.714 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:48.714 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:48.714 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:48.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb74effd640 1 -- 10.20.193.110:0/1903201503 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 107281921 0 0) 0x7fb768131480 con 0x7fb768152e60 2026-02-13T20:23:48.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb74effd640 1 -- 10.20.193.110:0/1903201503 >> v1:10.20.193.110:6790/0 conn(0x7fb7681401c0 legacy=0x7fb768152750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:48.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb74effd640 1 -- 10.20.193.110:0/1903201503 >> v1:10.20.193.188:6789/0 conn(0x7fb768091950 legacy=0x7fb76813e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:48.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb74effd640 10 monclient: _finish_hunting 0 2026-02-13T20:23:48.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb74effd640 1 monclient: found mon.a 2026-02-13T20:23:48.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb74effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:23:48.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb74effd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:23:48.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb74effd640 1 -- 10.20.193.110:0/1903201503 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb768130090 con 0x7fb768152e60 2026-02-13T20:23:48.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb74effd640 10 monclient: _finish_auth 0 2026-02-13T20:23:48.714 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb74effd640 10 monclient: _check_auth_tickets 2026-02-13T20:23:48.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb74effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:23:48.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb76cc5b640 5 monclient: authenticate success, global_id 124260 2026-02-13T20:23:48.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb76cc5b640 10 monclient: _renew_subs 2026-02-13T20:23:48.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb76cc5b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:23:48.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb76cc5b640 1 -- 10.20.193.110:0/1903201503 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb768131b50 con 0x7fb768152e60 2026-02-13T20:23:48.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb76cc5b640 10 monclient: _renew_subs 2026-02-13T20:23:48.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb76cc5b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:23:48.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb76cc5b640 1 -- 10.20.193.110:0/1903201503 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb7681961e0 con 0x7fb768152e60 2026-02-13T20:23:48.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb74effd640 1 -- 10.20.193.110:0/1903201503 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb758005c30 con 0x7fb768152e60 2026-02-13T20:23:48.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb74effd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:23:48.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb74effd640 1 -- 10.20.193.110:0/1903201503 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb758005f50 con 0x7fb768152e60 2026-02-13T20:23:48.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb74effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:48.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb74effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:23:48.715 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb74effd640 10 monclient: dump: 2026-02-13T20:23:48.715 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:48.716 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:48.716 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.716 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.716 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:48.716 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:48.716 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:48.716 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:48.716 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:48.716 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:48.716 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb764d72640 4 set_mon_vals no callback set 2026-02-13T20:23:48.716 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb76cc5b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:23:48.716 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.698+0000 7fb76cc5b640 1 -- 10.20.193.110:0/1903201503 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb768131f80 con 0x7fb768092020 2026-02-13T20:23:48.716 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.699+0000 7fb74effd640 1 -- 10.20.193.110:0/1903201503 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fb758012bc0 con 0x7fb768152e60 2026-02-13T20:23:48.716 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.699+0000 7fb74effd640 1 -- 10.20.193.110:0/1903201503 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(588..588 src has 1..588) ==== 3871+0+0 (unknown 1980572098 0 0) 0x7fb75804f9b0 con 0x7fb768152e60 2026-02-13T20:23:48.716 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.699+0000 7fb74effd640 1 -- 10.20.193.110:0/1903201503 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 123117389 0 0) 0x7fb768131f80 con 0x7fb768092020 2026-02-13T20:23:48.716 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.699+0000 7fb74effd640 10 monclient(hunting): _negotiate 2026-02-13T20:23:48.717 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.699+0000 7fb74effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:48.717 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.699+0000 7fb74effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:48.717 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.699+0000 7fb74effd640 10 monclient(hunting): my global_id is 134164 2026-02-13T20:23:48.717 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.699+0000 7fb74effd640 1 -- 10.20.193.110:0/1903201503 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb768131480 con 0x7fb768092020 2026-02-13T20:23:48.717 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.699+0000 7fb765d74640 10 monclient: get_auth_request con 0x7fb73403faa0 auth_method 0 2026-02-13T20:23:48.717 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.699+0000 7fb74effd640 1 -- 10.20.193.110:0/1903201503 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3095334165 0 0) 0x7fb768131480 con 0x7fb768092020 2026-02-13T20:23:48.717 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.699+0000 7fb74effd640 1 -- 10.20.193.110:0/1903201503 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb768131f80 con 0x7fb768092020 2026-02-13T20:23:48.717 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.699+0000 7fb74effd640 1 -- 10.20.193.110:0/1903201503 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb75c002f00 con 0x7fb768092020 2026-02-13T20:23:48.717 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.699+0000 7fb74effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:48.717 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.699+0000 7fb74effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:23:48.717 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.699+0000 7fb74effd640 10 monclient: dump: 2026-02-13T20:23:48.717 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:48.717 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:48.717 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.717 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.718 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:48.718 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:48.718 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:48.718 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:48.718 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:48.718 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:48.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.699+0000 7fb74effd640 1 -- 10.20.193.110:0/1903201503 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3538346651 0 0) 0x7fb768131f80 con 0x7fb768092020 2026-02-13T20:23:48.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.699+0000 7fb74effd640 1 -- 10.20.193.110:0/1903201503 --> v1:10.20.193.188:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb76808b450 con 0x7fb768092020 2026-02-13T20:23:48.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.699+0000 7fb74effd640 1 -- 10.20.193.110:0/1903201503 <== mon.1 v1:10.20.193.188:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fb75c0033a0 con 0x7fb768092020 2026-02-13T20:23:48.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.699+0000 7fb74effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:23:48.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.699+0000 7fb74effd640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:23:48.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.699+0000 7fb74effd640 1 -- 10.20.193.110:0/1903201503 >> v1:10.20.193.188:6789/0 conn(0x7fb768092020 legacy=0x7fb76808eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:48.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.699+0000 7fb74effd640 1 -- 10.20.193.110:0/1903201503 >> v1:10.20.193.188:6789/0 conn(0x7fb768092020 legacy=0x7fb76808eca0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:23:48.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.703+0000 7fb76cc5b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:23:48.718 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.703+0000 7fb76cc5b640 1 -- 10.20.193.110:0/1903201503 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb768132250 con 0x7fb76808f3b0 2026-02-13T20:23:48.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.703+0000 7fb74effd640 1 -- 10.20.193.110:0/1903201503 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2960286240 0 0) 0x7fb7681323f0 con 0x7fb76808f3b0 2026-02-13T20:23:48.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.703+0000 7fb74effd640 10 monclient(hunting): _negotiate 2026-02-13T20:23:48.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.703+0000 7fb74effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:48.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.703+0000 7fb74effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:48.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.703+0000 7fb74effd640 10 monclient(hunting): my global_id is 134167 2026-02-13T20:23:48.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.703+0000 7fb74effd640 1 -- 10.20.193.110:0/1903201503 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb768131f80 con 0x7fb76808f3b0 2026-02-13T20:23:48.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.704+0000 7fb74effd640 1 -- 10.20.193.110:0/1903201503 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 692404484 0 0) 0x7fb768131f80 con 0x7fb76808f3b0 2026-02-13T20:23:48.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.704+0000 7fb74effd640 1 -- 10.20.193.110:0/1903201503 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb7681323f0 con 0x7fb76808f3b0 2026-02-13T20:23:48.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.704+0000 7fb74effd640 1 -- 10.20.193.110:0/1903201503 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb75c003b20 con 0x7fb76808f3b0 2026-02-13T20:23:48.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.704+0000 7fb74effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:48.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.704+0000 7fb74effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:23:48.720 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.704+0000 7fb74effd640 10 monclient: dump: 2026-02-13T20:23:48.720 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:48.720 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:48.721 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.721 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.721 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:48.721 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:48.721 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:48.721 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:48.721 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:48.721 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:48.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.704+0000 7fb74effd640 1 -- 10.20.193.110:0/1903201503 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2368903107 0 0) 0x7fb7681323f0 con 0x7fb76808f3b0 2026-02-13T20:23:48.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.704+0000 7fb74effd640 1 -- 10.20.193.110:0/1903201503 --> v1:10.20.193.188:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb76812fad0 con 0x7fb76808f3b0 2026-02-13T20:23:48.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.704+0000 7fb74effd640 1 -- 10.20.193.110:0/1903201503 <== mon.1 v1:10.20.193.188:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4513 (unknown 0 0 2817041852) 0x7fb75c003e20 con 0x7fb76808f3b0 2026-02-13T20:23:48.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.704+0000 7fb74effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:23:48.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.704+0000 7fb74effd640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:23:48.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.704+0000 7fb74effd640 1 -- 10.20.193.110:0/1903201503 >> v1:10.20.193.188:6789/0 conn(0x7fb76808f3b0 legacy=0x7fb7681974a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:48.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.704+0000 7fb74effd640 1 -- 10.20.193.110:0/1903201503 >> v1:10.20.193.188:6789/0 conn(0x7fb76808f3b0 legacy=0x7fb7681974a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:23:48.722 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:23:48.722 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:23:48.722 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:23:48.722 INFO:teuthology.orchestra.run.trial110.stdout: "state": "peon", 2026-02-13T20:23:48.722 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 46, 2026-02-13T20:23:48.722 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 31417, 2026-02-13T20:23:48.722 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:23:48.722 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:23:48.722 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:23:48.722 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:23:48.723 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:23:48.723 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 2, 2026-02-13T20:23:48.723 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:23:48.723 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:23:48.723 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:23:48.723 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:23:48.723 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:23:48.723 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:23:48.723 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:23:48.723 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:23:48.723 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:23:48.723 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:23:48.723 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:23:48.723 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:23:48.723 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:23:48.723 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:23:48.724 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:23:48.724 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:23:48.724 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:23:48.724 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:23:48.724 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:23:48.724 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:23:48.724 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:23:48.724 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:23:48.724 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:23:48.724 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:23:48.724 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:23:48.724 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:23:48.724 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:23:48.724 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:23:48.724 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:23:48.724 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:23:48.725 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:23:48.725 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:23:48.725 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:23:48.725 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:48.725 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:23:48.725 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:23:48.725 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:23:48.725 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:23:48.725 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:23:48.725 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:23:48.725 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:23:48.725 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:23:48.725 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:23:48.725 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:23:48.726 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:23:48.726 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:23:48.726 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:23:48.726 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:23:48.726 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:23:48.726 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:23:48.726 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:23:48.726 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:23:48.726 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:23:48.726 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:23:48.726 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:23:48.726 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:23:48.726 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:23:48.726 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:23:48.726 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:23:48.726 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:23:48.726 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:23:48.726 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:23:48.726 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:23:48.727 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:23:48.727 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:23:48.727 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:23:48.727 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:48.727 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:23:48.727 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:48.727 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:23:48.727 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:23:48.727 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:23:48.727 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:23:48.727 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:48.727 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:23:48.727 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:23:48.727 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:23:48.727 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:23:48.727 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:23:48.727 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:48.727 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:23:48.728 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:23:48.728 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:23:48.728 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:23:48.728 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:23:48.728 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:23:48.728 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:48.728 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:48.728 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:23:48.728 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:23:48.728 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:23:48.728 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:23:48.728 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:48.728 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:23:48.728 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:23:48.728 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:23:48.728 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:23:48.728 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:23:48.728 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:48.728 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:23:48.729 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:23:48.729 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:23:48.729 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:23:48.729 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:23:48.729 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:23:48.729 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:48.729 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:48.729 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:23:48.729 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:23:48.729 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:23:48.729 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:23:48.729 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:48.729 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:23:48.729 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:23:48.729 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:23:48.729 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:23:48.729 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:23:48.729 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:48.729 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:23:48.730 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:23:48.730 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:23:48.730 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:23:48.730 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:23:48.730 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:23:48.730 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:23:48.730 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:23:48.730 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:48.730 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:23:48.730 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:23:48.730 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:48.730 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:23:48.730 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:23:48.730 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:23:48.730 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:23:48.730 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:23:48.730 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:23:48.730 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:48.730 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:23:48.730 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:23:48.731 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:23:48.731 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:23:48.731 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:23:48.731 INFO:teuthology.orchestra.run.trial110.stdout: "mgr": [ 2026-02-13T20:23:48.731 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:23:48.731 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:23:48.731 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:23:48.731 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:23:48.731 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:23:48.731 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:23:48.731 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:23:48.731 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:23:48.731 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:23:48.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.704+0000 7fb76cc5b640 1 -- 10.20.193.110:0/1903201503 >> v1:10.20.193.188:6812/1623052694 conn(0x7fb73403faa0 legacy=0x7fb73405ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:48.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.704+0000 7fb76cc5b640 10 monclient: shutdown 2026-02-13T20:23:48.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.704+0000 7fb76cc5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:23:48.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.704+0000 7fb76cc5b640 1 -- 10.20.193.110:0/1903201503 >> v1:10.20.193.110:6789/0 conn(0x7fb768152e60 legacy=0x7fb768194ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:48.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.704+0000 7fb766d76640 1 -- 10.20.193.110:0/1903201503 reap_dead start 2026-02-13T20:23:48.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.704+0000 7fb766d76640 1 -- 10.20.193.110:0/1903201503 reap_dead start 2026-02-13T20:23:48.732 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.704+0000 7fb76cc5b640 1 -- 10.20.193.110:0/1903201503 shutdown_connections 2026-02-13T20:23:48.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.704+0000 7fb76cc5b640 1 -- 10.20.193.110:0/1903201503 >> 10.20.193.110:0/1903201503 conn(0x7fb768054e90 msgr2=0x7fb768088e30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:23:48.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.704+0000 7fb76cc5b640 1 -- 10.20.193.110:0/1903201503 shutdown_connections 2026-02-13T20:23:48.733 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.704+0000 7fb76cc5b640 1 -- 10.20.193.110:0/1903201503 wait complete. 2026-02-13T20:23:48.733 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:23:48.733 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2026-02-13T20:23:48.733 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-13T20:23:48.733 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2026-02-13T20:23:48.733 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2026-02-13T20:23:48.733 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-13T20:23:48.734 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T20:23:48.742 INFO:tasks.ceph.mon.b:Stopped 2026-02-13T20:23:48.742 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-13T20:23:48.742 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T20:23:48.807 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.806+0000 7f9f3a10c640 10 monclient: get_monmap_and_config 2026-02-13T20:23:48.807 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.806+0000 7f9f3a10c640 10 monclient: build_initial_monmap 2026-02-13T20:23:48.807 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.806+0000 7f9f3a10c640 10 monclient: monmap: 2026-02-13T20:23:48.807 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:23:48.807 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:48.807 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:23:48.807315+0000 2026-02-13T20:23:48.807 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:23:48.807315+0000 2026-02-13T20:23:48.808 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:23:48.808 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:48.808 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:23:48.808 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:23:48.808 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:23:48.808 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:48.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.807+0000 7f9f3a10c640 1 Processor -- start 2026-02-13T20:23:48.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.807+0000 7f9f3a10c640 1 -- start start 2026-02-13T20:23:48.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.807+0000 7f9f3a10c640 10 monclient: init 2026-02-13T20:23:48.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.807+0000 7f9f3a10c640 10 monclient: _reopen_session rank -1 2026-02-13T20:23:48.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.807+0000 7f9f3a10c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:23:48.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.807+0000 7f9f3a10c640 10 monclient(hunting): picked mon.noname-a con 0x7f9f341401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:23:48.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.807+0000 7f9f3a10c640 10 monclient(hunting): picked mon.noname-b con 0x7f9f34092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:23:48.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.807+0000 7f9f3a10c640 10 monclient(hunting): picked mon.noname-c con 0x7f9f34091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:23:48.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.807+0000 7f9f3a10c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f3408b730 con 0x7f9f341401c0 2026-02-13T20:23:48.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.807+0000 7f9f3a10c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f3405c5b0 con 0x7f9f34091950 2026-02-13T20:23:48.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.807+0000 7f9f3a10c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f3408bcf0 con 0x7f9f34092020 2026-02-13T20:23:48.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.807+0000 7f9f3a10c640 10 monclient(hunting): _renew_subs 2026-02-13T20:23:48.816 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.807+0000 7f9f3a10c640 10 monclient(hunting): authenticate will time out at 1390.497656s 2026-02-13T20:23:48.816 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.807+0000 7f9f32ffd640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f9f34092020 0x7f9f341812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:44368/0 (socket says 10.20.193.110:44368) 2026-02-13T20:23:48.816 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.807+0000 7f9f32ffd640 1 -- 10.20.193.110:0/1656851911 learned_addr learned my addr 10.20.193.110:0/1656851911 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:23:48.816 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.807+0000 7f9f33fff640 1 -- 10.20.193.110:0/1656851911 >> v1:10.20.193.188:6789/0 conn(0x7f9f34091950 legacy=0x7f9f341a2a20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:23:48.816 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.807+0000 7f9f327fc640 1 -- 10.20.193.110:0/1656851911 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2093011664 0 0) 0x7f9f3408b730 con 0x7f9f341401c0 2026-02-13T20:23:48.816 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.807+0000 7f9f327fc640 10 monclient(hunting): _negotiate 2026-02-13T20:23:48.816 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.807+0000 7f9f327fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:48.816 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.807+0000 7f9f327fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:48.816 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.807+0000 7f9f327fc640 10 monclient(hunting): my global_id is 124263 2026-02-13T20:23:48.816 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.807+0000 7f9f327fc640 1 -- 10.20.193.110:0/1656851911 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f180035e0 con 0x7f9f341401c0 2026-02-13T20:23:48.816 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.808+0000 7f9f327fc640 1 -- 10.20.193.110:0/1656851911 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1207299211 0 0) 0x7f9f3408bcf0 con 0x7f9f34092020 2026-02-13T20:23:48.816 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.808+0000 7f9f327fc640 10 monclient(hunting): _negotiate 2026-02-13T20:23:48.816 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.808+0000 7f9f327fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:48.816 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.808+0000 7f9f327fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:48.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.808+0000 7f9f327fc640 10 monclient(hunting): my global_id is 94556 2026-02-13T20:23:48.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.808+0000 7f9f327fc640 1 -- 10.20.193.110:0/1656851911 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f3408b730 con 0x7f9f34092020 2026-02-13T20:23:48.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.808+0000 7f9f327fc640 1 -- 10.20.193.110:0/1656851911 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 291904831 0 0) 0x7f9f180035e0 con 0x7f9f341401c0 2026-02-13T20:23:48.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.808+0000 7f9f327fc640 1 -- 10.20.193.110:0/1656851911 >> v1:10.20.193.110:6790/0 conn(0x7f9f34092020 legacy=0x7f9f341812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:48.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.808+0000 7f9f327fc640 1 -- 10.20.193.110:0/1656851911 >> v1:10.20.193.188:6789/0 conn(0x7f9f34091950 legacy=0x7f9f341a2a20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:23:48.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.808+0000 7f9f327fc640 10 monclient: _finish_hunting 0 2026-02-13T20:23:48.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.808+0000 7f9f327fc640 1 monclient: found mon.noname-a 2026-02-13T20:23:48.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.808+0000 7f9f327fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:23:48.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.808+0000 7f9f327fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:23:48.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.808+0000 7f9f327fc640 1 -- 10.20.193.110:0/1656851911 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f34140590 con 0x7f9f341401c0 2026-02-13T20:23:48.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.808+0000 7f9f327fc640 10 monclient: _finish_auth 0 2026-02-13T20:23:48.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.808+0000 7f9f327fc640 10 monclient: _check_auth_tickets 2026-02-13T20:23:48.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.808+0000 7f9f327fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:23:48.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.808+0000 7f9f327fc640 1 -- 10.20.193.110:0/1656851911 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f9f20002dd0 con 0x7f9f341401c0 2026-02-13T20:23:48.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.808+0000 7f9f3a10c640 5 monclient: authenticate success, global_id 124263 2026-02-13T20:23:48.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.808+0000 7f9f3a10c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:23:48.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.808+0000 7f9f327fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:48.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.808+0000 7f9f327fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:23:48.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.808+0000 7f9f327fc640 10 monclient: dump: 2026-02-13T20:23:48.818 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:48.818 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:48.818 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.818 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.818 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:48.818 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:48.818 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:48.818 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:48.818 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:48.818 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:48.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.808+0000 7f9f3a10c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:23:48.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.808+0000 7f9f327fc640 1 -- 10.20.193.110:0/1656851911 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9f20002fa0 con 0x7f9f341401c0 2026-02-13T20:23:48.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.808+0000 7f9f327fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:23:48.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.808+0000 7f9f327fc640 1 -- 10.20.193.110:0/1656851911 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f9f200033b0 con 0x7f9f341401c0 2026-02-13T20:23:48.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.808+0000 7f9f327fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:48.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.808+0000 7f9f327fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:23:48.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.808+0000 7f9f327fc640 10 monclient: dump: 2026-02-13T20:23:48.819 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:48.819 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:48.819 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.819 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.819 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:48.819 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:48.819 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:48.819 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:48.819 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:48.819 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:48.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.808+0000 7f9f3a10c640 10 monclient: get_monmap_and_config success 2026-02-13T20:23:48.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.808+0000 7f9f3a10c640 4 set_mon_vals no callback set 2026-02-13T20:23:48.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.808+0000 7f9f3a10c640 10 monclient: shutdown 2026-02-13T20:23:48.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.808+0000 7f9f3a10c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:23:48.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.808+0000 7f9f3a10c640 1 -- 10.20.193.110:0/1656851911 >> v1:10.20.193.110:6789/0 conn(0x7f9f341401c0 legacy=0x7f9f34091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:48.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.808+0000 7f9f3a10c640 1 -- 10.20.193.110:0/1656851911 shutdown_connections 2026-02-13T20:23:48.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.808+0000 7f9f3a10c640 1 -- 10.20.193.110:0/1656851911 >> 10.20.193.110:0/1656851911 conn(0x7f9f34054e90 msgr2=0x7f9f34058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:23:48.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.808+0000 7f9f3a10c640 1 -- 10.20.193.110:0/1656851911 shutdown_connections 2026-02-13T20:23:48.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.808+0000 7f9f3a10c640 1 -- 10.20.193.110:0/1656851911 wait complete. 2026-02-13T20:23:48.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.808+0000 7f9f3a10c640 10 monclient: build_initial_monmap 2026-02-13T20:23:48.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.808+0000 7f9f3a10c640 10 monclient: monmap: 2026-02-13T20:23:48.820 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:23:48.820 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:23:48.820 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:23:48.820 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:23:48.821 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:23:48.821 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:23:48.821 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:23:48.821 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:23:48.821 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:23:48.821 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:48.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f3a10c640 1 Processor -- start 2026-02-13T20:23:48.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f3a10c640 1 -- start start 2026-02-13T20:23:48.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f3a10c640 10 monclient: init 2026-02-13T20:23:48.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f3a10c640 10 monclient: _reopen_session rank -1 2026-02-13T20:23:48.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f3a10c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:23:48.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f3a10c640 10 monclient(hunting): picked mon.noname-a con 0x7f9f34091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:23:48.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f3a10c640 10 monclient(hunting): picked mon.noname-b con 0x7f9f341401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:23:48.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f3a10c640 10 monclient(hunting): picked mon.noname-c con 0x7f9f3412ee10 addr v1:10.20.193.110:6790/0 2026-02-13T20:23:48.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f3a10c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f3408c3c0 con 0x7f9f34091950 2026-02-13T20:23:48.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f3a10c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f34130610 con 0x7f9f341401c0 2026-02-13T20:23:48.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f3a10c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f3412d6b0 con 0x7f9f3412ee10 2026-02-13T20:23:48.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f3a10c640 10 monclient(hunting): _renew_subs 2026-02-13T20:23:48.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f3a10c640 10 monclient(hunting): authenticate will time out at 1390.499368s 2026-02-13T20:23:48.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f337fe640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f9f34091950 0x7f9f3412c890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:49378/0 (socket says 10.20.193.110:49378) 2026-02-13T20:23:48.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f337fe640 1 -- 10.20.193.110:0/1661713305 learned_addr learned my addr 10.20.193.110:0/1661713305 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:23:48.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f32ffd640 1 -- 10.20.193.110:0/1661713305 >> v1:10.20.193.188:6789/0 conn(0x7f9f341401c0 legacy=0x7f9f3412cfa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:23:48.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f0ffff640 1 -- 10.20.193.110:0/1661713305 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1375309168 0 0) 0x7f9f3408c3c0 con 0x7f9f34091950 2026-02-13T20:23:48.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f0ffff640 10 monclient(hunting): _negotiate 2026-02-13T20:23:48.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f0ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:48.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f0ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:48.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f0ffff640 10 monclient(hunting): my global_id is 124266 2026-02-13T20:23:48.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f0ffff640 1 -- 10.20.193.110:0/1661713305 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f040035e0 con 0x7f9f34091950 2026-02-13T20:23:48.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f0ffff640 1 -- 10.20.193.110:0/1661713305 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 667652962 0 0) 0x7f9f3412d6b0 con 0x7f9f3412ee10 2026-02-13T20:23:48.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f0ffff640 10 monclient(hunting): _negotiate 2026-02-13T20:23:48.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f0ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:48.823 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f0ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:48.823 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f0ffff640 10 monclient(hunting): my global_id is 94559 2026-02-13T20:23:48.823 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f0ffff640 1 -- 10.20.193.110:0/1661713305 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f3408c3c0 con 0x7f9f3412ee10 2026-02-13T20:23:48.823 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f0ffff640 1 -- 10.20.193.110:0/1661713305 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 260854636 0 0) 0x7f9f040035e0 con 0x7f9f34091950 2026-02-13T20:23:48.823 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f0ffff640 1 -- 10.20.193.110:0/1661713305 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9f3412d6b0 con 0x7f9f34091950 2026-02-13T20:23:48.823 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f0ffff640 1 -- 10.20.193.110:0/1661713305 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f9f20002d20 con 0x7f9f34091950 2026-02-13T20:23:48.823 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f0ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:23:48.823 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f0ffff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:23:48.823 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f0ffff640 10 monclient(hunting): dump: 2026-02-13T20:23:48.823 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:48.823 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:48.823 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.823 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.823 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:48.823 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:48.823 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:48.824 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:48.824 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:48.824 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:48.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f0ffff640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:23:48.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f0ffff640 1 -- 10.20.193.110:0/1661713305 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2746969748 0 0) 0x7f9f3408c3c0 con 0x7f9f3412ee10 2026-02-13T20:23:48.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f0ffff640 1 -- 10.20.193.110:0/1661713305 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9f040035e0 con 0x7f9f3412ee10 2026-02-13T20:23:48.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f0ffff640 1 -- 10.20.193.110:0/1661713305 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f9f280051b0 con 0x7f9f3412ee10 2026-02-13T20:23:48.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f0ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:23:48.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f0ffff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:23:48.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f0ffff640 10 monclient(hunting): dump: 2026-02-13T20:23:48.824 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:48.824 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:48.824 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.824 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.824 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:48.824 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:48.825 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:48.825 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:48.825 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:48.825 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:48.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f0ffff640 1 -- 10.20.193.110:0/1661713305 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1960256622 0 0) 0x7f9f3412d6b0 con 0x7f9f34091950 2026-02-13T20:23:48.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f0ffff640 1 -- 10.20.193.110:0/1661713305 >> v1:10.20.193.110:6790/0 conn(0x7f9f3412ee10 legacy=0x7f9f34193130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:48.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f0ffff640 1 -- 10.20.193.110:0/1661713305 >> v1:10.20.193.188:6789/0 conn(0x7f9f341401c0 legacy=0x7f9f3412cfa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T20:23:48.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f0ffff640 10 monclient: _finish_hunting 0 2026-02-13T20:23:48.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f0ffff640 1 monclient: found mon.a 2026-02-13T20:23:48.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f0ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:23:48.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f0ffff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:23:48.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f0ffff640 1 -- 10.20.193.110:0/1661713305 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f3405d320 con 0x7f9f34091950 2026-02-13T20:23:48.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f0ffff640 10 monclient: _finish_auth 0 2026-02-13T20:23:48.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f0ffff640 10 monclient: _check_auth_tickets 2026-02-13T20:23:48.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f0ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:23:48.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f3a10c640 5 monclient: authenticate success, global_id 124266 2026-02-13T20:23:48.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f3a10c640 10 monclient: _renew_subs 2026-02-13T20:23:48.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f3a10c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:23:48.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f3a10c640 1 -- 10.20.193.110:0/1661713305 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9f3412f7a0 con 0x7f9f34091950 2026-02-13T20:23:48.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f3a10c640 10 monclient: _renew_subs 2026-02-13T20:23:48.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f3a10c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:23:48.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.809+0000 7f9f3a10c640 1 -- 10.20.193.110:0/1661713305 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9f34130330 con 0x7f9f34091950 2026-02-13T20:23:48.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.810+0000 7f9f0ffff640 1 -- 10.20.193.110:0/1661713305 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9f200038d0 con 0x7f9f34091950 2026-02-13T20:23:48.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.810+0000 7f9f0ffff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:23:48.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.810+0000 7f9f0ffff640 1 -- 10.20.193.110:0/1661713305 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f9f20003c70 con 0x7f9f34091950 2026-02-13T20:23:48.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.810+0000 7f9f0ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:48.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.810+0000 7f9f0ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:23:48.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.810+0000 7f9f0ffff640 10 monclient: dump: 2026-02-13T20:23:48.826 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:48.826 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:48.827 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.827 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:48.827 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:48.827 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:48.827 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:48.827 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:48.827 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:48.827 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:48.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.810+0000 7f9f31ffb640 4 set_mon_vals no callback set 2026-02-13T20:23:48.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.810+0000 7f9f3a10c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:23:48.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.810+0000 7f9f3a10c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:23:48.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.810+0000 7f9f3a10c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:23:48.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.810+0000 7f9f3a10c640 1 -- 10.20.193.110:0/1661713305 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f3412ff00 con 0x7f9f34091950 2026-02-13T20:23:48.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.810+0000 7f9f0ffff640 1 -- 10.20.193.110:0/1661713305 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f9f20003dd0 con 0x7f9f34091950 2026-02-13T20:23:48.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.810+0000 7f9f0ffff640 1 -- 10.20.193.110:0/1661713305 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(588..588 src has 1..588) ==== 3871+0+0 (unknown 1980572098 0 0) 0x7f9f2004ea20 con 0x7f9f34091950 2026-02-13T20:23:48.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.810+0000 7f9f32ffd640 10 monclient: get_auth_request con 0x7f9f0403fa20 auth_method 0 2026-02-13T20:23:48.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.812+0000 7f9f0ffff640 1 -- 10.20.193.110:0/1661713305 <== mon.0 v1:10.20.193.110:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f9f20017200 con 0x7f9f34091950 2026-02-13T20:23:48.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.812+0000 7f9f0ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:23:48.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.812+0000 7f9f0ffff640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:23:48.957 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.957+0000 7f9f3a10c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T20:23:48.958 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.957+0000 7f9f3a10c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T20:23:48.958 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.957+0000 7f9f3a10c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:23:48.958 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.957+0000 7f9f3a10c640 1 -- 10.20.193.110:0/1661713305 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9f3408ce20 con 0x7f9f34091950 2026-02-13T20:23:48.958 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.957+0000 7f9f0ffff640 1 -- 10.20.193.110:0/1661713305 <== mon.0 v1:10.20.193.110:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 229700755) 0x7f9f200169b0 con 0x7f9f34091950 2026-02-13T20:23:48.958 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.957+0000 7f9f0ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T20:23:48.958 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.957+0000 7f9f0ffff640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:23:48.959 INFO:teuthology.orchestra.run.trial110.stdout:{"election_epoch":46,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","modified":"2026-02-13T20:11:07.161192Z","created":"2026-02-13T20:11:07.161192Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6789","nonce":0}]},"addr":"10.20.193.110:6789/0","public_addr":"10.20.193.110:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161241+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6789","nonce":0}]},"addr":"10.20.193.188:6789/0","public_addr":"10.20.193.188:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161242+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6790","nonce":0}]},"addr":"10.20.193.110:6790/0","public_addr":"10.20.193.110:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161243+0000","crush_location":[]}]}} 2026-02-13T20:23:48.959 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.958+0000 7f9f3a10c640 1 -- 10.20.193.110:0/1661713305 >> v1:10.20.193.188:6812/1623052694 conn(0x7f9f0403fa20 legacy=0x7f9f0405fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:48.959 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.958+0000 7f9f3a10c640 10 monclient: shutdown 2026-02-13T20:23:48.960 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.958+0000 7f9f3a10c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:23:48.960 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.958+0000 7f9f3a10c640 1 -- 10.20.193.110:0/1661713305 >> v1:10.20.193.110:6789/0 conn(0x7f9f34091950 legacy=0x7f9f3412c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:48.960 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.958+0000 7f9f3a10c640 1 -- 10.20.193.110:0/1661713305 shutdown_connections 2026-02-13T20:23:48.960 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.958+0000 7f9f3a10c640 1 -- 10.20.193.110:0/1661713305 >> 10.20.193.110:0/1661713305 conn(0x7f9f34054e90 msgr2=0x7f9f3408de10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:23:48.960 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.958+0000 7f9f3a10c640 1 -- 10.20.193.110:0/1661713305 shutdown_connections 2026-02-13T20:23:48.960 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:48.958+0000 7f9f3a10c640 1 -- 10.20.193.110:0/1661713305 wait complete. 2026-02-13T20:23:51.968 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T20:23:52.033 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.033+0000 7f52cb5d4640 10 monclient: get_monmap_and_config 2026-02-13T20:23:52.033 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.033+0000 7f52cb5d4640 10 monclient: build_initial_monmap 2026-02-13T20:23:52.033 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.033+0000 7f52cb5d4640 10 monclient: monmap: 2026-02-13T20:23:52.033 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:23:52.034 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:52.034 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:23:52.033453+0000 2026-02-13T20:23:52.034 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:23:52.033453+0000 2026-02-13T20:23:52.034 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:23:52.034 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:52.034 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:23:52.034 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:23:52.034 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:23:52.034 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:52.041 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.033+0000 7f52cb5d4640 1 Processor -- start 2026-02-13T20:23:52.041 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.033+0000 7f52cb5d4640 1 -- start start 2026-02-13T20:23:52.041 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.033+0000 7f52cb5d4640 10 monclient: init 2026-02-13T20:23:52.041 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.033+0000 7f52cb5d4640 10 monclient: _reopen_session rank -1 2026-02-13T20:23:52.041 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.033+0000 7f52cb5d4640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:23:52.042 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.033+0000 7f52cb5d4640 10 monclient(hunting): picked mon.noname-c con 0x7f52c41401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:23:52.042 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.033+0000 7f52cb5d4640 10 monclient(hunting): picked mon.noname-a con 0x7f52c4092020 addr v1:10.20.193.110:6789/0 2026-02-13T20:23:52.042 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.033+0000 7f52cb5d4640 10 monclient(hunting): picked mon.noname-b con 0x7f52c4091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:23:52.042 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.033+0000 7f52cb5d4640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52c408b730 con 0x7f52c4092020 2026-02-13T20:23:52.042 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.033+0000 7f52cb5d4640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52c405c5b0 con 0x7f52c41401c0 2026-02-13T20:23:52.042 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.033+0000 7f52cb5d4640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52c408bcf0 con 0x7f52c4091950 2026-02-13T20:23:52.042 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.033+0000 7f52cb5d4640 10 monclient(hunting): _renew_subs 2026-02-13T20:23:52.042 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.033+0000 7f52cb5d4640 10 monclient(hunting): authenticate will time out at 1393.723812s 2026-02-13T20:23:52.042 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.033+0000 7f52c9349640 1 -- >> v1:10.20.193.188:6789/0 conn(0x7f52c41401c0 legacy=0x7f52c4091240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:23:52.042 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.033+0000 7f52c8b48640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f52c4092020 0x7f52c41812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:34216/0 (socket says 10.20.193.110:34216) 2026-02-13T20:23:52.042 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.033+0000 7f52c8b48640 1 -- 10.20.193.110:0/1561495957 learned_addr learned my addr 10.20.193.110:0/1561495957 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:23:52.042 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.034+0000 7f52b3fff640 1 -- 10.20.193.110:0/1561495957 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3606078635 0 0) 0x7f52c408bcf0 con 0x7f52c4091950 2026-02-13T20:23:52.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.034+0000 7f52b3fff640 10 monclient(hunting): _negotiate 2026-02-13T20:23:52.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.034+0000 7f52b3fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:52.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.034+0000 7f52b3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:52.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.034+0000 7f52b3fff640 10 monclient(hunting): my global_id is 94562 2026-02-13T20:23:52.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.034+0000 7f52b3fff640 1 -- 10.20.193.110:0/1561495957 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52ac0035e0 con 0x7f52c4091950 2026-02-13T20:23:52.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.034+0000 7f52b3fff640 1 -- 10.20.193.110:0/1561495957 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3156297101 0 0) 0x7f52ac0035e0 con 0x7f52c4091950 2026-02-13T20:23:52.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.034+0000 7f52b3fff640 1 -- 10.20.193.110:0/1561495957 >> v1:10.20.193.188:6789/0 conn(0x7f52c41401c0 legacy=0x7f52c4091240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:23:52.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.034+0000 7f52b3fff640 1 -- 10.20.193.110:0/1561495957 >> v1:10.20.193.110:6789/0 conn(0x7f52c4092020 legacy=0x7f52c41812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:52.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.034+0000 7f52b3fff640 10 monclient: _finish_hunting 0 2026-02-13T20:23:52.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.034+0000 7f52b3fff640 1 monclient: found mon.noname-b 2026-02-13T20:23:52.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.034+0000 7f52b3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:23:52.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.034+0000 7f52b3fff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:23:52.044 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.034+0000 7f52b3fff640 1 -- 10.20.193.110:0/1561495957 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52c4140590 con 0x7f52c4091950 2026-02-13T20:23:52.044 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.034+0000 7f52b3fff640 10 monclient: _finish_auth 0 2026-02-13T20:23:52.044 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.034+0000 7f52b3fff640 10 monclient: _check_auth_tickets 2026-02-13T20:23:52.044 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.034+0000 7f52b3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:23:52.044 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.034+0000 7f52b3fff640 1 -- 10.20.193.110:0/1561495957 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f52c0003eb0 con 0x7f52c4091950 2026-02-13T20:23:52.044 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.034+0000 7f52cb5d4640 5 monclient: authenticate success, global_id 94562 2026-02-13T20:23:52.044 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.034+0000 7f52b3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:52.044 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.034+0000 7f52b3fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:23:52.044 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.034+0000 7f52b3fff640 10 monclient: dump: 2026-02-13T20:23:52.044 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:52.044 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:52.044 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:52.045 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:52.045 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:52.045 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:52.045 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:52.045 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:52.045 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:52.045 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:52.045 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.034+0000 7f52cb5d4640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:23:52.045 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.034+0000 7f52b3fff640 1 -- 10.20.193.110:0/1561495957 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f52c0004080 con 0x7f52c4091950 2026-02-13T20:23:52.045 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.034+0000 7f52b3fff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:23:52.045 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.034+0000 7f52b3fff640 1 -- 10.20.193.110:0/1561495957 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f52c0004490 con 0x7f52c4091950 2026-02-13T20:23:52.045 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.034+0000 7f52cb5d4640 10 monclient: get_monmap_and_config success 2026-02-13T20:23:52.045 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.034+0000 7f52cb5d4640 4 set_mon_vals no callback set 2026-02-13T20:23:52.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.034+0000 7f52b3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:52.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.034+0000 7f52b3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:23:52.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.034+0000 7f52b3fff640 10 monclient: dump: 2026-02-13T20:23:52.046 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:52.046 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:52.046 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:52.046 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:52.046 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:52.046 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:52.046 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:52.046 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:52.046 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:52.047 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:52.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.034+0000 7f52cb5d4640 10 monclient: shutdown 2026-02-13T20:23:52.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.034+0000 7f52cb5d4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:23:52.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.034+0000 7f52cb5d4640 1 -- 10.20.193.110:0/1561495957 >> v1:10.20.193.110:6790/0 conn(0x7f52c4091950 legacy=0x7f52c41a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:52.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.034+0000 7f52cb5d4640 1 -- 10.20.193.110:0/1561495957 shutdown_connections 2026-02-13T20:23:52.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.034+0000 7f52cb5d4640 1 -- 10.20.193.110:0/1561495957 >> 10.20.193.110:0/1561495957 conn(0x7f52c4054e90 msgr2=0x7f52c4058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:23:52.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.034+0000 7f52cb5d4640 1 -- 10.20.193.110:0/1561495957 shutdown_connections 2026-02-13T20:23:52.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.034+0000 7f52cb5d4640 1 -- 10.20.193.110:0/1561495957 wait complete. 2026-02-13T20:23:52.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.035+0000 7f52cb5d4640 10 monclient: build_initial_monmap 2026-02-13T20:23:52.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.035+0000 7f52cb5d4640 10 monclient: monmap: 2026-02-13T20:23:52.047 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:23:52.047 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:23:52.048 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:23:52.048 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:23:52.048 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:23:52.048 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:23:52.048 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:23:52.048 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:23:52.048 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:23:52.048 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:52.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.035+0000 7f52cb5d4640 1 Processor -- start 2026-02-13T20:23:52.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.035+0000 7f52cb5d4640 1 -- start start 2026-02-13T20:23:52.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.035+0000 7f52cb5d4640 10 monclient: init 2026-02-13T20:23:52.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.035+0000 7f52cb5d4640 10 monclient: _reopen_session rank -1 2026-02-13T20:23:52.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.035+0000 7f52cb5d4640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:23:52.049 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.035+0000 7f52cb5d4640 10 monclient(hunting): picked mon.noname-c con 0x7f52c4091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:23:52.049 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.035+0000 7f52cb5d4640 10 monclient(hunting): picked mon.noname-b con 0x7f52c41401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:23:52.049 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.035+0000 7f52cb5d4640 10 monclient(hunting): picked mon.noname-a con 0x7f52c4130b40 addr v1:10.20.193.110:6789/0 2026-02-13T20:23:52.049 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.035+0000 7f52cb5d4640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52c4131b30 con 0x7f52c4130b40 2026-02-13T20:23:52.049 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.035+0000 7f52cb5d4640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52c4132060 con 0x7f52c41401c0 2026-02-13T20:23:52.049 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.035+0000 7f52cb5d4640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52c4132340 con 0x7f52c4091950 2026-02-13T20:23:52.049 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.035+0000 7f52cb5d4640 10 monclient(hunting): _renew_subs 2026-02-13T20:23:52.049 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.035+0000 7f52cb5d4640 10 monclient(hunting): authenticate will time out at 1393.725634s 2026-02-13T20:23:52.049 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.035+0000 7f52c9349640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f52c4091950 0x7f52c413e920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:51386/0 (socket says 10.20.193.110:51386) 2026-02-13T20:23:52.049 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.035+0000 7f52c9349640 1 -- 10.20.193.110:0/298872884 learned_addr learned my addr 10.20.193.110:0/298872884 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:23:52.049 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.035+0000 7f52c8b48640 1 -- 10.20.193.110:0/298872884 >> v1:10.20.193.188:6789/0 conn(0x7f52c41401c0 legacy=0x7f52c4193a40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:23:52.049 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.035+0000 7f52b1ffb640 1 -- 10.20.193.110:0/298872884 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1313498698 0 0) 0x7f52c4132340 con 0x7f52c4091950 2026-02-13T20:23:52.050 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.035+0000 7f52b1ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:23:52.050 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.035+0000 7f52b1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:23:52.050 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.035+0000 7f52b1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:23:52.050 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.035+0000 7f52b1ffb640 10 monclient(hunting): my global_id is 94565 2026-02-13T20:23:52.050 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.035+0000 7f52b1ffb640 1 -- 10.20.193.110:0/298872884 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52940035e0 con 0x7f52c4091950 2026-02-13T20:23:52.050 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.036+0000 7f52b1ffb640 1 -- 10.20.193.110:0/298872884 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 506199691 0 0) 0x7f52940035e0 con 0x7f52c4091950 2026-02-13T20:23:52.050 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.036+0000 7f52b1ffb640 1 -- 10.20.193.110:0/298872884 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f52c4132340 con 0x7f52c4091950 2026-02-13T20:23:52.050 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.036+0000 7f52b1ffb640 1 -- 10.20.193.110:0/298872884 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f52b4004250 con 0x7f52c4091950 2026-02-13T20:23:52.050 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.036+0000 7f52b1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:23:52.050 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.036+0000 7f52b1ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:23:52.050 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.036+0000 7f52b1ffb640 10 monclient(hunting): dump: 2026-02-13T20:23:52.050 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:52.051 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:52.051 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:52.051 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:52.051 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:52.051 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:52.051 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:52.051 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:52.051 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:52.051 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:52.051 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.036+0000 7f52b1ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:23:52.051 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.036+0000 7f52b1ffb640 1 -- 10.20.193.110:0/298872884 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 752042138 0 0) 0x7f52c4132340 con 0x7f52c4091950 2026-02-13T20:23:52.051 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.036+0000 7f52b1ffb640 1 -- 10.20.193.110:0/298872884 >> v1:10.20.193.188:6789/0 conn(0x7f52c41401c0 legacy=0x7f52c4193a40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T20:23:52.052 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.036+0000 7f52b1ffb640 1 -- 10.20.193.110:0/298872884 >> v1:10.20.193.110:6789/0 conn(0x7f52c4130b40 legacy=0x7f52c4195160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:52.052 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.036+0000 7f52b1ffb640 10 monclient: _finish_hunting 0 2026-02-13T20:23:52.052 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.036+0000 7f52b1ffb640 1 monclient: found mon.c 2026-02-13T20:23:52.052 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.036+0000 7f52b1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:23:52.052 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.036+0000 7f52b1ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:23:52.052 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.036+0000 7f52b1ffb640 1 -- 10.20.193.110:0/298872884 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52c405d320 con 0x7f52c4091950 2026-02-13T20:23:52.052 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.036+0000 7f52b1ffb640 10 monclient: _finish_auth 0 2026-02-13T20:23:52.052 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.036+0000 7f52b1ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:23:52.052 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.036+0000 7f52b1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:23:52.052 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.036+0000 7f52cb5d4640 5 monclient: authenticate success, global_id 94565 2026-02-13T20:23:52.052 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.036+0000 7f52cb5d4640 10 monclient: _renew_subs 2026-02-13T20:23:52.052 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.036+0000 7f52cb5d4640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:23:52.053 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.036+0000 7f52cb5d4640 1 -- 10.20.193.110:0/298872884 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f52c408c2a0 con 0x7f52c4091950 2026-02-13T20:23:52.053 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.036+0000 7f52cb5d4640 10 monclient: _renew_subs 2026-02-13T20:23:52.053 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.036+0000 7f52cb5d4640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:23:52.053 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.036+0000 7f52cb5d4640 1 -- 10.20.193.110:0/298872884 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f52c413f030 con 0x7f52c4091950 2026-02-13T20:23:52.053 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.036+0000 7f52b1ffb640 1 -- 10.20.193.110:0/298872884 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f52b4004420 con 0x7f52c4091950 2026-02-13T20:23:52.053 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.036+0000 7f52b1ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T20:23:52.053 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.036+0000 7f52b1ffb640 1 -- 10.20.193.110:0/298872884 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f52b4004800 con 0x7f52c4091950 2026-02-13T20:23:52.053 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.036+0000 7f52b1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:23:52.053 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.036+0000 7f52b1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:23:52.053 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.036+0000 7f52b37fe640 4 set_mon_vals no callback set 2026-02-13T20:23:52.053 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.036+0000 7f52b1ffb640 10 monclient: dump: 2026-02-13T20:23:52.053 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:23:52.054 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:52.054 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:52.054 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:23:52.054 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:23:52.054 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:52.054 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:23:52.054 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:23:52.054 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:23:52.054 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:52.054 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.036+0000 7f52cb5d4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:23:52.054 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.036+0000 7f52cb5d4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:23:52.054 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.036+0000 7f52cb5d4640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:23:52.054 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.036+0000 7f52cb5d4640 1 -- 10.20.193.110:0/298872884 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52c40008d0 con 0x7f52c4091950 2026-02-13T20:23:52.055 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.036+0000 7f52b1ffb640 1 -- 10.20.193.110:0/298872884 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f52b4004960 con 0x7f52c4091950 2026-02-13T20:23:52.055 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.037+0000 7f52b1ffb640 1 -- 10.20.193.110:0/298872884 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(588..588 src has 1..588) ==== 3871+0+0 (unknown 1980572098 0 0) 0x7f52b404e8e0 con 0x7f52c4091950 2026-02-13T20:23:52.055 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.037+0000 7f52c8b48640 10 monclient: get_auth_request con 0x7f529403f630 auth_method 0 2026-02-13T20:23:52.055 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.039+0000 7f52b1ffb640 1 -- 10.20.193.110:0/298872884 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f52b4017060 con 0x7f52c4091950 2026-02-13T20:23:52.055 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.039+0000 7f52b1ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:23:52.055 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.039+0000 7f52b1ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:23:52.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.183+0000 7f52cb5d4640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T20:23:52.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.183+0000 7f52cb5d4640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T20:23:52.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.183+0000 7f52cb5d4640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:23:52.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.183+0000 7f52cb5d4640 1 -- 10.20.193.110:0/298872884 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f52c4058410 con 0x7f52c4091950 2026-02-13T20:23:52.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.183+0000 7f52b1ffb640 1 -- 10.20.193.110:0/298872884 <== mon.2 v1:10.20.193.110:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 1809817011) 0x7f52b4016810 con 0x7f52c4091950 2026-02-13T20:23:52.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.183+0000 7f52b1ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T20:23:52.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.183+0000 7f52b1ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:23:52.185 INFO:teuthology.orchestra.run.trial110.stdout:{"election_epoch":46,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":5,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","modified":"2026-02-13T20:11:07.161192Z","created":"2026-02-13T20:11:07.161192Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6789","nonce":0}]},"addr":"10.20.193.110:6789/0","public_addr":"10.20.193.110:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161241+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6789","nonce":0}]},"addr":"10.20.193.188:6789/0","public_addr":"10.20.193.188:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161242+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6790","nonce":0}]},"addr":"10.20.193.110:6790/0","public_addr":"10.20.193.110:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161243+0000","crush_location":[]}]}} 2026-02-13T20:23:52.186 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.184+0000 7f52cb5d4640 1 -- 10.20.193.110:0/298872884 >> v1:10.20.193.188:6812/1623052694 conn(0x7f529403f630 legacy=0x7f529405fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:52.186 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.184+0000 7f52cb5d4640 10 monclient: shutdown 2026-02-13T20:23:52.186 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.184+0000 7f52cb5d4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:23:52.186 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.184+0000 7f52cb5d4640 1 -- 10.20.193.110:0/298872884 >> v1:10.20.193.110:6790/0 conn(0x7f52c4091950 legacy=0x7f52c413e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:52.186 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.184+0000 7f52cb5d4640 1 -- 10.20.193.110:0/298872884 shutdown_connections 2026-02-13T20:23:52.186 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.184+0000 7f52cb5d4640 1 -- 10.20.193.110:0/298872884 >> 10.20.193.110:0/298872884 conn(0x7f52c4054e90 msgr2=0x7f52c408dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:23:52.186 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.184+0000 7f52cb5d4640 1 -- 10.20.193.110:0/298872884 shutdown_connections 2026-02-13T20:23:52.187 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:52.184+0000 7f52cb5d4640 1 -- 10.20.193.110:0/298872884 wait complete. 2026-02-13T20:23:55.193 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T20:23:55.263 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:55.260+0000 7f5111ccc640 10 monclient: get_monmap_and_config 2026-02-13T20:23:55.263 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:55.261+0000 7f5111ccc640 10 monclient: build_initial_monmap 2026-02-13T20:23:55.263 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:55.261+0000 7f5111ccc640 10 monclient: monmap: 2026-02-13T20:23:55.263 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:23:55.263 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:23:55.263 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:23:55.261435+0000 2026-02-13T20:23:55.263 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:23:55.261435+0000 2026-02-13T20:23:55.263 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:23:55.264 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:23:55.264 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:23:55.264 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:23:55.264 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:23:55.264 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:23:55.264 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:55.261+0000 7f5111ccc640 1 Processor -- start 2026-02-13T20:23:55.264 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:55.261+0000 7f5111ccc640 1 -- start start 2026-02-13T20:23:55.264 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:55.261+0000 7f5111ccc640 10 monclient: init 2026-02-13T20:23:55.264 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:55.261+0000 7f5111ccc640 10 monclient: _reopen_session rank -1 2026-02-13T20:23:55.264 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:55.261+0000 7f5111ccc640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:23:55.264 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:55.261+0000 7f5111ccc640 10 monclient(hunting): picked mon.noname-c con 0x7f510c1401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:23:55.265 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:55.261+0000 7f5111ccc640 10 monclient(hunting): picked mon.noname-b con 0x7f510c092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:23:55.265 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:55.261+0000 7f5111ccc640 10 monclient(hunting): picked mon.noname-a con 0x7f510c091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:23:55.265 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:55.261+0000 7f5111ccc640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f510c08b730 con 0x7f510c091950 2026-02-13T20:23:55.265 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:55.261+0000 7f5111ccc640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f510c05c5b0 con 0x7f510c1401c0 2026-02-13T20:23:55.265 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:55.261+0000 7f5111ccc640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f510c08bcf0 con 0x7f510c092020 2026-02-13T20:23:55.265 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:55.261+0000 7f5111ccc640 10 monclient(hunting): _renew_subs 2026-02-13T20:23:55.265 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:55.261+0000 7f5111ccc640 10 monclient(hunting): authenticate will time out at 1396.951751s 2026-02-13T20:23:55.265 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:55.261+0000 7f510b7fe640 1 -- >> v1:10.20.193.188:6789/0 conn(0x7f510c1401c0 legacy=0x7f510c091240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:23:55.265 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:55.261+0000 7f510affd640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f510c092020 0x7f510c1812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:51390/0 (socket says 10.20.193.110:51390) 2026-02-13T20:23:55.265 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:55.261+0000 7f510affd640 1 -- 10.20.193.110:0/3556707499 learned_addr learned my addr 10.20.193.110:0/3556707499 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:23:55.265 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:55.261+0000 7f510bfff640 1 --1- 10.20.193.110:0/3556707499 >> v1:10.20.193.110:6789/0 conn(0x7f510c091950 0x7f510c1a2a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:34238/0 (socket says 10.20.193.110:34238) 2026-02-13T20:23:55.463 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:55.463+0000 7f510b7fe640 1 -- 10.20.193.110:0/3556707499 >> v1:10.20.193.188:6789/0 conn(0x7f510c1401c0 legacy=0x7f510c091240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:23:55.865 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:55.864+0000 7f510b7fe640 1 -- 10.20.193.110:0/3556707499 >> v1:10.20.193.188:6789/0 conn(0x7f510c1401c0 legacy=0x7f510c091240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:23:56.665 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:56.665+0000 7f510b7fe640 1 -- 10.20.193.110:0/3556707499 >> v1:10.20.193.188:6789/0 conn(0x7f510c1401c0 legacy=0x7f510c091240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:23:58.263 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:58.262+0000 7f51097fa640 10 monclient(hunting): tick 2026-02-13T20:23:58.263 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:58.262+0000 7f51097fa640 10 monclient(hunting): _check_auth_tickets 2026-02-13T20:23:58.263 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:58.262+0000 7f51097fa640 1 monclient(hunting): continuing hunt 2026-02-13T20:23:58.263 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:58.262+0000 7f51097fa640 10 monclient(hunting): _reopen_session rank -1 2026-02-13T20:23:58.263 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:58.262+0000 7f51097fa640 1 -- 10.20.193.110:0/3556707499 >> v1:10.20.193.110:6790/0 conn(0x7f510c092020 legacy=0x7f510c1812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:58.263 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:58.262+0000 7f51097fa640 1 -- 10.20.193.110:0/3556707499 >> v1:10.20.193.188:6789/0 conn(0x7f510c1401c0 legacy=0x7f510c091240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:23:58.263 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:58.262+0000 7f51097fa640 1 -- 10.20.193.110:0/3556707499 >> v1:10.20.193.110:6789/0 conn(0x7f510c091950 legacy=0x7f510c1a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:23:58.264 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:58.262+0000 7f51097fa640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:23:58.264 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:58.262+0000 7f51097fa640 10 monclient(hunting): picked mon.noname-c con 0x7f510c1401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:23:58.264 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:58.262+0000 7f51097fa640 10 monclient(hunting): picked mon.noname-b con 0x7f50e8024ed0 addr v1:10.20.193.110:6790/0 2026-02-13T20:23:58.264 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:58.262+0000 7f51097fa640 10 monclient(hunting): picked mon.noname-a con 0x7f510c091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:23:58.264 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:58.262+0000 7f51097fa640 1 -- 10.20.193.110:0/3556707499 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f510c140590 con 0x7f510c091950 2026-02-13T20:23:58.264 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:58.262+0000 7f51097fa640 1 -- 10.20.193.110:0/3556707499 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f510c05c5b0 con 0x7f510c1401c0 2026-02-13T20:23:58.264 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:58.262+0000 7f51097fa640 1 -- 10.20.193.110:0/3556707499 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50e806a380 con 0x7f50e8024ed0 2026-02-13T20:23:58.264 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:58.262+0000 7f51097fa640 10 monclient(hunting): _renew_subs 2026-02-13T20:23:58.264 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:58.262+0000 7f510b7fe640 1 -- 10.20.193.110:0/3556707499 >> v1:10.20.193.188:6789/0 conn(0x7f510c1401c0 legacy=0x7f50e8023790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:23:58.463 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:58.463+0000 7f510b7fe640 1 -- 10.20.193.110:0/3556707499 >> v1:10.20.193.188:6789/0 conn(0x7f510c1401c0 legacy=0x7f50e8023790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:23:58.865 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:58.864+0000 7f510b7fe640 1 -- 10.20.193.110:0/3556707499 >> v1:10.20.193.188:6789/0 conn(0x7f510c1401c0 legacy=0x7f50e8023790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:23:59.665 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:23:59.665+0000 7f510b7fe640 1 -- 10.20.193.110:0/3556707499 >> v1:10.20.193.188:6789/0 conn(0x7f510c1401c0 legacy=0x7f50e8023790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:24:01.262 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:01.261+0000 7f51097fa640 10 monclient(hunting): tick 2026-02-13T20:24:01.262 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:01.261+0000 7f51097fa640 10 monclient(hunting): _check_auth_tickets 2026-02-13T20:24:01.262 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:01.261+0000 7f51097fa640 1 monclient(hunting): continuing hunt 2026-02-13T20:24:01.263 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:01.261+0000 7f51097fa640 10 monclient(hunting): _reopen_session rank -1 2026-02-13T20:24:01.263 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:01.261+0000 7f51097fa640 1 -- 10.20.193.110:0/3556707499 >> v1:10.20.193.110:6790/0 conn(0x7f50e8024ed0 legacy=0x7f50e8045330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:24:01.263 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:01.261+0000 7f51097fa640 1 -- 10.20.193.110:0/3556707499 >> v1:10.20.193.188:6789/0 conn(0x7f510c1401c0 legacy=0x7f50e8023790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:24:01.263 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:01.261+0000 7f51097fa640 1 -- 10.20.193.110:0/3556707499 >> v1:10.20.193.110:6789/0 conn(0x7f510c091950 legacy=0x7f50e8066b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:24:01.263 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:01.261+0000 7f51097fa640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:24:01.263 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:01.261+0000 7f51097fa640 10 monclient(hunting): picked mon.noname-b con 0x7f50e8024ed0 addr v1:10.20.193.110:6790/0 2026-02-13T20:24:01.263 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:01.261+0000 7f51097fa640 10 monclient(hunting): picked mon.noname-c con 0x7f510c1401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:24:01.263 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:01.261+0000 7f51097fa640 10 monclient(hunting): picked mon.noname-a con 0x7f510c091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:24:01.263 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:01.261+0000 7f51097fa640 1 -- 10.20.193.110:0/3556707499 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50e806b640 con 0x7f510c091950 2026-02-13T20:24:01.263 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:01.261+0000 7f51097fa640 1 -- 10.20.193.110:0/3556707499 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f510c05c5b0 con 0x7f510c1401c0 2026-02-13T20:24:01.263 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:01.261+0000 7f51097fa640 1 -- 10.20.193.110:0/3556707499 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50e806a6f0 con 0x7f50e8024ed0 2026-02-13T20:24:01.263 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:01.261+0000 7f51097fa640 10 monclient(hunting): _renew_subs 2026-02-13T20:24:01.263 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:01.261+0000 7f510affd640 1 -- 10.20.193.110:0/3556707499 >> v1:10.20.193.188:6789/0 conn(0x7f510c1401c0 legacy=0x7f50e8023790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:24:01.463 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:01.462+0000 7f510affd640 1 -- 10.20.193.110:0/3556707499 >> v1:10.20.193.188:6789/0 conn(0x7f510c1401c0 legacy=0x7f50e8023790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:24:01.864 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:01.863+0000 7f510affd640 1 -- 10.20.193.110:0/3556707499 >> v1:10.20.193.188:6789/0 conn(0x7f510c1401c0 legacy=0x7f50e8023790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:24:02.665 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:02.664+0000 7f510affd640 1 -- 10.20.193.110:0/3556707499 >> v1:10.20.193.188:6789/0 conn(0x7f510c1401c0 legacy=0x7f50e8023790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:24:03.316 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.312+0000 7f510a7fc640 1 -- 10.20.193.110:0/3556707499 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3214001108 0 0) 0x7f50e806b640 con 0x7f510c091950 2026-02-13T20:24:03.316 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.312+0000 7f510a7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:24:03.316 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.312+0000 7f510a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:24:03.316 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.312+0000 7f510a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:24:03.316 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.312+0000 7f510a7fc640 10 monclient(hunting): my global_id is 124269 2026-02-13T20:24:03.316 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.312+0000 7f510a7fc640 1 -- 10.20.193.110:0/3556707499 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50f00035e0 con 0x7f510c091950 2026-02-13T20:24:03.317 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.312+0000 7f510a7fc640 1 -- 10.20.193.110:0/3556707499 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2194257794 0 0) 0x7f50f00035e0 con 0x7f510c091950 2026-02-13T20:24:03.317 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.312+0000 7f510a7fc640 1 -- 10.20.193.110:0/3556707499 >> v1:10.20.193.110:6790/0 conn(0x7f50e8024ed0 legacy=0x7f50e80452b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:24:03.317 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.312+0000 7f510a7fc640 1 -- 10.20.193.110:0/3556707499 >> v1:10.20.193.188:6789/0 conn(0x7f510c1401c0 legacy=0x7f50e8023790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:24:03.317 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.312+0000 7f510a7fc640 10 monclient: _finish_hunting 0 2026-02-13T20:24:03.317 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.312+0000 7f510a7fc640 1 monclient: found mon.noname-a 2026-02-13T20:24:03.317 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.312+0000 7f510a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:24:03.317 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.312+0000 7f510a7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:24:03.317 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.312+0000 7f510a7fc640 1 -- 10.20.193.110:0/3556707499 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50e806a920 con 0x7f510c091950 2026-02-13T20:24:03.317 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.312+0000 7f510a7fc640 10 monclient: _finish_auth 0 2026-02-13T20:24:03.317 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.312+0000 7f510a7fc640 10 monclient: _check_auth_tickets 2026-02-13T20:24:03.317 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.312+0000 7f510a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:24:03.318 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.312+0000 7f510a7fc640 1 -- 10.20.193.110:0/3556707499 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f5100003d90 con 0x7f510c091950 2026-02-13T20:24:03.318 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.312+0000 7f510a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:24:03.318 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.312+0000 7f510a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:24:03.318 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.312+0000 7f510a7fc640 10 monclient: dump: 2026-02-13T20:24:03.318 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:24:03.318 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:24:03.318 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:24:03.318 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:24:03.318 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:24:03.318 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:24:03.318 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:24:03.318 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:24:03.319 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:24:03.319 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:24:03.319 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.312+0000 7f5111ccc640 5 monclient: authenticate success, global_id 124269 2026-02-13T20:24:03.319 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.312+0000 7f5111ccc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:24:03.319 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.312+0000 7f510a7fc640 1 -- 10.20.193.110:0/3556707499 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5100003f90 con 0x7f510c091950 2026-02-13T20:24:03.319 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.312+0000 7f510a7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:24:03.319 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.312+0000 7f510a7fc640 1 -- 10.20.193.110:0/3556707499 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f51000043a0 con 0x7f510c091950 2026-02-13T20:24:03.319 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.312+0000 7f5111ccc640 10 monclient: get_monmap_and_config success 2026-02-13T20:24:03.319 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.312+0000 7f5111ccc640 4 set_mon_vals no callback set 2026-02-13T20:24:03.319 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.312+0000 7f510a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:24:03.319 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.312+0000 7f510a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:24:03.320 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.312+0000 7f510a7fc640 10 monclient: dump: 2026-02-13T20:24:03.320 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:24:03.320 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:24:03.320 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:24:03.320 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:24:03.320 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:24:03.320 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:24:03.320 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:24:03.321 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:24:03.321 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:24:03.321 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:24:03.321 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.313+0000 7f5111ccc640 10 monclient: shutdown 2026-02-13T20:24:03.321 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.313+0000 7f5111ccc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:24:03.321 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.313+0000 7f5111ccc640 1 -- 10.20.193.110:0/3556707499 >> v1:10.20.193.110:6789/0 conn(0x7f510c091950 legacy=0x7f50e8066ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:24:03.321 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.313+0000 7f5111ccc640 1 -- 10.20.193.110:0/3556707499 shutdown_connections 2026-02-13T20:24:03.321 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.313+0000 7f5111ccc640 1 -- 10.20.193.110:0/3556707499 >> 10.20.193.110:0/3556707499 conn(0x7f510c054e90 msgr2=0x7f510c058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:24:03.321 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.313+0000 7f5111ccc640 1 -- 10.20.193.110:0/3556707499 shutdown_connections 2026-02-13T20:24:03.321 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.313+0000 7f5111ccc640 1 -- 10.20.193.110:0/3556707499 wait complete. 2026-02-13T20:24:03.322 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.314+0000 7f5111ccc640 10 monclient: build_initial_monmap 2026-02-13T20:24:03.322 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.314+0000 7f5111ccc640 10 monclient: monmap: 2026-02-13T20:24:03.322 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:24:03.322 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:24:03.322 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:24:03.322 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:24:03.322 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:24:03.322 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:24:03.322 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:24:03.322 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:24:03.322 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:24:03.322 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:24:03.323 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.314+0000 7f5111ccc640 1 Processor -- start 2026-02-13T20:24:03.323 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.314+0000 7f5111ccc640 1 -- start start 2026-02-13T20:24:03.323 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.314+0000 7f5111ccc640 10 monclient: init 2026-02-13T20:24:03.327 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.315+0000 7f5111ccc640 10 monclient: _reopen_session rank -1 2026-02-13T20:24:03.327 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.315+0000 7f5111ccc640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:24:03.327 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.315+0000 7f5111ccc640 10 monclient(hunting): picked mon.noname-c con 0x7f50e8024ed0 addr v1:10.20.193.110:6790/0 2026-02-13T20:24:03.327 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.315+0000 7f5111ccc640 10 monclient(hunting): picked mon.noname-a con 0x7f510c091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:24:03.327 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.315+0000 7f5111ccc640 10 monclient(hunting): picked mon.noname-b con 0x7f510c1401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:24:03.327 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.315+0000 7f5111ccc640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f510c12e280 con 0x7f510c091950 2026-02-13T20:24:03.327 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.315+0000 7f5111ccc640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f510c12d720 con 0x7f510c1401c0 2026-02-13T20:24:03.327 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.315+0000 7f5111ccc640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f510c12f1e0 con 0x7f50e8024ed0 2026-02-13T20:24:03.328 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.315+0000 7f5111ccc640 10 monclient(hunting): _renew_subs 2026-02-13T20:24:03.328 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.315+0000 7f5111ccc640 10 monclient(hunting): authenticate will time out at 1405.006283s 2026-02-13T20:24:03.328 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.315+0000 7f510b7fe640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f50e8024ed0 0x7f510c1d6ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:47168/0 (socket says 10.20.193.110:47168) 2026-02-13T20:24:03.328 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.315+0000 7f510b7fe640 1 -- 10.20.193.110:0/1006246111 learned_addr learned my addr 10.20.193.110:0/1006246111 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:24:03.328 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.315+0000 7f510bfff640 1 -- 10.20.193.110:0/1006246111 >> v1:10.20.193.188:6789/0 conn(0x7f510c1401c0 legacy=0x7f510c239220 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:24:03.328 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.315+0000 7f50e7fff640 1 -- 10.20.193.110:0/1006246111 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3593903783 0 0) 0x7f510c12f1e0 con 0x7f50e8024ed0 2026-02-13T20:24:03.328 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.315+0000 7f50e7fff640 10 monclient(hunting): _negotiate 2026-02-13T20:24:03.328 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.315+0000 7f50e7fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:24:03.328 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.315+0000 7f50e7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:24:03.328 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.315+0000 7f50e7fff640 10 monclient(hunting): my global_id is 94568 2026-02-13T20:24:03.328 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.315+0000 7f50e7fff640 1 -- 10.20.193.110:0/1006246111 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50dc0035e0 con 0x7f50e8024ed0 2026-02-13T20:24:03.328 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.315+0000 7f50e7fff640 1 -- 10.20.193.110:0/1006246111 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3913218027 0 0) 0x7f50dc0035e0 con 0x7f50e8024ed0 2026-02-13T20:24:03.328 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.315+0000 7f50e7fff640 1 -- 10.20.193.110:0/1006246111 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f510c12f1e0 con 0x7f50e8024ed0 2026-02-13T20:24:03.328 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.315+0000 7f50e7fff640 1 -- 10.20.193.110:0/1006246111 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f50f80043c0 con 0x7f50e8024ed0 2026-02-13T20:24:03.328 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.315+0000 7f50e7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:24:03.328 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.315+0000 7f50e7fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:24:03.328 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.315+0000 7f50e7fff640 10 monclient(hunting): dump: 2026-02-13T20:24:03.329 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:24:03.329 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:24:03.329 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:24:03.329 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:24:03.329 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:24:03.329 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:24:03.329 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:24:03.329 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:24:03.329 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:24:03.329 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:24:03.329 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.315+0000 7f50e7fff640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:24:03.329 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.315+0000 7f50e7fff640 1 -- 10.20.193.110:0/1006246111 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1249257005 0 0) 0x7f510c12f1e0 con 0x7f50e8024ed0 2026-02-13T20:24:03.329 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.315+0000 7f50e7fff640 1 -- 10.20.193.110:0/1006246111 >> v1:10.20.193.188:6789/0 conn(0x7f510c1401c0 legacy=0x7f510c239220 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T20:24:03.329 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.315+0000 7f50e7fff640 1 -- 10.20.193.110:0/1006246111 >> v1:10.20.193.110:6789/0 conn(0x7f510c091950 legacy=0x7f510c13e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:24:03.329 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.315+0000 7f50e7fff640 10 monclient: _finish_hunting 0 2026-02-13T20:24:03.329 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.315+0000 7f50e7fff640 1 monclient: found mon.c 2026-02-13T20:24:03.329 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.315+0000 7f50e7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:24:03.330 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.315+0000 7f50e7fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:24:03.330 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.315+0000 7f50e7fff640 1 -- 10.20.193.110:0/1006246111 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f510c13f900 con 0x7f50e8024ed0 2026-02-13T20:24:03.330 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.315+0000 7f50e7fff640 10 monclient: _finish_auth 0 2026-02-13T20:24:03.330 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.315+0000 7f50e7fff640 10 monclient: _check_auth_tickets 2026-02-13T20:24:03.330 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.315+0000 7f50e7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:24:03.330 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.315+0000 7f5111ccc640 5 monclient: authenticate success, global_id 94568 2026-02-13T20:24:03.330 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.315+0000 7f5111ccc640 10 monclient: _renew_subs 2026-02-13T20:24:03.330 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.315+0000 7f5111ccc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:24:03.330 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.315+0000 7f5111ccc640 1 -- 10.20.193.110:0/1006246111 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f510c12fa80 con 0x7f50e8024ed0 2026-02-13T20:24:03.330 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.315+0000 7f5111ccc640 10 monclient: _renew_subs 2026-02-13T20:24:03.330 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.315+0000 7f5111ccc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:24:03.330 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.315+0000 7f5111ccc640 1 -- 10.20.193.110:0/1006246111 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f510c13e770 con 0x7f50e8024ed0 2026-02-13T20:24:03.330 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.316+0000 7f50e7fff640 1 -- 10.20.193.110:0/1006246111 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f50f80048f0 con 0x7f50e8024ed0 2026-02-13T20:24:03.330 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.316+0000 7f50e7fff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:24:03.330 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.316+0000 7f50e7fff640 1 -- 10.20.193.110:0/1006246111 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f50f8004cd0 con 0x7f50e8024ed0 2026-02-13T20:24:03.330 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.316+0000 7f50e7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:24:03.330 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.316+0000 7f50e7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:24:03.330 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.316+0000 7f50e7fff640 10 monclient: dump: 2026-02-13T20:24:03.330 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:24:03.331 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:24:03.331 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:24:03.331 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:24:03.331 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:24:03.331 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:24:03.331 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:24:03.331 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:24:03.331 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:24:03.331 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:24:03.331 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.316+0000 7f5109ffb640 4 set_mon_vals no callback set 2026-02-13T20:24:03.331 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.316+0000 7f5111ccc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:24:03.331 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.316+0000 7f5111ccc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:24:03.331 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.316+0000 7f5111ccc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:24:03.331 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.316+0000 7f5111ccc640 1 -- 10.20.193.110:0/1006246111 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f510c0008d0 con 0x7f50e8024ed0 2026-02-13T20:24:03.331 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.316+0000 7f50e7fff640 1 -- 10.20.193.110:0/1006246111 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f50f8004e30 con 0x7f50e8024ed0 2026-02-13T20:24:03.331 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.316+0000 7f50e7fff640 1 -- 10.20.193.110:0/1006246111 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(588..588 src has 1..588) ==== 3871+0+0 (unknown 1980572098 0 0) 0x7f50f804ea70 con 0x7f50e8024ed0 2026-02-13T20:24:03.331 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.316+0000 7f510affd640 10 monclient: get_auth_request con 0x7f50dc03f5e0 auth_method 0 2026-02-13T20:24:03.331 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.319+0000 7f50e7fff640 1 -- 10.20.193.110:0/1006246111 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f50f80171f0 con 0x7f50e8024ed0 2026-02-13T20:24:03.332 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.319+0000 7f50e7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:24:03.332 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.319+0000 7f50e7fff640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:24:03.463 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.462+0000 7f5111ccc640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T20:24:03.463 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.462+0000 7f5111ccc640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T20:24:03.463 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.462+0000 7f5111ccc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:24:03.464 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.462+0000 7f5111ccc640 1 -- 10.20.193.110:0/1006246111 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f510c12f760 con 0x7f50e8024ed0 2026-02-13T20:24:03.464 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.462+0000 7f50e7fff640 1 -- 10.20.193.110:0/1006246111 <== mon.2 v1:10.20.193.110:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 2796760627) 0x7f50f80169a0 con 0x7f50e8024ed0 2026-02-13T20:24:03.464 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.462+0000 7f50e7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T20:24:03.464 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.462+0000 7f50e7fff640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:24:03.464 INFO:teuthology.orchestra.run.trial110.stdout:{"election_epoch":50,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"c","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","modified":"2026-02-13T20:11:07.161192Z","created":"2026-02-13T20:11:07.161192Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6789","nonce":0}]},"addr":"10.20.193.110:6789/0","public_addr":"10.20.193.110:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161241+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6789","nonce":0}]},"addr":"10.20.193.188:6789/0","public_addr":"10.20.193.188:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161242+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6790","nonce":0}]},"addr":"10.20.193.110:6790/0","public_addr":"10.20.193.110:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161243+0000","crush_location":[]}]}} 2026-02-13T20:24:03.465 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.463+0000 7f5111ccc640 1 -- 10.20.193.110:0/1006246111 >> v1:10.20.193.188:6812/1623052694 conn(0x7f50dc03f5e0 legacy=0x7f50dc05fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:24:03.465 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.463+0000 7f5111ccc640 10 monclient: shutdown 2026-02-13T20:24:03.465 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.463+0000 7f5111ccc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:24:03.465 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.463+0000 7f5111ccc640 1 -- 10.20.193.110:0/1006246111 >> v1:10.20.193.110:6790/0 conn(0x7f50e8024ed0 legacy=0x7f510c1d6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:24:03.465 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.463+0000 7f5111ccc640 1 -- 10.20.193.110:0/1006246111 shutdown_connections 2026-02-13T20:24:03.465 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.463+0000 7f5111ccc640 1 -- 10.20.193.110:0/1006246111 >> 10.20.193.110:0/1006246111 conn(0x7f510c054e90 msgr2=0x7f510c08ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:24:03.465 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.463+0000 7f5111ccc640 1 -- 10.20.193.110:0/1006246111 shutdown_connections 2026-02-13T20:24:03.465 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.463+0000 7f5111ccc640 1 -- 10.20.193.110:0/1006246111 wait complete. 2026-02-13T20:24:03.472 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-13T20:24:03.472 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-13T20:24:03.472 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T20:24:03.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.535+0000 7fb916812640 10 monclient: get_monmap_and_config 2026-02-13T20:24:03.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.535+0000 7fb916812640 10 monclient: build_initial_monmap 2026-02-13T20:24:03.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.535+0000 7fb916812640 10 monclient: monmap: 2026-02-13T20:24:03.537 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:24:03.537 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:24:03.537 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:24:03.537262+0000 2026-02-13T20:24:03.537 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:24:03.537262+0000 2026-02-13T20:24:03.537 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:24:03.537 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:24:03.537 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:24:03.537 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:24:03.537 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:24:03.537 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:24:03.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.536+0000 7fb916812640 1 Processor -- start 2026-02-13T20:24:03.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.536+0000 7fb916812640 1 -- start start 2026-02-13T20:24:03.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.536+0000 7fb916812640 10 monclient: init 2026-02-13T20:24:03.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.536+0000 7fb916812640 10 monclient: _reopen_session rank -1 2026-02-13T20:24:03.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.536+0000 7fb916812640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:24:03.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.536+0000 7fb916812640 10 monclient(hunting): picked mon.noname-a con 0x7fb910091470 addr v1:10.20.193.110:6789/0 2026-02-13T20:24:03.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.536+0000 7fb916812640 10 monclient(hunting): picked mon.noname-b con 0x7fb910092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:24:03.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.536+0000 7fb916812640 10 monclient(hunting): picked mon.noname-c con 0x7fb9101401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:24:03.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.536+0000 7fb916812640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb91005c5b0 con 0x7fb910091470 2026-02-13T20:24:03.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.536+0000 7fb916812640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb910140620 con 0x7fb9101401c0 2026-02-13T20:24:03.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.536+0000 7fb916812640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb91008b450 con 0x7fb910092020 2026-02-13T20:24:03.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.536+0000 7fb916812640 10 monclient(hunting): _renew_subs 2026-02-13T20:24:03.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.536+0000 7fb916812640 10 monclient(hunting): authenticate will time out at 1405.227738s 2026-02-13T20:24:03.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.536+0000 7fb90f7fe640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fb910092020 0x7fb9101812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:47172/0 (socket says 10.20.193.110:47172) 2026-02-13T20:24:03.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.536+0000 7fb90f7fe640 1 -- 10.20.193.110:0/2066227954 learned_addr learned my addr 10.20.193.110:0/2066227954 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:24:03.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.536+0000 7fb914d88640 1 -- 10.20.193.110:0/2066227954 >> v1:10.20.193.188:6789/0 conn(0x7fb9101401c0 legacy=0x7fb9101a2a20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:24:03.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.536+0000 7fb90effd640 1 -- 10.20.193.110:0/2066227954 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2074849056 0 0) 0x7fb91008b450 con 0x7fb910092020 2026-02-13T20:24:03.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.536+0000 7fb90effd640 10 monclient(hunting): _negotiate 2026-02-13T20:24:03.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.536+0000 7fb90effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:24:03.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.536+0000 7fb90effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:24:03.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.536+0000 7fb90effd640 10 monclient(hunting): my global_id is 94571 2026-02-13T20:24:03.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.537+0000 7fb90effd640 1 -- 10.20.193.110:0/2066227954 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8f40035e0 con 0x7fb910092020 2026-02-13T20:24:03.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.537+0000 7fb90effd640 1 -- 10.20.193.110:0/2066227954 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 488381260 0 0) 0x7fb91005c5b0 con 0x7fb910091470 2026-02-13T20:24:03.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.537+0000 7fb90effd640 10 monclient(hunting): _negotiate 2026-02-13T20:24:03.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.537+0000 7fb90effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:24:03.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.537+0000 7fb90effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:24:03.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.537+0000 7fb90effd640 10 monclient(hunting): my global_id is 124272 2026-02-13T20:24:03.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.537+0000 7fb90effd640 1 -- 10.20.193.110:0/2066227954 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb91008b450 con 0x7fb910091470 2026-02-13T20:24:03.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.537+0000 7fb90effd640 1 -- 10.20.193.110:0/2066227954 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 144514745 0 0) 0x7fb8f40035e0 con 0x7fb910092020 2026-02-13T20:24:03.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.537+0000 7fb90effd640 1 -- 10.20.193.110:0/2066227954 >> v1:10.20.193.188:6789/0 conn(0x7fb9101401c0 legacy=0x7fb9101a2a20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:24:03.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.537+0000 7fb90effd640 1 -- 10.20.193.110:0/2066227954 >> v1:10.20.193.110:6789/0 conn(0x7fb910091470 legacy=0x7fb910091840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:24:03.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.537+0000 7fb90effd640 10 monclient: _finish_hunting 0 2026-02-13T20:24:03.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.537+0000 7fb90effd640 1 monclient: found mon.noname-b 2026-02-13T20:24:03.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.537+0000 7fb90effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:24:03.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.537+0000 7fb90effd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:24:03.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.537+0000 7fb90effd640 1 -- 10.20.193.110:0/2066227954 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb91008b730 con 0x7fb910092020 2026-02-13T20:24:03.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.537+0000 7fb90effd640 10 monclient: _finish_auth 0 2026-02-13T20:24:03.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.537+0000 7fb90effd640 10 monclient: _check_auth_tickets 2026-02-13T20:24:03.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.537+0000 7fb90effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:24:03.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.537+0000 7fb90effd640 1 -- 10.20.193.110:0/2066227954 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb900002dd0 con 0x7fb910092020 2026-02-13T20:24:03.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.537+0000 7fb90effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:24:03.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.537+0000 7fb90effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:24:03.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.537+0000 7fb90effd640 10 monclient: dump: 2026-02-13T20:24:03.545 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:24:03.546 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:24:03.546 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:24:03.546 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:24:03.546 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:24:03.546 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:24:03.546 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:24:03.546 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:24:03.546 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:24:03.546 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:24:03.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.537+0000 7fb916812640 5 monclient: authenticate success, global_id 94571 2026-02-13T20:24:03.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.537+0000 7fb916812640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:24:03.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.537+0000 7fb90effd640 1 -- 10.20.193.110:0/2066227954 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb900003090 con 0x7fb910092020 2026-02-13T20:24:03.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.537+0000 7fb90effd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:24:03.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.537+0000 7fb916812640 10 monclient: get_monmap_and_config success 2026-02-13T20:24:03.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.537+0000 7fb916812640 4 set_mon_vals no callback set 2026-02-13T20:24:03.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.537+0000 7fb90effd640 1 -- 10.20.193.110:0/2066227954 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb9000034a0 con 0x7fb910092020 2026-02-13T20:24:03.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.537+0000 7fb90effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:24:03.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.537+0000 7fb90effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:24:03.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.537+0000 7fb90effd640 10 monclient: dump: 2026-02-13T20:24:03.547 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:24:03.547 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:24:03.547 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:24:03.547 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:24:03.547 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:24:03.547 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:24:03.547 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:24:03.547 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:24:03.547 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:24:03.547 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:24:03.547 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.537+0000 7fb916812640 10 monclient: shutdown 2026-02-13T20:24:03.547 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.537+0000 7fb916812640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:24:03.547 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.537+0000 7fb916812640 1 -- 10.20.193.110:0/2066227954 >> v1:10.20.193.110:6790/0 conn(0x7fb910092020 legacy=0x7fb9101812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:24:03.547 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.537+0000 7fb916812640 1 -- 10.20.193.110:0/2066227954 shutdown_connections 2026-02-13T20:24:03.547 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.537+0000 7fb916812640 1 -- 10.20.193.110:0/2066227954 >> 10.20.193.110:0/2066227954 conn(0x7fb910054e90 msgr2=0x7fb910058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:24:03.547 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.537+0000 7fb916812640 1 -- 10.20.193.110:0/2066227954 shutdown_connections 2026-02-13T20:24:03.547 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.537+0000 7fb916812640 1 -- 10.20.193.110:0/2066227954 wait complete. 2026-02-13T20:24:03.547 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.538+0000 7fb916812640 10 monclient: build_initial_monmap 2026-02-13T20:24:03.547 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.538+0000 7fb916812640 10 monclient: monmap: 2026-02-13T20:24:03.548 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:24:03.548 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:24:03.548 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:24:03.548 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:24:03.548 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:24:03.548 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:24:03.548 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:24:03.548 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:24:03.548 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:24:03.548 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:24:03.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.538+0000 7fb916812640 1 Processor -- start 2026-02-13T20:24:03.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.538+0000 7fb916812640 1 -- start start 2026-02-13T20:24:03.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.538+0000 7fb916812640 10 monclient: init 2026-02-13T20:24:03.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.538+0000 7fb916812640 10 monclient: _reopen_session rank -1 2026-02-13T20:24:03.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.538+0000 7fb916812640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:24:03.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.538+0000 7fb916812640 10 monclient(hunting): picked mon.noname-c con 0x7fb910091470 addr v1:10.20.193.110:6790/0 2026-02-13T20:24:03.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.538+0000 7fb916812640 10 monclient(hunting): picked mon.noname-b con 0x7fb9101401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:24:03.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.538+0000 7fb916812640 10 monclient(hunting): picked mon.noname-a con 0x7fb91013e8d0 addr v1:10.20.193.110:6789/0 2026-02-13T20:24:03.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.538+0000 7fb916812640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb91012e3c0 con 0x7fb91013e8d0 2026-02-13T20:24:03.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.538+0000 7fb916812640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb91013fab0 con 0x7fb9101401c0 2026-02-13T20:24:03.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.538+0000 7fb916812640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb91012f320 con 0x7fb910091470 2026-02-13T20:24:03.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.538+0000 7fb916812640 10 monclient(hunting): _renew_subs 2026-02-13T20:24:03.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.538+0000 7fb916812640 10 monclient(hunting): authenticate will time out at 1405.229610s 2026-02-13T20:24:03.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.538+0000 7fb90ffff640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fb910091470 0x7fb910150530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:47176/0 (socket says 10.20.193.110:47176) 2026-02-13T20:24:03.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.538+0000 7fb90ffff640 1 -- 10.20.193.110:0/857583972 learned_addr learned my addr 10.20.193.110:0/857583972 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:24:03.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.538+0000 7fb90f7fe640 1 -- 10.20.193.110:0/857583972 >> v1:10.20.193.188:6789/0 conn(0x7fb9101401c0 legacy=0x7fb91013e1c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:24:03.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.538+0000 7fb90cff9640 1 -- 10.20.193.110:0/857583972 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1845039314 0 0) 0x7fb91012f320 con 0x7fb910091470 2026-02-13T20:24:03.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.538+0000 7fb90cff9640 10 monclient(hunting): _negotiate 2026-02-13T20:24:03.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.538+0000 7fb90cff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:24:03.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.538+0000 7fb90cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:24:03.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.538+0000 7fb90cff9640 10 monclient(hunting): my global_id is 94574 2026-02-13T20:24:03.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.538+0000 7fb90cff9640 1 -- 10.20.193.110:0/857583972 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8e00035e0 con 0x7fb910091470 2026-02-13T20:24:03.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.538+0000 7fb90cff9640 1 -- 10.20.193.110:0/857583972 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2117075646 0 0) 0x7fb91012e3c0 con 0x7fb91013e8d0 2026-02-13T20:24:03.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.538+0000 7fb90cff9640 10 monclient(hunting): _negotiate 2026-02-13T20:24:03.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.538+0000 7fb90cff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:24:03.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.538+0000 7fb90cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:24:03.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.538+0000 7fb90cff9640 10 monclient(hunting): my global_id is 124275 2026-02-13T20:24:03.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.538+0000 7fb90cff9640 1 -- 10.20.193.110:0/857583972 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb91012f320 con 0x7fb91013e8d0 2026-02-13T20:24:03.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.538+0000 7fb90cff9640 1 -- 10.20.193.110:0/857583972 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 971508010 0 0) 0x7fb8e00035e0 con 0x7fb910091470 2026-02-13T20:24:03.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.538+0000 7fb90cff9640 1 -- 10.20.193.110:0/857583972 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb91012e3c0 con 0x7fb910091470 2026-02-13T20:24:03.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.538+0000 7fb90cff9640 1 -- 10.20.193.110:0/857583972 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb8fc0030b0 con 0x7fb910091470 2026-02-13T20:24:03.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.538+0000 7fb90cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:24:03.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.538+0000 7fb90cff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:24:03.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.538+0000 7fb90cff9640 10 monclient(hunting): dump: 2026-02-13T20:24:03.550 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:24:03.550 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:24:03.550 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:24:03.550 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:24:03.550 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:24:03.550 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:24:03.550 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:24:03.550 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:24:03.550 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:24:03.550 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:24:03.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.538+0000 7fb90cff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:24:03.551 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.538+0000 7fb90cff9640 1 -- 10.20.193.110:0/857583972 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 694826684 0 0) 0x7fb91012f320 con 0x7fb91013e8d0 2026-02-13T20:24:03.551 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.538+0000 7fb90cff9640 1 -- 10.20.193.110:0/857583972 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb8e00035e0 con 0x7fb91013e8d0 2026-02-13T20:24:03.551 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.538+0000 7fb90cff9640 1 -- 10.20.193.110:0/857583972 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb904005160 con 0x7fb91013e8d0 2026-02-13T20:24:03.551 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.538+0000 7fb90cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:24:03.551 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.538+0000 7fb90cff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:24:03.551 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.538+0000 7fb90cff9640 10 monclient(hunting): dump: 2026-02-13T20:24:03.551 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:24:03.551 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:24:03.551 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:24:03.551 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:24:03.551 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:24:03.551 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:24:03.551 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:24:03.551 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:24:03.551 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:24:03.551 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:24:03.551 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.539+0000 7fb90cff9640 1 -- 10.20.193.110:0/857583972 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 88686958 0 0) 0x7fb91012e3c0 con 0x7fb910091470 2026-02-13T20:24:03.551 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.539+0000 7fb90cff9640 1 -- 10.20.193.110:0/857583972 >> v1:10.20.193.188:6789/0 conn(0x7fb9101401c0 legacy=0x7fb91013e1c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T20:24:03.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.539+0000 7fb90cff9640 1 -- 10.20.193.110:0/857583972 >> v1:10.20.193.110:6789/0 conn(0x7fb91013e8d0 legacy=0x7fb9101928a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:24:03.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.539+0000 7fb90cff9640 10 monclient: _finish_hunting 0 2026-02-13T20:24:03.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.539+0000 7fb90cff9640 1 monclient: found mon.c 2026-02-13T20:24:03.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.539+0000 7fb90cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:24:03.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.539+0000 7fb90cff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:24:03.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.539+0000 7fb90cff9640 1 -- 10.20.193.110:0/857583972 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb91012fbc0 con 0x7fb910091470 2026-02-13T20:24:03.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.539+0000 7fb90cff9640 10 monclient: _finish_auth 0 2026-02-13T20:24:03.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.539+0000 7fb90cff9640 10 monclient: _check_auth_tickets 2026-02-13T20:24:03.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.539+0000 7fb90cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:24:03.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.539+0000 7fb916812640 5 monclient: authenticate success, global_id 94574 2026-02-13T20:24:03.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.539+0000 7fb916812640 10 monclient: _renew_subs 2026-02-13T20:24:03.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.539+0000 7fb916812640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:24:03.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.539+0000 7fb916812640 1 -- 10.20.193.110:0/857583972 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb91012e9a0 con 0x7fb910091470 2026-02-13T20:24:03.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.539+0000 7fb916812640 10 monclient: _renew_subs 2026-02-13T20:24:03.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.539+0000 7fb916812640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:24:03.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.539+0000 7fb916812640 1 -- 10.20.193.110:0/857583972 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fb91012f8e0 con 0x7fb910091470 2026-02-13T20:24:03.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.539+0000 7fb90cff9640 1 -- 10.20.193.110:0/857583972 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb8fc003420 con 0x7fb910091470 2026-02-13T20:24:03.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.539+0000 7fb90cff9640 10 monclient: handle_config config(0 keys) 2026-02-13T20:24:03.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.539+0000 7fb90cff9640 1 -- 10.20.193.110:0/857583972 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb8fc003b30 con 0x7fb910091470 2026-02-13T20:24:03.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.539+0000 7fb90cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:24:03.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.539+0000 7fb90cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:24:03.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.539+0000 7fb90cff9640 10 monclient: dump: 2026-02-13T20:24:03.553 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:24:03.553 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:24:03.553 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:24:03.553 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:24:03.553 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:24:03.553 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:24:03.553 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:24:03.553 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:24:03.553 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:24:03.553 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:24:03.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.539+0000 7fb90e7fc640 4 set_mon_vals no callback set 2026-02-13T20:24:03.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.539+0000 7fb916812640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:24:03.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.539+0000 7fb916812640 1 -- 10.20.193.110:0/857583972 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb9100008d0 con 0x7fb910092020 2026-02-13T20:24:03.553 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.539+0000 7fb90cff9640 1 -- 10.20.193.110:0/857583972 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fb8fc003c90 con 0x7fb910091470 2026-02-13T20:24:03.554 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.539+0000 7fb90cff9640 1 -- 10.20.193.110:0/857583972 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(588..588 src has 1..588) ==== 3871+0+0 (unknown 1980572098 0 0) 0x7fb8fc04e8e0 con 0x7fb910091470 2026-02-13T20:24:03.554 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.539+0000 7fb90cff9640 1 -- 10.20.193.110:0/857583972 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 103548733 0 0) 0x7fb9100008d0 con 0x7fb910092020 2026-02-13T20:24:03.554 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.539+0000 7fb90cff9640 10 monclient(hunting): _negotiate 2026-02-13T20:24:03.554 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.539+0000 7fb90cff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:24:03.554 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.539+0000 7fb90cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:24:03.554 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.539+0000 7fb90cff9640 10 monclient(hunting): my global_id is 124278 2026-02-13T20:24:03.554 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.539+0000 7fb90cff9640 1 -- 10.20.193.110:0/857583972 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb91012e3c0 con 0x7fb910092020 2026-02-13T20:24:03.554 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.539+0000 7fb914d88640 10 monclient: get_auth_request con 0x7fb8e003f860 auth_method 0 2026-02-13T20:24:03.554 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.539+0000 7fb90cff9640 1 -- 10.20.193.110:0/857583972 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1154041496 0 0) 0x7fb91012e3c0 con 0x7fb910092020 2026-02-13T20:24:03.554 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.540+0000 7fb90cff9640 1 -- 10.20.193.110:0/857583972 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb9100008d0 con 0x7fb910092020 2026-02-13T20:24:03.554 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.540+0000 7fb90cff9640 1 -- 10.20.193.110:0/857583972 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb9000029d0 con 0x7fb910092020 2026-02-13T20:24:03.554 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.540+0000 7fb90cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:24:03.554 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.540+0000 7fb90cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:24:03.554 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.540+0000 7fb90cff9640 10 monclient: dump: 2026-02-13T20:24:03.554 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:24:03.554 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:24:03.554 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:24:03.554 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:24:03.554 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:24:03.555 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:24:03.555 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:24:03.555 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:24:03.555 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:24:03.555 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:24:03.555 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.540+0000 7fb90cff9640 1 -- 10.20.193.110:0/857583972 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1603831077 0 0) 0x7fb9100008d0 con 0x7fb910092020 2026-02-13T20:24:03.555 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.540+0000 7fb90cff9640 1 -- 10.20.193.110:0/857583972 --> v1:10.20.193.110:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb91005b9a0 con 0x7fb910092020 2026-02-13T20:24:03.555 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.540+0000 7fb90cff9640 1 -- 10.20.193.110:0/857583972 <== mon.0 v1:10.20.193.110:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fb900003320 con 0x7fb910092020 2026-02-13T20:24:03.555 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.540+0000 7fb90cff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:24:03.555 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.540+0000 7fb90cff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:24:03.555 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.540+0000 7fb90cff9640 1 -- 10.20.193.110:0/857583972 >> v1:10.20.193.110:6789/0 conn(0x7fb910092020 legacy=0x7fb910127b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:24:03.555 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.540+0000 7fb90cff9640 1 -- 10.20.193.110:0/857583972 >> v1:10.20.193.110:6789/0 conn(0x7fb910092020 legacy=0x7fb910127b20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:24:03.556 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.543+0000 7fb916812640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:24:03.556 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.543+0000 7fb916812640 1 -- 10.20.193.110:0/857583972 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb910058410 con 0x7fb910128230 2026-02-13T20:24:03.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.543+0000 7fb90cff9640 1 -- 10.20.193.110:0/857583972 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3896253725 0 0) 0x7fb910058410 con 0x7fb910128230 2026-02-13T20:24:03.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.543+0000 7fb90cff9640 10 monclient(hunting): _negotiate 2026-02-13T20:24:03.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.543+0000 7fb90cff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:24:03.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.543+0000 7fb90cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:24:03.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.543+0000 7fb90cff9640 10 monclient(hunting): my global_id is 124281 2026-02-13T20:24:03.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.543+0000 7fb90cff9640 1 -- 10.20.193.110:0/857583972 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb9100008d0 con 0x7fb910128230 2026-02-13T20:24:03.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.544+0000 7fb90cff9640 1 -- 10.20.193.110:0/857583972 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1220613747 0 0) 0x7fb9100008d0 con 0x7fb910128230 2026-02-13T20:24:03.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.544+0000 7fb90cff9640 1 -- 10.20.193.110:0/857583972 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb910058410 con 0x7fb910128230 2026-02-13T20:24:03.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.544+0000 7fb90cff9640 1 -- 10.20.193.110:0/857583972 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fb900004da0 con 0x7fb910128230 2026-02-13T20:24:03.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.544+0000 7fb90cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:24:03.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.544+0000 7fb90cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:24:03.557 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.544+0000 7fb90cff9640 10 monclient: dump: 2026-02-13T20:24:03.557 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:24:03.557 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:24:03.557 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:24:03.557 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:24:03.557 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:24:03.558 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:24:03.558 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:24:03.558 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:24:03.558 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:24:03.558 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:24:03.558 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.544+0000 7fb90cff9640 1 -- 10.20.193.110:0/857583972 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3691509011 0 0) 0x7fb910058410 con 0x7fb910128230 2026-02-13T20:24:03.558 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.544+0000 7fb90cff9640 1 -- 10.20.193.110:0/857583972 --> v1:10.20.193.110:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb9100561b0 con 0x7fb910128230 2026-02-13T20:24:03.558 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.544+0000 7fb90cff9640 1 -- 10.20.193.110:0/857583972 <== mon.0 v1:10.20.193.110:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4503 (unknown 0 0 2818802401) 0x7fb900005030 con 0x7fb910128230 2026-02-13T20:24:03.558 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.544+0000 7fb90cff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:24:03.558 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.544+0000 7fb90cff9640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:24:03.558 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.544+0000 7fb90cff9640 1 -- 10.20.193.110:0/857583972 >> v1:10.20.193.110:6789/0 conn(0x7fb910128230 legacy=0x7fb910195090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:24:03.558 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.544+0000 7fb90cff9640 1 -- 10.20.193.110:0/857583972 >> v1:10.20.193.110:6789/0 conn(0x7fb910128230 legacy=0x7fb910195090 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:24:03.558 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:24:03.558 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:24:03.559 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:24:03.559 INFO:teuthology.orchestra.run.trial110.stdout: "state": "peon", 2026-02-13T20:24:03.559 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 50, 2026-02-13T20:24:03.559 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 158963, 2026-02-13T20:24:03.559 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:24:03.559 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:24:03.559 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:24:03.559 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:24:03.559 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 0, 2026-02-13T20:24:03.559 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:24:03.559 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:24:03.559 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:24:03.559 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:24:03.559 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:24:03.559 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:24:03.559 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:24:03.559 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:24:03.560 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:24:03.560 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:24:03.560 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:24:03.560 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:24:03.560 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:24:03.560 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:24:03.560 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:24:03.560 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:24:03.560 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:24:03.560 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:24:03.560 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:24:03.560 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:24:03.560 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:24:03.560 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:24:03.560 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:24:03.560 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:24:03.560 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:24:03.560 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:24:03.561 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:24:03.561 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:24:03.561 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:24:03.561 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:24:03.561 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:24:03.561 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:24:03.561 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:24:03.561 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:24:03.561 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:24:03.561 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:24:03.561 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:24:03.561 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:24:03.561 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:24:03.561 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:24:03.561 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:24:03.561 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:24:03.561 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:24:03.562 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:24:03.562 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:24:03.562 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:24:03.562 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:24:03.562 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:24:03.562 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:24:03.562 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:24:03.562 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:24:03.562 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:24:03.562 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:24:03.562 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:24:03.562 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:24:03.562 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:24:03.562 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:24:03.562 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:24:03.562 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:24:03.562 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:24:03.562 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:24:03.562 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:24:03.563 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:24:03.563 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:24:03.563 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:24:03.563 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:24:03.563 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:24:03.563 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:24:03.563 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:24:03.563 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:24:03.563 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:24:03.563 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:24:03.563 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:24:03.563 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:24:03.563 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:24:03.563 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:24:03.563 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:24:03.563 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:24:03.563 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:24:03.563 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:24:03.564 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:24:03.564 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:24:03.564 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:24:03.564 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:24:03.564 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:24:03.564 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:24:03.564 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:24:03.564 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:24:03.564 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:24:03.564 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:24:03.564 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:24:03.564 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:24:03.564 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:24:03.564 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:24:03.564 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:24:03.564 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:24:03.564 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:24:03.564 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:24:03.565 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:24:03.565 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:24:03.565 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:24:03.565 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:24:03.565 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:24:03.565 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:24:03.565 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:24:03.565 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:24:03.565 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:24:03.565 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:24:03.565 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:24:03.565 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:24:03.565 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:24:03.565 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:24:03.565 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:24:03.565 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:24:03.565 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:24:03.565 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:24:03.565 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:24:03.566 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:24:03.566 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:24:03.566 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:24:03.566 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:24:03.566 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:24:03.566 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:24:03.566 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:24:03.566 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:24:03.566 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:24:03.566 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:24:03.566 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:24:03.566 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:24:03.566 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:24:03.566 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:24:03.566 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:24:03.566 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:24:03.566 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:24:03.566 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:24:03.567 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:24:03.567 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:24:03.567 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:24:03.567 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:24:03.567 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:24:03.567 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:24:03.567 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:24:03.567 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:24:03.567 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:24:03.567 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:24:03.567 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:24:03.567 INFO:teuthology.orchestra.run.trial110.stdout: "num": 4 2026-02-13T20:24:03.567 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:24:03.567 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:24:03.567 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:24:03.567 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:24:03.567 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:24:03.568 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.544+0000 7fb916812640 1 -- 10.20.193.110:0/857583972 >> v1:10.20.193.188:6812/1623052694 conn(0x7fb8e003f860 legacy=0x7fb8e005fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:24:03.569 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.544+0000 7fb916812640 10 monclient: shutdown 2026-02-13T20:24:03.569 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.544+0000 7fb916812640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:24:03.569 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.544+0000 7fb914d88640 1 -- 10.20.193.110:0/857583972 reap_dead start 2026-02-13T20:24:03.569 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.544+0000 7fb916812640 1 -- 10.20.193.110:0/857583972 >> v1:10.20.193.110:6790/0 conn(0x7fb910091470 legacy=0x7fb910150530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:24:03.569 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.544+0000 7fb916812640 1 -- 10.20.193.110:0/857583972 shutdown_connections 2026-02-13T20:24:03.569 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.544+0000 7fb916812640 1 -- 10.20.193.110:0/857583972 >> 10.20.193.110:0/857583972 conn(0x7fb910054e90 msgr2=0x7fb91008d540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:24:03.569 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.544+0000 7fb916812640 1 -- 10.20.193.110:0/857583972 shutdown_connections 2026-02-13T20:24:03.569 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.544+0000 7fb916812640 1 -- 10.20.193.110:0/857583972 wait complete. 2026-02-13T20:24:03.569 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-13T20:24:03.569 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-13T20:24:03.570 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T20:24:03.636 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.635+0000 7fee76e5b640 10 monclient: get_monmap_and_config 2026-02-13T20:24:03.637 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.635+0000 7fee76e5b640 10 monclient: build_initial_monmap 2026-02-13T20:24:03.637 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.635+0000 7fee76e5b640 10 monclient: monmap: 2026-02-13T20:24:03.637 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:24:03.637 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:24:03.637 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:24:03.637030+0000 2026-02-13T20:24:03.637 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:24:03.637030+0000 2026-02-13T20:24:03.637 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:24:03.637 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:24:03.637 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:24:03.637 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:24:03.637 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:24:03.637 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:24:03.643 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee76e5b640 1 Processor -- start 2026-02-13T20:24:03.643 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee76e5b640 1 -- start start 2026-02-13T20:24:03.643 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee76e5b640 10 monclient: init 2026-02-13T20:24:03.643 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee76e5b640 10 monclient: _reopen_session rank -1 2026-02-13T20:24:03.643 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee76e5b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:24:03.643 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee76e5b640 10 monclient(hunting): picked mon.noname-c con 0x7fee701401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:24:03.643 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee76e5b640 10 monclient(hunting): picked mon.noname-b con 0x7fee70092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:24:03.643 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee76e5b640 10 monclient(hunting): picked mon.noname-a con 0x7fee70091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:24:03.643 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee76e5b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee7008b730 con 0x7fee70091950 2026-02-13T20:24:03.643 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee76e5b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee7005c5b0 con 0x7fee701401c0 2026-02-13T20:24:03.643 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee76e5b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee7008bcf0 con 0x7fee70092020 2026-02-13T20:24:03.643 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee76e5b640 10 monclient(hunting): _renew_subs 2026-02-13T20:24:03.643 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee76e5b640 10 monclient(hunting): authenticate will time out at 1405.327398s 2026-02-13T20:24:03.644 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee74bd0640 1 -- >> v1:10.20.193.188:6789/0 conn(0x7fee701401c0 legacy=0x7fee70091240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:24:03.644 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee67fff640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fee70092020 0x7fee701812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:47182/0 (socket says 10.20.193.110:47182) 2026-02-13T20:24:03.644 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee67fff640 1 -- 10.20.193.110:0/426664016 learned_addr learned my addr 10.20.193.110:0/426664016 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:24:03.644 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee677fe640 1 -- 10.20.193.110:0/426664016 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4165152515 0 0) 0x7fee7008bcf0 con 0x7fee70092020 2026-02-13T20:24:03.644 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee677fe640 10 monclient(hunting): _negotiate 2026-02-13T20:24:03.644 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee677fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:24:03.644 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee677fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:24:03.644 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee677fe640 10 monclient(hunting): my global_id is 94577 2026-02-13T20:24:03.644 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee677fe640 1 -- 10.20.193.110:0/426664016 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee5c0035e0 con 0x7fee70092020 2026-02-13T20:24:03.644 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee677fe640 1 -- 10.20.193.110:0/426664016 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1701953976 0 0) 0x7fee7008b730 con 0x7fee70091950 2026-02-13T20:24:03.644 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee677fe640 10 monclient(hunting): _negotiate 2026-02-13T20:24:03.644 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee677fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:24:03.644 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee677fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:24:03.644 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee677fe640 10 monclient(hunting): my global_id is 124284 2026-02-13T20:24:03.644 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee677fe640 1 -- 10.20.193.110:0/426664016 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee7008bcf0 con 0x7fee70091950 2026-02-13T20:24:03.644 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee677fe640 1 -- 10.20.193.110:0/426664016 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 814695960 0 0) 0x7fee5c0035e0 con 0x7fee70092020 2026-02-13T20:24:03.644 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee677fe640 1 -- 10.20.193.110:0/426664016 >> v1:10.20.193.188:6789/0 conn(0x7fee701401c0 legacy=0x7fee70091240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:24:03.644 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee677fe640 1 -- 10.20.193.110:0/426664016 >> v1:10.20.193.110:6789/0 conn(0x7fee70091950 legacy=0x7fee701a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:24:03.645 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee677fe640 10 monclient: _finish_hunting 0 2026-02-13T20:24:03.645 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee677fe640 1 monclient: found mon.noname-b 2026-02-13T20:24:03.645 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee677fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:24:03.645 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee677fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:24:03.645 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee677fe640 1 -- 10.20.193.110:0/426664016 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee70140590 con 0x7fee70092020 2026-02-13T20:24:03.645 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee677fe640 10 monclient: _finish_auth 0 2026-02-13T20:24:03.645 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee677fe640 10 monclient: _check_auth_tickets 2026-02-13T20:24:03.645 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee677fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:24:03.645 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee677fe640 1 -- 10.20.193.110:0/426664016 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fee58002dd0 con 0x7fee70092020 2026-02-13T20:24:03.645 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee677fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:24:03.645 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee677fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:24:03.645 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee677fe640 10 monclient: dump: 2026-02-13T20:24:03.645 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:24:03.645 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:24:03.645 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:24:03.645 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:24:03.645 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:24:03.645 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:24:03.646 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:24:03.646 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:24:03.646 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:24:03.646 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:24:03.646 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee76e5b640 5 monclient: authenticate success, global_id 94577 2026-02-13T20:24:03.646 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee76e5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:24:03.646 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee677fe640 1 -- 10.20.193.110:0/426664016 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fee58002fa0 con 0x7fee70092020 2026-02-13T20:24:03.646 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee677fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:24:03.646 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee677fe640 1 -- 10.20.193.110:0/426664016 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fee580033b0 con 0x7fee70092020 2026-02-13T20:24:03.646 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee76e5b640 10 monclient: get_monmap_and_config success 2026-02-13T20:24:03.646 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee76e5b640 4 set_mon_vals no callback set 2026-02-13T20:24:03.646 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee677fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:24:03.646 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee677fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:24:03.646 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.636+0000 7fee677fe640 10 monclient: dump: 2026-02-13T20:24:03.646 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:24:03.646 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:24:03.646 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:24:03.646 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:24:03.647 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:24:03.647 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:24:03.647 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:24:03.647 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:24:03.647 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:24:03.647 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:24:03.647 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.637+0000 7fee76e5b640 10 monclient: shutdown 2026-02-13T20:24:03.647 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.637+0000 7fee76e5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:24:03.647 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.637+0000 7fee76e5b640 1 -- 10.20.193.110:0/426664016 >> v1:10.20.193.110:6790/0 conn(0x7fee70092020 legacy=0x7fee701812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:24:03.647 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.637+0000 7fee76e5b640 1 -- 10.20.193.110:0/426664016 shutdown_connections 2026-02-13T20:24:03.647 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.637+0000 7fee76e5b640 1 -- 10.20.193.110:0/426664016 >> 10.20.193.110:0/426664016 conn(0x7fee70054e90 msgr2=0x7fee70058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:24:03.647 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.637+0000 7fee76e5b640 1 -- 10.20.193.110:0/426664016 shutdown_connections 2026-02-13T20:24:03.647 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.637+0000 7fee76e5b640 1 -- 10.20.193.110:0/426664016 wait complete. 2026-02-13T20:24:03.647 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.637+0000 7fee76e5b640 10 monclient: build_initial_monmap 2026-02-13T20:24:03.647 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.637+0000 7fee76e5b640 10 monclient: monmap: 2026-02-13T20:24:03.647 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:24:03.647 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:24:03.647 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:24:03.647 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:24:03.647 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:24:03.648 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:24:03.648 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:24:03.648 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:24:03.648 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:24:03.648 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:24:03.648 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.637+0000 7fee76e5b640 1 Processor -- start 2026-02-13T20:24:03.648 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.637+0000 7fee76e5b640 1 -- start start 2026-02-13T20:24:03.648 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.637+0000 7fee76e5b640 10 monclient: init 2026-02-13T20:24:03.648 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.637+0000 7fee76e5b640 10 monclient: _reopen_session rank -1 2026-02-13T20:24:03.648 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.637+0000 7fee76e5b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:24:03.648 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.637+0000 7fee76e5b640 10 monclient(hunting): picked mon.noname-c con 0x7fee70091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:24:03.648 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.637+0000 7fee76e5b640 10 monclient(hunting): picked mon.noname-b con 0x7fee701401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:24:03.648 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.637+0000 7fee76e5b640 10 monclient(hunting): picked mon.noname-a con 0x7fee70194930 addr v1:10.20.193.110:6789/0 2026-02-13T20:24:03.648 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.637+0000 7fee76e5b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee70090fc0 con 0x7fee70194930 2026-02-13T20:24:03.648 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.637+0000 7fee76e5b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee7005d320 con 0x7fee701401c0 2026-02-13T20:24:03.648 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.637+0000 7fee76e5b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee70132240 con 0x7fee70091950 2026-02-13T20:24:03.648 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.637+0000 7fee76e5b640 10 monclient(hunting): _renew_subs 2026-02-13T20:24:03.648 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.637+0000 7fee76e5b640 10 monclient(hunting): authenticate will time out at 1405.328959s 2026-02-13T20:24:03.649 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.637+0000 7fee74bd0640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fee70091950 0x7fee70088e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:47196/0 (socket says 10.20.193.110:47196) 2026-02-13T20:24:03.649 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.637+0000 7fee74bd0640 1 -- 10.20.193.110:0/3126387504 learned_addr learned my addr 10.20.193.110:0/3126387504 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:24:03.649 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee67fff640 1 -- 10.20.193.110:0/3126387504 >> v1:10.20.193.188:6789/0 conn(0x7fee701401c0 legacy=0x7fee70089570 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:24:03.649 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee657fa640 1 -- 10.20.193.110:0/3126387504 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3789551979 0 0) 0x7fee70132240 con 0x7fee70091950 2026-02-13T20:24:03.649 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee657fa640 10 monclient(hunting): _negotiate 2026-02-13T20:24:03.649 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee657fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:24:03.649 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee657fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:24:03.649 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee657fa640 10 monclient(hunting): my global_id is 94580 2026-02-13T20:24:03.649 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee657fa640 1 -- 10.20.193.110:0/3126387504 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee400035e0 con 0x7fee70091950 2026-02-13T20:24:03.649 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee657fa640 1 -- 10.20.193.110:0/3126387504 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3914863403 0 0) 0x7fee70090fc0 con 0x7fee70194930 2026-02-13T20:24:03.649 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee657fa640 10 monclient(hunting): _negotiate 2026-02-13T20:24:03.649 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee657fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:24:03.649 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee657fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:24:03.649 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee657fa640 10 monclient(hunting): my global_id is 124287 2026-02-13T20:24:03.649 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee657fa640 1 -- 10.20.193.110:0/3126387504 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee70132240 con 0x7fee70194930 2026-02-13T20:24:03.649 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee657fa640 1 -- 10.20.193.110:0/3126387504 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4174421409 0 0) 0x7fee400035e0 con 0x7fee70091950 2026-02-13T20:24:03.649 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee657fa640 1 -- 10.20.193.110:0/3126387504 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fee70090fc0 con 0x7fee70091950 2026-02-13T20:24:03.650 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee657fa640 1 -- 10.20.193.110:0/3126387504 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fee60004250 con 0x7fee70091950 2026-02-13T20:24:03.650 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee657fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:24:03.650 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee657fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:24:03.650 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee657fa640 10 monclient(hunting): dump: 2026-02-13T20:24:03.650 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:24:03.650 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:24:03.650 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:24:03.650 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:24:03.650 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:24:03.650 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:24:03.650 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:24:03.650 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:24:03.650 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:24:03.650 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:24:03.650 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee657fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:24:03.650 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee657fa640 1 -- 10.20.193.110:0/3126387504 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1499331303 0 0) 0x7fee70132240 con 0x7fee70194930 2026-02-13T20:24:03.650 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee657fa640 1 -- 10.20.193.110:0/3126387504 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fee400035e0 con 0x7fee70194930 2026-02-13T20:24:03.650 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee657fa640 1 -- 10.20.193.110:0/3126387504 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fee6c004170 con 0x7fee70194930 2026-02-13T20:24:03.650 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee657fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:24:03.651 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee657fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:24:03.651 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee657fa640 10 monclient(hunting): dump: 2026-02-13T20:24:03.651 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:24:03.651 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:24:03.651 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:24:03.651 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:24:03.651 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:24:03.651 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:24:03.651 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:24:03.651 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:24:03.651 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:24:03.651 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:24:03.651 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee657fa640 1 -- 10.20.193.110:0/3126387504 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 381479253 0 0) 0x7fee70090fc0 con 0x7fee70091950 2026-02-13T20:24:03.651 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee657fa640 1 -- 10.20.193.110:0/3126387504 >> v1:10.20.193.188:6789/0 conn(0x7fee701401c0 legacy=0x7fee70089570 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T20:24:03.651 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee657fa640 1 -- 10.20.193.110:0/3126387504 >> v1:10.20.193.110:6789/0 conn(0x7fee70194930 legacy=0x7fee70194dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:24:03.651 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee657fa640 10 monclient: _finish_hunting 0 2026-02-13T20:24:03.651 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee657fa640 1 monclient: found mon.c 2026-02-13T20:24:03.651 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee657fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:24:03.651 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee657fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:24:03.652 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee657fa640 1 -- 10.20.193.110:0/3126387504 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee70089c80 con 0x7fee70091950 2026-02-13T20:24:03.652 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee657fa640 10 monclient: _finish_auth 0 2026-02-13T20:24:03.652 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee657fa640 10 monclient: _check_auth_tickets 2026-02-13T20:24:03.652 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee657fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:24:03.652 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee76e5b640 5 monclient: authenticate success, global_id 94580 2026-02-13T20:24:03.652 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee76e5b640 10 monclient: _renew_subs 2026-02-13T20:24:03.652 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee76e5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:24:03.652 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee76e5b640 1 -- 10.20.193.110:0/3126387504 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fee7008c3a0 con 0x7fee70091950 2026-02-13T20:24:03.652 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee76e5b640 10 monclient: _renew_subs 2026-02-13T20:24:03.652 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee76e5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:24:03.652 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee76e5b640 1 -- 10.20.193.110:0/3126387504 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fee70130a40 con 0x7fee70091950 2026-02-13T20:24:03.652 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee657fa640 1 -- 10.20.193.110:0/3126387504 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fee60004490 con 0x7fee70091950 2026-02-13T20:24:03.652 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee657fa640 10 monclient: handle_config config(0 keys) 2026-02-13T20:24:03.652 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee657fa640 1 -- 10.20.193.110:0/3126387504 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fee60004870 con 0x7fee70091950 2026-02-13T20:24:03.652 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee657fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:24:03.652 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee66ffd640 4 set_mon_vals no callback set 2026-02-13T20:24:03.652 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee657fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:24:03.652 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee657fa640 10 monclient: dump: 2026-02-13T20:24:03.653 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:24:03.653 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:24:03.653 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:24:03.653 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:24:03.653 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:24:03.653 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:24:03.653 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:24:03.653 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:24:03.653 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:24:03.653 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:24:03.653 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee76e5b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:24:03.653 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.638+0000 7fee76e5b640 1 -- 10.20.193.110:0/3126387504 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fee70131b30 con 0x7fee70092020 2026-02-13T20:24:03.653 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.639+0000 7fee657fa640 1 -- 10.20.193.110:0/3126387504 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fee600049d0 con 0x7fee70091950 2026-02-13T20:24:03.653 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.639+0000 7fee657fa640 1 -- 10.20.193.110:0/3126387504 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(588..588 src has 1..588) ==== 3871+0+0 (unknown 1980572098 0 0) 0x7fee6004e910 con 0x7fee70091950 2026-02-13T20:24:03.653 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.639+0000 7fee657fa640 1 -- 10.20.193.110:0/3126387504 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1500969044 0 0) 0x7fee70131b30 con 0x7fee70092020 2026-02-13T20:24:03.653 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.639+0000 7fee657fa640 10 monclient(hunting): _negotiate 2026-02-13T20:24:03.653 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.639+0000 7fee657fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:24:03.653 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.639+0000 7fee657fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:24:03.653 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.639+0000 7fee657fa640 10 monclient(hunting): my global_id is 94583 2026-02-13T20:24:03.654 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.639+0000 7fee657fa640 1 -- 10.20.193.110:0/3126387504 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee70090fc0 con 0x7fee70092020 2026-02-13T20:24:03.654 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.639+0000 7fee753d1640 10 monclient: get_auth_request con 0x7fee4003fa00 auth_method 0 2026-02-13T20:24:03.654 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.639+0000 7fee657fa640 1 -- 10.20.193.110:0/3126387504 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2603998593 0 0) 0x7fee70090fc0 con 0x7fee70092020 2026-02-13T20:24:03.654 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.639+0000 7fee657fa640 1 -- 10.20.193.110:0/3126387504 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fee70131b30 con 0x7fee70092020 2026-02-13T20:24:03.654 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.639+0000 7fee657fa640 1 -- 10.20.193.110:0/3126387504 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fee58002dd0 con 0x7fee70092020 2026-02-13T20:24:03.654 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.639+0000 7fee657fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:24:03.654 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.639+0000 7fee657fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:24:03.654 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.639+0000 7fee657fa640 10 monclient: dump: 2026-02-13T20:24:03.654 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:24:03.654 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:24:03.654 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:24:03.654 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:24:03.654 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:24:03.654 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:24:03.654 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:24:03.654 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:24:03.654 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:24:03.654 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:24:03.654 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.639+0000 7fee657fa640 1 -- 10.20.193.110:0/3126387504 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1512877301 0 0) 0x7fee70131b30 con 0x7fee70092020 2026-02-13T20:24:03.655 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.639+0000 7fee657fa640 1 -- 10.20.193.110:0/3126387504 --> v1:10.20.193.110:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fee7008b450 con 0x7fee70092020 2026-02-13T20:24:03.655 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.639+0000 7fee657fa640 1 -- 10.20.193.110:0/3126387504 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fee58003340 con 0x7fee70092020 2026-02-13T20:24:03.655 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.639+0000 7fee657fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:24:03.655 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.639+0000 7fee657fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:24:03.655 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.639+0000 7fee657fa640 1 -- 10.20.193.110:0/3126387504 >> v1:10.20.193.110:6790/0 conn(0x7fee70092020 legacy=0x7fee70127b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:24:03.655 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.639+0000 7fee657fa640 1 -- 10.20.193.110:0/3126387504 >> v1:10.20.193.110:6790/0 conn(0x7fee70092020 legacy=0x7fee70127b20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:24:03.656 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.643+0000 7fee76e5b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:24:03.656 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.643+0000 7fee76e5b640 1 -- 10.20.193.110:0/3126387504 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fee70055bb0 con 0x7fee70128230 2026-02-13T20:24:03.656 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.643+0000 7fee657fa640 1 -- 10.20.193.110:0/3126387504 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3593593931 0 0) 0x7fee70055bb0 con 0x7fee70128230 2026-02-13T20:24:03.656 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.643+0000 7fee657fa640 10 monclient(hunting): _negotiate 2026-02-13T20:24:03.656 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.643+0000 7fee657fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:24:03.656 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.643+0000 7fee657fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:24:03.656 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.643+0000 7fee657fa640 10 monclient(hunting): my global_id is 94586 2026-02-13T20:24:03.656 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.643+0000 7fee657fa640 1 -- 10.20.193.110:0/3126387504 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee70131b30 con 0x7fee70128230 2026-02-13T20:24:03.656 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.643+0000 7fee657fa640 1 -- 10.20.193.110:0/3126387504 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 175631037 0 0) 0x7fee70131b30 con 0x7fee70128230 2026-02-13T20:24:03.656 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.643+0000 7fee657fa640 1 -- 10.20.193.110:0/3126387504 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fee70055bb0 con 0x7fee70128230 2026-02-13T20:24:03.656 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.643+0000 7fee657fa640 1 -- 10.20.193.110:0/3126387504 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fee58004c40 con 0x7fee70128230 2026-02-13T20:24:03.657 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.643+0000 7fee657fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:24:03.657 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.643+0000 7fee657fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:24:03.657 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.643+0000 7fee657fa640 10 monclient: dump: 2026-02-13T20:24:03.657 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:24:03.657 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:24:03.657 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:24:03.657 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:24:03.657 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:24:03.657 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:24:03.657 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:24:03.657 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:24:03.657 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:24:03.657 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:24:03.657 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.643+0000 7fee657fa640 1 -- 10.20.193.110:0/3126387504 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3863385111 0 0) 0x7fee70055bb0 con 0x7fee70128230 2026-02-13T20:24:03.657 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.643+0000 7fee657fa640 1 -- 10.20.193.110:0/3126387504 --> v1:10.20.193.110:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fee70058410 con 0x7fee70128230 2026-02-13T20:24:03.657 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.643+0000 7fee657fa640 1 -- 10.20.193.110:0/3126387504 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4672 (unknown 0 0 2308623894) 0x7fee58004f80 con 0x7fee70128230 2026-02-13T20:24:03.657 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.643+0000 7fee657fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:24:03.657 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.643+0000 7fee657fa640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:24:03.658 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.643+0000 7fee657fa640 1 -- 10.20.193.110:0/3126387504 >> v1:10.20.193.110:6790/0 conn(0x7fee70128230 legacy=0x7fee70197500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:24:03.658 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.643+0000 7fee657fa640 1 -- 10.20.193.110:0/3126387504 >> v1:10.20.193.110:6790/0 conn(0x7fee70128230 legacy=0x7fee70197500 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:24:03.658 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:24:03.658 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:24:03.658 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:24:03.658 INFO:teuthology.orchestra.run.trial110.stdout: "state": "leader", 2026-02-13T20:24:03.658 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 50, 2026-02-13T20:24:03.658 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 515267, 2026-02-13T20:24:03.658 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:24:03.658 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:24:03.658 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:24:03.658 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:24:03.658 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 0, 2026-02-13T20:24:03.659 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:24:03.659 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:24:03.659 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:24:03.659 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:24:03.659 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:24:03.659 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:24:03.659 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:24:03.659 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:24:03.659 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:24:03.659 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:24:03.659 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:24:03.659 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:24:03.659 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:24:03.659 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:24:03.659 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:24:03.659 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:24:03.659 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:24:03.659 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:24:03.660 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:24:03.660 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:24:03.660 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:24:03.660 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:24:03.660 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:24:03.660 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:24:03.660 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:24:03.660 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:24:03.660 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:24:03.660 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:24:03.660 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:24:03.660 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:24:03.660 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:24:03.660 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:24:03.660 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:24:03.660 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:24:03.660 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:24:03.660 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:24:03.661 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:24:03.661 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:24:03.661 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:24:03.661 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:24:03.661 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:24:03.661 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:24:03.661 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:24:03.661 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:24:03.661 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:24:03.661 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:24:03.661 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:24:03.661 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:24:03.661 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:24:03.661 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:24:03.661 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:24:03.661 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:24:03.661 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:24:03.661 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:24:03.662 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:24:03.662 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:24:03.662 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:24:03.662 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:24:03.662 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:24:03.662 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:24:03.662 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:24:03.662 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:24:03.662 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:24:03.662 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:24:03.662 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:24:03.662 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:24:03.662 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:24:03.662 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:24:03.662 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:24:03.662 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:24:03.662 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:24:03.662 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:24:03.662 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:24:03.663 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:24:03.663 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:24:03.663 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:24:03.663 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:24:03.663 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:24:03.663 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:24:03.663 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:24:03.663 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:24:03.663 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:24:03.663 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:24:03.663 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:24:03.663 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:24:03.663 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:24:03.663 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:24:03.663 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:24:03.663 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:24:03.663 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:24:03.663 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:24:03.663 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:24:03.664 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:24:03.664 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:24:03.664 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:24:03.664 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:24:03.664 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:24:03.664 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:24:03.664 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:24:03.664 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:24:03.664 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:24:03.664 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:24:03.664 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:24:03.664 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:24:03.664 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:24:03.664 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:24:03.664 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:24:03.664 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:24:03.664 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:24:03.664 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:24:03.664 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:24:03.665 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:24:03.665 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:24:03.665 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:24:03.665 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:24:03.665 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:24:03.665 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:24:03.665 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:24:03.665 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:24:03.665 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:24:03.665 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:24:03.665 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:24:03.665 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:24:03.665 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:24:03.665 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:24:03.665 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:24:03.665 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:24:03.665 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:24:03.665 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:24:03.665 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:24:03.666 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:24:03.666 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:24:03.666 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:24:03.666 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:24:03.666 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:24:03.666 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:24:03.666 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:24:03.666 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:24:03.666 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:24:03.666 INFO:teuthology.orchestra.run.trial110.stdout: "num": 5 2026-02-13T20:24:03.666 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:24:03.666 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:24:03.666 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:24:03.666 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:24:03.666 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:24:03.666 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:24:03.666 INFO:teuthology.orchestra.run.trial110.stdout: "num": 4 2026-02-13T20:24:03.666 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:24:03.666 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:24:03.667 INFO:teuthology.orchestra.run.trial110.stdout: "mgr": [ 2026-02-13T20:24:03.667 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:24:03.667 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:24:03.667 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:24:03.667 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:24:03.667 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:24:03.667 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:24:03.667 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:24:03.667 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:24:03.667 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:24:03.668 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.644+0000 7fee76e5b640 1 -- 10.20.193.110:0/3126387504 >> v1:10.20.193.188:6812/1623052694 conn(0x7fee4003fa00 legacy=0x7fee4005feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:24:03.668 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.644+0000 7fee76e5b640 10 monclient: shutdown 2026-02-13T20:24:03.668 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.644+0000 7fee76e5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:24:03.668 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.644+0000 7fee76e5b640 1 -- 10.20.193.110:0/3126387504 >> v1:10.20.193.110:6790/0 conn(0x7fee70091950 legacy=0x7fee70088e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:24:03.668 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.644+0000 7fee753d1640 1 -- 10.20.193.110:0/3126387504 reap_dead start 2026-02-13T20:24:03.668 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.644+0000 7fee753d1640 1 -- 10.20.193.110:0/3126387504 reap_dead start 2026-02-13T20:24:03.668 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.644+0000 7fee76e5b640 1 -- 10.20.193.110:0/3126387504 shutdown_connections 2026-02-13T20:24:03.668 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.644+0000 7fee76e5b640 1 -- 10.20.193.110:0/3126387504 >> 10.20.193.110:0/3126387504 conn(0x7fee70054e90 msgr2=0x7fee7008dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:24:03.668 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.644+0000 7fee76e5b640 1 -- 10.20.193.110:0/3126387504 shutdown_connections 2026-02-13T20:24:03.669 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:24:03.644+0000 7fee76e5b640 1 -- 10.20.193.110:0/3126387504 wait complete. 2026-02-13T20:24:03.669 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-13T20:24:03.669 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-13T20:24:04.316 INFO:tasks.rados.rados.0.trial188.stdout:2764: done (0 left) 2026-02-13T20:24:04.317 INFO:tasks.rados.rados.0.trial188.stdout:2765: snap_create 2026-02-13T20:24:05.319 INFO:tasks.rados.rados.0.trial188.stdout:2765: done (0 left) 2026-02-13T20:24:05.319 INFO:tasks.rados.rados.0.trial188.stdout:2766: write (excl) oid 47 current snap is 289 2026-02-13T20:24:05.320 INFO:tasks.rados.rados.0.trial188.stdout:2766: seq_num 959 ranges {517913=424269,1401761=446989} 2026-02-13T20:24:05.323 INFO:tasks.rados.rados.0.trial188.stdout:2766: writing trial18843701-47 from 517913 to 942182 tid 1 2026-02-13T20:24:05.326 INFO:tasks.rados.rados.0.trial188.stdout:2766: writing trial18843701-47 from 1401761 to 1848750 tid 2 2026-02-13T20:24:05.327 INFO:tasks.rados.rados.0.trial188.stdout:2767: snap_remove snap 255 2026-02-13T20:24:06.320 INFO:tasks.rados.rados.0.trial188.stdout:2767: done (1 left) 2026-02-13T20:24:06.320 INFO:tasks.rados.rados.0.trial188.stdout:2768: read oid 10 snap -1 2026-02-13T20:24:06.320 INFO:tasks.rados.rados.0.trial188.stdout:2768: expect (ObjNum 645 snap 172 seq_num 645) 2026-02-13T20:24:06.320 INFO:tasks.rados.rados.0.trial188.stdout:2769: write oid 33 current snap is 289 2026-02-13T20:24:06.320 INFO:tasks.rados.rados.0.trial188.stdout:2769: seq_num 960 ranges {534720=499518,1460243=674477} 2026-02-13T20:24:06.324 INFO:tasks.rados.rados.0.trial188.stdout:2769: writing trial18843701-33 from 534720 to 1034238 tid 1 2026-02-13T20:24:06.329 INFO:tasks.rados.rados.0.trial188.stdout:2769: writing trial18843701-33 from 1460243 to 2134720 tid 2 2026-02-13T20:24:06.329 INFO:tasks.rados.rados.0.trial188.stdout:2770: write (excl) oid 20 current snap is 289 2026-02-13T20:24:06.329 INFO:tasks.rados.rados.0.trial188.stdout:2770: seq_num 961 ranges {551527=574767,1918725=232802} 2026-02-13T20:24:06.333 INFO:tasks.rados.rados.0.trial188.stdout:2770: writing trial18843701-20 from 551527 to 1126294 tid 1 2026-02-13T20:24:06.337 INFO:tasks.rados.rados.0.trial188.stdout:2770: writing trial18843701-20 from 1918725 to 2151527 tid 2 2026-02-13T20:24:06.337 INFO:tasks.rados.rados.0.trial188.stdout:2771: snap_remove snap 284 2026-02-13T20:24:07.323 INFO:tasks.rados.rados.0.trial188.stdout:2771: done (4 left) 2026-02-13T20:24:07.323 INFO:tasks.rados.rados.0.trial188.stdout:2772: write (excl) oid 23 current snap is 289 2026-02-13T20:24:07.323 INFO:tasks.rados.rados.0.trial188.stdout:2772: seq_num 962 ranges {568334=650016,1860854=307480} 2026-02-13T20:24:07.328 INFO:tasks.rados.rados.0.trial188.stdout:2772: writing trial18843701-23 from 568334 to 1218350 tid 1 2026-02-13T20:24:07.333 INFO:tasks.rados.rados.0.trial188.stdout:2772: writing trial18843701-23 from 1860854 to 2168334 tid 2 2026-02-13T20:24:07.333 INFO:tasks.rados.rados.0.trial188.stdout:2773: read oid 17 snap -1 2026-02-13T20:24:07.333 INFO:tasks.rados.rados.0.trial188.stdout:2773: expect (ObjNum 871 snap 253 seq_num 871) 2026-02-13T20:24:07.333 INFO:tasks.rados.rados.0.trial188.stdout:2774: copy_from oid 5 from oid 36 current snap is 289 2026-02-13T20:24:07.333 INFO:tasks.rados.rados.0.trial188.stdout:2766: finishing write tid 1 to trial18843701-47 2026-02-13T20:24:07.333 INFO:tasks.rados.rados.0.trial188.stdout:2766: finishing write tid 2 to trial18843701-47 2026-02-13T20:24:07.333 INFO:tasks.rados.rados.0.trial188.stdout:2766: finishing write tid 3 to trial18843701-47 2026-02-13T20:24:07.333 INFO:tasks.rados.rados.0.trial188.stdout:2766: finishing write tid 4 to trial18843701-47 2026-02-13T20:24:07.334 INFO:tasks.rados.rados.0.trial188.stdout:2766: oid 47 updating version 0 to 1013 2026-02-13T20:24:07.334 INFO:tasks.rados.rados.0.trial188.stdout:2766: oid 47 version 1013 is already newer than 1012 2026-02-13T20:24:07.334 INFO:tasks.rados.rados.0.trial188.stdout:2766: oid 47 updating version 1013 to 1014 2026-02-13T20:24:07.334 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 47 v 1014 (ObjNum 959 snap 289 seq_num 959) dirty exists 2026-02-13T20:24:07.334 INFO:tasks.rados.rados.0.trial188.stdout:2766: left oid 47 (ObjNum 959 snap 289 seq_num 959) 2026-02-13T20:24:07.334 INFO:tasks.rados.rados.0.trial188.stdout:2768: expect (ObjNum 645 snap 172 seq_num 645) 2026-02-13T20:24:07.340 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1936005 2026-02-13T20:24:07.368 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1398157 2026-02-13T20:24:07.384 INFO:tasks.rados.rados.0.trial188.stdout:2769: finishing write tid 1 to trial18843701-33 2026-02-13T20:24:07.384 INFO:tasks.rados.rados.0.trial188.stdout:2766: done (6 left) 2026-02-13T20:24:07.384 INFO:tasks.rados.rados.0.trial188.stdout:2768: done (5 left) 2026-02-13T20:24:07.384 INFO:tasks.rados.rados.0.trial188.stdout:2775: rollback oid 6 current snap is 289 2026-02-13T20:24:07.384 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 6 to 288 2026-02-13T20:24:07.384 INFO:tasks.rados.rados.0.trial188.stdout:2770: finishing write tid 1 to trial18843701-20 2026-02-13T20:24:07.384 INFO:tasks.rados.rados.0.trial188.stdout:2770: finishing write tid 2 to trial18843701-20 2026-02-13T20:24:07.385 INFO:tasks.rados.rados.0.trial188.stdout:2769: finishing write tid 2 to trial18843701-33 2026-02-13T20:24:07.385 INFO:tasks.rados.rados.0.trial188.stdout:2769: finishing write tid 3 to trial18843701-33 2026-02-13T20:24:07.385 INFO:tasks.rados.rados.0.trial188.stdout:2770: finishing write tid 3 to trial18843701-20 2026-02-13T20:24:07.385 INFO:tasks.rados.rados.0.trial188.stdout:2770: finishing write tid 4 to trial18843701-20 2026-02-13T20:24:07.385 INFO:tasks.rados.rados.0.trial188.stdout:2770: oid 20 updating version 0 to 1247 2026-02-13T20:24:07.385 INFO:tasks.rados.rados.0.trial188.stdout:2770: oid 20 version 1247 is already newer than 1246 2026-02-13T20:24:07.385 INFO:tasks.rados.rados.0.trial188.stdout:2770: oid 20 updating version 1247 to 1248 2026-02-13T20:24:07.385 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 20 v 1248 (ObjNum 961 snap 289 seq_num 961) dirty exists 2026-02-13T20:24:07.385 INFO:tasks.rados.rados.0.trial188.stdout:2770: left oid 20 (ObjNum 961 snap 289 seq_num 961) 2026-02-13T20:24:07.385 INFO:tasks.rados.rados.0.trial188.stdout:2769: finishing write tid 4 to trial18843701-33 2026-02-13T20:24:07.385 INFO:tasks.rados.rados.0.trial188.stdout:2769: oid 33 updating version 0 to 1017 2026-02-13T20:24:07.386 INFO:tasks.rados.rados.0.trial188.stdout:2769: oid 33 version 1017 is already newer than 1015 2026-02-13T20:24:07.386 INFO:tasks.rados.rados.0.trial188.stdout:2769: oid 33 version 1017 is already newer than 1016 2026-02-13T20:24:07.386 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 33 v 1017 (ObjNum 960 snap 289 seq_num 960) dirty exists 2026-02-13T20:24:07.386 INFO:tasks.rados.rados.0.trial188.stdout:2769: left oid 33 (ObjNum 960 snap 289 seq_num 960) 2026-02-13T20:24:07.386 INFO:tasks.rados.rados.0.trial188.stdout:2769: done (5 left) 2026-02-13T20:24:07.386 INFO:tasks.rados.rados.0.trial188.stdout:2770: done (4 left) 2026-02-13T20:24:07.386 INFO:tasks.rados.rados.0.trial188.stdout:2776: read oid 18 snap -1 2026-02-13T20:24:07.386 INFO:tasks.rados.rados.0.trial188.stdout:2776: expect deleted 2026-02-13T20:24:07.386 INFO:tasks.rados.rados.0.trial188.stdout:2777: write (excl) oid 8 current snap is 289 2026-02-13T20:24:07.386 INFO:tasks.rados.rados.0.trial188.stdout:2773: expect (ObjNum 871 snap 253 seq_num 871) 2026-02-13T20:24:07.386 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:24:07.463 INFO:tasks.rados.rados.0.trial188.stdout:2772: finishing write tid 1 to trial18843701-23 2026-02-13T20:24:07.463 INFO:tasks.rados.rados.0.trial188.stdout:2772: finishing write tid 2 to trial18843701-23 2026-02-13T20:24:07.463 INFO:tasks.rados.rados.0.trial188.stdout:2772: finishing write tid 3 to trial18843701-23 2026-02-13T20:24:07.463 INFO:tasks.rados.rados.0.trial188.stdout:2772: finishing write tid 4 to trial18843701-23 2026-02-13T20:24:07.463 INFO:tasks.rados.rados.0.trial188.stdout:2772: oid 23 updating version 0 to 1329 2026-02-13T20:24:07.463 INFO:tasks.rados.rados.0.trial188.stdout:2772: oid 23 version 1329 is already newer than 1327 2026-02-13T20:24:07.463 INFO:tasks.rados.rados.0.trial188.stdout:2772: oid 23 version 1329 is already newer than 1328 2026-02-13T20:24:07.464 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 23 v 1329 (ObjNum 962 snap 289 seq_num 962) dirty exists 2026-02-13T20:24:07.464 INFO:tasks.rados.rados.0.trial188.stdout:2772: left oid 23 (ObjNum 962 snap 289 seq_num 962) 2026-02-13T20:24:07.464 INFO:tasks.rados.rados.0.trial188.stdout:2774: finishing copy_from racing read to trial18843701-5 2026-02-13T20:24:07.464 INFO:tasks.rados.rados.0.trial188.stdout:2774: finishing copy_from to trial18843701-5 2026-02-13T20:24:07.464 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 5 v 1269 (ObjNum 927 snap 280 seq_num 927) dirty exists 2026-02-13T20:24:07.464 INFO:tasks.rados.rados.0.trial188.stdout:2777: seq_num 963 ranges {585141=725265,1919336=265805} 2026-02-13T20:24:07.467 INFO:tasks.rados.rados.0.trial188.stdout:2777: writing trial18843701-8 from 585141 to 1310406 tid 1 2026-02-13T20:24:07.471 INFO:tasks.rados.rados.0.trial188.stdout:2777: writing trial18843701-8 from 1919336 to 2185141 tid 2 2026-02-13T20:24:07.471 INFO:tasks.rados.rados.0.trial188.stdout:2772: done (5 left) 2026-02-13T20:24:07.471 INFO:tasks.rados.rados.0.trial188.stdout:2773: done (4 left) 2026-02-13T20:24:07.471 INFO:tasks.rados.rados.0.trial188.stdout:2774: done (3 left) 2026-02-13T20:24:07.471 INFO:tasks.rados.rados.0.trial188.stdout:2778: write oid 31 current snap is 289 2026-02-13T20:24:07.471 INFO:tasks.rados.rados.0.trial188.stdout:2778: seq_num 964 ranges {601948=400514,1577818=624130} 2026-02-13T20:24:07.474 INFO:tasks.rados.rados.0.trial188.stdout:2778: writing trial18843701-31 from 601948 to 1002462 tid 1 2026-02-13T20:24:07.479 INFO:tasks.rados.rados.0.trial188.stdout:2778: writing trial18843701-31 from 1577818 to 2201948 tid 2 2026-02-13T20:24:07.479 INFO:tasks.rados.rados.0.trial188.stdout:2779: rollback oid 34 current snap is 289 2026-02-13T20:24:07.480 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 34 to 288 2026-02-13T20:24:07.480 INFO:tasks.rados.rados.0.trial188.stdout:2775: finishing rollback tid 0 to trial18843701-6 2026-02-13T20:24:07.480 INFO:tasks.rados.rados.0.trial188.stdout:2775: finishing rollback tid 1 to trial18843701-6 2026-02-13T20:24:07.480 INFO:tasks.rados.rados.0.trial188.stdout:2775: finishing rollback tid 2 to trial18843701-6 2026-02-13T20:24:07.480 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 6 v 1333 (ObjNum 854 snap 250 seq_num 854) dirty exists 2026-02-13T20:24:07.480 INFO:tasks.rados.rados.0.trial188.stdout:2775: done (4 left) 2026-02-13T20:24:07.480 INFO:tasks.rados.rados.0.trial188.stdout:2776: done (3 left) 2026-02-13T20:24:07.480 INFO:tasks.rados.rados.0.trial188.stdout:2780: delete oid 38 current snap is 289 2026-02-13T20:24:07.485 INFO:tasks.rados.rados.0.trial188.stdout:2777: finishing write tid 1 to trial18843701-8 2026-02-13T20:24:07.486 INFO:tasks.rados.rados.0.trial188.stdout:2780: done (3 left) 2026-02-13T20:24:07.486 INFO:tasks.rados.rados.0.trial188.stdout:2781: write (excl) oid 48 current snap is 289 2026-02-13T20:24:07.486 INFO:tasks.rados.rados.0.trial188.stdout:2781: seq_num 966 ranges {635562=667365,2094782=140780} 2026-02-13T20:24:07.491 INFO:tasks.rados.rados.0.trial188.stdout:2781: writing trial18843701-48 from 635562 to 1302927 tid 1 2026-02-13T20:24:07.495 INFO:tasks.rados.rados.0.trial188.stdout:2781: writing trial18843701-48 from 2094782 to 2235562 tid 2 2026-02-13T20:24:07.495 INFO:tasks.rados.rados.0.trial188.stdout:2782: rollback oid 10 current snap is 289 2026-02-13T20:24:07.495 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 10 to 228 2026-02-13T20:24:07.496 INFO:tasks.rados.rados.0.trial188.stdout:2778: finishing write tid 1 to trial18843701-31 2026-02-13T20:24:07.496 INFO:tasks.rados.rados.0.trial188.stdout:2777: finishing write tid 2 to trial18843701-8 2026-02-13T20:24:07.496 INFO:tasks.rados.rados.0.trial188.stdout:2777: finishing write tid 3 to trial18843701-8 2026-02-13T20:24:07.496 INFO:tasks.rados.rados.0.trial188.stdout:2779: finishing rollback tid 0 to trial18843701-34 2026-02-13T20:24:07.496 INFO:tasks.rados.rados.0.trial188.stdout:2778: finishing write tid 2 to trial18843701-31 2026-02-13T20:24:07.496 INFO:tasks.rados.rados.0.trial188.stdout:2778: finishing write tid 3 to trial18843701-31 2026-02-13T20:24:07.496 INFO:tasks.rados.rados.0.trial188.stdout:2777: finishing write tid 4 to trial18843701-8 2026-02-13T20:24:07.496 INFO:tasks.rados.rados.0.trial188.stdout:2777: oid 8 updating version 0 to 1318 2026-02-13T20:24:07.496 INFO:tasks.rados.rados.0.trial188.stdout:2777: oid 8 updating version 1318 to 1319 2026-02-13T20:24:07.497 INFO:tasks.rados.rados.0.trial188.stdout:2777: oid 8 updating version 1319 to 1320 2026-02-13T20:24:07.497 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 8 v 1320 (ObjNum 963 snap 289 seq_num 963) dirty exists 2026-02-13T20:24:07.497 INFO:tasks.rados.rados.0.trial188.stdout:2777: left oid 8 (ObjNum 963 snap 289 seq_num 963) 2026-02-13T20:24:07.497 INFO:tasks.rados.rados.0.trial188.stdout:2779: finishing rollback tid 1 to trial18843701-34 2026-02-13T20:24:07.497 INFO:tasks.rados.rados.0.trial188.stdout:2778: finishing write tid 4 to trial18843701-31 2026-02-13T20:24:07.497 INFO:tasks.rados.rados.0.trial188.stdout:2778: oid 31 updating version 0 to 968 2026-02-13T20:24:07.497 INFO:tasks.rados.rados.0.trial188.stdout:2778: oid 31 version 968 is already newer than 967 2026-02-13T20:24:07.497 INFO:tasks.rados.rados.0.trial188.stdout:2778: oid 31 updating version 968 to 969 2026-02-13T20:24:07.497 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 31 v 969 (ObjNum 964 snap 289 seq_num 964) dirty exists 2026-02-13T20:24:07.497 INFO:tasks.rados.rados.0.trial188.stdout:2778: left oid 31 (ObjNum 964 snap 289 seq_num 964) 2026-02-13T20:24:07.497 INFO:tasks.rados.rados.0.trial188.stdout:2779: finishing rollback tid 2 to trial18843701-34 2026-02-13T20:24:07.497 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 34 v 1324 (ObjNum 896 snap 270 seq_num 896) dirty exists 2026-02-13T20:24:07.497 INFO:tasks.rados.rados.0.trial188.stdout:2777: done (4 left) 2026-02-13T20:24:07.498 INFO:tasks.rados.rados.0.trial188.stdout:2778: done (3 left) 2026-02-13T20:24:07.498 INFO:tasks.rados.rados.0.trial188.stdout:2779: done (2 left) 2026-02-13T20:24:07.498 INFO:tasks.rados.rados.0.trial188.stdout:2783: read oid 31 snap -1 2026-02-13T20:24:07.498 INFO:tasks.rados.rados.0.trial188.stdout:2783: expect (ObjNum 964 snap 289 seq_num 964) 2026-02-13T20:24:07.498 INFO:tasks.rados.rados.0.trial188.stdout:2784: write oid 35 current snap is 289 2026-02-13T20:24:07.498 INFO:tasks.rados.rados.0.trial188.stdout:2784: seq_num 967 ranges {652369=742614,2153264=99105} 2026-02-13T20:24:07.499 INFO:tasks.rados.rados.0.trial188.stdout:2784: writing trial18843701-35 from 652369 to 1394983 tid 1 2026-02-13T20:24:07.503 INFO:tasks.rados.rados.0.trial188.stdout:2784: writing trial18843701-35 from 2153264 to 2252369 tid 2 2026-02-13T20:24:07.503 INFO:tasks.rados.rados.0.trial188.stdout:2785: write (excl) oid 41 current snap is 289 2026-02-13T20:24:07.503 INFO:tasks.rados.rados.0.trial188.stdout:2785: seq_num 968 ranges {669176=417863,1811746=457430} 2026-02-13T20:24:07.506 INFO:tasks.rados.rados.0.trial188.stdout:2785: writing trial18843701-41 from 669176 to 1087039 tid 1 2026-02-13T20:24:07.511 INFO:tasks.rados.rados.0.trial188.stdout:2785: writing trial18843701-41 from 1811746 to 2269176 tid 2 2026-02-13T20:24:07.511 INFO:tasks.rados.rados.0.trial188.stdout:2786: write oid 5 current snap is 289 2026-02-13T20:24:07.511 INFO:tasks.rados.rados.0.trial188.stdout:2786: seq_num 969 ranges {685983=493112,1870228=415755} 2026-02-13T20:24:07.515 INFO:tasks.rados.rados.0.trial188.stdout:2786: writing trial18843701-5 from 685983 to 1179095 tid 1 2026-02-13T20:24:07.520 INFO:tasks.rados.rados.0.trial188.stdout:2786: writing trial18843701-5 from 1870228 to 2285983 tid 2 2026-02-13T20:24:07.520 INFO:tasks.rados.rados.0.trial188.stdout:2787: read oid 50 snap -1 2026-02-13T20:24:07.520 INFO:tasks.rados.rados.0.trial188.stdout:2787: expect (ObjNum 724 snap 214 seq_num 724) 2026-02-13T20:24:07.520 INFO:tasks.rados.rados.0.trial188.stdout:2788: write (excl) oid 43 current snap is 289 2026-02-13T20:24:07.520 INFO:tasks.rados.rados.0.trial188.stdout:2788: seq_num 970 ranges {702790=568361,1812357=490433} 2026-02-13T20:24:07.524 INFO:tasks.rados.rados.0.trial188.stdout:2788: writing trial18843701-43 from 702790 to 1271151 tid 1 2026-02-13T20:24:07.528 INFO:tasks.rados.rados.0.trial188.stdout:2788: writing trial18843701-43 from 1812357 to 2302790 tid 2 2026-02-13T20:24:07.528 INFO:tasks.rados.rados.0.trial188.stdout:2789: copy_from oid 33 from oid 11 current snap is 289 2026-02-13T20:24:07.528 INFO:tasks.rados.rados.0.trial188.stdout:2783: expect (ObjNum 964 snap 289 seq_num 964) 2026-02-13T20:24:07.548 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:24:07.574 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1287402 2026-02-13T20:24:07.582 INFO:tasks.rados.rados.0.trial188.stdout:2782: finishing rollback tid 0 to trial18843701-10 2026-02-13T20:24:07.582 INFO:tasks.rados.rados.0.trial188.stdout:2783: done (8 left) 2026-02-13T20:24:07.583 INFO:tasks.rados.rados.0.trial188.stdout:2790: write (excl) oid 44 current snap is 289 2026-02-13T20:24:07.583 INFO:tasks.rados.rados.0.trial188.stdout:2782: finishing rollback tid 1 to trial18843701-10 2026-02-13T20:24:07.583 INFO:tasks.rados.rados.0.trial188.stdout:2790: seq_num 971 ranges {719597=643610,1870839=448758} 2026-02-13T20:24:07.587 INFO:tasks.rados.rados.0.trial188.stdout:2790: writing trial18843701-44 from 719597 to 1363207 tid 1 2026-02-13T20:24:07.592 INFO:tasks.rados.rados.0.trial188.stdout:2790: writing trial18843701-44 from 1870839 to 2319597 tid 2 2026-02-13T20:24:07.593 INFO:tasks.rados.rados.0.trial188.stdout:2791: copy_from oid 40 from oid 29 current snap is 289 2026-02-13T20:24:07.593 INFO:tasks.rados.rados.0.trial188.stdout:2782: finishing rollback tid 2 to trial18843701-10 2026-02-13T20:24:07.593 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 10 v 1062 (ObjNum 762 snap 226 seq_num 762) dirty exists 2026-02-13T20:24:07.593 INFO:tasks.rados.rados.0.trial188.stdout:2781: finishing write tid 1 to trial18843701-48 2026-02-13T20:24:07.593 INFO:tasks.rados.rados.0.trial188.stdout:2781: finishing write tid 2 to trial18843701-48 2026-02-13T20:24:07.593 INFO:tasks.rados.rados.0.trial188.stdout:2781: finishing write tid 3 to trial18843701-48 2026-02-13T20:24:07.593 INFO:tasks.rados.rados.0.trial188.stdout:2781: finishing write tid 4 to trial18843701-48 2026-02-13T20:24:07.593 INFO:tasks.rados.rados.0.trial188.stdout:2781: oid 48 updating version 0 to 620 2026-02-13T20:24:07.593 INFO:tasks.rados.rados.0.trial188.stdout:2781: oid 48 updating version 620 to 621 2026-02-13T20:24:07.593 INFO:tasks.rados.rados.0.trial188.stdout:2781: oid 48 updating version 621 to 622 2026-02-13T20:24:07.594 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 48 v 622 (ObjNum 966 snap 289 seq_num 966) dirty exists 2026-02-13T20:24:07.594 INFO:tasks.rados.rados.0.trial188.stdout:2781: left oid 48 (ObjNum 966 snap 289 seq_num 966) 2026-02-13T20:24:07.594 INFO:tasks.rados.rados.0.trial188.stdout:2784: finishing write tid 1 to trial18843701-35 2026-02-13T20:24:07.594 INFO:tasks.rados.rados.0.trial188.stdout:2784: finishing write tid 2 to trial18843701-35 2026-02-13T20:24:07.594 INFO:tasks.rados.rados.0.trial188.stdout:2784: finishing write tid 3 to trial18843701-35 2026-02-13T20:24:07.594 INFO:tasks.rados.rados.0.trial188.stdout:2784: finishing write tid 4 to trial18843701-35 2026-02-13T20:24:07.594 INFO:tasks.rados.rados.0.trial188.stdout:2784: oid 35 updating version 0 to 814 2026-02-13T20:24:07.594 INFO:tasks.rados.rados.0.trial188.stdout:2784: oid 35 version 814 is already newer than 813 2026-02-13T20:24:07.594 INFO:tasks.rados.rados.0.trial188.stdout:2784: oid 35 version 814 is already newer than 812 2026-02-13T20:24:07.594 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 35 v 814 (ObjNum 967 snap 289 seq_num 967) dirty exists 2026-02-13T20:24:07.594 INFO:tasks.rados.rados.0.trial188.stdout:2784: left oid 35 (ObjNum 967 snap 289 seq_num 967) 2026-02-13T20:24:07.594 INFO:tasks.rados.rados.0.trial188.stdout:2785: finishing write tid 1 to trial18843701-41 2026-02-13T20:24:07.595 INFO:tasks.rados.rados.0.trial188.stdout:2787: expect (ObjNum 724 snap 214 seq_num 724) 2026-02-13T20:24:07.635 INFO:tasks.rados.rados.0.trial188.stdout:2785: finishing write tid 2 to trial18843701-41 2026-02-13T20:24:07.636 INFO:tasks.rados.rados.0.trial188.stdout:2786: finishing write tid 1 to trial18843701-5 2026-02-13T20:24:07.636 INFO:tasks.rados.rados.0.trial188.stdout:2785: finishing write tid 3 to trial18843701-41 2026-02-13T20:24:07.636 INFO:tasks.rados.rados.0.trial188.stdout:2785: finishing write tid 4 to trial18843701-41 2026-02-13T20:24:07.636 INFO:tasks.rados.rados.0.trial188.stdout:2785: oid 41 updating version 0 to 1249 2026-02-13T20:24:07.636 INFO:tasks.rados.rados.0.trial188.stdout:2785: oid 41 updating version 1249 to 1250 2026-02-13T20:24:07.636 INFO:tasks.rados.rados.0.trial188.stdout:2785: oid 41 updating version 1250 to 1251 2026-02-13T20:24:07.636 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 41 v 1251 (ObjNum 968 snap 289 seq_num 968) dirty exists 2026-02-13T20:24:07.636 INFO:tasks.rados.rados.0.trial188.stdout:2785: left oid 41 (ObjNum 968 snap 289 seq_num 968) 2026-02-13T20:24:07.636 INFO:tasks.rados.rados.0.trial188.stdout:2786: finishing write tid 2 to trial18843701-5 2026-02-13T20:24:07.636 INFO:tasks.rados.rados.0.trial188.stdout:2786: finishing write tid 3 to trial18843701-5 2026-02-13T20:24:07.637 INFO:tasks.rados.rados.0.trial188.stdout:2786: finishing write tid 4 to trial18843701-5 2026-02-13T20:24:07.637 INFO:tasks.rados.rados.0.trial188.stdout:2786: oid 5 updating version 0 to 1271 2026-02-13T20:24:07.637 INFO:tasks.rados.rados.0.trial188.stdout:2786: oid 5 updating version 1271 to 1272 2026-02-13T20:24:07.637 INFO:tasks.rados.rados.0.trial188.stdout:2786: oid 5 updating version 1272 to 1273 2026-02-13T20:24:07.637 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 5 v 1273 (ObjNum 969 snap 289 seq_num 969) dirty exists 2026-02-13T20:24:07.637 INFO:tasks.rados.rados.0.trial188.stdout:2786: left oid 5 (ObjNum 969 snap 289 seq_num 969) 2026-02-13T20:24:07.637 INFO:tasks.rados.rados.0.trial188.stdout:2788: finishing write tid 1 to trial18843701-43 2026-02-13T20:24:07.637 INFO:tasks.rados.rados.0.trial188.stdout:2788: finishing write tid 2 to trial18843701-43 2026-02-13T20:24:07.637 INFO:tasks.rados.rados.0.trial188.stdout:2788: finishing write tid 3 to trial18843701-43 2026-02-13T20:24:07.637 INFO:tasks.rados.rados.0.trial188.stdout:2788: finishing write tid 4 to trial18843701-43 2026-02-13T20:24:07.637 INFO:tasks.rados.rados.0.trial188.stdout:2788: oid 43 updating version 0 to 1069 2026-02-13T20:24:07.637 INFO:tasks.rados.rados.0.trial188.stdout:2788: oid 43 updating version 1069 to 1070 2026-02-13T20:24:07.637 INFO:tasks.rados.rados.0.trial188.stdout:2788: oid 43 updating version 1070 to 1071 2026-02-13T20:24:07.638 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 43 v 1071 (ObjNum 970 snap 289 seq_num 970) dirty exists 2026-02-13T20:24:07.638 INFO:tasks.rados.rados.0.trial188.stdout:2788: left oid 43 (ObjNum 970 snap 289 seq_num 970) 2026-02-13T20:24:07.638 INFO:tasks.rados.rados.0.trial188.stdout:2789: finishing copy_from racing read to trial18843701-33 2026-02-13T20:24:07.638 INFO:tasks.rados.rados.0.trial188.stdout:2789: finishing copy_from to trial18843701-33 2026-02-13T20:24:07.638 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 33 v 1059 (ObjNum 940 snap 280 seq_num 940) dirty exists 2026-02-13T20:24:07.638 INFO:tasks.rados.rados.0.trial188.stdout:2791: finishing copy_from racing read to trial18843701-40 2026-02-13T20:24:07.638 INFO:tasks.rados.rados.0.trial188.stdout:2790: finishing write tid 1 to trial18843701-44 2026-02-13T20:24:07.638 INFO:tasks.rados.rados.0.trial188.stdout:2781: done (9 left) 2026-02-13T20:24:07.638 INFO:tasks.rados.rados.0.trial188.stdout:2782: done (8 left) 2026-02-13T20:24:07.638 INFO:tasks.rados.rados.0.trial188.stdout:2784: done (7 left) 2026-02-13T20:24:07.638 INFO:tasks.rados.rados.0.trial188.stdout:2785: done (6 left) 2026-02-13T20:24:07.638 INFO:tasks.rados.rados.0.trial188.stdout:2786: done (5 left) 2026-02-13T20:24:07.639 INFO:tasks.rados.rados.0.trial188.stdout:2787: done (4 left) 2026-02-13T20:24:07.639 INFO:tasks.rados.rados.0.trial188.stdout:2788: done (3 left) 2026-02-13T20:24:07.639 INFO:tasks.rados.rados.0.trial188.stdout:2789: done (2 left) 2026-02-13T20:24:07.639 INFO:tasks.rados.rados.0.trial188.stdout:2792: read oid 2 snap -1 2026-02-13T20:24:07.639 INFO:tasks.rados.rados.0.trial188.stdout:2792: expect (ObjNum 949 snap 282 seq_num 949) 2026-02-13T20:24:07.639 INFO:tasks.rados.rados.0.trial188.stdout:2793: delete oid 34 current snap is 289 2026-02-13T20:24:07.639 INFO:tasks.rados.rados.0.trial188.stdout:2790: finishing write tid 2 to trial18843701-44 2026-02-13T20:24:07.639 INFO:tasks.rados.rados.0.trial188.stdout:2790: finishing write tid 3 to trial18843701-44 2026-02-13T20:24:07.639 INFO:tasks.rados.rados.0.trial188.stdout:2790: finishing write tid 4 to trial18843701-44 2026-02-13T20:24:07.639 INFO:tasks.rados.rados.0.trial188.stdout:2790: oid 44 updating version 0 to 1276 2026-02-13T20:24:07.639 INFO:tasks.rados.rados.0.trial188.stdout:2790: oid 44 version 1276 is already newer than 1275 2026-02-13T20:24:07.639 INFO:tasks.rados.rados.0.trial188.stdout:2790: oid 44 version 1276 is already newer than 1274 2026-02-13T20:24:07.639 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 44 v 1276 (ObjNum 971 snap 289 seq_num 971) dirty exists 2026-02-13T20:24:07.640 INFO:tasks.rados.rados.0.trial188.stdout:2790: left oid 44 (ObjNum 971 snap 289 seq_num 971) 2026-02-13T20:24:07.640 INFO:tasks.rados.rados.0.trial188.stdout:2791: finishing copy_from to trial18843701-40 2026-02-13T20:24:07.640 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 40 v 762 (ObjNum 868 snap 252 seq_num 868) dirty exists 2026-02-13T20:24:07.640 INFO:tasks.rados.rados.0.trial188.stdout:2790: done (3 left) 2026-02-13T20:24:07.640 INFO:tasks.rados.rados.0.trial188.stdout:2791: done (2 left) 2026-02-13T20:24:07.640 INFO:tasks.rados.rados.0.trial188.stdout:2793: done (1 left) 2026-02-13T20:24:07.640 INFO:tasks.rados.rados.0.trial188.stdout:2794: read oid 36 snap -1 2026-02-13T20:24:07.640 INFO:tasks.rados.rados.0.trial188.stdout:2794: expect (ObjNum 927 snap 280 seq_num 927) 2026-02-13T20:24:07.640 INFO:tasks.rados.rados.0.trial188.stdout:2795: delete oid 42 current snap is 289 2026-02-13T20:24:07.641 INFO:tasks.rados.rados.0.trial188.stdout:2795: done (2 left) 2026-02-13T20:24:07.641 INFO:tasks.rados.rados.0.trial188.stdout:2796: write oid 17 current snap is 289 2026-02-13T20:24:07.641 INFO:tasks.rados.rados.0.trial188.stdout:2796: seq_num 974 ranges {770018=585710,2046285=323733} 2026-02-13T20:24:07.645 INFO:tasks.rados.rados.0.trial188.stdout:2796: writing trial18843701-17 from 770018 to 1355728 tid 1 2026-02-13T20:24:07.649 INFO:tasks.rados.rados.0.trial188.stdout:2796: writing trial18843701-17 from 2046285 to 2370018 tid 2 2026-02-13T20:24:07.649 INFO:tasks.rados.rados.0.trial188.stdout:2797: write oid 45 current snap is 289 2026-02-13T20:24:07.649 INFO:tasks.rados.rados.0.trial188.stdout:2797: seq_num 975 ranges {786825=660959,2104767=282058} 2026-02-13T20:24:07.654 INFO:tasks.rados.rados.0.trial188.stdout:2797: writing trial18843701-45 from 786825 to 1447784 tid 1 2026-02-13T20:24:07.659 INFO:tasks.rados.rados.0.trial188.stdout:2797: writing trial18843701-45 from 2104767 to 2386825 tid 2 2026-02-13T20:24:07.659 INFO:tasks.rados.rados.0.trial188.stdout:2798: read oid 38 snap -1 2026-02-13T20:24:07.659 INFO:tasks.rados.rados.0.trial188.stdout:2798: expect deleted 2026-02-13T20:24:07.659 INFO:tasks.rados.rados.0.trial188.stdout:2799: read oid 3 snap 280 2026-02-13T20:24:07.659 INFO:tasks.rados.rados.0.trial188.stdout:2799: expect (ObjNum 892 snap 269 seq_num 892) 2026-02-13T20:24:07.659 INFO:tasks.rados.rados.0.trial188.stdout:2800: copy_from oid 13 from oid 35 current snap is 289 2026-02-13T20:24:07.659 INFO:tasks.rados.rados.0.trial188.stdout:2794: expect (ObjNum 927 snap 280 seq_num 927) 2026-02-13T20:24:07.787 INFO:tasks.rados.rados.0.trial188.stdout:2792: expect (ObjNum 949 snap 282 seq_num 949) 2026-02-13T20:24:07.818 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 3664212 2026-02-13T20:24:07.931 INFO:tasks.rados.rados.0.trial188.stdout:2792: done (6 left) 2026-02-13T20:24:07.931 INFO:tasks.rados.rados.0.trial188.stdout:2794: done (5 left) 2026-02-13T20:24:07.931 INFO:tasks.rados.rados.0.trial188.stdout:2798: done (4 left) 2026-02-13T20:24:07.932 INFO:tasks.rados.rados.0.trial188.stdout:2801: snap_create 2026-02-13T20:24:07.932 INFO:tasks.rados.rados.0.trial188.stdout:2796: finishing write tid 1 to trial18843701-17 2026-02-13T20:24:07.932 INFO:tasks.rados.rados.0.trial188.stdout:2796: finishing write tid 2 to trial18843701-17 2026-02-13T20:24:07.932 INFO:tasks.rados.rados.0.trial188.stdout:2796: finishing write tid 3 to trial18843701-17 2026-02-13T20:24:07.932 INFO:tasks.rados.rados.0.trial188.stdout:2796: finishing write tid 4 to trial18843701-17 2026-02-13T20:24:07.932 INFO:tasks.rados.rados.0.trial188.stdout:2796: oid 17 updating version 0 to 1060 2026-02-13T20:24:07.932 INFO:tasks.rados.rados.0.trial188.stdout:2796: oid 17 updating version 1060 to 1062 2026-02-13T20:24:07.932 INFO:tasks.rados.rados.0.trial188.stdout:2796: oid 17 version 1062 is already newer than 1061 2026-02-13T20:24:07.932 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 17 v 1062 (ObjNum 974 snap 289 seq_num 974) dirty exists 2026-02-13T20:24:07.932 INFO:tasks.rados.rados.0.trial188.stdout:2796: left oid 17 (ObjNum 974 snap 289 seq_num 974) 2026-02-13T20:24:07.932 INFO:tasks.rados.rados.0.trial188.stdout:2799: expect (ObjNum 892 snap 269 seq_num 892) 2026-02-13T20:24:07.933 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 753583 2026-02-13T20:24:07.979 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2416677 2026-02-13T20:24:07.984 INFO:tasks.rados.rados.0.trial188.stdout:2797: finishing write tid 1 to trial18843701-45 2026-02-13T20:24:07.984 INFO:tasks.rados.rados.0.trial188.stdout:2797: finishing write tid 2 to trial18843701-45 2026-02-13T20:24:07.985 INFO:tasks.rados.rados.0.trial188.stdout:2797: finishing write tid 3 to trial18843701-45 2026-02-13T20:24:07.985 INFO:tasks.rados.rados.0.trial188.stdout:2797: finishing write tid 4 to trial18843701-45 2026-02-13T20:24:07.985 INFO:tasks.rados.rados.0.trial188.stdout:2797: oid 45 updating version 0 to 1327 2026-02-13T20:24:07.985 INFO:tasks.rados.rados.0.trial188.stdout:2797: oid 45 updating version 1327 to 1328 2026-02-13T20:24:07.985 INFO:tasks.rados.rados.0.trial188.stdout:2797: oid 45 updating version 1328 to 1329 2026-02-13T20:24:07.985 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 45 v 1329 (ObjNum 975 snap 289 seq_num 975) dirty exists 2026-02-13T20:24:07.985 INFO:tasks.rados.rados.0.trial188.stdout:2797: left oid 45 (ObjNum 975 snap 289 seq_num 975) 2026-02-13T20:24:07.985 INFO:tasks.rados.rados.0.trial188.stdout:2800: finishing copy_from racing read to trial18843701-13 2026-02-13T20:24:07.985 INFO:tasks.rados.rados.0.trial188.stdout:2800: finishing copy_from to trial18843701-13 2026-02-13T20:24:07.985 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 13 v 814 (ObjNum 967 snap 289 seq_num 967) dirty exists 2026-02-13T20:24:08.327 INFO:tasks.rados.rados.0.trial188.stdout:2796: done (4 left) 2026-02-13T20:24:08.328 INFO:tasks.rados.rados.0.trial188.stdout:2797: done (3 left) 2026-02-13T20:24:08.328 INFO:tasks.rados.rados.0.trial188.stdout:2799: done (2 left) 2026-02-13T20:24:08.328 INFO:tasks.rados.rados.0.trial188.stdout:2800: done (1 left) 2026-02-13T20:24:08.328 INFO:tasks.rados.rados.0.trial188.stdout:2801: done (0 left) 2026-02-13T20:24:08.328 INFO:tasks.rados.rados.0.trial188.stdout:2802: read oid 21 snap -1 2026-02-13T20:24:08.328 INFO:tasks.rados.rados.0.trial188.stdout:2802: expect (ObjNum 948 snap 282 seq_num 948) 2026-02-13T20:24:08.328 INFO:tasks.rados.rados.0.trial188.stdout:2803: write oid 6 current snap is 290 2026-02-13T20:24:08.328 INFO:tasks.rados.rados.0.trial188.stdout:2803: seq_num 976 ranges {403632=736208,1763249=619999} 2026-02-13T20:24:08.332 INFO:tasks.rados.rados.0.trial188.stdout:2803: writing trial18843701-6 from 403632 to 1139840 tid 1 2026-02-13T20:24:08.338 INFO:tasks.rados.rados.0.trial188.stdout:2803: writing trial18843701-6 from 1763249 to 2383248 tid 2 2026-02-13T20:24:08.338 INFO:tasks.rados.rados.0.trial188.stdout:2804: write oid 16 current snap is 290 2026-02-13T20:24:08.338 INFO:tasks.rados.rados.0.trial188.stdout:2804: seq_num 977 ranges {420439=411457,1421731=480010} 2026-02-13T20:24:08.341 INFO:tasks.rados.rados.0.trial188.stdout:2804: writing trial18843701-16 from 420439 to 831896 tid 1 2026-02-13T20:24:08.345 INFO:tasks.rados.rados.0.trial188.stdout:2804: writing trial18843701-16 from 1421731 to 1901741 tid 2 2026-02-13T20:24:08.345 INFO:tasks.rados.rados.0.trial188.stdout:2805: rollback oid 27 current snap is 290 2026-02-13T20:24:08.345 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 27 to 282 2026-02-13T20:24:08.345 INFO:tasks.rados.rados.0.trial188.stdout:2802: expect (ObjNum 948 snap 282 seq_num 948) 2026-02-13T20:24:08.345 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:24:08.450 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:24:08.507 INFO:tasks.rados.rados.0.trial188.stdout:2805: finishing rollback tid 1 to trial18843701-27 2026-02-13T20:24:08.507 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 27 v 1235 (ObjNum -165696256 snap 32656 seq_num 304) dirty dne 2026-02-13T20:24:08.507 INFO:tasks.rados.rados.0.trial188.stdout:2803: finishing write tid 1 to trial18843701-6 2026-02-13T20:24:08.508 INFO:tasks.rados.rados.0.trial188.stdout:2803: finishing write tid 2 to trial18843701-6 2026-02-13T20:24:08.508 INFO:tasks.rados.rados.0.trial188.stdout:2802: done (3 left) 2026-02-13T20:24:08.508 INFO:tasks.rados.rados.0.trial188.stdout:2805: done (2 left) 2026-02-13T20:24:08.508 INFO:tasks.rados.rados.0.trial188.stdout:2806: copy_from oid 8 from oid 26 current snap is 290 2026-02-13T20:24:08.508 INFO:tasks.rados.rados.0.trial188.stdout:2803: finishing write tid 3 to trial18843701-6 2026-02-13T20:24:08.508 INFO:tasks.rados.rados.0.trial188.stdout:2803: finishing write tid 4 to trial18843701-6 2026-02-13T20:24:08.508 INFO:tasks.rados.rados.0.trial188.stdout:2803: oid 6 updating version 0 to 1336 2026-02-13T20:24:08.508 INFO:tasks.rados.rados.0.trial188.stdout:2803: oid 6 version 1336 is already newer than 1335 2026-02-13T20:24:08.508 INFO:tasks.rados.rados.0.trial188.stdout:2803: oid 6 updating version 1336 to 1337 2026-02-13T20:24:08.508 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 6 v 1337 (ObjNum 976 snap 290 seq_num 976) dirty exists 2026-02-13T20:24:08.508 INFO:tasks.rados.rados.0.trial188.stdout:2803: left oid 6 (ObjNum 976 snap 290 seq_num 976) 2026-02-13T20:24:08.509 INFO:tasks.rados.rados.0.trial188.stdout:2804: finishing write tid 1 to trial18843701-16 2026-02-13T20:24:08.509 INFO:tasks.rados.rados.0.trial188.stdout:2804: finishing write tid 2 to trial18843701-16 2026-02-13T20:24:08.509 INFO:tasks.rados.rados.0.trial188.stdout:2804: finishing write tid 3 to trial18843701-16 2026-02-13T20:24:08.509 INFO:tasks.rados.rados.0.trial188.stdout:2804: finishing write tid 4 to trial18843701-16 2026-02-13T20:24:08.509 INFO:tasks.rados.rados.0.trial188.stdout:2804: oid 16 updating version 0 to 1339 2026-02-13T20:24:08.509 INFO:tasks.rados.rados.0.trial188.stdout:2804: oid 16 updating version 1339 to 1341 2026-02-13T20:24:08.509 INFO:tasks.rados.rados.0.trial188.stdout:2804: oid 16 version 1341 is already newer than 1340 2026-02-13T20:24:08.509 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 16 v 1341 (ObjNum 977 snap 290 seq_num 977) dirty exists 2026-02-13T20:24:08.509 INFO:tasks.rados.rados.0.trial188.stdout:2804: left oid 16 (ObjNum 977 snap 290 seq_num 977) 2026-02-13T20:24:08.509 INFO:tasks.rados.rados.0.trial188.stdout:2803: done (2 left) 2026-02-13T20:24:08.509 INFO:tasks.rados.rados.0.trial188.stdout:2804: done (1 left) 2026-02-13T20:24:08.509 INFO:tasks.rados.rados.0.trial188.stdout:2807: copy_from oid 2 from oid 32 current snap is 290 2026-02-13T20:24:08.509 INFO:tasks.rados.rados.0.trial188.stdout:2808: snap_remove snap 286 2026-02-13T20:24:09.332 INFO:tasks.rados.rados.0.trial188.stdout:2808: done (2 left) 2026-02-13T20:24:09.333 INFO:tasks.rados.rados.0.trial188.stdout:2809: snap_create 2026-02-13T20:24:09.333 INFO:tasks.rados.rados.0.trial188.stdout:2807: finishing copy_from racing read to trial18843701-2 2026-02-13T20:24:09.333 INFO:tasks.rados.rados.0.trial188.stdout:2806: finishing copy_from racing read to trial18843701-8 2026-02-13T20:24:09.333 INFO:tasks.rados.rados.0.trial188.stdout:2807: finishing copy_from to trial18843701-2 2026-02-13T20:24:09.333 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 2 v 1245 (ObjNum 739 snap 220 seq_num 739) dirty exists 2026-02-13T20:24:09.333 INFO:tasks.rados.rados.0.trial188.stdout:2806: finishing copy_from to trial18843701-8 2026-02-13T20:24:09.333 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 8 v 982 (ObjNum 950 snap 282 seq_num 950) dirty exists 2026-02-13T20:24:10.332 INFO:tasks.rados.rados.0.trial188.stdout:2806: done (2 left) 2026-02-13T20:24:10.333 INFO:tasks.rados.rados.0.trial188.stdout:2807: done (1 left) 2026-02-13T20:24:10.333 INFO:tasks.rados.rados.0.trial188.stdout:2809: done (0 left) 2026-02-13T20:24:10.333 INFO:tasks.rados.rados.0.trial188.stdout:2810: write (excl) oid 35 current snap is 291 2026-02-13T20:24:10.333 INFO:tasks.rados.rados.0.trial188.stdout:2810: seq_num 978 ranges {437246=486706,1363860=623668} 2026-02-13T20:24:10.336 INFO:tasks.rados.rados.0.trial188.stdout:2810: writing trial18843701-35 from 437246 to 923952 tid 1 2026-02-13T20:24:10.341 INFO:tasks.rados.rados.0.trial188.stdout:2810: writing trial18843701-35 from 1363860 to 1987528 tid 2 2026-02-13T20:24:10.341 INFO:tasks.rados.rados.0.trial188.stdout:2811: copy_from oid 2 from oid 8 current snap is 291 2026-02-13T20:24:10.341 INFO:tasks.rados.rados.0.trial188.stdout:2812: read oid 32 snap 244 2026-02-13T20:24:10.341 INFO:tasks.rados.rados.0.trial188.stdout:2812: expect (ObjNum 753 snap 222 seq_num 753) 2026-02-13T20:24:10.341 INFO:tasks.rados.rados.0.trial188.stdout:2813: copy_from oid 40 from oid 23 current snap is 291 2026-02-13T20:24:10.341 INFO:tasks.rados.rados.0.trial188.stdout:2814: snap_remove snap 280 2026-02-13T20:24:11.338 INFO:tasks.rados.rados.0.trial188.stdout:2814: done (4 left) 2026-02-13T20:24:11.338 INFO:tasks.rados.rados.0.trial188.stdout:2815: snap_create 2026-02-13T20:24:11.338 INFO:tasks.rados.rados.0.trial188.stdout:2812: expect (ObjNum 753 snap 222 seq_num 753) 2026-02-13T20:24:11.402 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1097819 2026-02-13T20:24:11.424 INFO:tasks.rados.rados.0.trial188.stdout:2810: finishing write tid 1 to trial18843701-35 2026-02-13T20:24:11.425 INFO:tasks.rados.rados.0.trial188.stdout:2810: finishing write tid 2 to trial18843701-35 2026-02-13T20:24:11.425 INFO:tasks.rados.rados.0.trial188.stdout:2810: finishing write tid 3 to trial18843701-35 2026-02-13T20:24:11.425 INFO:tasks.rados.rados.0.trial188.stdout:2810: finishing write tid 4 to trial18843701-35 2026-02-13T20:24:11.425 INFO:tasks.rados.rados.0.trial188.stdout:2810: oid 35 updating version 0 to 822 2026-02-13T20:24:11.425 INFO:tasks.rados.rados.0.trial188.stdout:2810: oid 35 updating version 822 to 823 2026-02-13T20:24:11.425 INFO:tasks.rados.rados.0.trial188.stdout:2810: oid 35 version 823 is already newer than 821 2026-02-13T20:24:11.425 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 35 v 823 (ObjNum 978 snap 291 seq_num 978) dirty exists 2026-02-13T20:24:11.425 INFO:tasks.rados.rados.0.trial188.stdout:2810: left oid 35 (ObjNum 978 snap 291 seq_num 978) 2026-02-13T20:24:11.425 INFO:tasks.rados.rados.0.trial188.stdout:2813: finishing copy_from racing read to trial18843701-40 2026-02-13T20:24:11.426 INFO:tasks.rados.rados.0.trial188.stdout:2813: finishing copy_from to trial18843701-40 2026-02-13T20:24:11.426 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 40 v 1329 (ObjNum 962 snap 289 seq_num 962) dirty exists 2026-02-13T20:24:11.426 INFO:tasks.rados.rados.0.trial188.stdout:2811: finishing copy_from racing read to trial18843701-2 2026-02-13T20:24:11.426 INFO:tasks.rados.rados.0.trial188.stdout:2811: finishing copy_from to trial18843701-2 2026-02-13T20:24:11.426 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 2 v 982 (ObjNum 950 snap 282 seq_num 950) dirty exists 2026-02-13T20:24:12.237 INFO:tasks.rados.rados.0.trial188.stdout:2810: done (4 left) 2026-02-13T20:24:12.237 INFO:tasks.rados.rados.0.trial188.stdout:2811: done (3 left) 2026-02-13T20:24:12.237 INFO:tasks.rados.rados.0.trial188.stdout:2812: done (2 left) 2026-02-13T20:24:12.237 INFO:tasks.rados.rados.0.trial188.stdout:2813: done (1 left) 2026-02-13T20:24:12.237 INFO:tasks.rados.rados.0.trial188.stdout:2815: done (0 left) 2026-02-13T20:24:12.237 INFO:tasks.rados.rados.0.trial188.stdout:2816: snap_remove snap 244 2026-02-13T20:24:13.237 INFO:tasks.rados.rados.0.trial188.stdout:2816: done (0 left) 2026-02-13T20:24:13.238 INFO:tasks.rados.rados.0.trial188.stdout:2817: rollback oid 15 current snap is 292 2026-02-13T20:24:13.238 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 15 to 263 2026-02-13T20:24:13.238 INFO:tasks.rados.rados.0.trial188.stdout:2818: write (excl) oid 34 current snap is 292 2026-02-13T20:24:13.238 INFO:tasks.rados.rados.0.trial188.stdout:2818: seq_num 979 ranges {454053=561955,1422342=483679,2368404=85649} 2026-02-13T20:24:13.242 INFO:tasks.rados.rados.0.trial188.stdout:2818: writing trial18843701-34 from 454053 to 1016008 tid 1 2026-02-13T20:24:13.245 INFO:tasks.rados.rados.0.trial188.stdout:2818: writing trial18843701-34 from 1422342 to 1906021 tid 2 2026-02-13T20:24:13.247 INFO:tasks.rados.rados.0.trial188.stdout:2818: writing trial18843701-34 from 2368404 to 2454053 tid 3 2026-02-13T20:24:13.247 INFO:tasks.rados.rados.0.trial188.stdout:2819: write (excl) oid 45 current snap is 292 2026-02-13T20:24:13.247 INFO:tasks.rados.rados.0.trial188.stdout:2819: seq_num 980 ranges {470860=637204,1880824=590036} 2026-02-13T20:24:13.251 INFO:tasks.rados.rados.0.trial188.stdout:2819: writing trial18843701-45 from 470860 to 1108064 tid 1 2026-02-13T20:24:13.256 INFO:tasks.rados.rados.0.trial188.stdout:2819: writing trial18843701-45 from 1880824 to 2470860 tid 2 2026-02-13T20:24:13.256 INFO:tasks.rados.rados.0.trial188.stdout:2820: snap_remove snap 285 2026-02-13T20:24:14.239 INFO:tasks.rados.rados.0.trial188.stdout:2820: done (3 left) 2026-02-13T20:24:14.239 INFO:tasks.rados.rados.0.trial188.stdout:2821: snap_remove snap 262 2026-02-13T20:24:15.240 INFO:tasks.rados.rados.0.trial188.stdout:2821: done (3 left) 2026-02-13T20:24:15.241 INFO:tasks.rados.rados.0.trial188.stdout:2822: rollback oid 46 current snap is 292 2026-02-13T20:24:15.241 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 46 to 287 2026-02-13T20:24:15.241 INFO:tasks.rados.rados.0.trial188.stdout:2817: finishing rollback tid 0 to trial18843701-15 2026-02-13T20:24:15.241 INFO:tasks.rados.rados.0.trial188.stdout:2817: finishing rollback tid 1 to trial18843701-15 2026-02-13T20:24:15.241 INFO:tasks.rados.rados.0.trial188.stdout:2817: finishing rollback tid 2 to trial18843701-15 2026-02-13T20:24:15.241 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 15 v 985 (ObjNum 865 snap 250 seq_num 865) dirty exists 2026-02-13T20:24:15.241 INFO:tasks.rados.rados.0.trial188.stdout:2818: finishing write tid 1 to trial18843701-34 2026-02-13T20:24:15.241 INFO:tasks.rados.rados.0.trial188.stdout:2818: finishing write tid 2 to trial18843701-34 2026-02-13T20:24:15.241 INFO:tasks.rados.rados.0.trial188.stdout:2818: finishing write tid 3 to trial18843701-34 2026-02-13T20:24:15.241 INFO:tasks.rados.rados.0.trial188.stdout:2818: finishing write tid 4 to trial18843701-34 2026-02-13T20:24:15.241 INFO:tasks.rados.rados.0.trial188.stdout:2818: finishing write tid 5 to trial18843701-34 2026-02-13T20:24:15.242 INFO:tasks.rados.rados.0.trial188.stdout:2818: oid 34 updating version 0 to 1353 2026-02-13T20:24:15.242 INFO:tasks.rados.rados.0.trial188.stdout:2818: oid 34 version 1353 is already newer than 1352 2026-02-13T20:24:15.242 INFO:tasks.rados.rados.0.trial188.stdout:2818: oid 34 version 1353 is already newer than 1346 2026-02-13T20:24:15.242 INFO:tasks.rados.rados.0.trial188.stdout:2818: oid 34 version 1353 is already newer than 1351 2026-02-13T20:24:15.242 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 34 v 1353 (ObjNum 979 snap 292 seq_num 979) dirty exists 2026-02-13T20:24:15.242 INFO:tasks.rados.rados.0.trial188.stdout:2818: left oid 34 (ObjNum 979 snap 292 seq_num 979) 2026-02-13T20:24:15.242 INFO:tasks.rados.rados.0.trial188.stdout:2819: finishing write tid 1 to trial18843701-45 2026-02-13T20:24:15.242 INFO:tasks.rados.rados.0.trial188.stdout:2819: finishing write tid 2 to trial18843701-45 2026-02-13T20:24:15.242 INFO:tasks.rados.rados.0.trial188.stdout:2819: finishing write tid 3 to trial18843701-45 2026-02-13T20:24:15.242 INFO:tasks.rados.rados.0.trial188.stdout:2819: finishing write tid 4 to trial18843701-45 2026-02-13T20:24:15.242 INFO:tasks.rados.rados.0.trial188.stdout:2819: oid 45 updating version 0 to 1357 2026-02-13T20:24:15.242 INFO:tasks.rados.rados.0.trial188.stdout:2819: oid 45 version 1357 is already newer than 1355 2026-02-13T20:24:15.243 INFO:tasks.rados.rados.0.trial188.stdout:2819: oid 45 version 1357 is already newer than 1356 2026-02-13T20:24:15.243 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 45 v 1357 (ObjNum 980 snap 292 seq_num 980) dirty exists 2026-02-13T20:24:15.243 INFO:tasks.rados.rados.0.trial188.stdout:2819: left oid 45 (ObjNum 980 snap 292 seq_num 980) 2026-02-13T20:24:15.243 INFO:tasks.rados.rados.0.trial188.stdout:2817: done (3 left) 2026-02-13T20:24:15.243 INFO:tasks.rados.rados.0.trial188.stdout:2818: done (2 left) 2026-02-13T20:24:15.243 INFO:tasks.rados.rados.0.trial188.stdout:2819: done (1 left) 2026-02-13T20:24:15.243 INFO:tasks.rados.rados.0.trial188.stdout:2823: copy_from oid 40 from oid 41 current snap is 292 2026-02-13T20:24:15.243 INFO:tasks.rados.rados.0.trial188.stdout:2824: read oid 18 snap 287 2026-02-13T20:24:15.243 INFO:tasks.rados.rados.0.trial188.stdout:2824: expect deleted 2026-02-13T20:24:15.243 INFO:tasks.rados.rados.0.trial188.stdout:2825: read oid 50 snap -1 2026-02-13T20:24:15.243 INFO:tasks.rados.rados.0.trial188.stdout:2825: expect (ObjNum 724 snap 214 seq_num 724) 2026-02-13T20:24:15.243 INFO:tasks.rados.rados.0.trial188.stdout:2826: copy_from oid 4 from oid 29 current snap is 292 2026-02-13T20:24:15.243 INFO:tasks.rados.rados.0.trial188.stdout:2827: write (excl) oid 47 current snap is 292 2026-02-13T20:24:15.244 INFO:tasks.rados.rados.0.trial188.stdout:2827: seq_num 981 ranges {487667=428806,1655659=770995} 2026-02-13T20:24:15.244 INFO:tasks.rados.rados.0.trial188.stdout:2827: writing trial18843701-47 from 487667 to 916473 tid 1 2026-02-13T20:24:15.250 INFO:tasks.rados.rados.0.trial188.stdout:2827: writing trial18843701-47 from 1655659 to 2426654 tid 2 2026-02-13T20:24:15.250 INFO:tasks.rados.rados.0.trial188.stdout:2828: rollback oid 49 current snap is 292 2026-02-13T20:24:15.250 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 49 to 288 2026-02-13T20:24:15.250 INFO:tasks.rados.rados.0.trial188.stdout:2822: finishing rollback tid 0 to trial18843701-46 2026-02-13T20:24:15.250 INFO:tasks.rados.rados.0.trial188.stdout:2822: finishing rollback tid 1 to trial18843701-46 2026-02-13T20:24:15.250 INFO:tasks.rados.rados.0.trial188.stdout:2822: finishing rollback tid 2 to trial18843701-46 2026-02-13T20:24:15.250 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 46 v 1332 (ObjNum 872 snap 255 seq_num 872) dirty exists 2026-02-13T20:24:15.250 INFO:tasks.rados.rados.0.trial188.stdout:2822: done (6 left) 2026-02-13T20:24:15.250 INFO:tasks.rados.rados.0.trial188.stdout:2824: done (5 left) 2026-02-13T20:24:15.251 INFO:tasks.rados.rados.0.trial188.stdout:2829: delete oid 44 current snap is 292 2026-02-13T20:24:15.251 INFO:tasks.rados.rados.0.trial188.stdout:2825: expect (ObjNum 724 snap 214 seq_num 724) 2026-02-13T20:24:15.263 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:24:15.282 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 959529 2026-02-13T20:24:15.291 INFO:tasks.rados.rados.0.trial188.stdout:2826: finishing copy_from racing read to trial18843701-4 2026-02-13T20:24:15.292 INFO:tasks.rados.rados.0.trial188.stdout:2823: finishing copy_from racing read to trial18843701-40 2026-02-13T20:24:15.292 INFO:tasks.rados.rados.0.trial188.stdout:2828: finishing rollback tid 0 to trial18843701-49 2026-02-13T20:24:15.292 INFO:tasks.rados.rados.0.trial188.stdout:2828: finishing rollback tid 1 to trial18843701-49 2026-02-13T20:24:15.292 INFO:tasks.rados.rados.0.trial188.stdout:2828: finishing rollback tid 2 to trial18843701-49 2026-02-13T20:24:15.292 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 49 v 1363 (ObjNum 930 snap 280 seq_num 930) dirty exists 2026-02-13T20:24:15.292 INFO:tasks.rados.rados.0.trial188.stdout:2826: finishing copy_from to trial18843701-4 2026-02-13T20:24:15.292 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 4 v 762 (ObjNum 868 snap 252 seq_num 868) dirty exists 2026-02-13T20:24:15.292 INFO:tasks.rados.rados.0.trial188.stdout:2827: finishing write tid 1 to trial18843701-47 2026-02-13T20:24:15.292 INFO:tasks.rados.rados.0.trial188.stdout:2823: finishing copy_from to trial18843701-40 2026-02-13T20:24:15.292 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 40 v 1251 (ObjNum 968 snap 289 seq_num 968) dirty exists 2026-02-13T20:24:15.293 INFO:tasks.rados.rados.0.trial188.stdout:2827: finishing write tid 2 to trial18843701-47 2026-02-13T20:24:15.293 INFO:tasks.rados.rados.0.trial188.stdout:2827: finishing write tid 3 to trial18843701-47 2026-02-13T20:24:15.293 INFO:tasks.rados.rados.0.trial188.stdout:2827: finishing write tid 4 to trial18843701-47 2026-02-13T20:24:15.293 INFO:tasks.rados.rados.0.trial188.stdout:2827: oid 47 updating version 0 to 1061 2026-02-13T20:24:15.293 INFO:tasks.rados.rados.0.trial188.stdout:2827: oid 47 updating version 1061 to 1062 2026-02-13T20:24:15.293 INFO:tasks.rados.rados.0.trial188.stdout:2827: oid 47 version 1062 is already newer than 1060 2026-02-13T20:24:15.293 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 47 v 1062 (ObjNum 981 snap 292 seq_num 981) dirty exists 2026-02-13T20:24:15.293 INFO:tasks.rados.rados.0.trial188.stdout:2827: left oid 47 (ObjNum 981 snap 292 seq_num 981) 2026-02-13T20:24:15.293 INFO:tasks.rados.rados.0.trial188.stdout:2823: done (5 left) 2026-02-13T20:24:15.293 INFO:tasks.rados.rados.0.trial188.stdout:2825: done (4 left) 2026-02-13T20:24:15.293 INFO:tasks.rados.rados.0.trial188.stdout:2826: done (3 left) 2026-02-13T20:24:15.293 INFO:tasks.rados.rados.0.trial188.stdout:2827: done (2 left) 2026-02-13T20:24:15.294 INFO:tasks.rados.rados.0.trial188.stdout:2828: done (1 left) 2026-02-13T20:24:15.294 INFO:tasks.rados.rados.0.trial188.stdout:2829: done (0 left) 2026-02-13T20:24:15.294 INFO:tasks.rados.rados.0.trial188.stdout:2830: delete oid 40 current snap is 292 2026-02-13T20:24:15.294 INFO:tasks.rados.rados.0.trial188.stdout:2830: done (0 left) 2026-02-13T20:24:15.294 INFO:tasks.rados.rados.0.trial188.stdout:2831: write (excl) oid 35 current snap is 292 2026-02-13T20:24:15.295 INFO:tasks.rados.rados.0.trial188.stdout:2831: seq_num 984 ranges {538088=654553,1714752=634675} 2026-02-13T20:24:15.296 INFO:tasks.rados.rados.0.trial188.stdout:2831: writing trial18843701-35 from 538088 to 1192641 tid 1 2026-02-13T20:24:15.302 INFO:tasks.rados.rados.0.trial188.stdout:2831: writing trial18843701-35 from 1714752 to 2349427 tid 2 2026-02-13T20:24:15.302 INFO:tasks.rados.rados.0.trial188.stdout:2832: read oid 30 snap 259 2026-02-13T20:24:15.302 INFO:tasks.rados.rados.0.trial188.stdout:2832: expect deleted 2026-02-13T20:24:15.302 INFO:tasks.rados.rados.0.trial188.stdout:2833: rollback oid 43 current snap is 292 2026-02-13T20:24:15.302 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 43 to 282 2026-02-13T20:24:15.302 INFO:tasks.rados.rados.0.trial188.stdout:2834: rollback oid 9 current snap is 292 2026-02-13T20:24:15.302 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 9 to 291 2026-02-13T20:24:15.302 INFO:tasks.rados.rados.0.trial188.stdout:2835: snap_remove snap 288 2026-02-13T20:24:16.245 INFO:tasks.rados.rados.0.trial188.stdout:2835: done (4 left) 2026-02-13T20:24:16.246 INFO:tasks.rados.rados.0.trial188.stdout:2836: rollback oid 44 current snap is 292 2026-02-13T20:24:16.246 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 44 to 228 2026-02-13T20:24:16.246 INFO:tasks.rados.rados.0.trial188.stdout:2833: finishing rollback tid 0 to trial18843701-43 2026-02-13T20:24:16.246 INFO:tasks.rados.rados.0.trial188.stdout:2833: finishing rollback tid 1 to trial18843701-43 2026-02-13T20:24:16.246 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 43 v 1073 (ObjNum 33 snap 0 seq_num 16241552) dirty dne 2026-02-13T20:24:16.246 INFO:tasks.rados.rados.0.trial188.stdout:2831: finishing write tid 1 to trial18843701-35 2026-02-13T20:24:16.246 INFO:tasks.rados.rados.0.trial188.stdout:2831: finishing write tid 2 to trial18843701-35 2026-02-13T20:24:16.246 INFO:tasks.rados.rados.0.trial188.stdout:2831: finishing write tid 3 to trial18843701-35 2026-02-13T20:24:16.246 INFO:tasks.rados.rados.0.trial188.stdout:2831: finishing write tid 4 to trial18843701-35 2026-02-13T20:24:16.247 INFO:tasks.rados.rados.0.trial188.stdout:2831: oid 35 updating version 0 to 849 2026-02-13T20:24:16.247 INFO:tasks.rados.rados.0.trial188.stdout:2831: oid 35 version 849 is already newer than 847 2026-02-13T20:24:16.247 INFO:tasks.rados.rados.0.trial188.stdout:2831: oid 35 version 849 is already newer than 848 2026-02-13T20:24:16.247 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 35 v 849 (ObjNum 984 snap 292 seq_num 984) dirty exists 2026-02-13T20:24:16.247 INFO:tasks.rados.rados.0.trial188.stdout:2831: left oid 35 (ObjNum 984 snap 292 seq_num 984) 2026-02-13T20:24:16.247 INFO:tasks.rados.rados.0.trial188.stdout:2834: finishing rollback tid 1 to trial18843701-9 2026-02-13T20:24:16.247 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 9 v 794 (ObjNum 97 snap 0 seq_num 4148013832) dirty dne 2026-02-13T20:24:16.247 INFO:tasks.rados.rados.0.trial188.stdout:2831: done (4 left) 2026-02-13T20:24:16.247 INFO:tasks.rados.rados.0.trial188.stdout:2832: done (3 left) 2026-02-13T20:24:16.247 INFO:tasks.rados.rados.0.trial188.stdout:2833: done (2 left) 2026-02-13T20:24:16.247 INFO:tasks.rados.rados.0.trial188.stdout:2834: done (1 left) 2026-02-13T20:24:16.247 INFO:tasks.rados.rados.0.trial188.stdout:2837: snap_create 2026-02-13T20:24:16.248 INFO:tasks.rados.rados.0.trial188.stdout:2836: finishing rollback tid 1 to trial18843701-44 2026-02-13T20:24:16.248 INFO:tasks.rados.rados.0.trial188.stdout:2836: finishing rollback tid 2 to trial18843701-44 2026-02-13T20:24:16.248 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 44 v 1279 (ObjNum 766 snap 228 seq_num 766) dirty exists 2026-02-13T20:24:17.239 INFO:tasks.rados.rados.0.trial188.stdout:2836: done (1 left) 2026-02-13T20:24:17.239 INFO:tasks.rados.rados.0.trial188.stdout:2837: done (0 left) 2026-02-13T20:24:17.239 INFO:tasks.rados.rados.0.trial188.stdout:2838: copy_from oid 11 from oid 27 current snap is 293 2026-02-13T20:24:17.239 INFO:tasks.rados.rados.0.trial188.stdout:2839: copy_from oid 20 from oid 29 current snap is 293 2026-02-13T20:24:17.239 INFO:tasks.rados.rados.0.trial188.stdout:2840: write oid 31 current snap is 293 2026-02-13T20:24:17.239 INFO:tasks.rados.rados.0.trial188.stdout:2840: seq_num 985 ranges {554895=729802,1773234=778333} 2026-02-13T20:24:17.244 INFO:tasks.rados.rados.0.trial188.stdout:2840: writing trial18843701-31 from 554895 to 1284697 tid 1 2026-02-13T20:24:17.249 INFO:tasks.rados.rados.0.trial188.stdout:2840: writing trial18843701-31 from 1773234 to 2551567 tid 2 2026-02-13T20:24:17.249 INFO:tasks.rados.rados.0.trial188.stdout:2841: snap_create 2026-02-13T20:24:17.249 INFO:tasks.rados.rados.0.trial188.stdout:2838: finishing copy_from to trial18843701-11 2026-02-13T20:24:17.249 INFO:tasks.rados.rados.0.trial188.stdout:2838: got expected ENOENT (src dne) 2026-02-13T20:24:17.249 INFO:tasks.rados.rados.0.trial188.stdout:2838: finishing copy_from racing read to trial18843701-11 2026-02-13T20:24:17.265 INFO:tasks.rados.rados.0.trial188.stdout:2840: finishing write tid 1 to trial18843701-31 2026-02-13T20:24:17.266 INFO:tasks.rados.rados.0.trial188.stdout:2840: finishing write tid 2 to trial18843701-31 2026-02-13T20:24:17.266 INFO:tasks.rados.rados.0.trial188.stdout:2840: finishing write tid 3 to trial18843701-31 2026-02-13T20:24:17.266 INFO:tasks.rados.rados.0.trial188.stdout:2840: finishing write tid 4 to trial18843701-31 2026-02-13T20:24:17.267 INFO:tasks.rados.rados.0.trial188.stdout:2840: oid 31 updating version 0 to 971 2026-02-13T20:24:17.267 INFO:tasks.rados.rados.0.trial188.stdout:2840: oid 31 version 971 is already newer than 970 2026-02-13T20:24:17.267 INFO:tasks.rados.rados.0.trial188.stdout:2840: oid 31 updating version 971 to 972 2026-02-13T20:24:17.267 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 31 v 972 (ObjNum 985 snap 293 seq_num 985) dirty exists 2026-02-13T20:24:17.267 INFO:tasks.rados.rados.0.trial188.stdout:2840: left oid 31 (ObjNum 985 snap 293 seq_num 985) 2026-02-13T20:24:17.267 INFO:tasks.rados.rados.0.trial188.stdout:2839: finishing copy_from racing read to trial18843701-20 2026-02-13T20:24:17.269 INFO:tasks.rados.rados.0.trial188.stdout:2839: finishing copy_from to trial18843701-20 2026-02-13T20:24:17.269 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 20 v 762 (ObjNum 868 snap 252 seq_num 868) dirty exists 2026-02-13T20:24:18.247 INFO:tasks.rados.rados.0.trial188.stdout:2838: done (3 left) 2026-02-13T20:24:18.247 INFO:tasks.rados.rados.0.trial188.stdout:2839: done (2 left) 2026-02-13T20:24:18.247 INFO:tasks.rados.rados.0.trial188.stdout:2840: done (1 left) 2026-02-13T20:24:18.247 INFO:tasks.rados.rados.0.trial188.stdout:2841: done (0 left) 2026-02-13T20:24:18.247 INFO:tasks.rados.rados.0.trial188.stdout:2842: read oid 49 snap -1 2026-02-13T20:24:18.247 INFO:tasks.rados.rados.0.trial188.stdout:2842: expect (ObjNum 930 snap 280 seq_num 930) 2026-02-13T20:24:18.247 INFO:tasks.rados.rados.0.trial188.stdout:2843: snap_remove snap 282 2026-02-13T20:24:19.248 INFO:tasks.rados.rados.0.trial188.stdout:2843: done (1 left) 2026-02-13T20:24:19.249 INFO:tasks.rados.rados.0.trial188.stdout:2844: write (excl) oid 3 current snap is 294 2026-02-13T20:24:19.249 INFO:tasks.rados.rados.0.trial188.stdout:2844: seq_num 986 ranges {571702=405051,1431716=638344,2560365=11337} 2026-02-13T20:24:19.252 INFO:tasks.rados.rados.0.trial188.stdout:2844: writing trial18843701-3 from 571702 to 976753 tid 1 2026-02-13T20:24:19.257 INFO:tasks.rados.rados.0.trial188.stdout:2844: writing trial18843701-3 from 1431716 to 2070060 tid 2 2026-02-13T20:24:19.259 INFO:tasks.rados.rados.0.trial188.stdout:2844: writing trial18843701-3 from 2560365 to 2571702 tid 3 2026-02-13T20:24:19.259 INFO:tasks.rados.rados.0.trial188.stdout:2845: snap_remove snap 289 2026-02-13T20:24:20.251 INFO:tasks.rados.rados.0.trial188.stdout:2845: done (2 left) 2026-02-13T20:24:20.251 INFO:tasks.rados.rados.0.trial188.stdout:2846: delete oid 12 current snap is 294 2026-02-13T20:24:20.251 INFO:tasks.rados.rados.0.trial188.stdout:2842: expect (ObjNum 930 snap 280 seq_num 930) 2026-02-13T20:24:20.251 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:24:20.342 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:24:20.390 INFO:tasks.rados.rados.0.trial188.stdout:2844: finishing write tid 1 to trial18843701-3 2026-02-13T20:24:20.391 INFO:tasks.rados.rados.0.trial188.stdout:2842: done (2 left) 2026-02-13T20:24:20.391 INFO:tasks.rados.rados.0.trial188.stdout:2846: done (1 left) 2026-02-13T20:24:20.391 INFO:tasks.rados.rados.0.trial188.stdout:2847: copy_from oid 24 from oid 15 current snap is 294 2026-02-13T20:24:20.391 INFO:tasks.rados.rados.0.trial188.stdout:2844: finishing write tid 2 to trial18843701-3 2026-02-13T20:24:20.391 INFO:tasks.rados.rados.0.trial188.stdout:2844: finishing write tid 3 to trial18843701-3 2026-02-13T20:24:20.391 INFO:tasks.rados.rados.0.trial188.stdout:2844: finishing write tid 4 to trial18843701-3 2026-02-13T20:24:20.391 INFO:tasks.rados.rados.0.trial188.stdout:2844: finishing write tid 5 to trial18843701-3 2026-02-13T20:24:20.391 INFO:tasks.rados.rados.0.trial188.stdout:2844: oid 3 updating version 0 to 986 2026-02-13T20:24:20.391 INFO:tasks.rados.rados.0.trial188.stdout:2844: oid 3 updating version 986 to 987 2026-02-13T20:24:20.391 INFO:tasks.rados.rados.0.trial188.stdout:2844: oid 3 updating version 987 to 989 2026-02-13T20:24:20.391 INFO:tasks.rados.rados.0.trial188.stdout:2844: oid 3 version 989 is already newer than 988 2026-02-13T20:24:20.392 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 3 v 989 (ObjNum 986 snap 294 seq_num 986) dirty exists 2026-02-13T20:24:20.392 INFO:tasks.rados.rados.0.trial188.stdout:2844: left oid 3 (ObjNum 986 snap 294 seq_num 986) 2026-02-13T20:24:20.392 INFO:tasks.rados.rados.0.trial188.stdout:2844: done (1 left) 2026-02-13T20:24:20.392 INFO:tasks.rados.rados.0.trial188.stdout:2848: rollback oid 44 current snap is 294 2026-02-13T20:24:20.392 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 44 to 279 2026-02-13T20:24:20.392 INFO:tasks.rados.rados.0.trial188.stdout:2849: write (excl) oid 33 current snap is 294 2026-02-13T20:24:20.392 INFO:tasks.rados.rados.0.trial188.stdout:2849: seq_num 988 ranges {605316=555549,1832327=642013} 2026-02-13T20:24:20.394 INFO:tasks.rados.rados.0.trial188.stdout:2849: writing trial18843701-33 from 605316 to 1160865 tid 1 2026-02-13T20:24:20.399 INFO:tasks.rados.rados.0.trial188.stdout:2849: writing trial18843701-33 from 1832327 to 2474340 tid 2 2026-02-13T20:24:20.400 INFO:tasks.rados.rados.0.trial188.stdout:2850: rollback oid 16 current snap is 294 2026-02-13T20:24:20.400 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 16 to 291 2026-02-13T20:24:20.400 INFO:tasks.rados.rados.0.trial188.stdout:2848: finishing rollback tid 0 to trial18843701-44 2026-02-13T20:24:20.400 INFO:tasks.rados.rados.0.trial188.stdout:2851: delete oid 17 current snap is 294 2026-02-13T20:24:20.400 INFO:tasks.rados.rados.0.trial188.stdout:2848: finishing rollback tid 1 to trial18843701-44 2026-02-13T20:24:20.400 INFO:tasks.rados.rados.0.trial188.stdout:2848: finishing rollback tid 2 to trial18843701-44 2026-02-13T20:24:20.400 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 44 v 1282 (ObjNum 712 snap 203 seq_num 712) dirty exists 2026-02-13T20:24:20.414 INFO:tasks.rados.rados.0.trial188.stdout:2849: finishing write tid 1 to trial18843701-33 2026-02-13T20:24:20.414 INFO:tasks.rados.rados.0.trial188.stdout:2849: finishing write tid 2 to trial18843701-33 2026-02-13T20:24:20.414 INFO:tasks.rados.rados.0.trial188.stdout:2849: finishing write tid 3 to trial18843701-33 2026-02-13T20:24:20.415 INFO:tasks.rados.rados.0.trial188.stdout:2849: finishing write tid 4 to trial18843701-33 2026-02-13T20:24:20.415 INFO:tasks.rados.rados.0.trial188.stdout:2849: oid 33 updating version 0 to 1063 2026-02-13T20:24:20.415 INFO:tasks.rados.rados.0.trial188.stdout:2849: oid 33 updating version 1063 to 1065 2026-02-13T20:24:20.415 INFO:tasks.rados.rados.0.trial188.stdout:2849: oid 33 version 1065 is already newer than 1064 2026-02-13T20:24:20.415 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 33 v 1065 (ObjNum 988 snap 294 seq_num 988) dirty exists 2026-02-13T20:24:20.415 INFO:tasks.rados.rados.0.trial188.stdout:2849: left oid 33 (ObjNum 988 snap 294 seq_num 988) 2026-02-13T20:24:20.423 INFO:tasks.rados.rados.0.trial188.stdout:2847: finishing copy_from racing read to trial18843701-24 2026-02-13T20:24:20.427 INFO:tasks.rados.rados.0.trial188.stdout:2848: done (4 left) 2026-02-13T20:24:20.427 INFO:tasks.rados.rados.0.trial188.stdout:2849: done (3 left) 2026-02-13T20:24:20.427 INFO:tasks.rados.rados.0.trial188.stdout:2851: done (2 left) 2026-02-13T20:24:20.427 INFO:tasks.rados.rados.0.trial188.stdout:2852: snap_create 2026-02-13T20:24:20.427 INFO:tasks.rados.rados.0.trial188.stdout:2847: finishing copy_from to trial18843701-24 2026-02-13T20:24:20.427 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 24 v 985 (ObjNum 865 snap 250 seq_num 865) dirty exists 2026-02-13T20:24:20.428 INFO:tasks.rados.rados.0.trial188.stdout:2850: finishing rollback tid 0 to trial18843701-16 2026-02-13T20:24:20.428 INFO:tasks.rados.rados.0.trial188.stdout:2850: finishing rollback tid 1 to trial18843701-16 2026-02-13T20:24:20.428 INFO:tasks.rados.rados.0.trial188.stdout:2850: finishing rollback tid 2 to trial18843701-16 2026-02-13T20:24:20.428 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 16 v 1401 (ObjNum 977 snap 290 seq_num 977) dirty exists 2026-02-13T20:24:21.253 INFO:tasks.rados.rados.0.trial188.stdout:2847: done (2 left) 2026-02-13T20:24:21.253 INFO:tasks.rados.rados.0.trial188.stdout:2850: done (1 left) 2026-02-13T20:24:21.253 INFO:tasks.rados.rados.0.trial188.stdout:2852: done (0 left) 2026-02-13T20:24:21.253 INFO:tasks.rados.rados.0.trial188.stdout:2853: delete oid 49 current snap is 295 2026-02-13T20:24:21.255 INFO:tasks.rados.rados.0.trial188.stdout:2853: done (0 left) 2026-02-13T20:24:21.255 INFO:tasks.rados.rados.0.trial188.stdout:2854: read oid 35 snap -1 2026-02-13T20:24:21.255 INFO:tasks.rados.rados.0.trial188.stdout:2854: expect (ObjNum 984 snap 292 seq_num 984) 2026-02-13T20:24:21.255 INFO:tasks.rados.rados.0.trial188.stdout:2855: write (excl) oid 45 current snap is 295 2026-02-13T20:24:21.255 INFO:tasks.rados.rados.0.trial188.stdout:2855: seq_num 991 ranges {655737=497649,1607773=789340} 2026-02-13T20:24:21.259 INFO:tasks.rados.rados.0.trial188.stdout:2855: writing trial18843701-45 from 655737 to 1153386 tid 1 2026-02-13T20:24:21.264 INFO:tasks.rados.rados.0.trial188.stdout:2855: writing trial18843701-45 from 1607773 to 2397113 tid 2 2026-02-13T20:24:21.264 INFO:tasks.rados.rados.0.trial188.stdout:2856: read oid 4 snap -1 2026-02-13T20:24:21.264 INFO:tasks.rados.rados.0.trial188.stdout:2856: expect (ObjNum 868 snap 252 seq_num 868) 2026-02-13T20:24:21.264 INFO:tasks.rados.rados.0.trial188.stdout:2857: write oid 18 current snap is 295 2026-02-13T20:24:21.264 INFO:tasks.rados.rados.0.trial188.stdout:2857: seq_num 992 ranges {672544=572898,1666255=532998} 2026-02-13T20:24:21.269 INFO:tasks.rados.rados.0.trial188.stdout:2857: writing trial18843701-18 from 672544 to 1245442 tid 1 2026-02-13T20:24:21.273 INFO:tasks.rados.rados.0.trial188.stdout:2857: writing trial18843701-18 from 1666255 to 2199253 tid 2 2026-02-13T20:24:21.273 INFO:tasks.rados.rados.0.trial188.stdout:2858: copy_from oid 48 from oid 31 current snap is 295 2026-02-13T20:24:21.273 INFO:tasks.rados.rados.0.trial188.stdout:2854: expect (ObjNum 984 snap 292 seq_num 984) 2026-02-13T20:24:21.273 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 153699 2026-02-13T20:24:21.305 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:24:21.338 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 41101 2026-02-13T20:24:21.371 INFO:tasks.rados.rados.0.trial188.stdout:2856: expect (ObjNum 868 snap 252 seq_num 868) 2026-02-13T20:24:21.397 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:24:21.435 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2016431 2026-02-13T20:24:21.443 INFO:tasks.rados.rados.0.trial188.stdout:2855: finishing write tid 1 to trial18843701-45 2026-02-13T20:24:21.443 INFO:tasks.rados.rados.0.trial188.stdout:2854: done (4 left) 2026-02-13T20:24:21.443 INFO:tasks.rados.rados.0.trial188.stdout:2856: done (3 left) 2026-02-13T20:24:21.443 INFO:tasks.rados.rados.0.trial188.stdout:2859: write (excl) oid 35 current snap is 295 2026-02-13T20:24:21.443 INFO:tasks.rados.rados.0.trial188.stdout:2855: finishing write tid 2 to trial18843701-45 2026-02-13T20:24:21.443 INFO:tasks.rados.rados.0.trial188.stdout:2855: finishing write tid 3 to trial18843701-45 2026-02-13T20:24:21.443 INFO:tasks.rados.rados.0.trial188.stdout:2855: finishing write tid 4 to trial18843701-45 2026-02-13T20:24:21.443 INFO:tasks.rados.rados.0.trial188.stdout:2855: oid 45 updating version 0 to 1394 2026-02-13T20:24:21.444 INFO:tasks.rados.rados.0.trial188.stdout:2855: oid 45 version 1394 is already newer than 1393 2026-02-13T20:24:21.444 INFO:tasks.rados.rados.0.trial188.stdout:2855: oid 45 updating version 1394 to 1395 2026-02-13T20:24:21.444 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 45 v 1395 (ObjNum 991 snap 295 seq_num 991) dirty exists 2026-02-13T20:24:21.444 INFO:tasks.rados.rados.0.trial188.stdout:2855: left oid 45 (ObjNum 991 snap 295 seq_num 991) 2026-02-13T20:24:21.444 INFO:tasks.rados.rados.0.trial188.stdout:2857: finishing write tid 1 to trial18843701-18 2026-02-13T20:24:21.444 INFO:tasks.rados.rados.0.trial188.stdout:2857: finishing write tid 2 to trial18843701-18 2026-02-13T20:24:21.444 INFO:tasks.rados.rados.0.trial188.stdout:2857: finishing write tid 3 to trial18843701-18 2026-02-13T20:24:21.444 INFO:tasks.rados.rados.0.trial188.stdout:2857: finishing write tid 4 to trial18843701-18 2026-02-13T20:24:21.444 INFO:tasks.rados.rados.0.trial188.stdout:2857: oid 18 updating version 0 to 1066 2026-02-13T20:24:21.444 INFO:tasks.rados.rados.0.trial188.stdout:2857: oid 18 version 1066 is already newer than 1065 2026-02-13T20:24:21.444 INFO:tasks.rados.rados.0.trial188.stdout:2857: oid 18 updating version 1066 to 1067 2026-02-13T20:24:21.444 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 18 v 1067 (ObjNum 992 snap 295 seq_num 992) dirty exists 2026-02-13T20:24:21.444 INFO:tasks.rados.rados.0.trial188.stdout:2857: left oid 18 (ObjNum 992 snap 295 seq_num 992) 2026-02-13T20:24:21.444 INFO:tasks.rados.rados.0.trial188.stdout:2858: finishing copy_from racing read to trial18843701-48 2026-02-13T20:24:21.444 INFO:tasks.rados.rados.0.trial188.stdout:2858: finishing copy_from to trial18843701-48 2026-02-13T20:24:21.444 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 48 v 972 (ObjNum 985 snap 293 seq_num 985) dirty exists 2026-02-13T20:24:21.444 INFO:tasks.rados.rados.0.trial188.stdout:2859: seq_num 993 ranges {689351=648147,2124737=564614} 2026-02-13T20:24:21.449 INFO:tasks.rados.rados.0.trial188.stdout:2859: writing trial18843701-35 from 689351 to 1337498 tid 1 2026-02-13T20:24:21.454 INFO:tasks.rados.rados.0.trial188.stdout:2859: writing trial18843701-35 from 2124737 to 2689351 tid 2 2026-02-13T20:24:21.454 INFO:tasks.rados.rados.0.trial188.stdout:2855: done (3 left) 2026-02-13T20:24:21.454 INFO:tasks.rados.rados.0.trial188.stdout:2857: done (2 left) 2026-02-13T20:24:21.454 INFO:tasks.rados.rados.0.trial188.stdout:2858: done (1 left) 2026-02-13T20:24:21.454 INFO:tasks.rados.rados.0.trial188.stdout:2860: rollback oid 7 current snap is 295 2026-02-13T20:24:21.454 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 7 to 291 2026-02-13T20:24:21.454 INFO:tasks.rados.rados.0.trial188.stdout:2861: snap_remove snap 292 2026-02-13T20:24:22.239 INFO:tasks.rados.rados.0.trial188.stdout:2861: done (2 left) 2026-02-13T20:24:22.239 INFO:tasks.rados.rados.0.trial188.stdout:2862: delete oid 16 current snap is 295 2026-02-13T20:24:22.240 INFO:tasks.rados.rados.0.trial188.stdout:2860: finishing rollback tid 0 to trial18843701-7 2026-02-13T20:24:22.240 INFO:tasks.rados.rados.0.trial188.stdout:2860: finishing rollback tid 1 to trial18843701-7 2026-02-13T20:24:22.240 INFO:tasks.rados.rados.0.trial188.stdout:2860: finishing rollback tid 2 to trial18843701-7 2026-02-13T20:24:22.240 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 7 v 1245 (ObjNum 952 snap 283 seq_num 952) dirty exists 2026-02-13T20:24:22.240 INFO:tasks.rados.rados.0.trial188.stdout:2859: finishing write tid 1 to trial18843701-35 2026-02-13T20:24:22.240 INFO:tasks.rados.rados.0.trial188.stdout:2859: finishing write tid 2 to trial18843701-35 2026-02-13T20:24:22.240 INFO:tasks.rados.rados.0.trial188.stdout:2859: finishing write tid 3 to trial18843701-35 2026-02-13T20:24:22.240 INFO:tasks.rados.rados.0.trial188.stdout:2859: finishing write tid 4 to trial18843701-35 2026-02-13T20:24:22.240 INFO:tasks.rados.rados.0.trial188.stdout:2859: oid 35 updating version 0 to 864 2026-02-13T20:24:22.240 INFO:tasks.rados.rados.0.trial188.stdout:2859: oid 35 version 864 is already newer than 863 2026-02-13T20:24:22.240 INFO:tasks.rados.rados.0.trial188.stdout:2859: oid 35 version 864 is already newer than 862 2026-02-13T20:24:22.241 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 35 v 864 (ObjNum 993 snap 295 seq_num 993) dirty exists 2026-02-13T20:24:22.241 INFO:tasks.rados.rados.0.trial188.stdout:2859: left oid 35 (ObjNum 993 snap 295 seq_num 993) 2026-02-13T20:24:22.243 INFO:tasks.rados.rados.0.trial188.stdout:2859: done (2 left) 2026-02-13T20:24:22.243 INFO:tasks.rados.rados.0.trial188.stdout:2860: done (1 left) 2026-02-13T20:24:22.243 INFO:tasks.rados.rados.0.trial188.stdout:2862: done (0 left) 2026-02-13T20:24:22.243 INFO:tasks.rados.rados.0.trial188.stdout:2863: read oid 20 snap 287 2026-02-13T20:24:22.243 INFO:tasks.rados.rados.0.trial188.stdout:2863: expect (ObjNum 912 snap 276 seq_num 912) 2026-02-13T20:24:22.243 INFO:tasks.rados.rados.0.trial188.stdout:2864: write oid 26 current snap is 295 2026-02-13T20:24:22.243 INFO:tasks.rados.rados.0.trial188.stdout:2864: seq_num 995 ranges {722965=798645,2125348=597617} 2026-02-13T20:24:22.249 INFO:tasks.rados.rados.0.trial188.stdout:2864: writing trial18843701-26 from 722965 to 1521610 tid 1 2026-02-13T20:24:22.254 INFO:tasks.rados.rados.0.trial188.stdout:2864: writing trial18843701-26 from 2125348 to 2722965 tid 2 2026-02-13T20:24:22.254 INFO:tasks.rados.rados.0.trial188.stdout:2865: copy_from oid 32 from oid 46 current snap is 295 2026-02-13T20:24:22.254 INFO:tasks.rados.rados.0.trial188.stdout:2863: expect (ObjNum 912 snap 276 seq_num 912) 2026-02-13T20:24:22.259 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 972473 2026-02-13T20:24:22.346 INFO:tasks.rados.rados.0.trial188.stdout:2864: finishing write tid 1 to trial18843701-26 2026-02-13T20:24:22.346 INFO:tasks.rados.rados.0.trial188.stdout:2864: finishing write tid 2 to trial18843701-26 2026-02-13T20:24:22.346 INFO:tasks.rados.rados.0.trial188.stdout:2863: done (2 left) 2026-02-13T20:24:22.347 INFO:tasks.rados.rados.0.trial188.stdout:2866: copy_from oid 5 from oid 21 current snap is 295 2026-02-13T20:24:22.347 INFO:tasks.rados.rados.0.trial188.stdout:2864: finishing write tid 3 to trial18843701-26 2026-02-13T20:24:22.347 INFO:tasks.rados.rados.0.trial188.stdout:2864: finishing write tid 4 to trial18843701-26 2026-02-13T20:24:22.347 INFO:tasks.rados.rados.0.trial188.stdout:2864: oid 26 updating version 0 to 991 2026-02-13T20:24:22.347 INFO:tasks.rados.rados.0.trial188.stdout:2864: oid 26 updating version 991 to 992 2026-02-13T20:24:22.347 INFO:tasks.rados.rados.0.trial188.stdout:2864: oid 26 version 992 is already newer than 990 2026-02-13T20:24:22.347 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 26 v 992 (ObjNum 995 snap 295 seq_num 995) dirty exists 2026-02-13T20:24:22.347 INFO:tasks.rados.rados.0.trial188.stdout:2864: left oid 26 (ObjNum 995 snap 295 seq_num 995) 2026-02-13T20:24:22.347 INFO:tasks.rados.rados.0.trial188.stdout:2865: finishing copy_from racing read to trial18843701-32 2026-02-13T20:24:22.347 INFO:tasks.rados.rados.0.trial188.stdout:2865: finishing copy_from to trial18843701-32 2026-02-13T20:24:22.347 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 32 v 1332 (ObjNum 872 snap 255 seq_num 872) dirty exists 2026-02-13T20:24:22.347 INFO:tasks.rados.rados.0.trial188.stdout:2864: done (2 left) 2026-02-13T20:24:22.348 INFO:tasks.rados.rados.0.trial188.stdout:2865: done (1 left) 2026-02-13T20:24:22.348 INFO:tasks.rados.rados.0.trial188.stdout:2867: snap_remove snap 287 2026-02-13T20:24:23.265 INFO:tasks.rados.rados.0.trial188.stdout:2867: done (1 left) 2026-02-13T20:24:23.265 INFO:tasks.rados.rados.0.trial188.stdout:2868: read oid 3 snap -1 2026-02-13T20:24:23.265 INFO:tasks.rados.rados.0.trial188.stdout:2868: expect (ObjNum 986 snap 294 seq_num 986) 2026-02-13T20:24:23.265 INFO:tasks.rados.rados.0.trial188.stdout:2869: snap_create 2026-02-13T20:24:23.265 INFO:tasks.rados.rados.0.trial188.stdout:2866: finishing copy_from racing read to trial18843701-5 2026-02-13T20:24:23.265 INFO:tasks.rados.rados.0.trial188.stdout:2866: finishing copy_from to trial18843701-5 2026-02-13T20:24:23.265 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 5 v 607 (ObjNum 948 snap 282 seq_num 948) dirty exists 2026-02-13T20:24:23.270 INFO:tasks.rados.rados.0.trial188.stdout:2868: expect (ObjNum 986 snap 294 seq_num 986) 2026-02-13T20:24:24.268 INFO:tasks.rados.rados.0.trial188.stdout:2866: done (2 left) 2026-02-13T20:24:24.269 INFO:tasks.rados.rados.0.trial188.stdout:2868: done (1 left) 2026-02-13T20:24:24.269 INFO:tasks.rados.rados.0.trial188.stdout:2869: done (0 left) 2026-02-13T20:24:24.269 INFO:tasks.rados.rados.0.trial188.stdout:2870: delete oid 20 current snap is 296 2026-02-13T20:24:24.272 INFO:tasks.rados.rados.0.trial188.stdout:2870: done (0 left) 2026-02-13T20:24:24.272 INFO:tasks.rados.rados.0.trial188.stdout:2871: copy_from oid 5 from oid 11 current snap is 296 2026-02-13T20:24:24.272 INFO:tasks.rados.rados.0.trial188.stdout:2872: read oid 17 snap -1 2026-02-13T20:24:24.272 INFO:tasks.rados.rados.0.trial188.stdout:2872: expect deleted 2026-02-13T20:24:24.272 INFO:tasks.rados.rados.0.trial188.stdout:2873: write oid 48 current snap is 296 2026-02-13T20:24:24.272 INFO:tasks.rados.rados.0.trial188.stdout:2873: seq_num 997 ranges {756579=665496,1958665=400347} 2026-02-13T20:24:24.277 INFO:tasks.rados.rados.0.trial188.stdout:2873: writing trial18843701-48 from 756579 to 1422075 tid 1 2026-02-13T20:24:24.280 INFO:tasks.rados.rados.0.trial188.stdout:2873: writing trial18843701-48 from 1958665 to 2359012 tid 2 2026-02-13T20:24:24.280 INFO:tasks.rados.rados.0.trial188.stdout:2874: snap_create 2026-02-13T20:24:24.295 INFO:tasks.rados.rados.0.trial188.stdout:2873: finishing write tid 1 to trial18843701-48 2026-02-13T20:24:24.295 INFO:tasks.rados.rados.0.trial188.stdout:2873: finishing write tid 2 to trial18843701-48 2026-02-13T20:24:24.295 INFO:tasks.rados.rados.0.trial188.stdout:2873: finishing write tid 3 to trial18843701-48 2026-02-13T20:24:24.295 INFO:tasks.rados.rados.0.trial188.stdout:2873: finishing write tid 4 to trial18843701-48 2026-02-13T20:24:24.295 INFO:tasks.rados.rados.0.trial188.stdout:2873: oid 48 updating version 0 to 975 2026-02-13T20:24:24.295 INFO:tasks.rados.rados.0.trial188.stdout:2873: oid 48 version 975 is already newer than 973 2026-02-13T20:24:24.295 INFO:tasks.rados.rados.0.trial188.stdout:2873: oid 48 version 975 is already newer than 974 2026-02-13T20:24:24.295 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 48 v 975 (ObjNum 997 snap 296 seq_num 997) dirty exists 2026-02-13T20:24:24.295 INFO:tasks.rados.rados.0.trial188.stdout:2873: left oid 48 (ObjNum 997 snap 296 seq_num 997) 2026-02-13T20:24:24.310 INFO:tasks.rados.rados.0.trial188.stdout:2871: finishing copy_from racing read to trial18843701-5 2026-02-13T20:24:24.313 INFO:tasks.rados.rados.0.trial188.stdout:2871: finishing copy_from to trial18843701-5 2026-02-13T20:24:24.314 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 5 v 1059 (ObjNum 940 snap 280 seq_num 940) dirty exists 2026-02-13T20:24:25.270 INFO:tasks.rados.rados.0.trial188.stdout:2871: done (3 left) 2026-02-13T20:24:25.270 INFO:tasks.rados.rados.0.trial188.stdout:2872: done (2 left) 2026-02-13T20:24:25.270 INFO:tasks.rados.rados.0.trial188.stdout:2873: done (1 left) 2026-02-13T20:24:25.270 INFO:tasks.rados.rados.0.trial188.stdout:2874: done (0 left) 2026-02-13T20:24:25.270 INFO:tasks.rados.rados.0.trial188.stdout:2875: write oid 43 current snap is 297 2026-02-13T20:24:25.270 INFO:tasks.rados.rados.0.trial188.stdout:2875: seq_num 998 ranges {773386=740745,2017147=544005} 2026-02-13T20:24:25.275 INFO:tasks.rados.rados.0.trial188.stdout:2875: writing trial18843701-43 from 773386 to 1514131 tid 1 2026-02-13T20:24:25.279 INFO:tasks.rados.rados.0.trial188.stdout:2875: writing trial18843701-43 from 2017147 to 2561152 tid 2 2026-02-13T20:24:25.279 INFO:tasks.rados.rados.0.trial188.stdout:2876: copy_from oid 42 from oid 15 current snap is 297 2026-02-13T20:24:25.279 INFO:tasks.rados.rados.0.trial188.stdout:2877: snap_create 2026-02-13T20:24:25.293 INFO:tasks.rados.rados.0.trial188.stdout:2875: finishing write tid 1 to trial18843701-43 2026-02-13T20:24:25.295 INFO:tasks.rados.rados.0.trial188.stdout:2875: finishing write tid 2 to trial18843701-43 2026-02-13T20:24:25.295 INFO:tasks.rados.rados.0.trial188.stdout:2875: finishing write tid 3 to trial18843701-43 2026-02-13T20:24:25.295 INFO:tasks.rados.rados.0.trial188.stdout:2875: finishing write tid 4 to trial18843701-43 2026-02-13T20:24:25.295 INFO:tasks.rados.rados.0.trial188.stdout:2875: oid 43 updating version 0 to 1075 2026-02-13T20:24:25.295 INFO:tasks.rados.rados.0.trial188.stdout:2875: oid 43 version 1075 is already newer than 1074 2026-02-13T20:24:25.295 INFO:tasks.rados.rados.0.trial188.stdout:2875: oid 43 updating version 1075 to 1076 2026-02-13T20:24:25.295 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 43 v 1076 (ObjNum 998 snap 297 seq_num 998) dirty exists 2026-02-13T20:24:25.295 INFO:tasks.rados.rados.0.trial188.stdout:2875: left oid 43 (ObjNum 998 snap 297 seq_num 998) 2026-02-13T20:24:25.312 INFO:tasks.rados.rados.0.trial188.stdout:2876: finishing copy_from racing read to trial18843701-42 2026-02-13T20:24:25.315 INFO:tasks.rados.rados.0.trial188.stdout:2876: finishing copy_from to trial18843701-42 2026-02-13T20:24:25.315 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 42 v 985 (ObjNum 865 snap 250 seq_num 865) dirty exists 2026-02-13T20:24:26.274 INFO:tasks.rados.rados.0.trial188.stdout:2875: done (2 left) 2026-02-13T20:24:26.275 INFO:tasks.rados.rados.0.trial188.stdout:2876: done (1 left) 2026-02-13T20:24:26.275 INFO:tasks.rados.rados.0.trial188.stdout:2877: done (0 left) 2026-02-13T20:24:26.275 INFO:tasks.rados.rados.0.trial188.stdout:2878: rollback oid 45 current snap is 298 2026-02-13T20:24:26.275 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 45 to 279 2026-02-13T20:24:26.275 INFO:tasks.rados.rados.0.trial188.stdout:2879: copy_from oid 41 from oid 31 current snap is 298 2026-02-13T20:24:26.275 INFO:tasks.rados.rados.0.trial188.stdout:2880: copy_from oid 19 from oid 30 current snap is 298 2026-02-13T20:24:26.275 INFO:tasks.rados.rados.0.trial188.stdout:2881: write (excl) oid 7 current snap is 298 2026-02-13T20:24:26.275 INFO:tasks.rados.rados.0.trial188.stdout:2881: seq_num 999 ranges {790193=415994,1959276=404016} 2026-02-13T20:24:26.279 INFO:tasks.rados.rados.0.trial188.stdout:2881: writing trial18843701-7 from 790193 to 1206187 tid 1 2026-02-13T20:24:26.283 INFO:tasks.rados.rados.0.trial188.stdout:2881: writing trial18843701-7 from 1959276 to 2363292 tid 2 2026-02-13T20:24:26.284 INFO:tasks.rados.rados.0.trial188.stdout:2882: read oid 34 snap 290 2026-02-13T20:24:26.284 INFO:tasks.rados.rados.0.trial188.stdout:2882: expect deleted 2026-02-13T20:24:26.284 INFO:tasks.rados.rados.0.trial188.stdout:2883: write oid 35 current snap is 298 2026-02-13T20:24:26.284 INFO:tasks.rados.rados.0.trial188.stdout:2883: seq_num 1000 ranges {407000=491243,1617758=547674,2595228=211772} 2026-02-13T20:24:26.287 INFO:tasks.rados.rados.0.trial188.stdout:2883: writing trial18843701-35 from 407000 to 898243 tid 1 2026-02-13T20:24:26.291 INFO:tasks.rados.rados.0.trial188.stdout:2883: writing trial18843701-35 from 1617758 to 2165432 tid 2 2026-02-13T20:24:26.294 INFO:tasks.rados.rados.0.trial188.stdout:2883: writing trial18843701-35 from 2595228 to 2807000 tid 3 2026-02-13T20:24:26.294 INFO:tasks.rados.rados.0.trial188.stdout:2884: read oid 40 snap -1 2026-02-13T20:24:26.294 INFO:tasks.rados.rados.0.trial188.stdout:2884: expect deleted 2026-02-13T20:24:26.294 INFO:tasks.rados.rados.0.trial188.stdout:2885: delete oid 36 current snap is 298 2026-02-13T20:24:26.294 INFO:tasks.rados.rados.0.trial188.stdout:2880: finishing copy_from to trial18843701-19 2026-02-13T20:24:26.294 INFO:tasks.rados.rados.0.trial188.stdout:2880: got expected ENOENT (src dne) 2026-02-13T20:24:26.294 INFO:tasks.rados.rados.0.trial188.stdout:2880: finishing copy_from racing read to trial18843701-19 2026-02-13T20:24:26.294 INFO:tasks.rados.rados.0.trial188.stdout:2878: finishing rollback tid 0 to trial18843701-45 2026-02-13T20:24:26.294 INFO:tasks.rados.rados.0.trial188.stdout:2878: finishing rollback tid 1 to trial18843701-45 2026-02-13T20:24:26.294 INFO:tasks.rados.rados.0.trial188.stdout:2878: finishing rollback tid 2 to trial18843701-45 2026-02-13T20:24:26.294 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 45 v 1407 (ObjNum 752 snap 222 seq_num 752) dirty exists 2026-02-13T20:24:26.295 INFO:tasks.rados.rados.0.trial188.stdout:2881: finishing write tid 1 to trial18843701-7 2026-02-13T20:24:26.295 INFO:tasks.rados.rados.0.trial188.stdout:2881: finishing write tid 2 to trial18843701-7 2026-02-13T20:24:26.295 INFO:tasks.rados.rados.0.trial188.stdout:2881: finishing write tid 3 to trial18843701-7 2026-02-13T20:24:26.295 INFO:tasks.rados.rados.0.trial188.stdout:2881: finishing write tid 4 to trial18843701-7 2026-02-13T20:24:26.295 INFO:tasks.rados.rados.0.trial188.stdout:2881: oid 7 updating version 0 to 1246 2026-02-13T20:24:26.295 INFO:tasks.rados.rados.0.trial188.stdout:2881: oid 7 updating version 1246 to 1247 2026-02-13T20:24:26.295 INFO:tasks.rados.rados.0.trial188.stdout:2881: oid 7 updating version 1247 to 1248 2026-02-13T20:24:26.295 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 7 v 1248 (ObjNum 999 snap 298 seq_num 999) dirty exists 2026-02-13T20:24:26.295 INFO:tasks.rados.rados.0.trial188.stdout:2881: left oid 7 (ObjNum 999 snap 298 seq_num 999) 2026-02-13T20:24:26.302 INFO:tasks.rados.rados.0.trial188.stdout:2878: done (7 left) 2026-02-13T20:24:26.302 INFO:tasks.rados.rados.0.trial188.stdout:2880: done (6 left) 2026-02-13T20:24:26.302 INFO:tasks.rados.rados.0.trial188.stdout:2881: done (5 left) 2026-02-13T20:24:26.302 INFO:tasks.rados.rados.0.trial188.stdout:2882: done (4 left) 2026-02-13T20:24:26.302 INFO:tasks.rados.rados.0.trial188.stdout:2885: done (3 left) 2026-02-13T20:24:26.302 INFO:tasks.rados.rados.0.trial188.stdout:2886: rollback oid 45 current snap is 298 2026-02-13T20:24:26.302 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 45 to 290 2026-02-13T20:24:26.302 INFO:tasks.rados.rados.0.trial188.stdout:2887: snap_remove snap 297 2026-02-13T20:24:27.242 INFO:tasks.rados.rados.0.trial188.stdout:2887: done (4 left) 2026-02-13T20:24:27.242 INFO:tasks.rados.rados.0.trial188.stdout:2888: rollback oid 28 current snap is 298 2026-02-13T20:24:27.242 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 28 to 294 2026-02-13T20:24:27.242 INFO:tasks.rados.rados.0.trial188.stdout:2879: finishing copy_from racing read to trial18843701-41 2026-02-13T20:24:27.242 INFO:tasks.rados.rados.0.trial188.stdout:2883: finishing write tid 1 to trial18843701-35 2026-02-13T20:24:27.242 INFO:tasks.rados.rados.0.trial188.stdout:2883: finishing write tid 2 to trial18843701-35 2026-02-13T20:24:27.242 INFO:tasks.rados.rados.0.trial188.stdout:2883: finishing write tid 3 to trial18843701-35 2026-02-13T20:24:27.242 INFO:tasks.rados.rados.0.trial188.stdout:2886: finishing rollback tid 0 to trial18843701-45 2026-02-13T20:24:27.242 INFO:tasks.rados.rados.0.trial188.stdout:2886: finishing rollback tid 1 to trial18843701-45 2026-02-13T20:24:27.243 INFO:tasks.rados.rados.0.trial188.stdout:2886: finishing rollback tid 2 to trial18843701-45 2026-02-13T20:24:27.243 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 45 v 1410 (ObjNum 975 snap 289 seq_num 975) dirty exists 2026-02-13T20:24:27.243 INFO:tasks.rados.rados.0.trial188.stdout:2883: finishing write tid 4 to trial18843701-35 2026-02-13T20:24:27.243 INFO:tasks.rados.rados.0.trial188.stdout:2879: finishing copy_from to trial18843701-41 2026-02-13T20:24:27.243 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 41 v 972 (ObjNum 985 snap 293 seq_num 985) dirty exists 2026-02-13T20:24:27.243 INFO:tasks.rados.rados.0.trial188.stdout:2883: finishing write tid 5 to trial18843701-35 2026-02-13T20:24:27.243 INFO:tasks.rados.rados.0.trial188.stdout:2883: oid 35 updating version 0 to 986 2026-02-13T20:24:27.243 INFO:tasks.rados.rados.0.trial188.stdout:2883: oid 35 updating version 986 to 987 2026-02-13T20:24:27.243 INFO:tasks.rados.rados.0.trial188.stdout:2883: oid 35 updating version 987 to 989 2026-02-13T20:24:27.243 INFO:tasks.rados.rados.0.trial188.stdout:2883: oid 35 version 989 is already newer than 988 2026-02-13T20:24:27.243 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 35 v 989 (ObjNum 1000 snap 298 seq_num 1000) dirty exists 2026-02-13T20:24:27.243 INFO:tasks.rados.rados.0.trial188.stdout:2883: left oid 35 (ObjNum 1000 snap 298 seq_num 1000) 2026-02-13T20:24:27.244 INFO:tasks.rados.rados.0.trial188.stdout:2879: done (4 left) 2026-02-13T20:24:27.244 INFO:tasks.rados.rados.0.trial188.stdout:2883: done (3 left) 2026-02-13T20:24:27.244 INFO:tasks.rados.rados.0.trial188.stdout:2884: done (2 left) 2026-02-13T20:24:27.244 INFO:tasks.rados.rados.0.trial188.stdout:2886: done (1 left) 2026-02-13T20:24:27.244 INFO:tasks.rados.rados.0.trial188.stdout:2889: write oid 17 current snap is 298 2026-02-13T20:24:27.244 INFO:tasks.rados.rados.0.trial188.stdout:2889: seq_num 1002 ranges {440614=641741,1734722=551343} 2026-02-13T20:24:27.246 INFO:tasks.rados.rados.0.trial188.stdout:2889: writing trial18843701-17 from 440614 to 1082355 tid 1 2026-02-13T20:24:27.251 INFO:tasks.rados.rados.0.trial188.stdout:2889: writing trial18843701-17 from 1734722 to 2286065 tid 2 2026-02-13T20:24:27.251 INFO:tasks.rados.rados.0.trial188.stdout:2890: read oid 5 snap -1 2026-02-13T20:24:27.251 INFO:tasks.rados.rados.0.trial188.stdout:2890: expect (ObjNum 940 snap 280 seq_num 940) 2026-02-13T20:24:27.251 INFO:tasks.rados.rados.0.trial188.stdout:2891: copy_from oid 37 from oid 25 current snap is 298 2026-02-13T20:24:27.252 INFO:tasks.rados.rados.0.trial188.stdout:2888: finishing rollback tid 0 to trial18843701-28 2026-02-13T20:24:27.252 INFO:tasks.rados.rados.0.trial188.stdout:2888: finishing rollback tid 1 to trial18843701-28 2026-02-13T20:24:27.252 INFO:tasks.rados.rados.0.trial188.stdout:2888: finishing rollback tid 2 to trial18843701-28 2026-02-13T20:24:27.252 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 28 v 1416 (ObjNum 933 snap 280 seq_num 933) dirty exists 2026-02-13T20:24:27.252 INFO:tasks.rados.rados.0.trial188.stdout:2888: done (3 left) 2026-02-13T20:24:27.252 INFO:tasks.rados.rados.0.trial188.stdout:2892: read oid 27 snap -1 2026-02-13T20:24:27.252 INFO:tasks.rados.rados.0.trial188.stdout:2892: expect deleted 2026-02-13T20:24:27.252 INFO:tasks.rados.rados.0.trial188.stdout:2893: snap_create 2026-02-13T20:24:27.263 INFO:tasks.rados.rados.0.trial188.stdout:2890: expect (ObjNum 940 snap 280 seq_num 940) 2026-02-13T20:24:27.307 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1112416 2026-02-13T20:24:27.347 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:24:27.395 INFO:tasks.rados.rados.0.trial188.stdout:2889: finishing write tid 1 to trial18843701-17 2026-02-13T20:24:27.395 INFO:tasks.rados.rados.0.trial188.stdout:2889: finishing write tid 2 to trial18843701-17 2026-02-13T20:24:27.395 INFO:tasks.rados.rados.0.trial188.stdout:2889: finishing write tid 3 to trial18843701-17 2026-02-13T20:24:27.396 INFO:tasks.rados.rados.0.trial188.stdout:2889: finishing write tid 4 to trial18843701-17 2026-02-13T20:24:27.396 INFO:tasks.rados.rados.0.trial188.stdout:2889: oid 17 updating version 0 to 1069 2026-02-13T20:24:27.396 INFO:tasks.rados.rados.0.trial188.stdout:2889: oid 17 updating version 1069 to 1070 2026-02-13T20:24:27.396 INFO:tasks.rados.rados.0.trial188.stdout:2889: oid 17 version 1070 is already newer than 1068 2026-02-13T20:24:27.396 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 17 v 1070 (ObjNum 1002 snap 298 seq_num 1002) dirty exists 2026-02-13T20:24:27.396 INFO:tasks.rados.rados.0.trial188.stdout:2889: left oid 17 (ObjNum 1002 snap 298 seq_num 1002) 2026-02-13T20:24:27.396 INFO:tasks.rados.rados.0.trial188.stdout:2891: finishing copy_from racing read to trial18843701-37 2026-02-13T20:24:27.396 INFO:tasks.rados.rados.0.trial188.stdout:2891: finishing copy_from to trial18843701-37 2026-02-13T20:24:27.396 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 37 v 1324 (ObjNum 756 snap 223 seq_num 756) dirty exists 2026-02-13T20:24:28.244 INFO:tasks.rados.rados.0.trial188.stdout:2889: done (4 left) 2026-02-13T20:24:28.245 INFO:tasks.rados.rados.0.trial188.stdout:2890: done (3 left) 2026-02-13T20:24:28.245 INFO:tasks.rados.rados.0.trial188.stdout:2891: done (2 left) 2026-02-13T20:24:28.245 INFO:tasks.rados.rados.0.trial188.stdout:2892: done (1 left) 2026-02-13T20:24:28.245 INFO:tasks.rados.rados.0.trial188.stdout:2893: done (0 left) 2026-02-13T20:24:28.245 INFO:tasks.rados.rados.0.trial188.stdout:2894: write oid 26 current snap is 299 2026-02-13T20:24:28.245 INFO:tasks.rados.rados.0.trial188.stdout:2894: seq_num 1003 ranges {457421=716990,1676851=411354,2677497=179924} 2026-02-13T20:24:28.249 INFO:tasks.rados.rados.0.trial188.stdout:2894: writing trial18843701-26 from 457421 to 1174411 tid 1 2026-02-13T20:24:28.253 INFO:tasks.rados.rados.0.trial188.stdout:2894: writing trial18843701-26 from 1676851 to 2088205 tid 2 2026-02-13T20:24:28.255 INFO:tasks.rados.rados.0.trial188.stdout:2894: writing trial18843701-26 from 2677497 to 2857421 tid 3 2026-02-13T20:24:28.256 INFO:tasks.rados.rados.0.trial188.stdout:2895: snap_remove snap 296 2026-02-13T20:24:29.245 INFO:tasks.rados.rados.0.trial188.stdout:2895: done (1 left) 2026-02-13T20:24:29.246 INFO:tasks.rados.rados.0.trial188.stdout:2896: copy_from oid 42 from oid 22 current snap is 299 2026-02-13T20:24:29.246 INFO:tasks.rados.rados.0.trial188.stdout:2894: finishing write tid 1 to trial18843701-26 2026-02-13T20:24:29.246 INFO:tasks.rados.rados.0.trial188.stdout:2894: finishing write tid 2 to trial18843701-26 2026-02-13T20:24:29.246 INFO:tasks.rados.rados.0.trial188.stdout:2894: finishing write tid 3 to trial18843701-26 2026-02-13T20:24:29.246 INFO:tasks.rados.rados.0.trial188.stdout:2894: finishing write tid 4 to trial18843701-26 2026-02-13T20:24:29.247 INFO:tasks.rados.rados.0.trial188.stdout:2894: finishing write tid 5 to trial18843701-26 2026-02-13T20:24:29.247 INFO:tasks.rados.rados.0.trial188.stdout:2894: oid 26 updating version 0 to 996 2026-02-13T20:24:29.247 INFO:tasks.rados.rados.0.trial188.stdout:2894: oid 26 version 996 is already newer than 995 2026-02-13T20:24:29.247 INFO:tasks.rados.rados.0.trial188.stdout:2894: oid 26 version 996 is already newer than 994 2026-02-13T20:24:29.247 INFO:tasks.rados.rados.0.trial188.stdout:2894: oid 26 version 996 is already newer than 993 2026-02-13T20:24:29.247 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 26 v 996 (ObjNum 1003 snap 299 seq_num 1003) dirty exists 2026-02-13T20:24:29.247 INFO:tasks.rados.rados.0.trial188.stdout:2894: left oid 26 (ObjNum 1003 snap 299 seq_num 1003) 2026-02-13T20:24:29.247 INFO:tasks.rados.rados.0.trial188.stdout:2894: done (1 left) 2026-02-13T20:24:29.248 INFO:tasks.rados.rados.0.trial188.stdout:2897: rollback oid 17 current snap is 299 2026-02-13T20:24:29.248 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 17 to 290 2026-02-13T20:24:29.248 INFO:tasks.rados.rados.0.trial188.stdout:2898: write oid 33 current snap is 299 2026-02-13T20:24:29.248 INFO:tasks.rados.rados.0.trial188.stdout:2898: seq_num 1004 ranges {474228=508592,1451686=555012,2704920=169308} 2026-02-13T20:24:29.249 INFO:tasks.rados.rados.0.trial188.stdout:2898: writing trial18843701-33 from 474228 to 982820 tid 1 2026-02-13T20:24:29.251 INFO:tasks.rados.rados.0.trial188.stdout:2898: writing trial18843701-33 from 1451686 to 2006698 tid 2 2026-02-13T20:24:29.255 INFO:tasks.rados.rados.0.trial188.stdout:2898: writing trial18843701-33 from 2704920 to 2874228 tid 3 2026-02-13T20:24:29.255 INFO:tasks.rados.rados.0.trial188.stdout:2899: read oid 44 snap -1 2026-02-13T20:24:29.255 INFO:tasks.rados.rados.0.trial188.stdout:2899: expect (ObjNum 712 snap 203 seq_num 712) 2026-02-13T20:24:29.255 INFO:tasks.rados.rados.0.trial188.stdout:2900: write (excl) oid 30 current snap is 299 2026-02-13T20:24:29.255 INFO:tasks.rados.rados.0.trial188.stdout:2900: seq_num 1005 ranges {491035=583841,1510168=698670,2732343=158692} 2026-02-13T20:24:29.259 INFO:tasks.rados.rados.0.trial188.stdout:2900: writing trial18843701-30 from 491035 to 1074876 tid 1 2026-02-13T20:24:29.263 INFO:tasks.rados.rados.0.trial188.stdout:2900: writing trial18843701-30 from 1510168 to 2208838 tid 2 2026-02-13T20:24:29.266 INFO:tasks.rados.rados.0.trial188.stdout:2900: writing trial18843701-30 from 2732343 to 2891035 tid 3 2026-02-13T20:24:29.266 INFO:tasks.rados.rados.0.trial188.stdout:2901: write (excl) oid 7 current snap is 299 2026-02-13T20:24:29.266 INFO:tasks.rados.rados.0.trial188.stdout:2901: seq_num 1006 ranges {507842=659090,1568650=558681,2759766=148076} 2026-02-13T20:24:29.270 INFO:tasks.rados.rados.0.trial188.stdout:2901: writing trial18843701-7 from 507842 to 1166932 tid 1 2026-02-13T20:24:29.273 INFO:tasks.rados.rados.0.trial188.stdout:2901: writing trial18843701-7 from 1568650 to 2127331 tid 2 2026-02-13T20:24:29.277 INFO:tasks.rados.rados.0.trial188.stdout:2901: writing trial18843701-7 from 2759766 to 2907842 tid 3 2026-02-13T20:24:29.277 INFO:tasks.rados.rados.0.trial188.stdout:2902: read oid 25 snap -1 2026-02-13T20:24:29.277 INFO:tasks.rados.rados.0.trial188.stdout:2902: expect (ObjNum 756 snap 223 seq_num 756) 2026-02-13T20:24:29.277 INFO:tasks.rados.rados.0.trial188.stdout:2903: write oid 3 current snap is 299 2026-02-13T20:24:29.277 INFO:tasks.rados.rados.0.trial188.stdout:2897: finishing rollback tid 0 to trial18843701-17 2026-02-13T20:24:29.277 INFO:tasks.rados.rados.0.trial188.stdout:2897: finishing rollback tid 1 to trial18843701-17 2026-02-13T20:24:29.277 INFO:tasks.rados.rados.0.trial188.stdout:2897: finishing rollback tid 2 to trial18843701-17 2026-02-13T20:24:29.278 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 17 v 1073 (ObjNum 974 snap 289 seq_num 974) dirty exists 2026-02-13T20:24:29.278 INFO:tasks.rados.rados.0.trial188.stdout:2899: expect (ObjNum 712 snap 203 seq_num 712) 2026-02-13T20:24:29.324 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1451811 2026-02-13T20:24:29.360 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1449301 2026-02-13T20:24:29.388 INFO:tasks.rados.rados.0.trial188.stdout:2898: finishing write tid 1 to trial18843701-33 2026-02-13T20:24:29.388 INFO:tasks.rados.rados.0.trial188.stdout:2898: finishing write tid 2 to trial18843701-33 2026-02-13T20:24:29.389 INFO:tasks.rados.rados.0.trial188.stdout:2896: finishing copy_from racing read to trial18843701-42 2026-02-13T20:24:29.389 INFO:tasks.rados.rados.0.trial188.stdout:2898: finishing write tid 3 to trial18843701-33 2026-02-13T20:24:29.389 INFO:tasks.rados.rados.0.trial188.stdout:2903: seq_num 1007 ranges {524649=734339,1910779=702339} 2026-02-13T20:24:29.393 INFO:tasks.rados.rados.0.trial188.stdout:2903: writing trial18843701-3 from 524649 to 1258988 tid 1 2026-02-13T20:24:29.398 INFO:tasks.rados.rados.0.trial188.stdout:2903: writing trial18843701-3 from 1910779 to 2613118 tid 2 2026-02-13T20:24:29.398 INFO:tasks.rados.rados.0.trial188.stdout:2897: done (7 left) 2026-02-13T20:24:29.399 INFO:tasks.rados.rados.0.trial188.stdout:2899: done (6 left) 2026-02-13T20:24:29.399 INFO:tasks.rados.rados.0.trial188.stdout:2904: write oid 13 current snap is 299 2026-02-13T20:24:29.399 INFO:tasks.rados.rados.0.trial188.stdout:2898: finishing write tid 4 to trial18843701-33 2026-02-13T20:24:29.399 INFO:tasks.rados.rados.0.trial188.stdout:2901: finishing write tid 1 to trial18843701-7 2026-02-13T20:24:29.399 INFO:tasks.rados.rados.0.trial188.stdout:2896: finishing copy_from to trial18843701-42 2026-02-13T20:24:29.399 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 42 v 1068 (ObjNum 953 snap 284 seq_num 953) dirty exists 2026-02-13T20:24:29.399 INFO:tasks.rados.rados.0.trial188.stdout:2900: finishing write tid 1 to trial18843701-30 2026-02-13T20:24:29.399 INFO:tasks.rados.rados.0.trial188.stdout:2904: seq_num 1008 ranges {541456=409588,1569261=562350,2814612=126844} 2026-02-13T20:24:29.401 INFO:tasks.rados.rados.0.trial188.stdout:2904: writing trial18843701-13 from 541456 to 951044 tid 1 2026-02-13T20:24:29.406 INFO:tasks.rados.rados.0.trial188.stdout:2904: writing trial18843701-13 from 1569261 to 2131611 tid 2 2026-02-13T20:24:29.409 INFO:tasks.rados.rados.0.trial188.stdout:2904: writing trial18843701-13 from 2814612 to 2941456 tid 3 2026-02-13T20:24:29.409 INFO:tasks.rados.rados.0.trial188.stdout:2896: done (6 left) 2026-02-13T20:24:29.409 INFO:tasks.rados.rados.0.trial188.stdout:2905: snap_remove snap 259 2026-02-13T20:24:30.249 INFO:tasks.rados.rados.0.trial188.stdout:2905: done (6 left) 2026-02-13T20:24:30.250 INFO:tasks.rados.rados.0.trial188.stdout:2906: write (excl) oid 41 current snap is 299 2026-02-13T20:24:30.250 INFO:tasks.rados.rados.0.trial188.stdout:2906: seq_num 1009 ranges {558263=484837,1627743=706008} 2026-02-13T20:24:30.253 INFO:tasks.rados.rados.0.trial188.stdout:2906: writing trial18843701-41 from 558263 to 1043100 tid 1 2026-02-13T20:24:30.260 INFO:tasks.rados.rados.0.trial188.stdout:2906: writing trial18843701-41 from 1627743 to 2333751 tid 2 2026-02-13T20:24:30.260 INFO:tasks.rados.rados.0.trial188.stdout:2907: read oid 27 snap 228 2026-02-13T20:24:30.260 INFO:tasks.rados.rados.0.trial188.stdout:2907: expect deleted 2026-02-13T20:24:30.260 INFO:tasks.rados.rados.0.trial188.stdout:2908: read oid 45 snap -1 2026-02-13T20:24:30.260 INFO:tasks.rados.rados.0.trial188.stdout:2908: expect (ObjNum 975 snap 289 seq_num 975) 2026-02-13T20:24:30.260 INFO:tasks.rados.rados.0.trial188.stdout:2909: read oid 26 snap -1 2026-02-13T20:24:30.260 INFO:tasks.rados.rados.0.trial188.stdout:2909: expect (ObjNum 1003 snap 299 seq_num 1003) 2026-02-13T20:24:30.260 INFO:tasks.rados.rados.0.trial188.stdout:2910: read oid 35 snap -1 2026-02-13T20:24:30.261 INFO:tasks.rados.rados.0.trial188.stdout:2910: expect (ObjNum 1000 snap 298 seq_num 1000) 2026-02-13T20:24:30.261 INFO:tasks.rados.rados.0.trial188.stdout:2911: delete oid 49 current snap is 299 2026-02-13T20:24:30.261 INFO:tasks.rados.rados.0.trial188.stdout:2898: finishing write tid 5 to trial18843701-33 2026-02-13T20:24:30.261 INFO:tasks.rados.rados.0.trial188.stdout:2898: oid 33 updating version 0 to 1069 2026-02-13T20:24:30.261 INFO:tasks.rados.rados.0.trial188.stdout:2898: oid 33 version 1069 is already newer than 1067 2026-02-13T20:24:30.261 INFO:tasks.rados.rados.0.trial188.stdout:2898: oid 33 version 1069 is already newer than 1068 2026-02-13T20:24:30.261 INFO:tasks.rados.rados.0.trial188.stdout:2898: oid 33 version 1069 is already newer than 1066 2026-02-13T20:24:30.261 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 33 v 1069 (ObjNum 1004 snap 299 seq_num 1004) dirty exists 2026-02-13T20:24:30.261 INFO:tasks.rados.rados.0.trial188.stdout:2898: left oid 33 (ObjNum 1004 snap 299 seq_num 1004) 2026-02-13T20:24:30.261 INFO:tasks.rados.rados.0.trial188.stdout:2900: finishing write tid 2 to trial18843701-30 2026-02-13T20:24:30.261 INFO:tasks.rados.rados.0.trial188.stdout:2901: finishing write tid 2 to trial18843701-7 2026-02-13T20:24:30.261 INFO:tasks.rados.rados.0.trial188.stdout:2901: finishing write tid 3 to trial18843701-7 2026-02-13T20:24:30.261 INFO:tasks.rados.rados.0.trial188.stdout:2900: finishing write tid 3 to trial18843701-30 2026-02-13T20:24:30.262 INFO:tasks.rados.rados.0.trial188.stdout:2901: finishing write tid 4 to trial18843701-7 2026-02-13T20:24:30.262 INFO:tasks.rados.rados.0.trial188.stdout:2901: finishing write tid 5 to trial18843701-7 2026-02-13T20:24:30.262 INFO:tasks.rados.rados.0.trial188.stdout:2901: oid 7 updating version 0 to 1250 2026-02-13T20:24:30.262 INFO:tasks.rados.rados.0.trial188.stdout:2901: oid 7 version 1250 is already newer than 1249 2026-02-13T20:24:30.262 INFO:tasks.rados.rados.0.trial188.stdout:2901: oid 7 updating version 1250 to 1251 2026-02-13T20:24:30.262 INFO:tasks.rados.rados.0.trial188.stdout:2901: oid 7 updating version 1251 to 1252 2026-02-13T20:24:30.262 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 7 v 1252 (ObjNum 1006 snap 299 seq_num 1006) dirty exists 2026-02-13T20:24:30.262 INFO:tasks.rados.rados.0.trial188.stdout:2901: left oid 7 (ObjNum 1006 snap 299 seq_num 1006) 2026-02-13T20:24:30.262 INFO:tasks.rados.rados.0.trial188.stdout:2902: expect (ObjNum 756 snap 223 seq_num 756) 2026-02-13T20:24:30.291 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:24:30.355 INFO:tasks.rados.rados.0.trial188.stdout:2900: finishing write tid 4 to trial18843701-30 2026-02-13T20:24:30.355 INFO:tasks.rados.rados.0.trial188.stdout:2900: finishing write tid 5 to trial18843701-30 2026-02-13T20:24:30.355 INFO:tasks.rados.rados.0.trial188.stdout:2900: oid 30 updating version 0 to 1385 2026-02-13T20:24:30.355 INFO:tasks.rados.rados.0.trial188.stdout:2900: oid 30 version 1385 is already newer than 1384 2026-02-13T20:24:30.355 INFO:tasks.rados.rados.0.trial188.stdout:2900: oid 30 updating version 1385 to 1386 2026-02-13T20:24:30.356 INFO:tasks.rados.rados.0.trial188.stdout:2900: oid 30 updating version 1386 to 1387 2026-02-13T20:24:30.356 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 30 v 1387 (ObjNum 1005 snap 299 seq_num 1005) dirty exists 2026-02-13T20:24:30.356 INFO:tasks.rados.rados.0.trial188.stdout:2900: left oid 30 (ObjNum 1005 snap 299 seq_num 1005) 2026-02-13T20:24:30.356 INFO:tasks.rados.rados.0.trial188.stdout:2903: finishing write tid 1 to trial18843701-3 2026-02-13T20:24:30.356 INFO:tasks.rados.rados.0.trial188.stdout:2903: finishing write tid 2 to trial18843701-3 2026-02-13T20:24:30.356 INFO:tasks.rados.rados.0.trial188.stdout:2903: finishing write tid 3 to trial18843701-3 2026-02-13T20:24:30.356 INFO:tasks.rados.rados.0.trial188.stdout:2903: finishing write tid 4 to trial18843701-3 2026-02-13T20:24:30.356 INFO:tasks.rados.rados.0.trial188.stdout:2903: oid 3 updating version 0 to 998 2026-02-13T20:24:30.356 INFO:tasks.rados.rados.0.trial188.stdout:2903: oid 3 updating version 998 to 999 2026-02-13T20:24:30.356 INFO:tasks.rados.rados.0.trial188.stdout:2903: oid 3 version 999 is already newer than 997 2026-02-13T20:24:30.356 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 3 v 999 (ObjNum 1007 snap 299 seq_num 1007) dirty exists 2026-02-13T20:24:30.356 INFO:tasks.rados.rados.0.trial188.stdout:2903: left oid 3 (ObjNum 1007 snap 299 seq_num 1007) 2026-02-13T20:24:30.356 INFO:tasks.rados.rados.0.trial188.stdout:2904: finishing write tid 1 to trial18843701-13 2026-02-13T20:24:30.357 INFO:tasks.rados.rados.0.trial188.stdout:2904: finishing write tid 2 to trial18843701-13 2026-02-13T20:24:30.357 INFO:tasks.rados.rados.0.trial188.stdout:2904: finishing write tid 3 to trial18843701-13 2026-02-13T20:24:30.357 INFO:tasks.rados.rados.0.trial188.stdout:2904: finishing write tid 4 to trial18843701-13 2026-02-13T20:24:30.357 INFO:tasks.rados.rados.0.trial188.stdout:2904: finishing write tid 5 to trial18843701-13 2026-02-13T20:24:30.357 INFO:tasks.rados.rados.0.trial188.stdout:2904: oid 13 updating version 0 to 1284 2026-02-13T20:24:30.357 INFO:tasks.rados.rados.0.trial188.stdout:2904: oid 13 updating version 1284 to 1286 2026-02-13T20:24:30.357 INFO:tasks.rados.rados.0.trial188.stdout:2904: oid 13 version 1286 is already newer than 1285 2026-02-13T20:24:30.357 INFO:tasks.rados.rados.0.trial188.stdout:2904: oid 13 version 1286 is already newer than 1283 2026-02-13T20:24:30.357 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 13 v 1286 (ObjNum 1008 snap 299 seq_num 1008) dirty exists 2026-02-13T20:24:30.357 INFO:tasks.rados.rados.0.trial188.stdout:2904: left oid 13 (ObjNum 1008 snap 299 seq_num 1008) 2026-02-13T20:24:30.357 INFO:tasks.rados.rados.0.trial188.stdout:2908: expect (ObjNum 975 snap 289 seq_num 975) 2026-02-13T20:24:30.426 INFO:tasks.rados.rados.0.trial188.stdout:2910: expect (ObjNum 1000 snap 298 seq_num 1000) 2026-02-13T20:24:30.426 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:24:30.483 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2004304 2026-02-13T20:24:30.518 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2201494 2026-02-13T20:24:30.525 INFO:tasks.rados.rados.0.trial188.stdout:2909: expect (ObjNum 1003 snap 299 seq_num 1003) 2026-02-13T20:24:30.566 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 352880 2026-02-13T20:24:30.643 INFO:tasks.rados.rados.0.trial188.stdout:2906: finishing write tid 1 to trial18843701-41 2026-02-13T20:24:30.643 INFO:tasks.rados.rados.0.trial188.stdout:2906: finishing write tid 2 to trial18843701-41 2026-02-13T20:24:30.643 INFO:tasks.rados.rados.0.trial188.stdout:2898: done (11 left) 2026-02-13T20:24:30.643 INFO:tasks.rados.rados.0.trial188.stdout:2900: done (10 left) 2026-02-13T20:24:30.643 INFO:tasks.rados.rados.0.trial188.stdout:2901: done (9 left) 2026-02-13T20:24:30.644 INFO:tasks.rados.rados.0.trial188.stdout:2902: done (8 left) 2026-02-13T20:24:30.644 INFO:tasks.rados.rados.0.trial188.stdout:2903: done (7 left) 2026-02-13T20:24:30.644 INFO:tasks.rados.rados.0.trial188.stdout:2904: done (6 left) 2026-02-13T20:24:30.644 INFO:tasks.rados.rados.0.trial188.stdout:2907: done (5 left) 2026-02-13T20:24:30.644 INFO:tasks.rados.rados.0.trial188.stdout:2908: done (4 left) 2026-02-13T20:24:30.644 INFO:tasks.rados.rados.0.trial188.stdout:2909: done (3 left) 2026-02-13T20:24:30.644 INFO:tasks.rados.rados.0.trial188.stdout:2910: done (2 left) 2026-02-13T20:24:30.644 INFO:tasks.rados.rados.0.trial188.stdout:2911: done (1 left) 2026-02-13T20:24:30.644 INFO:tasks.rados.rados.0.trial188.stdout:2912: snap_create 2026-02-13T20:24:30.644 INFO:tasks.rados.rados.0.trial188.stdout:2906: finishing write tid 3 to trial18843701-41 2026-02-13T20:24:30.644 INFO:tasks.rados.rados.0.trial188.stdout:2906: finishing write tid 4 to trial18843701-41 2026-02-13T20:24:30.645 INFO:tasks.rados.rados.0.trial188.stdout:2906: oid 41 updating version 0 to 1336 2026-02-13T20:24:30.645 INFO:tasks.rados.rados.0.trial188.stdout:2906: oid 41 version 1336 is already newer than 1335 2026-02-13T20:24:30.645 INFO:tasks.rados.rados.0.trial188.stdout:2906: oid 41 version 1336 is already newer than 1334 2026-02-13T20:24:30.645 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 41 v 1336 (ObjNum 1009 snap 299 seq_num 1009) dirty exists 2026-02-13T20:24:30.645 INFO:tasks.rados.rados.0.trial188.stdout:2906: left oid 41 (ObjNum 1009 snap 299 seq_num 1009) 2026-02-13T20:24:31.253 INFO:tasks.rados.rados.0.trial188.stdout:2906: done (1 left) 2026-02-13T20:24:31.253 INFO:tasks.rados.rados.0.trial188.stdout:2912: done (0 left) 2026-02-13T20:24:31.253 INFO:tasks.rados.rados.0.trial188.stdout:2913: write (excl) oid 31 current snap is 300 2026-02-13T20:24:31.253 INFO:tasks.rados.rados.0.trial188.stdout:2913: seq_num 1011 ranges {591877=635335,1628354=709677} 2026-02-13T20:24:31.258 INFO:tasks.rados.rados.0.trial188.stdout:2913: writing trial18843701-31 from 591877 to 1227212 tid 1 2026-02-13T20:24:31.262 INFO:tasks.rados.rados.0.trial188.stdout:2913: writing trial18843701-31 from 1628354 to 2338031 tid 2 2026-02-13T20:24:31.262 INFO:tasks.rados.rados.0.trial188.stdout:2914: read oid 25 snap -1 2026-02-13T20:24:31.263 INFO:tasks.rados.rados.0.trial188.stdout:2914: expect (ObjNum 756 snap 223 seq_num 756) 2026-02-13T20:24:31.263 INFO:tasks.rados.rados.0.trial188.stdout:2915: snap_create 2026-02-13T20:24:31.265 INFO:tasks.rados.rados.0.trial188.stdout:2914: expect (ObjNum 756 snap 223 seq_num 756) 2026-02-13T20:24:31.265 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:24:31.355 INFO:tasks.rados.rados.0.trial188.stdout:2913: finishing write tid 1 to trial18843701-31 2026-02-13T20:24:31.355 INFO:tasks.rados.rados.0.trial188.stdout:2913: finishing write tid 2 to trial18843701-31 2026-02-13T20:24:31.355 INFO:tasks.rados.rados.0.trial188.stdout:2913: finishing write tid 3 to trial18843701-31 2026-02-13T20:24:31.355 INFO:tasks.rados.rados.0.trial188.stdout:2913: finishing write tid 4 to trial18843701-31 2026-02-13T20:24:31.355 INFO:tasks.rados.rados.0.trial188.stdout:2913: oid 31 updating version 0 to 973 2026-02-13T20:24:31.355 INFO:tasks.rados.rados.0.trial188.stdout:2913: oid 31 updating version 973 to 975 2026-02-13T20:24:31.355 INFO:tasks.rados.rados.0.trial188.stdout:2913: oid 31 version 975 is already newer than 974 2026-02-13T20:24:31.355 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 31 v 975 (ObjNum 1011 snap 300 seq_num 1011) dirty exists 2026-02-13T20:24:31.355 INFO:tasks.rados.rados.0.trial188.stdout:2913: left oid 31 (ObjNum 1011 snap 300 seq_num 1011) 2026-02-13T20:24:32.240 INFO:tasks.rados.rados.0.trial188.stdout:2913: done (2 left) 2026-02-13T20:24:32.240 INFO:tasks.rados.rados.0.trial188.stdout:2914: done (1 left) 2026-02-13T20:24:32.240 INFO:tasks.rados.rados.0.trial188.stdout:2915: done (0 left) 2026-02-13T20:24:32.240 INFO:tasks.rados.rados.0.trial188.stdout:2916: snap_create 2026-02-13T20:24:33.241 INFO:tasks.rados.rados.0.trial188.stdout:2916: done (0 left) 2026-02-13T20:24:33.241 INFO:tasks.rados.rados.0.trial188.stdout:2917: snap_remove snap 301 2026-02-13T20:24:34.242 INFO:tasks.rados.rados.0.trial188.stdout:2917: done (0 left) 2026-02-13T20:24:34.242 INFO:tasks.rados.rados.0.trial188.stdout:2918: rollback oid 39 current snap is 302 2026-02-13T20:24:34.242 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 39 to 291 2026-02-13T20:24:34.242 INFO:tasks.rados.rados.0.trial188.stdout:2919: write (excl) oid 35 current snap is 302 2026-02-13T20:24:34.242 INFO:tasks.rados.rados.0.trial188.stdout:2919: seq_num 1012 ranges {608684=426937,1803189=569688,2924304=84380} 2026-02-13T20:24:34.246 INFO:tasks.rados.rados.0.trial188.stdout:2919: writing trial18843701-35 from 608684 to 1035621 tid 1 2026-02-13T20:24:34.251 INFO:tasks.rados.rados.0.trial188.stdout:2919: writing trial18843701-35 from 1803189 to 2372877 tid 2 2026-02-13T20:24:34.254 INFO:tasks.rados.rados.0.trial188.stdout:2919: writing trial18843701-35 from 2924304 to 3008684 tid 3 2026-02-13T20:24:34.254 INFO:tasks.rados.rados.0.trial188.stdout:2920: snap_remove snap 293 2026-02-13T20:24:35.244 INFO:tasks.rados.rados.0.trial188.stdout:2920: done (2 left) 2026-02-13T20:24:35.244 INFO:tasks.rados.rados.0.trial188.stdout:2921: snap_create 2026-02-13T20:24:35.244 INFO:tasks.rados.rados.0.trial188.stdout:2918: finishing rollback tid 1 to trial18843701-39 2026-02-13T20:24:35.244 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 39 v 1234 (ObjNum 353 snap 0 seq_num 16425488) dirty dne 2026-02-13T20:24:35.244 INFO:tasks.rados.rados.0.trial188.stdout:2919: finishing write tid 1 to trial18843701-35 2026-02-13T20:24:35.244 INFO:tasks.rados.rados.0.trial188.stdout:2919: finishing write tid 2 to trial18843701-35 2026-02-13T20:24:35.244 INFO:tasks.rados.rados.0.trial188.stdout:2919: finishing write tid 3 to trial18843701-35 2026-02-13T20:24:35.244 INFO:tasks.rados.rados.0.trial188.stdout:2919: finishing write tid 4 to trial18843701-35 2026-02-13T20:24:35.244 INFO:tasks.rados.rados.0.trial188.stdout:2919: finishing write tid 5 to trial18843701-35 2026-02-13T20:24:35.244 INFO:tasks.rados.rados.0.trial188.stdout:2919: oid 35 updating version 0 to 1070 2026-02-13T20:24:35.244 INFO:tasks.rados.rados.0.trial188.stdout:2919: oid 35 updating version 1070 to 1071 2026-02-13T20:24:35.244 INFO:tasks.rados.rados.0.trial188.stdout:2919: oid 35 version 1071 is already newer than 1069 2026-02-13T20:24:35.244 INFO:tasks.rados.rados.0.trial188.stdout:2919: oid 35 updating version 1071 to 1072 2026-02-13T20:24:35.244 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 35 v 1072 (ObjNum 1012 snap 302 seq_num 1012) dirty exists 2026-02-13T20:24:35.244 INFO:tasks.rados.rados.0.trial188.stdout:2919: left oid 35 (ObjNum 1012 snap 302 seq_num 1012) 2026-02-13T20:24:36.247 INFO:tasks.rados.rados.0.trial188.stdout:2918: done (2 left) 2026-02-13T20:24:36.247 INFO:tasks.rados.rados.0.trial188.stdout:2919: done (1 left) 2026-02-13T20:24:36.247 INFO:tasks.rados.rados.0.trial188.stdout:2921: done (0 left) 2026-02-13T20:24:36.247 INFO:tasks.rados.rados.0.trial188.stdout:2922: snap_remove snap 294 2026-02-13T20:24:37.242 INFO:tasks.rados.rados.0.trial188.stdout:2922: done (0 left) 2026-02-13T20:24:37.242 INFO:tasks.rados.rados.0.trial188.stdout:2923: write (excl) oid 45 current snap is 303 2026-02-13T20:24:37.242 INFO:tasks.rados.rados.0.trial188.stdout:2923: seq_num 1013 ranges {625491=502186,1861671=713346} 2026-02-13T20:24:37.246 INFO:tasks.rados.rados.0.trial188.stdout:2923: writing trial18843701-45 from 625491 to 1127677 tid 1 2026-02-13T20:24:37.252 INFO:tasks.rados.rados.0.trial188.stdout:2923: writing trial18843701-45 from 1861671 to 2575017 tid 2 2026-02-13T20:24:37.252 INFO:tasks.rados.rados.0.trial188.stdout:2924: write (excl) oid 12 current snap is 303 2026-02-13T20:24:37.252 INFO:tasks.rados.rados.0.trial188.stdout:2924: seq_num 1014 ranges {642298=577435,1920153=573357,2979150=63148} 2026-02-13T20:24:37.256 INFO:tasks.rados.rados.0.trial188.stdout:2924: writing trial18843701-12 from 642298 to 1219733 tid 1 2026-02-13T20:24:37.261 INFO:tasks.rados.rados.0.trial188.stdout:2924: writing trial18843701-12 from 1920153 to 2493510 tid 2 2026-02-13T20:24:37.263 INFO:tasks.rados.rados.0.trial188.stdout:2924: writing trial18843701-12 from 2979150 to 3042298 tid 3 2026-02-13T20:24:37.263 INFO:tasks.rados.rados.0.trial188.stdout:2925: copy_from oid 29 from oid 46 current snap is 303 2026-02-13T20:24:37.263 INFO:tasks.rados.rados.0.trial188.stdout:2926: delete oid 24 current snap is 303 2026-02-13T20:24:37.265 INFO:tasks.rados.rados.0.trial188.stdout:2923: finishing write tid 1 to trial18843701-45 2026-02-13T20:24:37.267 INFO:tasks.rados.rados.0.trial188.stdout:2923: finishing write tid 2 to trial18843701-45 2026-02-13T20:24:37.267 INFO:tasks.rados.rados.0.trial188.stdout:2923: finishing write tid 3 to trial18843701-45 2026-02-13T20:24:37.267 INFO:tasks.rados.rados.0.trial188.stdout:2923: finishing write tid 4 to trial18843701-45 2026-02-13T20:24:37.267 INFO:tasks.rados.rados.0.trial188.stdout:2923: oid 45 updating version 0 to 1438 2026-02-13T20:24:37.267 INFO:tasks.rados.rados.0.trial188.stdout:2923: oid 45 updating version 1438 to 1443 2026-02-13T20:24:37.267 INFO:tasks.rados.rados.0.trial188.stdout:2923: oid 45 updating version 1443 to 1444 2026-02-13T20:24:37.267 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 45 v 1444 (ObjNum 1013 snap 303 seq_num 1013) dirty exists 2026-02-13T20:24:37.267 INFO:tasks.rados.rados.0.trial188.stdout:2923: left oid 45 (ObjNum 1013 snap 303 seq_num 1013) 2026-02-13T20:24:37.274 INFO:tasks.rados.rados.0.trial188.stdout:2924: finishing write tid 1 to trial18843701-12 2026-02-13T20:24:37.275 INFO:tasks.rados.rados.0.trial188.stdout:2923: done (3 left) 2026-02-13T20:24:37.275 INFO:tasks.rados.rados.0.trial188.stdout:2926: done (2 left) 2026-02-13T20:24:37.275 INFO:tasks.rados.rados.0.trial188.stdout:2927: write (excl) oid 21 current snap is 303 2026-02-13T20:24:37.275 INFO:tasks.rados.rados.0.trial188.stdout:2927: seq_num 1016 ranges {675912=727933,1920764=460673,2801290=274622} 2026-02-13T20:24:37.280 INFO:tasks.rados.rados.0.trial188.stdout:2927: writing trial18843701-21 from 675912 to 1403845 tid 1 2026-02-13T20:24:37.284 INFO:tasks.rados.rados.0.trial188.stdout:2927: writing trial18843701-21 from 1920764 to 2381437 tid 2 2026-02-13T20:24:37.286 INFO:tasks.rados.rados.0.trial188.stdout:2927: writing trial18843701-21 from 2801290 to 3075912 tid 3 2026-02-13T20:24:37.286 INFO:tasks.rados.rados.0.trial188.stdout:2928: snap_create 2026-02-13T20:24:37.286 INFO:tasks.rados.rados.0.trial188.stdout:2924: finishing write tid 2 to trial18843701-12 2026-02-13T20:24:37.286 INFO:tasks.rados.rados.0.trial188.stdout:2924: finishing write tid 3 to trial18843701-12 2026-02-13T20:24:37.286 INFO:tasks.rados.rados.0.trial188.stdout:2924: finishing write tid 4 to trial18843701-12 2026-02-13T20:24:37.286 INFO:tasks.rados.rados.0.trial188.stdout:2924: finishing write tid 5 to trial18843701-12 2026-02-13T20:24:37.286 INFO:tasks.rados.rados.0.trial188.stdout:2924: oid 12 updating version 0 to 1074 2026-02-13T20:24:37.286 INFO:tasks.rados.rados.0.trial188.stdout:2924: oid 12 updating version 1074 to 1075 2026-02-13T20:24:37.287 INFO:tasks.rados.rados.0.trial188.stdout:2924: oid 12 updating version 1075 to 1076 2026-02-13T20:24:37.287 INFO:tasks.rados.rados.0.trial188.stdout:2924: oid 12 updating version 1076 to 1077 2026-02-13T20:24:37.287 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 12 v 1077 (ObjNum 1014 snap 303 seq_num 1014) dirty exists 2026-02-13T20:24:37.287 INFO:tasks.rados.rados.0.trial188.stdout:2924: left oid 12 (ObjNum 1014 snap 303 seq_num 1014) 2026-02-13T20:24:37.295 INFO:tasks.rados.rados.0.trial188.stdout:2925: finishing copy_from racing read to trial18843701-29 2026-02-13T20:24:37.296 INFO:tasks.rados.rados.0.trial188.stdout:2925: finishing copy_from to trial18843701-29 2026-02-13T20:24:37.296 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 29 v 1332 (ObjNum 872 snap 255 seq_num 872) dirty exists 2026-02-13T20:24:37.304 INFO:tasks.rados.rados.0.trial188.stdout:2927: finishing write tid 1 to trial18843701-21 2026-02-13T20:24:37.304 INFO:tasks.rados.rados.0.trial188.stdout:2927: finishing write tid 2 to trial18843701-21 2026-02-13T20:24:37.304 INFO:tasks.rados.rados.0.trial188.stdout:2927: finishing write tid 3 to trial18843701-21 2026-02-13T20:24:37.304 INFO:tasks.rados.rados.0.trial188.stdout:2927: finishing write tid 4 to trial18843701-21 2026-02-13T20:24:37.304 INFO:tasks.rados.rados.0.trial188.stdout:2927: finishing write tid 5 to trial18843701-21 2026-02-13T20:24:37.304 INFO:tasks.rados.rados.0.trial188.stdout:2927: oid 21 updating version 0 to 977 2026-02-13T20:24:37.304 INFO:tasks.rados.rados.0.trial188.stdout:2927: oid 21 version 977 is already newer than 976 2026-02-13T20:24:37.304 INFO:tasks.rados.rados.0.trial188.stdout:2927: oid 21 updating version 977 to 979 2026-02-13T20:24:37.304 INFO:tasks.rados.rados.0.trial188.stdout:2927: oid 21 version 979 is already newer than 978 2026-02-13T20:24:37.304 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 21 v 979 (ObjNum 1016 snap 303 seq_num 1016) dirty exists 2026-02-13T20:24:37.304 INFO:tasks.rados.rados.0.trial188.stdout:2927: left oid 21 (ObjNum 1016 snap 303 seq_num 1016) 2026-02-13T20:24:38.251 INFO:tasks.rados.rados.0.trial188.stdout:2924: done (3 left) 2026-02-13T20:24:38.252 INFO:tasks.rados.rados.0.trial188.stdout:2925: done (2 left) 2026-02-13T20:24:38.252 INFO:tasks.rados.rados.0.trial188.stdout:2927: done (1 left) 2026-02-13T20:24:38.252 INFO:tasks.rados.rados.0.trial188.stdout:2928: done (0 left) 2026-02-13T20:24:38.252 INFO:tasks.rados.rados.0.trial188.stdout:2929: rollback oid 39 current snap is 304 2026-02-13T20:24:38.252 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 39 to 228 2026-02-13T20:24:38.252 INFO:tasks.rados.rados.0.trial188.stdout:2930: snap_remove snap 263 2026-02-13T20:24:39.252 INFO:tasks.rados.rados.0.trial188.stdout:2930: done (1 left) 2026-02-13T20:24:39.252 INFO:tasks.rados.rados.0.trial188.stdout:2931: write oid 11 current snap is 304 2026-02-13T20:24:39.253 INFO:tasks.rados.rados.0.trial188.stdout:2931: seq_num 1017 ranges {692719=403182,1579246=720684,2828713=264006} 2026-02-13T20:24:39.257 INFO:tasks.rados.rados.0.trial188.stdout:2931: writing trial18843701-11 from 692719 to 1095901 tid 1 2026-02-13T20:24:39.261 INFO:tasks.rados.rados.0.trial188.stdout:2931: writing trial18843701-11 from 1579246 to 2299930 tid 2 2026-02-13T20:24:39.265 INFO:tasks.rados.rados.0.trial188.stdout:2931: writing trial18843701-11 from 2828713 to 3092719 tid 3 2026-02-13T20:24:39.265 INFO:tasks.rados.rados.0.trial188.stdout:2932: snap_create 2026-02-13T20:24:39.265 INFO:tasks.rados.rados.0.trial188.stdout:2929: finishing rollback tid 1 to trial18843701-39 2026-02-13T20:24:39.265 INFO:tasks.rados.rados.0.trial188.stdout:2929: finishing rollback tid 2 to trial18843701-39 2026-02-13T20:24:39.265 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 39 v 1334 (ObjNum 679 snap 194 seq_num 679) dirty exists 2026-02-13T20:24:39.277 INFO:tasks.rados.rados.0.trial188.stdout:2931: finishing write tid 1 to trial18843701-11 2026-02-13T20:24:39.278 INFO:tasks.rados.rados.0.trial188.stdout:2931: finishing write tid 2 to trial18843701-11 2026-02-13T20:24:39.278 INFO:tasks.rados.rados.0.trial188.stdout:2931: finishing write tid 3 to trial18843701-11 2026-02-13T20:24:39.278 INFO:tasks.rados.rados.0.trial188.stdout:2931: finishing write tid 4 to trial18843701-11 2026-02-13T20:24:39.278 INFO:tasks.rados.rados.0.trial188.stdout:2931: finishing write tid 5 to trial18843701-11 2026-02-13T20:24:39.278 INFO:tasks.rados.rados.0.trial188.stdout:2931: oid 11 updating version 0 to 1066 2026-02-13T20:24:39.278 INFO:tasks.rados.rados.0.trial188.stdout:2931: oid 11 version 1066 is already newer than 1064 2026-02-13T20:24:39.279 INFO:tasks.rados.rados.0.trial188.stdout:2931: oid 11 version 1066 is already newer than 1065 2026-02-13T20:24:39.279 INFO:tasks.rados.rados.0.trial188.stdout:2931: oid 11 version 1066 is already newer than 1063 2026-02-13T20:24:39.279 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 11 v 1066 (ObjNum 1017 snap 304 seq_num 1017) dirty exists 2026-02-13T20:24:39.279 INFO:tasks.rados.rados.0.trial188.stdout:2931: left oid 11 (ObjNum 1017 snap 304 seq_num 1017) 2026-02-13T20:24:40.257 INFO:tasks.rados.rados.0.trial188.stdout:2929: done (2 left) 2026-02-13T20:24:40.257 INFO:tasks.rados.rados.0.trial188.stdout:2931: done (1 left) 2026-02-13T20:24:40.257 INFO:tasks.rados.rados.0.trial188.stdout:2932: done (0 left) 2026-02-13T20:24:40.257 INFO:tasks.rados.rados.0.trial188.stdout:2933: snap_remove snap 228 2026-02-13T20:24:41.259 INFO:tasks.rados.rados.0.trial188.stdout:2933: done (0 left) 2026-02-13T20:24:41.259 INFO:tasks.rados.rados.0.trial188.stdout:2934: snap_create 2026-02-13T20:24:42.243 INFO:tasks.rados.rados.0.trial188.stdout:2934: done (0 left) 2026-02-13T20:24:42.243 INFO:tasks.rados.rados.0.trial188.stdout:2935: read oid 14 snap 298 2026-02-13T20:24:42.243 INFO:tasks.rados.rados.0.trial188.stdout:2935: expect (ObjNum 751 snap 222 seq_num 751) 2026-02-13T20:24:42.243 INFO:tasks.rados.rados.0.trial188.stdout:2936: snap_create 2026-02-13T20:24:42.254 INFO:tasks.rados.rados.0.trial188.stdout:2935: expect (ObjNum 751 snap 222 seq_num 751) 2026-02-13T20:24:42.256 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1648763 2026-02-13T20:24:43.245 INFO:tasks.rados.rados.0.trial188.stdout:2935: done (1 left) 2026-02-13T20:24:43.245 INFO:tasks.rados.rados.0.trial188.stdout:2936: done (0 left) 2026-02-13T20:24:43.245 INFO:tasks.rados.rados.0.trial188.stdout:2937: write oid 10 current snap is 307 2026-02-13T20:24:43.245 INFO:tasks.rados.rados.0.trial188.stdout:2937: seq_num 1018 ranges {709526=478431,1637728=464342,2856136=253390} 2026-02-13T20:24:43.250 INFO:tasks.rados.rados.0.trial188.stdout:2937: writing trial18843701-10 from 709526 to 1187957 tid 1 2026-02-13T20:24:43.253 INFO:tasks.rados.rados.0.trial188.stdout:2937: writing trial18843701-10 from 1637728 to 2102070 tid 2 2026-02-13T20:24:43.257 INFO:tasks.rados.rados.0.trial188.stdout:2937: writing trial18843701-10 from 2856136 to 3109526 tid 3 2026-02-13T20:24:43.257 INFO:tasks.rados.rados.0.trial188.stdout:2938: write (excl) oid 16 current snap is 307 2026-02-13T20:24:43.257 INFO:tasks.rados.rados.0.trial188.stdout:2938: seq_num 1019 ranges {726333=670033,2096210=724353} 2026-02-13T20:24:43.262 INFO:tasks.rados.rados.0.trial188.stdout:2938: writing trial18843701-16 from 726333 to 1396366 tid 1 2026-02-13T20:24:43.268 INFO:tasks.rados.rados.0.trial188.stdout:2938: writing trial18843701-16 from 2096210 to 2820563 tid 2 2026-02-13T20:24:43.268 INFO:tasks.rados.rados.0.trial188.stdout:2939: snap_remove snap 302 2026-02-13T20:24:44.265 INFO:tasks.rados.rados.0.trial188.stdout:2939: done (2 left) 2026-02-13T20:24:44.266 INFO:tasks.rados.rados.0.trial188.stdout:2940: rollback oid 25 current snap is 307 2026-02-13T20:24:44.266 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 25 to 299 2026-02-13T20:24:44.266 INFO:tasks.rados.rados.0.trial188.stdout:2937: finishing write tid 1 to trial18843701-10 2026-02-13T20:24:44.266 INFO:tasks.rados.rados.0.trial188.stdout:2937: finishing write tid 2 to trial18843701-10 2026-02-13T20:24:44.266 INFO:tasks.rados.rados.0.trial188.stdout:2937: finishing write tid 3 to trial18843701-10 2026-02-13T20:24:44.266 INFO:tasks.rados.rados.0.trial188.stdout:2937: finishing write tid 4 to trial18843701-10 2026-02-13T20:24:44.266 INFO:tasks.rados.rados.0.trial188.stdout:2937: finishing write tid 5 to trial18843701-10 2026-02-13T20:24:44.266 INFO:tasks.rados.rados.0.trial188.stdout:2937: oid 10 updating version 0 to 1069 2026-02-13T20:24:44.266 INFO:tasks.rados.rados.0.trial188.stdout:2937: oid 10 version 1069 is already newer than 1067 2026-02-13T20:24:44.266 INFO:tasks.rados.rados.0.trial188.stdout:2937: oid 10 updating version 1069 to 1070 2026-02-13T20:24:44.267 INFO:tasks.rados.rados.0.trial188.stdout:2937: oid 10 version 1070 is already newer than 1068 2026-02-13T20:24:44.267 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 10 v 1070 (ObjNum 1018 snap 307 seq_num 1018) dirty exists 2026-02-13T20:24:44.267 INFO:tasks.rados.rados.0.trial188.stdout:2937: left oid 10 (ObjNum 1018 snap 307 seq_num 1018) 2026-02-13T20:24:44.267 INFO:tasks.rados.rados.0.trial188.stdout:2938: finishing write tid 1 to trial18843701-16 2026-02-13T20:24:44.267 INFO:tasks.rados.rados.0.trial188.stdout:2938: finishing write tid 2 to trial18843701-16 2026-02-13T20:24:44.267 INFO:tasks.rados.rados.0.trial188.stdout:2938: finishing write tid 3 to trial18843701-16 2026-02-13T20:24:44.267 INFO:tasks.rados.rados.0.trial188.stdout:2938: finishing write tid 4 to trial18843701-16 2026-02-13T20:24:44.267 INFO:tasks.rados.rados.0.trial188.stdout:2938: oid 16 updating version 0 to 1460 2026-02-13T20:24:44.267 INFO:tasks.rados.rados.0.trial188.stdout:2938: oid 16 version 1460 is already newer than 1458 2026-02-13T20:24:44.267 INFO:tasks.rados.rados.0.trial188.stdout:2938: oid 16 version 1460 is already newer than 1459 2026-02-13T20:24:44.267 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 16 v 1460 (ObjNum 1019 snap 307 seq_num 1019) dirty exists 2026-02-13T20:24:44.267 INFO:tasks.rados.rados.0.trial188.stdout:2938: left oid 16 (ObjNum 1019 snap 307 seq_num 1019) 2026-02-13T20:24:44.268 INFO:tasks.rados.rados.0.trial188.stdout:2937: done (2 left) 2026-02-13T20:24:44.268 INFO:tasks.rados.rados.0.trial188.stdout:2938: done (1 left) 2026-02-13T20:24:44.268 INFO:tasks.rados.rados.0.trial188.stdout:2941: read oid 40 snap -1 2026-02-13T20:24:44.268 INFO:tasks.rados.rados.0.trial188.stdout:2941: expect deleted 2026-02-13T20:24:44.268 INFO:tasks.rados.rados.0.trial188.stdout:2942: rollback oid 14 current snap is 307 2026-02-13T20:24:44.268 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 14 to 304 2026-02-13T20:24:44.268 INFO:tasks.rados.rados.0.trial188.stdout:2943: write (excl) oid 12 current snap is 307 2026-02-13T20:24:44.268 INFO:tasks.rados.rados.0.trial188.stdout:2943: seq_num 1020 ranges {743140=745282,2154692=468011} 2026-02-13T20:24:44.270 INFO:tasks.rados.rados.0.trial188.stdout:2943: writing trial18843701-12 from 743140 to 1488422 tid 1 2026-02-13T20:24:44.275 INFO:tasks.rados.rados.0.trial188.stdout:2943: writing trial18843701-12 from 2154692 to 2622703 tid 2 2026-02-13T20:24:44.275 INFO:tasks.rados.rados.0.trial188.stdout:2944: read oid 5 snap -1 2026-02-13T20:24:44.275 INFO:tasks.rados.rados.0.trial188.stdout:2944: expect (ObjNum 940 snap 280 seq_num 940) 2026-02-13T20:24:44.275 INFO:tasks.rados.rados.0.trial188.stdout:2945: write oid 50 current snap is 307 2026-02-13T20:24:44.275 INFO:tasks.rados.rados.0.trial188.stdout:2945: seq_num 1021 ranges {759947=420531,1813174=728022} 2026-02-13T20:24:44.279 INFO:tasks.rados.rados.0.trial188.stdout:2945: writing trial18843701-50 from 759947 to 1180478 tid 1 2026-02-13T20:24:44.285 INFO:tasks.rados.rados.0.trial188.stdout:2945: writing trial18843701-50 from 1813174 to 2541196 tid 2 2026-02-13T20:24:44.285 INFO:tasks.rados.rados.0.trial188.stdout:2946: rollback oid 27 current snap is 307 2026-02-13T20:24:44.285 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 27 to 295 2026-02-13T20:24:44.285 INFO:tasks.rados.rados.0.trial188.stdout:2940: finishing rollback tid 0 to trial18843701-25 2026-02-13T20:24:44.285 INFO:tasks.rados.rados.0.trial188.stdout:2940: finishing rollback tid 1 to trial18843701-25 2026-02-13T20:24:44.285 INFO:tasks.rados.rados.0.trial188.stdout:2940: finishing rollback tid 2 to trial18843701-25 2026-02-13T20:24:44.286 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 25 v 1414 (ObjNum 756 snap 223 seq_num 756) dirty exists 2026-02-13T20:24:44.286 INFO:tasks.rados.rados.0.trial188.stdout:2942: finishing rollback tid 0 to trial18843701-14 2026-02-13T20:24:44.286 INFO:tasks.rados.rados.0.trial188.stdout:2942: finishing rollback tid 1 to trial18843701-14 2026-02-13T20:24:44.286 INFO:tasks.rados.rados.0.trial188.stdout:2940: done (6 left) 2026-02-13T20:24:44.286 INFO:tasks.rados.rados.0.trial188.stdout:2941: done (5 left) 2026-02-13T20:24:44.286 INFO:tasks.rados.rados.0.trial188.stdout:2947: read oid 49 snap -1 2026-02-13T20:24:44.286 INFO:tasks.rados.rados.0.trial188.stdout:2947: expect deleted 2026-02-13T20:24:44.286 INFO:tasks.rados.rados.0.trial188.stdout:2948: snap_remove snap 305 2026-02-13T20:24:45.268 INFO:tasks.rados.rados.0.trial188.stdout:2948: done (6 left) 2026-02-13T20:24:45.268 INFO:tasks.rados.rados.0.trial188.stdout:2949: write (excl) oid 30 current snap is 307 2026-02-13T20:24:45.268 INFO:tasks.rados.rados.0.trial188.stdout:2949: seq_num 1022 ranges {776754=495780,1871656=471680,2965828=210926} 2026-02-13T20:24:45.274 INFO:tasks.rados.rados.0.trial188.stdout:2949: writing trial18843701-30 from 776754 to 1272534 tid 1 2026-02-13T20:24:45.278 INFO:tasks.rados.rados.0.trial188.stdout:2949: writing trial18843701-30 from 1871656 to 2343336 tid 2 2026-02-13T20:24:45.281 INFO:tasks.rados.rados.0.trial188.stdout:2949: writing trial18843701-30 from 2965828 to 3176754 tid 3 2026-02-13T20:24:45.281 INFO:tasks.rados.rados.0.trial188.stdout:2950: write (excl) oid 28 current snap is 307 2026-02-13T20:24:45.281 INFO:tasks.rados.rados.0.trial188.stdout:2942: finishing rollback tid 2 to trial18843701-14 2026-02-13T20:24:45.281 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 14 v 1016 (ObjNum 751 snap 222 seq_num 751) dirty exists 2026-02-13T20:24:45.282 INFO:tasks.rados.rados.0.trial188.stdout:2950: seq_num 1023 ranges {793561=571029,1813785=731691,2993251=200310} 2026-02-13T20:24:45.286 INFO:tasks.rados.rados.0.trial188.stdout:2950: writing trial18843701-28 from 793561 to 1364590 tid 1 2026-02-13T20:24:45.291 INFO:tasks.rados.rados.0.trial188.stdout:2950: writing trial18843701-28 from 1813785 to 2545476 tid 2 2026-02-13T20:24:45.293 INFO:tasks.rados.rados.0.trial188.stdout:2950: writing trial18843701-28 from 2993251 to 3193561 tid 3 2026-02-13T20:24:45.294 INFO:tasks.rados.rados.0.trial188.stdout:2942: done (7 left) 2026-02-13T20:24:45.294 INFO:tasks.rados.rados.0.trial188.stdout:2951: write oid 13 current snap is 307 2026-02-13T20:24:45.294 INFO:tasks.rados.rados.0.trial188.stdout:2951: seq_num 1024 ranges {410368=646278,1472267=475349,2504321=405600} 2026-02-13T20:24:45.298 INFO:tasks.rados.rados.0.trial188.stdout:2951: writing trial18843701-13 from 410368 to 1056646 tid 1 2026-02-13T20:24:45.301 INFO:tasks.rados.rados.0.trial188.stdout:2951: writing trial18843701-13 from 1472267 to 1947616 tid 2 2026-02-13T20:24:45.306 INFO:tasks.rados.rados.0.trial188.stdout:2951: writing trial18843701-13 from 2504321 to 2909921 tid 3 2026-02-13T20:24:45.306 INFO:tasks.rados.rados.0.trial188.stdout:2952: copy_from oid 9 from oid 17 current snap is 307 2026-02-13T20:24:45.306 INFO:tasks.rados.rados.0.trial188.stdout:2946: finishing rollback tid 1 to trial18843701-27 2026-02-13T20:24:45.306 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 27 v 0 (ObjNum 49 snap 0 seq_num 1634300532) dirty dne 2026-02-13T20:24:45.306 INFO:tasks.rados.rados.0.trial188.stdout:2944: expect (ObjNum 940 snap 280 seq_num 940) 2026-02-13T20:24:45.306 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:24:45.361 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1156275 2026-02-13T20:24:45.400 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:24:45.449 INFO:tasks.rados.rados.0.trial188.stdout:2943: finishing write tid 1 to trial18843701-12 2026-02-13T20:24:45.449 INFO:tasks.rados.rados.0.trial188.stdout:2944: done (8 left) 2026-02-13T20:24:45.449 INFO:tasks.rados.rados.0.trial188.stdout:2946: done (7 left) 2026-02-13T20:24:45.450 INFO:tasks.rados.rados.0.trial188.stdout:2947: done (6 left) 2026-02-13T20:24:45.450 INFO:tasks.rados.rados.0.trial188.stdout:2953: read oid 25 snap -1 2026-02-13T20:24:45.450 INFO:tasks.rados.rados.0.trial188.stdout:2953: expect (ObjNum 756 snap 223 seq_num 756) 2026-02-13T20:24:45.450 INFO:tasks.rados.rados.0.trial188.stdout:2954: write oid 18 current snap is 307 2026-02-13T20:24:45.450 INFO:tasks.rados.rados.0.trial188.stdout:2954: seq_num 1025 ranges {427175=721527,1930749=735360} 2026-02-13T20:24:45.453 INFO:tasks.rados.rados.0.trial188.stdout:2954: writing trial18843701-18 from 427175 to 1148702 tid 1 2026-02-13T20:24:45.460 INFO:tasks.rados.rados.0.trial188.stdout:2954: writing trial18843701-18 from 1930749 to 2666109 tid 2 2026-02-13T20:24:45.460 INFO:tasks.rados.rados.0.trial188.stdout:2955: snap_create 2026-02-13T20:24:45.460 INFO:tasks.rados.rados.0.trial188.stdout:2943: finishing write tid 2 to trial18843701-12 2026-02-13T20:24:45.460 INFO:tasks.rados.rados.0.trial188.stdout:2943: finishing write tid 3 to trial18843701-12 2026-02-13T20:24:45.460 INFO:tasks.rados.rados.0.trial188.stdout:2945: finishing write tid 1 to trial18843701-50 2026-02-13T20:24:45.460 INFO:tasks.rados.rados.0.trial188.stdout:2943: finishing write tid 4 to trial18843701-12 2026-02-13T20:24:45.460 INFO:tasks.rados.rados.0.trial188.stdout:2943: oid 12 updating version 0 to 1078 2026-02-13T20:24:45.460 INFO:tasks.rados.rados.0.trial188.stdout:2943: oid 12 updating version 1078 to 1080 2026-02-13T20:24:45.460 INFO:tasks.rados.rados.0.trial188.stdout:2943: oid 12 version 1080 is already newer than 1079 2026-02-13T20:24:45.461 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 12 v 1080 (ObjNum 1020 snap 307 seq_num 1020) dirty exists 2026-02-13T20:24:45.461 INFO:tasks.rados.rados.0.trial188.stdout:2943: left oid 12 (ObjNum 1020 snap 307 seq_num 1020) 2026-02-13T20:24:45.461 INFO:tasks.rados.rados.0.trial188.stdout:2945: finishing write tid 2 to trial18843701-50 2026-02-13T20:24:45.461 INFO:tasks.rados.rados.0.trial188.stdout:2945: finishing write tid 3 to trial18843701-50 2026-02-13T20:24:45.461 INFO:tasks.rados.rados.0.trial188.stdout:2945: finishing write tid 4 to trial18843701-50 2026-02-13T20:24:45.461 INFO:tasks.rados.rados.0.trial188.stdout:2945: oid 50 updating version 0 to 1465 2026-02-13T20:24:45.461 INFO:tasks.rados.rados.0.trial188.stdout:2945: oid 50 version 1465 is already newer than 1464 2026-02-13T20:24:45.461 INFO:tasks.rados.rados.0.trial188.stdout:2945: oid 50 updating version 1465 to 1466 2026-02-13T20:24:45.461 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 50 v 1466 (ObjNum 1021 snap 307 seq_num 1021) dirty exists 2026-02-13T20:24:45.461 INFO:tasks.rados.rados.0.trial188.stdout:2945: left oid 50 (ObjNum 1021 snap 307 seq_num 1021) 2026-02-13T20:24:45.461 INFO:tasks.rados.rados.0.trial188.stdout:2949: finishing write tid 1 to trial18843701-30 2026-02-13T20:24:45.461 INFO:tasks.rados.rados.0.trial188.stdout:2949: finishing write tid 2 to trial18843701-30 2026-02-13T20:24:45.462 INFO:tasks.rados.rados.0.trial188.stdout:2949: finishing write tid 3 to trial18843701-30 2026-02-13T20:24:45.462 INFO:tasks.rados.rados.0.trial188.stdout:2950: finishing write tid 1 to trial18843701-28 2026-02-13T20:24:45.462 INFO:tasks.rados.rados.0.trial188.stdout:2950: finishing write tid 2 to trial18843701-28 2026-02-13T20:24:45.462 INFO:tasks.rados.rados.0.trial188.stdout:2949: finishing write tid 4 to trial18843701-30 2026-02-13T20:24:45.462 INFO:tasks.rados.rados.0.trial188.stdout:2949: finishing write tid 5 to trial18843701-30 2026-02-13T20:24:45.462 INFO:tasks.rados.rados.0.trial188.stdout:2949: oid 30 updating version 0 to 1420 2026-02-13T20:24:45.462 INFO:tasks.rados.rados.0.trial188.stdout:2949: oid 30 updating version 1420 to 1421 2026-02-13T20:24:45.462 INFO:tasks.rados.rados.0.trial188.stdout:2949: oid 30 version 1421 is already newer than 1416 2026-02-13T20:24:45.462 INFO:tasks.rados.rados.0.trial188.stdout:2949: oid 30 version 1421 is already newer than 1419 2026-02-13T20:24:45.462 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 30 v 1421 (ObjNum 1022 snap 307 seq_num 1022) dirty exists 2026-02-13T20:24:45.462 INFO:tasks.rados.rados.0.trial188.stdout:2949: left oid 30 (ObjNum 1022 snap 307 seq_num 1022) 2026-02-13T20:24:45.462 INFO:tasks.rados.rados.0.trial188.stdout:2951: finishing write tid 1 to trial18843701-13 2026-02-13T20:24:45.463 INFO:tasks.rados.rados.0.trial188.stdout:2950: finishing write tid 3 to trial18843701-28 2026-02-13T20:24:45.463 INFO:tasks.rados.rados.0.trial188.stdout:2951: finishing write tid 2 to trial18843701-13 2026-02-13T20:24:45.463 INFO:tasks.rados.rados.0.trial188.stdout:2950: finishing write tid 4 to trial18843701-28 2026-02-13T20:24:45.463 INFO:tasks.rados.rados.0.trial188.stdout:2951: finishing write tid 3 to trial18843701-13 2026-02-13T20:24:45.463 INFO:tasks.rados.rados.0.trial188.stdout:2951: finishing write tid 4 to trial18843701-13 2026-02-13T20:24:45.463 INFO:tasks.rados.rados.0.trial188.stdout:2950: finishing write tid 5 to trial18843701-28 2026-02-13T20:24:45.463 INFO:tasks.rados.rados.0.trial188.stdout:2950: oid 28 updating version 0 to 1471 2026-02-13T20:24:45.463 INFO:tasks.rados.rados.0.trial188.stdout:2950: oid 28 version 1471 is already newer than 1470 2026-02-13T20:24:45.463 INFO:tasks.rados.rados.0.trial188.stdout:2950: oid 28 version 1471 is already newer than 1469 2026-02-13T20:24:45.463 INFO:tasks.rados.rados.0.trial188.stdout:2950: oid 28 version 1471 is already newer than 1468 2026-02-13T20:24:45.463 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 28 v 1471 (ObjNum 1023 snap 307 seq_num 1023) dirty exists 2026-02-13T20:24:45.464 INFO:tasks.rados.rados.0.trial188.stdout:2950: left oid 28 (ObjNum 1023 snap 307 seq_num 1023) 2026-02-13T20:24:45.464 INFO:tasks.rados.rados.0.trial188.stdout:2951: finishing write tid 5 to trial18843701-13 2026-02-13T20:24:45.464 INFO:tasks.rados.rados.0.trial188.stdout:2951: oid 13 updating version 0 to 1319 2026-02-13T20:24:45.464 INFO:tasks.rados.rados.0.trial188.stdout:2951: oid 13 updating version 1319 to 1321 2026-02-13T20:24:45.464 INFO:tasks.rados.rados.0.trial188.stdout:2951: oid 13 version 1321 is already newer than 1318 2026-02-13T20:24:45.464 INFO:tasks.rados.rados.0.trial188.stdout:2951: oid 13 version 1321 is already newer than 1320 2026-02-13T20:24:45.464 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 13 v 1321 (ObjNum 1024 snap 307 seq_num 1024) dirty exists 2026-02-13T20:24:45.464 INFO:tasks.rados.rados.0.trial188.stdout:2951: left oid 13 (ObjNum 1024 snap 307 seq_num 1024) 2026-02-13T20:24:45.464 INFO:tasks.rados.rados.0.trial188.stdout:2952: finishing copy_from racing read to trial18843701-9 2026-02-13T20:24:45.464 INFO:tasks.rados.rados.0.trial188.stdout:2952: finishing copy_from to trial18843701-9 2026-02-13T20:24:45.464 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 9 v 1073 (ObjNum 974 snap 289 seq_num 974) dirty exists 2026-02-13T20:24:45.465 INFO:tasks.rados.rados.0.trial188.stdout:2953: expect (ObjNum 756 snap 223 seq_num 756) 2026-02-13T20:24:45.558 INFO:tasks.rados.rados.0.trial188.stdout:2954: finishing write tid 1 to trial18843701-18 2026-02-13T20:24:45.558 INFO:tasks.rados.rados.0.trial188.stdout:2954: finishing write tid 2 to trial18843701-18 2026-02-13T20:24:45.559 INFO:tasks.rados.rados.0.trial188.stdout:2954: finishing write tid 3 to trial18843701-18 2026-02-13T20:24:45.559 INFO:tasks.rados.rados.0.trial188.stdout:2954: finishing write tid 4 to trial18843701-18 2026-02-13T20:24:45.559 INFO:tasks.rados.rados.0.trial188.stdout:2954: oid 18 updating version 0 to 1083 2026-02-13T20:24:45.559 INFO:tasks.rados.rados.0.trial188.stdout:2954: oid 18 version 1083 is already newer than 1081 2026-02-13T20:24:45.559 INFO:tasks.rados.rados.0.trial188.stdout:2954: oid 18 version 1083 is already newer than 1082 2026-02-13T20:24:45.559 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 18 v 1083 (ObjNum 1025 snap 307 seq_num 1025) dirty exists 2026-02-13T20:24:45.559 INFO:tasks.rados.rados.0.trial188.stdout:2954: left oid 18 (ObjNum 1025 snap 307 seq_num 1025) 2026-02-13T20:24:46.272 INFO:tasks.rados.rados.0.trial188.stdout:2943: done (8 left) 2026-02-13T20:24:46.272 INFO:tasks.rados.rados.0.trial188.stdout:2945: done (7 left) 2026-02-13T20:24:46.272 INFO:tasks.rados.rados.0.trial188.stdout:2949: done (6 left) 2026-02-13T20:24:46.273 INFO:tasks.rados.rados.0.trial188.stdout:2950: done (5 left) 2026-02-13T20:24:46.273 INFO:tasks.rados.rados.0.trial188.stdout:2951: done (4 left) 2026-02-13T20:24:46.273 INFO:tasks.rados.rados.0.trial188.stdout:2952: done (3 left) 2026-02-13T20:24:46.273 INFO:tasks.rados.rados.0.trial188.stdout:2953: done (2 left) 2026-02-13T20:24:46.273 INFO:tasks.rados.rados.0.trial188.stdout:2954: done (1 left) 2026-02-13T20:24:46.273 INFO:tasks.rados.rados.0.trial188.stdout:2955: done (0 left) 2026-02-13T20:24:46.273 INFO:tasks.rados.rados.0.trial188.stdout:2956: write (excl) oid 17 current snap is 308 2026-02-13T20:24:46.273 INFO:tasks.rados.rados.0.trial188.stdout:2956: seq_num 1026 ranges {443982=796776,1989231=479018,2959167=284815} 2026-02-13T20:24:46.278 INFO:tasks.rados.rados.0.trial188.stdout:2956: writing trial18843701-17 from 443982 to 1240758 tid 1 2026-02-13T20:24:46.282 INFO:tasks.rados.rados.0.trial188.stdout:2956: writing trial18843701-17 from 1989231 to 2468249 tid 2 2026-02-13T20:24:46.286 INFO:tasks.rados.rados.0.trial188.stdout:2956: writing trial18843701-17 from 2959167 to 3243982 tid 3 2026-02-13T20:24:46.286 INFO:tasks.rados.rados.0.trial188.stdout:2957: snap_remove snap 298 2026-02-13T20:24:47.243 INFO:tasks.rados.rados.0.trial188.stdout:2957: done (1 left) 2026-02-13T20:24:47.244 INFO:tasks.rados.rados.0.trial188.stdout:2958: snap_remove snap 300 2026-02-13T20:24:48.244 INFO:tasks.rados.rados.0.trial188.stdout:2958: done (1 left) 2026-02-13T20:24:48.244 INFO:tasks.rados.rados.0.trial188.stdout:2959: write (excl) oid 35 current snap is 308 2026-02-13T20:24:48.244 INFO:tasks.rados.rados.0.trial188.stdout:2959: seq_num 1027 ranges {460789=588378,1764066=739029,3219296=41493} 2026-02-13T20:24:48.248 INFO:tasks.rados.rados.0.trial188.stdout:2959: writing trial18843701-35 from 460789 to 1049167 tid 1 2026-02-13T20:24:48.254 INFO:tasks.rados.rados.0.trial188.stdout:2959: writing trial18843701-35 from 1764066 to 2503095 tid 2 2026-02-13T20:24:48.257 INFO:tasks.rados.rados.0.trial188.stdout:2959: writing trial18843701-35 from 3219296 to 3260789 tid 3 2026-02-13T20:24:48.257 INFO:tasks.rados.rados.0.trial188.stdout:2960: copy_from oid 32 from oid 38 current snap is 308 2026-02-13T20:24:48.258 INFO:tasks.rados.rados.0.trial188.stdout:2956: finishing write tid 1 to trial18843701-17 2026-02-13T20:24:48.258 INFO:tasks.rados.rados.0.trial188.stdout:2956: finishing write tid 2 to trial18843701-17 2026-02-13T20:24:48.258 INFO:tasks.rados.rados.0.trial188.stdout:2956: finishing write tid 3 to trial18843701-17 2026-02-13T20:24:48.258 INFO:tasks.rados.rados.0.trial188.stdout:2956: finishing write tid 4 to trial18843701-17 2026-02-13T20:24:48.258 INFO:tasks.rados.rados.0.trial188.stdout:2956: finishing write tid 5 to trial18843701-17 2026-02-13T20:24:48.258 INFO:tasks.rados.rados.0.trial188.stdout:2956: oid 17 updating version 0 to 1085 2026-02-13T20:24:48.258 INFO:tasks.rados.rados.0.trial188.stdout:2956: oid 17 updating version 1085 to 1086 2026-02-13T20:24:48.258 INFO:tasks.rados.rados.0.trial188.stdout:2956: oid 17 updating version 1086 to 1087 2026-02-13T20:24:48.258 INFO:tasks.rados.rados.0.trial188.stdout:2956: oid 17 version 1087 is already newer than 1084 2026-02-13T20:24:48.258 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 17 v 1087 (ObjNum 1026 snap 308 seq_num 1026) dirty exists 2026-02-13T20:24:48.258 INFO:tasks.rados.rados.0.trial188.stdout:2956: left oid 17 (ObjNum 1026 snap 308 seq_num 1026) 2026-02-13T20:24:48.259 INFO:tasks.rados.rados.0.trial188.stdout:2956: done (2 left) 2026-02-13T20:24:48.259 INFO:tasks.rados.rados.0.trial188.stdout:2961: snap_remove snap 295 2026-02-13T20:24:48.271 INFO:tasks.ceph.osd.5.trial188.stderr:2026-02-13T20:24:48.269+0000 7f138c2b8640 -1 snap_mapper [pg_id:5, match:5, mask_bits:4, last_key_checked:, pool:3, shard:-1, shard_prefix: , prefixes: {"0000000000000003.5"}] get_next_objects_to_trim New Clone-Objects were added to Snap 130 after trimming was started 2026-02-13T20:24:49.245 INFO:tasks.rados.rados.0.trial188.stdout:2961: done (2 left) 2026-02-13T20:24:49.245 INFO:tasks.rados.rados.0.trial188.stdout:2962: read oid 4 snap -1 2026-02-13T20:24:49.245 INFO:tasks.rados.rados.0.trial188.stdout:2962: expect (ObjNum 868 snap 252 seq_num 868) 2026-02-13T20:24:49.245 INFO:tasks.rados.rados.0.trial188.stdout:2963: snap_remove snap 307 2026-02-13T20:24:50.248 INFO:tasks.rados.rados.0.trial188.stdout:2963: done (3 left) 2026-02-13T20:24:50.248 INFO:tasks.rados.rados.0.trial188.stdout:2964: write (excl) oid 21 current snap is 308 2026-02-13T20:24:50.248 INFO:tasks.rados.rados.0.trial188.stdout:2959: finishing write tid 1 to trial18843701-35 2026-02-13T20:24:50.248 INFO:tasks.rados.rados.0.trial188.stdout:2964: seq_num 1028 ranges {477596=663627,1706195=482687,2614013=567041} 2026-02-13T20:24:50.254 INFO:tasks.rados.rados.0.trial188.stdout:2964: writing trial18843701-21 from 477596 to 1141223 tid 1 2026-02-13T20:24:50.257 INFO:tasks.rados.rados.0.trial188.stdout:2964: writing trial18843701-21 from 1706195 to 2188882 tid 2 2026-02-13T20:24:50.261 INFO:tasks.rados.rados.0.trial188.stdout:2964: writing trial18843701-21 from 2614013 to 3181054 tid 3 2026-02-13T20:24:50.261 INFO:tasks.rados.rados.0.trial188.stdout:2965: copy_from oid 10 from oid 12 current snap is 308 2026-02-13T20:24:50.261 INFO:tasks.rados.rados.0.trial188.stdout:2960: finishing copy_from to trial18843701-32 2026-02-13T20:24:50.261 INFO:tasks.rados.rados.0.trial188.stdout:2960: got expected ENOENT (src dne) 2026-02-13T20:24:50.261 INFO:tasks.rados.rados.0.trial188.stdout:2960: finishing copy_from racing read to trial18843701-32 2026-02-13T20:24:50.262 INFO:tasks.rados.rados.0.trial188.stdout:2960: done (4 left) 2026-02-13T20:24:50.262 INFO:tasks.rados.rados.0.trial188.stdout:2966: write oid 23 current snap is 308 2026-02-13T20:24:50.262 INFO:tasks.rados.rados.0.trial188.stdout:2966: seq_num 1029 ranges {494403=738876,1764677=626345,3041436=252967} 2026-02-13T20:24:50.266 INFO:tasks.rados.rados.0.trial188.stdout:2966: writing trial18843701-23 from 494403 to 1233279 tid 1 2026-02-13T20:24:50.270 INFO:tasks.rados.rados.0.trial188.stdout:2966: writing trial18843701-23 from 1764677 to 2391022 tid 2 2026-02-13T20:24:50.274 INFO:tasks.rados.rados.0.trial188.stdout:2966: writing trial18843701-23 from 3041436 to 3294403 tid 3 2026-02-13T20:24:50.274 INFO:tasks.rados.rados.0.trial188.stdout:2967: write (excl) oid 46 current snap is 308 2026-02-13T20:24:50.274 INFO:tasks.rados.rados.0.trial188.stdout:2959: finishing write tid 2 to trial18843701-35 2026-02-13T20:24:50.274 INFO:tasks.rados.rados.0.trial188.stdout:2959: finishing write tid 3 to trial18843701-35 2026-02-13T20:24:50.274 INFO:tasks.rados.rados.0.trial188.stdout:2959: finishing write tid 4 to trial18843701-35 2026-02-13T20:24:50.274 INFO:tasks.rados.rados.0.trial188.stdout:2959: finishing write tid 5 to trial18843701-35 2026-02-13T20:24:50.274 INFO:tasks.rados.rados.0.trial188.stdout:2959: oid 35 updating version 0 to 1076 2026-02-13T20:24:50.274 INFO:tasks.rados.rados.0.trial188.stdout:2959: oid 35 version 1076 is already newer than 1074 2026-02-13T20:24:50.274 INFO:tasks.rados.rados.0.trial188.stdout:2959: oid 35 version 1076 is already newer than 1075 2026-02-13T20:24:50.275 INFO:tasks.rados.rados.0.trial188.stdout:2959: oid 35 updating version 1076 to 1077 2026-02-13T20:24:50.275 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 35 v 1077 (ObjNum 1027 snap 308 seq_num 1027) dirty exists 2026-02-13T20:24:50.275 INFO:tasks.rados.rados.0.trial188.stdout:2959: left oid 35 (ObjNum 1027 snap 308 seq_num 1027) 2026-02-13T20:24:50.275 INFO:tasks.rados.rados.0.trial188.stdout:2962: expect (ObjNum 868 snap 252 seq_num 868) 2026-02-13T20:24:50.290 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2501736 2026-02-13T20:24:50.343 INFO:tasks.rados.rados.0.trial188.stdout:2964: finishing write tid 1 to trial18843701-21 2026-02-13T20:24:50.343 INFO:tasks.rados.rados.0.trial188.stdout:2964: finishing write tid 2 to trial18843701-21 2026-02-13T20:24:50.343 INFO:tasks.rados.rados.0.trial188.stdout:2964: finishing write tid 3 to trial18843701-21 2026-02-13T20:24:50.343 INFO:tasks.rados.rados.0.trial188.stdout:2966: finishing write tid 1 to trial18843701-23 2026-02-13T20:24:50.343 INFO:tasks.rados.rados.0.trial188.stdout:2964: finishing write tid 4 to trial18843701-21 2026-02-13T20:24:50.343 INFO:tasks.rados.rados.0.trial188.stdout:2967: seq_num 1030 ranges {511210=414125,1423159=486356,2668859=589585} 2026-02-13T20:24:50.346 INFO:tasks.rados.rados.0.trial188.stdout:2967: writing trial18843701-46 from 511210 to 925335 tid 1 2026-02-13T20:24:50.350 INFO:tasks.rados.rados.0.trial188.stdout:2967: writing trial18843701-46 from 1423159 to 1909515 tid 2 2026-02-13T20:24:50.355 INFO:tasks.rados.rados.0.trial188.stdout:2967: writing trial18843701-46 from 2668859 to 3258444 tid 3 2026-02-13T20:24:50.355 INFO:tasks.rados.rados.0.trial188.stdout:2959: done (5 left) 2026-02-13T20:24:50.356 INFO:tasks.rados.rados.0.trial188.stdout:2962: done (4 left) 2026-02-13T20:24:50.356 INFO:tasks.rados.rados.0.trial188.stdout:2968: snap_remove snap 306 2026-02-13T20:24:51.252 INFO:tasks.rados.rados.0.trial188.stdout:2968: done (4 left) 2026-02-13T20:24:51.252 INFO:tasks.rados.rados.0.trial188.stdout:2969: write oid 16 current snap is 308 2026-02-13T20:24:51.252 INFO:tasks.rados.rados.0.trial188.stdout:2969: seq_num 1031 ranges {528017=489374,1481641=630014,2696282=400857} 2026-02-13T20:24:51.256 INFO:tasks.rados.rados.0.trial188.stdout:2969: writing trial18843701-16 from 528017 to 1017391 tid 1 2026-02-13T20:24:51.260 INFO:tasks.rados.rados.0.trial188.stdout:2969: writing trial18843701-16 from 1481641 to 2111655 tid 2 2026-02-13T20:24:51.264 INFO:tasks.rados.rados.0.trial188.stdout:2969: writing trial18843701-16 from 2696282 to 3097139 tid 3 2026-02-13T20:24:51.265 INFO:tasks.rados.rados.0.trial188.stdout:2970: snap_create 2026-02-13T20:24:51.265 INFO:tasks.rados.rados.0.trial188.stdout:2966: finishing write tid 2 to trial18843701-23 2026-02-13T20:24:51.265 INFO:tasks.rados.rados.0.trial188.stdout:2966: finishing write tid 3 to trial18843701-23 2026-02-13T20:24:51.265 INFO:tasks.rados.rados.0.trial188.stdout:2964: finishing write tid 5 to trial18843701-21 2026-02-13T20:24:51.265 INFO:tasks.rados.rados.0.trial188.stdout:2964: oid 21 updating version 0 to 983 2026-02-13T20:24:51.265 INFO:tasks.rados.rados.0.trial188.stdout:2964: oid 21 version 983 is already newer than 980 2026-02-13T20:24:51.265 INFO:tasks.rados.rados.0.trial188.stdout:2964: oid 21 version 983 is already newer than 981 2026-02-13T20:24:51.265 INFO:tasks.rados.rados.0.trial188.stdout:2964: oid 21 version 983 is already newer than 982 2026-02-13T20:24:51.265 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 21 v 983 (ObjNum 1028 snap 308 seq_num 1028) dirty exists 2026-02-13T20:24:51.265 INFO:tasks.rados.rados.0.trial188.stdout:2964: left oid 21 (ObjNum 1028 snap 308 seq_num 1028) 2026-02-13T20:24:51.266 INFO:tasks.rados.rados.0.trial188.stdout:2966: finishing write tid 4 to trial18843701-23 2026-02-13T20:24:51.266 INFO:tasks.rados.rados.0.trial188.stdout:2966: finishing write tid 5 to trial18843701-23 2026-02-13T20:24:51.266 INFO:tasks.rados.rados.0.trial188.stdout:2966: oid 23 updating version 0 to 1486 2026-02-13T20:24:51.266 INFO:tasks.rados.rados.0.trial188.stdout:2966: oid 23 version 1486 is already newer than 1485 2026-02-13T20:24:51.266 INFO:tasks.rados.rados.0.trial188.stdout:2966: oid 23 version 1486 is already newer than 1484 2026-02-13T20:24:51.266 INFO:tasks.rados.rados.0.trial188.stdout:2966: oid 23 updating version 1486 to 1487 2026-02-13T20:24:51.266 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 23 v 1487 (ObjNum 1029 snap 308 seq_num 1029) dirty exists 2026-02-13T20:24:51.266 INFO:tasks.rados.rados.0.trial188.stdout:2966: left oid 23 (ObjNum 1029 snap 308 seq_num 1029) 2026-02-13T20:24:51.266 INFO:tasks.rados.rados.0.trial188.stdout:2965: finishing copy_from racing read to trial18843701-10 2026-02-13T20:24:51.266 INFO:tasks.rados.rados.0.trial188.stdout:2965: finishing copy_from to trial18843701-10 2026-02-13T20:24:51.266 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 10 v 1080 (ObjNum 1020 snap 307 seq_num 1020) dirty exists 2026-02-13T20:24:51.266 INFO:tasks.rados.rados.0.trial188.stdout:2967: finishing write tid 1 to trial18843701-46 2026-02-13T20:24:51.266 INFO:tasks.rados.rados.0.trial188.stdout:2967: finishing write tid 2 to trial18843701-46 2026-02-13T20:24:51.267 INFO:tasks.rados.rados.0.trial188.stdout:2967: finishing write tid 3 to trial18843701-46 2026-02-13T20:24:51.267 INFO:tasks.rados.rados.0.trial188.stdout:2967: finishing write tid 4 to trial18843701-46 2026-02-13T20:24:51.267 INFO:tasks.rados.rados.0.trial188.stdout:2967: finishing write tid 5 to trial18843701-46 2026-02-13T20:24:51.267 INFO:tasks.rados.rados.0.trial188.stdout:2967: oid 46 updating version 0 to 1337 2026-02-13T20:24:51.267 INFO:tasks.rados.rados.0.trial188.stdout:2967: oid 46 updating version 1337 to 1338 2026-02-13T20:24:51.267 INFO:tasks.rados.rados.0.trial188.stdout:2967: oid 46 updating version 1338 to 1339 2026-02-13T20:24:51.267 INFO:tasks.rados.rados.0.trial188.stdout:2967: oid 46 updating version 1339 to 1340 2026-02-13T20:24:51.267 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 46 v 1340 (ObjNum 1030 snap 308 seq_num 1030) dirty exists 2026-02-13T20:24:51.267 INFO:tasks.rados.rados.0.trial188.stdout:2967: left oid 46 (ObjNum 1030 snap 308 seq_num 1030) 2026-02-13T20:24:51.283 INFO:tasks.rados.rados.0.trial188.stdout:2969: finishing write tid 1 to trial18843701-16 2026-02-13T20:24:51.283 INFO:tasks.rados.rados.0.trial188.stdout:2969: finishing write tid 2 to trial18843701-16 2026-02-13T20:24:51.283 INFO:tasks.rados.rados.0.trial188.stdout:2969: finishing write tid 3 to trial18843701-16 2026-02-13T20:24:51.283 INFO:tasks.rados.rados.0.trial188.stdout:2969: finishing write tid 4 to trial18843701-16 2026-02-13T20:24:51.284 INFO:tasks.rados.rados.0.trial188.stdout:2969: finishing write tid 5 to trial18843701-16 2026-02-13T20:24:51.284 INFO:tasks.rados.rados.0.trial188.stdout:2969: oid 16 updating version 0 to 1493 2026-02-13T20:24:51.284 INFO:tasks.rados.rados.0.trial188.stdout:2969: oid 16 updating version 1493 to 1494 2026-02-13T20:24:51.284 INFO:tasks.rados.rados.0.trial188.stdout:2969: oid 16 updating version 1494 to 1495 2026-02-13T20:24:51.284 INFO:tasks.rados.rados.0.trial188.stdout:2969: oid 16 version 1495 is already newer than 1492 2026-02-13T20:24:51.284 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 16 v 1495 (ObjNum 1031 snap 308 seq_num 1031) dirty exists 2026-02-13T20:24:51.284 INFO:tasks.rados.rados.0.trial188.stdout:2969: left oid 16 (ObjNum 1031 snap 308 seq_num 1031) 2026-02-13T20:24:52.244 INFO:tasks.rados.rados.0.trial188.stdout:2964: done (5 left) 2026-02-13T20:24:52.244 INFO:tasks.rados.rados.0.trial188.stdout:2965: done (4 left) 2026-02-13T20:24:52.244 INFO:tasks.rados.rados.0.trial188.stdout:2966: done (3 left) 2026-02-13T20:24:52.245 INFO:tasks.rados.rados.0.trial188.stdout:2967: done (2 left) 2026-02-13T20:24:52.245 INFO:tasks.rados.rados.0.trial188.stdout:2969: done (1 left) 2026-02-13T20:24:52.245 INFO:tasks.rados.rados.0.trial188.stdout:2970: done (0 left) 2026-02-13T20:24:52.245 INFO:tasks.rados.rados.0.trial188.stdout:2971: snap_create 2026-02-13T20:24:53.244 INFO:tasks.rados.rados.0.trial188.stdout:2971: done (0 left) 2026-02-13T20:24:53.245 INFO:tasks.rados.rados.0.trial188.stdout:2972: write oid 22 current snap is 310 2026-02-13T20:24:53.245 INFO:tasks.rados.rados.0.trial188.stdout:2972: seq_num 1032 ranges {544824=564623,1823770=490025,3007352=337472} 2026-02-13T20:24:53.248 INFO:tasks.rados.rados.0.trial188.stdout:2972: writing trial18843701-22 from 544824 to 1109447 tid 1 2026-02-13T20:24:53.253 INFO:tasks.rados.rados.0.trial188.stdout:2972: writing trial18843701-22 from 1823770 to 2313795 tid 2 2026-02-13T20:24:53.257 INFO:tasks.rados.rados.0.trial188.stdout:2972: writing trial18843701-22 from 3007352 to 3344824 tid 3 2026-02-13T20:24:53.257 INFO:tasks.rados.rados.0.trial188.stdout:2973: rollback oid 40 current snap is 310 2026-02-13T20:24:53.257 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 40 to 279 2026-02-13T20:24:53.257 INFO:tasks.rados.rados.0.trial188.stdout:2974: read oid 36 snap -1 2026-02-13T20:24:53.257 INFO:tasks.rados.rados.0.trial188.stdout:2974: expect deleted 2026-02-13T20:24:53.257 INFO:tasks.rados.rados.0.trial188.stdout:2975: delete oid 9 current snap is 310 2026-02-13T20:24:53.259 INFO:tasks.rados.rados.0.trial188.stdout:2974: done (3 left) 2026-02-13T20:24:53.259 INFO:tasks.rados.rados.0.trial188.stdout:2975: done (2 left) 2026-02-13T20:24:53.260 INFO:tasks.rados.rados.0.trial188.stdout:2976: read oid 47 snap -1 2026-02-13T20:24:53.260 INFO:tasks.rados.rados.0.trial188.stdout:2976: expect (ObjNum 981 snap 292 seq_num 981) 2026-02-13T20:24:53.260 INFO:tasks.rados.rados.0.trial188.stdout:2977: snap_create 2026-02-13T20:24:53.263 INFO:tasks.rados.rados.0.trial188.stdout:2976: expect (ObjNum 981 snap 292 seq_num 981) 2026-02-13T20:24:53.264 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:24:53.356 INFO:tasks.rados.rados.0.trial188.stdout:2972: finishing write tid 1 to trial18843701-22 2026-02-13T20:24:53.356 INFO:tasks.rados.rados.0.trial188.stdout:2972: finishing write tid 2 to trial18843701-22 2026-02-13T20:24:53.357 INFO:tasks.rados.rados.0.trial188.stdout:2973: finishing rollback tid 1 to trial18843701-40 2026-02-13T20:24:53.357 INFO:tasks.rados.rados.0.trial188.stdout:2972: finishing write tid 3 to trial18843701-22 2026-02-13T20:24:53.357 INFO:tasks.rados.rados.0.trial188.stdout:2973: finishing rollback tid 2 to trial18843701-40 2026-02-13T20:24:53.357 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 40 v 1342 (ObjNum 894 snap 270 seq_num 894) dirty exists 2026-02-13T20:24:53.357 INFO:tasks.rados.rados.0.trial188.stdout:2972: finishing write tid 4 to trial18843701-22 2026-02-13T20:24:53.357 INFO:tasks.rados.rados.0.trial188.stdout:2972: finishing write tid 5 to trial18843701-22 2026-02-13T20:24:53.357 INFO:tasks.rados.rados.0.trial188.stdout:2972: oid 22 updating version 0 to 1080 2026-02-13T20:24:53.357 INFO:tasks.rados.rados.0.trial188.stdout:2972: oid 22 version 1080 is already newer than 1078 2026-02-13T20:24:53.357 INFO:tasks.rados.rados.0.trial188.stdout:2972: oid 22 version 1080 is already newer than 1079 2026-02-13T20:24:53.357 INFO:tasks.rados.rados.0.trial188.stdout:2972: oid 22 version 1080 is already newer than 1077 2026-02-13T20:24:53.358 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 22 v 1080 (ObjNum 1032 snap 310 seq_num 1032) dirty exists 2026-02-13T20:24:53.358 INFO:tasks.rados.rados.0.trial188.stdout:2972: left oid 22 (ObjNum 1032 snap 310 seq_num 1032) 2026-02-13T20:24:54.257 INFO:tasks.rados.rados.0.trial188.stdout:2972: done (3 left) 2026-02-13T20:24:54.257 INFO:tasks.rados.rados.0.trial188.stdout:2973: done (2 left) 2026-02-13T20:24:54.258 INFO:tasks.rados.rados.0.trial188.stdout:2976: done (1 left) 2026-02-13T20:24:54.258 INFO:tasks.rados.rados.0.trial188.stdout:2977: done (0 left) 2026-02-13T20:24:54.258 INFO:tasks.rados.rados.0.trial188.stdout:2978: write oid 31 current snap is 311 2026-02-13T20:24:54.258 INFO:tasks.rados.rados.0.trial188.stdout:2978: seq_num 1034 ranges {578438=431474,1657087=493694,2778551=599887} 2026-02-13T20:24:54.261 INFO:tasks.rados.rados.0.trial188.stdout:2978: writing trial18843701-31 from 578438 to 1009912 tid 1 2026-02-13T20:24:54.266 INFO:tasks.rados.rados.0.trial188.stdout:2978: writing trial18843701-31 from 1657087 to 2150781 tid 2 2026-02-13T20:24:54.270 INFO:tasks.rados.rados.0.trial188.stdout:2978: writing trial18843701-31 from 2778551 to 3378438 tid 3 2026-02-13T20:24:54.271 INFO:tasks.rados.rados.0.trial188.stdout:2979: delete oid 41 current snap is 311 2026-02-13T20:24:54.273 INFO:tasks.rados.rados.0.trial188.stdout:2979: done (1 left) 2026-02-13T20:24:54.274 INFO:tasks.rados.rados.0.trial188.stdout:2980: read oid 44 snap -1 2026-02-13T20:24:54.274 INFO:tasks.rados.rados.0.trial188.stdout:2980: expect (ObjNum 712 snap 203 seq_num 712) 2026-02-13T20:24:54.274 INFO:tasks.rados.rados.0.trial188.stdout:2981: copy_from oid 29 from oid 45 current snap is 311 2026-02-13T20:24:54.274 INFO:tasks.rados.rados.0.trial188.stdout:2982: snap_create 2026-02-13T20:24:54.277 INFO:tasks.rados.rados.0.trial188.stdout:2978: finishing write tid 1 to trial18843701-31 2026-02-13T20:24:54.284 INFO:tasks.rados.rados.0.trial188.stdout:2980: expect (ObjNum 712 snap 203 seq_num 712) 2026-02-13T20:24:54.348 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 153768 2026-02-13T20:24:54.388 INFO:tasks.rados.rados.0.trial188.stdout:2978: finishing write tid 2 to trial18843701-31 2026-02-13T20:24:54.388 INFO:tasks.rados.rados.0.trial188.stdout:2978: finishing write tid 3 to trial18843701-31 2026-02-13T20:24:54.388 INFO:tasks.rados.rados.0.trial188.stdout:2978: finishing write tid 4 to trial18843701-31 2026-02-13T20:24:54.388 INFO:tasks.rados.rados.0.trial188.stdout:2978: finishing write tid 5 to trial18843701-31 2026-02-13T20:24:54.388 INFO:tasks.rados.rados.0.trial188.stdout:2978: oid 31 updating version 0 to 979 2026-02-13T20:24:54.388 INFO:tasks.rados.rados.0.trial188.stdout:2978: oid 31 version 979 is already newer than 978 2026-02-13T20:24:54.388 INFO:tasks.rados.rados.0.trial188.stdout:2978: oid 31 version 979 is already newer than 977 2026-02-13T20:24:54.388 INFO:tasks.rados.rados.0.trial188.stdout:2978: oid 31 version 979 is already newer than 976 2026-02-13T20:24:54.388 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 31 v 979 (ObjNum 1034 snap 311 seq_num 1034) dirty exists 2026-02-13T20:24:54.389 INFO:tasks.rados.rados.0.trial188.stdout:2978: left oid 31 (ObjNum 1034 snap 311 seq_num 1034) 2026-02-13T20:24:54.389 INFO:tasks.rados.rados.0.trial188.stdout:2981: finishing copy_from racing read to trial18843701-29 2026-02-13T20:24:54.389 INFO:tasks.rados.rados.0.trial188.stdout:2981: finishing copy_from to trial18843701-29 2026-02-13T20:24:54.389 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 29 v 1444 (ObjNum 1013 snap 303 seq_num 1013) dirty exists 2026-02-13T20:24:55.261 INFO:tasks.rados.rados.0.trial188.stdout:2978: done (3 left) 2026-02-13T20:24:55.262 INFO:tasks.rados.rados.0.trial188.stdout:2980: done (2 left) 2026-02-13T20:24:55.262 INFO:tasks.rados.rados.0.trial188.stdout:2981: done (1 left) 2026-02-13T20:24:55.262 INFO:tasks.rados.rados.0.trial188.stdout:2982: done (0 left) 2026-02-13T20:24:55.262 INFO:tasks.rados.rados.0.trial188.stdout:2983: rollback oid 5 current snap is 312 2026-02-13T20:24:55.262 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 5 to 291 2026-02-13T20:24:55.262 INFO:tasks.rados.rados.0.trial188.stdout:2984: copy_from oid 35 from oid 13 current snap is 312 2026-02-13T20:24:55.262 INFO:tasks.rados.rados.0.trial188.stdout:2985: snap_remove snap 290 2026-02-13T20:24:56.263 INFO:tasks.rados.rados.0.trial188.stdout:2985: done (2 left) 2026-02-13T20:24:56.263 INFO:tasks.rados.rados.0.trial188.stdout:2986: snap_remove snap 304 2026-02-13T20:24:57.246 INFO:tasks.rados.rados.0.trial188.stdout:2986: done (2 left) 2026-02-13T20:24:57.246 INFO:tasks.rados.rados.0.trial188.stdout:2987: snap_create 2026-02-13T20:24:57.246 INFO:tasks.rados.rados.0.trial188.stdout:2983: finishing rollback tid 0 to trial18843701-5 2026-02-13T20:24:57.246 INFO:tasks.rados.rados.0.trial188.stdout:2983: finishing rollback tid 1 to trial18843701-5 2026-02-13T20:24:57.246 INFO:tasks.rados.rados.0.trial188.stdout:2983: finishing rollback tid 2 to trial18843701-5 2026-02-13T20:24:57.247 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 5 v 1335 (ObjNum 969 snap 289 seq_num 969) dirty exists 2026-02-13T20:24:57.247 INFO:tasks.rados.rados.0.trial188.stdout:2984: finishing copy_from racing read to trial18843701-35 2026-02-13T20:24:57.247 INFO:tasks.rados.rados.0.trial188.stdout:2984: finishing copy_from to trial18843701-35 2026-02-13T20:24:57.247 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 35 v 1321 (ObjNum 1024 snap 307 seq_num 1024) dirty exists 2026-02-13T20:24:58.246 INFO:tasks.rados.rados.0.trial188.stdout:2983: done (2 left) 2026-02-13T20:24:58.246 INFO:tasks.rados.rados.0.trial188.stdout:2984: done (1 left) 2026-02-13T20:24:58.246 INFO:tasks.rados.rados.0.trial188.stdout:2987: done (0 left) 2026-02-13T20:24:58.246 INFO:tasks.rados.rados.0.trial188.stdout:2988: snap_remove snap 279 2026-02-13T20:24:59.247 INFO:tasks.rados.rados.0.trial188.stdout:2988: done (0 left) 2026-02-13T20:24:59.247 INFO:tasks.rados.rados.0.trial188.stdout:2989: copy_from oid 12 from oid 34 current snap is 313 2026-02-13T20:24:59.247 INFO:tasks.rados.rados.0.trial188.stdout:2990: copy_from oid 31 from oid 29 current snap is 313 2026-02-13T20:24:59.247 INFO:tasks.rados.rados.0.trial188.stdout:2991: rollback oid 38 current snap is 313 2026-02-13T20:24:59.247 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 38 to 303 2026-02-13T20:24:59.247 INFO:tasks.rados.rados.0.trial188.stdout:2992: snap_remove snap 283 2026-02-13T20:25:00.252 INFO:tasks.rados.rados.0.trial188.stdout:2992: done (3 left) 2026-02-13T20:25:00.252 INFO:tasks.rados.rados.0.trial188.stdout:2993: write (excl) oid 49 current snap is 313 2026-02-13T20:25:00.252 INFO:tasks.rados.rados.0.trial188.stdout:2993: seq_num 1036 ranges {612052=581972,1657698=497363,2717044=695008} 2026-02-13T20:25:00.257 INFO:tasks.rados.rados.0.trial188.stdout:2993: writing trial18843701-49 from 612052 to 1194024 tid 1 2026-02-13T20:25:00.261 INFO:tasks.rados.rados.0.trial188.stdout:2993: writing trial18843701-49 from 1657698 to 2155061 tid 2 2026-02-13T20:25:00.267 INFO:tasks.rados.rados.0.trial188.stdout:2993: writing trial18843701-49 from 2717044 to 3412052 tid 3 2026-02-13T20:25:00.267 INFO:tasks.rados.rados.0.trial188.stdout:2994: read oid 44 snap -1 2026-02-13T20:25:00.267 INFO:tasks.rados.rados.0.trial188.stdout:2994: expect (ObjNum 712 snap 203 seq_num 712) 2026-02-13T20:25:00.267 INFO:tasks.rados.rados.0.trial188.stdout:2995: read oid 19 snap -1 2026-02-13T20:25:00.267 INFO:tasks.rados.rados.0.trial188.stdout:2995: expect (ObjNum 891 snap 269 seq_num 891) 2026-02-13T20:25:00.267 INFO:tasks.rados.rados.0.trial188.stdout:2996: read oid 5 snap -1 2026-02-13T20:25:00.267 INFO:tasks.rados.rados.0.trial188.stdout:2996: expect (ObjNum 969 snap 289 seq_num 969) 2026-02-13T20:25:00.267 INFO:tasks.rados.rados.0.trial188.stdout:2997: delete oid 23 current snap is 313 2026-02-13T20:25:00.267 INFO:tasks.rados.rados.0.trial188.stdout:2991: finishing rollback tid 1 to trial18843701-38 2026-02-13T20:25:00.267 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 38 v 1340 (ObjNum 49 snap 0 seq_num 1634300532) dirty dne 2026-02-13T20:25:00.267 INFO:tasks.rados.rados.0.trial188.stdout:2989: finishing copy_from racing read to trial18843701-12 2026-02-13T20:25:00.267 INFO:tasks.rados.rados.0.trial188.stdout:2989: finishing copy_from to trial18843701-12 2026-02-13T20:25:00.267 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 12 v 1353 (ObjNum 979 snap 292 seq_num 979) dirty exists 2026-02-13T20:25:00.268 INFO:tasks.rados.rados.0.trial188.stdout:2990: finishing copy_from racing read to trial18843701-31 2026-02-13T20:25:00.268 INFO:tasks.rados.rados.0.trial188.stdout:2990: finishing copy_from to trial18843701-31 2026-02-13T20:25:00.268 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 31 v 1444 (ObjNum 1013 snap 303 seq_num 1013) dirty exists 2026-02-13T20:25:00.271 INFO:tasks.rados.rados.0.trial188.stdout:2989: done (7 left) 2026-02-13T20:25:00.271 INFO:tasks.rados.rados.0.trial188.stdout:2990: done (6 left) 2026-02-13T20:25:00.271 INFO:tasks.rados.rados.0.trial188.stdout:2991: done (5 left) 2026-02-13T20:25:00.271 INFO:tasks.rados.rados.0.trial188.stdout:2997: done (4 left) 2026-02-13T20:25:00.271 INFO:tasks.rados.rados.0.trial188.stdout:2998: copy_from oid 38 from oid 20 current snap is 313 2026-02-13T20:25:00.271 INFO:tasks.rados.rados.0.trial188.stdout:2999: write (excl) oid 13 current snap is 313 2026-02-13T20:25:00.271 INFO:tasks.rados.rados.0.trial188.stdout:2999: seq_num 1038 ranges {645666=732470,2174662=501032,3288243=157423} 2026-02-13T20:25:00.276 INFO:tasks.rados.rados.0.trial188.stdout:2999: writing trial18843701-13 from 645666 to 1378136 tid 1 2026-02-13T20:25:00.282 INFO:tasks.rados.rados.0.trial188.stdout:2999: writing trial18843701-13 from 2174662 to 2675694 tid 2 2026-02-13T20:25:00.285 INFO:tasks.rados.rados.0.trial188.stdout:2999: writing trial18843701-13 from 3288243 to 3445666 tid 3 2026-02-13T20:25:00.285 INFO:tasks.rados.rados.0.trial188.stdout:3000: read oid 45 snap -1 2026-02-13T20:25:00.285 INFO:tasks.rados.rados.0.trial188.stdout:3000: expect (ObjNum 1013 snap 303 seq_num 1013) 2026-02-13T20:25:00.286 INFO:tasks.rados.rados.0.trial188.stdout:3001: read oid 47 snap 291 2026-02-13T20:25:00.286 INFO:tasks.rados.rados.0.trial188.stdout:3001: expect (ObjNum 959 snap 289 seq_num 959) 2026-02-13T20:25:00.286 INFO:tasks.rados.rados.0.trial188.stdout:3002: rollback oid 46 current snap is 313 2026-02-13T20:25:00.286 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 46 to 309 2026-02-13T20:25:00.286 INFO:tasks.rados.rados.0.trial188.stdout:2995: expect (ObjNum 891 snap 269 seq_num 891) 2026-02-13T20:25:00.432 INFO:tasks.rados.rados.0.trial188.stdout:2994: expect (ObjNum 712 snap 203 seq_num 712) 2026-02-13T20:25:00.442 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2069549 2026-02-13T20:25:00.465 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:25:00.506 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 88332 2026-02-13T20:25:00.548 INFO:tasks.rados.rados.0.trial188.stdout:2996: expect (ObjNum 969 snap 289 seq_num 969) 2026-02-13T20:25:00.594 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1816661 2026-02-13T20:25:00.622 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2008646 2026-02-13T20:25:00.624 INFO:tasks.rados.rados.0.trial188.stdout:2993: finishing write tid 1 to trial18843701-49 2026-02-13T20:25:00.624 INFO:tasks.rados.rados.0.trial188.stdout:2994: done (8 left) 2026-02-13T20:25:00.624 INFO:tasks.rados.rados.0.trial188.stdout:2995: done (7 left) 2026-02-13T20:25:00.624 INFO:tasks.rados.rados.0.trial188.stdout:2996: done (6 left) 2026-02-13T20:25:00.624 INFO:tasks.rados.rados.0.trial188.stdout:3003: read oid 2 snap -1 2026-02-13T20:25:00.624 INFO:tasks.rados.rados.0.trial188.stdout:3003: expect (ObjNum 950 snap 282 seq_num 950) 2026-02-13T20:25:00.624 INFO:tasks.rados.rados.0.trial188.stdout:3004: rollback oid 12 current snap is 313 2026-02-13T20:25:00.624 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 12 to 299 2026-02-13T20:25:00.624 INFO:tasks.rados.rados.0.trial188.stdout:2998: finishing copy_from to trial18843701-38 2026-02-13T20:25:00.625 INFO:tasks.rados.rados.0.trial188.stdout:2998: got expected ENOENT (src dne) 2026-02-13T20:25:00.625 INFO:tasks.rados.rados.0.trial188.stdout:2993: finishing write tid 2 to trial18843701-49 2026-02-13T20:25:00.625 INFO:tasks.rados.rados.0.trial188.stdout:2998: finishing copy_from racing read to trial18843701-38 2026-02-13T20:25:00.625 INFO:tasks.rados.rados.0.trial188.stdout:3001: expect (ObjNum 959 snap 289 seq_num 959) 2026-02-13T20:25:00.625 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 466689 2026-02-13T20:25:00.693 INFO:tasks.rados.rados.0.trial188.stdout:3000: expect (ObjNum 1013 snap 303 seq_num 1013) 2026-02-13T20:25:00.793 INFO:tasks.rados.rados.0.trial188.stdout:2993: finishing write tid 3 to trial18843701-49 2026-02-13T20:25:00.793 INFO:tasks.rados.rados.0.trial188.stdout:2993: finishing write tid 4 to trial18843701-49 2026-02-13T20:25:00.793 INFO:tasks.rados.rados.0.trial188.stdout:2993: finishing write tid 5 to trial18843701-49 2026-02-13T20:25:00.793 INFO:tasks.rados.rados.0.trial188.stdout:2993: oid 49 updating version 0 to 1458 2026-02-13T20:25:00.793 INFO:tasks.rados.rados.0.trial188.stdout:2993: oid 49 version 1458 is already newer than 1456 2026-02-13T20:25:00.793 INFO:tasks.rados.rados.0.trial188.stdout:2993: oid 49 version 1458 is already newer than 1457 2026-02-13T20:25:00.793 INFO:tasks.rados.rados.0.trial188.stdout:2993: oid 49 version 1458 is already newer than 1455 2026-02-13T20:25:00.793 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 49 v 1458 (ObjNum 1036 snap 313 seq_num 1036) dirty exists 2026-02-13T20:25:00.794 INFO:tasks.rados.rados.0.trial188.stdout:2993: left oid 49 (ObjNum 1036 snap 313 seq_num 1036) 2026-02-13T20:25:00.794 INFO:tasks.rados.rados.0.trial188.stdout:2999: finishing write tid 1 to trial18843701-13 2026-02-13T20:25:00.794 INFO:tasks.rados.rados.0.trial188.stdout:3002: finishing rollback tid 0 to trial18843701-46 2026-02-13T20:25:00.794 INFO:tasks.rados.rados.0.trial188.stdout:3002: finishing rollback tid 1 to trial18843701-46 2026-02-13T20:25:00.794 INFO:tasks.rados.rados.0.trial188.stdout:3002: finishing rollback tid 2 to trial18843701-46 2026-02-13T20:25:00.794 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 46 v 1346 (ObjNum 1030 snap 308 seq_num 1030) dirty exists 2026-02-13T20:25:00.794 INFO:tasks.rados.rados.0.trial188.stdout:2999: finishing write tid 2 to trial18843701-13 2026-02-13T20:25:00.794 INFO:tasks.rados.rados.0.trial188.stdout:2999: finishing write tid 3 to trial18843701-13 2026-02-13T20:25:00.794 INFO:tasks.rados.rados.0.trial188.stdout:2993: done (7 left) 2026-02-13T20:25:00.794 INFO:tasks.rados.rados.0.trial188.stdout:2998: done (6 left) 2026-02-13T20:25:00.794 INFO:tasks.rados.rados.0.trial188.stdout:3000: done (5 left) 2026-02-13T20:25:00.794 INFO:tasks.rados.rados.0.trial188.stdout:3001: done (4 left) 2026-02-13T20:25:00.795 INFO:tasks.rados.rados.0.trial188.stdout:3002: done (3 left) 2026-02-13T20:25:00.795 INFO:tasks.rados.rados.0.trial188.stdout:3005: write oid 19 current snap is 313 2026-02-13T20:25:00.795 INFO:tasks.rados.rados.0.trial188.stdout:2999: finishing write tid 4 to trial18843701-13 2026-02-13T20:25:00.795 INFO:tasks.rados.rados.0.trial188.stdout:3005: seq_num 1039 ranges {662473=407719,1833144=644690,3199313=263160} 2026-02-13T20:25:00.796 INFO:tasks.rados.rados.0.trial188.stdout:3005: writing trial18843701-19 from 662473 to 1070192 tid 1 2026-02-13T20:25:00.801 INFO:tasks.rados.rados.0.trial188.stdout:3005: writing trial18843701-19 from 1833144 to 2477834 tid 2 2026-02-13T20:25:00.805 INFO:tasks.rados.rados.0.trial188.stdout:3005: writing trial18843701-19 from 3199313 to 3462473 tid 3 2026-02-13T20:25:00.805 INFO:tasks.rados.rados.0.trial188.stdout:3006: rollback oid 49 current snap is 313 2026-02-13T20:25:00.805 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 49 to 312 2026-02-13T20:25:00.805 INFO:tasks.rados.rados.0.trial188.stdout:2999: finishing write tid 5 to trial18843701-13 2026-02-13T20:25:00.805 INFO:tasks.rados.rados.0.trial188.stdout:2999: oid 13 updating version 0 to 1364 2026-02-13T20:25:00.806 INFO:tasks.rados.rados.0.trial188.stdout:2999: oid 13 updating version 1364 to 1365 2026-02-13T20:25:00.806 INFO:tasks.rados.rados.0.trial188.stdout:2999: oid 13 updating version 1365 to 1366 2026-02-13T20:25:00.806 INFO:tasks.rados.rados.0.trial188.stdout:2999: oid 13 version 1366 is already newer than 1363 2026-02-13T20:25:00.806 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 13 v 1366 (ObjNum 1038 snap 313 seq_num 1038) dirty exists 2026-02-13T20:25:00.806 INFO:tasks.rados.rados.0.trial188.stdout:2999: left oid 13 (ObjNum 1038 snap 313 seq_num 1038) 2026-02-13T20:25:00.806 INFO:tasks.rados.rados.0.trial188.stdout:3004: finishing rollback tid 0 to trial18843701-12 2026-02-13T20:25:00.806 INFO:tasks.rados.rados.0.trial188.stdout:3004: finishing rollback tid 1 to trial18843701-12 2026-02-13T20:25:00.806 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 12 v 1355 (ObjNum 129 snap 0 seq_num 13780864) dirty dne 2026-02-13T20:25:00.806 INFO:tasks.rados.rados.0.trial188.stdout:3003: expect (ObjNum 950 snap 282 seq_num 950) 2026-02-13T20:25:00.816 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1601699 2026-02-13T20:25:00.848 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:25:00.941 INFO:tasks.rados.rados.0.trial188.stdout:3006: finishing rollback tid 0 to trial18843701-49 2026-02-13T20:25:00.941 INFO:tasks.rados.rados.0.trial188.stdout:3006: finishing rollback tid 1 to trial18843701-49 2026-02-13T20:25:00.941 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 49 v 1460 (ObjNum 129 snap 0 seq_num 13858832) dirty dne 2026-02-13T20:25:00.941 INFO:tasks.rados.rados.0.trial188.stdout:3005: finishing write tid 1 to trial18843701-19 2026-02-13T20:25:00.941 INFO:tasks.rados.rados.0.trial188.stdout:3005: finishing write tid 2 to trial18843701-19 2026-02-13T20:25:00.941 INFO:tasks.rados.rados.0.trial188.stdout:2999: done (4 left) 2026-02-13T20:25:00.941 INFO:tasks.rados.rados.0.trial188.stdout:3003: done (3 left) 2026-02-13T20:25:00.941 INFO:tasks.rados.rados.0.trial188.stdout:3004: done (2 left) 2026-02-13T20:25:00.941 INFO:tasks.rados.rados.0.trial188.stdout:3006: done (1 left) 2026-02-13T20:25:00.941 INFO:tasks.rados.rados.0.trial188.stdout:3007: snap_remove snap 309 2026-02-13T20:25:01.256 INFO:tasks.rados.rados.0.trial188.stdout:3007: done (1 left) 2026-02-13T20:25:01.256 INFO:tasks.rados.rados.0.trial188.stdout:3008: copy_from oid 22 from oid 35 current snap is 313 2026-02-13T20:25:01.256 INFO:tasks.rados.rados.0.trial188.stdout:3005: finishing write tid 3 to trial18843701-19 2026-02-13T20:25:01.256 INFO:tasks.rados.rados.0.trial188.stdout:3005: finishing write tid 4 to trial18843701-19 2026-02-13T20:25:01.256 INFO:tasks.rados.rados.0.trial188.stdout:3005: finishing write tid 5 to trial18843701-19 2026-02-13T20:25:01.256 INFO:tasks.rados.rados.0.trial188.stdout:3005: oid 19 updating version 0 to 1445 2026-02-13T20:25:01.256 INFO:tasks.rados.rados.0.trial188.stdout:3005: oid 19 updating version 1445 to 1447 2026-02-13T20:25:01.257 INFO:tasks.rados.rados.0.trial188.stdout:3005: oid 19 updating version 1447 to 1448 2026-02-13T20:25:01.257 INFO:tasks.rados.rados.0.trial188.stdout:3005: oid 19 version 1448 is already newer than 1446 2026-02-13T20:25:01.257 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 19 v 1448 (ObjNum 1039 snap 313 seq_num 1039) dirty exists 2026-02-13T20:25:01.257 INFO:tasks.rados.rados.0.trial188.stdout:3005: left oid 19 (ObjNum 1039 snap 313 seq_num 1039) 2026-02-13T20:25:01.257 INFO:tasks.rados.rados.0.trial188.stdout:3005: done (1 left) 2026-02-13T20:25:01.257 INFO:tasks.rados.rados.0.trial188.stdout:3009: snap_create 2026-02-13T20:25:01.296 INFO:tasks.rados.rados.0.trial188.stdout:3008: finishing copy_from racing read to trial18843701-22 2026-02-13T20:25:01.299 INFO:tasks.rados.rados.0.trial188.stdout:3008: finishing copy_from to trial18843701-22 2026-02-13T20:25:01.299 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 22 v 1321 (ObjNum 1024 snap 307 seq_num 1024) dirty exists 2026-02-13T20:25:02.246 INFO:tasks.rados.rados.0.trial188.stdout:3008: done (1 left) 2026-02-13T20:25:02.246 INFO:tasks.rados.rados.0.trial188.stdout:3009: done (0 left) 2026-02-13T20:25:02.246 INFO:tasks.rados.rados.0.trial188.stdout:3010: read oid 17 snap 313 2026-02-13T20:25:02.246 INFO:tasks.rados.rados.0.trial188.stdout:3010: expect (ObjNum 1026 snap 308 seq_num 1026) 2026-02-13T20:25:02.246 INFO:tasks.rados.rados.0.trial188.stdout:3011: write (excl) oid 39 current snap is 314 2026-02-13T20:25:02.247 INFO:tasks.rados.rados.0.trial188.stdout:3011: seq_num 1040 ranges {679280=482968,1775273=788348,3110383=368897} 2026-02-13T20:25:02.251 INFO:tasks.rados.rados.0.trial188.stdout:3011: writing trial18843701-39 from 679280 to 1162248 tid 1 2026-02-13T20:25:02.256 INFO:tasks.rados.rados.0.trial188.stdout:3011: writing trial18843701-39 from 1775273 to 2563621 tid 2 2026-02-13T20:25:02.259 INFO:tasks.rados.rados.0.trial188.stdout:3011: writing trial18843701-39 from 3110383 to 3479280 tid 3 2026-02-13T20:25:02.260 INFO:tasks.rados.rados.0.trial188.stdout:3012: rollback oid 9 current snap is 314 2026-02-13T20:25:02.260 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 9 to 303 2026-02-13T20:25:02.260 INFO:tasks.rados.rados.0.trial188.stdout:3010: expect (ObjNum 1026 snap 308 seq_num 1026) 2026-02-13T20:25:02.260 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:25:02.333 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2437531 2026-02-13T20:25:02.343 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 165347 2026-02-13T20:25:02.388 INFO:tasks.rados.rados.0.trial188.stdout:3012: finishing rollback tid 1 to trial18843701-9 2026-02-13T20:25:02.388 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 9 v 1078 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-13T20:25:02.388 INFO:tasks.rados.rados.0.trial188.stdout:3011: finishing write tid 1 to trial18843701-39 2026-02-13T20:25:02.388 INFO:tasks.rados.rados.0.trial188.stdout:3011: finishing write tid 2 to trial18843701-39 2026-02-13T20:25:02.388 INFO:tasks.rados.rados.0.trial188.stdout:3011: finishing write tid 3 to trial18843701-39 2026-02-13T20:25:02.388 INFO:tasks.rados.rados.0.trial188.stdout:3010: done (2 left) 2026-02-13T20:25:02.388 INFO:tasks.rados.rados.0.trial188.stdout:3012: done (1 left) 2026-02-13T20:25:02.388 INFO:tasks.rados.rados.0.trial188.stdout:3013: write oid 47 current snap is 314 2026-02-13T20:25:02.388 INFO:tasks.rados.rados.0.trial188.stdout:3013: seq_num 1041 ranges {696087=558217,1833755=648359,3137806=358281} 2026-02-13T20:25:02.392 INFO:tasks.rados.rados.0.trial188.stdout:3013: writing trial18843701-47 from 696087 to 1254304 tid 1 2026-02-13T20:25:02.397 INFO:tasks.rados.rados.0.trial188.stdout:3013: writing trial18843701-47 from 1833755 to 2482114 tid 2 2026-02-13T20:25:02.401 INFO:tasks.rados.rados.0.trial188.stdout:3013: writing trial18843701-47 from 3137806 to 3496087 tid 3 2026-02-13T20:25:02.401 INFO:tasks.rados.rados.0.trial188.stdout:3014: rollback oid 38 current snap is 314 2026-02-13T20:25:02.401 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 38 to 299 2026-02-13T20:25:02.402 INFO:tasks.rados.rados.0.trial188.stdout:3011: finishing write tid 4 to trial18843701-39 2026-02-13T20:25:02.402 INFO:tasks.rados.rados.0.trial188.stdout:3011: finishing write tid 5 to trial18843701-39 2026-02-13T20:25:02.402 INFO:tasks.rados.rados.0.trial188.stdout:3011: oid 39 updating version 0 to 1449 2026-02-13T20:25:02.402 INFO:tasks.rados.rados.0.trial188.stdout:3011: oid 39 updating version 1449 to 1452 2026-02-13T20:25:02.402 INFO:tasks.rados.rados.0.trial188.stdout:3011: oid 39 version 1452 is already newer than 1450 2026-02-13T20:25:02.402 INFO:tasks.rados.rados.0.trial188.stdout:3011: oid 39 version 1452 is already newer than 1451 2026-02-13T20:25:02.402 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 39 v 1452 (ObjNum 1040 snap 314 seq_num 1040) dirty exists 2026-02-13T20:25:02.402 INFO:tasks.rados.rados.0.trial188.stdout:3011: left oid 39 (ObjNum 1040 snap 314 seq_num 1040) 2026-02-13T20:25:02.402 INFO:tasks.rados.rados.0.trial188.stdout:3011: done (2 left) 2026-02-13T20:25:02.402 INFO:tasks.rados.rados.0.trial188.stdout:3015: read oid 43 snap -1 2026-02-13T20:25:02.402 INFO:tasks.rados.rados.0.trial188.stdout:3015: expect (ObjNum 998 snap 297 seq_num 998) 2026-02-13T20:25:02.403 INFO:tasks.rados.rados.0.trial188.stdout:3016: write oid 48 current snap is 314 2026-02-13T20:25:02.403 INFO:tasks.rados.rados.0.trial188.stdout:3016: seq_num 1042 ranges {712894=749819,2008590=792017,3281582=231312} 2026-02-13T20:25:02.406 INFO:tasks.rados.rados.0.trial188.stdout:3016: writing trial18843701-48 from 712894 to 1462713 tid 1 2026-02-13T20:25:02.411 INFO:tasks.rados.rados.0.trial188.stdout:3016: writing trial18843701-48 from 2008590 to 2800607 tid 2 2026-02-13T20:25:02.414 INFO:tasks.rados.rados.0.trial188.stdout:3016: writing trial18843701-48 from 3281582 to 3512894 tid 3 2026-02-13T20:25:02.414 INFO:tasks.rados.rados.0.trial188.stdout:3017: copy_from oid 9 from oid 14 current snap is 314 2026-02-13T20:25:02.414 INFO:tasks.rados.rados.0.trial188.stdout:3015: expect (ObjNum 998 snap 297 seq_num 998) 2026-02-13T20:25:02.435 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 634614 2026-02-13T20:25:02.472 INFO:tasks.rados.rados.0.trial188.stdout:3014: finishing rollback tid 1 to trial18843701-38 2026-02-13T20:25:02.472 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 38 v 0 (ObjNum 65 snap 0 seq_num 11788704) dirty dne 2026-02-13T20:25:02.472 INFO:tasks.rados.rados.0.trial188.stdout:3013: finishing write tid 1 to trial18843701-47 2026-02-13T20:25:02.472 INFO:tasks.rados.rados.0.trial188.stdout:3013: finishing write tid 2 to trial18843701-47 2026-02-13T20:25:02.472 INFO:tasks.rados.rados.0.trial188.stdout:3013: finishing write tid 3 to trial18843701-47 2026-02-13T20:25:02.472 INFO:tasks.rados.rados.0.trial188.stdout:3013: finishing write tid 4 to trial18843701-47 2026-02-13T20:25:02.472 INFO:tasks.rados.rados.0.trial188.stdout:3014: done (4 left) 2026-02-13T20:25:02.472 INFO:tasks.rados.rados.0.trial188.stdout:3015: done (3 left) 2026-02-13T20:25:02.472 INFO:tasks.rados.rados.0.trial188.stdout:3018: copy_from oid 42 from oid 25 current snap is 314 2026-02-13T20:25:02.472 INFO:tasks.rados.rados.0.trial188.stdout:3013: finishing write tid 5 to trial18843701-47 2026-02-13T20:25:02.472 INFO:tasks.rados.rados.0.trial188.stdout:3013: oid 47 updating version 0 to 1072 2026-02-13T20:25:02.472 INFO:tasks.rados.rados.0.trial188.stdout:3013: oid 47 version 1072 is already newer than 1070 2026-02-13T20:25:02.472 INFO:tasks.rados.rados.0.trial188.stdout:3013: oid 47 version 1072 is already newer than 1071 2026-02-13T20:25:02.472 INFO:tasks.rados.rados.0.trial188.stdout:3013: oid 47 updating version 1072 to 1073 2026-02-13T20:25:02.472 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 47 v 1073 (ObjNum 1041 snap 314 seq_num 1041) dirty exists 2026-02-13T20:25:02.473 INFO:tasks.rados.rados.0.trial188.stdout:3013: left oid 47 (ObjNum 1041 snap 314 seq_num 1041) 2026-02-13T20:25:02.473 INFO:tasks.rados.rados.0.trial188.stdout:3016: finishing write tid 1 to trial18843701-48 2026-02-13T20:25:02.473 INFO:tasks.rados.rados.0.trial188.stdout:3016: finishing write tid 2 to trial18843701-48 2026-02-13T20:25:02.473 INFO:tasks.rados.rados.0.trial188.stdout:3016: finishing write tid 3 to trial18843701-48 2026-02-13T20:25:02.473 INFO:tasks.rados.rados.0.trial188.stdout:3016: finishing write tid 4 to trial18843701-48 2026-02-13T20:25:02.473 INFO:tasks.rados.rados.0.trial188.stdout:3016: finishing write tid 5 to trial18843701-48 2026-02-13T20:25:02.473 INFO:tasks.rados.rados.0.trial188.stdout:3016: oid 48 updating version 0 to 985 2026-02-13T20:25:02.473 INFO:tasks.rados.rados.0.trial188.stdout:3016: oid 48 updating version 985 to 986 2026-02-13T20:25:02.473 INFO:tasks.rados.rados.0.trial188.stdout:3016: oid 48 version 986 is already newer than 984 2026-02-13T20:25:02.473 INFO:tasks.rados.rados.0.trial188.stdout:3016: oid 48 updating version 986 to 987 2026-02-13T20:25:02.473 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 48 v 987 (ObjNum 1042 snap 314 seq_num 1042) dirty exists 2026-02-13T20:25:02.473 INFO:tasks.rados.rados.0.trial188.stdout:3016: left oid 48 (ObjNum 1042 snap 314 seq_num 1042) 2026-02-13T20:25:02.473 INFO:tasks.rados.rados.0.trial188.stdout:3017: finishing copy_from racing read to trial18843701-9 2026-02-13T20:25:02.473 INFO:tasks.rados.rados.0.trial188.stdout:3017: finishing copy_from to trial18843701-9 2026-02-13T20:25:02.473 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 9 v 1016 (ObjNum 751 snap 222 seq_num 751) dirty exists 2026-02-13T20:25:02.473 INFO:tasks.rados.rados.0.trial188.stdout:3013: done (3 left) 2026-02-13T20:25:02.473 INFO:tasks.rados.rados.0.trial188.stdout:3016: done (2 left) 2026-02-13T20:25:02.473 INFO:tasks.rados.rados.0.trial188.stdout:3017: done (1 left) 2026-02-13T20:25:02.473 INFO:tasks.rados.rados.0.trial188.stdout:3019: rollback oid 50 current snap is 314 2026-02-13T20:25:02.473 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 50 to 291 2026-02-13T20:25:02.473 INFO:tasks.rados.rados.0.trial188.stdout:3020: snap_remove snap 313 2026-02-13T20:25:03.264 INFO:tasks.rados.rados.0.trial188.stdout:3020: done (2 left) 2026-02-13T20:25:03.265 INFO:tasks.rados.rados.0.trial188.stdout:3021: copy_from oid 11 from oid 18 current snap is 314 2026-02-13T20:25:03.265 INFO:tasks.rados.rados.0.trial188.stdout:3019: finishing rollback tid 0 to trial18843701-50 2026-02-13T20:25:03.265 INFO:tasks.rados.rados.0.trial188.stdout:3019: finishing rollback tid 1 to trial18843701-50 2026-02-13T20:25:03.265 INFO:tasks.rados.rados.0.trial188.stdout:3019: finishing rollback tid 2 to trial18843701-50 2026-02-13T20:25:03.265 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 50 v 1539 (ObjNum 724 snap 214 seq_num 724) dirty exists 2026-02-13T20:25:03.265 INFO:tasks.rados.rados.0.trial188.stdout:3018: finishing copy_from racing read to trial18843701-42 2026-02-13T20:25:03.265 INFO:tasks.rados.rados.0.trial188.stdout:3018: finishing copy_from to trial18843701-42 2026-02-13T20:25:03.265 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 42 v 1414 (ObjNum 756 snap 223 seq_num 756) dirty exists 2026-02-13T20:25:03.265 INFO:tasks.rados.rados.0.trial188.stdout:3018: done (2 left) 2026-02-13T20:25:03.265 INFO:tasks.rados.rados.0.trial188.stdout:3019: done (1 left) 2026-02-13T20:25:03.265 INFO:tasks.rados.rados.0.trial188.stdout:3022: read oid 41 snap -1 2026-02-13T20:25:03.266 INFO:tasks.rados.rados.0.trial188.stdout:3022: expect deleted 2026-02-13T20:25:03.266 INFO:tasks.rados.rados.0.trial188.stdout:3023: snap_remove snap 310 2026-02-13T20:25:04.267 INFO:tasks.rados.rados.0.trial188.stdout:3023: done (2 left) 2026-02-13T20:25:04.267 INFO:tasks.rados.rados.0.trial188.stdout:3024: read oid 35 snap -1 2026-02-13T20:25:04.267 INFO:tasks.rados.rados.0.trial188.stdout:3024: expect (ObjNum 1024 snap 307 seq_num 1024) 2026-02-13T20:25:04.267 INFO:tasks.rados.rados.0.trial188.stdout:3025: snap_remove snap 308 2026-02-13T20:25:05.268 INFO:tasks.rados.rados.0.trial188.stdout:3025: done (3 left) 2026-02-13T20:25:05.268 INFO:tasks.rados.rados.0.trial188.stdout:3026: read oid 29 snap -1 2026-02-13T20:25:05.268 INFO:tasks.rados.rados.0.trial188.stdout:3026: expect (ObjNum 1013 snap 303 seq_num 1013) 2026-02-13T20:25:05.268 INFO:tasks.rados.rados.0.trial188.stdout:3027: snap_remove snap 303 2026-02-13T20:25:06.270 INFO:tasks.rados.rados.0.trial188.stdout:3027: done (4 left) 2026-02-13T20:25:06.270 INFO:tasks.rados.rados.0.trial188.stdout:3028: write oid 34 current snap is 314 2026-02-13T20:25:06.270 INFO:tasks.rados.rados.0.trial188.stdout:3028: seq_num 1043 ranges {729701=425068,1667072=652028,2909005=485180} 2026-02-13T20:25:06.275 INFO:tasks.rados.rados.0.trial188.stdout:3028: writing trial18843701-34 from 729701 to 1154769 tid 1 2026-02-13T20:25:06.280 INFO:tasks.rados.rados.0.trial188.stdout:3028: writing trial18843701-34 from 1667072 to 2319100 tid 2 2026-02-13T20:25:06.284 INFO:tasks.rados.rados.0.trial188.stdout:3028: writing trial18843701-34 from 2909005 to 3394185 tid 3 2026-02-13T20:25:06.284 INFO:tasks.rados.rados.0.trial188.stdout:3029: delete oid 23 current snap is 314 2026-02-13T20:25:06.284 INFO:tasks.rados.rados.0.trial188.stdout:3021: finishing copy_from racing read to trial18843701-11 2026-02-13T20:25:06.284 INFO:tasks.rados.rados.0.trial188.stdout:3021: finishing copy_from to trial18843701-11 2026-02-13T20:25:06.284 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 11 v 1083 (ObjNum 1025 snap 307 seq_num 1025) dirty exists 2026-02-13T20:25:06.284 INFO:tasks.rados.rados.0.trial188.stdout:3024: expect (ObjNum 1024 snap 307 seq_num 1024) 2026-02-13T20:25:06.332 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 11341 2026-02-13T20:25:06.438 INFO:tasks.rados.rados.0.trial188.stdout:3026: expect (ObjNum 1013 snap 303 seq_num 1013) 2026-02-13T20:25:06.438 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:25:06.478 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1030597 2026-02-13T20:25:06.538 INFO:tasks.rados.rados.0.trial188.stdout:3028: finishing write tid 1 to trial18843701-34 2026-02-13T20:25:06.538 INFO:tasks.rados.rados.0.trial188.stdout:3028: finishing write tid 2 to trial18843701-34 2026-02-13T20:25:06.538 INFO:tasks.rados.rados.0.trial188.stdout:3028: finishing write tid 3 to trial18843701-34 2026-02-13T20:25:06.538 INFO:tasks.rados.rados.0.trial188.stdout:3021: done (5 left) 2026-02-13T20:25:06.538 INFO:tasks.rados.rados.0.trial188.stdout:3022: done (4 left) 2026-02-13T20:25:06.538 INFO:tasks.rados.rados.0.trial188.stdout:3024: done (3 left) 2026-02-13T20:25:06.539 INFO:tasks.rados.rados.0.trial188.stdout:3026: done (2 left) 2026-02-13T20:25:06.539 INFO:tasks.rados.rados.0.trial188.stdout:3029: done (1 left) 2026-02-13T20:25:06.539 INFO:tasks.rados.rados.0.trial188.stdout:3030: delete oid 40 current snap is 314 2026-02-13T20:25:06.539 INFO:tasks.rados.rados.0.trial188.stdout:3028: finishing write tid 4 to trial18843701-34 2026-02-13T20:25:06.539 INFO:tasks.rados.rados.0.trial188.stdout:3028: finishing write tid 5 to trial18843701-34 2026-02-13T20:25:06.539 INFO:tasks.rados.rados.0.trial188.stdout:3028: oid 34 updating version 0 to 1517 2026-02-13T20:25:06.539 INFO:tasks.rados.rados.0.trial188.stdout:3028: oid 34 updating version 1517 to 1518 2026-02-13T20:25:06.539 INFO:tasks.rados.rados.0.trial188.stdout:3028: oid 34 updating version 1518 to 1519 2026-02-13T20:25:06.539 INFO:tasks.rados.rados.0.trial188.stdout:3028: oid 34 updating version 1519 to 1520 2026-02-13T20:25:06.540 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 34 v 1520 (ObjNum 1043 snap 314 seq_num 1043) dirty exists 2026-02-13T20:25:06.540 INFO:tasks.rados.rados.0.trial188.stdout:3028: left oid 34 (ObjNum 1043 snap 314 seq_num 1043) 2026-02-13T20:25:06.541 INFO:tasks.rados.rados.0.trial188.stdout:3028: done (1 left) 2026-02-13T20:25:06.541 INFO:tasks.rados.rados.0.trial188.stdout:3030: done (0 left) 2026-02-13T20:25:06.541 INFO:tasks.rados.rados.0.trial188.stdout:3031: delete oid 30 current snap is 314 2026-02-13T20:25:06.541 INFO:tasks.rados.rados.0.trial188.stdout:3031: done (0 left) 2026-02-13T20:25:06.541 INFO:tasks.rados.rados.0.trial188.stdout:3032: copy_from oid 9 from oid 26 current snap is 314 2026-02-13T20:25:06.541 INFO:tasks.rados.rados.0.trial188.stdout:3033: delete oid 13 current snap is 314 2026-02-13T20:25:06.542 INFO:tasks.rados.rados.0.trial188.stdout:3033: done (1 left) 2026-02-13T20:25:06.542 INFO:tasks.rados.rados.0.trial188.stdout:3034: snap_remove snap 311 2026-02-13T20:25:07.247 INFO:tasks.rados.rados.0.trial188.stdout:3034: done (1 left) 2026-02-13T20:25:07.247 INFO:tasks.rados.rados.0.trial188.stdout:3035: rollback oid 8 current snap is 314 2026-02-13T20:25:07.248 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 8 to 291 2026-02-13T20:25:07.248 INFO:tasks.rados.rados.0.trial188.stdout:3032: finishing copy_from racing read to trial18843701-9 2026-02-13T20:25:07.248 INFO:tasks.rados.rados.0.trial188.stdout:3032: finishing copy_from to trial18843701-9 2026-02-13T20:25:07.248 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 9 v 996 (ObjNum 1003 snap 299 seq_num 1003) dirty exists 2026-02-13T20:25:07.248 INFO:tasks.rados.rados.0.trial188.stdout:3032: done (1 left) 2026-02-13T20:25:07.248 INFO:tasks.rados.rados.0.trial188.stdout:3036: write oid 28 current snap is 314 2026-02-13T20:25:07.248 INFO:tasks.rados.rados.0.trial188.stdout:3036: seq_num 1048 ranges {413736=401313,1326776=403024,2413414=457893,3438716=175020} 2026-02-13T20:25:07.251 INFO:tasks.rados.rados.0.trial188.stdout:3036: writing trial18843701-28 from 413736 to 815049 tid 1 2026-02-13T20:25:07.255 INFO:tasks.rados.rados.0.trial188.stdout:3036: writing trial18843701-28 from 1326776 to 1729800 tid 2 2026-02-13T20:25:07.259 INFO:tasks.rados.rados.0.trial188.stdout:3036: writing trial18843701-28 from 2413414 to 2871307 tid 3 2026-02-13T20:25:07.262 INFO:tasks.rados.rados.0.trial188.stdout:3036: writing trial18843701-28 from 3438716 to 3613736 tid 4 2026-02-13T20:25:07.262 INFO:tasks.rados.rados.0.trial188.stdout:3037: write (excl) oid 36 current snap is 314 2026-02-13T20:25:07.262 INFO:tasks.rados.rados.0.trial188.stdout:3037: seq_num 1049 ranges {430543=476562,1385258=663035,2840837=669165} 2026-02-13T20:25:07.265 INFO:tasks.rados.rados.0.trial188.stdout:3037: writing trial18843701-36 from 430543 to 907105 tid 1 2026-02-13T20:25:07.270 INFO:tasks.rados.rados.0.trial188.stdout:3037: writing trial18843701-36 from 1385258 to 2048293 tid 2 2026-02-13T20:25:07.275 INFO:tasks.rados.rados.0.trial188.stdout:3037: writing trial18843701-36 from 2840837 to 3510002 tid 3 2026-02-13T20:25:07.276 INFO:tasks.rados.rados.0.trial188.stdout:3038: read oid 6 snap -1 2026-02-13T20:25:07.276 INFO:tasks.rados.rados.0.trial188.stdout:3038: expect (ObjNum 976 snap 290 seq_num 976) 2026-02-13T20:25:07.276 INFO:tasks.rados.rados.0.trial188.stdout:3039: snap_remove snap 299 2026-02-13T20:25:08.276 INFO:tasks.rados.rados.0.trial188.stdout:3039: done (4 left) 2026-02-13T20:25:08.277 INFO:tasks.rados.rados.0.trial188.stdout:3040: write (excl) oid 4 current snap is 314 2026-02-13T20:25:08.277 INFO:tasks.rados.rados.0.trial188.stdout:3040: seq_num 1050 ranges {447350=668164,1560093=406693,2584613=480437} 2026-02-13T20:25:08.281 INFO:tasks.rados.rados.0.trial188.stdout:3040: writing trial18843701-4 from 447350 to 1115514 tid 1 2026-02-13T20:25:08.284 INFO:tasks.rados.rados.0.trial188.stdout:3040: writing trial18843701-4 from 1560093 to 1966786 tid 2 2026-02-13T20:25:08.290 INFO:tasks.rados.rados.0.trial188.stdout:3040: writing trial18843701-4 from 2584613 to 3065050 tid 3 2026-02-13T20:25:08.291 INFO:tasks.rados.rados.0.trial188.stdout:3041: copy_from oid 27 from oid 32 current snap is 314 2026-02-13T20:25:08.291 INFO:tasks.rados.rados.0.trial188.stdout:3035: finishing rollback tid 0 to trial18843701-8 2026-02-13T20:25:08.291 INFO:tasks.rados.rados.0.trial188.stdout:3035: finishing rollback tid 1 to trial18843701-8 2026-02-13T20:25:08.291 INFO:tasks.rados.rados.0.trial188.stdout:3035: finishing rollback tid 2 to trial18843701-8 2026-02-13T20:25:08.291 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 8 v 1526 (ObjNum 950 snap 282 seq_num 950) dirty exists 2026-02-13T20:25:08.291 INFO:tasks.rados.rados.0.trial188.stdout:3035: done (5 left) 2026-02-13T20:25:08.292 INFO:tasks.rados.rados.0.trial188.stdout:3042: copy_from oid 24 from oid 19 current snap is 314 2026-02-13T20:25:08.292 INFO:tasks.rados.rados.0.trial188.stdout:3036: finishing write tid 1 to trial18843701-28 2026-02-13T20:25:08.292 INFO:tasks.rados.rados.0.trial188.stdout:3036: finishing write tid 2 to trial18843701-28 2026-02-13T20:25:08.292 INFO:tasks.rados.rados.0.trial188.stdout:3036: finishing write tid 3 to trial18843701-28 2026-02-13T20:25:08.292 INFO:tasks.rados.rados.0.trial188.stdout:3037: finishing write tid 1 to trial18843701-36 2026-02-13T20:25:08.292 INFO:tasks.rados.rados.0.trial188.stdout:3036: finishing write tid 4 to trial18843701-28 2026-02-13T20:25:08.293 INFO:tasks.rados.rados.0.trial188.stdout:3036: finishing write tid 5 to trial18843701-28 2026-02-13T20:25:08.293 INFO:tasks.rados.rados.0.trial188.stdout:3037: finishing write tid 2 to trial18843701-36 2026-02-13T20:25:08.293 INFO:tasks.rados.rados.0.trial188.stdout:3036: finishing write tid 6 to trial18843701-28 2026-02-13T20:25:08.293 INFO:tasks.rados.rados.0.trial188.stdout:3036: oid 28 updating version 0 to 1532 2026-02-13T20:25:08.293 INFO:tasks.rados.rados.0.trial188.stdout:3036: oid 28 version 1532 is already newer than 1528 2026-02-13T20:25:08.293 INFO:tasks.rados.rados.0.trial188.stdout:3036: oid 28 version 1532 is already newer than 1531 2026-02-13T20:25:08.294 INFO:tasks.rados.rados.0.trial188.stdout:3036: oid 28 version 1532 is already newer than 1530 2026-02-13T20:25:08.294 INFO:tasks.rados.rados.0.trial188.stdout:3036: oid 28 version 1532 is already newer than 1529 2026-02-13T20:25:08.294 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 28 v 1532 (ObjNum 1048 snap 314 seq_num 1048) dirty exists 2026-02-13T20:25:08.294 INFO:tasks.rados.rados.0.trial188.stdout:3036: left oid 28 (ObjNum 1048 snap 314 seq_num 1048) 2026-02-13T20:25:08.294 INFO:tasks.rados.rados.0.trial188.stdout:3038: expect (ObjNum 976 snap 290 seq_num 976) 2026-02-13T20:25:08.314 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:25:08.374 INFO:tasks.rados.rados.0.trial188.stdout:3037: finishing write tid 3 to trial18843701-36 2026-02-13T20:25:08.374 INFO:tasks.rados.rados.0.trial188.stdout:3036: done (5 left) 2026-02-13T20:25:08.374 INFO:tasks.rados.rados.0.trial188.stdout:3038: done (4 left) 2026-02-13T20:25:08.374 INFO:tasks.rados.rados.0.trial188.stdout:3043: rollback oid 7 current snap is 314 2026-02-13T20:25:08.374 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 7 to 291 2026-02-13T20:25:08.374 INFO:tasks.rados.rados.0.trial188.stdout:3037: finishing write tid 4 to trial18843701-36 2026-02-13T20:25:08.375 INFO:tasks.rados.rados.0.trial188.stdout:3037: finishing write tid 5 to trial18843701-36 2026-02-13T20:25:08.375 INFO:tasks.rados.rados.0.trial188.stdout:3037: oid 36 updating version 0 to 1561 2026-02-13T20:25:08.375 INFO:tasks.rados.rados.0.trial188.stdout:3037: oid 36 updating version 1561 to 1562 2026-02-13T20:25:08.375 INFO:tasks.rados.rados.0.trial188.stdout:3037: oid 36 version 1562 is already newer than 1560 2026-02-13T20:25:08.375 INFO:tasks.rados.rados.0.trial188.stdout:3037: oid 36 version 1562 is already newer than 1559 2026-02-13T20:25:08.375 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 36 v 1562 (ObjNum 1049 snap 314 seq_num 1049) dirty exists 2026-02-13T20:25:08.375 INFO:tasks.rados.rados.0.trial188.stdout:3037: left oid 36 (ObjNum 1049 snap 314 seq_num 1049) 2026-02-13T20:25:08.375 INFO:tasks.rados.rados.0.trial188.stdout:3040: finishing write tid 1 to trial18843701-4 2026-02-13T20:25:08.375 INFO:tasks.rados.rados.0.trial188.stdout:3041: finishing copy_from racing read to trial18843701-27 2026-02-13T20:25:08.375 INFO:tasks.rados.rados.0.trial188.stdout:3041: finishing copy_from to trial18843701-27 2026-02-13T20:25:08.375 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 27 v 1332 (ObjNum 872 snap 255 seq_num 872) dirty exists 2026-02-13T20:25:08.375 INFO:tasks.rados.rados.0.trial188.stdout:3042: finishing copy_from racing read to trial18843701-24 2026-02-13T20:25:08.376 INFO:tasks.rados.rados.0.trial188.stdout:3040: finishing write tid 2 to trial18843701-4 2026-02-13T20:25:08.376 INFO:tasks.rados.rados.0.trial188.stdout:3040: finishing write tid 3 to trial18843701-4 2026-02-13T20:25:08.376 INFO:tasks.rados.rados.0.trial188.stdout:3040: finishing write tid 4 to trial18843701-4 2026-02-13T20:25:08.376 INFO:tasks.rados.rados.0.trial188.stdout:3040: finishing write tid 5 to trial18843701-4 2026-02-13T20:25:08.376 INFO:tasks.rados.rados.0.trial188.stdout:3040: oid 4 updating version 0 to 1085 2026-02-13T20:25:08.376 INFO:tasks.rados.rados.0.trial188.stdout:3040: oid 4 updating version 1085 to 1086 2026-02-13T20:25:08.376 INFO:tasks.rados.rados.0.trial188.stdout:3040: oid 4 updating version 1086 to 1087 2026-02-13T20:25:08.376 INFO:tasks.rados.rados.0.trial188.stdout:3040: oid 4 version 1087 is already newer than 1084 2026-02-13T20:25:08.376 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 4 v 1087 (ObjNum 1050 snap 314 seq_num 1050) dirty exists 2026-02-13T20:25:08.376 INFO:tasks.rados.rados.0.trial188.stdout:3040: left oid 4 (ObjNum 1050 snap 314 seq_num 1050) 2026-02-13T20:25:08.376 INFO:tasks.rados.rados.0.trial188.stdout:3042: finishing copy_from to trial18843701-24 2026-02-13T20:25:08.376 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 24 v 1448 (ObjNum 1039 snap 313 seq_num 1039) dirty exists 2026-02-13T20:25:08.377 INFO:tasks.rados.rados.0.trial188.stdout:3037: done (4 left) 2026-02-13T20:25:08.377 INFO:tasks.rados.rados.0.trial188.stdout:3040: done (3 left) 2026-02-13T20:25:08.377 INFO:tasks.rados.rados.0.trial188.stdout:3041: done (2 left) 2026-02-13T20:25:08.377 INFO:tasks.rados.rados.0.trial188.stdout:3042: done (1 left) 2026-02-13T20:25:08.377 INFO:tasks.rados.rados.0.trial188.stdout:3044: write oid 4 current snap is 314 2026-02-13T20:25:08.377 INFO:tasks.rados.rados.0.trial188.stdout:3044: seq_num 1051 ranges {464157=743413,1618575=666704,3012036=408062} 2026-02-13T20:25:08.378 INFO:tasks.rados.rados.0.trial188.stdout:3044: writing trial18843701-4 from 464157 to 1207570 tid 1 2026-02-13T20:25:08.382 INFO:tasks.rados.rados.0.trial188.stdout:3044: writing trial18843701-4 from 1618575 to 2285279 tid 2 2026-02-13T20:25:08.386 INFO:tasks.rados.rados.0.trial188.stdout:3044: writing trial18843701-4 from 3012036 to 3420098 tid 3 2026-02-13T20:25:08.386 INFO:tasks.rados.rados.0.trial188.stdout:3045: snap_remove snap 312 2026-02-13T20:25:09.280 INFO:tasks.rados.rados.0.trial188.stdout:3045: done (2 left) 2026-02-13T20:25:09.280 INFO:tasks.rados.rados.0.trial188.stdout:3046: delete oid 44 current snap is 314 2026-02-13T20:25:09.280 INFO:tasks.rados.rados.0.trial188.stdout:3043: finishing rollback tid 0 to trial18843701-7 2026-02-13T20:25:09.280 INFO:tasks.rados.rados.0.trial188.stdout:3043: finishing rollback tid 1 to trial18843701-7 2026-02-13T20:25:09.280 INFO:tasks.rados.rados.0.trial188.stdout:3043: finishing rollback tid 2 to trial18843701-7 2026-02-13T20:25:09.280 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 7 v 1455 (ObjNum 952 snap 283 seq_num 952) dirty exists 2026-02-13T20:25:09.280 INFO:tasks.rados.rados.0.trial188.stdout:3044: finishing write tid 1 to trial18843701-4 2026-02-13T20:25:09.280 INFO:tasks.rados.rados.0.trial188.stdout:3044: finishing write tid 2 to trial18843701-4 2026-02-13T20:25:09.280 INFO:tasks.rados.rados.0.trial188.stdout:3044: finishing write tid 3 to trial18843701-4 2026-02-13T20:25:09.280 INFO:tasks.rados.rados.0.trial188.stdout:3044: finishing write tid 4 to trial18843701-4 2026-02-13T20:25:09.281 INFO:tasks.rados.rados.0.trial188.stdout:3044: finishing write tid 5 to trial18843701-4 2026-02-13T20:25:09.281 INFO:tasks.rados.rados.0.trial188.stdout:3044: oid 4 updating version 0 to 1091 2026-02-13T20:25:09.281 INFO:tasks.rados.rados.0.trial188.stdout:3044: oid 4 version 1091 is already newer than 1088 2026-02-13T20:25:09.281 INFO:tasks.rados.rados.0.trial188.stdout:3044: oid 4 version 1091 is already newer than 1089 2026-02-13T20:25:09.281 INFO:tasks.rados.rados.0.trial188.stdout:3044: oid 4 version 1091 is already newer than 1090 2026-02-13T20:25:09.281 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 4 v 1091 (ObjNum 1051 snap 314 seq_num 1051) dirty exists 2026-02-13T20:25:09.281 INFO:tasks.rados.rados.0.trial188.stdout:3044: left oid 4 (ObjNum 1051 snap 314 seq_num 1051) 2026-02-13T20:25:09.283 INFO:tasks.rados.rados.0.trial188.stdout:3043: done (2 left) 2026-02-13T20:25:09.283 INFO:tasks.rados.rados.0.trial188.stdout:3044: done (1 left) 2026-02-13T20:25:09.283 INFO:tasks.rados.rados.0.trial188.stdout:3046: done (0 left) 2026-02-13T20:25:09.283 INFO:tasks.rados.rados.0.trial188.stdout:3047: snap_remove snap 291 2026-02-13T20:25:10.285 INFO:tasks.rados.rados.0.trial188.stdout:3047: done (0 left) 2026-02-13T20:25:10.285 INFO:tasks.rados.rados.0.trial188.stdout:3048: copy_from oid 22 from oid 33 current snap is 314 2026-02-13T20:25:10.285 INFO:tasks.rados.rados.0.trial188.stdout:3049: write (excl) oid 4 current snap is 314 2026-02-13T20:25:10.286 INFO:tasks.rados.rados.0.trial188.stdout:3049: seq_num 1053 ranges {497771=493911,1619186=554020,2950529=430606} 2026-02-13T20:25:10.288 INFO:tasks.rados.rados.0.trial188.stdout:3049: writing trial18843701-4 from 497771 to 991682 tid 1 2026-02-13T20:25:10.293 INFO:tasks.rados.rados.0.trial188.stdout:3049: writing trial18843701-4 from 1619186 to 2173206 tid 2 2026-02-13T20:25:10.299 INFO:tasks.rados.rados.0.trial188.stdout:3049: writing trial18843701-4 from 2950529 to 3381135 tid 3 2026-02-13T20:25:10.300 INFO:tasks.rados.rados.0.trial188.stdout:3050: write (excl) oid 32 current snap is 314 2026-02-13T20:25:10.300 INFO:tasks.rados.rados.0.trial188.stdout:3050: seq_num 1054 ranges {514578=569160,1677668=414031,2577952=641878} 2026-02-13T20:25:10.303 INFO:tasks.rados.rados.0.trial188.stdout:3050: writing trial18843701-32 from 514578 to 1083738 tid 1 2026-02-13T20:25:10.307 INFO:tasks.rados.rados.0.trial188.stdout:3050: writing trial18843701-32 from 1677668 to 2091699 tid 2 2026-02-13T20:25:10.311 INFO:tasks.rados.rados.0.trial188.stdout:3050: writing trial18843701-32 from 2577952 to 3219830 tid 3 2026-02-13T20:25:10.311 INFO:tasks.rados.rados.0.trial188.stdout:3051: rollback oid 42 current snap is 314 2026-02-13T20:25:10.312 INFO:tasks.rados.rados.0.trial188.stdout:3051: done (3 left) 2026-02-13T20:25:10.312 INFO:tasks.rados.rados.0.trial188.stdout:3052: snap_create 2026-02-13T20:25:10.317 INFO:tasks.rados.rados.0.trial188.stdout:3049: finishing write tid 1 to trial18843701-4 2026-02-13T20:25:10.317 INFO:tasks.rados.rados.0.trial188.stdout:3049: finishing write tid 2 to trial18843701-4 2026-02-13T20:25:10.318 INFO:tasks.rados.rados.0.trial188.stdout:3049: finishing write tid 3 to trial18843701-4 2026-02-13T20:25:10.319 INFO:tasks.rados.rados.0.trial188.stdout:3049: finishing write tid 4 to trial18843701-4 2026-02-13T20:25:10.319 INFO:tasks.rados.rados.0.trial188.stdout:3049: finishing write tid 5 to trial18843701-4 2026-02-13T20:25:10.319 INFO:tasks.rados.rados.0.trial188.stdout:3049: oid 4 updating version 0 to 1092 2026-02-13T20:25:10.319 INFO:tasks.rados.rados.0.trial188.stdout:3049: oid 4 updating version 1092 to 1094 2026-02-13T20:25:10.319 INFO:tasks.rados.rados.0.trial188.stdout:3049: oid 4 updating version 1094 to 1095 2026-02-13T20:25:10.319 INFO:tasks.rados.rados.0.trial188.stdout:3049: oid 4 version 1095 is already newer than 1093 2026-02-13T20:25:10.319 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 4 v 1095 (ObjNum 1053 snap 314 seq_num 1053) dirty exists 2026-02-13T20:25:10.319 INFO:tasks.rados.rados.0.trial188.stdout:3049: left oid 4 (ObjNum 1053 snap 314 seq_num 1053) 2026-02-13T20:25:10.322 INFO:tasks.rados.rados.0.trial188.stdout:3048: finishing copy_from racing read to trial18843701-22 2026-02-13T20:25:10.328 INFO:tasks.rados.rados.0.trial188.stdout:3050: finishing write tid 1 to trial18843701-32 2026-02-13T20:25:10.331 INFO:tasks.rados.rados.0.trial188.stdout:3048: finishing copy_from to trial18843701-22 2026-02-13T20:25:10.331 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 22 v 1069 (ObjNum 1004 snap 299 seq_num 1004) dirty exists 2026-02-13T20:25:10.332 INFO:tasks.rados.rados.0.trial188.stdout:3050: finishing write tid 2 to trial18843701-32 2026-02-13T20:25:10.332 INFO:tasks.rados.rados.0.trial188.stdout:3050: finishing write tid 3 to trial18843701-32 2026-02-13T20:25:10.332 INFO:tasks.rados.rados.0.trial188.stdout:3050: finishing write tid 4 to trial18843701-32 2026-02-13T20:25:10.332 INFO:tasks.rados.rados.0.trial188.stdout:3050: finishing write tid 5 to trial18843701-32 2026-02-13T20:25:10.332 INFO:tasks.rados.rados.0.trial188.stdout:3050: oid 32 updating version 0 to 1351 2026-02-13T20:25:10.332 INFO:tasks.rados.rados.0.trial188.stdout:3050: oid 32 version 1351 is already newer than 1350 2026-02-13T20:25:10.332 INFO:tasks.rados.rados.0.trial188.stdout:3050: oid 32 version 1351 is already newer than 1349 2026-02-13T20:25:10.332 INFO:tasks.rados.rados.0.trial188.stdout:3050: oid 32 version 1351 is already newer than 1348 2026-02-13T20:25:10.332 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 32 v 1351 (ObjNum 1054 snap 314 seq_num 1054) dirty exists 2026-02-13T20:25:10.332 INFO:tasks.rados.rados.0.trial188.stdout:3050: left oid 32 (ObjNum 1054 snap 314 seq_num 1054) 2026-02-13T20:25:11.289 INFO:tasks.rados.rados.0.trial188.stdout:3048: done (3 left) 2026-02-13T20:25:11.289 INFO:tasks.rados.rados.0.trial188.stdout:3049: done (2 left) 2026-02-13T20:25:11.289 INFO:tasks.rados.rados.0.trial188.stdout:3050: done (1 left) 2026-02-13T20:25:11.289 INFO:tasks.rados.rados.0.trial188.stdout:3052: done (0 left) 2026-02-13T20:25:11.289 INFO:tasks.rados.rados.0.trial188.stdout:3053: read oid 23 snap -1 2026-02-13T20:25:11.290 INFO:tasks.rados.rados.0.trial188.stdout:3053: expect deleted 2026-02-13T20:25:11.290 INFO:tasks.rados.rados.0.trial188.stdout:3054: snap_remove snap 314 2026-02-13T20:25:12.248 INFO:tasks.rados.rados.0.trial188.stdout:3054: done (1 left) 2026-02-13T20:25:12.248 INFO:tasks.rados.rados.0.trial188.stdout:3055: rollback oid 30 current snap is 315 2026-02-13T20:25:12.248 INFO:tasks.rados.rados.0.trial188.stdout:3055: done (1 left) 2026-02-13T20:25:12.249 INFO:tasks.rados.rados.0.trial188.stdout:3056: rollback oid 20 current snap is 315 2026-02-13T20:25:12.249 INFO:tasks.rados.rados.0.trial188.stdout:3056: done (1 left) 2026-02-13T20:25:12.249 INFO:tasks.rados.rados.0.trial188.stdout:3057: copy_from oid 4 from oid 50 current snap is 315 2026-02-13T20:25:12.249 INFO:tasks.rados.rados.0.trial188.stdout:3053: done (1 left) 2026-02-13T20:25:12.249 INFO:tasks.rados.rados.0.trial188.stdout:3058: read oid 1 snap -1 2026-02-13T20:25:12.249 INFO:tasks.rados.rados.0.trial188.stdout:3058: expect (ObjNum 873 snap 255 seq_num 873) 2026-02-13T20:25:12.249 INFO:tasks.rados.rados.0.trial188.stdout:3059: write (excl) oid 7 current snap is 315 2026-02-13T20:25:12.249 INFO:tasks.rados.rados.0.trial188.stdout:3059: seq_num 1055 ranges {531385=644409,1736150=557689,3005375=569503} 2026-02-13T20:25:12.252 INFO:tasks.rados.rados.0.trial188.stdout:3059: writing trial18843701-7 from 531385 to 1175794 tid 1 2026-02-13T20:25:12.256 INFO:tasks.rados.rados.0.trial188.stdout:3059: writing trial18843701-7 from 1736150 to 2293839 tid 2 2026-02-13T20:25:12.261 INFO:tasks.rados.rados.0.trial188.stdout:3059: writing trial18843701-7 from 3005375 to 3574878 tid 3 2026-02-13T20:25:12.262 INFO:tasks.rados.rados.0.trial188.stdout:3060: snap_create 2026-02-13T20:25:12.262 INFO:tasks.rados.rados.0.trial188.stdout:3058: expect (ObjNum 873 snap 255 seq_num 873) 2026-02-13T20:25:12.264 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1280762 2026-02-13T20:25:12.277 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:25:12.315 INFO:tasks.rados.rados.0.trial188.stdout:3059: finishing write tid 1 to trial18843701-7 2026-02-13T20:25:12.315 INFO:tasks.rados.rados.0.trial188.stdout:3057: finishing copy_from racing read to trial18843701-4 2026-02-13T20:25:12.315 INFO:tasks.rados.rados.0.trial188.stdout:3057: finishing copy_from to trial18843701-4 2026-02-13T20:25:12.316 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 4 v 1539 (ObjNum 724 snap 214 seq_num 724) dirty exists 2026-02-13T20:25:12.316 INFO:tasks.rados.rados.0.trial188.stdout:3059: finishing write tid 2 to trial18843701-7 2026-02-13T20:25:12.316 INFO:tasks.rados.rados.0.trial188.stdout:3059: finishing write tid 3 to trial18843701-7 2026-02-13T20:25:12.316 INFO:tasks.rados.rados.0.trial188.stdout:3059: finishing write tid 4 to trial18843701-7 2026-02-13T20:25:12.316 INFO:tasks.rados.rados.0.trial188.stdout:3059: finishing write tid 5 to trial18843701-7 2026-02-13T20:25:12.316 INFO:tasks.rados.rados.0.trial188.stdout:3059: oid 7 updating version 0 to 1456 2026-02-13T20:25:12.316 INFO:tasks.rados.rados.0.trial188.stdout:3059: oid 7 updating version 1456 to 1457 2026-02-13T20:25:12.316 INFO:tasks.rados.rados.0.trial188.stdout:3059: oid 7 updating version 1457 to 1459 2026-02-13T20:25:12.316 INFO:tasks.rados.rados.0.trial188.stdout:3059: oid 7 version 1459 is already newer than 1458 2026-02-13T20:25:12.316 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 7 v 1459 (ObjNum 1055 snap 315 seq_num 1055) dirty exists 2026-02-13T20:25:12.316 INFO:tasks.rados.rados.0.trial188.stdout:3059: left oid 7 (ObjNum 1055 snap 315 seq_num 1055) 2026-02-13T20:25:13.249 INFO:tasks.rados.rados.0.trial188.stdout:3057: done (3 left) 2026-02-13T20:25:13.250 INFO:tasks.rados.rados.0.trial188.stdout:3058: done (2 left) 2026-02-13T20:25:13.250 INFO:tasks.rados.rados.0.trial188.stdout:3059: done (1 left) 2026-02-13T20:25:13.250 INFO:tasks.rados.rados.0.trial188.stdout:3060: done (0 left) 2026-02-13T20:25:13.250 INFO:tasks.rados.rados.0.trial188.stdout:3061: delete oid 27 current snap is 316 2026-02-13T20:25:13.253 INFO:tasks.rados.rados.0.trial188.stdout:3061: done (0 left) 2026-02-13T20:25:13.253 INFO:tasks.rados.rados.0.trial188.stdout:3062: write (excl) oid 47 current snap is 316 2026-02-13T20:25:13.253 INFO:tasks.rados.rados.0.trial188.stdout:3062: seq_num 1057 ranges {564999=511260,1853114=561358,3060221=592047} 2026-02-13T20:25:13.257 INFO:tasks.rados.rados.0.trial188.stdout:3062: writing trial18843701-47 from 564999 to 1076259 tid 1 2026-02-13T20:25:13.262 INFO:tasks.rados.rados.0.trial188.stdout:3062: writing trial18843701-47 from 1853114 to 2414472 tid 2 2026-02-13T20:25:13.268 INFO:tasks.rados.rados.0.trial188.stdout:3062: writing trial18843701-47 from 3060221 to 3652268 tid 3 2026-02-13T20:25:13.268 INFO:tasks.rados.rados.0.trial188.stdout:3063: snap_remove snap 315 2026-02-13T20:25:14.251 INFO:tasks.rados.rados.0.trial188.stdout:3063: done (1 left) 2026-02-13T20:25:14.251 INFO:tasks.rados.rados.0.trial188.stdout:3064: write (excl) oid 11 current snap is 316 2026-02-13T20:25:14.251 INFO:tasks.rados.rados.0.trial188.stdout:3062: finishing write tid 1 to trial18843701-47 2026-02-13T20:25:14.251 INFO:tasks.rados.rados.0.trial188.stdout:3062: finishing write tid 2 to trial18843701-47 2026-02-13T20:25:14.251 INFO:tasks.rados.rados.0.trial188.stdout:3062: finishing write tid 3 to trial18843701-47 2026-02-13T20:25:14.251 INFO:tasks.rados.rados.0.trial188.stdout:3062: finishing write tid 4 to trial18843701-47 2026-02-13T20:25:14.251 INFO:tasks.rados.rados.0.trial188.stdout:3062: finishing write tid 5 to trial18843701-47 2026-02-13T20:25:14.251 INFO:tasks.rados.rados.0.trial188.stdout:3062: oid 47 updating version 0 to 1074 2026-02-13T20:25:14.251 INFO:tasks.rados.rados.0.trial188.stdout:3062: oid 47 updating version 1074 to 1075 2026-02-13T20:25:14.252 INFO:tasks.rados.rados.0.trial188.stdout:3062: oid 47 updating version 1075 to 1077 2026-02-13T20:25:14.252 INFO:tasks.rados.rados.0.trial188.stdout:3062: oid 47 version 1077 is already newer than 1076 2026-02-13T20:25:14.252 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 47 v 1077 (ObjNum 1057 snap 316 seq_num 1057) dirty exists 2026-02-13T20:25:14.252 INFO:tasks.rados.rados.0.trial188.stdout:3062: left oid 47 (ObjNum 1057 snap 316 seq_num 1057) 2026-02-13T20:25:14.252 INFO:tasks.rados.rados.0.trial188.stdout:3064: seq_num 1058 ranges {581806=586509,1911596=421369,3087644=403319} 2026-02-13T20:25:14.255 INFO:tasks.rados.rados.0.trial188.stdout:3064: writing trial18843701-11 from 581806 to 1168315 tid 1 2026-02-13T20:25:14.259 INFO:tasks.rados.rados.0.trial188.stdout:3064: writing trial18843701-11 from 1911596 to 2332965 tid 2 2026-02-13T20:25:14.264 INFO:tasks.rados.rados.0.trial188.stdout:3064: writing trial18843701-11 from 3087644 to 3490963 tid 3 2026-02-13T20:25:14.264 INFO:tasks.rados.rados.0.trial188.stdout:3062: done (1 left) 2026-02-13T20:25:14.264 INFO:tasks.rados.rados.0.trial188.stdout:3065: delete oid 22 current snap is 316 2026-02-13T20:25:14.265 INFO:tasks.rados.rados.0.trial188.stdout:3065: done (1 left) 2026-02-13T20:25:14.265 INFO:tasks.rados.rados.0.trial188.stdout:3066: write oid 39 current snap is 316 2026-02-13T20:25:14.265 INFO:tasks.rados.rados.0.trial188.stdout:3066: seq_num 1060 ranges {615420=737007,1912207=425038,3026137=542216} 2026-02-13T20:25:14.270 INFO:tasks.rados.rados.0.trial188.stdout:3066: writing trial18843701-39 from 615420 to 1352427 tid 1 2026-02-13T20:25:14.274 INFO:tasks.rados.rados.0.trial188.stdout:3066: writing trial18843701-39 from 1912207 to 2337245 tid 2 2026-02-13T20:25:14.278 INFO:tasks.rados.rados.0.trial188.stdout:3066: writing trial18843701-39 from 3026137 to 3568353 tid 3 2026-02-13T20:25:14.278 INFO:tasks.rados.rados.0.trial188.stdout:3067: rollback oid 40 current snap is 316 2026-02-13T20:25:14.278 INFO:tasks.rados.rados.0.trial188.stdout:3067: done (2 left) 2026-02-13T20:25:14.278 INFO:tasks.rados.rados.0.trial188.stdout:3068: rollback oid 17 current snap is 316 2026-02-13T20:25:14.278 INFO:tasks.rados.rados.0.trial188.stdout:3068: done (2 left) 2026-02-13T20:25:14.279 INFO:tasks.rados.rados.0.trial188.stdout:3069: read oid 49 snap -1 2026-02-13T20:25:14.279 INFO:tasks.rados.rados.0.trial188.stdout:3069: expect deleted 2026-02-13T20:25:14.279 INFO:tasks.rados.rados.0.trial188.stdout:3070: rollback oid 22 current snap is 316 2026-02-13T20:25:14.279 INFO:tasks.rados.rados.0.trial188.stdout:3070: done (3 left) 2026-02-13T20:25:14.279 INFO:tasks.rados.rados.0.trial188.stdout:3071: rollback oid 40 current snap is 316 2026-02-13T20:25:14.279 INFO:tasks.rados.rados.0.trial188.stdout:3071: done (3 left) 2026-02-13T20:25:14.279 INFO:tasks.rados.rados.0.trial188.stdout:3072: write oid 18 current snap is 316 2026-02-13T20:25:14.279 INFO:tasks.rados.rados.0.trial188.stdout:3072: seq_num 1061 ranges {632227=412256,1570689=568696,2653560=753488} 2026-02-13T20:25:14.282 INFO:tasks.rados.rados.0.trial188.stdout:3072: writing trial18843701-18 from 632227 to 1044483 tid 1 2026-02-13T20:25:14.286 INFO:tasks.rados.rados.0.trial188.stdout:3072: writing trial18843701-18 from 1570689 to 2139385 tid 2 2026-02-13T20:25:14.291 INFO:tasks.rados.rados.0.trial188.stdout:3072: writing trial18843701-18 from 2653560 to 3407048 tid 3 2026-02-13T20:25:14.291 INFO:tasks.rados.rados.0.trial188.stdout:3073: read oid 27 snap -1 2026-02-13T20:25:14.291 INFO:tasks.rados.rados.0.trial188.stdout:3073: expect deleted 2026-02-13T20:25:14.291 INFO:tasks.rados.rados.0.trial188.stdout:3074: read oid 28 snap -1 2026-02-13T20:25:14.291 INFO:tasks.rados.rados.0.trial188.stdout:3074: expect (ObjNum 1048 snap 314 seq_num 1048) 2026-02-13T20:25:14.291 INFO:tasks.rados.rados.0.trial188.stdout:3075: write oid 8 current snap is 316 2026-02-13T20:25:14.292 INFO:tasks.rados.rados.0.trial188.stdout:3075: seq_num 1062 ranges {649034=487505,1629171=428707,2680983=564760,3798768=50266} 2026-02-13T20:25:14.295 INFO:tasks.rados.rados.0.trial188.stdout:3075: writing trial18843701-8 from 649034 to 1136539 tid 1 2026-02-13T20:25:14.299 INFO:tasks.rados.rados.0.trial188.stdout:3075: writing trial18843701-8 from 1629171 to 2057878 tid 2 2026-02-13T20:25:14.303 INFO:tasks.rados.rados.0.trial188.stdout:3075: writing trial18843701-8 from 2680983 to 3245743 tid 3 2026-02-13T20:25:14.306 INFO:tasks.rados.rados.0.trial188.stdout:3075: writing trial18843701-8 from 3798768 to 3849034 tid 4 2026-02-13T20:25:14.306 INFO:tasks.rados.rados.0.trial188.stdout:3076: snap_create 2026-02-13T20:25:14.306 INFO:tasks.rados.rados.0.trial188.stdout:3064: finishing write tid 1 to trial18843701-11 2026-02-13T20:25:14.306 INFO:tasks.rados.rados.0.trial188.stdout:3064: finishing write tid 2 to trial18843701-11 2026-02-13T20:25:14.306 INFO:tasks.rados.rados.0.trial188.stdout:3064: finishing write tid 3 to trial18843701-11 2026-02-13T20:25:14.306 INFO:tasks.rados.rados.0.trial188.stdout:3064: finishing write tid 4 to trial18843701-11 2026-02-13T20:25:14.306 INFO:tasks.rados.rados.0.trial188.stdout:3064: finishing write tid 5 to trial18843701-11 2026-02-13T20:25:14.306 INFO:tasks.rados.rados.0.trial188.stdout:3064: oid 11 updating version 0 to 1540 2026-02-13T20:25:14.306 INFO:tasks.rados.rados.0.trial188.stdout:3064: oid 11 updating version 1540 to 1543 2026-02-13T20:25:14.306 INFO:tasks.rados.rados.0.trial188.stdout:3064: oid 11 version 1543 is already newer than 1541 2026-02-13T20:25:14.306 INFO:tasks.rados.rados.0.trial188.stdout:3064: oid 11 version 1543 is already newer than 1542 2026-02-13T20:25:14.306 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 11 v 1543 (ObjNum 1058 snap 316 seq_num 1058) dirty exists 2026-02-13T20:25:14.306 INFO:tasks.rados.rados.0.trial188.stdout:3064: left oid 11 (ObjNum 1058 snap 316 seq_num 1058) 2026-02-13T20:25:14.306 INFO:tasks.rados.rados.0.trial188.stdout:3074: expect (ObjNum 1048 snap 314 seq_num 1048) 2026-02-13T20:25:14.306 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:25:14.421 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:25:14.478 INFO:tasks.rados.rados.0.trial188.stdout:3066: finishing write tid 1 to trial18843701-39 2026-02-13T20:25:14.478 INFO:tasks.rados.rados.0.trial188.stdout:3066: finishing write tid 2 to trial18843701-39 2026-02-13T20:25:14.479 INFO:tasks.rados.rados.0.trial188.stdout:3066: finishing write tid 3 to trial18843701-39 2026-02-13T20:25:14.479 INFO:tasks.rados.rados.0.trial188.stdout:3066: finishing write tid 4 to trial18843701-39 2026-02-13T20:25:14.479 INFO:tasks.rados.rados.0.trial188.stdout:3066: finishing write tid 5 to trial18843701-39 2026-02-13T20:25:14.479 INFO:tasks.rados.rados.0.trial188.stdout:3066: oid 39 updating version 0 to 1460 2026-02-13T20:25:14.479 INFO:tasks.rados.rados.0.trial188.stdout:3066: oid 39 updating version 1460 to 1463 2026-02-13T20:25:14.479 INFO:tasks.rados.rados.0.trial188.stdout:3066: oid 39 version 1463 is already newer than 1462 2026-02-13T20:25:14.479 INFO:tasks.rados.rados.0.trial188.stdout:3066: oid 39 version 1463 is already newer than 1461 2026-02-13T20:25:14.479 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 39 v 1463 (ObjNum 1060 snap 316 seq_num 1060) dirty exists 2026-02-13T20:25:14.479 INFO:tasks.rados.rados.0.trial188.stdout:3066: left oid 39 (ObjNum 1060 snap 316 seq_num 1060) 2026-02-13T20:25:14.479 INFO:tasks.rados.rados.0.trial188.stdout:3075: finishing write tid 1 to trial18843701-8 2026-02-13T20:25:14.479 INFO:tasks.rados.rados.0.trial188.stdout:3075: finishing write tid 2 to trial18843701-8 2026-02-13T20:25:14.479 INFO:tasks.rados.rados.0.trial188.stdout:3075: finishing write tid 3 to trial18843701-8 2026-02-13T20:25:14.480 INFO:tasks.rados.rados.0.trial188.stdout:3075: finishing write tid 4 to trial18843701-8 2026-02-13T20:25:14.480 INFO:tasks.rados.rados.0.trial188.stdout:3075: finishing write tid 5 to trial18843701-8 2026-02-13T20:25:14.480 INFO:tasks.rados.rados.0.trial188.stdout:3075: finishing write tid 6 to trial18843701-8 2026-02-13T20:25:14.480 INFO:tasks.rados.rados.0.trial188.stdout:3075: oid 8 updating version 0 to 1557 2026-02-13T20:25:14.480 INFO:tasks.rados.rados.0.trial188.stdout:3075: oid 8 version 1557 is already newer than 1555 2026-02-13T20:25:14.480 INFO:tasks.rados.rados.0.trial188.stdout:3075: oid 8 updating version 1557 to 1559 2026-02-13T20:25:14.480 INFO:tasks.rados.rados.0.trial188.stdout:3075: oid 8 version 1559 is already newer than 1558 2026-02-13T20:25:14.480 INFO:tasks.rados.rados.0.trial188.stdout:3075: oid 8 version 1559 is already newer than 1556 2026-02-13T20:25:14.480 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 8 v 1559 (ObjNum 1062 snap 316 seq_num 1062) dirty exists 2026-02-13T20:25:14.480 INFO:tasks.rados.rados.0.trial188.stdout:3075: left oid 8 (ObjNum 1062 snap 316 seq_num 1062) 2026-02-13T20:25:14.480 INFO:tasks.rados.rados.0.trial188.stdout:3072: finishing write tid 1 to trial18843701-18 2026-02-13T20:25:14.480 INFO:tasks.rados.rados.0.trial188.stdout:3072: finishing write tid 2 to trial18843701-18 2026-02-13T20:25:14.481 INFO:tasks.rados.rados.0.trial188.stdout:3072: finishing write tid 3 to trial18843701-18 2026-02-13T20:25:14.481 INFO:tasks.rados.rados.0.trial188.stdout:3072: finishing write tid 4 to trial18843701-18 2026-02-13T20:25:14.481 INFO:tasks.rados.rados.0.trial188.stdout:3072: finishing write tid 5 to trial18843701-18 2026-02-13T20:25:14.481 INFO:tasks.rados.rados.0.trial188.stdout:3072: oid 18 updating version 0 to 1357 2026-02-13T20:25:14.481 INFO:tasks.rados.rados.0.trial188.stdout:3072: oid 18 updating version 1357 to 1359 2026-02-13T20:25:14.481 INFO:tasks.rados.rados.0.trial188.stdout:3072: oid 18 version 1359 is already newer than 1356 2026-02-13T20:25:14.481 INFO:tasks.rados.rados.0.trial188.stdout:3072: oid 18 version 1359 is already newer than 1358 2026-02-13T20:25:14.481 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 18 v 1359 (ObjNum 1061 snap 316 seq_num 1061) dirty exists 2026-02-13T20:25:14.481 INFO:tasks.rados.rados.0.trial188.stdout:3072: left oid 18 (ObjNum 1061 snap 316 seq_num 1061) 2026-02-13T20:25:15.293 INFO:tasks.rados.rados.0.trial188.stdout:3064: done (7 left) 2026-02-13T20:25:15.293 INFO:tasks.rados.rados.0.trial188.stdout:3066: done (6 left) 2026-02-13T20:25:15.293 INFO:tasks.rados.rados.0.trial188.stdout:3069: done (5 left) 2026-02-13T20:25:15.293 INFO:tasks.rados.rados.0.trial188.stdout:3072: done (4 left) 2026-02-13T20:25:15.293 INFO:tasks.rados.rados.0.trial188.stdout:3073: done (3 left) 2026-02-13T20:25:15.293 INFO:tasks.rados.rados.0.trial188.stdout:3074: done (2 left) 2026-02-13T20:25:15.293 INFO:tasks.rados.rados.0.trial188.stdout:3075: done (1 left) 2026-02-13T20:25:15.293 INFO:tasks.rados.rados.0.trial188.stdout:3076: done (0 left) 2026-02-13T20:25:15.293 INFO:tasks.rados.rados.0.trial188.stdout:3077: read oid 12 snap 316 2026-02-13T20:25:15.293 INFO:tasks.rados.rados.0.trial188.stdout:3077: expect deleted 2026-02-13T20:25:15.293 INFO:tasks.rados.rados.0.trial188.stdout:3078: delete oid 24 current snap is 317 2026-02-13T20:25:15.296 INFO:tasks.rados.rados.0.trial188.stdout:3077: done (1 left) 2026-02-13T20:25:15.296 INFO:tasks.rados.rados.0.trial188.stdout:3078: done (0 left) 2026-02-13T20:25:15.296 INFO:tasks.rados.rados.0.trial188.stdout:3079: write (excl) oid 49 current snap is 317 2026-02-13T20:25:15.296 INFO:tasks.rados.rados.0.trial188.stdout:3079: seq_num 1064 ranges {682648=638003,2029782=432376,3019476=587304} 2026-02-13T20:25:15.301 INFO:tasks.rados.rados.0.trial188.stdout:3079: writing trial18843701-49 from 682648 to 1320651 tid 1 2026-02-13T20:25:15.305 INFO:tasks.rados.rados.0.trial188.stdout:3079: writing trial18843701-49 from 2029782 to 2462158 tid 2 2026-02-13T20:25:15.309 INFO:tasks.rados.rados.0.trial188.stdout:3079: writing trial18843701-49 from 3019476 to 3606780 tid 3 2026-02-13T20:25:15.309 INFO:tasks.rados.rados.0.trial188.stdout:3080: snap_remove snap 316 2026-02-13T20:25:16.296 INFO:tasks.rados.rados.0.trial188.stdout:3080: done (1 left) 2026-02-13T20:25:16.296 INFO:tasks.rados.rados.0.trial188.stdout:3081: read oid 23 snap -1 2026-02-13T20:25:16.296 INFO:tasks.rados.rados.0.trial188.stdout:3081: expect deleted 2026-02-13T20:25:16.296 INFO:tasks.rados.rados.0.trial188.stdout:3082: delete oid 29 current snap is 317 2026-02-13T20:25:16.296 INFO:tasks.rados.rados.0.trial188.stdout:3079: finishing write tid 1 to trial18843701-49 2026-02-13T20:25:16.296 INFO:tasks.rados.rados.0.trial188.stdout:3079: finishing write tid 2 to trial18843701-49 2026-02-13T20:25:16.296 INFO:tasks.rados.rados.0.trial188.stdout:3079: finishing write tid 3 to trial18843701-49 2026-02-13T20:25:16.296 INFO:tasks.rados.rados.0.trial188.stdout:3079: finishing write tid 4 to trial18843701-49 2026-02-13T20:25:16.296 INFO:tasks.rados.rados.0.trial188.stdout:3079: finishing write tid 5 to trial18843701-49 2026-02-13T20:25:16.296 INFO:tasks.rados.rados.0.trial188.stdout:3079: oid 49 updating version 0 to 1485 2026-02-13T20:25:16.296 INFO:tasks.rados.rados.0.trial188.stdout:3079: oid 49 updating version 1485 to 1487 2026-02-13T20:25:16.296 INFO:tasks.rados.rados.0.trial188.stdout:3079: oid 49 version 1487 is already newer than 1484 2026-02-13T20:25:16.297 INFO:tasks.rados.rados.0.trial188.stdout:3079: oid 49 version 1487 is already newer than 1486 2026-02-13T20:25:16.297 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 49 v 1487 (ObjNum 1064 snap 317 seq_num 1064) dirty exists 2026-02-13T20:25:16.297 INFO:tasks.rados.rados.0.trial188.stdout:3079: left oid 49 (ObjNum 1064 snap 317 seq_num 1064) 2026-02-13T20:25:16.298 INFO:tasks.rados.rados.0.trial188.stdout:3079: done (2 left) 2026-02-13T20:25:16.298 INFO:tasks.rados.rados.0.trial188.stdout:3082: done (1 left) 2026-02-13T20:25:16.298 INFO:tasks.rados.rados.0.trial188.stdout:3083: read oid 28 snap -1 2026-02-13T20:25:16.298 INFO:tasks.rados.rados.0.trial188.stdout:3083: expect (ObjNum 1048 snap 314 seq_num 1048) 2026-02-13T20:25:16.298 INFO:tasks.rados.rados.0.trial188.stdout:3084: read oid 1 snap -1 2026-02-13T20:25:16.298 INFO:tasks.rados.rados.0.trial188.stdout:3084: expect (ObjNum 873 snap 255 seq_num 873) 2026-02-13T20:25:16.298 INFO:tasks.rados.rados.0.trial188.stdout:3085: delete oid 20 current snap is 317 2026-02-13T20:25:16.300 INFO:tasks.rados.rados.0.trial188.stdout:3084: expect (ObjNum 873 snap 255 seq_num 873) 2026-02-13T20:25:16.304 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1086131 2026-02-13T20:25:16.352 INFO:tasks.rados.rados.0.trial188.stdout:3083: expect (ObjNum 1048 snap 314 seq_num 1048) 2026-02-13T20:25:16.372 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1955292 2026-02-13T20:25:16.512 INFO:tasks.rados.rados.0.trial188.stdout:3081: done (3 left) 2026-02-13T20:25:16.513 INFO:tasks.rados.rados.0.trial188.stdout:3083: done (2 left) 2026-02-13T20:25:16.513 INFO:tasks.rados.rados.0.trial188.stdout:3084: done (1 left) 2026-02-13T20:25:16.513 INFO:tasks.rados.rados.0.trial188.stdout:3085: done (0 left) 2026-02-13T20:25:16.513 INFO:tasks.rados.rados.0.trial188.stdout:3086: snap_create 2026-02-13T20:25:17.248 INFO:tasks.rados.rados.0.trial188.stdout:3086: done (0 left) 2026-02-13T20:25:17.249 INFO:tasks.rados.rados.0.trial188.stdout:3087: snap_create 2026-02-13T20:25:18.250 INFO:tasks.rados.rados.0.trial188.stdout:3087: done (0 left) 2026-02-13T20:25:18.250 INFO:tasks.rados.rados.0.trial188.stdout:3088: read oid 14 snap -1 2026-02-13T20:25:18.250 INFO:tasks.rados.rados.0.trial188.stdout:3088: expect (ObjNum 751 snap 222 seq_num 751) 2026-02-13T20:25:18.250 INFO:tasks.rados.rados.0.trial188.stdout:3089: delete oid 48 current snap is 319 2026-02-13T20:25:18.254 INFO:tasks.rados.rados.0.trial188.stdout:3089: done (1 left) 2026-02-13T20:25:18.254 INFO:tasks.rados.rados.0.trial188.stdout:3090: read oid 6 snap -1 2026-02-13T20:25:18.254 INFO:tasks.rados.rados.0.trial188.stdout:3090: expect (ObjNum 976 snap 290 seq_num 976) 2026-02-13T20:25:18.254 INFO:tasks.rados.rados.0.trial188.stdout:3091: read oid 29 snap -1 2026-02-13T20:25:18.254 INFO:tasks.rados.rados.0.trial188.stdout:3091: expect deleted 2026-02-13T20:25:18.254 INFO:tasks.rados.rados.0.trial188.stdout:3092: read oid 19 snap -1 2026-02-13T20:25:18.254 INFO:tasks.rados.rados.0.trial188.stdout:3092: expect (ObjNum 1039 snap 313 seq_num 1039) 2026-02-13T20:25:18.254 INFO:tasks.rados.rados.0.trial188.stdout:3093: write (excl) oid 18 current snap is 319 2026-02-13T20:25:18.254 INFO:tasks.rados.rados.0.trial188.stdout:3093: seq_num 1068 ranges {749876=655352,1863710=723361,3012815=748745} 2026-02-13T20:25:18.260 INFO:tasks.rados.rados.0.trial188.stdout:3093: writing trial18843701-18 from 749876 to 1405228 tid 1 2026-02-13T20:25:18.265 INFO:tasks.rados.rados.0.trial188.stdout:3093: writing trial18843701-18 from 1863710 to 2587071 tid 2 2026-02-13T20:25:18.269 INFO:tasks.rados.rados.0.trial188.stdout:3093: writing trial18843701-18 from 3012815 to 3761560 tid 3 2026-02-13T20:25:18.270 INFO:tasks.rados.rados.0.trial188.stdout:3094: snap_remove snap 317 2026-02-13T20:25:19.251 INFO:tasks.rados.rados.0.trial188.stdout:3094: done (5 left) 2026-02-13T20:25:19.251 INFO:tasks.rados.rados.0.trial188.stdout:3095: delete oid 50 current snap is 319 2026-02-13T20:25:19.251 INFO:tasks.rados.rados.0.trial188.stdout:3092: expect (ObjNum 1039 snap 313 seq_num 1039) 2026-02-13T20:25:19.274 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1595698 2026-02-13T20:25:19.348 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2506080 2026-02-13T20:25:19.430 INFO:tasks.rados.rados.0.trial188.stdout:3088: expect (ObjNum 751 snap 222 seq_num 751) 2026-02-13T20:25:19.430 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:25:19.476 INFO:tasks.rados.rados.0.trial188.stdout:3090: expect (ObjNum 976 snap 290 seq_num 976) 2026-02-13T20:25:19.508 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 616387 2026-02-13T20:25:19.562 INFO:tasks.rados.rados.0.trial188.stdout:3093: finishing write tid 1 to trial18843701-18 2026-02-13T20:25:19.562 INFO:tasks.rados.rados.0.trial188.stdout:3088: done (5 left) 2026-02-13T20:25:19.562 INFO:tasks.rados.rados.0.trial188.stdout:3090: done (4 left) 2026-02-13T20:25:19.562 INFO:tasks.rados.rados.0.trial188.stdout:3091: done (3 left) 2026-02-13T20:25:19.562 INFO:tasks.rados.rados.0.trial188.stdout:3092: done (2 left) 2026-02-13T20:25:19.562 INFO:tasks.rados.rados.0.trial188.stdout:3095: done (1 left) 2026-02-13T20:25:19.562 INFO:tasks.rados.rados.0.trial188.stdout:3096: read oid 41 snap -1 2026-02-13T20:25:19.562 INFO:tasks.rados.rados.0.trial188.stdout:3096: expect deleted 2026-02-13T20:25:19.562 INFO:tasks.rados.rados.0.trial188.stdout:3097: delete oid 25 current snap is 319 2026-02-13T20:25:19.562 INFO:tasks.rados.rados.0.trial188.stdout:3093: finishing write tid 2 to trial18843701-18 2026-02-13T20:25:19.562 INFO:tasks.rados.rados.0.trial188.stdout:3093: finishing write tid 3 to trial18843701-18 2026-02-13T20:25:19.562 INFO:tasks.rados.rados.0.trial188.stdout:3093: finishing write tid 4 to trial18843701-18 2026-02-13T20:25:19.562 INFO:tasks.rados.rados.0.trial188.stdout:3093: finishing write tid 5 to trial18843701-18 2026-02-13T20:25:19.562 INFO:tasks.rados.rados.0.trial188.stdout:3093: oid 18 updating version 0 to 1361 2026-02-13T20:25:19.562 INFO:tasks.rados.rados.0.trial188.stdout:3093: oid 18 version 1361 is already newer than 1360 2026-02-13T20:25:19.562 INFO:tasks.rados.rados.0.trial188.stdout:3093: oid 18 updating version 1361 to 1363 2026-02-13T20:25:19.562 INFO:tasks.rados.rados.0.trial188.stdout:3093: oid 18 version 1363 is already newer than 1362 2026-02-13T20:25:19.562 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 18 v 1363 (ObjNum 1068 snap 319 seq_num 1068) dirty exists 2026-02-13T20:25:19.562 INFO:tasks.rados.rados.0.trial188.stdout:3093: left oid 18 (ObjNum 1068 snap 319 seq_num 1068) 2026-02-13T20:25:19.563 INFO:tasks.rados.rados.0.trial188.stdout:3093: done (2 left) 2026-02-13T20:25:19.564 INFO:tasks.rados.rados.0.trial188.stdout:3096: done (1 left) 2026-02-13T20:25:19.564 INFO:tasks.rados.rados.0.trial188.stdout:3097: done (0 left) 2026-02-13T20:25:19.564 INFO:tasks.rados.rados.0.trial188.stdout:3098: write (excl) oid 18 current snap is 319 2026-02-13T20:25:19.564 INFO:tasks.rados.rados.0.trial188.stdout:3098: seq_num 1071 ranges {400297=481099,1639156=361141} 2026-02-13T20:25:19.568 INFO:tasks.rados.rados.0.trial188.stdout:3098: writing trial18843701-18 from 400297 to 881396 tid 1 2026-02-13T20:25:19.572 INFO:tasks.rados.rados.0.trial188.stdout:3098: writing trial18843701-18 from 1639156 to 2000297 tid 2 2026-02-13T20:25:19.572 INFO:tasks.rados.rados.0.trial188.stdout:3099: snap_remove snap 318 2026-02-13T20:25:20.256 INFO:tasks.rados.rados.0.trial188.stdout:3099: done (1 left) 2026-02-13T20:25:20.256 INFO:tasks.rados.rados.0.trial188.stdout:3100: rollback oid 48 current snap is 319 2026-02-13T20:25:20.257 INFO:tasks.rados.rados.0.trial188.stdout:3100: done (1 left) 2026-02-13T20:25:20.257 INFO:tasks.rados.rados.0.trial188.stdout:3101: write (excl) oid 22 current snap is 319 2026-02-13T20:25:20.257 INFO:tasks.rados.rados.0.trial188.stdout:3101: seq_num 1072 ranges {417104=672701,1813991=203113} 2026-02-13T20:25:20.260 INFO:tasks.rados.rados.0.trial188.stdout:3101: writing trial18843701-22 from 417104 to 1089805 tid 1 2026-02-13T20:25:20.266 INFO:tasks.rados.rados.0.trial188.stdout:3101: writing trial18843701-22 from 1813991 to 2017104 tid 2 2026-02-13T20:25:20.266 INFO:tasks.rados.rados.0.trial188.stdout:3102: read oid 34 snap -1 2026-02-13T20:25:20.266 INFO:tasks.rados.rados.0.trial188.stdout:3102: expect (ObjNum 1043 snap 314 seq_num 1043) 2026-02-13T20:25:20.267 INFO:tasks.rados.rados.0.trial188.stdout:3103: read oid 32 snap -1 2026-02-13T20:25:20.267 INFO:tasks.rados.rados.0.trial188.stdout:3103: expect (ObjNum 1054 snap 314 seq_num 1054) 2026-02-13T20:25:20.267 INFO:tasks.rados.rados.0.trial188.stdout:3104: delete oid 29 current snap is 319 2026-02-13T20:25:20.267 INFO:tasks.rados.rados.0.trial188.stdout:3098: finishing write tid 1 to trial18843701-18 2026-02-13T20:25:20.267 INFO:tasks.rados.rados.0.trial188.stdout:3098: finishing write tid 2 to trial18843701-18 2026-02-13T20:25:20.267 INFO:tasks.rados.rados.0.trial188.stdout:3098: finishing write tid 3 to trial18843701-18 2026-02-13T20:25:20.267 INFO:tasks.rados.rados.0.trial188.stdout:3098: finishing write tid 4 to trial18843701-18 2026-02-13T20:25:20.267 INFO:tasks.rados.rados.0.trial188.stdout:3098: oid 18 updating version 0 to 1364 2026-02-13T20:25:20.267 INFO:tasks.rados.rados.0.trial188.stdout:3098: oid 18 updating version 1364 to 1366 2026-02-13T20:25:20.267 INFO:tasks.rados.rados.0.trial188.stdout:3098: oid 18 version 1366 is already newer than 1365 2026-02-13T20:25:20.267 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 18 v 1366 (ObjNum 1071 snap 319 seq_num 1071) dirty exists 2026-02-13T20:25:20.267 INFO:tasks.rados.rados.0.trial188.stdout:3098: left oid 18 (ObjNum 1071 snap 319 seq_num 1071) 2026-02-13T20:25:20.268 INFO:tasks.rados.rados.0.trial188.stdout:3098: done (4 left) 2026-02-13T20:25:20.268 INFO:tasks.rados.rados.0.trial188.stdout:3104: done (3 left) 2026-02-13T20:25:20.268 INFO:tasks.rados.rados.0.trial188.stdout:3105: read oid 40 snap -1 2026-02-13T20:25:20.268 INFO:tasks.rados.rados.0.trial188.stdout:3105: expect deleted 2026-02-13T20:25:20.268 INFO:tasks.rados.rados.0.trial188.stdout:3106: snap_create 2026-02-13T20:25:20.271 INFO:tasks.rados.rados.0.trial188.stdout:3102: expect (ObjNum 1043 snap 314 seq_num 1043) 2026-02-13T20:25:20.271 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:25:20.307 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:25:20.374 INFO:tasks.rados.rados.0.trial188.stdout:3103: expect (ObjNum 1054 snap 314 seq_num 1054) 2026-02-13T20:25:20.408 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:25:20.485 INFO:tasks.rados.rados.0.trial188.stdout:3101: finishing write tid 1 to trial18843701-22 2026-02-13T20:25:20.485 INFO:tasks.rados.rados.0.trial188.stdout:3101: finishing write tid 2 to trial18843701-22 2026-02-13T20:25:20.485 INFO:tasks.rados.rados.0.trial188.stdout:3101: finishing write tid 3 to trial18843701-22 2026-02-13T20:25:20.485 INFO:tasks.rados.rados.0.trial188.stdout:3101: finishing write tid 4 to trial18843701-22 2026-02-13T20:25:20.485 INFO:tasks.rados.rados.0.trial188.stdout:3101: oid 22 updating version 0 to 1325 2026-02-13T20:25:20.486 INFO:tasks.rados.rados.0.trial188.stdout:3101: oid 22 version 1325 is already newer than 1324 2026-02-13T20:25:20.486 INFO:tasks.rados.rados.0.trial188.stdout:3101: oid 22 version 1325 is already newer than 1323 2026-02-13T20:25:20.486 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 22 v 1325 (ObjNum 1072 snap 319 seq_num 1072) dirty exists 2026-02-13T20:25:20.486 INFO:tasks.rados.rados.0.trial188.stdout:3101: left oid 22 (ObjNum 1072 snap 319 seq_num 1072) 2026-02-13T20:25:21.258 INFO:tasks.rados.rados.0.trial188.stdout:3101: done (4 left) 2026-02-13T20:25:21.259 INFO:tasks.rados.rados.0.trial188.stdout:3102: done (3 left) 2026-02-13T20:25:21.259 INFO:tasks.rados.rados.0.trial188.stdout:3103: done (2 left) 2026-02-13T20:25:21.259 INFO:tasks.rados.rados.0.trial188.stdout:3105: done (1 left) 2026-02-13T20:25:21.259 INFO:tasks.rados.rados.0.trial188.stdout:3106: done (0 left) 2026-02-13T20:25:21.259 INFO:tasks.rados.rados.0.trial188.stdout:3107: read oid 13 snap 319 2026-02-13T20:25:21.259 INFO:tasks.rados.rados.0.trial188.stdout:3107: expect deleted 2026-02-13T20:25:21.259 INFO:tasks.rados.rados.0.trial188.stdout:3108: snap_create 2026-02-13T20:25:22.249 INFO:tasks.rados.rados.0.trial188.stdout:3107: done (1 left) 2026-02-13T20:25:22.249 INFO:tasks.rados.rados.0.trial188.stdout:3108: done (0 left) 2026-02-13T20:25:22.249 INFO:tasks.rados.rados.0.trial188.stdout:3109: snap_remove snap 319 2026-02-13T20:25:23.251 INFO:tasks.rados.rados.0.trial188.stdout:3109: done (0 left) 2026-02-13T20:25:23.252 INFO:tasks.rados.rados.0.trial188.stdout:3110: copy_from oid 42 from oid 33 current snap is 321 2026-02-13T20:25:23.252 INFO:tasks.rados.rados.0.trial188.stdout:3111: read oid 50 snap -1 2026-02-13T20:25:23.252 INFO:tasks.rados.rados.0.trial188.stdout:3111: expect deleted 2026-02-13T20:25:23.252 INFO:tasks.rados.rados.0.trial188.stdout:3112: rollback oid 2 current snap is 321 2026-02-13T20:25:23.252 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 2 to 320 2026-02-13T20:25:23.252 INFO:tasks.rados.rados.0.trial188.stdout:3113: write (excl) oid 8 current snap is 321 2026-02-13T20:25:23.252 INFO:tasks.rados.rados.0.trial188.stdout:3113: seq_num 1074 ranges {450718=423199,1414602=636116} 2026-02-13T20:25:23.256 INFO:tasks.rados.rados.0.trial188.stdout:3113: writing trial18843701-8 from 450718 to 873917 tid 1 2026-02-13T20:25:23.261 INFO:tasks.rados.rados.0.trial188.stdout:3113: writing trial18843701-8 from 1414602 to 2050718 tid 2 2026-02-13T20:25:23.261 INFO:tasks.rados.rados.0.trial188.stdout:3114: read oid 9 snap -1 2026-02-13T20:25:23.261 INFO:tasks.rados.rados.0.trial188.stdout:3114: expect (ObjNum 1003 snap 299 seq_num 1003) 2026-02-13T20:25:23.261 INFO:tasks.rados.rados.0.trial188.stdout:3115: write (excl) oid 35 current snap is 321 2026-02-13T20:25:23.262 INFO:tasks.rados.rados.0.trial188.stdout:3115: seq_num 1075 ranges {467525=498448,1473084=594379} 2026-02-13T20:25:23.264 INFO:tasks.rados.rados.0.trial188.stdout:3115: writing trial18843701-35 from 467525 to 965973 tid 1 2026-02-13T20:25:23.270 INFO:tasks.rados.rados.0.trial188.stdout:3115: writing trial18843701-35 from 1473084 to 2067463 tid 2 2026-02-13T20:25:23.270 INFO:tasks.rados.rados.0.trial188.stdout:3116: read oid 16 snap 320 2026-02-13T20:25:23.270 INFO:tasks.rados.rados.0.trial188.stdout:3116: expect (ObjNum 1031 snap 308 seq_num 1031) 2026-02-13T20:25:23.270 INFO:tasks.rados.rados.0.trial188.stdout:3117: copy_from oid 37 from oid 4 current snap is 321 2026-02-13T20:25:23.270 INFO:tasks.rados.rados.0.trial188.stdout:3112: finishing rollback tid 0 to trial18843701-2 2026-02-13T20:25:23.270 INFO:tasks.rados.rados.0.trial188.stdout:3112: finishing rollback tid 1 to trial18843701-2 2026-02-13T20:25:23.271 INFO:tasks.rados.rados.0.trial188.stdout:3112: finishing rollback tid 2 to trial18843701-2 2026-02-13T20:25:23.271 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 2 v 1404 (ObjNum 950 snap 282 seq_num 950) dirty exists 2026-02-13T20:25:23.271 INFO:tasks.rados.rados.0.trial188.stdout:3111: done (7 left) 2026-02-13T20:25:23.271 INFO:tasks.rados.rados.0.trial188.stdout:3112: done (6 left) 2026-02-13T20:25:23.271 INFO:tasks.rados.rados.0.trial188.stdout:3118: copy_from oid 20 from oid 27 current snap is 321 2026-02-13T20:25:23.271 INFO:tasks.rados.rados.0.trial188.stdout:3119: read oid 25 snap -1 2026-02-13T20:25:23.271 INFO:tasks.rados.rados.0.trial188.stdout:3119: expect deleted 2026-02-13T20:25:23.271 INFO:tasks.rados.rados.0.trial188.stdout:3120: copy_from oid 11 from oid 47 current snap is 321 2026-02-13T20:25:23.271 INFO:tasks.rados.rados.0.trial188.stdout:3121: read oid 31 snap -1 2026-02-13T20:25:23.271 INFO:tasks.rados.rados.0.trial188.stdout:3121: expect (ObjNum 1013 snap 303 seq_num 1013) 2026-02-13T20:25:23.271 INFO:tasks.rados.rados.0.trial188.stdout:3122: snap_create 2026-02-13T20:25:23.279 INFO:tasks.rados.rados.0.trial188.stdout:3121: expect (ObjNum 1013 snap 303 seq_num 1013) 2026-02-13T20:25:23.282 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 877104 2026-02-13T20:25:23.383 INFO:tasks.rados.rados.0.trial188.stdout:3116: expect (ObjNum 1031 snap 308 seq_num 1031) 2026-02-13T20:25:23.479 INFO:tasks.rados.rados.0.trial188.stdout:3110: finishing copy_from racing read to trial18843701-42 2026-02-13T20:25:23.480 INFO:tasks.rados.rados.0.trial188.stdout:3114: expect (ObjNum 1003 snap 299 seq_num 1003) 2026-02-13T20:25:23.480 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:25:23.529 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1355057 2026-02-13T20:25:23.557 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:25:23.599 INFO:tasks.rados.rados.0.trial188.stdout:3118: finishing copy_from to trial18843701-20 2026-02-13T20:25:23.599 INFO:tasks.rados.rados.0.trial188.stdout:3118: got expected ENOENT (src dne) 2026-02-13T20:25:23.599 INFO:tasks.rados.rados.0.trial188.stdout:3117: finishing copy_from racing read to trial18843701-37 2026-02-13T20:25:23.599 INFO:tasks.rados.rados.0.trial188.stdout:3118: finishing copy_from racing read to trial18843701-20 2026-02-13T20:25:23.599 INFO:tasks.rados.rados.0.trial188.stdout:3113: finishing write tid 1 to trial18843701-8 2026-02-13T20:25:23.600 INFO:tasks.rados.rados.0.trial188.stdout:3113: finishing write tid 2 to trial18843701-8 2026-02-13T20:25:23.600 INFO:tasks.rados.rados.0.trial188.stdout:3113: finishing write tid 3 to trial18843701-8 2026-02-13T20:25:23.600 INFO:tasks.rados.rados.0.trial188.stdout:3113: finishing write tid 4 to trial18843701-8 2026-02-13T20:25:23.600 INFO:tasks.rados.rados.0.trial188.stdout:3113: oid 8 updating version 0 to 1562 2026-02-13T20:25:23.600 INFO:tasks.rados.rados.0.trial188.stdout:3113: oid 8 updating version 1562 to 1563 2026-02-13T20:25:23.600 INFO:tasks.rados.rados.0.trial188.stdout:3113: oid 8 version 1563 is already newer than 1561 2026-02-13T20:25:23.600 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 8 v 1563 (ObjNum 1074 snap 321 seq_num 1074) dirty exists 2026-02-13T20:25:23.600 INFO:tasks.rados.rados.0.trial188.stdout:3113: left oid 8 (ObjNum 1074 snap 321 seq_num 1074) 2026-02-13T20:25:23.600 INFO:tasks.rados.rados.0.trial188.stdout:3117: finishing copy_from to trial18843701-37 2026-02-13T20:25:23.600 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 37 v 1539 (ObjNum 724 snap 214 seq_num 724) dirty exists 2026-02-13T20:25:23.600 INFO:tasks.rados.rados.0.trial188.stdout:3110: finishing copy_from to trial18843701-42 2026-02-13T20:25:23.600 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 42 v 1069 (ObjNum 1004 snap 299 seq_num 1004) dirty exists 2026-02-13T20:25:23.601 INFO:tasks.rados.rados.0.trial188.stdout:3115: finishing write tid 1 to trial18843701-35 2026-02-13T20:25:23.601 INFO:tasks.rados.rados.0.trial188.stdout:3115: finishing write tid 2 to trial18843701-35 2026-02-13T20:25:23.601 INFO:tasks.rados.rados.0.trial188.stdout:3115: finishing write tid 3 to trial18843701-35 2026-02-13T20:25:23.601 INFO:tasks.rados.rados.0.trial188.stdout:3115: finishing write tid 4 to trial18843701-35 2026-02-13T20:25:23.601 INFO:tasks.rados.rados.0.trial188.stdout:3115: oid 35 updating version 0 to 1417 2026-02-13T20:25:23.601 INFO:tasks.rados.rados.0.trial188.stdout:3115: oid 35 version 1417 is already newer than 1415 2026-02-13T20:25:23.601 INFO:tasks.rados.rados.0.trial188.stdout:3115: oid 35 version 1417 is already newer than 1416 2026-02-13T20:25:23.601 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 35 v 1417 (ObjNum 1075 snap 321 seq_num 1075) dirty exists 2026-02-13T20:25:23.601 INFO:tasks.rados.rados.0.trial188.stdout:3115: left oid 35 (ObjNum 1075 snap 321 seq_num 1075) 2026-02-13T20:25:23.601 INFO:tasks.rados.rados.0.trial188.stdout:3120: finishing copy_from racing read to trial18843701-11 2026-02-13T20:25:23.601 INFO:tasks.rados.rados.0.trial188.stdout:3120: finishing copy_from to trial18843701-11 2026-02-13T20:25:23.601 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 11 v 1077 (ObjNum 1057 snap 316 seq_num 1057) dirty exists 2026-02-13T20:25:24.268 INFO:tasks.rados.rados.0.trial188.stdout:3110: done (10 left) 2026-02-13T20:25:24.268 INFO:tasks.rados.rados.0.trial188.stdout:3113: done (9 left) 2026-02-13T20:25:24.269 INFO:tasks.rados.rados.0.trial188.stdout:3114: done (8 left) 2026-02-13T20:25:24.269 INFO:tasks.rados.rados.0.trial188.stdout:3115: done (7 left) 2026-02-13T20:25:24.269 INFO:tasks.rados.rados.0.trial188.stdout:3116: done (6 left) 2026-02-13T20:25:24.269 INFO:tasks.rados.rados.0.trial188.stdout:3117: done (5 left) 2026-02-13T20:25:24.269 INFO:tasks.rados.rados.0.trial188.stdout:3118: done (4 left) 2026-02-13T20:25:24.269 INFO:tasks.rados.rados.0.trial188.stdout:3119: done (3 left) 2026-02-13T20:25:24.269 INFO:tasks.rados.rados.0.trial188.stdout:3120: done (2 left) 2026-02-13T20:25:24.269 INFO:tasks.rados.rados.0.trial188.stdout:3121: done (1 left) 2026-02-13T20:25:24.269 INFO:tasks.rados.rados.0.trial188.stdout:3122: done (0 left) 2026-02-13T20:25:24.269 INFO:tasks.rados.rados.0.trial188.stdout:3123: snap_remove snap 320 2026-02-13T20:25:25.270 INFO:tasks.rados.rados.0.trial188.stdout:3123: done (0 left) 2026-02-13T20:25:25.270 INFO:tasks.rados.rados.0.trial188.stdout:3124: read oid 29 snap -1 2026-02-13T20:25:25.270 INFO:tasks.rados.rados.0.trial188.stdout:3124: expect deleted 2026-02-13T20:25:25.270 INFO:tasks.rados.rados.0.trial188.stdout:3125: snap_create 2026-02-13T20:25:26.272 INFO:tasks.rados.rados.0.trial188.stdout:3124: done (1 left) 2026-02-13T20:25:26.272 INFO:tasks.rados.rados.0.trial188.stdout:3125: done (0 left) 2026-02-13T20:25:26.273 INFO:tasks.rados.rados.0.trial188.stdout:3126: snap_remove snap 321 2026-02-13T20:25:27.249 INFO:tasks.rados.rados.0.trial188.stdout:3126: done (0 left) 2026-02-13T20:25:27.249 INFO:tasks.rados.rados.0.trial188.stdout:3127: snap_remove snap 322 2026-02-13T20:25:28.253 INFO:tasks.rados.rados.0.trial188.stdout:3127: done (0 left) 2026-02-13T20:25:28.253 INFO:tasks.rados.rados.0.trial188.stdout:3128: read oid 5 snap -1 2026-02-13T20:25:28.253 INFO:tasks.rados.rados.0.trial188.stdout:3128: expect (ObjNum 969 snap 289 seq_num 969) 2026-02-13T20:25:28.253 INFO:tasks.rados.rados.0.trial188.stdout:3129: read oid 27 snap -1 2026-02-13T20:25:28.254 INFO:tasks.rados.rados.0.trial188.stdout:3129: expect deleted 2026-02-13T20:25:28.254 INFO:tasks.rados.rados.0.trial188.stdout:3130: read oid 3 snap -1 2026-02-13T20:25:28.254 INFO:tasks.rados.rados.0.trial188.stdout:3130: expect (ObjNum 1007 snap 299 seq_num 1007) 2026-02-13T20:25:28.254 INFO:tasks.rados.rados.0.trial188.stdout:3131: read oid 4 snap -1 2026-02-13T20:25:28.254 INFO:tasks.rados.rados.0.trial188.stdout:3131: expect (ObjNum 724 snap 214 seq_num 724) 2026-02-13T20:25:28.254 INFO:tasks.rados.rados.0.trial188.stdout:3132: copy_from oid 12 from oid 15 current snap is 323 2026-02-13T20:25:28.254 INFO:tasks.rados.rados.0.trial188.stdout:3133: rollback oid 28 current snap is 323 2026-02-13T20:25:28.254 INFO:tasks.rados.rados.0.trial188.stdout:3133: done (5 left) 2026-02-13T20:25:28.254 INFO:tasks.rados.rados.0.trial188.stdout:3134: rollback oid 29 current snap is 323 2026-02-13T20:25:28.254 INFO:tasks.rados.rados.0.trial188.stdout:3134: done (5 left) 2026-02-13T20:25:28.254 INFO:tasks.rados.rados.0.trial188.stdout:3135: copy_from oid 19 from oid 50 current snap is 323 2026-02-13T20:25:28.255 INFO:tasks.rados.rados.0.trial188.stdout:3136: write oid 44 current snap is 323 2026-02-13T20:25:28.255 INFO:tasks.rados.rados.0.trial188.stdout:3136: seq_num 1076 ranges {484332=573697,1531566=552766} 2026-02-13T20:25:28.256 INFO:tasks.rados.rados.0.trial188.stdout:3136: writing trial18843701-44 from 484332 to 1058029 tid 1 2026-02-13T20:25:28.261 INFO:tasks.rados.rados.0.trial188.stdout:3136: writing trial18843701-44 from 1531566 to 2084332 tid 2 2026-02-13T20:25:28.261 INFO:tasks.rados.rados.0.trial188.stdout:3137: read oid 7 snap -1 2026-02-13T20:25:28.261 INFO:tasks.rados.rados.0.trial188.stdout:3137: expect (ObjNum 1055 snap 315 seq_num 1055) 2026-02-13T20:25:28.261 INFO:tasks.rados.rados.0.trial188.stdout:3138: read oid 49 snap -1 2026-02-13T20:25:28.261 INFO:tasks.rados.rados.0.trial188.stdout:3138: expect (ObjNum 1064 snap 317 seq_num 1064) 2026-02-13T20:25:28.261 INFO:tasks.rados.rados.0.trial188.stdout:3139: delete oid 35 current snap is 323 2026-02-13T20:25:28.261 INFO:tasks.rados.rados.0.trial188.stdout:3131: expect (ObjNum 724 snap 214 seq_num 724) 2026-02-13T20:25:28.264 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 903753 2026-02-13T20:25:28.274 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:25:28.306 INFO:tasks.rados.rados.0.trial188.stdout:3135: finishing copy_from to trial18843701-19 2026-02-13T20:25:28.306 INFO:tasks.rados.rados.0.trial188.stdout:3135: got expected ENOENT (src dne) 2026-02-13T20:25:28.306 INFO:tasks.rados.rados.0.trial188.stdout:3135: finishing copy_from racing read to trial18843701-19 2026-02-13T20:25:28.306 INFO:tasks.rados.rados.0.trial188.stdout:3129: done (9 left) 2026-02-13T20:25:28.306 INFO:tasks.rados.rados.0.trial188.stdout:3131: done (8 left) 2026-02-13T20:25:28.306 INFO:tasks.rados.rados.0.trial188.stdout:3135: done (7 left) 2026-02-13T20:25:28.306 INFO:tasks.rados.rados.0.trial188.stdout:3139: done (6 left) 2026-02-13T20:25:28.306 INFO:tasks.rados.rados.0.trial188.stdout:3140: delete oid 13 current snap is 323 2026-02-13T20:25:28.306 INFO:tasks.rados.rados.0.trial188.stdout:3128: expect (ObjNum 969 snap 289 seq_num 969) 2026-02-13T20:25:28.332 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:25:28.364 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 595999 2026-02-13T20:25:28.389 INFO:tasks.rados.rados.0.trial188.stdout:3130: expect (ObjNum 1007 snap 299 seq_num 1007) 2026-02-13T20:25:28.391 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 669719 2026-02-13T20:25:28.482 INFO:tasks.rados.rados.0.trial188.stdout:3128: done (6 left) 2026-02-13T20:25:28.482 INFO:tasks.rados.rados.0.trial188.stdout:3130: done (5 left) 2026-02-13T20:25:28.483 INFO:tasks.rados.rados.0.trial188.stdout:3140: done (4 left) 2026-02-13T20:25:28.483 INFO:tasks.rados.rados.0.trial188.stdout:3141: snap_create 2026-02-13T20:25:28.483 INFO:tasks.rados.rados.0.trial188.stdout:3138: expect (ObjNum 1064 snap 317 seq_num 1064) 2026-02-13T20:25:28.506 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:25:28.533 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:25:28.561 INFO:tasks.rados.rados.0.trial188.stdout:3137: expect (ObjNum 1055 snap 315 seq_num 1055) 2026-02-13T20:25:28.567 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1121309 2026-02-13T20:25:28.618 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1851374 2026-02-13T20:25:28.681 INFO:tasks.rados.rados.0.trial188.stdout:3136: finishing write tid 1 to trial18843701-44 2026-02-13T20:25:28.681 INFO:tasks.rados.rados.0.trial188.stdout:3136: finishing write tid 2 to trial18843701-44 2026-02-13T20:25:28.681 INFO:tasks.rados.rados.0.trial188.stdout:3136: finishing write tid 3 to trial18843701-44 2026-02-13T20:25:28.681 INFO:tasks.rados.rados.0.trial188.stdout:3136: finishing write tid 4 to trial18843701-44 2026-02-13T20:25:28.682 INFO:tasks.rados.rados.0.trial188.stdout:3136: oid 44 updating version 0 to 1407 2026-02-13T20:25:28.682 INFO:tasks.rados.rados.0.trial188.stdout:3136: oid 44 updating version 1407 to 1409 2026-02-13T20:25:28.682 INFO:tasks.rados.rados.0.trial188.stdout:3136: oid 44 version 1409 is already newer than 1408 2026-02-13T20:25:28.682 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 44 v 1409 (ObjNum 1076 snap 323 seq_num 1076) dirty exists 2026-02-13T20:25:28.682 INFO:tasks.rados.rados.0.trial188.stdout:3136: left oid 44 (ObjNum 1076 snap 323 seq_num 1076) 2026-02-13T20:25:28.682 INFO:tasks.rados.rados.0.trial188.stdout:3132: finishing copy_from racing read to trial18843701-12 2026-02-13T20:25:28.682 INFO:tasks.rados.rados.0.trial188.stdout:3132: finishing copy_from to trial18843701-12 2026-02-13T20:25:28.682 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 12 v 985 (ObjNum 865 snap 250 seq_num 865) dirty exists 2026-02-13T20:25:29.274 INFO:tasks.rados.rados.0.trial188.stdout:3132: done (4 left) 2026-02-13T20:25:29.274 INFO:tasks.rados.rados.0.trial188.stdout:3136: done (3 left) 2026-02-13T20:25:29.274 INFO:tasks.rados.rados.0.trial188.stdout:3137: done (2 left) 2026-02-13T20:25:29.274 INFO:tasks.rados.rados.0.trial188.stdout:3138: done (1 left) 2026-02-13T20:25:29.274 INFO:tasks.rados.rados.0.trial188.stdout:3141: done (0 left) 2026-02-13T20:25:29.274 INFO:tasks.rados.rados.0.trial188.stdout:3142: delete oid 31 current snap is 324 2026-02-13T20:25:29.277 INFO:tasks.rados.rados.0.trial188.stdout:3142: done (0 left) 2026-02-13T20:25:29.277 INFO:tasks.rados.rados.0.trial188.stdout:3143: write oid 35 current snap is 324 2026-02-13T20:25:29.277 INFO:tasks.rados.rados.0.trial188.stdout:3143: seq_num 1080 ranges {551560=591046,1765494=386066} 2026-02-13T20:25:29.282 INFO:tasks.rados.rados.0.trial188.stdout:3143: writing trial18843701-35 from 551560 to 1142606 tid 1 2026-02-13T20:25:29.287 INFO:tasks.rados.rados.0.trial188.stdout:3143: writing trial18843701-35 from 1765494 to 2151560 tid 2 2026-02-13T20:25:29.287 INFO:tasks.rados.rados.0.trial188.stdout:3144: write oid 40 current snap is 324 2026-02-13T20:25:29.287 INFO:tasks.rados.rados.0.trial188.stdout:3144: seq_num 1081 ranges {568367=666295,1707623=460744} 2026-02-13T20:25:29.292 INFO:tasks.rados.rados.0.trial188.stdout:3144: writing trial18843701-40 from 568367 to 1234662 tid 1 2026-02-13T20:25:29.296 INFO:tasks.rados.rados.0.trial188.stdout:3144: writing trial18843701-40 from 1707623 to 2168367 tid 2 2026-02-13T20:25:29.297 INFO:tasks.rados.rados.0.trial188.stdout:3145: rollback oid 15 current snap is 324 2026-02-13T20:25:29.297 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 15 to 323 2026-02-13T20:25:29.297 INFO:tasks.rados.rados.0.trial188.stdout:3146: rollback oid 2 current snap is 324 2026-02-13T20:25:29.297 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 2 to 323 2026-02-13T20:25:29.297 INFO:tasks.rados.rados.0.trial188.stdout:3147: copy_from oid 37 from oid 42 current snap is 324 2026-02-13T20:25:29.297 INFO:tasks.rados.rados.0.trial188.stdout:3148: read oid 49 snap -1 2026-02-13T20:25:29.297 INFO:tasks.rados.rados.0.trial188.stdout:3148: expect (ObjNum 1064 snap 317 seq_num 1064) 2026-02-13T20:25:29.297 INFO:tasks.rados.rados.0.trial188.stdout:3149: rollback oid 36 current snap is 324 2026-02-13T20:25:29.297 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 36 to 323 2026-02-13T20:25:29.297 INFO:tasks.rados.rados.0.trial188.stdout:3150: rollback oid 47 current snap is 324 2026-02-13T20:25:29.297 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 47 to 323 2026-02-13T20:25:29.298 INFO:tasks.rados.rados.0.trial188.stdout:3151: write oid 48 current snap is 324 2026-02-13T20:25:29.298 INFO:tasks.rados.rados.0.trial188.stdout:3151: seq_num 1082 ranges {585174=741544,1766105=419069} 2026-02-13T20:25:29.301 INFO:tasks.rados.rados.0.trial188.stdout:3151: writing trial18843701-48 from 585174 to 1326718 tid 1 2026-02-13T20:25:29.305 INFO:tasks.rados.rados.0.trial188.stdout:3151: writing trial18843701-48 from 1766105 to 2185174 tid 2 2026-02-13T20:25:29.305 INFO:tasks.rados.rados.0.trial188.stdout:3152: delete oid 25 current snap is 324 2026-02-13T20:25:29.306 INFO:tasks.rados.rados.0.trial188.stdout:3146: finishing rollback tid 0 to trial18843701-2 2026-02-13T20:25:29.306 INFO:tasks.rados.rados.0.trial188.stdout:3143: finishing write tid 1 to trial18843701-35 2026-02-13T20:25:29.306 INFO:tasks.rados.rados.0.trial188.stdout:3143: finishing write tid 2 to trial18843701-35 2026-02-13T20:25:29.306 INFO:tasks.rados.rados.0.trial188.stdout:3143: finishing write tid 3 to trial18843701-35 2026-02-13T20:25:29.306 INFO:tasks.rados.rados.0.trial188.stdout:3143: finishing write tid 4 to trial18843701-35 2026-02-13T20:25:29.306 INFO:tasks.rados.rados.0.trial188.stdout:3143: oid 35 updating version 0 to 1420 2026-02-13T20:25:29.306 INFO:tasks.rados.rados.0.trial188.stdout:3143: oid 35 updating version 1420 to 1421 2026-02-13T20:25:29.306 INFO:tasks.rados.rados.0.trial188.stdout:3143: oid 35 version 1421 is already newer than 1419 2026-02-13T20:25:29.306 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 35 v 1421 (ObjNum 1080 snap 324 seq_num 1080) dirty exists 2026-02-13T20:25:29.306 INFO:tasks.rados.rados.0.trial188.stdout:3143: left oid 35 (ObjNum 1080 snap 324 seq_num 1080) 2026-02-13T20:25:29.306 INFO:tasks.rados.rados.0.trial188.stdout:3145: finishing rollback tid 0 to trial18843701-15 2026-02-13T20:25:29.307 INFO:tasks.rados.rados.0.trial188.stdout:3145: finishing rollback tid 1 to trial18843701-15 2026-02-13T20:25:29.307 INFO:tasks.rados.rados.0.trial188.stdout:3148: expect (ObjNum 1064 snap 317 seq_num 1064) 2026-02-13T20:25:29.340 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 3541431 2026-02-13T20:25:29.345 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1895048 2026-02-13T20:25:29.365 INFO:tasks.rados.rados.0.trial188.stdout:3146: finishing rollback tid 1 to trial18843701-2 2026-02-13T20:25:29.365 INFO:tasks.rados.rados.0.trial188.stdout:3146: finishing rollback tid 2 to trial18843701-2 2026-02-13T20:25:29.365 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 2 v 1414 (ObjNum 950 snap 282 seq_num 950) dirty exists 2026-02-13T20:25:29.365 INFO:tasks.rados.rados.0.trial188.stdout:3145: finishing rollback tid 2 to trial18843701-15 2026-02-13T20:25:29.365 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 15 v 1072 (ObjNum 865 snap 250 seq_num 865) dirty exists 2026-02-13T20:25:29.365 INFO:tasks.rados.rados.0.trial188.stdout:3149: finishing rollback tid 0 to trial18843701-36 2026-02-13T20:25:29.365 INFO:tasks.rados.rados.0.trial188.stdout:3149: finishing rollback tid 1 to trial18843701-36 2026-02-13T20:25:29.366 INFO:tasks.rados.rados.0.trial188.stdout:3149: finishing rollback tid 2 to trial18843701-36 2026-02-13T20:25:29.366 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 36 v 1595 (ObjNum 1049 snap 314 seq_num 1049) dirty exists 2026-02-13T20:25:29.366 INFO:tasks.rados.rados.0.trial188.stdout:3150: finishing rollback tid 0 to trial18843701-47 2026-02-13T20:25:29.366 INFO:tasks.rados.rados.0.trial188.stdout:3150: finishing rollback tid 1 to trial18843701-47 2026-02-13T20:25:29.366 INFO:tasks.rados.rados.0.trial188.stdout:3150: finishing rollback tid 2 to trial18843701-47 2026-02-13T20:25:29.366 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 47 v 1080 (ObjNum 1057 snap 316 seq_num 1057) dirty exists 2026-02-13T20:25:29.366 INFO:tasks.rados.rados.0.trial188.stdout:3144: finishing write tid 1 to trial18843701-40 2026-02-13T20:25:29.366 INFO:tasks.rados.rados.0.trial188.stdout:3144: finishing write tid 2 to trial18843701-40 2026-02-13T20:25:29.366 INFO:tasks.rados.rados.0.trial188.stdout:3144: finishing write tid 3 to trial18843701-40 2026-02-13T20:25:29.366 INFO:tasks.rados.rados.0.trial188.stdout:3144: finishing write tid 4 to trial18843701-40 2026-02-13T20:25:29.366 INFO:tasks.rados.rados.0.trial188.stdout:3144: oid 40 updating version 0 to 1353 2026-02-13T20:25:29.366 INFO:tasks.rados.rados.0.trial188.stdout:3144: oid 40 updating version 1353 to 1354 2026-02-13T20:25:29.367 INFO:tasks.rados.rados.0.trial188.stdout:3144: oid 40 version 1354 is already newer than 1352 2026-02-13T20:25:29.367 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 40 v 1354 (ObjNum 1081 snap 324 seq_num 1081) dirty exists 2026-02-13T20:25:29.367 INFO:tasks.rados.rados.0.trial188.stdout:3144: left oid 40 (ObjNum 1081 snap 324 seq_num 1081) 2026-02-13T20:25:29.367 INFO:tasks.rados.rados.0.trial188.stdout:3151: finishing write tid 1 to trial18843701-48 2026-02-13T20:25:29.367 INFO:tasks.rados.rados.0.trial188.stdout:3151: finishing write tid 2 to trial18843701-48 2026-02-13T20:25:29.367 INFO:tasks.rados.rados.0.trial188.stdout:3143: done (9 left) 2026-02-13T20:25:29.367 INFO:tasks.rados.rados.0.trial188.stdout:3144: done (8 left) 2026-02-13T20:25:29.367 INFO:tasks.rados.rados.0.trial188.stdout:3145: done (7 left) 2026-02-13T20:25:29.367 INFO:tasks.rados.rados.0.trial188.stdout:3146: done (6 left) 2026-02-13T20:25:29.367 INFO:tasks.rados.rados.0.trial188.stdout:3148: done (5 left) 2026-02-13T20:25:29.367 INFO:tasks.rados.rados.0.trial188.stdout:3149: done (4 left) 2026-02-13T20:25:29.367 INFO:tasks.rados.rados.0.trial188.stdout:3150: done (3 left) 2026-02-13T20:25:29.368 INFO:tasks.rados.rados.0.trial188.stdout:3152: done (2 left) 2026-02-13T20:25:29.368 INFO:tasks.rados.rados.0.trial188.stdout:3153: read oid 18 snap -1 2026-02-13T20:25:29.368 INFO:tasks.rados.rados.0.trial188.stdout:3153: expect (ObjNum 1071 snap 319 seq_num 1071) 2026-02-13T20:25:29.368 INFO:tasks.rados.rados.0.trial188.stdout:3154: snap_remove snap 323 2026-02-13T20:25:30.278 INFO:tasks.rados.rados.0.trial188.stdout:3154: done (3 left) 2026-02-13T20:25:30.278 INFO:tasks.rados.rados.0.trial188.stdout:3155: write oid 40 current snap is 324 2026-02-13T20:25:30.278 INFO:tasks.rados.rados.0.trial188.stdout:3151: finishing write tid 3 to trial18843701-48 2026-02-13T20:25:30.278 INFO:tasks.rados.rados.0.trial188.stdout:3151: finishing write tid 4 to trial18843701-48 2026-02-13T20:25:30.278 INFO:tasks.rados.rados.0.trial188.stdout:3151: oid 48 updating version 0 to 991 2026-02-13T20:25:30.279 INFO:tasks.rados.rados.0.trial188.stdout:3151: oid 48 version 991 is already newer than 989 2026-02-13T20:25:30.279 INFO:tasks.rados.rados.0.trial188.stdout:3151: oid 48 version 991 is already newer than 990 2026-02-13T20:25:30.279 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 48 v 991 (ObjNum 1082 snap 324 seq_num 1082) dirty exists 2026-02-13T20:25:30.279 INFO:tasks.rados.rados.0.trial188.stdout:3151: left oid 48 (ObjNum 1082 snap 324 seq_num 1082) 2026-02-13T20:25:30.279 INFO:tasks.rados.rados.0.trial188.stdout:3147: finishing copy_from racing read to trial18843701-37 2026-02-13T20:25:30.279 INFO:tasks.rados.rados.0.trial188.stdout:3155: seq_num 1084 ranges {618788=492042,1883069=335719} 2026-02-13T20:25:30.283 INFO:tasks.rados.rados.0.trial188.stdout:3155: writing trial18843701-40 from 618788 to 1110830 tid 1 2026-02-13T20:25:30.287 INFO:tasks.rados.rados.0.trial188.stdout:3155: writing trial18843701-40 from 1883069 to 2218788 tid 2 2026-02-13T20:25:30.287 INFO:tasks.rados.rados.0.trial188.stdout:3151: done (3 left) 2026-02-13T20:25:30.287 INFO:tasks.rados.rados.0.trial188.stdout:3156: snap_create 2026-02-13T20:25:30.287 INFO:tasks.rados.rados.0.trial188.stdout:3147: finishing copy_from to trial18843701-37 2026-02-13T20:25:30.288 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 37 v 1069 (ObjNum 1004 snap 299 seq_num 1004) dirty exists 2026-02-13T20:25:30.288 INFO:tasks.rados.rados.0.trial188.stdout:3153: expect (ObjNum 1071 snap 319 seq_num 1071) 2026-02-13T20:25:30.310 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:25:30.358 INFO:tasks.rados.rados.0.trial188.stdout:3155: finishing write tid 1 to trial18843701-40 2026-02-13T20:25:30.358 INFO:tasks.rados.rados.0.trial188.stdout:3155: finishing write tid 2 to trial18843701-40 2026-02-13T20:25:30.358 INFO:tasks.rados.rados.0.trial188.stdout:3155: finishing write tid 3 to trial18843701-40 2026-02-13T20:25:30.358 INFO:tasks.rados.rados.0.trial188.stdout:3155: finishing write tid 4 to trial18843701-40 2026-02-13T20:25:30.358 INFO:tasks.rados.rados.0.trial188.stdout:3155: oid 40 updating version 0 to 1355 2026-02-13T20:25:30.358 INFO:tasks.rados.rados.0.trial188.stdout:3155: oid 40 updating version 1355 to 1357 2026-02-13T20:25:30.358 INFO:tasks.rados.rados.0.trial188.stdout:3155: oid 40 version 1357 is already newer than 1356 2026-02-13T20:25:30.359 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 40 v 1357 (ObjNum 1084 snap 324 seq_num 1084) dirty exists 2026-02-13T20:25:30.359 INFO:tasks.rados.rados.0.trial188.stdout:3155: left oid 40 (ObjNum 1084 snap 324 seq_num 1084) 2026-02-13T20:25:31.279 INFO:tasks.rados.rados.0.trial188.stdout:3147: done (3 left) 2026-02-13T20:25:31.280 INFO:tasks.rados.rados.0.trial188.stdout:3153: done (2 left) 2026-02-13T20:25:31.280 INFO:tasks.rados.rados.0.trial188.stdout:3155: done (1 left) 2026-02-13T20:25:31.280 INFO:tasks.rados.rados.0.trial188.stdout:3156: done (0 left) 2026-02-13T20:25:31.280 INFO:tasks.rados.rados.0.trial188.stdout:3157: delete oid 14 current snap is 325 2026-02-13T20:25:31.283 INFO:tasks.rados.rados.0.trial188.stdout:3157: done (0 left) 2026-02-13T20:25:31.283 INFO:tasks.rados.rados.0.trial188.stdout:3158: read oid 40 snap -1 2026-02-13T20:25:31.283 INFO:tasks.rados.rados.0.trial188.stdout:3158: expect (ObjNum 1084 snap 324 seq_num 1084) 2026-02-13T20:25:31.283 INFO:tasks.rados.rados.0.trial188.stdout:3159: snap_remove snap 324 2026-02-13T20:25:32.251 INFO:tasks.rados.rados.0.trial188.stdout:3159: done (1 left) 2026-02-13T20:25:32.251 INFO:tasks.rados.rados.0.trial188.stdout:3160: read oid 15 snap -1 2026-02-13T20:25:32.251 INFO:tasks.rados.rados.0.trial188.stdout:3160: expect (ObjNum 865 snap 250 seq_num 865) 2026-02-13T20:25:32.251 INFO:tasks.rados.rados.0.trial188.stdout:3161: write oid 42 current snap is 325 2026-02-13T20:25:32.251 INFO:tasks.rados.rados.0.trial188.stdout:3161: seq_num 1086 ranges {652402=642540,1883680=368722} 2026-02-13T20:25:32.256 INFO:tasks.rados.rados.0.trial188.stdout:3161: writing trial18843701-42 from 652402 to 1294942 tid 1 2026-02-13T20:25:32.260 INFO:tasks.rados.rados.0.trial188.stdout:3161: writing trial18843701-42 from 1883680 to 2252402 tid 2 2026-02-13T20:25:32.260 INFO:tasks.rados.rados.0.trial188.stdout:3162: delete oid 19 current snap is 325 2026-02-13T20:25:32.260 INFO:tasks.rados.rados.0.trial188.stdout:3158: expect (ObjNum 1084 snap 324 seq_num 1084) 2026-02-13T20:25:32.316 INFO:tasks.rados.rados.0.trial188.stdout:3160: expect (ObjNum 865 snap 250 seq_num 865) 2026-02-13T20:25:32.357 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:25:32.421 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1252336 2026-02-13T20:25:32.453 INFO:tasks.rados.rados.0.trial188.stdout:3161: finishing write tid 1 to trial18843701-42 2026-02-13T20:25:32.453 INFO:tasks.rados.rados.0.trial188.stdout:3161: finishing write tid 2 to trial18843701-42 2026-02-13T20:25:32.453 INFO:tasks.rados.rados.0.trial188.stdout:3161: finishing write tid 3 to trial18843701-42 2026-02-13T20:25:32.453 INFO:tasks.rados.rados.0.trial188.stdout:3161: finishing write tid 4 to trial18843701-42 2026-02-13T20:25:32.453 INFO:tasks.rados.rados.0.trial188.stdout:3161: oid 42 updating version 0 to 1423 2026-02-13T20:25:32.453 INFO:tasks.rados.rados.0.trial188.stdout:3161: oid 42 updating version 1423 to 1424 2026-02-13T20:25:32.453 INFO:tasks.rados.rados.0.trial188.stdout:3161: oid 42 version 1424 is already newer than 1422 2026-02-13T20:25:32.453 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 42 v 1424 (ObjNum 1086 snap 325 seq_num 1086) dirty exists 2026-02-13T20:25:32.453 INFO:tasks.rados.rados.0.trial188.stdout:3161: left oid 42 (ObjNum 1086 snap 325 seq_num 1086) 2026-02-13T20:25:32.454 INFO:tasks.rados.rados.0.trial188.stdout:3158: done (3 left) 2026-02-13T20:25:32.454 INFO:tasks.rados.rados.0.trial188.stdout:3160: done (2 left) 2026-02-13T20:25:32.454 INFO:tasks.rados.rados.0.trial188.stdout:3161: done (1 left) 2026-02-13T20:25:32.454 INFO:tasks.rados.rados.0.trial188.stdout:3162: done (0 left) 2026-02-13T20:25:32.454 INFO:tasks.rados.rados.0.trial188.stdout:3163: write (excl) oid 31 current snap is 325 2026-02-13T20:25:32.454 INFO:tasks.rados.rados.0.trial188.stdout:3163: seq_num 1088 ranges {686016=509391,1716997=569019} 2026-02-13T20:25:32.457 INFO:tasks.rados.rados.0.trial188.stdout:3163: writing trial18843701-31 from 686016 to 1195407 tid 1 2026-02-13T20:25:32.461 INFO:tasks.rados.rados.0.trial188.stdout:3163: writing trial18843701-31 from 1716997 to 2286016 tid 2 2026-02-13T20:25:32.461 INFO:tasks.rados.rados.0.trial188.stdout:3164: copy_from oid 22 from oid 3 current snap is 325 2026-02-13T20:25:32.461 INFO:tasks.rados.rados.0.trial188.stdout:3165: delete oid 6 current snap is 325 2026-02-13T20:25:32.474 INFO:tasks.rados.rados.0.trial188.stdout:3163: finishing write tid 1 to trial18843701-31 2026-02-13T20:25:32.474 INFO:tasks.rados.rados.0.trial188.stdout:3163: finishing write tid 2 to trial18843701-31 2026-02-13T20:25:32.474 INFO:tasks.rados.rados.0.trial188.stdout:3165: done (2 left) 2026-02-13T20:25:32.474 INFO:tasks.rados.rados.0.trial188.stdout:3166: read oid 15 snap -1 2026-02-13T20:25:32.474 INFO:tasks.rados.rados.0.trial188.stdout:3166: expect (ObjNum 865 snap 250 seq_num 865) 2026-02-13T20:25:32.474 INFO:tasks.rados.rados.0.trial188.stdout:3167: write oid 46 current snap is 325 2026-02-13T20:25:32.475 INFO:tasks.rados.rados.0.trial188.stdout:3167: seq_num 1090 ranges {719630=659889,2117608=202022} 2026-02-13T20:25:32.479 INFO:tasks.rados.rados.0.trial188.stdout:3167: writing trial18843701-46 from 719630 to 1379519 tid 1 2026-02-13T20:25:32.483 INFO:tasks.rados.rados.0.trial188.stdout:3167: writing trial18843701-46 from 2117608 to 2319630 tid 2 2026-02-13T20:25:32.484 INFO:tasks.rados.rados.0.trial188.stdout:3168: rollback oid 29 current snap is 325 2026-02-13T20:25:32.484 INFO:tasks.rados.rados.0.trial188.stdout:3168: done (4 left) 2026-02-13T20:25:32.484 INFO:tasks.rados.rados.0.trial188.stdout:3169: delete oid 17 current snap is 325 2026-02-13T20:25:32.484 INFO:tasks.rados.rados.0.trial188.stdout:3163: finishing write tid 3 to trial18843701-31 2026-02-13T20:25:32.484 INFO:tasks.rados.rados.0.trial188.stdout:3163: finishing write tid 4 to trial18843701-31 2026-02-13T20:25:32.484 INFO:tasks.rados.rados.0.trial188.stdout:3163: oid 31 updating version 0 to 1446 2026-02-13T20:25:32.484 INFO:tasks.rados.rados.0.trial188.stdout:3163: oid 31 updating version 1446 to 1448 2026-02-13T20:25:32.484 INFO:tasks.rados.rados.0.trial188.stdout:3163: oid 31 version 1448 is already newer than 1447 2026-02-13T20:25:32.484 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 31 v 1448 (ObjNum 1088 snap 325 seq_num 1088) dirty exists 2026-02-13T20:25:32.484 INFO:tasks.rados.rados.0.trial188.stdout:3163: left oid 31 (ObjNum 1088 snap 325 seq_num 1088) 2026-02-13T20:25:32.485 INFO:tasks.rados.rados.0.trial188.stdout:3166: expect (ObjNum 865 snap 250 seq_num 865) 2026-02-13T20:25:32.626 INFO:tasks.rados.rados.0.trial188.stdout:3164: finishing copy_from racing read to trial18843701-22 2026-02-13T20:25:32.626 INFO:tasks.rados.rados.0.trial188.stdout:3167: finishing write tid 1 to trial18843701-46 2026-02-13T20:25:32.626 INFO:tasks.rados.rados.0.trial188.stdout:3167: finishing write tid 2 to trial18843701-46 2026-02-13T20:25:32.626 INFO:tasks.rados.rados.0.trial188.stdout:3167: finishing write tid 3 to trial18843701-46 2026-02-13T20:25:32.626 INFO:tasks.rados.rados.0.trial188.stdout:3167: finishing write tid 4 to trial18843701-46 2026-02-13T20:25:32.626 INFO:tasks.rados.rados.0.trial188.stdout:3167: oid 46 updating version 0 to 1359 2026-02-13T20:25:32.626 INFO:tasks.rados.rados.0.trial188.stdout:3167: oid 46 version 1359 is already newer than 1358 2026-02-13T20:25:32.626 INFO:tasks.rados.rados.0.trial188.stdout:3167: oid 46 updating version 1359 to 1360 2026-02-13T20:25:32.626 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 46 v 1360 (ObjNum 1090 snap 325 seq_num 1090) dirty exists 2026-02-13T20:25:32.626 INFO:tasks.rados.rados.0.trial188.stdout:3167: left oid 46 (ObjNum 1090 snap 325 seq_num 1090) 2026-02-13T20:25:32.626 INFO:tasks.rados.rados.0.trial188.stdout:3164: finishing copy_from to trial18843701-22 2026-02-13T20:25:32.626 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 22 v 999 (ObjNum 1007 snap 299 seq_num 1007) dirty exists 2026-02-13T20:25:32.626 INFO:tasks.rados.rados.0.trial188.stdout:3163: done (4 left) 2026-02-13T20:25:32.626 INFO:tasks.rados.rados.0.trial188.stdout:3164: done (3 left) 2026-02-13T20:25:32.626 INFO:tasks.rados.rados.0.trial188.stdout:3166: done (2 left) 2026-02-13T20:25:32.626 INFO:tasks.rados.rados.0.trial188.stdout:3167: done (1 left) 2026-02-13T20:25:32.626 INFO:tasks.rados.rados.0.trial188.stdout:3169: done (0 left) 2026-02-13T20:25:32.626 INFO:tasks.rados.rados.0.trial188.stdout:3170: delete oid 2 current snap is 325 2026-02-13T20:25:32.627 INFO:tasks.rados.rados.0.trial188.stdout:3170: done (0 left) 2026-02-13T20:25:32.627 INFO:tasks.rados.rados.0.trial188.stdout:3171: rollback oid 7 current snap is 325 2026-02-13T20:25:32.627 INFO:tasks.rados.rados.0.trial188.stdout:3171: done (0 left) 2026-02-13T20:25:32.627 INFO:tasks.rados.rados.0.trial188.stdout:3172: write (excl) oid 3 current snap is 325 2026-02-13T20:25:32.627 INFO:tasks.rados.rados.0.trial188.stdout:3172: seq_num 1093 ranges {770051=485636,1776701=511047} 2026-02-13T20:25:32.632 INFO:tasks.rados.rados.0.trial188.stdout:3172: writing trial18843701-3 from 770051 to 1255687 tid 1 2026-02-13T20:25:32.636 INFO:tasks.rados.rados.0.trial188.stdout:3172: writing trial18843701-3 from 1776701 to 2287748 tid 2 2026-02-13T20:25:32.636 INFO:tasks.rados.rados.0.trial188.stdout:3173: delete oid 8 current snap is 325 2026-02-13T20:25:32.650 INFO:tasks.rados.rados.0.trial188.stdout:3173: done (1 left) 2026-02-13T20:25:32.650 INFO:tasks.rados.rados.0.trial188.stdout:3174: rollback oid 2 current snap is 325 2026-02-13T20:25:32.650 INFO:tasks.rados.rados.0.trial188.stdout:3174: done (1 left) 2026-02-13T20:25:32.650 INFO:tasks.rados.rados.0.trial188.stdout:3175: copy_from oid 2 from oid 16 current snap is 325 2026-02-13T20:25:32.651 INFO:tasks.rados.rados.0.trial188.stdout:3172: finishing write tid 1 to trial18843701-3 2026-02-13T20:25:32.651 INFO:tasks.rados.rados.0.trial188.stdout:3176: snap_create 2026-02-13T20:25:32.651 INFO:tasks.rados.rados.0.trial188.stdout:3172: finishing write tid 2 to trial18843701-3 2026-02-13T20:25:32.651 INFO:tasks.rados.rados.0.trial188.stdout:3172: finishing write tid 3 to trial18843701-3 2026-02-13T20:25:32.651 INFO:tasks.rados.rados.0.trial188.stdout:3172: finishing write tid 4 to trial18843701-3 2026-02-13T20:25:32.651 INFO:tasks.rados.rados.0.trial188.stdout:3172: oid 3 updating version 0 to 1081 2026-02-13T20:25:32.651 INFO:tasks.rados.rados.0.trial188.stdout:3172: oid 3 version 1081 is already newer than 1080 2026-02-13T20:25:32.651 INFO:tasks.rados.rados.0.trial188.stdout:3172: oid 3 version 1081 is already newer than 1079 2026-02-13T20:25:32.651 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 3 v 1081 (ObjNum 1093 snap 325 seq_num 1093) dirty exists 2026-02-13T20:25:32.651 INFO:tasks.rados.rados.0.trial188.stdout:3172: left oid 3 (ObjNum 1093 snap 325 seq_num 1093) 2026-02-13T20:25:32.685 INFO:tasks.rados.rados.0.trial188.stdout:3175: finishing copy_from racing read to trial18843701-2 2026-02-13T20:25:32.688 INFO:tasks.rados.rados.0.trial188.stdout:3175: finishing copy_from to trial18843701-2 2026-02-13T20:25:32.688 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 2 v 1495 (ObjNum 1031 snap 308 seq_num 1031) dirty exists 2026-02-13T20:25:33.286 INFO:tasks.rados.rados.0.trial188.stdout:3172: done (2 left) 2026-02-13T20:25:33.286 INFO:tasks.rados.rados.0.trial188.stdout:3175: done (1 left) 2026-02-13T20:25:33.286 INFO:tasks.rados.rados.0.trial188.stdout:3176: done (0 left) 2026-02-13T20:25:33.287 INFO:tasks.rados.rados.0.trial188.stdout:3177: delete oid 34 current snap is 326 2026-02-13T20:25:33.291 INFO:tasks.rados.rados.0.trial188.stdout:3177: done (0 left) 2026-02-13T20:25:33.291 INFO:tasks.rados.rados.0.trial188.stdout:3178: copy_from oid 2 from oid 39 current snap is 326 2026-02-13T20:25:33.291 INFO:tasks.rados.rados.0.trial188.stdout:3179: write oid 23 current snap is 326 2026-02-13T20:25:33.291 INFO:tasks.rados.rados.0.trial188.stdout:3179: seq_num 1096 ranges {420472=427736,1268500=658374,2347953=72519} 2026-02-13T20:25:33.294 INFO:tasks.rados.rados.0.trial188.stdout:3179: writing trial18843701-23 from 420472 to 848208 tid 1 2026-02-13T20:25:33.298 INFO:tasks.rados.rados.0.trial188.stdout:3179: writing trial18843701-23 from 1268500 to 1926874 tid 2 2026-02-13T20:25:33.300 INFO:tasks.rados.rados.0.trial188.stdout:3179: writing trial18843701-23 from 2347953 to 2420472 tid 3 2026-02-13T20:25:33.300 INFO:tasks.rados.rados.0.trial188.stdout:3180: read oid 14 snap -1 2026-02-13T20:25:33.300 INFO:tasks.rados.rados.0.trial188.stdout:3180: expect deleted 2026-02-13T20:25:33.301 INFO:tasks.rados.rados.0.trial188.stdout:3181: write oid 3 current snap is 326 2026-02-13T20:25:33.301 INFO:tasks.rados.rados.0.trial188.stdout:3181: seq_num 1097 ranges {437279=502985,1610629=518385} 2026-02-13T20:25:33.303 INFO:tasks.rados.rados.0.trial188.stdout:3181: writing trial18843701-3 from 437279 to 940264 tid 1 2026-02-13T20:25:33.308 INFO:tasks.rados.rados.0.trial188.stdout:3181: writing trial18843701-3 from 1610629 to 2129014 tid 2 2026-02-13T20:25:33.308 INFO:tasks.rados.rados.0.trial188.stdout:3182: write oid 17 current snap is 326 2026-02-13T20:25:33.308 INFO:tasks.rados.rados.0.trial188.stdout:3182: seq_num 1098 ranges {454086=578234,1669111=662043} 2026-02-13T20:25:33.312 INFO:tasks.rados.rados.0.trial188.stdout:3182: writing trial18843701-17 from 454086 to 1032320 tid 1 2026-02-13T20:25:33.317 INFO:tasks.rados.rados.0.trial188.stdout:3182: writing trial18843701-17 from 1669111 to 2331154 tid 2 2026-02-13T20:25:33.317 INFO:tasks.rados.rados.0.trial188.stdout:3183: copy_from oid 27 from oid 7 current snap is 326 2026-02-13T20:25:33.317 INFO:tasks.rados.rados.0.trial188.stdout:3179: finishing write tid 1 to trial18843701-23 2026-02-13T20:25:33.317 INFO:tasks.rados.rados.0.trial188.stdout:3179: finishing write tid 2 to trial18843701-23 2026-02-13T20:25:33.318 INFO:tasks.rados.rados.0.trial188.stdout:3179: finishing write tid 3 to trial18843701-23 2026-02-13T20:25:33.318 INFO:tasks.rados.rados.0.trial188.stdout:3184: copy_from oid 1 from oid 43 current snap is 326 2026-02-13T20:25:33.318 INFO:tasks.rados.rados.0.trial188.stdout:3180: done (6 left) 2026-02-13T20:25:33.318 INFO:tasks.rados.rados.0.trial188.stdout:3185: delete oid 18 current snap is 326 2026-02-13T20:25:33.319 INFO:tasks.rados.rados.0.trial188.stdout:3179: finishing write tid 4 to trial18843701-23 2026-02-13T20:25:33.319 INFO:tasks.rados.rados.0.trial188.stdout:3179: finishing write tid 5 to trial18843701-23 2026-02-13T20:25:33.319 INFO:tasks.rados.rados.0.trial188.stdout:3179: oid 23 updating version 0 to 1601 2026-02-13T20:25:33.319 INFO:tasks.rados.rados.0.trial188.stdout:3179: oid 23 version 1601 is already newer than 1599 2026-02-13T20:25:33.319 INFO:tasks.rados.rados.0.trial188.stdout:3179: oid 23 updating version 1601 to 1602 2026-02-13T20:25:33.319 INFO:tasks.rados.rados.0.trial188.stdout:3179: oid 23 version 1602 is already newer than 1600 2026-02-13T20:25:33.320 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 23 v 1602 (ObjNum 1096 snap 326 seq_num 1096) dirty exists 2026-02-13T20:25:33.320 INFO:tasks.rados.rados.0.trial188.stdout:3179: left oid 23 (ObjNum 1096 snap 326 seq_num 1096) 2026-02-13T20:25:33.330 INFO:tasks.rados.rados.0.trial188.stdout:3181: finishing write tid 1 to trial18843701-3 2026-02-13T20:25:33.330 INFO:tasks.rados.rados.0.trial188.stdout:3182: finishing write tid 1 to trial18843701-17 2026-02-13T20:25:33.330 INFO:tasks.rados.rados.0.trial188.stdout:3181: finishing write tid 2 to trial18843701-3 2026-02-13T20:25:33.331 INFO:tasks.rados.rados.0.trial188.stdout:3181: finishing write tid 3 to trial18843701-3 2026-02-13T20:25:33.331 INFO:tasks.rados.rados.0.trial188.stdout:3181: finishing write tid 4 to trial18843701-3 2026-02-13T20:25:33.332 INFO:tasks.rados.rados.0.trial188.stdout:3181: oid 3 updating version 0 to 1084 2026-02-13T20:25:33.332 INFO:tasks.rados.rados.0.trial188.stdout:3181: oid 3 version 1084 is already newer than 1083 2026-02-13T20:25:33.332 INFO:tasks.rados.rados.0.trial188.stdout:3181: oid 3 updating version 1084 to 1085 2026-02-13T20:25:33.332 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 3 v 1085 (ObjNum 1097 snap 326 seq_num 1097) dirty exists 2026-02-13T20:25:33.332 INFO:tasks.rados.rados.0.trial188.stdout:3181: left oid 3 (ObjNum 1097 snap 326 seq_num 1097) 2026-02-13T20:25:33.332 INFO:tasks.rados.rados.0.trial188.stdout:3182: finishing write tid 2 to trial18843701-17 2026-02-13T20:25:33.332 INFO:tasks.rados.rados.0.trial188.stdout:3182: finishing write tid 3 to trial18843701-17 2026-02-13T20:25:33.332 INFO:tasks.rados.rados.0.trial188.stdout:3182: finishing write tid 4 to trial18843701-17 2026-02-13T20:25:33.332 INFO:tasks.rados.rados.0.trial188.stdout:3182: oid 17 updating version 0 to 1370 2026-02-13T20:25:33.332 INFO:tasks.rados.rados.0.trial188.stdout:3182: oid 17 version 1370 is already newer than 1369 2026-02-13T20:25:33.332 INFO:tasks.rados.rados.0.trial188.stdout:3182: oid 17 version 1370 is already newer than 1368 2026-02-13T20:25:33.332 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 17 v 1370 (ObjNum 1098 snap 326 seq_num 1098) dirty exists 2026-02-13T20:25:33.333 INFO:tasks.rados.rados.0.trial188.stdout:3182: left oid 17 (ObjNum 1098 snap 326 seq_num 1098) 2026-02-13T20:25:33.333 INFO:tasks.rados.rados.0.trial188.stdout:3179: done (6 left) 2026-02-13T20:25:33.333 INFO:tasks.rados.rados.0.trial188.stdout:3181: done (5 left) 2026-02-13T20:25:33.333 INFO:tasks.rados.rados.0.trial188.stdout:3182: done (4 left) 2026-02-13T20:25:33.333 INFO:tasks.rados.rados.0.trial188.stdout:3185: done (3 left) 2026-02-13T20:25:33.333 INFO:tasks.rados.rados.0.trial188.stdout:3186: write (excl) oid 44 current snap is 326 2026-02-13T20:25:33.333 INFO:tasks.rados.rados.0.trial188.stdout:3186: seq_num 1100 ranges {487700=728732,1786075=665712} 2026-02-13T20:25:33.336 INFO:tasks.rados.rados.0.trial188.stdout:3186: writing trial18843701-44 from 487700 to 1216432 tid 1 2026-02-13T20:25:33.341 INFO:tasks.rados.rados.0.trial188.stdout:3186: writing trial18843701-44 from 1786075 to 2451787 tid 2 2026-02-13T20:25:33.342 INFO:tasks.rados.rados.0.trial188.stdout:3187: read oid 46 snap -1 2026-02-13T20:25:33.342 INFO:tasks.rados.rados.0.trial188.stdout:3187: expect (ObjNum 1090 snap 325 seq_num 1090) 2026-02-13T20:25:33.342 INFO:tasks.rados.rados.0.trial188.stdout:3188: read oid 32 snap -1 2026-02-13T20:25:33.342 INFO:tasks.rados.rados.0.trial188.stdout:3188: expect (ObjNum 1054 snap 314 seq_num 1054) 2026-02-13T20:25:33.342 INFO:tasks.rados.rados.0.trial188.stdout:3189: copy_from oid 40 from oid 22 current snap is 326 2026-02-13T20:25:33.342 INFO:tasks.rados.rados.0.trial188.stdout:3178: finishing copy_from racing read to trial18843701-2 2026-02-13T20:25:33.342 INFO:tasks.rados.rados.0.trial188.stdout:3190: snap_remove snap 325 2026-02-13T20:25:33.670 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2026-02-13T20:25:33.670 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2026-02-13T20:25:33.670 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-13T20:25:33.670 DEBUG:teuthology.orchestra.run.trial188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-13T20:25:33.673 INFO:tasks.ceph.mon.b:Started 2026-02-13T20:25:33.673 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-13T20:25:33.674 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T20:25:33.750 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.748+0000 7f8713394640 10 monclient: get_monmap_and_config 2026-02-13T20:25:33.751 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.748+0000 7f8713394640 10 monclient: build_initial_monmap 2026-02-13T20:25:33.751 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.748+0000 7f8713394640 10 monclient: monmap: 2026-02-13T20:25:33.751 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:25:33.751 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:33.751 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:25:33.750349+0000 2026-02-13T20:25:33.751 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:25:33.750349+0000 2026-02-13T20:25:33.751 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:25:33.751 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:33.751 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:25:33.751 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:25:33.751 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:25:33.752 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:33.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.749+0000 7f8713394640 1 Processor -- start 2026-02-13T20:25:33.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.749+0000 7f8713394640 1 -- start start 2026-02-13T20:25:33.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.749+0000 7f8713394640 10 monclient: init 2026-02-13T20:25:33.759 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.749+0000 7f8713394640 10 monclient: _reopen_session rank -1 2026-02-13T20:25:33.759 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.749+0000 7f8713394640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:25:33.759 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.749+0000 7f8713394640 10 monclient(hunting): picked mon.noname-c con 0x7f870c1401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:25:33.759 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.749+0000 7f8713394640 10 monclient(hunting): picked mon.noname-a con 0x7f870c092020 addr v1:10.20.193.110:6789/0 2026-02-13T20:25:33.759 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.749+0000 7f8713394640 10 monclient(hunting): picked mon.noname-b con 0x7f870c091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:25:33.760 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.749+0000 7f8710908640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f870c092020 0x7f870c1812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:47936/0 (socket says 10.20.193.110:47936) 2026-02-13T20:25:33.760 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.749+0000 7f8710908640 1 -- 10.20.193.110:0/2928883438 learned_addr learned my addr 10.20.193.110:0/2928883438 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:25:33.760 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.749+0000 7f8713394640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f870c08b730 con 0x7f870c092020 2026-02-13T20:25:33.760 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.750+0000 7f8713394640 1 -- 10.20.193.110:0/2928883438 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f870c05c5b0 con 0x7f870c1401c0 2026-02-13T20:25:33.760 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.750+0000 7f8713394640 1 -- 10.20.193.110:0/2928883438 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f870c08bcf0 con 0x7f870c091950 2026-02-13T20:25:33.760 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.750+0000 7f8713394640 10 monclient(hunting): _renew_subs 2026-02-13T20:25:33.760 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.750+0000 7f8713394640 10 monclient(hunting): authenticate will time out at 1495.441027s 2026-02-13T20:25:33.760 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.750+0000 7f86fbfff640 1 -- 10.20.193.110:0/2928883438 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 98569317 0 0) 0x7f870c08bcf0 con 0x7f870c091950 2026-02-13T20:25:33.760 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.750+0000 7f86fbfff640 10 monclient(hunting): _negotiate 2026-02-13T20:25:33.760 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.750+0000 7f86fbfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:33.761 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.750+0000 7f86fbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:33.761 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.750+0000 7f86fbfff640 10 monclient(hunting): my global_id is 94589 2026-02-13T20:25:33.761 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.750+0000 7f86fbfff640 1 -- 10.20.193.110:0/2928883438 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86f40035e0 con 0x7f870c091950 2026-02-13T20:25:33.761 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.751+0000 7f86fbfff640 1 -- 10.20.193.110:0/2928883438 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 737637425 0 0) 0x7f86f40035e0 con 0x7f870c091950 2026-02-13T20:25:33.761 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.751+0000 7f86fbfff640 1 -- 10.20.193.110:0/2928883438 >> v1:10.20.193.188:6789/0 conn(0x7f870c1401c0 legacy=0x7f870c091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:33.761 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.751+0000 7f86fbfff640 1 -- 10.20.193.110:0/2928883438 >> v1:10.20.193.110:6789/0 conn(0x7f870c092020 legacy=0x7f870c1812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:33.761 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.751+0000 7f86fbfff640 10 monclient: _finish_hunting 0 2026-02-13T20:25:33.761 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.751+0000 7f86fbfff640 1 monclient: found mon.noname-b 2026-02-13T20:25:33.761 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.751+0000 7f86fbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:25:33.761 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.751+0000 7f86fbfff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:25:33.761 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.751+0000 7f86fbfff640 1 -- 10.20.193.110:0/2928883438 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f870c140590 con 0x7f870c091950 2026-02-13T20:25:33.761 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.751+0000 7f86fbfff640 10 monclient: _finish_auth 0 2026-02-13T20:25:33.762 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.751+0000 7f86fbfff640 10 monclient: _check_auth_tickets 2026-02-13T20:25:33.762 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.751+0000 7f86fbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:25:33.762 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.751+0000 7f86fbfff640 1 -- 10.20.193.110:0/2928883438 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f8708003eb0 con 0x7f870c091950 2026-02-13T20:25:33.762 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.751+0000 7f86fbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:33.762 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.751+0000 7f86fbfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:25:33.762 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.751+0000 7f86fbfff640 10 monclient: dump: 2026-02-13T20:25:33.762 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:33.762 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:33.762 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:33.762 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:33.762 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:33.762 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:33.763 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:33.763 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:33.763 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:33.763 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:33.763 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.751+0000 7f8713394640 5 monclient: authenticate success, global_id 94589 2026-02-13T20:25:33.763 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.751+0000 7f8713394640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:25:33.763 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.751+0000 7f86fbfff640 1 -- 10.20.193.110:0/2928883438 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8708004080 con 0x7f870c091950 2026-02-13T20:25:33.763 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.751+0000 7f86fbfff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:25:33.763 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.751+0000 7f86fbfff640 1 -- 10.20.193.110:0/2928883438 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f8708004490 con 0x7f870c091950 2026-02-13T20:25:33.763 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.751+0000 7f86fbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:33.763 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.751+0000 7f86fbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:25:33.763 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.751+0000 7f86fbfff640 10 monclient: dump: 2026-02-13T20:25:33.764 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:33.764 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:33.764 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:33.764 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:33.764 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:33.764 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:33.764 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:33.764 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:33.764 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:33.764 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:33.764 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.751+0000 7f8713394640 10 monclient: get_monmap_and_config success 2026-02-13T20:25:33.764 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.751+0000 7f8713394640 4 set_mon_vals no callback set 2026-02-13T20:25:33.765 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.751+0000 7f8713394640 10 monclient: shutdown 2026-02-13T20:25:33.765 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.751+0000 7f8713394640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:25:33.765 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.751+0000 7f8713394640 1 -- 10.20.193.110:0/2928883438 >> v1:10.20.193.110:6790/0 conn(0x7f870c091950 legacy=0x7f870c1a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:33.765 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.751+0000 7f8713394640 1 -- 10.20.193.110:0/2928883438 shutdown_connections 2026-02-13T20:25:33.765 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.751+0000 7f8713394640 1 -- 10.20.193.110:0/2928883438 >> 10.20.193.110:0/2928883438 conn(0x7f870c054e90 msgr2=0x7f870c058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:25:33.765 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.751+0000 7f8713394640 1 -- 10.20.193.110:0/2928883438 shutdown_connections 2026-02-13T20:25:33.765 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.751+0000 7f8713394640 1 -- 10.20.193.110:0/2928883438 wait complete. 2026-02-13T20:25:33.765 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.752+0000 7f8713394640 10 monclient: build_initial_monmap 2026-02-13T20:25:33.765 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.752+0000 7f8713394640 10 monclient: monmap: 2026-02-13T20:25:33.765 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:25:33.765 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:25:33.765 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:25:33.766 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:25:33.766 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:25:33.766 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:25:33.766 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:25:33.766 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:25:33.766 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:25:33.766 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:33.766 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.752+0000 7f8713394640 1 Processor -- start 2026-02-13T20:25:33.766 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.752+0000 7f8713394640 1 -- start start 2026-02-13T20:25:33.766 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.752+0000 7f8713394640 10 monclient: init 2026-02-13T20:25:33.766 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.752+0000 7f8713394640 10 monclient: _reopen_session rank -1 2026-02-13T20:25:33.766 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.752+0000 7f8713394640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:25:33.766 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.752+0000 7f8713394640 10 monclient(hunting): picked mon.noname-b con 0x7f870c091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:25:33.767 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.752+0000 7f8713394640 10 monclient(hunting): picked mon.noname-c con 0x7f870c1401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:25:33.767 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.752+0000 7f8713394640 10 monclient(hunting): picked mon.noname-a con 0x7f870c13eab0 addr v1:10.20.193.110:6789/0 2026-02-13T20:25:33.767 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.752+0000 7f8713394640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f870c12fda0 con 0x7f870c13eab0 2026-02-13T20:25:33.767 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.752+0000 7f8713394640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f870c091040 con 0x7f870c091950 2026-02-13T20:25:33.767 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.752+0000 7f8713394640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f870c08c4c0 con 0x7f870c1401c0 2026-02-13T20:25:33.767 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.752+0000 7f8713394640 10 monclient(hunting): _renew_subs 2026-02-13T20:25:33.767 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.752+0000 7f8713394640 10 monclient(hunting): authenticate will time out at 1495.443628s 2026-02-13T20:25:33.767 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.752+0000 7f871190a640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f870c13eab0 0x7f870c1930d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:47952/0 (socket says 10.20.193.110:47952) 2026-02-13T20:25:33.767 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.752+0000 7f871190a640 1 -- 10.20.193.110:0/1186375994 learned_addr learned my addr 10.20.193.110:0/1186375994 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:25:33.767 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.752+0000 7f8710908640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f870c1401c0 0x7f870c1919b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:48016/0 (socket says 10.20.193.110:48016) 2026-02-13T20:25:33.767 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.752+0000 7f86f9ffb640 1 -- 10.20.193.110:0/1186375994 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3517801585 0 0) 0x7f870c08c4c0 con 0x7f870c1401c0 2026-02-13T20:25:33.767 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.752+0000 7f86f9ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:25:33.768 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.752+0000 7f86f9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:33.768 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.752+0000 7f86f9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:33.768 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.752+0000 7f86f9ffb640 10 monclient(hunting): my global_id is 94592 2026-02-13T20:25:33.768 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.752+0000 7f86f9ffb640 1 -- 10.20.193.110:0/1186375994 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86dc0035e0 con 0x7f870c1401c0 2026-02-13T20:25:33.768 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.753+0000 7f86f9ffb640 1 -- 10.20.193.110:0/1186375994 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 330177409 0 0) 0x7f86dc0035e0 con 0x7f870c1401c0 2026-02-13T20:25:33.768 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.753+0000 7f86f9ffb640 1 -- 10.20.193.110:0/1186375994 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f870c08c4c0 con 0x7f870c1401c0 2026-02-13T20:25:33.768 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.753+0000 7f86f9ffb640 1 -- 10.20.193.110:0/1186375994 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f8700002f30 con 0x7f870c1401c0 2026-02-13T20:25:33.768 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.753+0000 7f86f9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:25:33.768 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.753+0000 7f86f9ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:25:33.768 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.753+0000 7f86f9ffb640 10 monclient(hunting): dump: 2026-02-13T20:25:33.768 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:33.768 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:33.769 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:33.769 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:33.769 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:33.769 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:33.769 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:33.769 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:33.769 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:33.769 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:33.769 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.753+0000 7f86f9ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:25:33.769 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.753+0000 7f86f9ffb640 1 -- 10.20.193.110:0/1186375994 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2552117244 0 0) 0x7f870c08c4c0 con 0x7f870c1401c0 2026-02-13T20:25:33.769 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.753+0000 7f86f9ffb640 1 -- 10.20.193.110:0/1186375994 >> v1:10.20.193.188:6789/0 conn(0x7f870c091950 legacy=0x7f870c13e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:33.769 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.753+0000 7f86f9ffb640 1 -- 10.20.193.110:0/1186375994 >> v1:10.20.193.110:6789/0 conn(0x7f870c13eab0 legacy=0x7f870c1930d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:33.770 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.753+0000 7f86f9ffb640 10 monclient: _finish_hunting 0 2026-02-13T20:25:33.770 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.753+0000 7f86f9ffb640 1 monclient: found mon.c 2026-02-13T20:25:33.770 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.753+0000 7f86f9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:25:33.770 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.753+0000 7f86f9ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:25:33.770 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.753+0000 7f86f9ffb640 1 -- 10.20.193.110:0/1186375994 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f870c05d320 con 0x7f870c1401c0 2026-02-13T20:25:33.770 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.753+0000 7f86f9ffb640 10 monclient: _finish_auth 0 2026-02-13T20:25:33.770 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.753+0000 7f86f9ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:25:33.770 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.753+0000 7f86f9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:25:33.770 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.753+0000 7f8713394640 5 monclient: authenticate success, global_id 94592 2026-02-13T20:25:33.770 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.753+0000 7f8713394640 10 monclient: _renew_subs 2026-02-13T20:25:33.770 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.753+0000 7f8713394640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:25:33.770 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.753+0000 7f8713394640 1 -- 10.20.193.110:0/1186375994 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f870c12da40 con 0x7f870c1401c0 2026-02-13T20:25:33.771 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.753+0000 7f8713394640 10 monclient: _renew_subs 2026-02-13T20:25:33.771 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.753+0000 7f8713394640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:25:33.771 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.753+0000 7f8713394640 1 -- 10.20.193.110:0/1186375994 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f870c150650 con 0x7f870c1401c0 2026-02-13T20:25:33.771 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.753+0000 7f86f9ffb640 1 -- 10.20.193.110:0/1186375994 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8700003100 con 0x7f870c1401c0 2026-02-13T20:25:33.771 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.753+0000 7f86f9ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T20:25:33.771 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.753+0000 7f86f9ffb640 1 -- 10.20.193.110:0/1186375994 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f8700004a50 con 0x7f870c1401c0 2026-02-13T20:25:33.771 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.753+0000 7f86f9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:33.771 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.753+0000 7f86f9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:25:33.771 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.753+0000 7f86fb7fe640 4 set_mon_vals no callback set 2026-02-13T20:25:33.771 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.753+0000 7f86f9ffb640 10 monclient: dump: 2026-02-13T20:25:33.771 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:33.771 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:33.771 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:33.772 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:33.772 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:33.772 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:33.772 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:33.772 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:33.772 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:33.772 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:33.772 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.753+0000 7f8713394640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:25:33.772 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.753+0000 7f8713394640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:25:33.772 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.753+0000 7f8713394640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:25:33.772 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.753+0000 7f8713394640 1 -- 10.20.193.110:0/1186375994 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f870c12fbd0 con 0x7f870c1401c0 2026-02-13T20:25:33.772 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.753+0000 7f86f9ffb640 1 -- 10.20.193.110:0/1186375994 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f8700004bb0 con 0x7f870c1401c0 2026-02-13T20:25:33.773 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.754+0000 7f86f9ffb640 1 -- 10.20.193.110:0/1186375994 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(678..678 src has 1..678) ==== 3899+0+0 (unknown 225009374 0 0) 0x7f870004e8b0 con 0x7f870c1401c0 2026-02-13T20:25:33.773 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.754+0000 7f8711109640 10 monclient: get_auth_request con 0x7f86dc03f6f0 auth_method 0 2026-02-13T20:25:33.773 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.756+0000 7f86f9ffb640 1 -- 10.20.193.110:0/1186375994 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f8700004e90 con 0x7f870c1401c0 2026-02-13T20:25:33.773 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.756+0000 7f86f9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:25:33.773 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.756+0000 7f86f9ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:25:33.916 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.915+0000 7f8713394640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T20:25:33.916 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.915+0000 7f8713394640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T20:25:33.916 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.915+0000 7f8713394640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:25:33.916 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.915+0000 7f8713394640 1 -- 10.20.193.110:0/1186375994 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f870c055bb0 con 0x7f870c1401c0 2026-02-13T20:25:33.916 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.915+0000 7f86f9ffb640 1 -- 10.20.193.110:0/1186375994 <== mon.2 v1:10.20.193.110:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 516812499) 0x7f8700016760 con 0x7f870c1401c0 2026-02-13T20:25:33.917 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.915+0000 7f86f9ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T20:25:33.917 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.915+0000 7f86f9ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:25:33.917 INFO:teuthology.orchestra.run.trial110.stdout:{"election_epoch":52,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","modified":"2026-02-13T20:11:07.161192Z","created":"2026-02-13T20:11:07.161192Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6789","nonce":0}]},"addr":"10.20.193.110:6789/0","public_addr":"10.20.193.110:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161241+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6789","nonce":0}]},"addr":"10.20.193.188:6789/0","public_addr":"10.20.193.188:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161242+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6790","nonce":0}]},"addr":"10.20.193.110:6790/0","public_addr":"10.20.193.110:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161243+0000","crush_location":[]}]}} 2026-02-13T20:25:33.917 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.916+0000 7f8713394640 1 -- 10.20.193.110:0/1186375994 >> v1:10.20.193.188:6812/1623052694 conn(0x7f86dc03f6f0 legacy=0x7f86dc05fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:33.917 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.916+0000 7f8713394640 10 monclient: shutdown 2026-02-13T20:25:33.917 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.916+0000 7f8713394640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:25:33.917 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.916+0000 7f8713394640 1 -- 10.20.193.110:0/1186375994 >> v1:10.20.193.110:6790/0 conn(0x7f870c1401c0 legacy=0x7f870c1919b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:33.917 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.916+0000 7f8713394640 1 -- 10.20.193.110:0/1186375994 shutdown_connections 2026-02-13T20:25:33.918 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.916+0000 7f8713394640 1 -- 10.20.193.110:0/1186375994 >> 10.20.193.110:0/1186375994 conn(0x7f870c054e90 msgr2=0x7f870c08de50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:25:33.918 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.916+0000 7f8713394640 1 -- 10.20.193.110:0/1186375994 shutdown_connections 2026-02-13T20:25:33.918 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.916+0000 7f8713394640 1 -- 10.20.193.110:0/1186375994 wait complete. 2026-02-13T20:25:33.925 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-13T20:25:33.925 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-13T20:25:33.925 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T20:25:34.001 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.989+0000 7ff0d2047640 10 monclient: get_monmap_and_config 2026-02-13T20:25:34.001 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.989+0000 7ff0d2047640 10 monclient: build_initial_monmap 2026-02-13T20:25:34.001 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.989+0000 7ff0d2047640 10 monclient: monmap: 2026-02-13T20:25:34.001 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:25:34.001 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:34.002 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:25:33.990640+0000 2026-02-13T20:25:34.002 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:25:33.990640+0000 2026-02-13T20:25:34.002 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:25:34.002 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:34.002 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:25:34.002 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:25:34.002 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:25:34.002 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:34.002 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.989+0000 7ff0d2047640 1 Processor -- start 2026-02-13T20:25:34.002 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.989+0000 7ff0d2047640 1 -- start start 2026-02-13T20:25:34.003 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.989+0000 7ff0d2047640 10 monclient: init 2026-02-13T20:25:34.003 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.989+0000 7ff0d2047640 10 monclient: _reopen_session rank -1 2026-02-13T20:25:34.003 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.989+0000 7ff0d2047640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:25:34.003 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.989+0000 7ff0d2047640 10 monclient(hunting): picked mon.noname-a con 0x7ff0cc1401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:25:34.003 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.989+0000 7ff0d2047640 10 monclient(hunting): picked mon.noname-b con 0x7ff0cc092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:25:34.003 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.989+0000 7ff0d2047640 10 monclient(hunting): picked mon.noname-c con 0x7ff0cc091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:25:34.003 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.989+0000 7ff0d2047640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0cc08b730 con 0x7ff0cc1401c0 2026-02-13T20:25:34.003 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.989+0000 7ff0d2047640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0cc05c5b0 con 0x7ff0cc091950 2026-02-13T20:25:34.003 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.989+0000 7ff0d2047640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0cc08bcf0 con 0x7ff0cc092020 2026-02-13T20:25:34.003 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.989+0000 7ff0d2047640 10 monclient(hunting): _renew_subs 2026-02-13T20:25:34.004 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.990+0000 7ff0d2047640 10 monclient(hunting): authenticate will time out at 1495.681004s 2026-02-13T20:25:34.004 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.990+0000 7ff0cb7fe640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7ff0cc1401c0 0x7ff0cc091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:47964/0 (socket says 10.20.193.110:47964) 2026-02-13T20:25:34.004 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.990+0000 7ff0cb7fe640 1 -- 10.20.193.110:0/2057649190 learned_addr learned my addr 10.20.193.110:0/2057649190 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:25:34.004 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.990+0000 7ff0ca7fc640 1 -- 10.20.193.110:0/2057649190 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3169847110 0 0) 0x7ff0cc08b730 con 0x7ff0cc1401c0 2026-02-13T20:25:34.004 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.990+0000 7ff0ca7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:25:34.004 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.990+0000 7ff0ca7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:34.004 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.990+0000 7ff0ca7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:34.004 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.990+0000 7ff0ca7fc640 10 monclient(hunting): my global_id is 124290 2026-02-13T20:25:34.004 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.990+0000 7ff0ca7fc640 1 -- 10.20.193.110:0/2057649190 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0b00035e0 con 0x7ff0cc1401c0 2026-02-13T20:25:34.004 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.990+0000 7ff0ca7fc640 1 -- 10.20.193.110:0/2057649190 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4150793760 0 0) 0x7ff0cc08bcf0 con 0x7ff0cc092020 2026-02-13T20:25:34.004 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.990+0000 7ff0ca7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:25:34.005 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.990+0000 7ff0ca7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:34.005 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.990+0000 7ff0ca7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:34.005 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.990+0000 7ff0ca7fc640 10 monclient(hunting): my global_id is 94595 2026-02-13T20:25:34.005 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.990+0000 7ff0ca7fc640 1 -- 10.20.193.110:0/2057649190 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0cc08b730 con 0x7ff0cc092020 2026-02-13T20:25:34.005 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.990+0000 7ff0ca7fc640 1 -- 10.20.193.110:0/2057649190 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1171940126 0 0) 0x7ff0b00035e0 con 0x7ff0cc1401c0 2026-02-13T20:25:34.005 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.990+0000 7ff0ca7fc640 1 -- 10.20.193.110:0/2057649190 >> v1:10.20.193.110:6790/0 conn(0x7ff0cc092020 legacy=0x7ff0cc1812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:34.005 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.990+0000 7ff0ca7fc640 1 -- 10.20.193.110:0/2057649190 >> v1:10.20.193.188:6789/0 conn(0x7ff0cc091950 legacy=0x7ff0cc1a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:34.005 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.990+0000 7ff0ca7fc640 10 monclient: _finish_hunting 0 2026-02-13T20:25:34.005 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.990+0000 7ff0ca7fc640 1 monclient: found mon.noname-a 2026-02-13T20:25:34.006 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.990+0000 7ff0ca7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:25:34.006 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.990+0000 7ff0ca7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:25:34.006 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.990+0000 7ff0ca7fc640 1 -- 10.20.193.110:0/2057649190 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0cc140590 con 0x7ff0cc1401c0 2026-02-13T20:25:34.006 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.990+0000 7ff0ca7fc640 10 monclient: _finish_auth 0 2026-02-13T20:25:34.006 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.990+0000 7ff0ca7fc640 10 monclient: _check_auth_tickets 2026-02-13T20:25:34.006 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.990+0000 7ff0ca7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:25:34.006 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.990+0000 7ff0ca7fc640 1 -- 10.20.193.110:0/2057649190 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff0b8002dd0 con 0x7ff0cc1401c0 2026-02-13T20:25:34.006 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.990+0000 7ff0d2047640 5 monclient: authenticate success, global_id 124290 2026-02-13T20:25:34.006 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.990+0000 7ff0d2047640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:25:34.006 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.990+0000 7ff0ca7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:34.006 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.990+0000 7ff0ca7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:25:34.007 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.990+0000 7ff0ca7fc640 10 monclient: dump: 2026-02-13T20:25:34.007 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:34.007 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:34.007 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.007 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.007 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:34.007 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:34.007 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:34.007 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:34.007 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:34.008 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:34.008 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.990+0000 7ff0d2047640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:25:34.008 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.990+0000 7ff0ca7fc640 1 -- 10.20.193.110:0/2057649190 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff0b8002f60 con 0x7ff0cc1401c0 2026-02-13T20:25:34.008 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.990+0000 7ff0ca7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:25:34.008 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.990+0000 7ff0d2047640 10 monclient: get_monmap_and_config success 2026-02-13T20:25:34.008 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.990+0000 7ff0d2047640 4 set_mon_vals no callback set 2026-02-13T20:25:34.008 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.990+0000 7ff0ca7fc640 1 -- 10.20.193.110:0/2057649190 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff0b8003330 con 0x7ff0cc1401c0 2026-02-13T20:25:34.008 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.990+0000 7ff0ca7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:34.008 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.990+0000 7ff0ca7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:25:34.008 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.990+0000 7ff0ca7fc640 10 monclient: dump: 2026-02-13T20:25:34.008 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:34.009 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:34.009 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.009 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.009 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:34.009 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:34.009 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:34.009 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:34.009 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:34.009 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:34.009 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.990+0000 7ff0d2047640 10 monclient: shutdown 2026-02-13T20:25:34.010 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.990+0000 7ff0d2047640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:25:34.010 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.990+0000 7ff0d2047640 1 -- 10.20.193.110:0/2057649190 >> v1:10.20.193.110:6789/0 conn(0x7ff0cc1401c0 legacy=0x7ff0cc091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:34.010 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.990+0000 7ff0d2047640 1 -- 10.20.193.110:0/2057649190 shutdown_connections 2026-02-13T20:25:34.010 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.990+0000 7ff0d2047640 1 -- 10.20.193.110:0/2057649190 >> 10.20.193.110:0/2057649190 conn(0x7ff0cc054e90 msgr2=0x7ff0cc058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:25:34.010 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.990+0000 7ff0d2047640 1 -- 10.20.193.110:0/2057649190 shutdown_connections 2026-02-13T20:25:34.010 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.990+0000 7ff0d2047640 1 -- 10.20.193.110:0/2057649190 wait complete. 2026-02-13T20:25:34.010 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.991+0000 7ff0d2047640 10 monclient: build_initial_monmap 2026-02-13T20:25:34.010 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.991+0000 7ff0d2047640 10 monclient: monmap: 2026-02-13T20:25:34.010 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:25:34.010 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:25:34.011 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:25:34.011 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:25:34.011 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:25:34.011 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:25:34.011 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:25:34.011 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:25:34.011 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:25:34.011 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:34.011 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.991+0000 7ff0d2047640 1 Processor -- start 2026-02-13T20:25:34.011 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.991+0000 7ff0d2047640 1 -- start start 2026-02-13T20:25:34.011 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.991+0000 7ff0d2047640 10 monclient: init 2026-02-13T20:25:34.012 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.991+0000 7ff0d2047640 10 monclient: _reopen_session rank -1 2026-02-13T20:25:34.012 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.991+0000 7ff0d2047640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:25:34.012 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.991+0000 7ff0d2047640 10 monclient(hunting): picked mon.noname-a con 0x7ff0cc091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:25:34.012 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.991+0000 7ff0d2047640 10 monclient(hunting): picked mon.noname-c con 0x7ff0cc1401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:25:34.012 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.991+0000 7ff0d2047640 10 monclient(hunting): picked mon.noname-b con 0x7ff0cc13ec00 addr v1:10.20.193.188:6789/0 2026-02-13T20:25:34.012 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.991+0000 7ff0d2047640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0cc08c310 con 0x7ff0cc091950 2026-02-13T20:25:34.012 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.991+0000 7ff0d2047640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0cc12db90 con 0x7ff0cc13ec00 2026-02-13T20:25:34.012 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.991+0000 7ff0d2047640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0cc05d320 con 0x7ff0cc1401c0 2026-02-13T20:25:34.012 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.991+0000 7ff0d2047640 10 monclient(hunting): _renew_subs 2026-02-13T20:25:34.012 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.991+0000 7ff0d2047640 10 monclient(hunting): authenticate will time out at 1495.682815s 2026-02-13T20:25:34.012 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.991+0000 7ff0cb7fe640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7ff0cc091950 0x7ff0cc13e4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:47974/0 (socket says 10.20.193.110:47974) 2026-02-13T20:25:34.013 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.991+0000 7ff0cb7fe640 1 -- 10.20.193.110:0/3999990231 learned_addr learned my addr 10.20.193.110:0/3999990231 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:25:34.013 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.991+0000 7ff0a7fff640 1 -- 10.20.193.110:0/3999990231 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 367955592 0 0) 0x7ff0cc08c310 con 0x7ff0cc091950 2026-02-13T20:25:34.013 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 10 monclient(hunting): _negotiate 2026-02-13T20:25:34.013 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:34.013 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:34.013 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 10 monclient(hunting): my global_id is 124293 2026-02-13T20:25:34.013 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 1 -- 10.20.193.110:0/3999990231 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff09c0035e0 con 0x7ff0cc091950 2026-02-13T20:25:34.013 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 1 -- 10.20.193.110:0/3999990231 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2937322587 0 0) 0x7ff0cc05d320 con 0x7ff0cc1401c0 2026-02-13T20:25:34.013 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 10 monclient(hunting): _negotiate 2026-02-13T20:25:34.013 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:34.014 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:34.014 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 10 monclient(hunting): my global_id is 94598 2026-02-13T20:25:34.014 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 1 -- 10.20.193.110:0/3999990231 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0cc08c310 con 0x7ff0cc1401c0 2026-02-13T20:25:34.014 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 1 -- 10.20.193.110:0/3999990231 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4289848734 0 0) 0x7ff09c0035e0 con 0x7ff0cc091950 2026-02-13T20:25:34.014 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 1 -- 10.20.193.110:0/3999990231 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff0cc05d320 con 0x7ff0cc091950 2026-02-13T20:25:34.014 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 1 -- 10.20.193.110:0/3999990231 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff0b8003280 con 0x7ff0cc091950 2026-02-13T20:25:34.014 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:25:34.014 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:25:34.014 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 10 monclient(hunting): dump: 2026-02-13T20:25:34.014 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:34.014 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:34.014 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.015 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.015 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:34.015 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:34.015 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:34.015 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:34.015 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:34.015 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:34.015 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:25:34.015 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 1 -- 10.20.193.110:0/3999990231 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 712287254 0 0) 0x7ff0cc12db90 con 0x7ff0cc13ec00 2026-02-13T20:25:34.015 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 10 monclient(hunting): _negotiate 2026-02-13T20:25:34.015 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:34.016 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:34.016 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 10 monclient(hunting): my global_id is 144103 2026-02-13T20:25:34.016 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 1 -- 10.20.193.110:0/3999990231 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff09c0035e0 con 0x7ff0cc13ec00 2026-02-13T20:25:34.016 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 1 -- 10.20.193.110:0/3999990231 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4230211482 0 0) 0x7ff0cc08c310 con 0x7ff0cc1401c0 2026-02-13T20:25:34.016 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 1 -- 10.20.193.110:0/3999990231 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff0cc12db90 con 0x7ff0cc1401c0 2026-02-13T20:25:34.016 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 1 -- 10.20.193.110:0/3999990231 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff0bc003040 con 0x7ff0cc1401c0 2026-02-13T20:25:34.016 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:25:34.016 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:25:34.016 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 10 monclient(hunting): dump: 2026-02-13T20:25:34.016 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:34.016 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:34.016 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.017 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.017 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:34.017 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:34.017 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:34.017 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:34.017 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:34.017 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:34.017 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 1 -- 10.20.193.110:0/3999990231 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3761860116 0 0) 0x7ff0cc05d320 con 0x7ff0cc091950 2026-02-13T20:25:34.017 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 1 -- 10.20.193.110:0/3999990231 >> v1:10.20.193.110:6790/0 conn(0x7ff0cc1401c0 legacy=0x7ff0cc191660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:34.017 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 1 -- 10.20.193.110:0/3999990231 >> v1:10.20.193.188:6789/0 conn(0x7ff0cc13ec00 legacy=0x7ff0cc192d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:34.017 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 10 monclient: _finish_hunting 0 2026-02-13T20:25:34.017 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 1 monclient: found mon.a 2026-02-13T20:25:34.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:25:34.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:25:34.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 1 -- 10.20.193.110:0/3999990231 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0cc12fef0 con 0x7ff0cc091950 2026-02-13T20:25:34.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 10 monclient: _finish_auth 0 2026-02-13T20:25:34.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 10 monclient: _check_auth_tickets 2026-02-13T20:25:34.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:25:34.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0d2047640 5 monclient: authenticate success, global_id 124293 2026-02-13T20:25:34.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0d2047640 10 monclient: _renew_subs 2026-02-13T20:25:34.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0d2047640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:25:34.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0d2047640 1 -- 10.20.193.110:0/3999990231 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff0cc12f650 con 0x7ff0cc091950 2026-02-13T20:25:34.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0d2047640 10 monclient: _renew_subs 2026-02-13T20:25:34.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0d2047640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:25:34.019 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0d2047640 1 -- 10.20.193.110:0/3999990231 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff0cc150530 con 0x7ff0cc091950 2026-02-13T20:25:34.019 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 1 -- 10.20.193.110:0/3999990231 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff0b8004b50 con 0x7ff0cc091950 2026-02-13T20:25:34.019 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:25:34.019 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 1 -- 10.20.193.110:0/3999990231 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff0b8004ef0 con 0x7ff0cc091950 2026-02-13T20:25:34.019 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:34.019 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:25:34.019 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 10 monclient: dump: 2026-02-13T20:25:34.019 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:34.019 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:34.019 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.019 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.019 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:34.019 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:34.020 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:34.020 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:34.020 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:34.020 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:34.020 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0c9ffb640 4 set_mon_vals no callback set 2026-02-13T20:25:34.020 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0d2047640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:25:34.020 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0d2047640 1 -- 10.20.193.110:0/3999990231 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff0cc0008d0 con 0x7ff0cc092020 2026-02-13T20:25:34.020 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 1 -- 10.20.193.110:0/3999990231 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2421878578 0 0) 0x7ff0cc0008d0 con 0x7ff0cc092020 2026-02-13T20:25:34.020 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 10 monclient(hunting): _negotiate 2026-02-13T20:25:34.020 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:34.020 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:34.020 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 10 monclient(hunting): my global_id is 124296 2026-02-13T20:25:34.021 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 1 -- 10.20.193.110:0/3999990231 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0cc05d320 con 0x7ff0cc092020 2026-02-13T20:25:34.021 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.992+0000 7ff0a7fff640 1 -- 10.20.193.110:0/3999990231 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7ff0b8005050 con 0x7ff0cc091950 2026-02-13T20:25:34.021 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.993+0000 7ff0a7fff640 1 -- 10.20.193.110:0/3999990231 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(678..678 src has 1..678) ==== 3899+0+0 (unknown 225009374 0 0) 0x7ff0b804ea50 con 0x7ff0cc091950 2026-02-13T20:25:34.021 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.993+0000 7ff0a7fff640 1 -- 10.20.193.110:0/3999990231 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1122549403 0 0) 0x7ff0cc05d320 con 0x7ff0cc092020 2026-02-13T20:25:34.021 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.993+0000 7ff0a7fff640 1 -- 10.20.193.110:0/3999990231 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff0cc0008d0 con 0x7ff0cc092020 2026-02-13T20:25:34.021 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.993+0000 7ff0a7fff640 1 -- 10.20.193.110:0/3999990231 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff0bc0035d0 con 0x7ff0cc092020 2026-02-13T20:25:34.021 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.993+0000 7ff0a7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:34.021 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.993+0000 7ff0a7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:25:34.021 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.993+0000 7ff0a7fff640 10 monclient: dump: 2026-02-13T20:25:34.021 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:34.021 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:34.021 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.022 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.022 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:34.022 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:34.022 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:34.022 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:34.022 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:34.022 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:34.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.993+0000 7ff0cbfff640 10 monclient: get_auth_request con 0x7ff09c03fc90 auth_method 0 2026-02-13T20:25:34.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.993+0000 7ff0a7fff640 1 -- 10.20.193.110:0/3999990231 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3928337154 0 0) 0x7ff0cc0008d0 con 0x7ff0cc092020 2026-02-13T20:25:34.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.993+0000 7ff0a7fff640 1 -- 10.20.193.110:0/3999990231 --> v1:10.20.193.110:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff0cc08b450 con 0x7ff0cc092020 2026-02-13T20:25:34.023 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.993+0000 7ff0a7fff640 1 -- 10.20.193.110:0/3999990231 <== mon.0 v1:10.20.193.110:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7ff0bc005850 con 0x7ff0cc092020 2026-02-13T20:25:34.023 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.993+0000 7ff0a7fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:25:34.023 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.993+0000 7ff0a7fff640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:25:34.023 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.993+0000 7ff0a7fff640 1 -- 10.20.193.110:0/3999990231 >> v1:10.20.193.110:6789/0 conn(0x7ff0cc092020 legacy=0x7ff0cc127b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:34.023 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.993+0000 7ff0a7fff640 1 -- 10.20.193.110:0/3999990231 >> v1:10.20.193.110:6789/0 conn(0x7ff0cc092020 legacy=0x7ff0cc127b20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:25:34.023 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.996+0000 7ff0d2047640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:25:34.023 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.996+0000 7ff0d2047640 1 -- 10.20.193.110:0/3999990231 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff0cc058410 con 0x7ff0cc128230 2026-02-13T20:25:34.023 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.997+0000 7ff0a7fff640 1 -- 10.20.193.110:0/3999990231 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 576448674 0 0) 0x7ff0cc058410 con 0x7ff0cc128230 2026-02-13T20:25:34.023 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.997+0000 7ff0a7fff640 10 monclient(hunting): _negotiate 2026-02-13T20:25:34.023 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.997+0000 7ff0a7fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:34.023 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.997+0000 7ff0a7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:34.023 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.997+0000 7ff0a7fff640 10 monclient(hunting): my global_id is 124299 2026-02-13T20:25:34.023 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.997+0000 7ff0a7fff640 1 -- 10.20.193.110:0/3999990231 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0cc0008d0 con 0x7ff0cc128230 2026-02-13T20:25:34.023 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.997+0000 7ff0a7fff640 1 -- 10.20.193.110:0/3999990231 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3993790508 0 0) 0x7ff0cc0008d0 con 0x7ff0cc128230 2026-02-13T20:25:34.023 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.997+0000 7ff0a7fff640 1 -- 10.20.193.110:0/3999990231 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff0cc058410 con 0x7ff0cc128230 2026-02-13T20:25:34.024 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.997+0000 7ff0a7fff640 1 -- 10.20.193.110:0/3999990231 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff0bc003ef0 con 0x7ff0cc128230 2026-02-13T20:25:34.024 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.997+0000 7ff0a7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:34.024 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.997+0000 7ff0a7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:25:34.024 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.997+0000 7ff0a7fff640 10 monclient: dump: 2026-02-13T20:25:34.024 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:34.024 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:34.024 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.024 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.024 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:34.024 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:34.024 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:34.024 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:34.024 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:34.024 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:34.024 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.997+0000 7ff0a7fff640 1 -- 10.20.193.110:0/3999990231 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3409329448 0 0) 0x7ff0cc058410 con 0x7ff0cc128230 2026-02-13T20:25:34.025 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.997+0000 7ff0a7fff640 1 -- 10.20.193.110:0/3999990231 --> v1:10.20.193.110:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff0cc0561b0 con 0x7ff0cc128230 2026-02-13T20:25:34.025 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.997+0000 7ff0a7fff640 1 -- 10.20.193.110:0/3999990231 <== mon.0 v1:10.20.193.110:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4514 (unknown 0 0 1581871750) 0x7ff0bc005390 con 0x7ff0cc128230 2026-02-13T20:25:34.025 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.997+0000 7ff0a7fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:25:34.025 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.997+0000 7ff0a7fff640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:25:34.025 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.997+0000 7ff0a7fff640 1 -- 10.20.193.110:0/3999990231 >> v1:10.20.193.110:6789/0 conn(0x7ff0cc128230 legacy=0x7ff0cc1954b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:34.025 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.997+0000 7ff0a7fff640 1 -- 10.20.193.110:0/3999990231 >> v1:10.20.193.110:6789/0 conn(0x7ff0cc128230 legacy=0x7ff0cc1954b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:25:34.025 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:25:34.025 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:25:34.026 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:25:34.026 INFO:teuthology.orchestra.run.trial110.stdout: "state": "peon", 2026-02-13T20:25:34.026 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 52, 2026-02-13T20:25:34.026 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 249416, 2026-02-13T20:25:34.026 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:25:34.026 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:25:34.026 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:25:34.026 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:25:34.026 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:25:34.026 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 0, 2026-02-13T20:25:34.026 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:25:34.026 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:25:34.026 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:25:34.026 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:25:34.027 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:25:34.027 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:25:34.027 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:25:34.027 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:25:34.027 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:25:34.027 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:25:34.027 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:25:34.027 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:25:34.027 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:25:34.027 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:25:34.027 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:25:34.027 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:25:34.027 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:25:34.027 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:25:34.027 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:25:34.028 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:25:34.028 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:25:34.028 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:25:34.028 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:25:34.028 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:25:34.028 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:25:34.028 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:25:34.028 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:25:34.028 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:25:34.028 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:25:34.028 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:25:34.028 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:25:34.028 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:25:34.028 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:25:34.029 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:34.029 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:25:34.029 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:25:34.029 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:25:34.029 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:25:34.029 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:25:34.029 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:25:34.029 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:25:34.029 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:25:34.029 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:25:34.029 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:25:34.029 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:25:34.029 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:25:34.029 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:25:34.029 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:25:34.030 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:25:34.030 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:25:34.030 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:25:34.030 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:25:34.030 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:25:34.030 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:25:34.030 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:25:34.030 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:25:34.030 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:25:34.030 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:25:34.030 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:25:34.030 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:25:34.030 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:25:34.030 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:25:34.030 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:25:34.030 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:25:34.031 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:25:34.031 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:25:34.031 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:34.031 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:25:34.031 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:34.031 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:25:34.031 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:25:34.031 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:25:34.031 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:25:34.031 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:34.031 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:25:34.031 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:25:34.031 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:25:34.031 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:34.031 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:25:34.032 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:34.032 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:25:34.032 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:25:34.032 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:25:34.032 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:25:34.032 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:25:34.032 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:25:34.032 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:34.032 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:34.032 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:25:34.032 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:25:34.032 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:25:34.032 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:25:34.032 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:34.032 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:25:34.032 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:25:34.033 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:25:34.033 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:34.033 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:25:34.033 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:34.033 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:25:34.033 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:25:34.033 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:25:34.033 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:25:34.033 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:25:34.033 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:25:34.033 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:34.033 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:34.033 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:25:34.033 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:25:34.033 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:25:34.033 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:25:34.033 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:34.034 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:25:34.034 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:25:34.034 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:25:34.034 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:34.034 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:25:34.034 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:34.034 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:25:34.034 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:25:34.034 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:25:34.034 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:25:34.034 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:25:34.034 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:25:34.034 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:34.034 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:25:34.034 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:34.034 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:25:34.034 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:25:34.035 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:34.035 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:25:34.035 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:25:34.035 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:25:34.035 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:34.035 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:25:34.035 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:25:34.035 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:34.035 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:25:34.035 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:25:34.035 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:25:34.035 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:34.035 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:25:34.035 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:25:34.035 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:34.035 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:25:34.035 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:25:34.035 INFO:teuthology.orchestra.run.trial110.stdout: "num": 5 2026-02-13T20:25:34.035 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:34.036 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:25:34.036 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:34.036 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:25:34.036 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:25:34.037 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.997+0000 7ff0d2047640 1 -- 10.20.193.110:0/3999990231 >> v1:10.20.193.188:6812/1623052694 conn(0x7ff09c03fc90 legacy=0x7ff09c060140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:34.037 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.997+0000 7ff0d2047640 10 monclient: shutdown 2026-02-13T20:25:34.037 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.997+0000 7ff0d2047640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:25:34.037 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.997+0000 7ff0d2047640 1 -- 10.20.193.110:0/3999990231 >> v1:10.20.193.110:6789/0 conn(0x7ff0cc091950 legacy=0x7ff0cc13e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:34.037 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.997+0000 7ff0cbfff640 1 -- 10.20.193.110:0/3999990231 reap_dead start 2026-02-13T20:25:34.037 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.997+0000 7ff0d2047640 1 -- 10.20.193.110:0/3999990231 shutdown_connections 2026-02-13T20:25:34.037 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.997+0000 7ff0d2047640 1 -- 10.20.193.110:0/3999990231 >> 10.20.193.110:0/3999990231 conn(0x7ff0cc054e90 msgr2=0x7ff0cc08dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:25:34.037 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.997+0000 7ff0d2047640 1 -- 10.20.193.110:0/3999990231 shutdown_connections 2026-02-13T20:25:34.037 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:33.997+0000 7ff0d2047640 1 -- 10.20.193.110:0/3999990231 wait complete. 2026-02-13T20:25:34.038 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:25:34.038 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-13T20:25:34.038 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T20:25:34.118 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.102+0000 7ff044b4c640 10 monclient: get_monmap_and_config 2026-02-13T20:25:34.118 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.102+0000 7ff044b4c640 10 monclient: build_initial_monmap 2026-02-13T20:25:34.118 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.102+0000 7ff044b4c640 10 monclient: monmap: 2026-02-13T20:25:34.119 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:25:34.119 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:34.119 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:25:34.104085+0000 2026-02-13T20:25:34.119 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:25:34.104085+0000 2026-02-13T20:25:34.119 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:25:34.119 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:34.119 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:25:34.119 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:25:34.119 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:25:34.120 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:34.120 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff044b4c640 1 Processor -- start 2026-02-13T20:25:34.120 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff044b4c640 1 -- start start 2026-02-13T20:25:34.120 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff044b4c640 10 monclient: init 2026-02-13T20:25:34.120 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff044b4c640 10 monclient: _reopen_session rank -1 2026-02-13T20:25:34.120 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff044b4c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:25:34.120 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff044b4c640 10 monclient(hunting): picked mon.noname-c con 0x7ff04005a420 addr v1:10.20.193.188:6789/0 2026-02-13T20:25:34.121 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff044b4c640 10 monclient(hunting): picked mon.noname-b con 0x7ff04013fb80 addr v1:10.20.193.110:6790/0 2026-02-13T20:25:34.121 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff044b4c640 10 monclient(hunting): picked mon.noname-a con 0x7ff040089b00 addr v1:10.20.193.110:6789/0 2026-02-13T20:25:34.121 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff044b4c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff04005a7f0 con 0x7ff040089b00 2026-02-13T20:25:34.121 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff044b4c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff04013d000 con 0x7ff04005a420 2026-02-13T20:25:34.121 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff044b4c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff04008a8d0 con 0x7ff04013fb80 2026-02-13T20:25:34.121 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff044b4c640 10 monclient(hunting): _renew_subs 2026-02-13T20:25:34.121 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff044b4c640 10 monclient(hunting): authenticate will time out at 1495.794464s 2026-02-13T20:25:34.121 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff03ed76640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7ff040089b00 0x7ff0401a18f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:47988/0 (socket says 10.20.193.110:47988) 2026-02-13T20:25:34.121 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff03ed76640 1 -- 10.20.193.110:0/511170366 learned_addr learned my addr 10.20.193.110:0/511170366 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:25:34.122 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff03dd74640 1 --1- 10.20.193.110:0/511170366 >> v1:10.20.193.110:6790/0 conn(0x7ff04013fb80 0x7ff0401801c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:48048/0 (socket says 10.20.193.110:48048) 2026-02-13T20:25:34.122 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff03d573640 1 -- 10.20.193.110:0/511170366 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2676506225 0 0) 0x7ff04005a7f0 con 0x7ff040089b00 2026-02-13T20:25:34.122 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff03d573640 10 monclient(hunting): _negotiate 2026-02-13T20:25:34.122 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff03d573640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:34.122 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff03d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:34.122 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff03d573640 10 monclient(hunting): my global_id is 124302 2026-02-13T20:25:34.122 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff03d573640 1 -- 10.20.193.110:0/511170366 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff02c0035e0 con 0x7ff040089b00 2026-02-13T20:25:34.122 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff03d573640 1 -- 10.20.193.110:0/511170366 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3789180856 0 0) 0x7ff04008a8d0 con 0x7ff04013fb80 2026-02-13T20:25:34.123 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff03d573640 10 monclient(hunting): _negotiate 2026-02-13T20:25:34.123 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff03d573640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:34.123 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff03d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:34.123 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff03d573640 10 monclient(hunting): my global_id is 94601 2026-02-13T20:25:34.123 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff03d573640 1 -- 10.20.193.110:0/511170366 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff04005a7f0 con 0x7ff04013fb80 2026-02-13T20:25:34.123 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff03d573640 1 -- 10.20.193.110:0/511170366 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1231071613 0 0) 0x7ff04013d000 con 0x7ff04005a420 2026-02-13T20:25:34.123 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff03d573640 10 monclient(hunting): _negotiate 2026-02-13T20:25:34.123 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff03d573640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:34.123 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff03d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:34.124 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff03d573640 10 monclient(hunting): my global_id is 144106 2026-02-13T20:25:34.124 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff03d573640 1 -- 10.20.193.110:0/511170366 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff04008a8d0 con 0x7ff04005a420 2026-02-13T20:25:34.124 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff03d573640 1 -- 10.20.193.110:0/511170366 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3242992301 0 0) 0x7ff02c0035e0 con 0x7ff040089b00 2026-02-13T20:25:34.124 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff03d573640 1 -- 10.20.193.110:0/511170366 >> v1:10.20.193.110:6790/0 conn(0x7ff04013fb80 legacy=0x7ff0401801c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:34.124 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff03d573640 1 -- 10.20.193.110:0/511170366 >> v1:10.20.193.188:6789/0 conn(0x7ff04005a420 legacy=0x7ff04013f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:34.124 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff03d573640 10 monclient: _finish_hunting 0 2026-02-13T20:25:34.124 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff03d573640 1 monclient: found mon.noname-a 2026-02-13T20:25:34.124 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff03d573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:25:34.125 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff03d573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:25:34.125 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff03d573640 1 -- 10.20.193.110:0/511170366 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff04008abb0 con 0x7ff040089b00 2026-02-13T20:25:34.125 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff03d573640 10 monclient: _finish_auth 0 2026-02-13T20:25:34.125 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff03d573640 10 monclient: _check_auth_tickets 2026-02-13T20:25:34.125 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff03d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:25:34.125 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff03d573640 1 -- 10.20.193.110:0/511170366 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff030003eb0 con 0x7ff040089b00 2026-02-13T20:25:34.125 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff03d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:34.125 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff03d573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:25:34.125 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff03d573640 10 monclient: dump: 2026-02-13T20:25:34.126 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:34.126 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:34.126 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.126 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.126 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:34.126 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:34.126 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:34.126 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:34.126 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:34.127 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:34.127 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff044b4c640 5 monclient: authenticate success, global_id 124302 2026-02-13T20:25:34.127 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff044b4c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:25:34.127 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff03d573640 1 -- 10.20.193.110:0/511170366 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff030004130 con 0x7ff040089b00 2026-02-13T20:25:34.127 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff03d573640 10 monclient: handle_config config(0 keys) 2026-02-13T20:25:34.127 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff03d573640 1 -- 10.20.193.110:0/511170366 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff030004540 con 0x7ff040089b00 2026-02-13T20:25:34.127 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff03d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:34.127 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff03d573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:25:34.128 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff03d573640 10 monclient: dump: 2026-02-13T20:25:34.128 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:34.128 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:34.128 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.128 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.128 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:34.128 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:34.128 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:34.128 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:34.129 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:34.129 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:34.129 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff044b4c640 10 monclient: get_monmap_and_config success 2026-02-13T20:25:34.129 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.103+0000 7ff044b4c640 4 set_mon_vals no callback set 2026-02-13T20:25:34.129 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.104+0000 7ff044b4c640 10 monclient: shutdown 2026-02-13T20:25:34.129 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.104+0000 7ff044b4c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:25:34.129 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.104+0000 7ff044b4c640 1 -- 10.20.193.110:0/511170366 >> v1:10.20.193.110:6789/0 conn(0x7ff040089b00 legacy=0x7ff0401a18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:34.129 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.104+0000 7ff044b4c640 1 -- 10.20.193.110:0/511170366 shutdown_connections 2026-02-13T20:25:34.130 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.104+0000 7ff044b4c640 1 -- 10.20.193.110:0/511170366 >> 10.20.193.110:0/511170366 conn(0x7ff040054e90 msgr2=0x7ff040058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:25:34.130 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.104+0000 7ff044b4c640 1 -- 10.20.193.110:0/511170366 shutdown_connections 2026-02-13T20:25:34.130 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.104+0000 7ff044b4c640 1 -- 10.20.193.110:0/511170366 wait complete. 2026-02-13T20:25:34.130 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.104+0000 7ff044b4c640 10 monclient: build_initial_monmap 2026-02-13T20:25:34.130 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.104+0000 7ff044b4c640 10 monclient: monmap: 2026-02-13T20:25:34.130 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:25:34.130 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:25:34.130 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:25:34.131 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:25:34.131 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:25:34.131 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:25:34.131 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:25:34.131 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:25:34.131 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:25:34.131 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:34.131 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.104+0000 7ff044b4c640 1 Processor -- start 2026-02-13T20:25:34.131 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.104+0000 7ff044b4c640 1 -- start start 2026-02-13T20:25:34.132 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.104+0000 7ff044b4c640 10 monclient: init 2026-02-13T20:25:34.132 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff044b4c640 10 monclient: _reopen_session rank -1 2026-02-13T20:25:34.132 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff044b4c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:25:34.132 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff044b4c640 10 monclient(hunting): picked mon.noname-b con 0x7ff04005a420 addr v1:10.20.193.188:6789/0 2026-02-13T20:25:34.132 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff044b4c640 10 monclient(hunting): picked mon.noname-a con 0x7ff040089b00 addr v1:10.20.193.110:6789/0 2026-02-13T20:25:34.132 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff044b4c640 10 monclient(hunting): picked mon.noname-c con 0x7ff04013fb80 addr v1:10.20.193.110:6790/0 2026-02-13T20:25:34.132 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff044b4c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff04013d520 con 0x7ff040089b00 2026-02-13T20:25:34.132 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff044b4c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff04012dae0 con 0x7ff04005a420 2026-02-13T20:25:34.133 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff044b4c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff04012ef10 con 0x7ff04013fb80 2026-02-13T20:25:34.133 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff044b4c640 10 monclient(hunting): _renew_subs 2026-02-13T20:25:34.133 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff044b4c640 10 monclient(hunting): authenticate will time out at 1495.796197s 2026-02-13T20:25:34.133 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff03dd74640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7ff040089b00 0x7ff040191ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:48002/0 (socket says 10.20.193.110:48002) 2026-02-13T20:25:34.133 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff03dd74640 1 -- 10.20.193.110:0/3263119760 learned_addr learned my addr 10.20.193.110:0/3263119760 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:25:34.133 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 1 -- 10.20.193.110:0/3263119760 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4291512774 0 0) 0x7ff04005a7f0 con 0x7ff040089b00 2026-02-13T20:25:34.133 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:25:34.133 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:34.133 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:34.133 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 10 monclient(hunting): my global_id is 124305 2026-02-13T20:25:34.134 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 1 -- 10.20.193.110:0/3263119760 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff00c0035e0 con 0x7ff040089b00 2026-02-13T20:25:34.134 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 1 -- 10.20.193.110:0/3263119760 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1760323106 0 0) 0x7ff04012ef10 con 0x7ff04013fb80 2026-02-13T20:25:34.134 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:25:34.134 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:34.134 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:34.134 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 10 monclient(hunting): my global_id is 94604 2026-02-13T20:25:34.134 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 1 -- 10.20.193.110:0/3263119760 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff04005a7f0 con 0x7ff04013fb80 2026-02-13T20:25:34.134 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 1 -- 10.20.193.110:0/3263119760 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2170253509 0 0) 0x7ff04012dae0 con 0x7ff04005a420 2026-02-13T20:25:34.134 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:25:34.134 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:34.134 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:34.135 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 10 monclient(hunting): my global_id is 144109 2026-02-13T20:25:34.135 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 1 -- 10.20.193.110:0/3263119760 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff04012ef10 con 0x7ff04005a420 2026-02-13T20:25:34.135 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 1 -- 10.20.193.110:0/3263119760 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1521013921 0 0) 0x7ff00c0035e0 con 0x7ff040089b00 2026-02-13T20:25:34.135 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 1 -- 10.20.193.110:0/3263119760 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff04012dae0 con 0x7ff040089b00 2026-02-13T20:25:34.135 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 1 -- 10.20.193.110:0/3263119760 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff028003060 con 0x7ff040089b00 2026-02-13T20:25:34.135 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:25:34.135 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:25:34.135 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 10 monclient(hunting): dump: 2026-02-13T20:25:34.135 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:34.135 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:34.135 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.136 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.136 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:34.136 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:34.136 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:34.136 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:34.136 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:34.136 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:34.136 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:25:34.136 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 1 -- 10.20.193.110:0/3263119760 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 67790320 0 0) 0x7ff04005a7f0 con 0x7ff04013fb80 2026-02-13T20:25:34.136 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 1 -- 10.20.193.110:0/3263119760 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff00c0035e0 con 0x7ff04013fb80 2026-02-13T20:25:34.136 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 1 -- 10.20.193.110:0/3263119760 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff0300042a0 con 0x7ff04013fb80 2026-02-13T20:25:34.137 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:25:34.137 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:25:34.137 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 10 monclient(hunting): dump: 2026-02-13T20:25:34.137 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:34.137 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:34.137 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.137 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.137 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:34.137 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:34.137 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:34.137 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:34.137 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:34.137 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:34.137 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 1 -- 10.20.193.110:0/3263119760 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 16713765 0 0) 0x7ff04012ef10 con 0x7ff04005a420 2026-02-13T20:25:34.137 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 1 -- 10.20.193.110:0/3263119760 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff04005a7f0 con 0x7ff04005a420 2026-02-13T20:25:34.137 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 1 -- 10.20.193.110:0/3263119760 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff034002f90 con 0x7ff04005a420 2026-02-13T20:25:34.137 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:25:34.138 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-13T20:25:34.138 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 10 monclient(hunting): dump: 2026-02-13T20:25:34.138 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:34.138 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:34.138 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.138 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.138 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:34.138 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:34.138 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:34.138 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:34.138 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:34.138 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:34.138 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 1 -- 10.20.193.110:0/3263119760 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3093678083 0 0) 0x7ff04012dae0 con 0x7ff040089b00 2026-02-13T20:25:34.138 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 1 -- 10.20.193.110:0/3263119760 >> v1:10.20.193.110:6790/0 conn(0x7ff04013fb80 legacy=0x7ff0401931f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:34.138 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 1 -- 10.20.193.110:0/3263119760 >> v1:10.20.193.188:6789/0 conn(0x7ff04005a420 legacy=0x7ff04013c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:34.138 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 10 monclient: _finish_hunting 0 2026-02-13T20:25:34.138 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 1 monclient: found mon.a 2026-02-13T20:25:34.138 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:25:34.138 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:25:34.138 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 1 -- 10.20.193.110:0/3263119760 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff04005d320 con 0x7ff040089b00 2026-02-13T20:25:34.139 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 10 monclient: _finish_auth 0 2026-02-13T20:25:34.139 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 10 monclient: _check_auth_tickets 2026-02-13T20:25:34.139 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:25:34.139 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff044b4c640 5 monclient: authenticate success, global_id 124305 2026-02-13T20:25:34.139 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff044b4c640 10 monclient: _renew_subs 2026-02-13T20:25:34.139 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff044b4c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:25:34.139 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff044b4c640 1 -- 10.20.193.110:0/3263119760 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff04012cbb0 con 0x7ff040089b00 2026-02-13T20:25:34.139 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff044b4c640 10 monclient: _renew_subs 2026-02-13T20:25:34.139 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff044b4c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:25:34.139 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff044b4c640 1 -- 10.20.193.110:0/3263119760 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff04013cc10 con 0x7ff040089b00 2026-02-13T20:25:34.139 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 1 -- 10.20.193.110:0/3263119760 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff0280048a0 con 0x7ff040089b00 2026-02-13T20:25:34.139 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:25:34.139 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 1 -- 10.20.193.110:0/3263119760 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff028004bc0 con 0x7ff040089b00 2026-02-13T20:25:34.139 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:34.139 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:25:34.139 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff026ffd640 10 monclient: dump: 2026-02-13T20:25:34.139 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:34.139 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:34.139 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.139 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.140 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:34.140 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:34.140 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:34.140 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:34.140 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:34.140 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:34.140 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.105+0000 7ff03cd72640 4 set_mon_vals no callback set 2026-02-13T20:25:34.140 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.106+0000 7ff044b4c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:25:34.140 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.106+0000 7ff044b4c640 1 -- 10.20.193.110:0/3263119760 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff040150b40 con 0x7ff040150770 2026-02-13T20:25:34.140 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.106+0000 7ff026ffd640 1 -- 10.20.193.110:0/3263119760 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7ff028011830 con 0x7ff040089b00 2026-02-13T20:25:34.140 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.106+0000 7ff026ffd640 1 -- 10.20.193.110:0/3263119760 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(678..678 src has 1..678) ==== 3899+0+0 (unknown 225009374 0 0) 0x7ff02804e740 con 0x7ff040089b00 2026-02-13T20:25:34.140 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.106+0000 7ff026ffd640 1 -- 10.20.193.110:0/3263119760 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2471232192 0 0) 0x7ff040150b40 con 0x7ff040150770 2026-02-13T20:25:34.140 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.106+0000 7ff026ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:25:34.140 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.106+0000 7ff026ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:34.140 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.106+0000 7ff026ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:34.140 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.106+0000 7ff026ffd640 10 monclient(hunting): my global_id is 94607 2026-02-13T20:25:34.140 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.106+0000 7ff026ffd640 1 -- 10.20.193.110:0/3263119760 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff04012dae0 con 0x7ff040150770 2026-02-13T20:25:34.140 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.106+0000 7ff03ed76640 10 monclient: get_auth_request con 0x7ff00c03fee0 auth_method 0 2026-02-13T20:25:34.140 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.106+0000 7ff026ffd640 1 -- 10.20.193.110:0/3263119760 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2328086562 0 0) 0x7ff04012dae0 con 0x7ff040150770 2026-02-13T20:25:34.140 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.106+0000 7ff026ffd640 1 -- 10.20.193.110:0/3263119760 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff040150b40 con 0x7ff040150770 2026-02-13T20:25:34.141 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.106+0000 7ff026ffd640 1 -- 10.20.193.110:0/3263119760 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff034003560 con 0x7ff040150770 2026-02-13T20:25:34.141 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.106+0000 7ff026ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:34.141 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.106+0000 7ff026ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:25:34.141 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.106+0000 7ff026ffd640 10 monclient: dump: 2026-02-13T20:25:34.141 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:34.141 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:34.141 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.141 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.141 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:34.141 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:34.141 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:34.141 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:34.141 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:34.141 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:34.141 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.106+0000 7ff026ffd640 1 -- 10.20.193.110:0/3263119760 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4178557105 0 0) 0x7ff040150b40 con 0x7ff040150770 2026-02-13T20:25:34.141 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.106+0000 7ff026ffd640 1 -- 10.20.193.110:0/3263119760 --> v1:10.20.193.110:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff04008a5f0 con 0x7ff040150770 2026-02-13T20:25:34.141 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.107+0000 7ff026ffd640 1 -- 10.20.193.110:0/3263119760 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7ff034005870 con 0x7ff040150770 2026-02-13T20:25:34.141 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.107+0000 7ff026ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:25:34.141 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.107+0000 7ff026ffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:25:34.141 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.107+0000 7ff026ffd640 1 -- 10.20.193.110:0/3263119760 >> v1:10.20.193.110:6790/0 conn(0x7ff040150770 legacy=0x7ff040127b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:34.141 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.107+0000 7ff026ffd640 1 -- 10.20.193.110:0/3263119760 >> v1:10.20.193.110:6790/0 conn(0x7ff040150770 legacy=0x7ff040127b20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:25:34.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.110+0000 7ff044b4c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:25:34.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.110+0000 7ff044b4c640 1 -- 10.20.193.110:0/3263119760 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff04013d520 con 0x7ff040128230 2026-02-13T20:25:34.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.110+0000 7ff026ffd640 1 -- 10.20.193.110:0/3263119760 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4128767748 0 0) 0x7ff04005a7f0 con 0x7ff040128230 2026-02-13T20:25:34.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.110+0000 7ff026ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:25:34.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.110+0000 7ff026ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:34.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.110+0000 7ff026ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:34.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.110+0000 7ff026ffd640 10 monclient(hunting): my global_id is 94610 2026-02-13T20:25:34.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.110+0000 7ff026ffd640 1 -- 10.20.193.110:0/3263119760 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff040150b40 con 0x7ff040128230 2026-02-13T20:25:34.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.110+0000 7ff026ffd640 1 -- 10.20.193.110:0/3263119760 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1037270270 0 0) 0x7ff040150b40 con 0x7ff040128230 2026-02-13T20:25:34.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.110+0000 7ff026ffd640 1 -- 10.20.193.110:0/3263119760 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff04005a7f0 con 0x7ff040128230 2026-02-13T20:25:34.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.110+0000 7ff026ffd640 1 -- 10.20.193.110:0/3263119760 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff034003e80 con 0x7ff040128230 2026-02-13T20:25:34.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.110+0000 7ff026ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:34.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.110+0000 7ff026ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:25:34.142 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.110+0000 7ff026ffd640 10 monclient: dump: 2026-02-13T20:25:34.142 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:34.142 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:34.142 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.142 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.142 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:34.142 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:34.142 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:34.142 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:34.142 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:34.143 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:34.143 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.110+0000 7ff026ffd640 1 -- 10.20.193.110:0/3263119760 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3380894213 0 0) 0x7ff04005a7f0 con 0x7ff040128230 2026-02-13T20:25:34.143 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.110+0000 7ff026ffd640 1 -- 10.20.193.110:0/3263119760 --> v1:10.20.193.110:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff04012ea90 con 0x7ff040128230 2026-02-13T20:25:34.143 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.111+0000 7ff026ffd640 1 -- 10.20.193.110:0/3263119760 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4683 (unknown 0 0 2378756384) 0x7ff0340053e0 con 0x7ff040128230 2026-02-13T20:25:34.143 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.111+0000 7ff026ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:25:34.143 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.111+0000 7ff026ffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:25:34.143 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.111+0000 7ff026ffd640 1 -- 10.20.193.110:0/3263119760 >> v1:10.20.193.110:6790/0 conn(0x7ff040128230 legacy=0x7ff040195920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:34.143 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.111+0000 7ff026ffd640 1 -- 10.20.193.110:0/3263119760 >> v1:10.20.193.110:6790/0 conn(0x7ff040128230 legacy=0x7ff040195920 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:25:34.143 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:25:34.143 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:25:34.143 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:25:34.143 INFO:teuthology.orchestra.run.trial110.stdout: "state": "leader", 2026-02-13T20:25:34.143 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 52, 2026-02-13T20:25:34.143 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 605735, 2026-02-13T20:25:34.143 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:25:34.144 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:25:34.144 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:25:34.144 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:25:34.144 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:25:34.144 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 0, 2026-02-13T20:25:34.144 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:25:34.144 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:25:34.144 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:25:34.144 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:25:34.144 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:25:34.144 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:25:34.144 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:25:34.144 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:25:34.144 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:25:34.144 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:25:34.144 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:25:34.144 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:25:34.144 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:25:34.144 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:25:34.144 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:25:34.144 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:25:34.144 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:25:34.145 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:25:34.145 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:25:34.145 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:25:34.145 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:25:34.145 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:25:34.145 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:25:34.145 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:25:34.145 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:25:34.145 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:25:34.145 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:25:34.145 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:25:34.145 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:25:34.145 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:25:34.145 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:25:34.145 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:25:34.145 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:25:34.145 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:34.145 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:25:34.145 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:25:34.145 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:25:34.145 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:25:34.146 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:25:34.146 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:25:34.146 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:25:34.146 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:25:34.146 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:25:34.146 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:25:34.146 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:25:34.146 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:25:34.146 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:25:34.146 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:25:34.146 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:25:34.146 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:25:34.146 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:25:34.146 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:25:34.146 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:25:34.146 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:25:34.146 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:25:34.146 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:25:34.146 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:25:34.146 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:25:34.146 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:25:34.146 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:25:34.146 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:25:34.146 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:25:34.146 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:25:34.147 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:25:34.147 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:25:34.147 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:25:34.147 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:34.147 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:25:34.147 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:34.147 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:25:34.147 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:25:34.147 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:25:34.147 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:25:34.147 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:34.147 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:25:34.147 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:25:34.147 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:25:34.147 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:34.147 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:25:34.147 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:34.147 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:25:34.147 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:25:34.147 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:25:34.147 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:25:34.147 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:25:34.147 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:25:34.147 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:34.147 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:34.148 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:25:34.148 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:25:34.148 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:25:34.148 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:25:34.148 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:34.148 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:25:34.148 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:25:34.148 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:25:34.148 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:34.148 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:25:34.148 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:34.148 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:25:34.148 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:25:34.148 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:25:34.148 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:25:34.148 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:25:34.148 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:25:34.148 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:34.148 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:34.148 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:25:34.148 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:25:34.148 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:25:34.148 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:25:34.148 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:34.149 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:25:34.149 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:25:34.149 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:25:34.149 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:34.149 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:25:34.149 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:34.149 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:25:34.149 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:25:34.149 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:25:34.149 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:25:34.149 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:25:34.149 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:25:34.149 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:34.149 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:25:34.149 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:34.149 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:25:34.149 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:25:34.149 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:34.149 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:25:34.149 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:25:34.149 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:25:34.149 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:34.149 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:25:34.149 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:25:34.149 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:34.150 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:25:34.150 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:25:34.150 INFO:teuthology.orchestra.run.trial110.stdout: "num": 5 2026-02-13T20:25:34.150 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:34.150 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:25:34.150 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:25:34.150 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:34.150 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:25:34.150 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:25:34.150 INFO:teuthology.orchestra.run.trial110.stdout: "num": 3 2026-02-13T20:25:34.150 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:34.150 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:25:34.150 INFO:teuthology.orchestra.run.trial110.stdout: "mgr": [ 2026-02-13T20:25:34.150 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:34.150 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:25:34.150 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:25:34.150 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:25:34.150 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:34.150 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:25:34.150 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:34.150 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:25:34.150 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:25:34.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.111+0000 7ff044b4c640 1 -- 10.20.193.110:0/3263119760 >> v1:10.20.193.188:6812/1623052694 conn(0x7ff00c03fee0 legacy=0x7ff00c060390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:34.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.111+0000 7ff044b4c640 10 monclient: shutdown 2026-02-13T20:25:34.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.111+0000 7ff044b4c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:25:34.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.111+0000 7ff044b4c640 1 -- 10.20.193.110:0/3263119760 >> v1:10.20.193.110:6789/0 conn(0x7ff040089b00 legacy=0x7ff040191ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:34.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.111+0000 7ff03ed76640 1 -- 10.20.193.110:0/3263119760 reap_dead start 2026-02-13T20:25:34.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.111+0000 7ff03ed76640 1 -- 10.20.193.110:0/3263119760 reap_dead start 2026-02-13T20:25:34.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.111+0000 7ff044b4c640 1 -- 10.20.193.110:0/3263119760 shutdown_connections 2026-02-13T20:25:34.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.111+0000 7ff044b4c640 1 -- 10.20.193.110:0/3263119760 >> 10.20.193.110:0/3263119760 conn(0x7ff040054e90 msgr2=0x7ff04008d360 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:25:34.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.111+0000 7ff044b4c640 1 -- 10.20.193.110:0/3263119760 shutdown_connections 2026-02-13T20:25:34.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.111+0000 7ff044b4c640 1 -- 10.20.193.110:0/3263119760 wait complete. 2026-02-13T20:25:34.152 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:25:34.152 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-13T20:25:34.152 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T20:25:34.218 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.216+0000 7faa590c3640 10 monclient: get_monmap_and_config 2026-02-13T20:25:34.218 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.216+0000 7faa590c3640 10 monclient: build_initial_monmap 2026-02-13T20:25:34.218 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.216+0000 7faa590c3640 10 monclient: monmap: 2026-02-13T20:25:34.218 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:25:34.218 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:34.218 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:25:34.218103+0000 2026-02-13T20:25:34.218 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:25:34.218103+0000 2026-02-13T20:25:34.218 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:25:34.218 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:34.219 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:25:34.219 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:25:34.219 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:25:34.219 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:34.219 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.217+0000 7faa590c3640 1 Processor -- start 2026-02-13T20:25:34.219 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.217+0000 7faa590c3640 1 -- start start 2026-02-13T20:25:34.219 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.217+0000 7faa590c3640 10 monclient: init 2026-02-13T20:25:34.224 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.217+0000 7faa590c3640 10 monclient: _reopen_session rank -1 2026-02-13T20:25:34.224 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.217+0000 7faa590c3640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:25:34.224 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.217+0000 7faa590c3640 10 monclient(hunting): picked mon.noname-c con 0x7faa541401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:25:34.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.217+0000 7faa590c3640 10 monclient(hunting): picked mon.noname-b con 0x7faa54092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:25:34.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.217+0000 7faa590c3640 10 monclient(hunting): picked mon.noname-a con 0x7faa54091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:25:34.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.217+0000 7faa590c3640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa5408b730 con 0x7faa54091950 2026-02-13T20:25:34.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.217+0000 7faa590c3640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa5405c5b0 con 0x7faa541401c0 2026-02-13T20:25:34.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.217+0000 7faa590c3640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa5408bcf0 con 0x7faa54092020 2026-02-13T20:25:34.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.217+0000 7faa590c3640 10 monclient(hunting): _renew_subs 2026-02-13T20:25:34.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.217+0000 7faa590c3640 10 monclient(hunting): authenticate will time out at 1495.908482s 2026-02-13T20:25:34.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.217+0000 7faa53577640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7faa54091950 0x7faa541a2a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:48016/0 (socket says 10.20.193.110:48016) 2026-02-13T20:25:34.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.217+0000 7faa53577640 1 -- 10.20.193.110:0/3783433959 learned_addr learned my addr 10.20.193.110:0/3783433959 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:25:34.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.217+0000 7faa52575640 1 --1- 10.20.193.110:0/3783433959 >> v1:10.20.193.110:6790/0 conn(0x7faa54092020 0x7faa541812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:48076/0 (socket says 10.20.193.110:48076) 2026-02-13T20:25:34.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.217+0000 7faa51d74640 1 -- 10.20.193.110:0/3783433959 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1797012212 0 0) 0x7faa5408bcf0 con 0x7faa54092020 2026-02-13T20:25:34.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.217+0000 7faa51d74640 10 monclient(hunting): _negotiate 2026-02-13T20:25:34.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.217+0000 7faa51d74640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:34.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.217+0000 7faa51d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:34.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.217+0000 7faa51d74640 10 monclient(hunting): my global_id is 94613 2026-02-13T20:25:34.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.217+0000 7faa51d74640 1 -- 10.20.193.110:0/3783433959 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa400035e0 con 0x7faa54092020 2026-02-13T20:25:34.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.217+0000 7faa51d74640 1 -- 10.20.193.110:0/3783433959 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 751591406 0 0) 0x7faa5408b730 con 0x7faa54091950 2026-02-13T20:25:34.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.217+0000 7faa51d74640 10 monclient(hunting): _negotiate 2026-02-13T20:25:34.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.217+0000 7faa51d74640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:34.226 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.217+0000 7faa51d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:34.226 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.217+0000 7faa51d74640 10 monclient(hunting): my global_id is 124308 2026-02-13T20:25:34.226 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.217+0000 7faa51d74640 1 -- 10.20.193.110:0/3783433959 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa5408bcf0 con 0x7faa54091950 2026-02-13T20:25:34.226 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.217+0000 7faa51d74640 1 -- 10.20.193.110:0/3783433959 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1973649428 0 0) 0x7faa5405c5b0 con 0x7faa541401c0 2026-02-13T20:25:34.226 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.217+0000 7faa51d74640 10 monclient(hunting): _negotiate 2026-02-13T20:25:34.226 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.217+0000 7faa51d74640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:34.226 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.217+0000 7faa51d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:34.226 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.217+0000 7faa51d74640 10 monclient(hunting): my global_id is 144112 2026-02-13T20:25:34.226 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.217+0000 7faa51d74640 1 -- 10.20.193.110:0/3783433959 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa5408b730 con 0x7faa541401c0 2026-02-13T20:25:34.226 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.217+0000 7faa51d74640 1 -- 10.20.193.110:0/3783433959 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3747330539 0 0) 0x7faa400035e0 con 0x7faa54092020 2026-02-13T20:25:34.226 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.218+0000 7faa51d74640 1 -- 10.20.193.110:0/3783433959 >> v1:10.20.193.188:6789/0 conn(0x7faa541401c0 legacy=0x7faa54091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:34.226 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.218+0000 7faa51d74640 1 -- 10.20.193.110:0/3783433959 >> v1:10.20.193.110:6789/0 conn(0x7faa54091950 legacy=0x7faa541a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:34.226 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.218+0000 7faa51d74640 10 monclient: _finish_hunting 0 2026-02-13T20:25:34.226 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.218+0000 7faa51d74640 1 monclient: found mon.noname-b 2026-02-13T20:25:34.226 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.218+0000 7faa51d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:25:34.226 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.218+0000 7faa51d74640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:25:34.226 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.218+0000 7faa51d74640 1 -- 10.20.193.110:0/3783433959 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa54140590 con 0x7faa54092020 2026-02-13T20:25:34.226 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.218+0000 7faa51d74640 10 monclient: _finish_auth 0 2026-02-13T20:25:34.226 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.218+0000 7faa51d74640 10 monclient: _check_auth_tickets 2026-02-13T20:25:34.227 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.218+0000 7faa51d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:25:34.227 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.218+0000 7faa51d74640 1 -- 10.20.193.110:0/3783433959 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7faa3c002dd0 con 0x7faa54092020 2026-02-13T20:25:34.227 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.218+0000 7faa51d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:34.227 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.218+0000 7faa51d74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:25:34.227 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.218+0000 7faa51d74640 10 monclient: dump: 2026-02-13T20:25:34.227 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:34.227 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:34.227 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.227 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.227 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:34.227 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:34.227 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:34.227 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:34.227 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:34.227 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:34.227 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.218+0000 7faa590c3640 5 monclient: authenticate success, global_id 94613 2026-02-13T20:25:34.227 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.218+0000 7faa590c3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:25:34.227 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.218+0000 7faa51d74640 1 -- 10.20.193.110:0/3783433959 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7faa3c002f60 con 0x7faa54092020 2026-02-13T20:25:34.227 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.218+0000 7faa51d74640 10 monclient: handle_config config(0 keys) 2026-02-13T20:25:34.227 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.218+0000 7faa51d74640 1 -- 10.20.193.110:0/3783433959 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7faa3c003370 con 0x7faa54092020 2026-02-13T20:25:34.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.218+0000 7faa51d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:34.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.218+0000 7faa51d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:25:34.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.218+0000 7faa51d74640 10 monclient: dump: 2026-02-13T20:25:34.228 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:34.228 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:34.228 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.228 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.228 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:34.228 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:34.228 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:34.228 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:34.228 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:34.228 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:34.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.218+0000 7faa590c3640 10 monclient: get_monmap_and_config success 2026-02-13T20:25:34.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.218+0000 7faa590c3640 4 set_mon_vals no callback set 2026-02-13T20:25:34.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.218+0000 7faa590c3640 10 monclient: shutdown 2026-02-13T20:25:34.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.218+0000 7faa590c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:25:34.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.218+0000 7faa590c3640 1 -- 10.20.193.110:0/3783433959 >> v1:10.20.193.110:6790/0 conn(0x7faa54092020 legacy=0x7faa541812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:34.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.218+0000 7faa590c3640 1 -- 10.20.193.110:0/3783433959 shutdown_connections 2026-02-13T20:25:34.229 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.218+0000 7faa590c3640 1 -- 10.20.193.110:0/3783433959 >> 10.20.193.110:0/3783433959 conn(0x7faa54054e90 msgr2=0x7faa54058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:25:34.229 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.218+0000 7faa590c3640 1 -- 10.20.193.110:0/3783433959 shutdown_connections 2026-02-13T20:25:34.229 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.218+0000 7faa590c3640 1 -- 10.20.193.110:0/3783433959 wait complete. 2026-02-13T20:25:34.229 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.218+0000 7faa590c3640 10 monclient: build_initial_monmap 2026-02-13T20:25:34.229 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.218+0000 7faa590c3640 10 monclient: monmap: 2026-02-13T20:25:34.229 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:25:34.229 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:25:34.229 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:25:34.229 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:25:34.229 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:25:34.229 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:25:34.229 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:25:34.229 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:25:34.229 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:25:34.229 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:34.229 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa590c3640 1 Processor -- start 2026-02-13T20:25:34.229 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa590c3640 1 -- start start 2026-02-13T20:25:34.229 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa590c3640 10 monclient: init 2026-02-13T20:25:34.229 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa590c3640 10 monclient: _reopen_session rank -1 2026-02-13T20:25:34.229 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa590c3640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:25:34.230 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa590c3640 10 monclient(hunting): picked mon.noname-c con 0x7faa54091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:25:34.230 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa590c3640 10 monclient(hunting): picked mon.noname-b con 0x7faa541401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:25:34.230 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa590c3640 10 monclient(hunting): picked mon.noname-a con 0x7faa541527e0 addr v1:10.20.193.110:6789/0 2026-02-13T20:25:34.230 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa590c3640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa54132570 con 0x7faa541527e0 2026-02-13T20:25:34.230 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa590c3640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa54131fb0 con 0x7faa541401c0 2026-02-13T20:25:34.230 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa590c3640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa54132290 con 0x7faa54091950 2026-02-13T20:25:34.230 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa590c3640 10 monclient(hunting): _renew_subs 2026-02-13T20:25:34.230 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa590c3640 10 monclient(hunting): authenticate will time out at 1495.910316s 2026-02-13T20:25:34.230 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa52d76640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7faa54091950 0x7faa5413eb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:48086/0 (socket says 10.20.193.110:48086) 2026-02-13T20:25:34.230 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa52d76640 1 -- 10.20.193.110:0/1227080421 learned_addr learned my addr 10.20.193.110:0/1227080421 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:25:34.230 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa337fe640 1 -- 10.20.193.110:0/1227080421 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3071114915 0 0) 0x7faa54132290 con 0x7faa54091950 2026-02-13T20:25:34.230 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa337fe640 10 monclient(hunting): _negotiate 2026-02-13T20:25:34.230 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa337fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:34.230 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa337fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:34.230 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa337fe640 10 monclient(hunting): my global_id is 94616 2026-02-13T20:25:34.230 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa337fe640 1 -- 10.20.193.110:0/1227080421 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa200035e0 con 0x7faa54091950 2026-02-13T20:25:34.230 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa337fe640 1 -- 10.20.193.110:0/1227080421 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1604761007 0 0) 0x7faa54132570 con 0x7faa541527e0 2026-02-13T20:25:34.230 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa337fe640 10 monclient(hunting): _negotiate 2026-02-13T20:25:34.230 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa337fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:34.231 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa337fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:34.231 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa337fe640 10 monclient(hunting): my global_id is 124311 2026-02-13T20:25:34.231 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa337fe640 1 -- 10.20.193.110:0/1227080421 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa54132290 con 0x7faa541527e0 2026-02-13T20:25:34.231 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa337fe640 1 -- 10.20.193.110:0/1227080421 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3220156870 0 0) 0x7faa54131fb0 con 0x7faa541401c0 2026-02-13T20:25:34.231 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa337fe640 10 monclient(hunting): _negotiate 2026-02-13T20:25:34.231 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa337fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:34.231 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa337fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:34.231 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa337fe640 10 monclient(hunting): my global_id is 144115 2026-02-13T20:25:34.231 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa337fe640 1 -- 10.20.193.110:0/1227080421 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa54132570 con 0x7faa541401c0 2026-02-13T20:25:34.231 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa337fe640 1 -- 10.20.193.110:0/1227080421 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1925509791 0 0) 0x7faa200035e0 con 0x7faa54091950 2026-02-13T20:25:34.231 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa337fe640 1 -- 10.20.193.110:0/1227080421 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faa54131fb0 con 0x7faa54091950 2026-02-13T20:25:34.231 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa337fe640 1 -- 10.20.193.110:0/1227080421 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7faa48003150 con 0x7faa54091950 2026-02-13T20:25:34.231 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa337fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:25:34.231 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa337fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:25:34.231 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa337fe640 10 monclient(hunting): dump: 2026-02-13T20:25:34.231 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:34.231 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:34.231 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.231 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.231 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:34.231 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:34.232 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:34.232 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:34.232 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:34.232 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:34.232 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa337fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:25:34.232 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa337fe640 1 -- 10.20.193.110:0/1227080421 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3889322792 0 0) 0x7faa54132290 con 0x7faa541527e0 2026-02-13T20:25:34.232 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa337fe640 1 -- 10.20.193.110:0/1227080421 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faa200035e0 con 0x7faa541527e0 2026-02-13T20:25:34.232 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa337fe640 1 -- 10.20.193.110:0/1227080421 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7faa440040f0 con 0x7faa541527e0 2026-02-13T20:25:34.232 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa337fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:25:34.232 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa337fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:25:34.232 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa337fe640 10 monclient(hunting): dump: 2026-02-13T20:25:34.232 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:34.232 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:34.232 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.232 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.232 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:34.232 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:34.232 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:34.232 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:34.232 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:34.233 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:34.233 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa337fe640 1 -- 10.20.193.110:0/1227080421 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 553559278 0 0) 0x7faa54132570 con 0x7faa541401c0 2026-02-13T20:25:34.233 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa337fe640 1 -- 10.20.193.110:0/1227080421 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faa54132290 con 0x7faa541401c0 2026-02-13T20:25:34.233 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa337fe640 1 -- 10.20.193.110:0/1227080421 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7faa3c0030d0 con 0x7faa541401c0 2026-02-13T20:25:34.233 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa337fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:25:34.233 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa337fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-13T20:25:34.233 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa337fe640 10 monclient(hunting): dump: 2026-02-13T20:25:34.233 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:34.233 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:34.233 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.233 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.233 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:34.233 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:34.233 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:34.233 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:34.233 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:34.233 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:34.233 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa337fe640 1 -- 10.20.193.110:0/1227080421 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3526456517 0 0) 0x7faa54131fb0 con 0x7faa54091950 2026-02-13T20:25:34.233 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa337fe640 1 -- 10.20.193.110:0/1227080421 >> v1:10.20.193.188:6789/0 conn(0x7faa541401c0 legacy=0x7faa54193b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:34.234 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa337fe640 1 -- 10.20.193.110:0/1227080421 >> v1:10.20.193.110:6789/0 conn(0x7faa541527e0 legacy=0x7faa54195280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:34.234 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa337fe640 10 monclient: _finish_hunting 0 2026-02-13T20:25:34.234 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa337fe640 1 monclient: found mon.c 2026-02-13T20:25:34.234 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa337fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:25:34.234 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa337fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:25:34.234 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa337fe640 1 -- 10.20.193.110:0/1227080421 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa54091070 con 0x7faa54091950 2026-02-13T20:25:34.234 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa337fe640 10 monclient: _finish_auth 0 2026-02-13T20:25:34.234 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa337fe640 10 monclient: _check_auth_tickets 2026-02-13T20:25:34.234 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa337fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:25:34.234 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa590c3640 5 monclient: authenticate success, global_id 94616 2026-02-13T20:25:34.234 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa590c3640 10 monclient: _renew_subs 2026-02-13T20:25:34.234 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa590c3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:25:34.234 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa590c3640 1 -- 10.20.193.110:0/1227080421 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7faa5408c550 con 0x7faa54091950 2026-02-13T20:25:34.234 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa590c3640 10 monclient: _renew_subs 2026-02-13T20:25:34.234 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa590c3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:25:34.234 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.219+0000 7faa590c3640 1 -- 10.20.193.110:0/1227080421 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7faa54131cd0 con 0x7faa54091950 2026-02-13T20:25:34.234 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.220+0000 7faa337fe640 1 -- 10.20.193.110:0/1227080421 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7faa480032b0 con 0x7faa54091950 2026-02-13T20:25:34.234 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.220+0000 7faa337fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:25:34.234 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.220+0000 7faa337fe640 1 -- 10.20.193.110:0/1227080421 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7faa48003b30 con 0x7faa54091950 2026-02-13T20:25:34.234 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.220+0000 7faa337fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:34.235 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.220+0000 7faa337fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:25:34.235 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.220+0000 7faa337fe640 10 monclient: dump: 2026-02-13T20:25:34.235 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:34.235 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:34.235 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.235 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.235 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:34.235 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:34.235 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:34.235 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:34.235 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:34.235 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:34.235 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.220+0000 7faa51573640 4 set_mon_vals no callback set 2026-02-13T20:25:34.235 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.220+0000 7faa590c3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:25:34.235 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.220+0000 7faa590c3640 1 -- 10.20.193.110:0/1227080421 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7faa5413f240 con 0x7faa54092020 2026-02-13T20:25:34.235 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.220+0000 7faa337fe640 1 -- 10.20.193.110:0/1227080421 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7faa48003c90 con 0x7faa54091950 2026-02-13T20:25:34.235 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.220+0000 7faa337fe640 1 -- 10.20.193.110:0/1227080421 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(678..678 src has 1..678) ==== 3899+0+0 (unknown 225009374 0 0) 0x7faa4804e8e0 con 0x7faa54091950 2026-02-13T20:25:34.235 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.221+0000 7faa337fe640 1 -- 10.20.193.110:0/1227080421 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1332052376 0 0) 0x7faa5413f240 con 0x7faa54092020 2026-02-13T20:25:34.235 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.221+0000 7faa337fe640 10 monclient(hunting): _negotiate 2026-02-13T20:25:34.235 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.221+0000 7faa337fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:34.236 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.221+0000 7faa337fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:34.236 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.221+0000 7faa337fe640 10 monclient(hunting): my global_id is 144118 2026-02-13T20:25:34.236 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.221+0000 7faa337fe640 1 -- 10.20.193.110:0/1227080421 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa54131fb0 con 0x7faa54092020 2026-02-13T20:25:34.236 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.221+0000 7faa53577640 10 monclient: get_auth_request con 0x7faa2003ff80 auth_method 0 2026-02-13T20:25:34.236 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.221+0000 7faa337fe640 1 -- 10.20.193.110:0/1227080421 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4274453005 0 0) 0x7faa54131fb0 con 0x7faa54092020 2026-02-13T20:25:34.236 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.221+0000 7faa337fe640 1 -- 10.20.193.110:0/1227080421 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faa5413f240 con 0x7faa54092020 2026-02-13T20:25:34.236 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.221+0000 7faa337fe640 1 -- 10.20.193.110:0/1227080421 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7faa3c004a50 con 0x7faa54092020 2026-02-13T20:25:34.236 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.221+0000 7faa337fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:34.236 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.221+0000 7faa337fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:25:34.236 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.221+0000 7faa337fe640 10 monclient: dump: 2026-02-13T20:25:34.236 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:34.236 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:34.236 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.236 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.236 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:34.236 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:34.236 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:34.236 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:34.236 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:34.236 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:34.236 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.221+0000 7faa337fe640 1 -- 10.20.193.110:0/1227080421 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 507759826 0 0) 0x7faa5413f240 con 0x7faa54092020 2026-02-13T20:25:34.237 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.221+0000 7faa337fe640 1 -- 10.20.193.110:0/1227080421 --> v1:10.20.193.188:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faa5408b450 con 0x7faa54092020 2026-02-13T20:25:34.237 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.221+0000 7faa337fe640 1 -- 10.20.193.110:0/1227080421 <== mon.1 v1:10.20.193.188:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7faa3c0029c0 con 0x7faa54092020 2026-02-13T20:25:34.237 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.221+0000 7faa337fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:25:34.237 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.221+0000 7faa337fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:25:34.237 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.221+0000 7faa337fe640 1 -- 10.20.193.110:0/1227080421 >> v1:10.20.193.188:6789/0 conn(0x7faa54092020 legacy=0x7faa54127b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:34.237 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.221+0000 7faa337fe640 1 -- 10.20.193.110:0/1227080421 >> v1:10.20.193.188:6789/0 conn(0x7faa54092020 legacy=0x7faa54127b20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:25:34.238 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.225+0000 7faa590c3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:25:34.238 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.225+0000 7faa590c3640 1 -- 10.20.193.110:0/1227080421 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7faa54055bb0 con 0x7faa54128230 2026-02-13T20:25:34.238 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.225+0000 7faa337fe640 1 -- 10.20.193.110:0/1227080421 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 152323672 0 0) 0x7faa54055bb0 con 0x7faa54128230 2026-02-13T20:25:34.238 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.225+0000 7faa337fe640 10 monclient(hunting): _negotiate 2026-02-13T20:25:34.238 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.225+0000 7faa337fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:34.238 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.225+0000 7faa337fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:34.238 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.225+0000 7faa337fe640 10 monclient(hunting): my global_id is 144121 2026-02-13T20:25:34.238 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.225+0000 7faa337fe640 1 -- 10.20.193.110:0/1227080421 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa5413f240 con 0x7faa54128230 2026-02-13T20:25:34.238 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.225+0000 7faa337fe640 1 -- 10.20.193.110:0/1227080421 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 661162733 0 0) 0x7faa5413f240 con 0x7faa54128230 2026-02-13T20:25:34.238 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.225+0000 7faa337fe640 1 -- 10.20.193.110:0/1227080421 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faa54055bb0 con 0x7faa54128230 2026-02-13T20:25:34.239 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.225+0000 7faa337fe640 1 -- 10.20.193.110:0/1227080421 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7faa3c006370 con 0x7faa54128230 2026-02-13T20:25:34.239 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.225+0000 7faa337fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:34.239 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.225+0000 7faa337fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:25:34.239 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.225+0000 7faa337fe640 10 monclient: dump: 2026-02-13T20:25:34.239 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:34.239 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:34.239 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.239 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.239 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:34.239 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:34.239 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:34.239 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:34.239 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:34.239 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:34.239 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.225+0000 7faa337fe640 1 -- 10.20.193.110:0/1227080421 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 909943444 0 0) 0x7faa54055bb0 con 0x7faa54128230 2026-02-13T20:25:34.239 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.225+0000 7faa337fe640 1 -- 10.20.193.110:0/1227080421 --> v1:10.20.193.188:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7faa54058410 con 0x7faa54128230 2026-02-13T20:25:34.239 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.226+0000 7faa337fe640 1 -- 10.20.193.110:0/1227080421 <== mon.1 v1:10.20.193.188:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4344 (unknown 0 0 1279501321) 0x7faa3c006810 con 0x7faa54128230 2026-02-13T20:25:34.239 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.226+0000 7faa337fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:25:34.239 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.226+0000 7faa337fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:25:34.240 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.226+0000 7faa337fe640 1 -- 10.20.193.110:0/1227080421 >> v1:10.20.193.188:6789/0 conn(0x7faa54128230 legacy=0x7faa541979b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:34.240 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.226+0000 7faa337fe640 1 -- 10.20.193.110:0/1227080421 >> v1:10.20.193.188:6789/0 conn(0x7faa54128230 legacy=0x7faa541979b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:25:34.240 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:25:34.240 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:25:34.240 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:25:34.240 INFO:teuthology.orchestra.run.trial110.stdout: "state": "peon", 2026-02-13T20:25:34.240 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 52, 2026-02-13T20:25:34.240 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 497, 2026-02-13T20:25:34.240 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:25:34.240 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:25:34.240 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:25:34.240 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:25:34.240 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:25:34.240 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 0, 2026-02-13T20:25:34.241 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:25:34.241 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:25:34.241 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:25:34.241 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:25:34.241 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:25:34.241 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:25:34.241 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:25:34.241 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:25:34.241 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:25:34.241 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:25:34.241 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:25:34.241 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:25:34.241 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:25:34.241 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:25:34.241 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:25:34.241 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:25:34.241 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:25:34.241 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:25:34.241 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:25:34.242 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:25:34.242 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:25:34.242 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:25:34.242 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:25:34.242 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:25:34.242 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:25:34.242 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:25:34.242 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:25:34.242 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:25:34.242 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:25:34.242 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:25:34.242 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:25:34.242 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:25:34.242 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:25:34.242 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:34.242 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:25:34.242 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:25:34.242 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:25:34.242 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:25:34.243 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:25:34.243 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:25:34.243 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:25:34.243 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:25:34.243 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:25:34.243 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:25:34.243 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:25:34.243 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:25:34.243 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:25:34.243 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:25:34.243 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:25:34.243 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:25:34.243 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:25:34.243 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:25:34.243 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:25:34.243 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:25:34.243 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:25:34.243 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:25:34.244 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:25:34.244 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:25:34.244 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:25:34.244 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:25:34.244 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:25:34.244 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:25:34.244 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:25:34.244 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:25:34.244 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:25:34.244 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:25:34.244 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:34.244 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:25:34.244 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:34.244 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:25:34.244 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:25:34.244 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:25:34.244 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:25:34.244 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:34.244 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:25:34.244 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:25:34.245 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:25:34.245 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:34.245 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:25:34.245 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:34.245 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:25:34.245 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:25:34.245 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:25:34.245 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:25:34.245 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:25:34.245 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:25:34.245 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:34.245 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:34.245 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:25:34.245 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:25:34.245 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:25:34.245 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:25:34.245 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:34.245 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:25:34.245 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:25:34.245 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:25:34.246 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:34.246 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:25:34.246 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:34.246 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:25:34.246 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:25:34.246 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:25:34.246 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:25:34.246 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:25:34.246 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:25:34.246 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:34.246 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:34.246 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:25:34.246 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:25:34.246 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:25:34.246 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:25:34.246 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:34.246 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:25:34.246 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:25:34.246 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:25:34.247 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:34.247 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:25:34.247 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:34.247 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:25:34.247 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:25:34.247 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:25:34.247 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:25:34.247 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:25:34.247 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:25:34.247 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:34.247 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:25:34.247 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:34.247 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:25:34.247 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:25:34.247 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:34.247 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:25:34.247 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:25:34.247 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:25:34.247 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:34.247 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:25:34.248 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:25:34.248 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:34.248 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:25:34.248 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:25:34.248 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:25:34.248 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:34.248 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:25:34.248 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:34.248 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:25:34.248 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:25:34.249 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.226+0000 7faa590c3640 1 -- 10.20.193.110:0/1227080421 >> v1:10.20.193.188:6812/1623052694 conn(0x7faa2003ff80 legacy=0x7faa20060430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:34.249 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.226+0000 7faa590c3640 10 monclient: shutdown 2026-02-13T20:25:34.249 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.226+0000 7faa590c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:25:34.249 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.226+0000 7faa590c3640 1 -- 10.20.193.110:0/1227080421 >> v1:10.20.193.110:6790/0 conn(0x7faa54091950 legacy=0x7faa5413eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:34.249 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.226+0000 7faa53577640 1 -- 10.20.193.110:0/1227080421 reap_dead start 2026-02-13T20:25:34.249 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.226+0000 7faa53577640 1 -- 10.20.193.110:0/1227080421 reap_dead start 2026-02-13T20:25:34.249 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.226+0000 7faa590c3640 1 -- 10.20.193.110:0/1227080421 shutdown_connections 2026-02-13T20:25:34.249 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.226+0000 7faa590c3640 1 -- 10.20.193.110:0/1227080421 >> 10.20.193.110:0/1227080421 conn(0x7faa54054e90 msgr2=0x7faa5408ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:25:34.250 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.226+0000 7faa590c3640 1 -- 10.20.193.110:0/1227080421 shutdown_connections 2026-02-13T20:25:34.250 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.226+0000 7faa590c3640 1 -- 10.20.193.110:0/1227080421 wait complete. 2026-02-13T20:25:34.250 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:25:34.250 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-13T20:25:34.250 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-13T20:25:34.290 INFO:tasks.rados.rados.0.trial188.stdout:3190: done (7 left) 2026-02-13T20:25:34.290 INFO:tasks.rados.rados.0.trial188.stdout:3191: write (excl) oid 42 current snap is 326 2026-02-13T20:25:34.290 INFO:tasks.rados.rados.0.trial188.stdout:3191: seq_num 1101 ranges {504507=403981,1328204=409370,2252362=252145} 2026-02-13T20:25:34.294 INFO:tasks.rados.rados.0.trial188.stdout:3191: writing trial18843701-42 from 504507 to 908488 tid 1 2026-02-13T20:25:34.297 INFO:tasks.rados.rados.0.trial188.stdout:3191: writing trial18843701-42 from 1328204 to 1737574 tid 2 2026-02-13T20:25:34.300 INFO:tasks.rados.rados.0.trial188.stdout:3191: writing trial18843701-42 from 2252362 to 2504507 tid 3 2026-02-13T20:25:34.300 INFO:tasks.rados.rados.0.trial188.stdout:3192: write (excl) oid 33 current snap is 326 2026-02-13T20:25:34.300 INFO:tasks.rados.rados.0.trial188.stdout:3192: seq_num 1102 ranges {521314=479230,1786686=669381} 2026-02-13T20:25:34.304 INFO:tasks.rados.rados.0.trial188.stdout:3192: writing trial18843701-33 from 521314 to 1000544 tid 1 2026-02-13T20:25:34.309 INFO:tasks.rados.rados.0.trial188.stdout:3192: writing trial18843701-33 from 1786686 to 2456067 tid 2 2026-02-13T20:25:34.310 INFO:tasks.rados.rados.0.trial188.stdout:3193: write oid 4 current snap is 326 2026-02-13T20:25:34.310 INFO:tasks.rados.rados.0.trial188.stdout:3193: seq_num 1103 ranges {538121=670832,1961521=413039} 2026-02-13T20:25:34.314 INFO:tasks.rados.rados.0.trial188.stdout:3193: writing trial18843701-4 from 538121 to 1208953 tid 1 2026-02-13T20:25:34.316 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.315+0000 7f228bd0c640 10 monclient: get_monmap_and_config 2026-02-13T20:25:34.316 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.315+0000 7f228bd0c640 10 monclient: build_initial_monmap 2026-02-13T20:25:34.316 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.315+0000 7f228bd0c640 10 monclient: monmap: 2026-02-13T20:25:34.316 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:25:34.316 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:34.317 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:25:34.316566+0000 2026-02-13T20:25:34.317 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:25:34.316566+0000 2026-02-13T20:25:34.317 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:25:34.317 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:34.317 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:25:34.317 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:25:34.317 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:25:34.317 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:34.323 INFO:tasks.rados.rados.0.trial188.stdout:3193: writing trial18843701-4 from 1961521 to 2374560 tid 2 2026-02-13T20:25:34.324 INFO:tasks.rados.rados.0.trial188.stdout:3194: delete oid 31 current snap is 326 2026-02-13T20:25:34.324 INFO:tasks.rados.rados.0.trial188.stdout:3187: expect (ObjNum 1090 snap 325 seq_num 1090) 2026-02-13T20:25:34.326 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.315+0000 7f228bd0c640 1 Processor -- start 2026-02-13T20:25:34.326 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.315+0000 7f228bd0c640 1 -- start start 2026-02-13T20:25:34.326 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.315+0000 7f228bd0c640 10 monclient: init 2026-02-13T20:25:34.326 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.315+0000 7f228bd0c640 10 monclient: _reopen_session rank -1 2026-02-13T20:25:34.326 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.315+0000 7f228bd0c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:25:34.326 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.316+0000 7f228bd0c640 10 monclient(hunting): picked mon.noname-b con 0x7f228405c540 addr v1:10.20.193.110:6790/0 2026-02-13T20:25:34.326 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.316+0000 7f228bd0c640 10 monclient(hunting): picked mon.noname-c con 0x7f228405d050 addr v1:10.20.193.188:6789/0 2026-02-13T20:25:34.327 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.316+0000 7f228bd0c640 10 monclient(hunting): picked mon.noname-a con 0x7f2284142430 addr v1:10.20.193.110:6789/0 2026-02-13T20:25:34.327 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.316+0000 7f228bd0c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f228408f370 con 0x7f2284142430 2026-02-13T20:25:34.327 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.316+0000 7f228bd0c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f228408f540 con 0x7f228405d050 2026-02-13T20:25:34.327 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.316+0000 7f228bd0c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22840905e0 con 0x7f228405c540 2026-02-13T20:25:34.327 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.316+0000 7f228bd0c640 10 monclient(hunting): _renew_subs 2026-02-13T20:25:34.327 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.316+0000 7f228bd0c640 10 monclient(hunting): authenticate will time out at 1496.007084s 2026-02-13T20:25:34.327 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.316+0000 7f2289a81640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f228405c540 0x7f228405c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:48100/0 (socket says 10.20.193.110:48100) 2026-02-13T20:25:34.327 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.316+0000 7f2289a81640 1 -- 10.20.193.110:0/225341517 learned_addr learned my addr 10.20.193.110:0/225341517 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:25:34.327 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.316+0000 7f2288a7f640 1 -- 10.20.193.110:0/225341517 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2620304649 0 0) 0x7f22840905e0 con 0x7f228405c540 2026-02-13T20:25:34.327 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.316+0000 7f2288a7f640 10 monclient(hunting): _negotiate 2026-02-13T20:25:34.327 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.316+0000 7f2288a7f640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:34.327 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.316+0000 7f2288a7f640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:34.328 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.316+0000 7f2288a7f640 10 monclient(hunting): my global_id is 94619 2026-02-13T20:25:34.328 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.316+0000 7f2288a7f640 1 -- 10.20.193.110:0/225341517 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f226c0035e0 con 0x7f228405c540 2026-02-13T20:25:34.328 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.316+0000 7f2288a7f640 1 -- 10.20.193.110:0/225341517 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1872091722 0 0) 0x7f228408f370 con 0x7f2284142430 2026-02-13T20:25:34.328 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.316+0000 7f2288a7f640 10 monclient(hunting): _negotiate 2026-02-13T20:25:34.328 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.316+0000 7f2288a7f640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:34.328 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.316+0000 7f2288a7f640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:34.328 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.316+0000 7f2288a7f640 10 monclient(hunting): my global_id is 124314 2026-02-13T20:25:34.328 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.316+0000 7f2288a7f640 1 -- 10.20.193.110:0/225341517 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22840905e0 con 0x7f2284142430 2026-02-13T20:25:34.328 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.316+0000 7f2288a7f640 1 -- 10.20.193.110:0/225341517 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2678317684 0 0) 0x7f226c0035e0 con 0x7f228405c540 2026-02-13T20:25:34.328 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.316+0000 7f2288a7f640 1 -- 10.20.193.110:0/225341517 >> v1:10.20.193.188:6789/0 conn(0x7f228405d050 legacy=0x7f2284183540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:34.328 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.316+0000 7f2288a7f640 1 -- 10.20.193.110:0/225341517 >> v1:10.20.193.110:6789/0 conn(0x7f2284142430 legacy=0x7f22841a4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:34.329 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.316+0000 7f2288a7f640 10 monclient: _finish_hunting 0 2026-02-13T20:25:34.329 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.316+0000 7f2288a7f640 1 monclient: found mon.noname-b 2026-02-13T20:25:34.329 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.316+0000 7f2288a7f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:25:34.329 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.316+0000 7f2288a7f640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:25:34.329 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.316+0000 7f2288a7f640 1 -- 10.20.193.110:0/225341517 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2284142850 con 0x7f228405c540 2026-02-13T20:25:34.329 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.316+0000 7f2288a7f640 10 monclient: _finish_auth 0 2026-02-13T20:25:34.329 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.316+0000 7f2288a7f640 10 monclient: _check_auth_tickets 2026-02-13T20:25:34.329 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.316+0000 7f2288a7f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:25:34.329 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.316+0000 7f2288a7f640 1 -- 10.20.193.110:0/225341517 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f2274002dd0 con 0x7f228405c540 2026-02-13T20:25:34.329 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.316+0000 7f2288a7f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:34.329 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.316+0000 7f2288a7f640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:25:34.329 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.316+0000 7f2288a7f640 10 monclient: dump: 2026-02-13T20:25:34.330 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:34.330 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:34.330 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.330 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.330 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:34.330 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:34.330 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:34.330 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:34.330 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:34.330 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:34.330 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.316+0000 7f228bd0c640 5 monclient: authenticate success, global_id 94619 2026-02-13T20:25:34.331 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.316+0000 7f228bd0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:25:34.331 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.316+0000 7f2288a7f640 1 -- 10.20.193.110:0/225341517 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2274002f60 con 0x7f228405c540 2026-02-13T20:25:34.331 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.316+0000 7f2288a7f640 10 monclient: handle_config config(0 keys) 2026-02-13T20:25:34.331 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.316+0000 7f2288a7f640 1 -- 10.20.193.110:0/225341517 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f2274003330 con 0x7f228405c540 2026-02-13T20:25:34.331 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.316+0000 7f2288a7f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:34.331 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.316+0000 7f2288a7f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:25:34.331 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.316+0000 7f2288a7f640 10 monclient: dump: 2026-02-13T20:25:34.331 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:34.331 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:34.331 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.331 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.331 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:34.331 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:34.332 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:34.332 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:34.332 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:34.332 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:34.332 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.316+0000 7f228bd0c640 10 monclient: get_monmap_and_config success 2026-02-13T20:25:34.332 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.316+0000 7f228bd0c640 4 set_mon_vals no callback set 2026-02-13T20:25:34.332 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.316+0000 7f228bd0c640 10 monclient: shutdown 2026-02-13T20:25:34.332 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.316+0000 7f228bd0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:25:34.332 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.316+0000 7f228bd0c640 1 -- 10.20.193.110:0/225341517 >> v1:10.20.193.110:6790/0 conn(0x7f228405c540 legacy=0x7f228405c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:34.332 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.317+0000 7f228bd0c640 1 -- 10.20.193.110:0/225341517 shutdown_connections 2026-02-13T20:25:34.332 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.317+0000 7f228bd0c640 1 -- 10.20.193.110:0/225341517 >> 10.20.193.110:0/225341517 conn(0x7f2284093270 msgr2=0x7f2284054330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:25:34.332 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.317+0000 7f228bd0c640 1 -- 10.20.193.110:0/225341517 shutdown_connections 2026-02-13T20:25:34.333 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.317+0000 7f228bd0c640 1 -- 10.20.193.110:0/225341517 wait complete. 2026-02-13T20:25:34.333 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.317+0000 7f228bd0c640 10 monclient: build_initial_monmap 2026-02-13T20:25:34.333 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.317+0000 7f228bd0c640 10 monclient: monmap: 2026-02-13T20:25:34.333 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:25:34.333 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:25:34.333 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:25:34.333 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:25:34.333 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:25:34.333 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:25:34.333 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:25:34.333 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:25:34.333 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:25:34.334 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:34.334 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.317+0000 7f228bd0c640 1 Processor -- start 2026-02-13T20:25:34.334 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.317+0000 7f228bd0c640 1 -- start start 2026-02-13T20:25:34.334 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.317+0000 7f228bd0c640 10 monclient: init 2026-02-13T20:25:34.334 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f228bd0c640 10 monclient: _reopen_session rank -1 2026-02-13T20:25:34.334 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f228bd0c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:25:34.334 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f228bd0c640 10 monclient(hunting): picked mon.noname-b con 0x7f228405c540 addr v1:10.20.193.188:6789/0 2026-02-13T20:25:34.334 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f228bd0c640 10 monclient(hunting): picked mon.noname-c con 0x7f228405d050 addr v1:10.20.193.110:6790/0 2026-02-13T20:25:34.334 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f228bd0c640 10 monclient(hunting): picked mon.noname-a con 0x7f2284142430 addr v1:10.20.193.110:6789/0 2026-02-13T20:25:34.334 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f228bd0c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22841314d0 con 0x7f2284142430 2026-02-13T20:25:34.334 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f228bd0c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f228412fa10 con 0x7f228405c540 2026-02-13T20:25:34.335 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f228bd0c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f228405d590 con 0x7f228405d050 2026-02-13T20:25:34.335 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f228bd0c640 10 monclient(hunting): _renew_subs 2026-02-13T20:25:34.335 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f228bd0c640 10 monclient(hunting): authenticate will time out at 1496.009182s 2026-02-13T20:25:34.335 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f2289280640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f228405d050 0x7f2284193770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:48114/0 (socket says 10.20.193.110:48114) 2026-02-13T20:25:34.335 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f2289280640 1 -- 10.20.193.110:0/2100728739 learned_addr learned my addr 10.20.193.110:0/2100728739 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:25:34.335 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f22727fc640 1 -- 10.20.193.110:0/2100728739 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4048517916 0 0) 0x7f22841314d0 con 0x7f2284142430 2026-02-13T20:25:34.335 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f22727fc640 10 monclient(hunting): _negotiate 2026-02-13T20:25:34.335 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f22727fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:34.335 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f22727fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:34.335 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f22727fc640 10 monclient(hunting): my global_id is 124317 2026-02-13T20:25:34.335 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f22727fc640 1 -- 10.20.193.110:0/2100728739 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22540035e0 con 0x7f2284142430 2026-02-13T20:25:34.335 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f22727fc640 1 -- 10.20.193.110:0/2100728739 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2539754284 0 0) 0x7f228405d590 con 0x7f228405d050 2026-02-13T20:25:34.335 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f22727fc640 10 monclient(hunting): _negotiate 2026-02-13T20:25:34.335 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f22727fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:34.336 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f22727fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:34.336 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f22727fc640 10 monclient(hunting): my global_id is 94622 2026-02-13T20:25:34.336 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f22727fc640 1 -- 10.20.193.110:0/2100728739 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22841314d0 con 0x7f228405d050 2026-02-13T20:25:34.336 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f22727fc640 1 -- 10.20.193.110:0/2100728739 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 102172451 0 0) 0x7f22841314d0 con 0x7f228405d050 2026-02-13T20:25:34.336 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f22727fc640 1 -- 10.20.193.110:0/2100728739 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f228405d590 con 0x7f228405d050 2026-02-13T20:25:34.336 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f22727fc640 1 -- 10.20.193.110:0/2100728739 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3377307161 0 0) 0x7f22540035e0 con 0x7f2284142430 2026-02-13T20:25:34.336 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f22727fc640 1 -- 10.20.193.110:0/2100728739 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f22841314d0 con 0x7f2284142430 2026-02-13T20:25:34.336 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f22727fc640 1 -- 10.20.193.110:0/2100728739 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f2278003170 con 0x7f228405d050 2026-02-13T20:25:34.336 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f22727fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:25:34.336 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f22727fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:25:34.336 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f22727fc640 10 monclient(hunting): dump: 2026-02-13T20:25:34.336 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:34.336 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:34.336 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.337 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.337 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:34.337 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:34.337 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:34.337 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:34.337 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:34.337 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:34.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f22727fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:25:34.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f22727fc640 1 -- 10.20.193.110:0/2100728739 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f22800042d0 con 0x7f2284142430 2026-02-13T20:25:34.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f22727fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:25:34.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f22727fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:25:34.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f22727fc640 10 monclient(hunting): dump: 2026-02-13T20:25:34.337 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:34.337 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:34.338 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.338 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.338 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:34.338 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:34.338 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:34.338 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:34.338 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:34.338 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:34.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f22727fc640 1 -- 10.20.193.110:0/2100728739 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1516715270 0 0) 0x7f228405d590 con 0x7f228405d050 2026-02-13T20:25:34.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f22727fc640 1 -- 10.20.193.110:0/2100728739 >> v1:10.20.193.188:6789/0 conn(0x7f228405c540 legacy=0x7f2284140370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:34.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f22727fc640 1 -- 10.20.193.110:0/2100728739 >> v1:10.20.193.110:6789/0 conn(0x7f2284142430 legacy=0x7f2284194e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:34.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f22727fc640 10 monclient: _finish_hunting 0 2026-02-13T20:25:34.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f22727fc640 1 monclient: found mon.c 2026-02-13T20:25:34.339 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f22727fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:25:34.339 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f22727fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:25:34.339 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f22727fc640 1 -- 10.20.193.110:0/2100728739 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2284131a90 con 0x7f228405d050 2026-02-13T20:25:34.339 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f22727fc640 10 monclient: _finish_auth 0 2026-02-13T20:25:34.339 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f22727fc640 10 monclient: _check_auth_tickets 2026-02-13T20:25:34.339 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f22727fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:25:34.339 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f228bd0c640 5 monclient: authenticate success, global_id 94622 2026-02-13T20:25:34.339 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f228bd0c640 10 monclient: _renew_subs 2026-02-13T20:25:34.339 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f228bd0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:25:34.339 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f228bd0c640 1 -- 10.20.193.110:0/2100728739 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2284131d70 con 0x7f228405d050 2026-02-13T20:25:34.339 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f228bd0c640 10 monclient: _renew_subs 2026-02-13T20:25:34.339 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f228bd0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:25:34.339 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f228bd0c640 1 -- 10.20.193.110:0/2100728739 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f2284130570 con 0x7f228405d050 2026-02-13T20:25:34.339 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f22727fc640 1 -- 10.20.193.110:0/2100728739 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f22780034c0 con 0x7f228405d050 2026-02-13T20:25:34.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f22727fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:25:34.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f22727fc640 1 -- 10.20.193.110:0/2100728739 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f2278003b30 con 0x7f228405d050 2026-02-13T20:25:34.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f22727fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:34.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f22727fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:25:34.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f22727fc640 10 monclient: dump: 2026-02-13T20:25:34.340 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:34.340 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:34.340 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.340 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:34.340 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:34.340 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:34.340 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:34.340 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:34.340 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:34.340 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:34.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.318+0000 7f2273fff640 4 set_mon_vals no callback set 2026-02-13T20:25:34.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.319+0000 7f228bd0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:25:34.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.319+0000 7f228bd0c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:25:34.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.319+0000 7f228bd0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:25:34.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.319+0000 7f228bd0c640 1 -- 10.20.193.110:0/2100728739 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2284091630 con 0x7f228405d050 2026-02-13T20:25:34.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.319+0000 7f22727fc640 1 -- 10.20.193.110:0/2100728739 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f2278003c90 con 0x7f228405d050 2026-02-13T20:25:34.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.319+0000 7f22727fc640 1 -- 10.20.193.110:0/2100728739 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(679..679 src has 1..679) ==== 3927+0+0 (unknown 3573025896 0 0) 0x7f227804e9c0 con 0x7f228405d050 2026-02-13T20:25:34.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.319+0000 7f2289a81640 10 monclient: get_auth_request con 0x7f225403fb00 auth_method 0 2026-02-13T20:25:34.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.321+0000 7f22727fc640 1 -- 10.20.193.110:0/2100728739 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f2278017100 con 0x7f228405d050 2026-02-13T20:25:34.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.321+0000 7f22727fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:25:34.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.321+0000 7f22727fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:25:34.353 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 739983 2026-02-13T20:25:34.403 INFO:tasks.rados.rados.0.trial188.stdout:3188: expect (ObjNum 1054 snap 314 seq_num 1054) 2026-02-13T20:25:34.469 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.467+0000 7f228bd0c640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-13T20:25:34.469 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.467+0000 7f228bd0c640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-13T20:25:34.469 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.467+0000 7f228bd0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:25:34.469 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.467+0000 7f228bd0c640 1 -- 10.20.193.110:0/2100728739 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f2284055bb0 con 0x7f228405d050 2026-02-13T20:25:34.470 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.468+0000 7f22727fc640 1 -- 10.20.193.110:0/2100728739 <== mon.2 v1:10.20.193.110:6790/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7f22780168b0 con 0x7f228405d050 2026-02-13T20:25:34.470 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.468+0000 7f22727fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-13T20:25:34.471 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.468+0000 7f22727fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:25:34.472 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.468+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.472 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.468+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=23,config=2,health=12,kv=10,logm=53} crc {auth=1613319564,config=1618278320,health=1443902372,kv=2847523468,logm=2868927542}) 2026-02-13T20:25:34.472 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.468+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=22,config=2,health=13,kv=11,logm=52} crc {auth=103432697,config=1618278320,health=1009219655,kv=1564860261,logm=871697364}) 2026-02-13T20:25:34.472 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.468+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.472 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.468+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=23,config=2,health=12,kv=10,logm=53} crc {auth=1613319564,config=1618278320,health=1443902372,kv=2847523468,logm=2868927542}) 2026-02-13T20:25:34.472 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.468+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=20,config=2,health=13,kv=11,logm=54} crc {auth=681522344,config=1618278320,health=1009219655,kv=1564860262,logm=1373651340}) 2026-02-13T20:25:34.473 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.468+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.473 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.468+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=147308417}) 2026-02-13T20:25:34.473 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.468+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3295783837}) 2026-02-13T20:25:34.473 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.468+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.473 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.468+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=147308417}) 2026-02-13T20:25:34.473 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.469+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3150682530}) 2026-02-13T20:25:34.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.469+0000 7f228bd0c640 1 -- 10.20.193.110:0/2100728739 >> v1:10.20.193.188:6812/1623052694 conn(0x7f225403fb00 legacy=0x7f225405ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:34.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.469+0000 7f228bd0c640 10 monclient: shutdown 2026-02-13T20:25:34.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.469+0000 7f228bd0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:25:34.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.469+0000 7f228bd0c640 1 -- 10.20.193.110:0/2100728739 >> v1:10.20.193.110:6790/0 conn(0x7f228405d050 legacy=0x7f2284193770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:34.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.469+0000 7f228bd0c640 1 -- 10.20.193.110:0/2100728739 shutdown_connections 2026-02-13T20:25:34.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.469+0000 7f228bd0c640 1 -- 10.20.193.110:0/2100728739 >> 10.20.193.110:0/2100728739 conn(0x7f2284093270 msgr2=0x7f228405ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:25:34.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.469+0000 7f228bd0c640 1 -- 10.20.193.110:0/2100728739 shutdown_connections 2026-02-13T20:25:34.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:34.469+0000 7f228bd0c640 1 -- 10.20.193.110:0/2100728739 wait complete. 2026-02-13T20:25:34.482 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.469+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.482 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.469+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2313319057}) 2026-02-13T20:25:34.482 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.469+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1769600450}) 2026-02-13T20:25:34.482 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.469+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.482 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.469+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2313319057}) 2026-02-13T20:25:34.483 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.469+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3910921996}) 2026-02-13T20:25:34.483 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.470+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.483 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.470+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4272738514}) 2026-02-13T20:25:34.483 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.470+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1768230129}) 2026-02-13T20:25:34.483 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.470+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.483 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.470+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4272738514}) 2026-02-13T20:25:34.483 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.470+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1006176652}) 2026-02-13T20:25:34.483 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.470+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.483 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.470+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=411280762}) 2026-02-13T20:25:34.483 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.470+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1520272970}) 2026-02-13T20:25:34.483 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.470+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.483 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.470+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=411280762}) 2026-02-13T20:25:34.484 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.470+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3571533130}) 2026-02-13T20:25:34.484 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.471+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.484 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.471+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4028860714}) 2026-02-13T20:25:34.484 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.471+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1119405735}) 2026-02-13T20:25:34.484 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.471+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.484 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.471+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4028860714}) 2026-02-13T20:25:34.484 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.471+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=474195467}) 2026-02-13T20:25:34.484 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.471+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.484 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.471+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4048690543}) 2026-02-13T20:25:34.484 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.471+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=734767842}) 2026-02-13T20:25:34.484 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.471+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.484 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.471+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4048690543}) 2026-02-13T20:25:34.485 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.471+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3213629378}) 2026-02-13T20:25:34.485 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.471+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.485 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.471+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2708769858}) 2026-02-13T20:25:34.485 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.471+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3003360557}) 2026-02-13T20:25:34.485 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.471+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.485 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.471+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2708769858}) 2026-02-13T20:25:34.485 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.471+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3647059813}) 2026-02-13T20:25:34.485 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.472+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.485 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.472+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2897628617}) 2026-02-13T20:25:34.486 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.472+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2355492609}) 2026-02-13T20:25:34.486 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.472+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.486 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.472+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2897628617}) 2026-02-13T20:25:34.486 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.472+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1989597599}) 2026-02-13T20:25:34.486 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.472+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.486 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.472+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4175772933}) 2026-02-13T20:25:34.486 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.472+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3859958282}) 2026-02-13T20:25:34.486 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.472+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.486 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.472+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4175772933}) 2026-02-13T20:25:34.486 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.472+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=270940591}) 2026-02-13T20:25:34.486 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.473+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.486 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.473+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3792966909}) 2026-02-13T20:25:34.487 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.473+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2532458395}) 2026-02-13T20:25:34.487 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.473+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.487 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.473+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3792966909}) 2026-02-13T20:25:34.487 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.473+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1623474432}) 2026-02-13T20:25:34.487 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.473+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.487 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.473+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3522537592}) 2026-02-13T20:25:34.487 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.473+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3949780862}) 2026-02-13T20:25:34.487 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.473+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.487 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.473+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3522537592}) 2026-02-13T20:25:34.487 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.473+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2314502482}) 2026-02-13T20:25:34.487 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.473+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.487 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.473+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1508565960}) 2026-02-13T20:25:34.488 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.473+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=616362184}) 2026-02-13T20:25:34.488 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.473+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.488 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.473+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1508565960}) 2026-02-13T20:25:34.488 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.473+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=537819600}) 2026-02-13T20:25:34.488 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.474+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.488 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.474+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=694337962}) 2026-02-13T20:25:34.488 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.474+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=500535362}) 2026-02-13T20:25:34.488 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.474+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.488 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.474+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=694337962}) 2026-02-13T20:25:34.488 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.474+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3768189748}) 2026-02-13T20:25:34.488 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.474+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.488 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.474+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3732863714}) 2026-02-13T20:25:34.489 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.474+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1718237546}) 2026-02-13T20:25:34.489 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.474+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.489 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.474+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3732863714}) 2026-02-13T20:25:34.489 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.474+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4194043899}) 2026-02-13T20:25:34.489 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.475+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.489 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.475+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=789278391}) 2026-02-13T20:25:34.489 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.475+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=394238399}) 2026-02-13T20:25:34.489 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.475+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.489 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.475+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=789278391}) 2026-02-13T20:25:34.489 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.475+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4007974525}) 2026-02-13T20:25:34.489 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.475+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.489 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.475+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2216965021}) 2026-02-13T20:25:34.490 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.475+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=818479775}) 2026-02-13T20:25:34.490 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.475+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.490 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.475+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2216965021}) 2026-02-13T20:25:34.490 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.475+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4268639494}) 2026-02-13T20:25:34.490 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.475+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.490 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.475+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1311372099}) 2026-02-13T20:25:34.490 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.475+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2246732371}) 2026-02-13T20:25:34.490 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.475+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.490 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.475+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1311372099}) 2026-02-13T20:25:34.490 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.475+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=240466429}) 2026-02-13T20:25:34.490 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.476+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.490 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.476+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1454385151}) 2026-02-13T20:25:34.490 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.476+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3333025379}) 2026-02-13T20:25:34.491 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.476+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.491 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.476+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1454385151}) 2026-02-13T20:25:34.491 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.476+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1874880224}) 2026-02-13T20:25:34.491 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.476+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.491 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.476+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1944231210}) 2026-02-13T20:25:34.491 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.476+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3559636617}) 2026-02-13T20:25:34.491 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.476+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.491 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.476+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1944231210}) 2026-02-13T20:25:34.491 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.476+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3965517585}) 2026-02-13T20:25:34.492 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-13T20:25:34.494 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2402575 2026-02-13T20:25:34.502 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.477+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.502 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.477+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1992873267}) 2026-02-13T20:25:34.503 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.477+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=48714757}) 2026-02-13T20:25:34.503 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.477+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.503 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.477+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1992873267}) 2026-02-13T20:25:34.503 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.477+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2492613566}) 2026-02-13T20:25:34.503 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.477+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.503 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.477+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1351767722}) 2026-02-13T20:25:34.503 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.477+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2817519938}) 2026-02-13T20:25:34.503 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.477+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.503 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.477+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1351767722}) 2026-02-13T20:25:34.503 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.477+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3505266098}) 2026-02-13T20:25:34.503 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.478+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.503 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.478+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1298221484}) 2026-02-13T20:25:34.504 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.478+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1441675832}) 2026-02-13T20:25:34.504 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.478+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.504 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.478+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1298221484}) 2026-02-13T20:25:34.504 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.478+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2714236411}) 2026-02-13T20:25:34.504 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.478+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.504 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.478+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4194987305}) 2026-02-13T20:25:34.504 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.478+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3348499473}) 2026-02-13T20:25:34.504 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.478+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.504 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.478+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4194987305}) 2026-02-13T20:25:34.504 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.478+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1357941766}) 2026-02-13T20:25:34.504 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.479+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.504 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.479+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1643818195}) 2026-02-13T20:25:34.504 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.479+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4173972903}) 2026-02-13T20:25:34.504 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.479+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.504 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.479+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1643818195}) 2026-02-13T20:25:34.505 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.479+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3993986783}) 2026-02-13T20:25:34.505 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.479+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.505 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.479+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=735841061}) 2026-02-13T20:25:34.505 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.479+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=119286668}) 2026-02-13T20:25:34.505 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.479+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.505 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.479+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=735841061}) 2026-02-13T20:25:34.505 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.479+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3526942363}) 2026-02-13T20:25:34.505 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.479+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.505 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.479+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=993248917}) 2026-02-13T20:25:34.505 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.479+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4203183589}) 2026-02-13T20:25:34.505 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.479+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.505 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.479+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=993248917}) 2026-02-13T20:25:34.505 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.479+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=703244408}) 2026-02-13T20:25:34.506 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.480+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.506 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.480+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3001948014}) 2026-02-13T20:25:34.506 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.480+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1165902490}) 2026-02-13T20:25:34.506 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.480+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.506 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.480+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3001948014}) 2026-02-13T20:25:34.506 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.480+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3051202114}) 2026-02-13T20:25:34.506 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.480+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.506 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.480+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2628905780}) 2026-02-13T20:25:34.506 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.480+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2644104043}) 2026-02-13T20:25:34.506 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.480+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.506 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.480+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2628905780}) 2026-02-13T20:25:34.506 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.480+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=499793739}) 2026-02-13T20:25:34.506 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.481+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.506 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.481+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=37,mdsmap=2,mgr=7,mgr_command_descs=1,mgrstat=8,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=24} crc {logm=126173855,mdsmap=3827184867,mgr=4192473933,mgr_command_descs=714296370,mgrstat=3486412421,mon_config_key=2718569267,monmap=207866894,nvmeofgw=3360707892,osd_metadata=3198298551,osd_pg_creating=407488823,osd_snap=1008453828}) 2026-02-13T20:25:34.506 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.481+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=43,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=9,monmap=2,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=14} crc {logm=3389937902,mdsmap=3740562891,mgr=2881591710,mgr_command_descs=714296370,mgr_metadata=2819730505,mgrstat=4105043817,mon_config_key=1317016591,monmap=2677135861,nvmeofgw=3360707892,osd_metadata=91123727,osd_pg_creating=407488823,osd_snap=4080561908}) 2026-02-13T20:25:34.506 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.481+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.507 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.481+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=37,mdsmap=2,mgr=7,mgr_command_descs=1,mgrstat=8,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=24} crc {logm=126173855,mdsmap=3827184867,mgr=4192473933,mgr_command_descs=714296370,mgrstat=3486412421,mon_config_key=2718569267,monmap=207866894,nvmeofgw=3360707892,osd_metadata=3198298551,osd_pg_creating=407488823,osd_snap=1008453828}) 2026-02-13T20:25:34.507 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.481+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=43,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=13} crc {logm=2510543602,mdsmap=3827184867,mgr=2881591710,mgr_command_descs=714296370,mgr_metadata=2819730505,mgrstat=4105043817,mon_config_key=3180865086,monmap=207866894,nvmeofgw=3360707892,osd_metadata=91123727,osd_pg_creating=407488823,osd_snap=2006647573}) 2026-02-13T20:25:34.507 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.481+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.507 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.481+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=100} crc {osd_snap=1670432699}) 2026-02-13T20:25:34.507 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.481+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=100} crc {osd_snap=1067442652}) 2026-02-13T20:25:34.507 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.481+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.507 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.481+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=100} crc {osd_snap=1670432699}) 2026-02-13T20:25:34.507 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.481+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=100} crc {osd_snap=3451390499}) 2026-02-13T20:25:34.507 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.482+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.507 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.482+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=7,osdmap=93} crc {osd_snap=979946165,osdmap=3078460295}) 2026-02-13T20:25:34.507 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.482+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=7,osdmap=93} crc {osd_snap=2418572749,osdmap=762445743}) 2026-02-13T20:25:34.507 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.482+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.507 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.482+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=7,osdmap=93} crc {osd_snap=979946165,osdmap=3078460295}) 2026-02-13T20:25:34.507 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.482+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=8,osdmap=92} crc {osd_snap=736755658,osdmap=3417941622}) 2026-02-13T20:25:34.507 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.482+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.508 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.482+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1931107817}) 2026-02-13T20:25:34.508 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.482+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2908351393}) 2026-02-13T20:25:34.508 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.482+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.508 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.482+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1931107817}) 2026-02-13T20:25:34.508 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.482+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=945082528}) 2026-02-13T20:25:34.508 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.483+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.508 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.483+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1174333145}) 2026-02-13T20:25:34.508 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.483+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1251416681}) 2026-02-13T20:25:34.508 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.483+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.508 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.483+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1174333145}) 2026-02-13T20:25:34.508 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.483+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2331689227}) 2026-02-13T20:25:34.508 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.484+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.508 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.484+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3050476688}) 2026-02-13T20:25:34.508 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.484+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=583581111}) 2026-02-13T20:25:34.508 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.484+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.509 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.484+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3050476688}) 2026-02-13T20:25:34.509 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.484+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=4033929303}) 2026-02-13T20:25:34.509 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.484+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.509 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.484+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=52056692}) 2026-02-13T20:25:34.509 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.484+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2895527741}) 2026-02-13T20:25:34.509 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.484+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.509 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.484+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=52056692}) 2026-02-13T20:25:34.509 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.484+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1206181958}) 2026-02-13T20:25:34.509 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.485+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.509 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.485+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2029141340}) 2026-02-13T20:25:34.509 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.485+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3978427623}) 2026-02-13T20:25:34.509 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.485+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.509 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.485+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2029141340}) 2026-02-13T20:25:34.509 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.485+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2572662819}) 2026-02-13T20:25:34.509 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.485+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.509 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.485+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3720740450}) 2026-02-13T20:25:34.510 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.485+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3112565451}) 2026-02-13T20:25:34.510 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.485+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.510 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.485+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3720740450}) 2026-02-13T20:25:34.510 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.485+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=706857458}) 2026-02-13T20:25:34.510 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.486+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.510 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.486+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=520113084}) 2026-02-13T20:25:34.510 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.486+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3540911752}) 2026-02-13T20:25:34.510 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.486+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.510 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.486+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=520113084}) 2026-02-13T20:25:34.510 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.486+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2865245190}) 2026-02-13T20:25:34.510 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.487+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.510 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.487+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=4066381798}) 2026-02-13T20:25:34.510 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.487+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1128941034}) 2026-02-13T20:25:34.510 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.487+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.510 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.487+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=4066381798}) 2026-02-13T20:25:34.510 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.487+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1698035372}) 2026-02-13T20:25:34.511 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.489+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.511 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.489+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=92} crc {osdmap=1249637579}) 2026-02-13T20:25:34.511 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.489+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=91} crc {osdmap=2372734426}) 2026-02-13T20:25:34.511 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.489+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:25:34.511 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.489+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=92} crc {osdmap=1249637579}) 2026-02-13T20:25:34.511 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:25:34.489+0000 7f50907f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=92} crc {osdmap=4141843129}) 2026-02-13T20:25:34.513 INFO:tasks.rados.rados.0.trial188.stdout:3184: finishing copy_from racing read to trial18843701-1 2026-02-13T20:25:34.513 INFO:tasks.rados.rados.0.trial188.stdout:3183: finishing copy_from racing read to trial18843701-27 2026-02-13T20:25:34.513 INFO:tasks.rados.rados.0.trial188.stdout:3183: finishing copy_from to trial18843701-27 2026-02-13T20:25:34.513 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 27 v 1459 (ObjNum 1055 snap 315 seq_num 1055) dirty exists 2026-02-13T20:25:34.513 INFO:tasks.rados.rados.0.trial188.stdout:3178: finishing copy_from to trial18843701-2 2026-02-13T20:25:34.513 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 2 v 1463 (ObjNum 1060 snap 316 seq_num 1060) dirty exists 2026-02-13T20:25:34.513 INFO:tasks.rados.rados.0.trial188.stdout:3186: finishing write tid 1 to trial18843701-44 2026-02-13T20:25:34.513 INFO:tasks.rados.rados.0.trial188.stdout:3184: finishing copy_from to trial18843701-1 2026-02-13T20:25:34.513 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 1 v 1076 (ObjNum 998 snap 297 seq_num 998) dirty exists 2026-02-13T20:25:34.513 INFO:tasks.rados.rados.0.trial188.stdout:3186: finishing write tid 2 to trial18843701-44 2026-02-13T20:25:34.513 INFO:tasks.rados.rados.0.trial188.stdout:3178: done (10 left) 2026-02-13T20:25:34.513 INFO:tasks.rados.rados.0.trial188.stdout:3183: done (9 left) 2026-02-13T20:25:34.513 INFO:tasks.rados.rados.0.trial188.stdout:3184: done (8 left) 2026-02-13T20:25:34.514 INFO:tasks.rados.rados.0.trial188.stdout:3187: done (7 left) 2026-02-13T20:25:34.514 INFO:tasks.rados.rados.0.trial188.stdout:3188: done (6 left) 2026-02-13T20:25:34.514 INFO:tasks.rados.rados.0.trial188.stdout:3194: done (5 left) 2026-02-13T20:25:34.514 INFO:tasks.rados.rados.0.trial188.stdout:3195: copy_from oid 46 from oid 2 current snap is 326 2026-02-13T20:25:34.514 INFO:tasks.rados.rados.0.trial188.stdout:3186: finishing write tid 3 to trial18843701-44 2026-02-13T20:25:34.514 INFO:tasks.rados.rados.0.trial188.stdout:3186: finishing write tid 4 to trial18843701-44 2026-02-13T20:25:34.514 INFO:tasks.rados.rados.0.trial188.stdout:3186: oid 44 updating version 0 to 1497 2026-02-13T20:25:34.514 INFO:tasks.rados.rados.0.trial188.stdout:3186: oid 44 version 1497 is already newer than 1496 2026-02-13T20:25:34.514 INFO:tasks.rados.rados.0.trial188.stdout:3186: oid 44 updating version 1497 to 1498 2026-02-13T20:25:34.514 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 44 v 1498 (ObjNum 1100 snap 326 seq_num 1100) dirty exists 2026-02-13T20:25:34.514 INFO:tasks.rados.rados.0.trial188.stdout:3186: left oid 44 (ObjNum 1100 snap 326 seq_num 1100) 2026-02-13T20:25:34.514 INFO:tasks.rados.rados.0.trial188.stdout:3189: finishing copy_from racing read to trial18843701-40 2026-02-13T20:25:34.514 INFO:tasks.rados.rados.0.trial188.stdout:3189: finishing copy_from to trial18843701-40 2026-02-13T20:25:34.514 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 40 v 999 (ObjNum 1007 snap 299 seq_num 1007) dirty exists 2026-02-13T20:25:34.514 INFO:tasks.rados.rados.0.trial188.stdout:3191: finishing write tid 1 to trial18843701-42 2026-02-13T20:25:34.514 INFO:tasks.rados.rados.0.trial188.stdout:3191: finishing write tid 2 to trial18843701-42 2026-02-13T20:25:34.514 INFO:tasks.rados.rados.0.trial188.stdout:3191: finishing write tid 3 to trial18843701-42 2026-02-13T20:25:34.514 INFO:tasks.rados.rados.0.trial188.stdout:3191: finishing write tid 4 to trial18843701-42 2026-02-13T20:25:34.514 INFO:tasks.rados.rados.0.trial188.stdout:3192: finishing write tid 1 to trial18843701-33 2026-02-13T20:25:34.515 INFO:tasks.rados.rados.0.trial188.stdout:3192: finishing write tid 2 to trial18843701-33 2026-02-13T20:25:34.515 INFO:tasks.rados.rados.0.trial188.stdout:3191: finishing write tid 5 to trial18843701-42 2026-02-13T20:25:34.515 INFO:tasks.rados.rados.0.trial188.stdout:3191: oid 42 updating version 0 to 1426 2026-02-13T20:25:34.515 INFO:tasks.rados.rados.0.trial188.stdout:3191: oid 42 updating version 1426 to 1428 2026-02-13T20:25:34.515 INFO:tasks.rados.rados.0.trial188.stdout:3191: oid 42 version 1428 is already newer than 1425 2026-02-13T20:25:34.515 INFO:tasks.rados.rados.0.trial188.stdout:3191: oid 42 version 1428 is already newer than 1427 2026-02-13T20:25:34.515 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 42 v 1428 (ObjNum 1101 snap 326 seq_num 1101) dirty exists 2026-02-13T20:25:34.515 INFO:tasks.rados.rados.0.trial188.stdout:3191: left oid 42 (ObjNum 1101 snap 326 seq_num 1101) 2026-02-13T20:25:34.515 INFO:tasks.rados.rados.0.trial188.stdout:3193: finishing write tid 1 to trial18843701-4 2026-02-13T20:25:34.515 INFO:tasks.rados.rados.0.trial188.stdout:3193: finishing write tid 2 to trial18843701-4 2026-02-13T20:25:34.515 INFO:tasks.rados.rados.0.trial188.stdout:3193: finishing write tid 3 to trial18843701-4 2026-02-13T20:25:34.515 INFO:tasks.rados.rados.0.trial188.stdout:3193: finishing write tid 4 to trial18843701-4 2026-02-13T20:25:34.515 INFO:tasks.rados.rados.0.trial188.stdout:3193: oid 4 updating version 0 to 1546 2026-02-13T20:25:34.515 INFO:tasks.rados.rados.0.trial188.stdout:3193: oid 4 version 1546 is already newer than 1544 2026-02-13T20:25:34.515 INFO:tasks.rados.rados.0.trial188.stdout:3193: oid 4 version 1546 is already newer than 1545 2026-02-13T20:25:34.515 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 4 v 1546 (ObjNum 1103 snap 326 seq_num 1103) dirty exists 2026-02-13T20:25:34.515 INFO:tasks.rados.rados.0.trial188.stdout:3193: left oid 4 (ObjNum 1103 snap 326 seq_num 1103) 2026-02-13T20:25:34.515 INFO:tasks.rados.rados.0.trial188.stdout:3192: finishing write tid 3 to trial18843701-33 2026-02-13T20:25:34.515 INFO:tasks.rados.rados.0.trial188.stdout:3186: done (5 left) 2026-02-13T20:25:34.516 INFO:tasks.rados.rados.0.trial188.stdout:3189: done (4 left) 2026-02-13T20:25:34.516 INFO:tasks.rados.rados.0.trial188.stdout:3191: done (3 left) 2026-02-13T20:25:34.516 INFO:tasks.rados.rados.0.trial188.stdout:3193: done (2 left) 2026-02-13T20:25:34.516 INFO:tasks.rados.rados.0.trial188.stdout:3196: copy_from oid 5 from oid 9 current snap is 326 2026-02-13T20:25:34.516 INFO:tasks.rados.rados.0.trial188.stdout:3192: finishing write tid 4 to trial18843701-33 2026-02-13T20:25:34.516 INFO:tasks.rados.rados.0.trial188.stdout:3192: oid 33 updating version 0 to 1083 2026-02-13T20:25:34.516 INFO:tasks.rados.rados.0.trial188.stdout:3192: oid 33 version 1083 is already newer than 1082 2026-02-13T20:25:34.516 INFO:tasks.rados.rados.0.trial188.stdout:3192: oid 33 version 1083 is already newer than 1081 2026-02-13T20:25:34.516 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 33 v 1083 (ObjNum 1102 snap 326 seq_num 1102) dirty exists 2026-02-13T20:25:34.516 INFO:tasks.rados.rados.0.trial188.stdout:3192: left oid 33 (ObjNum 1102 snap 326 seq_num 1102) 2026-02-13T20:25:34.516 INFO:tasks.rados.rados.0.trial188.stdout:3192: done (2 left) 2026-02-13T20:25:34.516 INFO:tasks.rados.rados.0.trial188.stdout:3197: delete oid 48 current snap is 326 2026-02-13T20:25:34.516 INFO:tasks.rados.rados.0.trial188.stdout:3197: done (2 left) 2026-02-13T20:25:34.516 INFO:tasks.rados.rados.0.trial188.stdout:3198: write (excl) oid 1 current snap is 326 2026-02-13T20:25:34.516 INFO:tasks.rados.rados.0.trial188.stdout:3198: seq_num 1106 ranges {588542=496579,1620614=676719} 2026-02-13T20:25:34.516 INFO:tasks.rados.rados.0.trial188.stdout:3198: writing trial18843701-1 from 588542 to 1085121 tid 1 2026-02-13T20:25:34.517 INFO:tasks.rados.rados.0.trial188.stdout:3198: writing trial18843701-1 from 1620614 to 2297333 tid 2 2026-02-13T20:25:34.517 INFO:tasks.rados.rados.0.trial188.stdout:3199: read oid 12 snap -1 2026-02-13T20:25:34.517 INFO:tasks.rados.rados.0.trial188.stdout:3199: expect (ObjNum 865 snap 250 seq_num 865) 2026-02-13T20:25:34.517 INFO:tasks.rados.rados.0.trial188.stdout:3200: snap_create 2026-02-13T20:25:34.522 INFO:tasks.rados.rados.0.trial188.stdout:3199: expect (ObjNum 865 snap 250 seq_num 865) 2026-02-13T20:25:34.622 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:25:34.672 INFO:tasks.rados.rados.0.trial188.stdout:3196: finishing copy_from racing read to trial18843701-5 2026-02-13T20:25:34.672 INFO:tasks.rados.rados.0.trial188.stdout:3195: finishing copy_from racing read to trial18843701-46 2026-02-13T20:25:34.672 INFO:tasks.rados.rados.0.trial188.stdout:3196: finishing copy_from to trial18843701-5 2026-02-13T20:25:34.672 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 5 v 996 (ObjNum 1003 snap 299 seq_num 1003) dirty exists 2026-02-13T20:25:34.672 INFO:tasks.rados.rados.0.trial188.stdout:3198: finishing write tid 1 to trial18843701-1 2026-02-13T20:25:34.673 INFO:tasks.rados.rados.0.trial188.stdout:3198: finishing write tid 2 to trial18843701-1 2026-02-13T20:25:34.673 INFO:tasks.rados.rados.0.trial188.stdout:3198: finishing write tid 3 to trial18843701-1 2026-02-13T20:25:34.673 INFO:tasks.rados.rados.0.trial188.stdout:3198: finishing write tid 4 to trial18843701-1 2026-02-13T20:25:34.673 INFO:tasks.rados.rados.0.trial188.stdout:3198: oid 1 updating version 0 to 1501 2026-02-13T20:25:34.673 INFO:tasks.rados.rados.0.trial188.stdout:3198: oid 1 version 1501 is already newer than 1499 2026-02-13T20:25:34.673 INFO:tasks.rados.rados.0.trial188.stdout:3198: oid 1 version 1501 is already newer than 1500 2026-02-13T20:25:34.673 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 1 v 1501 (ObjNum 1106 snap 326 seq_num 1106) dirty exists 2026-02-13T20:25:34.673 INFO:tasks.rados.rados.0.trial188.stdout:3198: left oid 1 (ObjNum 1106 snap 326 seq_num 1106) 2026-02-13T20:25:34.673 INFO:tasks.rados.rados.0.trial188.stdout:3195: finishing copy_from to trial18843701-46 2026-02-13T20:25:34.673 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 46 v 1463 (ObjNum 1060 snap 316 seq_num 1060) dirty exists 2026-02-13T20:25:35.293 INFO:tasks.rados.rados.0.trial188.stdout:3195: done (4 left) 2026-02-13T20:25:35.293 INFO:tasks.rados.rados.0.trial188.stdout:3196: done (3 left) 2026-02-13T20:25:35.293 INFO:tasks.rados.rados.0.trial188.stdout:3198: done (2 left) 2026-02-13T20:25:35.293 INFO:tasks.rados.rados.0.trial188.stdout:3199: done (1 left) 2026-02-13T20:25:35.293 INFO:tasks.rados.rados.0.trial188.stdout:3200: done (0 left) 2026-02-13T20:25:35.293 INFO:tasks.rados.rados.0.trial188.stdout:3201: rollback oid 10 current snap is 327 2026-02-13T20:25:35.293 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 10 to 326 2026-02-13T20:25:35.293 INFO:tasks.rados.rados.0.trial188.stdout:3202: write (excl) oid 11 current snap is 327 2026-02-13T20:25:35.293 INFO:tasks.rados.rados.0.trial188.stdout:3202: seq_num 1107 ranges {605349=571828,1679096=420377} 2026-02-13T20:25:35.298 INFO:tasks.rados.rados.0.trial188.stdout:3202: writing trial18843701-11 from 605349 to 1177177 tid 1 2026-02-13T20:25:35.302 INFO:tasks.rados.rados.0.trial188.stdout:3202: writing trial18843701-11 from 1679096 to 2099473 tid 2 2026-02-13T20:25:35.302 INFO:tasks.rados.rados.0.trial188.stdout:3203: read oid 27 snap 326 2026-02-13T20:25:35.302 INFO:tasks.rados.rados.0.trial188.stdout:3203: expect (ObjNum 1055 snap 315 seq_num 1055) 2026-02-13T20:25:35.302 INFO:tasks.rados.rados.0.trial188.stdout:3204: rollback oid 44 current snap is 327 2026-02-13T20:25:35.302 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 44 to 326 2026-02-13T20:25:35.302 INFO:tasks.rados.rados.0.trial188.stdout:3201: finishing rollback tid 0 to trial18843701-10 2026-02-13T20:25:35.302 INFO:tasks.rados.rados.0.trial188.stdout:3201: finishing rollback tid 1 to trial18843701-10 2026-02-13T20:25:35.302 INFO:tasks.rados.rados.0.trial188.stdout:3201: finishing rollback tid 2 to trial18843701-10 2026-02-13T20:25:35.302 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 10 v 1549 (ObjNum 1020 snap 307 seq_num 1020) dirty exists 2026-02-13T20:25:35.302 INFO:tasks.rados.rados.0.trial188.stdout:3201: done (3 left) 2026-02-13T20:25:35.302 INFO:tasks.rados.rados.0.trial188.stdout:3205: write oid 39 current snap is 327 2026-02-13T20:25:35.303 INFO:tasks.rados.rados.0.trial188.stdout:3205: seq_num 1108 ranges {622156=647077,1737578=680388} 2026-02-13T20:25:35.306 INFO:tasks.rados.rados.0.trial188.stdout:3205: writing trial18843701-39 from 622156 to 1269233 tid 1 2026-02-13T20:25:35.311 INFO:tasks.rados.rados.0.trial188.stdout:3205: writing trial18843701-39 from 1737578 to 2417966 tid 2 2026-02-13T20:25:35.311 INFO:tasks.rados.rados.0.trial188.stdout:3206: snap_create 2026-02-13T20:25:35.311 INFO:tasks.rados.rados.0.trial188.stdout:3204: finishing rollback tid 0 to trial18843701-44 2026-02-13T20:25:35.311 INFO:tasks.rados.rados.0.trial188.stdout:3204: finishing rollback tid 1 to trial18843701-44 2026-02-13T20:25:35.311 INFO:tasks.rados.rados.0.trial188.stdout:3204: finishing rollback tid 2 to trial18843701-44 2026-02-13T20:25:35.311 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 44 v 1504 (ObjNum 1100 snap 326 seq_num 1100) dirty exists 2026-02-13T20:25:35.311 INFO:tasks.rados.rados.0.trial188.stdout:3203: expect (ObjNum 1055 snap 315 seq_num 1055) 2026-02-13T20:25:35.362 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1835073 2026-02-13T20:25:35.415 INFO:tasks.rados.rados.0.trial188.stdout:3202: finishing write tid 1 to trial18843701-11 2026-02-13T20:25:35.415 INFO:tasks.rados.rados.0.trial188.stdout:3202: finishing write tid 2 to trial18843701-11 2026-02-13T20:25:35.415 INFO:tasks.rados.rados.0.trial188.stdout:3202: finishing write tid 3 to trial18843701-11 2026-02-13T20:25:35.415 INFO:tasks.rados.rados.0.trial188.stdout:3202: finishing write tid 4 to trial18843701-11 2026-02-13T20:25:35.415 INFO:tasks.rados.rados.0.trial188.stdout:3202: oid 11 updating version 0 to 1552 2026-02-13T20:25:35.415 INFO:tasks.rados.rados.0.trial188.stdout:3202: oid 11 version 1552 is already newer than 1551 2026-02-13T20:25:35.415 INFO:tasks.rados.rados.0.trial188.stdout:3202: oid 11 version 1552 is already newer than 1550 2026-02-13T20:25:35.416 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 11 v 1552 (ObjNum 1107 snap 327 seq_num 1107) dirty exists 2026-02-13T20:25:35.416 INFO:tasks.rados.rados.0.trial188.stdout:3202: left oid 11 (ObjNum 1107 snap 327 seq_num 1107) 2026-02-13T20:25:35.416 INFO:tasks.rados.rados.0.trial188.stdout:3205: finishing write tid 1 to trial18843701-39 2026-02-13T20:25:35.416 INFO:tasks.rados.rados.0.trial188.stdout:3205: finishing write tid 2 to trial18843701-39 2026-02-13T20:25:35.416 INFO:tasks.rados.rados.0.trial188.stdout:3205: finishing write tid 3 to trial18843701-39 2026-02-13T20:25:35.416 INFO:tasks.rados.rados.0.trial188.stdout:3205: finishing write tid 4 to trial18843701-39 2026-02-13T20:25:35.416 INFO:tasks.rados.rados.0.trial188.stdout:3205: oid 39 updating version 0 to 1468 2026-02-13T20:25:35.416 INFO:tasks.rados.rados.0.trial188.stdout:3205: oid 39 version 1468 is already newer than 1467 2026-02-13T20:25:35.416 INFO:tasks.rados.rados.0.trial188.stdout:3205: oid 39 version 1468 is already newer than 1466 2026-02-13T20:25:35.416 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 39 v 1468 (ObjNum 1108 snap 327 seq_num 1108) dirty exists 2026-02-13T20:25:35.416 INFO:tasks.rados.rados.0.trial188.stdout:3205: left oid 39 (ObjNum 1108 snap 327 seq_num 1108) 2026-02-13T20:25:35.494 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-13T20:25:35.494 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T20:25:35.560 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.558+0000 7f34f450c640 10 monclient: get_monmap_and_config 2026-02-13T20:25:35.560 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.558+0000 7f34f450c640 10 monclient: build_initial_monmap 2026-02-13T20:25:35.560 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.558+0000 7f34f450c640 10 monclient: monmap: 2026-02-13T20:25:35.560 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:25:35.560 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:35.560 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:25:35.560057+0000 2026-02-13T20:25:35.560 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:25:35.560057+0000 2026-02-13T20:25:35.560 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:25:35.561 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:35.561 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:25:35.561 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:25:35.561 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:25:35.561 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:35.569 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.559+0000 7f34f450c640 1 Processor -- start 2026-02-13T20:25:35.569 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.559+0000 7f34f450c640 1 -- start start 2026-02-13T20:25:35.569 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.559+0000 7f34f450c640 10 monclient: init 2026-02-13T20:25:35.570 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.559+0000 7f34f450c640 10 monclient: _reopen_session rank -1 2026-02-13T20:25:35.570 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.559+0000 7f34f450c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:25:35.570 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.559+0000 7f34f450c640 10 monclient(hunting): picked mon.noname-c con 0x7f34ec1401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:25:35.570 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.559+0000 7f34f450c640 10 monclient(hunting): picked mon.noname-a con 0x7f34ec092020 addr v1:10.20.193.110:6789/0 2026-02-13T20:25:35.570 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.559+0000 7f34f450c640 10 monclient(hunting): picked mon.noname-b con 0x7f34ec091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:25:35.570 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.559+0000 7f34f450c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34ec08b730 con 0x7f34ec092020 2026-02-13T20:25:35.570 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.559+0000 7f34f450c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34ec05c5b0 con 0x7f34ec1401c0 2026-02-13T20:25:35.570 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.559+0000 7f34f450c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34ec08bcf0 con 0x7f34ec091950 2026-02-13T20:25:35.570 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.559+0000 7f34f450c640 10 monclient(hunting): _renew_subs 2026-02-13T20:25:35.570 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.559+0000 7f34f450c640 10 monclient(hunting): authenticate will time out at 1497.250454s 2026-02-13T20:25:35.570 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.559+0000 7f34f1a80640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f34ec092020 0x7f34ec1812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:48066/0 (socket says 10.20.193.110:48066) 2026-02-13T20:25:35.571 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.559+0000 7f34f1a80640 1 -- 10.20.193.110:0/2214565752 learned_addr learned my addr 10.20.193.110:0/2214565752 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:25:35.571 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.559+0000 7f34f127f640 1 -- 10.20.193.110:0/2214565752 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3601584283 0 0) 0x7f34ec08b730 con 0x7f34ec092020 2026-02-13T20:25:35.571 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.559+0000 7f34f127f640 10 monclient(hunting): _negotiate 2026-02-13T20:25:35.571 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.559+0000 7f34f127f640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:35.571 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.559+0000 7f34f127f640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:35.571 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.559+0000 7f34f127f640 10 monclient(hunting): my global_id is 124320 2026-02-13T20:25:35.571 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.559+0000 7f34f127f640 1 -- 10.20.193.110:0/2214565752 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34d40035e0 con 0x7f34ec092020 2026-02-13T20:25:35.571 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.559+0000 7f34f127f640 1 -- 10.20.193.110:0/2214565752 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2756756936 0 0) 0x7f34ec08bcf0 con 0x7f34ec091950 2026-02-13T20:25:35.571 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.559+0000 7f34f127f640 10 monclient(hunting): _negotiate 2026-02-13T20:25:35.571 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.559+0000 7f34f127f640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:35.571 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.559+0000 7f34f127f640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:35.572 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.559+0000 7f34f127f640 10 monclient(hunting): my global_id is 94625 2026-02-13T20:25:35.572 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.559+0000 7f34f127f640 1 -- 10.20.193.110:0/2214565752 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34ec08b730 con 0x7f34ec091950 2026-02-13T20:25:35.572 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.559+0000 7f34f127f640 1 -- 10.20.193.110:0/2214565752 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2518485958 0 0) 0x7f34d40035e0 con 0x7f34ec092020 2026-02-13T20:25:35.572 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.559+0000 7f34f127f640 1 -- 10.20.193.110:0/2214565752 >> v1:10.20.193.110:6790/0 conn(0x7f34ec091950 legacy=0x7f34ec1a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:35.572 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.560+0000 7f34f127f640 1 -- 10.20.193.110:0/2214565752 >> v1:10.20.193.188:6789/0 conn(0x7f34ec1401c0 legacy=0x7f34ec091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T20:25:35.572 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.560+0000 7f34f127f640 10 monclient: _finish_hunting 0 2026-02-13T20:25:35.572 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.560+0000 7f34f127f640 1 monclient: found mon.noname-a 2026-02-13T20:25:35.572 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.560+0000 7f34f127f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:25:35.572 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.560+0000 7f34f127f640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:25:35.572 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.560+0000 7f34f127f640 1 -- 10.20.193.110:0/2214565752 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34ec140590 con 0x7f34ec092020 2026-02-13T20:25:35.572 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.560+0000 7f34f127f640 10 monclient: _finish_auth 0 2026-02-13T20:25:35.573 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.560+0000 7f34f127f640 10 monclient: _check_auth_tickets 2026-02-13T20:25:35.573 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.560+0000 7f34f127f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:25:35.573 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.560+0000 7f34f127f640 1 -- 10.20.193.110:0/2214565752 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f34e0002dd0 con 0x7f34ec092020 2026-02-13T20:25:35.573 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.560+0000 7f34f450c640 5 monclient: authenticate success, global_id 124320 2026-02-13T20:25:35.573 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.560+0000 7f34f450c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:25:35.573 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.560+0000 7f34f127f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:35.573 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.560+0000 7f34f127f640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:25:35.573 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.560+0000 7f34f127f640 10 monclient: dump: 2026-02-13T20:25:35.573 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:35.573 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:35.573 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:35.573 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:35.574 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:35.574 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:35.574 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:35.574 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:35.574 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:35.574 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:35.574 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.560+0000 7f34f450c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:25:35.574 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.560+0000 7f34f127f640 1 -- 10.20.193.110:0/2214565752 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f34e0002f60 con 0x7f34ec092020 2026-02-13T20:25:35.574 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.560+0000 7f34f127f640 10 monclient: handle_config config(0 keys) 2026-02-13T20:25:35.574 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.560+0000 7f34f450c640 10 monclient: get_monmap_and_config success 2026-02-13T20:25:35.574 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.560+0000 7f34f450c640 4 set_mon_vals no callback set 2026-02-13T20:25:35.575 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.560+0000 7f34f127f640 1 -- 10.20.193.110:0/2214565752 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f34e0003370 con 0x7f34ec092020 2026-02-13T20:25:35.575 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.560+0000 7f34f127f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:35.575 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.560+0000 7f34f127f640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:25:35.575 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.560+0000 7f34f127f640 10 monclient: dump: 2026-02-13T20:25:35.575 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:35.575 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:35.575 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:35.575 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:35.575 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:35.575 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:35.575 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:35.575 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:35.576 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:35.576 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:35.576 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.560+0000 7f34f450c640 10 monclient: shutdown 2026-02-13T20:25:35.576 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.560+0000 7f34f450c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:25:35.576 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.560+0000 7f34f450c640 1 -- 10.20.193.110:0/2214565752 >> v1:10.20.193.110:6789/0 conn(0x7f34ec092020 legacy=0x7f34ec1812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:35.576 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.560+0000 7f34f450c640 1 -- 10.20.193.110:0/2214565752 shutdown_connections 2026-02-13T20:25:35.576 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.560+0000 7f34f450c640 1 -- 10.20.193.110:0/2214565752 >> 10.20.193.110:0/2214565752 conn(0x7f34ec054e90 msgr2=0x7f34ec058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:25:35.576 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.560+0000 7f34f450c640 1 -- 10.20.193.110:0/2214565752 shutdown_connections 2026-02-13T20:25:35.576 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.560+0000 7f34f450c640 1 -- 10.20.193.110:0/2214565752 wait complete. 2026-02-13T20:25:35.576 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.560+0000 7f34f450c640 10 monclient: build_initial_monmap 2026-02-13T20:25:35.576 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.560+0000 7f34f450c640 10 monclient: monmap: 2026-02-13T20:25:35.576 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:25:35.577 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:25:35.577 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:25:35.577 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:25:35.577 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:25:35.577 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:25:35.577 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:25:35.577 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:25:35.577 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:25:35.577 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:35.577 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34f450c640 1 Processor -- start 2026-02-13T20:25:35.577 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34f450c640 1 -- start start 2026-02-13T20:25:35.578 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34f450c640 10 monclient: init 2026-02-13T20:25:35.578 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34f450c640 10 monclient: _reopen_session rank -1 2026-02-13T20:25:35.578 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34f450c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:25:35.578 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34f450c640 10 monclient(hunting): picked mon.noname-a con 0x7f34ec091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:25:35.578 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34f450c640 10 monclient(hunting): picked mon.noname-b con 0x7f34ec1401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:25:35.578 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34f450c640 10 monclient(hunting): picked mon.noname-c con 0x7f34ec1502e0 addr v1:10.20.193.110:6790/0 2026-02-13T20:25:35.578 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34f450c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34ec12e8e0 con 0x7f34ec091950 2026-02-13T20:25:35.578 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34f450c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34ec090d20 con 0x7f34ec1401c0 2026-02-13T20:25:35.578 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34f450c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34ec13fa90 con 0x7f34ec1502e0 2026-02-13T20:25:35.579 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34f450c640 10 monclient(hunting): _renew_subs 2026-02-13T20:25:35.579 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34f450c640 10 monclient(hunting): authenticate will time out at 1497.252323s 2026-02-13T20:25:35.579 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34f2281640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f34ec091950 0x7f34ec13e6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:48082/0 (socket says 10.20.193.110:48082) 2026-02-13T20:25:35.579 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34f2281640 1 -- 10.20.193.110:0/2160353149 learned_addr learned my addr 10.20.193.110:0/2160353149 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:25:35.579 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34d2ffd640 1 -- 10.20.193.110:0/2160353149 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 772797350 0 0) 0x7f34ec13fa90 con 0x7f34ec1502e0 2026-02-13T20:25:35.579 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34d2ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:25:35.579 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34d2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:35.579 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34d2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:35.579 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34d2ffd640 10 monclient(hunting): my global_id is 94628 2026-02-13T20:25:35.579 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34d2ffd640 1 -- 10.20.193.110:0/2160353149 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34bc0035e0 con 0x7f34ec1502e0 2026-02-13T20:25:35.579 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34d2ffd640 1 -- 10.20.193.110:0/2160353149 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2931513855 0 0) 0x7f34ec12e8e0 con 0x7f34ec091950 2026-02-13T20:25:35.580 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34d2ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:25:35.580 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34d2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:35.580 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34d2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:35.580 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34d2ffd640 10 monclient(hunting): my global_id is 124323 2026-02-13T20:25:35.580 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34d2ffd640 1 -- 10.20.193.110:0/2160353149 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34ec13fa90 con 0x7f34ec091950 2026-02-13T20:25:35.580 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34d2ffd640 1 -- 10.20.193.110:0/2160353149 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 24711673 0 0) 0x7f34bc0035e0 con 0x7f34ec1502e0 2026-02-13T20:25:35.580 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34d2ffd640 1 -- 10.20.193.110:0/2160353149 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f34ec12e8e0 con 0x7f34ec1502e0 2026-02-13T20:25:35.580 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34d2ffd640 1 -- 10.20.193.110:0/2160353149 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f34e8004250 con 0x7f34ec1502e0 2026-02-13T20:25:35.580 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34d2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:25:35.580 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34d2ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:25:35.580 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34d2ffd640 10 monclient(hunting): dump: 2026-02-13T20:25:35.580 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:35.581 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:35.581 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:35.581 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:35.581 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:35.581 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:35.581 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:35.581 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:35.581 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:35.581 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:35.581 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34d2ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:25:35.581 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34d2ffd640 1 -- 10.20.193.110:0/2160353149 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2622033327 0 0) 0x7f34ec13fa90 con 0x7f34ec091950 2026-02-13T20:25:35.581 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34d2ffd640 1 -- 10.20.193.110:0/2160353149 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f34bc0035e0 con 0x7f34ec091950 2026-02-13T20:25:35.581 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34d2ffd640 1 -- 10.20.193.110:0/2160353149 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f34dc004030 con 0x7f34ec091950 2026-02-13T20:25:35.582 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34d2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:25:35.582 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34d2ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:25:35.582 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34d2ffd640 10 monclient(hunting): dump: 2026-02-13T20:25:35.582 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:35.582 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:35.582 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:35.582 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:35.582 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:35.582 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:35.582 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:35.582 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:35.582 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:35.582 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:35.583 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34d2ffd640 1 -- 10.20.193.110:0/2160353149 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2959290749 0 0) 0x7f34ec12e8e0 con 0x7f34ec1502e0 2026-02-13T20:25:35.583 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34d2ffd640 1 -- 10.20.193.110:0/2160353149 >> v1:10.20.193.188:6789/0 conn(0x7f34ec1401c0 legacy=0x7f34ec191640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:35.583 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34d2ffd640 1 -- 10.20.193.110:0/2160353149 >> v1:10.20.193.110:6789/0 conn(0x7f34ec091950 legacy=0x7f34ec13e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:35.583 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34d2ffd640 10 monclient: _finish_hunting 0 2026-02-13T20:25:35.583 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34d2ffd640 1 monclient: found mon.c 2026-02-13T20:25:35.583 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34d2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:25:35.583 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34d2ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:25:35.583 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34d2ffd640 1 -- 10.20.193.110:0/2160353149 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34ec12fe00 con 0x7f34ec1502e0 2026-02-13T20:25:35.583 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34d2ffd640 10 monclient: _finish_auth 0 2026-02-13T20:25:35.583 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34d2ffd640 10 monclient: _check_auth_tickets 2026-02-13T20:25:35.583 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34d2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:25:35.584 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34f450c640 5 monclient: authenticate success, global_id 94628 2026-02-13T20:25:35.584 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34f450c640 10 monclient: _renew_subs 2026-02-13T20:25:35.584 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34f450c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:25:35.584 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34f450c640 1 -- 10.20.193.110:0/2160353149 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f34ec13edd0 con 0x7f34ec1502e0 2026-02-13T20:25:35.584 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34f450c640 10 monclient: _renew_subs 2026-02-13T20:25:35.584 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34f450c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:25:35.584 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34f450c640 1 -- 10.20.193.110:0/2160353149 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f34ec1300e0 con 0x7f34ec1502e0 2026-02-13T20:25:35.584 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34d2ffd640 1 -- 10.20.193.110:0/2160353149 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f34e8003880 con 0x7f34ec1502e0 2026-02-13T20:25:35.584 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34d2ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:25:35.584 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34d2ffd640 1 -- 10.20.193.110:0/2160353149 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f34e80048d0 con 0x7f34ec1502e0 2026-02-13T20:25:35.584 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:35.584 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34d2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:25:35.585 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34d2ffd640 10 monclient: dump: 2026-02-13T20:25:35.585 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:35.585 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:35.585 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:35.585 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:35.585 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:35.585 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:35.585 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:35.585 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:35.585 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:35.585 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:35.585 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.561+0000 7f34f0a7e640 4 set_mon_vals no callback set 2026-02-13T20:25:35.585 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.562+0000 7f34f450c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:25:35.586 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.562+0000 7f34f450c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:25:35.586 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.562+0000 7f34f450c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:25:35.586 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.562+0000 7f34f450c640 1 -- 10.20.193.110:0/2160353149 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34ec0008d0 con 0x7f34ec1502e0 2026-02-13T20:25:35.586 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.562+0000 7f34d2ffd640 1 -- 10.20.193.110:0/2160353149 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f34e8004a30 con 0x7f34ec1502e0 2026-02-13T20:25:35.586 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.562+0000 7f34d2ffd640 1 -- 10.20.193.110:0/2160353149 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(680..680 src has 1..680) ==== 3899+0+0 (unknown 3290828237 0 0) 0x7f34e804e5d0 con 0x7f34ec1502e0 2026-02-13T20:25:35.586 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.562+0000 7f34f2281640 10 monclient: get_auth_request con 0x7f34bc03faa0 auth_method 0 2026-02-13T20:25:35.586 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.564+0000 7f34d2ffd640 1 -- 10.20.193.110:0/2160353149 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f34e80061d0 con 0x7f34ec1502e0 2026-02-13T20:25:35.586 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.564+0000 7f34d2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:25:35.586 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.564+0000 7f34d2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:25:35.711 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.708+0000 7f34f450c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T20:25:35.711 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.708+0000 7f34f450c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T20:25:35.711 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.708+0000 7f34f450c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:25:35.711 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.708+0000 7f34f450c640 1 -- 10.20.193.110:0/2160353149 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f34ec1510c0 con 0x7f34ec1502e0 2026-02-13T20:25:35.711 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.709+0000 7f34d2ffd640 1 -- 10.20.193.110:0/2160353149 <== mon.2 v1:10.20.193.110:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 158308019) 0x7f34e8014dd0 con 0x7f34ec1502e0 2026-02-13T20:25:35.711 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.709+0000 7f34d2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T20:25:35.711 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.709+0000 7f34d2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:25:35.712 INFO:teuthology.orchestra.run.trial110.stdout:{"election_epoch":52,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","modified":"2026-02-13T20:11:07.161192Z","created":"2026-02-13T20:11:07.161192Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6789","nonce":0}]},"addr":"10.20.193.110:6789/0","public_addr":"10.20.193.110:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161241+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6789","nonce":0}]},"addr":"10.20.193.188:6789/0","public_addr":"10.20.193.188:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161242+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6790","nonce":0}]},"addr":"10.20.193.110:6790/0","public_addr":"10.20.193.110:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161243+0000","crush_location":[]}]}} 2026-02-13T20:25:35.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.710+0000 7f34f450c640 1 -- 10.20.193.110:0/2160353149 >> v1:10.20.193.188:6812/1623052694 conn(0x7f34bc03faa0 legacy=0x7f34bc05ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:35.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.710+0000 7f34f450c640 10 monclient: shutdown 2026-02-13T20:25:35.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.710+0000 7f34f450c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:25:35.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.710+0000 7f34f450c640 1 -- 10.20.193.110:0/2160353149 >> v1:10.20.193.110:6790/0 conn(0x7f34ec1502e0 legacy=0x7f34ec192d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:35.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.710+0000 7f34f450c640 1 -- 10.20.193.110:0/2160353149 shutdown_connections 2026-02-13T20:25:35.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.710+0000 7f34f450c640 1 -- 10.20.193.110:0/2160353149 >> 10.20.193.110:0/2160353149 conn(0x7f34ec054e90 msgr2=0x7f34ec08db70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:25:35.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.710+0000 7f34f450c640 1 -- 10.20.193.110:0/2160353149 shutdown_connections 2026-02-13T20:25:35.713 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.710+0000 7f34f450c640 1 -- 10.20.193.110:0/2160353149 wait complete. 2026-02-13T20:25:35.719 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-13T20:25:35.719 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-13T20:25:35.719 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-13T20:25:35.719 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T20:25:35.798 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.785+0000 7f99d141b640 10 monclient: get_monmap_and_config 2026-02-13T20:25:35.798 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.785+0000 7f99d141b640 10 monclient: build_initial_monmap 2026-02-13T20:25:35.799 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.785+0000 7f99d141b640 10 monclient: monmap: 2026-02-13T20:25:35.799 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:25:35.799 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:35.799 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:25:35.787286+0000 2026-02-13T20:25:35.799 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:25:35.787286+0000 2026-02-13T20:25:35.799 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:25:35.799 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:35.799 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:25:35.799 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:25:35.800 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:25:35.800 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:35.800 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.786+0000 7f99d141b640 1 Processor -- start 2026-02-13T20:25:35.800 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.786+0000 7f99d141b640 1 -- start start 2026-02-13T20:25:35.800 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.786+0000 7f99d141b640 10 monclient: init 2026-02-13T20:25:35.800 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.786+0000 7f99d141b640 10 monclient: _reopen_session rank -1 2026-02-13T20:25:35.800 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.786+0000 7f99d141b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:25:35.800 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.786+0000 7f99d141b640 10 monclient(hunting): picked mon.noname-a con 0x7f99cc1401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:25:35.800 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.786+0000 7f99d141b640 10 monclient(hunting): picked mon.noname-b con 0x7f99cc092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:25:35.800 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.786+0000 7f99d141b640 10 monclient(hunting): picked mon.noname-c con 0x7f99cc091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:25:35.801 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.786+0000 7f99d141b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99cc08b730 con 0x7f99cc1401c0 2026-02-13T20:25:35.801 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.786+0000 7f99d141b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99cc05c5b0 con 0x7f99cc091950 2026-02-13T20:25:35.801 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.786+0000 7f99d141b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99cc08bcf0 con 0x7f99cc092020 2026-02-13T20:25:35.801 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.786+0000 7f99d141b640 10 monclient(hunting): _renew_subs 2026-02-13T20:25:35.801 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.786+0000 7f99d141b640 10 monclient(hunting): authenticate will time out at 1497.477649s 2026-02-13T20:25:35.801 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.786+0000 7f99caffd640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f99cc1401c0 0x7f99cc091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:48086/0 (socket says 10.20.193.110:48086) 2026-02-13T20:25:35.801 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.786+0000 7f99caffd640 1 -- 10.20.193.110:0/2871515571 learned_addr learned my addr 10.20.193.110:0/2871515571 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:25:35.801 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.786+0000 7f99c9ffb640 1 -- 10.20.193.110:0/2871515571 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3424033803 0 0) 0x7f99cc08b730 con 0x7f99cc1401c0 2026-02-13T20:25:35.801 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.786+0000 7f99c9ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:25:35.801 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.786+0000 7f99c9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:35.801 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.786+0000 7f99c9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:35.802 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.786+0000 7f99c9ffb640 10 monclient(hunting): my global_id is 124326 2026-02-13T20:25:35.802 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.786+0000 7f99c9ffb640 1 -- 10.20.193.110:0/2871515571 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99b80035e0 con 0x7f99cc1401c0 2026-02-13T20:25:35.802 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.786+0000 7f99c9ffb640 1 -- 10.20.193.110:0/2871515571 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4169761930 0 0) 0x7f99cc08bcf0 con 0x7f99cc092020 2026-02-13T20:25:35.802 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.786+0000 7f99c9ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:25:35.802 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.786+0000 7f99c9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:35.802 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.786+0000 7f99c9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:35.802 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.786+0000 7f99c9ffb640 10 monclient(hunting): my global_id is 94631 2026-02-13T20:25:35.802 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.786+0000 7f99c9ffb640 1 -- 10.20.193.110:0/2871515571 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99cc08b730 con 0x7f99cc092020 2026-02-13T20:25:35.802 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.787+0000 7f99c9ffb640 1 -- 10.20.193.110:0/2871515571 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2525725556 0 0) 0x7f99b80035e0 con 0x7f99cc1401c0 2026-02-13T20:25:35.802 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.787+0000 7f99c9ffb640 1 -- 10.20.193.110:0/2871515571 >> v1:10.20.193.110:6790/0 conn(0x7f99cc092020 legacy=0x7f99cc1812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:35.802 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.787+0000 7f99c9ffb640 1 -- 10.20.193.110:0/2871515571 >> v1:10.20.193.188:6789/0 conn(0x7f99cc091950 legacy=0x7f99cc1a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:35.803 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.787+0000 7f99c9ffb640 10 monclient: _finish_hunting 0 2026-02-13T20:25:35.803 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.787+0000 7f99c9ffb640 1 monclient: found mon.noname-a 2026-02-13T20:25:35.803 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.787+0000 7f99c9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:25:35.803 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.787+0000 7f99c9ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:25:35.803 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.787+0000 7f99c9ffb640 1 -- 10.20.193.110:0/2871515571 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99cc140590 con 0x7f99cc1401c0 2026-02-13T20:25:35.803 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.787+0000 7f99c9ffb640 10 monclient: _finish_auth 0 2026-02-13T20:25:35.803 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.787+0000 7f99c9ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:25:35.803 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.787+0000 7f99c9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:25:35.803 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.787+0000 7f99d141b640 5 monclient: authenticate success, global_id 124326 2026-02-13T20:25:35.803 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.787+0000 7f99c9ffb640 1 -- 10.20.193.110:0/2871515571 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f99c0002dd0 con 0x7f99cc1401c0 2026-02-13T20:25:35.803 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.787+0000 7f99d141b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:25:35.804 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.787+0000 7f99c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:35.804 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.787+0000 7f99c9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:25:35.804 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.787+0000 7f99c9ffb640 10 monclient: dump: 2026-02-13T20:25:35.804 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:35.804 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:35.804 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:35.804 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:35.804 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:35.804 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:35.804 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:35.805 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:35.805 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:35.805 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:35.805 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.787+0000 7f99d141b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:25:35.805 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.787+0000 7f99c9ffb640 1 -- 10.20.193.110:0/2871515571 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f99c0003020 con 0x7f99cc1401c0 2026-02-13T20:25:35.805 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.787+0000 7f99c9ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T20:25:35.805 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.787+0000 7f99c9ffb640 1 -- 10.20.193.110:0/2871515571 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f99c0003430 con 0x7f99cc1401c0 2026-02-13T20:25:35.805 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.787+0000 7f99c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:35.805 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.787+0000 7f99c9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:25:35.805 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.787+0000 7f99c9ffb640 10 monclient: dump: 2026-02-13T20:25:35.805 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:35.806 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:35.806 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:35.806 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:35.806 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:35.806 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:35.806 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:35.806 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:35.806 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:35.806 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:35.806 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.787+0000 7f99d141b640 10 monclient: get_monmap_and_config success 2026-02-13T20:25:35.806 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.787+0000 7f99d141b640 4 set_mon_vals no callback set 2026-02-13T20:25:35.807 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.787+0000 7f99d141b640 10 monclient: shutdown 2026-02-13T20:25:35.807 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.787+0000 7f99d141b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:25:35.807 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.787+0000 7f99d141b640 1 -- 10.20.193.110:0/2871515571 >> v1:10.20.193.110:6789/0 conn(0x7f99cc1401c0 legacy=0x7f99cc091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:35.807 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.787+0000 7f99d141b640 1 -- 10.20.193.110:0/2871515571 shutdown_connections 2026-02-13T20:25:35.807 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.787+0000 7f99d141b640 1 -- 10.20.193.110:0/2871515571 >> 10.20.193.110:0/2871515571 conn(0x7f99cc054e90 msgr2=0x7f99cc058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:25:35.807 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.787+0000 7f99d141b640 1 -- 10.20.193.110:0/2871515571 shutdown_connections 2026-02-13T20:25:35.807 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.787+0000 7f99d141b640 1 -- 10.20.193.110:0/2871515571 wait complete. 2026-02-13T20:25:35.807 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.788+0000 7f99d141b640 10 monclient: build_initial_monmap 2026-02-13T20:25:35.807 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.788+0000 7f99d141b640 10 monclient: monmap: 2026-02-13T20:25:35.807 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:25:35.808 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:25:35.808 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:25:35.808 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:25:35.808 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:25:35.808 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:25:35.808 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:25:35.808 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:25:35.808 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:25:35.808 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:35.808 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.788+0000 7f99d141b640 1 Processor -- start 2026-02-13T20:25:35.808 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.788+0000 7f99d141b640 1 -- start start 2026-02-13T20:25:35.809 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.788+0000 7f99d141b640 10 monclient: init 2026-02-13T20:25:35.809 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.788+0000 7f99d141b640 10 monclient: _reopen_session rank -1 2026-02-13T20:25:35.809 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.788+0000 7f99d141b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:25:35.809 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.788+0000 7f99d141b640 10 monclient(hunting): picked mon.noname-b con 0x7f99cc091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:25:35.809 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.788+0000 7f99d141b640 10 monclient(hunting): picked mon.noname-a con 0x7f99cc1401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:25:35.809 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.788+0000 7f99d141b640 10 monclient(hunting): picked mon.noname-c con 0x7f99cc194a00 addr v1:10.20.193.110:6790/0 2026-02-13T20:25:35.809 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.788+0000 7f99d141b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99cc1324c0 con 0x7f99cc1401c0 2026-02-13T20:25:35.809 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.788+0000 7f99d141b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99cc131f00 con 0x7f99cc091950 2026-02-13T20:25:35.809 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.788+0000 7f99d141b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99cc12f600 con 0x7f99cc194a00 2026-02-13T20:25:35.809 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.788+0000 7f99d141b640 10 monclient(hunting): _renew_subs 2026-02-13T20:25:35.810 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.788+0000 7f99d141b640 10 monclient(hunting): authenticate will time out at 1497.479651s 2026-02-13T20:25:35.810 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.788+0000 7f99ca7fc640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f99cc1401c0 0x7f99cc12eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:48090/0 (socket says 10.20.193.110:48090) 2026-02-13T20:25:35.810 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.788+0000 7f99ca7fc640 1 -- 10.20.193.110:0/2897805743 learned_addr learned my addr 10.20.193.110:0/2897805743 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:25:35.810 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.788+0000 7f99cb7fe640 1 --1- 10.20.193.110:0/2897805743 >> v1:10.20.193.110:6790/0 conn(0x7f99cc194a00 0x7f99cc194e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:48162/0 (socket says 10.20.193.110:48162) 2026-02-13T20:25:35.810 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.788+0000 7f99ab7fe640 1 -- 10.20.193.110:0/2897805743 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 609723846 0 0) 0x7f99cc1324c0 con 0x7f99cc1401c0 2026-02-13T20:25:35.810 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.788+0000 7f99ab7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:25:35.810 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.788+0000 7f99ab7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:35.810 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.788+0000 7f99ab7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:35.810 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.788+0000 7f99ab7fe640 10 monclient(hunting): my global_id is 124329 2026-02-13T20:25:35.810 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.788+0000 7f99ab7fe640 1 -- 10.20.193.110:0/2897805743 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99980035e0 con 0x7f99cc1401c0 2026-02-13T20:25:35.810 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.788+0000 7f99ab7fe640 1 -- 10.20.193.110:0/2897805743 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4289483210 0 0) 0x7f99cc12f600 con 0x7f99cc194a00 2026-02-13T20:25:35.811 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.788+0000 7f99ab7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:25:35.811 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.788+0000 7f99ab7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:35.811 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.788+0000 7f99ab7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:35.811 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.788+0000 7f99ab7fe640 10 monclient(hunting): my global_id is 94634 2026-02-13T20:25:35.811 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.788+0000 7f99ab7fe640 1 -- 10.20.193.110:0/2897805743 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99cc1324c0 con 0x7f99cc194a00 2026-02-13T20:25:35.811 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.789+0000 7f99ab7fe640 1 -- 10.20.193.110:0/2897805743 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1523447209 0 0) 0x7f99980035e0 con 0x7f99cc1401c0 2026-02-13T20:25:35.811 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.789+0000 7f99ab7fe640 1 -- 10.20.193.110:0/2897805743 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f99cc12f600 con 0x7f99cc1401c0 2026-02-13T20:25:35.811 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.789+0000 7f99ab7fe640 1 -- 10.20.193.110:0/2897805743 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f99b40030d0 con 0x7f99cc1401c0 2026-02-13T20:25:35.811 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.789+0000 7f99ab7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:25:35.811 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.789+0000 7f99ab7fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:25:35.811 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.789+0000 7f99ab7fe640 10 monclient(hunting): dump: 2026-02-13T20:25:35.811 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:35.812 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:35.812 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:35.812 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:35.812 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:35.812 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:35.812 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:35.812 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:35.812 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:35.812 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:35.812 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.789+0000 7f99ab7fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:25:35.812 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.789+0000 7f99ab7fe640 1 -- 10.20.193.110:0/2897805743 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4157640841 0 0) 0x7f99cc1324c0 con 0x7f99cc194a00 2026-02-13T20:25:35.812 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.789+0000 7f99ab7fe640 1 -- 10.20.193.110:0/2897805743 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f99980035e0 con 0x7f99cc194a00 2026-02-13T20:25:35.813 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.789+0000 7f99ab7fe640 1 -- 10.20.193.110:0/2897805743 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f99bc004110 con 0x7f99cc194a00 2026-02-13T20:25:35.813 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.789+0000 7f99ab7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:25:35.813 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.789+0000 7f99ab7fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:25:35.813 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.789+0000 7f99ab7fe640 10 monclient(hunting): dump: 2026-02-13T20:25:35.813 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:35.813 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:35.813 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:35.813 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:35.813 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:35.813 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:35.813 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:35.813 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:35.813 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:35.814 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:35.814 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.789+0000 7f99ab7fe640 1 -- 10.20.193.110:0/2897805743 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2708451972 0 0) 0x7f99cc12f600 con 0x7f99cc1401c0 2026-02-13T20:25:35.814 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.789+0000 7f99ab7fe640 1 -- 10.20.193.110:0/2897805743 >> v1:10.20.193.110:6790/0 conn(0x7f99cc194a00 legacy=0x7f99cc194e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:35.814 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.789+0000 7f99ab7fe640 1 -- 10.20.193.110:0/2897805743 >> v1:10.20.193.188:6789/0 conn(0x7f99cc091950 legacy=0x7f99cc12e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:35.814 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.789+0000 7f99ab7fe640 10 monclient: _finish_hunting 0 2026-02-13T20:25:35.814 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.789+0000 7f99ab7fe640 1 monclient: found mon.a 2026-02-13T20:25:35.814 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.789+0000 7f99ab7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:25:35.814 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.789+0000 7f99ab7fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:25:35.814 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.789+0000 7f99ab7fe640 1 -- 10.20.193.110:0/2897805743 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99cc130600 con 0x7f99cc1401c0 2026-02-13T20:25:35.814 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.789+0000 7f99ab7fe640 10 monclient: _finish_auth 0 2026-02-13T20:25:35.814 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.789+0000 7f99ab7fe640 10 monclient: _check_auth_tickets 2026-02-13T20:25:35.814 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.789+0000 7f99ab7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:25:35.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.789+0000 7f99d141b640 5 monclient: authenticate success, global_id 124329 2026-02-13T20:25:35.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.789+0000 7f99d141b640 10 monclient: _renew_subs 2026-02-13T20:25:35.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.789+0000 7f99d141b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:25:35.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.789+0000 7f99d141b640 1 -- 10.20.193.110:0/2897805743 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f99cc091090 con 0x7f99cc1401c0 2026-02-13T20:25:35.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.789+0000 7f99d141b640 10 monclient: _renew_subs 2026-02-13T20:25:35.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.789+0000 7f99d141b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:25:35.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.789+0000 7f99d141b640 1 -- 10.20.193.110:0/2897805743 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f99cc05d320 con 0x7f99cc1401c0 2026-02-13T20:25:35.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.789+0000 7f99ab7fe640 1 -- 10.20.193.110:0/2897805743 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f99b40032a0 con 0x7f99cc1401c0 2026-02-13T20:25:35.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.789+0000 7f99ab7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:25:35.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.789+0000 7f99ab7fe640 1 -- 10.20.193.110:0/2897805743 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f99b4003980 con 0x7f99cc1401c0 2026-02-13T20:25:35.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.789+0000 7f99ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:35.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.789+0000 7f99ab7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:25:35.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.789+0000 7f99ab7fe640 10 monclient: dump: 2026-02-13T20:25:35.816 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:35.816 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:35.816 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:35.816 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:35.816 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:35.816 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:35.816 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:35.816 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:35.816 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:35.816 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:35.816 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.789+0000 7f99c97fa640 4 set_mon_vals no callback set 2026-02-13T20:25:35.816 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.789+0000 7f99d141b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:25:35.816 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.789+0000 7f99d141b640 1 -- 10.20.193.110:0/2897805743 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f99cc0008d0 con 0x7f99cc092020 2026-02-13T20:25:35.816 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.789+0000 7f99ab7fe640 1 -- 10.20.193.110:0/2897805743 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f99b4003ae0 con 0x7f99cc1401c0 2026-02-13T20:25:35.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.789+0000 7f99ab7fe640 1 -- 10.20.193.110:0/2897805743 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(680..680 src has 1..680) ==== 3899+0+0 (unknown 3290828237 0 0) 0x7f99b404e8c0 con 0x7f99cc1401c0 2026-02-13T20:25:35.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.789+0000 7f99ab7fe640 1 -- 10.20.193.110:0/2897805743 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1685329910 0 0) 0x7f99cc0008d0 con 0x7f99cc092020 2026-02-13T20:25:35.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.789+0000 7f99ab7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:25:35.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.789+0000 7f99ab7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:35.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.789+0000 7f99ab7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:35.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.789+0000 7f99ab7fe640 10 monclient(hunting): my global_id is 124332 2026-02-13T20:25:35.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.789+0000 7f99ab7fe640 1 -- 10.20.193.110:0/2897805743 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99cc12f600 con 0x7f99cc092020 2026-02-13T20:25:35.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.790+0000 7f99cb7fe640 10 monclient: get_auth_request con 0x7f999803fa00 auth_method 0 2026-02-13T20:25:35.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.790+0000 7f99ab7fe640 1 -- 10.20.193.110:0/2897805743 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3741701012 0 0) 0x7f99cc12f600 con 0x7f99cc092020 2026-02-13T20:25:35.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.790+0000 7f99ab7fe640 1 -- 10.20.193.110:0/2897805743 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f99cc0008d0 con 0x7f99cc092020 2026-02-13T20:25:35.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.790+0000 7f99ab7fe640 1 -- 10.20.193.110:0/2897805743 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f99c0002d90 con 0x7f99cc092020 2026-02-13T20:25:35.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.790+0000 7f99ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:35.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.790+0000 7f99ab7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:25:35.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.790+0000 7f99ab7fe640 10 monclient: dump: 2026-02-13T20:25:35.818 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:35.818 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:35.818 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:35.818 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:35.818 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:35.818 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:35.818 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:35.818 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:35.818 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:35.818 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:35.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.790+0000 7f99ab7fe640 1 -- 10.20.193.110:0/2897805743 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 454912256 0 0) 0x7f99cc0008d0 con 0x7f99cc092020 2026-02-13T20:25:35.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.790+0000 7f99ab7fe640 1 -- 10.20.193.110:0/2897805743 --> v1:10.20.193.110:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f99cc08b450 con 0x7f99cc092020 2026-02-13T20:25:35.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.790+0000 7f99ab7fe640 1 -- 10.20.193.110:0/2897805743 <== mon.0 v1:10.20.193.110:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f99c0003190 con 0x7f99cc092020 2026-02-13T20:25:35.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.790+0000 7f99ab7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:25:35.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.790+0000 7f99ab7fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:25:35.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.790+0000 7f99ab7fe640 1 -- 10.20.193.110:0/2897805743 >> v1:10.20.193.110:6789/0 conn(0x7f99cc092020 legacy=0x7f99cc08ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:35.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.790+0000 7f99ab7fe640 1 -- 10.20.193.110:0/2897805743 >> v1:10.20.193.110:6789/0 conn(0x7f99cc092020 legacy=0x7f99cc08ef60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:25:35.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.793+0000 7f99d141b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:25:35.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.793+0000 7f99d141b640 1 -- 10.20.193.110:0/2897805743 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f99cc058410 con 0x7f99cc04d1c0 2026-02-13T20:25:35.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.793+0000 7f99ab7fe640 1 -- 10.20.193.110:0/2897805743 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3073322125 0 0) 0x7f99cc058410 con 0x7f99cc04d1c0 2026-02-13T20:25:35.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.793+0000 7f99ab7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:25:35.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.793+0000 7f99ab7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:35.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.793+0000 7f99ab7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:35.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.793+0000 7f99ab7fe640 10 monclient(hunting): my global_id is 124335 2026-02-13T20:25:35.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.793+0000 7f99ab7fe640 1 -- 10.20.193.110:0/2897805743 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99cc0008d0 con 0x7f99cc04d1c0 2026-02-13T20:25:35.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.794+0000 7f99ab7fe640 1 -- 10.20.193.110:0/2897805743 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4154423185 0 0) 0x7f99cc0008d0 con 0x7f99cc04d1c0 2026-02-13T20:25:35.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.794+0000 7f99ab7fe640 1 -- 10.20.193.110:0/2897805743 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f99cc058410 con 0x7f99cc04d1c0 2026-02-13T20:25:35.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.794+0000 7f99ab7fe640 1 -- 10.20.193.110:0/2897805743 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f99c0004c30 con 0x7f99cc04d1c0 2026-02-13T20:25:35.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.794+0000 7f99ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:35.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.794+0000 7f99ab7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:25:35.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.794+0000 7f99ab7fe640 10 monclient: dump: 2026-02-13T20:25:35.820 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:35.820 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:35.820 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:35.820 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:35.820 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:35.820 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:35.820 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:35.820 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:35.820 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:35.820 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:35.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.794+0000 7f99ab7fe640 1 -- 10.20.193.110:0/2897805743 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3780650341 0 0) 0x7f99cc058410 con 0x7f99cc04d1c0 2026-02-13T20:25:35.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.794+0000 7f99ab7fe640 1 -- 10.20.193.110:0/2897805743 --> v1:10.20.193.110:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f99cc0561b0 con 0x7f99cc04d1c0 2026-02-13T20:25:35.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.794+0000 7f99ab7fe640 1 -- 10.20.193.110:0/2897805743 <== mon.0 v1:10.20.193.110:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4514 (unknown 0 0 4224172481) 0x7f99c0005040 con 0x7f99cc04d1c0 2026-02-13T20:25:35.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.794+0000 7f99ab7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:25:35.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.794+0000 7f99ab7fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:25:35.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.794+0000 7f99ab7fe640 1 -- 10.20.193.110:0/2897805743 >> v1:10.20.193.110:6789/0 conn(0x7f99cc04d1c0 legacy=0x7f99cc1975b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:35.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.794+0000 7f99ab7fe640 1 -- 10.20.193.110:0/2897805743 >> v1:10.20.193.110:6789/0 conn(0x7f99cc04d1c0 legacy=0x7f99cc1975b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:25:35.821 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:25:35.821 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:25:35.821 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:25:35.821 INFO:teuthology.orchestra.run.trial110.stdout: "state": "peon", 2026-02-13T20:25:35.822 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 52, 2026-02-13T20:25:35.822 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 251213, 2026-02-13T20:25:35.822 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:25:35.822 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:25:35.822 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:25:35.822 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:25:35.822 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:25:35.822 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 2, 2026-02-13T20:25:35.822 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:25:35.822 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:25:35.822 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:25:35.822 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:25:35.822 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:25:35.822 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:25:35.822 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:25:35.823 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:25:35.823 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:25:35.823 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:25:35.823 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:25:35.823 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:25:35.823 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:25:35.823 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:25:35.823 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:25:35.823 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:25:35.823 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:25:35.823 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:25:35.823 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:25:35.823 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:25:35.823 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:25:35.823 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:25:35.823 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:25:35.823 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:25:35.824 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:25:35.824 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:25:35.824 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:25:35.824 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:25:35.824 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:25:35.824 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:25:35.824 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:25:35.824 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:25:35.824 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:25:35.824 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:35.824 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:25:35.824 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:25:35.824 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:25:35.824 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:25:35.824 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:25:35.824 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:25:35.824 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:25:35.825 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:25:35.825 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:25:35.825 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:25:35.825 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:25:35.825 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:25:35.825 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:25:35.825 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:25:35.825 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:25:35.825 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:25:35.825 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:25:35.825 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:25:35.825 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:25:35.825 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:25:35.825 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:25:35.825 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:25:35.825 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:25:35.825 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:25:35.825 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:25:35.825 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:25:35.826 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:25:35.826 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:25:35.826 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:25:35.826 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:25:35.826 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:25:35.826 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:25:35.826 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:35.826 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:25:35.826 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:35.826 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:25:35.826 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:25:35.826 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:25:35.826 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:25:35.826 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:35.826 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:25:35.826 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:25:35.826 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:25:35.826 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:35.827 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:25:35.827 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:35.827 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:25:35.827 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:25:35.827 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:25:35.827 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:25:35.827 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:25:35.827 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:25:35.827 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:35.827 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:35.827 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:25:35.827 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:25:35.827 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:25:35.827 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:25:35.827 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:35.827 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:25:35.827 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:25:35.827 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:25:35.827 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:35.828 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:25:35.828 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:35.828 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:25:35.828 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:25:35.828 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:25:35.828 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:25:35.828 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:25:35.828 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:25:35.828 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:35.828 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:35.828 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:25:35.828 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:25:35.828 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:25:35.828 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:25:35.828 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:35.828 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:25:35.828 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:25:35.828 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:25:35.828 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:35.828 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:25:35.829 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:35.829 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:25:35.829 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:25:35.829 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:25:35.829 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:25:35.829 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:25:35.829 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:25:35.829 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:35.829 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:25:35.829 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:35.829 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:25:35.829 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:25:35.829 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:35.829 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:25:35.829 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:25:35.829 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:25:35.829 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:35.829 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:25:35.829 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:25:35.829 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:35.830 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:25:35.830 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:25:35.830 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:25:35.830 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:35.830 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:25:35.830 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:25:35.830 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:35.830 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:25:35.830 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:25:35.830 INFO:teuthology.orchestra.run.trial110.stdout: "num": 5 2026-02-13T20:25:35.830 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:35.830 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:25:35.830 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:35.830 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:25:35.830 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:25:35.831 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.794+0000 7f99d141b640 1 -- 10.20.193.110:0/2897805743 >> v1:10.20.193.188:6812/1623052694 conn(0x7f999803fa00 legacy=0x7f999805feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:35.831 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.794+0000 7f99d141b640 10 monclient: shutdown 2026-02-13T20:25:35.831 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.794+0000 7f99d141b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:25:35.832 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.794+0000 7f99d141b640 1 -- 10.20.193.110:0/2897805743 >> v1:10.20.193.110:6789/0 conn(0x7f99cc1401c0 legacy=0x7f99cc12eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:35.832 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.794+0000 7f99cb7fe640 1 -- 10.20.193.110:0/2897805743 reap_dead start 2026-02-13T20:25:35.832 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.794+0000 7f99d141b640 1 -- 10.20.193.110:0/2897805743 shutdown_connections 2026-02-13T20:25:35.832 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.794+0000 7f99d141b640 1 -- 10.20.193.110:0/2897805743 >> 10.20.193.110:0/2897805743 conn(0x7f99cc054e90 msgr2=0x7f99cc088e30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:25:35.832 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.794+0000 7f99d141b640 1 -- 10.20.193.110:0/2897805743 shutdown_connections 2026-02-13T20:25:35.832 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.794+0000 7f99d141b640 1 -- 10.20.193.110:0/2897805743 wait complete. 2026-02-13T20:25:35.832 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:25:35.832 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-13T20:25:35.832 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T20:25:35.905 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.897+0000 7fdd3ff0c640 10 monclient: get_monmap_and_config 2026-02-13T20:25:35.905 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.897+0000 7fdd3ff0c640 10 monclient: build_initial_monmap 2026-02-13T20:25:35.905 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.897+0000 7fdd3ff0c640 10 monclient: monmap: 2026-02-13T20:25:35.906 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:25:35.906 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:35.906 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:25:35.898747+0000 2026-02-13T20:25:35.906 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:25:35.898747+0000 2026-02-13T20:25:35.906 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:25:35.906 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:35.906 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:25:35.906 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:25:35.906 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:25:35.906 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:35.906 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.897+0000 7fdd3ff0c640 1 Processor -- start 2026-02-13T20:25:35.906 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.897+0000 7fdd3ff0c640 1 -- start start 2026-02-13T20:25:35.907 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.897+0000 7fdd3ff0c640 10 monclient: init 2026-02-13T20:25:35.907 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3ff0c640 10 monclient: _reopen_session rank -1 2026-02-13T20:25:35.907 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3ff0c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:25:35.907 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3ff0c640 10 monclient(hunting): picked mon.noname-a con 0x7fdd381401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:25:35.907 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3ff0c640 10 monclient(hunting): picked mon.noname-c con 0x7fdd38092020 addr v1:10.20.193.188:6789/0 2026-02-13T20:25:35.907 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3ff0c640 10 monclient(hunting): picked mon.noname-b con 0x7fdd38091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:25:35.907 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3ff0c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd3808b730 con 0x7fdd381401c0 2026-02-13T20:25:35.907 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3ff0c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd3805c5b0 con 0x7fdd38092020 2026-02-13T20:25:35.907 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3ff0c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd3808bcf0 con 0x7fdd38091950 2026-02-13T20:25:35.907 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3ff0c640 10 monclient(hunting): _renew_subs 2026-02-13T20:25:35.907 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3ff0c640 10 monclient(hunting): authenticate will time out at 1497.589113s 2026-02-13T20:25:35.907 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3dc81640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fdd381401c0 0x7fdd38091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:48136/0 (socket says 10.20.193.110:48136) 2026-02-13T20:25:35.907 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3dc81640 1 -- 10.20.193.110:0/1552486647 learned_addr learned my addr 10.20.193.110:0/1552486647 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:25:35.907 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3cc7f640 1 -- 10.20.193.110:0/1552486647 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2996171695 0 0) 0x7fdd3808bcf0 con 0x7fdd38091950 2026-02-13T20:25:35.908 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3cc7f640 10 monclient(hunting): _negotiate 2026-02-13T20:25:35.908 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3cc7f640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:35.908 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3cc7f640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:35.908 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3cc7f640 10 monclient(hunting): my global_id is 94637 2026-02-13T20:25:35.908 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3cc7f640 1 -- 10.20.193.110:0/1552486647 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd200035e0 con 0x7fdd38091950 2026-02-13T20:25:35.908 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3cc7f640 1 -- 10.20.193.110:0/1552486647 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2395554155 0 0) 0x7fdd3808b730 con 0x7fdd381401c0 2026-02-13T20:25:35.908 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3cc7f640 10 monclient(hunting): _negotiate 2026-02-13T20:25:35.908 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3cc7f640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:35.908 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3cc7f640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:35.908 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3cc7f640 10 monclient(hunting): my global_id is 124338 2026-02-13T20:25:35.908 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3cc7f640 1 -- 10.20.193.110:0/1552486647 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd3808bcf0 con 0x7fdd381401c0 2026-02-13T20:25:35.908 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3cc7f640 1 -- 10.20.193.110:0/1552486647 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2018085565 0 0) 0x7fdd200035e0 con 0x7fdd38091950 2026-02-13T20:25:35.908 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3cc7f640 1 -- 10.20.193.110:0/1552486647 >> v1:10.20.193.188:6789/0 conn(0x7fdd38092020 legacy=0x7fdd381812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:35.908 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3cc7f640 1 -- 10.20.193.110:0/1552486647 >> v1:10.20.193.110:6789/0 conn(0x7fdd381401c0 legacy=0x7fdd38091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:35.909 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3cc7f640 10 monclient: _finish_hunting 0 2026-02-13T20:25:35.909 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3cc7f640 1 monclient: found mon.noname-b 2026-02-13T20:25:35.909 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3cc7f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:25:35.909 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3cc7f640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:25:35.909 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3cc7f640 1 -- 10.20.193.110:0/1552486647 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd38140590 con 0x7fdd38091950 2026-02-13T20:25:35.909 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3cc7f640 10 monclient: _finish_auth 0 2026-02-13T20:25:35.909 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3cc7f640 10 monclient: _check_auth_tickets 2026-02-13T20:25:35.909 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3cc7f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:25:35.909 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3cc7f640 1 -- 10.20.193.110:0/1552486647 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fdd34003eb0 con 0x7fdd38091950 2026-02-13T20:25:35.909 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3cc7f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:35.909 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3cc7f640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:25:35.909 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3cc7f640 10 monclient: dump: 2026-02-13T20:25:35.909 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:35.909 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:35.910 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:35.910 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:35.910 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:35.910 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:35.910 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:35.910 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:35.910 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:35.910 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:35.910 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3ff0c640 5 monclient: authenticate success, global_id 94637 2026-02-13T20:25:35.910 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3ff0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:25:35.910 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3cc7f640 1 -- 10.20.193.110:0/1552486647 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdd34004040 con 0x7fdd38091950 2026-02-13T20:25:35.910 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3cc7f640 10 monclient: handle_config config(0 keys) 2026-02-13T20:25:35.910 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3cc7f640 1 -- 10.20.193.110:0/1552486647 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fdd34004450 con 0x7fdd38091950 2026-02-13T20:25:35.910 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3ff0c640 10 monclient: get_monmap_and_config success 2026-02-13T20:25:35.910 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3ff0c640 4 set_mon_vals no callback set 2026-02-13T20:25:35.910 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3cc7f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:35.911 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3cc7f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:25:35.911 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3cc7f640 10 monclient: dump: 2026-02-13T20:25:35.911 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:35.911 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:35.911 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:35.911 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:35.911 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:35.911 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:35.911 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:35.911 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:35.911 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:35.911 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:35.911 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3ff0c640 10 monclient: shutdown 2026-02-13T20:25:35.911 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3ff0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:25:35.911 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.898+0000 7fdd3ff0c640 1 -- 10.20.193.110:0/1552486647 >> v1:10.20.193.110:6790/0 conn(0x7fdd38091950 legacy=0x7fdd381a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:35.912 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.899+0000 7fdd3ff0c640 1 -- 10.20.193.110:0/1552486647 shutdown_connections 2026-02-13T20:25:35.912 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.899+0000 7fdd3ff0c640 1 -- 10.20.193.110:0/1552486647 >> 10.20.193.110:0/1552486647 conn(0x7fdd38054e90 msgr2=0x7fdd38058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:25:35.912 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.899+0000 7fdd3ff0c640 1 -- 10.20.193.110:0/1552486647 shutdown_connections 2026-02-13T20:25:35.912 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.899+0000 7fdd3ff0c640 1 -- 10.20.193.110:0/1552486647 wait complete. 2026-02-13T20:25:35.912 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.899+0000 7fdd3ff0c640 10 monclient: build_initial_monmap 2026-02-13T20:25:35.912 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.899+0000 7fdd3ff0c640 10 monclient: monmap: 2026-02-13T20:25:35.912 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:25:35.912 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:25:35.912 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:25:35.912 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:25:35.912 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:25:35.912 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:25:35.912 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:25:35.912 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:25:35.913 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:25:35.913 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:35.913 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.899+0000 7fdd3ff0c640 1 Processor -- start 2026-02-13T20:25:35.913 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.899+0000 7fdd3ff0c640 1 -- start start 2026-02-13T20:25:35.913 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.899+0000 7fdd3ff0c640 10 monclient: init 2026-02-13T20:25:35.913 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd3ff0c640 10 monclient: _reopen_session rank -1 2026-02-13T20:25:35.913 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd3ff0c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:25:35.913 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd3ff0c640 10 monclient(hunting): picked mon.noname-c con 0x7fdd38091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:25:35.913 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd3ff0c640 10 monclient(hunting): picked mon.noname-a con 0x7fdd381401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:25:35.913 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd3ff0c640 10 monclient(hunting): picked mon.noname-b con 0x7fdd3813ec00 addr v1:10.20.193.188:6789/0 2026-02-13T20:25:35.913 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd3ff0c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd3812db90 con 0x7fdd381401c0 2026-02-13T20:25:35.913 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd3ff0c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd38090ee0 con 0x7fdd3813ec00 2026-02-13T20:25:35.913 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd3ff0c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd3805d320 con 0x7fdd38091950 2026-02-13T20:25:35.913 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd3ff0c640 10 monclient(hunting): _renew_subs 2026-02-13T20:25:35.913 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd3ff0c640 10 monclient(hunting): authenticate will time out at 1497.591099s 2026-02-13T20:25:35.913 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd3dc81640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fdd38091950 0x7fdd3813e4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:48176/0 (socket says 10.20.193.110:48176) 2026-02-13T20:25:35.914 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd3dc81640 1 -- 10.20.193.110:0/3385056759 learned_addr learned my addr 10.20.193.110:0/3385056759 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:25:35.914 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd267fc640 1 -- 10.20.193.110:0/3385056759 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1068664289 0 0) 0x7fdd3805d320 con 0x7fdd38091950 2026-02-13T20:25:35.914 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd267fc640 10 monclient(hunting): _negotiate 2026-02-13T20:25:35.914 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd267fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:35.914 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd267fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:35.914 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd267fc640 10 monclient(hunting): my global_id is 94640 2026-02-13T20:25:35.914 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd267fc640 1 -- 10.20.193.110:0/3385056759 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd080035e0 con 0x7fdd38091950 2026-02-13T20:25:35.914 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd267fc640 1 -- 10.20.193.110:0/3385056759 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1906279532 0 0) 0x7fdd3812db90 con 0x7fdd381401c0 2026-02-13T20:25:35.914 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd267fc640 10 monclient(hunting): _negotiate 2026-02-13T20:25:35.914 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd267fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:35.914 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd267fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:35.914 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd267fc640 10 monclient(hunting): my global_id is 124341 2026-02-13T20:25:35.914 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd267fc640 1 -- 10.20.193.110:0/3385056759 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd3805d320 con 0x7fdd381401c0 2026-02-13T20:25:35.914 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd267fc640 1 -- 10.20.193.110:0/3385056759 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3708521515 0 0) 0x7fdd080035e0 con 0x7fdd38091950 2026-02-13T20:25:35.915 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd267fc640 1 -- 10.20.193.110:0/3385056759 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdd3812db90 con 0x7fdd38091950 2026-02-13T20:25:35.915 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd267fc640 1 -- 10.20.193.110:0/3385056759 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fdd280031f0 con 0x7fdd38091950 2026-02-13T20:25:35.915 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd267fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:25:35.915 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd267fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:25:35.915 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd267fc640 10 monclient(hunting): dump: 2026-02-13T20:25:35.915 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:35.915 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:35.915 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:35.915 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:35.915 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:35.915 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:35.915 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:35.915 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:35.916 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:35.916 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:35.916 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd267fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:25:35.916 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd267fc640 1 -- 10.20.193.110:0/3385056759 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4248439372 0 0) 0x7fdd3805d320 con 0x7fdd381401c0 2026-02-13T20:25:35.916 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd267fc640 1 -- 10.20.193.110:0/3385056759 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdd080035e0 con 0x7fdd381401c0 2026-02-13T20:25:35.916 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd267fc640 1 -- 10.20.193.110:0/3385056759 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fdd2c002ff0 con 0x7fdd381401c0 2026-02-13T20:25:35.916 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd267fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:25:35.916 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd267fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:25:35.916 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd267fc640 10 monclient(hunting): dump: 2026-02-13T20:25:35.916 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:35.916 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:35.916 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:35.916 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:35.916 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:35.916 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:35.916 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:35.917 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:35.917 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:35.917 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:35.917 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd267fc640 1 -- 10.20.193.110:0/3385056759 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1898880151 0 0) 0x7fdd3812db90 con 0x7fdd38091950 2026-02-13T20:25:35.917 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd267fc640 1 -- 10.20.193.110:0/3385056759 >> v1:10.20.193.188:6789/0 conn(0x7fdd3813ec00 legacy=0x7fdd38192d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:35.917 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd267fc640 1 -- 10.20.193.110:0/3385056759 >> v1:10.20.193.110:6789/0 conn(0x7fdd381401c0 legacy=0x7fdd38191660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:35.917 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd267fc640 10 monclient: _finish_hunting 0 2026-02-13T20:25:35.917 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd267fc640 1 monclient: found mon.c 2026-02-13T20:25:35.917 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd267fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:25:35.917 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd267fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:25:35.917 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd267fc640 1 -- 10.20.193.110:0/3385056759 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd3812f650 con 0x7fdd38091950 2026-02-13T20:25:35.917 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd267fc640 10 monclient: _finish_auth 0 2026-02-13T20:25:35.918 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd267fc640 10 monclient: _check_auth_tickets 2026-02-13T20:25:35.918 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd267fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:25:35.918 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd3ff0c640 5 monclient: authenticate success, global_id 94640 2026-02-13T20:25:35.918 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd3ff0c640 10 monclient: _renew_subs 2026-02-13T20:25:35.918 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd3ff0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:25:35.918 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd3ff0c640 1 -- 10.20.193.110:0/3385056759 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdd3812e6f0 con 0x7fdd38091950 2026-02-13T20:25:35.918 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd3ff0c640 10 monclient: _renew_subs 2026-02-13T20:25:35.918 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd3ff0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:25:35.918 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd3ff0c640 1 -- 10.20.193.110:0/3385056759 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fdd381506d0 con 0x7fdd38091950 2026-02-13T20:25:35.918 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd267fc640 1 -- 10.20.193.110:0/3385056759 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdd280048a0 con 0x7fdd38091950 2026-02-13T20:25:35.918 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd267fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:25:35.918 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd267fc640 1 -- 10.20.193.110:0/3385056759 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fdd28004bc0 con 0x7fdd38091950 2026-02-13T20:25:35.918 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd267fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:35.918 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd267fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:25:35.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd27fff640 4 set_mon_vals no callback set 2026-02-13T20:25:35.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd267fc640 10 monclient: dump: 2026-02-13T20:25:35.919 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:35.919 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:35.919 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:35.919 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:35.919 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:35.919 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:35.919 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:35.919 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:35.919 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:35.919 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:35.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.900+0000 7fdd3ff0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:25:35.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.901+0000 7fdd3ff0c640 1 -- 10.20.193.110:0/3385056759 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fdd3812fda0 con 0x7fdd38092020 2026-02-13T20:25:35.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.901+0000 7fdd267fc640 1 -- 10.20.193.110:0/3385056759 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fdd28011830 con 0x7fdd38091950 2026-02-13T20:25:35.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.901+0000 7fdd267fc640 1 -- 10.20.193.110:0/3385056759 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(680..680 src has 1..680) ==== 3899+0+0 (unknown 3290828237 0 0) 0x7fdd2804e930 con 0x7fdd38091950 2026-02-13T20:25:35.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.901+0000 7fdd267fc640 1 -- 10.20.193.110:0/3385056759 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1160935458 0 0) 0x7fdd3812fda0 con 0x7fdd38092020 2026-02-13T20:25:35.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.901+0000 7fdd267fc640 10 monclient(hunting): _negotiate 2026-02-13T20:25:35.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.901+0000 7fdd267fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:35.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.901+0000 7fdd267fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:35.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.901+0000 7fdd267fc640 10 monclient(hunting): my global_id is 94643 2026-02-13T20:25:35.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.901+0000 7fdd267fc640 1 -- 10.20.193.110:0/3385056759 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd3812db90 con 0x7fdd38092020 2026-02-13T20:25:35.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.901+0000 7fdd3e482640 10 monclient: get_auth_request con 0x7fdd0803fa50 auth_method 0 2026-02-13T20:25:35.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.901+0000 7fdd267fc640 1 -- 10.20.193.110:0/3385056759 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 215608645 0 0) 0x7fdd3812db90 con 0x7fdd38092020 2026-02-13T20:25:35.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.901+0000 7fdd267fc640 1 -- 10.20.193.110:0/3385056759 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdd3812fda0 con 0x7fdd38092020 2026-02-13T20:25:35.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.901+0000 7fdd267fc640 1 -- 10.20.193.110:0/3385056759 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fdd2c003530 con 0x7fdd38092020 2026-02-13T20:25:35.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.901+0000 7fdd267fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:35.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.901+0000 7fdd267fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:25:35.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.901+0000 7fdd267fc640 10 monclient: dump: 2026-02-13T20:25:35.920 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:35.920 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:35.921 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:35.921 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:35.921 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:35.921 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:35.921 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:35.921 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:35.921 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:35.921 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:35.921 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.901+0000 7fdd267fc640 1 -- 10.20.193.110:0/3385056759 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1360496719 0 0) 0x7fdd3812fda0 con 0x7fdd38092020 2026-02-13T20:25:35.921 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.901+0000 7fdd267fc640 1 -- 10.20.193.110:0/3385056759 --> v1:10.20.193.110:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdd3808b450 con 0x7fdd38092020 2026-02-13T20:25:35.921 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.902+0000 7fdd267fc640 1 -- 10.20.193.110:0/3385056759 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fdd2c005890 con 0x7fdd38092020 2026-02-13T20:25:35.921 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.902+0000 7fdd267fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:25:35.921 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.902+0000 7fdd267fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:25:35.921 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.902+0000 7fdd267fc640 1 -- 10.20.193.110:0/3385056759 >> v1:10.20.193.110:6790/0 conn(0x7fdd38092020 legacy=0x7fdd38127b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:35.921 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.902+0000 7fdd267fc640 1 -- 10.20.193.110:0/3385056759 >> v1:10.20.193.110:6790/0 conn(0x7fdd38092020 legacy=0x7fdd38127b20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:25:35.923 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.905+0000 7fdd3ff0c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:25:35.923 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.905+0000 7fdd3ff0c640 1 -- 10.20.193.110:0/3385056759 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fdd38150980 con 0x7fdd38128230 2026-02-13T20:25:35.923 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.905+0000 7fdd267fc640 1 -- 10.20.193.110:0/3385056759 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2154629278 0 0) 0x7fdd38150980 con 0x7fdd38128230 2026-02-13T20:25:35.923 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.905+0000 7fdd267fc640 10 monclient(hunting): _negotiate 2026-02-13T20:25:35.923 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.905+0000 7fdd267fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:35.923 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.905+0000 7fdd267fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:35.923 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.905+0000 7fdd267fc640 10 monclient(hunting): my global_id is 94646 2026-02-13T20:25:35.923 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.905+0000 7fdd267fc640 1 -- 10.20.193.110:0/3385056759 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd3812fda0 con 0x7fdd38128230 2026-02-13T20:25:35.923 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.905+0000 7fdd267fc640 1 -- 10.20.193.110:0/3385056759 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1806255129 0 0) 0x7fdd3812fda0 con 0x7fdd38128230 2026-02-13T20:25:35.924 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.905+0000 7fdd267fc640 1 -- 10.20.193.110:0/3385056759 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdd38150980 con 0x7fdd38128230 2026-02-13T20:25:35.924 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.905+0000 7fdd267fc640 1 -- 10.20.193.110:0/3385056759 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fdd2c003f10 con 0x7fdd38128230 2026-02-13T20:25:35.924 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.905+0000 7fdd267fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:35.924 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.905+0000 7fdd267fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:25:35.924 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.905+0000 7fdd267fc640 10 monclient: dump: 2026-02-13T20:25:35.924 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:35.924 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:35.924 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:35.924 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:35.924 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:35.924 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:35.924 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:35.924 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:35.924 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:35.924 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:35.925 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.905+0000 7fdd267fc640 1 -- 10.20.193.110:0/3385056759 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1901463310 0 0) 0x7fdd38150980 con 0x7fdd38128230 2026-02-13T20:25:35.925 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.905+0000 7fdd267fc640 1 -- 10.20.193.110:0/3385056759 --> v1:10.20.193.110:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdd38055bb0 con 0x7fdd38128230 2026-02-13T20:25:35.925 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.906+0000 7fdd267fc640 1 -- 10.20.193.110:0/3385056759 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4683 (unknown 0 0 98001358) 0x7fdd2c004250 con 0x7fdd38128230 2026-02-13T20:25:35.925 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.906+0000 7fdd267fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:25:35.925 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.906+0000 7fdd267fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:25:35.925 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.906+0000 7fdd267fc640 1 -- 10.20.193.110:0/3385056759 >> v1:10.20.193.110:6790/0 conn(0x7fdd38128230 legacy=0x7fdd381954b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:35.925 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.906+0000 7fdd267fc640 1 -- 10.20.193.110:0/3385056759 >> v1:10.20.193.110:6790/0 conn(0x7fdd38128230 legacy=0x7fdd381954b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:25:35.925 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:25:35.925 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:25:35.926 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:25:35.926 INFO:teuthology.orchestra.run.trial110.stdout: "state": "leader", 2026-02-13T20:25:35.926 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 52, 2026-02-13T20:25:35.926 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 607530, 2026-02-13T20:25:35.926 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:25:35.926 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:25:35.926 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:25:35.926 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:25:35.926 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:25:35.926 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 2, 2026-02-13T20:25:35.926 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:25:35.926 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:25:35.926 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:25:35.926 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:25:35.927 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:25:35.927 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:25:35.927 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:25:35.927 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:25:35.927 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:25:35.927 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:25:35.927 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:25:35.927 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:25:35.927 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:25:35.927 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:25:35.927 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:25:35.927 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:25:35.927 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:25:35.927 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:25:35.927 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:25:35.928 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:25:35.928 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:25:35.928 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:25:35.928 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:25:35.928 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:25:35.928 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:25:35.928 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:25:35.928 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:25:35.928 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:25:35.928 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:25:35.928 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:25:35.928 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:25:35.928 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:25:35.928 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:25:35.928 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:35.928 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:25:35.929 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:25:35.929 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:25:35.929 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:25:35.929 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:25:35.929 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:25:35.929 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:25:35.929 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:25:35.929 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:25:35.929 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:25:35.929 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:25:35.929 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:25:35.929 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:25:35.929 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:25:35.929 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:25:35.929 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:25:35.929 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:25:35.929 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:25:35.930 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:25:35.930 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:25:35.930 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:25:35.930 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:25:35.930 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:25:35.930 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:25:35.930 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:25:35.930 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:25:35.930 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:25:35.930 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:25:35.930 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:25:35.930 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:25:35.930 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:25:35.930 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:25:35.930 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:35.930 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:25:35.930 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:35.931 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:25:35.931 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:25:35.931 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:25:35.931 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:25:35.931 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:35.931 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:25:35.931 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:25:35.931 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:25:35.931 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:35.931 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:25:35.931 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:35.931 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:25:35.931 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:25:35.931 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:25:35.931 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:25:35.931 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:25:35.931 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:25:35.931 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:35.931 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:35.932 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:25:35.932 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:25:35.932 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:25:35.932 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:25:35.932 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:35.932 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:25:35.932 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:25:35.932 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:25:35.932 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:35.932 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:25:35.932 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:35.932 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:25:35.932 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:25:35.932 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:25:35.932 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:25:35.932 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:25:35.933 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:25:35.933 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:35.933 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:35.933 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:25:35.933 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:25:35.933 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:25:35.933 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:25:35.933 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:35.933 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:25:35.933 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:25:35.933 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:25:35.933 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:35.933 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:25:35.933 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:35.933 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:25:35.933 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:25:35.933 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:25:35.933 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:25:35.934 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:25:35.934 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:25:35.934 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:35.934 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:25:35.934 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:35.934 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:25:35.934 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:25:35.934 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:35.934 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:25:35.934 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:25:35.934 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:25:35.934 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:35.934 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:25:35.934 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:25:35.934 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:35.934 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:25:35.934 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:25:35.934 INFO:teuthology.orchestra.run.trial110.stdout: "num": 5 2026-02-13T20:25:35.934 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:35.934 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:25:35.935 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:25:35.935 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:35.935 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:25:35.935 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:25:35.935 INFO:teuthology.orchestra.run.trial110.stdout: "num": 3 2026-02-13T20:25:35.935 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:35.935 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:25:35.935 INFO:teuthology.orchestra.run.trial110.stdout: "mgr": [ 2026-02-13T20:25:35.935 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:35.935 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:25:35.935 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:25:35.935 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:25:35.935 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:35.935 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:25:35.935 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:35.935 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:25:35.935 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:25:35.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.906+0000 7fdd3ff0c640 1 -- 10.20.193.110:0/3385056759 >> v1:10.20.193.188:6812/1623052694 conn(0x7fdd0803fa50 legacy=0x7fdd0805ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:35.936 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.906+0000 7fdd3ff0c640 10 monclient: shutdown 2026-02-13T20:25:35.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.906+0000 7fdd3ff0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:25:35.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.906+0000 7fdd3ff0c640 1 -- 10.20.193.110:0/3385056759 >> v1:10.20.193.110:6790/0 conn(0x7fdd38091950 legacy=0x7fdd3813e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:35.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.906+0000 7fdd3e482640 1 -- 10.20.193.110:0/3385056759 reap_dead start 2026-02-13T20:25:35.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.906+0000 7fdd3e482640 1 -- 10.20.193.110:0/3385056759 reap_dead start 2026-02-13T20:25:35.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.906+0000 7fdd3ff0c640 1 -- 10.20.193.110:0/3385056759 shutdown_connections 2026-02-13T20:25:35.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.906+0000 7fdd3ff0c640 1 -- 10.20.193.110:0/3385056759 >> 10.20.193.110:0/3385056759 conn(0x7fdd38054e90 msgr2=0x7fdd3808dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:25:35.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.906+0000 7fdd3ff0c640 1 -- 10.20.193.110:0/3385056759 shutdown_connections 2026-02-13T20:25:35.937 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:35.906+0000 7fdd3ff0c640 1 -- 10.20.193.110:0/3385056759 wait complete. 2026-02-13T20:25:35.937 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:25:35.937 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-13T20:25:35.937 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T20:25:36.002 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.001+0000 7f7be2eaf640 10 monclient: get_monmap_and_config 2026-02-13T20:25:36.003 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.001+0000 7f7be2eaf640 10 monclient: build_initial_monmap 2026-02-13T20:25:36.003 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.001+0000 7f7be2eaf640 10 monclient: monmap: 2026-02-13T20:25:36.003 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:25:36.003 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:36.003 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:25:36.002546+0000 2026-02-13T20:25:36.003 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:25:36.002546+0000 2026-02-13T20:25:36.003 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:25:36.003 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:36.003 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:25:36.003 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:25:36.003 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:25:36.003 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:36.003 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.001+0000 7f7be2eaf640 1 Processor -- start 2026-02-13T20:25:36.003 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.001+0000 7f7be2eaf640 1 -- start start 2026-02-13T20:25:36.003 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.001+0000 7f7be2eaf640 10 monclient: init 2026-02-13T20:25:36.009 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.001+0000 7f7be2eaf640 10 monclient: _reopen_session rank -1 2026-02-13T20:25:36.009 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.001+0000 7f7be2eaf640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:25:36.009 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.001+0000 7f7be2eaf640 10 monclient(hunting): picked mon.noname-a con 0x7f7bdc1401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:25:36.009 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.001+0000 7f7be2eaf640 10 monclient(hunting): picked mon.noname-b con 0x7f7bdc092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:25:36.009 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.001+0000 7f7be2eaf640 10 monclient(hunting): picked mon.noname-c con 0x7f7bdc091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:25:36.009 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.001+0000 7f7be2eaf640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bdc08b730 con 0x7f7bdc1401c0 2026-02-13T20:25:36.009 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.001+0000 7f7be2eaf640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bdc05c5b0 con 0x7f7bdc091950 2026-02-13T20:25:36.009 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.001+0000 7f7be2eaf640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bdc08bcf0 con 0x7f7bdc092020 2026-02-13T20:25:36.010 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.001+0000 7f7be2eaf640 10 monclient(hunting): _renew_subs 2026-02-13T20:25:36.010 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.001+0000 7f7be2eaf640 10 monclient(hunting): authenticate will time out at 1497.692933s 2026-02-13T20:25:36.010 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.001+0000 7f7bd3fff640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f7bdc092020 0x7f7bdc1812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:48204/0 (socket says 10.20.193.110:48204) 2026-02-13T20:25:36.010 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.002+0000 7f7bd3fff640 1 -- 10.20.193.110:0/3557235231 learned_addr learned my addr 10.20.193.110:0/3557235231 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:25:36.010 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.002+0000 7f7bd37fe640 1 -- 10.20.193.110:0/3557235231 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1562380871 0 0) 0x7f7bdc08bcf0 con 0x7f7bdc092020 2026-02-13T20:25:36.010 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.002+0000 7f7bd37fe640 10 monclient(hunting): _negotiate 2026-02-13T20:25:36.010 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.002+0000 7f7bd37fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:36.010 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.002+0000 7f7bd37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:36.010 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.002+0000 7f7bd37fe640 10 monclient(hunting): my global_id is 94649 2026-02-13T20:25:36.010 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.002+0000 7f7bd37fe640 1 -- 10.20.193.110:0/3557235231 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bc80035e0 con 0x7f7bdc092020 2026-02-13T20:25:36.010 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.002+0000 7f7bd37fe640 1 -- 10.20.193.110:0/3557235231 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1757417497 0 0) 0x7f7bdc08b730 con 0x7f7bdc1401c0 2026-02-13T20:25:36.010 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.002+0000 7f7bd37fe640 10 monclient(hunting): _negotiate 2026-02-13T20:25:36.010 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.002+0000 7f7bd37fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:36.010 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.002+0000 7f7bd37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:36.010 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.002+0000 7f7bd37fe640 10 monclient(hunting): my global_id is 124344 2026-02-13T20:25:36.010 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.002+0000 7f7bd37fe640 1 -- 10.20.193.110:0/3557235231 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bdc08bcf0 con 0x7f7bdc1401c0 2026-02-13T20:25:36.010 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.002+0000 7f7bd37fe640 1 -- 10.20.193.110:0/3557235231 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2395553110 0 0) 0x7f7bc80035e0 con 0x7f7bdc092020 2026-02-13T20:25:36.010 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.002+0000 7f7bd37fe640 1 -- 10.20.193.110:0/3557235231 >> v1:10.20.193.188:6789/0 conn(0x7f7bdc091950 legacy=0x7f7bdc1a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:36.011 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.002+0000 7f7bd37fe640 1 -- 10.20.193.110:0/3557235231 >> v1:10.20.193.110:6789/0 conn(0x7f7bdc1401c0 legacy=0x7f7bdc091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:36.011 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.002+0000 7f7bd37fe640 10 monclient: _finish_hunting 0 2026-02-13T20:25:36.011 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.002+0000 7f7bd37fe640 1 monclient: found mon.noname-b 2026-02-13T20:25:36.011 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.002+0000 7f7bd37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:25:36.011 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.002+0000 7f7bd37fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:25:36.011 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.002+0000 7f7bd37fe640 1 -- 10.20.193.110:0/3557235231 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bdc140590 con 0x7f7bdc092020 2026-02-13T20:25:36.011 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.002+0000 7f7bd37fe640 10 monclient: _finish_auth 0 2026-02-13T20:25:36.011 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.002+0000 7f7bd37fe640 10 monclient: _check_auth_tickets 2026-02-13T20:25:36.011 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.002+0000 7f7bd37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:25:36.011 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.002+0000 7f7bd37fe640 1 -- 10.20.193.110:0/3557235231 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f7bc4002dd0 con 0x7f7bdc092020 2026-02-13T20:25:36.011 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.002+0000 7f7bd37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:36.011 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.002+0000 7f7bd37fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:25:36.011 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.002+0000 7f7bd37fe640 10 monclient: dump: 2026-02-13T20:25:36.011 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:36.011 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:36.011 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:36.011 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:36.011 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:36.012 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:36.012 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:36.012 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:36.012 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:36.012 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:36.012 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.002+0000 7f7be2eaf640 5 monclient: authenticate success, global_id 94649 2026-02-13T20:25:36.012 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.002+0000 7f7be2eaf640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:25:36.012 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.002+0000 7f7bd37fe640 1 -- 10.20.193.110:0/3557235231 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7bc4002fa0 con 0x7f7bdc092020 2026-02-13T20:25:36.012 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.002+0000 7f7bd37fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:25:36.012 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.002+0000 7f7be2eaf640 10 monclient: get_monmap_and_config success 2026-02-13T20:25:36.012 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.002+0000 7f7be2eaf640 4 set_mon_vals no callback set 2026-02-13T20:25:36.012 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.002+0000 7f7bd37fe640 1 -- 10.20.193.110:0/3557235231 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f7bc40033b0 con 0x7f7bdc092020 2026-02-13T20:25:36.012 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.002+0000 7f7bd37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:36.012 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.002+0000 7f7bd37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:25:36.012 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.002+0000 7f7bd37fe640 10 monclient: dump: 2026-02-13T20:25:36.012 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:36.012 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:36.012 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:36.013 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:36.013 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:36.013 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:36.013 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:36.013 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:36.013 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:36.013 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:36.013 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.002+0000 7f7be2eaf640 10 monclient: shutdown 2026-02-13T20:25:36.013 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.002+0000 7f7be2eaf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:25:36.013 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.002+0000 7f7be2eaf640 1 -- 10.20.193.110:0/3557235231 >> v1:10.20.193.110:6790/0 conn(0x7f7bdc092020 legacy=0x7f7bdc1812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:36.013 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.002+0000 7f7be2eaf640 1 -- 10.20.193.110:0/3557235231 shutdown_connections 2026-02-13T20:25:36.013 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.002+0000 7f7be2eaf640 1 -- 10.20.193.110:0/3557235231 >> 10.20.193.110:0/3557235231 conn(0x7f7bdc054e90 msgr2=0x7f7bdc058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:25:36.013 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.002+0000 7f7be2eaf640 1 -- 10.20.193.110:0/3557235231 shutdown_connections 2026-02-13T20:25:36.013 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.002+0000 7f7be2eaf640 1 -- 10.20.193.110:0/3557235231 wait complete. 2026-02-13T20:25:36.013 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.003+0000 7f7be2eaf640 10 monclient: build_initial_monmap 2026-02-13T20:25:36.013 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.003+0000 7f7be2eaf640 10 monclient: monmap: 2026-02-13T20:25:36.013 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:25:36.013 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:25:36.013 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:25:36.014 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:25:36.014 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:25:36.014 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:25:36.014 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:25:36.014 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:25:36.014 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:25:36.014 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:36.014 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.003+0000 7f7be2eaf640 1 Processor -- start 2026-02-13T20:25:36.014 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.003+0000 7f7be2eaf640 1 -- start start 2026-02-13T20:25:36.014 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.003+0000 7f7be2eaf640 10 monclient: init 2026-02-13T20:25:36.014 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.003+0000 7f7be2eaf640 10 monclient: _reopen_session rank -1 2026-02-13T20:25:36.014 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.003+0000 7f7be2eaf640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:25:36.014 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.003+0000 7f7be2eaf640 10 monclient(hunting): picked mon.noname-a con 0x7f7bdc091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:25:36.014 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.003+0000 7f7be2eaf640 10 monclient(hunting): picked mon.noname-c con 0x7f7bdc1401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:25:36.014 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.003+0000 7f7be2eaf640 10 monclient(hunting): picked mon.noname-b con 0x7f7bdc12c1f0 addr v1:10.20.193.188:6789/0 2026-02-13T20:25:36.014 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.003+0000 7f7be2eaf640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bdc12d150 con 0x7f7bdc091950 2026-02-13T20:25:36.014 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.003+0000 7f7be2eaf640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bdc08c480 con 0x7f7bdc12c1f0 2026-02-13T20:25:36.014 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.003+0000 7f7be2eaf640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bdc05d320 con 0x7f7bdc1401c0 2026-02-13T20:25:36.015 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.003+0000 7f7be2eaf640 10 monclient(hunting): _renew_subs 2026-02-13T20:25:36.015 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.003+0000 7f7be2eaf640 10 monclient(hunting): authenticate will time out at 1497.694692s 2026-02-13T20:25:36.015 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.003+0000 7f7bd3fff640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f7bdc1401c0 0x7f7bdc12a2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:48218/0 (socket says 10.20.193.110:48218) 2026-02-13T20:25:36.015 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.003+0000 7f7bd3fff640 1 -- 10.20.193.110:0/1093495710 learned_addr learned my addr 10.20.193.110:0/1093495710 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:25:36.015 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.003+0000 7f7be0c24640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f7bdc091950 0x7f7bdc129bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:48166/0 (socket says 10.20.193.110:48166) 2026-02-13T20:25:36.015 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.003+0000 7f7bd17fa640 1 -- 10.20.193.110:0/1093495710 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 185699880 0 0) 0x7f7bdc05d320 con 0x7f7bdc1401c0 2026-02-13T20:25:36.015 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.003+0000 7f7bd17fa640 10 monclient(hunting): _negotiate 2026-02-13T20:25:36.015 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.003+0000 7f7bd17fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:36.015 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.003+0000 7f7bd17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:36.015 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.003+0000 7f7bd17fa640 10 monclient(hunting): my global_id is 94652 2026-02-13T20:25:36.015 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.003+0000 7f7bd17fa640 1 -- 10.20.193.110:0/1093495710 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bac0035e0 con 0x7f7bdc1401c0 2026-02-13T20:25:36.015 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.003+0000 7f7bd17fa640 1 -- 10.20.193.110:0/1093495710 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1279932871 0 0) 0x7f7bdc12d150 con 0x7f7bdc091950 2026-02-13T20:25:36.015 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.003+0000 7f7bd17fa640 10 monclient(hunting): _negotiate 2026-02-13T20:25:36.015 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.003+0000 7f7bd17fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:36.015 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.003+0000 7f7bd17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:36.015 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.003+0000 7f7bd17fa640 10 monclient(hunting): my global_id is 124347 2026-02-13T20:25:36.015 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.003+0000 7f7bd17fa640 1 -- 10.20.193.110:0/1093495710 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bdc05d320 con 0x7f7bdc091950 2026-02-13T20:25:36.015 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.004+0000 7f7bd17fa640 1 -- 10.20.193.110:0/1093495710 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1208513132 0 0) 0x7f7bac0035e0 con 0x7f7bdc1401c0 2026-02-13T20:25:36.015 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.004+0000 7f7bd17fa640 1 -- 10.20.193.110:0/1093495710 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7bdc12d150 con 0x7f7bdc1401c0 2026-02-13T20:25:36.016 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.004+0000 7f7bd17fa640 1 -- 10.20.193.110:0/1093495710 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f7bc40032c0 con 0x7f7bdc1401c0 2026-02-13T20:25:36.016 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.004+0000 7f7bd17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:25:36.016 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.004+0000 7f7bd17fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:25:36.016 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.004+0000 7f7bd17fa640 10 monclient(hunting): dump: 2026-02-13T20:25:36.016 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:36.016 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:36.016 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:36.016 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:36.016 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:36.016 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:36.016 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:36.016 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:36.016 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:36.016 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:36.016 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.004+0000 7f7bd17fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:25:36.016 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.004+0000 7f7bd17fa640 1 -- 10.20.193.110:0/1093495710 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 367749654 0 0) 0x7f7bdc05d320 con 0x7f7bdc091950 2026-02-13T20:25:36.016 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.004+0000 7f7bd17fa640 1 -- 10.20.193.110:0/1093495710 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7bac0035e0 con 0x7f7bdc091950 2026-02-13T20:25:36.016 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.004+0000 7f7bd17fa640 1 -- 10.20.193.110:0/1093495710 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f7bcc003010 con 0x7f7bdc091950 2026-02-13T20:25:36.016 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.004+0000 7f7bd17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:25:36.017 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.004+0000 7f7bd17fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:25:36.017 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.004+0000 7f7bd17fa640 10 monclient(hunting): dump: 2026-02-13T20:25:36.017 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:36.017 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:36.017 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:36.017 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:36.017 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:36.017 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:36.017 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:36.017 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:36.017 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:36.017 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:36.017 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.004+0000 7f7bd17fa640 1 -- 10.20.193.110:0/1093495710 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2440228336 0 0) 0x7f7bac0035e0 con 0x7f7bdc091950 2026-02-13T20:25:36.017 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.004+0000 7f7bd17fa640 1 -- 10.20.193.110:0/1093495710 >> v1:10.20.193.110:6790/0 conn(0x7f7bdc1401c0 legacy=0x7f7bdc12a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:36.017 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.004+0000 7f7bd17fa640 1 -- 10.20.193.110:0/1093495710 >> v1:10.20.193.188:6789/0 conn(0x7f7bdc12c1f0 legacy=0x7f7bdc1a2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:36.017 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.004+0000 7f7bd17fa640 10 monclient: _finish_hunting 0 2026-02-13T20:25:36.017 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.004+0000 7f7bd17fa640 1 monclient: found mon.a 2026-02-13T20:25:36.017 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.004+0000 7f7bd17fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:25:36.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.004+0000 7f7bd17fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:25:36.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.004+0000 7f7bd17fa640 1 -- 10.20.193.110:0/1093495710 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bdc12d710 con 0x7f7bdc091950 2026-02-13T20:25:36.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.004+0000 7f7bd17fa640 10 monclient: _finish_auth 0 2026-02-13T20:25:36.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.004+0000 7f7bd17fa640 10 monclient: _check_auth_tickets 2026-02-13T20:25:36.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.004+0000 7f7bd17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:25:36.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.004+0000 7f7be2eaf640 5 monclient: authenticate success, global_id 124347 2026-02-13T20:25:36.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.004+0000 7f7be2eaf640 10 monclient: _renew_subs 2026-02-13T20:25:36.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.004+0000 7f7be2eaf640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:25:36.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.004+0000 7f7be2eaf640 1 -- 10.20.193.110:0/1093495710 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7bdc12d9f0 con 0x7f7bdc091950 2026-02-13T20:25:36.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.004+0000 7f7be2eaf640 10 monclient: _renew_subs 2026-02-13T20:25:36.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.004+0000 7f7be2eaf640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:25:36.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.004+0000 7f7be2eaf640 1 -- 10.20.193.110:0/1093495710 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7bdc12b690 con 0x7f7bdc091950 2026-02-13T20:25:36.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.004+0000 7f7bd17fa640 1 -- 10.20.193.110:0/1093495710 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7bcc0036d0 con 0x7f7bdc091950 2026-02-13T20:25:36.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.004+0000 7f7bd17fa640 10 monclient: handle_config config(0 keys) 2026-02-13T20:25:36.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.004+0000 7f7bd17fa640 1 -- 10.20.193.110:0/1093495710 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f7bcc003170 con 0x7f7bdc091950 2026-02-13T20:25:36.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.004+0000 7f7bd17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:36.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.004+0000 7f7bd17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:25:36.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.004+0000 7f7bd17fa640 10 monclient: dump: 2026-02-13T20:25:36.019 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:36.019 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:36.019 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:36.019 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:36.019 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:36.019 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:36.019 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:36.019 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:36.019 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:36.019 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:36.019 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.004+0000 7f7bd2ffd640 4 set_mon_vals no callback set 2026-02-13T20:25:36.019 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.004+0000 7f7be2eaf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:25:36.019 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.004+0000 7f7be2eaf640 1 -- 10.20.193.110:0/1093495710 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7bdc08f470 con 0x7f7bdc092020 2026-02-13T20:25:36.019 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.004+0000 7f7bd17fa640 1 -- 10.20.193.110:0/1093495710 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f7bcc003ae0 con 0x7f7bdc091950 2026-02-13T20:25:36.019 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.005+0000 7f7bd17fa640 1 -- 10.20.193.110:0/1093495710 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(680..680 src has 1..680) ==== 3899+0+0 (unknown 3290828237 0 0) 0x7f7bcc04e7b0 con 0x7f7bdc091950 2026-02-13T20:25:36.019 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.005+0000 7f7bd17fa640 1 -- 10.20.193.110:0/1093495710 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2987116641 0 0) 0x7f7bdc08f470 con 0x7f7bdc092020 2026-02-13T20:25:36.019 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.005+0000 7f7bd17fa640 10 monclient(hunting): _negotiate 2026-02-13T20:25:36.019 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.005+0000 7f7bd17fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:36.019 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.005+0000 7f7bd17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:36.020 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.005+0000 7f7bd17fa640 10 monclient(hunting): my global_id is 144148 2026-02-13T20:25:36.020 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.005+0000 7f7bd17fa640 1 -- 10.20.193.110:0/1093495710 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bac0035e0 con 0x7f7bdc092020 2026-02-13T20:25:36.020 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.005+0000 7f7be1425640 10 monclient: get_auth_request con 0x7f7bac03fa50 auth_method 0 2026-02-13T20:25:36.020 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.005+0000 7f7bd17fa640 1 -- 10.20.193.110:0/1093495710 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4287958154 0 0) 0x7f7bac0035e0 con 0x7f7bdc092020 2026-02-13T20:25:36.020 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.005+0000 7f7bd17fa640 1 -- 10.20.193.110:0/1093495710 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7bdc08f470 con 0x7f7bdc092020 2026-02-13T20:25:36.020 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.005+0000 7f7bd17fa640 1 -- 10.20.193.110:0/1093495710 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f7bc40029b0 con 0x7f7bdc092020 2026-02-13T20:25:36.020 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.005+0000 7f7bd17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:36.020 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.005+0000 7f7bd17fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:25:36.020 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.005+0000 7f7bd17fa640 10 monclient: dump: 2026-02-13T20:25:36.020 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:36.020 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:36.020 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:36.020 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:36.020 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:36.020 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:36.020 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:36.020 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:36.020 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:36.020 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:36.021 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.005+0000 7f7bd17fa640 1 -- 10.20.193.110:0/1093495710 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1646744389 0 0) 0x7f7bdc08f470 con 0x7f7bdc092020 2026-02-13T20:25:36.021 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.005+0000 7f7bd17fa640 1 -- 10.20.193.110:0/1093495710 --> v1:10.20.193.188:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7bdc08b450 con 0x7f7bdc092020 2026-02-13T20:25:36.021 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.006+0000 7f7bd17fa640 1 -- 10.20.193.110:0/1093495710 <== mon.1 v1:10.20.193.188:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f7bc4007050 con 0x7f7bdc092020 2026-02-13T20:25:36.021 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.006+0000 7f7bd17fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:25:36.021 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.006+0000 7f7bd17fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:25:36.021 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.006+0000 7f7bd17fa640 1 -- 10.20.193.110:0/1093495710 >> v1:10.20.193.188:6789/0 conn(0x7f7bdc092020 legacy=0x7f7bdc08dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:36.021 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.006+0000 7f7bd17fa640 1 -- 10.20.193.110:0/1093495710 >> v1:10.20.193.188:6789/0 conn(0x7f7bdc092020 legacy=0x7f7bdc08dd50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:25:36.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.009+0000 7f7be2eaf640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:25:36.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.009+0000 7f7be2eaf640 1 -- 10.20.193.110:0/1093495710 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7bdc055bb0 con 0x7f7bdc12ab10 2026-02-13T20:25:36.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.010+0000 7f7bd17fa640 1 -- 10.20.193.110:0/1093495710 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 36235055 0 0) 0x7f7bdc055bb0 con 0x7f7bdc12ab10 2026-02-13T20:25:36.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.010+0000 7f7bd17fa640 10 monclient(hunting): _negotiate 2026-02-13T20:25:36.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.010+0000 7f7bd17fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:36.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.010+0000 7f7bd17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:36.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.010+0000 7f7bd17fa640 10 monclient(hunting): my global_id is 144151 2026-02-13T20:25:36.022 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.010+0000 7f7bd17fa640 1 -- 10.20.193.110:0/1093495710 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bdc08f470 con 0x7f7bdc12ab10 2026-02-13T20:25:36.023 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.010+0000 7f7bd17fa640 1 -- 10.20.193.110:0/1093495710 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 357765879 0 0) 0x7f7bdc08f470 con 0x7f7bdc12ab10 2026-02-13T20:25:36.023 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.010+0000 7f7bd17fa640 1 -- 10.20.193.110:0/1093495710 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7bdc055bb0 con 0x7f7bdc12ab10 2026-02-13T20:25:36.023 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.010+0000 7f7bd17fa640 1 -- 10.20.193.110:0/1093495710 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f7bc4005680 con 0x7f7bdc12ab10 2026-02-13T20:25:36.023 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.010+0000 7f7bd17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:36.023 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.010+0000 7f7bd17fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:25:36.023 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.010+0000 7f7bd17fa640 10 monclient: dump: 2026-02-13T20:25:36.023 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:36.023 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:36.023 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:36.023 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:36.023 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:36.023 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:36.023 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:36.023 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:36.023 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:36.023 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:36.023 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.010+0000 7f7bd17fa640 1 -- 10.20.193.110:0/1093495710 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1627900820 0 0) 0x7f7bdc055bb0 con 0x7f7bdc12ab10 2026-02-13T20:25:36.023 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.010+0000 7f7bd17fa640 1 -- 10.20.193.110:0/1093495710 --> v1:10.20.193.188:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7bdc058410 con 0x7f7bdc12ab10 2026-02-13T20:25:36.023 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.010+0000 7f7bd17fa640 1 -- 10.20.193.110:0/1093495710 <== mon.1 v1:10.20.193.188:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4345 (unknown 0 0 2606998998) 0x7f7bc4006b80 con 0x7f7bdc12ab10 2026-02-13T20:25:36.024 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.010+0000 7f7bd17fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:25:36.024 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.010+0000 7f7bd17fa640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:25:36.024 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.010+0000 7f7bd17fa640 1 -- 10.20.193.110:0/1093495710 >> v1:10.20.193.188:6789/0 conn(0x7f7bdc12ab10 legacy=0x7f7bdc11a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:36.024 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.010+0000 7f7bd17fa640 1 -- 10.20.193.110:0/1093495710 >> v1:10.20.193.188:6789/0 conn(0x7f7bdc12ab10 legacy=0x7f7bdc11a100 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:25:36.024 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:25:36.024 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:25:36.024 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:25:36.024 INFO:teuthology.orchestra.run.trial110.stdout: "state": "peon", 2026-02-13T20:25:36.024 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 52, 2026-02-13T20:25:36.024 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 2281, 2026-02-13T20:25:36.024 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:25:36.024 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:25:36.024 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:25:36.025 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:25:36.025 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:25:36.025 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 2, 2026-02-13T20:25:36.025 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:25:36.025 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:25:36.025 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:25:36.025 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:25:36.025 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:25:36.025 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:25:36.025 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:25:36.025 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:25:36.025 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:25:36.025 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:25:36.025 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:25:36.025 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:25:36.025 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:25:36.025 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:25:36.025 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:25:36.026 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:25:36.026 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:25:36.026 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:25:36.026 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:25:36.026 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:25:36.026 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:25:36.026 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:25:36.026 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:25:36.026 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:25:36.026 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:25:36.026 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:25:36.026 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:25:36.026 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:25:36.026 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:25:36.026 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:25:36.026 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:25:36.026 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:25:36.026 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:25:36.026 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:36.027 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:25:36.027 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:25:36.027 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:25:36.027 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:25:36.027 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:25:36.027 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:25:36.027 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:25:36.027 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:25:36.027 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:25:36.027 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:25:36.027 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:25:36.027 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:25:36.027 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:25:36.027 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:25:36.027 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:25:36.027 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:25:36.027 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:25:36.028 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:25:36.028 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:25:36.028 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:25:36.028 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:25:36.028 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:25:36.028 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:25:36.028 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:25:36.028 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:25:36.028 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:25:36.028 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:25:36.028 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:25:36.028 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:25:36.028 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:25:36.028 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:25:36.028 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:25:36.028 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:36.028 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:25:36.028 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:36.028 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:25:36.029 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:25:36.029 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:25:36.029 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:25:36.029 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:36.029 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:25:36.029 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:25:36.029 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:25:36.029 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:36.029 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:25:36.029 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:36.029 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:25:36.029 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:25:36.029 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:25:36.029 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:25:36.029 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:25:36.029 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:25:36.029 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:36.029 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:36.029 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:25:36.030 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:25:36.030 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:25:36.030 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:25:36.030 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:36.030 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:25:36.030 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:25:36.030 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:25:36.030 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:36.030 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:25:36.030 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:36.030 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:25:36.030 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:25:36.030 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:25:36.030 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:25:36.030 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:25:36.030 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:25:36.030 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:36.030 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:36.031 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:25:36.031 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:25:36.031 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:25:36.031 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:25:36.031 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:36.031 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:25:36.031 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:25:36.031 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:25:36.031 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:36.031 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:25:36.031 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:36.031 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:25:36.031 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:25:36.031 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:25:36.031 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:25:36.031 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:25:36.031 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:25:36.031 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:36.031 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:25:36.032 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:36.032 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:25:36.032 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:25:36.032 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:36.032 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:25:36.032 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:25:36.032 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:25:36.032 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:36.032 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:25:36.032 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:25:36.032 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:36.032 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:25:36.032 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:25:36.032 INFO:teuthology.orchestra.run.trial110.stdout: "num": 2 2026-02-13T20:25:36.032 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:36.032 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:25:36.032 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:36.032 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:25:36.033 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:25:36.034 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.010+0000 7f7be2eaf640 1 -- 10.20.193.110:0/1093495710 >> v1:10.20.193.188:6812/1623052694 conn(0x7f7bac03fa50 legacy=0x7f7bac05ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:36.034 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.010+0000 7f7be2eaf640 10 monclient: shutdown 2026-02-13T20:25:36.034 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.010+0000 7f7be2eaf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:25:36.034 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.010+0000 7f7be2eaf640 1 -- 10.20.193.110:0/1093495710 >> v1:10.20.193.110:6789/0 conn(0x7f7bdc091950 legacy=0x7f7bdc129bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:36.034 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.010+0000 7f7be1425640 1 -- 10.20.193.110:0/1093495710 reap_dead start 2026-02-13T20:25:36.034 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.011+0000 7f7be1425640 1 -- 10.20.193.110:0/1093495710 reap_dead start 2026-02-13T20:25:36.034 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.011+0000 7f7be2eaf640 1 -- 10.20.193.110:0/1093495710 shutdown_connections 2026-02-13T20:25:36.034 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.011+0000 7f7be2eaf640 1 -- 10.20.193.110:0/1093495710 >> 10.20.193.110:0/1093495710 conn(0x7f7bdc054e90 msgr2=0x7f7bdc08a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:25:36.034 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.011+0000 7f7be2eaf640 1 -- 10.20.193.110:0/1093495710 shutdown_connections 2026-02-13T20:25:36.034 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.011+0000 7f7be2eaf640 1 -- 10.20.193.110:0/1093495710 wait complete. 2026-02-13T20:25:36.034 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:25:36.035 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2026-02-13T20:25:36.035 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-13T20:25:36.035 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2026-02-13T20:25:36.035 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-13T20:25:36.035 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-13T20:25:36.035 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T20:25:36.047 INFO:tasks.ceph.mon.c:Stopped 2026-02-13T20:25:36.047 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-13T20:25:36.047 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T20:25:36.157 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.149+0000 7f6afcecc640 10 monclient: get_monmap_and_config 2026-02-13T20:25:36.157 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.149+0000 7f6afcecc640 10 monclient: build_initial_monmap 2026-02-13T20:25:36.157 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.149+0000 7f6afcecc640 10 monclient: monmap: 2026-02-13T20:25:36.157 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:25:36.157 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:36.157 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:25:36.151325+0000 2026-02-13T20:25:36.157 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:25:36.151325+0000 2026-02-13T20:25:36.157 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:25:36.157 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:36.157 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:25:36.157 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:25:36.157 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:25:36.157 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:36.157 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.150+0000 7f6afcecc640 1 Processor -- start 2026-02-13T20:25:36.157 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.150+0000 7f6afcecc640 1 -- start start 2026-02-13T20:25:36.157 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.150+0000 7f6afcecc640 10 monclient: init 2026-02-13T20:25:36.157 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.150+0000 7f6afcecc640 10 monclient: _reopen_session rank -1 2026-02-13T20:25:36.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.150+0000 7f6afcecc640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:25:36.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.150+0000 7f6afcecc640 10 monclient(hunting): picked mon.noname-b con 0x7f6af81401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:25:36.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.150+0000 7f6afcecc640 10 monclient(hunting): picked mon.noname-c con 0x7f6af8092020 addr v1:10.20.193.188:6789/0 2026-02-13T20:25:36.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.150+0000 7f6afcecc640 10 monclient(hunting): picked mon.noname-a con 0x7f6af8091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:25:36.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.150+0000 7f6afcecc640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6af808b730 con 0x7f6af8091950 2026-02-13T20:25:36.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.150+0000 7f6afcecc640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6af805c5b0 con 0x7f6af8092020 2026-02-13T20:25:36.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.150+0000 7f6afcecc640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6af808bcf0 con 0x7f6af81401c0 2026-02-13T20:25:36.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.150+0000 7f6afcecc640 10 monclient(hunting): _renew_subs 2026-02-13T20:25:36.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.150+0000 7f6afcecc640 10 monclient(hunting): authenticate will time out at 1497.841654s 2026-02-13T20:25:36.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.150+0000 7f6af6575640 1 -- >> v1:10.20.193.110:6790/0 conn(0x7f6af81401c0 legacy=0x7f6af8091240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6790/0 2026-02-13T20:25:36.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.150+0000 7f6af6d76640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f6af8091950 0x7f6af81a2a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:48200/0 (socket says 10.20.193.110:48200) 2026-02-13T20:25:36.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.150+0000 7f6af6d76640 1 -- 10.20.193.110:0/2843425074 learned_addr learned my addr 10.20.193.110:0/2843425074 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:25:36.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.151+0000 7f6af5573640 1 -- 10.20.193.110:0/2843425074 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 276352727 0 0) 0x7f6af808b730 con 0x7f6af8091950 2026-02-13T20:25:36.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.151+0000 7f6af5573640 10 monclient(hunting): _negotiate 2026-02-13T20:25:36.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.151+0000 7f6af5573640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:36.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.151+0000 7f6af5573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:36.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.151+0000 7f6af5573640 10 monclient(hunting): my global_id is 124350 2026-02-13T20:25:36.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.151+0000 7f6af5573640 1 -- 10.20.193.110:0/2843425074 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ae40035e0 con 0x7f6af8091950 2026-02-13T20:25:36.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.151+0000 7f6af5573640 1 -- 10.20.193.110:0/2843425074 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2198581736 0 0) 0x7f6ae40035e0 con 0x7f6af8091950 2026-02-13T20:25:36.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.151+0000 7f6af5573640 1 -- 10.20.193.110:0/2843425074 >> v1:10.20.193.110:6790/0 conn(0x7f6af81401c0 legacy=0x7f6af8091240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:25:36.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.151+0000 7f6af5573640 1 -- 10.20.193.110:0/2843425074 >> v1:10.20.193.188:6789/0 conn(0x7f6af8092020 legacy=0x7f6af81812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:36.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.151+0000 7f6af5573640 10 monclient: _finish_hunting 0 2026-02-13T20:25:36.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.151+0000 7f6af5573640 1 monclient: found mon.noname-a 2026-02-13T20:25:36.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.151+0000 7f6af5573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:25:36.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.151+0000 7f6af5573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:25:36.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.151+0000 7f6af5573640 1 -- 10.20.193.110:0/2843425074 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6af8140590 con 0x7f6af8091950 2026-02-13T20:25:36.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.151+0000 7f6af5573640 10 monclient: _finish_auth 0 2026-02-13T20:25:36.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.151+0000 7f6af5573640 10 monclient: _check_auth_tickets 2026-02-13T20:25:36.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.151+0000 7f6af5573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:25:36.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.151+0000 7f6afcecc640 5 monclient: authenticate success, global_id 124350 2026-02-13T20:25:36.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.151+0000 7f6af5573640 1 -- 10.20.193.110:0/2843425074 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f6ae8003eb0 con 0x7f6af8091950 2026-02-13T20:25:36.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.151+0000 7f6afcecc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:25:36.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.151+0000 7f6af5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:36.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.151+0000 7f6af5573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:25:36.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.151+0000 7f6af5573640 10 monclient: dump: 2026-02-13T20:25:36.158 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:36.159 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:36.159 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:36.159 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:36.159 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:36.159 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:36.159 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:36.159 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:36.159 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:36.159 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:36.159 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.151+0000 7f6afcecc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:25:36.159 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.151+0000 7f6af5573640 1 -- 10.20.193.110:0/2843425074 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6ae8004080 con 0x7f6af8091950 2026-02-13T20:25:36.159 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.151+0000 7f6af5573640 10 monclient: handle_config config(0 keys) 2026-02-13T20:25:36.159 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.151+0000 7f6af5573640 1 -- 10.20.193.110:0/2843425074 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f6ae8004490 con 0x7f6af8091950 2026-02-13T20:25:36.159 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.151+0000 7f6afcecc640 10 monclient: get_monmap_and_config success 2026-02-13T20:25:36.159 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.151+0000 7f6afcecc640 4 set_mon_vals no callback set 2026-02-13T20:25:36.159 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.151+0000 7f6af5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:36.159 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.151+0000 7f6af5573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:25:36.159 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.151+0000 7f6af5573640 10 monclient: dump: 2026-02-13T20:25:36.159 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:36.159 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:36.159 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:36.159 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:36.159 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:36.159 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:36.159 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:36.159 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:36.159 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:36.159 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:36.159 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.151+0000 7f6afcecc640 10 monclient: shutdown 2026-02-13T20:25:36.159 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.151+0000 7f6afcecc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:25:36.159 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.151+0000 7f6afcecc640 1 -- 10.20.193.110:0/2843425074 >> v1:10.20.193.110:6789/0 conn(0x7f6af8091950 legacy=0x7f6af81a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:36.159 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.151+0000 7f6afcecc640 1 -- 10.20.193.110:0/2843425074 shutdown_connections 2026-02-13T20:25:36.159 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.151+0000 7f6afcecc640 1 -- 10.20.193.110:0/2843425074 >> 10.20.193.110:0/2843425074 conn(0x7f6af8054e90 msgr2=0x7f6af8058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:25:36.159 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.151+0000 7f6afcecc640 1 -- 10.20.193.110:0/2843425074 shutdown_connections 2026-02-13T20:25:36.159 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.151+0000 7f6afcecc640 1 -- 10.20.193.110:0/2843425074 wait complete. 2026-02-13T20:25:36.159 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.151+0000 7f6afcecc640 10 monclient: build_initial_monmap 2026-02-13T20:25:36.159 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.151+0000 7f6afcecc640 10 monclient: monmap: 2026-02-13T20:25:36.159 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:25:36.159 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:25:36.160 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:25:36.160 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:25:36.160 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:25:36.160 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:25:36.160 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:25:36.160 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:25:36.160 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:25:36.160 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:36.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.152+0000 7f6afcecc640 1 Processor -- start 2026-02-13T20:25:36.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.152+0000 7f6afcecc640 1 -- start start 2026-02-13T20:25:36.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.152+0000 7f6afcecc640 10 monclient: init 2026-02-13T20:25:36.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.152+0000 7f6afcecc640 10 monclient: _reopen_session rank -1 2026-02-13T20:25:36.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.152+0000 7f6afcecc640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:25:36.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.152+0000 7f6afcecc640 10 monclient(hunting): picked mon.noname-c con 0x7f6af8091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:25:36.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.152+0000 7f6afcecc640 10 monclient(hunting): picked mon.noname-a con 0x7f6af81401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:25:36.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.152+0000 7f6afcecc640 10 monclient(hunting): picked mon.noname-b con 0x7f6af8150550 addr v1:10.20.193.188:6789/0 2026-02-13T20:25:36.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.152+0000 7f6afcecc640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6af8090ec0 con 0x7f6af81401c0 2026-02-13T20:25:36.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.152+0000 7f6afcecc640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6af8132240 con 0x7f6af8150550 2026-02-13T20:25:36.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.152+0000 7f6afcecc640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6af808c2a0 con 0x7f6af8091950 2026-02-13T20:25:36.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.152+0000 7f6afcecc640 10 monclient(hunting): _renew_subs 2026-02-13T20:25:36.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.152+0000 7f6afcecc640 10 monclient(hunting): authenticate will time out at 1497.843464s 2026-02-13T20:25:36.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.152+0000 7f6af6575640 1 -- >> v1:10.20.193.110:6790/0 conn(0x7f6af8091950 legacy=0x7f6af813e820 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.110:6790/0 2026-02-13T20:25:36.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.152+0000 7f6af5d74640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f6af81401c0 0x7f6af8193a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:48214/0 (socket says 10.20.193.110:48214) 2026-02-13T20:25:36.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.152+0000 7f6af5d74640 1 -- 10.20.193.110:0/3481399508 learned_addr learned my addr 10.20.193.110:0/3481399508 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:25:36.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.152+0000 7f6adeffd640 1 -- 10.20.193.110:0/3481399508 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 760892496 0 0) 0x7f6af8090ec0 con 0x7f6af81401c0 2026-02-13T20:25:36.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.152+0000 7f6adeffd640 10 monclient(hunting): _negotiate 2026-02-13T20:25:36.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.152+0000 7f6adeffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:36.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.152+0000 7f6adeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:36.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.152+0000 7f6adeffd640 10 monclient(hunting): my global_id is 124353 2026-02-13T20:25:36.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.152+0000 7f6adeffd640 1 -- 10.20.193.110:0/3481399508 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ac40035e0 con 0x7f6af81401c0 2026-02-13T20:25:36.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.152+0000 7f6adeffd640 1 -- 10.20.193.110:0/3481399508 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2352731606 0 0) 0x7f6ac40035e0 con 0x7f6af81401c0 2026-02-13T20:25:36.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.152+0000 7f6adeffd640 1 -- 10.20.193.110:0/3481399508 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6af8090ec0 con 0x7f6af81401c0 2026-02-13T20:25:36.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.152+0000 7f6adeffd640 1 -- 10.20.193.110:0/3481399508 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f6ae0003170 con 0x7f6af81401c0 2026-02-13T20:25:36.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.152+0000 7f6adeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:25:36.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.152+0000 7f6adeffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:25:36.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.152+0000 7f6adeffd640 10 monclient(hunting): dump: 2026-02-13T20:25:36.160 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:36.160 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:36.160 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:36.161 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:36.161 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:36.161 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:36.161 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:36.161 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:36.161 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:36.161 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:36.161 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.152+0000 7f6adeffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:25:36.161 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.152+0000 7f6adeffd640 1 -- 10.20.193.110:0/3481399508 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2558056859 0 0) 0x7f6af8132240 con 0x7f6af8150550 2026-02-13T20:25:36.161 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.152+0000 7f6adeffd640 10 monclient(hunting): _negotiate 2026-02-13T20:25:36.161 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.152+0000 7f6adeffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:36.161 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.152+0000 7f6adeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:36.161 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.152+0000 7f6adeffd640 10 monclient(hunting): my global_id is 144157 2026-02-13T20:25:36.161 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.152+0000 7f6adeffd640 1 -- 10.20.193.110:0/3481399508 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ac40035e0 con 0x7f6af8150550 2026-02-13T20:25:36.161 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.153+0000 7f6adeffd640 1 -- 10.20.193.110:0/3481399508 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1037116898 0 0) 0x7f6af8090ec0 con 0x7f6af81401c0 2026-02-13T20:25:36.161 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.153+0000 7f6adeffd640 1 -- 10.20.193.110:0/3481399508 >> v1:10.20.193.110:6790/0 conn(0x7f6af8091950 legacy=0x7f6af813e820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T20:25:36.161 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.153+0000 7f6adeffd640 1 -- 10.20.193.110:0/3481399508 >> v1:10.20.193.188:6789/0 conn(0x7f6af8150550 legacy=0x7f6af8195160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:36.161 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.153+0000 7f6adeffd640 10 monclient: _finish_hunting 0 2026-02-13T20:25:36.161 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.153+0000 7f6adeffd640 1 monclient: found mon.a 2026-02-13T20:25:36.161 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.153+0000 7f6adeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:25:36.161 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.153+0000 7f6adeffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:25:36.161 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.153+0000 7f6adeffd640 1 -- 10.20.193.110:0/3481399508 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6af805d320 con 0x7f6af81401c0 2026-02-13T20:25:36.161 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.153+0000 7f6adeffd640 10 monclient: _finish_auth 0 2026-02-13T20:25:36.161 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.153+0000 7f6adeffd640 10 monclient: _check_auth_tickets 2026-02-13T20:25:36.161 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.153+0000 7f6adeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:25:36.161 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.153+0000 7f6afcecc640 5 monclient: authenticate success, global_id 124353 2026-02-13T20:25:36.161 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.153+0000 7f6afcecc640 10 monclient: _renew_subs 2026-02-13T20:25:36.161 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.153+0000 7f6afcecc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:25:36.161 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.153+0000 7f6afcecc640 1 -- 10.20.193.110:0/3481399508 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6af808a730 con 0x7f6af81401c0 2026-02-13T20:25:36.161 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.153+0000 7f6afcecc640 10 monclient: _renew_subs 2026-02-13T20:25:36.161 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.153+0000 7f6afcecc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:25:36.161 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.153+0000 7f6afcecc640 1 -- 10.20.193.110:0/3481399508 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6af8130bf0 con 0x7f6af81401c0 2026-02-13T20:25:36.161 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.153+0000 7f6adeffd640 1 -- 10.20.193.110:0/3481399508 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6ae00034e0 con 0x7f6af81401c0 2026-02-13T20:25:36.161 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.153+0000 7f6adeffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:25:36.161 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.153+0000 7f6adeffd640 1 -- 10.20.193.110:0/3481399508 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f6ae0003b30 con 0x7f6af81401c0 2026-02-13T20:25:36.161 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.153+0000 7f6adeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:36.161 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.153+0000 7f6adeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:25:36.161 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.153+0000 7f6adeffd640 10 monclient: dump: 2026-02-13T20:25:36.161 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:36.161 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:36.162 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:36.162 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:36.162 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:36.162 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:36.162 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:36.162 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:36.162 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:36.162 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:36.162 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.153+0000 7f6af4d72640 4 set_mon_vals no callback set 2026-02-13T20:25:36.162 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.153+0000 7f6afcecc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:25:36.162 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.153+0000 7f6afcecc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:25:36.162 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.153+0000 7f6afcecc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:25:36.162 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.153+0000 7f6afcecc640 1 -- 10.20.193.110:0/3481399508 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6af8150950 con 0x7f6af81401c0 2026-02-13T20:25:36.162 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.153+0000 7f6adeffd640 1 -- 10.20.193.110:0/3481399508 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f6ae0003c90 con 0x7f6af81401c0 2026-02-13T20:25:36.162 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.154+0000 7f6adeffd640 1 -- 10.20.193.110:0/3481399508 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(680..680 src has 1..680) ==== 3899+0+0 (unknown 3290828237 0 0) 0x7f6ae004ea10 con 0x7f6af81401c0 2026-02-13T20:25:36.162 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.154+0000 7f6af6575640 10 monclient: get_auth_request con 0x7f6ac403f790 auth_method 0 2026-02-13T20:25:36.162 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.156+0000 7f6adeffd640 1 -- 10.20.193.110:0/3481399508 <== mon.0 v1:10.20.193.110:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f6af8150950 con 0x7f6af81401c0 2026-02-13T20:25:36.162 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.156+0000 7f6adeffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:25:36.162 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.156+0000 7f6adeffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:25:36.307 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.306+0000 7f6afcecc640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T20:25:36.307 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.306+0000 7f6afcecc640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T20:25:36.308 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.306+0000 7f6afcecc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:25:36.308 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.306+0000 7f6afcecc640 1 -- 10.20.193.110:0/3481399508 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6af8150950 con 0x7f6af81401c0 2026-02-13T20:25:36.308 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.306+0000 7f6adeffd640 1 -- 10.20.193.110:0/3481399508 <== mon.0 v1:10.20.193.110:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 831069715) 0x7f6af8150950 con 0x7f6af81401c0 2026-02-13T20:25:36.308 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.306+0000 7f6adeffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T20:25:36.308 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.306+0000 7f6adeffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:25:36.308 INFO:teuthology.orchestra.run.trial110.stdout:{"election_epoch":52,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","modified":"2026-02-13T20:11:07.161192Z","created":"2026-02-13T20:11:07.161192Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6789","nonce":0}]},"addr":"10.20.193.110:6789/0","public_addr":"10.20.193.110:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161241+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6789","nonce":0}]},"addr":"10.20.193.188:6789/0","public_addr":"10.20.193.188:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161242+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6790","nonce":0}]},"addr":"10.20.193.110:6790/0","public_addr":"10.20.193.110:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161243+0000","crush_location":[]}]}} 2026-02-13T20:25:36.309 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.307+0000 7f6afcecc640 1 -- 10.20.193.110:0/3481399508 >> v1:10.20.193.188:6812/1623052694 conn(0x7f6ac403f790 legacy=0x7f6ac405fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:36.309 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.307+0000 7f6afcecc640 10 monclient: shutdown 2026-02-13T20:25:36.309 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.307+0000 7f6afcecc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:25:36.309 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.307+0000 7f6afcecc640 1 -- 10.20.193.110:0/3481399508 >> v1:10.20.193.110:6789/0 conn(0x7f6af81401c0 legacy=0x7f6af8193a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:36.309 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.307+0000 7f6afcecc640 1 -- 10.20.193.110:0/3481399508 shutdown_connections 2026-02-13T20:25:36.309 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.307+0000 7f6afcecc640 1 -- 10.20.193.110:0/3481399508 >> 10.20.193.110:0/3481399508 conn(0x7f6af8054e90 msgr2=0x7f6af808dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:25:36.309 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.308+0000 7f6afcecc640 1 -- 10.20.193.110:0/3481399508 shutdown_connections 2026-02-13T20:25:36.309 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:36.308+0000 7f6afcecc640 1 -- 10.20.193.110:0/3481399508 wait complete. 2026-02-13T20:25:39.317 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T20:25:39.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.383+0000 7f529205b640 10 monclient: get_monmap_and_config 2026-02-13T20:25:39.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.383+0000 7f529205b640 10 monclient: build_initial_monmap 2026-02-13T20:25:39.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.384+0000 7f529205b640 10 monclient: monmap: 2026-02-13T20:25:39.392 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:25:39.392 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:39.393 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:25:39.385422+0000 2026-02-13T20:25:39.393 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:25:39.385422+0000 2026-02-13T20:25:39.393 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:25:39.393 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:39.393 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:25:39.393 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:25:39.393 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:25:39.393 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:39.393 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.384+0000 7f529205b640 1 Processor -- start 2026-02-13T20:25:39.393 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.384+0000 7f529205b640 1 -- start start 2026-02-13T20:25:39.393 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.384+0000 7f529205b640 10 monclient: init 2026-02-13T20:25:39.394 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.384+0000 7f529205b640 10 monclient: _reopen_session rank -1 2026-02-13T20:25:39.394 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.384+0000 7f529205b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:25:39.394 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.384+0000 7f529205b640 10 monclient(hunting): picked mon.noname-a con 0x7f528c1401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:25:39.394 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.384+0000 7f529205b640 10 monclient(hunting): picked mon.noname-b con 0x7f528c092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:25:39.394 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.384+0000 7f529205b640 10 monclient(hunting): picked mon.noname-c con 0x7f528c091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:25:39.394 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.384+0000 7f529205b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f528c08b730 con 0x7f528c1401c0 2026-02-13T20:25:39.394 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.384+0000 7f529205b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f528c05c5b0 con 0x7f528c091950 2026-02-13T20:25:39.394 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.384+0000 7f529205b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f528c08bcf0 con 0x7f528c092020 2026-02-13T20:25:39.394 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.384+0000 7f529205b640 10 monclient(hunting): _renew_subs 2026-02-13T20:25:39.394 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.384+0000 7f529205b640 10 monclient(hunting): authenticate will time out at 1501.075744s 2026-02-13T20:25:39.394 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.384+0000 7f528affd640 1 -- >> v1:10.20.193.110:6790/0 conn(0x7f528c092020 legacy=0x7f528c1812f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6790/0 2026-02-13T20:25:39.395 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.384+0000 7f528b7fe640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f528c1401c0 0x7f528c091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:48230/0 (socket says 10.20.193.110:48230) 2026-02-13T20:25:39.395 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.384+0000 7f528b7fe640 1 -- 10.20.193.110:0/340035676 learned_addr learned my addr 10.20.193.110:0/340035676 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:25:39.395 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.385+0000 7f528a7fc640 1 -- 10.20.193.110:0/340035676 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2687470188 0 0) 0x7f528c08b730 con 0x7f528c1401c0 2026-02-13T20:25:39.395 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.385+0000 7f528a7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:25:39.395 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.385+0000 7f528a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:39.395 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.385+0000 7f528a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:39.395 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.385+0000 7f528a7fc640 10 monclient(hunting): my global_id is 124356 2026-02-13T20:25:39.395 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.385+0000 7f528a7fc640 1 -- 10.20.193.110:0/340035676 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52700035e0 con 0x7f528c1401c0 2026-02-13T20:25:39.395 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.385+0000 7f528a7fc640 1 -- 10.20.193.110:0/340035676 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2725088273 0 0) 0x7f52700035e0 con 0x7f528c1401c0 2026-02-13T20:25:39.395 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.385+0000 7f528a7fc640 1 -- 10.20.193.110:0/340035676 >> v1:10.20.193.110:6790/0 conn(0x7f528c092020 legacy=0x7f528c1812f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:25:39.396 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.385+0000 7f528a7fc640 1 -- 10.20.193.110:0/340035676 >> v1:10.20.193.188:6789/0 conn(0x7f528c091950 legacy=0x7f528c1a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:39.396 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.385+0000 7f528a7fc640 10 monclient: _finish_hunting 0 2026-02-13T20:25:39.396 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.385+0000 7f528a7fc640 1 monclient: found mon.noname-a 2026-02-13T20:25:39.396 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.385+0000 7f528a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:25:39.396 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.385+0000 7f528a7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:25:39.396 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.385+0000 7f528a7fc640 1 -- 10.20.193.110:0/340035676 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f528c140590 con 0x7f528c1401c0 2026-02-13T20:25:39.396 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.385+0000 7f528a7fc640 10 monclient: _finish_auth 0 2026-02-13T20:25:39.396 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.385+0000 7f528a7fc640 10 monclient: _check_auth_tickets 2026-02-13T20:25:39.396 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.385+0000 7f528a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:25:39.396 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.385+0000 7f528a7fc640 1 -- 10.20.193.110:0/340035676 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f5278002dd0 con 0x7f528c1401c0 2026-02-13T20:25:39.396 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.385+0000 7f528a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:39.397 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.385+0000 7f528a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:25:39.397 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.385+0000 7f528a7fc640 10 monclient: dump: 2026-02-13T20:25:39.397 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:39.397 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:39.397 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:39.397 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:39.397 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:39.397 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:39.397 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:39.397 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:39.398 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:39.398 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:39.398 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.385+0000 7f529205b640 5 monclient: authenticate success, global_id 124356 2026-02-13T20:25:39.398 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.385+0000 7f529205b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:25:39.398 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.385+0000 7f528a7fc640 1 -- 10.20.193.110:0/340035676 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5278002fa0 con 0x7f528c1401c0 2026-02-13T20:25:39.398 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.385+0000 7f528a7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:25:39.398 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.385+0000 7f529205b640 10 monclient: get_monmap_and_config success 2026-02-13T20:25:39.398 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.385+0000 7f529205b640 4 set_mon_vals no callback set 2026-02-13T20:25:39.398 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.385+0000 7f528a7fc640 1 -- 10.20.193.110:0/340035676 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f52780033b0 con 0x7f528c1401c0 2026-02-13T20:25:39.398 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.385+0000 7f528a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:39.398 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.385+0000 7f528a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:25:39.399 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.385+0000 7f528a7fc640 10 monclient: dump: 2026-02-13T20:25:39.399 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:39.399 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:39.399 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:39.399 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:39.399 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:39.399 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:39.399 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:39.399 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:39.399 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:39.399 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:39.400 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.385+0000 7f529205b640 10 monclient: shutdown 2026-02-13T20:25:39.400 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.385+0000 7f529205b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:25:39.400 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.385+0000 7f529205b640 1 -- 10.20.193.110:0/340035676 >> v1:10.20.193.110:6789/0 conn(0x7f528c1401c0 legacy=0x7f528c091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:39.400 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.385+0000 7f529205b640 1 -- 10.20.193.110:0/340035676 shutdown_connections 2026-02-13T20:25:39.400 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.385+0000 7f529205b640 1 -- 10.20.193.110:0/340035676 >> 10.20.193.110:0/340035676 conn(0x7f528c054e90 msgr2=0x7f528c058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:25:39.400 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.385+0000 7f529205b640 1 -- 10.20.193.110:0/340035676 shutdown_connections 2026-02-13T20:25:39.400 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.385+0000 7f529205b640 1 -- 10.20.193.110:0/340035676 wait complete. 2026-02-13T20:25:39.400 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.386+0000 7f529205b640 10 monclient: build_initial_monmap 2026-02-13T20:25:39.400 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.386+0000 7f529205b640 10 monclient: monmap: 2026-02-13T20:25:39.400 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:25:39.400 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:25:39.400 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:25:39.401 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:25:39.401 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:25:39.401 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:25:39.401 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:25:39.401 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:25:39.401 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:25:39.401 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:39.401 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.386+0000 7f529205b640 1 Processor -- start 2026-02-13T20:25:39.401 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.386+0000 7f529205b640 1 -- start start 2026-02-13T20:25:39.401 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.386+0000 7f529205b640 10 monclient: init 2026-02-13T20:25:39.401 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.386+0000 7f529205b640 10 monclient: _reopen_session rank -1 2026-02-13T20:25:39.401 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.386+0000 7f529205b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:25:39.402 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.386+0000 7f529205b640 10 monclient(hunting): picked mon.noname-a con 0x7f528c091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:25:39.402 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.386+0000 7f529205b640 10 monclient(hunting): picked mon.noname-b con 0x7f528c1401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:25:39.402 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.386+0000 7f529205b640 10 monclient(hunting): picked mon.noname-c con 0x7f528c124630 addr v1:10.20.193.110:6790/0 2026-02-13T20:25:39.402 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.386+0000 7f529205b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f528c12d090 con 0x7f528c091950 2026-02-13T20:25:39.402 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.386+0000 7f529205b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f528c124ad0 con 0x7f528c1401c0 2026-02-13T20:25:39.402 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.386+0000 7f529205b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f528c12b010 con 0x7f528c124630 2026-02-13T20:25:39.402 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.386+0000 7f529205b640 10 monclient(hunting): _renew_subs 2026-02-13T20:25:39.402 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.386+0000 7f529205b640 10 monclient(hunting): authenticate will time out at 1501.077827s 2026-02-13T20:25:39.402 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.386+0000 7f528bfff640 1 -- >> v1:10.20.193.110:6790/0 conn(0x7f528c124630 legacy=0x7f528c1a2050 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.110:6790/0 2026-02-13T20:25:39.402 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.386+0000 7f528b7fe640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f528c091950 0x7f528c114200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:48240/0 (socket says 10.20.193.110:48240) 2026-02-13T20:25:39.402 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.386+0000 7f528b7fe640 1 -- 10.20.193.110:0/2025745848 learned_addr learned my addr 10.20.193.110:0/2025745848 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:25:39.402 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.387+0000 7f5267fff640 1 -- 10.20.193.110:0/2025745848 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3907265417 0 0) 0x7f528c12d090 con 0x7f528c091950 2026-02-13T20:25:39.403 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.387+0000 7f5267fff640 10 monclient(hunting): _negotiate 2026-02-13T20:25:39.403 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.387+0000 7f5267fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:39.403 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.387+0000 7f5267fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:39.403 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.387+0000 7f5267fff640 10 monclient(hunting): my global_id is 124359 2026-02-13T20:25:39.403 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.387+0000 7f5267fff640 1 -- 10.20.193.110:0/2025745848 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f525c0035e0 con 0x7f528c091950 2026-02-13T20:25:39.403 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.387+0000 7f5267fff640 1 -- 10.20.193.110:0/2025745848 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2021413972 0 0) 0x7f525c0035e0 con 0x7f528c091950 2026-02-13T20:25:39.403 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.387+0000 7f5267fff640 1 -- 10.20.193.110:0/2025745848 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f528c12d090 con 0x7f528c091950 2026-02-13T20:25:39.403 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.387+0000 7f5267fff640 1 -- 10.20.193.110:0/2025745848 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f52780032c0 con 0x7f528c091950 2026-02-13T20:25:39.403 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.387+0000 7f5267fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:25:39.403 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.387+0000 7f5267fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:25:39.403 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.387+0000 7f5267fff640 10 monclient(hunting): dump: 2026-02-13T20:25:39.403 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:39.404 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:39.404 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:39.404 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:39.404 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:39.404 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:39.404 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:39.404 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:39.404 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:39.404 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:39.404 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.387+0000 7f5267fff640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:25:39.404 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.387+0000 7f5267fff640 1 -- 10.20.193.110:0/2025745848 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3517878465 0 0) 0x7f528c12d090 con 0x7f528c091950 2026-02-13T20:25:39.404 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.387+0000 7f5267fff640 1 -- 10.20.193.110:0/2025745848 >> v1:10.20.193.110:6790/0 conn(0x7f528c124630 legacy=0x7f528c1a2050 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T20:25:39.404 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.387+0000 7f5267fff640 1 -- 10.20.193.110:0/2025745848 >> v1:10.20.193.188:6789/0 conn(0x7f528c1401c0 legacy=0x7f528c114910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:39.405 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.387+0000 7f5267fff640 10 monclient: _finish_hunting 0 2026-02-13T20:25:39.405 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.387+0000 7f5267fff640 1 monclient: found mon.a 2026-02-13T20:25:39.405 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.387+0000 7f5267fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:25:39.405 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.387+0000 7f5267fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:25:39.405 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.387+0000 7f5267fff640 1 -- 10.20.193.110:0/2025745848 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f528c12cdb0 con 0x7f528c091950 2026-02-13T20:25:39.405 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.387+0000 7f5267fff640 10 monclient: _finish_auth 0 2026-02-13T20:25:39.405 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.387+0000 7f5267fff640 10 monclient: _check_auth_tickets 2026-02-13T20:25:39.405 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.387+0000 7f5267fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:25:39.405 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.387+0000 7f529205b640 5 monclient: authenticate success, global_id 124359 2026-02-13T20:25:39.405 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.387+0000 7f529205b640 10 monclient: _renew_subs 2026-02-13T20:25:39.405 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.387+0000 7f529205b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:25:39.405 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.387+0000 7f529205b640 1 -- 10.20.193.110:0/2025745848 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f528c12cad0 con 0x7f528c091950 2026-02-13T20:25:39.406 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.387+0000 7f529205b640 10 monclient: _renew_subs 2026-02-13T20:25:39.406 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.387+0000 7f529205b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:25:39.406 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.387+0000 7f529205b640 1 -- 10.20.193.110:0/2025745848 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f528c1a3970 con 0x7f528c091950 2026-02-13T20:25:39.406 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.387+0000 7f5267fff640 1 -- 10.20.193.110:0/2025745848 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5278003460 con 0x7f528c091950 2026-02-13T20:25:39.406 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.387+0000 7f5267fff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:25:39.406 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.387+0000 7f5267fff640 1 -- 10.20.193.110:0/2025745848 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f5278004d40 con 0x7f528c091950 2026-02-13T20:25:39.406 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.387+0000 7f5267fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:39.406 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.387+0000 7f5267fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:25:39.406 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.387+0000 7f5267fff640 10 monclient: dump: 2026-02-13T20:25:39.406 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:39.406 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:39.406 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:39.406 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:39.407 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:39.407 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:39.407 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:39.407 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:39.407 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:39.407 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:39.407 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.387+0000 7f5289ffb640 4 set_mon_vals no callback set 2026-02-13T20:25:39.407 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.387+0000 7f529205b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:25:39.407 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.387+0000 7f529205b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:25:39.407 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.387+0000 7f529205b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:25:39.407 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.387+0000 7f529205b640 1 -- 10.20.193.110:0/2025745848 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f528c0008d0 con 0x7f528c091950 2026-02-13T20:25:39.407 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.388+0000 7f5267fff640 1 -- 10.20.193.110:0/2025745848 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f5278004ea0 con 0x7f528c091950 2026-02-13T20:25:39.408 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.388+0000 7f5267fff640 1 -- 10.20.193.110:0/2025745848 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(680..680 src has 1..680) ==== 3899+0+0 (unknown 3290828237 0 0) 0x7f527804eae0 con 0x7f528c091950 2026-02-13T20:25:39.408 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.388+0000 7f528affd640 10 monclient: get_auth_request con 0x7f525c03f630 auth_method 0 2026-02-13T20:25:39.408 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.390+0000 7f5267fff640 1 -- 10.20.193.110:0/2025745848 <== mon.0 v1:10.20.193.110:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f52780172a0 con 0x7f528c091950 2026-02-13T20:25:39.408 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.390+0000 7f5267fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:25:39.408 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.390+0000 7f5267fff640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:25:39.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.541+0000 7f529205b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T20:25:39.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.541+0000 7f529205b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T20:25:39.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.541+0000 7f529205b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:25:39.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.541+0000 7f529205b640 1 -- 10.20.193.110:0/2025745848 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f528c058410 con 0x7f528c091950 2026-02-13T20:25:39.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.541+0000 7f5267fff640 1 -- 10.20.193.110:0/2025745848 <== mon.0 v1:10.20.193.110:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 1474721587) 0x7f5278016a50 con 0x7f528c091950 2026-02-13T20:25:39.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.541+0000 7f5267fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T20:25:39.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.541+0000 7f5267fff640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:25:39.544 INFO:teuthology.orchestra.run.trial110.stdout:{"election_epoch":52,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":5,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","modified":"2026-02-13T20:11:07.161192Z","created":"2026-02-13T20:11:07.161192Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6789","nonce":0}]},"addr":"10.20.193.110:6789/0","public_addr":"10.20.193.110:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161241+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6789","nonce":0}]},"addr":"10.20.193.188:6789/0","public_addr":"10.20.193.188:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161242+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6790","nonce":0}]},"addr":"10.20.193.110:6790/0","public_addr":"10.20.193.110:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161243+0000","crush_location":[]}]}} 2026-02-13T20:25:39.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.542+0000 7f529205b640 1 -- 10.20.193.110:0/2025745848 >> v1:10.20.193.188:6812/1623052694 conn(0x7f525c03f630 legacy=0x7f525c05fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:39.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.542+0000 7f529205b640 10 monclient: shutdown 2026-02-13T20:25:39.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.542+0000 7f529205b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:25:39.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.542+0000 7f529205b640 1 -- 10.20.193.110:0/2025745848 >> v1:10.20.193.110:6789/0 conn(0x7f528c091950 legacy=0x7f528c114200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:39.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.542+0000 7f529205b640 1 -- 10.20.193.110:0/2025745848 shutdown_connections 2026-02-13T20:25:39.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.542+0000 7f529205b640 1 -- 10.20.193.110:0/2025745848 >> 10.20.193.110:0/2025745848 conn(0x7f528c054e90 msgr2=0x7f528c08dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:25:39.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.542+0000 7f529205b640 1 -- 10.20.193.110:0/2025745848 shutdown_connections 2026-02-13T20:25:39.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:39.542+0000 7f529205b640 1 -- 10.20.193.110:0/2025745848 wait complete. 2026-02-13T20:25:42.552 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T20:25:42.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:42.618+0000 7fcb26c8c640 10 monclient: get_monmap_and_config 2026-02-13T20:25:42.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:42.618+0000 7fcb26c8c640 10 monclient: build_initial_monmap 2026-02-13T20:25:42.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:42.618+0000 7fcb26c8c640 10 monclient: monmap: 2026-02-13T20:25:42.621 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:25:42.622 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:42.622 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:25:42.620040+0000 2026-02-13T20:25:42.622 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:25:42.620040+0000 2026-02-13T20:25:42.622 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:25:42.622 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:42.622 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:25:42.622 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:25:42.622 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:25:42.622 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:42.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:42.619+0000 7fcb26c8c640 1 Processor -- start 2026-02-13T20:25:42.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:42.619+0000 7fcb26c8c640 1 -- start start 2026-02-13T20:25:42.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:42.619+0000 7fcb26c8c640 10 monclient: init 2026-02-13T20:25:42.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:42.619+0000 7fcb26c8c640 10 monclient: _reopen_session rank -1 2026-02-13T20:25:42.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:42.619+0000 7fcb26c8c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:25:42.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:42.619+0000 7fcb26c8c640 10 monclient(hunting): picked mon.noname-a con 0x7fcb20091e20 addr v1:10.20.193.110:6789/0 2026-02-13T20:25:42.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:42.619+0000 7fcb26c8c640 10 monclient(hunting): picked mon.noname-b con 0x7fcb20089540 addr v1:10.20.193.110:6790/0 2026-02-13T20:25:42.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:42.619+0000 7fcb26c8c640 10 monclient(hunting): picked mon.noname-c con 0x7fcb20089980 addr v1:10.20.193.188:6789/0 2026-02-13T20:25:42.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:42.619+0000 7fcb26c8c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb2005b3d0 con 0x7fcb20091e20 2026-02-13T20:25:42.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:42.619+0000 7fcb26c8c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb2005b6b0 con 0x7fcb20089980 2026-02-13T20:25:42.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:42.619+0000 7fcb26c8c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb2005cd90 con 0x7fcb20089540 2026-02-13T20:25:42.624 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:42.619+0000 7fcb26c8c640 10 monclient(hunting): _renew_subs 2026-02-13T20:25:42.624 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:42.619+0000 7fcb26c8c640 10 monclient(hunting): authenticate will time out at 1504.310462s 2026-02-13T20:25:42.624 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:42.619+0000 7fcb17fff640 1 -- >> v1:10.20.193.110:6790/0 conn(0x7fcb20089540 legacy=0x7fcb20183d00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6790/0 2026-02-13T20:25:42.624 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:42.619+0000 7fcb24a01640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fcb20091e20 0x7fcb20088e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:47524/0 (socket says 10.20.193.110:47524) 2026-02-13T20:25:42.624 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:42.619+0000 7fcb24a01640 1 -- 10.20.193.110:0/3760501209 learned_addr learned my addr 10.20.193.110:0/3760501209 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:25:42.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:42.820+0000 7fcb17fff640 1 -- 10.20.193.110:0/3760501209 >> v1:10.20.193.110:6790/0 conn(0x7fcb20089540 legacy=0x7fcb20183d00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6790/0 2026-02-13T20:25:43.222 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:43.222+0000 7fcb17fff640 1 -- 10.20.193.110:0/3760501209 >> v1:10.20.193.110:6790/0 conn(0x7fcb20089540 legacy=0x7fcb20183d00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6790/0 2026-02-13T20:25:44.024 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:44.023+0000 7fcb17fff640 1 -- 10.20.193.110:0/3760501209 >> v1:10.20.193.110:6790/0 conn(0x7fcb20089540 legacy=0x7fcb20183d00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6790/0 2026-02-13T20:25:45.620 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:45.620+0000 7fcb167fc640 10 monclient(hunting): tick 2026-02-13T20:25:45.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:45.620+0000 7fcb167fc640 10 monclient(hunting): _check_auth_tickets 2026-02-13T20:25:45.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:45.620+0000 7fcb167fc640 1 monclient(hunting): continuing hunt 2026-02-13T20:25:45.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:45.620+0000 7fcb167fc640 10 monclient(hunting): _reopen_session rank -1 2026-02-13T20:25:45.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:45.620+0000 7fcb167fc640 1 -- 10.20.193.110:0/3760501209 >> v1:10.20.193.110:6790/0 conn(0x7fcb20089540 legacy=0x7fcb20183d00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:25:45.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:45.620+0000 7fcb167fc640 1 -- 10.20.193.110:0/3760501209 >> v1:10.20.193.188:6789/0 conn(0x7fcb20089980 legacy=0x7fcb201a5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:45.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:45.620+0000 7fcb167fc640 1 -- 10.20.193.110:0/3760501209 >> v1:10.20.193.110:6789/0 conn(0x7fcb20091e20 legacy=0x7fcb20088e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:45.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:45.620+0000 7fcb167fc640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:25:45.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:45.620+0000 7fcb167fc640 10 monclient(hunting): picked mon.noname-b con 0x7fcb20089540 addr v1:10.20.193.110:6790/0 2026-02-13T20:25:45.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:45.620+0000 7fcb167fc640 10 monclient(hunting): picked mon.noname-a con 0x7fcb20091e20 addr v1:10.20.193.110:6789/0 2026-02-13T20:25:45.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:45.620+0000 7fcb24a01640 1 -- 10.20.193.110:0/3760501209 >> v1:10.20.193.110:6790/0 conn(0x7fcb20089540 legacy=0x7fcb040237c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6790/0 2026-02-13T20:25:45.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:45.620+0000 7fcb167fc640 10 monclient(hunting): picked mon.noname-c con 0x7fcb20089980 addr v1:10.20.193.188:6789/0 2026-02-13T20:25:45.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:45.620+0000 7fcb167fc640 1 -- 10.20.193.110:0/3760501209 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb2008ad10 con 0x7fcb20091e20 2026-02-13T20:25:45.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:45.620+0000 7fcb167fc640 1 -- 10.20.193.110:0/3760501209 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb2005cd90 con 0x7fcb20089980 2026-02-13T20:25:45.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:45.620+0000 7fcb167fc640 1 -- 10.20.193.110:0/3760501209 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb04069f80 con 0x7fcb20089540 2026-02-13T20:25:45.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:45.620+0000 7fcb167fc640 10 monclient(hunting): _renew_subs 2026-02-13T20:25:45.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:45.821+0000 7fcb24a01640 1 -- 10.20.193.110:0/3760501209 >> v1:10.20.193.110:6790/0 conn(0x7fcb20089540 legacy=0x7fcb040237c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6790/0 2026-02-13T20:25:46.222 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:46.222+0000 7fcb24a01640 1 -- 10.20.193.110:0/3760501209 >> v1:10.20.193.110:6790/0 conn(0x7fcb20089540 legacy=0x7fcb040237c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6790/0 2026-02-13T20:25:47.024 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:47.023+0000 7fcb24a01640 1 -- 10.20.193.110:0/3760501209 >> v1:10.20.193.110:6790/0 conn(0x7fcb20089540 legacy=0x7fcb040237c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6790/0 2026-02-13T20:25:48.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:48.620+0000 7fcb167fc640 10 monclient(hunting): tick 2026-02-13T20:25:48.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:48.620+0000 7fcb167fc640 10 monclient(hunting): _check_auth_tickets 2026-02-13T20:25:48.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:48.620+0000 7fcb167fc640 1 monclient(hunting): continuing hunt 2026-02-13T20:25:48.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:48.620+0000 7fcb167fc640 10 monclient(hunting): _reopen_session rank -1 2026-02-13T20:25:48.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:48.620+0000 7fcb167fc640 1 -- 10.20.193.110:0/3760501209 >> v1:10.20.193.110:6790/0 conn(0x7fcb20089540 legacy=0x7fcb040237c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:25:48.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:48.620+0000 7fcb167fc640 1 -- 10.20.193.110:0/3760501209 >> v1:10.20.193.188:6789/0 conn(0x7fcb20089980 legacy=0x7fcb04066760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:48.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:48.620+0000 7fcb167fc640 1 -- 10.20.193.110:0/3760501209 >> v1:10.20.193.110:6789/0 conn(0x7fcb20091e20 legacy=0x7fcb04044f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:48.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:48.620+0000 7fcb167fc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:25:48.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:48.620+0000 7fcb167fc640 10 monclient(hunting): picked mon.noname-a con 0x7fcb0406a1c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:25:48.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:48.620+0000 7fcb167fc640 10 monclient(hunting): picked mon.noname-b con 0x7fcb20089540 addr v1:10.20.193.110:6790/0 2026-02-13T20:25:48.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:48.620+0000 7fcb167fc640 10 monclient(hunting): picked mon.noname-c con 0x7fcb20089980 addr v1:10.20.193.188:6789/0 2026-02-13T20:25:48.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:48.620+0000 7fcb167fc640 1 -- 10.20.193.110:0/3760501209 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb0406b1e0 con 0x7fcb0406a1c0 2026-02-13T20:25:48.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:48.620+0000 7fcb167fc640 1 -- 10.20.193.110:0/3760501209 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb04069f80 con 0x7fcb20089980 2026-02-13T20:25:48.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:48.620+0000 7fcb167fc640 1 -- 10.20.193.110:0/3760501209 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb0406af90 con 0x7fcb20089540 2026-02-13T20:25:48.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:48.620+0000 7fcb167fc640 10 monclient(hunting): _renew_subs 2026-02-13T20:25:48.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:48.620+0000 7fcb17fff640 1 -- 10.20.193.110:0/3760501209 >> v1:10.20.193.110:6790/0 conn(0x7fcb20089540 legacy=0x7fcb040237c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6790/0 2026-02-13T20:25:48.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:48.822+0000 7fcb17fff640 1 -- 10.20.193.110:0/3760501209 >> v1:10.20.193.110:6790/0 conn(0x7fcb20089540 legacy=0x7fcb040237c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6790/0 2026-02-13T20:25:49.223 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:49.223+0000 7fcb17fff640 1 -- 10.20.193.110:0/3760501209 >> v1:10.20.193.110:6790/0 conn(0x7fcb20089540 legacy=0x7fcb040237c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6790/0 2026-02-13T20:25:50.024 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.024+0000 7fcb17fff640 1 -- 10.20.193.110:0/3760501209 >> v1:10.20.193.110:6790/0 conn(0x7fcb20089540 legacy=0x7fcb040237c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6790/0 2026-02-13T20:25:50.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.298+0000 7fcb177fe640 1 -- 10.20.193.110:0/3760501209 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2747279954 0 0) 0x7fcb0406b1e0 con 0x7fcb0406a1c0 2026-02-13T20:25:50.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.298+0000 7fcb177fe640 10 monclient(hunting): _negotiate 2026-02-13T20:25:50.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.298+0000 7fcb177fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:50.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.298+0000 7fcb177fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:50.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.298+0000 7fcb177fe640 10 monclient(hunting): my global_id is 124362 2026-02-13T20:25:50.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.298+0000 7fcb177fe640 1 -- 10.20.193.110:0/3760501209 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb0c0035e0 con 0x7fcb0406a1c0 2026-02-13T20:25:50.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.299+0000 7fcb177fe640 1 -- 10.20.193.110:0/3760501209 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2260726009 0 0) 0x7fcb0c0035e0 con 0x7fcb0406a1c0 2026-02-13T20:25:50.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.299+0000 7fcb177fe640 1 -- 10.20.193.110:0/3760501209 >> v1:10.20.193.110:6790/0 conn(0x7fcb20089540 legacy=0x7fcb040237c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:25:50.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.299+0000 7fcb177fe640 1 -- 10.20.193.110:0/3760501209 >> v1:10.20.193.188:6789/0 conn(0x7fcb20089980 legacy=0x7fcb04066760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:50.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.299+0000 7fcb177fe640 10 monclient: _finish_hunting 0 2026-02-13T20:25:50.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.299+0000 7fcb177fe640 1 monclient: found mon.noname-a 2026-02-13T20:25:50.304 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.299+0000 7fcb177fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:25:50.305 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.299+0000 7fcb177fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:25:50.305 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.299+0000 7fcb177fe640 1 -- 10.20.193.110:0/3760501209 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb04044fd0 con 0x7fcb0406a1c0 2026-02-13T20:25:50.305 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.299+0000 7fcb177fe640 10 monclient: _finish_auth 0 2026-02-13T20:25:50.305 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.299+0000 7fcb177fe640 10 monclient: _check_auth_tickets 2026-02-13T20:25:50.305 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.299+0000 7fcb177fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:25:50.305 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.299+0000 7fcb177fe640 1 -- 10.20.193.110:0/3760501209 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fcb10002db0 con 0x7fcb0406a1c0 2026-02-13T20:25:50.305 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.299+0000 7fcb177fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:50.305 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.299+0000 7fcb177fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:25:50.305 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.299+0000 7fcb177fe640 10 monclient: dump: 2026-02-13T20:25:50.305 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:50.305 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:50.305 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:50.305 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:50.305 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:50.305 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:50.305 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:50.305 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:50.305 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:50.305 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:50.305 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.299+0000 7fcb26c8c640 5 monclient: authenticate success, global_id 124362 2026-02-13T20:25:50.305 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.299+0000 7fcb26c8c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:25:50.305 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.299+0000 7fcb177fe640 1 -- 10.20.193.110:0/3760501209 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcb10002fb0 con 0x7fcb0406a1c0 2026-02-13T20:25:50.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.299+0000 7fcb177fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:25:50.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.299+0000 7fcb177fe640 1 -- 10.20.193.110:0/3760501209 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fcb100033c0 con 0x7fcb0406a1c0 2026-02-13T20:25:50.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.299+0000 7fcb177fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:50.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.299+0000 7fcb177fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:25:50.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.299+0000 7fcb177fe640 10 monclient: dump: 2026-02-13T20:25:50.306 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:50.306 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:50.306 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:50.306 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:50.306 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:50.306 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:50.306 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:50.306 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:50.306 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:50.306 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:50.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.299+0000 7fcb26c8c640 10 monclient: get_monmap_and_config success 2026-02-13T20:25:50.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.299+0000 7fcb26c8c640 4 set_mon_vals no callback set 2026-02-13T20:25:50.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.299+0000 7fcb26c8c640 10 monclient: shutdown 2026-02-13T20:25:50.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.299+0000 7fcb26c8c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:25:50.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.299+0000 7fcb26c8c640 1 -- 10.20.193.110:0/3760501209 >> v1:10.20.193.110:6789/0 conn(0x7fcb0406a1c0 legacy=0x7fcb0406a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:50.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.299+0000 7fcb26c8c640 1 -- 10.20.193.110:0/3760501209 shutdown_connections 2026-02-13T20:25:50.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.299+0000 7fcb26c8c640 1 -- 10.20.193.110:0/3760501209 >> 10.20.193.110:0/3760501209 conn(0x7fcb20054e90 msgr2=0x7fcb20058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:25:50.306 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.299+0000 7fcb26c8c640 1 -- 10.20.193.110:0/3760501209 shutdown_connections 2026-02-13T20:25:50.307 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.299+0000 7fcb26c8c640 1 -- 10.20.193.110:0/3760501209 wait complete. 2026-02-13T20:25:50.307 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.300+0000 7fcb26c8c640 10 monclient: build_initial_monmap 2026-02-13T20:25:50.307 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.300+0000 7fcb26c8c640 10 monclient: monmap: 2026-02-13T20:25:50.307 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:25:50.307 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:25:50.307 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:25:50.307 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:25:50.307 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:25:50.307 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:25:50.307 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:25:50.307 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:25:50.307 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:25:50.307 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:50.307 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.300+0000 7fcb26c8c640 1 Processor -- start 2026-02-13T20:25:50.307 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.300+0000 7fcb26c8c640 1 -- start start 2026-02-13T20:25:50.307 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.300+0000 7fcb26c8c640 10 monclient: init 2026-02-13T20:25:50.307 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb26c8c640 10 monclient: _reopen_session rank -1 2026-02-13T20:25:50.307 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb26c8c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:25:50.307 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb26c8c640 10 monclient(hunting): picked mon.noname-a con 0x7fcb0406a1c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:25:50.307 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb26c8c640 10 monclient(hunting): picked mon.noname-c con 0x7fcb20089540 addr v1:10.20.193.110:6790/0 2026-02-13T20:25:50.307 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb26c8c640 10 monclient(hunting): picked mon.noname-b con 0x7fcb20089980 addr v1:10.20.193.188:6789/0 2026-02-13T20:25:50.307 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb26c8c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb20059340 con 0x7fcb0406a1c0 2026-02-13T20:25:50.307 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb26c8c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb2005d320 con 0x7fcb20089980 2026-02-13T20:25:50.308 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb17fff640 1 -- >> v1:10.20.193.110:6790/0 conn(0x7fcb20089540 legacy=0x7fcb20191a90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.110:6790/0 2026-02-13T20:25:50.308 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb26c8c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb201ab9a0 con 0x7fcb20089540 2026-02-13T20:25:50.308 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb26c8c640 10 monclient(hunting): _renew_subs 2026-02-13T20:25:50.308 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb26c8c640 10 monclient(hunting): authenticate will time out at 1511.992132s 2026-02-13T20:25:50.308 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb24a01640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fcb0406a1c0 0x7fcb20191380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:47558/0 (socket says 10.20.193.110:47558) 2026-02-13T20:25:50.308 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb24a01640 1 -- 10.20.193.110:0/3033414770 learned_addr learned my addr 10.20.193.110:0/3033414770 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:25:50.308 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb157fa640 1 -- 10.20.193.110:0/3033414770 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1042588886 0 0) 0x7fcb20059340 con 0x7fcb0406a1c0 2026-02-13T20:25:50.308 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb157fa640 10 monclient(hunting): _negotiate 2026-02-13T20:25:50.308 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb157fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:50.308 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb157fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:50.308 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb157fa640 10 monclient(hunting): my global_id is 124365 2026-02-13T20:25:50.308 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb157fa640 1 -- 10.20.193.110:0/3033414770 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcaf00035e0 con 0x7fcb0406a1c0 2026-02-13T20:25:50.308 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb157fa640 1 -- 10.20.193.110:0/3033414770 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1611695215 0 0) 0x7fcaf00035e0 con 0x7fcb0406a1c0 2026-02-13T20:25:50.308 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb157fa640 1 -- 10.20.193.110:0/3033414770 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcb20059340 con 0x7fcb0406a1c0 2026-02-13T20:25:50.308 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb157fa640 1 -- 10.20.193.110:0/3033414770 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fcb100032d0 con 0x7fcb0406a1c0 2026-02-13T20:25:50.308 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb157fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:25:50.308 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb157fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:25:50.308 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb157fa640 10 monclient(hunting): dump: 2026-02-13T20:25:50.308 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:50.308 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:50.308 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:50.308 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:50.308 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:50.309 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:50.309 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:50.309 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:50.309 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:50.309 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:50.309 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb157fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:25:50.309 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb157fa640 1 -- 10.20.193.110:0/3033414770 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1138102018 0 0) 0x7fcb20059340 con 0x7fcb0406a1c0 2026-02-13T20:25:50.309 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb157fa640 1 -- 10.20.193.110:0/3033414770 >> v1:10.20.193.110:6790/0 conn(0x7fcb20089540 legacy=0x7fcb20191a90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T20:25:50.309 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb157fa640 1 -- 10.20.193.110:0/3033414770 >> v1:10.20.193.188:6789/0 conn(0x7fcb20089980 legacy=0x7fcb2023c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:50.309 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb157fa640 10 monclient: _finish_hunting 0 2026-02-13T20:25:50.309 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb157fa640 1 monclient: found mon.a 2026-02-13T20:25:50.309 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb157fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:25:50.309 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb157fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:25:50.309 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb157fa640 1 -- 10.20.193.110:0/3033414770 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb20194dc0 con 0x7fcb0406a1c0 2026-02-13T20:25:50.309 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb157fa640 10 monclient: _finish_auth 0 2026-02-13T20:25:50.309 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb157fa640 10 monclient: _check_auth_tickets 2026-02-13T20:25:50.309 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb157fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:25:50.309 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb26c8c640 5 monclient: authenticate success, global_id 124365 2026-02-13T20:25:50.309 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb26c8c640 10 monclient: _renew_subs 2026-02-13T20:25:50.309 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb26c8c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:25:50.309 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb26c8c640 1 -- 10.20.193.110:0/3033414770 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fcb201950a0 con 0x7fcb0406a1c0 2026-02-13T20:25:50.309 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb26c8c640 10 monclient: _renew_subs 2026-02-13T20:25:50.309 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb26c8c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:25:50.310 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb26c8c640 1 -- 10.20.193.110:0/3033414770 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fcb20192340 con 0x7fcb0406a1c0 2026-02-13T20:25:50.310 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb157fa640 1 -- 10.20.193.110:0/3033414770 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcb100034a0 con 0x7fcb0406a1c0 2026-02-13T20:25:50.310 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb157fa640 10 monclient: handle_config config(0 keys) 2026-02-13T20:25:50.310 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb157fa640 1 -- 10.20.193.110:0/3033414770 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fcb10004d00 con 0x7fcb0406a1c0 2026-02-13T20:25:50.310 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb157fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:50.310 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb157fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:25:50.310 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb16ffd640 4 set_mon_vals no callback set 2026-02-13T20:25:50.310 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.301+0000 7fcb157fa640 10 monclient: dump: 2026-02-13T20:25:50.310 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:50.310 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:50.310 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:50.310 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:50.310 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:50.310 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:50.310 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:50.310 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:50.310 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:50.310 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:50.310 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.302+0000 7fcb26c8c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:25:50.310 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.302+0000 7fcb26c8c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:25:50.310 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.302+0000 7fcb26c8c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:25:50.310 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.302+0000 7fcb157fa640 1 -- 10.20.193.110:0/3033414770 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fcb10011970 con 0x7fcb0406a1c0 2026-02-13T20:25:50.310 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.302+0000 7fcb26c8c640 1 -- 10.20.193.110:0/3033414770 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb2005bcc0 con 0x7fcb0406a1c0 2026-02-13T20:25:50.310 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.302+0000 7fcb157fa640 1 -- 10.20.193.110:0/3033414770 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(680..680 src has 1..680) ==== 3899+0+0 (unknown 3290828237 0 0) 0x7fcb1004e9d0 con 0x7fcb0406a1c0 2026-02-13T20:25:50.311 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.303+0000 7fcb17fff640 10 monclient: get_auth_request con 0x7fcaf003f5c0 auth_method 0 2026-02-13T20:25:50.311 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.305+0000 7fcb157fa640 1 -- 10.20.193.110:0/3033414770 <== mon.0 v1:10.20.193.110:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fcb100171f0 con 0x7fcb0406a1c0 2026-02-13T20:25:50.311 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.305+0000 7fcb157fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:25:50.311 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.305+0000 7fcb157fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:25:50.358 INFO:tasks.rados.rados.0.trial188.stdout:3202: done (4 left) 2026-02-13T20:25:50.358 INFO:tasks.rados.rados.0.trial188.stdout:3203: done (3 left) 2026-02-13T20:25:50.358 INFO:tasks.rados.rados.0.trial188.stdout:3204: done (2 left) 2026-02-13T20:25:50.358 INFO:tasks.rados.rados.0.trial188.stdout:3205: done (1 left) 2026-02-13T20:25:50.358 INFO:tasks.rados.rados.0.trial188.stdout:3206: done (0 left) 2026-02-13T20:25:50.358 INFO:tasks.rados.rados.0.trial188.stdout:3207: snap_remove snap 327 2026-02-13T20:25:50.457 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.455+0000 7fcb26c8c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T20:25:50.457 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.455+0000 7fcb26c8c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T20:25:50.457 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.455+0000 7fcb26c8c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:25:50.457 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.455+0000 7fcb26c8c640 1 -- 10.20.193.110:0/3033414770 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fcb20055bb0 con 0x7fcb0406a1c0 2026-02-13T20:25:50.457 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.456+0000 7fcb157fa640 1 -- 10.20.193.110:0/3033414770 <== mon.0 v1:10.20.193.110:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 3983227991) 0x7fcb100169a0 con 0x7fcb0406a1c0 2026-02-13T20:25:50.457 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.456+0000 7fcb157fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T20:25:50.457 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.456+0000 7fcb157fa640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:25:50.457 INFO:teuthology.orchestra.run.trial110.stdout:{"election_epoch":54,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","modified":"2026-02-13T20:11:07.161192Z","created":"2026-02-13T20:11:07.161192Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6789","nonce":0}]},"addr":"10.20.193.110:6789/0","public_addr":"10.20.193.110:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161241+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6789","nonce":0}]},"addr":"10.20.193.188:6789/0","public_addr":"10.20.193.188:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161242+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6790","nonce":0}]},"addr":"10.20.193.110:6790/0","public_addr":"10.20.193.110:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161243+0000","crush_location":[]}]}} 2026-02-13T20:25:50.458 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.457+0000 7fcb26c8c640 1 -- 10.20.193.110:0/3033414770 >> v1:10.20.193.188:6812/1623052694 conn(0x7fcaf003f5c0 legacy=0x7fcaf005fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:50.458 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.457+0000 7fcb26c8c640 10 monclient: shutdown 2026-02-13T20:25:50.458 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.457+0000 7fcb26c8c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:25:50.458 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.457+0000 7fcb26c8c640 1 -- 10.20.193.110:0/3033414770 >> v1:10.20.193.110:6789/0 conn(0x7fcb0406a1c0 legacy=0x7fcb20191380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:50.458 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.457+0000 7fcb26c8c640 1 -- 10.20.193.110:0/3033414770 shutdown_connections 2026-02-13T20:25:50.458 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.457+0000 7fcb26c8c640 1 -- 10.20.193.110:0/3033414770 >> 10.20.193.110:0/3033414770 conn(0x7fcb20054e90 msgr2=0x7fcb201a90a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:25:50.458 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.457+0000 7fcb26c8c640 1 -- 10.20.193.110:0/3033414770 shutdown_connections 2026-02-13T20:25:50.458 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.457+0000 7fcb26c8c640 1 -- 10.20.193.110:0/3033414770 wait complete. 2026-02-13T20:25:50.467 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-13T20:25:50.467 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-13T20:25:50.467 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T20:25:50.534 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.532+0000 7fe0c961b640 10 monclient: get_monmap_and_config 2026-02-13T20:25:50.534 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.532+0000 7fe0c961b640 10 monclient: build_initial_monmap 2026-02-13T20:25:50.534 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.532+0000 7fe0c961b640 10 monclient: monmap: 2026-02-13T20:25:50.534 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:25:50.534 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:50.534 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:25:50.534090+0000 2026-02-13T20:25:50.534 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:25:50.534090+0000 2026-02-13T20:25:50.534 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:25:50.534 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:50.534 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:25:50.534 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:25:50.534 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:25:50.534 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:50.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.533+0000 7fe0c961b640 1 Processor -- start 2026-02-13T20:25:50.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.533+0000 7fe0c961b640 1 -- start start 2026-02-13T20:25:50.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.533+0000 7fe0c961b640 10 monclient: init 2026-02-13T20:25:50.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.533+0000 7fe0c961b640 10 monclient: _reopen_session rank -1 2026-02-13T20:25:50.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.533+0000 7fe0c961b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:25:50.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.533+0000 7fe0c961b640 10 monclient(hunting): picked mon.noname-a con 0x7fe0c41401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:25:50.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.533+0000 7fe0c961b640 10 monclient(hunting): picked mon.noname-c con 0x7fe0c4092020 addr v1:10.20.193.188:6789/0 2026-02-13T20:25:50.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.533+0000 7fe0c961b640 10 monclient(hunting): picked mon.noname-b con 0x7fe0c4091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:25:50.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.533+0000 7fe0c961b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0c408b730 con 0x7fe0c41401c0 2026-02-13T20:25:50.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.533+0000 7fe0c961b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0c405c5b0 con 0x7fe0c4092020 2026-02-13T20:25:50.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.533+0000 7fe0c961b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0c408bcf0 con 0x7fe0c4091950 2026-02-13T20:25:50.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.533+0000 7fe0c961b640 10 monclient(hunting): _renew_subs 2026-02-13T20:25:50.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.533+0000 7fe0c961b640 10 monclient(hunting): authenticate will time out at 1512.224485s 2026-02-13T20:25:50.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.533+0000 7fe0c37fe640 1 -- >> v1:10.20.193.110:6790/0 conn(0x7fe0c4091950 legacy=0x7fe0c41a2a20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6790/0 2026-02-13T20:25:50.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.533+0000 7fe0c2ffd640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fe0c41401c0 0x7fe0c4091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:47572/0 (socket says 10.20.193.110:47572) 2026-02-13T20:25:50.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.533+0000 7fe0c2ffd640 1 -- 10.20.193.110:0/264594213 learned_addr learned my addr 10.20.193.110:0/264594213 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:25:50.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.533+0000 7fe0c1ffb640 1 -- 10.20.193.110:0/264594213 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 16375866 0 0) 0x7fe0c408b730 con 0x7fe0c41401c0 2026-02-13T20:25:50.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.533+0000 7fe0c1ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:25:50.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.533+0000 7fe0c1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:50.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.533+0000 7fe0c1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:50.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.533+0000 7fe0c1ffb640 10 monclient(hunting): my global_id is 124368 2026-02-13T20:25:50.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.533+0000 7fe0c1ffb640 1 -- 10.20.193.110:0/264594213 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0b00035e0 con 0x7fe0c41401c0 2026-02-13T20:25:50.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.533+0000 7fe0c1ffb640 1 -- 10.20.193.110:0/264594213 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 149766039 0 0) 0x7fe0b00035e0 con 0x7fe0c41401c0 2026-02-13T20:25:50.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.533+0000 7fe0c1ffb640 1 -- 10.20.193.110:0/264594213 >> v1:10.20.193.110:6790/0 conn(0x7fe0c4091950 legacy=0x7fe0c41a2a20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:25:50.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.533+0000 7fe0c1ffb640 1 -- 10.20.193.110:0/264594213 >> v1:10.20.193.188:6789/0 conn(0x7fe0c4092020 legacy=0x7fe0c41812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:50.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.533+0000 7fe0c1ffb640 10 monclient: _finish_hunting 0 2026-02-13T20:25:50.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.533+0000 7fe0c1ffb640 1 monclient: found mon.noname-a 2026-02-13T20:25:50.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.533+0000 7fe0c1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:25:50.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.533+0000 7fe0c1ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:25:50.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.533+0000 7fe0c1ffb640 1 -- 10.20.193.110:0/264594213 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0c4140590 con 0x7fe0c41401c0 2026-02-13T20:25:50.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.533+0000 7fe0c1ffb640 10 monclient: _finish_auth 0 2026-02-13T20:25:50.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.533+0000 7fe0c1ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:25:50.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.533+0000 7fe0c1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:25:50.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.533+0000 7fe0c961b640 5 monclient: authenticate success, global_id 124368 2026-02-13T20:25:50.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.533+0000 7fe0c1ffb640 1 -- 10.20.193.110:0/264594213 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe0b8002dd0 con 0x7fe0c41401c0 2026-02-13T20:25:50.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.533+0000 7fe0c961b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:25:50.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.533+0000 7fe0c1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:50.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.533+0000 7fe0c1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:25:50.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.533+0000 7fe0c1ffb640 10 monclient: dump: 2026-02-13T20:25:50.536 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:50.536 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:50.536 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:50.536 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:50.536 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:50.536 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:50.536 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:50.536 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:50.536 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:50.536 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:50.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.534+0000 7fe0c961b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:25:50.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.534+0000 7fe0c1ffb640 1 -- 10.20.193.110:0/264594213 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe0b8003020 con 0x7fe0c41401c0 2026-02-13T20:25:50.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.534+0000 7fe0c1ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T20:25:50.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.534+0000 7fe0c961b640 10 monclient: get_monmap_and_config success 2026-02-13T20:25:50.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.534+0000 7fe0c961b640 4 set_mon_vals no callback set 2026-02-13T20:25:50.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.534+0000 7fe0c1ffb640 1 -- 10.20.193.110:0/264594213 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe0b8003430 con 0x7fe0c41401c0 2026-02-13T20:25:50.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.534+0000 7fe0c1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:50.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.534+0000 7fe0c1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:25:50.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.534+0000 7fe0c1ffb640 10 monclient: dump: 2026-02-13T20:25:50.537 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:50.537 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:50.537 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:50.537 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:50.537 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:50.537 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:50.537 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:50.537 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:50.537 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:50.537 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:50.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.534+0000 7fe0c961b640 10 monclient: shutdown 2026-02-13T20:25:50.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.534+0000 7fe0c961b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:25:50.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.534+0000 7fe0c961b640 1 -- 10.20.193.110:0/264594213 >> v1:10.20.193.110:6789/0 conn(0x7fe0c41401c0 legacy=0x7fe0c4091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:50.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.534+0000 7fe0c961b640 1 -- 10.20.193.110:0/264594213 shutdown_connections 2026-02-13T20:25:50.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.534+0000 7fe0c961b640 1 -- 10.20.193.110:0/264594213 >> 10.20.193.110:0/264594213 conn(0x7fe0c4054e90 msgr2=0x7fe0c4058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:25:50.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.534+0000 7fe0c961b640 1 -- 10.20.193.110:0/264594213 shutdown_connections 2026-02-13T20:25:50.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.534+0000 7fe0c961b640 1 -- 10.20.193.110:0/264594213 wait complete. 2026-02-13T20:25:50.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.534+0000 7fe0c961b640 10 monclient: build_initial_monmap 2026-02-13T20:25:50.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.534+0000 7fe0c961b640 10 monclient: monmap: 2026-02-13T20:25:50.539 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:25:50.539 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:25:50.539 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:25:50.539 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:25:50.539 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:25:50.539 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:25:50.539 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:25:50.539 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:25:50.539 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:25:50.539 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:50.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.534+0000 7fe0c961b640 1 Processor -- start 2026-02-13T20:25:50.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.534+0000 7fe0c961b640 1 -- start start 2026-02-13T20:25:50.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.534+0000 7fe0c961b640 10 monclient: init 2026-02-13T20:25:50.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0c961b640 10 monclient: _reopen_session rank -1 2026-02-13T20:25:50.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0c961b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:25:50.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0c961b640 10 monclient(hunting): picked mon.noname-a con 0x7fe0c4091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:25:50.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0c961b640 10 monclient(hunting): picked mon.noname-c con 0x7fe0c41401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:25:50.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0c961b640 10 monclient(hunting): picked mon.noname-b con 0x7fe0c4089c50 addr v1:10.20.193.188:6789/0 2026-02-13T20:25:50.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0c961b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0c408c410 con 0x7fe0c4091950 2026-02-13T20:25:50.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0c961b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0c405d320 con 0x7fe0c4089c50 2026-02-13T20:25:50.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0c961b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0c408a880 con 0x7fe0c41401c0 2026-02-13T20:25:50.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0c961b640 10 monclient(hunting): _renew_subs 2026-02-13T20:25:50.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0c961b640 10 monclient(hunting): authenticate will time out at 1512.226228s 2026-02-13T20:25:50.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0c27fc640 1 -- >> v1:10.20.193.110:6790/0 conn(0x7fe0c41401c0 legacy=0x7fe0c4089540 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.110:6790/0 2026-02-13T20:25:50.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0c2ffd640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fe0c4091950 0x7fe0c4088e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:47576/0 (socket says 10.20.193.110:47576) 2026-02-13T20:25:50.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0c2ffd640 1 -- 10.20.193.110:0/2262579347 learned_addr learned my addr 10.20.193.110:0/2262579347 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:25:50.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0a37fe640 1 -- 10.20.193.110:0/2262579347 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1783298716 0 0) 0x7fe0c408c410 con 0x7fe0c4091950 2026-02-13T20:25:50.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0a37fe640 10 monclient(hunting): _negotiate 2026-02-13T20:25:50.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0a37fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:50.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0a37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:50.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0a37fe640 10 monclient(hunting): my global_id is 124371 2026-02-13T20:25:50.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0a37fe640 1 -- 10.20.193.110:0/2262579347 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0900035e0 con 0x7fe0c4091950 2026-02-13T20:25:50.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0a37fe640 1 -- 10.20.193.110:0/2262579347 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4061173763 0 0) 0x7fe0900035e0 con 0x7fe0c4091950 2026-02-13T20:25:50.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0a37fe640 1 -- 10.20.193.110:0/2262579347 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe0c408c410 con 0x7fe0c4091950 2026-02-13T20:25:50.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0a37fe640 1 -- 10.20.193.110:0/2262579347 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe0b8003400 con 0x7fe0c4091950 2026-02-13T20:25:50.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0a37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:25:50.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0a37fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:25:50.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0a37fe640 10 monclient(hunting): dump: 2026-02-13T20:25:50.540 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:50.540 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:50.540 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:50.540 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:50.540 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:50.540 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:50.540 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:50.540 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:50.540 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:50.540 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:50.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0a37fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:25:50.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0a37fe640 1 -- 10.20.193.110:0/2262579347 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 593570359 0 0) 0x7fe0c408c410 con 0x7fe0c4091950 2026-02-13T20:25:50.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0a37fe640 1 -- 10.20.193.110:0/2262579347 >> v1:10.20.193.110:6790/0 conn(0x7fe0c41401c0 legacy=0x7fe0c4089540 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T20:25:50.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0a37fe640 1 -- 10.20.193.110:0/2262579347 >> v1:10.20.193.188:6789/0 conn(0x7fe0c4089c50 legacy=0x7fe0c4195170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:50.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0a37fe640 10 monclient: _finish_hunting 0 2026-02-13T20:25:50.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0a37fe640 1 monclient: found mon.a 2026-02-13T20:25:50.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0a37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:25:50.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0a37fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:25:50.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0a37fe640 1 -- 10.20.193.110:0/2262579347 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0c4132660 con 0x7fe0c4091950 2026-02-13T20:25:50.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0a37fe640 10 monclient: _finish_auth 0 2026-02-13T20:25:50.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0a37fe640 10 monclient: _check_auth_tickets 2026-02-13T20:25:50.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0a37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:25:50.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0c961b640 5 monclient: authenticate success, global_id 124371 2026-02-13T20:25:50.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0c961b640 10 monclient: _renew_subs 2026-02-13T20:25:50.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0c961b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:25:50.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0c961b640 1 -- 10.20.193.110:0/2262579347 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe0c4132380 con 0x7fe0c4091950 2026-02-13T20:25:50.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0c961b640 10 monclient: _renew_subs 2026-02-13T20:25:50.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0c961b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:25:50.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0c961b640 1 -- 10.20.193.110:0/2262579347 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe0c4196890 con 0x7fe0c4091950 2026-02-13T20:25:50.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0a37fe640 1 -- 10.20.193.110:0/2262579347 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe0b8004b90 con 0x7fe0c4091950 2026-02-13T20:25:50.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0a37fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:25:50.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0a37fe640 1 -- 10.20.193.110:0/2262579347 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe0b8004f30 con 0x7fe0c4091950 2026-02-13T20:25:50.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0a37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:50.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0a37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:25:50.541 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0a37fe640 10 monclient: dump: 2026-02-13T20:25:50.541 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:50.541 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:50.541 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:50.541 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:50.541 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:50.541 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:50.541 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:50.541 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:50.541 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:50.541 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:50.541 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.535+0000 7fe0c17fa640 4 set_mon_vals no callback set 2026-02-13T20:25:50.541 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.537+0000 7fe0c961b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:25:50.541 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.537+0000 7fe0c961b640 1 -- 10.20.193.110:0/2262579347 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe0c408d070 con 0x7fe0c4092020 2026-02-13T20:25:50.541 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.537+0000 7fe0a37fe640 1 -- 10.20.193.110:0/2262579347 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fe0b8005090 con 0x7fe0c4091950 2026-02-13T20:25:50.541 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.537+0000 7fe0a37fe640 1 -- 10.20.193.110:0/2262579347 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(681..681 src has 1..681) ==== 3899+0+0 (unknown 3847639174 0 0) 0x7fe0b804ebc0 con 0x7fe0c4091950 2026-02-13T20:25:50.541 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.537+0000 7fe0a37fe640 1 -- 10.20.193.110:0/2262579347 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 600775715 0 0) 0x7fe0c408d070 con 0x7fe0c4092020 2026-02-13T20:25:50.541 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.537+0000 7fe0a37fe640 10 monclient(hunting): _negotiate 2026-02-13T20:25:50.541 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.537+0000 7fe0a37fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:50.541 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.537+0000 7fe0a37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:50.541 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.537+0000 7fe0a37fe640 10 monclient(hunting): my global_id is 124374 2026-02-13T20:25:50.541 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.537+0000 7fe0a37fe640 1 -- 10.20.193.110:0/2262579347 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0c408c410 con 0x7fe0c4092020 2026-02-13T20:25:50.541 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.537+0000 7fe0c37fe640 10 monclient: get_auth_request con 0x7fe09003f570 auth_method 0 2026-02-13T20:25:50.541 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.537+0000 7fe0a37fe640 1 -- 10.20.193.110:0/2262579347 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1106184822 0 0) 0x7fe0c408c410 con 0x7fe0c4092020 2026-02-13T20:25:50.541 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.537+0000 7fe0a37fe640 1 -- 10.20.193.110:0/2262579347 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe0c408d070 con 0x7fe0c4092020 2026-02-13T20:25:50.541 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.537+0000 7fe0a37fe640 1 -- 10.20.193.110:0/2262579347 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe0ac002d80 con 0x7fe0c4092020 2026-02-13T20:25:50.541 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.537+0000 7fe0a37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:50.541 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.537+0000 7fe0a37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:25:50.541 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.537+0000 7fe0a37fe640 10 monclient: dump: 2026-02-13T20:25:50.541 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:50.541 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:50.541 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:50.541 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:50.541 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:50.541 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:50.541 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:50.541 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:50.541 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:50.541 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:50.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.537+0000 7fe0a37fe640 1 -- 10.20.193.110:0/2262579347 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2778894795 0 0) 0x7fe0c408d070 con 0x7fe0c4092020 2026-02-13T20:25:50.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.537+0000 7fe0a37fe640 1 -- 10.20.193.110:0/2262579347 --> v1:10.20.193.110:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe0c408a270 con 0x7fe0c4092020 2026-02-13T20:25:50.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.537+0000 7fe0a37fe640 1 -- 10.20.193.110:0/2262579347 <== mon.0 v1:10.20.193.110:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fe0ac003300 con 0x7fe0c4092020 2026-02-13T20:25:50.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.537+0000 7fe0a37fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:25:50.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.537+0000 7fe0a37fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:25:50.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.537+0000 7fe0a37fe640 1 -- 10.20.193.110:0/2262579347 >> v1:10.20.193.110:6789/0 conn(0x7fe0c4092020 legacy=0x7fe0c4127b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:50.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.537+0000 7fe0a37fe640 1 -- 10.20.193.110:0/2262579347 >> v1:10.20.193.110:6789/0 conn(0x7fe0c4092020 legacy=0x7fe0c4127b20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:25:50.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.541+0000 7fe0c961b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:25:50.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.541+0000 7fe0c961b640 1 -- 10.20.193.110:0/2262579347 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe0c4131ea0 con 0x7fe0c4128230 2026-02-13T20:25:50.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.541+0000 7fe0a37fe640 1 -- 10.20.193.110:0/2262579347 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1813983768 0 0) 0x7fe0c4131ea0 con 0x7fe0c4128230 2026-02-13T20:25:50.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.541+0000 7fe0a37fe640 10 monclient(hunting): _negotiate 2026-02-13T20:25:50.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.541+0000 7fe0a37fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:50.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.541+0000 7fe0a37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:50.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.541+0000 7fe0a37fe640 10 monclient(hunting): my global_id is 124377 2026-02-13T20:25:50.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.541+0000 7fe0a37fe640 1 -- 10.20.193.110:0/2262579347 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0c408d070 con 0x7fe0c4128230 2026-02-13T20:25:50.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.541+0000 7fe0a37fe640 1 -- 10.20.193.110:0/2262579347 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 156312385 0 0) 0x7fe0c408d070 con 0x7fe0c4128230 2026-02-13T20:25:50.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.541+0000 7fe0a37fe640 1 -- 10.20.193.110:0/2262579347 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe0c4131ea0 con 0x7fe0c4128230 2026-02-13T20:25:50.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.541+0000 7fe0a37fe640 1 -- 10.20.193.110:0/2262579347 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe0ac003990 con 0x7fe0c4128230 2026-02-13T20:25:50.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.541+0000 7fe0a37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:50.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.541+0000 7fe0a37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:25:50.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.541+0000 7fe0a37fe640 10 monclient: dump: 2026-02-13T20:25:50.543 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:50.543 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:50.543 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:50.543 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:50.543 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:50.543 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:50.543 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:50.543 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:50.543 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:50.543 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:50.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.541+0000 7fe0a37fe640 1 -- 10.20.193.110:0/2262579347 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 214496402 0 0) 0x7fe0c4131ea0 con 0x7fe0c4128230 2026-02-13T20:25:50.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.541+0000 7fe0a37fe640 1 -- 10.20.193.110:0/2262579347 --> v1:10.20.193.110:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe0c408b450 con 0x7fe0c4128230 2026-02-13T20:25:50.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.541+0000 7fe0a37fe640 1 -- 10.20.193.110:0/2262579347 <== mon.0 v1:10.20.193.110:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4503 (unknown 0 0 637168524) 0x7fe0ac005880 con 0x7fe0c4128230 2026-02-13T20:25:50.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.541+0000 7fe0a37fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:25:50.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.541+0000 7fe0a37fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:25:50.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.541+0000 7fe0a37fe640 1 -- 10.20.193.110:0/2262579347 >> v1:10.20.193.110:6789/0 conn(0x7fe0c4128230 legacy=0x7fe0c4197b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:50.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.541+0000 7fe0a37fe640 1 -- 10.20.193.110:0/2262579347 >> v1:10.20.193.110:6789/0 conn(0x7fe0c4128230 legacy=0x7fe0c4197b50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:25:50.543 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:25:50.543 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:25:50.543 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:25:50.543 INFO:teuthology.orchestra.run.trial110.stdout: "state": "peon", 2026-02-13T20:25:50.543 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 54, 2026-02-13T20:25:50.543 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 265959, 2026-02-13T20:25:50.543 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:25:50.543 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:25:50.543 INFO:teuthology.orchestra.run.trial110.stdout: 1 2026-02-13T20:25:50.543 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:25:50.543 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 0, 2026-02-13T20:25:50.543 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:25:50.543 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:25:50.543 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:25:50.544 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:25:50.544 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:25:50.544 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:25:50.544 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:25:50.544 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:25:50.544 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:25:50.544 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:25:50.544 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:25:50.544 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:25:50.544 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:25:50.544 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:25:50.544 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:25:50.544 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:25:50.544 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:25:50.544 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:25:50.544 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:25:50.544 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:25:50.544 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:25:50.544 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:25:50.544 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:25:50.544 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:25:50.544 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:25:50.544 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:25:50.544 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:25:50.544 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:25:50.544 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:25:50.544 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:25:50.544 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:25:50.544 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:25:50.544 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:25:50.544 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:50.544 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:25:50.544 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:25:50.544 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:25:50.544 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:25:50.544 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:25:50.544 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:25:50.545 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:25:50.545 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:25:50.545 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:25:50.545 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:25:50.545 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:25:50.545 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:25:50.545 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:25:50.545 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:25:50.545 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:25:50.545 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:25:50.545 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:25:50.545 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:25:50.545 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:25:50.545 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:25:50.545 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:25:50.545 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:25:50.545 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:25:50.545 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:25:50.545 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:25:50.545 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:25:50.545 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:25:50.545 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:25:50.545 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:25:50.545 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:25:50.545 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:25:50.545 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:25:50.545 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:50.545 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:25:50.545 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:50.545 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:25:50.545 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:25:50.545 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:25:50.545 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:25:50.545 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:50.545 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:25:50.545 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:25:50.545 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:25:50.545 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:50.545 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:25:50.546 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:50.546 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:25:50.546 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:25:50.546 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:25:50.546 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:25:50.546 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:25:50.546 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:25:50.546 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:50.546 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:50.546 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:25:50.546 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:25:50.546 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:25:50.546 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:25:50.546 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:50.546 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:25:50.546 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:25:50.546 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:25:50.546 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:50.546 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:25:50.546 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:50.546 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:25:50.546 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:25:50.546 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:25:50.546 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:25:50.546 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:25:50.546 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:25:50.546 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:50.546 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:50.546 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:25:50.546 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:25:50.546 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:25:50.546 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:25:50.546 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:50.546 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:25:50.546 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:25:50.546 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:25:50.546 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:50.546 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:25:50.546 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:50.547 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:25:50.547 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:25:50.547 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:25:50.547 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:25:50.547 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:25:50.547 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:25:50.547 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:50.547 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:25:50.547 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:50.547 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:25:50.547 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:25:50.547 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:50.547 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:25:50.547 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:25:50.547 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:25:50.547 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:50.547 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:25:50.547 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:25:50.547 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:50.547 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:25:50.547 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:25:50.547 INFO:teuthology.orchestra.run.trial110.stdout: "num": 3 2026-02-13T20:25:50.547 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:50.547 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:25:50.547 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:25:50.547 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:50.547 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:25:50.547 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:25:50.547 INFO:teuthology.orchestra.run.trial110.stdout: "num": 5 2026-02-13T20:25:50.547 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:50.547 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:25:50.547 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:50.547 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:25:50.547 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:25:50.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.541+0000 7fe0c961b640 1 -- 10.20.193.110:0/2262579347 >> v1:10.20.193.188:6812/1623052694 conn(0x7fe09003f570 legacy=0x7fe09005fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:50.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.541+0000 7fe0c961b640 10 monclient: shutdown 2026-02-13T20:25:50.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.541+0000 7fe0c961b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:25:50.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.541+0000 7fe0c961b640 1 -- 10.20.193.110:0/2262579347 >> v1:10.20.193.110:6789/0 conn(0x7fe0c4091950 legacy=0x7fe0c4088e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:50.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.541+0000 7fe0c37fe640 1 -- 10.20.193.110:0/2262579347 reap_dead start 2026-02-13T20:25:50.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.541+0000 7fe0c37fe640 1 -- 10.20.193.110:0/2262579347 reap_dead start 2026-02-13T20:25:50.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.541+0000 7fe0c961b640 1 -- 10.20.193.110:0/2262579347 shutdown_connections 2026-02-13T20:25:50.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.541+0000 7fe0c961b640 1 -- 10.20.193.110:0/2262579347 >> 10.20.193.110:0/2262579347 conn(0x7fe0c4054e90 msgr2=0x7fe0c408dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:25:50.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.541+0000 7fe0c961b640 1 -- 10.20.193.110:0/2262579347 shutdown_connections 2026-02-13T20:25:50.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.541+0000 7fe0c961b640 1 -- 10.20.193.110:0/2262579347 wait complete. 2026-02-13T20:25:50.548 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-13T20:25:50.548 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-13T20:25:50.548 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T20:25:50.620 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.613+0000 7f09d2212640 10 monclient: get_monmap_and_config 2026-02-13T20:25:50.620 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.613+0000 7f09d2212640 10 monclient: build_initial_monmap 2026-02-13T20:25:50.620 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.613+0000 7f09d2212640 10 monclient: monmap: 2026-02-13T20:25:50.620 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:25:50.621 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:50.621 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:25:50.614920+0000 2026-02-13T20:25:50.621 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:25:50.614920+0000 2026-02-13T20:25:50.621 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:25:50.621 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:50.621 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:25:50.621 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:25:50.621 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:25:50.621 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:50.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.613+0000 7f09d2212640 1 Processor -- start 2026-02-13T20:25:50.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.613+0000 7f09d2212640 1 -- start start 2026-02-13T20:25:50.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.613+0000 7f09d2212640 10 monclient: init 2026-02-13T20:25:50.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.614+0000 7f09d2212640 10 monclient: _reopen_session rank -1 2026-02-13T20:25:50.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.614+0000 7f09d2212640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:25:50.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.614+0000 7f09d2212640 10 monclient(hunting): picked mon.noname-a con 0x7f09cc1401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:25:50.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.614+0000 7f09d2212640 10 monclient(hunting): picked mon.noname-c con 0x7f09cc092020 addr v1:10.20.193.188:6789/0 2026-02-13T20:25:50.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.614+0000 7f09d2212640 10 monclient(hunting): picked mon.noname-b con 0x7f09cc091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:25:50.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.614+0000 7f09d2212640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09cc08b730 con 0x7f09cc1401c0 2026-02-13T20:25:50.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.614+0000 7f09d2212640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09cc05c5b0 con 0x7f09cc092020 2026-02-13T20:25:50.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.614+0000 7f09d2212640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09cc08bcf0 con 0x7f09cc091950 2026-02-13T20:25:50.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.614+0000 7f09d2212640 10 monclient(hunting): _renew_subs 2026-02-13T20:25:50.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.614+0000 7f09d2212640 10 monclient(hunting): authenticate will time out at 1512.305273s 2026-02-13T20:25:50.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.614+0000 7f09cbfff640 1 -- >> v1:10.20.193.110:6790/0 conn(0x7f09cc091950 legacy=0x7f09cc1a2a20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.110:6790/0 2026-02-13T20:25:50.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.614+0000 7f09cb7fe640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f09cc1401c0 0x7f09cc091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:47588/0 (socket says 10.20.193.110:47588) 2026-02-13T20:25:50.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.614+0000 7f09cb7fe640 1 -- 10.20.193.110:0/3239907058 learned_addr learned my addr 10.20.193.110:0/3239907058 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:25:50.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.614+0000 7f09ca7fc640 1 -- 10.20.193.110:0/3239907058 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3475718416 0 0) 0x7f09cc08b730 con 0x7f09cc1401c0 2026-02-13T20:25:50.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.614+0000 7f09ca7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:25:50.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.614+0000 7f09ca7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:50.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.614+0000 7f09ca7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:50.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.614+0000 7f09ca7fc640 10 monclient(hunting): my global_id is 124380 2026-02-13T20:25:50.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.614+0000 7f09ca7fc640 1 -- 10.20.193.110:0/3239907058 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09b00035e0 con 0x7f09cc1401c0 2026-02-13T20:25:50.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.614+0000 7f09ca7fc640 1 -- 10.20.193.110:0/3239907058 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2744132079 0 0) 0x7f09b00035e0 con 0x7f09cc1401c0 2026-02-13T20:25:50.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.614+0000 7f09ca7fc640 1 -- 10.20.193.110:0/3239907058 >> v1:10.20.193.110:6790/0 conn(0x7f09cc091950 legacy=0x7f09cc1a2a20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:25:50.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.614+0000 7f09ca7fc640 1 -- 10.20.193.110:0/3239907058 >> v1:10.20.193.188:6789/0 conn(0x7f09cc092020 legacy=0x7f09cc1812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:50.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.614+0000 7f09ca7fc640 10 monclient: _finish_hunting 0 2026-02-13T20:25:50.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.614+0000 7f09ca7fc640 1 monclient: found mon.noname-a 2026-02-13T20:25:50.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.614+0000 7f09ca7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:25:50.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.614+0000 7f09ca7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:25:50.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.614+0000 7f09ca7fc640 1 -- 10.20.193.110:0/3239907058 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09cc140590 con 0x7f09cc1401c0 2026-02-13T20:25:50.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.614+0000 7f09ca7fc640 10 monclient: _finish_auth 0 2026-02-13T20:25:50.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.614+0000 7f09ca7fc640 10 monclient: _check_auth_tickets 2026-02-13T20:25:50.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.614+0000 7f09ca7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:25:50.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.614+0000 7f09ca7fc640 1 -- 10.20.193.110:0/3239907058 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f09b8002dd0 con 0x7f09cc1401c0 2026-02-13T20:25:50.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.614+0000 7f09ca7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:50.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.614+0000 7f09ca7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:25:50.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.614+0000 7f09ca7fc640 10 monclient: dump: 2026-02-13T20:25:50.623 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:50.623 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:50.623 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:50.623 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:50.623 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:50.623 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:50.624 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:50.624 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:50.624 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:50.624 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:50.624 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.614+0000 7f09d2212640 5 monclient: authenticate success, global_id 124380 2026-02-13T20:25:50.624 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.614+0000 7f09d2212640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:25:50.624 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.614+0000 7f09ca7fc640 1 -- 10.20.193.110:0/3239907058 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f09b8002fa0 con 0x7f09cc1401c0 2026-02-13T20:25:50.624 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.614+0000 7f09ca7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:25:50.624 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.614+0000 7f09d2212640 10 monclient: get_monmap_and_config success 2026-02-13T20:25:50.624 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.614+0000 7f09d2212640 4 set_mon_vals no callback set 2026-02-13T20:25:50.624 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.614+0000 7f09ca7fc640 1 -- 10.20.193.110:0/3239907058 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f09b80033b0 con 0x7f09cc1401c0 2026-02-13T20:25:50.624 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.614+0000 7f09ca7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:50.624 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.614+0000 7f09ca7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:25:50.624 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.614+0000 7f09ca7fc640 10 monclient: dump: 2026-02-13T20:25:50.624 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:50.624 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:50.624 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:50.624 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:50.625 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:50.625 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:50.625 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:50.625 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:50.625 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:50.625 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:50.625 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.615+0000 7f09d2212640 10 monclient: shutdown 2026-02-13T20:25:50.625 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.615+0000 7f09d2212640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:25:50.625 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.615+0000 7f09d2212640 1 -- 10.20.193.110:0/3239907058 >> v1:10.20.193.110:6789/0 conn(0x7f09cc1401c0 legacy=0x7f09cc091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:50.625 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.615+0000 7f09d2212640 1 -- 10.20.193.110:0/3239907058 shutdown_connections 2026-02-13T20:25:50.625 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.615+0000 7f09d2212640 1 -- 10.20.193.110:0/3239907058 >> 10.20.193.110:0/3239907058 conn(0x7f09cc054e90 msgr2=0x7f09cc058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:25:50.625 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.615+0000 7f09d2212640 1 -- 10.20.193.110:0/3239907058 shutdown_connections 2026-02-13T20:25:50.625 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.615+0000 7f09d2212640 1 -- 10.20.193.110:0/3239907058 wait complete. 2026-02-13T20:25:50.625 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.615+0000 7f09d2212640 10 monclient: build_initial_monmap 2026-02-13T20:25:50.625 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.615+0000 7f09d2212640 10 monclient: monmap: 2026-02-13T20:25:50.625 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:25:50.625 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:25:50.625 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:25:50.626 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:25:50.626 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:25:50.626 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:25:50.626 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:25:50.626 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:25:50.626 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:25:50.626 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:50.626 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.615+0000 7f09d2212640 1 Processor -- start 2026-02-13T20:25:50.626 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.615+0000 7f09d2212640 1 -- start start 2026-02-13T20:25:50.626 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.615+0000 7f09d2212640 10 monclient: init 2026-02-13T20:25:50.626 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09d2212640 10 monclient: _reopen_session rank -1 2026-02-13T20:25:50.626 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09d2212640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:25:50.626 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09d2212640 10 monclient(hunting): picked mon.noname-a con 0x7f09cc091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:25:50.626 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09d2212640 10 monclient(hunting): picked mon.noname-c con 0x7f09cc1401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:25:50.626 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09d2212640 10 monclient(hunting): picked mon.noname-b con 0x7f09cc13eae0 addr v1:10.20.193.188:6789/0 2026-02-13T20:25:50.626 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09d2212640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09cc12e5d0 con 0x7f09cc091950 2026-02-13T20:25:50.626 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09d2212640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09cc08c480 con 0x7f09cc13eae0 2026-02-13T20:25:50.626 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09d2212640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09cc12f550 con 0x7f09cc1401c0 2026-02-13T20:25:50.626 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09d2212640 10 monclient(hunting): _renew_subs 2026-02-13T20:25:50.627 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09d2212640 10 monclient(hunting): authenticate will time out at 1512.307189s 2026-02-13T20:25:50.627 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09caffd640 1 -- >> v1:10.20.193.110:6790/0 conn(0x7f09cc1401c0 legacy=0x7f09cc13e3d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.110:6790/0 2026-02-13T20:25:50.627 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09cb7fe640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f09cc091950 0x7f09cc150270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:47604/0 (socket says 10.20.193.110:47604) 2026-02-13T20:25:50.627 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09cb7fe640 1 -- 10.20.193.110:0/3504220363 learned_addr learned my addr 10.20.193.110:0/3504220363 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:25:50.627 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09a7fff640 1 -- 10.20.193.110:0/3504220363 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2554592801 0 0) 0x7f09cc12e5d0 con 0x7f09cc091950 2026-02-13T20:25:50.627 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09a7fff640 10 monclient(hunting): _negotiate 2026-02-13T20:25:50.627 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09a7fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:50.627 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09a7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:50.627 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09a7fff640 10 monclient(hunting): my global_id is 124383 2026-02-13T20:25:50.627 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09a7fff640 1 -- 10.20.193.110:0/3504220363 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f099c0035e0 con 0x7f09cc091950 2026-02-13T20:25:50.627 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09a7fff640 1 -- 10.20.193.110:0/3504220363 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3377926382 0 0) 0x7f099c0035e0 con 0x7f09cc091950 2026-02-13T20:25:50.627 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09a7fff640 1 -- 10.20.193.110:0/3504220363 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f09cc12e5d0 con 0x7f09cc091950 2026-02-13T20:25:50.627 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09a7fff640 1 -- 10.20.193.110:0/3504220363 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f09b80032c0 con 0x7f09cc091950 2026-02-13T20:25:50.627 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09a7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:25:50.627 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09a7fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:25:50.627 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09a7fff640 10 monclient(hunting): dump: 2026-02-13T20:25:50.627 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:50.627 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:50.628 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:50.628 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:50.628 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:50.628 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:50.628 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:50.628 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:50.628 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:50.628 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:50.628 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09a7fff640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:25:50.628 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09a7fff640 1 -- 10.20.193.110:0/3504220363 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3687668687 0 0) 0x7f09cc12e5d0 con 0x7f09cc091950 2026-02-13T20:25:50.628 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09a7fff640 1 -- 10.20.193.110:0/3504220363 >> v1:10.20.193.110:6790/0 conn(0x7f09cc1401c0 legacy=0x7f09cc13e3d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T20:25:50.628 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09a7fff640 1 -- 10.20.193.110:0/3504220363 >> v1:10.20.193.188:6789/0 conn(0x7f09cc13eae0 legacy=0x7f09cc1925e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:50.628 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09a7fff640 10 monclient: _finish_hunting 0 2026-02-13T20:25:50.628 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09a7fff640 1 monclient: found mon.a 2026-02-13T20:25:50.628 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09a7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:25:50.628 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09a7fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:25:50.628 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09a7fff640 1 -- 10.20.193.110:0/3504220363 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09cc12fb10 con 0x7f09cc091950 2026-02-13T20:25:50.628 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09a7fff640 10 monclient: _finish_auth 0 2026-02-13T20:25:50.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09a7fff640 10 monclient: _check_auth_tickets 2026-02-13T20:25:50.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09a7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:25:50.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09d2212640 5 monclient: authenticate success, global_id 124383 2026-02-13T20:25:50.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09d2212640 10 monclient: _renew_subs 2026-02-13T20:25:50.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09d2212640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:25:50.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09d2212640 1 -- 10.20.193.110:0/3504220363 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f09cc05d320 con 0x7f09cc091950 2026-02-13T20:25:50.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09d2212640 10 monclient: _renew_subs 2026-02-13T20:25:50.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09d2212640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:25:50.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09d2212640 1 -- 10.20.193.110:0/3504220363 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f09cc193d00 con 0x7f09cc091950 2026-02-13T20:25:50.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09a7fff640 1 -- 10.20.193.110:0/3504220363 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f09b8003460 con 0x7f09cc091950 2026-02-13T20:25:50.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09a7fff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:25:50.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09a7fff640 1 -- 10.20.193.110:0/3504220363 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f09b8004d40 con 0x7f09cc091950 2026-02-13T20:25:50.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09a7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:50.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09a7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:25:50.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09c9ffb640 4 set_mon_vals no callback set 2026-02-13T20:25:50.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.616+0000 7f09a7fff640 10 monclient: dump: 2026-02-13T20:25:50.629 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:50.629 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:50.629 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:50.630 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:50.630 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:50.630 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:50.630 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:50.630 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:50.630 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:50.630 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:50.630 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.617+0000 7f09d2212640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:25:50.630 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.617+0000 7f09d2212640 1 -- 10.20.193.110:0/3504220363 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f09cc12f6e0 con 0x7f09cc092020 2026-02-13T20:25:50.630 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.617+0000 7f09a7fff640 1 -- 10.20.193.110:0/3504220363 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f09b8004ea0 con 0x7f09cc091950 2026-02-13T20:25:50.630 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.617+0000 7f09a7fff640 1 -- 10.20.193.110:0/3504220363 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(681..681 src has 1..681) ==== 3899+0+0 (unknown 3847639174 0 0) 0x7f09b804eae0 con 0x7f09cc091950 2026-02-13T20:25:50.630 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.617+0000 7f09a7fff640 1 -- 10.20.193.110:0/3504220363 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3921095720 0 0) 0x7f09cc05c5b0 con 0x7f09cc092020 2026-02-13T20:25:50.630 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.617+0000 7f09a7fff640 10 monclient(hunting): _negotiate 2026-02-13T20:25:50.630 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.617+0000 7f09a7fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:50.630 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.617+0000 7f09a7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:50.630 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.617+0000 7f09a7fff640 10 monclient(hunting): my global_id is 144175 2026-02-13T20:25:50.630 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.617+0000 7f09a7fff640 1 -- 10.20.193.110:0/3504220363 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09cc12e5d0 con 0x7f09cc092020 2026-02-13T20:25:50.630 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.617+0000 7f09cbfff640 10 monclient: get_auth_request con 0x7f099c03f5e0 auth_method 0 2026-02-13T20:25:50.631 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.617+0000 7f09a7fff640 1 -- 10.20.193.110:0/3504220363 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 642305505 0 0) 0x7f09cc12e5d0 con 0x7f09cc092020 2026-02-13T20:25:50.631 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.617+0000 7f09a7fff640 1 -- 10.20.193.110:0/3504220363 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f09cc05c5b0 con 0x7f09cc092020 2026-02-13T20:25:50.631 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.617+0000 7f09a7fff640 1 -- 10.20.193.110:0/3504220363 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f09bc002e30 con 0x7f09cc092020 2026-02-13T20:25:50.631 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.617+0000 7f09a7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:50.631 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.617+0000 7f09a7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:25:50.631 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.617+0000 7f09a7fff640 10 monclient: dump: 2026-02-13T20:25:50.631 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:50.631 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:50.631 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:50.631 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:50.631 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:50.631 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:50.631 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:50.631 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:50.631 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:50.631 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:50.631 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.618+0000 7f09a7fff640 1 -- 10.20.193.110:0/3504220363 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1334855602 0 0) 0x7f09cc05c5b0 con 0x7f09cc092020 2026-02-13T20:25:50.631 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.618+0000 7f09a7fff640 1 -- 10.20.193.110:0/3504220363 --> v1:10.20.193.188:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f09cc08b450 con 0x7f09cc092020 2026-02-13T20:25:50.631 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.618+0000 7f09a7fff640 1 -- 10.20.193.110:0/3504220363 <== mon.1 v1:10.20.193.188:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f09bc0033d0 con 0x7f09cc092020 2026-02-13T20:25:50.632 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.618+0000 7f09a7fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:25:50.632 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.618+0000 7f09a7fff640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:25:50.632 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.618+0000 7f09a7fff640 1 -- 10.20.193.110:0/3504220363 >> v1:10.20.193.188:6789/0 conn(0x7f09cc092020 legacy=0x7f09cc127b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:50.632 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.618+0000 7f09a7fff640 1 -- 10.20.193.110:0/3504220363 >> v1:10.20.193.188:6789/0 conn(0x7f09cc092020 legacy=0x7f09cc127b20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:25:50.633 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.621+0000 7f09d2212640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:25:50.633 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.621+0000 7f09d2212640 1 -- 10.20.193.110:0/3504220363 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f09cc12fd30 con 0x7f09cc128230 2026-02-13T20:25:50.633 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.622+0000 7f09a7fff640 1 -- 10.20.193.110:0/3504220363 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1248273051 0 0) 0x7f09cc12fd30 con 0x7f09cc128230 2026-02-13T20:25:50.633 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.622+0000 7f09a7fff640 10 monclient(hunting): _negotiate 2026-02-13T20:25:50.633 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.622+0000 7f09a7fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:25:50.633 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.622+0000 7f09a7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:25:50.633 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.622+0000 7f09a7fff640 10 monclient(hunting): my global_id is 144178 2026-02-13T20:25:50.633 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.622+0000 7f09a7fff640 1 -- 10.20.193.110:0/3504220363 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09cc05c5b0 con 0x7f09cc128230 2026-02-13T20:25:50.633 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.622+0000 7f09a7fff640 1 -- 10.20.193.110:0/3504220363 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1478354823 0 0) 0x7f09cc05c5b0 con 0x7f09cc128230 2026-02-13T20:25:50.633 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.622+0000 7f09a7fff640 1 -- 10.20.193.110:0/3504220363 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f09cc12fd30 con 0x7f09cc128230 2026-02-13T20:25:50.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.622+0000 7f09a7fff640 1 -- 10.20.193.110:0/3504220363 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f09bc003aa0 con 0x7f09cc128230 2026-02-13T20:25:50.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.622+0000 7f09a7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:25:50.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.622+0000 7f09a7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:25:50.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.622+0000 7f09a7fff640 10 monclient: dump: 2026-02-13T20:25:50.634 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:25:50.634 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:25:50.634 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:50.634 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:25:50.634 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:25:50.634 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:25:50.634 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:25:50.634 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:25:50.634 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:25:50.634 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:25:50.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.622+0000 7f09a7fff640 1 -- 10.20.193.110:0/3504220363 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 325304604 0 0) 0x7f09cc12fd30 con 0x7f09cc128230 2026-02-13T20:25:50.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.622+0000 7f09a7fff640 1 -- 10.20.193.110:0/3504220363 --> v1:10.20.193.188:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f09cc055bb0 con 0x7f09cc128230 2026-02-13T20:25:50.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.622+0000 7f09a7fff640 1 -- 10.20.193.110:0/3504220363 <== mon.1 v1:10.20.193.188:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4671 (unknown 0 0 1057553740) 0x7f09bc005880 con 0x7f09cc128230 2026-02-13T20:25:50.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.622+0000 7f09a7fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:25:50.635 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.622+0000 7f09a7fff640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:25:50.635 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.622+0000 7f09a7fff640 1 -- 10.20.193.110:0/3504220363 >> v1:10.20.193.188:6789/0 conn(0x7f09cc128230 legacy=0x7f09cc195010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:50.635 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.622+0000 7f09a7fff640 1 -- 10.20.193.110:0/3504220363 >> v1:10.20.193.188:6789/0 conn(0x7f09cc128230 legacy=0x7f09cc195010 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:25:50.635 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:25:50.635 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:25:50.635 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:25:50.635 INFO:teuthology.orchestra.run.trial110.stdout: "state": "leader", 2026-02-13T20:25:50.635 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 54, 2026-02-13T20:25:50.635 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 16893, 2026-02-13T20:25:50.635 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:25:50.635 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:25:50.635 INFO:teuthology.orchestra.run.trial110.stdout: 1 2026-02-13T20:25:50.636 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:25:50.636 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 0, 2026-02-13T20:25:50.636 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:25:50.636 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:25:50.636 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:25:50.636 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:25:50.636 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:25:50.636 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:25:50.636 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:25:50.636 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:25:50.636 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:25:50.636 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:25:50.636 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:25:50.636 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:25:50.636 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:25:50.636 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:25:50.636 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:25:50.636 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:25:50.637 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:25:50.637 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:25:50.637 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:25:50.637 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:25:50.637 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:25:50.637 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:25:50.637 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:25:50.637 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:25:50.637 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:25:50.637 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:25:50.637 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:25:50.637 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:25:50.637 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:25:50.637 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:25:50.637 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:25:50.637 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:25:50.637 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:25:50.637 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:50.638 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:25:50.638 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:25:50.638 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:25:50.638 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:25:50.638 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:25:50.638 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:25:50.638 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:25:50.638 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:25:50.638 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:25:50.638 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:25:50.638 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:25:50.638 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:25:50.638 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:25:50.638 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:25:50.638 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:25:50.638 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:25:50.638 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:25:50.638 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:25:50.639 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:25:50.639 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:25:50.639 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:25:50.639 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:25:50.639 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:25:50.639 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:25:50.639 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:25:50.639 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:25:50.639 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:25:50.639 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:25:50.639 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:25:50.639 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:25:50.639 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:25:50.639 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:25:50.639 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:50.639 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:25:50.639 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:50.639 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:25:50.640 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:25:50.640 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:25:50.640 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:25:50.640 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:50.640 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:25:50.640 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:25:50.640 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:25:50.640 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:50.640 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:25:50.640 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:50.640 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:25:50.640 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:25:50.640 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:25:50.640 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:25:50.640 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:25:50.640 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:25:50.640 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:50.640 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:50.641 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:25:50.641 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:25:50.641 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:25:50.641 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:25:50.641 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:50.641 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:25:50.641 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:25:50.641 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:25:50.641 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:50.641 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:25:50.641 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:50.641 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:25:50.641 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:25:50.641 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:25:50.641 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:25:50.641 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:25:50.641 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:25:50.641 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:50.641 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:50.642 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:25:50.642 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:25:50.642 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:25:50.642 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:25:50.642 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:50.642 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:25:50.642 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:25:50.642 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:25:50.642 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:50.642 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:25:50.642 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:50.642 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:25:50.642 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:25:50.642 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:25:50.642 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:25:50.642 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:25:50.642 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:25:50.642 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:50.643 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:25:50.643 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:50.643 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:25:50.643 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:25:50.643 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:50.643 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:25:50.643 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:25:50.643 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:25:50.643 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:50.643 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:25:50.643 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:25:50.643 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:50.643 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:25:50.643 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:25:50.643 INFO:teuthology.orchestra.run.trial110.stdout: "num": 3 2026-02-13T20:25:50.643 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:50.643 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:25:50.643 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:25:50.643 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:50.643 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:25:50.644 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:25:50.644 INFO:teuthology.orchestra.run.trial110.stdout: "num": 3 2026-02-13T20:25:50.644 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:50.644 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:25:50.644 INFO:teuthology.orchestra.run.trial110.stdout: "mgr": [ 2026-02-13T20:25:50.644 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:25:50.644 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:25:50.644 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:25:50.644 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:25:50.644 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:25:50.644 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:25:50.644 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:25:50.644 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:25:50.644 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:25:50.645 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.622+0000 7f09d2212640 1 -- 10.20.193.110:0/3504220363 >> v1:10.20.193.188:6812/1623052694 conn(0x7f099c03f5e0 legacy=0x7f099c05fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:50.645 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.623+0000 7f09d2212640 10 monclient: shutdown 2026-02-13T20:25:50.645 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.623+0000 7f09d2212640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:25:50.645 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.623+0000 7f09d2212640 1 -- 10.20.193.110:0/3504220363 >> v1:10.20.193.110:6789/0 conn(0x7f09cc091950 legacy=0x7f09cc150270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:25:50.646 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.623+0000 7f09cbfff640 1 -- 10.20.193.110:0/3504220363 reap_dead start 2026-02-13T20:25:50.646 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.623+0000 7f09cbfff640 1 -- 10.20.193.110:0/3504220363 reap_dead start 2026-02-13T20:25:50.646 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.623+0000 7f09d2212640 1 -- 10.20.193.110:0/3504220363 shutdown_connections 2026-02-13T20:25:50.646 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.623+0000 7f09d2212640 1 -- 10.20.193.110:0/3504220363 >> 10.20.193.110:0/3504220363 conn(0x7f09cc054e90 msgr2=0x7f09cc08dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:25:50.646 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.623+0000 7f09d2212640 1 -- 10.20.193.110:0/3504220363 shutdown_connections 2026-02-13T20:25:50.646 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:25:50.623+0000 7f09d2212640 1 -- 10.20.193.110:0/3504220363 wait complete. 2026-02-13T20:25:50.646 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-13T20:25:50.646 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-13T20:25:51.360 INFO:tasks.rados.rados.0.trial188.stdout:3207: done (0 left) 2026-02-13T20:25:51.360 INFO:tasks.rados.rados.0.trial188.stdout:3208: snap_remove snap 326 2026-02-13T20:25:52.360 INFO:tasks.rados.rados.0.trial188.stdout:3208: done (0 left) 2026-02-13T20:25:52.361 INFO:tasks.rados.rados.0.trial188.stdout:3209: rollback oid 13 current snap is 328 2026-02-13T20:25:52.361 INFO:tasks.rados.rados.0.trial188.stdout:3209: done (0 left) 2026-02-13T20:25:52.361 INFO:tasks.rados.rados.0.trial188.stdout:3210: write (excl) oid 23 current snap is 328 2026-02-13T20:25:52.361 INFO:tasks.rados.rados.0.trial188.stdout:3210: seq_num 1109 ranges {638963=722326,2079707=424046} 2026-02-13T20:25:52.365 INFO:tasks.rados.rados.0.trial188.stdout:3210: writing trial18843701-23 from 638963 to 1361289 tid 1 2026-02-13T20:25:52.370 INFO:tasks.rados.rados.0.trial188.stdout:3210: writing trial18843701-23 from 2079707 to 2503753 tid 2 2026-02-13T20:25:52.370 INFO:tasks.rados.rados.0.trial188.stdout:3211: write (excl) oid 19 current snap is 328 2026-02-13T20:25:52.370 INFO:tasks.rados.rados.0.trial188.stdout:3211: seq_num 1110 ranges {655770=513928,1854542=684057} 2026-02-13T20:25:52.374 INFO:tasks.rados.rados.0.trial188.stdout:3211: writing trial18843701-19 from 655770 to 1169698 tid 1 2026-02-13T20:25:52.379 INFO:tasks.rados.rados.0.trial188.stdout:3211: writing trial18843701-19 from 1854542 to 2538599 tid 2 2026-02-13T20:25:52.379 INFO:tasks.rados.rados.0.trial188.stdout:3212: copy_from oid 41 from oid 12 current snap is 328 2026-02-13T20:25:52.379 INFO:tasks.rados.rados.0.trial188.stdout:3213: rollback oid 35 current snap is 328 2026-02-13T20:25:52.379 INFO:tasks.rados.rados.0.trial188.stdout:3213: done (3 left) 2026-02-13T20:25:52.379 INFO:tasks.rados.rados.0.trial188.stdout:3214: snap_create 2026-02-13T20:25:52.392 INFO:tasks.rados.rados.0.trial188.stdout:3210: finishing write tid 1 to trial18843701-23 2026-02-13T20:25:52.400 INFO:tasks.rados.rados.0.trial188.stdout:3210: finishing write tid 2 to trial18843701-23 2026-02-13T20:25:52.400 INFO:tasks.rados.rados.0.trial188.stdout:3211: finishing write tid 1 to trial18843701-19 2026-02-13T20:25:52.400 INFO:tasks.rados.rados.0.trial188.stdout:3210: finishing write tid 3 to trial18843701-23 2026-02-13T20:25:52.400 INFO:tasks.rados.rados.0.trial188.stdout:3210: finishing write tid 4 to trial18843701-23 2026-02-13T20:25:52.400 INFO:tasks.rados.rados.0.trial188.stdout:3210: oid 23 updating version 0 to 1605 2026-02-13T20:25:52.401 INFO:tasks.rados.rados.0.trial188.stdout:3210: oid 23 version 1605 is already newer than 1604 2026-02-13T20:25:52.401 INFO:tasks.rados.rados.0.trial188.stdout:3210: oid 23 version 1605 is already newer than 1603 2026-02-13T20:25:52.401 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 23 v 1605 (ObjNum 1109 snap 328 seq_num 1109) dirty exists 2026-02-13T20:25:52.401 INFO:tasks.rados.rados.0.trial188.stdout:3210: left oid 23 (ObjNum 1109 snap 328 seq_num 1109) 2026-02-13T20:25:52.401 INFO:tasks.rados.rados.0.trial188.stdout:3211: finishing write tid 2 to trial18843701-19 2026-02-13T20:25:52.401 INFO:tasks.rados.rados.0.trial188.stdout:3211: finishing write tid 3 to trial18843701-19 2026-02-13T20:25:52.401 INFO:tasks.rados.rados.0.trial188.stdout:3211: finishing write tid 4 to trial18843701-19 2026-02-13T20:25:52.401 INFO:tasks.rados.rados.0.trial188.stdout:3211: oid 19 updating version 0 to 1469 2026-02-13T20:25:52.401 INFO:tasks.rados.rados.0.trial188.stdout:3211: oid 19 updating version 1469 to 1471 2026-02-13T20:25:52.401 INFO:tasks.rados.rados.0.trial188.stdout:3211: oid 19 version 1471 is already newer than 1470 2026-02-13T20:25:52.401 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 19 v 1471 (ObjNum 1110 snap 328 seq_num 1110) dirty exists 2026-02-13T20:25:52.401 INFO:tasks.rados.rados.0.trial188.stdout:3211: left oid 19 (ObjNum 1110 snap 328 seq_num 1110) 2026-02-13T20:25:52.416 INFO:tasks.rados.rados.0.trial188.stdout:3212: finishing copy_from racing read to trial18843701-41 2026-02-13T20:25:52.416 INFO:tasks.rados.rados.0.trial188.stdout:3212: finishing copy_from to trial18843701-41 2026-02-13T20:25:52.416 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 41 v 985 (ObjNum 865 snap 250 seq_num 865) dirty exists 2026-02-13T20:25:53.365 INFO:tasks.rados.rados.0.trial188.stdout:3210: done (3 left) 2026-02-13T20:25:53.366 INFO:tasks.rados.rados.0.trial188.stdout:3211: done (2 left) 2026-02-13T20:25:53.366 INFO:tasks.rados.rados.0.trial188.stdout:3212: done (1 left) 2026-02-13T20:25:53.366 INFO:tasks.rados.rados.0.trial188.stdout:3214: done (0 left) 2026-02-13T20:25:53.366 INFO:tasks.rados.rados.0.trial188.stdout:3215: write oid 21 current snap is 329 2026-02-13T20:25:53.366 INFO:tasks.rados.rados.0.trial188.stdout:3215: seq_num 1111 ranges {672577=589177,1913024=427715} 2026-02-13T20:25:53.371 INFO:tasks.rados.rados.0.trial188.stdout:3215: writing trial18843701-21 from 672577 to 1261754 tid 1 2026-02-13T20:25:53.375 INFO:tasks.rados.rados.0.trial188.stdout:3215: writing trial18843701-21 from 1913024 to 2340739 tid 2 2026-02-13T20:25:53.375 INFO:tasks.rados.rados.0.trial188.stdout:3216: write (excl) oid 49 current snap is 329 2026-02-13T20:25:53.375 INFO:tasks.rados.rados.0.trial188.stdout:3216: seq_num 1112 ranges {689384=664426,1971506=687726} 2026-02-13T20:25:53.380 INFO:tasks.rados.rados.0.trial188.stdout:3216: writing trial18843701-49 from 689384 to 1353810 tid 1 2026-02-13T20:25:53.385 INFO:tasks.rados.rados.0.trial188.stdout:3216: writing trial18843701-49 from 1971506 to 2659232 tid 2 2026-02-13T20:25:53.385 INFO:tasks.rados.rados.0.trial188.stdout:3217: read oid 26 snap 328 2026-02-13T20:25:53.385 INFO:tasks.rados.rados.0.trial188.stdout:3217: expect (ObjNum 1003 snap 299 seq_num 1003) 2026-02-13T20:25:53.385 INFO:tasks.rados.rados.0.trial188.stdout:3218: snap_create 2026-02-13T20:25:53.388 INFO:tasks.rados.rados.0.trial188.stdout:3215: finishing write tid 1 to trial18843701-21 2026-02-13T20:25:53.388 INFO:tasks.rados.rados.0.trial188.stdout:3215: finishing write tid 2 to trial18843701-21 2026-02-13T20:25:53.388 INFO:tasks.rados.rados.0.trial188.stdout:3215: finishing write tid 3 to trial18843701-21 2026-02-13T20:25:53.389 INFO:tasks.rados.rados.0.trial188.stdout:3215: finishing write tid 4 to trial18843701-21 2026-02-13T20:25:53.389 INFO:tasks.rados.rados.0.trial188.stdout:3215: oid 21 updating version 0 to 994 2026-02-13T20:25:53.389 INFO:tasks.rados.rados.0.trial188.stdout:3215: oid 21 updating version 994 to 995 2026-02-13T20:25:53.389 INFO:tasks.rados.rados.0.trial188.stdout:3215: oid 21 version 995 is already newer than 993 2026-02-13T20:25:53.389 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 21 v 995 (ObjNum 1111 snap 329 seq_num 1111) dirty exists 2026-02-13T20:25:53.389 INFO:tasks.rados.rados.0.trial188.stdout:3215: left oid 21 (ObjNum 1111 snap 329 seq_num 1111) 2026-02-13T20:25:53.393 INFO:tasks.rados.rados.0.trial188.stdout:3217: expect (ObjNum 1003 snap 299 seq_num 1003) 2026-02-13T20:25:53.423 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2425944 2026-02-13T20:25:53.429 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:25:53.511 INFO:tasks.rados.rados.0.trial188.stdout:3216: finishing write tid 1 to trial18843701-49 2026-02-13T20:25:53.511 INFO:tasks.rados.rados.0.trial188.stdout:3216: finishing write tid 2 to trial18843701-49 2026-02-13T20:25:53.511 INFO:tasks.rados.rados.0.trial188.stdout:3216: finishing write tid 3 to trial18843701-49 2026-02-13T20:25:53.511 INFO:tasks.rados.rados.0.trial188.stdout:3216: finishing write tid 4 to trial18843701-49 2026-02-13T20:25:53.511 INFO:tasks.rados.rados.0.trial188.stdout:3216: oid 49 updating version 0 to 1497 2026-02-13T20:25:53.511 INFO:tasks.rados.rados.0.trial188.stdout:3216: oid 49 version 1497 is already newer than 1495 2026-02-13T20:25:53.511 INFO:tasks.rados.rados.0.trial188.stdout:3216: oid 49 version 1497 is already newer than 1496 2026-02-13T20:25:53.512 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 49 v 1497 (ObjNum 1112 snap 329 seq_num 1112) dirty exists 2026-02-13T20:25:53.512 INFO:tasks.rados.rados.0.trial188.stdout:3216: left oid 49 (ObjNum 1112 snap 329 seq_num 1112) 2026-02-13T20:25:53.737 INFO:tasks.rados.rados.0.trial188.stdout:3215: done (3 left) 2026-02-13T20:25:53.737 INFO:tasks.rados.rados.0.trial188.stdout:3216: done (2 left) 2026-02-13T20:25:53.737 INFO:tasks.rados.rados.0.trial188.stdout:3217: done (1 left) 2026-02-13T20:25:53.737 INFO:tasks.rados.rados.0.trial188.stdout:3218: done (0 left) 2026-02-13T20:25:53.737 INFO:tasks.rados.rados.0.trial188.stdout:3219: write (excl) oid 26 current snap is 330 2026-02-13T20:25:53.737 INFO:tasks.rados.rados.0.trial188.stdout:3219: seq_num 1113 ranges {706191=739675,1913635=431384} 2026-02-13T20:25:53.742 INFO:tasks.rados.rados.0.trial188.stdout:3219: writing trial18843701-26 from 706191 to 1445866 tid 1 2026-02-13T20:25:53.745 INFO:tasks.rados.rados.0.trial188.stdout:3219: writing trial18843701-26 from 1913635 to 2345019 tid 2 2026-02-13T20:25:53.745 INFO:tasks.rados.rados.0.trial188.stdout:3220: snap_create 2026-02-13T20:25:53.762 INFO:tasks.rados.rados.0.trial188.stdout:3219: finishing write tid 1 to trial18843701-26 2026-02-13T20:25:53.762 INFO:tasks.rados.rados.0.trial188.stdout:3219: finishing write tid 2 to trial18843701-26 2026-02-13T20:25:53.762 INFO:tasks.rados.rados.0.trial188.stdout:3219: finishing write tid 3 to trial18843701-26 2026-02-13T20:25:53.762 INFO:tasks.rados.rados.0.trial188.stdout:3219: finishing write tid 4 to trial18843701-26 2026-02-13T20:25:53.762 INFO:tasks.rados.rados.0.trial188.stdout:3219: oid 26 updating version 0 to 1089 2026-02-13T20:25:53.762 INFO:tasks.rados.rados.0.trial188.stdout:3219: oid 26 updating version 1089 to 1090 2026-02-13T20:25:53.762 INFO:tasks.rados.rados.0.trial188.stdout:3219: oid 26 updating version 1090 to 1091 2026-02-13T20:25:53.762 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 26 v 1091 (ObjNum 1113 snap 330 seq_num 1113) dirty exists 2026-02-13T20:25:53.763 INFO:tasks.rados.rados.0.trial188.stdout:3219: left oid 26 (ObjNum 1113 snap 330 seq_num 1113) 2026-02-13T20:25:54.740 INFO:tasks.rados.rados.0.trial188.stdout:3219: done (1 left) 2026-02-13T20:25:54.740 INFO:tasks.rados.rados.0.trial188.stdout:3220: done (0 left) 2026-02-13T20:25:54.740 INFO:tasks.rados.rados.0.trial188.stdout:3221: write oid 9 current snap is 331 2026-02-13T20:25:54.740 INFO:tasks.rados.rados.0.trial188.stdout:3221: seq_num 1114 ranges {722998=414924,1572117=575042} 2026-02-13T20:25:54.744 INFO:tasks.rados.rados.0.trial188.stdout:3221: writing trial18843701-9 from 722998 to 1137922 tid 1 2026-02-13T20:25:54.748 INFO:tasks.rados.rados.0.trial188.stdout:3221: writing trial18843701-9 from 1572117 to 2147159 tid 2 2026-02-13T20:25:54.748 INFO:tasks.rados.rados.0.trial188.stdout:3222: write oid 2 current snap is 331 2026-02-13T20:25:54.748 INFO:tasks.rados.rados.0.trial188.stdout:3222: seq_num 1115 ranges {739805=490173,1630599=435053,2636284=103521} 2026-02-13T20:25:54.753 INFO:tasks.rados.rados.0.trial188.stdout:3222: writing trial18843701-2 from 739805 to 1229978 tid 1 2026-02-13T20:25:54.756 INFO:tasks.rados.rados.0.trial188.stdout:3222: writing trial18843701-2 from 1630599 to 2065652 tid 2 2026-02-13T20:25:54.758 INFO:tasks.rados.rados.0.trial188.stdout:3222: writing trial18843701-2 from 2636284 to 2739805 tid 3 2026-02-13T20:25:54.758 INFO:tasks.rados.rados.0.trial188.stdout:3223: snap_create 2026-02-13T20:25:54.760 INFO:tasks.rados.rados.0.trial188.stdout:3221: finishing write tid 1 to trial18843701-9 2026-02-13T20:25:54.760 INFO:tasks.rados.rados.0.trial188.stdout:3221: finishing write tid 2 to trial18843701-9 2026-02-13T20:25:54.760 INFO:tasks.rados.rados.0.trial188.stdout:3221: finishing write tid 3 to trial18843701-9 2026-02-13T20:25:54.760 INFO:tasks.rados.rados.0.trial188.stdout:3221: finishing write tid 4 to trial18843701-9 2026-02-13T20:25:54.760 INFO:tasks.rados.rados.0.trial188.stdout:3221: oid 9 updating version 0 to 1431 2026-02-13T20:25:54.760 INFO:tasks.rados.rados.0.trial188.stdout:3221: oid 9 version 1431 is already newer than 1430 2026-02-13T20:25:54.760 INFO:tasks.rados.rados.0.trial188.stdout:3221: oid 9 version 1431 is already newer than 1429 2026-02-13T20:25:54.760 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 9 v 1431 (ObjNum 1114 snap 331 seq_num 1114) dirty exists 2026-02-13T20:25:54.760 INFO:tasks.rados.rados.0.trial188.stdout:3221: left oid 9 (ObjNum 1114 snap 331 seq_num 1114) 2026-02-13T20:25:54.775 INFO:tasks.rados.rados.0.trial188.stdout:3222: finishing write tid 1 to trial18843701-2 2026-02-13T20:25:54.775 INFO:tasks.rados.rados.0.trial188.stdout:3222: finishing write tid 2 to trial18843701-2 2026-02-13T20:25:54.775 INFO:tasks.rados.rados.0.trial188.stdout:3222: finishing write tid 3 to trial18843701-2 2026-02-13T20:25:54.775 INFO:tasks.rados.rados.0.trial188.stdout:3222: finishing write tid 4 to trial18843701-2 2026-02-13T20:25:54.775 INFO:tasks.rados.rados.0.trial188.stdout:3222: finishing write tid 5 to trial18843701-2 2026-02-13T20:25:54.775 INFO:tasks.rados.rados.0.trial188.stdout:3222: oid 2 updating version 0 to 1507 2026-02-13T20:25:54.775 INFO:tasks.rados.rados.0.trial188.stdout:3222: oid 2 version 1507 is already newer than 1506 2026-02-13T20:25:54.776 INFO:tasks.rados.rados.0.trial188.stdout:3222: oid 2 updating version 1507 to 1508 2026-02-13T20:25:54.776 INFO:tasks.rados.rados.0.trial188.stdout:3222: oid 2 version 1508 is already newer than 1505 2026-02-13T20:25:54.776 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 2 v 1508 (ObjNum 1115 snap 331 seq_num 1115) dirty exists 2026-02-13T20:25:54.776 INFO:tasks.rados.rados.0.trial188.stdout:3222: left oid 2 (ObjNum 1115 snap 331 seq_num 1115) 2026-02-13T20:25:55.742 INFO:tasks.rados.rados.0.trial188.stdout:3221: done (2 left) 2026-02-13T20:25:55.743 INFO:tasks.rados.rados.0.trial188.stdout:3222: done (1 left) 2026-02-13T20:25:55.743 INFO:tasks.rados.rados.0.trial188.stdout:3223: done (0 left) 2026-02-13T20:25:55.743 INFO:tasks.rados.rados.0.trial188.stdout:3224: copy_from oid 34 from oid 9 current snap is 332 2026-02-13T20:25:55.743 INFO:tasks.rados.rados.0.trial188.stdout:3225: rollback oid 47 current snap is 332 2026-02-13T20:25:55.743 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 47 to 330 2026-02-13T20:25:55.743 INFO:tasks.rados.rados.0.trial188.stdout:3226: read oid 18 snap -1 2026-02-13T20:25:55.743 INFO:tasks.rados.rados.0.trial188.stdout:3226: expect deleted 2026-02-13T20:25:55.743 INFO:tasks.rados.rados.0.trial188.stdout:3227: rollback oid 14 current snap is 332 2026-02-13T20:25:55.743 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 14 to 330 2026-02-13T20:25:55.744 INFO:tasks.rados.rados.0.trial188.stdout:3228: read oid 20 snap 330 2026-02-13T20:25:55.744 INFO:tasks.rados.rados.0.trial188.stdout:3228: expect deleted 2026-02-13T20:25:55.744 INFO:tasks.rados.rados.0.trial188.stdout:3229: copy_from oid 50 from oid 31 current snap is 332 2026-02-13T20:25:55.744 INFO:tasks.rados.rados.0.trial188.stdout:3230: read oid 13 snap -1 2026-02-13T20:25:55.744 INFO:tasks.rados.rados.0.trial188.stdout:3230: expect deleted 2026-02-13T20:25:55.744 INFO:tasks.rados.rados.0.trial188.stdout:3231: snap_remove snap 331 2026-02-13T20:25:56.743 INFO:tasks.rados.rados.0.trial188.stdout:3231: done (7 left) 2026-02-13T20:25:56.743 INFO:tasks.rados.rados.0.trial188.stdout:3232: rollback oid 32 current snap is 332 2026-02-13T20:25:56.743 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 32 to 328 2026-02-13T20:25:56.743 INFO:tasks.rados.rados.0.trial188.stdout:3227: finishing rollback tid 1 to trial18843701-14 2026-02-13T20:25:56.743 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 14 v 0 (ObjNum 33 snap 0 seq_num 15158736) dirty dne 2026-02-13T20:25:56.743 INFO:tasks.rados.rados.0.trial188.stdout:3225: finishing rollback tid 0 to trial18843701-47 2026-02-13T20:25:56.743 INFO:tasks.rados.rados.0.trial188.stdout:3225: finishing rollback tid 1 to trial18843701-47 2026-02-13T20:25:56.744 INFO:tasks.rados.rados.0.trial188.stdout:3225: finishing rollback tid 2 to trial18843701-47 2026-02-13T20:25:56.744 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 47 v 1086 (ObjNum 1057 snap 316 seq_num 1057) dirty exists 2026-02-13T20:25:56.744 INFO:tasks.rados.rados.0.trial188.stdout:3229: finishing copy_from to trial18843701-50 2026-02-13T20:25:56.744 INFO:tasks.rados.rados.0.trial188.stdout:3229: got expected ENOENT (src dne) 2026-02-13T20:25:56.744 INFO:tasks.rados.rados.0.trial188.stdout:3229: finishing copy_from racing read to trial18843701-50 2026-02-13T20:25:56.744 INFO:tasks.rados.rados.0.trial188.stdout:3224: finishing copy_from racing read to trial18843701-34 2026-02-13T20:25:56.744 INFO:tasks.rados.rados.0.trial188.stdout:3224: finishing copy_from to trial18843701-34 2026-02-13T20:25:56.744 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 34 v 1431 (ObjNum 1114 snap 331 seq_num 1114) dirty exists 2026-02-13T20:25:56.744 INFO:tasks.rados.rados.0.trial188.stdout:3224: done (7 left) 2026-02-13T20:25:56.744 INFO:tasks.rados.rados.0.trial188.stdout:3225: done (6 left) 2026-02-13T20:25:56.744 INFO:tasks.rados.rados.0.trial188.stdout:3226: done (5 left) 2026-02-13T20:25:56.744 INFO:tasks.rados.rados.0.trial188.stdout:3227: done (4 left) 2026-02-13T20:25:56.744 INFO:tasks.rados.rados.0.trial188.stdout:3228: done (3 left) 2026-02-13T20:25:56.744 INFO:tasks.rados.rados.0.trial188.stdout:3229: done (2 left) 2026-02-13T20:25:56.744 INFO:tasks.rados.rados.0.trial188.stdout:3230: done (1 left) 2026-02-13T20:25:56.744 INFO:tasks.rados.rados.0.trial188.stdout:3233: snap_create 2026-02-13T20:25:56.746 INFO:tasks.rados.rados.0.trial188.stdout:3232: finishing rollback tid 0 to trial18843701-32 2026-02-13T20:25:56.746 INFO:tasks.rados.rados.0.trial188.stdout:3232: finishing rollback tid 1 to trial18843701-32 2026-02-13T20:25:56.746 INFO:tasks.rados.rados.0.trial188.stdout:3232: finishing rollback tid 2 to trial18843701-32 2026-02-13T20:25:56.746 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 32 v 1466 (ObjNum 1054 snap 314 seq_num 1054) dirty exists 2026-02-13T20:25:57.743 INFO:tasks.rados.rados.0.trial188.stdout:3232: done (1 left) 2026-02-13T20:25:57.743 INFO:tasks.rados.rados.0.trial188.stdout:3233: done (0 left) 2026-02-13T20:25:57.743 INFO:tasks.rados.rados.0.trial188.stdout:3234: write oid 33 current snap is 333 2026-02-13T20:25:57.744 INFO:tasks.rados.rados.0.trial188.stdout:3234: seq_num 1116 ranges {756612=565422,2089081=578711} 2026-02-13T20:25:57.748 INFO:tasks.rados.rados.0.trial188.stdout:3234: writing trial18843701-33 from 756612 to 1322034 tid 1 2026-02-13T20:25:57.753 INFO:tasks.rados.rados.0.trial188.stdout:3234: writing trial18843701-33 from 2089081 to 2667792 tid 2 2026-02-13T20:25:57.754 INFO:tasks.rados.rados.0.trial188.stdout:3235: read oid 8 snap -1 2026-02-13T20:25:57.754 INFO:tasks.rados.rados.0.trial188.stdout:3235: expect deleted 2026-02-13T20:25:57.754 INFO:tasks.rados.rados.0.trial188.stdout:3236: snap_remove snap 330 2026-02-13T20:25:58.748 INFO:tasks.rados.rados.0.trial188.stdout:3236: done (2 left) 2026-02-13T20:25:58.748 INFO:tasks.rados.rados.0.trial188.stdout:3237: delete oid 42 current snap is 333 2026-02-13T20:25:58.748 INFO:tasks.rados.rados.0.trial188.stdout:3234: finishing write tid 1 to trial18843701-33 2026-02-13T20:25:58.748 INFO:tasks.rados.rados.0.trial188.stdout:3234: finishing write tid 2 to trial18843701-33 2026-02-13T20:25:58.748 INFO:tasks.rados.rados.0.trial188.stdout:3234: finishing write tid 3 to trial18843701-33 2026-02-13T20:25:58.748 INFO:tasks.rados.rados.0.trial188.stdout:3234: finishing write tid 4 to trial18843701-33 2026-02-13T20:25:58.748 INFO:tasks.rados.rados.0.trial188.stdout:3234: oid 33 updating version 0 to 1088 2026-02-13T20:25:58.748 INFO:tasks.rados.rados.0.trial188.stdout:3234: oid 33 updating version 1088 to 1089 2026-02-13T20:25:58.748 INFO:tasks.rados.rados.0.trial188.stdout:3234: oid 33 version 1089 is already newer than 1087 2026-02-13T20:25:58.748 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 33 v 1089 (ObjNum 1116 snap 333 seq_num 1116) dirty exists 2026-02-13T20:25:58.748 INFO:tasks.rados.rados.0.trial188.stdout:3234: left oid 33 (ObjNum 1116 snap 333 seq_num 1116) 2026-02-13T20:25:58.750 INFO:tasks.rados.rados.0.trial188.stdout:3234: done (2 left) 2026-02-13T20:25:58.750 INFO:tasks.rados.rados.0.trial188.stdout:3235: done (1 left) 2026-02-13T20:25:58.750 INFO:tasks.rados.rados.0.trial188.stdout:3237: done (0 left) 2026-02-13T20:25:58.750 INFO:tasks.rados.rados.0.trial188.stdout:3238: write (excl) oid 29 current snap is 333 2026-02-13T20:25:58.750 INFO:tasks.rados.rados.0.trial188.stdout:3238: seq_num 1118 ranges {790226=432273,1806045=582380} 2026-02-13T20:25:58.755 INFO:tasks.rados.rados.0.trial188.stdout:3238: writing trial18843701-29 from 790226 to 1222499 tid 1 2026-02-13T20:25:58.759 INFO:tasks.rados.rados.0.trial188.stdout:3238: writing trial18843701-29 from 1806045 to 2388425 tid 2 2026-02-13T20:25:58.759 INFO:tasks.rados.rados.0.trial188.stdout:3239: write (excl) oid 13 current snap is 333 2026-02-13T20:25:58.759 INFO:tasks.rados.rados.0.trial188.stdout:3239: seq_num 1119 ranges {407033=507522,1464527=442391,2345976=461057} 2026-02-13T20:25:58.762 INFO:tasks.rados.rados.0.trial188.stdout:3239: writing trial18843701-13 from 407033 to 914555 tid 1 2026-02-13T20:25:58.766 INFO:tasks.rados.rados.0.trial188.stdout:3239: writing trial18843701-13 from 1464527 to 1906918 tid 2 2026-02-13T20:25:58.770 INFO:tasks.rados.rados.0.trial188.stdout:3239: writing trial18843701-13 from 2345976 to 2807033 tid 3 2026-02-13T20:25:58.770 INFO:tasks.rados.rados.0.trial188.stdout:3240: snap_create 2026-02-13T20:25:58.771 INFO:tasks.rados.rados.0.trial188.stdout:3238: finishing write tid 1 to trial18843701-29 2026-02-13T20:25:58.776 INFO:tasks.rados.rados.0.trial188.stdout:3238: finishing write tid 2 to trial18843701-29 2026-02-13T20:25:58.776 INFO:tasks.rados.rados.0.trial188.stdout:3238: finishing write tid 3 to trial18843701-29 2026-02-13T20:25:58.776 INFO:tasks.rados.rados.0.trial188.stdout:3238: finishing write tid 4 to trial18843701-29 2026-02-13T20:25:58.776 INFO:tasks.rados.rados.0.trial188.stdout:3238: oid 29 updating version 0 to 1473 2026-02-13T20:25:58.776 INFO:tasks.rados.rados.0.trial188.stdout:3238: oid 29 updating version 1473 to 1474 2026-02-13T20:25:58.776 INFO:tasks.rados.rados.0.trial188.stdout:3238: oid 29 version 1474 is already newer than 1472 2026-02-13T20:25:58.776 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 29 v 1474 (ObjNum 1118 snap 333 seq_num 1118) dirty exists 2026-02-13T20:25:58.776 INFO:tasks.rados.rados.0.trial188.stdout:3238: left oid 29 (ObjNum 1118 snap 333 seq_num 1118) 2026-02-13T20:25:58.782 INFO:tasks.rados.rados.0.trial188.stdout:3239: finishing write tid 1 to trial18843701-13 2026-02-13T20:25:58.782 INFO:tasks.rados.rados.0.trial188.stdout:3239: finishing write tid 2 to trial18843701-13 2026-02-13T20:25:58.782 INFO:tasks.rados.rados.0.trial188.stdout:3239: finishing write tid 3 to trial18843701-13 2026-02-13T20:25:58.782 INFO:tasks.rados.rados.0.trial188.stdout:3239: finishing write tid 4 to trial18843701-13 2026-02-13T20:25:58.782 INFO:tasks.rados.rados.0.trial188.stdout:3239: finishing write tid 5 to trial18843701-13 2026-02-13T20:25:58.782 INFO:tasks.rados.rados.0.trial188.stdout:3239: oid 13 updating version 0 to 1510 2026-02-13T20:25:58.782 INFO:tasks.rados.rados.0.trial188.stdout:3239: oid 13 updating version 1510 to 1512 2026-02-13T20:25:58.783 INFO:tasks.rados.rados.0.trial188.stdout:3239: oid 13 version 1512 is already newer than 1509 2026-02-13T20:25:58.783 INFO:tasks.rados.rados.0.trial188.stdout:3239: oid 13 version 1512 is already newer than 1511 2026-02-13T20:25:58.783 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 13 v 1512 (ObjNum 1119 snap 333 seq_num 1119) dirty exists 2026-02-13T20:25:58.783 INFO:tasks.rados.rados.0.trial188.stdout:3239: left oid 13 (ObjNum 1119 snap 333 seq_num 1119) 2026-02-13T20:25:59.750 INFO:tasks.rados.rados.0.trial188.stdout:3238: done (2 left) 2026-02-13T20:25:59.750 INFO:tasks.rados.rados.0.trial188.stdout:3239: done (1 left) 2026-02-13T20:25:59.750 INFO:tasks.rados.rados.0.trial188.stdout:3240: done (0 left) 2026-02-13T20:25:59.750 INFO:tasks.rados.rados.0.trial188.stdout:3241: delete oid 38 current snap is 334 2026-02-13T20:25:59.754 INFO:tasks.rados.rados.0.trial188.stdout:3241: done (0 left) 2026-02-13T20:25:59.754 INFO:tasks.rados.rados.0.trial188.stdout:3242: write oid 16 current snap is 334 2026-02-13T20:25:59.754 INFO:tasks.rados.rados.0.trial188.stdout:3242: seq_num 1121 ranges {440647=658020,1581491=446060,2800822=39825} 2026-02-13T20:25:59.758 INFO:tasks.rados.rados.0.trial188.stdout:3242: writing trial18843701-16 from 440647 to 1098667 tid 1 2026-02-13T20:25:59.761 INFO:tasks.rados.rados.0.trial188.stdout:3242: writing trial18843701-16 from 1581491 to 2027551 tid 2 2026-02-13T20:25:59.765 INFO:tasks.rados.rados.0.trial188.stdout:3242: writing trial18843701-16 from 2800822 to 2840647 tid 3 2026-02-13T20:25:59.765 INFO:tasks.rados.rados.0.trial188.stdout:3243: read oid 1 snap 332 2026-02-13T20:25:59.765 INFO:tasks.rados.rados.0.trial188.stdout:3243: expect (ObjNum 1106 snap 326 seq_num 1106) 2026-02-13T20:25:59.765 INFO:tasks.rados.rados.0.trial188.stdout:3244: snap_create 2026-02-13T20:25:59.770 INFO:tasks.rados.rados.0.trial188.stdout:3243: expect (ObjNum 1106 snap 326 seq_num 1106) 2026-02-13T20:25:59.810 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2439743 2026-02-13T20:25:59.840 INFO:tasks.rados.rados.0.trial188.stdout:3242: finishing write tid 1 to trial18843701-16 2026-02-13T20:25:59.840 INFO:tasks.rados.rados.0.trial188.stdout:3242: finishing write tid 2 to trial18843701-16 2026-02-13T20:25:59.841 INFO:tasks.rados.rados.0.trial188.stdout:3242: finishing write tid 3 to trial18843701-16 2026-02-13T20:25:59.841 INFO:tasks.rados.rados.0.trial188.stdout:3242: finishing write tid 4 to trial18843701-16 2026-02-13T20:25:59.841 INFO:tasks.rados.rados.0.trial188.stdout:3242: finishing write tid 5 to trial18843701-16 2026-02-13T20:25:59.841 INFO:tasks.rados.rados.0.trial188.stdout:3242: oid 16 updating version 0 to 1610 2026-02-13T20:25:59.841 INFO:tasks.rados.rados.0.trial188.stdout:3242: oid 16 version 1610 is already newer than 1607 2026-02-13T20:25:59.841 INFO:tasks.rados.rados.0.trial188.stdout:3242: oid 16 version 1610 is already newer than 1609 2026-02-13T20:25:59.841 INFO:tasks.rados.rados.0.trial188.stdout:3242: oid 16 version 1610 is already newer than 1608 2026-02-13T20:25:59.841 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 16 v 1610 (ObjNum 1121 snap 334 seq_num 1121) dirty exists 2026-02-13T20:25:59.841 INFO:tasks.rados.rados.0.trial188.stdout:3242: left oid 16 (ObjNum 1121 snap 334 seq_num 1121) 2026-02-13T20:26:00.753 INFO:tasks.rados.rados.0.trial188.stdout:3242: done (2 left) 2026-02-13T20:26:00.754 INFO:tasks.rados.rados.0.trial188.stdout:3243: done (1 left) 2026-02-13T20:26:00.754 INFO:tasks.rados.rados.0.trial188.stdout:3244: done (0 left) 2026-02-13T20:26:00.754 INFO:tasks.rados.rados.0.trial188.stdout:3245: read oid 28 snap -1 2026-02-13T20:26:00.754 INFO:tasks.rados.rados.0.trial188.stdout:3245: expect (ObjNum 1048 snap 314 seq_num 1048) 2026-02-13T20:26:00.754 INFO:tasks.rados.rados.0.trial188.stdout:3246: read oid 4 snap -1 2026-02-13T20:26:00.754 INFO:tasks.rados.rados.0.trial188.stdout:3246: expect (ObjNum 1103 snap 326 seq_num 1103) 2026-02-13T20:26:00.754 INFO:tasks.rados.rados.0.trial188.stdout:3247: read oid 36 snap -1 2026-02-13T20:26:00.754 INFO:tasks.rados.rados.0.trial188.stdout:3247: expect (ObjNum 1049 snap 314 seq_num 1049) 2026-02-13T20:26:00.754 INFO:tasks.rados.rados.0.trial188.stdout:3248: snap_create 2026-02-13T20:26:00.761 INFO:tasks.rados.rados.0.trial188.stdout:3246: expect (ObjNum 1103 snap 326 seq_num 1103) 2026-02-13T20:26:00.764 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 909305 2026-02-13T20:26:00.818 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1525092 2026-02-13T20:26:00.834 INFO:tasks.rados.rados.0.trial188.stdout:3247: expect (ObjNum 1049 snap 314 seq_num 1049) 2026-02-13T20:26:00.859 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:26:00.885 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:26:00.910 INFO:tasks.rados.rados.0.trial188.stdout:3245: expect (ObjNum 1048 snap 314 seq_num 1048) 2026-02-13T20:26:00.911 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:26:01.757 INFO:tasks.rados.rados.0.trial188.stdout:3245: done (3 left) 2026-02-13T20:26:01.758 INFO:tasks.rados.rados.0.trial188.stdout:3246: done (2 left) 2026-02-13T20:26:01.758 INFO:tasks.rados.rados.0.trial188.stdout:3247: done (1 left) 2026-02-13T20:26:01.758 INFO:tasks.rados.rados.0.trial188.stdout:3248: done (0 left) 2026-02-13T20:26:01.758 INFO:tasks.rados.rados.0.trial188.stdout:3249: read oid 49 snap -1 2026-02-13T20:26:01.758 INFO:tasks.rados.rados.0.trial188.stdout:3249: expect (ObjNum 1112 snap 329 seq_num 1112) 2026-02-13T20:26:01.758 INFO:tasks.rados.rados.0.trial188.stdout:3250: snap_remove snap 329 2026-02-13T20:26:02.756 INFO:tasks.rados.rados.0.trial188.stdout:3250: done (1 left) 2026-02-13T20:26:02.756 INFO:tasks.rados.rados.0.trial188.stdout:3251: write (excl) oid 42 current snap is 336 2026-02-13T20:26:02.756 INFO:tasks.rados.rados.0.trial188.stdout:3251: seq_num 1122 ranges {457454=733269,1923620=589718} 2026-02-13T20:26:02.761 INFO:tasks.rados.rados.0.trial188.stdout:3251: writing trial18843701-42 from 457454 to 1190723 tid 1 2026-02-13T20:26:02.766 INFO:tasks.rados.rados.0.trial188.stdout:3251: writing trial18843701-42 from 1923620 to 2513338 tid 2 2026-02-13T20:26:02.766 INFO:tasks.rados.rados.0.trial188.stdout:3252: copy_from oid 47 from oid 22 current snap is 336 2026-02-13T20:26:02.766 INFO:tasks.rados.rados.0.trial188.stdout:3249: expect (ObjNum 1112 snap 329 seq_num 1112) 2026-02-13T20:26:02.771 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 807791 2026-02-13T20:26:02.790 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 932949 2026-02-13T20:26:02.823 INFO:tasks.rados.rados.0.trial188.stdout:3251: finishing write tid 1 to trial18843701-42 2026-02-13T20:26:02.823 INFO:tasks.rados.rados.0.trial188.stdout:3251: finishing write tid 2 to trial18843701-42 2026-02-13T20:26:02.823 INFO:tasks.rados.rados.0.trial188.stdout:3251: finishing write tid 3 to trial18843701-42 2026-02-13T20:26:02.823 INFO:tasks.rados.rados.0.trial188.stdout:3249: done (2 left) 2026-02-13T20:26:02.823 INFO:tasks.rados.rados.0.trial188.stdout:3253: snap_create 2026-02-13T20:26:02.823 INFO:tasks.rados.rados.0.trial188.stdout:3251: finishing write tid 4 to trial18843701-42 2026-02-13T20:26:02.823 INFO:tasks.rados.rados.0.trial188.stdout:3251: oid 42 updating version 0 to 1433 2026-02-13T20:26:02.823 INFO:tasks.rados.rados.0.trial188.stdout:3251: oid 42 updating version 1433 to 1435 2026-02-13T20:26:02.823 INFO:tasks.rados.rados.0.trial188.stdout:3251: oid 42 version 1435 is already newer than 1434 2026-02-13T20:26:02.823 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 42 v 1435 (ObjNum 1122 snap 336 seq_num 1122) dirty exists 2026-02-13T20:26:02.823 INFO:tasks.rados.rados.0.trial188.stdout:3251: left oid 42 (ObjNum 1122 snap 336 seq_num 1122) 2026-02-13T20:26:02.823 INFO:tasks.rados.rados.0.trial188.stdout:3252: finishing copy_from racing read to trial18843701-47 2026-02-13T20:26:02.823 INFO:tasks.rados.rados.0.trial188.stdout:3252: finishing copy_from to trial18843701-47 2026-02-13T20:26:02.823 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 47 v 999 (ObjNum 1007 snap 299 seq_num 1007) dirty exists 2026-02-13T20:26:03.739 INFO:tasks.rados.rados.0.trial188.stdout:3251: done (2 left) 2026-02-13T20:26:03.739 INFO:tasks.rados.rados.0.trial188.stdout:3252: done (1 left) 2026-02-13T20:26:03.739 INFO:tasks.rados.rados.0.trial188.stdout:3253: done (0 left) 2026-02-13T20:26:03.739 INFO:tasks.rados.rados.0.trial188.stdout:3254: delete oid 6 current snap is 337 2026-02-13T20:26:03.741 INFO:tasks.rados.rados.0.trial188.stdout:3254: done (0 left) 2026-02-13T20:26:03.741 INFO:tasks.rados.rados.0.trial188.stdout:3255: rollback oid 8 current snap is 337 2026-02-13T20:26:03.741 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 8 to 334 2026-02-13T20:26:03.741 INFO:tasks.rados.rados.0.trial188.stdout:3256: snap_create 2026-02-13T20:26:03.744 INFO:tasks.rados.rados.0.trial188.stdout:3255: finishing rollback tid 1 to trial18843701-8 2026-02-13T20:26:03.744 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 8 v 0 (ObjNum 808923956 snap 842280241 seq_num 304) dirty dne 2026-02-13T20:26:04.741 INFO:tasks.rados.rados.0.trial188.stdout:3255: done (1 left) 2026-02-13T20:26:04.741 INFO:tasks.rados.rados.0.trial188.stdout:3256: done (0 left) 2026-02-13T20:26:04.741 INFO:tasks.rados.rados.0.trial188.stdout:3257: rollback oid 1 current snap is 338 2026-02-13T20:26:04.741 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 1 to 337 2026-02-13T20:26:04.741 INFO:tasks.rados.rados.0.trial188.stdout:3258: read oid 23 snap 334 2026-02-13T20:26:04.741 INFO:tasks.rados.rados.0.trial188.stdout:3258: expect (ObjNum 1109 snap 328 seq_num 1109) 2026-02-13T20:26:04.741 INFO:tasks.rados.rados.0.trial188.stdout:3259: snap_remove snap 335 2026-02-13T20:26:05.742 INFO:tasks.rados.rados.0.trial188.stdout:3259: done (2 left) 2026-02-13T20:26:05.742 INFO:tasks.rados.rados.0.trial188.stdout:3260: rollback oid 33 current snap is 338 2026-02-13T20:26:05.742 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 33 to 328 2026-02-13T20:26:05.742 INFO:tasks.rados.rados.0.trial188.stdout:3257: finishing rollback tid 0 to trial18843701-1 2026-02-13T20:26:05.743 INFO:tasks.rados.rados.0.trial188.stdout:3257: finishing rollback tid 1 to trial18843701-1 2026-02-13T20:26:05.743 INFO:tasks.rados.rados.0.trial188.stdout:3257: finishing rollback tid 2 to trial18843701-1 2026-02-13T20:26:05.743 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 1 v 1515 (ObjNum 1106 snap 326 seq_num 1106) dirty exists 2026-02-13T20:26:05.743 INFO:tasks.rados.rados.0.trial188.stdout:3258: expect (ObjNum 1109 snap 328 seq_num 1109) 2026-02-13T20:26:05.746 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 680141 2026-02-13T20:26:05.765 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:26:05.791 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:26:05.817 INFO:tasks.rados.rados.0.trial188.stdout:3260: finishing rollback tid 0 to trial18843701-33 2026-02-13T20:26:05.817 INFO:tasks.rados.rados.0.trial188.stdout:3260: finishing rollback tid 1 to trial18843701-33 2026-02-13T20:26:05.817 INFO:tasks.rados.rados.0.trial188.stdout:3260: finishing rollback tid 2 to trial18843701-33 2026-02-13T20:26:05.817 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 33 v 1092 (ObjNum 1102 snap 326 seq_num 1102) dirty exists 2026-02-13T20:26:05.817 INFO:tasks.rados.rados.0.trial188.stdout:3257: done (2 left) 2026-02-13T20:26:05.818 INFO:tasks.rados.rados.0.trial188.stdout:3258: done (1 left) 2026-02-13T20:26:05.818 INFO:tasks.rados.rados.0.trial188.stdout:3260: done (0 left) 2026-02-13T20:26:05.818 INFO:tasks.rados.rados.0.trial188.stdout:3261: snap_remove snap 336 2026-02-13T20:26:06.747 INFO:tasks.rados.rados.0.trial188.stdout:3261: done (0 left) 2026-02-13T20:26:06.747 INFO:tasks.rados.rados.0.trial188.stdout:3262: snap_create 2026-02-13T20:26:07.748 INFO:tasks.rados.rados.0.trial188.stdout:3262: done (0 left) 2026-02-13T20:26:07.748 INFO:tasks.rados.rados.0.trial188.stdout:3263: write oid 45 current snap is 339 2026-02-13T20:26:07.749 INFO:tasks.rados.rados.0.trial188.stdout:3263: seq_num 1124 ranges {491068=483767,1640584=593387,2650385=240683} 2026-02-13T20:26:07.752 INFO:tasks.rados.rados.0.trial188.stdout:3263: writing trial18843701-45 from 491068 to 974835 tid 1 2026-02-13T20:26:07.757 INFO:tasks.rados.rados.0.trial188.stdout:3263: writing trial18843701-45 from 1640584 to 2233971 tid 2 2026-02-13T20:26:07.760 INFO:tasks.rados.rados.0.trial188.stdout:3263: writing trial18843701-45 from 2650385 to 2891068 tid 3 2026-02-13T20:26:07.760 INFO:tasks.rados.rados.0.trial188.stdout:3264: delete oid 27 current snap is 339 2026-02-13T20:26:07.774 INFO:tasks.rados.rados.0.trial188.stdout:3263: finishing write tid 1 to trial18843701-45 2026-02-13T20:26:07.774 INFO:tasks.rados.rados.0.trial188.stdout:3263: finishing write tid 2 to trial18843701-45 2026-02-13T20:26:07.774 INFO:tasks.rados.rados.0.trial188.stdout:3264: done (1 left) 2026-02-13T20:26:07.774 INFO:tasks.rados.rados.0.trial188.stdout:3265: delete oid 50 current snap is 339 2026-02-13T20:26:07.774 INFO:tasks.rados.rados.0.trial188.stdout:3263: finishing write tid 3 to trial18843701-45 2026-02-13T20:26:07.774 INFO:tasks.rados.rados.0.trial188.stdout:3263: finishing write tid 4 to trial18843701-45 2026-02-13T20:26:07.774 INFO:tasks.rados.rados.0.trial188.stdout:3263: finishing write tid 5 to trial18843701-45 2026-02-13T20:26:07.774 INFO:tasks.rados.rados.0.trial188.stdout:3263: oid 45 updating version 0 to 1585 2026-02-13T20:26:07.775 INFO:tasks.rados.rados.0.trial188.stdout:3263: oid 45 version 1585 is already newer than 1584 2026-02-13T20:26:07.775 INFO:tasks.rados.rados.0.trial188.stdout:3263: oid 45 version 1585 is already newer than 1583 2026-02-13T20:26:07.775 INFO:tasks.rados.rados.0.trial188.stdout:3263: oid 45 version 1585 is already newer than 1582 2026-02-13T20:26:07.775 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 45 v 1585 (ObjNum 1124 snap 339 seq_num 1124) dirty exists 2026-02-13T20:26:07.775 INFO:tasks.rados.rados.0.trial188.stdout:3263: left oid 45 (ObjNum 1124 snap 339 seq_num 1124) 2026-02-13T20:26:07.776 INFO:tasks.rados.rados.0.trial188.stdout:3263: done (1 left) 2026-02-13T20:26:07.776 INFO:tasks.rados.rados.0.trial188.stdout:3265: done (0 left) 2026-02-13T20:26:07.776 INFO:tasks.rados.rados.0.trial188.stdout:3266: write oid 17 current snap is 339 2026-02-13T20:26:07.776 INFO:tasks.rados.rados.0.trial188.stdout:3266: seq_num 1127 ranges {541489=425867,1416030=740714,2732654=208835} 2026-02-13T20:26:07.778 INFO:tasks.rados.rados.0.trial188.stdout:3266: writing trial18843701-17 from 541489 to 967356 tid 1 2026-02-13T20:26:07.783 INFO:tasks.rados.rados.0.trial188.stdout:3266: writing trial18843701-17 from 1416030 to 2156744 tid 2 2026-02-13T20:26:07.786 INFO:tasks.rados.rados.0.trial188.stdout:3266: writing trial18843701-17 from 2732654 to 2941489 tid 3 2026-02-13T20:26:07.787 INFO:tasks.rados.rados.0.trial188.stdout:3267: rollback oid 7 current snap is 339 2026-02-13T20:26:07.787 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 7 to 338 2026-02-13T20:26:07.787 INFO:tasks.rados.rados.0.trial188.stdout:3268: read oid 39 snap -1 2026-02-13T20:26:07.787 INFO:tasks.rados.rados.0.trial188.stdout:3268: expect (ObjNum 1108 snap 327 seq_num 1108) 2026-02-13T20:26:07.787 INFO:tasks.rados.rados.0.trial188.stdout:3269: read oid 5 snap 332 2026-02-13T20:26:07.787 INFO:tasks.rados.rados.0.trial188.stdout:3269: expect (ObjNum 1003 snap 299 seq_num 1003) 2026-02-13T20:26:07.787 INFO:tasks.rados.rados.0.trial188.stdout:3270: rollback oid 47 current snap is 339 2026-02-13T20:26:07.787 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 47 to 337 2026-02-13T20:26:07.787 INFO:tasks.rados.rados.0.trial188.stdout:3271: read oid 15 snap 334 2026-02-13T20:26:07.787 INFO:tasks.rados.rados.0.trial188.stdout:3271: expect (ObjNum 865 snap 250 seq_num 865) 2026-02-13T20:26:07.787 INFO:tasks.rados.rados.0.trial188.stdout:3272: snap_create 2026-02-13T20:26:07.788 INFO:tasks.rados.rados.0.trial188.stdout:3270: finishing rollback tid 0 to trial18843701-47 2026-02-13T20:26:07.790 INFO:tasks.rados.rados.0.trial188.stdout:3270: finishing rollback tid 1 to trial18843701-47 2026-02-13T20:26:07.790 INFO:tasks.rados.rados.0.trial188.stdout:3270: finishing rollback tid 2 to trial18843701-47 2026-02-13T20:26:07.790 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 47 v 1095 (ObjNum 1007 snap 299 seq_num 1007) dirty exists 2026-02-13T20:26:07.791 INFO:tasks.rados.rados.0.trial188.stdout:3269: expect (ObjNum 1003 snap 299 seq_num 1003) 2026-02-13T20:26:07.834 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1309313 2026-02-13T20:26:07.897 INFO:tasks.rados.rados.0.trial188.stdout:3271: expect (ObjNum 865 snap 250 seq_num 865) 2026-02-13T20:26:07.946 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:26:07.998 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:26:08.047 INFO:tasks.rados.rados.0.trial188.stdout:3266: finishing write tid 1 to trial18843701-17 2026-02-13T20:26:08.048 INFO:tasks.rados.rados.0.trial188.stdout:3266: finishing write tid 2 to trial18843701-17 2026-02-13T20:26:08.048 INFO:tasks.rados.rados.0.trial188.stdout:3266: finishing write tid 3 to trial18843701-17 2026-02-13T20:26:08.048 INFO:tasks.rados.rados.0.trial188.stdout:3266: finishing write tid 4 to trial18843701-17 2026-02-13T20:26:08.048 INFO:tasks.rados.rados.0.trial188.stdout:3266: finishing write tid 5 to trial18843701-17 2026-02-13T20:26:08.048 INFO:tasks.rados.rados.0.trial188.stdout:3266: oid 17 updating version 0 to 1373 2026-02-13T20:26:08.048 INFO:tasks.rados.rados.0.trial188.stdout:3266: oid 17 updating version 1373 to 1374 2026-02-13T20:26:08.048 INFO:tasks.rados.rados.0.trial188.stdout:3266: oid 17 updating version 1374 to 1375 2026-02-13T20:26:08.048 INFO:tasks.rados.rados.0.trial188.stdout:3266: oid 17 version 1375 is already newer than 1372 2026-02-13T20:26:08.048 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 17 v 1375 (ObjNum 1127 snap 339 seq_num 1127) dirty exists 2026-02-13T20:26:08.049 INFO:tasks.rados.rados.0.trial188.stdout:3266: left oid 17 (ObjNum 1127 snap 339 seq_num 1127) 2026-02-13T20:26:08.049 INFO:tasks.rados.rados.0.trial188.stdout:3267: finishing rollback tid 0 to trial18843701-7 2026-02-13T20:26:08.049 INFO:tasks.rados.rados.0.trial188.stdout:3267: finishing rollback tid 1 to trial18843701-7 2026-02-13T20:26:08.049 INFO:tasks.rados.rados.0.trial188.stdout:3267: finishing rollback tid 2 to trial18843701-7 2026-02-13T20:26:08.049 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 7 v 1477 (ObjNum 1055 snap 315 seq_num 1055) dirty exists 2026-02-13T20:26:08.049 INFO:tasks.rados.rados.0.trial188.stdout:3268: expect (ObjNum 1108 snap 327 seq_num 1108) 2026-02-13T20:26:08.091 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2568958 2026-02-13T20:26:08.172 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1501468 2026-02-13T20:26:08.752 INFO:tasks.rados.rados.0.trial188.stdout:3266: done (6 left) 2026-02-13T20:26:08.752 INFO:tasks.rados.rados.0.trial188.stdout:3267: done (5 left) 2026-02-13T20:26:08.752 INFO:tasks.rados.rados.0.trial188.stdout:3268: done (4 left) 2026-02-13T20:26:08.752 INFO:tasks.rados.rados.0.trial188.stdout:3269: done (3 left) 2026-02-13T20:26:08.752 INFO:tasks.rados.rados.0.trial188.stdout:3270: done (2 left) 2026-02-13T20:26:08.752 INFO:tasks.rados.rados.0.trial188.stdout:3271: done (1 left) 2026-02-13T20:26:08.752 INFO:tasks.rados.rados.0.trial188.stdout:3272: done (0 left) 2026-02-13T20:26:08.752 INFO:tasks.rados.rados.0.trial188.stdout:3273: write (excl) oid 9 current snap is 340 2026-02-13T20:26:08.752 INFO:tasks.rados.rados.0.trial188.stdout:3273: seq_num 1128 ranges {558296=501116,1474512=600725,2760077=198219} 2026-02-13T20:26:08.756 INFO:tasks.rados.rados.0.trial188.stdout:3273: writing trial18843701-9 from 558296 to 1059412 tid 1 2026-02-13T20:26:08.759 INFO:tasks.rados.rados.0.trial188.stdout:3273: writing trial18843701-9 from 1474512 to 2075237 tid 2 2026-02-13T20:26:08.763 INFO:tasks.rados.rados.0.trial188.stdout:3273: writing trial18843701-9 from 2760077 to 2958296 tid 3 2026-02-13T20:26:08.763 INFO:tasks.rados.rados.0.trial188.stdout:3274: delete oid 29 current snap is 340 2026-02-13T20:26:08.775 INFO:tasks.rados.rados.0.trial188.stdout:3273: finishing write tid 1 to trial18843701-9 2026-02-13T20:26:08.775 INFO:tasks.rados.rados.0.trial188.stdout:3273: finishing write tid 2 to trial18843701-9 2026-02-13T20:26:08.775 INFO:tasks.rados.rados.0.trial188.stdout:3273: finishing write tid 3 to trial18843701-9 2026-02-13T20:26:08.775 INFO:tasks.rados.rados.0.trial188.stdout:3274: done (1 left) 2026-02-13T20:26:08.775 INFO:tasks.rados.rados.0.trial188.stdout:3275: snap_remove snap 332 2026-02-13T20:26:09.753 INFO:tasks.rados.rados.0.trial188.stdout:3275: done (1 left) 2026-02-13T20:26:09.754 INFO:tasks.rados.rados.0.trial188.stdout:3276: copy_from oid 29 from oid 36 current snap is 340 2026-02-13T20:26:09.754 INFO:tasks.rados.rados.0.trial188.stdout:3273: finishing write tid 4 to trial18843701-9 2026-02-13T20:26:09.754 INFO:tasks.rados.rados.0.trial188.stdout:3273: finishing write tid 5 to trial18843701-9 2026-02-13T20:26:09.754 INFO:tasks.rados.rados.0.trial188.stdout:3273: oid 9 updating version 0 to 1439 2026-02-13T20:26:09.754 INFO:tasks.rados.rados.0.trial188.stdout:3273: oid 9 version 1439 is already newer than 1438 2026-02-13T20:26:09.754 INFO:tasks.rados.rados.0.trial188.stdout:3273: oid 9 version 1439 is already newer than 1437 2026-02-13T20:26:09.754 INFO:tasks.rados.rados.0.trial188.stdout:3273: oid 9 version 1439 is already newer than 1436 2026-02-13T20:26:09.754 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 9 v 1439 (ObjNum 1128 snap 340 seq_num 1128) dirty exists 2026-02-13T20:26:09.754 INFO:tasks.rados.rados.0.trial188.stdout:3273: left oid 9 (ObjNum 1128 snap 340 seq_num 1128) 2026-02-13T20:26:09.754 INFO:tasks.rados.rados.0.trial188.stdout:3273: done (1 left) 2026-02-13T20:26:09.754 INFO:tasks.rados.rados.0.trial188.stdout:3277: copy_from oid 14 from oid 2 current snap is 340 2026-02-13T20:26:09.754 INFO:tasks.rados.rados.0.trial188.stdout:3278: read oid 15 snap -1 2026-02-13T20:26:09.754 INFO:tasks.rados.rados.0.trial188.stdout:3278: expect (ObjNum 865 snap 250 seq_num 865) 2026-02-13T20:26:09.754 INFO:tasks.rados.rados.0.trial188.stdout:3279: read oid 47 snap -1 2026-02-13T20:26:09.754 INFO:tasks.rados.rados.0.trial188.stdout:3279: expect (ObjNum 1007 snap 299 seq_num 1007) 2026-02-13T20:26:09.754 INFO:tasks.rados.rados.0.trial188.stdout:3280: snap_create 2026-02-13T20:26:09.761 INFO:tasks.rados.rados.0.trial188.stdout:3278: expect (ObjNum 865 snap 250 seq_num 865) 2026-02-13T20:26:09.767 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 860816 2026-02-13T20:26:09.853 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:26:09.902 INFO:tasks.rados.rados.0.trial188.stdout:3279: expect (ObjNum 1007 snap 299 seq_num 1007) 2026-02-13T20:26:09.902 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:26:09.948 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1555881 2026-02-13T20:26:09.976 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1658475 2026-02-13T20:26:09.992 INFO:tasks.rados.rados.0.trial188.stdout:3276: finishing copy_from racing read to trial18843701-29 2026-02-13T20:26:09.992 INFO:tasks.rados.rados.0.trial188.stdout:3276: finishing copy_from to trial18843701-29 2026-02-13T20:26:09.992 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 29 v 1595 (ObjNum 1049 snap 314 seq_num 1049) dirty exists 2026-02-13T20:26:09.992 INFO:tasks.rados.rados.0.trial188.stdout:3277: finishing copy_from racing read to trial18843701-14 2026-02-13T20:26:09.992 INFO:tasks.rados.rados.0.trial188.stdout:3277: finishing copy_from to trial18843701-14 2026-02-13T20:26:09.992 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 14 v 1508 (ObjNum 1115 snap 331 seq_num 1115) dirty exists 2026-02-13T20:26:10.759 INFO:tasks.rados.rados.0.trial188.stdout:3276: done (4 left) 2026-02-13T20:26:10.759 INFO:tasks.rados.rados.0.trial188.stdout:3277: done (3 left) 2026-02-13T20:26:10.759 INFO:tasks.rados.rados.0.trial188.stdout:3278: done (2 left) 2026-02-13T20:26:10.760 INFO:tasks.rados.rados.0.trial188.stdout:3279: done (1 left) 2026-02-13T20:26:10.760 INFO:tasks.rados.rados.0.trial188.stdout:3280: done (0 left) 2026-02-13T20:26:10.760 INFO:tasks.rados.rados.0.trial188.stdout:3281: delete oid 38 current snap is 341 2026-02-13T20:26:10.762 INFO:tasks.rados.rados.0.trial188.stdout:3281: done (0 left) 2026-02-13T20:26:10.762 INFO:tasks.rados.rados.0.trial188.stdout:3282: read oid 46 snap 340 2026-02-13T20:26:10.762 INFO:tasks.rados.rados.0.trial188.stdout:3282: expect (ObjNum 1060 snap 316 seq_num 1060) 2026-02-13T20:26:10.762 INFO:tasks.rados.rados.0.trial188.stdout:3283: rollback oid 7 current snap is 341 2026-02-13T20:26:10.762 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 7 to 328 2026-02-13T20:26:10.762 INFO:tasks.rados.rados.0.trial188.stdout:3284: copy_from oid 36 from oid 27 current snap is 341 2026-02-13T20:26:10.762 INFO:tasks.rados.rados.0.trial188.stdout:3285: write oid 3 current snap is 341 2026-02-13T20:26:10.762 INFO:tasks.rados.rados.0.trial188.stdout:3285: seq_num 1131 ranges {608717=726863,1933605=748052} 2026-02-13T20:26:10.766 INFO:tasks.rados.rados.0.trial188.stdout:3285: writing trial18843701-3 from 608717 to 1335580 tid 1 2026-02-13T20:26:10.773 INFO:tasks.rados.rados.0.trial188.stdout:3285: writing trial18843701-3 from 1933605 to 2681657 tid 2 2026-02-13T20:26:10.773 INFO:tasks.rados.rados.0.trial188.stdout:3286: write oid 50 current snap is 341 2026-02-13T20:26:10.773 INFO:tasks.rados.rados.0.trial188.stdout:3286: seq_num 1132 ranges {625524=402112,1592087=608063,2869769=155755} 2026-02-13T20:26:10.777 INFO:tasks.rados.rados.0.trial188.stdout:3286: writing trial18843701-50 from 625524 to 1027636 tid 1 2026-02-13T20:26:10.782 INFO:tasks.rados.rados.0.trial188.stdout:3286: writing trial18843701-50 from 1592087 to 2200150 tid 2 2026-02-13T20:26:10.786 INFO:tasks.rados.rados.0.trial188.stdout:3286: writing trial18843701-50 from 2869769 to 3025524 tid 3 2026-02-13T20:26:10.786 INFO:tasks.rados.rados.0.trial188.stdout:3287: delete oid 41 current snap is 341 2026-02-13T20:26:10.786 INFO:tasks.rados.rados.0.trial188.stdout:3284: finishing copy_from to trial18843701-36 2026-02-13T20:26:10.786 INFO:tasks.rados.rados.0.trial188.stdout:3284: got expected ENOENT (src dne) 2026-02-13T20:26:10.786 INFO:tasks.rados.rados.0.trial188.stdout:3284: finishing copy_from racing read to trial18843701-36 2026-02-13T20:26:10.786 INFO:tasks.rados.rados.0.trial188.stdout:3283: finishing rollback tid 0 to trial18843701-7 2026-02-13T20:26:10.786 INFO:tasks.rados.rados.0.trial188.stdout:3283: finishing rollback tid 1 to trial18843701-7 2026-02-13T20:26:10.787 INFO:tasks.rados.rados.0.trial188.stdout:3283: finishing rollback tid 2 to trial18843701-7 2026-02-13T20:26:10.787 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 7 v 1598 (ObjNum 1055 snap 315 seq_num 1055) dirty exists 2026-02-13T20:26:10.787 INFO:tasks.rados.rados.0.trial188.stdout:3282: expect (ObjNum 1060 snap 316 seq_num 1060) 2026-02-13T20:26:10.923 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:26:10.996 INFO:tasks.rados.rados.0.trial188.stdout:3285: finishing write tid 1 to trial18843701-3 2026-02-13T20:26:10.996 INFO:tasks.rados.rados.0.trial188.stdout:3282: done (5 left) 2026-02-13T20:26:10.996 INFO:tasks.rados.rados.0.trial188.stdout:3283: done (4 left) 2026-02-13T20:26:10.996 INFO:tasks.rados.rados.0.trial188.stdout:3284: done (3 left) 2026-02-13T20:26:10.996 INFO:tasks.rados.rados.0.trial188.stdout:3287: done (2 left) 2026-02-13T20:26:10.996 INFO:tasks.rados.rados.0.trial188.stdout:3288: read oid 17 snap -1 2026-02-13T20:26:10.996 INFO:tasks.rados.rados.0.trial188.stdout:3288: expect (ObjNum 1127 snap 339 seq_num 1127) 2026-02-13T20:26:10.996 INFO:tasks.rados.rados.0.trial188.stdout:3289: read oid 19 snap -1 2026-02-13T20:26:10.996 INFO:tasks.rados.rados.0.trial188.stdout:3289: expect (ObjNum 1110 snap 328 seq_num 1110) 2026-02-13T20:26:10.996 INFO:tasks.rados.rados.0.trial188.stdout:3290: delete oid 10 current snap is 341 2026-02-13T20:26:10.996 INFO:tasks.rados.rados.0.trial188.stdout:3285: finishing write tid 2 to trial18843701-3 2026-02-13T20:26:10.996 INFO:tasks.rados.rados.0.trial188.stdout:3285: finishing write tid 3 to trial18843701-3 2026-02-13T20:26:10.997 INFO:tasks.rados.rados.0.trial188.stdout:3286: finishing write tid 1 to trial18843701-50 2026-02-13T20:26:10.997 INFO:tasks.rados.rados.0.trial188.stdout:3285: finishing write tid 4 to trial18843701-3 2026-02-13T20:26:10.997 INFO:tasks.rados.rados.0.trial188.stdout:3285: oid 3 updating version 0 to 1511 2026-02-13T20:26:10.997 INFO:tasks.rados.rados.0.trial188.stdout:3285: oid 3 version 1511 is already newer than 1510 2026-02-13T20:26:10.997 INFO:tasks.rados.rados.0.trial188.stdout:3285: oid 3 version 1511 is already newer than 1509 2026-02-13T20:26:10.997 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 3 v 1511 (ObjNum 1131 snap 341 seq_num 1131) dirty exists 2026-02-13T20:26:10.997 INFO:tasks.rados.rados.0.trial188.stdout:3285: left oid 3 (ObjNum 1131 snap 341 seq_num 1131) 2026-02-13T20:26:10.997 INFO:tasks.rados.rados.0.trial188.stdout:3286: finishing write tid 2 to trial18843701-50 2026-02-13T20:26:10.997 INFO:tasks.rados.rados.0.trial188.stdout:3286: finishing write tid 3 to trial18843701-50 2026-02-13T20:26:10.997 INFO:tasks.rados.rados.0.trial188.stdout:3286: finishing write tid 4 to trial18843701-50 2026-02-13T20:26:10.997 INFO:tasks.rados.rados.0.trial188.stdout:3286: finishing write tid 5 to trial18843701-50 2026-02-13T20:26:10.997 INFO:tasks.rados.rados.0.trial188.stdout:3286: oid 50 updating version 0 to 1618 2026-02-13T20:26:10.997 INFO:tasks.rados.rados.0.trial188.stdout:3286: oid 50 version 1618 is already newer than 1617 2026-02-13T20:26:10.997 INFO:tasks.rados.rados.0.trial188.stdout:3286: oid 50 updating version 1618 to 1620 2026-02-13T20:26:10.997 INFO:tasks.rados.rados.0.trial188.stdout:3286: oid 50 version 1620 is already newer than 1619 2026-02-13T20:26:10.997 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 50 v 1620 (ObjNum 1132 snap 341 seq_num 1132) dirty exists 2026-02-13T20:26:10.997 INFO:tasks.rados.rados.0.trial188.stdout:3286: left oid 50 (ObjNum 1132 snap 341 seq_num 1132) 2026-02-13T20:26:11.002 INFO:tasks.rados.rados.0.trial188.stdout:3288: expect (ObjNum 1127 snap 339 seq_num 1127) 2026-02-13T20:26:11.088 INFO:tasks.rados.rados.0.trial188.stdout:3289: expect (ObjNum 1110 snap 328 seq_num 1110) 2026-02-13T20:26:11.124 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1314192 2026-02-13T20:26:11.135 INFO:tasks.rados.rados.0.trial188.stdout:3285: done (4 left) 2026-02-13T20:26:11.136 INFO:tasks.rados.rados.0.trial188.stdout:3286: done (3 left) 2026-02-13T20:26:11.136 INFO:tasks.rados.rados.0.trial188.stdout:3288: done (2 left) 2026-02-13T20:26:11.136 INFO:tasks.rados.rados.0.trial188.stdout:3289: done (1 left) 2026-02-13T20:26:11.136 INFO:tasks.rados.rados.0.trial188.stdout:3290: done (0 left) 2026-02-13T20:26:11.136 INFO:tasks.rados.rados.0.trial188.stdout:3291: write oid 10 current snap is 341 2026-02-13T20:26:11.136 INFO:tasks.rados.rados.0.trial188.stdout:3291: seq_num 1135 ranges {675945=744212,2167533=755390} 2026-02-13T20:26:11.141 INFO:tasks.rados.rados.0.trial188.stdout:3291: writing trial18843701-10 from 675945 to 1420157 tid 1 2026-02-13T20:26:11.147 INFO:tasks.rados.rados.0.trial188.stdout:3291: writing trial18843701-10 from 2167533 to 2922923 tid 2 2026-02-13T20:26:11.147 INFO:tasks.rados.rados.0.trial188.stdout:3292: snap_create 2026-02-13T20:26:11.163 INFO:tasks.rados.rados.0.trial188.stdout:3291: finishing write tid 1 to trial18843701-10 2026-02-13T20:26:11.163 INFO:tasks.rados.rados.0.trial188.stdout:3291: finishing write tid 2 to trial18843701-10 2026-02-13T20:26:11.163 INFO:tasks.rados.rados.0.trial188.stdout:3291: finishing write tid 3 to trial18843701-10 2026-02-13T20:26:11.163 INFO:tasks.rados.rados.0.trial188.stdout:3291: finishing write tid 4 to trial18843701-10 2026-02-13T20:26:11.163 INFO:tasks.rados.rados.0.trial188.stdout:3291: oid 10 updating version 0 to 1555 2026-02-13T20:26:11.163 INFO:tasks.rados.rados.0.trial188.stdout:3291: oid 10 updating version 1555 to 1556 2026-02-13T20:26:11.164 INFO:tasks.rados.rados.0.trial188.stdout:3291: oid 10 version 1556 is already newer than 1554 2026-02-13T20:26:11.164 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 10 v 1556 (ObjNum 1135 snap 341 seq_num 1135) dirty exists 2026-02-13T20:26:11.164 INFO:tasks.rados.rados.0.trial188.stdout:3291: left oid 10 (ObjNum 1135 snap 341 seq_num 1135) 2026-02-13T20:26:11.763 INFO:tasks.rados.rados.0.trial188.stdout:3291: done (1 left) 2026-02-13T20:26:11.763 INFO:tasks.rados.rados.0.trial188.stdout:3292: done (0 left) 2026-02-13T20:26:11.764 INFO:tasks.rados.rados.0.trial188.stdout:3293: delete oid 27 current snap is 342 2026-02-13T20:26:11.764 INFO:tasks.rados.rados.0.trial188.stdout:3293: done (0 left) 2026-02-13T20:26:11.765 INFO:tasks.rados.rados.0.trial188.stdout:3294: delete oid 4 current snap is 342 2026-02-13T20:26:11.766 INFO:tasks.rados.rados.0.trial188.stdout:3294: done (0 left) 2026-02-13T20:26:11.766 INFO:tasks.rados.rados.0.trial188.stdout:3295: copy_from oid 38 from oid 32 current snap is 342 2026-02-13T20:26:11.766 INFO:tasks.rados.rados.0.trial188.stdout:3296: write (excl) oid 25 current snap is 342 2026-02-13T20:26:11.766 INFO:tasks.rados.rados.0.trial188.stdout:3296: seq_num 1138 ranges {726366=569959,1826626=502717,2801601=324765} 2026-02-13T20:26:11.771 INFO:tasks.rados.rados.0.trial188.stdout:3296: writing trial18843701-25 from 726366 to 1296325 tid 1 2026-02-13T20:26:11.775 INFO:tasks.rados.rados.0.trial188.stdout:3296: writing trial18843701-25 from 1826626 to 2329343 tid 2 2026-02-13T20:26:11.779 INFO:tasks.rados.rados.0.trial188.stdout:3296: writing trial18843701-25 from 2801601 to 3126366 tid 3 2026-02-13T20:26:11.779 INFO:tasks.rados.rados.0.trial188.stdout:3297: read oid 20 snap -1 2026-02-13T20:26:11.779 INFO:tasks.rados.rados.0.trial188.stdout:3297: expect deleted 2026-02-13T20:26:11.779 INFO:tasks.rados.rados.0.trial188.stdout:3298: rollback oid 29 current snap is 342 2026-02-13T20:26:11.780 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 29 to 340 2026-02-13T20:26:11.780 INFO:tasks.rados.rados.0.trial188.stdout:3299: read oid 35 snap -1 2026-02-13T20:26:11.780 INFO:tasks.rados.rados.0.trial188.stdout:3299: expect (ObjNum 1080 snap 324 seq_num 1080) 2026-02-13T20:26:11.780 INFO:tasks.rados.rados.0.trial188.stdout:3300: copy_from oid 48 from oid 47 current snap is 342 2026-02-13T20:26:11.780 INFO:tasks.rados.rados.0.trial188.stdout:3301: read oid 11 snap -1 2026-02-13T20:26:11.780 INFO:tasks.rados.rados.0.trial188.stdout:3301: expect (ObjNum 1107 snap 327 seq_num 1107) 2026-02-13T20:26:11.780 INFO:tasks.rados.rados.0.trial188.stdout:3302: snap_remove snap 337 2026-02-13T20:26:12.767 INFO:tasks.rados.rados.0.trial188.stdout:3302: done (7 left) 2026-02-13T20:26:12.767 INFO:tasks.rados.rados.0.trial188.stdout:3303: delete oid 46 current snap is 342 2026-02-13T20:26:12.767 INFO:tasks.rados.rados.0.trial188.stdout:3298: finishing rollback tid 0 to trial18843701-29 2026-02-13T20:26:12.767 INFO:tasks.rados.rados.0.trial188.stdout:3298: finishing rollback tid 1 to trial18843701-29 2026-02-13T20:26:12.767 INFO:tasks.rados.rados.0.trial188.stdout:3298: finishing rollback tid 2 to trial18843701-29 2026-02-13T20:26:12.767 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 29 v 1601 (ObjNum 1049 snap 314 seq_num 1049) dirty exists 2026-02-13T20:26:12.767 INFO:tasks.rados.rados.0.trial188.stdout:3301: expect (ObjNum 1107 snap 327 seq_num 1107) 2026-02-13T20:26:12.885 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:26:12.945 INFO:tasks.rados.rados.0.trial188.stdout:3295: finishing copy_from racing read to trial18843701-38 2026-02-13T20:26:12.945 INFO:tasks.rados.rados.0.trial188.stdout:3297: done (7 left) 2026-02-13T20:26:12.945 INFO:tasks.rados.rados.0.trial188.stdout:3298: done (6 left) 2026-02-13T20:26:12.945 INFO:tasks.rados.rados.0.trial188.stdout:3301: done (5 left) 2026-02-13T20:26:12.945 INFO:tasks.rados.rados.0.trial188.stdout:3303: done (4 left) 2026-02-13T20:26:12.945 INFO:tasks.rados.rados.0.trial188.stdout:3304: write (excl) oid 5 current snap is 342 2026-02-13T20:26:12.945 INFO:tasks.rados.rados.0.trial188.stdout:3304: seq_num 1140 ranges {759980=720457,1943590=506386,2856447=303533} 2026-02-13T20:26:12.950 INFO:tasks.rados.rados.0.trial188.stdout:3304: writing trial18843701-5 from 759980 to 1480437 tid 1 2026-02-13T20:26:12.953 INFO:tasks.rados.rados.0.trial188.stdout:3304: writing trial18843701-5 from 1943590 to 2449976 tid 2 2026-02-13T20:26:12.957 INFO:tasks.rados.rados.0.trial188.stdout:3304: writing trial18843701-5 from 2856447 to 3159980 tid 3 2026-02-13T20:26:12.957 INFO:tasks.rados.rados.0.trial188.stdout:3305: delete oid 13 current snap is 342 2026-02-13T20:26:12.957 INFO:tasks.rados.rados.0.trial188.stdout:3296: finishing write tid 1 to trial18843701-25 2026-02-13T20:26:12.957 INFO:tasks.rados.rados.0.trial188.stdout:3295: finishing copy_from to trial18843701-38 2026-02-13T20:26:12.957 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 38 v 1466 (ObjNum 1054 snap 314 seq_num 1054) dirty exists 2026-02-13T20:26:12.957 INFO:tasks.rados.rados.0.trial188.stdout:3296: finishing write tid 2 to trial18843701-25 2026-02-13T20:26:12.957 INFO:tasks.rados.rados.0.trial188.stdout:3296: finishing write tid 3 to trial18843701-25 2026-02-13T20:26:12.957 INFO:tasks.rados.rados.0.trial188.stdout:3296: finishing write tid 4 to trial18843701-25 2026-02-13T20:26:12.958 INFO:tasks.rados.rados.0.trial188.stdout:3296: finishing write tid 5 to trial18843701-25 2026-02-13T20:26:12.958 INFO:tasks.rados.rados.0.trial188.stdout:3296: oid 25 updating version 0 to 1505 2026-02-13T20:26:12.958 INFO:tasks.rados.rados.0.trial188.stdout:3296: oid 25 updating version 1505 to 1508 2026-02-13T20:26:12.958 INFO:tasks.rados.rados.0.trial188.stdout:3296: oid 25 version 1508 is already newer than 1507 2026-02-13T20:26:12.958 INFO:tasks.rados.rados.0.trial188.stdout:3296: oid 25 updating version 1508 to 1509 2026-02-13T20:26:12.958 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 25 v 1509 (ObjNum 1138 snap 342 seq_num 1138) dirty exists 2026-02-13T20:26:12.958 INFO:tasks.rados.rados.0.trial188.stdout:3296: left oid 25 (ObjNum 1138 snap 342 seq_num 1138) 2026-02-13T20:26:12.958 INFO:tasks.rados.rados.0.trial188.stdout:3299: expect (ObjNum 1080 snap 324 seq_num 1080) 2026-02-13T20:26:12.959 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 565015 2026-02-13T20:26:12.971 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1193908 2026-02-13T20:26:12.980 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:26:12.998 INFO:tasks.rados.rados.0.trial188.stdout:3300: finishing copy_from racing read to trial18843701-48 2026-02-13T20:26:12.998 INFO:tasks.rados.rados.0.trial188.stdout:3300: finishing copy_from to trial18843701-48 2026-02-13T20:26:12.998 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 48 v 1095 (ObjNum 1007 snap 299 seq_num 1007) dirty exists 2026-02-13T20:26:12.998 INFO:tasks.rados.rados.0.trial188.stdout:3295: done (5 left) 2026-02-13T20:26:12.999 INFO:tasks.rados.rados.0.trial188.stdout:3296: done (4 left) 2026-02-13T20:26:12.999 INFO:tasks.rados.rados.0.trial188.stdout:3299: done (3 left) 2026-02-13T20:26:12.999 INFO:tasks.rados.rados.0.trial188.stdout:3300: done (2 left) 2026-02-13T20:26:12.999 INFO:tasks.rados.rados.0.trial188.stdout:3305: done (1 left) 2026-02-13T20:26:12.999 INFO:tasks.rados.rados.0.trial188.stdout:3306: read oid 14 snap 338 2026-02-13T20:26:12.999 INFO:tasks.rados.rados.0.trial188.stdout:3306: expect deleted 2026-02-13T20:26:13.000 INFO:tasks.rados.rados.0.trial188.stdout:3307: copy_from oid 25 from oid 36 current snap is 342 2026-02-13T20:26:13.000 INFO:tasks.rados.rados.0.trial188.stdout:3304: finishing write tid 1 to trial18843701-5 2026-02-13T20:26:13.000 INFO:tasks.rados.rados.0.trial188.stdout:3304: finishing write tid 2 to trial18843701-5 2026-02-13T20:26:13.000 INFO:tasks.rados.rados.0.trial188.stdout:3304: finishing write tid 3 to trial18843701-5 2026-02-13T20:26:13.000 INFO:tasks.rados.rados.0.trial188.stdout:3304: finishing write tid 4 to trial18843701-5 2026-02-13T20:26:13.000 INFO:tasks.rados.rados.0.trial188.stdout:3304: finishing write tid 5 to trial18843701-5 2026-02-13T20:26:13.000 INFO:tasks.rados.rados.0.trial188.stdout:3304: oid 5 updating version 0 to 1518 2026-02-13T20:26:13.001 INFO:tasks.rados.rados.0.trial188.stdout:3304: oid 5 version 1518 is already newer than 1517 2026-02-13T20:26:13.001 INFO:tasks.rados.rados.0.trial188.stdout:3304: oid 5 updating version 1518 to 1519 2026-02-13T20:26:13.001 INFO:tasks.rados.rados.0.trial188.stdout:3304: oid 5 version 1519 is already newer than 1516 2026-02-13T20:26:13.001 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 5 v 1519 (ObjNum 1140 snap 342 seq_num 1140) dirty exists 2026-02-13T20:26:13.001 INFO:tasks.rados.rados.0.trial188.stdout:3304: left oid 5 (ObjNum 1140 snap 342 seq_num 1140) 2026-02-13T20:26:13.001 INFO:tasks.rados.rados.0.trial188.stdout:3304: done (2 left) 2026-02-13T20:26:13.001 INFO:tasks.rados.rados.0.trial188.stdout:3308: snap_create 2026-02-13T20:26:13.027 INFO:tasks.rados.rados.0.trial188.stdout:3307: finishing copy_from racing read to trial18843701-25 2026-02-13T20:26:13.028 INFO:tasks.rados.rados.0.trial188.stdout:3307: finishing copy_from to trial18843701-25 2026-02-13T20:26:13.029 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 25 v 1595 (ObjNum 1049 snap 314 seq_num 1049) dirty exists 2026-02-13T20:26:13.741 INFO:tasks.rados.rados.0.trial188.stdout:3306: done (2 left) 2026-02-13T20:26:13.742 INFO:tasks.rados.rados.0.trial188.stdout:3307: done (1 left) 2026-02-13T20:26:13.742 INFO:tasks.rados.rados.0.trial188.stdout:3308: done (0 left) 2026-02-13T20:26:13.742 INFO:tasks.rados.rados.0.trial188.stdout:3309: read oid 37 snap -1 2026-02-13T20:26:13.742 INFO:tasks.rados.rados.0.trial188.stdout:3309: expect (ObjNum 1004 snap 299 seq_num 1004) 2026-02-13T20:26:13.742 INFO:tasks.rados.rados.0.trial188.stdout:3310: read oid 11 snap 334 2026-02-13T20:26:13.742 INFO:tasks.rados.rados.0.trial188.stdout:3310: expect (ObjNum 1107 snap 327 seq_num 1107) 2026-02-13T20:26:13.742 INFO:tasks.rados.rados.0.trial188.stdout:3311: snap_create 2026-02-13T20:26:13.745 INFO:tasks.rados.rados.0.trial188.stdout:3310: expect (ObjNum 1107 snap 327 seq_num 1107) 2026-02-13T20:26:13.919 INFO:tasks.rados.rados.0.trial188.stdout:3309: expect (ObjNum 1004 snap 299 seq_num 1004) 2026-02-13T20:26:14.744 INFO:tasks.rados.rados.0.trial188.stdout:3309: done (2 left) 2026-02-13T20:26:14.744 INFO:tasks.rados.rados.0.trial188.stdout:3310: done (1 left) 2026-02-13T20:26:14.744 INFO:tasks.rados.rados.0.trial188.stdout:3311: done (0 left) 2026-02-13T20:26:14.744 INFO:tasks.rados.rados.0.trial188.stdout:3312: read oid 30 snap -1 2026-02-13T20:26:14.744 INFO:tasks.rados.rados.0.trial188.stdout:3312: expect deleted 2026-02-13T20:26:14.744 INFO:tasks.rados.rados.0.trial188.stdout:3313: snap_remove snap 333 2026-02-13T20:26:15.745 INFO:tasks.rados.rados.0.trial188.stdout:3313: done (1 left) 2026-02-13T20:26:15.745 INFO:tasks.rados.rados.0.trial188.stdout:3314: write oid 40 current snap is 344 2026-02-13T20:26:15.745 INFO:tasks.rados.rados.0.trial188.stdout:3314: seq_num 1142 ranges {793594=587308,2060554=510055} 2026-02-13T20:26:15.750 INFO:tasks.rados.rados.0.trial188.stdout:3314: writing trial18843701-40 from 793594 to 1380902 tid 1 2026-02-13T20:26:15.755 INFO:tasks.rados.rados.0.trial188.stdout:3314: writing trial18843701-40 from 2060554 to 2570609 tid 2 2026-02-13T20:26:15.755 INFO:tasks.rados.rados.0.trial188.stdout:3315: rollback oid 4 current snap is 344 2026-02-13T20:26:15.755 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 4 to 340 2026-02-13T20:26:15.755 INFO:tasks.rados.rados.0.trial188.stdout:3312: done (2 left) 2026-02-13T20:26:15.755 INFO:tasks.rados.rados.0.trial188.stdout:3316: snap_create 2026-02-13T20:26:15.756 INFO:tasks.rados.rados.0.trial188.stdout:3315: finishing rollback tid 1 to trial18843701-4 2026-02-13T20:26:15.756 INFO:tasks.rados.rados.0.trial188.stdout:3315: finishing rollback tid 2 to trial18843701-4 2026-02-13T20:26:15.756 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 4 v 1559 (ObjNum 1103 snap 326 seq_num 1103) dirty exists 2026-02-13T20:26:15.769 INFO:tasks.rados.rados.0.trial188.stdout:3314: finishing write tid 1 to trial18843701-40 2026-02-13T20:26:15.769 INFO:tasks.rados.rados.0.trial188.stdout:3314: finishing write tid 2 to trial18843701-40 2026-02-13T20:26:15.769 INFO:tasks.rados.rados.0.trial188.stdout:3314: finishing write tid 3 to trial18843701-40 2026-02-13T20:26:15.769 INFO:tasks.rados.rados.0.trial188.stdout:3314: finishing write tid 4 to trial18843701-40 2026-02-13T20:26:15.769 INFO:tasks.rados.rados.0.trial188.stdout:3314: oid 40 updating version 0 to 1471 2026-02-13T20:26:15.769 INFO:tasks.rados.rados.0.trial188.stdout:3314: oid 40 version 1471 is already newer than 1470 2026-02-13T20:26:15.769 INFO:tasks.rados.rados.0.trial188.stdout:3314: oid 40 version 1471 is already newer than 1469 2026-02-13T20:26:15.769 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 40 v 1471 (ObjNum 1142 snap 344 seq_num 1142) dirty exists 2026-02-13T20:26:15.770 INFO:tasks.rados.rados.0.trial188.stdout:3314: left oid 40 (ObjNum 1142 snap 344 seq_num 1142) 2026-02-13T20:26:16.747 INFO:tasks.rados.rados.0.trial188.stdout:3314: done (2 left) 2026-02-13T20:26:16.747 INFO:tasks.rados.rados.0.trial188.stdout:3315: done (1 left) 2026-02-13T20:26:16.747 INFO:tasks.rados.rados.0.trial188.stdout:3316: done (0 left) 2026-02-13T20:26:16.747 INFO:tasks.rados.rados.0.trial188.stdout:3317: copy_from oid 49 from oid 18 current snap is 345 2026-02-13T20:26:16.747 INFO:tasks.rados.rados.0.trial188.stdout:3318: write (excl) oid 37 current snap is 345 2026-02-13T20:26:16.747 INFO:tasks.rados.rados.0.trial188.stdout:3318: seq_num 1143 ranges {410401=662557,1719036=770066,2938716=271685} 2026-02-13T20:26:16.750 INFO:tasks.rados.rados.0.trial188.stdout:3318: writing trial18843701-37 from 410401 to 1072958 tid 1 2026-02-13T20:26:16.756 INFO:tasks.rados.rados.0.trial188.stdout:3318: writing trial18843701-37 from 1719036 to 2489102 tid 2 2026-02-13T20:26:16.759 INFO:tasks.rados.rados.0.trial188.stdout:3318: writing trial18843701-37 from 2938716 to 3210401 tid 3 2026-02-13T20:26:16.759 INFO:tasks.rados.rados.0.trial188.stdout:3319: snap_create 2026-02-13T20:26:16.759 INFO:tasks.rados.rados.0.trial188.stdout:3317: finishing copy_from to trial18843701-49 2026-02-13T20:26:16.760 INFO:tasks.rados.rados.0.trial188.stdout:3317: got expected ENOENT (src dne) 2026-02-13T20:26:16.760 INFO:tasks.rados.rados.0.trial188.stdout:3317: finishing copy_from racing read to trial18843701-49 2026-02-13T20:26:16.777 INFO:tasks.rados.rados.0.trial188.stdout:3318: finishing write tid 1 to trial18843701-37 2026-02-13T20:26:16.777 INFO:tasks.rados.rados.0.trial188.stdout:3318: finishing write tid 2 to trial18843701-37 2026-02-13T20:26:16.777 INFO:tasks.rados.rados.0.trial188.stdout:3318: finishing write tid 3 to trial18843701-37 2026-02-13T20:26:16.777 INFO:tasks.rados.rados.0.trial188.stdout:3318: finishing write tid 4 to trial18843701-37 2026-02-13T20:26:16.777 INFO:tasks.rados.rados.0.trial188.stdout:3318: finishing write tid 5 to trial18843701-37 2026-02-13T20:26:16.777 INFO:tasks.rados.rados.0.trial188.stdout:3318: oid 37 updating version 0 to 1595 2026-02-13T20:26:16.777 INFO:tasks.rados.rados.0.trial188.stdout:3318: oid 37 version 1595 is already newer than 1593 2026-02-13T20:26:16.778 INFO:tasks.rados.rados.0.trial188.stdout:3318: oid 37 updating version 1595 to 1596 2026-02-13T20:26:16.778 INFO:tasks.rados.rados.0.trial188.stdout:3318: oid 37 version 1596 is already newer than 1594 2026-02-13T20:26:16.778 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 37 v 1596 (ObjNum 1143 snap 345 seq_num 1143) dirty exists 2026-02-13T20:26:16.778 INFO:tasks.rados.rados.0.trial188.stdout:3318: left oid 37 (ObjNum 1143 snap 345 seq_num 1143) 2026-02-13T20:26:17.751 INFO:tasks.rados.rados.0.trial188.stdout:3317: done (2 left) 2026-02-13T20:26:17.751 INFO:tasks.rados.rados.0.trial188.stdout:3318: done (1 left) 2026-02-13T20:26:17.751 INFO:tasks.rados.rados.0.trial188.stdout:3319: done (0 left) 2026-02-13T20:26:17.751 INFO:tasks.rados.rados.0.trial188.stdout:3320: rollback oid 36 current snap is 346 2026-02-13T20:26:17.752 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 36 to 334 2026-02-13T20:26:17.752 INFO:tasks.rados.rados.0.trial188.stdout:3321: write oid 39 current snap is 346 2026-02-13T20:26:17.752 INFO:tasks.rados.rados.0.trial188.stdout:3321: seq_num 1144 ranges {427208=737806,1777518=513724,2966139=261069} 2026-02-13T20:26:17.755 INFO:tasks.rados.rados.0.trial188.stdout:3321: writing trial18843701-39 from 427208 to 1165014 tid 1 2026-02-13T20:26:17.759 INFO:tasks.rados.rados.0.trial188.stdout:3321: writing trial18843701-39 from 1777518 to 2291242 tid 2 2026-02-13T20:26:17.764 INFO:tasks.rados.rados.0.trial188.stdout:3321: writing trial18843701-39 from 2966139 to 3227208 tid 3 2026-02-13T20:26:17.764 INFO:tasks.rados.rados.0.trial188.stdout:3322: write (excl) oid 41 current snap is 346 2026-02-13T20:26:17.764 INFO:tasks.rados.rados.0.trial188.stdout:3322: seq_num 1145 ranges {444015=413055,1436000=773735,2709915=534100} 2026-02-13T20:26:17.767 INFO:tasks.rados.rados.0.trial188.stdout:3322: writing trial18843701-41 from 444015 to 857070 tid 1 2026-02-13T20:26:17.772 INFO:tasks.rados.rados.0.trial188.stdout:3322: writing trial18843701-41 from 1436000 to 2209735 tid 2 2026-02-13T20:26:17.776 INFO:tasks.rados.rados.0.trial188.stdout:3322: writing trial18843701-41 from 2709915 to 3244015 tid 3 2026-02-13T20:26:17.776 INFO:tasks.rados.rados.0.trial188.stdout:3323: delete oid 37 current snap is 346 2026-02-13T20:26:17.776 INFO:tasks.rados.rados.0.trial188.stdout:3320: finishing rollback tid 0 to trial18843701-36 2026-02-13T20:26:17.776 INFO:tasks.rados.rados.0.trial188.stdout:3320: finishing rollback tid 1 to trial18843701-36 2026-02-13T20:26:17.776 INFO:tasks.rados.rados.0.trial188.stdout:3320: finishing rollback tid 2 to trial18843701-36 2026-02-13T20:26:17.777 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 36 v 1626 (ObjNum 1049 snap 314 seq_num 1049) dirty exists 2026-02-13T20:26:17.778 INFO:tasks.rados.rados.0.trial188.stdout:3320: done (3 left) 2026-02-13T20:26:17.778 INFO:tasks.rados.rados.0.trial188.stdout:3323: done (2 left) 2026-02-13T20:26:17.779 INFO:tasks.rados.rados.0.trial188.stdout:3324: read oid 19 snap 343 2026-02-13T20:26:17.779 INFO:tasks.rados.rados.0.trial188.stdout:3324: expect (ObjNum 1110 snap 328 seq_num 1110) 2026-02-13T20:26:17.779 INFO:tasks.rados.rados.0.trial188.stdout:3325: write (excl) oid 50 current snap is 346 2026-02-13T20:26:17.779 INFO:tasks.rados.rados.0.trial188.stdout:3325: seq_num 1147 ranges {477629=563553,1836611=777404,3048408=229221} 2026-02-13T20:26:17.783 INFO:tasks.rados.rados.0.trial188.stdout:3325: writing trial18843701-50 from 477629 to 1041182 tid 1 2026-02-13T20:26:17.789 INFO:tasks.rados.rados.0.trial188.stdout:3325: writing trial18843701-50 from 1836611 to 2614015 tid 2 2026-02-13T20:26:17.792 INFO:tasks.rados.rados.0.trial188.stdout:3325: writing trial18843701-50 from 3048408 to 3277629 tid 3 2026-02-13T20:26:17.792 INFO:tasks.rados.rados.0.trial188.stdout:3326: snap_remove snap 338 2026-02-13T20:26:18.752 INFO:tasks.rados.rados.0.trial188.stdout:3321: finishing write tid 1 to trial18843701-39 2026-02-13T20:26:18.752 INFO:tasks.rados.rados.0.trial188.stdout:3321: finishing write tid 2 to trial18843701-39 2026-02-13T20:26:18.753 INFO:tasks.rados.rados.0.trial188.stdout:3321: finishing write tid 3 to trial18843701-39 2026-02-13T20:26:18.753 INFO:tasks.rados.rados.0.trial188.stdout:3326: done (4 left) 2026-02-13T20:26:18.753 INFO:tasks.rados.rados.0.trial188.stdout:3327: read oid 48 snap -1 2026-02-13T20:26:18.753 INFO:tasks.rados.rados.0.trial188.stdout:3327: expect (ObjNum 1007 snap 299 seq_num 1007) 2026-02-13T20:26:18.753 INFO:tasks.rados.rados.0.trial188.stdout:3328: snap_create 2026-02-13T20:26:18.753 INFO:tasks.rados.rados.0.trial188.stdout:3321: finishing write tid 4 to trial18843701-39 2026-02-13T20:26:18.753 INFO:tasks.rados.rados.0.trial188.stdout:3321: finishing write tid 5 to trial18843701-39 2026-02-13T20:26:18.753 INFO:tasks.rados.rados.0.trial188.stdout:3321: oid 39 updating version 0 to 1603 2026-02-13T20:26:18.753 INFO:tasks.rados.rados.0.trial188.stdout:3321: oid 39 updating version 1603 to 1604 2026-02-13T20:26:18.753 INFO:tasks.rados.rados.0.trial188.stdout:3321: oid 39 version 1604 is already newer than 1602 2026-02-13T20:26:18.753 INFO:tasks.rados.rados.0.trial188.stdout:3321: oid 39 updating version 1604 to 1605 2026-02-13T20:26:18.753 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 39 v 1605 (ObjNum 1144 snap 346 seq_num 1144) dirty exists 2026-02-13T20:26:18.754 INFO:tasks.rados.rados.0.trial188.stdout:3321: left oid 39 (ObjNum 1144 snap 346 seq_num 1144) 2026-02-13T20:26:18.754 INFO:tasks.rados.rados.0.trial188.stdout:3324: expect (ObjNum 1110 snap 328 seq_num 1110) 2026-02-13T20:26:18.754 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:26:18.790 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:26:18.809 INFO:tasks.rados.rados.0.trial188.stdout:3322: finishing write tid 1 to trial18843701-41 2026-02-13T20:26:18.809 INFO:tasks.rados.rados.0.trial188.stdout:3322: finishing write tid 2 to trial18843701-41 2026-02-13T20:26:18.809 INFO:tasks.rados.rados.0.trial188.stdout:3322: finishing write tid 3 to trial18843701-41 2026-02-13T20:26:18.809 INFO:tasks.rados.rados.0.trial188.stdout:3322: finishing write tid 4 to trial18843701-41 2026-02-13T20:26:18.809 INFO:tasks.rados.rados.0.trial188.stdout:3322: finishing write tid 5 to trial18843701-41 2026-02-13T20:26:18.810 INFO:tasks.rados.rados.0.trial188.stdout:3322: oid 41 updating version 0 to 1472 2026-02-13T20:26:18.810 INFO:tasks.rados.rados.0.trial188.stdout:3322: oid 41 updating version 1472 to 1474 2026-02-13T20:26:18.810 INFO:tasks.rados.rados.0.trial188.stdout:3322: oid 41 version 1474 is already newer than 1473 2026-02-13T20:26:18.810 INFO:tasks.rados.rados.0.trial188.stdout:3322: oid 41 updating version 1474 to 1475 2026-02-13T20:26:18.810 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 41 v 1475 (ObjNum 1145 snap 346 seq_num 1145) dirty exists 2026-02-13T20:26:18.810 INFO:tasks.rados.rados.0.trial188.stdout:3322: left oid 41 (ObjNum 1145 snap 346 seq_num 1145) 2026-02-13T20:26:18.810 INFO:tasks.rados.rados.0.trial188.stdout:3325: finishing write tid 1 to trial18843701-50 2026-02-13T20:26:18.810 INFO:tasks.rados.rados.0.trial188.stdout:3325: finishing write tid 2 to trial18843701-50 2026-02-13T20:26:18.810 INFO:tasks.rados.rados.0.trial188.stdout:3325: finishing write tid 3 to trial18843701-50 2026-02-13T20:26:18.810 INFO:tasks.rados.rados.0.trial188.stdout:3325: finishing write tid 4 to trial18843701-50 2026-02-13T20:26:18.810 INFO:tasks.rados.rados.0.trial188.stdout:3325: finishing write tid 5 to trial18843701-50 2026-02-13T20:26:18.810 INFO:tasks.rados.rados.0.trial188.stdout:3325: oid 50 updating version 0 to 1629 2026-02-13T20:26:18.811 INFO:tasks.rados.rados.0.trial188.stdout:3325: oid 50 updating version 1629 to 1630 2026-02-13T20:26:18.811 INFO:tasks.rados.rados.0.trial188.stdout:3325: oid 50 version 1630 is already newer than 1628 2026-02-13T20:26:18.811 INFO:tasks.rados.rados.0.trial188.stdout:3325: oid 50 updating version 1630 to 1631 2026-02-13T20:26:18.811 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 50 v 1631 (ObjNum 1147 snap 346 seq_num 1147) dirty exists 2026-02-13T20:26:18.811 INFO:tasks.rados.rados.0.trial188.stdout:3325: left oid 50 (ObjNum 1147 snap 346 seq_num 1147) 2026-02-13T20:26:18.811 INFO:tasks.rados.rados.0.trial188.stdout:3327: expect (ObjNum 1007 snap 299 seq_num 1007) 2026-02-13T20:26:18.870 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:26:19.753 INFO:tasks.rados.rados.0.trial188.stdout:3321: done (5 left) 2026-02-13T20:26:19.753 INFO:tasks.rados.rados.0.trial188.stdout:3322: done (4 left) 2026-02-13T20:26:19.753 INFO:tasks.rados.rados.0.trial188.stdout:3324: done (3 left) 2026-02-13T20:26:19.753 INFO:tasks.rados.rados.0.trial188.stdout:3325: done (2 left) 2026-02-13T20:26:19.753 INFO:tasks.rados.rados.0.trial188.stdout:3327: done (1 left) 2026-02-13T20:26:19.753 INFO:tasks.rados.rados.0.trial188.stdout:3328: done (0 left) 2026-02-13T20:26:19.753 INFO:tasks.rados.rados.0.trial188.stdout:3329: read oid 2 snap -1 2026-02-13T20:26:19.753 INFO:tasks.rados.rados.0.trial188.stdout:3329: expect (ObjNum 1115 snap 331 seq_num 1115) 2026-02-13T20:26:19.754 INFO:tasks.rados.rados.0.trial188.stdout:3330: copy_from oid 11 from oid 27 current snap is 347 2026-02-13T20:26:19.754 INFO:tasks.rados.rados.0.trial188.stdout:3331: copy_from oid 34 from oid 21 current snap is 347 2026-02-13T20:26:19.754 INFO:tasks.rados.rados.0.trial188.stdout:3332: copy_from oid 18 from oid 49 current snap is 347 2026-02-13T20:26:19.754 INFO:tasks.rados.rados.0.trial188.stdout:3333: rollback oid 13 current snap is 347 2026-02-13T20:26:19.754 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 13 to 343 2026-02-13T20:26:19.754 INFO:tasks.rados.rados.0.trial188.stdout:3334: rollback oid 44 current snap is 347 2026-02-13T20:26:19.754 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 44 to 339 2026-02-13T20:26:19.754 INFO:tasks.rados.rados.0.trial188.stdout:3335: write (excl) oid 24 current snap is 347 2026-02-13T20:26:19.754 INFO:tasks.rados.rados.0.trial188.stdout:3335: seq_num 1148 ranges {494436=755155,2011446=521062,3075831=218605} 2026-02-13T20:26:19.758 INFO:tasks.rados.rados.0.trial188.stdout:3335: writing trial18843701-24 from 494436 to 1249591 tid 1 2026-02-13T20:26:19.763 INFO:tasks.rados.rados.0.trial188.stdout:3335: writing trial18843701-24 from 2011446 to 2532508 tid 2 2026-02-13T20:26:19.765 INFO:tasks.rados.rados.0.trial188.stdout:3335: writing trial18843701-24 from 3075831 to 3294436 tid 3 2026-02-13T20:26:19.766 INFO:tasks.rados.rados.0.trial188.stdout:3336: delete oid 45 current snap is 347 2026-02-13T20:26:19.766 INFO:tasks.rados.rados.0.trial188.stdout:3330: finishing copy_from to trial18843701-11 2026-02-13T20:26:19.766 INFO:tasks.rados.rados.0.trial188.stdout:3330: got expected ENOENT (src dne) 2026-02-13T20:26:19.766 INFO:tasks.rados.rados.0.trial188.stdout:3330: finishing copy_from racing read to trial18843701-11 2026-02-13T20:26:19.766 INFO:tasks.rados.rados.0.trial188.stdout:3329: expect (ObjNum 1115 snap 331 seq_num 1115) 2026-02-13T20:26:19.781 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1262002 2026-02-13T20:26:19.932 INFO:tasks.rados.rados.0.trial188.stdout:3333: finishing rollback tid 1 to trial18843701-13 2026-02-13T20:26:19.933 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 13 v 1520 (ObjNum 81 snap 0 seq_num 3893434365) dirty dne 2026-02-13T20:26:19.933 INFO:tasks.rados.rados.0.trial188.stdout:3334: finishing rollback tid 0 to trial18843701-44 2026-02-13T20:26:19.933 INFO:tasks.rados.rados.0.trial188.stdout:3329: done (7 left) 2026-02-13T20:26:19.933 INFO:tasks.rados.rados.0.trial188.stdout:3330: done (6 left) 2026-02-13T20:26:19.933 INFO:tasks.rados.rados.0.trial188.stdout:3333: done (5 left) 2026-02-13T20:26:19.933 INFO:tasks.rados.rados.0.trial188.stdout:3336: done (4 left) 2026-02-13T20:26:19.933 INFO:tasks.rados.rados.0.trial188.stdout:3337: read oid 33 snap -1 2026-02-13T20:26:19.933 INFO:tasks.rados.rados.0.trial188.stdout:3337: expect (ObjNum 1102 snap 326 seq_num 1102) 2026-02-13T20:26:19.933 INFO:tasks.rados.rados.0.trial188.stdout:3338: write oid 19 current snap is 347 2026-02-13T20:26:19.933 INFO:tasks.rados.rados.0.trial188.stdout:3338: seq_num 1150 ranges {528050=505653,1612057=524731,2614324=567403} 2026-02-13T20:26:19.936 INFO:tasks.rados.rados.0.trial188.stdout:3338: writing trial18843701-19 from 528050 to 1033703 tid 1 2026-02-13T20:26:19.940 INFO:tasks.rados.rados.0.trial188.stdout:3338: writing trial18843701-19 from 1612057 to 2136788 tid 2 2026-02-13T20:26:19.944 INFO:tasks.rados.rados.0.trial188.stdout:3338: writing trial18843701-19 from 2614324 to 3181727 tid 3 2026-02-13T20:26:19.944 INFO:tasks.rados.rados.0.trial188.stdout:3339: write oid 35 current snap is 347 2026-02-13T20:26:19.944 INFO:tasks.rados.rados.0.trial188.stdout:3339: seq_num 1151 ranges {544857=580902,1670539=668389,3041747=303110} 2026-02-13T20:26:19.949 INFO:tasks.rados.rados.0.trial188.stdout:3339: writing trial18843701-35 from 544857 to 1125759 tid 1 2026-02-13T20:26:19.953 INFO:tasks.rados.rados.0.trial188.stdout:3339: writing trial18843701-35 from 1670539 to 2338928 tid 2 2026-02-13T20:26:19.957 INFO:tasks.rados.rados.0.trial188.stdout:3339: writing trial18843701-35 from 3041747 to 3344857 tid 3 2026-02-13T20:26:19.957 INFO:tasks.rados.rados.0.trial188.stdout:3340: delete oid 42 current snap is 347 2026-02-13T20:26:19.958 INFO:tasks.rados.rados.0.trial188.stdout:3334: finishing rollback tid 1 to trial18843701-44 2026-02-13T20:26:19.958 INFO:tasks.rados.rados.0.trial188.stdout:3334: finishing rollback tid 2 to trial18843701-44 2026-02-13T20:26:19.958 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 44 v 1523 (ObjNum 1100 snap 326 seq_num 1100) dirty exists 2026-02-13T20:26:19.958 INFO:tasks.rados.rados.0.trial188.stdout:3332: finishing copy_from racing read to trial18843701-18 2026-02-13T20:26:19.958 INFO:tasks.rados.rados.0.trial188.stdout:3332: finishing copy_from to trial18843701-18 2026-02-13T20:26:19.958 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 18 v 1497 (ObjNum 1112 snap 329 seq_num 1112) dirty exists 2026-02-13T20:26:19.958 INFO:tasks.rados.rados.0.trial188.stdout:3331: finishing copy_from racing read to trial18843701-34 2026-02-13T20:26:19.958 INFO:tasks.rados.rados.0.trial188.stdout:3335: finishing write tid 1 to trial18843701-24 2026-02-13T20:26:19.958 INFO:tasks.rados.rados.0.trial188.stdout:3335: finishing write tid 2 to trial18843701-24 2026-02-13T20:26:19.958 INFO:tasks.rados.rados.0.trial188.stdout:3335: finishing write tid 3 to trial18843701-24 2026-02-13T20:26:19.958 INFO:tasks.rados.rados.0.trial188.stdout:3335: finishing write tid 4 to trial18843701-24 2026-02-13T20:26:19.959 INFO:tasks.rados.rados.0.trial188.stdout:3335: finishing write tid 5 to trial18843701-24 2026-02-13T20:26:19.959 INFO:tasks.rados.rados.0.trial188.stdout:3335: oid 24 updating version 0 to 1637 2026-02-13T20:26:19.959 INFO:tasks.rados.rados.0.trial188.stdout:3335: oid 24 version 1637 is already newer than 1636 2026-02-13T20:26:19.959 INFO:tasks.rados.rados.0.trial188.stdout:3335: oid 24 version 1637 is already newer than 1635 2026-02-13T20:26:19.959 INFO:tasks.rados.rados.0.trial188.stdout:3335: oid 24 version 1637 is already newer than 1634 2026-02-13T20:26:19.959 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 24 v 1637 (ObjNum 1148 snap 347 seq_num 1148) dirty exists 2026-02-13T20:26:19.959 INFO:tasks.rados.rados.0.trial188.stdout:3335: left oid 24 (ObjNum 1148 snap 347 seq_num 1148) 2026-02-13T20:26:19.959 INFO:tasks.rados.rados.0.trial188.stdout:3331: finishing copy_from to trial18843701-34 2026-02-13T20:26:19.959 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 34 v 995 (ObjNum 1111 snap 329 seq_num 1111) dirty exists 2026-02-13T20:26:19.959 INFO:tasks.rados.rados.0.trial188.stdout:3337: expect (ObjNum 1102 snap 326 seq_num 1102) 2026-02-13T20:26:19.959 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:26:20.075 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1765672 2026-02-13T20:26:20.104 INFO:tasks.rados.rados.0.trial188.stdout:3338: finishing write tid 1 to trial18843701-19 2026-02-13T20:26:20.104 INFO:tasks.rados.rados.0.trial188.stdout:3338: finishing write tid 2 to trial18843701-19 2026-02-13T20:26:20.105 INFO:tasks.rados.rados.0.trial188.stdout:3331: done (7 left) 2026-02-13T20:26:20.105 INFO:tasks.rados.rados.0.trial188.stdout:3332: done (6 left) 2026-02-13T20:26:20.105 INFO:tasks.rados.rados.0.trial188.stdout:3334: done (5 left) 2026-02-13T20:26:20.105 INFO:tasks.rados.rados.0.trial188.stdout:3335: done (4 left) 2026-02-13T20:26:20.105 INFO:tasks.rados.rados.0.trial188.stdout:3337: done (3 left) 2026-02-13T20:26:20.105 INFO:tasks.rados.rados.0.trial188.stdout:3340: done (2 left) 2026-02-13T20:26:20.105 INFO:tasks.rados.rados.0.trial188.stdout:3341: write (excl) oid 30 current snap is 347 2026-02-13T20:26:20.105 INFO:tasks.rados.rados.0.trial188.stdout:3338: finishing write tid 3 to trial18843701-19 2026-02-13T20:26:20.105 INFO:tasks.rados.rados.0.trial188.stdout:3338: finishing write tid 4 to trial18843701-19 2026-02-13T20:26:20.105 INFO:tasks.rados.rados.0.trial188.stdout:3341: seq_num 1153 ranges {578471=731400,1787503=672058,3096593=281878} 2026-02-13T20:26:20.109 INFO:tasks.rados.rados.0.trial188.stdout:3341: writing trial18843701-30 from 578471 to 1309871 tid 1 2026-02-13T20:26:20.113 INFO:tasks.rados.rados.0.trial188.stdout:3341: writing trial18843701-30 from 1787503 to 2459561 tid 2 2026-02-13T20:26:20.117 INFO:tasks.rados.rados.0.trial188.stdout:3341: writing trial18843701-30 from 3096593 to 3378471 tid 3 2026-02-13T20:26:20.117 INFO:tasks.rados.rados.0.trial188.stdout:3342: write (excl) oid 9 current snap is 347 2026-02-13T20:26:20.117 INFO:tasks.rados.rados.0.trial188.stdout:3342: seq_num 1154 ranges {595278=406649,1729632=532069,3007663=387615} 2026-02-13T20:26:20.120 INFO:tasks.rados.rados.0.trial188.stdout:3342: writing trial18843701-9 from 595278 to 1001927 tid 1 2026-02-13T20:26:20.125 INFO:tasks.rados.rados.0.trial188.stdout:3342: writing trial18843701-9 from 1729632 to 2261701 tid 2 2026-02-13T20:26:20.129 INFO:tasks.rados.rados.0.trial188.stdout:3342: writing trial18843701-9 from 3007663 to 3395278 tid 3 2026-02-13T20:26:20.129 INFO:tasks.rados.rados.0.trial188.stdout:3343: write (excl) oid 13 current snap is 347 2026-02-13T20:26:20.130 INFO:tasks.rados.rados.0.trial188.stdout:3343: seq_num 1155 ranges {612085=481898,1788114=675727,3035086=376999} 2026-02-13T20:26:20.133 INFO:tasks.rados.rados.0.trial188.stdout:3343: writing trial18843701-13 from 612085 to 1093983 tid 1 2026-02-13T20:26:20.139 INFO:tasks.rados.rados.0.trial188.stdout:3343: writing trial18843701-13 from 1788114 to 2463841 tid 2 2026-02-13T20:26:20.142 INFO:tasks.rados.rados.0.trial188.stdout:3343: writing trial18843701-13 from 3035086 to 3412085 tid 3 2026-02-13T20:26:20.142 INFO:tasks.rados.rados.0.trial188.stdout:3344: write oid 32 current snap is 347 2026-02-13T20:26:20.142 INFO:tasks.rados.rados.0.trial188.stdout:3344: seq_num 1156 ranges {628892=673500,1962949=535738,3178862=250030} 2026-02-13T20:26:20.147 INFO:tasks.rados.rados.0.trial188.stdout:3344: writing trial18843701-32 from 628892 to 1302392 tid 1 2026-02-13T20:26:20.152 INFO:tasks.rados.rados.0.trial188.stdout:3344: writing trial18843701-32 from 1962949 to 2498687 tid 2 2026-02-13T20:26:20.156 INFO:tasks.rados.rados.0.trial188.stdout:3344: writing trial18843701-32 from 3178862 to 3428892 tid 3 2026-02-13T20:26:20.156 INFO:tasks.rados.rados.0.trial188.stdout:3345: snap_create 2026-02-13T20:26:20.156 INFO:tasks.rados.rados.0.trial188.stdout:3338: finishing write tid 5 to trial18843701-19 2026-02-13T20:26:20.156 INFO:tasks.rados.rados.0.trial188.stdout:3338: oid 19 updating version 0 to 1608 2026-02-13T20:26:20.156 INFO:tasks.rados.rados.0.trial188.stdout:3338: oid 19 version 1608 is already newer than 1606 2026-02-13T20:26:20.156 INFO:tasks.rados.rados.0.trial188.stdout:3338: oid 19 version 1608 is already newer than 1607 2026-02-13T20:26:20.156 INFO:tasks.rados.rados.0.trial188.stdout:3338: oid 19 updating version 1608 to 1609 2026-02-13T20:26:20.157 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 19 v 1609 (ObjNum 1150 snap 347 seq_num 1150) dirty exists 2026-02-13T20:26:20.157 INFO:tasks.rados.rados.0.trial188.stdout:3338: left oid 19 (ObjNum 1150 snap 347 seq_num 1150) 2026-02-13T20:26:20.157 INFO:tasks.rados.rados.0.trial188.stdout:3339: finishing write tid 1 to trial18843701-35 2026-02-13T20:26:20.157 INFO:tasks.rados.rados.0.trial188.stdout:3339: finishing write tid 2 to trial18843701-35 2026-02-13T20:26:20.157 INFO:tasks.rados.rados.0.trial188.stdout:3339: finishing write tid 3 to trial18843701-35 2026-02-13T20:26:20.157 INFO:tasks.rados.rados.0.trial188.stdout:3339: finishing write tid 4 to trial18843701-35 2026-02-13T20:26:20.157 INFO:tasks.rados.rados.0.trial188.stdout:3339: finishing write tid 5 to trial18843701-35 2026-02-13T20:26:20.157 INFO:tasks.rados.rados.0.trial188.stdout:3339: oid 35 updating version 0 to 1441 2026-02-13T20:26:20.157 INFO:tasks.rados.rados.0.trial188.stdout:3339: oid 35 updating version 1441 to 1443 2026-02-13T20:26:20.157 INFO:tasks.rados.rados.0.trial188.stdout:3339: oid 35 version 1443 is already newer than 1440 2026-02-13T20:26:20.157 INFO:tasks.rados.rados.0.trial188.stdout:3339: oid 35 version 1443 is already newer than 1442 2026-02-13T20:26:20.157 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 35 v 1443 (ObjNum 1151 snap 347 seq_num 1151) dirty exists 2026-02-13T20:26:20.158 INFO:tasks.rados.rados.0.trial188.stdout:3339: left oid 35 (ObjNum 1151 snap 347 seq_num 1151) 2026-02-13T20:26:20.158 INFO:tasks.rados.rados.0.trial188.stdout:3341: finishing write tid 1 to trial18843701-30 2026-02-13T20:26:20.158 INFO:tasks.rados.rados.0.trial188.stdout:3341: finishing write tid 2 to trial18843701-30 2026-02-13T20:26:20.158 INFO:tasks.rados.rados.0.trial188.stdout:3341: finishing write tid 3 to trial18843701-30 2026-02-13T20:26:20.158 INFO:tasks.rados.rados.0.trial188.stdout:3341: finishing write tid 4 to trial18843701-30 2026-02-13T20:26:20.158 INFO:tasks.rados.rados.0.trial188.stdout:3341: finishing write tid 5 to trial18843701-30 2026-02-13T20:26:20.158 INFO:tasks.rados.rados.0.trial188.stdout:3341: oid 30 updating version 0 to 1597 2026-02-13T20:26:20.158 INFO:tasks.rados.rados.0.trial188.stdout:3341: oid 30 version 1597 is already newer than 1596 2026-02-13T20:26:20.158 INFO:tasks.rados.rados.0.trial188.stdout:3341: oid 30 updating version 1597 to 1598 2026-02-13T20:26:20.158 INFO:tasks.rados.rados.0.trial188.stdout:3341: oid 30 updating version 1598 to 1599 2026-02-13T20:26:20.158 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 30 v 1599 (ObjNum 1153 snap 347 seq_num 1153) dirty exists 2026-02-13T20:26:20.158 INFO:tasks.rados.rados.0.trial188.stdout:3341: left oid 30 (ObjNum 1153 snap 347 seq_num 1153) 2026-02-13T20:26:20.158 INFO:tasks.rados.rados.0.trial188.stdout:3342: finishing write tid 1 to trial18843701-9 2026-02-13T20:26:20.159 INFO:tasks.rados.rados.0.trial188.stdout:3343: finishing write tid 1 to trial18843701-13 2026-02-13T20:26:20.159 INFO:tasks.rados.rados.0.trial188.stdout:3342: finishing write tid 2 to trial18843701-9 2026-02-13T20:26:20.160 INFO:tasks.rados.rados.0.trial188.stdout:3343: finishing write tid 2 to trial18843701-13 2026-02-13T20:26:20.160 INFO:tasks.rados.rados.0.trial188.stdout:3342: finishing write tid 3 to trial18843701-9 2026-02-13T20:26:20.160 INFO:tasks.rados.rados.0.trial188.stdout:3343: finishing write tid 3 to trial18843701-13 2026-02-13T20:26:20.160 INFO:tasks.rados.rados.0.trial188.stdout:3342: finishing write tid 4 to trial18843701-9 2026-02-13T20:26:20.160 INFO:tasks.rados.rados.0.trial188.stdout:3343: finishing write tid 4 to trial18843701-13 2026-02-13T20:26:20.160 INFO:tasks.rados.rados.0.trial188.stdout:3342: finishing write tid 5 to trial18843701-9 2026-02-13T20:26:20.160 INFO:tasks.rados.rados.0.trial188.stdout:3342: oid 9 updating version 0 to 1448 2026-02-13T20:26:20.161 INFO:tasks.rados.rados.0.trial188.stdout:3342: oid 9 version 1448 is already newer than 1446 2026-02-13T20:26:20.161 INFO:tasks.rados.rados.0.trial188.stdout:3342: oid 9 version 1448 is already newer than 1445 2026-02-13T20:26:20.161 INFO:tasks.rados.rados.0.trial188.stdout:3342: oid 9 version 1448 is already newer than 1447 2026-02-13T20:26:20.161 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 9 v 1448 (ObjNum 1154 snap 347 seq_num 1154) dirty exists 2026-02-13T20:26:20.161 INFO:tasks.rados.rados.0.trial188.stdout:3342: left oid 9 (ObjNum 1154 snap 347 seq_num 1154) 2026-02-13T20:26:20.161 INFO:tasks.rados.rados.0.trial188.stdout:3343: finishing write tid 5 to trial18843701-13 2026-02-13T20:26:20.161 INFO:tasks.rados.rados.0.trial188.stdout:3343: oid 13 updating version 0 to 1527 2026-02-13T20:26:20.161 INFO:tasks.rados.rados.0.trial188.stdout:3343: oid 13 version 1527 is already newer than 1526 2026-02-13T20:26:20.161 INFO:tasks.rados.rados.0.trial188.stdout:3343: oid 13 version 1527 is already newer than 1525 2026-02-13T20:26:20.161 INFO:tasks.rados.rados.0.trial188.stdout:3343: oid 13 version 1527 is already newer than 1524 2026-02-13T20:26:20.161 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 13 v 1527 (ObjNum 1155 snap 347 seq_num 1155) dirty exists 2026-02-13T20:26:20.161 INFO:tasks.rados.rados.0.trial188.stdout:3343: left oid 13 (ObjNum 1155 snap 347 seq_num 1155) 2026-02-13T20:26:20.171 INFO:tasks.rados.rados.0.trial188.stdout:3344: finishing write tid 1 to trial18843701-32 2026-02-13T20:26:20.171 INFO:tasks.rados.rados.0.trial188.stdout:3344: finishing write tid 2 to trial18843701-32 2026-02-13T20:26:20.171 INFO:tasks.rados.rados.0.trial188.stdout:3344: finishing write tid 3 to trial18843701-32 2026-02-13T20:26:20.171 INFO:tasks.rados.rados.0.trial188.stdout:3344: finishing write tid 4 to trial18843701-32 2026-02-13T20:26:20.172 INFO:tasks.rados.rados.0.trial188.stdout:3344: finishing write tid 5 to trial18843701-32 2026-02-13T20:26:20.172 INFO:tasks.rados.rados.0.trial188.stdout:3344: oid 32 updating version 0 to 1479 2026-02-13T20:26:20.172 INFO:tasks.rados.rados.0.trial188.stdout:3344: oid 32 version 1479 is already newer than 1476 2026-02-13T20:26:20.172 INFO:tasks.rados.rados.0.trial188.stdout:3344: oid 32 version 1479 is already newer than 1478 2026-02-13T20:26:20.172 INFO:tasks.rados.rados.0.trial188.stdout:3344: oid 32 version 1479 is already newer than 1477 2026-02-13T20:26:20.172 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 32 v 1479 (ObjNum 1156 snap 347 seq_num 1156) dirty exists 2026-02-13T20:26:20.172 INFO:tasks.rados.rados.0.trial188.stdout:3344: left oid 32 (ObjNum 1156 snap 347 seq_num 1156) 2026-02-13T20:26:20.758 INFO:tasks.rados.rados.0.trial188.stdout:3338: done (6 left) 2026-02-13T20:26:20.759 INFO:tasks.rados.rados.0.trial188.stdout:3339: done (5 left) 2026-02-13T20:26:20.759 INFO:tasks.rados.rados.0.trial188.stdout:3341: done (4 left) 2026-02-13T20:26:20.759 INFO:tasks.rados.rados.0.trial188.stdout:3342: done (3 left) 2026-02-13T20:26:20.759 INFO:tasks.rados.rados.0.trial188.stdout:3343: done (2 left) 2026-02-13T20:26:20.759 INFO:tasks.rados.rados.0.trial188.stdout:3344: done (1 left) 2026-02-13T20:26:20.759 INFO:tasks.rados.rados.0.trial188.stdout:3345: done (0 left) 2026-02-13T20:26:20.760 INFO:tasks.rados.rados.0.trial188.stdout:3346: delete oid 5 current snap is 348 2026-02-13T20:26:20.761 INFO:tasks.rados.rados.0.trial188.stdout:3346: done (0 left) 2026-02-13T20:26:20.761 INFO:tasks.rados.rados.0.trial188.stdout:3347: write (excl) oid 14 current snap is 348 2026-02-13T20:26:20.761 INFO:tasks.rados.rados.0.trial188.stdout:3347: seq_num 1158 ranges {662506=423998,1563560=539407,2717355=490285} 2026-02-13T20:26:20.765 INFO:tasks.rados.rados.0.trial188.stdout:3347: writing trial18843701-14 from 662506 to 1086504 tid 1 2026-02-13T20:26:20.769 INFO:tasks.rados.rados.0.trial188.stdout:3347: writing trial18843701-14 from 1563560 to 2102967 tid 2 2026-02-13T20:26:20.773 INFO:tasks.rados.rados.0.trial188.stdout:3347: writing trial18843701-14 from 2717355 to 3207640 tid 3 2026-02-13T20:26:20.773 INFO:tasks.rados.rados.0.trial188.stdout:3348: snap_create 2026-02-13T20:26:20.786 INFO:tasks.rados.rados.0.trial188.stdout:3347: finishing write tid 1 to trial18843701-14 2026-02-13T20:26:20.787 INFO:tasks.rados.rados.0.trial188.stdout:3347: finishing write tid 2 to trial18843701-14 2026-02-13T20:26:20.788 INFO:tasks.rados.rados.0.trial188.stdout:3347: finishing write tid 3 to trial18843701-14 2026-02-13T20:26:20.788 INFO:tasks.rados.rados.0.trial188.stdout:3347: finishing write tid 4 to trial18843701-14 2026-02-13T20:26:20.788 INFO:tasks.rados.rados.0.trial188.stdout:3347: finishing write tid 5 to trial18843701-14 2026-02-13T20:26:20.789 INFO:tasks.rados.rados.0.trial188.stdout:3347: oid 14 updating version 0 to 1515 2026-02-13T20:26:20.789 INFO:tasks.rados.rados.0.trial188.stdout:3347: oid 14 version 1515 is already newer than 1512 2026-02-13T20:26:20.789 INFO:tasks.rados.rados.0.trial188.stdout:3347: oid 14 version 1515 is already newer than 1513 2026-02-13T20:26:20.789 INFO:tasks.rados.rados.0.trial188.stdout:3347: oid 14 version 1515 is already newer than 1514 2026-02-13T20:26:20.789 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 14 v 1515 (ObjNum 1158 snap 348 seq_num 1158) dirty exists 2026-02-13T20:26:20.789 INFO:tasks.rados.rados.0.trial188.stdout:3347: left oid 14 (ObjNum 1158 snap 348 seq_num 1158) 2026-02-13T20:26:21.760 INFO:tasks.rados.rados.0.trial188.stdout:3347: done (1 left) 2026-02-13T20:26:21.760 INFO:tasks.rados.rados.0.trial188.stdout:3348: done (0 left) 2026-02-13T20:26:21.761 INFO:tasks.rados.rados.0.trial188.stdout:3349: read oid 35 snap -1 2026-02-13T20:26:21.761 INFO:tasks.rados.rados.0.trial188.stdout:3349: expect (ObjNum 1151 snap 347 seq_num 1151) 2026-02-13T20:26:21.761 INFO:tasks.rados.rados.0.trial188.stdout:3350: write oid 36 current snap is 349 2026-02-13T20:26:21.761 INFO:tasks.rados.rados.0.trial188.stdout:3350: seq_num 1159 ranges {679313=499247,1622042=683065,2744778=701557} 2026-02-13T20:26:21.765 INFO:tasks.rados.rados.0.trial188.stdout:3350: writing trial18843701-36 from 679313 to 1178560 tid 1 2026-02-13T20:26:21.769 INFO:tasks.rados.rados.0.trial188.stdout:3350: writing trial18843701-36 from 1622042 to 2305107 tid 2 2026-02-13T20:26:21.774 INFO:tasks.rados.rados.0.trial188.stdout:3350: writing trial18843701-36 from 2744778 to 3446335 tid 3 2026-02-13T20:26:21.774 INFO:tasks.rados.rados.0.trial188.stdout:3351: rollback oid 23 current snap is 349 2026-02-13T20:26:21.774 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 23 to 344 2026-02-13T20:26:21.774 INFO:tasks.rados.rados.0.trial188.stdout:3349: expect (ObjNum 1151 snap 347 seq_num 1151) 2026-02-13T20:26:21.774 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:26:21.812 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1467642 2026-02-13T20:26:21.844 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1875384 2026-02-13T20:26:21.859 INFO:tasks.rados.rados.0.trial188.stdout:3350: finishing write tid 1 to trial18843701-36 2026-02-13T20:26:21.859 INFO:tasks.rados.rados.0.trial188.stdout:3350: finishing write tid 2 to trial18843701-36 2026-02-13T20:26:21.859 INFO:tasks.rados.rados.0.trial188.stdout:3350: finishing write tid 3 to trial18843701-36 2026-02-13T20:26:21.859 INFO:tasks.rados.rados.0.trial188.stdout:3350: finishing write tid 4 to trial18843701-36 2026-02-13T20:26:21.859 INFO:tasks.rados.rados.0.trial188.stdout:3349: done (2 left) 2026-02-13T20:26:21.859 INFO:tasks.rados.rados.0.trial188.stdout:3352: snap_remove snap 343 2026-02-13T20:26:22.766 INFO:tasks.rados.rados.0.trial188.stdout:3352: done (2 left) 2026-02-13T20:26:22.766 INFO:tasks.rados.rados.0.trial188.stdout:3353: delete oid 45 current snap is 349 2026-02-13T20:26:22.766 INFO:tasks.rados.rados.0.trial188.stdout:3350: finishing write tid 5 to trial18843701-36 2026-02-13T20:26:22.767 INFO:tasks.rados.rados.0.trial188.stdout:3350: oid 36 updating version 0 to 1641 2026-02-13T20:26:22.767 INFO:tasks.rados.rados.0.trial188.stdout:3350: oid 36 version 1641 is already newer than 1639 2026-02-13T20:26:22.767 INFO:tasks.rados.rados.0.trial188.stdout:3350: oid 36 updating version 1641 to 1642 2026-02-13T20:26:22.767 INFO:tasks.rados.rados.0.trial188.stdout:3350: oid 36 version 1642 is already newer than 1640 2026-02-13T20:26:22.767 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 36 v 1642 (ObjNum 1159 snap 349 seq_num 1159) dirty exists 2026-02-13T20:26:22.767 INFO:tasks.rados.rados.0.trial188.stdout:3350: left oid 36 (ObjNum 1159 snap 349 seq_num 1159) 2026-02-13T20:26:22.767 INFO:tasks.rados.rados.0.trial188.stdout:3351: finishing rollback tid 0 to trial18843701-23 2026-02-13T20:26:22.767 INFO:tasks.rados.rados.0.trial188.stdout:3351: finishing rollback tid 1 to trial18843701-23 2026-02-13T20:26:22.767 INFO:tasks.rados.rados.0.trial188.stdout:3351: finishing rollback tid 2 to trial18843701-23 2026-02-13T20:26:22.767 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 23 v 1646 (ObjNum 1109 snap 328 seq_num 1109) dirty exists 2026-02-13T20:26:22.769 INFO:tasks.rados.rados.0.trial188.stdout:3350: done (2 left) 2026-02-13T20:26:22.769 INFO:tasks.rados.rados.0.trial188.stdout:3351: done (1 left) 2026-02-13T20:26:22.769 INFO:tasks.rados.rados.0.trial188.stdout:3353: done (0 left) 2026-02-13T20:26:22.769 INFO:tasks.rados.rados.0.trial188.stdout:3354: snap_create 2026-02-13T20:26:23.740 INFO:tasks.rados.rados.0.trial188.stdout:3354: done (0 left) 2026-02-13T20:26:23.740 INFO:tasks.rados.rados.0.trial188.stdout:3355: snap_create 2026-02-13T20:26:24.741 INFO:tasks.rados.rados.0.trial188.stdout:3355: done (0 left) 2026-02-13T20:26:24.741 INFO:tasks.rados.rados.0.trial188.stdout:3356: snap_create 2026-02-13T20:26:25.742 INFO:tasks.rados.rados.0.trial188.stdout:3356: done (0 left) 2026-02-13T20:26:25.743 INFO:tasks.rados.rados.0.trial188.stdout:3357: read oid 19 snap -1 2026-02-13T20:26:25.743 INFO:tasks.rados.rados.0.trial188.stdout:3357: expect (ObjNum 1150 snap 347 seq_num 1150) 2026-02-13T20:26:25.743 INFO:tasks.rados.rados.0.trial188.stdout:3358: snap_remove snap 344 2026-02-13T20:26:26.745 INFO:tasks.rados.rados.0.trial188.stdout:3358: done (1 left) 2026-02-13T20:26:26.745 INFO:tasks.rados.rados.0.trial188.stdout:3359: snap_create 2026-02-13T20:26:26.745 INFO:tasks.rados.rados.0.trial188.stdout:3357: expect (ObjNum 1150 snap 347 seq_num 1150) 2026-02-13T20:26:26.746 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:26:26.790 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1812057 2026-02-13T20:26:27.745 INFO:tasks.rados.rados.0.trial188.stdout:3357: done (1 left) 2026-02-13T20:26:27.745 INFO:tasks.rados.rados.0.trial188.stdout:3359: done (0 left) 2026-02-13T20:26:27.745 INFO:tasks.rados.rados.0.trial188.stdout:3360: copy_from oid 11 from oid 41 current snap is 353 2026-02-13T20:26:27.745 INFO:tasks.rados.rados.0.trial188.stdout:3361: read oid 23 snap -1 2026-02-13T20:26:27.745 INFO:tasks.rados.rados.0.trial188.stdout:3361: expect (ObjNum 1109 snap 328 seq_num 1109) 2026-02-13T20:26:27.745 INFO:tasks.rados.rados.0.trial188.stdout:3362: rollback oid 17 current snap is 353 2026-02-13T20:26:27.745 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 17 to 340 2026-02-13T20:26:27.745 INFO:tasks.rados.rados.0.trial188.stdout:3363: snap_create 2026-02-13T20:26:27.750 INFO:tasks.rados.rados.0.trial188.stdout:3362: finishing rollback tid 0 to trial18843701-17 2026-02-13T20:26:27.750 INFO:tasks.rados.rados.0.trial188.stdout:3362: finishing rollback tid 1 to trial18843701-17 2026-02-13T20:26:27.750 INFO:tasks.rados.rados.0.trial188.stdout:3362: finishing rollback tid 2 to trial18843701-17 2026-02-13T20:26:27.751 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 17 v 1500 (ObjNum 1127 snap 339 seq_num 1127) dirty exists 2026-02-13T20:26:27.751 INFO:tasks.rados.rados.0.trial188.stdout:3361: expect (ObjNum 1109 snap 328 seq_num 1109) 2026-02-13T20:26:27.769 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2570335 2026-02-13T20:26:27.779 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1975945 2026-02-13T20:26:27.792 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:26:27.818 INFO:tasks.rados.rados.0.trial188.stdout:3360: finishing copy_from racing read to trial18843701-11 2026-02-13T20:26:27.818 INFO:tasks.rados.rados.0.trial188.stdout:3360: finishing copy_from to trial18843701-11 2026-02-13T20:26:27.819 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 11 v 1475 (ObjNum 1145 snap 346 seq_num 1145) dirty exists 2026-02-13T20:26:28.742 INFO:tasks.rados.rados.0.trial188.stdout:3360: done (3 left) 2026-02-13T20:26:28.742 INFO:tasks.rados.rados.0.trial188.stdout:3361: done (2 left) 2026-02-13T20:26:28.742 INFO:tasks.rados.rados.0.trial188.stdout:3362: done (1 left) 2026-02-13T20:26:28.742 INFO:tasks.rados.rados.0.trial188.stdout:3363: done (0 left) 2026-02-13T20:26:28.742 INFO:tasks.rados.rados.0.trial188.stdout:3364: write (excl) oid 41 current snap is 354 2026-02-13T20:26:28.743 INFO:tasks.rados.rados.0.trial188.stdout:3364: seq_num 1161 ranges {712927=649745,2139006=686734} 2026-02-13T20:26:28.746 INFO:tasks.rados.rados.0.trial188.stdout:3364: writing trial18843701-41 from 712927 to 1362672 tid 1 2026-02-13T20:26:28.752 INFO:tasks.rados.rados.0.trial188.stdout:3364: writing trial18843701-41 from 2139006 to 2825740 tid 2 2026-02-13T20:26:28.752 INFO:tasks.rados.rados.0.trial188.stdout:3365: write oid 26 current snap is 354 2026-02-13T20:26:28.753 INFO:tasks.rados.rados.0.trial188.stdout:3365: seq_num 1162 ranges {729734=724994,2197488=430392,3227047=302687} 2026-02-13T20:26:28.757 INFO:tasks.rados.rados.0.trial188.stdout:3365: writing trial18843701-26 from 729734 to 1454728 tid 1 2026-02-13T20:26:28.762 INFO:tasks.rados.rados.0.trial188.stdout:3365: writing trial18843701-26 from 2197488 to 2627880 tid 2 2026-02-13T20:26:28.765 INFO:tasks.rados.rados.0.trial188.stdout:3365: writing trial18843701-26 from 3227047 to 3529734 tid 3 2026-02-13T20:26:28.765 INFO:tasks.rados.rados.0.trial188.stdout:3366: delete oid 6 current snap is 354 2026-02-13T20:26:28.773 INFO:tasks.rados.rados.0.trial188.stdout:3364: finishing write tid 1 to trial18843701-41 2026-02-13T20:26:28.773 INFO:tasks.rados.rados.0.trial188.stdout:3364: finishing write tid 2 to trial18843701-41 2026-02-13T20:26:28.773 INFO:tasks.rados.rados.0.trial188.stdout:3364: finishing write tid 3 to trial18843701-41 2026-02-13T20:26:28.773 INFO:tasks.rados.rados.0.trial188.stdout:3364: finishing write tid 4 to trial18843701-41 2026-02-13T20:26:28.773 INFO:tasks.rados.rados.0.trial188.stdout:3364: oid 41 updating version 0 to 1482 2026-02-13T20:26:28.773 INFO:tasks.rados.rados.0.trial188.stdout:3364: oid 41 version 1482 is already newer than 1481 2026-02-13T20:26:28.773 INFO:tasks.rados.rados.0.trial188.stdout:3364: oid 41 version 1482 is already newer than 1480 2026-02-13T20:26:28.773 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 41 v 1482 (ObjNum 1161 snap 354 seq_num 1161) dirty exists 2026-02-13T20:26:28.774 INFO:tasks.rados.rados.0.trial188.stdout:3364: left oid 41 (ObjNum 1161 snap 354 seq_num 1161) 2026-02-13T20:26:28.781 INFO:tasks.rados.rados.0.trial188.stdout:3365: finishing write tid 1 to trial18843701-26 2026-02-13T20:26:28.781 INFO:tasks.rados.rados.0.trial188.stdout:3365: finishing write tid 2 to trial18843701-26 2026-02-13T20:26:28.782 INFO:tasks.rados.rados.0.trial188.stdout:3365: finishing write tid 3 to trial18843701-26 2026-02-13T20:26:28.782 INFO:tasks.rados.rados.0.trial188.stdout:3365: finishing write tid 4 to trial18843701-26 2026-02-13T20:26:28.782 INFO:tasks.rados.rados.0.trial188.stdout:3365: finishing write tid 5 to trial18843701-26 2026-02-13T20:26:28.783 INFO:tasks.rados.rados.0.trial188.stdout:3365: oid 26 updating version 0 to 1519 2026-02-13T20:26:28.783 INFO:tasks.rados.rados.0.trial188.stdout:3365: oid 26 version 1519 is already newer than 1516 2026-02-13T20:26:28.783 INFO:tasks.rados.rados.0.trial188.stdout:3365: oid 26 version 1519 is already newer than 1517 2026-02-13T20:26:28.783 INFO:tasks.rados.rados.0.trial188.stdout:3365: oid 26 version 1519 is already newer than 1518 2026-02-13T20:26:28.783 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 26 v 1519 (ObjNum 1162 snap 354 seq_num 1162) dirty exists 2026-02-13T20:26:28.783 INFO:tasks.rados.rados.0.trial188.stdout:3365: left oid 26 (ObjNum 1162 snap 354 seq_num 1162) 2026-02-13T20:26:28.783 INFO:tasks.rados.rados.0.trial188.stdout:3364: done (2 left) 2026-02-13T20:26:28.784 INFO:tasks.rados.rados.0.trial188.stdout:3365: done (1 left) 2026-02-13T20:26:28.784 INFO:tasks.rados.rados.0.trial188.stdout:3366: done (0 left) 2026-02-13T20:26:28.784 INFO:tasks.rados.rados.0.trial188.stdout:3367: snap_remove snap 350 2026-02-13T20:26:29.749 INFO:tasks.rados.rados.0.trial188.stdout:3367: done (0 left) 2026-02-13T20:26:29.749 INFO:tasks.rados.rados.0.trial188.stdout:3368: write oid 49 current snap is 354 2026-02-13T20:26:29.749 INFO:tasks.rados.rados.0.trial188.stdout:3368: seq_num 1164 ranges {763348=591845,1914452=434061,2881893=674270} 2026-02-13T20:26:29.754 INFO:tasks.rados.rados.0.trial188.stdout:3368: writing trial18843701-49 from 763348 to 1355193 tid 1 2026-02-13T20:26:29.757 INFO:tasks.rados.rados.0.trial188.stdout:3368: writing trial18843701-49 from 1914452 to 2348513 tid 2 2026-02-13T20:26:29.762 INFO:tasks.rados.rados.0.trial188.stdout:3368: writing trial18843701-49 from 2881893 to 3556163 tid 3 2026-02-13T20:26:29.762 INFO:tasks.rados.rados.0.trial188.stdout:3369: write oid 4 current snap is 354 2026-02-13T20:26:29.762 INFO:tasks.rados.rados.0.trial188.stdout:3369: seq_num 1165 ranges {780155=667094,1972934=694072,3309316=270839} 2026-02-13T20:26:29.768 INFO:tasks.rados.rados.0.trial188.stdout:3369: writing trial18843701-4 from 780155 to 1447249 tid 1 2026-02-13T20:26:29.773 INFO:tasks.rados.rados.0.trial188.stdout:3369: writing trial18843701-4 from 1972934 to 2667006 tid 2 2026-02-13T20:26:29.777 INFO:tasks.rados.rados.0.trial188.stdout:3369: writing trial18843701-4 from 3309316 to 3580155 tid 3 2026-02-13T20:26:29.777 INFO:tasks.rados.rados.0.trial188.stdout:3370: snap_remove snap 352 2026-02-13T20:26:30.752 INFO:tasks.rados.rados.0.trial188.stdout:3370: done (2 left) 2026-02-13T20:26:30.753 INFO:tasks.rados.rados.0.trial188.stdout:3371: read oid 37 snap 342 2026-02-13T20:26:30.753 INFO:tasks.rados.rados.0.trial188.stdout:3371: expect (ObjNum 1004 snap 299 seq_num 1004) 2026-02-13T20:26:30.753 INFO:tasks.rados.rados.0.trial188.stdout:3372: write (excl) oid 46 current snap is 354 2026-02-13T20:26:30.753 INFO:tasks.rados.rados.0.trial188.stdout:3372: seq_num 1166 ranges {796962=742343,2031416=437730,2936739=413167} 2026-02-13T20:26:30.758 INFO:tasks.rados.rados.0.trial188.stdout:3372: writing trial18843701-46 from 796962 to 1539305 tid 1 2026-02-13T20:26:30.761 INFO:tasks.rados.rados.0.trial188.stdout:3372: writing trial18843701-46 from 2031416 to 2469146 tid 2 2026-02-13T20:26:30.765 INFO:tasks.rados.rados.0.trial188.stdout:3372: writing trial18843701-46 from 2936739 to 3349906 tid 3 2026-02-13T20:26:30.765 INFO:tasks.rados.rados.0.trial188.stdout:3373: snap_remove snap 353 2026-02-13T20:26:31.756 INFO:tasks.rados.rados.0.trial188.stdout:3373: done (4 left) 2026-02-13T20:26:31.757 INFO:tasks.rados.rados.0.trial188.stdout:3374: read oid 31 snap -1 2026-02-13T20:26:31.757 INFO:tasks.rados.rados.0.trial188.stdout:3374: expect deleted 2026-02-13T20:26:31.757 INFO:tasks.rados.rados.0.trial188.stdout:3375: write oid 38 current snap is 354 2026-02-13T20:26:31.757 INFO:tasks.rados.rados.0.trial188.stdout:3375: seq_num 1167 ranges {413769=417592,1573545=697741,2847809=624439} 2026-02-13T20:26:31.759 INFO:tasks.rados.rados.0.trial188.stdout:3375: writing trial18843701-38 from 413769 to 831361 tid 1 2026-02-13T20:26:31.765 INFO:tasks.rados.rados.0.trial188.stdout:3375: writing trial18843701-38 from 1573545 to 2271286 tid 2 2026-02-13T20:26:31.775 INFO:tasks.rados.rados.0.trial188.stdout:3375: writing trial18843701-38 from 2847809 to 3472248 tid 3 2026-02-13T20:26:31.775 INFO:tasks.rados.rados.0.trial188.stdout:3376: snap_create 2026-02-13T20:26:31.775 INFO:tasks.rados.rados.0.trial188.stdout:3368: finishing write tid 1 to trial18843701-49 2026-02-13T20:26:31.775 INFO:tasks.rados.rados.0.trial188.stdout:3368: finishing write tid 2 to trial18843701-49 2026-02-13T20:26:31.775 INFO:tasks.rados.rados.0.trial188.stdout:3368: finishing write tid 3 to trial18843701-49 2026-02-13T20:26:31.775 INFO:tasks.rados.rados.0.trial188.stdout:3368: finishing write tid 4 to trial18843701-49 2026-02-13T20:26:31.775 INFO:tasks.rados.rados.0.trial188.stdout:3368: finishing write tid 5 to trial18843701-49 2026-02-13T20:26:31.775 INFO:tasks.rados.rados.0.trial188.stdout:3368: oid 49 updating version 0 to 1601 2026-02-13T20:26:31.776 INFO:tasks.rados.rados.0.trial188.stdout:3368: oid 49 version 1601 is already newer than 1600 2026-02-13T20:26:31.776 INFO:tasks.rados.rados.0.trial188.stdout:3368: oid 49 updating version 1601 to 1602 2026-02-13T20:26:31.776 INFO:tasks.rados.rados.0.trial188.stdout:3368: oid 49 updating version 1602 to 1603 2026-02-13T20:26:31.776 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 49 v 1603 (ObjNum 1164 snap 354 seq_num 1164) dirty exists 2026-02-13T20:26:31.776 INFO:tasks.rados.rados.0.trial188.stdout:3368: left oid 49 (ObjNum 1164 snap 354 seq_num 1164) 2026-02-13T20:26:31.776 INFO:tasks.rados.rados.0.trial188.stdout:3369: finishing write tid 1 to trial18843701-4 2026-02-13T20:26:31.776 INFO:tasks.rados.rados.0.trial188.stdout:3369: finishing write tid 2 to trial18843701-4 2026-02-13T20:26:31.776 INFO:tasks.rados.rados.0.trial188.stdout:3369: finishing write tid 3 to trial18843701-4 2026-02-13T20:26:31.776 INFO:tasks.rados.rados.0.trial188.stdout:3369: finishing write tid 4 to trial18843701-4 2026-02-13T20:26:31.776 INFO:tasks.rados.rados.0.trial188.stdout:3369: finishing write tid 5 to trial18843701-4 2026-02-13T20:26:31.776 INFO:tasks.rados.rados.0.trial188.stdout:3369: oid 4 updating version 0 to 1560 2026-02-13T20:26:31.776 INFO:tasks.rados.rados.0.trial188.stdout:3369: oid 4 updating version 1560 to 1562 2026-02-13T20:26:31.777 INFO:tasks.rados.rados.0.trial188.stdout:3369: oid 4 version 1562 is already newer than 1561 2026-02-13T20:26:31.777 INFO:tasks.rados.rados.0.trial188.stdout:3369: oid 4 updating version 1562 to 1563 2026-02-13T20:26:31.777 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 4 v 1563 (ObjNum 1165 snap 354 seq_num 1165) dirty exists 2026-02-13T20:26:31.777 INFO:tasks.rados.rados.0.trial188.stdout:3369: left oid 4 (ObjNum 1165 snap 354 seq_num 1165) 2026-02-13T20:26:31.777 INFO:tasks.rados.rados.0.trial188.stdout:3371: expect (ObjNum 1004 snap 299 seq_num 1004) 2026-02-13T20:26:31.791 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1818291 2026-02-13T20:26:31.825 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:26:31.883 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 134850 2026-02-13T20:26:31.939 INFO:tasks.rados.rados.0.trial188.stdout:3372: finishing write tid 1 to trial18843701-46 2026-02-13T20:26:31.939 INFO:tasks.rados.rados.0.trial188.stdout:3372: finishing write tid 2 to trial18843701-46 2026-02-13T20:26:31.940 INFO:tasks.rados.rados.0.trial188.stdout:3372: finishing write tid 3 to trial18843701-46 2026-02-13T20:26:31.940 INFO:tasks.rados.rados.0.trial188.stdout:3372: finishing write tid 4 to trial18843701-46 2026-02-13T20:26:31.940 INFO:tasks.rados.rados.0.trial188.stdout:3372: finishing write tid 5 to trial18843701-46 2026-02-13T20:26:31.940 INFO:tasks.rados.rados.0.trial188.stdout:3372: oid 46 updating version 0 to 1483 2026-02-13T20:26:31.940 INFO:tasks.rados.rados.0.trial188.stdout:3372: oid 46 updating version 1483 to 1486 2026-02-13T20:26:31.940 INFO:tasks.rados.rados.0.trial188.stdout:3372: oid 46 version 1486 is already newer than 1485 2026-02-13T20:26:31.940 INFO:tasks.rados.rados.0.trial188.stdout:3372: oid 46 version 1486 is already newer than 1484 2026-02-13T20:26:31.940 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 46 v 1486 (ObjNum 1166 snap 354 seq_num 1166) dirty exists 2026-02-13T20:26:31.940 INFO:tasks.rados.rados.0.trial188.stdout:3372: left oid 46 (ObjNum 1166 snap 354 seq_num 1166) 2026-02-13T20:26:31.940 INFO:tasks.rados.rados.0.trial188.stdout:3375: finishing write tid 1 to trial18843701-38 2026-02-13T20:26:31.940 INFO:tasks.rados.rados.0.trial188.stdout:3375: finishing write tid 2 to trial18843701-38 2026-02-13T20:26:31.941 INFO:tasks.rados.rados.0.trial188.stdout:3375: finishing write tid 3 to trial18843701-38 2026-02-13T20:26:31.941 INFO:tasks.rados.rados.0.trial188.stdout:3375: finishing write tid 4 to trial18843701-38 2026-02-13T20:26:31.941 INFO:tasks.rados.rados.0.trial188.stdout:3375: finishing write tid 5 to trial18843701-38 2026-02-13T20:26:31.941 INFO:tasks.rados.rados.0.trial188.stdout:3375: oid 38 updating version 0 to 1604 2026-02-13T20:26:31.941 INFO:tasks.rados.rados.0.trial188.stdout:3375: oid 38 updating version 1604 to 1606 2026-02-13T20:26:31.941 INFO:tasks.rados.rados.0.trial188.stdout:3375: oid 38 version 1606 is already newer than 1605 2026-02-13T20:26:31.941 INFO:tasks.rados.rados.0.trial188.stdout:3375: oid 38 updating version 1606 to 1607 2026-02-13T20:26:31.941 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 38 v 1607 (ObjNum 1167 snap 354 seq_num 1167) dirty exists 2026-02-13T20:26:31.941 INFO:tasks.rados.rados.0.trial188.stdout:3375: left oid 38 (ObjNum 1167 snap 354 seq_num 1167) 2026-02-13T20:26:32.760 INFO:tasks.rados.rados.0.trial188.stdout:3368: done (6 left) 2026-02-13T20:26:32.760 INFO:tasks.rados.rados.0.trial188.stdout:3369: done (5 left) 2026-02-13T20:26:32.760 INFO:tasks.rados.rados.0.trial188.stdout:3371: done (4 left) 2026-02-13T20:26:32.760 INFO:tasks.rados.rados.0.trial188.stdout:3372: done (3 left) 2026-02-13T20:26:32.761 INFO:tasks.rados.rados.0.trial188.stdout:3374: done (2 left) 2026-02-13T20:26:32.761 INFO:tasks.rados.rados.0.trial188.stdout:3375: done (1 left) 2026-02-13T20:26:32.761 INFO:tasks.rados.rados.0.trial188.stdout:3376: done (0 left) 2026-02-13T20:26:32.761 INFO:tasks.rados.rados.0.trial188.stdout:3377: read oid 25 snap -1 2026-02-13T20:26:32.761 INFO:tasks.rados.rados.0.trial188.stdout:3377: expect (ObjNum 1049 snap 314 seq_num 1049) 2026-02-13T20:26:32.761 INFO:tasks.rados.rados.0.trial188.stdout:3378: snap_create 2026-02-13T20:26:32.772 INFO:tasks.rados.rados.0.trial188.stdout:3377: expect (ObjNum 1049 snap 314 seq_num 1049) 2026-02-13T20:26:32.803 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2085974 2026-02-13T20:26:32.819 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 629978 2026-02-13T20:26:33.742 INFO:tasks.rados.rados.0.trial188.stdout:3377: done (1 left) 2026-02-13T20:26:33.743 INFO:tasks.rados.rados.0.trial188.stdout:3378: done (0 left) 2026-02-13T20:26:33.743 INFO:tasks.rados.rados.0.trial188.stdout:3379: copy_from oid 29 from oid 42 current snap is 356 2026-02-13T20:26:33.743 INFO:tasks.rados.rados.0.trial188.stdout:3380: snap_remove snap 339 2026-02-13T20:26:34.743 INFO:tasks.rados.rados.0.trial188.stdout:3380: done (1 left) 2026-02-13T20:26:34.743 INFO:tasks.rados.rados.0.trial188.stdout:3381: snap_create 2026-02-13T20:26:34.743 INFO:tasks.rados.rados.0.trial188.stdout:3379: finishing copy_from to trial18843701-29 2026-02-13T20:26:34.743 INFO:tasks.rados.rados.0.trial188.stdout:3379: got expected ENOENT (src dne) 2026-02-13T20:26:34.743 INFO:tasks.rados.rados.0.trial188.stdout:3379: finishing copy_from racing read to trial18843701-29 2026-02-13T20:26:35.743 INFO:tasks.rados.rados.0.trial188.stdout:3379: done (1 left) 2026-02-13T20:26:35.743 INFO:tasks.rados.rados.0.trial188.stdout:3381: done (0 left) 2026-02-13T20:26:35.743 INFO:tasks.rados.rados.0.trial188.stdout:3382: read oid 22 snap -1 2026-02-13T20:26:35.743 INFO:tasks.rados.rados.0.trial188.stdout:3382: expect (ObjNum 1007 snap 299 seq_num 1007) 2026-02-13T20:26:35.743 INFO:tasks.rados.rados.0.trial188.stdout:3383: write oid 5 current snap is 357 2026-02-13T20:26:35.743 INFO:tasks.rados.rados.0.trial188.stdout:3383: seq_num 1168 ranges {430576=492841,1632027=441399,2475232=435711,3365397=265179} 2026-02-13T20:26:35.746 INFO:tasks.rados.rados.0.trial188.stdout:3383: writing trial18843701-5 from 430576 to 923417 tid 1 2026-02-13T20:26:35.750 INFO:tasks.rados.rados.0.trial188.stdout:3383: writing trial18843701-5 from 1632027 to 2073426 tid 2 2026-02-13T20:26:35.754 INFO:tasks.rados.rados.0.trial188.stdout:3383: writing trial18843701-5 from 2475232 to 2910943 tid 3 2026-02-13T20:26:35.757 INFO:tasks.rados.rados.0.trial188.stdout:3383: writing trial18843701-5 from 3365397 to 3630576 tid 4 2026-02-13T20:26:35.757 INFO:tasks.rados.rados.0.trial188.stdout:3384: read oid 18 snap 328 2026-02-13T20:26:35.757 INFO:tasks.rados.rados.0.trial188.stdout:3384: expect deleted 2026-02-13T20:26:35.757 INFO:tasks.rados.rados.0.trial188.stdout:3385: read oid 20 snap -1 2026-02-13T20:26:35.757 INFO:tasks.rados.rados.0.trial188.stdout:3385: expect deleted 2026-02-13T20:26:35.757 INFO:tasks.rados.rados.0.trial188.stdout:3386: read oid 26 snap -1 2026-02-13T20:26:35.757 INFO:tasks.rados.rados.0.trial188.stdout:3386: expect (ObjNum 1162 snap 354 seq_num 1162) 2026-02-13T20:26:35.757 INFO:tasks.rados.rados.0.trial188.stdout:3387: read oid 1 snap -1 2026-02-13T20:26:35.757 INFO:tasks.rados.rados.0.trial188.stdout:3387: expect (ObjNum 1106 snap 326 seq_num 1106) 2026-02-13T20:26:35.757 INFO:tasks.rados.rados.0.trial188.stdout:3388: read oid 16 snap 349 2026-02-13T20:26:35.757 INFO:tasks.rados.rados.0.trial188.stdout:3388: expect (ObjNum 1121 snap 334 seq_num 1121) 2026-02-13T20:26:35.757 INFO:tasks.rados.rados.0.trial188.stdout:3389: write oid 45 current snap is 357 2026-02-13T20:26:35.757 INFO:tasks.rados.rados.0.trial188.stdout:3389: seq_num 1169 ranges {447383=568090,1690509=701410,2902655=646983} 2026-02-13T20:26:35.761 INFO:tasks.rados.rados.0.trial188.stdout:3389: writing trial18843701-45 from 447383 to 1015473 tid 1 2026-02-13T20:26:35.766 INFO:tasks.rados.rados.0.trial188.stdout:3389: writing trial18843701-45 from 1690509 to 2391919 tid 2 2026-02-13T20:26:35.771 INFO:tasks.rados.rados.0.trial188.stdout:3389: writing trial18843701-45 from 2902655 to 3549638 tid 3 2026-02-13T20:26:35.771 INFO:tasks.rados.rados.0.trial188.stdout:3390: read oid 29 snap -1 2026-02-13T20:26:35.771 INFO:tasks.rados.rados.0.trial188.stdout:3390: expect (ObjNum 1049 snap 314 seq_num 1049) 2026-02-13T20:26:35.771 INFO:tasks.rados.rados.0.trial188.stdout:3391: snap_remove snap 345 2026-02-13T20:26:36.749 INFO:tasks.rados.rados.0.trial188.stdout:3391: done (9 left) 2026-02-13T20:26:36.749 INFO:tasks.rados.rados.0.trial188.stdout:3392: snap_create 2026-02-13T20:26:36.749 INFO:tasks.rados.rados.0.trial188.stdout:3382: expect (ObjNum 1007 snap 299 seq_num 1007) 2026-02-13T20:26:36.778 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:26:36.833 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2858613 2026-02-13T20:26:36.837 INFO:tasks.rados.rados.0.trial188.stdout:3383: finishing write tid 1 to trial18843701-5 2026-02-13T20:26:36.838 INFO:tasks.rados.rados.0.trial188.stdout:3383: finishing write tid 2 to trial18843701-5 2026-02-13T20:26:36.838 INFO:tasks.rados.rados.0.trial188.stdout:3383: finishing write tid 3 to trial18843701-5 2026-02-13T20:26:36.838 INFO:tasks.rados.rados.0.trial188.stdout:3387: expect (ObjNum 1106 snap 326 seq_num 1106) 2026-02-13T20:26:36.838 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:26:36.863 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:26:36.888 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:26:36.914 INFO:tasks.rados.rados.0.trial188.stdout:3383: finishing write tid 4 to trial18843701-5 2026-02-13T20:26:36.914 INFO:tasks.rados.rados.0.trial188.stdout:3386: expect (ObjNum 1162 snap 354 seq_num 1162) 2026-02-13T20:26:36.914 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:26:37.025 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:26:37.086 INFO:tasks.rados.rados.0.trial188.stdout:3390: expect (ObjNum 1049 snap 314 seq_num 1049) 2026-02-13T20:26:37.143 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1730216 2026-02-13T20:26:37.156 INFO:tasks.rados.rados.0.trial188.stdout:3383: finishing write tid 5 to trial18843701-5 2026-02-13T20:26:37.156 INFO:tasks.rados.rados.0.trial188.stdout:3383: finishing write tid 6 to trial18843701-5 2026-02-13T20:26:37.156 INFO:tasks.rados.rados.0.trial188.stdout:3383: oid 5 updating version 0 to 1532 2026-02-13T20:26:37.156 INFO:tasks.rados.rados.0.trial188.stdout:3383: oid 5 version 1532 is already newer than 1531 2026-02-13T20:26:37.156 INFO:tasks.rados.rados.0.trial188.stdout:3383: oid 5 version 1532 is already newer than 1529 2026-02-13T20:26:37.156 INFO:tasks.rados.rados.0.trial188.stdout:3383: oid 5 updating version 1532 to 1533 2026-02-13T20:26:37.156 INFO:tasks.rados.rados.0.trial188.stdout:3383: oid 5 version 1533 is already newer than 1530 2026-02-13T20:26:37.156 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 5 v 1533 (ObjNum 1168 snap 357 seq_num 1168) dirty exists 2026-02-13T20:26:37.156 INFO:tasks.rados.rados.0.trial188.stdout:3383: left oid 5 (ObjNum 1168 snap 357 seq_num 1168) 2026-02-13T20:26:37.157 INFO:tasks.rados.rados.0.trial188.stdout:3388: expect (ObjNum 1121 snap 334 seq_num 1121) 2026-02-13T20:26:37.195 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:26:37.270 INFO:tasks.rados.rados.0.trial188.stdout:3389: finishing write tid 1 to trial18843701-45 2026-02-13T20:26:37.270 INFO:tasks.rados.rados.0.trial188.stdout:3389: finishing write tid 2 to trial18843701-45 2026-02-13T20:26:37.270 INFO:tasks.rados.rados.0.trial188.stdout:3389: finishing write tid 3 to trial18843701-45 2026-02-13T20:26:37.270 INFO:tasks.rados.rados.0.trial188.stdout:3389: finishing write tid 4 to trial18843701-45 2026-02-13T20:26:37.270 INFO:tasks.rados.rados.0.trial188.stdout:3389: finishing write tid 5 to trial18843701-45 2026-02-13T20:26:37.270 INFO:tasks.rados.rados.0.trial188.stdout:3389: oid 45 updating version 0 to 1629 2026-02-13T20:26:37.270 INFO:tasks.rados.rados.0.trial188.stdout:3389: oid 45 version 1629 is already newer than 1627 2026-02-13T20:26:37.270 INFO:tasks.rados.rados.0.trial188.stdout:3389: oid 45 version 1629 is already newer than 1626 2026-02-13T20:26:37.271 INFO:tasks.rados.rados.0.trial188.stdout:3389: oid 45 version 1629 is already newer than 1628 2026-02-13T20:26:37.271 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 45 v 1629 (ObjNum 1169 snap 357 seq_num 1169) dirty exists 2026-02-13T20:26:37.271 INFO:tasks.rados.rados.0.trial188.stdout:3389: left oid 45 (ObjNum 1169 snap 357 seq_num 1169) 2026-02-13T20:26:37.752 INFO:tasks.rados.rados.0.trial188.stdout:3382: done (9 left) 2026-02-13T20:26:37.753 INFO:tasks.rados.rados.0.trial188.stdout:3383: done (8 left) 2026-02-13T20:26:37.753 INFO:tasks.rados.rados.0.trial188.stdout:3384: done (7 left) 2026-02-13T20:26:37.753 INFO:tasks.rados.rados.0.trial188.stdout:3385: done (6 left) 2026-02-13T20:26:37.753 INFO:tasks.rados.rados.0.trial188.stdout:3386: done (5 left) 2026-02-13T20:26:37.753 INFO:tasks.rados.rados.0.trial188.stdout:3387: done (4 left) 2026-02-13T20:26:37.753 INFO:tasks.rados.rados.0.trial188.stdout:3388: done (3 left) 2026-02-13T20:26:37.753 INFO:tasks.rados.rados.0.trial188.stdout:3389: done (2 left) 2026-02-13T20:26:37.753 INFO:tasks.rados.rados.0.trial188.stdout:3390: done (1 left) 2026-02-13T20:26:37.753 INFO:tasks.rados.rados.0.trial188.stdout:3392: done (0 left) 2026-02-13T20:26:37.753 INFO:tasks.rados.rados.0.trial188.stdout:3393: snap_remove snap 354 2026-02-13T20:26:38.743 INFO:tasks.rados.rados.0.trial188.stdout:3393: done (0 left) 2026-02-13T20:26:38.743 INFO:tasks.rados.rados.0.trial188.stdout:3394: snap_create 2026-02-13T20:26:39.743 INFO:tasks.rados.rados.0.trial188.stdout:3394: done (0 left) 2026-02-13T20:26:39.744 INFO:tasks.rados.rados.0.trial188.stdout:3395: copy_from oid 19 from oid 3 current snap is 359 2026-02-13T20:26:39.744 INFO:tasks.rados.rados.0.trial188.stdout:3396: read oid 15 snap 334 2026-02-13T20:26:39.744 INFO:tasks.rados.rados.0.trial188.stdout:3396: expect (ObjNum 865 snap 250 seq_num 865) 2026-02-13T20:26:39.744 INFO:tasks.rados.rados.0.trial188.stdout:3397: snap_create 2026-02-13T20:26:39.751 INFO:tasks.rados.rados.0.trial188.stdout:3396: expect (ObjNum 865 snap 250 seq_num 865) 2026-02-13T20:26:39.896 INFO:tasks.rados.rados.0.trial188.stdout:3395: finishing copy_from racing read to trial18843701-19 2026-02-13T20:26:39.896 INFO:tasks.rados.rados.0.trial188.stdout:3395: finishing copy_from to trial18843701-19 2026-02-13T20:26:39.896 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 19 v 1511 (ObjNum 1131 snap 341 seq_num 1131) dirty exists 2026-02-13T20:26:40.744 INFO:tasks.rados.rados.0.trial188.stdout:3395: done (2 left) 2026-02-13T20:26:40.745 INFO:tasks.rados.rados.0.trial188.stdout:3396: done (1 left) 2026-02-13T20:26:40.745 INFO:tasks.rados.rados.0.trial188.stdout:3397: done (0 left) 2026-02-13T20:26:40.745 INFO:tasks.rados.rados.0.trial188.stdout:3398: write oid 20 current snap is 360 2026-02-13T20:26:40.745 INFO:tasks.rados.rados.0.trial188.stdout:3398: seq_num 1170 ranges {464190=643339,1748991=445068,2930078=574608} 2026-02-13T20:26:40.750 INFO:tasks.rados.rados.0.trial188.stdout:3398: writing trial18843701-20 from 464190 to 1107529 tid 1 2026-02-13T20:26:40.754 INFO:tasks.rados.rados.0.trial188.stdout:3398: writing trial18843701-20 from 1748991 to 2194059 tid 2 2026-02-13T20:26:40.759 INFO:tasks.rados.rados.0.trial188.stdout:3398: writing trial18843701-20 from 2930078 to 3504686 tid 3 2026-02-13T20:26:40.760 INFO:tasks.rados.rados.0.trial188.stdout:3399: copy_from oid 29 from oid 4 current snap is 360 2026-02-13T20:26:40.760 INFO:tasks.rados.rados.0.trial188.stdout:3400: write oid 17 current snap is 360 2026-02-13T20:26:40.760 INFO:tasks.rados.rados.0.trial188.stdout:3400: seq_num 1171 ranges {480997=434941,1407473=705079,2557501=785880} 2026-02-13T20:26:40.763 INFO:tasks.rados.rados.0.trial188.stdout:3400: writing trial18843701-17 from 480997 to 915938 tid 1 2026-02-13T20:26:40.767 INFO:tasks.rados.rados.0.trial188.stdout:3400: writing trial18843701-17 from 1407473 to 2112552 tid 2 2026-02-13T20:26:40.772 INFO:tasks.rados.rados.0.trial188.stdout:3400: writing trial18843701-17 from 2557501 to 3343381 tid 3 2026-02-13T20:26:40.772 INFO:tasks.rados.rados.0.trial188.stdout:3401: read oid 32 snap -1 2026-02-13T20:26:40.772 INFO:tasks.rados.rados.0.trial188.stdout:3401: expect (ObjNum 1156 snap 347 seq_num 1156) 2026-02-13T20:26:40.773 INFO:tasks.rados.rados.0.trial188.stdout:3402: write oid 16 current snap is 360 2026-02-13T20:26:40.773 INFO:tasks.rados.rados.0.trial188.stdout:3402: seq_num 1172 ranges {497804=510190,1465955=448737,2584924=597152} 2026-02-13T20:26:40.776 INFO:tasks.rados.rados.0.trial188.stdout:3402: writing trial18843701-16 from 497804 to 1007994 tid 1 2026-02-13T20:26:40.779 INFO:tasks.rados.rados.0.trial188.stdout:3402: writing trial18843701-16 from 1465955 to 1914692 tid 2 2026-02-13T20:26:40.784 INFO:tasks.rados.rados.0.trial188.stdout:3402: writing trial18843701-16 from 2584924 to 3182076 tid 3 2026-02-13T20:26:40.784 INFO:tasks.rados.rados.0.trial188.stdout:3403: rollback oid 47 current snap is 360 2026-02-13T20:26:40.785 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 47 to 358 2026-02-13T20:26:40.785 INFO:tasks.rados.rados.0.trial188.stdout:3398: finishing write tid 1 to trial18843701-20 2026-02-13T20:26:40.785 INFO:tasks.rados.rados.0.trial188.stdout:3398: finishing write tid 2 to trial18843701-20 2026-02-13T20:26:40.785 INFO:tasks.rados.rados.0.trial188.stdout:3398: finishing write tid 3 to trial18843701-20 2026-02-13T20:26:40.785 INFO:tasks.rados.rados.0.trial188.stdout:3398: finishing write tid 4 to trial18843701-20 2026-02-13T20:26:40.785 INFO:tasks.rados.rados.0.trial188.stdout:3398: finishing write tid 5 to trial18843701-20 2026-02-13T20:26:40.785 INFO:tasks.rados.rados.0.trial188.stdout:3398: oid 20 updating version 0 to 1251 2026-02-13T20:26:40.785 INFO:tasks.rados.rados.0.trial188.stdout:3398: oid 20 updating version 1251 to 1253 2026-02-13T20:26:40.785 INFO:tasks.rados.rados.0.trial188.stdout:3398: oid 20 version 1253 is already newer than 1252 2026-02-13T20:26:40.785 INFO:tasks.rados.rados.0.trial188.stdout:3398: oid 20 version 1253 is already newer than 1250 2026-02-13T20:26:40.785 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 20 v 1253 (ObjNum 1170 snap 360 seq_num 1170) dirty exists 2026-02-13T20:26:40.785 INFO:tasks.rados.rados.0.trial188.stdout:3398: left oid 20 (ObjNum 1170 snap 360 seq_num 1170) 2026-02-13T20:26:40.786 INFO:tasks.rados.rados.0.trial188.stdout:3401: expect (ObjNum 1156 snap 347 seq_num 1156) 2026-02-13T20:26:40.798 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2545549 2026-02-13T20:26:40.817 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1140213 2026-02-13T20:26:40.840 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:26:40.873 INFO:tasks.rados.rados.0.trial188.stdout:3403: finishing rollback tid 0 to trial18843701-47 2026-02-13T20:26:40.874 INFO:tasks.rados.rados.0.trial188.stdout:3403: finishing rollback tid 1 to trial18843701-47 2026-02-13T20:26:40.874 INFO:tasks.rados.rados.0.trial188.stdout:3403: finishing rollback tid 2 to trial18843701-47 2026-02-13T20:26:40.874 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 47 v 1098 (ObjNum 1007 snap 299 seq_num 1007) dirty exists 2026-02-13T20:26:40.874 INFO:tasks.rados.rados.0.trial188.stdout:3400: finishing write tid 1 to trial18843701-17 2026-02-13T20:26:40.874 INFO:tasks.rados.rados.0.trial188.stdout:3400: finishing write tid 2 to trial18843701-17 2026-02-13T20:26:40.874 INFO:tasks.rados.rados.0.trial188.stdout:3402: finishing write tid 1 to trial18843701-16 2026-02-13T20:26:40.874 INFO:tasks.rados.rados.0.trial188.stdout:3400: finishing write tid 3 to trial18843701-17 2026-02-13T20:26:40.874 INFO:tasks.rados.rados.0.trial188.stdout:3398: done (5 left) 2026-02-13T20:26:40.874 INFO:tasks.rados.rados.0.trial188.stdout:3401: done (4 left) 2026-02-13T20:26:40.874 INFO:tasks.rados.rados.0.trial188.stdout:3403: done (3 left) 2026-02-13T20:26:40.874 INFO:tasks.rados.rados.0.trial188.stdout:3404: snap_remove snap 328 2026-02-13T20:26:41.758 INFO:tasks.rados.rados.0.trial188.stdout:3404: done (3 left) 2026-02-13T20:26:41.758 INFO:tasks.rados.rados.0.trial188.stdout:3405: write (excl) oid 21 current snap is 360 2026-02-13T20:26:41.759 INFO:tasks.rados.rados.0.trial188.stdout:3405: seq_num 1173 ranges {514611=585439,1524437=592395,2895994=408424} 2026-02-13T20:26:41.762 INFO:tasks.rados.rados.0.trial188.stdout:3405: writing trial18843701-21 from 514611 to 1100050 tid 1 2026-02-13T20:26:41.766 INFO:tasks.rados.rados.0.trial188.stdout:3405: writing trial18843701-21 from 1524437 to 2116832 tid 2 2026-02-13T20:26:41.771 INFO:tasks.rados.rados.0.trial188.stdout:3405: writing trial18843701-21 from 2895994 to 3304418 tid 3 2026-02-13T20:26:41.771 INFO:tasks.rados.rados.0.trial188.stdout:3406: write (excl) oid 7 current snap is 360 2026-02-13T20:26:41.771 INFO:tasks.rados.rados.0.trial188.stdout:3406: seq_num 1174 ranges {531418=660688,1982919=452406,3039770=691648} 2026-02-13T20:26:41.775 INFO:tasks.rados.rados.0.trial188.stdout:3406: writing trial18843701-7 from 531418 to 1192106 tid 1 2026-02-13T20:26:41.780 INFO:tasks.rados.rados.0.trial188.stdout:3406: writing trial18843701-7 from 1982919 to 2435325 tid 2 2026-02-13T20:26:41.786 INFO:tasks.rados.rados.0.trial188.stdout:3406: writing trial18843701-7 from 3039770 to 3731418 tid 3 2026-02-13T20:26:41.786 INFO:tasks.rados.rados.0.trial188.stdout:3407: rollback oid 5 current snap is 360 2026-02-13T20:26:41.786 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 5 to 340 2026-02-13T20:26:41.786 INFO:tasks.rados.rados.0.trial188.stdout:3399: finishing copy_from to trial18843701-29 2026-02-13T20:26:41.786 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 29 v 1563 (ObjNum 1165 snap 354 seq_num 1165) dirty exists 2026-02-13T20:26:41.787 INFO:tasks.rados.rados.0.trial188.stdout:3400: finishing write tid 4 to trial18843701-17 2026-02-13T20:26:41.787 INFO:tasks.rados.rados.0.trial188.stdout:3400: finishing write tid 5 to trial18843701-17 2026-02-13T20:26:41.787 INFO:tasks.rados.rados.0.trial188.stdout:3400: oid 17 updating version 0 to 1501 2026-02-13T20:26:41.787 INFO:tasks.rados.rados.0.trial188.stdout:3400: oid 17 updating version 1501 to 1502 2026-02-13T20:26:41.787 INFO:tasks.rados.rados.0.trial188.stdout:3400: oid 17 updating version 1502 to 1504 2026-02-13T20:26:41.787 INFO:tasks.rados.rados.0.trial188.stdout:3400: oid 17 version 1504 is already newer than 1503 2026-02-13T20:26:41.787 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 17 v 1504 (ObjNum 1171 snap 360 seq_num 1171) dirty exists 2026-02-13T20:26:41.787 INFO:tasks.rados.rados.0.trial188.stdout:3400: left oid 17 (ObjNum 1171 snap 360 seq_num 1171) 2026-02-13T20:26:41.787 INFO:tasks.rados.rados.0.trial188.stdout:3402: finishing write tid 2 to trial18843701-16 2026-02-13T20:26:41.787 INFO:tasks.rados.rados.0.trial188.stdout:3399: finishing copy_from racing read to trial18843701-29 2026-02-13T20:26:41.787 INFO:tasks.rados.rados.0.trial188.stdout:3402: finishing write tid 3 to trial18843701-16 2026-02-13T20:26:41.787 INFO:tasks.rados.rados.0.trial188.stdout:3402: finishing write tid 4 to trial18843701-16 2026-02-13T20:26:41.787 INFO:tasks.rados.rados.0.trial188.stdout:3402: finishing write tid 5 to trial18843701-16 2026-02-13T20:26:41.788 INFO:tasks.rados.rados.0.trial188.stdout:3402: oid 16 updating version 0 to 1672 2026-02-13T20:26:41.788 INFO:tasks.rados.rados.0.trial188.stdout:3402: oid 16 updating version 1672 to 1673 2026-02-13T20:26:41.788 INFO:tasks.rados.rados.0.trial188.stdout:3402: oid 16 updating version 1673 to 1674 2026-02-13T20:26:41.788 INFO:tasks.rados.rados.0.trial188.stdout:3402: oid 16 version 1674 is already newer than 1671 2026-02-13T20:26:41.788 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 16 v 1674 (ObjNum 1172 snap 360 seq_num 1172) dirty exists 2026-02-13T20:26:41.788 INFO:tasks.rados.rados.0.trial188.stdout:3402: left oid 16 (ObjNum 1172 snap 360 seq_num 1172) 2026-02-13T20:26:41.788 INFO:tasks.rados.rados.0.trial188.stdout:3399: done (5 left) 2026-02-13T20:26:41.788 INFO:tasks.rados.rados.0.trial188.stdout:3400: done (4 left) 2026-02-13T20:26:41.788 INFO:tasks.rados.rados.0.trial188.stdout:3402: done (3 left) 2026-02-13T20:26:41.788 INFO:tasks.rados.rados.0.trial188.stdout:3408: snap_remove snap 356 2026-02-13T20:26:42.762 INFO:tasks.rados.rados.0.trial188.stdout:3408: done (3 left) 2026-02-13T20:26:42.763 INFO:tasks.rados.rados.0.trial188.stdout:3409: write oid 1 current snap is 360 2026-02-13T20:26:42.763 INFO:tasks.rados.rados.0.trial188.stdout:3409: seq_num 1175 ranges {548225=735937,1925048=596064,2950840=547321} 2026-02-13T20:26:42.767 INFO:tasks.rados.rados.0.trial188.stdout:3409: writing trial18843701-1 from 548225 to 1284162 tid 1 2026-02-13T20:26:42.772 INFO:tasks.rados.rados.0.trial188.stdout:3409: writing trial18843701-1 from 1925048 to 2521112 tid 2 2026-02-13T20:26:42.777 INFO:tasks.rados.rados.0.trial188.stdout:3409: writing trial18843701-1 from 2950840 to 3498161 tid 3 2026-02-13T20:26:42.777 INFO:tasks.rados.rados.0.trial188.stdout:3410: rollback oid 49 current snap is 360 2026-02-13T20:26:42.777 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 49 to 348 2026-02-13T20:26:42.777 INFO:tasks.rados.rados.0.trial188.stdout:3405: finishing write tid 1 to trial18843701-21 2026-02-13T20:26:42.777 INFO:tasks.rados.rados.0.trial188.stdout:3405: finishing write tid 2 to trial18843701-21 2026-02-13T20:26:42.777 INFO:tasks.rados.rados.0.trial188.stdout:3405: finishing write tid 3 to trial18843701-21 2026-02-13T20:26:42.777 INFO:tasks.rados.rados.0.trial188.stdout:3407: finishing rollback tid 0 to trial18843701-5 2026-02-13T20:26:42.777 INFO:tasks.rados.rados.0.trial188.stdout:3407: finishing rollback tid 1 to trial18843701-5 2026-02-13T20:26:42.778 INFO:tasks.rados.rados.0.trial188.stdout:3407: finishing rollback tid 2 to trial18843701-5 2026-02-13T20:26:42.778 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 5 v 1536 (ObjNum 1003 snap 299 seq_num 1003) dirty exists 2026-02-13T20:26:42.778 INFO:tasks.rados.rados.0.trial188.stdout:3406: finishing write tid 1 to trial18843701-7 2026-02-13T20:26:42.778 INFO:tasks.rados.rados.0.trial188.stdout:3405: finishing write tid 4 to trial18843701-21 2026-02-13T20:26:42.778 INFO:tasks.rados.rados.0.trial188.stdout:3405: finishing write tid 5 to trial18843701-21 2026-02-13T20:26:42.778 INFO:tasks.rados.rados.0.trial188.stdout:3405: oid 21 updating version 0 to 1099 2026-02-13T20:26:42.778 INFO:tasks.rados.rados.0.trial188.stdout:3405: oid 21 version 1099 is already newer than 1097 2026-02-13T20:26:42.778 INFO:tasks.rados.rados.0.trial188.stdout:3405: oid 21 version 1099 is already newer than 1098 2026-02-13T20:26:42.778 INFO:tasks.rados.rados.0.trial188.stdout:3405: oid 21 version 1099 is already newer than 1096 2026-02-13T20:26:42.778 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 21 v 1099 (ObjNum 1173 snap 360 seq_num 1173) dirty exists 2026-02-13T20:26:42.778 INFO:tasks.rados.rados.0.trial188.stdout:3405: left oid 21 (ObjNum 1173 snap 360 seq_num 1173) 2026-02-13T20:26:42.778 INFO:tasks.rados.rados.0.trial188.stdout:3406: finishing write tid 2 to trial18843701-7 2026-02-13T20:26:42.779 INFO:tasks.rados.rados.0.trial188.stdout:3406: finishing write tid 3 to trial18843701-7 2026-02-13T20:26:42.779 INFO:tasks.rados.rados.0.trial188.stdout:3406: finishing write tid 4 to trial18843701-7 2026-02-13T20:26:42.779 INFO:tasks.rados.rados.0.trial188.stdout:3406: finishing write tid 5 to trial18843701-7 2026-02-13T20:26:42.779 INFO:tasks.rados.rados.0.trial188.stdout:3406: oid 7 updating version 0 to 1613 2026-02-13T20:26:42.779 INFO:tasks.rados.rados.0.trial188.stdout:3406: oid 7 version 1613 is already newer than 1610 2026-02-13T20:26:42.779 INFO:tasks.rados.rados.0.trial188.stdout:3406: oid 7 version 1613 is already newer than 1612 2026-02-13T20:26:42.779 INFO:tasks.rados.rados.0.trial188.stdout:3406: oid 7 version 1613 is already newer than 1611 2026-02-13T20:26:42.779 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 7 v 1613 (ObjNum 1174 snap 360 seq_num 1174) dirty exists 2026-02-13T20:26:42.779 INFO:tasks.rados.rados.0.trial188.stdout:3406: left oid 7 (ObjNum 1174 snap 360 seq_num 1174) 2026-02-13T20:26:42.779 INFO:tasks.rados.rados.0.trial188.stdout:3405: done (4 left) 2026-02-13T20:26:42.779 INFO:tasks.rados.rados.0.trial188.stdout:3406: done (3 left) 2026-02-13T20:26:42.779 INFO:tasks.rados.rados.0.trial188.stdout:3407: done (2 left) 2026-02-13T20:26:42.780 INFO:tasks.rados.rados.0.trial188.stdout:3411: write (excl) oid 35 current snap is 360 2026-02-13T20:26:42.780 INFO:tasks.rados.rados.0.trial188.stdout:3411: seq_num 1176 ranges {565032=411186,1583530=456075,2578263=758593} 2026-02-13T20:26:42.780 INFO:tasks.rados.rados.0.trial188.stdout:3411: writing trial18843701-35 from 565032 to 976218 tid 1 2026-02-13T20:26:42.784 INFO:tasks.rados.rados.0.trial188.stdout:3411: writing trial18843701-35 from 1583530 to 2039605 tid 2 2026-02-13T20:26:42.789 INFO:tasks.rados.rados.0.trial188.stdout:3411: writing trial18843701-35 from 2578263 to 3336856 tid 3 2026-02-13T20:26:42.789 INFO:tasks.rados.rados.0.trial188.stdout:3412: snap_remove snap 340 2026-02-13T20:26:43.745 INFO:tasks.rados.rados.0.trial188.stdout:3412: done (3 left) 2026-02-13T20:26:43.746 INFO:tasks.rados.rados.0.trial188.stdout:3413: copy_from oid 4 from oid 38 current snap is 360 2026-02-13T20:26:43.746 INFO:tasks.rados.rados.0.trial188.stdout:3410: finishing rollback tid 0 to trial18843701-49 2026-02-13T20:26:43.746 INFO:tasks.rados.rados.0.trial188.stdout:3410: finishing rollback tid 1 to trial18843701-49 2026-02-13T20:26:43.746 INFO:tasks.rados.rados.0.trial188.stdout:3410: finishing rollback tid 2 to trial18843701-49 2026-02-13T20:26:43.746 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 49 v 1610 (ObjNum 1112 snap 329 seq_num 1112) dirty exists 2026-02-13T20:26:43.746 INFO:tasks.rados.rados.0.trial188.stdout:3409: finishing write tid 1 to trial18843701-1 2026-02-13T20:26:43.746 INFO:tasks.rados.rados.0.trial188.stdout:3409: finishing write tid 2 to trial18843701-1 2026-02-13T20:26:43.746 INFO:tasks.rados.rados.0.trial188.stdout:3409: finishing write tid 3 to trial18843701-1 2026-02-13T20:26:43.746 INFO:tasks.rados.rados.0.trial188.stdout:3409: finishing write tid 4 to trial18843701-1 2026-02-13T20:26:43.746 INFO:tasks.rados.rados.0.trial188.stdout:3409: finishing write tid 5 to trial18843701-1 2026-02-13T20:26:43.746 INFO:tasks.rados.rados.0.trial188.stdout:3409: oid 1 updating version 0 to 1539 2026-02-13T20:26:43.746 INFO:tasks.rados.rados.0.trial188.stdout:3409: oid 1 updating version 1539 to 1540 2026-02-13T20:26:43.746 INFO:tasks.rados.rados.0.trial188.stdout:3409: oid 1 version 1540 is already newer than 1538 2026-02-13T20:26:43.746 INFO:tasks.rados.rados.0.trial188.stdout:3409: oid 1 version 1540 is already newer than 1537 2026-02-13T20:26:43.746 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 1 v 1540 (ObjNum 1175 snap 360 seq_num 1175) dirty exists 2026-02-13T20:26:43.746 INFO:tasks.rados.rados.0.trial188.stdout:3409: left oid 1 (ObjNum 1175 snap 360 seq_num 1175) 2026-02-13T20:26:43.746 INFO:tasks.rados.rados.0.trial188.stdout:3411: finishing write tid 1 to trial18843701-35 2026-02-13T20:26:43.746 INFO:tasks.rados.rados.0.trial188.stdout:3411: finishing write tid 2 to trial18843701-35 2026-02-13T20:26:43.746 INFO:tasks.rados.rados.0.trial188.stdout:3411: finishing write tid 3 to trial18843701-35 2026-02-13T20:26:43.746 INFO:tasks.rados.rados.0.trial188.stdout:3411: finishing write tid 4 to trial18843701-35 2026-02-13T20:26:43.746 INFO:tasks.rados.rados.0.trial188.stdout:3411: finishing write tid 5 to trial18843701-35 2026-02-13T20:26:43.746 INFO:tasks.rados.rados.0.trial188.stdout:3411: oid 35 updating version 0 to 1452 2026-02-13T20:26:43.746 INFO:tasks.rados.rados.0.trial188.stdout:3411: oid 35 version 1452 is already newer than 1451 2026-02-13T20:26:43.746 INFO:tasks.rados.rados.0.trial188.stdout:3411: oid 35 version 1452 is already newer than 1450 2026-02-13T20:26:43.746 INFO:tasks.rados.rados.0.trial188.stdout:3411: oid 35 version 1452 is already newer than 1449 2026-02-13T20:26:43.747 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 35 v 1452 (ObjNum 1176 snap 360 seq_num 1176) dirty exists 2026-02-13T20:26:43.747 INFO:tasks.rados.rados.0.trial188.stdout:3411: left oid 35 (ObjNum 1176 snap 360 seq_num 1176) 2026-02-13T20:26:43.747 INFO:tasks.rados.rados.0.trial188.stdout:3409: done (3 left) 2026-02-13T20:26:43.747 INFO:tasks.rados.rados.0.trial188.stdout:3410: done (2 left) 2026-02-13T20:26:43.747 INFO:tasks.rados.rados.0.trial188.stdout:3411: done (1 left) 2026-02-13T20:26:43.747 INFO:tasks.rados.rados.0.trial188.stdout:3414: write (excl) oid 29 current snap is 360 2026-02-13T20:26:43.747 INFO:tasks.rados.rados.0.trial188.stdout:3414: seq_num 1177 ranges {581839=486435,1642012=599733,3005686=569865} 2026-02-13T20:26:43.750 INFO:tasks.rados.rados.0.trial188.stdout:3414: writing trial18843701-29 from 581839 to 1068274 tid 1 2026-02-13T20:26:43.761 INFO:tasks.rados.rados.0.trial188.stdout:3414: writing trial18843701-29 from 1642012 to 2241745 tid 2 2026-02-13T20:26:43.761 INFO:tasks.rados.rados.0.trial188.stdout:3414: writing trial18843701-29 from 3005686 to 3575551 tid 3 2026-02-13T20:26:43.762 INFO:tasks.rados.rados.0.trial188.stdout:3415: delete oid 17 current snap is 360 2026-02-13T20:26:43.773 INFO:tasks.rados.rados.0.trial188.stdout:3414: finishing write tid 1 to trial18843701-29 2026-02-13T20:26:43.783 INFO:tasks.rados.rados.0.trial188.stdout:3414: finishing write tid 2 to trial18843701-29 2026-02-13T20:26:43.783 INFO:tasks.rados.rados.0.trial188.stdout:3414: finishing write tid 3 to trial18843701-29 2026-02-13T20:26:43.783 INFO:tasks.rados.rados.0.trial188.stdout:3414: finishing write tid 4 to trial18843701-29 2026-02-13T20:26:43.783 INFO:tasks.rados.rados.0.trial188.stdout:3414: finishing write tid 5 to trial18843701-29 2026-02-13T20:26:43.783 INFO:tasks.rados.rados.0.trial188.stdout:3414: oid 29 updating version 0 to 1615 2026-02-13T20:26:43.783 INFO:tasks.rados.rados.0.trial188.stdout:3414: oid 29 updating version 1615 to 1617 2026-02-13T20:26:43.783 INFO:tasks.rados.rados.0.trial188.stdout:3414: oid 29 version 1617 is already newer than 1616 2026-02-13T20:26:43.783 INFO:tasks.rados.rados.0.trial188.stdout:3414: oid 29 version 1617 is already newer than 1614 2026-02-13T20:26:43.783 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 29 v 1617 (ObjNum 1177 snap 360 seq_num 1177) dirty exists 2026-02-13T20:26:43.784 INFO:tasks.rados.rados.0.trial188.stdout:3414: left oid 29 (ObjNum 1177 snap 360 seq_num 1177) 2026-02-13T20:26:43.784 INFO:tasks.rados.rados.0.trial188.stdout:3414: done (2 left) 2026-02-13T20:26:43.784 INFO:tasks.rados.rados.0.trial188.stdout:3415: done (1 left) 2026-02-13T20:26:43.784 INFO:tasks.rados.rados.0.trial188.stdout:3416: delete oid 23 current snap is 360 2026-02-13T20:26:43.784 INFO:tasks.rados.rados.0.trial188.stdout:3416: done (1 left) 2026-02-13T20:26:43.784 INFO:tasks.rados.rados.0.trial188.stdout:3417: snap_remove snap 342 2026-02-13T20:26:44.766 INFO:tasks.rados.rados.0.trial188.stdout:3417: done (1 left) 2026-02-13T20:26:44.766 INFO:tasks.rados.rados.0.trial188.stdout:3418: copy_from oid 35 from oid 1 current snap is 360 2026-02-13T20:26:44.767 INFO:tasks.rados.rados.0.trial188.stdout:3413: finishing copy_from racing read to trial18843701-4 2026-02-13T20:26:44.767 INFO:tasks.rados.rados.0.trial188.stdout:3413: finishing copy_from to trial18843701-4 2026-02-13T20:26:44.767 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 4 v 1607 (ObjNum 1167 snap 354 seq_num 1167) dirty exists 2026-02-13T20:26:44.767 INFO:tasks.rados.rados.0.trial188.stdout:3413: done (1 left) 2026-02-13T20:26:44.767 INFO:tasks.rados.rados.0.trial188.stdout:3419: copy_from oid 2 from oid 14 current snap is 360 2026-02-13T20:26:44.767 INFO:tasks.rados.rados.0.trial188.stdout:3420: delete oid 18 current snap is 360 2026-02-13T20:26:44.770 INFO:tasks.rados.rados.0.trial188.stdout:3420: done (2 left) 2026-02-13T20:26:44.770 INFO:tasks.rados.rados.0.trial188.stdout:3421: write oid 32 current snap is 360 2026-02-13T20:26:44.770 INFO:tasks.rados.rados.0.trial188.stdout:3421: seq_num 1181 ranges {649067=503784,1875940=607071,3115378=731306} 2026-02-13T20:26:44.774 INFO:tasks.rados.rados.0.trial188.stdout:3421: writing trial18843701-32 from 649067 to 1152851 tid 1 2026-02-13T20:26:44.779 INFO:tasks.rados.rados.0.trial188.stdout:3421: writing trial18843701-32 from 1875940 to 2483011 tid 2 2026-02-13T20:26:44.785 INFO:tasks.rados.rados.0.trial188.stdout:3421: writing trial18843701-32 from 3115378 to 3846684 tid 3 2026-02-13T20:26:44.785 INFO:tasks.rados.rados.0.trial188.stdout:3422: snap_create 2026-02-13T20:26:44.808 INFO:tasks.rados.rados.0.trial188.stdout:3418: finishing copy_from racing read to trial18843701-35 2026-02-13T20:26:44.813 INFO:tasks.rados.rados.0.trial188.stdout:3419: finishing copy_from racing read to trial18843701-2 2026-02-13T20:26:44.815 INFO:tasks.rados.rados.0.trial188.stdout:3418: finishing copy_from to trial18843701-35 2026-02-13T20:26:44.815 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 35 v 1540 (ObjNum 1175 snap 360 seq_num 1175) dirty exists 2026-02-13T20:26:44.840 INFO:tasks.rados.rados.0.trial188.stdout:3419: finishing copy_from to trial18843701-2 2026-02-13T20:26:44.840 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 2 v 1515 (ObjNum 1158 snap 348 seq_num 1158) dirty exists 2026-02-13T20:26:44.841 INFO:tasks.rados.rados.0.trial188.stdout:3421: finishing write tid 1 to trial18843701-32 2026-02-13T20:26:44.841 INFO:tasks.rados.rados.0.trial188.stdout:3421: finishing write tid 2 to trial18843701-32 2026-02-13T20:26:44.841 INFO:tasks.rados.rados.0.trial188.stdout:3421: finishing write tid 3 to trial18843701-32 2026-02-13T20:26:44.841 INFO:tasks.rados.rados.0.trial188.stdout:3421: finishing write tid 4 to trial18843701-32 2026-02-13T20:26:44.841 INFO:tasks.rados.rados.0.trial188.stdout:3421: finishing write tid 5 to trial18843701-32 2026-02-13T20:26:44.841 INFO:tasks.rados.rados.0.trial188.stdout:3421: oid 32 updating version 0 to 1488 2026-02-13T20:26:44.841 INFO:tasks.rados.rados.0.trial188.stdout:3421: oid 32 version 1488 is already newer than 1487 2026-02-13T20:26:44.841 INFO:tasks.rados.rados.0.trial188.stdout:3421: oid 32 updating version 1488 to 1489 2026-02-13T20:26:44.841 INFO:tasks.rados.rados.0.trial188.stdout:3421: oid 32 updating version 1489 to 1490 2026-02-13T20:26:44.841 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 32 v 1490 (ObjNum 1181 snap 360 seq_num 1181) dirty exists 2026-02-13T20:26:44.841 INFO:tasks.rados.rados.0.trial188.stdout:3421: left oid 32 (ObjNum 1181 snap 360 seq_num 1181) 2026-02-13T20:26:45.770 INFO:tasks.rados.rados.0.trial188.stdout:3418: done (3 left) 2026-02-13T20:26:45.770 INFO:tasks.rados.rados.0.trial188.stdout:3419: done (2 left) 2026-02-13T20:26:45.770 INFO:tasks.rados.rados.0.trial188.stdout:3421: done (1 left) 2026-02-13T20:26:45.770 INFO:tasks.rados.rados.0.trial188.stdout:3422: done (0 left) 2026-02-13T20:26:45.770 INFO:tasks.rados.rados.0.trial188.stdout:3423: rollback oid 21 current snap is 361 2026-02-13T20:26:45.770 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 21 to 347 2026-02-13T20:26:45.770 INFO:tasks.rados.rados.0.trial188.stdout:3424: copy_from oid 5 from oid 3 current snap is 361 2026-02-13T20:26:45.770 INFO:tasks.rados.rados.0.trial188.stdout:3425: snap_create 2026-02-13T20:26:45.772 INFO:tasks.rados.rados.0.trial188.stdout:3423: finishing rollback tid 0 to trial18843701-21 2026-02-13T20:26:45.772 INFO:tasks.rados.rados.0.trial188.stdout:3423: finishing rollback tid 1 to trial18843701-21 2026-02-13T20:26:45.772 INFO:tasks.rados.rados.0.trial188.stdout:3423: finishing rollback tid 2 to trial18843701-21 2026-02-13T20:26:45.772 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 21 v 1102 (ObjNum 1111 snap 329 seq_num 1111) dirty exists 2026-02-13T20:26:45.806 INFO:tasks.rados.rados.0.trial188.stdout:3424: finishing copy_from racing read to trial18843701-5 2026-02-13T20:26:45.809 INFO:tasks.rados.rados.0.trial188.stdout:3424: finishing copy_from to trial18843701-5 2026-02-13T20:26:45.809 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 5 v 1511 (ObjNum 1131 snap 341 seq_num 1131) dirty exists 2026-02-13T20:26:46.772 INFO:tasks.rados.rados.0.trial188.stdout:3423: done (2 left) 2026-02-13T20:26:46.772 INFO:tasks.rados.rados.0.trial188.stdout:3424: done (1 left) 2026-02-13T20:26:46.772 INFO:tasks.rados.rados.0.trial188.stdout:3425: done (0 left) 2026-02-13T20:26:46.772 INFO:tasks.rados.rados.0.trial188.stdout:3426: read oid 36 snap -1 2026-02-13T20:26:46.772 INFO:tasks.rados.rados.0.trial188.stdout:3426: expect (ObjNum 1159 snap 349 seq_num 1159) 2026-02-13T20:26:46.772 INFO:tasks.rados.rados.0.trial188.stdout:3427: rollback oid 30 current snap is 362 2026-02-13T20:26:46.773 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 30 to 334 2026-02-13T20:26:46.773 INFO:tasks.rados.rados.0.trial188.stdout:3428: write oid 50 current snap is 362 2026-02-13T20:26:46.773 INFO:tasks.rados.rados.0.trial188.stdout:3428: seq_num 1182 ranges {665874=579033,1934422=467082,3142801=542578} 2026-02-13T20:26:46.776 INFO:tasks.rados.rados.0.trial188.stdout:3428: writing trial18843701-50 from 665874 to 1244907 tid 1 2026-02-13T20:26:46.781 INFO:tasks.rados.rados.0.trial188.stdout:3428: writing trial18843701-50 from 1934422 to 2401504 tid 2 2026-02-13T20:26:46.786 INFO:tasks.rados.rados.0.trial188.stdout:3428: writing trial18843701-50 from 3142801 to 3685379 tid 3 2026-02-13T20:26:46.786 INFO:tasks.rados.rados.0.trial188.stdout:3429: snap_remove snap 361 2026-02-13T20:26:47.777 INFO:tasks.rados.rados.0.trial188.stdout:3429: done (3 left) 2026-02-13T20:26:47.777 INFO:tasks.rados.rados.0.trial188.stdout:3430: snap_create 2026-02-13T20:26:47.777 INFO:tasks.rados.rados.0.trial188.stdout:3427: finishing rollback tid 0 to trial18843701-30 2026-02-13T20:26:47.778 INFO:tasks.rados.rados.0.trial188.stdout:3427: finishing rollback tid 1 to trial18843701-30 2026-02-13T20:26:47.778 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 30 v 1612 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-13T20:26:47.778 INFO:tasks.rados.rados.0.trial188.stdout:3426: expect (ObjNum 1159 snap 349 seq_num 1159) 2026-02-13T20:26:47.778 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:26:47.811 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:26:47.850 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1242565 2026-02-13T20:26:47.877 INFO:tasks.rados.rados.0.trial188.stdout:3428: finishing write tid 1 to trial18843701-50 2026-02-13T20:26:47.878 INFO:tasks.rados.rados.0.trial188.stdout:3428: finishing write tid 2 to trial18843701-50 2026-02-13T20:26:47.878 INFO:tasks.rados.rados.0.trial188.stdout:3428: finishing write tid 3 to trial18843701-50 2026-02-13T20:26:47.878 INFO:tasks.rados.rados.0.trial188.stdout:3428: finishing write tid 4 to trial18843701-50 2026-02-13T20:26:47.878 INFO:tasks.rados.rados.0.trial188.stdout:3428: finishing write tid 5 to trial18843701-50 2026-02-13T20:26:47.878 INFO:tasks.rados.rados.0.trial188.stdout:3428: oid 50 updating version 0 to 1701 2026-02-13T20:26:47.878 INFO:tasks.rados.rados.0.trial188.stdout:3428: oid 50 version 1701 is already newer than 1700 2026-02-13T20:26:47.878 INFO:tasks.rados.rados.0.trial188.stdout:3428: oid 50 updating version 1701 to 1703 2026-02-13T20:26:47.878 INFO:tasks.rados.rados.0.trial188.stdout:3428: oid 50 version 1703 is already newer than 1702 2026-02-13T20:26:47.878 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 50 v 1703 (ObjNum 1182 snap 362 seq_num 1182) dirty exists 2026-02-13T20:26:47.878 INFO:tasks.rados.rados.0.trial188.stdout:3428: left oid 50 (ObjNum 1182 snap 362 seq_num 1182) 2026-02-13T20:26:48.745 INFO:tasks.rados.rados.0.trial188.stdout:3426: done (3 left) 2026-02-13T20:26:48.745 INFO:tasks.rados.rados.0.trial188.stdout:3427: done (2 left) 2026-02-13T20:26:48.745 INFO:tasks.rados.rados.0.trial188.stdout:3428: done (1 left) 2026-02-13T20:26:48.745 INFO:tasks.rados.rados.0.trial188.stdout:3430: done (0 left) 2026-02-13T20:26:48.746 INFO:tasks.rados.rados.0.trial188.stdout:3431: rollback oid 29 current snap is 363 2026-02-13T20:26:48.746 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 29 to 357 2026-02-13T20:26:48.746 INFO:tasks.rados.rados.0.trial188.stdout:3432: delete oid 42 current snap is 363 2026-02-13T20:26:48.750 INFO:tasks.rados.rados.0.trial188.stdout:3431: finishing rollback tid 0 to trial18843701-29 2026-02-13T20:26:48.750 INFO:tasks.rados.rados.0.trial188.stdout:3432: done (1 left) 2026-02-13T20:26:48.750 INFO:tasks.rados.rados.0.trial188.stdout:3433: delete oid 44 current snap is 363 2026-02-13T20:26:48.751 INFO:tasks.rados.rados.0.trial188.stdout:3431: finishing rollback tid 1 to trial18843701-29 2026-02-13T20:26:48.751 INFO:tasks.rados.rados.0.trial188.stdout:3431: finishing rollback tid 2 to trial18843701-29 2026-02-13T20:26:48.751 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 29 v 1620 (ObjNum 1049 snap 314 seq_num 1049) dirty exists 2026-02-13T20:26:48.752 INFO:tasks.rados.rados.0.trial188.stdout:3431: done (1 left) 2026-02-13T20:26:48.752 INFO:tasks.rados.rados.0.trial188.stdout:3433: done (0 left) 2026-02-13T20:26:48.752 INFO:tasks.rados.rados.0.trial188.stdout:3434: copy_from oid 27 from oid 13 current snap is 363 2026-02-13T20:26:48.752 INFO:tasks.rados.rados.0.trial188.stdout:3435: snap_remove snap 347 2026-02-13T20:26:49.748 INFO:tasks.rados.rados.0.trial188.stdout:3435: done (1 left) 2026-02-13T20:26:49.748 INFO:tasks.rados.rados.0.trial188.stdout:3436: rollback oid 25 current snap is 363 2026-02-13T20:26:49.748 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 25 to 362 2026-02-13T20:26:49.748 INFO:tasks.rados.rados.0.trial188.stdout:3434: finishing copy_from racing read to trial18843701-27 2026-02-13T20:26:49.748 INFO:tasks.rados.rados.0.trial188.stdout:3434: finishing copy_from to trial18843701-27 2026-02-13T20:26:49.748 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 27 v 1527 (ObjNum 1155 snap 347 seq_num 1155) dirty exists 2026-02-13T20:26:49.748 INFO:tasks.rados.rados.0.trial188.stdout:3434: done (1 left) 2026-02-13T20:26:49.748 INFO:tasks.rados.rados.0.trial188.stdout:3437: read oid 39 snap -1 2026-02-13T20:26:49.748 INFO:tasks.rados.rados.0.trial188.stdout:3437: expect (ObjNum 1144 snap 346 seq_num 1144) 2026-02-13T20:26:49.748 INFO:tasks.rados.rados.0.trial188.stdout:3438: read oid 33 snap -1 2026-02-13T20:26:49.748 INFO:tasks.rados.rados.0.trial188.stdout:3438: expect (ObjNum 1102 snap 326 seq_num 1102) 2026-02-13T20:26:49.748 INFO:tasks.rados.rados.0.trial188.stdout:3439: write (excl) oid 34 current snap is 363 2026-02-13T20:26:49.748 INFO:tasks.rados.rados.0.trial188.stdout:3439: seq_num 1185 ranges {716295=404780,1593515=614409,2708717=492747,3640519=275776} 2026-02-13T20:26:49.753 INFO:tasks.rados.rados.0.trial188.stdout:3439: writing trial18843701-34 from 716295 to 1121075 tid 1 2026-02-13T20:26:49.757 INFO:tasks.rados.rados.0.trial188.stdout:3439: writing trial18843701-34 from 1593515 to 2207924 tid 2 2026-02-13T20:26:49.761 INFO:tasks.rados.rados.0.trial188.stdout:3439: writing trial18843701-34 from 2708717 to 3201464 tid 3 2026-02-13T20:26:49.764 INFO:tasks.rados.rados.0.trial188.stdout:3439: writing trial18843701-34 from 3640519 to 3916295 tid 4 2026-02-13T20:26:49.764 INFO:tasks.rados.rados.0.trial188.stdout:3440: rollback oid 48 current snap is 363 2026-02-13T20:26:49.764 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 48 to 362 2026-02-13T20:26:49.764 INFO:tasks.rados.rados.0.trial188.stdout:3438: expect (ObjNum 1102 snap 326 seq_num 1102) 2026-02-13T20:26:49.764 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:26:49.867 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:26:49.918 INFO:tasks.rados.rados.0.trial188.stdout:3436: finishing rollback tid 0 to trial18843701-25 2026-02-13T20:26:49.918 INFO:tasks.rados.rados.0.trial188.stdout:3437: expect (ObjNum 1144 snap 346 seq_num 1144) 2026-02-13T20:26:49.993 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1190284 2026-02-13T20:26:50.119 INFO:tasks.rados.rados.0.trial188.stdout:3436: finishing rollback tid 1 to trial18843701-25 2026-02-13T20:26:50.119 INFO:tasks.rados.rados.0.trial188.stdout:3440: finishing rollback tid 0 to trial18843701-48 2026-02-13T20:26:50.119 INFO:tasks.rados.rados.0.trial188.stdout:3440: finishing rollback tid 1 to trial18843701-48 2026-02-13T20:26:50.119 INFO:tasks.rados.rados.0.trial188.stdout:3440: finishing rollback tid 2 to trial18843701-48 2026-02-13T20:26:50.119 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 48 v 1105 (ObjNum 1007 snap 299 seq_num 1007) dirty exists 2026-02-13T20:26:50.119 INFO:tasks.rados.rados.0.trial188.stdout:3436: finishing rollback tid 2 to trial18843701-25 2026-02-13T20:26:50.120 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 25 v 1615 (ObjNum 1049 snap 314 seq_num 1049) dirty exists 2026-02-13T20:26:50.120 INFO:tasks.rados.rados.0.trial188.stdout:3439: finishing write tid 1 to trial18843701-34 2026-02-13T20:26:50.120 INFO:tasks.rados.rados.0.trial188.stdout:3439: finishing write tid 2 to trial18843701-34 2026-02-13T20:26:50.120 INFO:tasks.rados.rados.0.trial188.stdout:3439: finishing write tid 3 to trial18843701-34 2026-02-13T20:26:50.120 INFO:tasks.rados.rados.0.trial188.stdout:3439: finishing write tid 4 to trial18843701-34 2026-02-13T20:26:50.120 INFO:tasks.rados.rados.0.trial188.stdout:3439: finishing write tid 5 to trial18843701-34 2026-02-13T20:26:50.120 INFO:tasks.rados.rados.0.trial188.stdout:3439: finishing write tid 6 to trial18843701-34 2026-02-13T20:26:50.120 INFO:tasks.rados.rados.0.trial188.stdout:3439: oid 34 updating version 0 to 1654 2026-02-13T20:26:50.120 INFO:tasks.rados.rados.0.trial188.stdout:3439: oid 34 updating version 1654 to 1655 2026-02-13T20:26:50.120 INFO:tasks.rados.rados.0.trial188.stdout:3439: oid 34 updating version 1655 to 1657 2026-02-13T20:26:50.121 INFO:tasks.rados.rados.0.trial188.stdout:3439: oid 34 version 1657 is already newer than 1656 2026-02-13T20:26:50.121 INFO:tasks.rados.rados.0.trial188.stdout:3439: oid 34 version 1657 is already newer than 1653 2026-02-13T20:26:50.121 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 34 v 1657 (ObjNum 1185 snap 363 seq_num 1185) dirty exists 2026-02-13T20:26:50.121 INFO:tasks.rados.rados.0.trial188.stdout:3439: left oid 34 (ObjNum 1185 snap 363 seq_num 1185) 2026-02-13T20:26:50.121 INFO:tasks.rados.rados.0.trial188.stdout:3436: done (4 left) 2026-02-13T20:26:50.121 INFO:tasks.rados.rados.0.trial188.stdout:3437: done (3 left) 2026-02-13T20:26:50.121 INFO:tasks.rados.rados.0.trial188.stdout:3438: done (2 left) 2026-02-13T20:26:50.121 INFO:tasks.rados.rados.0.trial188.stdout:3439: done (1 left) 2026-02-13T20:26:50.121 INFO:tasks.rados.rados.0.trial188.stdout:3440: done (0 left) 2026-02-13T20:26:50.121 INFO:tasks.rados.rados.0.trial188.stdout:3441: read oid 6 snap 334 2026-02-13T20:26:50.121 INFO:tasks.rados.rados.0.trial188.stdout:3441: expect deleted 2026-02-13T20:26:50.121 INFO:tasks.rados.rados.0.trial188.stdout:3442: read oid 50 snap -1 2026-02-13T20:26:50.122 INFO:tasks.rados.rados.0.trial188.stdout:3442: expect (ObjNum 1182 snap 362 seq_num 1182) 2026-02-13T20:26:50.122 INFO:tasks.rados.rados.0.trial188.stdout:3443: copy_from oid 17 from oid 15 current snap is 363 2026-02-13T20:26:50.122 INFO:tasks.rados.rados.0.trial188.stdout:3444: write oid 13 current snap is 363 2026-02-13T20:26:50.122 INFO:tasks.rados.rados.0.trial188.stdout:3444: seq_num 1186 ranges {733102=596382,1768350=758067,3136140=704019} 2026-02-13T20:26:50.123 INFO:tasks.rados.rados.0.trial188.stdout:3444: writing trial18843701-13 from 733102 to 1329484 tid 1 2026-02-13T20:26:50.127 INFO:tasks.rados.rados.0.trial188.stdout:3444: writing trial18843701-13 from 1768350 to 2526417 tid 2 2026-02-13T20:26:50.132 INFO:tasks.rados.rados.0.trial188.stdout:3444: writing trial18843701-13 from 3136140 to 3840159 tid 3 2026-02-13T20:26:50.133 INFO:tasks.rados.rados.0.trial188.stdout:3445: write (excl) oid 23 current snap is 363 2026-02-13T20:26:50.133 INFO:tasks.rados.rados.0.trial188.stdout:3445: seq_num 1187 ranges {749909=671631,2110479=618078,3163563=515291} 2026-02-13T20:26:50.137 INFO:tasks.rados.rados.0.trial188.stdout:3445: writing trial18843701-23 from 749909 to 1421540 tid 1 2026-02-13T20:26:50.142 INFO:tasks.rados.rados.0.trial188.stdout:3445: writing trial18843701-23 from 2110479 to 2728557 tid 2 2026-02-13T20:26:50.147 INFO:tasks.rados.rados.0.trial188.stdout:3445: writing trial18843701-23 from 3163563 to 3678854 tid 3 2026-02-13T20:26:50.147 INFO:tasks.rados.rados.0.trial188.stdout:3446: rollback oid 8 current snap is 363 2026-02-13T20:26:50.147 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 8 to 360 2026-02-13T20:26:50.147 INFO:tasks.rados.rados.0.trial188.stdout:3442: expect (ObjNum 1182 snap 362 seq_num 1182) 2026-02-13T20:26:50.147 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:26:50.196 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:26:50.299 INFO:tasks.rados.rados.0.trial188.stdout:3444: finishing write tid 1 to trial18843701-13 2026-02-13T20:26:50.300 INFO:tasks.rados.rados.0.trial188.stdout:3443: finishing copy_from racing read to trial18843701-17 2026-02-13T20:26:50.300 INFO:tasks.rados.rados.0.trial188.stdout:3444: finishing write tid 2 to trial18843701-13 2026-02-13T20:26:50.300 INFO:tasks.rados.rados.0.trial188.stdout:3441: done (5 left) 2026-02-13T20:26:50.300 INFO:tasks.rados.rados.0.trial188.stdout:3442: done (4 left) 2026-02-13T20:26:50.300 INFO:tasks.rados.rados.0.trial188.stdout:3447: snap_create 2026-02-13T20:26:50.300 INFO:tasks.rados.rados.0.trial188.stdout:3444: finishing write tid 3 to trial18843701-13 2026-02-13T20:26:50.300 INFO:tasks.rados.rados.0.trial188.stdout:3443: finishing copy_from to trial18843701-17 2026-02-13T20:26:50.300 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 17 v 1072 (ObjNum 865 snap 250 seq_num 865) dirty exists 2026-02-13T20:26:50.300 INFO:tasks.rados.rados.0.trial188.stdout:3445: finishing write tid 1 to trial18843701-23 2026-02-13T20:26:50.300 INFO:tasks.rados.rados.0.trial188.stdout:3446: finishing rollback tid 1 to trial18843701-8 2026-02-13T20:26:50.300 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 8 v 0 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-13T20:26:50.300 INFO:tasks.rados.rados.0.trial188.stdout:3444: finishing write tid 4 to trial18843701-13 2026-02-13T20:26:50.300 INFO:tasks.rados.rados.0.trial188.stdout:3444: finishing write tid 5 to trial18843701-13 2026-02-13T20:26:50.300 INFO:tasks.rados.rados.0.trial188.stdout:3444: oid 13 updating version 0 to 1566 2026-02-13T20:26:50.300 INFO:tasks.rados.rados.0.trial188.stdout:3444: oid 13 version 1566 is already newer than 1565 2026-02-13T20:26:50.300 INFO:tasks.rados.rados.0.trial188.stdout:3444: oid 13 updating version 1566 to 1567 2026-02-13T20:26:50.300 INFO:tasks.rados.rados.0.trial188.stdout:3444: oid 13 updating version 1567 to 1568 2026-02-13T20:26:50.300 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 13 v 1568 (ObjNum 1186 snap 363 seq_num 1186) dirty exists 2026-02-13T20:26:50.300 INFO:tasks.rados.rados.0.trial188.stdout:3444: left oid 13 (ObjNum 1186 snap 363 seq_num 1186) 2026-02-13T20:26:50.300 INFO:tasks.rados.rados.0.trial188.stdout:3445: finishing write tid 2 to trial18843701-23 2026-02-13T20:26:50.300 INFO:tasks.rados.rados.0.trial188.stdout:3445: finishing write tid 3 to trial18843701-23 2026-02-13T20:26:50.300 INFO:tasks.rados.rados.0.trial188.stdout:3445: finishing write tid 4 to trial18843701-23 2026-02-13T20:26:50.300 INFO:tasks.rados.rados.0.trial188.stdout:3445: finishing write tid 5 to trial18843701-23 2026-02-13T20:26:50.300 INFO:tasks.rados.rados.0.trial188.stdout:3445: oid 23 updating version 0 to 1716 2026-02-13T20:26:50.300 INFO:tasks.rados.rados.0.trial188.stdout:3445: oid 23 version 1716 is already newer than 1714 2026-02-13T20:26:50.300 INFO:tasks.rados.rados.0.trial188.stdout:3445: oid 23 version 1716 is already newer than 1715 2026-02-13T20:26:50.300 INFO:tasks.rados.rados.0.trial188.stdout:3445: oid 23 updating version 1716 to 1717 2026-02-13T20:26:50.300 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 23 v 1717 (ObjNum 1187 snap 363 seq_num 1187) dirty exists 2026-02-13T20:26:50.300 INFO:tasks.rados.rados.0.trial188.stdout:3445: left oid 23 (ObjNum 1187 snap 363 seq_num 1187) 2026-02-13T20:26:50.782 INFO:tasks.rados.rados.0.trial188.stdout:3443: done (4 left) 2026-02-13T20:26:50.782 INFO:tasks.rados.rados.0.trial188.stdout:3444: done (3 left) 2026-02-13T20:26:50.782 INFO:tasks.rados.rados.0.trial188.stdout:3445: done (2 left) 2026-02-13T20:26:50.782 INFO:tasks.rados.rados.0.trial188.stdout:3446: done (1 left) 2026-02-13T20:26:50.782 INFO:tasks.rados.rados.0.trial188.stdout:3447: done (0 left) 2026-02-13T20:26:50.782 INFO:tasks.rados.rados.0.trial188.stdout:3448: read oid 48 snap -1 2026-02-13T20:26:50.782 INFO:tasks.rados.rados.0.trial188.stdout:3448: expect (ObjNum 1007 snap 299 seq_num 1007) 2026-02-13T20:26:50.782 INFO:tasks.rados.rados.0.trial188.stdout:3449: read oid 43 snap -1 2026-02-13T20:26:50.783 INFO:tasks.rados.rados.0.trial188.stdout:3449: expect (ObjNum 998 snap 297 seq_num 998) 2026-02-13T20:26:50.783 INFO:tasks.rados.rados.0.trial188.stdout:3450: copy_from oid 5 from oid 20 current snap is 364 2026-02-13T20:26:50.783 INFO:tasks.rados.rados.0.trial188.stdout:3451: write oid 39 current snap is 364 2026-02-13T20:26:50.783 INFO:tasks.rados.rados.0.trial188.stdout:3451: seq_num 1188 ranges {766716=746880,2168961=761736,3474633=442916} 2026-02-13T20:26:50.788 INFO:tasks.rados.rados.0.trial188.stdout:3451: writing trial18843701-39 from 766716 to 1513596 tid 1 2026-02-13T20:26:50.794 INFO:tasks.rados.rados.0.trial188.stdout:3451: writing trial18843701-39 from 2168961 to 2930697 tid 2 2026-02-13T20:26:50.798 INFO:tasks.rados.rados.0.trial188.stdout:3451: writing trial18843701-39 from 3474633 to 3917549 tid 3 2026-02-13T20:26:50.798 INFO:tasks.rados.rados.0.trial188.stdout:3452: rollback oid 16 current snap is 364 2026-02-13T20:26:50.798 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 16 to 359 2026-02-13T20:26:50.798 INFO:tasks.rados.rados.0.trial188.stdout:3449: expect (ObjNum 998 snap 297 seq_num 998) 2026-02-13T20:26:50.802 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 822729 2026-02-13T20:26:50.818 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 895154 2026-02-13T20:26:50.850 INFO:tasks.rados.rados.0.trial188.stdout:3448: expect (ObjNum 1007 snap 299 seq_num 1007) 2026-02-13T20:26:50.851 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 443128 2026-02-13T20:26:50.888 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1377831 2026-02-13T20:26:50.938 INFO:tasks.rados.rados.0.trial188.stdout:3451: finishing write tid 1 to trial18843701-39 2026-02-13T20:26:50.938 INFO:tasks.rados.rados.0.trial188.stdout:3448: done (4 left) 2026-02-13T20:26:50.938 INFO:tasks.rados.rados.0.trial188.stdout:3449: done (3 left) 2026-02-13T20:26:50.938 INFO:tasks.rados.rados.0.trial188.stdout:3453: write (excl) oid 1 current snap is 364 2026-02-13T20:26:50.938 INFO:tasks.rados.rados.0.trial188.stdout:3451: finishing write tid 2 to trial18843701-39 2026-02-13T20:26:50.938 INFO:tasks.rados.rados.0.trial188.stdout:3450: finishing copy_from racing read to trial18843701-5 2026-02-13T20:26:50.938 INFO:tasks.rados.rados.0.trial188.stdout:3452: finishing rollback tid 0 to trial18843701-16 2026-02-13T20:26:50.938 INFO:tasks.rados.rados.0.trial188.stdout:3451: finishing write tid 3 to trial18843701-39 2026-02-13T20:26:50.938 INFO:tasks.rados.rados.0.trial188.stdout:3451: finishing write tid 4 to trial18843701-39 2026-02-13T20:26:50.938 INFO:tasks.rados.rados.0.trial188.stdout:3451: finishing write tid 5 to trial18843701-39 2026-02-13T20:26:50.938 INFO:tasks.rados.rados.0.trial188.stdout:3451: oid 39 updating version 0 to 1621 2026-02-13T20:26:50.939 INFO:tasks.rados.rados.0.trial188.stdout:3451: oid 39 updating version 1621 to 1623 2026-02-13T20:26:50.939 INFO:tasks.rados.rados.0.trial188.stdout:3451: oid 39 updating version 1623 to 1624 2026-02-13T20:26:50.939 INFO:tasks.rados.rados.0.trial188.stdout:3451: oid 39 version 1624 is already newer than 1622 2026-02-13T20:26:50.939 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 39 v 1624 (ObjNum 1188 snap 364 seq_num 1188) dirty exists 2026-02-13T20:26:50.939 INFO:tasks.rados.rados.0.trial188.stdout:3451: left oid 39 (ObjNum 1188 snap 364 seq_num 1188) 2026-02-13T20:26:50.939 INFO:tasks.rados.rados.0.trial188.stdout:3452: finishing rollback tid 1 to trial18843701-16 2026-02-13T20:26:50.939 INFO:tasks.rados.rados.0.trial188.stdout:3452: finishing rollback tid 2 to trial18843701-16 2026-02-13T20:26:50.939 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 16 v 1721 (ObjNum 1121 snap 334 seq_num 1121) dirty exists 2026-02-13T20:26:50.939 INFO:tasks.rados.rados.0.trial188.stdout:3450: finishing copy_from to trial18843701-5 2026-02-13T20:26:50.939 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 5 v 1253 (ObjNum 1170 snap 360 seq_num 1170) dirty exists 2026-02-13T20:26:50.939 INFO:tasks.rados.rados.0.trial188.stdout:3453: seq_num 1189 ranges {783523=422129,1827443=621747,3218409=654188} 2026-02-13T20:26:50.943 INFO:tasks.rados.rados.0.trial188.stdout:3453: writing trial18843701-1 from 783523 to 1205652 tid 1 2026-02-13T20:26:50.947 INFO:tasks.rados.rados.0.trial188.stdout:3453: writing trial18843701-1 from 1827443 to 2449190 tid 2 2026-02-13T20:26:50.952 INFO:tasks.rados.rados.0.trial188.stdout:3453: writing trial18843701-1 from 3218409 to 3872597 tid 3 2026-02-13T20:26:50.953 INFO:tasks.rados.rados.0.trial188.stdout:3450: done (3 left) 2026-02-13T20:26:50.953 INFO:tasks.rados.rados.0.trial188.stdout:3451: done (2 left) 2026-02-13T20:26:50.953 INFO:tasks.rados.rados.0.trial188.stdout:3452: done (1 left) 2026-02-13T20:26:50.953 INFO:tasks.rados.rados.0.trial188.stdout:3454: copy_from oid 13 from oid 23 current snap is 364 2026-02-13T20:26:50.953 INFO:tasks.rados.rados.0.trial188.stdout:3455: delete oid 30 current snap is 364 2026-02-13T20:26:50.954 INFO:tasks.rados.rados.0.trial188.stdout:3455: done (2 left) 2026-02-13T20:26:50.954 INFO:tasks.rados.rados.0.trial188.stdout:3456: write (excl) oid 24 current snap is 364 2026-02-13T20:26:50.954 INFO:tasks.rados.rados.0.trial188.stdout:3456: seq_num 1191 ranges {417137=572627,1428054=589083} 2026-02-13T20:26:50.958 INFO:tasks.rados.rados.0.trial188.stdout:3456: writing trial18843701-24 from 417137 to 989764 tid 1 2026-02-13T20:26:50.962 INFO:tasks.rados.rados.0.trial188.stdout:3456: writing trial18843701-24 from 1428054 to 2017137 tid 2 2026-02-13T20:26:50.962 INFO:tasks.rados.rados.0.trial188.stdout:3457: read oid 21 snap -1 2026-02-13T20:26:50.962 INFO:tasks.rados.rados.0.trial188.stdout:3457: expect (ObjNum 1111 snap 329 seq_num 1111) 2026-02-13T20:26:50.962 INFO:tasks.rados.rados.0.trial188.stdout:3458: copy_from oid 19 from oid 7 current snap is 364 2026-02-13T20:26:50.962 INFO:tasks.rados.rados.0.trial188.stdout:3459: read oid 40 snap -1 2026-02-13T20:26:50.962 INFO:tasks.rados.rados.0.trial188.stdout:3459: expect (ObjNum 1142 snap 344 seq_num 1142) 2026-02-13T20:26:50.962 INFO:tasks.rados.rados.0.trial188.stdout:3460: snap_create 2026-02-13T20:26:50.967 INFO:tasks.rados.rados.0.trial188.stdout:3457: expect (ObjNum 1111 snap 329 seq_num 1111) 2026-02-13T20:26:51.069 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1150676 2026-02-13T20:26:51.111 INFO:tasks.rados.rados.0.trial188.stdout:3453: finishing write tid 1 to trial18843701-1 2026-02-13T20:26:51.111 INFO:tasks.rados.rados.0.trial188.stdout:3453: finishing write tid 2 to trial18843701-1 2026-02-13T20:26:51.112 INFO:tasks.rados.rados.0.trial188.stdout:3459: expect (ObjNum 1142 snap 344 seq_num 1142) 2026-02-13T20:26:51.112 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:26:51.189 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:26:51.231 INFO:tasks.rados.rados.0.trial188.stdout:3458: finishing copy_from racing read to trial18843701-19 2026-02-13T20:26:51.232 INFO:tasks.rados.rados.0.trial188.stdout:3456: finishing write tid 1 to trial18843701-24 2026-02-13T20:26:51.232 INFO:tasks.rados.rados.0.trial188.stdout:3454: finishing copy_from racing read to trial18843701-13 2026-02-13T20:26:51.232 INFO:tasks.rados.rados.0.trial188.stdout:3456: finishing write tid 2 to trial18843701-24 2026-02-13T20:26:51.232 INFO:tasks.rados.rados.0.trial188.stdout:3453: finishing write tid 3 to trial18843701-1 2026-02-13T20:26:51.232 INFO:tasks.rados.rados.0.trial188.stdout:3456: finishing write tid 3 to trial18843701-24 2026-02-13T20:26:51.232 INFO:tasks.rados.rados.0.trial188.stdout:3453: finishing write tid 4 to trial18843701-1 2026-02-13T20:26:51.232 INFO:tasks.rados.rados.0.trial188.stdout:3458: finishing copy_from to trial18843701-19 2026-02-13T20:26:51.232 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 19 v 1613 (ObjNum 1174 snap 360 seq_num 1174) dirty exists 2026-02-13T20:26:51.233 INFO:tasks.rados.rados.0.trial188.stdout:3453: finishing write tid 5 to trial18843701-1 2026-02-13T20:26:51.233 INFO:tasks.rados.rados.0.trial188.stdout:3453: oid 1 updating version 0 to 1575 2026-02-13T20:26:51.233 INFO:tasks.rados.rados.0.trial188.stdout:3453: oid 1 version 1575 is already newer than 1573 2026-02-13T20:26:51.233 INFO:tasks.rados.rados.0.trial188.stdout:3453: oid 1 version 1575 is already newer than 1572 2026-02-13T20:26:51.233 INFO:tasks.rados.rados.0.trial188.stdout:3453: oid 1 version 1575 is already newer than 1574 2026-02-13T20:26:51.233 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 1 v 1575 (ObjNum 1189 snap 364 seq_num 1189) dirty exists 2026-02-13T20:26:51.233 INFO:tasks.rados.rados.0.trial188.stdout:3453: left oid 1 (ObjNum 1189 snap 364 seq_num 1189) 2026-02-13T20:26:51.233 INFO:tasks.rados.rados.0.trial188.stdout:3454: finishing copy_from to trial18843701-13 2026-02-13T20:26:51.233 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 13 v 1717 (ObjNum 1187 snap 363 seq_num 1187) dirty exists 2026-02-13T20:26:51.233 INFO:tasks.rados.rados.0.trial188.stdout:3456: finishing write tid 4 to trial18843701-24 2026-02-13T20:26:51.233 INFO:tasks.rados.rados.0.trial188.stdout:3456: oid 24 updating version 0 to 1724 2026-02-13T20:26:51.234 INFO:tasks.rados.rados.0.trial188.stdout:3456: oid 24 updating version 1724 to 1725 2026-02-13T20:26:51.234 INFO:tasks.rados.rados.0.trial188.stdout:3456: oid 24 version 1725 is already newer than 1723 2026-02-13T20:26:51.234 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 24 v 1725 (ObjNum 1191 snap 364 seq_num 1191) dirty exists 2026-02-13T20:26:51.234 INFO:tasks.rados.rados.0.trial188.stdout:3456: left oid 24 (ObjNum 1191 snap 364 seq_num 1191) 2026-02-13T20:26:51.786 INFO:tasks.rados.rados.0.trial188.stdout:3453: done (6 left) 2026-02-13T20:26:51.786 INFO:tasks.rados.rados.0.trial188.stdout:3454: done (5 left) 2026-02-13T20:26:51.786 INFO:tasks.rados.rados.0.trial188.stdout:3456: done (4 left) 2026-02-13T20:26:51.786 INFO:tasks.rados.rados.0.trial188.stdout:3457: done (3 left) 2026-02-13T20:26:51.786 INFO:tasks.rados.rados.0.trial188.stdout:3458: done (2 left) 2026-02-13T20:26:51.786 INFO:tasks.rados.rados.0.trial188.stdout:3459: done (1 left) 2026-02-13T20:26:51.786 INFO:tasks.rados.rados.0.trial188.stdout:3460: done (0 left) 2026-02-13T20:26:51.787 INFO:tasks.rados.rados.0.trial188.stdout:3461: snap_create 2026-02-13T20:26:52.788 INFO:tasks.rados.rados.0.trial188.stdout:3461: done (0 left) 2026-02-13T20:26:52.788 INFO:tasks.rados.rados.0.trial188.stdout:3462: delete oid 49 current snap is 366 2026-02-13T20:26:52.790 INFO:tasks.rados.rados.0.trial188.stdout:3462: done (0 left) 2026-02-13T20:26:52.790 INFO:tasks.rados.rados.0.trial188.stdout:3463: write oid 36 current snap is 366 2026-02-13T20:26:52.790 INFO:tasks.rados.rados.0.trial188.stdout:3463: seq_num 1193 ranges {450751=723125,1945018=105733} 2026-02-13T20:26:52.795 INFO:tasks.rados.rados.0.trial188.stdout:3463: writing trial18843701-36 from 450751 to 1173876 tid 1 2026-02-13T20:26:52.798 INFO:tasks.rados.rados.0.trial188.stdout:3463: writing trial18843701-36 from 1945018 to 2050751 tid 2 2026-02-13T20:26:52.798 INFO:tasks.rados.rados.0.trial188.stdout:3464: write oid 38 current snap is 366 2026-02-13T20:26:52.798 INFO:tasks.rados.rados.0.trial188.stdout:3464: seq_num 1194 ranges {467558=514727,1719853=347705} 2026-02-13T20:26:52.802 INFO:tasks.rados.rados.0.trial188.stdout:3464: writing trial18843701-38 from 467558 to 982285 tid 1 2026-02-13T20:26:52.806 INFO:tasks.rados.rados.0.trial188.stdout:3464: writing trial18843701-38 from 1719853 to 2067558 tid 2 2026-02-13T20:26:52.806 INFO:tasks.rados.rados.0.trial188.stdout:3465: write (excl) oid 28 current snap is 366 2026-02-13T20:26:52.806 INFO:tasks.rados.rados.0.trial188.stdout:3465: seq_num 1195 ranges {484365=589976,1661982=422383} 2026-02-13T20:26:52.811 INFO:tasks.rados.rados.0.trial188.stdout:3465: writing trial18843701-28 from 484365 to 1074341 tid 1 2026-02-13T20:26:52.815 INFO:tasks.rados.rados.0.trial188.stdout:3465: writing trial18843701-28 from 1661982 to 2084365 tid 2 2026-02-13T20:26:52.815 INFO:tasks.rados.rados.0.trial188.stdout:3466: rollback oid 10 current snap is 366 2026-02-13T20:26:52.815 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 10 to 363 2026-02-13T20:26:52.815 INFO:tasks.rados.rados.0.trial188.stdout:3463: finishing write tid 1 to trial18843701-36 2026-02-13T20:26:52.815 INFO:tasks.rados.rados.0.trial188.stdout:3463: finishing write tid 2 to trial18843701-36 2026-02-13T20:26:52.815 INFO:tasks.rados.rados.0.trial188.stdout:3463: finishing write tid 3 to trial18843701-36 2026-02-13T20:26:52.815 INFO:tasks.rados.rados.0.trial188.stdout:3463: finishing write tid 4 to trial18843701-36 2026-02-13T20:26:52.815 INFO:tasks.rados.rados.0.trial188.stdout:3463: oid 36 updating version 0 to 1728 2026-02-13T20:26:52.815 INFO:tasks.rados.rados.0.trial188.stdout:3463: oid 36 updating version 1728 to 1729 2026-02-13T20:26:52.815 INFO:tasks.rados.rados.0.trial188.stdout:3463: oid 36 version 1729 is already newer than 1727 2026-02-13T20:26:52.815 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 36 v 1729 (ObjNum 1193 snap 366 seq_num 1193) dirty exists 2026-02-13T20:26:52.815 INFO:tasks.rados.rados.0.trial188.stdout:3463: left oid 36 (ObjNum 1193 snap 366 seq_num 1193) 2026-02-13T20:26:52.815 INFO:tasks.rados.rados.0.trial188.stdout:3463: done (3 left) 2026-02-13T20:26:52.815 INFO:tasks.rados.rados.0.trial188.stdout:3467: snap_remove snap 348 2026-02-13T20:26:53.747 INFO:tasks.rados.rados.0.trial188.stdout:3467: done (3 left) 2026-02-13T20:26:53.748 INFO:tasks.rados.rados.0.trial188.stdout:3468: write (excl) oid 15 current snap is 366 2026-02-13T20:26:53.748 INFO:tasks.rados.rados.0.trial188.stdout:3468: seq_num 1196 ranges {501172=665225,1720464=380708} 2026-02-13T20:26:53.752 INFO:tasks.rados.rados.0.trial188.stdout:3468: writing trial18843701-15 from 501172 to 1166397 tid 1 2026-02-13T20:26:53.756 INFO:tasks.rados.rados.0.trial188.stdout:3468: writing trial18843701-15 from 1720464 to 2101172 tid 2 2026-02-13T20:26:53.757 INFO:tasks.rados.rados.0.trial188.stdout:3469: delete oid 46 current snap is 366 2026-02-13T20:26:53.757 INFO:tasks.rados.rados.0.trial188.stdout:3466: finishing rollback tid 0 to trial18843701-10 2026-02-13T20:26:53.757 INFO:tasks.rados.rados.0.trial188.stdout:3466: finishing rollback tid 1 to trial18843701-10 2026-02-13T20:26:53.757 INFO:tasks.rados.rados.0.trial188.stdout:3466: finishing rollback tid 2 to trial18843701-10 2026-02-13T20:26:53.757 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 10 v 1610 (ObjNum 1135 snap 341 seq_num 1135) dirty exists 2026-02-13T20:26:53.757 INFO:tasks.rados.rados.0.trial188.stdout:3464: finishing write tid 1 to trial18843701-38 2026-02-13T20:26:53.757 INFO:tasks.rados.rados.0.trial188.stdout:3464: finishing write tid 2 to trial18843701-38 2026-02-13T20:26:53.757 INFO:tasks.rados.rados.0.trial188.stdout:3465: finishing write tid 1 to trial18843701-28 2026-02-13T20:26:53.757 INFO:tasks.rados.rados.0.trial188.stdout:3464: finishing write tid 3 to trial18843701-38 2026-02-13T20:26:53.758 INFO:tasks.rados.rados.0.trial188.stdout:3465: finishing write tid 2 to trial18843701-28 2026-02-13T20:26:53.758 INFO:tasks.rados.rados.0.trial188.stdout:3465: finishing write tid 3 to trial18843701-28 2026-02-13T20:26:53.758 INFO:tasks.rados.rados.0.trial188.stdout:3464: finishing write tid 4 to trial18843701-38 2026-02-13T20:26:53.758 INFO:tasks.rados.rados.0.trial188.stdout:3464: oid 38 updating version 0 to 1618 2026-02-13T20:26:53.758 INFO:tasks.rados.rados.0.trial188.stdout:3464: oid 38 updating version 1618 to 1619 2026-02-13T20:26:53.758 INFO:tasks.rados.rados.0.trial188.stdout:3464: oid 38 version 1619 is already newer than 1617 2026-02-13T20:26:53.758 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 38 v 1619 (ObjNum 1194 snap 366 seq_num 1194) dirty exists 2026-02-13T20:26:53.758 INFO:tasks.rados.rados.0.trial188.stdout:3464: left oid 38 (ObjNum 1194 snap 366 seq_num 1194) 2026-02-13T20:26:53.758 INFO:tasks.rados.rados.0.trial188.stdout:3465: finishing write tid 4 to trial18843701-28 2026-02-13T20:26:53.758 INFO:tasks.rados.rados.0.trial188.stdout:3465: oid 28 updating version 0 to 1661 2026-02-13T20:26:53.759 INFO:tasks.rados.rados.0.trial188.stdout:3465: oid 28 updating version 1661 to 1662 2026-02-13T20:26:53.759 INFO:tasks.rados.rados.0.trial188.stdout:3465: oid 28 version 1662 is already newer than 1660 2026-02-13T20:26:53.759 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 28 v 1662 (ObjNum 1195 snap 366 seq_num 1195) dirty exists 2026-02-13T20:26:53.759 INFO:tasks.rados.rados.0.trial188.stdout:3465: left oid 28 (ObjNum 1195 snap 366 seq_num 1195) 2026-02-13T20:26:53.760 INFO:tasks.rados.rados.0.trial188.stdout:3464: done (4 left) 2026-02-13T20:26:53.760 INFO:tasks.rados.rados.0.trial188.stdout:3465: done (3 left) 2026-02-13T20:26:53.760 INFO:tasks.rados.rados.0.trial188.stdout:3466: done (2 left) 2026-02-13T20:26:53.760 INFO:tasks.rados.rados.0.trial188.stdout:3469: done (1 left) 2026-02-13T20:26:53.760 INFO:tasks.rados.rados.0.trial188.stdout:3470: write oid 32 current snap is 366 2026-02-13T20:26:53.760 INFO:tasks.rados.rados.0.trial188.stdout:3470: seq_num 1198 ranges {534786=415723,1437428=697358} 2026-02-13T20:26:53.761 INFO:tasks.rados.rados.0.trial188.stdout:3470: writing trial18843701-32 from 534786 to 950509 tid 1 2026-02-13T20:26:53.766 INFO:tasks.rados.rados.0.trial188.stdout:3470: writing trial18843701-32 from 1437428 to 2134786 tid 2 2026-02-13T20:26:53.766 INFO:tasks.rados.rados.0.trial188.stdout:3471: snap_create 2026-02-13T20:26:53.770 INFO:tasks.rados.rados.0.trial188.stdout:3468: finishing write tid 1 to trial18843701-15 2026-02-13T20:26:53.771 INFO:tasks.rados.rados.0.trial188.stdout:3468: finishing write tid 2 to trial18843701-15 2026-02-13T20:26:53.771 INFO:tasks.rados.rados.0.trial188.stdout:3468: finishing write tid 3 to trial18843701-15 2026-02-13T20:26:53.771 INFO:tasks.rados.rados.0.trial188.stdout:3468: finishing write tid 4 to trial18843701-15 2026-02-13T20:26:53.771 INFO:tasks.rados.rados.0.trial188.stdout:3468: oid 15 updating version 0 to 1521 2026-02-13T20:26:53.771 INFO:tasks.rados.rados.0.trial188.stdout:3468: oid 15 updating version 1521 to 1522 2026-02-13T20:26:53.771 INFO:tasks.rados.rados.0.trial188.stdout:3468: oid 15 version 1522 is already newer than 1520 2026-02-13T20:26:53.771 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 15 v 1522 (ObjNum 1196 snap 366 seq_num 1196) dirty exists 2026-02-13T20:26:53.771 INFO:tasks.rados.rados.0.trial188.stdout:3468: left oid 15 (ObjNum 1196 snap 366 seq_num 1196) 2026-02-13T20:26:53.780 INFO:tasks.rados.rados.0.trial188.stdout:3470: finishing write tid 1 to trial18843701-32 2026-02-13T20:26:53.780 INFO:tasks.rados.rados.0.trial188.stdout:3470: finishing write tid 2 to trial18843701-32 2026-02-13T20:26:53.780 INFO:tasks.rados.rados.0.trial188.stdout:3470: finishing write tid 3 to trial18843701-32 2026-02-13T20:26:53.780 INFO:tasks.rados.rados.0.trial188.stdout:3470: finishing write tid 4 to trial18843701-32 2026-02-13T20:26:53.781 INFO:tasks.rados.rados.0.trial188.stdout:3470: oid 32 updating version 0 to 1493 2026-02-13T20:26:53.781 INFO:tasks.rados.rados.0.trial188.stdout:3470: oid 32 version 1493 is already newer than 1492 2026-02-13T20:26:53.781 INFO:tasks.rados.rados.0.trial188.stdout:3470: oid 32 updating version 1493 to 1494 2026-02-13T20:26:53.781 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 32 v 1494 (ObjNum 1198 snap 366 seq_num 1198) dirty exists 2026-02-13T20:26:53.781 INFO:tasks.rados.rados.0.trial188.stdout:3470: left oid 32 (ObjNum 1198 snap 366 seq_num 1198) 2026-02-13T20:26:54.749 INFO:tasks.rados.rados.0.trial188.stdout:3468: done (2 left) 2026-02-13T20:26:54.749 INFO:tasks.rados.rados.0.trial188.stdout:3470: done (1 left) 2026-02-13T20:26:54.749 INFO:tasks.rados.rados.0.trial188.stdout:3471: done (0 left) 2026-02-13T20:26:54.750 INFO:tasks.rados.rados.0.trial188.stdout:3472: rollback oid 39 current snap is 367 2026-02-13T20:26:54.750 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 39 to 365 2026-02-13T20:26:54.750 INFO:tasks.rados.rados.0.trial188.stdout:3473: write oid 38 current snap is 367 2026-02-13T20:26:54.750 INFO:tasks.rados.rados.0.trial188.stdout:3473: seq_num 1199 ranges {551593=490972,1779557=372036} 2026-02-13T20:26:54.753 INFO:tasks.rados.rados.0.trial188.stdout:3473: writing trial18843701-38 from 551593 to 1042565 tid 1 2026-02-13T20:26:54.758 INFO:tasks.rados.rados.0.trial188.stdout:3473: writing trial18843701-38 from 1779557 to 2151593 tid 2 2026-02-13T20:26:54.758 INFO:tasks.rados.rados.0.trial188.stdout:3474: write oid 29 current snap is 367 2026-02-13T20:26:54.758 INFO:tasks.rados.rados.0.trial188.stdout:3472: finishing rollback tid 0 to trial18843701-39 2026-02-13T20:26:54.758 INFO:tasks.rados.rados.0.trial188.stdout:3472: finishing rollback tid 1 to trial18843701-39 2026-02-13T20:26:54.758 INFO:tasks.rados.rados.0.trial188.stdout:3472: finishing rollback tid 2 to trial18843701-39 2026-02-13T20:26:54.758 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 39 v 1627 (ObjNum 1188 snap 364 seq_num 1188) dirty exists 2026-02-13T20:26:54.758 INFO:tasks.rados.rados.0.trial188.stdout:3474: seq_num 1200 ranges {568400=566221,1838039=330361} 2026-02-13T20:26:54.762 INFO:tasks.rados.rados.0.trial188.stdout:3474: writing trial18843701-29 from 568400 to 1134621 tid 1 2026-02-13T20:26:54.766 INFO:tasks.rados.rados.0.trial188.stdout:3474: writing trial18843701-29 from 1838039 to 2168400 tid 2 2026-02-13T20:26:54.766 INFO:tasks.rados.rados.0.trial188.stdout:3472: done (2 left) 2026-02-13T20:26:54.766 INFO:tasks.rados.rados.0.trial188.stdout:3475: write oid 36 current snap is 367 2026-02-13T20:26:54.766 INFO:tasks.rados.rados.0.trial188.stdout:3475: seq_num 1201 ranges {585207=641470,1896521=288686} 2026-02-13T20:26:54.770 INFO:tasks.rados.rados.0.trial188.stdout:3475: writing trial18843701-36 from 585207 to 1226677 tid 1 2026-02-13T20:26:54.775 INFO:tasks.rados.rados.0.trial188.stdout:3475: writing trial18843701-36 from 1896521 to 2185207 tid 2 2026-02-13T20:26:54.775 INFO:tasks.rados.rados.0.trial188.stdout:3476: rollback oid 35 current snap is 367 2026-02-13T20:26:54.775 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 35 to 349 2026-02-13T20:26:54.775 INFO:tasks.rados.rados.0.trial188.stdout:3473: finishing write tid 1 to trial18843701-38 2026-02-13T20:26:54.775 INFO:tasks.rados.rados.0.trial188.stdout:3473: finishing write tid 2 to trial18843701-38 2026-02-13T20:26:54.775 INFO:tasks.rados.rados.0.trial188.stdout:3473: finishing write tid 3 to trial18843701-38 2026-02-13T20:26:54.775 INFO:tasks.rados.rados.0.trial188.stdout:3473: finishing write tid 4 to trial18843701-38 2026-02-13T20:26:54.775 INFO:tasks.rados.rados.0.trial188.stdout:3473: oid 38 updating version 0 to 1621 2026-02-13T20:26:54.775 INFO:tasks.rados.rados.0.trial188.stdout:3473: oid 38 updating version 1621 to 1622 2026-02-13T20:26:54.776 INFO:tasks.rados.rados.0.trial188.stdout:3473: oid 38 version 1622 is already newer than 1620 2026-02-13T20:26:54.776 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 38 v 1622 (ObjNum 1199 snap 367 seq_num 1199) dirty exists 2026-02-13T20:26:54.776 INFO:tasks.rados.rados.0.trial188.stdout:3473: left oid 38 (ObjNum 1199 snap 367 seq_num 1199) 2026-02-13T20:26:54.776 INFO:tasks.rados.rados.0.trial188.stdout:3473: done (3 left) 2026-02-13T20:26:54.776 INFO:tasks.rados.rados.0.trial188.stdout:3477: rollback oid 30 current snap is 367 2026-02-13T20:26:54.776 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 30 to 364 2026-02-13T20:26:54.776 INFO:tasks.rados.rados.0.trial188.stdout:3478: read oid 47 snap -1 2026-02-13T20:26:54.776 INFO:tasks.rados.rados.0.trial188.stdout:3478: expect (ObjNum 1007 snap 299 seq_num 1007) 2026-02-13T20:26:54.776 INFO:tasks.rados.rados.0.trial188.stdout:3479: write oid 31 current snap is 367 2026-02-13T20:26:54.776 INFO:tasks.rados.rados.0.trial188.stdout:3479: seq_num 1202 ranges {602014=433072,1671356=530658} 2026-02-13T20:26:54.778 INFO:tasks.rados.rados.0.trial188.stdout:3479: writing trial18843701-31 from 602014 to 1035086 tid 1 2026-02-13T20:26:54.783 INFO:tasks.rados.rados.0.trial188.stdout:3479: writing trial18843701-31 from 1671356 to 2202014 tid 2 2026-02-13T20:26:54.783 INFO:tasks.rados.rados.0.trial188.stdout:3480: rollback oid 3 current snap is 367 2026-02-13T20:26:54.783 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 3 to 346 2026-02-13T20:26:54.783 INFO:tasks.rados.rados.0.trial188.stdout:3474: finishing write tid 1 to trial18843701-29 2026-02-13T20:26:54.783 INFO:tasks.rados.rados.0.trial188.stdout:3474: finishing write tid 2 to trial18843701-29 2026-02-13T20:26:54.783 INFO:tasks.rados.rados.0.trial188.stdout:3481: delete oid 11 current snap is 367 2026-02-13T20:26:54.783 INFO:tasks.rados.rados.0.trial188.stdout:3477: finishing rollback tid 1 to trial18843701-30 2026-02-13T20:26:54.784 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 30 v 1612 (ObjNum 33 snap 0 seq_num 15082096) dirty dne 2026-02-13T20:26:54.785 INFO:tasks.rados.rados.0.trial188.stdout:3478: expect (ObjNum 1007 snap 299 seq_num 1007) 2026-02-13T20:26:54.824 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1120369 2026-02-13T20:26:54.850 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 121646 2026-02-13T20:26:54.883 INFO:tasks.rados.rados.0.trial188.stdout:3476: finishing rollback tid 0 to trial18843701-35 2026-02-13T20:26:54.883 INFO:tasks.rados.rados.0.trial188.stdout:3474: finishing write tid 3 to trial18843701-29 2026-02-13T20:26:54.883 INFO:tasks.rados.rados.0.trial188.stdout:3474: finishing write tid 4 to trial18843701-29 2026-02-13T20:26:54.883 INFO:tasks.rados.rados.0.trial188.stdout:3474: oid 29 updating version 0 to 1630 2026-02-13T20:26:54.883 INFO:tasks.rados.rados.0.trial188.stdout:3474: oid 29 version 1630 is already newer than 1629 2026-02-13T20:26:54.883 INFO:tasks.rados.rados.0.trial188.stdout:3474: oid 29 version 1630 is already newer than 1628 2026-02-13T20:26:54.883 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 29 v 1630 (ObjNum 1200 snap 367 seq_num 1200) dirty exists 2026-02-13T20:26:54.883 INFO:tasks.rados.rados.0.trial188.stdout:3474: left oid 29 (ObjNum 1200 snap 367 seq_num 1200) 2026-02-13T20:26:54.883 INFO:tasks.rados.rados.0.trial188.stdout:3476: finishing rollback tid 1 to trial18843701-35 2026-02-13T20:26:54.884 INFO:tasks.rados.rados.0.trial188.stdout:3476: finishing rollback tid 2 to trial18843701-35 2026-02-13T20:26:54.884 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 35 v 1543 (ObjNum 1151 snap 347 seq_num 1151) dirty exists 2026-02-13T20:26:54.884 INFO:tasks.rados.rados.0.trial188.stdout:3479: finishing write tid 1 to trial18843701-31 2026-02-13T20:26:54.884 INFO:tasks.rados.rados.0.trial188.stdout:3475: finishing write tid 1 to trial18843701-36 2026-02-13T20:26:54.884 INFO:tasks.rados.rados.0.trial188.stdout:3474: done (7 left) 2026-02-13T20:26:54.884 INFO:tasks.rados.rados.0.trial188.stdout:3476: done (6 left) 2026-02-13T20:26:54.884 INFO:tasks.rados.rados.0.trial188.stdout:3477: done (5 left) 2026-02-13T20:26:54.884 INFO:tasks.rados.rados.0.trial188.stdout:3478: done (4 left) 2026-02-13T20:26:54.884 INFO:tasks.rados.rados.0.trial188.stdout:3481: done (3 left) 2026-02-13T20:26:54.884 INFO:tasks.rados.rados.0.trial188.stdout:3482: snap_remove snap 357 2026-02-13T20:26:55.791 INFO:tasks.rados.rados.0.trial188.stdout:3482: done (3 left) 2026-02-13T20:26:55.791 INFO:tasks.rados.rados.0.trial188.stdout:3483: read oid 33 snap -1 2026-02-13T20:26:55.791 INFO:tasks.rados.rados.0.trial188.stdout:3483: expect (ObjNum 1102 snap 326 seq_num 1102) 2026-02-13T20:26:55.791 INFO:tasks.rados.rados.0.trial188.stdout:3484: write (excl) oid 34 current snap is 367 2026-02-13T20:26:55.791 INFO:tasks.rados.rados.0.trial188.stdout:3484: seq_num 1204 ranges {635628=583570,1671967=563661} 2026-02-13T20:26:55.795 INFO:tasks.rados.rados.0.trial188.stdout:3484: writing trial18843701-34 from 635628 to 1219198 tid 1 2026-02-13T20:26:55.799 INFO:tasks.rados.rados.0.trial188.stdout:3484: writing trial18843701-34 from 1671967 to 2235628 tid 2 2026-02-13T20:26:55.800 INFO:tasks.rados.rados.0.trial188.stdout:3485: snap_create 2026-02-13T20:26:55.800 INFO:tasks.rados.rados.0.trial188.stdout:3479: finishing write tid 2 to trial18843701-31 2026-02-13T20:26:55.800 INFO:tasks.rados.rados.0.trial188.stdout:3475: finishing write tid 2 to trial18843701-36 2026-02-13T20:26:55.800 INFO:tasks.rados.rados.0.trial188.stdout:3475: finishing write tid 3 to trial18843701-36 2026-02-13T20:26:55.800 INFO:tasks.rados.rados.0.trial188.stdout:3475: finishing write tid 4 to trial18843701-36 2026-02-13T20:26:55.800 INFO:tasks.rados.rados.0.trial188.stdout:3475: oid 36 updating version 0 to 1743 2026-02-13T20:26:55.800 INFO:tasks.rados.rados.0.trial188.stdout:3475: oid 36 version 1743 is already newer than 1741 2026-02-13T20:26:55.800 INFO:tasks.rados.rados.0.trial188.stdout:3475: oid 36 version 1743 is already newer than 1742 2026-02-13T20:26:55.800 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 36 v 1743 (ObjNum 1201 snap 367 seq_num 1201) dirty exists 2026-02-13T20:26:55.800 INFO:tasks.rados.rados.0.trial188.stdout:3475: left oid 36 (ObjNum 1201 snap 367 seq_num 1201) 2026-02-13T20:26:55.801 INFO:tasks.rados.rados.0.trial188.stdout:3479: finishing write tid 3 to trial18843701-31 2026-02-13T20:26:55.801 INFO:tasks.rados.rados.0.trial188.stdout:3480: finishing rollback tid 0 to trial18843701-3 2026-02-13T20:26:55.801 INFO:tasks.rados.rados.0.trial188.stdout:3479: finishing write tid 4 to trial18843701-31 2026-02-13T20:26:55.801 INFO:tasks.rados.rados.0.trial188.stdout:3479: oid 31 updating version 0 to 1450 2026-02-13T20:26:55.801 INFO:tasks.rados.rados.0.trial188.stdout:3479: oid 31 updating version 1450 to 1451 2026-02-13T20:26:55.801 INFO:tasks.rados.rados.0.trial188.stdout:3479: oid 31 updating version 1451 to 1452 2026-02-13T20:26:55.801 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 31 v 1452 (ObjNum 1202 snap 367 seq_num 1202) dirty exists 2026-02-13T20:26:55.801 INFO:tasks.rados.rados.0.trial188.stdout:3479: left oid 31 (ObjNum 1202 snap 367 seq_num 1202) 2026-02-13T20:26:55.801 INFO:tasks.rados.rados.0.trial188.stdout:3480: finishing rollback tid 1 to trial18843701-3 2026-02-13T20:26:55.801 INFO:tasks.rados.rados.0.trial188.stdout:3480: finishing rollback tid 2 to trial18843701-3 2026-02-13T20:26:55.802 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 3 v 1525 (ObjNum 1131 snap 341 seq_num 1131) dirty exists 2026-02-13T20:26:55.802 INFO:tasks.rados.rados.0.trial188.stdout:3483: expect (ObjNum 1102 snap 326 seq_num 1102) 2026-02-13T20:26:55.847 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:26:55.953 INFO:tasks.rados.rados.0.trial188.stdout:3484: finishing write tid 1 to trial18843701-34 2026-02-13T20:26:55.953 INFO:tasks.rados.rados.0.trial188.stdout:3484: finishing write tid 2 to trial18843701-34 2026-02-13T20:26:55.953 INFO:tasks.rados.rados.0.trial188.stdout:3484: finishing write tid 3 to trial18843701-34 2026-02-13T20:26:55.953 INFO:tasks.rados.rados.0.trial188.stdout:3484: finishing write tid 4 to trial18843701-34 2026-02-13T20:26:55.953 INFO:tasks.rados.rados.0.trial188.stdout:3484: oid 34 updating version 0 to 1670 2026-02-13T20:26:55.953 INFO:tasks.rados.rados.0.trial188.stdout:3484: oid 34 version 1670 is already newer than 1668 2026-02-13T20:26:55.953 INFO:tasks.rados.rados.0.trial188.stdout:3484: oid 34 version 1670 is already newer than 1669 2026-02-13T20:26:55.954 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 34 v 1670 (ObjNum 1204 snap 367 seq_num 1204) dirty exists 2026-02-13T20:26:55.954 INFO:tasks.rados.rados.0.trial188.stdout:3484: left oid 34 (ObjNum 1204 snap 367 seq_num 1204) 2026-02-13T20:26:56.795 INFO:tasks.rados.rados.0.trial188.stdout:3475: done (5 left) 2026-02-13T20:26:56.795 INFO:tasks.rados.rados.0.trial188.stdout:3479: done (4 left) 2026-02-13T20:26:56.795 INFO:tasks.rados.rados.0.trial188.stdout:3480: done (3 left) 2026-02-13T20:26:56.795 INFO:tasks.rados.rados.0.trial188.stdout:3483: done (2 left) 2026-02-13T20:26:56.795 INFO:tasks.rados.rados.0.trial188.stdout:3484: done (1 left) 2026-02-13T20:26:56.795 INFO:tasks.rados.rados.0.trial188.stdout:3485: done (0 left) 2026-02-13T20:26:56.796 INFO:tasks.rados.rados.0.trial188.stdout:3486: snap_create 2026-02-13T20:26:57.796 INFO:tasks.rados.rados.0.trial188.stdout:3486: done (0 left) 2026-02-13T20:26:57.796 INFO:tasks.rados.rados.0.trial188.stdout:3487: read oid 30 snap 351 2026-02-13T20:26:57.796 INFO:tasks.rados.rados.0.trial188.stdout:3487: expect (ObjNum 1153 snap 347 seq_num 1153) 2026-02-13T20:26:57.796 INFO:tasks.rados.rados.0.trial188.stdout:3488: copy_from oid 20 from oid 6 current snap is 369 2026-02-13T20:26:57.796 INFO:tasks.rados.rados.0.trial188.stdout:3489: read oid 48 snap -1 2026-02-13T20:26:57.796 INFO:tasks.rados.rados.0.trial188.stdout:3489: expect (ObjNum 1007 snap 299 seq_num 1007) 2026-02-13T20:26:57.797 INFO:tasks.rados.rados.0.trial188.stdout:3490: delete oid 44 current snap is 369 2026-02-13T20:26:57.797 INFO:tasks.rados.rados.0.trial188.stdout:3488: finishing copy_from to trial18843701-20 2026-02-13T20:26:57.797 INFO:tasks.rados.rados.0.trial188.stdout:3488: got expected ENOENT (src dne) 2026-02-13T20:26:57.797 INFO:tasks.rados.rados.0.trial188.stdout:3488: finishing copy_from racing read to trial18843701-20 2026-02-13T20:26:57.799 INFO:tasks.rados.rados.0.trial188.stdout:3488: done (3 left) 2026-02-13T20:26:57.800 INFO:tasks.rados.rados.0.trial188.stdout:3490: done (2 left) 2026-02-13T20:26:57.800 INFO:tasks.rados.rados.0.trial188.stdout:3491: copy_from oid 12 from oid 11 current snap is 369 2026-02-13T20:26:57.800 INFO:tasks.rados.rados.0.trial188.stdout:3492: snap_remove snap 355 2026-02-13T20:26:58.749 INFO:tasks.rados.rados.0.trial188.stdout:3492: done (3 left) 2026-02-13T20:26:58.749 INFO:tasks.rados.rados.0.trial188.stdout:3493: write oid 17 current snap is 369 2026-02-13T20:26:58.750 INFO:tasks.rados.rados.0.trial188.stdout:3493: seq_num 1206 ranges {669242=734068,2188931=80311} 2026-02-13T20:26:58.754 INFO:tasks.rados.rados.0.trial188.stdout:3493: writing trial18843701-17 from 669242 to 1403310 tid 1 2026-02-13T20:26:58.758 INFO:tasks.rados.rados.0.trial188.stdout:3493: writing trial18843701-17 from 2188931 to 2269242 tid 2 2026-02-13T20:26:58.759 INFO:tasks.rados.rados.0.trial188.stdout:3494: read oid 9 snap -1 2026-02-13T20:26:58.759 INFO:tasks.rados.rados.0.trial188.stdout:3494: expect (ObjNum 1154 snap 347 seq_num 1154) 2026-02-13T20:26:58.759 INFO:tasks.rados.rados.0.trial188.stdout:3495: read oid 44 snap 359 2026-02-13T20:26:58.759 INFO:tasks.rados.rados.0.trial188.stdout:3495: expect (ObjNum 1100 snap 326 seq_num 1100) 2026-02-13T20:26:58.759 INFO:tasks.rados.rados.0.trial188.stdout:3496: rollback oid 20 current snap is 369 2026-02-13T20:26:58.759 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 20 to 351 2026-02-13T20:26:58.759 INFO:tasks.rados.rados.0.trial188.stdout:3491: finishing copy_from to trial18843701-12 2026-02-13T20:26:58.759 INFO:tasks.rados.rados.0.trial188.stdout:3491: got expected ENOENT (src dne) 2026-02-13T20:26:58.759 INFO:tasks.rados.rados.0.trial188.stdout:3491: finishing copy_from racing read to trial18843701-12 2026-02-13T20:26:58.759 INFO:tasks.rados.rados.0.trial188.stdout:3487: expect (ObjNum 1153 snap 347 seq_num 1153) 2026-02-13T20:26:58.761 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 831129 2026-02-13T20:26:58.794 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1465532 2026-02-13T20:26:58.811 INFO:tasks.rados.rados.0.trial188.stdout:3489: expect (ObjNum 1007 snap 299 seq_num 1007) 2026-02-13T20:26:58.811 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:26:58.906 INFO:tasks.rados.rados.0.trial188.stdout:3487: done (6 left) 2026-02-13T20:26:58.906 INFO:tasks.rados.rados.0.trial188.stdout:3489: done (5 left) 2026-02-13T20:26:58.906 INFO:tasks.rados.rados.0.trial188.stdout:3491: done (4 left) 2026-02-13T20:26:58.907 INFO:tasks.rados.rados.0.trial188.stdout:3497: write (excl) oid 25 current snap is 369 2026-02-13T20:26:58.907 INFO:tasks.rados.rados.0.trial188.stdout:3496: finishing rollback tid 0 to trial18843701-20 2026-02-13T20:26:58.907 INFO:tasks.rados.rados.0.trial188.stdout:3496: finishing rollback tid 1 to trial18843701-20 2026-02-13T20:26:58.907 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 20 v 1255 (ObjNum 289 snap 0 seq_num 1) dirty dne 2026-02-13T20:26:58.907 INFO:tasks.rados.rados.0.trial188.stdout:3495: expect (ObjNum 1100 snap 326 seq_num 1100) 2026-02-13T20:26:58.956 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:26:58.981 INFO:tasks.rados.rados.0.trial188.stdout:3494: expect (ObjNum 1154 snap 347 seq_num 1154) 2026-02-13T20:26:59.166 INFO:tasks.rados.rados.0.trial188.stdout:3493: finishing write tid 1 to trial18843701-17 2026-02-13T20:26:59.166 INFO:tasks.rados.rados.0.trial188.stdout:3493: finishing write tid 2 to trial18843701-17 2026-02-13T20:26:59.166 INFO:tasks.rados.rados.0.trial188.stdout:3497: seq_num 1207 ranges {686049=409317,1847413=438636} 2026-02-13T20:26:59.169 INFO:tasks.rados.rados.0.trial188.stdout:3497: writing trial18843701-25 from 686049 to 1095366 tid 1 2026-02-13T20:26:59.174 INFO:tasks.rados.rados.0.trial188.stdout:3497: writing trial18843701-25 from 1847413 to 2286049 tid 2 2026-02-13T20:26:59.174 INFO:tasks.rados.rados.0.trial188.stdout:3494: done (4 left) 2026-02-13T20:26:59.175 INFO:tasks.rados.rados.0.trial188.stdout:3495: done (3 left) 2026-02-13T20:26:59.175 INFO:tasks.rados.rados.0.trial188.stdout:3496: done (2 left) 2026-02-13T20:26:59.175 INFO:tasks.rados.rados.0.trial188.stdout:3498: write oid 31 current snap is 369 2026-02-13T20:26:59.175 INFO:tasks.rados.rados.0.trial188.stdout:3498: seq_num 1208 ranges {702856=484566,1789542=513314} 2026-02-13T20:26:59.178 INFO:tasks.rados.rados.0.trial188.stdout:3498: writing trial18843701-31 from 702856 to 1187422 tid 1 2026-02-13T20:26:59.183 INFO:tasks.rados.rados.0.trial188.stdout:3498: writing trial18843701-31 from 1789542 to 2302856 tid 2 2026-02-13T20:26:59.183 INFO:tasks.rados.rados.0.trial188.stdout:3499: read oid 12 snap 363 2026-02-13T20:26:59.183 INFO:tasks.rados.rados.0.trial188.stdout:3499: expect (ObjNum 865 snap 250 seq_num 865) 2026-02-13T20:26:59.183 INFO:tasks.rados.rados.0.trial188.stdout:3500: delete oid 22 current snap is 369 2026-02-13T20:26:59.184 INFO:tasks.rados.rados.0.trial188.stdout:3493: finishing write tid 3 to trial18843701-17 2026-02-13T20:26:59.184 INFO:tasks.rados.rados.0.trial188.stdout:3493: finishing write tid 4 to trial18843701-17 2026-02-13T20:26:59.184 INFO:tasks.rados.rados.0.trial188.stdout:3493: oid 17 updating version 0 to 1509 2026-02-13T20:26:59.184 INFO:tasks.rados.rados.0.trial188.stdout:3493: oid 17 version 1509 is already newer than 1507 2026-02-13T20:26:59.184 INFO:tasks.rados.rados.0.trial188.stdout:3493: oid 17 version 1509 is already newer than 1508 2026-02-13T20:26:59.184 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 17 v 1509 (ObjNum 1206 snap 369 seq_num 1206) dirty exists 2026-02-13T20:26:59.184 INFO:tasks.rados.rados.0.trial188.stdout:3493: left oid 17 (ObjNum 1206 snap 369 seq_num 1206) 2026-02-13T20:26:59.185 INFO:tasks.rados.rados.0.trial188.stdout:3493: done (4 left) 2026-02-13T20:26:59.185 INFO:tasks.rados.rados.0.trial188.stdout:3500: done (3 left) 2026-02-13T20:26:59.185 INFO:tasks.rados.rados.0.trial188.stdout:3501: snap_remove snap 364 2026-02-13T20:26:59.802 INFO:tasks.rados.rados.0.trial188.stdout:3501: done (3 left) 2026-02-13T20:26:59.802 INFO:tasks.rados.rados.0.trial188.stdout:3502: write oid 10 current snap is 369 2026-02-13T20:26:59.802 INFO:tasks.rados.rados.0.trial188.stdout:3497: finishing write tid 1 to trial18843701-25 2026-02-13T20:26:59.803 INFO:tasks.rados.rados.0.trial188.stdout:3502: seq_num 1210 ranges {736470=751417,2022859=313611} 2026-02-13T20:26:59.808 INFO:tasks.rados.rados.0.trial188.stdout:3502: writing trial18843701-10 from 736470 to 1487887 tid 1 2026-02-13T20:26:59.811 INFO:tasks.rados.rados.0.trial188.stdout:3502: writing trial18843701-10 from 2022859 to 2336470 tid 2 2026-02-13T20:26:59.811 INFO:tasks.rados.rados.0.trial188.stdout:3503: snap_create 2026-02-13T20:26:59.812 INFO:tasks.rados.rados.0.trial188.stdout:3497: finishing write tid 2 to trial18843701-25 2026-02-13T20:26:59.812 INFO:tasks.rados.rados.0.trial188.stdout:3497: finishing write tid 3 to trial18843701-25 2026-02-13T20:26:59.812 INFO:tasks.rados.rados.0.trial188.stdout:3497: finishing write tid 4 to trial18843701-25 2026-02-13T20:26:59.812 INFO:tasks.rados.rados.0.trial188.stdout:3497: oid 25 updating version 0 to 1624 2026-02-13T20:26:59.812 INFO:tasks.rados.rados.0.trial188.stdout:3497: oid 25 updating version 1624 to 1625 2026-02-13T20:26:59.812 INFO:tasks.rados.rados.0.trial188.stdout:3497: oid 25 version 1625 is already newer than 1623 2026-02-13T20:26:59.812 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 25 v 1625 (ObjNum 1207 snap 369 seq_num 1207) dirty exists 2026-02-13T20:26:59.812 INFO:tasks.rados.rados.0.trial188.stdout:3497: left oid 25 (ObjNum 1207 snap 369 seq_num 1207) 2026-02-13T20:26:59.812 INFO:tasks.rados.rados.0.trial188.stdout:3498: finishing write tid 1 to trial18843701-31 2026-02-13T20:26:59.812 INFO:tasks.rados.rados.0.trial188.stdout:3498: finishing write tid 2 to trial18843701-31 2026-02-13T20:26:59.813 INFO:tasks.rados.rados.0.trial188.stdout:3498: finishing write tid 3 to trial18843701-31 2026-02-13T20:26:59.813 INFO:tasks.rados.rados.0.trial188.stdout:3499: expect (ObjNum 865 snap 250 seq_num 865) 2026-02-13T20:26:59.953 INFO:tasks.rados.rados.0.trial188.stdout:3498: finishing write tid 4 to trial18843701-31 2026-02-13T20:26:59.953 INFO:tasks.rados.rados.0.trial188.stdout:3498: oid 31 updating version 0 to 1454 2026-02-13T20:26:59.953 INFO:tasks.rados.rados.0.trial188.stdout:3498: oid 31 updating version 1454 to 1455 2026-02-13T20:26:59.953 INFO:tasks.rados.rados.0.trial188.stdout:3498: oid 31 version 1455 is already newer than 1453 2026-02-13T20:26:59.953 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 31 v 1455 (ObjNum 1208 snap 369 seq_num 1208) dirty exists 2026-02-13T20:26:59.954 INFO:tasks.rados.rados.0.trial188.stdout:3498: left oid 31 (ObjNum 1208 snap 369 seq_num 1208) 2026-02-13T20:26:59.954 INFO:tasks.rados.rados.0.trial188.stdout:3502: finishing write tid 1 to trial18843701-10 2026-02-13T20:26:59.954 INFO:tasks.rados.rados.0.trial188.stdout:3502: finishing write tid 2 to trial18843701-10 2026-02-13T20:26:59.954 INFO:tasks.rados.rados.0.trial188.stdout:3502: finishing write tid 3 to trial18843701-10 2026-02-13T20:26:59.954 INFO:tasks.rados.rados.0.trial188.stdout:3502: finishing write tid 4 to trial18843701-10 2026-02-13T20:26:59.954 INFO:tasks.rados.rados.0.trial188.stdout:3502: oid 10 updating version 0 to 1612 2026-02-13T20:26:59.954 INFO:tasks.rados.rados.0.trial188.stdout:3502: oid 10 updating version 1612 to 1614 2026-02-13T20:26:59.954 INFO:tasks.rados.rados.0.trial188.stdout:3502: oid 10 version 1614 is already newer than 1613 2026-02-13T20:26:59.954 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 10 v 1614 (ObjNum 1210 snap 369 seq_num 1210) dirty exists 2026-02-13T20:26:59.954 INFO:tasks.rados.rados.0.trial188.stdout:3502: left oid 10 (ObjNum 1210 snap 369 seq_num 1210) 2026-02-13T20:27:00.808 INFO:tasks.rados.rados.0.trial188.stdout:3497: done (4 left) 2026-02-13T20:27:00.809 INFO:tasks.rados.rados.0.trial188.stdout:3498: done (3 left) 2026-02-13T20:27:00.809 INFO:tasks.rados.rados.0.trial188.stdout:3499: done (2 left) 2026-02-13T20:27:00.809 INFO:tasks.rados.rados.0.trial188.stdout:3502: done (1 left) 2026-02-13T20:27:00.809 INFO:tasks.rados.rados.0.trial188.stdout:3503: done (0 left) 2026-02-13T20:27:00.809 INFO:tasks.rados.rados.0.trial188.stdout:3504: copy_from oid 19 from oid 15 current snap is 370 2026-02-13T20:27:00.809 INFO:tasks.rados.rados.0.trial188.stdout:3505: copy_from oid 12 from oid 49 current snap is 370 2026-02-13T20:27:00.809 INFO:tasks.rados.rados.0.trial188.stdout:3506: write (excl) oid 14 current snap is 370 2026-02-13T20:27:00.809 INFO:tasks.rados.rados.0.trial188.stdout:3506: seq_num 1211 ranges {753277=426666,1681341=545753} 2026-02-13T20:27:00.812 INFO:tasks.rados.rados.0.trial188.stdout:3506: writing trial18843701-14 from 753277 to 1179943 tid 1 2026-02-13T20:27:00.817 INFO:tasks.rados.rados.0.trial188.stdout:3506: writing trial18843701-14 from 1681341 to 2227094 tid 2 2026-02-13T20:27:00.817 INFO:tasks.rados.rados.0.trial188.stdout:3507: read oid 22 snap 365 2026-02-13T20:27:00.817 INFO:tasks.rados.rados.0.trial188.stdout:3507: expect (ObjNum 1007 snap 299 seq_num 1007) 2026-02-13T20:27:00.817 INFO:tasks.rados.rados.0.trial188.stdout:3508: rollback oid 10 current snap is 370 2026-02-13T20:27:00.818 INFO:tasks.rados.rados.0.trial188.stdout:3505: finishing copy_from to trial18843701-12 2026-02-13T20:27:00.818 INFO:tasks.rados.rados.0.trial188.stdout:3505: got expected ENOENT (src dne) 2026-02-13T20:27:00.818 INFO:tasks.rados.rados.0.trial188.stdout:3505: finishing copy_from racing read to trial18843701-12 2026-02-13T20:27:00.818 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 10 to 341 2026-02-13T20:27:00.818 INFO:tasks.rados.rados.0.trial188.stdout:3505: done (4 left) 2026-02-13T20:27:00.818 INFO:tasks.rados.rados.0.trial188.stdout:3509: rollback oid 46 current snap is 370 2026-02-13T20:27:00.818 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 46 to 341 2026-02-13T20:27:00.818 INFO:tasks.rados.rados.0.trial188.stdout:3510: delete oid 23 current snap is 370 2026-02-13T20:27:00.822 INFO:tasks.rados.rados.0.trial188.stdout:3508: finishing rollback tid 0 to trial18843701-10 2026-02-13T20:27:00.823 INFO:tasks.rados.rados.0.trial188.stdout:3508: finishing rollback tid 1 to trial18843701-10 2026-02-13T20:27:00.823 INFO:tasks.rados.rados.0.trial188.stdout:3508: finishing rollback tid 2 to trial18843701-10 2026-02-13T20:27:00.823 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 10 v 1617 (ObjNum 1135 snap 341 seq_num 1135) dirty exists 2026-02-13T20:27:00.824 INFO:tasks.rados.rados.0.trial188.stdout:3509: finishing rollback tid 1 to trial18843701-46 2026-02-13T20:27:00.824 INFO:tasks.rados.rados.0.trial188.stdout:3509: finishing rollback tid 2 to trial18843701-46 2026-02-13T20:27:00.824 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 46 v 1496 (ObjNum 1060 snap 316 seq_num 1060) dirty exists 2026-02-13T20:27:00.826 INFO:tasks.rados.rados.0.trial188.stdout:3507: expect (ObjNum 1007 snap 299 seq_num 1007) 2026-02-13T20:27:00.859 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:27:00.892 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:27:00.926 INFO:tasks.rados.rados.0.trial188.stdout:3506: finishing write tid 1 to trial18843701-14 2026-02-13T20:27:00.926 INFO:tasks.rados.rados.0.trial188.stdout:3506: finishing write tid 2 to trial18843701-14 2026-02-13T20:27:00.927 INFO:tasks.rados.rados.0.trial188.stdout:3506: finishing write tid 3 to trial18843701-14 2026-02-13T20:27:00.927 INFO:tasks.rados.rados.0.trial188.stdout:3506: finishing write tid 4 to trial18843701-14 2026-02-13T20:27:00.927 INFO:tasks.rados.rados.0.trial188.stdout:3506: oid 14 updating version 0 to 1526 2026-02-13T20:27:00.927 INFO:tasks.rados.rados.0.trial188.stdout:3506: oid 14 updating version 1526 to 1527 2026-02-13T20:27:00.927 INFO:tasks.rados.rados.0.trial188.stdout:3506: oid 14 updating version 1527 to 1528 2026-02-13T20:27:00.927 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 14 v 1528 (ObjNum 1211 snap 370 seq_num 1211) dirty exists 2026-02-13T20:27:00.927 INFO:tasks.rados.rados.0.trial188.stdout:3506: left oid 14 (ObjNum 1211 snap 370 seq_num 1211) 2026-02-13T20:27:00.927 INFO:tasks.rados.rados.0.trial188.stdout:3504: finishing copy_from racing read to trial18843701-19 2026-02-13T20:27:00.927 INFO:tasks.rados.rados.0.trial188.stdout:3506: done (5 left) 2026-02-13T20:27:00.927 INFO:tasks.rados.rados.0.trial188.stdout:3507: done (4 left) 2026-02-13T20:27:00.927 INFO:tasks.rados.rados.0.trial188.stdout:3508: done (3 left) 2026-02-13T20:27:00.928 INFO:tasks.rados.rados.0.trial188.stdout:3509: done (2 left) 2026-02-13T20:27:00.928 INFO:tasks.rados.rados.0.trial188.stdout:3510: done (1 left) 2026-02-13T20:27:00.928 INFO:tasks.rados.rados.0.trial188.stdout:3511: read oid 35 snap -1 2026-02-13T20:27:00.928 INFO:tasks.rados.rados.0.trial188.stdout:3511: expect (ObjNum 1151 snap 347 seq_num 1151) 2026-02-13T20:27:00.928 INFO:tasks.rados.rados.0.trial188.stdout:3512: delete oid 36 current snap is 370 2026-02-13T20:27:00.928 INFO:tasks.rados.rados.0.trial188.stdout:3504: finishing copy_from to trial18843701-19 2026-02-13T20:27:00.928 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 19 v 1522 (ObjNum 1196 snap 366 seq_num 1196) dirty exists 2026-02-13T20:27:00.929 INFO:tasks.rados.rados.0.trial188.stdout:3504: done (2 left) 2026-02-13T20:27:00.929 INFO:tasks.rados.rados.0.trial188.stdout:3512: done (1 left) 2026-02-13T20:27:00.929 INFO:tasks.rados.rados.0.trial188.stdout:3513: read oid 1 snap -1 2026-02-13T20:27:00.929 INFO:tasks.rados.rados.0.trial188.stdout:3513: expect (ObjNum 1189 snap 364 seq_num 1189) 2026-02-13T20:27:00.929 INFO:tasks.rados.rados.0.trial188.stdout:3514: snap_remove snap 366 2026-02-13T20:27:01.811 INFO:tasks.rados.rados.0.trial188.stdout:3514: done (2 left) 2026-02-13T20:27:01.811 INFO:tasks.rados.rados.0.trial188.stdout:3515: write oid 10 current snap is 370 2026-02-13T20:27:01.812 INFO:tasks.rados.rados.0.trial188.stdout:3515: seq_num 1214 ranges {403698=652413,1740434=663264} 2026-02-13T20:27:01.815 INFO:tasks.rados.rados.0.trial188.stdout:3515: writing trial18843701-10 from 403698 to 1056111 tid 1 2026-02-13T20:27:01.820 INFO:tasks.rados.rados.0.trial188.stdout:3515: writing trial18843701-10 from 1740434 to 2403698 tid 2 2026-02-13T20:27:01.820 INFO:tasks.rados.rados.0.trial188.stdout:3516: write oid 4 current snap is 370 2026-02-13T20:27:01.820 INFO:tasks.rados.rados.0.trial188.stdout:3516: seq_num 1215 ranges {420505=727662,1798916=553091} 2026-02-13T20:27:01.824 INFO:tasks.rados.rados.0.trial188.stdout:3516: writing trial18843701-4 from 420505 to 1148167 tid 1 2026-02-13T20:27:01.829 INFO:tasks.rados.rados.0.trial188.stdout:3516: writing trial18843701-4 from 1798916 to 2352007 tid 2 2026-02-13T20:27:01.829 INFO:tasks.rados.rados.0.trial188.stdout:3517: snap_remove snap 367 2026-02-13T20:27:02.814 INFO:tasks.rados.rados.0.trial188.stdout:3517: done (4 left) 2026-02-13T20:27:02.814 INFO:tasks.rados.rados.0.trial188.stdout:3518: write (excl) oid 43 current snap is 370 2026-02-13T20:27:02.814 INFO:tasks.rados.rados.0.trial188.stdout:3518: seq_num 1216 ranges {437312=402911,1341045=696749} 2026-02-13T20:27:02.817 INFO:tasks.rados.rados.0.trial188.stdout:3518: writing trial18843701-43 from 437312 to 840223 tid 1 2026-02-13T20:27:02.823 INFO:tasks.rados.rados.0.trial188.stdout:3518: writing trial18843701-43 from 1341045 to 2037794 tid 2 2026-02-13T20:27:02.823 INFO:tasks.rados.rados.0.trial188.stdout:3519: delete oid 21 current snap is 370 2026-02-13T20:27:02.823 INFO:tasks.rados.rados.0.trial188.stdout:3511: expect (ObjNum 1151 snap 347 seq_num 1151) 2026-02-13T20:27:02.886 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 117669 2026-02-13T20:27:02.918 INFO:tasks.rados.rados.0.trial188.stdout:3513: expect (ObjNum 1189 snap 364 seq_num 1189) 2026-02-13T20:27:02.918 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:27:03.036 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:27:03.094 INFO:tasks.rados.rados.0.trial188.stdout:3515: finishing write tid 1 to trial18843701-10 2026-02-13T20:27:03.094 INFO:tasks.rados.rados.0.trial188.stdout:3511: done (5 left) 2026-02-13T20:27:03.094 INFO:tasks.rados.rados.0.trial188.stdout:3513: done (4 left) 2026-02-13T20:27:03.094 INFO:tasks.rados.rados.0.trial188.stdout:3519: done (3 left) 2026-02-13T20:27:03.094 INFO:tasks.rados.rados.0.trial188.stdout:3520: snap_remove snap 334 2026-02-13T20:27:03.749 INFO:tasks.rados.rados.0.trial188.stdout:3520: done (3 left) 2026-02-13T20:27:03.749 INFO:tasks.rados.rados.0.trial188.stdout:3521: delete oid 36 current snap is 370 2026-02-13T20:27:03.749 INFO:tasks.rados.rados.0.trial188.stdout:3515: finishing write tid 2 to trial18843701-10 2026-02-13T20:27:03.749 INFO:tasks.rados.rados.0.trial188.stdout:3515: finishing write tid 3 to trial18843701-10 2026-02-13T20:27:03.749 INFO:tasks.rados.rados.0.trial188.stdout:3515: finishing write tid 4 to trial18843701-10 2026-02-13T20:27:03.749 INFO:tasks.rados.rados.0.trial188.stdout:3515: oid 10 updating version 0 to 1620 2026-02-13T20:27:03.750 INFO:tasks.rados.rados.0.trial188.stdout:3515: oid 10 version 1620 is already newer than 1619 2026-02-13T20:27:03.750 INFO:tasks.rados.rados.0.trial188.stdout:3515: oid 10 version 1620 is already newer than 1618 2026-02-13T20:27:03.750 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 10 v 1620 (ObjNum 1214 snap 370 seq_num 1214) dirty exists 2026-02-13T20:27:03.750 INFO:tasks.rados.rados.0.trial188.stdout:3515: left oid 10 (ObjNum 1214 snap 370 seq_num 1214) 2026-02-13T20:27:03.750 INFO:tasks.rados.rados.0.trial188.stdout:3516: finishing write tid 1 to trial18843701-4 2026-02-13T20:27:03.750 INFO:tasks.rados.rados.0.trial188.stdout:3516: finishing write tid 2 to trial18843701-4 2026-02-13T20:27:03.750 INFO:tasks.rados.rados.0.trial188.stdout:3516: finishing write tid 3 to trial18843701-4 2026-02-13T20:27:03.750 INFO:tasks.rados.rados.0.trial188.stdout:3516: finishing write tid 4 to trial18843701-4 2026-02-13T20:27:03.750 INFO:tasks.rados.rados.0.trial188.stdout:3516: oid 4 updating version 0 to 1623 2026-02-13T20:27:03.750 INFO:tasks.rados.rados.0.trial188.stdout:3516: oid 4 version 1623 is already newer than 1621 2026-02-13T20:27:03.750 INFO:tasks.rados.rados.0.trial188.stdout:3516: oid 4 version 1623 is already newer than 1622 2026-02-13T20:27:03.750 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 4 v 1623 (ObjNum 1215 snap 370 seq_num 1215) dirty exists 2026-02-13T20:27:03.751 INFO:tasks.rados.rados.0.trial188.stdout:3516: left oid 4 (ObjNum 1215 snap 370 seq_num 1215) 2026-02-13T20:27:03.751 INFO:tasks.rados.rados.0.trial188.stdout:3518: finishing write tid 1 to trial18843701-43 2026-02-13T20:27:03.751 INFO:tasks.rados.rados.0.trial188.stdout:3518: finishing write tid 2 to trial18843701-43 2026-02-13T20:27:03.751 INFO:tasks.rados.rados.0.trial188.stdout:3518: finishing write tid 3 to trial18843701-43 2026-02-13T20:27:03.751 INFO:tasks.rados.rados.0.trial188.stdout:3518: finishing write tid 4 to trial18843701-43 2026-02-13T20:27:03.751 INFO:tasks.rados.rados.0.trial188.stdout:3518: oid 43 updating version 0 to 1327 2026-02-13T20:27:03.751 INFO:tasks.rados.rados.0.trial188.stdout:3518: oid 43 updating version 1327 to 1329 2026-02-13T20:27:03.751 INFO:tasks.rados.rados.0.trial188.stdout:3518: oid 43 version 1329 is already newer than 1328 2026-02-13T20:27:03.751 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 43 v 1329 (ObjNum 1216 snap 370 seq_num 1216) dirty exists 2026-02-13T20:27:03.751 INFO:tasks.rados.rados.0.trial188.stdout:3518: left oid 43 (ObjNum 1216 snap 370 seq_num 1216) 2026-02-13T20:27:03.754 INFO:tasks.rados.rados.0.trial188.stdout:3515: done (3 left) 2026-02-13T20:27:03.754 INFO:tasks.rados.rados.0.trial188.stdout:3516: done (2 left) 2026-02-13T20:27:03.754 INFO:tasks.rados.rados.0.trial188.stdout:3518: done (1 left) 2026-02-13T20:27:03.754 INFO:tasks.rados.rados.0.trial188.stdout:3521: done (0 left) 2026-02-13T20:27:03.754 INFO:tasks.rados.rados.0.trial188.stdout:3522: read oid 19 snap -1 2026-02-13T20:27:03.754 INFO:tasks.rados.rados.0.trial188.stdout:3522: expect (ObjNum 1196 snap 366 seq_num 1196) 2026-02-13T20:27:03.755 INFO:tasks.rados.rados.0.trial188.stdout:3523: delete oid 37 current snap is 370 2026-02-13T20:27:03.755 INFO:tasks.rados.rados.0.trial188.stdout:3523: done (1 left) 2026-02-13T20:27:03.755 INFO:tasks.rados.rados.0.trial188.stdout:3524: write (excl) oid 37 current snap is 370 2026-02-13T20:27:03.755 INFO:tasks.rados.rados.0.trial188.stdout:3524: seq_num 1220 ranges {504540=420260,1574973=704087} 2026-02-13T20:27:03.758 INFO:tasks.rados.rados.0.trial188.stdout:3524: writing trial18843701-37 from 504540 to 924800 tid 1 2026-02-13T20:27:03.763 INFO:tasks.rados.rados.0.trial188.stdout:3524: writing trial18843701-37 from 1574973 to 2279060 tid 2 2026-02-13T20:27:03.763 INFO:tasks.rados.rados.0.trial188.stdout:3525: snap_remove snap 360 2026-02-13T20:27:04.752 INFO:tasks.rados.rados.0.trial188.stdout:3525: done (2 left) 2026-02-13T20:27:04.752 INFO:tasks.rados.rados.0.trial188.stdout:3526: read oid 47 snap 351 2026-02-13T20:27:04.752 INFO:tasks.rados.rados.0.trial188.stdout:3526: expect (ObjNum 1007 snap 299 seq_num 1007) 2026-02-13T20:27:04.753 INFO:tasks.rados.rados.0.trial188.stdout:3527: copy_from oid 5 from oid 26 current snap is 370 2026-02-13T20:27:04.753 INFO:tasks.rados.rados.0.trial188.stdout:3522: expect (ObjNum 1196 snap 366 seq_num 1196) 2026-02-13T20:27:04.798 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:27:04.891 INFO:tasks.rados.rados.0.trial188.stdout:3524: finishing write tid 1 to trial18843701-37 2026-02-13T20:27:04.891 INFO:tasks.rados.rados.0.trial188.stdout:3524: finishing write tid 2 to trial18843701-37 2026-02-13T20:27:04.891 INFO:tasks.rados.rados.0.trial188.stdout:3524: finishing write tid 3 to trial18843701-37 2026-02-13T20:27:04.891 INFO:tasks.rados.rados.0.trial188.stdout:3524: finishing write tid 4 to trial18843701-37 2026-02-13T20:27:04.891 INFO:tasks.rados.rados.0.trial188.stdout:3524: oid 37 updating version 0 to 1694 2026-02-13T20:27:04.892 INFO:tasks.rados.rados.0.trial188.stdout:3524: oid 37 updating version 1694 to 1696 2026-02-13T20:27:04.892 INFO:tasks.rados.rados.0.trial188.stdout:3524: oid 37 version 1696 is already newer than 1695 2026-02-13T20:27:04.892 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 37 v 1696 (ObjNum 1220 snap 370 seq_num 1220) dirty exists 2026-02-13T20:27:04.892 INFO:tasks.rados.rados.0.trial188.stdout:3524: left oid 37 (ObjNum 1220 snap 370 seq_num 1220) 2026-02-13T20:27:04.892 INFO:tasks.rados.rados.0.trial188.stdout:3522: done (3 left) 2026-02-13T20:27:04.892 INFO:tasks.rados.rados.0.trial188.stdout:3524: done (2 left) 2026-02-13T20:27:04.892 INFO:tasks.rados.rados.0.trial188.stdout:3528: rollback oid 45 current snap is 370 2026-02-13T20:27:04.892 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 45 to 365 2026-02-13T20:27:04.892 INFO:tasks.rados.rados.0.trial188.stdout:3526: expect (ObjNum 1007 snap 299 seq_num 1007) 2026-02-13T20:27:04.924 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:27:04.957 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:27:04.990 INFO:tasks.rados.rados.0.trial188.stdout:3527: finishing copy_from racing read to trial18843701-5 2026-02-13T20:27:04.990 INFO:tasks.rados.rados.0.trial188.stdout:3526: done (2 left) 2026-02-13T20:27:04.991 INFO:tasks.rados.rados.0.trial188.stdout:3529: read oid 13 snap 362 2026-02-13T20:27:04.991 INFO:tasks.rados.rados.0.trial188.stdout:3529: expect (ObjNum 1155 snap 347 seq_num 1155) 2026-02-13T20:27:04.991 INFO:tasks.rados.rados.0.trial188.stdout:3530: write (excl) oid 30 current snap is 370 2026-02-13T20:27:04.991 INFO:tasks.rados.rados.0.trial188.stdout:3527: finishing copy_from to trial18843701-5 2026-02-13T20:27:04.991 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 5 v 1519 (ObjNum 1162 snap 354 seq_num 1162) dirty exists 2026-02-13T20:27:04.991 INFO:tasks.rados.rados.0.trial188.stdout:3528: finishing rollback tid 0 to trial18843701-45 2026-02-13T20:27:04.991 INFO:tasks.rados.rados.0.trial188.stdout:3528: finishing rollback tid 1 to trial18843701-45 2026-02-13T20:27:04.991 INFO:tasks.rados.rados.0.trial188.stdout:3528: finishing rollback tid 2 to trial18843701-45 2026-02-13T20:27:04.991 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 45 v 1704 (ObjNum 1169 snap 357 seq_num 1169) dirty exists 2026-02-13T20:27:04.991 INFO:tasks.rados.rados.0.trial188.stdout:3530: seq_num 1221 ranges {521347=495509,1633455=564098} 2026-02-13T20:27:04.994 INFO:tasks.rados.rados.0.trial188.stdout:3530: writing trial18843701-30 from 521347 to 1016856 tid 1 2026-02-13T20:27:04.999 INFO:tasks.rados.rados.0.trial188.stdout:3530: writing trial18843701-30 from 1633455 to 2197553 tid 2 2026-02-13T20:27:04.999 INFO:tasks.rados.rados.0.trial188.stdout:3527: done (3 left) 2026-02-13T20:27:04.999 INFO:tasks.rados.rados.0.trial188.stdout:3528: done (2 left) 2026-02-13T20:27:04.999 INFO:tasks.rados.rados.0.trial188.stdout:3531: write oid 10 current snap is 370 2026-02-13T20:27:04.999 INFO:tasks.rados.rados.0.trial188.stdout:3531: seq_num 1222 ranges {538154=570758,1691937=707756} 2026-02-13T20:27:05.003 INFO:tasks.rados.rados.0.trial188.stdout:3531: writing trial18843701-10 from 538154 to 1108912 tid 1 2026-02-13T20:27:05.008 INFO:tasks.rados.rados.0.trial188.stdout:3531: writing trial18843701-10 from 1691937 to 2399693 tid 2 2026-02-13T20:27:05.008 INFO:tasks.rados.rados.0.trial188.stdout:3532: write (excl) oid 22 current snap is 370 2026-02-13T20:27:05.008 INFO:tasks.rados.rados.0.trial188.stdout:3532: seq_num 1223 ranges {554961=646007,1750419=451414} 2026-02-13T20:27:05.012 INFO:tasks.rados.rados.0.trial188.stdout:3532: writing trial18843701-22 from 554961 to 1200968 tid 1 2026-02-13T20:27:05.016 INFO:tasks.rados.rados.0.trial188.stdout:3532: writing trial18843701-22 from 1750419 to 2201833 tid 2 2026-02-13T20:27:05.016 INFO:tasks.rados.rados.0.trial188.stdout:3533: rollback oid 18 current snap is 370 2026-02-13T20:27:05.017 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 18 to 358 2026-02-13T20:27:05.017 INFO:tasks.rados.rados.0.trial188.stdout:3529: expect (ObjNum 1155 snap 347 seq_num 1155) 2026-02-13T20:27:05.058 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:27:05.084 INFO:tasks.rados.rados.0.trial188.stdout:3530: finishing write tid 1 to trial18843701-30 2026-02-13T20:27:05.084 INFO:tasks.rados.rados.0.trial188.stdout:3529: done (4 left) 2026-02-13T20:27:05.084 INFO:tasks.rados.rados.0.trial188.stdout:3534: rollback oid 15 current snap is 370 2026-02-13T20:27:05.085 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 15 to 369 2026-02-13T20:27:05.085 INFO:tasks.rados.rados.0.trial188.stdout:3530: finishing write tid 2 to trial18843701-30 2026-02-13T20:27:05.085 INFO:tasks.rados.rados.0.trial188.stdout:3530: finishing write tid 3 to trial18843701-30 2026-02-13T20:27:05.085 INFO:tasks.rados.rados.0.trial188.stdout:3530: finishing write tid 4 to trial18843701-30 2026-02-13T20:27:05.085 INFO:tasks.rados.rados.0.trial188.stdout:3530: oid 30 updating version 0 to 1635 2026-02-13T20:27:05.085 INFO:tasks.rados.rados.0.trial188.stdout:3530: oid 30 updating version 1635 to 1636 2026-02-13T20:27:05.085 INFO:tasks.rados.rados.0.trial188.stdout:3530: oid 30 updating version 1636 to 1637 2026-02-13T20:27:05.085 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 30 v 1637 (ObjNum 1221 snap 370 seq_num 1221) dirty exists 2026-02-13T20:27:05.085 INFO:tasks.rados.rados.0.trial188.stdout:3530: left oid 30 (ObjNum 1221 snap 370 seq_num 1221) 2026-02-13T20:27:05.085 INFO:tasks.rados.rados.0.trial188.stdout:3532: finishing write tid 1 to trial18843701-22 2026-02-13T20:27:05.085 INFO:tasks.rados.rados.0.trial188.stdout:3533: finishing rollback tid 1 to trial18843701-18 2026-02-13T20:27:05.085 INFO:tasks.rados.rados.0.trial188.stdout:3533: finishing rollback tid 2 to trial18843701-18 2026-02-13T20:27:05.086 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 18 v 1511 (ObjNum 1112 snap 329 seq_num 1112) dirty exists 2026-02-13T20:27:05.086 INFO:tasks.rados.rados.0.trial188.stdout:3532: finishing write tid 2 to trial18843701-22 2026-02-13T20:27:05.086 INFO:tasks.rados.rados.0.trial188.stdout:3532: finishing write tid 3 to trial18843701-22 2026-02-13T20:27:05.086 INFO:tasks.rados.rados.0.trial188.stdout:3532: finishing write tid 4 to trial18843701-22 2026-02-13T20:27:05.086 INFO:tasks.rados.rados.0.trial188.stdout:3532: oid 22 updating version 0 to 1332 2026-02-13T20:27:05.086 INFO:tasks.rados.rados.0.trial188.stdout:3532: oid 22 version 1332 is already newer than 1331 2026-02-13T20:27:05.086 INFO:tasks.rados.rados.0.trial188.stdout:3532: oid 22 version 1332 is already newer than 1330 2026-02-13T20:27:05.086 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 22 v 1332 (ObjNum 1223 snap 370 seq_num 1223) dirty exists 2026-02-13T20:27:05.086 INFO:tasks.rados.rados.0.trial188.stdout:3532: left oid 22 (ObjNum 1223 snap 370 seq_num 1223) 2026-02-13T20:27:05.086 INFO:tasks.rados.rados.0.trial188.stdout:3531: finishing write tid 1 to trial18843701-10 2026-02-13T20:27:05.086 INFO:tasks.rados.rados.0.trial188.stdout:3531: finishing write tid 2 to trial18843701-10 2026-02-13T20:27:05.086 INFO:tasks.rados.rados.0.trial188.stdout:3531: finishing write tid 3 to trial18843701-10 2026-02-13T20:27:05.086 INFO:tasks.rados.rados.0.trial188.stdout:3531: finishing write tid 4 to trial18843701-10 2026-02-13T20:27:05.087 INFO:tasks.rados.rados.0.trial188.stdout:3531: oid 10 updating version 0 to 1625 2026-02-13T20:27:05.087 INFO:tasks.rados.rados.0.trial188.stdout:3531: oid 10 updating version 1625 to 1626 2026-02-13T20:27:05.087 INFO:tasks.rados.rados.0.trial188.stdout:3531: oid 10 version 1626 is already newer than 1624 2026-02-13T20:27:05.087 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 10 v 1626 (ObjNum 1222 snap 370 seq_num 1222) dirty exists 2026-02-13T20:27:05.087 INFO:tasks.rados.rados.0.trial188.stdout:3531: left oid 10 (ObjNum 1222 snap 370 seq_num 1222) 2026-02-13T20:27:05.087 INFO:tasks.rados.rados.0.trial188.stdout:3530: done (4 left) 2026-02-13T20:27:05.087 INFO:tasks.rados.rados.0.trial188.stdout:3531: done (3 left) 2026-02-13T20:27:05.087 INFO:tasks.rados.rados.0.trial188.stdout:3532: done (2 left) 2026-02-13T20:27:05.087 INFO:tasks.rados.rados.0.trial188.stdout:3533: done (1 left) 2026-02-13T20:27:05.087 INFO:tasks.rados.rados.0.trial188.stdout:3535: write oid 21 current snap is 370 2026-02-13T20:27:05.087 INFO:tasks.rados.rados.0.trial188.stdout:3535: seq_num 1224 ranges {571768=437609,1808901=711425} 2026-02-13T20:27:05.088 INFO:tasks.rados.rados.0.trial188.stdout:3535: writing trial18843701-21 from 571768 to 1009377 tid 1 2026-02-13T20:27:05.093 INFO:tasks.rados.rados.0.trial188.stdout:3535: writing trial18843701-21 from 1808901 to 2520326 tid 2 2026-02-13T20:27:05.093 INFO:tasks.rados.rados.0.trial188.stdout:3536: rollback oid 34 current snap is 370 2026-02-13T20:27:05.094 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 34 to 362 2026-02-13T20:27:05.094 INFO:tasks.rados.rados.0.trial188.stdout:3534: finishing rollback tid 0 to trial18843701-15 2026-02-13T20:27:05.094 INFO:tasks.rados.rados.0.trial188.stdout:3534: finishing rollback tid 1 to trial18843701-15 2026-02-13T20:27:05.094 INFO:tasks.rados.rados.0.trial188.stdout:3534: finishing rollback tid 2 to trial18843701-15 2026-02-13T20:27:05.094 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 15 v 1531 (ObjNum 1196 snap 366 seq_num 1196) dirty exists 2026-02-13T20:27:05.094 INFO:tasks.rados.rados.0.trial188.stdout:3534: done (2 left) 2026-02-13T20:27:05.094 INFO:tasks.rados.rados.0.trial188.stdout:3537: snap_remove snap 358 2026-02-13T20:27:05.817 INFO:tasks.rados.rados.0.trial188.stdout:3537: done (2 left) 2026-02-13T20:27:05.817 INFO:tasks.rados.rados.0.trial188.stdout:3538: delete oid 24 current snap is 370 2026-02-13T20:27:05.817 INFO:tasks.rados.rados.0.trial188.stdout:3536: finishing rollback tid 0 to trial18843701-34 2026-02-13T20:27:05.817 INFO:tasks.rados.rados.0.trial188.stdout:3536: finishing rollback tid 1 to trial18843701-34 2026-02-13T20:27:05.817 INFO:tasks.rados.rados.0.trial188.stdout:3536: finishing rollback tid 2 to trial18843701-34 2026-02-13T20:27:05.817 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 34 v 1708 (ObjNum 1111 snap 329 seq_num 1111) dirty exists 2026-02-13T20:27:05.818 INFO:tasks.rados.rados.0.trial188.stdout:3535: finishing write tid 1 to trial18843701-21 2026-02-13T20:27:05.818 INFO:tasks.rados.rados.0.trial188.stdout:3535: finishing write tid 2 to trial18843701-21 2026-02-13T20:27:05.818 INFO:tasks.rados.rados.0.trial188.stdout:3535: finishing write tid 3 to trial18843701-21 2026-02-13T20:27:05.818 INFO:tasks.rados.rados.0.trial188.stdout:3535: finishing write tid 4 to trial18843701-21 2026-02-13T20:27:05.818 INFO:tasks.rados.rados.0.trial188.stdout:3535: oid 21 updating version 0 to 1107 2026-02-13T20:27:05.818 INFO:tasks.rados.rados.0.trial188.stdout:3535: oid 21 updating version 1107 to 1109 2026-02-13T20:27:05.818 INFO:tasks.rados.rados.0.trial188.stdout:3535: oid 21 version 1109 is already newer than 1108 2026-02-13T20:27:05.818 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 21 v 1109 (ObjNum 1224 snap 370 seq_num 1224) dirty exists 2026-02-13T20:27:05.818 INFO:tasks.rados.rados.0.trial188.stdout:3535: left oid 21 (ObjNum 1224 snap 370 seq_num 1224) 2026-02-13T20:27:05.820 INFO:tasks.rados.rados.0.trial188.stdout:3535: done (2 left) 2026-02-13T20:27:05.820 INFO:tasks.rados.rados.0.trial188.stdout:3536: done (1 left) 2026-02-13T20:27:05.820 INFO:tasks.rados.rados.0.trial188.stdout:3538: done (0 left) 2026-02-13T20:27:05.820 INFO:tasks.rados.rados.0.trial188.stdout:3539: delete oid 39 current snap is 370 2026-02-13T20:27:05.823 INFO:tasks.rados.rados.0.trial188.stdout:3539: done (0 left) 2026-02-13T20:27:05.823 INFO:tasks.rados.rados.0.trial188.stdout:3540: write oid 40 current snap is 370 2026-02-13T20:27:05.823 INFO:tasks.rados.rados.0.trial188.stdout:3540: seq_num 1227 ranges {622189=663356,1984347=458752} 2026-02-13T20:27:05.828 INFO:tasks.rados.rados.0.trial188.stdout:3540: writing trial18843701-40 from 622189 to 1285545 tid 1 2026-02-13T20:27:05.832 INFO:tasks.rados.rados.0.trial188.stdout:3540: writing trial18843701-40 from 1984347 to 2443099 tid 2 2026-02-13T20:27:05.832 INFO:tasks.rados.rados.0.trial188.stdout:3541: snap_create 2026-02-13T20:27:05.846 INFO:tasks.rados.rados.0.trial188.stdout:3540: finishing write tid 1 to trial18843701-40 2026-02-13T20:27:05.847 INFO:tasks.rados.rados.0.trial188.stdout:3540: finishing write tid 2 to trial18843701-40 2026-02-13T20:27:05.847 INFO:tasks.rados.rados.0.trial188.stdout:3540: finishing write tid 3 to trial18843701-40 2026-02-13T20:27:05.847 INFO:tasks.rados.rados.0.trial188.stdout:3540: finishing write tid 4 to trial18843701-40 2026-02-13T20:27:05.847 INFO:tasks.rados.rados.0.trial188.stdout:3540: oid 40 updating version 0 to 1499 2026-02-13T20:27:05.847 INFO:tasks.rados.rados.0.trial188.stdout:3540: oid 40 version 1499 is already newer than 1498 2026-02-13T20:27:05.847 INFO:tasks.rados.rados.0.trial188.stdout:3540: oid 40 version 1499 is already newer than 1497 2026-02-13T20:27:05.847 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 40 v 1499 (ObjNum 1227 snap 370 seq_num 1227) dirty exists 2026-02-13T20:27:05.847 INFO:tasks.rados.rados.0.trial188.stdout:3540: left oid 40 (ObjNum 1227 snap 370 seq_num 1227) 2026-02-13T20:27:06.820 INFO:tasks.rados.rados.0.trial188.stdout:3540: done (1 left) 2026-02-13T20:27:06.820 INFO:tasks.rados.rados.0.trial188.stdout:3541: done (0 left) 2026-02-13T20:27:06.820 INFO:tasks.rados.rados.0.trial188.stdout:3542: snap_create 2026-02-13T20:27:07.821 INFO:tasks.rados.rados.0.trial188.stdout:3542: done (0 left) 2026-02-13T20:27:07.821 INFO:tasks.rados.rados.0.trial188.stdout:3543: snap_remove snap 371 2026-02-13T20:27:08.748 INFO:tasks.rados.rados.0.trial188.stdout:3543: done (0 left) 2026-02-13T20:27:08.749 INFO:tasks.rados.rados.0.trial188.stdout:3544: snap_remove snap 349 2026-02-13T20:27:09.750 INFO:tasks.rados.rados.0.trial188.stdout:3544: done (0 left) 2026-02-13T20:27:09.750 INFO:tasks.rados.rados.0.trial188.stdout:3545: read oid 21 snap -1 2026-02-13T20:27:09.750 INFO:tasks.rados.rados.0.trial188.stdout:3545: expect (ObjNum 1224 snap 370 seq_num 1224) 2026-02-13T20:27:09.750 INFO:tasks.rados.rados.0.trial188.stdout:3546: write oid 45 current snap is 372 2026-02-13T20:27:09.750 INFO:tasks.rados.rados.0.trial188.stdout:3546: seq_num 1228 ranges {638996=738605,1926476=712520} 2026-02-13T20:27:09.755 INFO:tasks.rados.rados.0.trial188.stdout:3546: writing trial18843701-45 from 638996 to 1377601 tid 1 2026-02-13T20:27:09.760 INFO:tasks.rados.rados.0.trial188.stdout:3546: writing trial18843701-45 from 1926476 to 2638996 tid 2 2026-02-13T20:27:09.760 INFO:tasks.rados.rados.0.trial188.stdout:3547: write oid 44 current snap is 372 2026-02-13T20:27:09.761 INFO:tasks.rados.rados.0.trial188.stdout:3547: seq_num 1229 ranges {655803=413854,1584958=462421} 2026-02-13T20:27:09.764 INFO:tasks.rados.rados.0.trial188.stdout:3547: writing trial18843701-44 from 655803 to 1069657 tid 1 2026-02-13T20:27:09.768 INFO:tasks.rados.rados.0.trial188.stdout:3547: writing trial18843701-44 from 1584958 to 2047379 tid 2 2026-02-13T20:27:09.768 INFO:tasks.rados.rados.0.trial188.stdout:3548: write (excl) oid 36 current snap is 372 2026-02-13T20:27:09.768 INFO:tasks.rados.rados.0.trial188.stdout:3548: seq_num 1230 ranges {672610=489103,1643440=722432} 2026-02-13T20:27:09.772 INFO:tasks.rados.rados.0.trial188.stdout:3548: writing trial18843701-36 from 672610 to 1161713 tid 1 2026-02-13T20:27:09.776 INFO:tasks.rados.rados.0.trial188.stdout:3548: writing trial18843701-36 from 1643440 to 2365872 tid 2 2026-02-13T20:27:09.777 INFO:tasks.rados.rados.0.trial188.stdout:3549: copy_from oid 46 from oid 13 current snap is 372 2026-02-13T20:27:09.777 INFO:tasks.rados.rados.0.trial188.stdout:3545: expect (ObjNum 1224 snap 370 seq_num 1224) 2026-02-13T20:27:09.779 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1317992 2026-02-13T20:27:09.790 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 202614 2026-02-13T20:27:09.808 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 498347 2026-02-13T20:27:09.824 INFO:tasks.rados.rados.0.trial188.stdout:3546: finishing write tid 1 to trial18843701-45 2026-02-13T20:27:09.824 INFO:tasks.rados.rados.0.trial188.stdout:3545: done (4 left) 2026-02-13T20:27:09.824 INFO:tasks.rados.rados.0.trial188.stdout:3550: snap_remove snap 351 2026-02-13T20:27:10.753 INFO:tasks.rados.rados.0.trial188.stdout:3550: done (4 left) 2026-02-13T20:27:10.753 INFO:tasks.rados.rados.0.trial188.stdout:3551: read oid 33 snap -1 2026-02-13T20:27:10.754 INFO:tasks.rados.rados.0.trial188.stdout:3551: expect (ObjNum 1102 snap 326 seq_num 1102) 2026-02-13T20:27:10.754 INFO:tasks.rados.rados.0.trial188.stdout:3552: rollback oid 6 current snap is 372 2026-02-13T20:27:10.754 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 6 to 365 2026-02-13T20:27:10.754 INFO:tasks.rados.rados.0.trial188.stdout:3546: finishing write tid 2 to trial18843701-45 2026-02-13T20:27:10.754 INFO:tasks.rados.rados.0.trial188.stdout:3547: finishing write tid 1 to trial18843701-44 2026-02-13T20:27:10.754 INFO:tasks.rados.rados.0.trial188.stdout:3547: finishing write tid 2 to trial18843701-44 2026-02-13T20:27:10.754 INFO:tasks.rados.rados.0.trial188.stdout:3546: finishing write tid 3 to trial18843701-45 2026-02-13T20:27:10.754 INFO:tasks.rados.rados.0.trial188.stdout:3546: finishing write tid 4 to trial18843701-45 2026-02-13T20:27:10.754 INFO:tasks.rados.rados.0.trial188.stdout:3546: oid 45 updating version 0 to 1722 2026-02-13T20:27:10.754 INFO:tasks.rados.rados.0.trial188.stdout:3546: oid 45 version 1722 is already newer than 1721 2026-02-13T20:27:10.754 INFO:tasks.rados.rados.0.trial188.stdout:3546: oid 45 version 1722 is already newer than 1720 2026-02-13T20:27:10.755 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 45 v 1722 (ObjNum 1228 snap 372 seq_num 1228) dirty exists 2026-02-13T20:27:10.755 INFO:tasks.rados.rados.0.trial188.stdout:3546: left oid 45 (ObjNum 1228 snap 372 seq_num 1228) 2026-02-13T20:27:10.755 INFO:tasks.rados.rados.0.trial188.stdout:3547: finishing write tid 3 to trial18843701-44 2026-02-13T20:27:10.755 INFO:tasks.rados.rados.0.trial188.stdout:3547: finishing write tid 4 to trial18843701-44 2026-02-13T20:27:10.755 INFO:tasks.rados.rados.0.trial188.stdout:3547: oid 44 updating version 0 to 1720 2026-02-13T20:27:10.755 INFO:tasks.rados.rados.0.trial188.stdout:3547: oid 44 version 1720 is already newer than 1719 2026-02-13T20:27:10.755 INFO:tasks.rados.rados.0.trial188.stdout:3547: oid 44 version 1720 is already newer than 1718 2026-02-13T20:27:10.755 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 44 v 1720 (ObjNum 1229 snap 372 seq_num 1229) dirty exists 2026-02-13T20:27:10.755 INFO:tasks.rados.rados.0.trial188.stdout:3547: left oid 44 (ObjNum 1229 snap 372 seq_num 1229) 2026-02-13T20:27:10.755 INFO:tasks.rados.rados.0.trial188.stdout:3548: finishing write tid 1 to trial18843701-36 2026-02-13T20:27:10.755 INFO:tasks.rados.rados.0.trial188.stdout:3548: finishing write tid 2 to trial18843701-36 2026-02-13T20:27:10.756 INFO:tasks.rados.rados.0.trial188.stdout:3546: done (5 left) 2026-02-13T20:27:10.756 INFO:tasks.rados.rados.0.trial188.stdout:3547: done (4 left) 2026-02-13T20:27:10.756 INFO:tasks.rados.rados.0.trial188.stdout:3553: write (excl) oid 2 current snap is 372 2026-02-13T20:27:10.756 INFO:tasks.rados.rados.0.trial188.stdout:3548: finishing write tid 3 to trial18843701-36 2026-02-13T20:27:10.756 INFO:tasks.rados.rados.0.trial188.stdout:3548: finishing write tid 4 to trial18843701-36 2026-02-13T20:27:10.756 INFO:tasks.rados.rados.0.trial188.stdout:3548: oid 36 updating version 0 to 1817 2026-02-13T20:27:10.756 INFO:tasks.rados.rados.0.trial188.stdout:3548: oid 36 version 1817 is already newer than 1815 2026-02-13T20:27:10.756 INFO:tasks.rados.rados.0.trial188.stdout:3548: oid 36 version 1817 is already newer than 1816 2026-02-13T20:27:10.756 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 36 v 1817 (ObjNum 1230 snap 372 seq_num 1230) dirty exists 2026-02-13T20:27:10.756 INFO:tasks.rados.rados.0.trial188.stdout:3548: left oid 36 (ObjNum 1230 snap 372 seq_num 1230) 2026-02-13T20:27:10.756 INFO:tasks.rados.rados.0.trial188.stdout:3549: finishing copy_from racing read to trial18843701-46 2026-02-13T20:27:10.756 INFO:tasks.rados.rados.0.trial188.stdout:3549: finishing copy_from to trial18843701-46 2026-02-13T20:27:10.756 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 46 v 1717 (ObjNum 1187 snap 363 seq_num 1187) dirty exists 2026-02-13T20:27:10.757 INFO:tasks.rados.rados.0.trial188.stdout:3553: seq_num 1231 ranges {689417=564352,1701922=466090} 2026-02-13T20:27:10.757 INFO:tasks.rados.rados.0.trial188.stdout:3553: writing trial18843701-2 from 689417 to 1253769 tid 1 2026-02-13T20:27:10.761 INFO:tasks.rados.rados.0.trial188.stdout:3553: writing trial18843701-2 from 1701922 to 2168012 tid 2 2026-02-13T20:27:10.761 INFO:tasks.rados.rados.0.trial188.stdout:3548: done (4 left) 2026-02-13T20:27:10.761 INFO:tasks.rados.rados.0.trial188.stdout:3549: done (3 left) 2026-02-13T20:27:10.761 INFO:tasks.rados.rados.0.trial188.stdout:3554: copy_from oid 29 from oid 5 current snap is 372 2026-02-13T20:27:10.762 INFO:tasks.rados.rados.0.trial188.stdout:3552: finishing rollback tid 1 to trial18843701-6 2026-02-13T20:27:10.762 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 6 v 0 (ObjNum 225 snap 0 seq_num 13747344) dirty dne 2026-02-13T20:27:10.762 INFO:tasks.rados.rados.0.trial188.stdout:3552: done (3 left) 2026-02-13T20:27:10.762 INFO:tasks.rados.rados.0.trial188.stdout:3555: delete oid 17 current snap is 372 2026-02-13T20:27:10.762 INFO:tasks.rados.rados.0.trial188.stdout:3551: expect (ObjNum 1102 snap 326 seq_num 1102) 2026-02-13T20:27:10.785 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2206037 2026-02-13T20:27:10.909 INFO:tasks.rados.rados.0.trial188.stdout:3553: finishing write tid 1 to trial18843701-2 2026-02-13T20:27:10.909 INFO:tasks.rados.rados.0.trial188.stdout:3553: finishing write tid 2 to trial18843701-2 2026-02-13T20:27:10.910 INFO:tasks.rados.rados.0.trial188.stdout:3553: finishing write tid 3 to trial18843701-2 2026-02-13T20:27:10.910 INFO:tasks.rados.rados.0.trial188.stdout:3553: finishing write tid 4 to trial18843701-2 2026-02-13T20:27:10.910 INFO:tasks.rados.rados.0.trial188.stdout:3553: oid 2 updating version 0 to 1722 2026-02-13T20:27:10.910 INFO:tasks.rados.rados.0.trial188.stdout:3553: oid 2 version 1722 is already newer than 1721 2026-02-13T20:27:10.910 INFO:tasks.rados.rados.0.trial188.stdout:3553: oid 2 updating version 1722 to 1723 2026-02-13T20:27:10.910 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 2 v 1723 (ObjNum 1231 snap 372 seq_num 1231) dirty exists 2026-02-13T20:27:10.910 INFO:tasks.rados.rados.0.trial188.stdout:3553: left oid 2 (ObjNum 1231 snap 372 seq_num 1231) 2026-02-13T20:27:10.910 INFO:tasks.rados.rados.0.trial188.stdout:3554: finishing copy_from racing read to trial18843701-29 2026-02-13T20:27:10.910 INFO:tasks.rados.rados.0.trial188.stdout:3554: finishing copy_from to trial18843701-29 2026-02-13T20:27:10.910 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 29 v 1519 (ObjNum 1162 snap 354 seq_num 1162) dirty exists 2026-02-13T20:27:10.910 INFO:tasks.rados.rados.0.trial188.stdout:3551: done (3 left) 2026-02-13T20:27:10.911 INFO:tasks.rados.rados.0.trial188.stdout:3553: done (2 left) 2026-02-13T20:27:10.911 INFO:tasks.rados.rados.0.trial188.stdout:3554: done (1 left) 2026-02-13T20:27:10.911 INFO:tasks.rados.rados.0.trial188.stdout:3555: done (0 left) 2026-02-13T20:27:10.911 INFO:tasks.rados.rados.0.trial188.stdout:3556: snap_create 2026-02-13T20:27:11.830 INFO:tasks.rados.rados.0.trial188.stdout:3556: done (0 left) 2026-02-13T20:27:11.830 INFO:tasks.rados.rados.0.trial188.stdout:3557: write oid 27 current snap is 373 2026-02-13T20:27:11.830 INFO:tasks.rados.rados.0.trial188.stdout:3557: seq_num 1233 ranges {723031=431203,1818886=469759} 2026-02-13T20:27:11.835 INFO:tasks.rados.rados.0.trial188.stdout:3557: writing trial18843701-27 from 723031 to 1154234 tid 1 2026-02-13T20:27:11.840 INFO:tasks.rados.rados.0.trial188.stdout:3557: writing trial18843701-27 from 1818886 to 2288645 tid 2 2026-02-13T20:27:11.840 INFO:tasks.rados.rados.0.trial188.stdout:3558: copy_from oid 23 from oid 41 current snap is 373 2026-02-13T20:27:11.840 INFO:tasks.rados.rados.0.trial188.stdout:3559: read oid 20 snap -1 2026-02-13T20:27:11.840 INFO:tasks.rados.rados.0.trial188.stdout:3559: expect deleted 2026-02-13T20:27:11.840 INFO:tasks.rados.rados.0.trial188.stdout:3560: snap_create 2026-02-13T20:27:11.851 INFO:tasks.rados.rados.0.trial188.stdout:3557: finishing write tid 1 to trial18843701-27 2026-02-13T20:27:11.851 INFO:tasks.rados.rados.0.trial188.stdout:3557: finishing write tid 2 to trial18843701-27 2026-02-13T20:27:11.851 INFO:tasks.rados.rados.0.trial188.stdout:3557: finishing write tid 3 to trial18843701-27 2026-02-13T20:27:11.852 INFO:tasks.rados.rados.0.trial188.stdout:3557: finishing write tid 4 to trial18843701-27 2026-02-13T20:27:11.852 INFO:tasks.rados.rados.0.trial188.stdout:3557: oid 27 updating version 0 to 1663 2026-02-13T20:27:11.852 INFO:tasks.rados.rados.0.trial188.stdout:3557: oid 27 updating version 1663 to 1665 2026-02-13T20:27:11.852 INFO:tasks.rados.rados.0.trial188.stdout:3557: oid 27 version 1665 is already newer than 1664 2026-02-13T20:27:11.852 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 27 v 1665 (ObjNum 1233 snap 373 seq_num 1233) dirty exists 2026-02-13T20:27:11.852 INFO:tasks.rados.rados.0.trial188.stdout:3557: left oid 27 (ObjNum 1233 snap 373 seq_num 1233) 2026-02-13T20:27:11.884 INFO:tasks.rados.rados.0.trial188.stdout:3558: finishing copy_from racing read to trial18843701-23 2026-02-13T20:27:11.886 INFO:tasks.rados.rados.0.trial188.stdout:3558: finishing copy_from to trial18843701-23 2026-02-13T20:27:11.886 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 23 v 1482 (ObjNum 1161 snap 354 seq_num 1161) dirty exists 2026-02-13T20:27:12.834 INFO:tasks.rados.rados.0.trial188.stdout:3557: done (3 left) 2026-02-13T20:27:12.834 INFO:tasks.rados.rados.0.trial188.stdout:3558: done (2 left) 2026-02-13T20:27:12.834 INFO:tasks.rados.rados.0.trial188.stdout:3559: done (1 left) 2026-02-13T20:27:12.834 INFO:tasks.rados.rados.0.trial188.stdout:3560: done (0 left) 2026-02-13T20:27:12.835 INFO:tasks.rados.rados.0.trial188.stdout:3561: snap_create 2026-02-13T20:27:13.750 INFO:tasks.rados.rados.0.trial188.stdout:3561: done (0 left) 2026-02-13T20:27:13.750 INFO:tasks.rados.rados.0.trial188.stdout:3562: rollback oid 44 current snap is 375 2026-02-13T20:27:13.750 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 44 to 359 2026-02-13T20:27:13.750 INFO:tasks.rados.rados.0.trial188.stdout:3563: write (excl) oid 26 current snap is 375 2026-02-13T20:27:13.750 INFO:tasks.rados.rados.0.trial188.stdout:3563: seq_num 1234 ranges {739838=506452,1877368=613417} 2026-02-13T20:27:13.755 INFO:tasks.rados.rados.0.trial188.stdout:3563: writing trial18843701-26 from 739838 to 1246290 tid 1 2026-02-13T20:27:13.760 INFO:tasks.rados.rados.0.trial188.stdout:3563: writing trial18843701-26 from 1877368 to 2490785 tid 2 2026-02-13T20:27:13.761 INFO:tasks.rados.rados.0.trial188.stdout:3564: read oid 12 snap 372 2026-02-13T20:27:13.761 INFO:tasks.rados.rados.0.trial188.stdout:3564: expect (ObjNum 865 snap 250 seq_num 865) 2026-02-13T20:27:13.761 INFO:tasks.rados.rados.0.trial188.stdout:3565: copy_from oid 2 from oid 24 current snap is 375 2026-02-13T20:27:13.761 INFO:tasks.rados.rados.0.trial188.stdout:3562: finishing rollback tid 0 to trial18843701-44 2026-02-13T20:27:13.761 INFO:tasks.rados.rados.0.trial188.stdout:3562: finishing rollback tid 1 to trial18843701-44 2026-02-13T20:27:13.761 INFO:tasks.rados.rados.0.trial188.stdout:3562: finishing rollback tid 2 to trial18843701-44 2026-02-13T20:27:13.761 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 44 v 1726 (ObjNum 1100 snap 326 seq_num 1100) dirty exists 2026-02-13T20:27:13.761 INFO:tasks.rados.rados.0.trial188.stdout:3562: done (3 left) 2026-02-13T20:27:13.761 INFO:tasks.rados.rados.0.trial188.stdout:3566: delete oid 14 current snap is 375 2026-02-13T20:27:13.761 INFO:tasks.rados.rados.0.trial188.stdout:3565: finishing copy_from to trial18843701-2 2026-02-13T20:27:13.762 INFO:tasks.rados.rados.0.trial188.stdout:3565: got expected ENOENT (src dne) 2026-02-13T20:27:13.762 INFO:tasks.rados.rados.0.trial188.stdout:3565: finishing copy_from racing read to trial18843701-2 2026-02-13T20:27:13.769 INFO:tasks.rados.rados.0.trial188.stdout:3564: expect (ObjNum 865 snap 250 seq_num 865) 2026-02-13T20:27:13.814 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 512273 2026-02-13T20:27:13.899 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2489222 2026-02-13T20:27:13.899 INFO:tasks.rados.rados.0.trial188.stdout:3563: finishing write tid 1 to trial18843701-26 2026-02-13T20:27:13.900 INFO:tasks.rados.rados.0.trial188.stdout:3564: done (3 left) 2026-02-13T20:27:13.900 INFO:tasks.rados.rados.0.trial188.stdout:3565: done (2 left) 2026-02-13T20:27:13.900 INFO:tasks.rados.rados.0.trial188.stdout:3566: done (1 left) 2026-02-13T20:27:13.900 INFO:tasks.rados.rados.0.trial188.stdout:3567: delete oid 44 current snap is 375 2026-02-13T20:27:13.900 INFO:tasks.rados.rados.0.trial188.stdout:3563: finishing write tid 2 to trial18843701-26 2026-02-13T20:27:13.900 INFO:tasks.rados.rados.0.trial188.stdout:3563: finishing write tid 3 to trial18843701-26 2026-02-13T20:27:13.900 INFO:tasks.rados.rados.0.trial188.stdout:3563: finishing write tid 4 to trial18843701-26 2026-02-13T20:27:13.900 INFO:tasks.rados.rados.0.trial188.stdout:3563: oid 26 updating version 0 to 1532 2026-02-13T20:27:13.900 INFO:tasks.rados.rados.0.trial188.stdout:3563: oid 26 updating version 1532 to 1534 2026-02-13T20:27:13.900 INFO:tasks.rados.rados.0.trial188.stdout:3563: oid 26 version 1534 is already newer than 1533 2026-02-13T20:27:13.901 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 26 v 1534 (ObjNum 1234 snap 375 seq_num 1234) dirty exists 2026-02-13T20:27:13.901 INFO:tasks.rados.rados.0.trial188.stdout:3563: left oid 26 (ObjNum 1234 snap 375 seq_num 1234) 2026-02-13T20:27:13.901 INFO:tasks.rados.rados.0.trial188.stdout:3563: done (1 left) 2026-02-13T20:27:13.902 INFO:tasks.rados.rados.0.trial188.stdout:3567: done (0 left) 2026-02-13T20:27:13.902 INFO:tasks.rados.rados.0.trial188.stdout:3568: read oid 1 snap 369 2026-02-13T20:27:13.902 INFO:tasks.rados.rados.0.trial188.stdout:3568: expect (ObjNum 1189 snap 364 seq_num 1189) 2026-02-13T20:27:13.902 INFO:tasks.rados.rados.0.trial188.stdout:3569: write oid 37 current snap is 375 2026-02-13T20:27:13.902 INFO:tasks.rados.rados.0.trial188.stdout:3569: seq_num 1237 ranges {790259=732199,1936461=477097} 2026-02-13T20:27:13.906 INFO:tasks.rados.rados.0.trial188.stdout:3569: writing trial18843701-37 from 790259 to 1522458 tid 1 2026-02-13T20:27:13.909 INFO:tasks.rados.rados.0.trial188.stdout:3569: writing trial18843701-37 from 1936461 to 2413558 tid 2 2026-02-13T20:27:13.909 INFO:tasks.rados.rados.0.trial188.stdout:3570: snap_remove snap 368 2026-02-13T20:27:14.837 INFO:tasks.rados.rados.0.trial188.stdout:3570: done (2 left) 2026-02-13T20:27:14.838 INFO:tasks.rados.rados.0.trial188.stdout:3571: read oid 25 snap 341 2026-02-13T20:27:14.838 INFO:tasks.rados.rados.0.trial188.stdout:3571: expect deleted 2026-02-13T20:27:14.838 INFO:tasks.rados.rados.0.trial188.stdout:3572: write (excl) oid 21 current snap is 375 2026-02-13T20:27:14.838 INFO:tasks.rados.rados.0.trial188.stdout:3572: seq_num 1238 ranges {407066=407448,1594943=620755} 2026-02-13T20:27:14.840 INFO:tasks.rados.rados.0.trial188.stdout:3572: writing trial18843701-21 from 407066 to 814514 tid 1 2026-02-13T20:27:14.846 INFO:tasks.rados.rados.0.trial188.stdout:3572: writing trial18843701-21 from 1594943 to 2215698 tid 2 2026-02-13T20:27:14.846 INFO:tasks.rados.rados.0.trial188.stdout:3573: snap_remove snap 363 2026-02-13T20:27:15.840 INFO:tasks.rados.rados.0.trial188.stdout:3573: done (4 left) 2026-02-13T20:27:15.840 INFO:tasks.rados.rados.0.trial188.stdout:3574: write oid 48 current snap is 375 2026-02-13T20:27:15.841 INFO:tasks.rados.rados.0.trial188.stdout:3574: seq_num 1239 ranges {423873=482697,1653425=480766,2691441=132432} 2026-02-13T20:27:15.844 INFO:tasks.rados.rados.0.trial188.stdout:3574: writing trial18843701-48 from 423873 to 906570 tid 1 2026-02-13T20:27:15.849 INFO:tasks.rados.rados.0.trial188.stdout:3574: writing trial18843701-48 from 1653425 to 2134191 tid 2 2026-02-13T20:27:15.852 INFO:tasks.rados.rados.0.trial188.stdout:3574: writing trial18843701-48 from 2691441 to 2823873 tid 3 2026-02-13T20:27:15.852 INFO:tasks.rados.rados.0.trial188.stdout:3575: write oid 46 current snap is 375 2026-02-13T20:27:15.852 INFO:tasks.rados.rados.0.trial188.stdout:3575: seq_num 1240 ranges {440680=674299,1711907=624424} 2026-02-13T20:27:15.856 INFO:tasks.rados.rados.0.trial188.stdout:3575: writing trial18843701-46 from 440680 to 1114979 tid 1 2026-02-13T20:27:15.861 INFO:tasks.rados.rados.0.trial188.stdout:3575: writing trial18843701-46 from 1711907 to 2336331 tid 2 2026-02-13T20:27:15.861 INFO:tasks.rados.rados.0.trial188.stdout:3576: delete oid 4 current snap is 375 2026-02-13T20:27:15.861 INFO:tasks.rados.rados.0.trial188.stdout:3568: expect (ObjNum 1189 snap 364 seq_num 1189) 2026-02-13T20:27:15.900 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 3160201 2026-02-13T20:27:15.912 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:27:16.027 INFO:tasks.rados.rados.0.trial188.stdout:3569: finishing write tid 1 to trial18843701-37 2026-02-13T20:27:16.028 INFO:tasks.rados.rados.0.trial188.stdout:3569: finishing write tid 2 to trial18843701-37 2026-02-13T20:27:16.028 INFO:tasks.rados.rados.0.trial188.stdout:3568: done (6 left) 2026-02-13T20:27:16.028 INFO:tasks.rados.rados.0.trial188.stdout:3576: done (5 left) 2026-02-13T20:27:16.028 INFO:tasks.rados.rados.0.trial188.stdout:3577: rollback oid 47 current snap is 375 2026-02-13T20:27:16.028 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 47 to 370 2026-02-13T20:27:16.028 INFO:tasks.rados.rados.0.trial188.stdout:3569: finishing write tid 3 to trial18843701-37 2026-02-13T20:27:16.028 INFO:tasks.rados.rados.0.trial188.stdout:3569: finishing write tid 4 to trial18843701-37 2026-02-13T20:27:16.028 INFO:tasks.rados.rados.0.trial188.stdout:3569: oid 37 updating version 0 to 1729 2026-02-13T20:27:16.028 INFO:tasks.rados.rados.0.trial188.stdout:3569: oid 37 updating version 1729 to 1730 2026-02-13T20:27:16.028 INFO:tasks.rados.rados.0.trial188.stdout:3569: oid 37 version 1730 is already newer than 1728 2026-02-13T20:27:16.028 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 37 v 1730 (ObjNum 1237 snap 375 seq_num 1237) dirty exists 2026-02-13T20:27:16.029 INFO:tasks.rados.rados.0.trial188.stdout:3569: left oid 37 (ObjNum 1237 snap 375 seq_num 1237) 2026-02-13T20:27:16.029 INFO:tasks.rados.rados.0.trial188.stdout:3572: finishing write tid 1 to trial18843701-21 2026-02-13T20:27:16.029 INFO:tasks.rados.rados.0.trial188.stdout:3572: finishing write tid 2 to trial18843701-21 2026-02-13T20:27:16.029 INFO:tasks.rados.rados.0.trial188.stdout:3572: finishing write tid 3 to trial18843701-21 2026-02-13T20:27:16.029 INFO:tasks.rados.rados.0.trial188.stdout:3572: finishing write tid 4 to trial18843701-21 2026-02-13T20:27:16.029 INFO:tasks.rados.rados.0.trial188.stdout:3572: oid 21 updating version 0 to 1110 2026-02-13T20:27:16.029 INFO:tasks.rados.rados.0.trial188.stdout:3572: oid 21 updating version 1110 to 1112 2026-02-13T20:27:16.029 INFO:tasks.rados.rados.0.trial188.stdout:3572: oid 21 version 1112 is already newer than 1111 2026-02-13T20:27:16.029 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 21 v 1112 (ObjNum 1238 snap 375 seq_num 1238) dirty exists 2026-02-13T20:27:16.029 INFO:tasks.rados.rados.0.trial188.stdout:3572: left oid 21 (ObjNum 1238 snap 375 seq_num 1238) 2026-02-13T20:27:16.029 INFO:tasks.rados.rados.0.trial188.stdout:3574: finishing write tid 1 to trial18843701-48 2026-02-13T20:27:16.029 INFO:tasks.rados.rados.0.trial188.stdout:3574: finishing write tid 2 to trial18843701-48 2026-02-13T20:27:16.030 INFO:tasks.rados.rados.0.trial188.stdout:3574: finishing write tid 3 to trial18843701-48 2026-02-13T20:27:16.030 INFO:tasks.rados.rados.0.trial188.stdout:3574: finishing write tid 4 to trial18843701-48 2026-02-13T20:27:16.030 INFO:tasks.rados.rados.0.trial188.stdout:3574: finishing write tid 5 to trial18843701-48 2026-02-13T20:27:16.030 INFO:tasks.rados.rados.0.trial188.stdout:3574: oid 48 updating version 0 to 1113 2026-02-13T20:27:16.030 INFO:tasks.rados.rados.0.trial188.stdout:3574: oid 48 updating version 1113 to 1116 2026-02-13T20:27:16.030 INFO:tasks.rados.rados.0.trial188.stdout:3574: oid 48 version 1116 is already newer than 1115 2026-02-13T20:27:16.030 INFO:tasks.rados.rados.0.trial188.stdout:3574: oid 48 version 1116 is already newer than 1114 2026-02-13T20:27:16.030 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 48 v 1116 (ObjNum 1239 snap 375 seq_num 1239) dirty exists 2026-02-13T20:27:16.030 INFO:tasks.rados.rados.0.trial188.stdout:3574: left oid 48 (ObjNum 1239 snap 375 seq_num 1239) 2026-02-13T20:27:16.030 INFO:tasks.rados.rados.0.trial188.stdout:3575: finishing write tid 1 to trial18843701-46 2026-02-13T20:27:16.030 INFO:tasks.rados.rados.0.trial188.stdout:3575: finishing write tid 2 to trial18843701-46 2026-02-13T20:27:16.030 INFO:tasks.rados.rados.0.trial188.stdout:3575: finishing write tid 3 to trial18843701-46 2026-02-13T20:27:16.031 INFO:tasks.rados.rados.0.trial188.stdout:3575: finishing write tid 4 to trial18843701-46 2026-02-13T20:27:16.031 INFO:tasks.rados.rados.0.trial188.stdout:3575: oid 46 updating version 0 to 1719 2026-02-13T20:27:16.031 INFO:tasks.rados.rados.0.trial188.stdout:3575: oid 46 version 1719 is already newer than 1718 2026-02-13T20:27:16.031 INFO:tasks.rados.rados.0.trial188.stdout:3575: oid 46 updating version 1719 to 1720 2026-02-13T20:27:16.031 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 46 v 1720 (ObjNum 1240 snap 375 seq_num 1240) dirty exists 2026-02-13T20:27:16.031 INFO:tasks.rados.rados.0.trial188.stdout:3575: left oid 46 (ObjNum 1240 snap 375 seq_num 1240) 2026-02-13T20:27:16.031 INFO:tasks.rados.rados.0.trial188.stdout:3569: done (5 left) 2026-02-13T20:27:16.031 INFO:tasks.rados.rados.0.trial188.stdout:3571: done (4 left) 2026-02-13T20:27:16.031 INFO:tasks.rados.rados.0.trial188.stdout:3572: done (3 left) 2026-02-13T20:27:16.031 INFO:tasks.rados.rados.0.trial188.stdout:3574: done (2 left) 2026-02-13T20:27:16.031 INFO:tasks.rados.rados.0.trial188.stdout:3575: done (1 left) 2026-02-13T20:27:16.031 INFO:tasks.rados.rados.0.trial188.stdout:3578: read oid 26 snap -1 2026-02-13T20:27:16.032 INFO:tasks.rados.rados.0.trial188.stdout:3578: expect (ObjNum 1234 snap 375 seq_num 1234) 2026-02-13T20:27:16.032 INFO:tasks.rados.rados.0.trial188.stdout:3579: read oid 28 snap -1 2026-02-13T20:27:16.032 INFO:tasks.rados.rados.0.trial188.stdout:3579: expect (ObjNum 1195 snap 366 seq_num 1195) 2026-02-13T20:27:16.032 INFO:tasks.rados.rados.0.trial188.stdout:3580: write (excl) oid 44 current snap is 375 2026-02-13T20:27:16.032 INFO:tasks.rados.rados.0.trial188.stdout:3580: seq_num 1242 ranges {474294=424797,1428871=628093,2657357=216937} 2026-02-13T20:27:16.032 INFO:tasks.rados.rados.0.trial188.stdout:3580: writing trial18843701-44 from 474294 to 899091 tid 1 2026-02-13T20:27:16.034 INFO:tasks.rados.rados.0.trial188.stdout:3580: writing trial18843701-44 from 1428871 to 2056964 tid 2 2026-02-13T20:27:16.038 INFO:tasks.rados.rados.0.trial188.stdout:3580: writing trial18843701-44 from 2657357 to 2874294 tid 3 2026-02-13T20:27:16.038 INFO:tasks.rados.rados.0.trial188.stdout:3581: write oid 1 current snap is 375 2026-02-13T20:27:16.038 INFO:tasks.rados.rados.0.trial188.stdout:3581: seq_num 1243 ranges {491101=500046,1487353=488104,2401133=489968} 2026-02-13T20:27:16.041 INFO:tasks.rados.rados.0.trial188.stdout:3581: writing trial18843701-1 from 491101 to 991147 tid 1 2026-02-13T20:27:16.045 INFO:tasks.rados.rados.0.trial188.stdout:3581: writing trial18843701-1 from 1487353 to 1975457 tid 2 2026-02-13T20:27:16.049 INFO:tasks.rados.rados.0.trial188.stdout:3581: writing trial18843701-1 from 2401133 to 2891101 tid 3 2026-02-13T20:27:16.049 INFO:tasks.rados.rados.0.trial188.stdout:3582: read oid 48 snap -1 2026-02-13T20:27:16.049 INFO:tasks.rados.rados.0.trial188.stdout:3582: expect (ObjNum 1239 snap 375 seq_num 1239) 2026-02-13T20:27:16.050 INFO:tasks.rados.rados.0.trial188.stdout:3583: copy_from oid 40 from oid 17 current snap is 375 2026-02-13T20:27:16.050 INFO:tasks.rados.rados.0.trial188.stdout:3577: finishing rollback tid 0 to trial18843701-47 2026-02-13T20:27:16.050 INFO:tasks.rados.rados.0.trial188.stdout:3577: finishing rollback tid 1 to trial18843701-47 2026-02-13T20:27:16.050 INFO:tasks.rados.rados.0.trial188.stdout:3577: finishing rollback tid 2 to trial18843701-47 2026-02-13T20:27:16.050 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 47 v 1101 (ObjNum 1007 snap 299 seq_num 1007) dirty exists 2026-02-13T20:27:16.050 INFO:tasks.rados.rados.0.trial188.stdout:3579: expect (ObjNum 1195 snap 366 seq_num 1195) 2026-02-13T20:27:16.070 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 84734 2026-02-13T20:27:16.104 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1077789 2026-02-13T20:27:16.117 INFO:tasks.rados.rados.0.trial188.stdout:3578: expect (ObjNum 1234 snap 375 seq_num 1234) 2026-02-13T20:27:16.240 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:27:16.303 INFO:tasks.rados.rados.0.trial188.stdout:3580: finishing write tid 1 to trial18843701-44 2026-02-13T20:27:16.304 INFO:tasks.rados.rados.0.trial188.stdout:3580: finishing write tid 2 to trial18843701-44 2026-02-13T20:27:16.304 INFO:tasks.rados.rados.0.trial188.stdout:3577: done (6 left) 2026-02-13T20:27:16.304 INFO:tasks.rados.rados.0.trial188.stdout:3578: done (5 left) 2026-02-13T20:27:16.304 INFO:tasks.rados.rados.0.trial188.stdout:3579: done (4 left) 2026-02-13T20:27:16.304 INFO:tasks.rados.rados.0.trial188.stdout:3584: delete oid 15 current snap is 375 2026-02-13T20:27:16.304 INFO:tasks.rados.rados.0.trial188.stdout:3583: finishing copy_from to trial18843701-40 2026-02-13T20:27:16.304 INFO:tasks.rados.rados.0.trial188.stdout:3583: got expected ENOENT (src dne) 2026-02-13T20:27:16.304 INFO:tasks.rados.rados.0.trial188.stdout:3583: finishing copy_from racing read to trial18843701-40 2026-02-13T20:27:16.304 INFO:tasks.rados.rados.0.trial188.stdout:3580: finishing write tid 3 to trial18843701-44 2026-02-13T20:27:16.304 INFO:tasks.rados.rados.0.trial188.stdout:3580: finishing write tid 4 to trial18843701-44 2026-02-13T20:27:16.305 INFO:tasks.rados.rados.0.trial188.stdout:3580: finishing write tid 5 to trial18843701-44 2026-02-13T20:27:16.305 INFO:tasks.rados.rados.0.trial188.stdout:3580: oid 44 updating version 0 to 1728 2026-02-13T20:27:16.305 INFO:tasks.rados.rados.0.trial188.stdout:3580: oid 44 updating version 1728 to 1729 2026-02-13T20:27:16.305 INFO:tasks.rados.rados.0.trial188.stdout:3580: oid 44 updating version 1729 to 1730 2026-02-13T20:27:16.305 INFO:tasks.rados.rados.0.trial188.stdout:3580: oid 44 updating version 1730 to 1731 2026-02-13T20:27:16.305 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 44 v 1731 (ObjNum 1242 snap 375 seq_num 1242) dirty exists 2026-02-13T20:27:16.305 INFO:tasks.rados.rados.0.trial188.stdout:3580: left oid 44 (ObjNum 1242 snap 375 seq_num 1242) 2026-02-13T20:27:16.305 INFO:tasks.rados.rados.0.trial188.stdout:3582: expect (ObjNum 1239 snap 375 seq_num 1239) 2026-02-13T20:27:16.365 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2211295 2026-02-13T20:27:16.376 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:27:16.418 INFO:tasks.rados.rados.0.trial188.stdout:3581: finishing write tid 1 to trial18843701-1 2026-02-13T20:27:16.419 INFO:tasks.rados.rados.0.trial188.stdout:3580: done (4 left) 2026-02-13T20:27:16.419 INFO:tasks.rados.rados.0.trial188.stdout:3582: done (3 left) 2026-02-13T20:27:16.419 INFO:tasks.rados.rados.0.trial188.stdout:3583: done (2 left) 2026-02-13T20:27:16.419 INFO:tasks.rados.rados.0.trial188.stdout:3584: done (1 left) 2026-02-13T20:27:16.419 INFO:tasks.rados.rados.0.trial188.stdout:3585: write (excl) oid 2 current snap is 375 2026-02-13T20:27:16.419 INFO:tasks.rados.rados.0.trial188.stdout:3581: finishing write tid 2 to trial18843701-1 2026-02-13T20:27:16.419 INFO:tasks.rados.rados.0.trial188.stdout:3581: finishing write tid 3 to trial18843701-1 2026-02-13T20:27:16.419 INFO:tasks.rados.rados.0.trial188.stdout:3581: finishing write tid 4 to trial18843701-1 2026-02-13T20:27:16.419 INFO:tasks.rados.rados.0.trial188.stdout:3581: finishing write tid 5 to trial18843701-1 2026-02-13T20:27:16.419 INFO:tasks.rados.rados.0.trial188.stdout:3581: oid 1 updating version 0 to 1732 2026-02-13T20:27:16.419 INFO:tasks.rados.rados.0.trial188.stdout:3581: oid 1 updating version 1732 to 1735 2026-02-13T20:27:16.420 INFO:tasks.rados.rados.0.trial188.stdout:3581: oid 1 version 1735 is already newer than 1734 2026-02-13T20:27:16.420 INFO:tasks.rados.rados.0.trial188.stdout:3581: oid 1 version 1735 is already newer than 1733 2026-02-13T20:27:16.420 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 1 v 1735 (ObjNum 1243 snap 375 seq_num 1243) dirty exists 2026-02-13T20:27:16.420 INFO:tasks.rados.rados.0.trial188.stdout:3581: left oid 1 (ObjNum 1243 snap 375 seq_num 1243) 2026-02-13T20:27:16.420 INFO:tasks.rados.rados.0.trial188.stdout:3585: seq_num 1245 ranges {524715=650544,1887964=491773} 2026-02-13T20:27:16.422 INFO:tasks.rados.rados.0.trial188.stdout:3585: writing trial18843701-2 from 524715 to 1175259 tid 1 2026-02-13T20:27:16.427 INFO:tasks.rados.rados.0.trial188.stdout:3585: writing trial18843701-2 from 1887964 to 2379737 tid 2 2026-02-13T20:27:16.427 INFO:tasks.rados.rados.0.trial188.stdout:3581: done (1 left) 2026-02-13T20:27:16.427 INFO:tasks.rados.rados.0.trial188.stdout:3586: delete oid 37 current snap is 375 2026-02-13T20:27:16.433 INFO:tasks.rados.rados.0.trial188.stdout:3586: done (1 left) 2026-02-13T20:27:16.433 INFO:tasks.rados.rados.0.trial188.stdout:3587: read oid 43 snap -1 2026-02-13T20:27:16.433 INFO:tasks.rados.rados.0.trial188.stdout:3587: expect (ObjNum 1216 snap 370 seq_num 1216) 2026-02-13T20:27:16.434 INFO:tasks.rados.rados.0.trial188.stdout:3588: delete oid 24 current snap is 375 2026-02-13T20:27:16.441 INFO:tasks.rados.rados.0.trial188.stdout:3588: done (2 left) 2026-02-13T20:27:16.442 INFO:tasks.rados.rados.0.trial188.stdout:3589: read oid 30 snap 346 2026-02-13T20:27:16.442 INFO:tasks.rados.rados.0.trial188.stdout:3589: expect deleted 2026-02-13T20:27:16.442 INFO:tasks.rados.rados.0.trial188.stdout:3590: read oid 11 snap -1 2026-02-13T20:27:16.442 INFO:tasks.rados.rados.0.trial188.stdout:3590: expect deleted 2026-02-13T20:27:16.442 INFO:tasks.rados.rados.0.trial188.stdout:3591: copy_from oid 50 from oid 21 current snap is 375 2026-02-13T20:27:16.442 INFO:tasks.rados.rados.0.trial188.stdout:3592: snap_remove snap 341 2026-02-13T20:27:16.845 INFO:tasks.rados.rados.0.trial188.stdout:3592: done (5 left) 2026-02-13T20:27:16.846 INFO:tasks.rados.rados.0.trial188.stdout:3593: read oid 9 snap 372 2026-02-13T20:27:16.846 INFO:tasks.rados.rados.0.trial188.stdout:3593: expect (ObjNum 1154 snap 347 seq_num 1154) 2026-02-13T20:27:16.846 INFO:tasks.rados.rados.0.trial188.stdout:3594: rollback oid 38 current snap is 375 2026-02-13T20:27:16.846 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 38 to 365 2026-02-13T20:27:16.846 INFO:tasks.rados.rados.0.trial188.stdout:3585: finishing write tid 1 to trial18843701-2 2026-02-13T20:27:16.846 INFO:tasks.rados.rados.0.trial188.stdout:3585: finishing write tid 2 to trial18843701-2 2026-02-13T20:27:16.846 INFO:tasks.rados.rados.0.trial188.stdout:3585: finishing write tid 3 to trial18843701-2 2026-02-13T20:27:16.846 INFO:tasks.rados.rados.0.trial188.stdout:3587: expect (ObjNum 1216 snap 370 seq_num 1216) 2026-02-13T20:27:16.847 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:27:16.892 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:27:16.915 INFO:tasks.rados.rados.0.trial188.stdout:3585: finishing write tid 4 to trial18843701-2 2026-02-13T20:27:16.916 INFO:tasks.rados.rados.0.trial188.stdout:3585: oid 2 updating version 0 to 1738 2026-02-13T20:27:16.916 INFO:tasks.rados.rados.0.trial188.stdout:3585: oid 2 version 1738 is already newer than 1737 2026-02-13T20:27:16.916 INFO:tasks.rados.rados.0.trial188.stdout:3585: oid 2 version 1738 is already newer than 1736 2026-02-13T20:27:16.916 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 2 v 1738 (ObjNum 1245 snap 375 seq_num 1245) dirty exists 2026-02-13T20:27:16.916 INFO:tasks.rados.rados.0.trial188.stdout:3585: left oid 2 (ObjNum 1245 snap 375 seq_num 1245) 2026-02-13T20:27:16.916 INFO:tasks.rados.rados.0.trial188.stdout:3591: finishing copy_from racing read to trial18843701-50 2026-02-13T20:27:16.916 INFO:tasks.rados.rados.0.trial188.stdout:3591: finishing copy_from to trial18843701-50 2026-02-13T20:27:16.916 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 50 v 1112 (ObjNum 1238 snap 375 seq_num 1238) dirty exists 2026-02-13T20:27:16.916 INFO:tasks.rados.rados.0.trial188.stdout:3594: finishing rollback tid 0 to trial18843701-38 2026-02-13T20:27:16.916 INFO:tasks.rados.rados.0.trial188.stdout:3585: done (6 left) 2026-02-13T20:27:16.917 INFO:tasks.rados.rados.0.trial188.stdout:3587: done (5 left) 2026-02-13T20:27:16.917 INFO:tasks.rados.rados.0.trial188.stdout:3589: done (4 left) 2026-02-13T20:27:16.917 INFO:tasks.rados.rados.0.trial188.stdout:3590: done (3 left) 2026-02-13T20:27:16.917 INFO:tasks.rados.rados.0.trial188.stdout:3591: done (2 left) 2026-02-13T20:27:16.917 INFO:tasks.rados.rados.0.trial188.stdout:3595: copy_from oid 12 from oid 34 current snap is 375 2026-02-13T20:27:16.917 INFO:tasks.rados.rados.0.trial188.stdout:3594: finishing rollback tid 1 to trial18843701-38 2026-02-13T20:27:16.917 INFO:tasks.rados.rados.0.trial188.stdout:3594: finishing rollback tid 2 to trial18843701-38 2026-02-13T20:27:16.917 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 38 v 1683 (ObjNum 1167 snap 354 seq_num 1167) dirty exists 2026-02-13T20:27:16.917 INFO:tasks.rados.rados.0.trial188.stdout:3593: expect (ObjNum 1154 snap 347 seq_num 1154) 2026-02-13T20:27:16.987 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 982718 2026-02-13T20:27:17.051 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1091103 2026-02-13T20:27:17.097 INFO:tasks.rados.rados.0.trial188.stdout:3595: finishing copy_from racing read to trial18843701-12 2026-02-13T20:27:17.097 INFO:tasks.rados.rados.0.trial188.stdout:3595: finishing copy_from to trial18843701-12 2026-02-13T20:27:17.097 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 12 v 1708 (ObjNum 1111 snap 329 seq_num 1111) dirty exists 2026-02-13T20:27:17.097 INFO:tasks.rados.rados.0.trial188.stdout:3593: done (2 left) 2026-02-13T20:27:17.097 INFO:tasks.rados.rados.0.trial188.stdout:3594: done (1 left) 2026-02-13T20:27:17.097 INFO:tasks.rados.rados.0.trial188.stdout:3595: done (0 left) 2026-02-13T20:27:17.098 INFO:tasks.rados.rados.0.trial188.stdout:3596: write oid 49 current snap is 375 2026-02-13T20:27:17.098 INFO:tasks.rados.rados.0.trial188.stdout:3596: seq_num 1248 ranges {575136=592644,1663410=639100,2705542=269594} 2026-02-13T20:27:17.101 INFO:tasks.rados.rados.0.trial188.stdout:3596: writing trial18843701-49 from 575136 to 1167780 tid 1 2026-02-13T20:27:17.105 INFO:tasks.rados.rados.0.trial188.stdout:3596: writing trial18843701-49 from 1663410 to 2302510 tid 2 2026-02-13T20:27:17.108 INFO:tasks.rados.rados.0.trial188.stdout:3596: writing trial18843701-49 from 2705542 to 2975136 tid 3 2026-02-13T20:27:17.108 INFO:tasks.rados.rados.0.trial188.stdout:3597: delete oid 17 current snap is 375 2026-02-13T20:27:17.109 INFO:tasks.rados.rados.0.trial188.stdout:3597: done (1 left) 2026-02-13T20:27:17.109 INFO:tasks.rados.rados.0.trial188.stdout:3598: read oid 4 snap -1 2026-02-13T20:27:17.109 INFO:tasks.rados.rados.0.trial188.stdout:3598: expect deleted 2026-02-13T20:27:17.109 INFO:tasks.rados.rados.0.trial188.stdout:3599: snap_create 2026-02-13T20:27:17.123 INFO:tasks.rados.rados.0.trial188.stdout:3596: finishing write tid 1 to trial18843701-49 2026-02-13T20:27:17.123 INFO:tasks.rados.rados.0.trial188.stdout:3596: finishing write tid 2 to trial18843701-49 2026-02-13T20:27:17.123 INFO:tasks.rados.rados.0.trial188.stdout:3596: finishing write tid 3 to trial18843701-49 2026-02-13T20:27:17.123 INFO:tasks.rados.rados.0.trial188.stdout:3596: finishing write tid 4 to trial18843701-49 2026-02-13T20:27:17.123 INFO:tasks.rados.rados.0.trial188.stdout:3596: finishing write tid 5 to trial18843701-49 2026-02-13T20:27:17.123 INFO:tasks.rados.rados.0.trial188.stdout:3596: oid 49 updating version 0 to 1685 2026-02-13T20:27:17.123 INFO:tasks.rados.rados.0.trial188.stdout:3596: oid 49 updating version 1685 to 1687 2026-02-13T20:27:17.124 INFO:tasks.rados.rados.0.trial188.stdout:3596: oid 49 version 1687 is already newer than 1684 2026-02-13T20:27:17.124 INFO:tasks.rados.rados.0.trial188.stdout:3596: oid 49 version 1687 is already newer than 1686 2026-02-13T20:27:17.124 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 49 v 1687 (ObjNum 1248 snap 375 seq_num 1248) dirty exists 2026-02-13T20:27:17.124 INFO:tasks.rados.rados.0.trial188.stdout:3596: left oid 49 (ObjNum 1248 snap 375 seq_num 1248) 2026-02-13T20:27:17.849 INFO:tasks.rados.rados.0.trial188.stdout:3596: done (2 left) 2026-02-13T20:27:17.849 INFO:tasks.rados.rados.0.trial188.stdout:3598: done (1 left) 2026-02-13T20:27:17.849 INFO:tasks.rados.rados.0.trial188.stdout:3599: done (0 left) 2026-02-13T20:27:17.849 INFO:tasks.rados.rados.0.trial188.stdout:3600: snap_create 2026-02-13T20:27:18.750 INFO:tasks.rados.rados.0.trial188.stdout:3600: done (0 left) 2026-02-13T20:27:18.750 INFO:tasks.rados.rados.0.trial188.stdout:3601: write (excl) oid 33 current snap is 377 2026-02-13T20:27:18.751 INFO:tasks.rados.rados.0.trial188.stdout:3601: seq_num 1250 ranges {608750=743142,1780374=642769} 2026-02-13T20:27:18.755 INFO:tasks.rados.rados.0.trial188.stdout:3601: writing trial18843701-33 from 608750 to 1351892 tid 1 2026-02-13T20:27:18.759 INFO:tasks.rados.rados.0.trial188.stdout:3601: writing trial18843701-33 from 1780374 to 2423143 tid 2 2026-02-13T20:27:18.759 INFO:tasks.rados.rados.0.trial188.stdout:3602: snap_create 2026-02-13T20:27:18.776 INFO:tasks.rados.rados.0.trial188.stdout:3601: finishing write tid 1 to trial18843701-33 2026-02-13T20:27:18.777 INFO:tasks.rados.rados.0.trial188.stdout:3601: finishing write tid 2 to trial18843701-33 2026-02-13T20:27:18.777 INFO:tasks.rados.rados.0.trial188.stdout:3601: finishing write tid 3 to trial18843701-33 2026-02-13T20:27:18.777 INFO:tasks.rados.rados.0.trial188.stdout:3601: finishing write tid 4 to trial18843701-33 2026-02-13T20:27:18.777 INFO:tasks.rados.rados.0.trial188.stdout:3601: oid 33 updating version 0 to 1104 2026-02-13T20:27:18.777 INFO:tasks.rados.rados.0.trial188.stdout:3601: oid 33 version 1104 is already newer than 1102 2026-02-13T20:27:18.777 INFO:tasks.rados.rados.0.trial188.stdout:3601: oid 33 version 1104 is already newer than 1103 2026-02-13T20:27:18.777 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 33 v 1104 (ObjNum 1250 snap 377 seq_num 1250) dirty exists 2026-02-13T20:27:18.777 INFO:tasks.rados.rados.0.trial188.stdout:3601: left oid 33 (ObjNum 1250 snap 377 seq_num 1250) 2026-02-13T20:27:19.754 INFO:tasks.rados.rados.0.trial188.stdout:3601: done (1 left) 2026-02-13T20:27:19.754 INFO:tasks.rados.rados.0.trial188.stdout:3602: done (0 left) 2026-02-13T20:27:19.754 INFO:tasks.rados.rados.0.trial188.stdout:3603: delete oid 43 current snap is 378 2026-02-13T20:27:19.757 INFO:tasks.rados.rados.0.trial188.stdout:3603: done (0 left) 2026-02-13T20:27:19.757 INFO:tasks.rados.rados.0.trial188.stdout:3604: write (excl) oid 28 current snap is 378 2026-02-13T20:27:19.757 INFO:tasks.rados.rados.0.trial188.stdout:3604: seq_num 1252 ranges {642364=493640,1897338=646438} 2026-02-13T20:27:19.761 INFO:tasks.rados.rados.0.trial188.stdout:3604: writing trial18843701-28 from 642364 to 1136004 tid 1 2026-02-13T20:27:19.767 INFO:tasks.rados.rados.0.trial188.stdout:3604: writing trial18843701-28 from 1897338 to 2543776 tid 2 2026-02-13T20:27:19.767 INFO:tasks.rados.rados.0.trial188.stdout:3605: delete oid 40 current snap is 378 2026-02-13T20:27:19.769 INFO:tasks.rados.rados.0.trial188.stdout:3605: done (1 left) 2026-02-13T20:27:19.769 INFO:tasks.rados.rados.0.trial188.stdout:3606: rollback oid 38 current snap is 378 2026-02-13T20:27:19.769 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 38 to 374 2026-02-13T20:27:19.769 INFO:tasks.rados.rados.0.trial188.stdout:3607: write (excl) oid 37 current snap is 378 2026-02-13T20:27:19.769 INFO:tasks.rados.rados.0.trial188.stdout:3607: seq_num 1254 ranges {675978=644138,1897949=650107} 2026-02-13T20:27:19.774 INFO:tasks.rados.rados.0.trial188.stdout:3607: writing trial18843701-37 from 675978 to 1320116 tid 1 2026-02-13T20:27:19.779 INFO:tasks.rados.rados.0.trial188.stdout:3607: writing trial18843701-37 from 1897949 to 2548056 tid 2 2026-02-13T20:27:19.779 INFO:tasks.rados.rados.0.trial188.stdout:3608: write (excl) oid 1 current snap is 378 2026-02-13T20:27:19.779 INFO:tasks.rados.rados.0.trial188.stdout:3608: seq_num 1255 ranges {692785=435740,1672784=793765,2897503=195282} 2026-02-13T20:27:19.783 INFO:tasks.rados.rados.0.trial188.stdout:3608: writing trial18843701-1 from 692785 to 1128525 tid 1 2026-02-13T20:27:19.788 INFO:tasks.rados.rados.0.trial188.stdout:3608: writing trial18843701-1 from 1672784 to 2466549 tid 2 2026-02-13T20:27:19.791 INFO:tasks.rados.rados.0.trial188.stdout:3608: writing trial18843701-1 from 2897503 to 3092785 tid 3 2026-02-13T20:27:19.792 INFO:tasks.rados.rados.0.trial188.stdout:3609: copy_from oid 45 from oid 48 current snap is 378 2026-02-13T20:27:19.792 INFO:tasks.rados.rados.0.trial188.stdout:3604: finishing write tid 1 to trial18843701-28 2026-02-13T20:27:19.792 INFO:tasks.rados.rados.0.trial188.stdout:3604: finishing write tid 2 to trial18843701-28 2026-02-13T20:27:19.792 INFO:tasks.rados.rados.0.trial188.stdout:3604: finishing write tid 3 to trial18843701-28 2026-02-13T20:27:19.792 INFO:tasks.rados.rados.0.trial188.stdout:3604: finishing write tid 4 to trial18843701-28 2026-02-13T20:27:19.792 INFO:tasks.rados.rados.0.trial188.stdout:3604: oid 28 updating version 0 to 1751 2026-02-13T20:27:19.792 INFO:tasks.rados.rados.0.trial188.stdout:3604: oid 28 updating version 1751 to 1752 2026-02-13T20:27:19.792 INFO:tasks.rados.rados.0.trial188.stdout:3604: oid 28 updating version 1752 to 1753 2026-02-13T20:27:19.792 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 28 v 1753 (ObjNum 1252 snap 378 seq_num 1252) dirty exists 2026-02-13T20:27:19.792 INFO:tasks.rados.rados.0.trial188.stdout:3604: left oid 28 (ObjNum 1252 snap 378 seq_num 1252) 2026-02-13T20:27:19.792 INFO:tasks.rados.rados.0.trial188.stdout:3606: finishing rollback tid 0 to trial18843701-38 2026-02-13T20:27:19.793 INFO:tasks.rados.rados.0.trial188.stdout:3606: finishing rollback tid 1 to trial18843701-38 2026-02-13T20:27:19.793 INFO:tasks.rados.rados.0.trial188.stdout:3604: done (4 left) 2026-02-13T20:27:19.793 INFO:tasks.rados.rados.0.trial188.stdout:3610: copy_from oid 7 from oid 21 current snap is 378 2026-02-13T20:27:19.793 INFO:tasks.rados.rados.0.trial188.stdout:3611: write (excl) oid 35 current snap is 378 2026-02-13T20:27:19.793 INFO:tasks.rados.rados.0.trial188.stdout:3611: seq_num 1256 ranges {709592=510989,1731266=653776,3041279=68313} 2026-02-13T20:27:19.795 INFO:tasks.rados.rados.0.trial188.stdout:3611: writing trial18843701-35 from 709592 to 1220581 tid 1 2026-02-13T20:27:19.799 INFO:tasks.rados.rados.0.trial188.stdout:3611: writing trial18843701-35 from 1731266 to 2385042 tid 2 2026-02-13T20:27:19.802 INFO:tasks.rados.rados.0.trial188.stdout:3611: writing trial18843701-35 from 3041279 to 3109592 tid 3 2026-02-13T20:27:19.803 INFO:tasks.rados.rados.0.trial188.stdout:3606: finishing rollback tid 2 to trial18843701-38 2026-02-13T20:27:19.803 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 38 v 1691 (ObjNum 1199 snap 367 seq_num 1199) dirty exists 2026-02-13T20:27:19.803 INFO:tasks.rados.rados.0.trial188.stdout:3612: read oid 47 snap -1 2026-02-13T20:27:19.803 INFO:tasks.rados.rados.0.trial188.stdout:3612: expect (ObjNum 1007 snap 299 seq_num 1007) 2026-02-13T20:27:19.803 INFO:tasks.rados.rados.0.trial188.stdout:3606: done (6 left) 2026-02-13T20:27:19.803 INFO:tasks.rados.rados.0.trial188.stdout:3613: snap_remove snap 375 2026-02-13T20:27:20.647 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-13T20:27:20.647 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-13T20:27:20.647 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-13T20:27:20.648 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-13T20:27:20.662 INFO:tasks.ceph.mon.c:Started 2026-02-13T20:27:20.663 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-13T20:27:20.663 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T20:27:20.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.728+0000 7f6c503c2640 10 monclient: get_monmap_and_config 2026-02-13T20:27:20.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.728+0000 7f6c503c2640 10 monclient: build_initial_monmap 2026-02-13T20:27:20.729 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.728+0000 7f6c503c2640 10 monclient: monmap: 2026-02-13T20:27:20.729 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:27:20.729 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:20.729 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:27:20.729029+0000 2026-02-13T20:27:20.729 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:27:20.729029+0000 2026-02-13T20:27:20.729 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:27:20.730 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:20.730 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:27:20.730 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:27:20.730 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:27:20.730 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:20.737 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.729+0000 7f6c503c2640 1 Processor -- start 2026-02-13T20:27:20.737 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.729+0000 7f6c503c2640 1 -- start start 2026-02-13T20:27:20.737 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.729+0000 7f6c503c2640 10 monclient: init 2026-02-13T20:27:20.737 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.729+0000 7f6c503c2640 10 monclient: _reopen_session rank -1 2026-02-13T20:27:20.737 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.729+0000 7f6c503c2640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:27:20.737 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.729+0000 7f6c503c2640 10 monclient(hunting): picked mon.noname-c con 0x7f6c48089250 addr v1:10.20.193.188:6789/0 2026-02-13T20:27:20.738 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.729+0000 7f6c503c2640 10 monclient(hunting): picked mon.noname-b con 0x7f6c48057780 addr v1:10.20.193.110:6790/0 2026-02-13T20:27:20.738 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.729+0000 7f6c503c2640 10 monclient(hunting): picked mon.noname-a con 0x7f6c48184b60 addr v1:10.20.193.110:6789/0 2026-02-13T20:27:20.738 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.729+0000 7f6c503c2640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c4808a950 con 0x7f6c48184b60 2026-02-13T20:27:20.738 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.729+0000 7f6c503c2640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c48089620 con 0x7f6c48089250 2026-02-13T20:27:20.738 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.729+0000 7f6c503c2640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c48057c60 con 0x7f6c48057780 2026-02-13T20:27:20.738 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.729+0000 7f6c503c2640 10 monclient(hunting): _renew_subs 2026-02-13T20:27:20.738 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.729+0000 7f6c503c2640 10 monclient(hunting): authenticate will time out at 1602.419502s 2026-02-13T20:27:20.738 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.729+0000 7f6c4d936640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f6c48057780 0x7f6c48183440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:48128/0 (socket says 10.20.193.110:48128) 2026-02-13T20:27:20.738 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.729+0000 7f6c4d936640 1 -- 10.20.193.110:0/2369898572 learned_addr learned my addr 10.20.193.110:0/2369898572 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:27:20.738 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.729+0000 7f6c4e938640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f6c48184b60 0x7f6c481a4f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:42566/0 (socket says 10.20.193.110:42566) 2026-02-13T20:27:20.738 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.729+0000 7f6c4d135640 1 -- 10.20.193.110:0/2369898572 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1481552298 0 0) 0x7f6c4808a950 con 0x7f6c48184b60 2026-02-13T20:27:20.739 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.729+0000 7f6c4d135640 10 monclient(hunting): _negotiate 2026-02-13T20:27:20.739 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.729+0000 7f6c4d135640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:20.739 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.729+0000 7f6c4d135640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:20.739 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.729+0000 7f6c4d135640 10 monclient(hunting): my global_id is 124386 2026-02-13T20:27:20.739 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.729+0000 7f6c4d135640 1 -- 10.20.193.110:0/2369898572 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c300035e0 con 0x7f6c48184b60 2026-02-13T20:27:20.739 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.729+0000 7f6c4d135640 1 -- 10.20.193.110:0/2369898572 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2732903860 0 0) 0x7f6c300035e0 con 0x7f6c48184b60 2026-02-13T20:27:20.739 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.729+0000 7f6c4d135640 1 -- 10.20.193.110:0/2369898572 >> v1:10.20.193.110:6790/0 conn(0x7f6c48057780 legacy=0x7f6c48183440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:20.739 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.729+0000 7f6c4d135640 1 -- 10.20.193.110:0/2369898572 >> v1:10.20.193.188:6789/0 conn(0x7f6c48089250 legacy=0x7f6c480580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T20:27:20.739 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.729+0000 7f6c4d135640 10 monclient: _finish_hunting 0 2026-02-13T20:27:20.739 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.729+0000 7f6c4d135640 1 monclient: found mon.noname-a 2026-02-13T20:27:20.739 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.729+0000 7f6c4d135640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:27:20.740 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.729+0000 7f6c4d135640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:27:20.740 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.729+0000 7f6c4d135640 1 -- 10.20.193.110:0/2369898572 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c48089a50 con 0x7f6c48184b60 2026-02-13T20:27:20.740 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.729+0000 7f6c4d135640 10 monclient: _finish_auth 0 2026-02-13T20:27:20.740 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.729+0000 7f6c4d135640 10 monclient: _check_auth_tickets 2026-02-13T20:27:20.740 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.729+0000 7f6c4d135640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:27:20.740 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.729+0000 7f6c4d135640 1 -- 10.20.193.110:0/2369898572 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f6c44003eb0 con 0x7f6c48184b60 2026-02-13T20:27:20.740 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.729+0000 7f6c4d135640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:20.740 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.729+0000 7f6c4d135640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:27:20.740 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.729+0000 7f6c4d135640 10 monclient: dump: 2026-02-13T20:27:20.740 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:20.740 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:20.740 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:20.740 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:20.741 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:20.741 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:20.741 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:20.741 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:20.741 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:20.741 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:20.741 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.729+0000 7f6c503c2640 5 monclient: authenticate success, global_id 124386 2026-02-13T20:27:20.741 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.729+0000 7f6c503c2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:27:20.741 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.730+0000 7f6c4d135640 1 -- 10.20.193.110:0/2369898572 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6c44004170 con 0x7f6c48184b60 2026-02-13T20:27:20.741 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.730+0000 7f6c4d135640 10 monclient: handle_config config(0 keys) 2026-02-13T20:27:20.741 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.730+0000 7f6c4d135640 1 -- 10.20.193.110:0/2369898572 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f6c44004580 con 0x7f6c48184b60 2026-02-13T20:27:20.741 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.730+0000 7f6c4d135640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:20.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.730+0000 7f6c4d135640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:27:20.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.730+0000 7f6c4d135640 10 monclient: dump: 2026-02-13T20:27:20.742 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:20.742 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:20.742 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:20.742 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:20.742 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:20.742 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:20.742 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:20.742 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:20.742 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:20.742 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:20.743 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.730+0000 7f6c503c2640 10 monclient: get_monmap_and_config success 2026-02-13T20:27:20.743 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.730+0000 7f6c503c2640 4 set_mon_vals no callback set 2026-02-13T20:27:20.743 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.730+0000 7f6c503c2640 10 monclient: shutdown 2026-02-13T20:27:20.743 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.730+0000 7f6c503c2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:27:20.743 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.730+0000 7f6c503c2640 1 -- 10.20.193.110:0/2369898572 >> v1:10.20.193.110:6789/0 conn(0x7f6c48184b60 legacy=0x7f6c481a4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:20.743 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.730+0000 7f6c503c2640 1 -- 10.20.193.110:0/2369898572 shutdown_connections 2026-02-13T20:27:20.743 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.730+0000 7f6c503c2640 1 -- 10.20.193.110:0/2369898572 >> 10.20.193.110:0/2369898572 conn(0x7f6c48054330 msgr2=0x7f6c48054730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:27:20.743 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.730+0000 7f6c503c2640 1 -- 10.20.193.110:0/2369898572 shutdown_connections 2026-02-13T20:27:20.743 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.730+0000 7f6c503c2640 1 -- 10.20.193.110:0/2369898572 wait complete. 2026-02-13T20:27:20.743 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.731+0000 7f6c503c2640 10 monclient: build_initial_monmap 2026-02-13T20:27:20.743 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.731+0000 7f6c503c2640 10 monclient: monmap: 2026-02-13T20:27:20.743 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:27:20.744 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:27:20.744 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:27:20.744 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:27:20.744 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:27:20.744 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:27:20.744 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:27:20.744 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:27:20.744 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:27:20.744 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:20.744 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.731+0000 7f6c503c2640 1 Processor -- start 2026-02-13T20:27:20.744 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.731+0000 7f6c503c2640 1 -- start start 2026-02-13T20:27:20.744 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.731+0000 7f6c503c2640 10 monclient: init 2026-02-13T20:27:20.744 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.731+0000 7f6c503c2640 10 monclient: _reopen_session rank -1 2026-02-13T20:27:20.745 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.731+0000 7f6c503c2640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:27:20.745 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.731+0000 7f6c503c2640 10 monclient(hunting): picked mon.noname-b con 0x7f6c48057780 addr v1:10.20.193.188:6789/0 2026-02-13T20:27:20.745 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.731+0000 7f6c503c2640 10 monclient(hunting): picked mon.noname-c con 0x7f6c48089250 addr v1:10.20.193.110:6790/0 2026-02-13T20:27:20.745 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.731+0000 7f6c503c2640 10 monclient(hunting): picked mon.noname-a con 0x7f6c48184b60 addr v1:10.20.193.110:6789/0 2026-02-13T20:27:20.745 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.731+0000 7f6c503c2640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c48111670 con 0x7f6c48184b60 2026-02-13T20:27:20.745 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.731+0000 7f6c503c2640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c4812b290 con 0x7f6c48057780 2026-02-13T20:27:20.745 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.731+0000 7f6c503c2640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c48062290 con 0x7f6c48089250 2026-02-13T20:27:20.745 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.731+0000 7f6c503c2640 10 monclient(hunting): _renew_subs 2026-02-13T20:27:20.745 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.731+0000 7f6c503c2640 10 monclient(hunting): authenticate will time out at 1602.421606s 2026-02-13T20:27:20.745 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.731+0000 7f6c4e938640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f6c48184b60 0x7f6c48173660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:42578/0 (socket says 10.20.193.110:42578) 2026-02-13T20:27:20.745 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.731+0000 7f6c4e938640 1 -- 10.20.193.110:0/3241746678 learned_addr learned my addr 10.20.193.110:0/3241746678 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:27:20.745 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.731+0000 7f6c2effd640 1 -- 10.20.193.110:0/3241746678 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3532406382 0 0) 0x7f6c48111670 con 0x7f6c48184b60 2026-02-13T20:27:20.746 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.731+0000 7f6c2effd640 10 monclient(hunting): _negotiate 2026-02-13T20:27:20.746 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.731+0000 7f6c2effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:20.746 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.731+0000 7f6c2effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:20.746 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.731+0000 7f6c2effd640 10 monclient(hunting): my global_id is 124389 2026-02-13T20:27:20.746 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.731+0000 7f6c2effd640 1 -- 10.20.193.110:0/3241746678 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c180035e0 con 0x7f6c48184b60 2026-02-13T20:27:20.746 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.732+0000 7f6c2effd640 1 -- 10.20.193.110:0/3241746678 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3847283422 0 0) 0x7f6c180035e0 con 0x7f6c48184b60 2026-02-13T20:27:20.746 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.732+0000 7f6c2effd640 1 -- 10.20.193.110:0/3241746678 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6c48111670 con 0x7f6c48184b60 2026-02-13T20:27:20.746 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.732+0000 7f6c2effd640 1 -- 10.20.193.110:0/3241746678 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f6c44004490 con 0x7f6c48184b60 2026-02-13T20:27:20.746 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.732+0000 7f6c2effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:27:20.746 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.732+0000 7f6c2effd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:27:20.746 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.732+0000 7f6c2effd640 10 monclient(hunting): dump: 2026-02-13T20:27:20.746 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:20.747 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:20.747 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:20.747 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:20.747 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:20.747 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:20.747 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:20.747 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:20.747 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:20.747 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:20.747 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.732+0000 7f6c2effd640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:27:20.747 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.732+0000 7f6c2effd640 1 -- 10.20.193.110:0/3241746678 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1011806305 0 0) 0x7f6c48111670 con 0x7f6c48184b60 2026-02-13T20:27:20.747 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.732+0000 7f6c2effd640 1 -- 10.20.193.110:0/3241746678 >> v1:10.20.193.110:6790/0 conn(0x7f6c48089250 legacy=0x7f6c48171f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:20.748 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.732+0000 7f6c2effd640 1 -- 10.20.193.110:0/3241746678 >> v1:10.20.193.188:6789/0 conn(0x7f6c48057780 legacy=0x7f6c4812ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:20.748 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.732+0000 7f6c2effd640 10 monclient: _finish_hunting 0 2026-02-13T20:27:20.748 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.732+0000 7f6c2effd640 1 monclient: found mon.a 2026-02-13T20:27:20.748 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.732+0000 7f6c2effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:27:20.748 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.732+0000 7f6c2effd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:27:20.748 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.732+0000 7f6c2effd640 1 -- 10.20.193.110:0/3241746678 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c48110180 con 0x7f6c48184b60 2026-02-13T20:27:20.748 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.732+0000 7f6c2effd640 10 monclient: _finish_auth 0 2026-02-13T20:27:20.748 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.732+0000 7f6c2effd640 10 monclient: _check_auth_tickets 2026-02-13T20:27:20.748 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.732+0000 7f6c2effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:27:20.748 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.732+0000 7f6c503c2640 5 monclient: authenticate success, global_id 124389 2026-02-13T20:27:20.748 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.732+0000 7f6c503c2640 10 monclient: _renew_subs 2026-02-13T20:27:20.748 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.732+0000 7f6c503c2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:27:20.749 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.732+0000 7f6c503c2640 1 -- 10.20.193.110:0/3241746678 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6c481124e0 con 0x7f6c48184b60 2026-02-13T20:27:20.749 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.732+0000 7f6c503c2640 10 monclient: _renew_subs 2026-02-13T20:27:20.749 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.732+0000 7f6c503c2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:27:20.749 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.732+0000 7f6c503c2640 1 -- 10.20.193.110:0/3241746678 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6c48110e80 con 0x7f6c48184b60 2026-02-13T20:27:20.749 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.732+0000 7f6c2effd640 1 -- 10.20.193.110:0/3241746678 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6c44005cd0 con 0x7f6c48184b60 2026-02-13T20:27:20.749 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.732+0000 7f6c2effd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:27:20.749 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.732+0000 7f6c2effd640 1 -- 10.20.193.110:0/3241746678 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f6c44005ff0 con 0x7f6c48184b60 2026-02-13T20:27:20.749 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.732+0000 7f6c2effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:20.749 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.732+0000 7f6c4c934640 4 set_mon_vals no callback set 2026-02-13T20:27:20.749 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.732+0000 7f6c2effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:27:20.749 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.732+0000 7f6c2effd640 10 monclient: dump: 2026-02-13T20:27:20.749 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:20.749 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:20.750 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:20.750 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:20.750 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:20.750 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:20.750 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:20.750 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:20.750 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:20.750 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:20.750 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.732+0000 7f6c503c2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:27:20.750 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.732+0000 7f6c503c2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:27:20.750 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.732+0000 7f6c503c2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:27:20.750 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.732+0000 7f6c503c2640 1 -- 10.20.193.110:0/3241746678 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c48089030 con 0x7f6c48184b60 2026-02-13T20:27:20.750 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.732+0000 7f6c2effd640 1 -- 10.20.193.110:0/3241746678 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f6c44012c60 con 0x7f6c48184b60 2026-02-13T20:27:20.751 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.733+0000 7f6c2effd640 1 -- 10.20.193.110:0/3241746678 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(771..771 src has 1..771) ==== 3931+0+0 (unknown 2572147740 0 0) 0x7f6c4404fb30 con 0x7f6c48184b60 2026-02-13T20:27:20.751 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.733+0000 7f6c4e137640 10 monclient: get_auth_request con 0x7f6c1803f5c0 auth_method 0 2026-02-13T20:27:20.751 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.735+0000 7f6c2effd640 1 -- 10.20.193.110:0/3241746678 <== mon.0 v1:10.20.193.110:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f6c44018330 con 0x7f6c48184b60 2026-02-13T20:27:20.751 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.735+0000 7f6c2effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:27:20.751 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.735+0000 7f6c2effd640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:27:20.880 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.879+0000 7f6c503c2640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T20:27:20.880 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.879+0000 7f6c503c2640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T20:27:20.880 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.879+0000 7f6c503c2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:27:20.880 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.879+0000 7f6c503c2640 1 -- 10.20.193.110:0/3241746678 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6c48112160 con 0x7f6c48184b60 2026-02-13T20:27:20.880 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.879+0000 7f6c2effd640 1 -- 10.20.193.110:0/3241746678 <== mon.0 v1:10.20.193.110:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 2779738168) 0x7f6c44017ae0 con 0x7f6c48184b60 2026-02-13T20:27:20.880 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.879+0000 7f6c2effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T20:27:20.880 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.879+0000 7f6c2effd640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:27:20.881 INFO:teuthology.orchestra.run.trial110.stdout:{"election_epoch":58,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","modified":"2026-02-13T20:11:07.161192Z","created":"2026-02-13T20:11:07.161192Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6789","nonce":0}]},"addr":"10.20.193.110:6789/0","public_addr":"10.20.193.110:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161241+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6789","nonce":0}]},"addr":"10.20.193.188:6789/0","public_addr":"10.20.193.188:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161242+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6790","nonce":0}]},"addr":"10.20.193.110:6790/0","public_addr":"10.20.193.110:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161243+0000","crush_location":[]}]}} 2026-02-13T20:27:20.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.880+0000 7f6c503c2640 1 -- 10.20.193.110:0/3241746678 >> v1:10.20.193.188:6812/1623052694 conn(0x7f6c1803f5c0 legacy=0x7f6c1805fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:20.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.880+0000 7f6c503c2640 10 monclient: shutdown 2026-02-13T20:27:20.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.880+0000 7f6c503c2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:27:20.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.880+0000 7f6c503c2640 1 -- 10.20.193.110:0/3241746678 >> v1:10.20.193.110:6789/0 conn(0x7f6c48184b60 legacy=0x7f6c48173660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:20.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.880+0000 7f6c503c2640 1 -- 10.20.193.110:0/3241746678 shutdown_connections 2026-02-13T20:27:20.883 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.880+0000 7f6c503c2640 1 -- 10.20.193.110:0/3241746678 >> 10.20.193.110:0/3241746678 conn(0x7f6c48054330 msgr2=0x7f6c4808c480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:27:20.883 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.880+0000 7f6c503c2640 1 -- 10.20.193.110:0/3241746678 shutdown_connections 2026-02-13T20:27:20.883 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.880+0000 7f6c503c2640 1 -- 10.20.193.110:0/3241746678 wait complete. 2026-02-13T20:27:20.889 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-13T20:27:20.889 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-13T20:27:20.889 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T20:27:20.954 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.954+0000 7f3a25fae640 10 monclient: get_monmap_and_config 2026-02-13T20:27:20.955 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.954+0000 7f3a25fae640 10 monclient: build_initial_monmap 2026-02-13T20:27:20.955 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.954+0000 7f3a25fae640 10 monclient: monmap: 2026-02-13T20:27:20.955 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:27:20.955 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:20.955 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:27:20.954814+0000 2026-02-13T20:27:20.955 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:27:20.954814+0000 2026-02-13T20:27:20.955 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:27:20.955 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:20.955 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:27:20.956 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:27:20.956 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:27:20.956 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:20.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.954+0000 7f3a25fae640 1 Processor -- start 2026-02-13T20:27:20.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.954+0000 7f3a25fae640 1 -- start start 2026-02-13T20:27:20.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.954+0000 7f3a25fae640 10 monclient: init 2026-02-13T20:27:20.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a25fae640 10 monclient: _reopen_session rank -1 2026-02-13T20:27:20.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a25fae640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:27:20.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a25fae640 10 monclient(hunting): picked mon.noname-a con 0x7f3a20091e20 addr v1:10.20.193.110:6789/0 2026-02-13T20:27:20.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a25fae640 10 monclient(hunting): picked mon.noname-c con 0x7f3a20089540 addr v1:10.20.193.188:6789/0 2026-02-13T20:27:20.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a25fae640 10 monclient(hunting): picked mon.noname-b con 0x7f3a20089980 addr v1:10.20.193.110:6790/0 2026-02-13T20:27:20.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a25fae640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a2005b3d0 con 0x7f3a20091e20 2026-02-13T20:27:20.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a25fae640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a2005b6b0 con 0x7f3a20089540 2026-02-13T20:27:20.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a25fae640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a2005cd90 con 0x7f3a20089980 2026-02-13T20:27:20.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a25fae640 10 monclient(hunting): _renew_subs 2026-02-13T20:27:20.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a25fae640 10 monclient(hunting): authenticate will time out at 1602.645159s 2026-02-13T20:27:20.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a1f7fe640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f3a20091e20 0x7f3a20088e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:42588/0 (socket says 10.20.193.110:42588) 2026-02-13T20:27:20.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a1f7fe640 1 -- 10.20.193.110:0/1493104495 learned_addr learned my addr 10.20.193.110:0/1493104495 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:27:20.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a1e7fc640 1 -- 10.20.193.110:0/1493104495 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2381063614 0 0) 0x7f3a2005cd90 con 0x7f3a20089980 2026-02-13T20:27:20.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a1e7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:27:20.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a1e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:20.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a1e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:20.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a1e7fc640 10 monclient(hunting): my global_id is 154100 2026-02-13T20:27:20.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a1e7fc640 1 -- 10.20.193.110:0/1493104495 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a040035e0 con 0x7f3a20089980 2026-02-13T20:27:20.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a1e7fc640 1 -- 10.20.193.110:0/1493104495 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2995068680 0 0) 0x7f3a2005b3d0 con 0x7f3a20091e20 2026-02-13T20:27:20.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a1e7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:27:20.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a1e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:20.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a1e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:20.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a1e7fc640 10 monclient(hunting): my global_id is 124392 2026-02-13T20:27:20.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a1e7fc640 1 -- 10.20.193.110:0/1493104495 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a2005cd90 con 0x7f3a20091e20 2026-02-13T20:27:20.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a1e7fc640 1 -- 10.20.193.110:0/1493104495 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3745127514 0 0) 0x7f3a040035e0 con 0x7f3a20089980 2026-02-13T20:27:20.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a1e7fc640 1 -- 10.20.193.110:0/1493104495 >> v1:10.20.193.188:6789/0 conn(0x7f3a20089540 legacy=0x7f3a20183d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T20:27:20.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a1e7fc640 1 -- 10.20.193.110:0/1493104495 >> v1:10.20.193.110:6789/0 conn(0x7f3a20091e20 legacy=0x7f3a20088e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:20.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a1e7fc640 10 monclient: _finish_hunting 0 2026-02-13T20:27:20.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a1e7fc640 1 monclient: found mon.noname-b 2026-02-13T20:27:20.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a1e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:27:20.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a1e7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:27:20.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a1e7fc640 1 -- 10.20.193.110:0/1493104495 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a2008ad10 con 0x7f3a20089980 2026-02-13T20:27:20.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a1e7fc640 10 monclient: _finish_auth 0 2026-02-13T20:27:20.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a1e7fc640 10 monclient: _check_auth_tickets 2026-02-13T20:27:20.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a1e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:27:20.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a25fae640 5 monclient: authenticate success, global_id 154100 2026-02-13T20:27:20.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a1e7fc640 1 -- 10.20.193.110:0/1493104495 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f3a14003eb0 con 0x7f3a20089980 2026-02-13T20:27:20.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a25fae640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:27:20.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a1e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:20.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a1e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:27:20.970 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a1e7fc640 10 monclient: dump: 2026-02-13T20:27:20.970 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:20.970 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:20.970 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:20.970 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:20.970 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:20.970 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:20.970 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:20.970 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:20.970 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:20.970 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:20.970 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a25fae640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:27:20.971 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a1e7fc640 1 -- 10.20.193.110:0/1493104495 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3a14004130 con 0x7f3a20089980 2026-02-13T20:27:20.971 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a1e7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:27:20.971 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a1e7fc640 1 -- 10.20.193.110:0/1493104495 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f3a14004540 con 0x7f3a20089980 2026-02-13T20:27:20.971 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a25fae640 10 monclient: get_monmap_and_config success 2026-02-13T20:27:20.971 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a25fae640 4 set_mon_vals no callback set 2026-02-13T20:27:20.971 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a1e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:20.971 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a1e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:27:20.971 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a1e7fc640 10 monclient: dump: 2026-02-13T20:27:20.971 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:20.971 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:20.971 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:20.971 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:20.971 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:20.972 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:20.972 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:20.972 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:20.972 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:20.972 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:20.972 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a25fae640 10 monclient: shutdown 2026-02-13T20:27:20.972 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a25fae640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:27:20.972 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.955+0000 7f3a25fae640 1 -- 10.20.193.110:0/1493104495 >> v1:10.20.193.110:6790/0 conn(0x7f3a20089980 legacy=0x7f3a201a5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:20.972 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.956+0000 7f3a25fae640 1 -- 10.20.193.110:0/1493104495 shutdown_connections 2026-02-13T20:27:20.972 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.956+0000 7f3a25fae640 1 -- 10.20.193.110:0/1493104495 >> 10.20.193.110:0/1493104495 conn(0x7f3a20054e90 msgr2=0x7f3a20058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:27:20.972 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.956+0000 7f3a25fae640 1 -- 10.20.193.110:0/1493104495 shutdown_connections 2026-02-13T20:27:20.972 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.956+0000 7f3a25fae640 1 -- 10.20.193.110:0/1493104495 wait complete. 2026-02-13T20:27:20.973 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.956+0000 7f3a25fae640 10 monclient: build_initial_monmap 2026-02-13T20:27:20.973 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.956+0000 7f3a25fae640 10 monclient: monmap: 2026-02-13T20:27:20.973 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:27:20.973 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:27:20.973 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:27:20.973 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:27:20.973 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:27:20.973 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:27:20.973 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:27:20.973 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:27:20.973 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:27:20.973 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:20.974 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.956+0000 7f3a25fae640 1 Processor -- start 2026-02-13T20:27:20.974 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.956+0000 7f3a25fae640 1 -- start start 2026-02-13T20:27:20.974 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.956+0000 7f3a25fae640 10 monclient: init 2026-02-13T20:27:20.974 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.956+0000 7f3a25fae640 10 monclient: _reopen_session rank -1 2026-02-13T20:27:20.974 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.956+0000 7f3a25fae640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:27:20.974 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.956+0000 7f3a25fae640 10 monclient(hunting): picked mon.noname-a con 0x7f3a20089540 addr v1:10.20.193.110:6789/0 2026-02-13T20:27:20.974 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.956+0000 7f3a25fae640 10 monclient(hunting): picked mon.noname-b con 0x7f3a20089980 addr v1:10.20.193.188:6789/0 2026-02-13T20:27:20.974 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.956+0000 7f3a25fae640 10 monclient(hunting): picked mon.noname-c con 0x7f3a20091e20 addr v1:10.20.193.110:6790/0 2026-02-13T20:27:20.974 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.956+0000 7f3a25fae640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a2005d320 con 0x7f3a20089540 2026-02-13T20:27:20.974 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.956+0000 7f3a25fae640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a200593d0 con 0x7f3a20089980 2026-02-13T20:27:20.974 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f3a25fae640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a20193e00 con 0x7f3a20091e20 2026-02-13T20:27:20.974 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f3a25fae640 10 monclient(hunting): _renew_subs 2026-02-13T20:27:20.974 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f3a25fae640 10 monclient(hunting): authenticate will time out at 1602.647012s 2026-02-13T20:27:20.975 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f3a1f7fe640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f3a20089540 0x7f3a201d6960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:42604/0 (socket says 10.20.193.110:42604) 2026-02-13T20:27:20.975 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f3a1ffff640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f3a20091e20 0x7f3a2023c240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:48140/0 (socket says 10.20.193.110:48140) 2026-02-13T20:27:20.975 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f3a1f7fe640 1 -- 10.20.193.110:0/986283742 learned_addr learned my addr 10.20.193.110:0/986283742 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:27:20.975 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f39fbfff640 1 -- 10.20.193.110:0/986283742 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2760472171 0 0) 0x7f3a20193e00 con 0x7f3a20091e20 2026-02-13T20:27:20.975 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f39fbfff640 10 monclient(hunting): _negotiate 2026-02-13T20:27:20.975 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f39fbfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:20.975 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f39fbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:20.975 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f39fbfff640 10 monclient(hunting): my global_id is 154103 2026-02-13T20:27:20.975 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f39fbfff640 1 -- 10.20.193.110:0/986283742 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f39f00035e0 con 0x7f3a20091e20 2026-02-13T20:27:20.975 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f39fbfff640 1 -- 10.20.193.110:0/986283742 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3494685249 0 0) 0x7f3a2005d320 con 0x7f3a20089540 2026-02-13T20:27:20.975 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f39fbfff640 10 monclient(hunting): _negotiate 2026-02-13T20:27:20.975 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f39fbfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:20.976 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f39fbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:20.976 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f39fbfff640 10 monclient(hunting): my global_id is 124395 2026-02-13T20:27:20.976 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f39fbfff640 1 -- 10.20.193.110:0/986283742 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a20193e00 con 0x7f3a20089540 2026-02-13T20:27:20.976 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f39fbfff640 1 -- 10.20.193.110:0/986283742 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 243780149 0 0) 0x7f39f00035e0 con 0x7f3a20091e20 2026-02-13T20:27:20.976 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f39fbfff640 1 -- 10.20.193.110:0/986283742 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3a2005d320 con 0x7f3a20091e20 2026-02-13T20:27:20.976 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f39fbfff640 1 -- 10.20.193.110:0/986283742 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f3a140042a0 con 0x7f3a20091e20 2026-02-13T20:27:20.976 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f39fbfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:27:20.976 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f39fbfff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:27:20.976 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f39fbfff640 10 monclient(hunting): dump: 2026-02-13T20:27:20.976 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:20.976 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:20.976 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:20.977 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:20.977 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:20.977 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:20.977 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:20.977 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:20.977 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:20.977 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:20.977 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f39fbfff640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:27:20.977 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f39fbfff640 1 -- 10.20.193.110:0/986283742 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 314616269 0 0) 0x7f3a20193e00 con 0x7f3a20089540 2026-02-13T20:27:20.977 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f39fbfff640 1 -- 10.20.193.110:0/986283742 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f39f00035e0 con 0x7f3a20089540 2026-02-13T20:27:20.977 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f39fbfff640 1 -- 10.20.193.110:0/986283742 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f3a0c003240 con 0x7f3a20089540 2026-02-13T20:27:20.977 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f39fbfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:27:20.977 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f39fbfff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:27:20.978 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f39fbfff640 10 monclient(hunting): dump: 2026-02-13T20:27:20.978 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:20.978 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:20.978 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:20.978 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:20.978 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:20.978 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:20.978 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:20.978 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:20.978 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:20.978 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:20.978 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f39fbfff640 1 -- 10.20.193.110:0/986283742 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2156159123 0 0) 0x7f3a2005d320 con 0x7f3a20091e20 2026-02-13T20:27:20.978 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f39fbfff640 1 -- 10.20.193.110:0/986283742 >> v1:10.20.193.188:6789/0 conn(0x7f3a20089980 legacy=0x7f3a2021ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:20.979 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f39fbfff640 1 -- 10.20.193.110:0/986283742 >> v1:10.20.193.110:6789/0 conn(0x7f3a20089540 legacy=0x7f3a201d6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:20.979 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f39fbfff640 10 monclient: _finish_hunting 0 2026-02-13T20:27:20.979 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f39fbfff640 1 monclient: found mon.c 2026-02-13T20:27:20.979 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f39fbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:27:20.979 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f39fbfff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:27:20.979 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f39fbfff640 1 -- 10.20.193.110:0/986283742 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a20196160 con 0x7f3a20091e20 2026-02-13T20:27:20.979 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f39fbfff640 10 monclient: _finish_auth 0 2026-02-13T20:27:20.979 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f39fbfff640 10 monclient: _check_auth_tickets 2026-02-13T20:27:20.979 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f39fbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:27:20.979 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f3a25fae640 5 monclient: authenticate success, global_id 154103 2026-02-13T20:27:20.979 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f3a25fae640 10 monclient: _renew_subs 2026-02-13T20:27:20.979 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f3a25fae640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:27:20.979 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f3a25fae640 1 -- 10.20.193.110:0/986283742 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3a20194d30 con 0x7f3a20091e20 2026-02-13T20:27:20.980 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f3a25fae640 10 monclient: _renew_subs 2026-02-13T20:27:20.980 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f3a25fae640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:27:20.980 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f3a25fae640 1 -- 10.20.193.110:0/986283742 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f3a201a9d80 con 0x7f3a20091e20 2026-02-13T20:27:20.980 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f39fbfff640 1 -- 10.20.193.110:0/986283742 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3a140045f0 con 0x7f3a20091e20 2026-02-13T20:27:20.980 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f39fbfff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:27:20.980 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f39fbfff640 1 -- 10.20.193.110:0/986283742 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f3a14004470 con 0x7f3a20091e20 2026-02-13T20:27:20.980 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f39fbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:20.980 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f39fbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:27:20.980 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f39fbfff640 10 monclient: dump: 2026-02-13T20:27:20.980 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:20.980 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:20.980 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:20.981 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:20.981 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:20.981 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:20.981 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:20.981 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:20.981 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:20.981 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:20.981 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f3a1dffb640 4 set_mon_vals no callback set 2026-02-13T20:27:20.981 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f3a25fae640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:27:20.981 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.957+0000 7f3a25fae640 1 -- 10.20.193.110:0/986283742 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3a201d6600 con 0x7f3a201d6230 2026-02-13T20:27:20.981 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.958+0000 7f39fbfff640 1 -- 10.20.193.110:0/986283742 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f3a14004cf0 con 0x7f3a20091e20 2026-02-13T20:27:20.981 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.958+0000 7f39fbfff640 1 -- 10.20.193.110:0/986283742 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(771..771 src has 1..771) ==== 3931+0+0 (unknown 2572147740 0 0) 0x7f3a1404f930 con 0x7f3a20091e20 2026-02-13T20:27:20.982 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.958+0000 7f39fbfff640 1 -- 10.20.193.110:0/986283742 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1287850113 0 0) 0x7f3a201d6600 con 0x7f3a201d6230 2026-02-13T20:27:20.982 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.958+0000 7f39fbfff640 10 monclient(hunting): _negotiate 2026-02-13T20:27:20.982 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.958+0000 7f39fbfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:20.982 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.958+0000 7f39fbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:20.982 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.958+0000 7f39fbfff640 10 monclient(hunting): my global_id is 124398 2026-02-13T20:27:20.982 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.958+0000 7f39fbfff640 1 -- 10.20.193.110:0/986283742 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a2005d320 con 0x7f3a201d6230 2026-02-13T20:27:20.982 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.958+0000 7f3a1effd640 10 monclient: get_auth_request con 0x7f39f003fa00 auth_method 0 2026-02-13T20:27:20.982 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.958+0000 7f39fbfff640 1 -- 10.20.193.110:0/986283742 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3973002748 0 0) 0x7f3a2005d320 con 0x7f3a201d6230 2026-02-13T20:27:20.982 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.958+0000 7f39fbfff640 1 -- 10.20.193.110:0/986283742 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3a201d6600 con 0x7f3a201d6230 2026-02-13T20:27:20.982 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.958+0000 7f39fbfff640 1 -- 10.20.193.110:0/986283742 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f3a0c004a50 con 0x7f3a201d6230 2026-02-13T20:27:20.982 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.958+0000 7f39fbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:20.982 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.958+0000 7f39fbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:27:20.982 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.958+0000 7f39fbfff640 10 monclient: dump: 2026-02-13T20:27:20.983 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:20.983 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:20.983 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:20.983 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:20.983 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:20.983 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:20.983 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:20.983 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:20.983 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:20.983 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:20.983 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.958+0000 7f39fbfff640 1 -- 10.20.193.110:0/986283742 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 382062633 0 0) 0x7f3a201d6600 con 0x7f3a201d6230 2026-02-13T20:27:20.983 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.958+0000 7f39fbfff640 1 -- 10.20.193.110:0/986283742 --> v1:10.20.193.110:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3a2005a3e0 con 0x7f3a201d6230 2026-02-13T20:27:20.984 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.959+0000 7f39fbfff640 1 -- 10.20.193.110:0/986283742 <== mon.0 v1:10.20.193.110:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f3a0c005990 con 0x7f3a201d6230 2026-02-13T20:27:20.984 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.959+0000 7f39fbfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:27:20.984 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.959+0000 7f39fbfff640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:27:20.984 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.959+0000 7f39fbfff640 1 -- 10.20.193.110:0/986283742 >> v1:10.20.193.110:6789/0 conn(0x7f3a201d6230 legacy=0x7f3a201ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:20.984 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.959+0000 7f39fbfff640 1 -- 10.20.193.110:0/986283742 >> v1:10.20.193.110:6789/0 conn(0x7f3a201d6230 legacy=0x7f3a201ace00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:27:20.984 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.962+0000 7f3a25fae640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:27:20.984 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.962+0000 7f3a25fae640 1 -- 10.20.193.110:0/986283742 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3a2005bd00 con 0x7f3a2004d1c0 2026-02-13T20:27:20.984 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.962+0000 7f39fbfff640 1 -- 10.20.193.110:0/986283742 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3391183755 0 0) 0x7f3a2005bd00 con 0x7f3a2004d1c0 2026-02-13T20:27:20.984 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.962+0000 7f39fbfff640 10 monclient(hunting): _negotiate 2026-02-13T20:27:20.984 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.962+0000 7f39fbfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:20.984 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.962+0000 7f39fbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:20.984 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.962+0000 7f39fbfff640 10 monclient(hunting): my global_id is 124401 2026-02-13T20:27:20.984 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.962+0000 7f39fbfff640 1 -- 10.20.193.110:0/986283742 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a201d6600 con 0x7f3a2004d1c0 2026-02-13T20:27:20.985 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.962+0000 7f39fbfff640 1 -- 10.20.193.110:0/986283742 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1088348327 0 0) 0x7f3a201d6600 con 0x7f3a2004d1c0 2026-02-13T20:27:20.985 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.962+0000 7f39fbfff640 1 -- 10.20.193.110:0/986283742 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3a2005bd00 con 0x7f3a2004d1c0 2026-02-13T20:27:20.985 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.962+0000 7f39fbfff640 1 -- 10.20.193.110:0/986283742 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f3a0c005280 con 0x7f3a2004d1c0 2026-02-13T20:27:20.985 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.962+0000 7f39fbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:20.985 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.962+0000 7f39fbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:27:20.985 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.962+0000 7f39fbfff640 10 monclient: dump: 2026-02-13T20:27:20.985 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:20.985 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:20.985 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:20.985 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:20.985 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:20.985 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:20.985 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:20.986 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:20.986 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:20.986 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:20.986 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.962+0000 7f39fbfff640 1 -- 10.20.193.110:0/986283742 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2569528009 0 0) 0x7f3a2005bd00 con 0x7f3a2004d1c0 2026-02-13T20:27:20.986 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.962+0000 7f39fbfff640 1 -- 10.20.193.110:0/986283742 --> v1:10.20.193.110:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3a200921f0 con 0x7f3a2004d1c0 2026-02-13T20:27:20.986 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.963+0000 7f39fbfff640 1 -- 10.20.193.110:0/986283742 <== mon.0 v1:10.20.193.110:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4514 (unknown 0 0 1667529828) 0x7f3a0c005660 con 0x7f3a2004d1c0 2026-02-13T20:27:20.986 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.963+0000 7f39fbfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:27:20.986 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.963+0000 7f39fbfff640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:27:20.986 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.963+0000 7f39fbfff640 1 -- 10.20.193.110:0/986283742 >> v1:10.20.193.110:6789/0 conn(0x7f3a2004d1c0 legacy=0x7f3a2025e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:20.987 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:27:20.987 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:27:20.987 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:27:20.987 INFO:teuthology.orchestra.run.trial110.stdout: "state": "peon", 2026-02-13T20:27:20.987 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 58, 2026-02-13T20:27:20.987 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 356381, 2026-02-13T20:27:20.987 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:27:20.987 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:27:20.987 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:27:20.988 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:27:20.988 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:27:20.988 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 0, 2026-02-13T20:27:20.988 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:27:20.988 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:27:20.988 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:27:20.988 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:27:20.988 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:27:20.988 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:27:20.988 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:27:20.988 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:27:20.988 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:27:20.989 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:27:20.989 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:27:20.989 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:27:20.989 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:27:20.989 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:27:20.989 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:27:20.989 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:27:20.989 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:27:20.989 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:27:20.989 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:27:20.989 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:27:20.989 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:27:20.990 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:27:20.990 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:27:20.990 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:27:20.990 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:27:20.990 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:27:20.990 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:27:20.990 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:27:20.990 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:27:20.990 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:27:20.990 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:27:20.990 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:27:20.990 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:27:20.990 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:20.990 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:27:20.991 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:27:20.991 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:27:20.991 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:27:20.991 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:27:20.991 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:27:20.991 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:27:20.991 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:27:20.991 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:27:20.991 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:27:20.991 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:27:20.991 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:27:20.991 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:27:20.991 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:27:20.992 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:27:20.992 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:27:20.992 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:27:20.992 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:27:20.992 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:27:20.992 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:27:20.992 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:27:20.992 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:27:20.992 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:27:20.992 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:27:20.992 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:27:20.992 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:27:20.992 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:27:20.992 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:27:20.992 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:27:20.993 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:27:20.993 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:27:20.993 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:27:20.993 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:20.993 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:27:20.993 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:20.993 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:27:20.993 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:27:20.993 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:27:20.993 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:27:20.993 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:20.993 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:27:20.993 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:27:20.993 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:27:20.994 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:20.994 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:27:20.994 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:20.994 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:27:20.994 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:27:20.994 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:27:20.994 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:27:20.994 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:27:20.994 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:27:20.994 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:20.994 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:20.994 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:27:20.994 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:27:20.994 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:27:20.995 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:27:20.995 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:20.995 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:27:20.995 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:27:20.995 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:27:20.995 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:20.995 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:27:20.995 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:20.995 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:27:20.995 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:27:20.995 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:27:20.995 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:27:20.995 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:27:20.995 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:27:20.995 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:20.996 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:20.996 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:27:20.996 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:27:20.996 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:27:20.996 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:27:20.996 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:20.996 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:27:20.996 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:27:20.996 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:27:20.996 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:20.996 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:27:20.996 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:20.996 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:27:20.996 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:27:20.997 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:27:20.997 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:27:20.997 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:27:20.997 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:27:20.997 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:20.997 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:27:20.997 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:20.997 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:27:20.997 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:27:20.997 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:20.997 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:27:20.997 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:27:20.997 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:27:20.997 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:20.997 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:27:20.998 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:27:20.998 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:20.998 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:27:20.998 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:27:20.998 INFO:teuthology.orchestra.run.trial110.stdout: "num": 3 2026-02-13T20:27:20.998 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:20.998 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:27:20.998 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:27:20.998 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:20.998 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:27:20.998 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:27:20.998 INFO:teuthology.orchestra.run.trial110.stdout: "num": 4 2026-02-13T20:27:20.998 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:20.998 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:27:20.998 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:20.998 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:27:20.999 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:27:21.000 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.963+0000 7f39fbfff640 1 -- 10.20.193.110:0/986283742 >> v1:10.20.193.110:6789/0 conn(0x7f3a2004d1c0 legacy=0x7f3a2025e980 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:27:21.000 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.963+0000 7f3a25fae640 1 -- 10.20.193.110:0/986283742 >> v1:10.20.193.188:6812/1623052694 conn(0x7f39f003fa00 legacy=0x7f39f005feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:21.000 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.963+0000 7f3a25fae640 10 monclient: shutdown 2026-02-13T20:27:21.000 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.963+0000 7f3a25fae640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:27:21.000 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.963+0000 7f3a25fae640 1 -- 10.20.193.110:0/986283742 >> v1:10.20.193.110:6790/0 conn(0x7f3a20091e20 legacy=0x7f3a2023c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:21.000 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.963+0000 7f3a1ffff640 1 -- 10.20.193.110:0/986283742 reap_dead start 2026-02-13T20:27:21.000 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.963+0000 7f3a1ffff640 1 -- 10.20.193.110:0/986283742 reap_dead start 2026-02-13T20:27:21.000 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.963+0000 7f3a25fae640 1 -- 10.20.193.110:0/986283742 shutdown_connections 2026-02-13T20:27:21.000 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.963+0000 7f3a25fae640 1 -- 10.20.193.110:0/986283742 >> 10.20.193.110:0/986283742 conn(0x7f3a20054e90 msgr2=0x7f3a201ab130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:27:21.001 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.963+0000 7f3a25fae640 1 -- 10.20.193.110:0/986283742 shutdown_connections 2026-02-13T20:27:21.001 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:20.963+0000 7f3a25fae640 1 -- 10.20.193.110:0/986283742 wait complete. 2026-02-13T20:27:21.001 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:27:21.001 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-13T20:27:21.001 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T20:27:21.067 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.066+0000 7f0d4f25b640 10 monclient: get_monmap_and_config 2026-02-13T20:27:21.067 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.066+0000 7f0d4f25b640 10 monclient: build_initial_monmap 2026-02-13T20:27:21.067 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.066+0000 7f0d4f25b640 10 monclient: monmap: 2026-02-13T20:27:21.067 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:27:21.067 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:21.067 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:27:21.067142+0000 2026-02-13T20:27:21.067 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:27:21.067142+0000 2026-02-13T20:27:21.068 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:27:21.068 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:21.068 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:27:21.068 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:27:21.068 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:27:21.068 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:21.078 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.067+0000 7f0d4f25b640 1 Processor -- start 2026-02-13T20:27:21.078 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.067+0000 7f0d4f25b640 1 -- start start 2026-02-13T20:27:21.078 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.067+0000 7f0d4f25b640 10 monclient: init 2026-02-13T20:27:21.078 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.067+0000 7f0d4f25b640 10 monclient: _reopen_session rank -1 2026-02-13T20:27:21.078 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.067+0000 7f0d4f25b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:27:21.078 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.067+0000 7f0d4f25b640 10 monclient(hunting): picked mon.noname-b con 0x7f0d4813f280 addr v1:10.20.193.110:6790/0 2026-02-13T20:27:21.078 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.067+0000 7f0d4f25b640 10 monclient(hunting): picked mon.noname-c con 0x7f0d4813ee70 addr v1:10.20.193.188:6789/0 2026-02-13T20:27:21.078 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.067+0000 7f0d4f25b640 10 monclient(hunting): picked mon.noname-a con 0x7f0d48089a90 addr v1:10.20.193.110:6789/0 2026-02-13T20:27:21.078 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.067+0000 7f0d4f25b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d4808a310 con 0x7f0d48089a90 2026-02-13T20:27:21.079 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.067+0000 7f0d4f25b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d4808a5f0 con 0x7f0d4813ee70 2026-02-13T20:27:21.079 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.067+0000 7f0d4f25b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d4808a8d0 con 0x7f0d4813f280 2026-02-13T20:27:21.079 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.067+0000 7f0d4f25b640 10 monclient(hunting): _renew_subs 2026-02-13T20:27:21.079 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.067+0000 7f0d4f25b640 10 monclient(hunting): authenticate will time out at 1602.757570s 2026-02-13T20:27:21.079 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.067+0000 7f0d4cfd0640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f0d4813f280 0x7f0d4813f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:57790/0 (socket says 10.20.193.110:57790) 2026-02-13T20:27:21.079 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.067+0000 7f0d4cfd0640 1 -- 10.20.193.110:0/2269833990 learned_addr learned my addr 10.20.193.110:0/2269833990 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:27:21.079 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.067+0000 7f0d3f7fe640 1 -- 10.20.193.110:0/2269833990 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1132954438 0 0) 0x7f0d4808a310 con 0x7f0d48089a90 2026-02-13T20:27:21.079 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.067+0000 7f0d3f7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:27:21.079 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.067+0000 7f0d3f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:21.079 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.067+0000 7f0d3f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:21.079 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.067+0000 7f0d3f7fe640 10 monclient(hunting): my global_id is 124404 2026-02-13T20:27:21.079 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.067+0000 7f0d3f7fe640 1 -- 10.20.193.110:0/2269833990 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d340035e0 con 0x7f0d48089a90 2026-02-13T20:27:21.079 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.067+0000 7f0d3f7fe640 1 -- 10.20.193.110:0/2269833990 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1709664183 0 0) 0x7f0d4808a8d0 con 0x7f0d4813f280 2026-02-13T20:27:21.080 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.067+0000 7f0d3f7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:27:21.080 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.067+0000 7f0d3f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:21.080 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.067+0000 7f0d3f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:21.080 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.067+0000 7f0d3f7fe640 10 monclient(hunting): my global_id is 154106 2026-02-13T20:27:21.080 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.067+0000 7f0d3f7fe640 1 -- 10.20.193.110:0/2269833990 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d4808a310 con 0x7f0d4813f280 2026-02-13T20:27:21.080 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.067+0000 7f0d3f7fe640 1 -- 10.20.193.110:0/2269833990 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2078661008 0 0) 0x7f0d340035e0 con 0x7f0d48089a90 2026-02-13T20:27:21.080 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.067+0000 7f0d3f7fe640 1 -- 10.20.193.110:0/2269833990 >> v1:10.20.193.110:6790/0 conn(0x7f0d4813f280 legacy=0x7f0d4813f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:21.080 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.067+0000 7f0d3f7fe640 1 -- 10.20.193.110:0/2269833990 >> v1:10.20.193.188:6789/0 conn(0x7f0d4813ee70 legacy=0x7f0d48180190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:21.080 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.067+0000 7f0d3f7fe640 10 monclient: _finish_hunting 0 2026-02-13T20:27:21.080 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.067+0000 7f0d3f7fe640 1 monclient: found mon.noname-a 2026-02-13T20:27:21.080 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.067+0000 7f0d3f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:27:21.080 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.068+0000 7f0d3f7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:27:21.080 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.068+0000 7f0d3f7fe640 1 -- 10.20.193.110:0/2269833990 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d4808abb0 con 0x7f0d48089a90 2026-02-13T20:27:21.080 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.068+0000 7f0d3f7fe640 10 monclient: _finish_auth 0 2026-02-13T20:27:21.081 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.068+0000 7f0d3f7fe640 10 monclient: _check_auth_tickets 2026-02-13T20:27:21.081 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.068+0000 7f0d3f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:27:21.081 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.068+0000 7f0d3f7fe640 1 -- 10.20.193.110:0/2269833990 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f0d44003eb0 con 0x7f0d48089a90 2026-02-13T20:27:21.081 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.068+0000 7f0d3f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:21.081 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.068+0000 7f0d3f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:27:21.081 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.068+0000 7f0d3f7fe640 10 monclient: dump: 2026-02-13T20:27:21.081 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:21.081 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:21.081 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:21.081 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:21.081 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:21.081 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:21.081 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:21.081 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:21.082 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:21.082 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:21.082 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.068+0000 7f0d4f25b640 5 monclient: authenticate success, global_id 124404 2026-02-13T20:27:21.082 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.068+0000 7f0d4f25b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:27:21.082 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.068+0000 7f0d3f7fe640 1 -- 10.20.193.110:0/2269833990 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0d44004130 con 0x7f0d48089a90 2026-02-13T20:27:21.082 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.068+0000 7f0d3f7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:27:21.082 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.068+0000 7f0d3f7fe640 1 -- 10.20.193.110:0/2269833990 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f0d44004540 con 0x7f0d48089a90 2026-02-13T20:27:21.082 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.068+0000 7f0d4f25b640 10 monclient: get_monmap_and_config success 2026-02-13T20:27:21.082 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.068+0000 7f0d4f25b640 4 set_mon_vals no callback set 2026-02-13T20:27:21.082 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.068+0000 7f0d3f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:21.082 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.068+0000 7f0d3f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:27:21.082 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.068+0000 7f0d3f7fe640 10 monclient: dump: 2026-02-13T20:27:21.082 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:21.083 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:21.083 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:21.083 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:21.083 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:21.083 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:21.083 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:21.083 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:21.083 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:21.083 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:21.083 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.068+0000 7f0d4f25b640 10 monclient: shutdown 2026-02-13T20:27:21.083 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.068+0000 7f0d4f25b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:27:21.083 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.068+0000 7f0d4f25b640 1 -- 10.20.193.110:0/2269833990 >> v1:10.20.193.110:6789/0 conn(0x7f0d48089a90 legacy=0x7f0d481a18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:21.083 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.068+0000 7f0d4f25b640 1 -- 10.20.193.110:0/2269833990 shutdown_connections 2026-02-13T20:27:21.083 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.068+0000 7f0d4f25b640 1 -- 10.20.193.110:0/2269833990 >> 10.20.193.110:0/2269833990 conn(0x7f0d48054e90 msgr2=0x7f0d48058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:27:21.083 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.068+0000 7f0d4f25b640 1 -- 10.20.193.110:0/2269833990 shutdown_connections 2026-02-13T20:27:21.084 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.068+0000 7f0d4f25b640 1 -- 10.20.193.110:0/2269833990 wait complete. 2026-02-13T20:27:21.084 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.068+0000 7f0d4f25b640 10 monclient: build_initial_monmap 2026-02-13T20:27:21.084 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.068+0000 7f0d4f25b640 10 monclient: monmap: 2026-02-13T20:27:21.084 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:27:21.084 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:27:21.084 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:27:21.084 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:27:21.084 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:27:21.084 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:27:21.084 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:27:21.084 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:27:21.084 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:27:21.084 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:21.084 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d4f25b640 1 Processor -- start 2026-02-13T20:27:21.085 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d4f25b640 1 -- start start 2026-02-13T20:27:21.085 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d4f25b640 10 monclient: init 2026-02-13T20:27:21.085 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d4f25b640 10 monclient: _reopen_session rank -1 2026-02-13T20:27:21.085 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d4f25b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:27:21.085 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d4f25b640 10 monclient(hunting): picked mon.noname-b con 0x7f0d48089a90 addr v1:10.20.193.188:6789/0 2026-02-13T20:27:21.085 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d4f25b640 10 monclient(hunting): picked mon.noname-c con 0x7f0d4813ee70 addr v1:10.20.193.110:6790/0 2026-02-13T20:27:21.085 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d4f25b640 10 monclient(hunting): picked mon.noname-a con 0x7f0d4813f280 addr v1:10.20.193.110:6789/0 2026-02-13T20:27:21.085 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d4f25b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d48133170 con 0x7f0d4813f280 2026-02-13T20:27:21.085 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d4f25b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d4805d320 con 0x7f0d48089a90 2026-02-13T20:27:21.085 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d4f25b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d4808cb30 con 0x7f0d4813ee70 2026-02-13T20:27:21.085 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d4f25b640 10 monclient(hunting): _renew_subs 2026-02-13T20:27:21.085 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d4f25b640 10 monclient(hunting): authenticate will time out at 1602.759314s 2026-02-13T20:27:21.085 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d3ffff640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f0d4813ee70 0x7f0d4808e9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:57806/0 (socket says 10.20.193.110:57806) 2026-02-13T20:27:21.085 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d3ffff640 1 -- 10.20.193.110:0/1951781249 learned_addr learned my addr 10.20.193.110:0/1951781249 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:27:21.086 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d3d7fa640 1 -- 10.20.193.110:0/1951781249 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4123138008 0 0) 0x7f0d4808cb30 con 0x7f0d4813ee70 2026-02-13T20:27:21.086 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d3d7fa640 10 monclient(hunting): _negotiate 2026-02-13T20:27:21.086 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d3d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:21.086 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d3d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:21.086 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d3d7fa640 10 monclient(hunting): my global_id is 154109 2026-02-13T20:27:21.086 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d3d7fa640 1 -- 10.20.193.110:0/1951781249 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d180035e0 con 0x7f0d4813ee70 2026-02-13T20:27:21.086 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d3d7fa640 1 -- 10.20.193.110:0/1951781249 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1606184454 0 0) 0x7f0d48133170 con 0x7f0d4813f280 2026-02-13T20:27:21.086 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d3d7fa640 10 monclient(hunting): _negotiate 2026-02-13T20:27:21.086 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d3d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:21.086 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d3d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:21.086 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d3d7fa640 10 monclient(hunting): my global_id is 124407 2026-02-13T20:27:21.086 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d3d7fa640 1 -- 10.20.193.110:0/1951781249 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d4808cb30 con 0x7f0d4813f280 2026-02-13T20:27:21.086 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d3d7fa640 1 -- 10.20.193.110:0/1951781249 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1090644582 0 0) 0x7f0d180035e0 con 0x7f0d4813ee70 2026-02-13T20:27:21.086 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d3d7fa640 1 -- 10.20.193.110:0/1951781249 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0d48133170 con 0x7f0d4813ee70 2026-02-13T20:27:21.087 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d3d7fa640 1 -- 10.20.193.110:0/1951781249 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f0d30003110 con 0x7f0d4813ee70 2026-02-13T20:27:21.087 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d3d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:27:21.087 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d3d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:27:21.087 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d3d7fa640 10 monclient(hunting): dump: 2026-02-13T20:27:21.087 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:21.087 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:21.087 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:21.087 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:21.087 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:21.087 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:21.087 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:21.087 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:21.087 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:21.087 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:21.088 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d3d7fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:27:21.088 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d3d7fa640 1 -- 10.20.193.110:0/1951781249 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2667956212 0 0) 0x7f0d4808cb30 con 0x7f0d4813f280 2026-02-13T20:27:21.088 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d3d7fa640 1 -- 10.20.193.110:0/1951781249 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0d180035e0 con 0x7f0d4813f280 2026-02-13T20:27:21.088 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d3d7fa640 1 -- 10.20.193.110:0/1951781249 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f0d440042a0 con 0x7f0d4813f280 2026-02-13T20:27:21.088 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d3d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:27:21.088 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d3d7fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:27:21.088 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d3d7fa640 10 monclient(hunting): dump: 2026-02-13T20:27:21.088 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:21.088 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:21.088 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:21.088 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:21.088 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:21.088 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:21.088 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:21.089 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:21.089 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:21.089 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:21.089 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d3d7fa640 1 -- 10.20.193.110:0/1951781249 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1570619175 0 0) 0x7f0d4805d320 con 0x7f0d48089a90 2026-02-13T20:27:21.089 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d3d7fa640 10 monclient(hunting): _negotiate 2026-02-13T20:27:21.089 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d3d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:21.089 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d3d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:21.089 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d3d7fa640 10 monclient(hunting): my global_id is 144193 2026-02-13T20:27:21.089 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d3d7fa640 1 -- 10.20.193.110:0/1951781249 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d4808cb30 con 0x7f0d48089a90 2026-02-13T20:27:21.089 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d3d7fa640 1 -- 10.20.193.110:0/1951781249 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3221613050 0 0) 0x7f0d48133170 con 0x7f0d4813ee70 2026-02-13T20:27:21.089 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d3d7fa640 1 -- 10.20.193.110:0/1951781249 >> v1:10.20.193.188:6789/0 conn(0x7f0d48089a90 legacy=0x7f0d4808e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:21.089 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d3d7fa640 1 -- 10.20.193.110:0/1951781249 >> v1:10.20.193.110:6789/0 conn(0x7f0d4813f280 legacy=0x7f0d481950b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:21.089 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d3d7fa640 10 monclient: _finish_hunting 0 2026-02-13T20:27:21.089 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d3d7fa640 1 monclient: found mon.c 2026-02-13T20:27:21.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d3d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:27:21.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d3d7fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:27:21.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d3d7fa640 1 -- 10.20.193.110:0/1951781249 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d4808c790 con 0x7f0d4813ee70 2026-02-13T20:27:21.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d3d7fa640 10 monclient: _finish_auth 0 2026-02-13T20:27:21.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d3d7fa640 10 monclient: _check_auth_tickets 2026-02-13T20:27:21.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d3d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:27:21.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d4f25b640 5 monclient: authenticate success, global_id 154109 2026-02-13T20:27:21.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d4f25b640 10 monclient: _renew_subs 2026-02-13T20:27:21.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d4f25b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:27:21.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d4f25b640 1 -- 10.20.193.110:0/1951781249 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0d4808fa20 con 0x7f0d4813ee70 2026-02-13T20:27:21.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d4f25b640 10 monclient: _renew_subs 2026-02-13T20:27:21.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d4f25b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:27:21.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.069+0000 7f0d4f25b640 1 -- 10.20.193.110:0/1951781249 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f0d4813ea20 con 0x7f0d4813ee70 2026-02-13T20:27:21.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.070+0000 7f0d3d7fa640 1 -- 10.20.193.110:0/1951781249 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0d30003480 con 0x7f0d4813ee70 2026-02-13T20:27:21.091 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.070+0000 7f0d3d7fa640 10 monclient: handle_config config(0 keys) 2026-02-13T20:27:21.091 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.070+0000 7f0d3d7fa640 1 -- 10.20.193.110:0/1951781249 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f0d30003b30 con 0x7f0d4813ee70 2026-02-13T20:27:21.091 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.070+0000 7f0d3d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:21.091 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.070+0000 7f0d3d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:27:21.091 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.070+0000 7f0d3d7fa640 10 monclient: dump: 2026-02-13T20:27:21.091 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:21.091 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:21.091 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:21.091 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:21.091 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:21.091 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:21.091 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:21.091 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:21.091 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:21.091 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:21.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.070+0000 7f0d3effd640 4 set_mon_vals no callback set 2026-02-13T20:27:21.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.070+0000 7f0d4f25b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:27:21.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.070+0000 7f0d4f25b640 1 -- 10.20.193.110:0/1951781249 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0d4808f4c0 con 0x7f0d4808f0f0 2026-02-13T20:27:21.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.070+0000 7f0d3d7fa640 1 -- 10.20.193.110:0/1951781249 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f0d30003c90 con 0x7f0d4813ee70 2026-02-13T20:27:21.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.070+0000 7f0d3d7fa640 1 -- 10.20.193.110:0/1951781249 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(771..771 src has 1..771) ==== 3931+0+0 (unknown 2572147740 0 0) 0x7f0d3004e9d0 con 0x7f0d4813ee70 2026-02-13T20:27:21.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.070+0000 7f0d3d7fa640 1 -- 10.20.193.110:0/1951781249 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2748793155 0 0) 0x7f0d4808f4c0 con 0x7f0d4808f0f0 2026-02-13T20:27:21.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.070+0000 7f0d3d7fa640 10 monclient(hunting): _negotiate 2026-02-13T20:27:21.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.070+0000 7f0d3d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:21.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.070+0000 7f0d3d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:21.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.070+0000 7f0d3d7fa640 10 monclient(hunting): my global_id is 154112 2026-02-13T20:27:21.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.070+0000 7f0d3d7fa640 1 -- 10.20.193.110:0/1951781249 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d48133170 con 0x7f0d4808f0f0 2026-02-13T20:27:21.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.070+0000 7f0d3d7fa640 1 -- 10.20.193.110:0/1951781249 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3333128713 0 0) 0x7f0d48133170 con 0x7f0d4808f0f0 2026-02-13T20:27:21.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.070+0000 7f0d3d7fa640 1 -- 10.20.193.110:0/1951781249 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0d4808f4c0 con 0x7f0d4808f0f0 2026-02-13T20:27:21.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.070+0000 7f0d3d7fa640 1 -- 10.20.193.110:0/1951781249 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f0d38002f20 con 0x7f0d4808f0f0 2026-02-13T20:27:21.093 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.070+0000 7f0d3d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:21.093 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.070+0000 7f0d3d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:27:21.093 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.070+0000 7f0d3d7fa640 10 monclient: dump: 2026-02-13T20:27:21.093 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:21.093 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:21.093 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:21.093 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:21.093 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:21.093 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:21.093 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:21.093 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:21.093 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:21.093 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:21.093 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.070+0000 7f0d4d7d1640 10 monclient: get_auth_request con 0x7f0d1803fcc0 auth_method 0 2026-02-13T20:27:21.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.070+0000 7f0d3d7fa640 1 -- 10.20.193.110:0/1951781249 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1712317155 0 0) 0x7f0d4808f4c0 con 0x7f0d4808f0f0 2026-02-13T20:27:21.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.071+0000 7f0d3d7fa640 1 -- 10.20.193.110:0/1951781249 --> v1:10.20.193.110:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0d480008d0 con 0x7f0d4808f0f0 2026-02-13T20:27:21.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.071+0000 7f0d3d7fa640 1 -- 10.20.193.110:0/1951781249 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f0d380032f0 con 0x7f0d4808f0f0 2026-02-13T20:27:21.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.071+0000 7f0d3d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:27:21.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.071+0000 7f0d3d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:27:21.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.071+0000 7f0d3d7fa640 1 -- 10.20.193.110:0/1951781249 >> v1:10.20.193.110:6790/0 conn(0x7f0d4808f0f0 legacy=0x7f0d48128ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:21.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.071+0000 7f0d3d7fa640 1 -- 10.20.193.110:0/1951781249 >> v1:10.20.193.110:6790/0 conn(0x7f0d4808f0f0 legacy=0x7f0d48128ca0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:27:21.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.074+0000 7f0d4f25b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:27:21.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.074+0000 7f0d4f25b640 1 -- 10.20.193.110:0/1951781249 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0d48058410 con 0x7f0d4804d1c0 2026-02-13T20:27:21.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.074+0000 7f0d3d7fa640 1 -- 10.20.193.110:0/1951781249 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3749918120 0 0) 0x7f0d48058410 con 0x7f0d4804d1c0 2026-02-13T20:27:21.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.074+0000 7f0d3d7fa640 10 monclient(hunting): _negotiate 2026-02-13T20:27:21.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.074+0000 7f0d3d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:21.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.074+0000 7f0d3d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:21.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.074+0000 7f0d3d7fa640 10 monclient(hunting): my global_id is 154115 2026-02-13T20:27:21.095 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.074+0000 7f0d3d7fa640 1 -- 10.20.193.110:0/1951781249 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d4808f4c0 con 0x7f0d4804d1c0 2026-02-13T20:27:21.095 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.074+0000 7f0d3d7fa640 1 -- 10.20.193.110:0/1951781249 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 464499665 0 0) 0x7f0d4808f4c0 con 0x7f0d4804d1c0 2026-02-13T20:27:21.095 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.074+0000 7f0d3d7fa640 1 -- 10.20.193.110:0/1951781249 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0d48058410 con 0x7f0d4804d1c0 2026-02-13T20:27:21.095 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.074+0000 7f0d3d7fa640 1 -- 10.20.193.110:0/1951781249 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f0d38004c40 con 0x7f0d4804d1c0 2026-02-13T20:27:21.095 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.074+0000 7f0d3d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:21.095 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.074+0000 7f0d3d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:27:21.095 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.074+0000 7f0d3d7fa640 10 monclient: dump: 2026-02-13T20:27:21.095 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:21.095 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:21.095 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:21.095 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:21.095 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:21.095 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:21.095 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:21.095 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:21.096 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:21.096 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:21.096 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.074+0000 7f0d3d7fa640 1 -- 10.20.193.110:0/1951781249 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3585269801 0 0) 0x7f0d48058410 con 0x7f0d4804d1c0 2026-02-13T20:27:21.096 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.074+0000 7f0d3d7fa640 1 -- 10.20.193.110:0/1951781249 --> v1:10.20.193.110:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0d480561b0 con 0x7f0d4804d1c0 2026-02-13T20:27:21.096 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.074+0000 7f0d3d7fa640 1 -- 10.20.193.110:0/1951781249 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4346 (unknown 0 0 2710117065) 0x7f0d38005050 con 0x7f0d4804d1c0 2026-02-13T20:27:21.096 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.074+0000 7f0d3d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:27:21.096 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.074+0000 7f0d3d7fa640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:27:21.096 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.074+0000 7f0d3d7fa640 1 -- 10.20.193.110:0/1951781249 >> v1:10.20.193.110:6790/0 conn(0x7f0d4804d1c0 legacy=0x7f0d4819edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:21.096 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.074+0000 7f0d3d7fa640 1 -- 10.20.193.110:0/1951781249 >> v1:10.20.193.110:6790/0 conn(0x7f0d4804d1c0 legacy=0x7f0d4819edd0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:27:21.097 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:27:21.097 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:27:21.097 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:27:21.097 INFO:teuthology.orchestra.run.trial110.stdout: "state": "leader", 2026-02-13T20:27:21.097 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 58, 2026-02-13T20:27:21.097 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 352, 2026-02-13T20:27:21.097 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:27:21.097 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:27:21.097 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:27:21.097 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:27:21.097 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:27:21.097 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 0, 2026-02-13T20:27:21.098 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:27:21.098 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:27:21.098 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:27:21.098 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:27:21.098 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:27:21.098 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:27:21.098 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:27:21.098 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:27:21.098 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:27:21.098 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:27:21.098 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:27:21.098 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:27:21.098 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:27:21.098 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:27:21.099 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:27:21.099 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:27:21.099 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:27:21.099 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:27:21.099 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:27:21.099 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:27:21.099 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:27:21.099 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:27:21.099 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:27:21.099 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:27:21.099 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:27:21.099 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:27:21.099 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:27:21.099 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:27:21.100 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:27:21.100 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:27:21.100 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:27:21.100 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:27:21.100 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:27:21.100 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:21.100 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:27:21.100 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:27:21.100 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:27:21.100 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:27:21.100 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:27:21.100 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:27:21.100 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:27:21.100 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:27:21.101 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:27:21.101 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:27:21.101 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:27:21.101 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:27:21.101 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:27:21.101 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:27:21.101 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:27:21.101 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:27:21.101 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:27:21.101 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:27:21.101 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:27:21.101 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:27:21.101 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:27:21.101 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:27:21.101 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:27:21.102 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:27:21.102 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:27:21.102 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:27:21.102 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:27:21.102 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:27:21.102 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:27:21.102 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:27:21.102 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:27:21.102 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:27:21.102 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:21.102 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:27:21.102 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:21.102 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:27:21.102 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:27:21.102 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:27:21.102 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:27:21.103 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:21.103 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:27:21.103 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:27:21.103 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:27:21.103 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:21.103 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:27:21.103 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:21.103 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:27:21.103 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:27:21.103 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:27:21.103 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:27:21.103 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:27:21.103 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:27:21.103 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:21.103 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:21.103 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:27:21.104 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:27:21.104 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:27:21.104 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:27:21.104 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:21.104 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:27:21.104 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:27:21.104 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:27:21.104 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:21.104 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:27:21.104 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:21.104 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:27:21.104 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:27:21.104 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:27:21.104 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:27:21.104 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:27:21.105 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:27:21.105 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:21.105 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:21.105 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:27:21.105 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:27:21.105 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:27:21.105 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:27:21.105 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:21.105 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:27:21.105 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:27:21.105 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:27:21.105 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:21.105 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:27:21.105 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:21.105 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:27:21.105 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:27:21.105 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:27:21.106 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:27:21.106 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:27:21.106 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:27:21.106 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:21.106 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:27:21.106 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:21.106 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:27:21.106 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:27:21.106 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:21.106 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:27:21.106 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:27:21.106 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:27:21.106 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:21.106 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:27:21.106 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:27:21.106 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:21.106 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:27:21.107 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:27:21.107 INFO:teuthology.orchestra.run.trial110.stdout: "num": 2 2026-02-13T20:27:21.107 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:21.107 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:27:21.107 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:21.107 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:27:21.107 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:27:21.108 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.075+0000 7f0d4f25b640 1 -- 10.20.193.110:0/1951781249 >> v1:10.20.193.188:6812/1623052694 conn(0x7f0d1803fcc0 legacy=0x7f0d18060170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:21.108 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.075+0000 7f0d4f25b640 10 monclient: shutdown 2026-02-13T20:27:21.108 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.075+0000 7f0d4f25b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:27:21.108 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.075+0000 7f0d4f25b640 1 -- 10.20.193.110:0/1951781249 >> v1:10.20.193.110:6790/0 conn(0x7f0d4813ee70 legacy=0x7f0d4808e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:21.108 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.075+0000 7f0d4d7d1640 1 -- 10.20.193.110:0/1951781249 reap_dead start 2026-02-13T20:27:21.108 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.075+0000 7f0d4d7d1640 1 -- 10.20.193.110:0/1951781249 reap_dead start 2026-02-13T20:27:21.108 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.075+0000 7f0d4f25b640 1 -- 10.20.193.110:0/1951781249 shutdown_connections 2026-02-13T20:27:21.109 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.075+0000 7f0d4f25b640 1 -- 10.20.193.110:0/1951781249 >> 10.20.193.110:0/1951781249 conn(0x7f0d48054e90 msgr2=0x7f0d4808ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:27:21.109 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.075+0000 7f0d4f25b640 1 -- 10.20.193.110:0/1951781249 shutdown_connections 2026-02-13T20:27:21.109 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.075+0000 7f0d4f25b640 1 -- 10.20.193.110:0/1951781249 wait complete. 2026-02-13T20:27:21.109 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:27:21.109 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-13T20:27:21.109 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T20:27:21.176 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.176+0000 7fc3b3c5b640 10 monclient: get_monmap_and_config 2026-02-13T20:27:21.176 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.176+0000 7fc3b3c5b640 10 monclient: build_initial_monmap 2026-02-13T20:27:21.176 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.176+0000 7fc3b3c5b640 10 monclient: monmap: 2026-02-13T20:27:21.176 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:27:21.177 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:21.177 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:27:21.176678+0000 2026-02-13T20:27:21.177 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:27:21.176678+0000 2026-02-13T20:27:21.177 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:27:21.177 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:21.177 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:27:21.177 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:27:21.177 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:27:21.177 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:21.183 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.176+0000 7fc3b3c5b640 1 Processor -- start 2026-02-13T20:27:21.183 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.176+0000 7fc3b3c5b640 1 -- start start 2026-02-13T20:27:21.183 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.176+0000 7fc3b3c5b640 10 monclient: init 2026-02-13T20:27:21.183 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.176+0000 7fc3b3c5b640 10 monclient: _reopen_session rank -1 2026-02-13T20:27:21.183 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.176+0000 7fc3b3c5b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:27:21.183 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.176+0000 7fc3b3c5b640 10 monclient(hunting): picked mon.noname-c con 0x7fc3ac1401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:27:21.183 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.176+0000 7fc3b3c5b640 10 monclient(hunting): picked mon.noname-a con 0x7fc3ac092020 addr v1:10.20.193.110:6789/0 2026-02-13T20:27:21.183 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.176+0000 7fc3b3c5b640 10 monclient(hunting): picked mon.noname-b con 0x7fc3ac091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:27:21.183 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.176+0000 7fc3b3c5b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3ac08b730 con 0x7fc3ac092020 2026-02-13T20:27:21.183 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.176+0000 7fc3b3c5b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3ac05c5b0 con 0x7fc3ac1401c0 2026-02-13T20:27:21.183 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.176+0000 7fc3b3c5b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3ac08bcf0 con 0x7fc3ac091950 2026-02-13T20:27:21.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.176+0000 7fc3b3c5b640 10 monclient(hunting): _renew_subs 2026-02-13T20:27:21.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.176+0000 7fc3b3c5b640 10 monclient(hunting): authenticate will time out at 1602.866998s 2026-02-13T20:27:21.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.177+0000 7fc3b11cf640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fc3ac092020 0x7fc3ac1812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:57818/0 (socket says 10.20.193.110:57818) 2026-02-13T20:27:21.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.177+0000 7fc3b11cf640 1 -- 10.20.193.110:0/3571117505 learned_addr learned my addr 10.20.193.110:0/3571117505 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:27:21.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.177+0000 7fc3b21d1640 1 --1- 10.20.193.110:0/3571117505 >> v1:10.20.193.110:6790/0 conn(0x7fc3ac091950 0x7fc3ac1a2a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:57828/0 (socket says 10.20.193.110:57828) 2026-02-13T20:27:21.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.177+0000 7fc3b09ce640 1 -- 10.20.193.110:0/3571117505 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3492675635 0 0) 0x7fc3ac08b730 con 0x7fc3ac092020 2026-02-13T20:27:21.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.177+0000 7fc3b09ce640 10 monclient(hunting): _negotiate 2026-02-13T20:27:21.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.177+0000 7fc3b09ce640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:21.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.177+0000 7fc3b09ce640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:21.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.177+0000 7fc3b09ce640 10 monclient(hunting): my global_id is 124410 2026-02-13T20:27:21.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.177+0000 7fc3b09ce640 1 -- 10.20.193.110:0/3571117505 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3940035e0 con 0x7fc3ac092020 2026-02-13T20:27:21.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.177+0000 7fc3b09ce640 1 -- 10.20.193.110:0/3571117505 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2722594315 0 0) 0x7fc3ac08bcf0 con 0x7fc3ac091950 2026-02-13T20:27:21.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.177+0000 7fc3b09ce640 10 monclient(hunting): _negotiate 2026-02-13T20:27:21.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.177+0000 7fc3b09ce640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:21.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.177+0000 7fc3b09ce640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:21.184 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.177+0000 7fc3b09ce640 10 monclient(hunting): my global_id is 154118 2026-02-13T20:27:21.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.177+0000 7fc3b09ce640 1 -- 10.20.193.110:0/3571117505 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3ac08b730 con 0x7fc3ac091950 2026-02-13T20:27:21.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.177+0000 7fc3b09ce640 1 -- 10.20.193.110:0/3571117505 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3030862879 0 0) 0x7fc3ac08b730 con 0x7fc3ac091950 2026-02-13T20:27:21.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.177+0000 7fc3b09ce640 1 -- 10.20.193.110:0/3571117505 >> v1:10.20.193.188:6789/0 conn(0x7fc3ac1401c0 legacy=0x7fc3ac091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T20:27:21.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.177+0000 7fc3b09ce640 1 -- 10.20.193.110:0/3571117505 >> v1:10.20.193.110:6789/0 conn(0x7fc3ac092020 legacy=0x7fc3ac1812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:21.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.177+0000 7fc3b09ce640 10 monclient: _finish_hunting 0 2026-02-13T20:27:21.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.177+0000 7fc3b09ce640 1 monclient: found mon.noname-b 2026-02-13T20:27:21.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.177+0000 7fc3b09ce640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:27:21.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.177+0000 7fc3b09ce640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:27:21.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.177+0000 7fc3b09ce640 1 -- 10.20.193.110:0/3571117505 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3ac140590 con 0x7fc3ac091950 2026-02-13T20:27:21.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.177+0000 7fc3b09ce640 10 monclient: _finish_auth 0 2026-02-13T20:27:21.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.177+0000 7fc3b09ce640 10 monclient: _check_auth_tickets 2026-02-13T20:27:21.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.177+0000 7fc3b09ce640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:27:21.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.177+0000 7fc3b09ce640 1 -- 10.20.193.110:0/3571117505 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc3a8003e30 con 0x7fc3ac091950 2026-02-13T20:27:21.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.177+0000 7fc3b3c5b640 5 monclient: authenticate success, global_id 154118 2026-02-13T20:27:21.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.177+0000 7fc3b09ce640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:21.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.177+0000 7fc3b09ce640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:27:21.185 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.177+0000 7fc3b09ce640 10 monclient: dump: 2026-02-13T20:27:21.186 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:21.186 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:21.186 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:21.186 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:21.186 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:21.186 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:21.186 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:21.186 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:21.186 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:21.186 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:21.186 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.177+0000 7fc3b3c5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:27:21.186 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.177+0000 7fc3b09ce640 1 -- 10.20.193.110:0/3571117505 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc3a8004080 con 0x7fc3ac091950 2026-02-13T20:27:21.186 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.177+0000 7fc3b09ce640 10 monclient: handle_config config(0 keys) 2026-02-13T20:27:21.186 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.177+0000 7fc3b09ce640 1 -- 10.20.193.110:0/3571117505 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc3a8004490 con 0x7fc3ac091950 2026-02-13T20:27:21.186 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.177+0000 7fc3b3c5b640 10 monclient: get_monmap_and_config success 2026-02-13T20:27:21.186 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.177+0000 7fc3b09ce640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:21.186 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.177+0000 7fc3b3c5b640 4 set_mon_vals no callback set 2026-02-13T20:27:21.186 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.177+0000 7fc3b09ce640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:27:21.187 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.177+0000 7fc3b09ce640 10 monclient: dump: 2026-02-13T20:27:21.187 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:21.187 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:21.187 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:21.187 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:21.187 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:21.187 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:21.187 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:21.187 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:21.187 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:21.187 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:21.187 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.177+0000 7fc3b3c5b640 10 monclient: shutdown 2026-02-13T20:27:21.187 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.177+0000 7fc3b3c5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:27:21.187 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.177+0000 7fc3b3c5b640 1 -- 10.20.193.110:0/3571117505 >> v1:10.20.193.110:6790/0 conn(0x7fc3ac091950 legacy=0x7fc3ac1a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:21.187 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.177+0000 7fc3b3c5b640 1 -- 10.20.193.110:0/3571117505 shutdown_connections 2026-02-13T20:27:21.187 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.177+0000 7fc3b3c5b640 1 -- 10.20.193.110:0/3571117505 >> 10.20.193.110:0/3571117505 conn(0x7fc3ac054e90 msgr2=0x7fc3ac058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:27:21.187 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.177+0000 7fc3b3c5b640 1 -- 10.20.193.110:0/3571117505 shutdown_connections 2026-02-13T20:27:21.187 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.177+0000 7fc3b3c5b640 1 -- 10.20.193.110:0/3571117505 wait complete. 2026-02-13T20:27:21.187 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.178+0000 7fc3b3c5b640 10 monclient: build_initial_monmap 2026-02-13T20:27:21.188 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.178+0000 7fc3b3c5b640 10 monclient: monmap: 2026-02-13T20:27:21.188 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:27:21.188 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:27:21.188 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:27:21.188 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:27:21.188 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:27:21.188 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:27:21.188 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:27:21.188 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:27:21.188 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:27:21.188 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:21.188 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.178+0000 7fc3b3c5b640 1 Processor -- start 2026-02-13T20:27:21.188 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.178+0000 7fc3b3c5b640 1 -- start start 2026-02-13T20:27:21.188 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.178+0000 7fc3b3c5b640 10 monclient: init 2026-02-13T20:27:21.188 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.178+0000 7fc3b3c5b640 10 monclient: _reopen_session rank -1 2026-02-13T20:27:21.188 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.178+0000 7fc3b3c5b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:27:21.188 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.178+0000 7fc3b3c5b640 10 monclient(hunting): picked mon.noname-c con 0x7fc3ac091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:27:21.188 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.178+0000 7fc3b3c5b640 10 monclient(hunting): picked mon.noname-b con 0x7fc3ac1401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:27:21.189 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.178+0000 7fc3b3c5b640 10 monclient(hunting): picked mon.noname-a con 0x7fc3ac13eb10 addr v1:10.20.193.110:6789/0 2026-02-13T20:27:21.189 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.178+0000 7fc3b3c5b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3ac13fb30 con 0x7fc3ac13eb10 2026-02-13T20:27:21.189 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.178+0000 7fc3b3c5b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3ac05d320 con 0x7fc3ac1401c0 2026-02-13T20:27:21.189 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.178+0000 7fc3b3c5b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3ac12daa0 con 0x7fc3ac091950 2026-02-13T20:27:21.189 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.178+0000 7fc3b3c5b640 10 monclient(hunting): _renew_subs 2026-02-13T20:27:21.189 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.178+0000 7fc3b3c5b640 10 monclient(hunting): authenticate will time out at 1602.868685s 2026-02-13T20:27:21.189 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.178+0000 7fc3b19d0640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fc3ac091950 0x7fc3ac13e400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:57838/0 (socket says 10.20.193.110:57838) 2026-02-13T20:27:21.189 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.178+0000 7fc3b19d0640 1 -- 10.20.193.110:0/3482316209 learned_addr learned my addr 10.20.193.110:0/3482316209 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:27:21.189 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.178+0000 7fc39a7fc640 1 -- 10.20.193.110:0/3482316209 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 637466080 0 0) 0x7fc3ac12daa0 con 0x7fc3ac091950 2026-02-13T20:27:21.189 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.178+0000 7fc39a7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:27:21.189 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.178+0000 7fc39a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:21.189 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.178+0000 7fc39a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:21.189 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.178+0000 7fc39a7fc640 10 monclient(hunting): my global_id is 154121 2026-02-13T20:27:21.189 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.178+0000 7fc39a7fc640 1 -- 10.20.193.110:0/3482316209 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc37c0035e0 con 0x7fc3ac091950 2026-02-13T20:27:21.189 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.178+0000 7fc39a7fc640 1 -- 10.20.193.110:0/3482316209 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 938420264 0 0) 0x7fc3ac13fb30 con 0x7fc3ac13eb10 2026-02-13T20:27:21.189 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.178+0000 7fc39a7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:27:21.189 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.178+0000 7fc39a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:21.189 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.178+0000 7fc39a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:21.189 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.178+0000 7fc39a7fc640 10 monclient(hunting): my global_id is 124413 2026-02-13T20:27:21.190 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.178+0000 7fc39a7fc640 1 -- 10.20.193.110:0/3482316209 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3ac12daa0 con 0x7fc3ac13eb10 2026-02-13T20:27:21.190 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.179+0000 7fc39a7fc640 1 -- 10.20.193.110:0/3482316209 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3593787804 0 0) 0x7fc37c0035e0 con 0x7fc3ac091950 2026-02-13T20:27:21.190 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.179+0000 7fc39a7fc640 1 -- 10.20.193.110:0/3482316209 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc3ac13fb30 con 0x7fc3ac091950 2026-02-13T20:27:21.190 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.179+0000 7fc39a7fc640 1 -- 10.20.193.110:0/3482316209 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc39c003fe0 con 0x7fc3ac091950 2026-02-13T20:27:21.190 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.179+0000 7fc39a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:27:21.190 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.179+0000 7fc39a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:27:21.190 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.179+0000 7fc39a7fc640 10 monclient(hunting): dump: 2026-02-13T20:27:21.190 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:21.190 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:21.190 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:21.190 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:21.190 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:21.190 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:21.190 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:21.190 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:21.190 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:21.190 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:21.190 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.179+0000 7fc39a7fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:27:21.191 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.179+0000 7fc39a7fc640 1 -- 10.20.193.110:0/3482316209 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2259322856 0 0) 0x7fc3ac12daa0 con 0x7fc3ac13eb10 2026-02-13T20:27:21.191 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.179+0000 7fc39a7fc640 1 -- 10.20.193.110:0/3482316209 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc37c0035e0 con 0x7fc3ac13eb10 2026-02-13T20:27:21.191 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.179+0000 7fc39a7fc640 1 -- 10.20.193.110:0/3482316209 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc3a80041f0 con 0x7fc3ac13eb10 2026-02-13T20:27:21.191 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.179+0000 7fc39a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:27:21.191 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.179+0000 7fc39a7fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:27:21.191 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.179+0000 7fc39a7fc640 10 monclient(hunting): dump: 2026-02-13T20:27:21.191 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:21.191 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:21.191 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:21.191 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:21.191 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:21.191 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:21.191 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:21.191 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:21.191 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:21.191 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:21.191 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.179+0000 7fc39a7fc640 1 -- 10.20.193.110:0/3482316209 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2841169369 0 0) 0x7fc3ac05d320 con 0x7fc3ac1401c0 2026-02-13T20:27:21.191 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.179+0000 7fc39a7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:27:21.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.179+0000 7fc39a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:21.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.179+0000 7fc39a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:21.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.179+0000 7fc39a7fc640 10 monclient(hunting): my global_id is 144196 2026-02-13T20:27:21.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.179+0000 7fc39a7fc640 1 -- 10.20.193.110:0/3482316209 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3ac12daa0 con 0x7fc3ac1401c0 2026-02-13T20:27:21.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.179+0000 7fc39a7fc640 1 -- 10.20.193.110:0/3482316209 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 298370391 0 0) 0x7fc3ac13fb30 con 0x7fc3ac091950 2026-02-13T20:27:21.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.179+0000 7fc39a7fc640 1 -- 10.20.193.110:0/3482316209 >> v1:10.20.193.188:6789/0 conn(0x7fc3ac1401c0 legacy=0x7fc3ac191790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:21.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.179+0000 7fc39a7fc640 1 -- 10.20.193.110:0/3482316209 >> v1:10.20.193.110:6789/0 conn(0x7fc3ac13eb10 legacy=0x7fc3ac192eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:21.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.179+0000 7fc39a7fc640 10 monclient: _finish_hunting 0 2026-02-13T20:27:21.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.179+0000 7fc39a7fc640 1 monclient: found mon.c 2026-02-13T20:27:21.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.179+0000 7fc39a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:27:21.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.179+0000 7fc39a7fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:27:21.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.179+0000 7fc39a7fc640 1 -- 10.20.193.110:0/3482316209 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3ac150ae0 con 0x7fc3ac091950 2026-02-13T20:27:21.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.179+0000 7fc39a7fc640 10 monclient: _finish_auth 0 2026-02-13T20:27:21.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.179+0000 7fc39a7fc640 10 monclient: _check_auth_tickets 2026-02-13T20:27:21.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.179+0000 7fc39a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:27:21.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.179+0000 7fc3b3c5b640 5 monclient: authenticate success, global_id 154121 2026-02-13T20:27:21.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.179+0000 7fc3b3c5b640 10 monclient: _renew_subs 2026-02-13T20:27:21.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.179+0000 7fc3b3c5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:27:21.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.179+0000 7fc3b3c5b640 1 -- 10.20.193.110:0/3482316209 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc3ac12fe00 con 0x7fc3ac091950 2026-02-13T20:27:21.193 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.179+0000 7fc3b3c5b640 10 monclient: _renew_subs 2026-02-13T20:27:21.193 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.179+0000 7fc3b3c5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:27:21.193 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.179+0000 7fc3b3c5b640 1 -- 10.20.193.110:0/3482316209 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fc3ac12e600 con 0x7fc3ac091950 2026-02-13T20:27:21.193 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.179+0000 7fc39a7fc640 1 -- 10.20.193.110:0/3482316209 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc39c0041b0 con 0x7fc3ac091950 2026-02-13T20:27:21.193 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.179+0000 7fc39a7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:27:21.193 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.179+0000 7fc39a7fc640 1 -- 10.20.193.110:0/3482316209 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc39c002850 con 0x7fc3ac091950 2026-02-13T20:27:21.193 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.179+0000 7fc39a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:21.193 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.179+0000 7fc39a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:27:21.193 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.179+0000 7fc39a7fc640 10 monclient: dump: 2026-02-13T20:27:21.193 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:21.193 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:21.193 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:21.193 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:21.193 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:21.193 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:21.193 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:21.193 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:21.193 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:21.194 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:21.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.179+0000 7fc39bfff640 4 set_mon_vals no callback set 2026-02-13T20:27:21.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.179+0000 7fc3b3c5b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:27:21.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.179+0000 7fc3b3c5b640 1 -- 10.20.193.110:0/3482316209 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc3ac08cb20 con 0x7fc3ac092020 2026-02-13T20:27:21.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.179+0000 7fc39a7fc640 1 -- 10.20.193.110:0/3482316209 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fc39c0029b0 con 0x7fc3ac091950 2026-02-13T20:27:21.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.180+0000 7fc39a7fc640 1 -- 10.20.193.110:0/3482316209 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(771..771 src has 1..771) ==== 3931+0+0 (unknown 2572147740 0 0) 0x7fc39c04e820 con 0x7fc3ac091950 2026-02-13T20:27:21.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.180+0000 7fc39a7fc640 1 -- 10.20.193.110:0/3482316209 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 463420284 0 0) 0x7fc3ac08cb20 con 0x7fc3ac092020 2026-02-13T20:27:21.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.180+0000 7fc39a7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:27:21.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.180+0000 7fc39a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:21.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.180+0000 7fc39a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:21.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.180+0000 7fc39a7fc640 10 monclient(hunting): my global_id is 144199 2026-02-13T20:27:21.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.180+0000 7fc39a7fc640 1 -- 10.20.193.110:0/3482316209 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3ac13fb30 con 0x7fc3ac092020 2026-02-13T20:27:21.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.180+0000 7fc3b21d1640 10 monclient: get_auth_request con 0x7fc37c03fcc0 auth_method 0 2026-02-13T20:27:21.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.180+0000 7fc39a7fc640 1 -- 10.20.193.110:0/3482316209 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2414969572 0 0) 0x7fc3ac13fb30 con 0x7fc3ac092020 2026-02-13T20:27:21.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.180+0000 7fc39a7fc640 1 -- 10.20.193.110:0/3482316209 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc3ac08cb20 con 0x7fc3ac092020 2026-02-13T20:27:21.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.180+0000 7fc39a7fc640 1 -- 10.20.193.110:0/3482316209 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc3a0002f40 con 0x7fc3ac092020 2026-02-13T20:27:21.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.180+0000 7fc39a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:21.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.180+0000 7fc39a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:27:21.195 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.180+0000 7fc39a7fc640 10 monclient: dump: 2026-02-13T20:27:21.195 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:21.195 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:21.195 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:21.195 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:21.195 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:21.195 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:21.195 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:21.195 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:21.195 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:21.195 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:21.195 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.180+0000 7fc39a7fc640 1 -- 10.20.193.110:0/3482316209 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 191238544 0 0) 0x7fc3ac08cb20 con 0x7fc3ac092020 2026-02-13T20:27:21.195 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.180+0000 7fc39a7fc640 1 -- 10.20.193.110:0/3482316209 --> v1:10.20.193.188:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc3ac08b450 con 0x7fc3ac092020 2026-02-13T20:27:21.195 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.180+0000 7fc39a7fc640 1 -- 10.20.193.110:0/3482316209 <== mon.1 v1:10.20.193.188:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fc3a0003500 con 0x7fc3ac092020 2026-02-13T20:27:21.195 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.180+0000 7fc39a7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:27:21.195 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.180+0000 7fc39a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:27:21.195 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.180+0000 7fc39a7fc640 1 -- 10.20.193.110:0/3482316209 >> v1:10.20.193.188:6789/0 conn(0x7fc3ac092020 legacy=0x7fc3ac127b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:21.195 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.180+0000 7fc39a7fc640 1 -- 10.20.193.110:0/3482316209 >> v1:10.20.193.188:6789/0 conn(0x7fc3ac092020 legacy=0x7fc3ac127b20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:27:21.197 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.184+0000 7fc3b3c5b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:27:21.197 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.184+0000 7fc3b3c5b640 1 -- 10.20.193.110:0/3482316209 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc3ac150860 con 0x7fc3ac150490 2026-02-13T20:27:21.197 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.184+0000 7fc39a7fc640 1 -- 10.20.193.110:0/3482316209 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3583642045 0 0) 0x7fc3ac150860 con 0x7fc3ac150490 2026-02-13T20:27:21.197 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.184+0000 7fc39a7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:27:21.197 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.184+0000 7fc39a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:21.197 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.184+0000 7fc39a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:21.197 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.184+0000 7fc39a7fc640 10 monclient(hunting): my global_id is 144202 2026-02-13T20:27:21.197 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.184+0000 7fc39a7fc640 1 -- 10.20.193.110:0/3482316209 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3ac08cb20 con 0x7fc3ac150490 2026-02-13T20:27:21.197 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.184+0000 7fc39a7fc640 1 -- 10.20.193.110:0/3482316209 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2212020012 0 0) 0x7fc3ac08cb20 con 0x7fc3ac150490 2026-02-13T20:27:21.197 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.184+0000 7fc39a7fc640 1 -- 10.20.193.110:0/3482316209 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc3ac150860 con 0x7fc3ac150490 2026-02-13T20:27:21.197 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.184+0000 7fc39a7fc640 1 -- 10.20.193.110:0/3482316209 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc3a0004c40 con 0x7fc3ac150490 2026-02-13T20:27:21.197 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.184+0000 7fc39a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:21.197 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.184+0000 7fc39a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:27:21.197 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.184+0000 7fc39a7fc640 10 monclient: dump: 2026-02-13T20:27:21.197 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:21.197 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:21.198 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:21.198 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:21.198 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:21.198 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:21.198 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:21.198 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:21.198 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:21.198 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:21.198 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.184+0000 7fc39a7fc640 1 -- 10.20.193.110:0/3482316209 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2989231165 0 0) 0x7fc3ac150860 con 0x7fc3ac150490 2026-02-13T20:27:21.198 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.184+0000 7fc39a7fc640 1 -- 10.20.193.110:0/3482316209 --> v1:10.20.193.188:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc3ac055bb0 con 0x7fc3ac150490 2026-02-13T20:27:21.198 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.185+0000 7fc39a7fc640 1 -- 10.20.193.110:0/3482316209 <== mon.1 v1:10.20.193.188:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4681 (unknown 0 0 1562397253) 0x7fc3a0004f80 con 0x7fc3ac150490 2026-02-13T20:27:21.198 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.185+0000 7fc39a7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:27:21.198 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.185+0000 7fc39a7fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:27:21.198 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.185+0000 7fc39a7fc640 1 -- 10.20.193.110:0/3482316209 >> v1:10.20.193.188:6789/0 conn(0x7fc3ac150490 legacy=0x7fc3ac128230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:21.198 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.185+0000 7fc39a7fc640 1 -- 10.20.193.110:0/3482316209 >> v1:10.20.193.188:6789/0 conn(0x7fc3ac150490 legacy=0x7fc3ac128230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:27:21.199 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:27:21.199 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:27:21.199 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:27:21.199 INFO:teuthology.orchestra.run.trial110.stdout: "state": "peon", 2026-02-13T20:27:21.199 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 58, 2026-02-13T20:27:21.199 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 107455, 2026-02-13T20:27:21.199 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:27:21.199 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:27:21.199 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:27:21.199 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:27:21.199 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:27:21.199 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 0, 2026-02-13T20:27:21.199 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:27:21.199 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:27:21.199 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:27:21.199 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:27:21.200 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:27:21.200 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:27:21.200 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:27:21.200 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:27:21.200 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:27:21.200 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:27:21.200 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:27:21.200 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:27:21.200 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:27:21.200 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:27:21.200 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:27:21.200 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:27:21.200 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:27:21.200 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:27:21.200 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:27:21.200 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:27:21.200 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:27:21.200 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:27:21.200 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:27:21.201 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:27:21.201 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:27:21.201 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:27:21.201 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:27:21.201 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:27:21.201 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:27:21.201 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:27:21.201 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:27:21.201 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:27:21.201 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:27:21.201 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:21.201 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:27:21.201 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:27:21.201 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:27:21.201 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:27:21.201 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:27:21.201 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:27:21.201 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:27:21.202 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:27:21.202 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:27:21.202 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:27:21.202 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:27:21.202 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:27:21.202 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:27:21.202 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:27:21.202 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:27:21.202 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:27:21.202 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:27:21.202 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:27:21.202 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:27:21.202 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:27:21.202 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:27:21.202 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:27:21.202 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:27:21.202 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:27:21.202 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:27:21.203 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:27:21.203 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:27:21.203 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:27:21.203 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:27:21.203 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:27:21.203 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:27:21.203 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:27:21.203 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:21.203 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:27:21.203 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:21.203 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:27:21.203 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:27:21.203 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:27:21.203 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:27:21.203 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:21.203 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:27:21.203 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:27:21.203 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:27:21.203 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:21.204 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:27:21.204 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:21.204 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:27:21.204 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:27:21.204 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:27:21.204 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:27:21.204 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:27:21.204 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:27:21.204 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:21.204 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:21.204 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:27:21.204 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:27:21.204 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:27:21.204 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:27:21.204 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:21.204 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:27:21.204 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:27:21.204 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:27:21.204 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:21.205 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:27:21.205 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:21.205 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:27:21.205 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:27:21.205 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:27:21.205 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:27:21.205 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:27:21.205 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:27:21.205 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:21.205 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:21.205 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:27:21.205 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:27:21.205 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:27:21.205 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:27:21.205 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:21.205 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:27:21.205 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:27:21.205 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:27:21.206 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:21.206 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:27:21.206 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:21.206 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:27:21.206 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:27:21.206 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:27:21.206 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:27:21.206 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:27:21.206 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:27:21.206 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:21.206 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:27:21.206 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:21.206 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:27:21.206 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:27:21.206 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:21.206 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:27:21.206 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:27:21.206 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:27:21.207 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:21.207 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:27:21.207 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:27:21.207 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:21.207 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:27:21.207 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:27:21.207 INFO:teuthology.orchestra.run.trial110.stdout: "num": 3 2026-02-13T20:27:21.207 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:21.207 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:27:21.207 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:27:21.207 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:21.207 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:27:21.207 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:27:21.207 INFO:teuthology.orchestra.run.trial110.stdout: "num": 3 2026-02-13T20:27:21.207 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:21.207 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:27:21.207 INFO:teuthology.orchestra.run.trial110.stdout: "mgr": [ 2026-02-13T20:27:21.207 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:21.207 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:27:21.208 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:27:21.208 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:27:21.208 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:21.208 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:27:21.208 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:21.208 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:27:21.208 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:27:21.209 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.185+0000 7fc3b3c5b640 1 -- 10.20.193.110:0/3482316209 >> v1:10.20.193.188:6812/1623052694 conn(0x7fc37c03fcc0 legacy=0x7fc37c060170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:21.209 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.185+0000 7fc3b3c5b640 10 monclient: shutdown 2026-02-13T20:27:21.209 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.185+0000 7fc3b3c5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:27:21.209 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.185+0000 7fc3b3c5b640 1 -- 10.20.193.110:0/3482316209 >> v1:10.20.193.110:6790/0 conn(0x7fc3ac091950 legacy=0x7fc3ac13e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:21.209 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.185+0000 7fc3b21d1640 1 -- 10.20.193.110:0/3482316209 reap_dead start 2026-02-13T20:27:21.209 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.185+0000 7fc3b21d1640 1 -- 10.20.193.110:0/3482316209 reap_dead start 2026-02-13T20:27:21.209 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.185+0000 7fc3b3c5b640 1 -- 10.20.193.110:0/3482316209 shutdown_connections 2026-02-13T20:27:21.209 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.185+0000 7fc3b3c5b640 1 -- 10.20.193.110:0/3482316209 >> 10.20.193.110:0/3482316209 conn(0x7fc3ac054e90 msgr2=0x7fc3ac08c110 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:27:21.209 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.185+0000 7fc3b3c5b640 1 -- 10.20.193.110:0/3482316209 shutdown_connections 2026-02-13T20:27:21.209 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.185+0000 7fc3b3c5b640 1 -- 10.20.193.110:0/3482316209 wait complete. 2026-02-13T20:27:21.210 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:27:21.210 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-13T20:27:21.210 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-13T20:27:21.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.274+0000 7f868f70c640 10 monclient: get_monmap_and_config 2026-02-13T20:27:21.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.274+0000 7f868f70c640 10 monclient: build_initial_monmap 2026-02-13T20:27:21.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.274+0000 7f868f70c640 10 monclient: monmap: 2026-02-13T20:27:21.275 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:27:21.275 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:21.275 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:27:21.274931+0000 2026-02-13T20:27:21.275 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:27:21.274931+0000 2026-02-13T20:27:21.275 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:27:21.275 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:21.276 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:27:21.276 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:27:21.276 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:27:21.276 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:21.281 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.274+0000 7f868f70c640 1 Processor -- start 2026-02-13T20:27:21.281 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.274+0000 7f868f70c640 1 -- start start 2026-02-13T20:27:21.281 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.274+0000 7f868f70c640 10 monclient: init 2026-02-13T20:27:21.281 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.275+0000 7f868f70c640 10 monclient: _reopen_session rank -1 2026-02-13T20:27:21.281 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.275+0000 7f868f70c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:27:21.281 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.275+0000 7f868f70c640 10 monclient(hunting): picked mon.noname-a con 0x7f86881401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:27:21.281 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.275+0000 7f868f70c640 10 monclient(hunting): picked mon.noname-c con 0x7f8688092020 addr v1:10.20.193.188:6789/0 2026-02-13T20:27:21.281 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.275+0000 7f868f70c640 10 monclient(hunting): picked mon.noname-b con 0x7f8688091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:27:21.281 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.275+0000 7f868f70c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f868808b730 con 0x7f86881401c0 2026-02-13T20:27:21.281 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.275+0000 7f868f70c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f868805c5b0 con 0x7f8688092020 2026-02-13T20:27:21.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.275+0000 7f868f70c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f868808bcf0 con 0x7f8688091950 2026-02-13T20:27:21.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.275+0000 7f868f70c640 10 monclient(hunting): _renew_subs 2026-02-13T20:27:21.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.275+0000 7f868f70c640 10 monclient(hunting): authenticate will time out at 1602.965253s 2026-02-13T20:27:21.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.275+0000 7f868d481640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f86881401c0 0x7f8688091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:57836/0 (socket says 10.20.193.110:57836) 2026-02-13T20:27:21.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.275+0000 7f868d481640 1 -- 10.20.193.110:0/2477899381 learned_addr learned my addr 10.20.193.110:0/2477899381 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:27:21.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.275+0000 7f8677fff640 1 -- 10.20.193.110:0/2477899381 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4256854603 0 0) 0x7f868808b730 con 0x7f86881401c0 2026-02-13T20:27:21.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.275+0000 7f8677fff640 10 monclient(hunting): _negotiate 2026-02-13T20:27:21.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.275+0000 7f8677fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:21.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.275+0000 7f8677fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:21.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.275+0000 7f8677fff640 10 monclient(hunting): my global_id is 124416 2026-02-13T20:27:21.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.275+0000 7f8677fff640 1 -- 10.20.193.110:0/2477899381 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86700035e0 con 0x7f86881401c0 2026-02-13T20:27:21.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.275+0000 7f8677fff640 1 -- 10.20.193.110:0/2477899381 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1810994196 0 0) 0x7f868808bcf0 con 0x7f8688091950 2026-02-13T20:27:21.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.275+0000 7f8677fff640 10 monclient(hunting): _negotiate 2026-02-13T20:27:21.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.275+0000 7f8677fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:21.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.275+0000 7f8677fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:21.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.275+0000 7f8677fff640 10 monclient(hunting): my global_id is 154124 2026-02-13T20:27:21.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.275+0000 7f8677fff640 1 -- 10.20.193.110:0/2477899381 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f868808b730 con 0x7f8688091950 2026-02-13T20:27:21.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.275+0000 7f8677fff640 1 -- 10.20.193.110:0/2477899381 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2156007058 0 0) 0x7f86700035e0 con 0x7f86881401c0 2026-02-13T20:27:21.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.275+0000 7f8677fff640 1 -- 10.20.193.110:0/2477899381 >> v1:10.20.193.110:6790/0 conn(0x7f8688091950 legacy=0x7f86881a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:21.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.275+0000 7f8677fff640 1 -- 10.20.193.110:0/2477899381 >> v1:10.20.193.188:6789/0 conn(0x7f8688092020 legacy=0x7f86881812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:21.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.275+0000 7f8677fff640 10 monclient: _finish_hunting 0 2026-02-13T20:27:21.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.275+0000 7f8677fff640 1 monclient: found mon.noname-a 2026-02-13T20:27:21.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.275+0000 7f8677fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:27:21.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.275+0000 7f8677fff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:27:21.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.275+0000 7f8677fff640 1 -- 10.20.193.110:0/2477899381 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8688140590 con 0x7f86881401c0 2026-02-13T20:27:21.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.275+0000 7f8677fff640 10 monclient: _finish_auth 0 2026-02-13T20:27:21.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.275+0000 7f8677fff640 10 monclient: _check_auth_tickets 2026-02-13T20:27:21.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.275+0000 7f8677fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:27:21.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.275+0000 7f8677fff640 1 -- 10.20.193.110:0/2477899381 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f8678002dd0 con 0x7f86881401c0 2026-02-13T20:27:21.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.275+0000 7f8677fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:21.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.275+0000 7f8677fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:27:21.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.275+0000 7f8677fff640 10 monclient: dump: 2026-02-13T20:27:21.283 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:21.283 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:21.283 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:21.283 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:21.284 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:21.284 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:21.284 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:21.284 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:21.284 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:21.284 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:21.284 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.275+0000 7f868f70c640 5 monclient: authenticate success, global_id 124416 2026-02-13T20:27:21.284 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.275+0000 7f868f70c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:27:21.284 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.275+0000 7f8677fff640 1 -- 10.20.193.110:0/2477899381 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8678002fe0 con 0x7f86881401c0 2026-02-13T20:27:21.284 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.275+0000 7f8677fff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:27:21.284 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.275+0000 7f868f70c640 10 monclient: get_monmap_and_config success 2026-02-13T20:27:21.284 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.275+0000 7f868f70c640 4 set_mon_vals no callback set 2026-02-13T20:27:21.284 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.275+0000 7f8677fff640 1 -- 10.20.193.110:0/2477899381 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f86780033f0 con 0x7f86881401c0 2026-02-13T20:27:21.284 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.275+0000 7f8677fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:21.284 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.275+0000 7f8677fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:27:21.284 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.275+0000 7f8677fff640 10 monclient: dump: 2026-02-13T20:27:21.284 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:21.285 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:21.285 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:21.285 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:21.285 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:21.285 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:21.285 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:21.285 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:21.285 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:21.285 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:21.285 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.276+0000 7f868f70c640 10 monclient: shutdown 2026-02-13T20:27:21.285 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.276+0000 7f868f70c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:27:21.285 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.276+0000 7f868f70c640 1 -- 10.20.193.110:0/2477899381 >> v1:10.20.193.110:6789/0 conn(0x7f86881401c0 legacy=0x7f8688091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:21.285 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.276+0000 7f868f70c640 1 -- 10.20.193.110:0/2477899381 shutdown_connections 2026-02-13T20:27:21.285 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.276+0000 7f868f70c640 1 -- 10.20.193.110:0/2477899381 >> 10.20.193.110:0/2477899381 conn(0x7f8688054e90 msgr2=0x7f8688058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:27:21.285 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.276+0000 7f868f70c640 1 -- 10.20.193.110:0/2477899381 shutdown_connections 2026-02-13T20:27:21.285 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.276+0000 7f868f70c640 1 -- 10.20.193.110:0/2477899381 wait complete. 2026-02-13T20:27:21.285 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.276+0000 7f868f70c640 10 monclient: build_initial_monmap 2026-02-13T20:27:21.285 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.276+0000 7f868f70c640 10 monclient: monmap: 2026-02-13T20:27:21.285 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:27:21.286 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:27:21.286 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:27:21.286 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:27:21.286 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:27:21.286 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:27:21.286 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:27:21.286 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:27:21.286 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:27:21.286 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:21.286 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.276+0000 7f868f70c640 1 Processor -- start 2026-02-13T20:27:21.286 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.276+0000 7f868f70c640 1 -- start start 2026-02-13T20:27:21.286 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.276+0000 7f868f70c640 10 monclient: init 2026-02-13T20:27:21.286 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.276+0000 7f868f70c640 10 monclient: _reopen_session rank -1 2026-02-13T20:27:21.286 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.276+0000 7f868f70c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:27:21.286 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.276+0000 7f868f70c640 10 monclient(hunting): picked mon.noname-a con 0x7f8688091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:27:21.286 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.276+0000 7f868f70c640 10 monclient(hunting): picked mon.noname-c con 0x7f86881401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:27:21.286 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.276+0000 7f868f70c640 10 monclient(hunting): picked mon.noname-b con 0x7f868812df80 addr v1:10.20.193.188:6789/0 2026-02-13T20:27:21.286 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.276+0000 7f868f70c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f868805d320 con 0x7f8688091950 2026-02-13T20:27:21.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.276+0000 7f868f70c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8688117140 con 0x7f868812df80 2026-02-13T20:27:21.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.276+0000 7f868f70c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f868808c380 con 0x7f86881401c0 2026-02-13T20:27:21.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.276+0000 7f868f70c640 10 monclient(hunting): _renew_subs 2026-02-13T20:27:21.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.276+0000 7f868f70c640 10 monclient(hunting): authenticate will time out at 1602.966981s 2026-02-13T20:27:21.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f868d481640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f8688091950 0x7f8688116320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:57846/0 (socket says 10.20.193.110:57846) 2026-02-13T20:27:21.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f868d481640 1 -- 10.20.193.110:0/3304024407 learned_addr learned my addr 10.20.193.110:0/3304024407 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:27:21.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f868cc80640 1 --1- 10.20.193.110:0/3304024407 >> v1:10.20.193.110:6790/0 conn(0x7f86881401c0 0x7f8688116a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:57844/0 (socket says 10.20.193.110:57844) 2026-02-13T20:27:21.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f868cc80640 1 -- 10.20.193.110:0/3304024407 >> v1:10.20.193.110:6790/0 conn(0x7f86881401c0 legacy=0x7f8688116a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-13T20:27:21.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f868cc80640 1 -- 10.20.193.110:0/3304024407 >> v1:10.20.193.110:6790/0 conn(0x7f86881401c0 legacy=0x7f8688116a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T20:27:21.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f868cc80640 1 --1- 10.20.193.110:0/3304024407 >> v1:10.20.193.110:6790/0 conn(0x7f86881401c0 0x7f8688116a30 :-1 s=OPENED pgs=489 gs=2 cs=1 l=1).handle_message read tag failed 2026-02-13T20:27:21.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f868cc80640 1 --1- 10.20.193.110:0/3304024407 >> v1:10.20.193.110:6790/0 conn(0x7f86881401c0 0x7f8688116a30 :-1 s=OPENED pgs=489 gs=2 cs=1 l=1).fault on lossy channel, failing 2026-02-13T20:27:21.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f8675ffb640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.110:6790/0 2026-02-13T20:27:21.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f8675ffb640 1 -- 10.20.193.110:0/3304024407 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 152254701 0 0) 0x7f868805d320 con 0x7f8688091950 2026-02-13T20:27:21.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f8675ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:27:21.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f8675ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:21.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f8675ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:21.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f8675ffb640 10 monclient(hunting): my global_id is 124419 2026-02-13T20:27:21.288 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f8675ffb640 1 -- 10.20.193.110:0/3304024407 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86580035e0 con 0x7f8688091950 2026-02-13T20:27:21.288 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f8675ffb640 1 -- 10.20.193.110:0/3304024407 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 565553274 0 0) 0x7f86580035e0 con 0x7f8688091950 2026-02-13T20:27:21.288 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f8675ffb640 1 -- 10.20.193.110:0/3304024407 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f868805d320 con 0x7f8688091950 2026-02-13T20:27:21.288 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f8675ffb640 1 -- 10.20.193.110:0/3304024407 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f86780033c0 con 0x7f8688091950 2026-02-13T20:27:21.288 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f8675ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:27:21.288 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f8675ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:27:21.288 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f8675ffb640 10 monclient(hunting): dump: 2026-02-13T20:27:21.288 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:21.288 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:21.288 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:21.288 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:21.288 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:21.288 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:21.288 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:21.288 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:21.288 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:21.288 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:21.288 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f8675ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:27:21.288 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f8675ffb640 1 -- 10.20.193.110:0/3304024407 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3743691618 0 0) 0x7f8688117140 con 0x7f868812df80 2026-02-13T20:27:21.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f8675ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:27:21.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f8675ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:21.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f8675ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:21.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f8675ffb640 10 monclient(hunting): my global_id is 144208 2026-02-13T20:27:21.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f8675ffb640 1 -- 10.20.193.110:0/3304024407 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86580035e0 con 0x7f868812df80 2026-02-13T20:27:21.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f8675ffb640 1 -- 10.20.193.110:0/3304024407 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4134598667 0 0) 0x7f868805d320 con 0x7f8688091950 2026-02-13T20:27:21.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f8675ffb640 1 -- 10.20.193.110:0/3304024407 >> v1:10.20.193.110:6790/0 conn(0x7f86881401c0 legacy=0x7f8688116a30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:27:21.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f8675ffb640 1 -- 10.20.193.110:0/3304024407 >> v1:10.20.193.188:6789/0 conn(0x7f868812df80 legacy=0x7f86881a2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:21.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f8675ffb640 10 monclient: _finish_hunting 0 2026-02-13T20:27:21.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f8675ffb640 1 monclient: found mon.a 2026-02-13T20:27:21.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f8675ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:27:21.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f8675ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:27:21.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f8675ffb640 1 -- 10.20.193.110:0/3304024407 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f868808a920 con 0x7f8688091950 2026-02-13T20:27:21.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f8675ffb640 10 monclient: _finish_auth 0 2026-02-13T20:27:21.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f8675ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:27:21.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f8675ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:27:21.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f868f70c640 5 monclient: authenticate success, global_id 124419 2026-02-13T20:27:21.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f868f70c640 10 monclient: _renew_subs 2026-02-13T20:27:21.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f868f70c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:27:21.290 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f868f70c640 1 -- 10.20.193.110:0/3304024407 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f868812eee0 con 0x7f8688091950 2026-02-13T20:27:21.290 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f868f70c640 10 monclient: _renew_subs 2026-02-13T20:27:21.290 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f868f70c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:27:21.290 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f868f70c640 1 -- 10.20.193.110:0/3304024407 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8688113260 con 0x7f8688091950 2026-02-13T20:27:21.290 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f8675ffb640 1 -- 10.20.193.110:0/3304024407 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8678004b50 con 0x7f8688091950 2026-02-13T20:27:21.290 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f8675ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T20:27:21.290 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f8675ffb640 1 -- 10.20.193.110:0/3304024407 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f8678004e70 con 0x7f8688091950 2026-02-13T20:27:21.290 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f8675ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:21.290 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f8675ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:27:21.290 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f8675ffb640 10 monclient: dump: 2026-02-13T20:27:21.290 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:21.290 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:21.290 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:21.290 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:21.290 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:21.290 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:21.290 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:21.290 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:21.290 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:21.291 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:21.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.277+0000 7f86777fe640 4 set_mon_vals no callback set 2026-02-13T20:27:21.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.278+0000 7f868f70c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:27:21.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.278+0000 7f868f70c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:27:21.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.278+0000 7f868f70c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:27:21.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.278+0000 7f868f70c640 1 -- 10.20.193.110:0/3304024407 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8688055bb0 con 0x7f8688091950 2026-02-13T20:27:21.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.278+0000 7f8675ffb640 1 -- 10.20.193.110:0/3304024407 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f8678004fd0 con 0x7f8688091950 2026-02-13T20:27:21.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.278+0000 7f8675ffb640 1 -- 10.20.193.110:0/3304024407 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(771..771 src has 1..771) ==== 3931+0+0 (unknown 2572147740 0 0) 0x7f867804eb20 con 0x7f8688091950 2026-02-13T20:27:21.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.278+0000 7f868cc80640 10 monclient: get_auth_request con 0x7f865803f810 auth_method 0 2026-02-13T20:27:21.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.281+0000 7f8675ffb640 1 -- 10.20.193.110:0/3304024407 <== mon.0 v1:10.20.193.110:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f86780172c0 con 0x7f8688091950 2026-02-13T20:27:21.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.281+0000 7f8675ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:27:21.291 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.281+0000 7f8675ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:27:21.436 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.436+0000 7f868f70c640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-13T20:27:21.436 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.436+0000 7f868f70c640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-13T20:27:21.436 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.436+0000 7f868f70c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:27:21.437 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.436+0000 7f868f70c640 1 -- 10.20.193.110:0/3304024407 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f86881135b0 con 0x7f8688091950 2026-02-13T20:27:21.437 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.437+0000 7f8675ffb640 1 -- 10.20.193.110:0/3304024407 <== mon.0 v1:10.20.193.110:6789/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7f8678016a70 con 0x7f8688091950 2026-02-13T20:27:21.437 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.437+0000 7f8675ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-13T20:27:21.437 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.437+0000 7f8675ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:27:21.439 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.437+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.439 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.437+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=21,config=2,health=12,kv=11,logm=54} crc {auth=2055273392,config=1618278320,health=2822512867,kv=1843422897,logm=1292226622}) 2026-02-13T20:27:21.439 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.437+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=22,config=2,health=13,kv=11,logm=52} crc {auth=2809198639,config=1618278320,health=650935996,kv=1564860261,logm=2069236625}) 2026-02-13T20:27:21.439 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.437+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.439 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.437+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=21,config=2,health=12,kv=11,logm=54} crc {auth=2055273392,config=1618278320,health=2822512867,kv=1843422897,logm=1292226622}) 2026-02-13T20:27:21.439 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.437+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=23,config=2,health=13,kv=11,logm=51} crc {auth=2417078220,config=1618278320,health=650935996,kv=1564860261,logm=1715184182}) 2026-02-13T20:27:21.439 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.437+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.439 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.437+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3417608379}) 2026-02-13T20:27:21.439 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.437+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=223107988}) 2026-02-13T20:27:21.440 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.437+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.440 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.437+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3417608379}) 2026-02-13T20:27:21.440 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.437+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2179546068}) 2026-02-13T20:27:21.440 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.438+0000 7f868f70c640 1 -- 10.20.193.110:0/3304024407 >> v1:10.20.193.188:6812/1623052694 conn(0x7f865803f810 legacy=0x7f865805fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:21.440 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.438+0000 7f868f70c640 10 monclient: shutdown 2026-02-13T20:27:21.440 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.438+0000 7f868f70c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:27:21.440 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.438+0000 7f868f70c640 1 -- 10.20.193.110:0/3304024407 >> v1:10.20.193.110:6789/0 conn(0x7f8688091950 legacy=0x7f8688116320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:21.441 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.438+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.441 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.438+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3296279468}) 2026-02-13T20:27:21.442 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.438+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3692650156}) 2026-02-13T20:27:21.442 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.438+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.442 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.438+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3296279468}) 2026-02-13T20:27:21.442 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.438+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2259219041}) 2026-02-13T20:27:21.443 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.438+0000 7f868f70c640 1 -- 10.20.193.110:0/3304024407 shutdown_connections 2026-02-13T20:27:21.443 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.438+0000 7f868f70c640 1 -- 10.20.193.110:0/3304024407 >> 10.20.193.110:0/3304024407 conn(0x7f8688054e90 msgr2=0x7f868808dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:27:21.443 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.438+0000 7f868f70c640 1 -- 10.20.193.110:0/3304024407 shutdown_connections 2026-02-13T20:27:21.443 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:21.438+0000 7f868f70c640 1 -- 10.20.193.110:0/3304024407 wait complete. 2026-02-13T20:27:21.450 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.438+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.450 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.438+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2992479297}) 2026-02-13T20:27:21.450 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.438+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=131327411}) 2026-02-13T20:27:21.451 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.438+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.451 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.438+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2992479297}) 2026-02-13T20:27:21.451 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.438+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4148013749}) 2026-02-13T20:27:21.451 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.439+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.451 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.439+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1501925850}) 2026-02-13T20:27:21.451 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.439+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1009115570}) 2026-02-13T20:27:21.451 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.439+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.451 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.439+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1501925850}) 2026-02-13T20:27:21.451 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.439+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=204018884}) 2026-02-13T20:27:21.451 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.439+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.451 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.439+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1935686972}) 2026-02-13T20:27:21.451 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.439+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2799119930}) 2026-02-13T20:27:21.452 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.439+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.452 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.439+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1935686972}) 2026-02-13T20:27:21.452 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.439+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1750188175}) 2026-02-13T20:27:21.452 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.440+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.452 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.440+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3141488396}) 2026-02-13T20:27:21.452 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.440+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=722901260}) 2026-02-13T20:27:21.452 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.440+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.452 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.440+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3141488396}) 2026-02-13T20:27:21.452 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.440+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3138138225}) 2026-02-13T20:27:21.452 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.440+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.452 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.440+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1153816939}) 2026-02-13T20:27:21.453 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.440+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3330639393}) 2026-02-13T20:27:21.453 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.440+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.453 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.440+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1153816939}) 2026-02-13T20:27:21.453 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.440+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3774008369}) 2026-02-13T20:27:21.453 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.441+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.453 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.441+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2873404725}) 2026-02-13T20:27:21.453 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.441+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2962048620}) 2026-02-13T20:27:21.453 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.441+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.453 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.441+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2873404725}) 2026-02-13T20:27:21.453 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.441+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=508751880}) 2026-02-13T20:27:21.453 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.441+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.453 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.441+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1446107719}) 2026-02-13T20:27:21.454 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.441+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3977491272}) 2026-02-13T20:27:21.454 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.441+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.454 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.441+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1446107719}) 2026-02-13T20:27:21.454 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.441+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2843104690}) 2026-02-13T20:27:21.454 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.441+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.454 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.441+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3913813574}) 2026-02-13T20:27:21.454 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.441+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2816553442}) 2026-02-13T20:27:21.454 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.441+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.454 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.441+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3913813574}) 2026-02-13T20:27:21.454 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.441+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=490251329}) 2026-02-13T20:27:21.454 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.442+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.454 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.442+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2500587340}) 2026-02-13T20:27:21.455 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.442+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3026299293}) 2026-02-13T20:27:21.455 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.442+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.455 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.442+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2500587340}) 2026-02-13T20:27:21.455 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.442+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3288206404}) 2026-02-13T20:27:21.455 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.442+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.455 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.442+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1879403739}) 2026-02-13T20:27:21.455 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.442+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4231661831}) 2026-02-13T20:27:21.455 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.442+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.455 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.442+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1879403739}) 2026-02-13T20:27:21.455 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.442+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=848748647}) 2026-02-13T20:27:21.455 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.443+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.455 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.443+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3471204943}) 2026-02-13T20:27:21.456 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.443+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3403575955}) 2026-02-13T20:27:21.456 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.443+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.456 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.443+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3471204943}) 2026-02-13T20:27:21.456 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.443+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3035650213}) 2026-02-13T20:27:21.456 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.443+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.456 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.443+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1344482479}) 2026-02-13T20:27:21.456 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.443+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=663498792}) 2026-02-13T20:27:21.456 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.443+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.456 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.443+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1344482479}) 2026-02-13T20:27:21.456 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.443+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=234527220}) 2026-02-13T20:27:21.456 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.443+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.457 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.443+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1594288316}) 2026-02-13T20:27:21.457 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.443+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1821708637}) 2026-02-13T20:27:21.457 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.443+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.457 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.443+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1594288316}) 2026-02-13T20:27:21.457 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.443+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=893547077}) 2026-02-13T20:27:21.457 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.444+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.457 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.444+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1642199211}) 2026-02-13T20:27:21.457 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.444+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3127063961}) 2026-02-13T20:27:21.457 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.444+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.457 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.444+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1642199211}) 2026-02-13T20:27:21.457 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.444+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1977607080}) 2026-02-13T20:27:21.457 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.444+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.457 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.444+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2288310341}) 2026-02-13T20:27:21.457 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.444+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3077496671}) 2026-02-13T20:27:21.458 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.444+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.458 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.444+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2288310341}) 2026-02-13T20:27:21.458 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.444+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3414662104}) 2026-02-13T20:27:21.458 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.445+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.458 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.445+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2168380499}) 2026-02-13T20:27:21.458 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.445+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=603900173}) 2026-02-13T20:27:21.458 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.445+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.458 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.445+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2168380499}) 2026-02-13T20:27:21.458 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.445+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2278189928}) 2026-02-13T20:27:21.458 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.445+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.458 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.445+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3940463962}) 2026-02-13T20:27:21.459 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.445+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1064914913}) 2026-02-13T20:27:21.459 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.445+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.459 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.445+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3940463962}) 2026-02-13T20:27:21.459 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.445+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2420383109}) 2026-02-13T20:27:21.460 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-13T20:27:21.471 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.445+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.471 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.445+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4264619469}) 2026-02-13T20:27:21.471 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.445+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1227664120}) 2026-02-13T20:27:21.471 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.445+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.471 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.445+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4264619469}) 2026-02-13T20:27:21.471 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.445+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=383899511}) 2026-02-13T20:27:21.471 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.446+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.471 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.446+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4141558365}) 2026-02-13T20:27:21.471 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.446+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2515714682}) 2026-02-13T20:27:21.471 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.446+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.472 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.446+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4141558365}) 2026-02-13T20:27:21.472 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.446+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=373238353}) 2026-02-13T20:27:21.472 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.446+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.472 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.446+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1870667576}) 2026-02-13T20:27:21.472 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.446+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1787611355}) 2026-02-13T20:27:21.472 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.446+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.472 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.446+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1870667576}) 2026-02-13T20:27:21.472 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.446+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3842012936}) 2026-02-13T20:27:21.472 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.447+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.472 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.447+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=793558131}) 2026-02-13T20:27:21.472 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.447+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4102872675}) 2026-02-13T20:27:21.472 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.447+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.472 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.447+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=793558131}) 2026-02-13T20:27:21.472 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.447+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3723640676}) 2026-02-13T20:27:21.473 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.447+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.473 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.447+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1775024432}) 2026-02-13T20:27:21.473 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.447+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=198867475}) 2026-02-13T20:27:21.473 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.447+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.473 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.447+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1775024432}) 2026-02-13T20:27:21.473 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.447+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1520354270}) 2026-02-13T20:27:21.473 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.448+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.473 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.448+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3111937896}) 2026-02-13T20:27:21.473 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.448+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2465141290}) 2026-02-13T20:27:21.473 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.448+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.473 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.448+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3111937896}) 2026-02-13T20:27:21.473 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.448+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2114949251}) 2026-02-13T20:27:21.473 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.448+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.473 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.448+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3008619619}) 2026-02-13T20:27:21.473 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.448+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1652929557}) 2026-02-13T20:27:21.474 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.448+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.474 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.448+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3008619619}) 2026-02-13T20:27:21.474 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.448+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3252717719}) 2026-02-13T20:27:21.474 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.448+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.474 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.448+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1805479448}) 2026-02-13T20:27:21.474 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.448+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3958467033}) 2026-02-13T20:27:21.474 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.448+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.474 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.448+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1805479448}) 2026-02-13T20:27:21.474 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.448+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2561229894}) 2026-02-13T20:27:21.474 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.449+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.474 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.449+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3116153788}) 2026-02-13T20:27:21.474 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.449+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=194263077}) 2026-02-13T20:27:21.474 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.449+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.474 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.449+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3116153788}) 2026-02-13T20:27:21.474 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.449+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2529205574}) 2026-02-13T20:27:21.475 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.450+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.475 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.450+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2127084363}) 2026-02-13T20:27:21.475 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.450+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3525687767}) 2026-02-13T20:27:21.475 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.450+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.475 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.450+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2127084363}) 2026-02-13T20:27:21.475 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.450+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=6785913}) 2026-02-13T20:27:21.475 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.450+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.475 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.450+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=91492800}) 2026-02-13T20:27:21.475 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.450+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2771798168}) 2026-02-13T20:27:21.475 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.450+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.475 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.450+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=91492800}) 2026-02-13T20:27:21.475 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.450+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=440090117}) 2026-02-13T20:27:21.475 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.451+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.475 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.451+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3917937720}) 2026-02-13T20:27:21.475 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.451+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=922013829}) 2026-02-13T20:27:21.475 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.451+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.476 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.451+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3917937720}) 2026-02-13T20:27:21.476 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.451+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2038392509}) 2026-02-13T20:27:21.476 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.451+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.476 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.451+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=90188967}) 2026-02-13T20:27:21.476 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.451+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3465123904}) 2026-02-13T20:27:21.476 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.451+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.476 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.451+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=90188967}) 2026-02-13T20:27:21.476 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.451+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2454392864}) 2026-02-13T20:27:21.476 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.452+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.476 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.452+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=56,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=9,monmap=2,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2} crc {logm=2826818976,mdsmap=3827184867,mgr=2881591710,mgr_command_descs=714296370,mgr_metadata=2819730505,mgrstat=431913691,mon_config_key=3424313430,monmap=2677135861,nvmeofgw=3360707892,osd_metadata=91123727,osd_pg_creating=2523849122,osd_snap=2675613900}) 2026-02-13T20:27:21.476 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.452+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=57,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=10,monmap=2,nvmeofgw=3,osd_metadata=6} crc {logm=2003890917,mdsmap=3740562891,mgr=2881591710,mgr_command_descs=714296370,mgr_metadata=2819730505,mgrstat=431913691,mon_config_key=3557484700,monmap=2677135861,nvmeofgw=3360707892,osd_metadata=91123727}) 2026-02-13T20:27:21.476 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.452+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.476 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.452+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=56,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=9,monmap=2,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2} crc {logm=2826818976,mdsmap=3827184867,mgr=2881591710,mgr_command_descs=714296370,mgr_metadata=2819730505,mgrstat=431913691,mon_config_key=3424313430,monmap=2677135861,nvmeofgw=3360707892,osd_metadata=91123727,osd_pg_creating=2523849122,osd_snap=2675613900}) 2026-02-13T20:27:21.476 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.452+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=58,mdsmap=3,mgr=7,mgr_metadata=1,mgrstat=8,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1} crc {logm=4077225658,mdsmap=3740562891,mgr=2792164528,mgr_metadata=2819730505,mgrstat=1704517082,mon_config_key=3557484700,monmap=207866894,nvmeofgw=3360707892,osd_metadata=91123727,osd_pg_creating=2523849122}) 2026-02-13T20:27:21.476 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.452+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.476 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.452+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=100} crc {osd_snap=268604568}) 2026-02-13T20:27:21.477 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.452+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=100} crc {osd_snap=3377855075}) 2026-02-13T20:27:21.477 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.452+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.477 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.452+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=100} crc {osd_snap=268604568}) 2026-02-13T20:27:21.477 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.452+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=100} crc {osd_snap=2329935234}) 2026-02-13T20:27:21.477 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.453+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.477 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.453+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=50,osdmap=50} crc {osd_snap=371654390,osdmap=3551232643}) 2026-02-13T20:27:21.477 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.453+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=50,osdmap=50} crc {osd_snap=532074123,osdmap=756424789}) 2026-02-13T20:27:21.477 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.453+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.477 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.453+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=50,osdmap=50} crc {osd_snap=371654390,osdmap=3551232643}) 2026-02-13T20:27:21.477 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.453+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=50,osdmap=50} crc {osd_snap=2833595808,osdmap=1084113169}) 2026-02-13T20:27:21.477 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.453+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.477 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.453+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1016809907}) 2026-02-13T20:27:21.477 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.453+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2771557013}) 2026-02-13T20:27:21.477 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.453+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.477 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.453+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1016809907}) 2026-02-13T20:27:21.477 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.453+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3748637022}) 2026-02-13T20:27:21.477 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.454+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.478 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.454+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=243602993}) 2026-02-13T20:27:21.478 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.454+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=820584215}) 2026-02-13T20:27:21.478 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.454+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.478 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.454+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=243602993}) 2026-02-13T20:27:21.478 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.454+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2309690946}) 2026-02-13T20:27:21.478 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.454+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.478 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.454+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=4149094296}) 2026-02-13T20:27:21.478 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.454+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3358050374}) 2026-02-13T20:27:21.478 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.454+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.478 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.454+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=4149094296}) 2026-02-13T20:27:21.478 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.454+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1853392746}) 2026-02-13T20:27:21.478 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.455+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.478 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.455+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3145558893}) 2026-02-13T20:27:21.478 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.455+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3918116910}) 2026-02-13T20:27:21.478 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.455+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.478 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.455+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3145558893}) 2026-02-13T20:27:21.478 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.455+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=4169508425}) 2026-02-13T20:27:21.478 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.455+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.479 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.455+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2510741410}) 2026-02-13T20:27:21.479 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.455+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2124253254}) 2026-02-13T20:27:21.479 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.455+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.479 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.455+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2510741410}) 2026-02-13T20:27:21.479 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.455+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=4196787595}) 2026-02-13T20:27:21.479 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.456+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.479 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.456+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3115584034}) 2026-02-13T20:27:21.479 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.456+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=674025600}) 2026-02-13T20:27:21.479 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.456+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.479 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.456+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3115584034}) 2026-02-13T20:27:21.479 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.456+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1662438259}) 2026-02-13T20:27:21.479 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.456+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.479 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.456+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3667143188}) 2026-02-13T20:27:21.479 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.456+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3011226433}) 2026-02-13T20:27:21.479 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.456+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.479 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.456+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3667143188}) 2026-02-13T20:27:21.479 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.456+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3007852009}) 2026-02-13T20:27:21.480 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.457+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.480 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.457+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1600820121}) 2026-02-13T20:27:21.480 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.457+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3084040209}) 2026-02-13T20:27:21.480 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.457+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.480 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.457+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1600820121}) 2026-02-13T20:27:21.480 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.457+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=118075542}) 2026-02-13T20:27:21.480 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.458+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.480 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.458+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=764154286}) 2026-02-13T20:27:21.480 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.458+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=676138904}) 2026-02-13T20:27:21.480 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.458+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.480 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.458+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=764154286}) 2026-02-13T20:27:21.480 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.458+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3418976927}) 2026-02-13T20:27:21.480 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.459+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.480 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.459+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2716398869}) 2026-02-13T20:27:21.480 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.459+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=331880234}) 2026-02-13T20:27:21.480 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.459+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.480 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.459+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2716398869}) 2026-02-13T20:27:21.480 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.459+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1262769750}) 2026-02-13T20:27:21.480 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.461+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.481 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.461+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=56} crc {osdmap=305134445}) 2026-02-13T20:27:21.481 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.461+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=53} crc {osdmap=400823266}) 2026-02-13T20:27:21.481 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.461+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:27:21.481 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.461+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=56} crc {osdmap=305134445}) 2026-02-13T20:27:21.481 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:27:21.461+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=53} crc {osdmap=366801762}) 2026-02-13T20:27:21.749 INFO:tasks.rados.rados.0.trial188.stdout:3613: done (6 left) 2026-02-13T20:27:21.749 INFO:tasks.rados.rados.0.trial188.stdout:3614: write (excl) oid 46 current snap is 378 2026-02-13T20:27:21.749 INFO:tasks.rados.rados.0.trial188.stdout:3608: finishing write tid 1 to trial18843701-1 2026-02-13T20:27:21.749 INFO:tasks.rados.rados.0.trial188.stdout:3614: seq_num 1257 ranges {726399=586238,2073395=797434} 2026-02-13T20:27:21.754 INFO:tasks.rados.rados.0.trial188.stdout:3614: writing trial18843701-46 from 726399 to 1312637 tid 1 2026-02-13T20:27:21.760 INFO:tasks.rados.rados.0.trial188.stdout:3614: writing trial18843701-46 from 2073395 to 2870829 tid 2 2026-02-13T20:27:21.760 INFO:tasks.rados.rados.0.trial188.stdout:3610: finishing copy_from racing read to trial18843701-7 2026-02-13T20:27:21.760 INFO:tasks.rados.rados.0.trial188.stdout:3615: read oid 30 snap -1 2026-02-13T20:27:21.760 INFO:tasks.rados.rados.0.trial188.stdout:3615: expect (ObjNum 1221 snap 370 seq_num 1221) 2026-02-13T20:27:21.760 INFO:tasks.rados.rados.0.trial188.stdout:3616: write oid 14 current snap is 378 2026-02-13T20:27:21.760 INFO:tasks.rados.rados.0.trial188.stdout:3616: seq_num 1258 ranges {743206=661487,2131877=541092} 2026-02-13T20:27:21.765 INFO:tasks.rados.rados.0.trial188.stdout:3616: writing trial18843701-14 from 743206 to 1404693 tid 1 2026-02-13T20:27:21.770 INFO:tasks.rados.rados.0.trial188.stdout:3616: writing trial18843701-14 from 2131877 to 2672969 tid 2 2026-02-13T20:27:21.770 INFO:tasks.rados.rados.0.trial188.stdout:3617: snap_create 2026-02-13T20:27:21.770 INFO:tasks.rados.rados.0.trial188.stdout:3612: expect (ObjNum 1007 snap 299 seq_num 1007) 2026-02-13T20:27:21.770 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:27:21.854 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2466587 2026-02-13T20:27:21.862 INFO:tasks.rados.rados.0.trial188.stdout:3609: finishing copy_from racing read to trial18843701-45 2026-02-13T20:27:21.863 INFO:tasks.rados.rados.0.trial188.stdout:3607: finishing write tid 1 to trial18843701-37 2026-02-13T20:27:21.863 INFO:tasks.rados.rados.0.trial188.stdout:3607: finishing write tid 2 to trial18843701-37 2026-02-13T20:27:21.863 INFO:tasks.rados.rados.0.trial188.stdout:3607: finishing write tid 3 to trial18843701-37 2026-02-13T20:27:21.863 INFO:tasks.rados.rados.0.trial188.stdout:3608: finishing write tid 2 to trial18843701-1 2026-02-13T20:27:21.863 INFO:tasks.rados.rados.0.trial188.stdout:3611: finishing write tid 1 to trial18843701-35 2026-02-13T20:27:21.863 INFO:tasks.rados.rados.0.trial188.stdout:3608: finishing write tid 3 to trial18843701-1 2026-02-13T20:27:21.863 INFO:tasks.rados.rados.0.trial188.stdout:3611: finishing write tid 2 to trial18843701-35 2026-02-13T20:27:21.863 INFO:tasks.rados.rados.0.trial188.stdout:3607: finishing write tid 4 to trial18843701-37 2026-02-13T20:27:21.863 INFO:tasks.rados.rados.0.trial188.stdout:3607: oid 37 updating version 0 to 1756 2026-02-13T20:27:21.863 INFO:tasks.rados.rados.0.trial188.stdout:3607: oid 37 version 1756 is already newer than 1755 2026-02-13T20:27:21.864 INFO:tasks.rados.rados.0.trial188.stdout:3607: oid 37 version 1756 is already newer than 1754 2026-02-13T20:27:21.864 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 37 v 1756 (ObjNum 1254 snap 378 seq_num 1254) dirty exists 2026-02-13T20:27:21.864 INFO:tasks.rados.rados.0.trial188.stdout:3607: left oid 37 (ObjNum 1254 snap 378 seq_num 1254) 2026-02-13T20:27:21.864 INFO:tasks.rados.rados.0.trial188.stdout:3610: finishing copy_from to trial18843701-7 2026-02-13T20:27:21.864 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 7 v 1112 (ObjNum 1238 snap 375 seq_num 1238) dirty exists 2026-02-13T20:27:21.864 INFO:tasks.rados.rados.0.trial188.stdout:3608: finishing write tid 4 to trial18843701-1 2026-02-13T20:27:21.864 INFO:tasks.rados.rados.0.trial188.stdout:3611: finishing write tid 3 to trial18843701-35 2026-02-13T20:27:21.864 INFO:tasks.rados.rados.0.trial188.stdout:3611: finishing write tid 4 to trial18843701-35 2026-02-13T20:27:21.864 INFO:tasks.rados.rados.0.trial188.stdout:3608: finishing write tid 5 to trial18843701-1 2026-02-13T20:27:21.864 INFO:tasks.rados.rados.0.trial188.stdout:3608: oid 1 updating version 0 to 1739 2026-02-13T20:27:21.864 INFO:tasks.rados.rados.0.trial188.stdout:3608: oid 1 updating version 1739 to 1742 2026-02-13T20:27:21.864 INFO:tasks.rados.rados.0.trial188.stdout:3608: oid 1 version 1742 is already newer than 1740 2026-02-13T20:27:21.865 INFO:tasks.rados.rados.0.trial188.stdout:3608: oid 1 version 1742 is already newer than 1741 2026-02-13T20:27:21.865 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 1 v 1742 (ObjNum 1255 snap 378 seq_num 1255) dirty exists 2026-02-13T20:27:21.865 INFO:tasks.rados.rados.0.trial188.stdout:3608: left oid 1 (ObjNum 1255 snap 378 seq_num 1255) 2026-02-13T20:27:21.865 INFO:tasks.rados.rados.0.trial188.stdout:3611: finishing write tid 5 to trial18843701-35 2026-02-13T20:27:21.865 INFO:tasks.rados.rados.0.trial188.stdout:3611: oid 35 updating version 0 to 1544 2026-02-13T20:27:21.865 INFO:tasks.rados.rados.0.trial188.stdout:3611: oid 35 updating version 1544 to 1545 2026-02-13T20:27:21.865 INFO:tasks.rados.rados.0.trial188.stdout:3611: oid 35 updating version 1545 to 1546 2026-02-13T20:27:21.865 INFO:tasks.rados.rados.0.trial188.stdout:3611: oid 35 updating version 1546 to 1547 2026-02-13T20:27:21.865 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 35 v 1547 (ObjNum 1256 snap 378 seq_num 1256) dirty exists 2026-02-13T20:27:21.865 INFO:tasks.rados.rados.0.trial188.stdout:3611: left oid 35 (ObjNum 1256 snap 378 seq_num 1256) 2026-02-13T20:27:21.865 INFO:tasks.rados.rados.0.trial188.stdout:3609: finishing copy_from to trial18843701-45 2026-02-13T20:27:21.865 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 45 v 1116 (ObjNum 1239 snap 375 seq_num 1239) dirty exists 2026-02-13T20:27:21.866 INFO:tasks.rados.rados.0.trial188.stdout:3615: expect (ObjNum 1221 snap 370 seq_num 1221) 2026-02-13T20:27:21.866 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:27:21.891 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:27:21.910 INFO:tasks.rados.rados.0.trial188.stdout:3614: finishing write tid 1 to trial18843701-46 2026-02-13T20:27:21.910 INFO:tasks.rados.rados.0.trial188.stdout:3614: finishing write tid 2 to trial18843701-46 2026-02-13T20:27:21.910 INFO:tasks.rados.rados.0.trial188.stdout:3614: finishing write tid 3 to trial18843701-46 2026-02-13T20:27:21.911 INFO:tasks.rados.rados.0.trial188.stdout:3614: finishing write tid 4 to trial18843701-46 2026-02-13T20:27:21.911 INFO:tasks.rados.rados.0.trial188.stdout:3614: oid 46 updating version 0 to 1723 2026-02-13T20:27:21.911 INFO:tasks.rados.rados.0.trial188.stdout:3614: oid 46 version 1723 is already newer than 1722 2026-02-13T20:27:21.911 INFO:tasks.rados.rados.0.trial188.stdout:3614: oid 46 updating version 1723 to 1724 2026-02-13T20:27:21.911 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 46 v 1724 (ObjNum 1257 snap 378 seq_num 1257) dirty exists 2026-02-13T20:27:21.911 INFO:tasks.rados.rados.0.trial188.stdout:3614: left oid 46 (ObjNum 1257 snap 378 seq_num 1257) 2026-02-13T20:27:21.911 INFO:tasks.rados.rados.0.trial188.stdout:3616: finishing write tid 1 to trial18843701-14 2026-02-13T20:27:21.911 INFO:tasks.rados.rados.0.trial188.stdout:3616: finishing write tid 2 to trial18843701-14 2026-02-13T20:27:21.911 INFO:tasks.rados.rados.0.trial188.stdout:3616: finishing write tid 3 to trial18843701-14 2026-02-13T20:27:21.911 INFO:tasks.rados.rados.0.trial188.stdout:3616: finishing write tid 4 to trial18843701-14 2026-02-13T20:27:21.911 INFO:tasks.rados.rados.0.trial188.stdout:3616: oid 14 updating version 0 to 1537 2026-02-13T20:27:21.912 INFO:tasks.rados.rados.0.trial188.stdout:3616: oid 14 updating version 1537 to 1539 2026-02-13T20:27:21.912 INFO:tasks.rados.rados.0.trial188.stdout:3616: oid 14 version 1539 is already newer than 1538 2026-02-13T20:27:21.912 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 14 v 1539 (ObjNum 1258 snap 378 seq_num 1258) dirty exists 2026-02-13T20:27:21.912 INFO:tasks.rados.rados.0.trial188.stdout:3616: left oid 14 (ObjNum 1258 snap 378 seq_num 1258) 2026-02-13T20:27:22.461 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-13T20:27:22.461 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T20:27:22.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.528+0000 7feb16212640 10 monclient: get_monmap_and_config 2026-02-13T20:27:22.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.528+0000 7feb16212640 10 monclient: build_initial_monmap 2026-02-13T20:27:22.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.528+0000 7feb16212640 10 monclient: monmap: 2026-02-13T20:27:22.535 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:27:22.535 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:22.535 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:27:22.529228+0000 2026-02-13T20:27:22.535 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:27:22.529228+0000 2026-02-13T20:27:22.535 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:27:22.536 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:22.536 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:27:22.536 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:27:22.536 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:27:22.536 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:22.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.529+0000 7feb16212640 1 Processor -- start 2026-02-13T20:27:22.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.529+0000 7feb16212640 1 -- start start 2026-02-13T20:27:22.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.529+0000 7feb16212640 10 monclient: init 2026-02-13T20:27:22.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.529+0000 7feb16212640 10 monclient: _reopen_session rank -1 2026-02-13T20:27:22.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.529+0000 7feb16212640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:27:22.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.529+0000 7feb16212640 10 monclient(hunting): picked mon.noname-b con 0x7feb101401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:27:22.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.529+0000 7feb16212640 10 monclient(hunting): picked mon.noname-c con 0x7feb10092020 addr v1:10.20.193.188:6789/0 2026-02-13T20:27:22.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.529+0000 7feb16212640 10 monclient(hunting): picked mon.noname-a con 0x7feb10091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:27:22.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.529+0000 7feb16212640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb1008b730 con 0x7feb10091950 2026-02-13T20:27:22.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.529+0000 7feb16212640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb1005c5b0 con 0x7feb10092020 2026-02-13T20:27:22.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.529+0000 7feb16212640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb1008bcf0 con 0x7feb101401c0 2026-02-13T20:27:22.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.529+0000 7feb16212640 10 monclient(hunting): _renew_subs 2026-02-13T20:27:22.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.529+0000 7feb16212640 10 monclient(hunting): authenticate will time out at 1604.219549s 2026-02-13T20:27:22.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.529+0000 7feb0f7fe640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7feb101401c0 0x7feb10091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:57846/0 (socket says 10.20.193.110:57846) 2026-02-13T20:27:22.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.529+0000 7feb0f7fe640 1 -- 10.20.193.110:0/3663566946 learned_addr learned my addr 10.20.193.110:0/3663566946 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:27:22.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.529+0000 7feb0e7fc640 1 -- 10.20.193.110:0/3663566946 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2855671245 0 0) 0x7feb1008bcf0 con 0x7feb101401c0 2026-02-13T20:27:22.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.529+0000 7feb0e7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:27:22.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.529+0000 7feb0e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:22.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.529+0000 7feb0e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:22.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.529+0000 7feb0e7fc640 10 monclient(hunting): my global_id is 154130 2026-02-13T20:27:22.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.529+0000 7feb0e7fc640 1 -- 10.20.193.110:0/3663566946 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feaf40035e0 con 0x7feb101401c0 2026-02-13T20:27:22.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.529+0000 7feb0e7fc640 1 -- 10.20.193.110:0/3663566946 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4193740944 0 0) 0x7feb1008b730 con 0x7feb10091950 2026-02-13T20:27:22.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.529+0000 7feb0e7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:27:22.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.529+0000 7feb0e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:22.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.529+0000 7feb0e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:22.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.529+0000 7feb0e7fc640 10 monclient(hunting): my global_id is 124422 2026-02-13T20:27:22.538 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.529+0000 7feb0e7fc640 1 -- 10.20.193.110:0/3663566946 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb1008bcf0 con 0x7feb10091950 2026-02-13T20:27:22.538 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.529+0000 7feb0e7fc640 1 -- 10.20.193.110:0/3663566946 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 370941719 0 0) 0x7feb1008bcf0 con 0x7feb10091950 2026-02-13T20:27:22.538 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.530+0000 7feb0e7fc640 1 -- 10.20.193.110:0/3663566946 >> v1:10.20.193.110:6790/0 conn(0x7feb101401c0 legacy=0x7feb10091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:22.538 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.530+0000 7feb0e7fc640 1 -- 10.20.193.110:0/3663566946 >> v1:10.20.193.188:6789/0 conn(0x7feb10092020 legacy=0x7feb101812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T20:27:22.538 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.530+0000 7feb0e7fc640 10 monclient: _finish_hunting 0 2026-02-13T20:27:22.538 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.530+0000 7feb0e7fc640 1 monclient: found mon.noname-a 2026-02-13T20:27:22.538 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.530+0000 7feb0e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:27:22.538 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.530+0000 7feb0e7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:27:22.538 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.530+0000 7feb0e7fc640 1 -- 10.20.193.110:0/3663566946 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb10140590 con 0x7feb10091950 2026-02-13T20:27:22.538 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.530+0000 7feb0e7fc640 10 monclient: _finish_auth 0 2026-02-13T20:27:22.538 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.530+0000 7feb0e7fc640 10 monclient: _check_auth_tickets 2026-02-13T20:27:22.538 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.530+0000 7feb0e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:27:22.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.530+0000 7feb0e7fc640 1 -- 10.20.193.110:0/3663566946 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7feb04003eb0 con 0x7feb10091950 2026-02-13T20:27:22.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.530+0000 7feb0e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:22.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.530+0000 7feb0e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:27:22.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.530+0000 7feb0e7fc640 10 monclient: dump: 2026-02-13T20:27:22.539 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:22.539 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:22.539 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:22.539 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:22.539 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:22.539 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:22.539 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:22.539 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:22.540 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:22.540 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:22.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.530+0000 7feb16212640 5 monclient: authenticate success, global_id 124422 2026-02-13T20:27:22.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.530+0000 7feb16212640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:27:22.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.530+0000 7feb0e7fc640 1 -- 10.20.193.110:0/3663566946 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feb04004100 con 0x7feb10091950 2026-02-13T20:27:22.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.530+0000 7feb0e7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:27:22.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.530+0000 7feb0e7fc640 1 -- 10.20.193.110:0/3663566946 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7feb04004510 con 0x7feb10091950 2026-02-13T20:27:22.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.530+0000 7feb0e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:22.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.530+0000 7feb0e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:27:22.540 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.530+0000 7feb0e7fc640 10 monclient: dump: 2026-02-13T20:27:22.540 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:22.540 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:22.541 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:22.541 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:22.541 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:22.541 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:22.541 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:22.541 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:22.541 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:22.541 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:22.541 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.530+0000 7feb16212640 10 monclient: get_monmap_and_config success 2026-02-13T20:27:22.541 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.530+0000 7feb16212640 4 set_mon_vals no callback set 2026-02-13T20:27:22.541 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.530+0000 7feb16212640 10 monclient: shutdown 2026-02-13T20:27:22.541 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.530+0000 7feb16212640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:27:22.541 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.530+0000 7feb16212640 1 -- 10.20.193.110:0/3663566946 >> v1:10.20.193.110:6789/0 conn(0x7feb10091950 legacy=0x7feb101a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:22.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.530+0000 7feb16212640 1 -- 10.20.193.110:0/3663566946 shutdown_connections 2026-02-13T20:27:22.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.530+0000 7feb16212640 1 -- 10.20.193.110:0/3663566946 >> 10.20.193.110:0/3663566946 conn(0x7feb10054e90 msgr2=0x7feb10058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:27:22.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.530+0000 7feb16212640 1 -- 10.20.193.110:0/3663566946 shutdown_connections 2026-02-13T20:27:22.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.530+0000 7feb16212640 1 -- 10.20.193.110:0/3663566946 wait complete. 2026-02-13T20:27:22.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.530+0000 7feb16212640 10 monclient: build_initial_monmap 2026-02-13T20:27:22.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.530+0000 7feb16212640 10 monclient: monmap: 2026-02-13T20:27:22.542 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:27:22.542 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:27:22.542 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:27:22.542 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:27:22.542 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:27:22.542 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:27:22.543 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:27:22.543 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:27:22.543 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:27:22.543 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:22.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.530+0000 7feb16212640 1 Processor -- start 2026-02-13T20:27:22.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.530+0000 7feb16212640 1 -- start start 2026-02-13T20:27:22.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.530+0000 7feb16212640 10 monclient: init 2026-02-13T20:27:22.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feb16212640 10 monclient: _reopen_session rank -1 2026-02-13T20:27:22.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feb16212640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:27:22.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feb16212640 10 monclient(hunting): picked mon.noname-b con 0x7feb10091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:27:22.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feb16212640 10 monclient(hunting): picked mon.noname-c con 0x7feb101401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:27:22.543 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feb16212640 10 monclient(hunting): picked mon.noname-a con 0x7feb10114230 addr v1:10.20.193.110:6789/0 2026-02-13T20:27:22.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feb16212640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb1008c230 con 0x7feb10114230 2026-02-13T20:27:22.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feb16212640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb1005d320 con 0x7feb10091950 2026-02-13T20:27:22.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feb16212640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb10114f60 con 0x7feb101401c0 2026-02-13T20:27:22.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feb16212640 10 monclient(hunting): _renew_subs 2026-02-13T20:27:22.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feb16212640 10 monclient(hunting): authenticate will time out at 1604.221214s 2026-02-13T20:27:22.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feb0ffff640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7feb10114230 0x7feb101a2740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:57856/0 (socket says 10.20.193.110:57856) 2026-02-13T20:27:22.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feb0effd640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7feb101401c0 0x7feb101a1020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:57852/0 (socket says 10.20.193.110:57852) 2026-02-13T20:27:22.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feb0ffff640 1 -- 10.20.193.110:0/79305253 learned_addr learned my addr 10.20.193.110:0/79305253 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:27:22.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feaebfff640 1 -- 10.20.193.110:0/79305253 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3317303083 0 0) 0x7feb10114f60 con 0x7feb101401c0 2026-02-13T20:27:22.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feaebfff640 10 monclient(hunting): _negotiate 2026-02-13T20:27:22.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feaebfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:22.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feaebfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:22.544 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feaebfff640 10 monclient(hunting): my global_id is 154133 2026-02-13T20:27:22.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feaebfff640 1 -- 10.20.193.110:0/79305253 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feae00035e0 con 0x7feb101401c0 2026-02-13T20:27:22.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feaebfff640 1 -- 10.20.193.110:0/79305253 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 170228459 0 0) 0x7feb10140590 con 0x7feb10114230 2026-02-13T20:27:22.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feaebfff640 10 monclient(hunting): _negotiate 2026-02-13T20:27:22.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feaebfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:22.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feaebfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:22.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feaebfff640 10 monclient(hunting): my global_id is 124425 2026-02-13T20:27:22.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feaebfff640 1 -- 10.20.193.110:0/79305253 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb10114f60 con 0x7feb10114230 2026-02-13T20:27:22.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feaebfff640 1 -- 10.20.193.110:0/79305253 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1016271303 0 0) 0x7feae00035e0 con 0x7feb101401c0 2026-02-13T20:27:22.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feaebfff640 1 -- 10.20.193.110:0/79305253 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feb10140590 con 0x7feb101401c0 2026-02-13T20:27:22.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feaebfff640 1 -- 10.20.193.110:0/79305253 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7feb00003ff0 con 0x7feb101401c0 2026-02-13T20:27:22.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feaebfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:27:22.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feaebfff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:27:22.545 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feaebfff640 10 monclient(hunting): dump: 2026-02-13T20:27:22.546 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:22.546 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:22.546 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:22.546 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:22.546 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:22.546 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:22.546 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:22.546 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:22.546 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:22.546 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:22.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feaebfff640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:27:22.546 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feaebfff640 1 -- 10.20.193.110:0/79305253 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 660473048 0 0) 0x7feb10114f60 con 0x7feb10114230 2026-02-13T20:27:22.547 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feaebfff640 1 -- 10.20.193.110:0/79305253 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feae00035e0 con 0x7feb10114230 2026-02-13T20:27:22.547 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feaebfff640 1 -- 10.20.193.110:0/79305253 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7feb04004420 con 0x7feb10114230 2026-02-13T20:27:22.547 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feaebfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:27:22.547 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feaebfff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:27:22.547 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feaebfff640 10 monclient(hunting): dump: 2026-02-13T20:27:22.547 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:22.547 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:22.547 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:22.547 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:22.547 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:22.547 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:22.547 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:22.547 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:22.548 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:22.548 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:22.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feaebfff640 1 -- 10.20.193.110:0/79305253 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3727660203 0 0) 0x7feb1005d320 con 0x7feb10091950 2026-02-13T20:27:22.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feaebfff640 10 monclient(hunting): _negotiate 2026-02-13T20:27:22.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feaebfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:22.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feaebfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:22.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feaebfff640 10 monclient(hunting): my global_id is 144211 2026-02-13T20:27:22.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feaebfff640 1 -- 10.20.193.110:0/79305253 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb10114f60 con 0x7feb10091950 2026-02-13T20:27:22.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feaebfff640 1 -- 10.20.193.110:0/79305253 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 690255514 0 0) 0x7feb10140590 con 0x7feb101401c0 2026-02-13T20:27:22.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feaebfff640 1 -- 10.20.193.110:0/79305253 >> v1:10.20.193.188:6789/0 conn(0x7feb10091950 legacy=0x7feb10114850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:22.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feaebfff640 1 -- 10.20.193.110:0/79305253 >> v1:10.20.193.110:6789/0 conn(0x7feb10114230 legacy=0x7feb101a2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:22.548 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feaebfff640 10 monclient: _finish_hunting 0 2026-02-13T20:27:22.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feaebfff640 1 monclient: found mon.c 2026-02-13T20:27:22.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feaebfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:27:22.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feaebfff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:27:22.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feaebfff640 1 -- 10.20.193.110:0/79305253 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb1012d2a0 con 0x7feb101401c0 2026-02-13T20:27:22.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feaebfff640 10 monclient: _finish_auth 0 2026-02-13T20:27:22.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feaebfff640 10 monclient: _check_auth_tickets 2026-02-13T20:27:22.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feaebfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:27:22.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feb16212640 5 monclient: authenticate success, global_id 154133 2026-02-13T20:27:22.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feb16212640 10 monclient: _renew_subs 2026-02-13T20:27:22.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feb16212640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:27:22.549 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feb16212640 1 -- 10.20.193.110:0/79305253 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7feb1012c0c0 con 0x7feb101401c0 2026-02-13T20:27:22.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feb16212640 10 monclient: _renew_subs 2026-02-13T20:27:22.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feb16212640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:27:22.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feb16212640 1 -- 10.20.193.110:0/79305253 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7feb1012ba50 con 0x7feb101401c0 2026-02-13T20:27:22.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feaebfff640 1 -- 10.20.193.110:0/79305253 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feb000041c0 con 0x7feb101401c0 2026-02-13T20:27:22.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feaebfff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:27:22.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feaebfff640 1 -- 10.20.193.110:0/79305253 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7feb000028d0 con 0x7feb101401c0 2026-02-13T20:27:22.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feaebfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:22.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feaebfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:27:22.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feb0dffb640 4 set_mon_vals no callback set 2026-02-13T20:27:22.550 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.531+0000 7feaebfff640 10 monclient: dump: 2026-02-13T20:27:22.550 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:22.550 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:22.550 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:22.551 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:22.551 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:22.551 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:22.551 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:22.551 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:22.551 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:22.551 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:22.551 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.532+0000 7feb16212640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:27:22.551 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.532+0000 7feb16212640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:27:22.551 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.532+0000 7feb16212640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:27:22.551 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.532+0000 7feb16212640 1 -- 10.20.193.110:0/79305253 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb1012aef0 con 0x7feb101401c0 2026-02-13T20:27:22.551 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.532+0000 7feaebfff640 1 -- 10.20.193.110:0/79305253 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7feb00002a30 con 0x7feb101401c0 2026-02-13T20:27:22.551 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.532+0000 7feaebfff640 1 -- 10.20.193.110:0/79305253 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(772..772 src has 1..772) ==== 3975+0+0 (unknown 1214345307 0 0) 0x7feb0004e6d0 con 0x7feb101401c0 2026-02-13T20:27:22.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.532+0000 7feb0f7fe640 10 monclient: get_auth_request con 0x7feae003fc70 auth_method 0 2026-02-13T20:27:22.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.534+0000 7feaebfff640 1 -- 10.20.193.110:0/79305253 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7feb00016de0 con 0x7feb101401c0 2026-02-13T20:27:22.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.534+0000 7feaebfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:27:22.552 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.534+0000 7feaebfff640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:27:22.686 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.686+0000 7feb16212640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T20:27:22.686 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.686+0000 7feb16212640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T20:27:22.686 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.686+0000 7feb16212640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:27:22.686 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.686+0000 7feb16212640 1 -- 10.20.193.110:0/79305253 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7feb1012ced0 con 0x7feb101401c0 2026-02-13T20:27:22.686 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.686+0000 7feaebfff640 1 -- 10.20.193.110:0/79305253 <== mon.2 v1:10.20.193.110:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 2987198552) 0x7feb00016590 con 0x7feb101401c0 2026-02-13T20:27:22.686 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.686+0000 7feaebfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T20:27:22.686 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.686+0000 7feaebfff640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:27:22.686 INFO:teuthology.orchestra.run.trial110.stdout:{"election_epoch":58,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","modified":"2026-02-13T20:11:07.161192Z","created":"2026-02-13T20:11:07.161192Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6789","nonce":0}]},"addr":"10.20.193.110:6789/0","public_addr":"10.20.193.110:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161241+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6789","nonce":0}]},"addr":"10.20.193.188:6789/0","public_addr":"10.20.193.188:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161242+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6790","nonce":0}]},"addr":"10.20.193.110:6790/0","public_addr":"10.20.193.110:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161243+0000","crush_location":[]}]}} 2026-02-13T20:27:22.687 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.687+0000 7feb16212640 1 -- 10.20.193.110:0/79305253 >> v1:10.20.193.188:6812/1623052694 conn(0x7feae003fc70 legacy=0x7feae0060120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:22.687 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.687+0000 7feb16212640 10 monclient: shutdown 2026-02-13T20:27:22.687 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.687+0000 7feb16212640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:27:22.687 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.687+0000 7feb16212640 1 -- 10.20.193.110:0/79305253 >> v1:10.20.193.110:6790/0 conn(0x7feb101401c0 legacy=0x7feb101a1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:22.687 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.687+0000 7feb16212640 1 -- 10.20.193.110:0/79305253 shutdown_connections 2026-02-13T20:27:22.687 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.687+0000 7feb16212640 1 -- 10.20.193.110:0/79305253 >> 10.20.193.110:0/79305253 conn(0x7feb10054e90 msgr2=0x7feb1008dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:27:22.687 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.687+0000 7feb16212640 1 -- 10.20.193.110:0/79305253 shutdown_connections 2026-02-13T20:27:22.687 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.687+0000 7feb16212640 1 -- 10.20.193.110:0/79305253 wait complete. 2026-02-13T20:27:22.694 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-13T20:27:22.694 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-13T20:27:22.694 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-13T20:27:22.694 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T20:27:22.748 INFO:tasks.rados.rados.0.trial188.stdout:3607: done (9 left) 2026-02-13T20:27:22.748 INFO:tasks.rados.rados.0.trial188.stdout:3608: done (8 left) 2026-02-13T20:27:22.748 INFO:tasks.rados.rados.0.trial188.stdout:3609: done (7 left) 2026-02-13T20:27:22.748 INFO:tasks.rados.rados.0.trial188.stdout:3610: done (6 left) 2026-02-13T20:27:22.748 INFO:tasks.rados.rados.0.trial188.stdout:3611: done (5 left) 2026-02-13T20:27:22.748 INFO:tasks.rados.rados.0.trial188.stdout:3612: done (4 left) 2026-02-13T20:27:22.748 INFO:tasks.rados.rados.0.trial188.stdout:3614: done (3 left) 2026-02-13T20:27:22.748 INFO:tasks.rados.rados.0.trial188.stdout:3615: done (2 left) 2026-02-13T20:27:22.749 INFO:tasks.rados.rados.0.trial188.stdout:3616: done (1 left) 2026-02-13T20:27:22.749 INFO:tasks.rados.rados.0.trial188.stdout:3617: done (0 left) 2026-02-13T20:27:22.749 INFO:tasks.rados.rados.0.trial188.stdout:3618: delete oid 2 current snap is 379 2026-02-13T20:27:22.750 INFO:tasks.rados.rados.0.trial188.stdout:3618: done (0 left) 2026-02-13T20:27:22.750 INFO:tasks.rados.rados.0.trial188.stdout:3619: snap_create 2026-02-13T20:27:22.762 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.761+0000 7fd59114c640 10 monclient: get_monmap_and_config 2026-02-13T20:27:22.762 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.761+0000 7fd59114c640 10 monclient: build_initial_monmap 2026-02-13T20:27:22.762 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.761+0000 7fd59114c640 10 monclient: monmap: 2026-02-13T20:27:22.762 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:27:22.762 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:22.762 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:27:22.762112+0000 2026-02-13T20:27:22.762 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:27:22.762112+0000 2026-02-13T20:27:22.762 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:27:22.762 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:22.762 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:27:22.763 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:27:22.763 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:27:22.763 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:22.772 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.762+0000 7fd59114c640 1 Processor -- start 2026-02-13T20:27:22.773 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.762+0000 7fd59114c640 1 -- start start 2026-02-13T20:27:22.773 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.762+0000 7fd59114c640 10 monclient: init 2026-02-13T20:27:22.773 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.762+0000 7fd59114c640 10 monclient: _reopen_session rank -1 2026-02-13T20:27:22.773 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.762+0000 7fd59114c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:27:22.773 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.762+0000 7fd59114c640 10 monclient(hunting): picked mon.noname-a con 0x7fd58c1401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:27:22.773 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.762+0000 7fd59114c640 10 monclient(hunting): picked mon.noname-c con 0x7fd58c092020 addr v1:10.20.193.188:6789/0 2026-02-13T20:27:22.773 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.762+0000 7fd59114c640 10 monclient(hunting): picked mon.noname-b con 0x7fd58c091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:27:22.773 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.762+0000 7fd59114c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd58c08b730 con 0x7fd58c1401c0 2026-02-13T20:27:22.773 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.762+0000 7fd59114c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd58c05c5b0 con 0x7fd58c092020 2026-02-13T20:27:22.773 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.762+0000 7fd59114c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd58c08bcf0 con 0x7fd58c091950 2026-02-13T20:27:22.773 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.762+0000 7fd59114c640 10 monclient(hunting): _renew_subs 2026-02-13T20:27:22.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.762+0000 7fd59114c640 10 monclient(hunting): authenticate will time out at 1604.452645s 2026-02-13T20:27:22.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.762+0000 7fd58ad76640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fd58c1401c0 0x7fd58c091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:57864/0 (socket says 10.20.193.110:57864) 2026-02-13T20:27:22.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.762+0000 7fd58ad76640 1 -- 10.20.193.110:0/167727523 learned_addr learned my addr 10.20.193.110:0/167727523 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:27:22.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.762+0000 7fd589d74640 1 -- 10.20.193.110:0/167727523 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3260266647 0 0) 0x7fd58c08b730 con 0x7fd58c1401c0 2026-02-13T20:27:22.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.762+0000 7fd589d74640 10 monclient(hunting): _negotiate 2026-02-13T20:27:22.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.762+0000 7fd589d74640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:22.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.762+0000 7fd589d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:22.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.762+0000 7fd589d74640 10 monclient(hunting): my global_id is 124428 2026-02-13T20:27:22.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.762+0000 7fd589d74640 1 -- 10.20.193.110:0/167727523 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5780035e0 con 0x7fd58c1401c0 2026-02-13T20:27:22.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.762+0000 7fd589d74640 1 -- 10.20.193.110:0/167727523 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1353535570 0 0) 0x7fd58c08bcf0 con 0x7fd58c091950 2026-02-13T20:27:22.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.762+0000 7fd589d74640 10 monclient(hunting): _negotiate 2026-02-13T20:27:22.775 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.762+0000 7fd589d74640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:22.775 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.762+0000 7fd589d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:22.775 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.762+0000 7fd589d74640 10 monclient(hunting): my global_id is 154136 2026-02-13T20:27:22.775 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.762+0000 7fd589d74640 1 -- 10.20.193.110:0/167727523 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd58c08b730 con 0x7fd58c091950 2026-02-13T20:27:22.775 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.763+0000 7fd589d74640 1 -- 10.20.193.110:0/167727523 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4229284065 0 0) 0x7fd5780035e0 con 0x7fd58c1401c0 2026-02-13T20:27:22.775 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.763+0000 7fd589d74640 1 -- 10.20.193.110:0/167727523 >> v1:10.20.193.110:6790/0 conn(0x7fd58c091950 legacy=0x7fd58c1a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:22.775 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.763+0000 7fd589d74640 1 -- 10.20.193.110:0/167727523 >> v1:10.20.193.188:6789/0 conn(0x7fd58c092020 legacy=0x7fd58c1812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:22.775 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.763+0000 7fd589d74640 10 monclient: _finish_hunting 0 2026-02-13T20:27:22.775 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.763+0000 7fd589d74640 1 monclient: found mon.noname-a 2026-02-13T20:27:22.775 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.763+0000 7fd589d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:27:22.775 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.763+0000 7fd589d74640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:27:22.775 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.763+0000 7fd589d74640 1 -- 10.20.193.110:0/167727523 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd58c140590 con 0x7fd58c1401c0 2026-02-13T20:27:22.776 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.763+0000 7fd589d74640 10 monclient: _finish_auth 0 2026-02-13T20:27:22.776 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.763+0000 7fd589d74640 10 monclient: _check_auth_tickets 2026-02-13T20:27:22.776 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.763+0000 7fd589d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:27:22.776 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.763+0000 7fd59114c640 5 monclient: authenticate success, global_id 124428 2026-02-13T20:27:22.776 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.763+0000 7fd589d74640 1 -- 10.20.193.110:0/167727523 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fd580002dd0 con 0x7fd58c1401c0 2026-02-13T20:27:22.776 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.763+0000 7fd59114c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:27:22.776 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.763+0000 7fd589d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:22.776 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.763+0000 7fd589d74640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:27:22.776 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.763+0000 7fd589d74640 10 monclient: dump: 2026-02-13T20:27:22.776 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:22.776 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:22.776 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:22.777 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:22.777 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:22.777 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:22.777 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:22.777 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:22.777 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:22.777 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:22.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.763+0000 7fd59114c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:27:22.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.763+0000 7fd589d74640 1 -- 10.20.193.110:0/167727523 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd580002f60 con 0x7fd58c1401c0 2026-02-13T20:27:22.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.763+0000 7fd589d74640 10 monclient: handle_config config(0 keys) 2026-02-13T20:27:22.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.763+0000 7fd589d74640 1 -- 10.20.193.110:0/167727523 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fd580003370 con 0x7fd58c1401c0 2026-02-13T20:27:22.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.763+0000 7fd59114c640 10 monclient: get_monmap_and_config success 2026-02-13T20:27:22.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.763+0000 7fd59114c640 4 set_mon_vals no callback set 2026-02-13T20:27:22.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.763+0000 7fd589d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:22.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.763+0000 7fd589d74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:27:22.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.763+0000 7fd589d74640 10 monclient: dump: 2026-02-13T20:27:22.778 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:22.778 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:22.778 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:22.778 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:22.778 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:22.778 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:22.778 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:22.778 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:22.778 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:22.779 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:22.779 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.763+0000 7fd59114c640 10 monclient: shutdown 2026-02-13T20:27:22.779 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.763+0000 7fd59114c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:27:22.779 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.763+0000 7fd59114c640 1 -- 10.20.193.110:0/167727523 >> v1:10.20.193.110:6789/0 conn(0x7fd58c1401c0 legacy=0x7fd58c091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:22.779 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.763+0000 7fd59114c640 1 -- 10.20.193.110:0/167727523 shutdown_connections 2026-02-13T20:27:22.779 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.763+0000 7fd59114c640 1 -- 10.20.193.110:0/167727523 >> 10.20.193.110:0/167727523 conn(0x7fd58c054e90 msgr2=0x7fd58c058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:27:22.779 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.763+0000 7fd59114c640 1 -- 10.20.193.110:0/167727523 shutdown_connections 2026-02-13T20:27:22.779 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.763+0000 7fd59114c640 1 -- 10.20.193.110:0/167727523 wait complete. 2026-02-13T20:27:22.779 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.763+0000 7fd59114c640 10 monclient: build_initial_monmap 2026-02-13T20:27:22.779 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.763+0000 7fd59114c640 10 monclient: monmap: 2026-02-13T20:27:22.779 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:27:22.779 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:27:22.780 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:27:22.780 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:27:22.780 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:27:22.780 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:27:22.780 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:27:22.780 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:27:22.780 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:27:22.780 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:22.780 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.764+0000 7fd59114c640 1 Processor -- start 2026-02-13T20:27:22.780 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.764+0000 7fd59114c640 1 -- start start 2026-02-13T20:27:22.780 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.764+0000 7fd59114c640 10 monclient: init 2026-02-13T20:27:22.780 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.764+0000 7fd59114c640 10 monclient: _reopen_session rank -1 2026-02-13T20:27:22.781 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.764+0000 7fd59114c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:27:22.781 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.764+0000 7fd59114c640 10 monclient(hunting): picked mon.noname-a con 0x7fd58c091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:27:22.781 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.764+0000 7fd59114c640 10 monclient(hunting): picked mon.noname-c con 0x7fd58c1401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:27:22.781 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.764+0000 7fd59114c640 10 monclient(hunting): picked mon.noname-b con 0x7fd58c13dc20 addr v1:10.20.193.188:6789/0 2026-02-13T20:27:22.781 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.764+0000 7fd59114c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd58c130f30 con 0x7fd58c091950 2026-02-13T20:27:22.781 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.764+0000 7fd59114c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd58c08ae00 con 0x7fd58c13dc20 2026-02-13T20:27:22.781 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.764+0000 7fd59114c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd58c05d320 con 0x7fd58c1401c0 2026-02-13T20:27:22.781 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.764+0000 7fd59114c640 10 monclient(hunting): _renew_subs 2026-02-13T20:27:22.781 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.764+0000 7fd59114c640 10 monclient(hunting): authenticate will time out at 1604.454467s 2026-02-13T20:27:22.781 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.764+0000 7fd58a575640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fd58c1401c0 0x7fd58c193920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:57868/0 (socket says 10.20.193.110:57868) 2026-02-13T20:27:22.781 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.764+0000 7fd58a575640 1 -- 10.20.193.110:0/3320394563 learned_addr learned my addr 10.20.193.110:0/3320394563 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:27:22.781 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.764+0000 7fd56b7fe640 1 -- 10.20.193.110:0/3320394563 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2897323016 0 0) 0x7fd58c05d320 con 0x7fd58c1401c0 2026-02-13T20:27:22.781 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.764+0000 7fd56b7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:27:22.782 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.764+0000 7fd56b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:22.782 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.764+0000 7fd56b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:22.782 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.764+0000 7fd56b7fe640 10 monclient(hunting): my global_id is 154139 2026-02-13T20:27:22.782 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.764+0000 7fd56b7fe640 1 -- 10.20.193.110:0/3320394563 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5580035e0 con 0x7fd58c1401c0 2026-02-13T20:27:22.782 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.764+0000 7fd56b7fe640 1 -- 10.20.193.110:0/3320394563 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 792818537 0 0) 0x7fd58c130f30 con 0x7fd58c091950 2026-02-13T20:27:22.782 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.764+0000 7fd56b7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:27:22.782 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.764+0000 7fd56b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:22.782 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.764+0000 7fd56b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:22.782 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.764+0000 7fd56b7fe640 10 monclient(hunting): my global_id is 124431 2026-02-13T20:27:22.782 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.764+0000 7fd56b7fe640 1 -- 10.20.193.110:0/3320394563 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd58c05d320 con 0x7fd58c091950 2026-02-13T20:27:22.782 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.764+0000 7fd56b7fe640 1 -- 10.20.193.110:0/3320394563 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2900087029 0 0) 0x7fd5580035e0 con 0x7fd58c1401c0 2026-02-13T20:27:22.782 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.764+0000 7fd56b7fe640 1 -- 10.20.193.110:0/3320394563 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd58c130f30 con 0x7fd58c1401c0 2026-02-13T20:27:22.783 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.764+0000 7fd56b7fe640 1 -- 10.20.193.110:0/3320394563 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fd574003170 con 0x7fd58c1401c0 2026-02-13T20:27:22.783 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.764+0000 7fd56b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:27:22.783 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.764+0000 7fd56b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:27:22.783 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.764+0000 7fd56b7fe640 10 monclient(hunting): dump: 2026-02-13T20:27:22.783 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:22.783 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:22.783 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:22.783 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:22.783 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:22.783 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:22.783 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:22.783 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:22.784 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:22.784 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:22.784 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.764+0000 7fd56b7fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:27:22.784 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.764+0000 7fd56b7fe640 1 -- 10.20.193.110:0/3320394563 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1230388829 0 0) 0x7fd58c05d320 con 0x7fd58c091950 2026-02-13T20:27:22.784 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.764+0000 7fd56b7fe640 1 -- 10.20.193.110:0/3320394563 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd5580035e0 con 0x7fd58c091950 2026-02-13T20:27:22.784 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.764+0000 7fd56b7fe640 1 -- 10.20.193.110:0/3320394563 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fd5800030d0 con 0x7fd58c091950 2026-02-13T20:27:22.784 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.764+0000 7fd56b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:27:22.784 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.764+0000 7fd56b7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:27:22.784 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.764+0000 7fd56b7fe640 10 monclient(hunting): dump: 2026-02-13T20:27:22.784 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:22.784 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:22.784 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:22.785 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:22.785 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:22.785 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:22.785 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:22.785 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:22.785 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:22.785 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:22.785 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.764+0000 7fd56b7fe640 1 -- 10.20.193.110:0/3320394563 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 5068006 0 0) 0x7fd58c130f30 con 0x7fd58c1401c0 2026-02-13T20:27:22.785 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.764+0000 7fd56b7fe640 1 -- 10.20.193.110:0/3320394563 >> v1:10.20.193.188:6789/0 conn(0x7fd58c13dc20 legacy=0x7fd58c195040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:22.785 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.764+0000 7fd56b7fe640 1 -- 10.20.193.110:0/3320394563 >> v1:10.20.193.110:6789/0 conn(0x7fd58c091950 legacy=0x7fd58c13d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:22.785 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.764+0000 7fd56b7fe640 10 monclient: _finish_hunting 0 2026-02-13T20:27:22.785 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.764+0000 7fd56b7fe640 1 monclient: found mon.c 2026-02-13T20:27:22.785 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.764+0000 7fd56b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:27:22.786 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.764+0000 7fd56b7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:27:22.786 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.764+0000 7fd56b7fe640 1 -- 10.20.193.110:0/3320394563 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd58c12ebd0 con 0x7fd58c1401c0 2026-02-13T20:27:22.786 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.765+0000 7fd56b7fe640 10 monclient: _finish_auth 0 2026-02-13T20:27:22.786 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.765+0000 7fd56b7fe640 10 monclient: _check_auth_tickets 2026-02-13T20:27:22.786 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.765+0000 7fd56b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:27:22.786 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.765+0000 7fd59114c640 5 monclient: authenticate success, global_id 154139 2026-02-13T20:27:22.786 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.765+0000 7fd59114c640 10 monclient: _renew_subs 2026-02-13T20:27:22.786 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.765+0000 7fd59114c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:27:22.786 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.765+0000 7fd59114c640 1 -- 10.20.193.110:0/3320394563 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd58c130690 con 0x7fd58c1401c0 2026-02-13T20:27:22.786 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.765+0000 7fd59114c640 10 monclient: _renew_subs 2026-02-13T20:27:22.786 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.765+0000 7fd59114c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:27:22.786 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.765+0000 7fd59114c640 1 -- 10.20.193.110:0/3320394563 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fd58c12f8d0 con 0x7fd58c1401c0 2026-02-13T20:27:22.786 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.765+0000 7fd56b7fe640 1 -- 10.20.193.110:0/3320394563 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd5740034e0 con 0x7fd58c1401c0 2026-02-13T20:27:22.787 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.765+0000 7fd56b7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:27:22.787 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.765+0000 7fd56b7fe640 1 -- 10.20.193.110:0/3320394563 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fd574003b30 con 0x7fd58c1401c0 2026-02-13T20:27:22.787 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.765+0000 7fd56b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:22.787 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.765+0000 7fd56b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:27:22.787 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.765+0000 7fd56b7fe640 10 monclient: dump: 2026-02-13T20:27:22.787 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:22.787 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:22.787 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:22.787 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:22.787 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:22.787 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:22.788 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:22.788 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:22.788 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:22.788 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:22.788 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.765+0000 7fd589573640 4 set_mon_vals no callback set 2026-02-13T20:27:22.788 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.765+0000 7fd59114c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:27:22.788 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.765+0000 7fd59114c640 1 -- 10.20.193.110:0/3320394563 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd58c1308d0 con 0x7fd58c092020 2026-02-13T20:27:22.788 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.765+0000 7fd56b7fe640 1 -- 10.20.193.110:0/3320394563 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fd574003c90 con 0x7fd58c1401c0 2026-02-13T20:27:22.788 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.765+0000 7fd56b7fe640 1 -- 10.20.193.110:0/3320394563 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(773..773 src has 1..773) ==== 3947+0+0 (unknown 2595509352 0 0) 0x7fd57404e9e0 con 0x7fd58c1401c0 2026-02-13T20:27:22.788 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.765+0000 7fd56b7fe640 1 -- 10.20.193.110:0/3320394563 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3522512847 0 0) 0x7fd58c1308d0 con 0x7fd58c092020 2026-02-13T20:27:22.788 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.765+0000 7fd56b7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:27:22.788 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.765+0000 7fd56b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:22.789 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.765+0000 7fd56b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:22.789 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.765+0000 7fd56b7fe640 10 monclient(hunting): my global_id is 124434 2026-02-13T20:27:22.789 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.765+0000 7fd56b7fe640 1 -- 10.20.193.110:0/3320394563 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd58c130f30 con 0x7fd58c092020 2026-02-13T20:27:22.789 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.766+0000 7fd56b7fe640 1 -- 10.20.193.110:0/3320394563 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3524703165 0 0) 0x7fd58c130f30 con 0x7fd58c092020 2026-02-13T20:27:22.789 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.766+0000 7fd56b7fe640 1 -- 10.20.193.110:0/3320394563 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd58c1308d0 con 0x7fd58c092020 2026-02-13T20:27:22.789 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.766+0000 7fd56b7fe640 1 -- 10.20.193.110:0/3320394563 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fd580004a50 con 0x7fd58c092020 2026-02-13T20:27:22.789 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.766+0000 7fd56b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:22.789 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.766+0000 7fd56b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:27:22.789 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.766+0000 7fd56b7fe640 10 monclient: dump: 2026-02-13T20:27:22.789 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:22.789 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:22.789 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:22.789 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:22.790 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:22.790 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:22.790 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:22.790 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:22.790 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:22.790 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:22.790 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.766+0000 7fd58b577640 10 monclient: get_auth_request con 0x7fd55803fa00 auth_method 0 2026-02-13T20:27:22.790 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.766+0000 7fd56b7fe640 1 -- 10.20.193.110:0/3320394563 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2133657956 0 0) 0x7fd58c1308d0 con 0x7fd58c092020 2026-02-13T20:27:22.790 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.766+0000 7fd56b7fe640 1 -- 10.20.193.110:0/3320394563 --> v1:10.20.193.110:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd58c08b450 con 0x7fd58c092020 2026-02-13T20:27:22.790 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.766+0000 7fd56b7fe640 1 -- 10.20.193.110:0/3320394563 <== mon.0 v1:10.20.193.110:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fd580004e90 con 0x7fd58c092020 2026-02-13T20:27:22.790 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.766+0000 7fd56b7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:27:22.790 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.766+0000 7fd56b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:27:22.791 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.766+0000 7fd56b7fe640 1 -- 10.20.193.110:0/3320394563 >> v1:10.20.193.110:6789/0 conn(0x7fd58c092020 legacy=0x7fd58c127b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:22.791 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.766+0000 7fd56b7fe640 1 -- 10.20.193.110:0/3320394563 >> v1:10.20.193.110:6789/0 conn(0x7fd58c092020 legacy=0x7fd58c127b20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:27:22.791 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.769+0000 7fd59114c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:27:22.791 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.769+0000 7fd59114c640 1 -- 10.20.193.110:0/3320394563 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd58c055bb0 con 0x7fd58c152730 2026-02-13T20:27:22.791 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.769+0000 7fd56b7fe640 1 -- 10.20.193.110:0/3320394563 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 301221800 0 0) 0x7fd58c055bb0 con 0x7fd58c152730 2026-02-13T20:27:22.791 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.769+0000 7fd56b7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:27:22.791 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.769+0000 7fd56b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:22.791 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.769+0000 7fd56b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:22.791 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.769+0000 7fd56b7fe640 10 monclient(hunting): my global_id is 124437 2026-02-13T20:27:22.791 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.769+0000 7fd56b7fe640 1 -- 10.20.193.110:0/3320394563 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd58c1308d0 con 0x7fd58c152730 2026-02-13T20:27:22.791 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.769+0000 7fd56b7fe640 1 -- 10.20.193.110:0/3320394563 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2183111434 0 0) 0x7fd58c1308d0 con 0x7fd58c152730 2026-02-13T20:27:22.791 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.769+0000 7fd56b7fe640 1 -- 10.20.193.110:0/3320394563 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd58c055bb0 con 0x7fd58c152730 2026-02-13T20:27:22.792 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.769+0000 7fd56b7fe640 1 -- 10.20.193.110:0/3320394563 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fd580005590 con 0x7fd58c152730 2026-02-13T20:27:22.792 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.769+0000 7fd56b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:22.792 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.769+0000 7fd56b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:27:22.792 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.769+0000 7fd56b7fe640 10 monclient: dump: 2026-02-13T20:27:22.792 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:22.792 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:22.792 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:22.792 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:22.792 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:22.792 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:22.792 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:22.792 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:22.792 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:22.793 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:22.793 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.769+0000 7fd56b7fe640 1 -- 10.20.193.110:0/3320394563 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2508195368 0 0) 0x7fd58c055bb0 con 0x7fd58c152730 2026-02-13T20:27:22.793 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.769+0000 7fd56b7fe640 1 -- 10.20.193.110:0/3320394563 --> v1:10.20.193.110:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd58c058410 con 0x7fd58c152730 2026-02-13T20:27:22.793 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.770+0000 7fd56b7fe640 1 -- 10.20.193.110:0/3320394563 <== mon.0 v1:10.20.193.110:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4514 (unknown 0 0 1504671008) 0x7fd5800059a0 con 0x7fd58c152730 2026-02-13T20:27:22.793 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.770+0000 7fd56b7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:27:22.793 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.770+0000 7fd56b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:27:22.793 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.770+0000 7fd56b7fe640 1 -- 10.20.193.110:0/3320394563 >> v1:10.20.193.110:6789/0 conn(0x7fd58c152730 legacy=0x7fd58c128230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:22.793 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.770+0000 7fd56b7fe640 1 -- 10.20.193.110:0/3320394563 >> v1:10.20.193.110:6789/0 conn(0x7fd58c152730 legacy=0x7fd58c128230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:27:22.793 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:27:22.794 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:27:22.794 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:27:22.794 INFO:teuthology.orchestra.run.trial110.stdout: "state": "peon", 2026-02-13T20:27:22.794 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 58, 2026-02-13T20:27:22.794 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 358188, 2026-02-13T20:27:22.794 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:27:22.794 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:27:22.794 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:27:22.794 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:27:22.794 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:27:22.794 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 2, 2026-02-13T20:27:22.795 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:27:22.795 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:27:22.795 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:27:22.795 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:27:22.795 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:27:22.795 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:27:22.795 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:27:22.795 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:27:22.795 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:27:22.795 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:27:22.795 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:27:22.795 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:27:22.795 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:27:22.795 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:27:22.796 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:27:22.796 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:27:22.796 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:27:22.796 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:27:22.796 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:27:22.796 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:27:22.796 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:27:22.796 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:27:22.796 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:27:22.796 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:27:22.796 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:27:22.796 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:27:22.796 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:27:22.797 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:27:22.797 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:27:22.797 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:27:22.797 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:27:22.797 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:27:22.797 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:27:22.797 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:22.797 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:27:22.797 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:27:22.797 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:27:22.797 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:27:22.797 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:27:22.797 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:27:22.797 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:27:22.797 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:27:22.798 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:27:22.798 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:27:22.798 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:27:22.798 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:27:22.798 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:27:22.798 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:27:22.798 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:27:22.798 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:27:22.798 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:27:22.798 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:27:22.798 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:27:22.798 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:27:22.798 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:27:22.798 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:27:22.798 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:27:22.798 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:27:22.799 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:27:22.799 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:27:22.799 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:27:22.799 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:27:22.799 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:27:22.799 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:27:22.799 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:27:22.799 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:27:22.799 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:22.799 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:27:22.799 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:22.799 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:27:22.799 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:27:22.799 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:27:22.799 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:27:22.800 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:22.800 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:27:22.800 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:27:22.800 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:27:22.800 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:22.800 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:27:22.800 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:22.800 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:27:22.800 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:27:22.800 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:27:22.800 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:27:22.800 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:27:22.800 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:27:22.800 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:22.800 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:22.800 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:27:22.800 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:27:22.801 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:27:22.801 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:27:22.801 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:22.801 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:27:22.801 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:27:22.801 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:27:22.801 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:22.801 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:27:22.801 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:22.801 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:27:22.801 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:27:22.801 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:27:22.801 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:27:22.801 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:27:22.801 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:27:22.801 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:22.801 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:22.802 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:27:22.802 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:27:22.802 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:27:22.802 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:27:22.802 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:22.802 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:27:22.802 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:27:22.802 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:27:22.802 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:22.802 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:27:22.802 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:22.802 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:27:22.802 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:27:22.802 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:27:22.802 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:27:22.802 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:27:22.802 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:27:22.802 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:22.803 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:27:22.803 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:22.803 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:27:22.803 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:27:22.803 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:22.803 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:27:22.803 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:27:22.803 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:27:22.803 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:22.803 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:27:22.803 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:27:22.803 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:22.803 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:27:22.803 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:27:22.803 INFO:teuthology.orchestra.run.trial110.stdout: "num": 3 2026-02-13T20:27:22.803 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:22.803 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:27:22.804 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:27:22.804 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:22.804 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:27:22.804 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:27:22.804 INFO:teuthology.orchestra.run.trial110.stdout: "num": 4 2026-02-13T20:27:22.804 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:22.804 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:27:22.804 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:22.804 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:27:22.804 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:27:22.805 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.770+0000 7fd59114c640 1 -- 10.20.193.110:0/3320394563 >> v1:10.20.193.188:6812/1623052694 conn(0x7fd55803fa00 legacy=0x7fd55805feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:22.805 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.770+0000 7fd59114c640 10 monclient: shutdown 2026-02-13T20:27:22.805 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.770+0000 7fd59114c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:27:22.806 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.770+0000 7fd59114c640 1 -- 10.20.193.110:0/3320394563 >> v1:10.20.193.110:6790/0 conn(0x7fd58c1401c0 legacy=0x7fd58c193920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:22.806 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.770+0000 7fd58b577640 1 -- 10.20.193.110:0/3320394563 reap_dead start 2026-02-13T20:27:22.806 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.770+0000 7fd58b577640 1 -- 10.20.193.110:0/3320394563 reap_dead start 2026-02-13T20:27:22.806 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.770+0000 7fd59114c640 1 -- 10.20.193.110:0/3320394563 shutdown_connections 2026-02-13T20:27:22.806 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.770+0000 7fd59114c640 1 -- 10.20.193.110:0/3320394563 >> 10.20.193.110:0/3320394563 conn(0x7fd58c054e90 msgr2=0x7fd58c13f050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:27:22.806 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.770+0000 7fd59114c640 1 -- 10.20.193.110:0/3320394563 shutdown_connections 2026-02-13T20:27:22.806 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.770+0000 7fd59114c640 1 -- 10.20.193.110:0/3320394563 wait complete. 2026-02-13T20:27:22.806 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:27:22.806 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-13T20:27:22.806 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T20:27:22.871 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.871+0000 7ff9187c2640 10 monclient: get_monmap_and_config 2026-02-13T20:27:22.871 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.871+0000 7ff9187c2640 10 monclient: build_initial_monmap 2026-02-13T20:27:22.871 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.871+0000 7ff9187c2640 10 monclient: monmap: 2026-02-13T20:27:22.872 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:27:22.872 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:22.872 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:27:22.871896+0000 2026-02-13T20:27:22.872 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:27:22.871896+0000 2026-02-13T20:27:22.872 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:27:22.872 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:22.872 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:27:22.872 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:27:22.872 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:27:22.872 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:22.881 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.871+0000 7ff9187c2640 1 Processor -- start 2026-02-13T20:27:22.881 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.872+0000 7ff9187c2640 1 -- start start 2026-02-13T20:27:22.881 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.872+0000 7ff9187c2640 10 monclient: init 2026-02-13T20:27:22.881 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.872+0000 7ff9187c2640 10 monclient: _reopen_session rank -1 2026-02-13T20:27:22.881 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.872+0000 7ff9187c2640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:27:22.881 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.872+0000 7ff9187c2640 10 monclient(hunting): picked mon.noname-c con 0x7ff9101401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:27:22.881 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.872+0000 7ff9187c2640 10 monclient(hunting): picked mon.noname-b con 0x7ff910092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:27:22.881 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.872+0000 7ff9187c2640 10 monclient(hunting): picked mon.noname-a con 0x7ff910091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:27:22.881 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.872+0000 7ff9187c2640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff91008b730 con 0x7ff910091950 2026-02-13T20:27:22.881 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.872+0000 7ff9187c2640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff91005c5b0 con 0x7ff9101401c0 2026-02-13T20:27:22.881 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.872+0000 7ff9187c2640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff91008bcf0 con 0x7ff910092020 2026-02-13T20:27:22.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.872+0000 7ff9187c2640 10 monclient(hunting): _renew_subs 2026-02-13T20:27:22.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.872+0000 7ff9187c2640 10 monclient(hunting): authenticate will time out at 1604.562514s 2026-02-13T20:27:22.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.872+0000 7ff916d38640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7ff910091950 0x7ff9101a2a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:57902/0 (socket says 10.20.193.110:57902) 2026-02-13T20:27:22.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.872+0000 7ff916d38640 1 -- 10.20.193.110:0/3507935852 learned_addr learned my addr 10.20.193.110:0/3507935852 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:27:22.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.872+0000 7ff915d36640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7ff910092020 0x7ff9101812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:57876/0 (socket says 10.20.193.110:57876) 2026-02-13T20:27:22.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.872+0000 7ff915535640 1 -- 10.20.193.110:0/3507935852 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3163345493 0 0) 0x7ff91008b730 con 0x7ff910091950 2026-02-13T20:27:22.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.872+0000 7ff915535640 10 monclient(hunting): _negotiate 2026-02-13T20:27:22.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.872+0000 7ff915535640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:22.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.872+0000 7ff915535640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:22.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.872+0000 7ff915535640 10 monclient(hunting): my global_id is 124440 2026-02-13T20:27:22.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.872+0000 7ff915535640 1 -- 10.20.193.110:0/3507935852 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8f80035e0 con 0x7ff910091950 2026-02-13T20:27:22.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.872+0000 7ff915535640 1 -- 10.20.193.110:0/3507935852 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 702080082 0 0) 0x7ff91008bcf0 con 0x7ff910092020 2026-02-13T20:27:22.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.872+0000 7ff915535640 10 monclient(hunting): _negotiate 2026-02-13T20:27:22.883 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.872+0000 7ff915535640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:22.883 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.872+0000 7ff915535640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:22.883 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.872+0000 7ff915535640 10 monclient(hunting): my global_id is 154142 2026-02-13T20:27:22.883 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.872+0000 7ff915535640 1 -- 10.20.193.110:0/3507935852 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff91008b730 con 0x7ff910092020 2026-02-13T20:27:22.883 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.872+0000 7ff915535640 1 -- 10.20.193.110:0/3507935852 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2754104731 0 0) 0x7ff91005c5b0 con 0x7ff9101401c0 2026-02-13T20:27:22.883 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.872+0000 7ff915535640 10 monclient(hunting): _negotiate 2026-02-13T20:27:22.883 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.872+0000 7ff915535640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:22.883 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.872+0000 7ff915535640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:22.883 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.872+0000 7ff915535640 10 monclient(hunting): my global_id is 144220 2026-02-13T20:27:22.883 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.872+0000 7ff915535640 1 -- 10.20.193.110:0/3507935852 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff91008bcf0 con 0x7ff9101401c0 2026-02-13T20:27:22.883 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.872+0000 7ff915535640 1 -- 10.20.193.110:0/3507935852 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4064482908 0 0) 0x7ff8f80035e0 con 0x7ff910091950 2026-02-13T20:27:22.883 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.872+0000 7ff915535640 1 -- 10.20.193.110:0/3507935852 >> v1:10.20.193.110:6790/0 conn(0x7ff910092020 legacy=0x7ff9101812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:22.883 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.872+0000 7ff915535640 1 -- 10.20.193.110:0/3507935852 >> v1:10.20.193.188:6789/0 conn(0x7ff9101401c0 legacy=0x7ff910091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:22.884 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.872+0000 7ff915535640 10 monclient: _finish_hunting 0 2026-02-13T20:27:22.884 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.872+0000 7ff915535640 1 monclient: found mon.noname-a 2026-02-13T20:27:22.884 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.872+0000 7ff915535640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:27:22.884 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.873+0000 7ff915535640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:27:22.884 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.873+0000 7ff915535640 1 -- 10.20.193.110:0/3507935852 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff910140590 con 0x7ff910091950 2026-02-13T20:27:22.884 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.873+0000 7ff915535640 10 monclient: _finish_auth 0 2026-02-13T20:27:22.884 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.873+0000 7ff915535640 10 monclient: _check_auth_tickets 2026-02-13T20:27:22.884 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.873+0000 7ff915535640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:27:22.884 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.873+0000 7ff9187c2640 5 monclient: authenticate success, global_id 124440 2026-02-13T20:27:22.884 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.873+0000 7ff915535640 1 -- 10.20.193.110:0/3507935852 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff90c003eb0 con 0x7ff910091950 2026-02-13T20:27:22.884 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.873+0000 7ff9187c2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:27:22.884 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.873+0000 7ff915535640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:22.884 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.873+0000 7ff915535640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:27:22.884 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.873+0000 7ff915535640 10 monclient: dump: 2026-02-13T20:27:22.885 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:22.885 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:22.885 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:22.885 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:22.885 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:22.885 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:22.885 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:22.885 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:22.885 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:22.885 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:22.885 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.873+0000 7ff9187c2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:27:22.885 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.873+0000 7ff915535640 1 -- 10.20.193.110:0/3507935852 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff90c0040c0 con 0x7ff910091950 2026-02-13T20:27:22.885 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.873+0000 7ff915535640 10 monclient: handle_config config(0 keys) 2026-02-13T20:27:22.885 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.873+0000 7ff915535640 1 -- 10.20.193.110:0/3507935852 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff90c0044d0 con 0x7ff910091950 2026-02-13T20:27:22.886 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.873+0000 7ff915535640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:22.886 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.873+0000 7ff915535640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:27:22.886 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.873+0000 7ff915535640 10 monclient: dump: 2026-02-13T20:27:22.886 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:22.886 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:22.886 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:22.886 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:22.886 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:22.886 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:22.886 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:22.886 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:22.886 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:22.886 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:22.886 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.873+0000 7ff9187c2640 10 monclient: get_monmap_and_config success 2026-02-13T20:27:22.886 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.873+0000 7ff9187c2640 4 set_mon_vals no callback set 2026-02-13T20:27:22.887 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.873+0000 7ff9187c2640 10 monclient: shutdown 2026-02-13T20:27:22.887 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.873+0000 7ff9187c2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:27:22.887 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.873+0000 7ff9187c2640 1 -- 10.20.193.110:0/3507935852 >> v1:10.20.193.110:6789/0 conn(0x7ff910091950 legacy=0x7ff9101a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:22.887 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.873+0000 7ff9187c2640 1 -- 10.20.193.110:0/3507935852 shutdown_connections 2026-02-13T20:27:22.887 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.873+0000 7ff9187c2640 1 -- 10.20.193.110:0/3507935852 >> 10.20.193.110:0/3507935852 conn(0x7ff910054e90 msgr2=0x7ff910058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:27:22.887 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.873+0000 7ff9187c2640 1 -- 10.20.193.110:0/3507935852 shutdown_connections 2026-02-13T20:27:22.887 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.873+0000 7ff9187c2640 1 -- 10.20.193.110:0/3507935852 wait complete. 2026-02-13T20:27:22.887 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.873+0000 7ff9187c2640 10 monclient: build_initial_monmap 2026-02-13T20:27:22.887 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.873+0000 7ff9187c2640 10 monclient: monmap: 2026-02-13T20:27:22.887 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:27:22.887 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:27:22.887 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:27:22.887 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:27:22.888 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:27:22.888 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:27:22.888 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:27:22.888 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:27:22.888 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:27:22.888 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:22.888 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.873+0000 7ff9187c2640 1 Processor -- start 2026-02-13T20:27:22.888 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff9187c2640 1 -- start start 2026-02-13T20:27:22.888 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff9187c2640 10 monclient: init 2026-02-13T20:27:22.888 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff9187c2640 10 monclient: _reopen_session rank -1 2026-02-13T20:27:22.888 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff9187c2640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:27:22.888 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff9187c2640 10 monclient(hunting): picked mon.noname-a con 0x7ff910091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:27:22.888 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff9187c2640 10 monclient(hunting): picked mon.noname-b con 0x7ff9101401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:27:22.888 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff9187c2640 10 monclient(hunting): picked mon.noname-c con 0x7ff910089c50 addr v1:10.20.193.110:6790/0 2026-02-13T20:27:22.889 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff9187c2640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff91008c5c0 con 0x7ff910091950 2026-02-13T20:27:22.889 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff9187c2640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff910131d10 con 0x7ff9101401c0 2026-02-13T20:27:22.889 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff9187c2640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff91008a0b0 con 0x7ff910089c50 2026-02-13T20:27:22.889 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff9187c2640 10 monclient(hunting): _renew_subs 2026-02-13T20:27:22.889 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff9187c2640 10 monclient(hunting): authenticate will time out at 1604.564302s 2026-02-13T20:27:22.889 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff916537640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7ff910091950 0x7ff910088e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:57910/0 (socket says 10.20.193.110:57910) 2026-02-13T20:27:22.889 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff916537640 1 -- 10.20.193.110:0/3056196571 learned_addr learned my addr 10.20.193.110:0/3056196571 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:27:22.889 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff8f6ffd640 1 -- 10.20.193.110:0/3056196571 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1411392660 0 0) 0x7ff91008bcf0 con 0x7ff910091950 2026-02-13T20:27:22.889 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff8f6ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:27:22.889 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff8f6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:22.889 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff8f6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:22.889 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff8f6ffd640 10 monclient(hunting): my global_id is 124443 2026-02-13T20:27:22.889 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff8f6ffd640 1 -- 10.20.193.110:0/3056196571 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8e00035e0 con 0x7ff910091950 2026-02-13T20:27:22.889 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff8f6ffd640 1 -- 10.20.193.110:0/3056196571 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3079247074 0 0) 0x7ff91008a0b0 con 0x7ff910089c50 2026-02-13T20:27:22.890 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff8f6ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:27:22.890 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff8f6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:22.890 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff8f6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:22.890 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff8f6ffd640 10 monclient(hunting): my global_id is 154145 2026-02-13T20:27:22.890 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff8f6ffd640 1 -- 10.20.193.110:0/3056196571 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff91008bcf0 con 0x7ff910089c50 2026-02-13T20:27:22.890 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff8f6ffd640 1 -- 10.20.193.110:0/3056196571 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3943726672 0 0) 0x7ff8e00035e0 con 0x7ff910091950 2026-02-13T20:27:22.890 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff8f6ffd640 1 -- 10.20.193.110:0/3056196571 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff91008a0b0 con 0x7ff910091950 2026-02-13T20:27:22.890 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff8f6ffd640 1 -- 10.20.193.110:0/3056196571 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff900003150 con 0x7ff910091950 2026-02-13T20:27:22.890 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff8f6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:27:22.890 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff8f6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:27:22.890 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff8f6ffd640 10 monclient(hunting): dump: 2026-02-13T20:27:22.890 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:22.890 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:22.890 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:22.890 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:22.891 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:22.891 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:22.891 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:22.891 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:22.891 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:22.891 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:22.891 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff8f6ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:27:22.891 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff8f6ffd640 1 -- 10.20.193.110:0/3056196571 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3692382858 0 0) 0x7ff91008bcf0 con 0x7ff910089c50 2026-02-13T20:27:22.891 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff8f6ffd640 1 -- 10.20.193.110:0/3056196571 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff8e00035e0 con 0x7ff910089c50 2026-02-13T20:27:22.891 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff8f6ffd640 1 -- 10.20.193.110:0/3056196571 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff90c0043e0 con 0x7ff910089c50 2026-02-13T20:27:22.891 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff8f6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:27:22.891 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff8f6ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:27:22.891 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff8f6ffd640 10 monclient(hunting): dump: 2026-02-13T20:27:22.891 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:22.892 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:22.892 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:22.892 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:22.892 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:22.892 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:22.892 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:22.892 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:22.892 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:22.892 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:22.892 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff8f6ffd640 1 -- 10.20.193.110:0/3056196571 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3599880186 0 0) 0x7ff910131d10 con 0x7ff9101401c0 2026-02-13T20:27:22.892 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff8f6ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:27:22.892 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff8f6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:22.892 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff8f6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:22.892 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff8f6ffd640 10 monclient(hunting): my global_id is 144223 2026-02-13T20:27:22.893 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff8f6ffd640 1 -- 10.20.193.110:0/3056196571 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff91008bcf0 con 0x7ff9101401c0 2026-02-13T20:27:22.893 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff8f6ffd640 1 -- 10.20.193.110:0/3056196571 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2925944742 0 0) 0x7ff91008a0b0 con 0x7ff910091950 2026-02-13T20:27:22.893 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff8f6ffd640 1 -- 10.20.193.110:0/3056196571 >> v1:10.20.193.110:6790/0 conn(0x7ff910089c50 legacy=0x7ff910195170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:22.893 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff8f6ffd640 1 -- 10.20.193.110:0/3056196571 >> v1:10.20.193.188:6789/0 conn(0x7ff9101401c0 legacy=0x7ff910089540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:22.893 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff8f6ffd640 10 monclient: _finish_hunting 0 2026-02-13T20:27:22.893 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff8f6ffd640 1 monclient: found mon.a 2026-02-13T20:27:22.893 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff8f6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:27:22.893 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff8f6ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:27:22.893 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff8f6ffd640 1 -- 10.20.193.110:0/3056196571 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9101322d0 con 0x7ff910091950 2026-02-13T20:27:22.893 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff8f6ffd640 10 monclient: _finish_auth 0 2026-02-13T20:27:22.893 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff8f6ffd640 10 monclient: _check_auth_tickets 2026-02-13T20:27:22.893 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff8f6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:27:22.893 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff9187c2640 5 monclient: authenticate success, global_id 124443 2026-02-13T20:27:22.894 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff9187c2640 10 monclient: _renew_subs 2026-02-13T20:27:22.894 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff9187c2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:27:22.894 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff9187c2640 1 -- 10.20.193.110:0/3056196571 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff9101325b0 con 0x7ff910091950 2026-02-13T20:27:22.894 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff9187c2640 10 monclient: _renew_subs 2026-02-13T20:27:22.894 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff9187c2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:27:22.894 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff9187c2640 1 -- 10.20.193.110:0/3056196571 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff91008a7e0 con 0x7ff910091950 2026-02-13T20:27:22.894 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff8f6ffd640 1 -- 10.20.193.110:0/3056196571 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff900003540 con 0x7ff910091950 2026-02-13T20:27:22.894 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff8f6ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:27:22.894 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff8f6ffd640 1 -- 10.20.193.110:0/3056196571 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff900003b30 con 0x7ff910091950 2026-02-13T20:27:22.894 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff8f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:22.894 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff8f6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:27:22.894 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff8f6ffd640 10 monclient: dump: 2026-02-13T20:27:22.894 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:22.894 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:22.895 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:22.895 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:22.895 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:22.895 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:22.895 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:22.895 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:22.895 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:22.895 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:22.895 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.874+0000 7ff914d34640 4 set_mon_vals no callback set 2026-02-13T20:27:22.895 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.875+0000 7ff9187c2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:27:22.895 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.875+0000 7ff9187c2640 1 -- 10.20.193.110:0/3056196571 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff910131ec0 con 0x7ff910092020 2026-02-13T20:27:22.895 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.875+0000 7ff8f6ffd640 1 -- 10.20.193.110:0/3056196571 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1967023854 0 0) 0x7ff91008bcf0 con 0x7ff910092020 2026-02-13T20:27:22.895 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.875+0000 7ff8f6ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:27:22.895 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.875+0000 7ff8f6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:22.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.875+0000 7ff8f6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:22.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.875+0000 7ff8f6ffd640 10 monclient(hunting): my global_id is 154148 2026-02-13T20:27:22.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.875+0000 7ff8f6ffd640 1 -- 10.20.193.110:0/3056196571 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff91008a0b0 con 0x7ff910092020 2026-02-13T20:27:22.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.875+0000 7ff8f6ffd640 1 -- 10.20.193.110:0/3056196571 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7ff900003c90 con 0x7ff910091950 2026-02-13T20:27:22.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.875+0000 7ff8f6ffd640 1 -- 10.20.193.110:0/3056196571 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(773..773 src has 1..773) ==== 3947+0+0 (unknown 2595509352 0 0) 0x7ff90004e890 con 0x7ff910091950 2026-02-13T20:27:22.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.875+0000 7ff8f6ffd640 1 -- 10.20.193.110:0/3056196571 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1435494873 0 0) 0x7ff91008a0b0 con 0x7ff910092020 2026-02-13T20:27:22.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.875+0000 7ff8f6ffd640 1 -- 10.20.193.110:0/3056196571 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff91008bcf0 con 0x7ff910092020 2026-02-13T20:27:22.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.875+0000 7ff8f6ffd640 1 -- 10.20.193.110:0/3056196571 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff904002e70 con 0x7ff910092020 2026-02-13T20:27:22.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.875+0000 7ff8f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:22.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.875+0000 7ff8f6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:27:22.896 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.875+0000 7ff8f6ffd640 10 monclient: dump: 2026-02-13T20:27:22.896 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:22.896 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:22.896 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:22.896 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:22.897 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:22.897 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:22.897 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:22.897 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:22.897 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:22.897 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:22.897 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.875+0000 7ff916d38640 10 monclient: get_auth_request con 0x7ff8e003fc90 auth_method 0 2026-02-13T20:27:22.897 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.875+0000 7ff8f6ffd640 1 -- 10.20.193.110:0/3056196571 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3263595391 0 0) 0x7ff91008bcf0 con 0x7ff910092020 2026-02-13T20:27:22.897 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.875+0000 7ff8f6ffd640 1 -- 10.20.193.110:0/3056196571 --> v1:10.20.193.110:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff91008b450 con 0x7ff910092020 2026-02-13T20:27:22.897 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.876+0000 7ff8f6ffd640 1 -- 10.20.193.110:0/3056196571 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7ff904003310 con 0x7ff910092020 2026-02-13T20:27:22.897 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.876+0000 7ff8f6ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:27:22.897 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.876+0000 7ff8f6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:27:22.897 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.876+0000 7ff8f6ffd640 1 -- 10.20.193.110:0/3056196571 >> v1:10.20.193.110:6790/0 conn(0x7ff910092020 legacy=0x7ff910127b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:22.897 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.876+0000 7ff8f6ffd640 1 -- 10.20.193.110:0/3056196571 >> v1:10.20.193.110:6790/0 conn(0x7ff910092020 legacy=0x7ff910127b20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:27:22.898 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.879+0000 7ff9187c2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:27:22.898 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.879+0000 7ff9187c2640 1 -- 10.20.193.110:0/3056196571 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff91008c5c0 con 0x7ff910128230 2026-02-13T20:27:22.898 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.879+0000 7ff8f6ffd640 1 -- 10.20.193.110:0/3056196571 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1847123163 0 0) 0x7ff91008b730 con 0x7ff910128230 2026-02-13T20:27:22.898 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.879+0000 7ff8f6ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:27:22.898 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.879+0000 7ff8f6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:22.898 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.879+0000 7ff8f6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:22.898 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.879+0000 7ff8f6ffd640 10 monclient(hunting): my global_id is 154151 2026-02-13T20:27:22.898 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.879+0000 7ff8f6ffd640 1 -- 10.20.193.110:0/3056196571 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff91008bcf0 con 0x7ff910128230 2026-02-13T20:27:22.898 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.880+0000 7ff8f6ffd640 1 -- 10.20.193.110:0/3056196571 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2103395961 0 0) 0x7ff91008bcf0 con 0x7ff910128230 2026-02-13T20:27:22.898 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.880+0000 7ff8f6ffd640 1 -- 10.20.193.110:0/3056196571 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff91008b730 con 0x7ff910128230 2026-02-13T20:27:22.898 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.880+0000 7ff8f6ffd640 1 -- 10.20.193.110:0/3056196571 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ff904004c40 con 0x7ff910128230 2026-02-13T20:27:22.898 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.880+0000 7ff8f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:22.898 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.880+0000 7ff8f6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:27:22.898 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.880+0000 7ff8f6ffd640 10 monclient: dump: 2026-02-13T20:27:22.899 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:22.899 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:22.899 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:22.899 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:22.899 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:22.899 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:22.899 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:22.899 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:22.899 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:22.899 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:22.899 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.880+0000 7ff8f6ffd640 1 -- 10.20.193.110:0/3056196571 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4199835629 0 0) 0x7ff91008b730 con 0x7ff910128230 2026-02-13T20:27:22.899 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.880+0000 7ff8f6ffd640 1 -- 10.20.193.110:0/3056196571 --> v1:10.20.193.110:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff910055bb0 con 0x7ff910128230 2026-02-13T20:27:22.899 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.880+0000 7ff8f6ffd640 1 -- 10.20.193.110:0/3056196571 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4347 (unknown 0 0 738949599) 0x7ff904005050 con 0x7ff910128230 2026-02-13T20:27:22.899 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.880+0000 7ff8f6ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:27:22.900 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.880+0000 7ff8f6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:27:22.900 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.880+0000 7ff8f6ffd640 1 -- 10.20.193.110:0/3056196571 >> v1:10.20.193.110:6790/0 conn(0x7ff910128230 legacy=0x7ff9101978a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:22.900 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.880+0000 7ff8f6ffd640 1 -- 10.20.193.110:0/3056196571 >> v1:10.20.193.110:6790/0 conn(0x7ff910128230 legacy=0x7ff9101978a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:27:22.900 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:27:22.900 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:27:22.900 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:27:22.900 INFO:teuthology.orchestra.run.trial110.stdout: "state": "leader", 2026-02-13T20:27:22.900 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 58, 2026-02-13T20:27:22.901 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 2158, 2026-02-13T20:27:22.901 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:27:22.901 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:27:22.901 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:27:22.901 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:27:22.901 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:27:22.901 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 2, 2026-02-13T20:27:22.901 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:27:22.901 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:27:22.901 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:27:22.901 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:27:22.901 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:27:22.901 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:27:22.901 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:27:22.902 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:27:22.902 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:27:22.902 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:27:22.902 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:27:22.902 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:27:22.902 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:27:22.902 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:27:22.902 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:27:22.902 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:27:22.902 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:27:22.902 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:27:22.902 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:27:22.902 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:27:22.902 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:27:22.902 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:27:22.902 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:27:22.903 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:27:22.903 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:27:22.903 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:27:22.903 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:27:22.903 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:27:22.903 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:27:22.903 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:27:22.903 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:27:22.903 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:27:22.903 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:27:22.903 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:22.903 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:27:22.903 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:27:22.903 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:27:22.903 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:27:22.904 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:27:22.904 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:27:22.904 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:27:22.904 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:27:22.904 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:27:22.904 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:27:22.904 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:27:22.904 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:27:22.904 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:27:22.904 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:27:22.904 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:27:22.904 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:27:22.904 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:27:22.904 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:27:22.904 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:27:22.904 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:27:22.904 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:27:22.905 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:27:22.905 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:27:22.905 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:27:22.905 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:27:22.905 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:27:22.905 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:27:22.905 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:27:22.905 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:27:22.905 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:27:22.905 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:27:22.905 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:27:22.905 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:22.905 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:27:22.905 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:22.905 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:27:22.905 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:27:22.905 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:27:22.906 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:27:22.906 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:22.906 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:27:22.906 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:27:22.906 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:27:22.906 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:22.906 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:27:22.906 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:22.906 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:27:22.906 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:27:22.906 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:27:22.906 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:27:22.906 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:27:22.906 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:27:22.906 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:22.906 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:22.906 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:27:22.907 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:27:22.907 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:27:22.907 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:27:22.907 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:22.907 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:27:22.907 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:27:22.907 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:27:22.907 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:22.907 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:27:22.907 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:22.907 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:27:22.907 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:27:22.907 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:27:22.907 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:27:22.907 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:27:22.907 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:27:22.907 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:22.908 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:22.908 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:27:22.908 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:27:22.908 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:27:22.908 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:27:22.908 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:22.908 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:27:22.908 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:27:22.908 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:27:22.908 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:22.908 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:27:22.908 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:22.908 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:27:22.908 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:27:22.908 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:27:22.908 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:27:22.908 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:27:22.908 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:27:22.909 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:22.909 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:27:22.909 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:22.909 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:27:22.909 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:27:22.909 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:22.909 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:27:22.909 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:27:22.909 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:27:22.909 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:22.909 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:27:22.909 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:27:22.909 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:22.909 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:27:22.909 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:27:22.909 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:27:22.909 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:22.910 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:27:22.910 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:22.910 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:27:22.910 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:27:22.911 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.880+0000 7ff9187c2640 1 -- 10.20.193.110:0/3056196571 >> v1:10.20.193.188:6812/1623052694 conn(0x7ff8e003fc90 legacy=0x7ff8e0060140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:22.911 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.880+0000 7ff9187c2640 10 monclient: shutdown 2026-02-13T20:27:22.911 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.880+0000 7ff9187c2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:27:22.911 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.880+0000 7ff9187c2640 1 -- 10.20.193.110:0/3056196571 >> v1:10.20.193.110:6789/0 conn(0x7ff910091950 legacy=0x7ff910088e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:22.911 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.880+0000 7ff916d38640 1 -- 10.20.193.110:0/3056196571 reap_dead start 2026-02-13T20:27:22.911 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.880+0000 7ff916d38640 1 -- 10.20.193.110:0/3056196571 reap_dead start 2026-02-13T20:27:22.911 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.880+0000 7ff9187c2640 1 -- 10.20.193.110:0/3056196571 shutdown_connections 2026-02-13T20:27:22.911 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.880+0000 7ff9187c2640 1 -- 10.20.193.110:0/3056196571 >> 10.20.193.110:0/3056196571 conn(0x7ff910054e90 msgr2=0x7ff91008dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:27:22.911 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.880+0000 7ff9187c2640 1 -- 10.20.193.110:0/3056196571 shutdown_connections 2026-02-13T20:27:22.911 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.880+0000 7ff9187c2640 1 -- 10.20.193.110:0/3056196571 wait complete. 2026-02-13T20:27:22.912 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:27:22.912 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-13T20:27:22.912 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T20:27:22.978 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.978+0000 7fc90630c640 10 monclient: get_monmap_and_config 2026-02-13T20:27:22.979 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.978+0000 7fc90630c640 10 monclient: build_initial_monmap 2026-02-13T20:27:22.979 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.978+0000 7fc90630c640 10 monclient: monmap: 2026-02-13T20:27:22.979 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:27:22.979 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:22.979 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:27:22.979109+0000 2026-02-13T20:27:22.979 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:27:22.979109+0000 2026-02-13T20:27:22.979 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:27:22.979 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:22.979 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:27:22.979 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:27:22.979 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:27:22.979 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:22.988 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.979+0000 7fc90630c640 1 Processor -- start 2026-02-13T20:27:22.988 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.979+0000 7fc90630c640 1 -- start start 2026-02-13T20:27:22.988 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.979+0000 7fc90630c640 10 monclient: init 2026-02-13T20:27:22.988 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.979+0000 7fc90630c640 10 monclient: _reopen_session rank -1 2026-02-13T20:27:22.988 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.979+0000 7fc90630c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:27:22.988 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.979+0000 7fc90630c640 10 monclient(hunting): picked mon.noname-a con 0x7fc9001401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:27:22.989 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.979+0000 7fc90630c640 10 monclient(hunting): picked mon.noname-b con 0x7fc900092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:27:22.989 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.979+0000 7fc90630c640 10 monclient(hunting): picked mon.noname-c con 0x7fc900091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:27:22.989 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.979+0000 7fc90630c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc90008b730 con 0x7fc9001401c0 2026-02-13T20:27:22.989 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.979+0000 7fc90630c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc90005c5b0 con 0x7fc900091950 2026-02-13T20:27:22.989 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.979+0000 7fc90630c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc90008bcf0 con 0x7fc900092020 2026-02-13T20:27:22.989 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.979+0000 7fc90630c640 10 monclient(hunting): _renew_subs 2026-02-13T20:27:22.989 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.979+0000 7fc90630c640 10 monclient(hunting): authenticate will time out at 1604.669460s 2026-02-13T20:27:22.989 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.979+0000 7fc8fffff640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fc9001401c0 0x7fc900091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:57924/0 (socket says 10.20.193.110:57924) 2026-02-13T20:27:22.989 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.979+0000 7fc8fffff640 1 -- 10.20.193.110:0/4234955143 learned_addr learned my addr 10.20.193.110:0/4234955143 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:27:22.989 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.979+0000 7fc8feffd640 1 -- 10.20.193.110:0/4234955143 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 419908455 0 0) 0x7fc90008b730 con 0x7fc9001401c0 2026-02-13T20:27:22.989 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.979+0000 7fc8feffd640 10 monclient(hunting): _negotiate 2026-02-13T20:27:22.989 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.979+0000 7fc8feffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:22.989 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.979+0000 7fc8feffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:22.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.979+0000 7fc8feffd640 10 monclient(hunting): my global_id is 124446 2026-02-13T20:27:22.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.979+0000 7fc8feffd640 1 -- 10.20.193.110:0/4234955143 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8e40035e0 con 0x7fc9001401c0 2026-02-13T20:27:22.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.979+0000 7fc8feffd640 1 -- 10.20.193.110:0/4234955143 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3559695411 0 0) 0x7fc90008bcf0 con 0x7fc900092020 2026-02-13T20:27:22.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.979+0000 7fc8feffd640 10 monclient(hunting): _negotiate 2026-02-13T20:27:22.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.979+0000 7fc8feffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:22.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.979+0000 7fc8feffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:22.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.979+0000 7fc8feffd640 10 monclient(hunting): my global_id is 154154 2026-02-13T20:27:22.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.979+0000 7fc8feffd640 1 -- 10.20.193.110:0/4234955143 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc90008b730 con 0x7fc900092020 2026-02-13T20:27:22.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.979+0000 7fc8feffd640 1 -- 10.20.193.110:0/4234955143 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1050003511 0 0) 0x7fc90008b730 con 0x7fc900092020 2026-02-13T20:27:22.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.979+0000 7fc8feffd640 1 -- 10.20.193.110:0/4234955143 >> v1:10.20.193.188:6789/0 conn(0x7fc900091950 legacy=0x7fc9001a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:22.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.979+0000 7fc8feffd640 1 -- 10.20.193.110:0/4234955143 >> v1:10.20.193.110:6789/0 conn(0x7fc9001401c0 legacy=0x7fc900091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:22.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.979+0000 7fc8feffd640 10 monclient: _finish_hunting 0 2026-02-13T20:27:22.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.979+0000 7fc8feffd640 1 monclient: found mon.noname-b 2026-02-13T20:27:22.991 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.979+0000 7fc8feffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:27:22.991 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.979+0000 7fc8feffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:27:22.991 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.979+0000 7fc8feffd640 1 -- 10.20.193.110:0/4234955143 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc900140590 con 0x7fc900092020 2026-02-13T20:27:22.991 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.979+0000 7fc8feffd640 10 monclient: _finish_auth 0 2026-02-13T20:27:22.991 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.979+0000 7fc8feffd640 10 monclient: _check_auth_tickets 2026-02-13T20:27:22.991 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.979+0000 7fc8feffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:27:22.991 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.979+0000 7fc8feffd640 1 -- 10.20.193.110:0/4234955143 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc8f0002dd0 con 0x7fc900092020 2026-02-13T20:27:22.991 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.979+0000 7fc8feffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:22.991 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.979+0000 7fc8feffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:27:22.991 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.979+0000 7fc8feffd640 10 monclient: dump: 2026-02-13T20:27:22.991 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:22.991 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:22.991 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:22.991 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:22.992 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:22.992 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:22.992 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:22.992 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:22.992 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:22.992 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:22.992 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.979+0000 7fc90630c640 5 monclient: authenticate success, global_id 154154 2026-02-13T20:27:22.992 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.979+0000 7fc90630c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:27:22.992 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.980+0000 7fc8feffd640 1 -- 10.20.193.110:0/4234955143 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc8f0002f60 con 0x7fc900092020 2026-02-13T20:27:22.992 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.980+0000 7fc8feffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:27:22.992 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.980+0000 7fc8feffd640 1 -- 10.20.193.110:0/4234955143 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc8f00032f0 con 0x7fc900092020 2026-02-13T20:27:22.992 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.980+0000 7fc8feffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:22.992 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.980+0000 7fc8feffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:27:22.993 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.980+0000 7fc8feffd640 10 monclient: dump: 2026-02-13T20:27:22.993 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:22.993 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:22.993 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:22.993 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:22.993 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:22.993 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:22.993 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:22.993 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:22.993 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:22.993 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:22.993 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.980+0000 7fc90630c640 10 monclient: get_monmap_and_config success 2026-02-13T20:27:22.993 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.980+0000 7fc90630c640 4 set_mon_vals no callback set 2026-02-13T20:27:22.993 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.980+0000 7fc90630c640 10 monclient: shutdown 2026-02-13T20:27:22.994 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.980+0000 7fc90630c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:27:22.994 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.980+0000 7fc90630c640 1 -- 10.20.193.110:0/4234955143 >> v1:10.20.193.110:6790/0 conn(0x7fc900092020 legacy=0x7fc9001812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:22.994 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.980+0000 7fc90630c640 1 -- 10.20.193.110:0/4234955143 shutdown_connections 2026-02-13T20:27:22.994 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.980+0000 7fc90630c640 1 -- 10.20.193.110:0/4234955143 >> 10.20.193.110:0/4234955143 conn(0x7fc900054e90 msgr2=0x7fc900058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:27:22.994 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.980+0000 7fc90630c640 1 -- 10.20.193.110:0/4234955143 shutdown_connections 2026-02-13T20:27:22.994 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.980+0000 7fc90630c640 1 -- 10.20.193.110:0/4234955143 wait complete. 2026-02-13T20:27:22.994 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.980+0000 7fc90630c640 10 monclient: build_initial_monmap 2026-02-13T20:27:22.994 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.980+0000 7fc90630c640 10 monclient: monmap: 2026-02-13T20:27:22.994 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:27:22.994 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:27:22.994 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:27:22.994 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:27:22.994 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:27:22.994 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:27:22.995 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:27:22.995 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:27:22.995 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:27:22.995 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:22.995 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.980+0000 7fc90630c640 1 Processor -- start 2026-02-13T20:27:22.995 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.980+0000 7fc90630c640 1 -- start start 2026-02-13T20:27:22.995 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.980+0000 7fc90630c640 10 monclient: init 2026-02-13T20:27:22.995 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc90630c640 10 monclient: _reopen_session rank -1 2026-02-13T20:27:22.995 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc90630c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:27:22.995 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc90630c640 10 monclient(hunting): picked mon.noname-a con 0x7fc900091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:27:22.995 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc90630c640 10 monclient(hunting): picked mon.noname-c con 0x7fc9001401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:27:22.995 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc90630c640 10 monclient(hunting): picked mon.noname-b con 0x7fc900130b20 addr v1:10.20.193.188:6789/0 2026-02-13T20:27:22.995 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc90630c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc90008a840 con 0x7fc900091950 2026-02-13T20:27:22.995 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc90630c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc90008c410 con 0x7fc900130b20 2026-02-13T20:27:22.996 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc90630c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc90005d320 con 0x7fc9001401c0 2026-02-13T20:27:22.996 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc90630c640 10 monclient(hunting): _renew_subs 2026-02-13T20:27:22.996 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc90630c640 10 monclient(hunting): authenticate will time out at 1604.671173s 2026-02-13T20:27:22.996 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc8fffff640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fc900091950 0x7fc90013e900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:57936/0 (socket says 10.20.193.110:57936) 2026-02-13T20:27:22.996 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc8ff7fe640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fc9001401c0 0x7fc900193a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:57912/0 (socket says 10.20.193.110:57912) 2026-02-13T20:27:22.996 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc8fffff640 1 -- 10.20.193.110:0/468887730 learned_addr learned my addr 10.20.193.110:0/468887730 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:27:22.996 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc8fcff9640 1 -- 10.20.193.110:0/468887730 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2719929619 0 0) 0x7fc90008a840 con 0x7fc900091950 2026-02-13T20:27:22.996 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc8fcff9640 10 monclient(hunting): _negotiate 2026-02-13T20:27:22.996 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc8fcff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:22.996 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc8fcff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:22.996 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc8fcff9640 10 monclient(hunting): my global_id is 124449 2026-02-13T20:27:22.996 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc8fcff9640 1 -- 10.20.193.110:0/468887730 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8d00035e0 con 0x7fc900091950 2026-02-13T20:27:22.996 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc8fcff9640 1 -- 10.20.193.110:0/468887730 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2809112883 0 0) 0x7fc90005d320 con 0x7fc9001401c0 2026-02-13T20:27:22.996 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc8fcff9640 10 monclient(hunting): _negotiate 2026-02-13T20:27:22.997 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc8fcff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:22.997 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc8fcff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:22.997 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc8fcff9640 10 monclient(hunting): my global_id is 154157 2026-02-13T20:27:22.997 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc8fcff9640 1 -- 10.20.193.110:0/468887730 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc90008a840 con 0x7fc9001401c0 2026-02-13T20:27:22.997 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc8fcff9640 1 -- 10.20.193.110:0/468887730 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2453535464 0 0) 0x7fc8d00035e0 con 0x7fc900091950 2026-02-13T20:27:22.997 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc8fcff9640 1 -- 10.20.193.110:0/468887730 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc90005d320 con 0x7fc900091950 2026-02-13T20:27:22.997 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc8fcff9640 1 -- 10.20.193.110:0/468887730 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1122819397 0 0) 0x7fc90008a840 con 0x7fc9001401c0 2026-02-13T20:27:22.997 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc8fcff9640 1 -- 10.20.193.110:0/468887730 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc8d00035e0 con 0x7fc9001401c0 2026-02-13T20:27:22.997 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc8fcff9640 1 -- 10.20.193.110:0/468887730 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc8ec0031f0 con 0x7fc900091950 2026-02-13T20:27:22.997 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc8fcff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:27:22.997 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc8fcff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:27:22.997 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc8fcff9640 10 monclient(hunting): dump: 2026-02-13T20:27:22.997 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:22.997 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:22.998 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:22.998 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:22.998 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:22.998 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:22.998 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:22.998 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:22.998 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:22.998 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:22.998 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc8fcff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:27:22.998 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc8fcff9640 1 -- 10.20.193.110:0/468887730 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc8f0003280 con 0x7fc9001401c0 2026-02-13T20:27:22.998 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc8fcff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:27:22.998 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc8fcff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:27:22.998 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc8fcff9640 10 monclient(hunting): dump: 2026-02-13T20:27:22.998 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:22.999 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:22.999 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:22.999 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:22.999 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:22.999 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:22.999 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:22.999 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:22.999 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:22.999 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:22.999 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc8fcff9640 1 -- 10.20.193.110:0/468887730 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2829229913 0 0) 0x7fc90005d320 con 0x7fc900091950 2026-02-13T20:27:22.999 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc8fcff9640 1 -- 10.20.193.110:0/468887730 >> v1:10.20.193.110:6790/0 conn(0x7fc9001401c0 legacy=0x7fc900193a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:22.999 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc8fcff9640 1 -- 10.20.193.110:0/468887730 >> v1:10.20.193.188:6789/0 conn(0x7fc900130b20 legacy=0x7fc900195160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:22.999 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc8fcff9640 10 monclient: _finish_hunting 0 2026-02-13T20:27:22.999 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc8fcff9640 1 monclient: found mon.a 2026-02-13T20:27:23.000 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc8fcff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:27:23.000 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc8fcff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:27:23.000 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc8fcff9640 1 -- 10.20.193.110:0/468887730 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc900132320 con 0x7fc900091950 2026-02-13T20:27:23.000 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc8fcff9640 10 monclient: _finish_auth 0 2026-02-13T20:27:23.000 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc8fcff9640 10 monclient: _check_auth_tickets 2026-02-13T20:27:23.000 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc8fcff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:27:23.000 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc90630c640 5 monclient: authenticate success, global_id 124449 2026-02-13T20:27:23.000 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc90630c640 10 monclient: _renew_subs 2026-02-13T20:27:23.000 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc90630c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:27:23.000 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc90630c640 1 -- 10.20.193.110:0/468887730 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc900131a80 con 0x7fc900091950 2026-02-13T20:27:23.000 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc90630c640 10 monclient: _renew_subs 2026-02-13T20:27:23.000 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc90630c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:27:23.000 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc90630c640 1 -- 10.20.193.110:0/468887730 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc900152ab0 con 0x7fc900091950 2026-02-13T20:27:23.000 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc8fcff9640 1 -- 10.20.193.110:0/468887730 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc8ec002e20 con 0x7fc900091950 2026-02-13T20:27:23.001 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc8fcff9640 10 monclient: handle_config config(0 keys) 2026-02-13T20:27:23.001 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc8fcff9640 1 -- 10.20.193.110:0/468887730 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc8ec004b00 con 0x7fc900091950 2026-02-13T20:27:23.001 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc8fcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:23.001 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc8fcff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:27:23.001 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc8fcff9640 10 monclient: dump: 2026-02-13T20:27:23.001 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:23.001 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:23.001 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:23.001 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:23.001 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:23.001 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:23.001 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:23.001 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:23.001 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:23.002 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:23.002 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.981+0000 7fc8fe7fc640 4 set_mon_vals no callback set 2026-02-13T20:27:23.002 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.982+0000 7fc90630c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:27:23.002 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.982+0000 7fc90630c640 1 -- 10.20.193.110:0/468887730 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc9000008d0 con 0x7fc900092020 2026-02-13T20:27:23.002 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.982+0000 7fc8fcff9640 1 -- 10.20.193.110:0/468887730 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fc8ec011770 con 0x7fc900091950 2026-02-13T20:27:23.002 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.982+0000 7fc8fcff9640 1 -- 10.20.193.110:0/468887730 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(773..773 src has 1..773) ==== 3947+0+0 (unknown 2595509352 0 0) 0x7fc8ec04e8a0 con 0x7fc900091950 2026-02-13T20:27:23.002 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.982+0000 7fc8fcff9640 1 -- 10.20.193.110:0/468887730 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1987959710 0 0) 0x7fc9000008d0 con 0x7fc900092020 2026-02-13T20:27:23.002 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.982+0000 7fc8fcff9640 10 monclient(hunting): _negotiate 2026-02-13T20:27:23.002 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.982+0000 7fc8fcff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:23.002 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.982+0000 7fc8fcff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:23.002 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.982+0000 7fc8fcff9640 10 monclient(hunting): my global_id is 144232 2026-02-13T20:27:23.002 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.982+0000 7fc8fcff9640 1 -- 10.20.193.110:0/468887730 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc90005d320 con 0x7fc900092020 2026-02-13T20:27:23.002 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.982+0000 7fc904882640 10 monclient: get_auth_request con 0x7fc8d003f970 auth_method 0 2026-02-13T20:27:23.002 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.982+0000 7fc8fcff9640 1 -- 10.20.193.110:0/468887730 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1320439550 0 0) 0x7fc90005d320 con 0x7fc900092020 2026-02-13T20:27:23.003 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.982+0000 7fc8fcff9640 1 -- 10.20.193.110:0/468887730 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc9000008d0 con 0x7fc900092020 2026-02-13T20:27:23.003 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.982+0000 7fc8fcff9640 1 -- 10.20.193.110:0/468887730 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc8f0003da0 con 0x7fc900092020 2026-02-13T20:27:23.003 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.982+0000 7fc8fcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:23.003 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.982+0000 7fc8fcff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:27:23.003 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.982+0000 7fc8fcff9640 10 monclient: dump: 2026-02-13T20:27:23.003 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:23.003 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:23.003 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:23.003 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:23.003 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:23.003 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:23.003 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:23.003 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:23.003 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:23.004 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:23.004 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.982+0000 7fc8fcff9640 1 -- 10.20.193.110:0/468887730 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2322486018 0 0) 0x7fc9000008d0 con 0x7fc900092020 2026-02-13T20:27:23.004 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.982+0000 7fc8fcff9640 1 -- 10.20.193.110:0/468887730 --> v1:10.20.193.188:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc90008b450 con 0x7fc900092020 2026-02-13T20:27:23.004 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.983+0000 7fc8fcff9640 1 -- 10.20.193.110:0/468887730 <== mon.1 v1:10.20.193.188:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fc8f0004160 con 0x7fc900092020 2026-02-13T20:27:23.004 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.983+0000 7fc8fcff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:27:23.004 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.983+0000 7fc8fcff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:27:23.004 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.983+0000 7fc8fcff9640 1 -- 10.20.193.110:0/468887730 >> v1:10.20.193.188:6789/0 conn(0x7fc900092020 legacy=0x7fc900127b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:23.004 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.983+0000 7fc8fcff9640 1 -- 10.20.193.110:0/468887730 >> v1:10.20.193.188:6789/0 conn(0x7fc900092020 legacy=0x7fc900127b20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:27:23.004 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.986+0000 7fc90630c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:27:23.004 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.986+0000 7fc90630c640 1 -- 10.20.193.110:0/468887730 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc90008a300 con 0x7fc900128230 2026-02-13T20:27:23.004 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.987+0000 7fc8fcff9640 1 -- 10.20.193.110:0/468887730 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1159732019 0 0) 0x7fc90008a300 con 0x7fc900128230 2026-02-13T20:27:23.004 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.987+0000 7fc8fcff9640 10 monclient(hunting): _negotiate 2026-02-13T20:27:23.004 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.987+0000 7fc8fcff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:23.004 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.987+0000 7fc8fcff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:23.005 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.987+0000 7fc8fcff9640 10 monclient(hunting): my global_id is 144235 2026-02-13T20:27:23.005 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.987+0000 7fc8fcff9640 1 -- 10.20.193.110:0/468887730 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9000008d0 con 0x7fc900128230 2026-02-13T20:27:23.005 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.987+0000 7fc8fcff9640 1 -- 10.20.193.110:0/468887730 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3025093842 0 0) 0x7fc9000008d0 con 0x7fc900128230 2026-02-13T20:27:23.005 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.987+0000 7fc8fcff9640 1 -- 10.20.193.110:0/468887730 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc90008a300 con 0x7fc900128230 2026-02-13T20:27:23.005 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.987+0000 7fc8fcff9640 1 -- 10.20.193.110:0/468887730 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc8f00058e0 con 0x7fc900128230 2026-02-13T20:27:23.005 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.987+0000 7fc8fcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:23.005 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.987+0000 7fc8fcff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:27:23.005 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.987+0000 7fc8fcff9640 10 monclient: dump: 2026-02-13T20:27:23.005 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:23.005 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:23.005 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:23.005 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:23.005 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:23.005 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:23.006 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:23.006 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:23.006 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:23.006 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:23.006 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.987+0000 7fc8fcff9640 1 -- 10.20.193.110:0/468887730 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3749456864 0 0) 0x7fc90008a300 con 0x7fc900128230 2026-02-13T20:27:23.006 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.987+0000 7fc8fcff9640 1 -- 10.20.193.110:0/468887730 --> v1:10.20.193.188:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc900058410 con 0x7fc900128230 2026-02-13T20:27:23.006 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.987+0000 7fc8fcff9640 1 -- 10.20.193.110:0/468887730 <== mon.1 v1:10.20.193.188:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4681 (unknown 0 0 1570404334) 0x7fc8f0007ac0 con 0x7fc900128230 2026-02-13T20:27:23.006 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.987+0000 7fc8fcff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:27:23.006 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.987+0000 7fc8fcff9640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:27:23.006 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.987+0000 7fc8fcff9640 1 -- 10.20.193.110:0/468887730 >> v1:10.20.193.188:6789/0 conn(0x7fc900128230 legacy=0x7fc900197890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:23.006 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.987+0000 7fc8fcff9640 1 -- 10.20.193.110:0/468887730 >> v1:10.20.193.188:6789/0 conn(0x7fc900128230 legacy=0x7fc900197890 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:27:23.007 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:27:23.007 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:27:23.007 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:27:23.007 INFO:teuthology.orchestra.run.trial110.stdout: "state": "peon", 2026-02-13T20:27:23.007 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 58, 2026-02-13T20:27:23.007 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 109257, 2026-02-13T20:27:23.007 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:27:23.007 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:27:23.007 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:27:23.007 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:27:23.007 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:27:23.007 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 2, 2026-02-13T20:27:23.008 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:27:23.008 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:27:23.008 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:27:23.008 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:27:23.008 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:27:23.008 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:27:23.008 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:27:23.008 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:27:23.008 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:27:23.008 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:27:23.008 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:27:23.008 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:27:23.008 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:27:23.008 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:27:23.008 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:27:23.009 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:27:23.009 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:27:23.009 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:27:23.009 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:27:23.009 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:27:23.009 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:27:23.009 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:27:23.009 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:27:23.009 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:27:23.009 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:27:23.009 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:27:23.009 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:27:23.009 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:27:23.009 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:27:23.009 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:27:23.009 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:27:23.010 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:27:23.010 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:27:23.010 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:23.010 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:27:23.010 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:27:23.010 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:27:23.010 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:27:23.010 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:27:23.010 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:27:23.010 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:27:23.010 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:27:23.010 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:27:23.010 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:27:23.010 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:27:23.010 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:27:23.011 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:27:23.011 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:27:23.011 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:27:23.011 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:27:23.011 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:27:23.011 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:27:23.011 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:27:23.011 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:27:23.011 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:27:23.011 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:27:23.011 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:27:23.011 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:27:23.011 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:27:23.011 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:27:23.011 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:27:23.012 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:27:23.012 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:27:23.012 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:27:23.012 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:27:23.012 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:27:23.012 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:23.012 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:27:23.012 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:23.012 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:27:23.012 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:27:23.012 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:27:23.012 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:27:23.012 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:23.012 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:27:23.012 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:27:23.013 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:27:23.013 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:23.013 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:27:23.013 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:23.013 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:27:23.013 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:27:23.013 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:27:23.013 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:27:23.013 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:27:23.013 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:27:23.013 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:23.013 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:23.013 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:27:23.013 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:27:23.013 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:27:23.013 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:27:23.013 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:23.014 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:27:23.014 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:27:23.014 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:27:23.014 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:23.014 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:27:23.014 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:23.014 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:27:23.014 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:27:23.014 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:27:23.014 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:27:23.014 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:27:23.014 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:27:23.014 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:23.014 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:23.014 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:27:23.014 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:27:23.014 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:27:23.015 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:27:23.015 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:23.015 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:27:23.015 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:27:23.015 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:27:23.015 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:23.015 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:27:23.015 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:23.015 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:27:23.015 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:27:23.015 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:27:23.015 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:27:23.015 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:27:23.015 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:27:23.015 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:23.015 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:27:23.015 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:23.016 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:27:23.016 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:27:23.016 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:23.016 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:27:23.016 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:27:23.016 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:27:23.016 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:23.016 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:27:23.016 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:27:23.016 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:23.016 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:27:23.016 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:27:23.016 INFO:teuthology.orchestra.run.trial110.stdout: "num": 3 2026-02-13T20:27:23.016 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:23.016 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:27:23.016 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:27:23.016 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:23.016 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:27:23.017 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:27:23.017 INFO:teuthology.orchestra.run.trial110.stdout: "num": 3 2026-02-13T20:27:23.017 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:23.017 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:27:23.017 INFO:teuthology.orchestra.run.trial110.stdout: "mgr": [ 2026-02-13T20:27:23.017 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:23.017 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:27:23.017 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:27:23.017 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:27:23.017 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:23.017 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:27:23.017 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:23.017 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:27:23.017 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:27:23.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.988+0000 7fc90630c640 1 -- 10.20.193.110:0/468887730 >> v1:10.20.193.188:6812/1623052694 conn(0x7fc8d003f970 legacy=0x7fc8d005fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:23.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.988+0000 7fc90630c640 10 monclient: shutdown 2026-02-13T20:27:23.018 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.988+0000 7fc90630c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:27:23.019 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.988+0000 7fc90630c640 1 -- 10.20.193.110:0/468887730 >> v1:10.20.193.110:6789/0 conn(0x7fc900091950 legacy=0x7fc90013e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:23.019 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.988+0000 7fc904882640 1 -- 10.20.193.110:0/468887730 reap_dead start 2026-02-13T20:27:23.019 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.988+0000 7fc904882640 1 -- 10.20.193.110:0/468887730 reap_dead start 2026-02-13T20:27:23.019 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.988+0000 7fc90630c640 1 -- 10.20.193.110:0/468887730 shutdown_connections 2026-02-13T20:27:23.019 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.988+0000 7fc90630c640 1 -- 10.20.193.110:0/468887730 >> 10.20.193.110:0/468887730 conn(0x7fc900054e90 msgr2=0x7fc90008dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:27:23.019 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.988+0000 7fc90630c640 1 -- 10.20.193.110:0/468887730 shutdown_connections 2026-02-13T20:27:23.019 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:22.988+0000 7fc90630c640 1 -- 10.20.193.110:0/468887730 wait complete. 2026-02-13T20:27:23.019 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:27:23.019 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2026-02-13T20:27:23.019 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-13T20:27:23.019 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2026-02-13T20:27:23.020 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b store 2026-02-13T20:27:23.020 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b sync_force --yes-i-really-mean-it 2026-02-13T20:27:23.086 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.086+0000 7f5bcd61b640 10 monclient: get_monmap_and_config 2026-02-13T20:27:23.086 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.086+0000 7f5bcd61b640 10 monclient: build_initial_monmap 2026-02-13T20:27:23.086 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.086+0000 7f5bcd61b640 10 monclient: monmap: 2026-02-13T20:27:23.086 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:27:23.086 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:23.086 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:27:23.086472+0000 2026-02-13T20:27:23.086 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:27:23.086472+0000 2026-02-13T20:27:23.086 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:27:23.086 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:23.086 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:27:23.086 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:27:23.086 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:27:23.086 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:23.093 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.086+0000 7f5bcd61b640 1 Processor -- start 2026-02-13T20:27:23.093 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.086+0000 7f5bcd61b640 1 -- start start 2026-02-13T20:27:23.093 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.086+0000 7f5bcd61b640 10 monclient: init 2026-02-13T20:27:23.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.086+0000 7f5bcd61b640 10 monclient: _reopen_session rank -1 2026-02-13T20:27:23.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.086+0000 7f5bcd61b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:27:23.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.086+0000 7f5bcd61b640 10 monclient(hunting): picked mon.noname-b con 0x7f5bc81401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:27:23.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.086+0000 7f5bcd61b640 10 monclient(hunting): picked mon.noname-c con 0x7f5bc8092020 addr v1:10.20.193.188:6789/0 2026-02-13T20:27:23.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.086+0000 7f5bcd61b640 10 monclient(hunting): picked mon.noname-a con 0x7f5bc8091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:27:23.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.086+0000 7f5bcd61b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bc808b730 con 0x7f5bc8091950 2026-02-13T20:27:23.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.086+0000 7f5bcd61b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bc805c5b0 con 0x7f5bc8092020 2026-02-13T20:27:23.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.086+0000 7f5bcd61b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bc808bcf0 con 0x7f5bc81401c0 2026-02-13T20:27:23.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.086+0000 7f5bcd61b640 10 monclient(hunting): _renew_subs 2026-02-13T20:27:23.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.086+0000 7f5bcd61b640 10 monclient(hunting): authenticate will time out at 1604.776863s 2026-02-13T20:27:23.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.086+0000 7f5bc6ffd640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f5bc81401c0 0x7f5bc8091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:57926/0 (socket says 10.20.193.110:57926) 2026-02-13T20:27:23.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.086+0000 7f5bc6ffd640 1 -- 10.20.193.110:0/598719592 learned_addr learned my addr 10.20.193.110:0/598719592 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:27:23.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.087+0000 7f5bc5ffb640 1 -- 10.20.193.110:0/598719592 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1327154001 0 0) 0x7f5bc808bcf0 con 0x7f5bc81401c0 2026-02-13T20:27:23.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.087+0000 7f5bc5ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:27:23.095 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.087+0000 7f5bc5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:23.095 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.087+0000 7f5bc5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:23.095 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.087+0000 7f5bc5ffb640 10 monclient(hunting): my global_id is 154160 2026-02-13T20:27:23.095 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.087+0000 7f5bc5ffb640 1 -- 10.20.193.110:0/598719592 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5bb40035e0 con 0x7f5bc81401c0 2026-02-13T20:27:23.095 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.087+0000 7f5bc5ffb640 1 -- 10.20.193.110:0/598719592 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1104800676 0 0) 0x7f5bc808b730 con 0x7f5bc8091950 2026-02-13T20:27:23.095 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.087+0000 7f5bc5ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:27:23.095 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.087+0000 7f5bc5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:23.095 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.087+0000 7f5bc5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:23.095 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.087+0000 7f5bc5ffb640 10 monclient(hunting): my global_id is 124452 2026-02-13T20:27:23.095 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.087+0000 7f5bc5ffb640 1 -- 10.20.193.110:0/598719592 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5bc808bcf0 con 0x7f5bc8091950 2026-02-13T20:27:23.095 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.087+0000 7f5bc5ffb640 1 -- 10.20.193.110:0/598719592 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3788421796 0 0) 0x7f5bb40035e0 con 0x7f5bc81401c0 2026-02-13T20:27:23.095 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.087+0000 7f5bc5ffb640 1 -- 10.20.193.110:0/598719592 >> v1:10.20.193.188:6789/0 conn(0x7f5bc8092020 legacy=0x7f5bc81812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:23.095 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.087+0000 7f5bc5ffb640 1 -- 10.20.193.110:0/598719592 >> v1:10.20.193.110:6789/0 conn(0x7f5bc8091950 legacy=0x7f5bc81a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:23.095 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.087+0000 7f5bc5ffb640 10 monclient: _finish_hunting 0 2026-02-13T20:27:23.096 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.087+0000 7f5bc5ffb640 1 monclient: found mon.noname-b 2026-02-13T20:27:23.096 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.087+0000 7f5bc5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:27:23.096 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.087+0000 7f5bc5ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:27:23.096 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.087+0000 7f5bc5ffb640 1 -- 10.20.193.110:0/598719592 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bc8140590 con 0x7f5bc81401c0 2026-02-13T20:27:23.096 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.087+0000 7f5bc5ffb640 10 monclient: _finish_auth 0 2026-02-13T20:27:23.096 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.087+0000 7f5bc5ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:27:23.096 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.087+0000 7f5bc5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:27:23.096 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.087+0000 7f5bc5ffb640 1 -- 10.20.193.110:0/598719592 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f5bbc002dd0 con 0x7f5bc81401c0 2026-02-13T20:27:23.096 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.087+0000 7f5bc5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:23.096 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.087+0000 7f5bc5ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:27:23.096 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.087+0000 7f5bc5ffb640 10 monclient: dump: 2026-02-13T20:27:23.096 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:23.096 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:23.096 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:23.096 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:23.097 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:23.097 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:23.097 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:23.097 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:23.097 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:23.097 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:23.097 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.087+0000 7f5bcd61b640 5 monclient: authenticate success, global_id 154160 2026-02-13T20:27:23.097 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.087+0000 7f5bcd61b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:27:23.097 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.087+0000 7f5bc5ffb640 1 -- 10.20.193.110:0/598719592 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5bbc002f60 con 0x7f5bc81401c0 2026-02-13T20:27:23.097 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.087+0000 7f5bc5ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T20:27:23.097 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.087+0000 7f5bc5ffb640 1 -- 10.20.193.110:0/598719592 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f5bbc003370 con 0x7f5bc81401c0 2026-02-13T20:27:23.097 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.087+0000 7f5bc5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:23.097 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.087+0000 7f5bc5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:27:23.097 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.087+0000 7f5bc5ffb640 10 monclient: dump: 2026-02-13T20:27:23.097 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:23.098 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:23.098 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:23.098 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:23.098 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:23.098 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:23.098 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:23.098 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:23.098 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:23.098 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:23.098 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.087+0000 7f5bcd61b640 10 monclient: get_monmap_and_config success 2026-02-13T20:27:23.098 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.087+0000 7f5bcd61b640 4 set_mon_vals no callback set 2026-02-13T20:27:23.098 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.087+0000 7f5bcd61b640 10 monclient: shutdown 2026-02-13T20:27:23.098 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.087+0000 7f5bcd61b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:27:23.098 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.087+0000 7f5bcd61b640 1 -- 10.20.193.110:0/598719592 >> v1:10.20.193.110:6790/0 conn(0x7f5bc81401c0 legacy=0x7f5bc8091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:23.098 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.087+0000 7f5bcd61b640 1 -- 10.20.193.110:0/598719592 shutdown_connections 2026-02-13T20:27:23.098 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.087+0000 7f5bcd61b640 1 -- 10.20.193.110:0/598719592 >> 10.20.193.110:0/598719592 conn(0x7f5bc8054e90 msgr2=0x7f5bc8058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:27:23.099 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.087+0000 7f5bcd61b640 1 -- 10.20.193.110:0/598719592 shutdown_connections 2026-02-13T20:27:23.099 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.087+0000 7f5bcd61b640 1 -- 10.20.193.110:0/598719592 wait complete. 2026-02-13T20:27:23.099 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.088+0000 7f5bcd61b640 10 monclient: build_initial_monmap 2026-02-13T20:27:23.099 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.088+0000 7f5bcd61b640 10 monclient: monmap: 2026-02-13T20:27:23.099 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:27:23.099 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:27:23.099 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:27:23.099 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:27:23.099 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:27:23.099 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:27:23.099 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:27:23.099 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:27:23.099 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:27:23.099 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:23.099 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.088+0000 7f5bcd61b640 1 Processor -- start 2026-02-13T20:27:23.100 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.088+0000 7f5bcd61b640 1 -- start start 2026-02-13T20:27:23.100 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.088+0000 7f5bcd61b640 10 monclient: init 2026-02-13T20:27:23.100 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.088+0000 7f5bcd61b640 10 monclient: _reopen_session rank -1 2026-02-13T20:27:23.100 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.088+0000 7f5bcd61b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:27:23.100 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.088+0000 7f5bcd61b640 10 monclient(hunting): picked mon.noname-b con 0x7f5bc8091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:27:23.100 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.088+0000 7f5bcd61b640 10 monclient(hunting): picked mon.noname-c con 0x7f5bc81401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:27:23.100 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.088+0000 7f5bcd61b640 10 monclient(hunting): picked mon.noname-a con 0x7f5bc812f9c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:27:23.100 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.088+0000 7f5bcd61b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bc805d390 con 0x7f5bc812f9c0 2026-02-13T20:27:23.100 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.088+0000 7f5bcd61b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bc8130920 con 0x7f5bc8091950 2026-02-13T20:27:23.100 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.088+0000 7f5bcd61b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bc8130350 con 0x7f5bc81401c0 2026-02-13T20:27:23.100 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.088+0000 7f5bcd61b640 10 monclient(hunting): _renew_subs 2026-02-13T20:27:23.100 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.088+0000 7f5bcd61b640 10 monclient(hunting): authenticate will time out at 1604.778593s 2026-02-13T20:27:23.100 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.088+0000 7f5bc67fc640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f5bc81401c0 0x7f5bc8193bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:57936/0 (socket says 10.20.193.110:57936) 2026-02-13T20:27:23.100 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.088+0000 7f5bc67fc640 1 -- 10.20.193.110:0/847761369 learned_addr learned my addr 10.20.193.110:0/847761369 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:27:23.100 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.088+0000 7f5ba77fe640 1 -- 10.20.193.110:0/847761369 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2701461552 0 0) 0x7f5bc8130350 con 0x7f5bc81401c0 2026-02-13T20:27:23.101 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.088+0000 7f5ba77fe640 10 monclient(hunting): _negotiate 2026-02-13T20:27:23.101 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.088+0000 7f5ba77fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:23.101 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.088+0000 7f5ba77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:23.101 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.088+0000 7f5ba77fe640 10 monclient(hunting): my global_id is 154163 2026-02-13T20:27:23.101 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.088+0000 7f5ba77fe640 1 -- 10.20.193.110:0/847761369 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b940035e0 con 0x7f5bc81401c0 2026-02-13T20:27:23.101 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.088+0000 7f5ba77fe640 1 -- 10.20.193.110:0/847761369 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2945675934 0 0) 0x7f5bb8003ad0 con 0x7f5bc812f9c0 2026-02-13T20:27:23.101 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.088+0000 7f5ba77fe640 10 monclient(hunting): _negotiate 2026-02-13T20:27:23.101 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.088+0000 7f5ba77fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:23.101 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.088+0000 7f5ba77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:23.101 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.088+0000 7f5ba77fe640 10 monclient(hunting): my global_id is 124455 2026-02-13T20:27:23.101 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.088+0000 7f5ba77fe640 1 -- 10.20.193.110:0/847761369 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5bc8130350 con 0x7f5bc812f9c0 2026-02-13T20:27:23.101 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.088+0000 7f5ba77fe640 1 -- 10.20.193.110:0/847761369 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2428228425 0 0) 0x7f5b940035e0 con 0x7f5bc81401c0 2026-02-13T20:27:23.101 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.088+0000 7f5ba77fe640 1 -- 10.20.193.110:0/847761369 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5bb8003ad0 con 0x7f5bc81401c0 2026-02-13T20:27:23.101 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.088+0000 7f5ba77fe640 1 -- 10.20.193.110:0/847761369 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f5bb0003170 con 0x7f5bc81401c0 2026-02-13T20:27:23.101 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.088+0000 7f5ba77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:27:23.101 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.088+0000 7f5ba77fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:27:23.102 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.088+0000 7f5ba77fe640 10 monclient(hunting): dump: 2026-02-13T20:27:23.102 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:23.102 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:23.102 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:23.102 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:23.102 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:23.102 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:23.102 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:23.102 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:23.102 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:23.102 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:23.102 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.088+0000 7f5ba77fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:27:23.102 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.088+0000 7f5ba77fe640 1 -- 10.20.193.110:0/847761369 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3663082170 0 0) 0x7f5bc8130350 con 0x7f5bc812f9c0 2026-02-13T20:27:23.102 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.088+0000 7f5ba77fe640 1 -- 10.20.193.110:0/847761369 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5b940035e0 con 0x7f5bc812f9c0 2026-02-13T20:27:23.102 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.088+0000 7f5ba77fe640 1 -- 10.20.193.110:0/847761369 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f5bb8004250 con 0x7f5bc812f9c0 2026-02-13T20:27:23.103 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.088+0000 7f5ba77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:27:23.103 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.088+0000 7f5ba77fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:27:23.103 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.088+0000 7f5ba77fe640 10 monclient(hunting): dump: 2026-02-13T20:27:23.103 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:23.103 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:23.103 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:23.103 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:23.103 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:23.103 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:23.103 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:23.103 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:23.103 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:23.103 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:23.103 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.089+0000 7f5ba77fe640 1 -- 10.20.193.110:0/847761369 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2431123288 0 0) 0x7f5bb8003ad0 con 0x7f5bc81401c0 2026-02-13T20:27:23.103 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.089+0000 7f5ba77fe640 1 -- 10.20.193.110:0/847761369 >> v1:10.20.193.188:6789/0 conn(0x7f5bc8091950 legacy=0x7f5bc813d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:23.103 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.089+0000 7f5ba77fe640 1 -- 10.20.193.110:0/847761369 >> v1:10.20.193.110:6789/0 conn(0x7f5bc812f9c0 legacy=0x7f5bc81952d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:23.104 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.089+0000 7f5ba77fe640 10 monclient: _finish_hunting 0 2026-02-13T20:27:23.104 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.089+0000 7f5ba77fe640 1 monclient: found mon.c 2026-02-13T20:27:23.104 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.089+0000 7f5ba77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:27:23.104 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.089+0000 7f5ba77fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:27:23.104 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.089+0000 7f5ba77fe640 1 -- 10.20.193.110:0/847761369 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bc812ee60 con 0x7f5bc81401c0 2026-02-13T20:27:23.104 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.089+0000 7f5ba77fe640 10 monclient: _finish_auth 0 2026-02-13T20:27:23.104 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.089+0000 7f5ba77fe640 10 monclient: _check_auth_tickets 2026-02-13T20:27:23.104 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.089+0000 7f5ba77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:27:23.104 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.089+0000 7f5bcd61b640 5 monclient: authenticate success, global_id 154163 2026-02-13T20:27:23.104 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.089+0000 7f5bcd61b640 10 monclient: _renew_subs 2026-02-13T20:27:23.104 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.089+0000 7f5bcd61b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:27:23.104 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.089+0000 7f5bcd61b640 1 -- 10.20.193.110:0/847761369 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5bc812e940 con 0x7f5bc81401c0 2026-02-13T20:27:23.104 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.089+0000 7f5bcd61b640 10 monclient: _renew_subs 2026-02-13T20:27:23.104 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.089+0000 7f5bcd61b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:27:23.104 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.089+0000 7f5bcd61b640 1 -- 10.20.193.110:0/847761369 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f5bc813deb0 con 0x7f5bc81401c0 2026-02-13T20:27:23.104 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.089+0000 7f5ba77fe640 1 -- 10.20.193.110:0/847761369 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5bb00034e0 con 0x7f5bc81401c0 2026-02-13T20:27:23.105 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.089+0000 7f5ba77fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:27:23.105 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.089+0000 7f5ba77fe640 1 -- 10.20.193.110:0/847761369 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f5bb0003b30 con 0x7f5bc81401c0 2026-02-13T20:27:23.105 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.089+0000 7f5ba77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:23.105 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.089+0000 7f5ba77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:27:23.105 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.089+0000 7f5ba77fe640 10 monclient: dump: 2026-02-13T20:27:23.105 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:23.105 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:23.105 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:23.105 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:23.105 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:23.105 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:23.105 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:23.105 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:23.105 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:23.105 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:23.106 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.089+0000 7f5bc57fa640 4 set_mon_vals no callback set 2026-02-13T20:27:23.106 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.089+0000 7f5bcd61b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:27:23.106 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.089+0000 7f5bcd61b640 1 -- 10.20.193.110:0/847761369 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5bc80008d0 con 0x7f5bc8092020 2026-02-13T20:27:23.106 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.089+0000 7f5ba77fe640 1 -- 10.20.193.110:0/847761369 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f5bb0003c90 con 0x7f5bc81401c0 2026-02-13T20:27:23.106 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.089+0000 7f5ba77fe640 1 -- 10.20.193.110:0/847761369 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(773..773 src has 1..773) ==== 3947+0+0 (unknown 2595509352 0 0) 0x7f5bb004ea40 con 0x7f5bc81401c0 2026-02-13T20:27:23.106 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.089+0000 7f5ba77fe640 1 -- 10.20.193.110:0/847761369 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 723726937 0 0) 0x7f5bc80008d0 con 0x7f5bc8092020 2026-02-13T20:27:23.106 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.089+0000 7f5ba77fe640 10 monclient(hunting): _negotiate 2026-02-13T20:27:23.106 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.089+0000 7f5ba77fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:23.106 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.089+0000 7f5ba77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:23.106 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.089+0000 7f5ba77fe640 10 monclient(hunting): my global_id is 144244 2026-02-13T20:27:23.106 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.089+0000 7f5ba77fe640 1 -- 10.20.193.110:0/847761369 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5bb8003ad0 con 0x7f5bc8092020 2026-02-13T20:27:23.106 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.090+0000 7f5bc77fe640 10 monclient: get_auth_request con 0x7f5b9403faa0 auth_method 0 2026-02-13T20:27:23.106 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.090+0000 7f5ba77fe640 1 -- 10.20.193.110:0/847761369 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3907369696 0 0) 0x7f5bb8003ad0 con 0x7f5bc8092020 2026-02-13T20:27:23.106 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.090+0000 7f5ba77fe640 1 -- 10.20.193.110:0/847761369 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5bc80008d0 con 0x7f5bc8092020 2026-02-13T20:27:23.106 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.090+0000 7f5ba77fe640 1 -- 10.20.193.110:0/847761369 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f5bbc002850 con 0x7f5bc8092020 2026-02-13T20:27:23.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.090+0000 7f5ba77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:23.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.090+0000 7f5ba77fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:27:23.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.090+0000 7f5ba77fe640 10 monclient: dump: 2026-02-13T20:27:23.107 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:23.107 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:23.107 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:23.107 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:23.107 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:23.107 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:23.107 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:23.107 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:23.107 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:23.107 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:23.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.090+0000 7f5ba77fe640 1 -- 10.20.193.110:0/847761369 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1339832138 0 0) 0x7f5bc80008d0 con 0x7f5bc8092020 2026-02-13T20:27:23.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.090+0000 7f5ba77fe640 1 -- 10.20.193.110:0/847761369 --> v1:10.20.193.188:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5bc808b450 con 0x7f5bc8092020 2026-02-13T20:27:23.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.090+0000 7f5ba77fe640 1 -- 10.20.193.110:0/847761369 <== mon.1 v1:10.20.193.188:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f5bbc002d10 con 0x7f5bc8092020 2026-02-13T20:27:23.108 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.090+0000 7f5ba77fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:27:23.108 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.090+0000 7f5ba77fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:27:23.108 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.090+0000 7f5ba77fe640 1 -- 10.20.193.110:0/847761369 >> v1:10.20.193.188:6789/0 conn(0x7f5bc8092020 legacy=0x7f5bc8128ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:23.108 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.090+0000 7f5ba77fe640 1 -- 10.20.193.110:0/847761369 >> v1:10.20.193.188:6789/0 conn(0x7f5bc8092020 legacy=0x7f5bc8128ca0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:27:23.109 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.094+0000 7f5bcd61b640 10 start_mon_command cmd=[{"prefix": "sync_force", "yes_i_really_mean_it": true}] 2026-02-13T20:27:23.109 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.094+0000 7f5bcd61b640 1 -- 10.20.193.110:0/847761369 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5bc814fbc0 con 0x7f5bc814f7f0 2026-02-13T20:27:23.109 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.095+0000 7f5ba77fe640 1 -- 10.20.193.110:0/847761369 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4209439504 0 0) 0x7f5bc814fbc0 con 0x7f5bc814f7f0 2026-02-13T20:27:23.109 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.095+0000 7f5ba77fe640 10 monclient(hunting): _negotiate 2026-02-13T20:27:23.110 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.095+0000 7f5ba77fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:23.110 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.095+0000 7f5ba77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:23.110 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.095+0000 7f5ba77fe640 10 monclient(hunting): my global_id is 144247 2026-02-13T20:27:23.110 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.095+0000 7f5ba77fe640 1 -- 10.20.193.110:0/847761369 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5bc80008d0 con 0x7f5bc814f7f0 2026-02-13T20:27:23.110 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.095+0000 7f5ba77fe640 1 -- 10.20.193.110:0/847761369 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1080507283 0 0) 0x7f5bc80008d0 con 0x7f5bc814f7f0 2026-02-13T20:27:23.110 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.095+0000 7f5ba77fe640 1 -- 10.20.193.110:0/847761369 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5bc814fbc0 con 0x7f5bc814f7f0 2026-02-13T20:27:23.110 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.095+0000 7f5ba77fe640 1 -- 10.20.193.110:0/847761369 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f5bbc004c40 con 0x7f5bc814f7f0 2026-02-13T20:27:23.110 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.095+0000 7f5ba77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:23.110 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.095+0000 7f5ba77fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:27:23.110 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.095+0000 7f5ba77fe640 10 monclient: dump: 2026-02-13T20:27:23.110 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:23.110 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:23.110 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:23.110 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:23.110 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:23.111 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:23.111 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:23.111 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:23.111 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:23.111 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:23.111 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.095+0000 7f5ba77fe640 1 -- 10.20.193.110:0/847761369 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 567736270 0 0) 0x7f5bc814fbc0 con 0x7f5bc814f7f0 2026-02-13T20:27:23.111 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.095+0000 7f5ba77fe640 1 -- 10.20.193.110:0/847761369 --> v1:10.20.193.188:6789/0 -- command(tid 2: {"prefix": "sync_force", "yes_i_really_mean_it": true}) -- 0x7f5bc804d8d0 con 0x7f5bc814f7f0 2026-02-13T20:27:23.111 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.095+0000 7f5ba77fe640 1 -- 10.20.193.110:0/847761369 <== mon.1 v1:10.20.193.188:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+83 (unknown 0 0 2946029456) 0x7f5bbc004ff0 con 0x7f5bc814f7f0 2026-02-13T20:27:23.111 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.095+0000 7f5ba77fe640 10 monclient: handle_command_reply 2 [{"prefix": "sync_force", "yes_i_really_mean_it": true}] 2026-02-13T20:27:23.111 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.095+0000 7f5ba77fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:27:23.111 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.095+0000 7f5ba77fe640 1 -- 10.20.193.110:0/847761369 >> v1:10.20.193.188:6789/0 conn(0x7f5bc814f7f0 legacy=0x7f5bc804d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:23.111 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.095+0000 7f5ba77fe640 1 -- 10.20.193.110:0/847761369 >> v1:10.20.193.188:6789/0 conn(0x7f5bc814f7f0 legacy=0x7f5bc804d1c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:27:23.112 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:27:23.112 INFO:teuthology.orchestra.run.trial110.stdout: "ret": 0, 2026-02-13T20:27:23.112 INFO:teuthology.orchestra.run.trial110.stdout: "msg": "forcing store sync the next time the monitor starts" 2026-02-13T20:27:23.112 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:27:23.113 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.096+0000 7f5bcd61b640 1 -- 10.20.193.110:0/847761369 >> v1:10.20.193.188:6812/1623052694 conn(0x7f5b9403faa0 legacy=0x7f5b9405ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:23.113 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.096+0000 7f5bcd61b640 10 monclient: shutdown 2026-02-13T20:27:23.113 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.096+0000 7f5bcd61b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:27:23.113 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.096+0000 7f5bcd61b640 1 -- 10.20.193.110:0/847761369 >> v1:10.20.193.110:6790/0 conn(0x7f5bc81401c0 legacy=0x7f5bc8193bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:23.113 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.096+0000 7f5bc77fe640 1 -- 10.20.193.110:0/847761369 reap_dead start 2026-02-13T20:27:23.113 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.096+0000 7f5bc77fe640 1 -- 10.20.193.110:0/847761369 reap_dead start 2026-02-13T20:27:23.113 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.096+0000 7f5bcd61b640 1 -- 10.20.193.110:0/847761369 shutdown_connections 2026-02-13T20:27:23.114 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.096+0000 7f5bcd61b640 1 -- 10.20.193.110:0/847761369 >> 10.20.193.110:0/847761369 conn(0x7f5bc8054e90 msgr2=0x7f5bc80898c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:27:23.114 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.096+0000 7f5bcd61b640 1 -- 10.20.193.110:0/847761369 shutdown_connections 2026-02-13T20:27:23.114 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.096+0000 7f5bcd61b640 1 -- 10.20.193.110:0/847761369 wait complete. 2026-02-13T20:27:23.114 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2026-02-13T20:27:23.114 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-13T20:27:23.114 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T20:27:23.125 INFO:tasks.ceph.mon.b:Stopped 2026-02-13T20:27:23.125 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-13T20:27:23.125 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T20:27:23.190 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.190+0000 7f4fbdf0c640 10 monclient: get_monmap_and_config 2026-02-13T20:27:23.190 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.190+0000 7f4fbdf0c640 10 monclient: build_initial_monmap 2026-02-13T20:27:23.190 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.190+0000 7f4fbdf0c640 10 monclient: monmap: 2026-02-13T20:27:23.190 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:27:23.190 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:23.191 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:27:23.190548+0000 2026-02-13T20:27:23.191 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:27:23.190548+0000 2026-02-13T20:27:23.191 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:27:23.191 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:23.191 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:27:23.191 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:27:23.191 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:27:23.191 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:23.199 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.190+0000 7f4fbdf0c640 1 Processor -- start 2026-02-13T20:27:23.199 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.190+0000 7f4fbdf0c640 1 -- start start 2026-02-13T20:27:23.200 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.190+0000 7f4fbdf0c640 10 monclient: init 2026-02-13T20:27:23.200 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.190+0000 7f4fbdf0c640 10 monclient: _reopen_session rank -1 2026-02-13T20:27:23.200 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.190+0000 7f4fbdf0c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:27:23.200 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.190+0000 7f4fbdf0c640 10 monclient(hunting): picked mon.noname-b con 0x7f4fb81401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:27:23.200 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.190+0000 7f4fbdf0c640 10 monclient(hunting): picked mon.noname-a con 0x7f4fb8092020 addr v1:10.20.193.110:6789/0 2026-02-13T20:27:23.200 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.190+0000 7f4fbdf0c640 10 monclient(hunting): picked mon.noname-c con 0x7f4fb8091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:27:23.200 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.190+0000 7f4fbdf0c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fb808b730 con 0x7f4fb8092020 2026-02-13T20:27:23.200 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.190+0000 7f4fbdf0c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fb805c5b0 con 0x7f4fb8091950 2026-02-13T20:27:23.200 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.190+0000 7f4fbdf0c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fb808bcf0 con 0x7f4fb81401c0 2026-02-13T20:27:23.200 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.190+0000 7f4fbdf0c640 10 monclient(hunting): _renew_subs 2026-02-13T20:27:23.201 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.190+0000 7f4fbdf0c640 10 monclient(hunting): authenticate will time out at 1604.880847s 2026-02-13T20:27:23.201 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.190+0000 7f4fb77fe640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f4fb81401c0 0x7f4fb8091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:57958/0 (socket says 10.20.193.110:57958) 2026-02-13T20:27:23.201 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.190+0000 7f4fb77fe640 1 -- 10.20.193.110:0/541185953 learned_addr learned my addr 10.20.193.110:0/541185953 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:27:23.201 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.190+0000 7f4fb7fff640 1 -- 10.20.193.110:0/541185953 >> v1:10.20.193.188:6789/0 conn(0x7f4fb8091950 legacy=0x7f4fb81a2a20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:27:23.201 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.191+0000 7f4fb67fc640 1 -- 10.20.193.110:0/541185953 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3117098521 0 0) 0x7f4fb808bcf0 con 0x7f4fb81401c0 2026-02-13T20:27:23.201 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.191+0000 7f4fb67fc640 10 monclient(hunting): _negotiate 2026-02-13T20:27:23.201 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.191+0000 7f4fb67fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:23.201 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.191+0000 7f4fb67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:23.201 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.191+0000 7f4fb67fc640 10 monclient(hunting): my global_id is 154166 2026-02-13T20:27:23.201 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.191+0000 7f4fb67fc640 1 -- 10.20.193.110:0/541185953 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f9c0035e0 con 0x7f4fb81401c0 2026-02-13T20:27:23.201 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.191+0000 7f4fb67fc640 1 -- 10.20.193.110:0/541185953 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3088851485 0 0) 0x7f4fb808b730 con 0x7f4fb8092020 2026-02-13T20:27:23.201 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.191+0000 7f4fb67fc640 10 monclient(hunting): _negotiate 2026-02-13T20:27:23.202 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.191+0000 7f4fb67fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:23.202 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.191+0000 7f4fb67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:23.202 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.191+0000 7f4fb67fc640 10 monclient(hunting): my global_id is 124458 2026-02-13T20:27:23.202 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.191+0000 7f4fb67fc640 1 -- 10.20.193.110:0/541185953 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fb808bcf0 con 0x7f4fb8092020 2026-02-13T20:27:23.202 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.191+0000 7f4fb67fc640 1 -- 10.20.193.110:0/541185953 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 176649873 0 0) 0x7f4f9c0035e0 con 0x7f4fb81401c0 2026-02-13T20:27:23.202 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.191+0000 7f4fb67fc640 1 -- 10.20.193.110:0/541185953 >> v1:10.20.193.188:6789/0 conn(0x7f4fb8091950 legacy=0x7f4fb81a2a20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:27:23.202 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.191+0000 7f4fb67fc640 1 -- 10.20.193.110:0/541185953 >> v1:10.20.193.110:6789/0 conn(0x7f4fb8092020 legacy=0x7f4fb81812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:23.202 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.191+0000 7f4fb67fc640 10 monclient: _finish_hunting 0 2026-02-13T20:27:23.202 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.191+0000 7f4fb67fc640 1 monclient: found mon.noname-b 2026-02-13T20:27:23.202 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.191+0000 7f4fb67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:27:23.202 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.191+0000 7f4fb67fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:27:23.202 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.191+0000 7f4fb67fc640 1 -- 10.20.193.110:0/541185953 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fb8140590 con 0x7f4fb81401c0 2026-02-13T20:27:23.203 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.191+0000 7f4fb67fc640 10 monclient: _finish_auth 0 2026-02-13T20:27:23.203 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.191+0000 7f4fb67fc640 10 monclient: _check_auth_tickets 2026-02-13T20:27:23.203 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.191+0000 7f4fb67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:27:23.203 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.191+0000 7f4fbdf0c640 5 monclient: authenticate success, global_id 154166 2026-02-13T20:27:23.203 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.191+0000 7f4fb67fc640 1 -- 10.20.193.110:0/541185953 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f4fa4002dd0 con 0x7f4fb81401c0 2026-02-13T20:27:23.203 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.191+0000 7f4fbdf0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:27:23.203 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.191+0000 7f4fb67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:23.203 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.191+0000 7f4fb67fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:27:23.203 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.191+0000 7f4fb67fc640 10 monclient: dump: 2026-02-13T20:27:23.203 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:23.203 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:23.203 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:23.204 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:23.204 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:23.204 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:23.204 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:23.204 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:23.204 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:23.204 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:23.204 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.191+0000 7f4fbdf0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:27:23.204 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.191+0000 7f4fb67fc640 1 -- 10.20.193.110:0/541185953 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4fa4002f60 con 0x7f4fb81401c0 2026-02-13T20:27:23.204 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.191+0000 7f4fb67fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:27:23.204 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.191+0000 7f4fb67fc640 1 -- 10.20.193.110:0/541185953 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f4fa4003370 con 0x7f4fb81401c0 2026-02-13T20:27:23.204 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.191+0000 7f4fbdf0c640 10 monclient: get_monmap_and_config success 2026-02-13T20:27:23.204 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.191+0000 7f4fb67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:23.205 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.191+0000 7f4fbdf0c640 4 set_mon_vals no callback set 2026-02-13T20:27:23.205 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.191+0000 7f4fb67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:27:23.205 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.191+0000 7f4fb67fc640 10 monclient: dump: 2026-02-13T20:27:23.205 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:23.205 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:23.205 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:23.205 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:23.205 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:23.205 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:23.205 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:23.205 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:23.205 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:23.206 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:23.206 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.191+0000 7f4fbdf0c640 10 monclient: shutdown 2026-02-13T20:27:23.206 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.191+0000 7f4fbdf0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:27:23.206 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.191+0000 7f4fbdf0c640 1 -- 10.20.193.110:0/541185953 >> v1:10.20.193.110:6790/0 conn(0x7f4fb81401c0 legacy=0x7f4fb8091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:23.206 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.191+0000 7f4fbdf0c640 1 -- 10.20.193.110:0/541185953 shutdown_connections 2026-02-13T20:27:23.206 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.191+0000 7f4fbdf0c640 1 -- 10.20.193.110:0/541185953 >> 10.20.193.110:0/541185953 conn(0x7f4fb8054e90 msgr2=0x7f4fb8058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:27:23.206 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.191+0000 7f4fbdf0c640 1 -- 10.20.193.110:0/541185953 shutdown_connections 2026-02-13T20:27:23.206 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.191+0000 7f4fbdf0c640 1 -- 10.20.193.110:0/541185953 wait complete. 2026-02-13T20:27:23.206 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.192+0000 7f4fbdf0c640 10 monclient: build_initial_monmap 2026-02-13T20:27:23.206 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.192+0000 7f4fbdf0c640 10 monclient: monmap: 2026-02-13T20:27:23.206 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:27:23.206 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:27:23.207 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:27:23.207 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:27:23.207 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:27:23.207 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:27:23.207 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:27:23.207 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:27:23.207 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:27:23.207 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:23.207 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.192+0000 7f4fbdf0c640 1 Processor -- start 2026-02-13T20:27:23.207 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.192+0000 7f4fbdf0c640 1 -- start start 2026-02-13T20:27:23.207 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.192+0000 7f4fbdf0c640 10 monclient: init 2026-02-13T20:27:23.207 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.192+0000 7f4fbdf0c640 10 monclient: _reopen_session rank -1 2026-02-13T20:27:23.208 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.192+0000 7f4fbdf0c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:27:23.208 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.192+0000 7f4fbdf0c640 10 monclient(hunting): picked mon.noname-b con 0x7f4fb8091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:27:23.208 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.192+0000 7f4fbdf0c640 10 monclient(hunting): picked mon.noname-a con 0x7f4fb81401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:27:23.208 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.192+0000 7f4fbdf0c640 10 monclient(hunting): picked mon.noname-c con 0x7f4fb81160d0 addr v1:10.20.193.110:6790/0 2026-02-13T20:27:23.208 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.192+0000 7f4fbdf0c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fb808c2a0 con 0x7f4fb81401c0 2026-02-13T20:27:23.208 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.192+0000 7f4fbdf0c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fb805d320 con 0x7f4fb8091950 2026-02-13T20:27:23.208 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.192+0000 7f4fbdf0c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fb812f4e0 con 0x7f4fb81160d0 2026-02-13T20:27:23.208 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.192+0000 7f4fbdf0c640 10 monclient(hunting): _renew_subs 2026-02-13T20:27:23.208 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.192+0000 7f4fbdf0c640 10 monclient(hunting): authenticate will time out at 1604.882804s 2026-02-13T20:27:23.208 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.192+0000 7f4fb77fe640 1 -- >> v1:10.20.193.188:6789/0 conn(0x7f4fb8091950 legacy=0x7f4fb81168a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:27:23.208 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.192+0000 7f4fb6ffd640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f4fb81401c0 0x7f4fb81a1020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:57976/0 (socket says 10.20.193.110:57976) 2026-02-13T20:27:23.208 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.192+0000 7f4fb6ffd640 1 -- 10.20.193.110:0/2254667306 learned_addr learned my addr 10.20.193.110:0/2254667306 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:27:23.209 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4f93fff640 1 -- 10.20.193.110:0/2254667306 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1858452538 0 0) 0x7f4fb808c2a0 con 0x7f4fb81401c0 2026-02-13T20:27:23.209 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4f93fff640 10 monclient(hunting): _negotiate 2026-02-13T20:27:23.209 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4f93fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:23.209 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4f93fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:23.209 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4f93fff640 10 monclient(hunting): my global_id is 124461 2026-02-13T20:27:23.209 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4f93fff640 1 -- 10.20.193.110:0/2254667306 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f880035e0 con 0x7f4fb81401c0 2026-02-13T20:27:23.209 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4f93fff640 1 -- 10.20.193.110:0/2254667306 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 88729471 0 0) 0x7f4fb812f4e0 con 0x7f4fb81160d0 2026-02-13T20:27:23.209 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4f93fff640 10 monclient(hunting): _negotiate 2026-02-13T20:27:23.209 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4f93fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:23.209 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4f93fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:23.209 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4f93fff640 10 monclient(hunting): my global_id is 154169 2026-02-13T20:27:23.209 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4f93fff640 1 -- 10.20.193.110:0/2254667306 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fb808c2a0 con 0x7f4fb81160d0 2026-02-13T20:27:23.210 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4f93fff640 1 -- 10.20.193.110:0/2254667306 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1916905396 0 0) 0x7f4fb808c2a0 con 0x7f4fb81160d0 2026-02-13T20:27:23.210 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4f93fff640 1 -- 10.20.193.110:0/2254667306 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4fb812f4e0 con 0x7f4fb81160d0 2026-02-13T20:27:23.210 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4f93fff640 1 -- 10.20.193.110:0/2254667306 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f4fac0050e0 con 0x7f4fb81160d0 2026-02-13T20:27:23.210 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4f93fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:27:23.210 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4f93fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:27:23.210 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4f93fff640 10 monclient(hunting): dump: 2026-02-13T20:27:23.210 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:23.210 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:23.210 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:23.210 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:23.210 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:23.210 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:23.210 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:23.211 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:23.211 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:23.211 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:23.211 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4f93fff640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:27:23.211 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4f93fff640 1 -- 10.20.193.110:0/2254667306 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3425936526 0 0) 0x7f4f880035e0 con 0x7f4fb81401c0 2026-02-13T20:27:23.211 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4f93fff640 1 -- 10.20.193.110:0/2254667306 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4fb808c2a0 con 0x7f4fb81401c0 2026-02-13T20:27:23.211 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4f93fff640 1 -- 10.20.193.110:0/2254667306 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f4fa8003170 con 0x7f4fb81401c0 2026-02-13T20:27:23.211 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4f93fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:27:23.211 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4f93fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:27:23.211 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4f93fff640 10 monclient(hunting): dump: 2026-02-13T20:27:23.211 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:23.211 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:23.212 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:23.212 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:23.212 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:23.212 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:23.212 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:23.212 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:23.212 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:23.212 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:23.212 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4f93fff640 1 -- 10.20.193.110:0/2254667306 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2899597759 0 0) 0x7f4fb812f4e0 con 0x7f4fb81160d0 2026-02-13T20:27:23.212 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4f93fff640 1 -- 10.20.193.110:0/2254667306 >> v1:10.20.193.188:6789/0 conn(0x7f4fb8091950 legacy=0x7f4fb81168a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T20:27:23.212 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4f93fff640 1 -- 10.20.193.110:0/2254667306 >> v1:10.20.193.110:6789/0 conn(0x7f4fb81401c0 legacy=0x7f4fb81a1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:23.212 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4f93fff640 10 monclient: _finish_hunting 0 2026-02-13T20:27:23.212 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4f93fff640 1 monclient: found mon.c 2026-02-13T20:27:23.213 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4f93fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:27:23.213 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4f93fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:27:23.213 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4f93fff640 1 -- 10.20.193.110:0/2254667306 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fb8116fb0 con 0x7f4fb81160d0 2026-02-13T20:27:23.213 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4f93fff640 10 monclient: _finish_auth 0 2026-02-13T20:27:23.213 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4f93fff640 10 monclient: _check_auth_tickets 2026-02-13T20:27:23.213 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4f93fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:27:23.213 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4fbdf0c640 5 monclient: authenticate success, global_id 154169 2026-02-13T20:27:23.213 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4fbdf0c640 10 monclient: _renew_subs 2026-02-13T20:27:23.213 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4fbdf0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:27:23.213 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4fbdf0c640 1 -- 10.20.193.110:0/2254667306 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4fb812dd80 con 0x7f4fb81160d0 2026-02-13T20:27:23.213 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4fbdf0c640 10 monclient: _renew_subs 2026-02-13T20:27:23.213 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4fbdf0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:27:23.214 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4fbdf0c640 1 -- 10.20.193.110:0/2254667306 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f4fb812d9c0 con 0x7f4fb81160d0 2026-02-13T20:27:23.214 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4f93fff640 1 -- 10.20.193.110:0/2254667306 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4fac005320 con 0x7f4fb81160d0 2026-02-13T20:27:23.214 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4f93fff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:27:23.214 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4f93fff640 1 -- 10.20.193.110:0/2254667306 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f4fac005700 con 0x7f4fb81160d0 2026-02-13T20:27:23.214 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4f93fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:23.214 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4f93fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:27:23.214 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4fb5ffb640 4 set_mon_vals no callback set 2026-02-13T20:27:23.214 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4f93fff640 10 monclient: dump: 2026-02-13T20:27:23.214 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:23.214 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:23.214 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:23.214 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:23.215 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:23.215 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:23.215 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:23.215 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:23.215 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:23.215 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:23.215 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4fbdf0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:27:23.215 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4fbdf0c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:27:23.215 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4fbdf0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:27:23.215 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4fbdf0c640 1 -- 10.20.193.110:0/2254667306 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fb812f0b0 con 0x7f4fb81160d0 2026-02-13T20:27:23.215 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.193+0000 7f4f93fff640 1 -- 10.20.193.110:0/2254667306 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f4fac005860 con 0x7f4fb81160d0 2026-02-13T20:27:23.215 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.194+0000 7f4f93fff640 1 -- 10.20.193.110:0/2254667306 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(773..773 src has 1..773) ==== 3947+0+0 (unknown 2595509352 0 0) 0x7f4fac04f750 con 0x7f4fb81160d0 2026-02-13T20:27:23.216 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.194+0000 7f4fb77fe640 10 monclient: get_auth_request con 0x7f4f8803fa00 auth_method 0 2026-02-13T20:27:23.216 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.196+0000 7f4f93fff640 1 -- 10.20.193.110:0/2254667306 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f4fac017f30 con 0x7f4fb81160d0 2026-02-13T20:27:23.216 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.196+0000 7f4f93fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:27:23.216 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.196+0000 7f4f93fff640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:27:23.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.339+0000 7f4fbdf0c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T20:27:23.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.339+0000 7f4fbdf0c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T20:27:23.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.339+0000 7f4fbdf0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:27:23.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.339+0000 7f4fbdf0c640 1 -- 10.20.193.110:0/2254667306 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f4fb8055bb0 con 0x7f4fb81160d0 2026-02-13T20:27:23.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.340+0000 7f4f93fff640 1 -- 10.20.193.110:0/2254667306 <== mon.2 v1:10.20.193.110:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 2330689784) 0x7f4fac015ec0 con 0x7f4fb81160d0 2026-02-13T20:27:23.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.340+0000 7f4f93fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T20:27:23.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.340+0000 7f4f93fff640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:27:23.341 INFO:teuthology.orchestra.run.trial110.stdout:{"election_epoch":58,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","modified":"2026-02-13T20:11:07.161192Z","created":"2026-02-13T20:11:07.161192Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6789","nonce":0}]},"addr":"10.20.193.110:6789/0","public_addr":"10.20.193.110:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161241+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6789","nonce":0}]},"addr":"10.20.193.188:6789/0","public_addr":"10.20.193.188:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161242+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6790","nonce":0}]},"addr":"10.20.193.110:6790/0","public_addr":"10.20.193.110:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161243+0000","crush_location":[]}]}} 2026-02-13T20:27:23.342 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.341+0000 7f4fbdf0c640 1 -- 10.20.193.110:0/2254667306 >> v1:10.20.193.188:6812/1623052694 conn(0x7f4f8803fa00 legacy=0x7f4f8805feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:23.342 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.341+0000 7f4fbdf0c640 10 monclient: shutdown 2026-02-13T20:27:23.342 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.341+0000 7f4fbdf0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:27:23.342 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.341+0000 7f4fbdf0c640 1 -- 10.20.193.110:0/2254667306 >> v1:10.20.193.110:6790/0 conn(0x7f4fb81160d0 legacy=0x7f4fb81a2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:23.342 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.341+0000 7f4fbdf0c640 1 -- 10.20.193.110:0/2254667306 shutdown_connections 2026-02-13T20:27:23.342 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.341+0000 7f4fbdf0c640 1 -- 10.20.193.110:0/2254667306 >> 10.20.193.110:0/2254667306 conn(0x7f4fb8054e90 msgr2=0x7f4fb808dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:27:23.342 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.341+0000 7f4fbdf0c640 1 -- 10.20.193.110:0/2254667306 shutdown_connections 2026-02-13T20:27:23.342 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:23.341+0000 7f4fbdf0c640 1 -- 10.20.193.110:0/2254667306 wait complete. 2026-02-13T20:27:26.349 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T20:27:26.416 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.415+0000 7f42cfc1b640 10 monclient: get_monmap_and_config 2026-02-13T20:27:26.416 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.415+0000 7f42cfc1b640 10 monclient: build_initial_monmap 2026-02-13T20:27:26.416 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.415+0000 7f42cfc1b640 10 monclient: monmap: 2026-02-13T20:27:26.416 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:27:26.416 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:26.417 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:27:26.416265+0000 2026-02-13T20:27:26.417 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:27:26.416265+0000 2026-02-13T20:27:26.417 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:27:26.417 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:26.417 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:27:26.417 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:27:26.417 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:27:26.417 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:26.425 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.416+0000 7f42cfc1b640 1 Processor -- start 2026-02-13T20:27:26.425 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.416+0000 7f42cfc1b640 1 -- start start 2026-02-13T20:27:26.425 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.416+0000 7f42cfc1b640 10 monclient: init 2026-02-13T20:27:26.425 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.416+0000 7f42cfc1b640 10 monclient: _reopen_session rank -1 2026-02-13T20:27:26.425 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.416+0000 7f42cfc1b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:27:26.425 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.416+0000 7f42cfc1b640 10 monclient(hunting): picked mon.noname-a con 0x7f42c805a420 addr v1:10.20.193.110:6789/0 2026-02-13T20:27:26.425 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.416+0000 7f42cfc1b640 10 monclient(hunting): picked mon.noname-c con 0x7f42c813fb80 addr v1:10.20.193.188:6789/0 2026-02-13T20:27:26.426 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.416+0000 7f42cfc1b640 10 monclient(hunting): picked mon.noname-b con 0x7f42c8089b00 addr v1:10.20.193.110:6790/0 2026-02-13T20:27:26.426 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.416+0000 7f42cfc1b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42c805a7f0 con 0x7f42c805a420 2026-02-13T20:27:26.426 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.416+0000 7f42cfc1b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42c813d000 con 0x7f42c813fb80 2026-02-13T20:27:26.426 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.416+0000 7f42cfc1b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42c808a8d0 con 0x7f42c8089b00 2026-02-13T20:27:26.426 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.416+0000 7f42cfc1b640 10 monclient(hunting): _renew_subs 2026-02-13T20:27:26.426 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.416+0000 7f42cfc1b640 10 monclient(hunting): authenticate will time out at 1608.106695s 2026-02-13T20:27:26.426 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.416+0000 7f42cd18f640 1 -- >> v1:10.20.193.188:6789/0 conn(0x7f42c813fb80 legacy=0x7f42c81801c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:27:26.426 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.416+0000 7f42ce191640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f42c8089b00 0x7f42c81a18f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:57980/0 (socket says 10.20.193.110:57980) 2026-02-13T20:27:26.426 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.416+0000 7f42cd990640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f42c805a420 0x7f42c813f470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:57980/0 (socket says 10.20.193.110:57980) 2026-02-13T20:27:26.426 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.416+0000 7f42ce191640 1 -- 10.20.193.110:0/36037437 learned_addr learned my addr 10.20.193.110:0/36037437 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:27:26.426 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.416+0000 7f42cc98e640 1 -- 10.20.193.110:0/36037437 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 223062669 0 0) 0x7f42c808a8d0 con 0x7f42c8089b00 2026-02-13T20:27:26.426 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.416+0000 7f42cc98e640 10 monclient(hunting): _negotiate 2026-02-13T20:27:26.427 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.417+0000 7f42cc98e640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:26.427 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.417+0000 7f42cc98e640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:26.427 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.417+0000 7f42cc98e640 10 monclient(hunting): my global_id is 154172 2026-02-13T20:27:26.427 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.417+0000 7f42cc98e640 1 -- 10.20.193.110:0/36037437 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42b00035e0 con 0x7f42c8089b00 2026-02-13T20:27:26.427 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.417+0000 7f42cc98e640 1 -- 10.20.193.110:0/36037437 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3350457148 0 0) 0x7f42b00035e0 con 0x7f42c8089b00 2026-02-13T20:27:26.427 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.417+0000 7f42cc98e640 1 -- 10.20.193.110:0/36037437 >> v1:10.20.193.188:6789/0 conn(0x7f42c813fb80 legacy=0x7f42c81801c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:27:26.427 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.417+0000 7f42cc98e640 1 -- 10.20.193.110:0/36037437 >> v1:10.20.193.110:6789/0 conn(0x7f42c805a420 legacy=0x7f42c813f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:26.427 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.417+0000 7f42cc98e640 10 monclient: _finish_hunting 0 2026-02-13T20:27:26.427 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.417+0000 7f42cc98e640 1 monclient: found mon.noname-b 2026-02-13T20:27:26.427 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.417+0000 7f42cc98e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:27:26.427 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.417+0000 7f42cc98e640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:27:26.427 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.417+0000 7f42cc98e640 1 -- 10.20.193.110:0/36037437 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42c808abb0 con 0x7f42c8089b00 2026-02-13T20:27:26.427 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.417+0000 7f42cc98e640 10 monclient: _finish_auth 0 2026-02-13T20:27:26.428 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.417+0000 7f42cc98e640 10 monclient: _check_auth_tickets 2026-02-13T20:27:26.428 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.417+0000 7f42cc98e640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:27:26.428 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.417+0000 7f42cc98e640 1 -- 10.20.193.110:0/36037437 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f42c4003eb0 con 0x7f42c8089b00 2026-02-13T20:27:26.428 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.417+0000 7f42cc98e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:26.428 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.417+0000 7f42cc98e640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:27:26.428 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.417+0000 7f42cc98e640 10 monclient: dump: 2026-02-13T20:27:26.428 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:26.428 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:26.428 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:26.428 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:26.428 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:26.428 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:26.429 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:26.429 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:26.429 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:26.429 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:26.429 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.417+0000 7f42cfc1b640 5 monclient: authenticate success, global_id 154172 2026-02-13T20:27:26.429 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.417+0000 7f42cfc1b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:27:26.429 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.417+0000 7f42cc98e640 1 -- 10.20.193.110:0/36037437 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f42c40040f0 con 0x7f42c8089b00 2026-02-13T20:27:26.429 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.417+0000 7f42cc98e640 10 monclient: handle_config config(0 keys) 2026-02-13T20:27:26.429 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.417+0000 7f42cc98e640 1 -- 10.20.193.110:0/36037437 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f42c4004500 con 0x7f42c8089b00 2026-02-13T20:27:26.429 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.417+0000 7f42cfc1b640 10 monclient: get_monmap_and_config success 2026-02-13T20:27:26.429 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.417+0000 7f42cfc1b640 4 set_mon_vals no callback set 2026-02-13T20:27:26.430 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.417+0000 7f42cc98e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:26.430 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.417+0000 7f42cc98e640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:27:26.430 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.417+0000 7f42cc98e640 10 monclient: dump: 2026-02-13T20:27:26.430 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:26.430 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:26.430 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:26.430 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:26.430 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:26.430 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:26.430 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:26.430 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:26.430 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:26.430 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:26.431 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.417+0000 7f42cfc1b640 10 monclient: shutdown 2026-02-13T20:27:26.431 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.417+0000 7f42cfc1b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:27:26.431 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.417+0000 7f42cfc1b640 1 -- 10.20.193.110:0/36037437 >> v1:10.20.193.110:6790/0 conn(0x7f42c8089b00 legacy=0x7f42c81a18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:26.431 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.417+0000 7f42cfc1b640 1 -- 10.20.193.110:0/36037437 shutdown_connections 2026-02-13T20:27:26.431 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.417+0000 7f42cfc1b640 1 -- 10.20.193.110:0/36037437 >> 10.20.193.110:0/36037437 conn(0x7f42c8054e90 msgr2=0x7f42c8058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:27:26.431 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.417+0000 7f42cfc1b640 1 -- 10.20.193.110:0/36037437 shutdown_connections 2026-02-13T20:27:26.431 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.417+0000 7f42cfc1b640 1 -- 10.20.193.110:0/36037437 wait complete. 2026-02-13T20:27:26.431 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.417+0000 7f42cfc1b640 10 monclient: build_initial_monmap 2026-02-13T20:27:26.431 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.417+0000 7f42cfc1b640 10 monclient: monmap: 2026-02-13T20:27:26.431 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:27:26.431 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:27:26.431 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:27:26.432 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:27:26.432 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:27:26.432 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:27:26.432 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:27:26.432 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:27:26.432 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:27:26.432 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:26.432 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.418+0000 7f42cfc1b640 1 Processor -- start 2026-02-13T20:27:26.432 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.418+0000 7f42cfc1b640 1 -- start start 2026-02-13T20:27:26.432 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.418+0000 7f42cfc1b640 10 monclient: init 2026-02-13T20:27:26.432 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.418+0000 7f42cfc1b640 10 monclient: _reopen_session rank -1 2026-02-13T20:27:26.432 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.418+0000 7f42cfc1b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:27:26.433 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.418+0000 7f42cfc1b640 10 monclient(hunting): picked mon.noname-b con 0x7f42c805a420 addr v1:10.20.193.188:6789/0 2026-02-13T20:27:26.433 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.418+0000 7f42cfc1b640 10 monclient(hunting): picked mon.noname-c con 0x7f42c8089b00 addr v1:10.20.193.110:6790/0 2026-02-13T20:27:26.433 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.418+0000 7f42cfc1b640 10 monclient(hunting): picked mon.noname-a con 0x7f42c813fb80 addr v1:10.20.193.110:6789/0 2026-02-13T20:27:26.433 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.418+0000 7f42cfc1b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42c805d320 con 0x7f42c813fb80 2026-02-13T20:27:26.433 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.418+0000 7f42cfc1b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42c8131880 con 0x7f42c805a420 2026-02-13T20:27:26.433 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.418+0000 7f42cfc1b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42c8059760 con 0x7f42c8089b00 2026-02-13T20:27:26.433 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.418+0000 7f42cfc1b640 10 monclient(hunting): _renew_subs 2026-02-13T20:27:26.433 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.418+0000 7f42cfc1b640 10 monclient(hunting): authenticate will time out at 1608.108450s 2026-02-13T20:27:26.433 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.418+0000 7f42cd990640 1 -- >> v1:10.20.193.188:6789/0 conn(0x7f42c805a420 legacy=0x7f42c812d5b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:27:26.433 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.418+0000 7f42cd18f640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f42c8089b00 0x7f42c812dcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:57992/0 (socket says 10.20.193.110:57992) 2026-02-13T20:27:26.433 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.418+0000 7f42cd18f640 1 -- 10.20.193.110:0/3472467545 learned_addr learned my addr 10.20.193.110:0/3472467545 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:27:26.433 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.418+0000 7f42b67fc640 1 -- 10.20.193.110:0/3472467545 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4042377868 0 0) 0x7f42c8059760 con 0x7f42c8089b00 2026-02-13T20:27:26.433 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.418+0000 7f42b67fc640 10 monclient(hunting): _negotiate 2026-02-13T20:27:26.434 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.418+0000 7f42b67fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:26.434 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.418+0000 7f42b67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:26.434 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.418+0000 7f42b67fc640 10 monclient(hunting): my global_id is 154175 2026-02-13T20:27:26.434 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.418+0000 7f42b67fc640 1 -- 10.20.193.110:0/3472467545 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42980035e0 con 0x7f42c8089b00 2026-02-13T20:27:26.434 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.418+0000 7f42b67fc640 1 -- 10.20.193.110:0/3472467545 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 743463433 0 0) 0x7f42980035e0 con 0x7f42c8089b00 2026-02-13T20:27:26.434 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.418+0000 7f42b67fc640 1 -- 10.20.193.110:0/3472467545 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f42c8059760 con 0x7f42c8089b00 2026-02-13T20:27:26.434 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.418+0000 7f42b67fc640 1 -- 10.20.193.110:0/3472467545 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f42bc0041d0 con 0x7f42c8089b00 2026-02-13T20:27:26.434 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.418+0000 7f42b67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:27:26.434 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.418+0000 7f42b67fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:27:26.434 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.418+0000 7f42b67fc640 10 monclient(hunting): dump: 2026-02-13T20:27:26.434 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:26.434 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:26.435 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:26.435 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:26.435 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:26.435 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:26.435 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:26.435 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:26.435 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:26.435 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:26.435 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.418+0000 7f42b67fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:27:26.435 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.418+0000 7f42b67fc640 1 -- 10.20.193.110:0/3472467545 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3204760524 0 0) 0x7f42c8059760 con 0x7f42c8089b00 2026-02-13T20:27:26.435 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.418+0000 7f42b67fc640 1 -- 10.20.193.110:0/3472467545 >> v1:10.20.193.188:6789/0 conn(0x7f42c805a420 legacy=0x7f42c812d5b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T20:27:26.435 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.418+0000 7f42b67fc640 1 -- 10.20.193.110:0/3472467545 >> v1:10.20.193.110:6789/0 conn(0x7f42c813fb80 legacy=0x7f42c823bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:26.435 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.418+0000 7f42b67fc640 10 monclient: _finish_hunting 0 2026-02-13T20:27:26.436 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.418+0000 7f42b67fc640 1 monclient: found mon.c 2026-02-13T20:27:26.436 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.418+0000 7f42b67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:27:26.436 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.418+0000 7f42b67fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:27:26.436 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.418+0000 7f42b67fc640 1 -- 10.20.193.110:0/3472467545 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42c81310a0 con 0x7f42c8089b00 2026-02-13T20:27:26.436 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.418+0000 7f42b67fc640 10 monclient: _finish_auth 0 2026-02-13T20:27:26.436 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.418+0000 7f42b67fc640 10 monclient: _check_auth_tickets 2026-02-13T20:27:26.436 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.418+0000 7f42b67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:27:26.436 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.418+0000 7f42cfc1b640 5 monclient: authenticate success, global_id 154175 2026-02-13T20:27:26.436 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.418+0000 7f42cfc1b640 10 monclient: _renew_subs 2026-02-13T20:27:26.436 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.418+0000 7f42cfc1b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:27:26.436 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.418+0000 7f42cfc1b640 1 -- 10.20.193.110:0/3472467545 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f42c8131380 con 0x7f42c8089b00 2026-02-13T20:27:26.436 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.419+0000 7f42cfc1b640 10 monclient: _renew_subs 2026-02-13T20:27:26.437 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.419+0000 7f42cfc1b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:27:26.437 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.419+0000 7f42cfc1b640 1 -- 10.20.193.110:0/3472467545 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f42c8130dc0 con 0x7f42c8089b00 2026-02-13T20:27:26.437 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.419+0000 7f42b67fc640 1 -- 10.20.193.110:0/3472467545 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f42bc004410 con 0x7f42c8089b00 2026-02-13T20:27:26.437 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.419+0000 7f42b67fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:27:26.437 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.419+0000 7f42b67fc640 1 -- 10.20.193.110:0/3472467545 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f42bc0047f0 con 0x7f42c8089b00 2026-02-13T20:27:26.437 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.419+0000 7f42b67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:26.437 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.419+0000 7f42b67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:27:26.437 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.419+0000 7f42b7fff640 4 set_mon_vals no callback set 2026-02-13T20:27:26.437 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.419+0000 7f42b67fc640 10 monclient: dump: 2026-02-13T20:27:26.437 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:26.437 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:26.437 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:26.437 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:26.438 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:26.438 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:26.438 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:26.438 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:26.438 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:26.438 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:26.438 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.419+0000 7f42cfc1b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:27:26.438 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.419+0000 7f42cfc1b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:27:26.438 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.419+0000 7f42cfc1b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:27:26.438 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.419+0000 7f42cfc1b640 1 -- 10.20.193.110:0/3472467545 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42c80008d0 con 0x7f42c8089b00 2026-02-13T20:27:26.438 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.419+0000 7f42b67fc640 1 -- 10.20.193.110:0/3472467545 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f42bc004950 con 0x7f42c8089b00 2026-02-13T20:27:26.438 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.419+0000 7f42b67fc640 1 -- 10.20.193.110:0/3472467545 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(773..773 src has 1..773) ==== 3947+0+0 (unknown 2595509352 0 0) 0x7f42bc04e930 con 0x7f42c8089b00 2026-02-13T20:27:26.438 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.420+0000 7f42cd990640 10 monclient: get_auth_request con 0x7f429803f630 auth_method 0 2026-02-13T20:27:26.439 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.421+0000 7f42b67fc640 1 -- 10.20.193.110:0/3472467545 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f42bc017060 con 0x7f42c8089b00 2026-02-13T20:27:26.439 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.422+0000 7f42b67fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:27:26.439 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.422+0000 7f42b67fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:27:26.566 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.566+0000 7f42cfc1b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T20:27:26.567 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.566+0000 7f42cfc1b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T20:27:26.567 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.566+0000 7f42cfc1b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:27:26.567 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.566+0000 7f42cfc1b640 1 -- 10.20.193.110:0/3472467545 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f42c8058410 con 0x7f42c8089b00 2026-02-13T20:27:26.567 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.566+0000 7f42b67fc640 1 -- 10.20.193.110:0/3472467545 <== mon.2 v1:10.20.193.110:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 3968133592) 0x7f42bc014ff0 con 0x7f42c8089b00 2026-02-13T20:27:26.567 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.566+0000 7f42b67fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T20:27:26.567 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.566+0000 7f42b67fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:27:26.568 INFO:teuthology.orchestra.run.trial110.stdout:{"election_epoch":58,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":5,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","modified":"2026-02-13T20:11:07.161192Z","created":"2026-02-13T20:11:07.161192Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6789","nonce":0}]},"addr":"10.20.193.110:6789/0","public_addr":"10.20.193.110:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161241+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6789","nonce":0}]},"addr":"10.20.193.188:6789/0","public_addr":"10.20.193.188:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161242+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6790","nonce":0}]},"addr":"10.20.193.110:6790/0","public_addr":"10.20.193.110:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161243+0000","crush_location":[]}]}} 2026-02-13T20:27:26.569 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.567+0000 7f42cfc1b640 1 -- 10.20.193.110:0/3472467545 >> v1:10.20.193.188:6812/1623052694 conn(0x7f429803f630 legacy=0x7f429805fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:26.569 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.567+0000 7f42cfc1b640 10 monclient: shutdown 2026-02-13T20:27:26.569 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.567+0000 7f42cfc1b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:27:26.569 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.567+0000 7f42cfc1b640 1 -- 10.20.193.110:0/3472467545 >> v1:10.20.193.110:6790/0 conn(0x7f42c8089b00 legacy=0x7f42c812dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:26.569 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.567+0000 7f42cfc1b640 1 -- 10.20.193.110:0/3472467545 shutdown_connections 2026-02-13T20:27:26.569 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.567+0000 7f42cfc1b640 1 -- 10.20.193.110:0/3472467545 >> 10.20.193.110:0/3472467545 conn(0x7f42c8054e90 msgr2=0x7f42c813d200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:27:26.569 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.567+0000 7f42cfc1b640 1 -- 10.20.193.110:0/3472467545 shutdown_connections 2026-02-13T20:27:26.569 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:26.567+0000 7f42cfc1b640 1 -- 10.20.193.110:0/3472467545 wait complete. 2026-02-13T20:27:29.576 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T20:27:29.641 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:29.641+0000 7fe41361b640 10 monclient: get_monmap_and_config 2026-02-13T20:27:29.641 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:29.641+0000 7fe41361b640 10 monclient: build_initial_monmap 2026-02-13T20:27:29.641 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:29.641+0000 7fe41361b640 10 monclient: monmap: 2026-02-13T20:27:29.641 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:27:29.642 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:29.642 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:27:29.641559+0000 2026-02-13T20:27:29.642 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:27:29.641559+0000 2026-02-13T20:27:29.642 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:27:29.642 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:29.642 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:27:29.642 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:27:29.642 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:27:29.642 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:29.644 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:29.641+0000 7fe41361b640 1 Processor -- start 2026-02-13T20:27:29.644 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:29.641+0000 7fe41361b640 1 -- start start 2026-02-13T20:27:29.644 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:29.641+0000 7fe41361b640 10 monclient: init 2026-02-13T20:27:29.644 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:29.641+0000 7fe41361b640 10 monclient: _reopen_session rank -1 2026-02-13T20:27:29.644 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:29.641+0000 7fe41361b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:27:29.644 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:29.641+0000 7fe41361b640 10 monclient(hunting): picked mon.noname-a con 0x7fe40c089250 addr v1:10.20.193.110:6789/0 2026-02-13T20:27:29.644 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:29.641+0000 7fe41361b640 10 monclient(hunting): picked mon.noname-b con 0x7fe40c057780 addr v1:10.20.193.110:6790/0 2026-02-13T20:27:29.645 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:29.641+0000 7fe41361b640 10 monclient(hunting): picked mon.noname-c con 0x7fe40c184b60 addr v1:10.20.193.188:6789/0 2026-02-13T20:27:29.645 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:29.641+0000 7fe41361b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe40c08a950 con 0x7fe40c089250 2026-02-13T20:27:29.645 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:29.642+0000 7fe41361b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe40c089620 con 0x7fe40c184b60 2026-02-13T20:27:29.645 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:29.642+0000 7fe41361b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe40c057c60 con 0x7fe40c057780 2026-02-13T20:27:29.645 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:29.642+0000 7fe41361b640 10 monclient(hunting): _renew_subs 2026-02-13T20:27:29.645 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:29.642+0000 7fe41361b640 10 monclient(hunting): authenticate will time out at 1611.332018s 2026-02-13T20:27:29.645 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:29.642+0000 7fe411b91640 1 -- >> v1:10.20.193.188:6789/0 conn(0x7fe40c184b60 legacy=0x7fe40c1a4f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:27:29.645 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:29.642+0000 7fe410b8f640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fe40c057780 0x7fe40c183440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:57996/0 (socket says 10.20.193.110:57996) 2026-02-13T20:27:29.645 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:29.642+0000 7fe410b8f640 1 -- 10.20.193.110:0/3602155992 learned_addr learned my addr 10.20.193.110:0/3602155992 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:27:29.843 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:29.843+0000 7fe411b91640 1 -- 10.20.193.110:0/3602155992 >> v1:10.20.193.188:6789/0 conn(0x7fe40c184b60 legacy=0x7fe40c1a4f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:27:30.244 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:30.244+0000 7fe411b91640 1 -- 10.20.193.110:0/3602155992 >> v1:10.20.193.188:6789/0 conn(0x7fe40c184b60 legacy=0x7fe40c1a4f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:27:31.045 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:31.045+0000 7fe411b91640 1 -- 10.20.193.110:0/3602155992 >> v1:10.20.193.188:6789/0 conn(0x7fe40c184b60 legacy=0x7fe40c1a4f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:27:32.643 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:32.642+0000 7fe3faffd640 10 monclient(hunting): tick 2026-02-13T20:27:32.643 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:32.642+0000 7fe3faffd640 10 monclient(hunting): _check_auth_tickets 2026-02-13T20:27:32.643 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:32.642+0000 7fe3faffd640 1 monclient(hunting): continuing hunt 2026-02-13T20:27:32.644 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:32.642+0000 7fe3faffd640 10 monclient(hunting): _reopen_session rank -1 2026-02-13T20:27:32.644 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:32.642+0000 7fe3faffd640 1 -- 10.20.193.110:0/3602155992 >> v1:10.20.193.110:6790/0 conn(0x7fe40c057780 legacy=0x7fe40c183440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:32.644 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:32.642+0000 7fe3faffd640 1 -- 10.20.193.110:0/3602155992 >> v1:10.20.193.188:6789/0 conn(0x7fe40c184b60 legacy=0x7fe40c1a4f40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:27:32.644 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:32.642+0000 7fe3faffd640 1 -- 10.20.193.110:0/3602155992 >> v1:10.20.193.110:6789/0 conn(0x7fe40c089250 legacy=0x7fe40c0580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:32.644 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:32.642+0000 7fe3faffd640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:27:32.644 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:32.642+0000 7fe3faffd640 10 monclient(hunting): picked mon.noname-b con 0x7fe40c057780 addr v1:10.20.193.110:6790/0 2026-02-13T20:27:32.644 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:32.642+0000 7fe3faffd640 10 monclient(hunting): picked mon.noname-c con 0x7fe40c184b60 addr v1:10.20.193.188:6789/0 2026-02-13T20:27:32.644 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:32.642+0000 7fe3faffd640 10 monclient(hunting): picked mon.noname-a con 0x7fe40c089250 addr v1:10.20.193.110:6789/0 2026-02-13T20:27:32.644 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:32.642+0000 7fe3faffd640 1 -- 10.20.193.110:0/3602155992 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe40c089a50 con 0x7fe40c089250 2026-02-13T20:27:32.644 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:32.642+0000 7fe3faffd640 1 -- 10.20.193.110:0/3602155992 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe40c089620 con 0x7fe40c184b60 2026-02-13T20:27:32.644 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:32.642+0000 7fe3faffd640 1 -- 10.20.193.110:0/3602155992 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3f0069fe0 con 0x7fe40c057780 2026-02-13T20:27:32.644 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:32.642+0000 7fe3faffd640 10 monclient(hunting): _renew_subs 2026-02-13T20:27:32.645 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:32.642+0000 7fe410b8f640 1 -- 10.20.193.110:0/3602155992 >> v1:10.20.193.188:6789/0 conn(0x7fe40c184b60 legacy=0x7fe3f0044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:27:32.844 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:32.843+0000 7fe410b8f640 1 -- 10.20.193.110:0/3602155992 >> v1:10.20.193.188:6789/0 conn(0x7fe40c184b60 legacy=0x7fe3f0044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:27:33.244 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:33.244+0000 7fe410b8f640 1 -- 10.20.193.110:0/3602155992 >> v1:10.20.193.188:6789/0 conn(0x7fe40c184b60 legacy=0x7fe3f0044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:27:34.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:34.046+0000 7fe410b8f640 1 -- 10.20.193.110:0/3602155992 >> v1:10.20.193.188:6789/0 conn(0x7fe40c184b60 legacy=0x7fe3f0044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:27:35.643 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:35.641+0000 7fe3faffd640 10 monclient(hunting): tick 2026-02-13T20:27:35.644 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:35.641+0000 7fe3faffd640 10 monclient(hunting): _check_auth_tickets 2026-02-13T20:27:35.644 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:35.641+0000 7fe3faffd640 1 monclient(hunting): continuing hunt 2026-02-13T20:27:35.644 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:35.641+0000 7fe3faffd640 10 monclient(hunting): _reopen_session rank -1 2026-02-13T20:27:35.644 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:35.641+0000 7fe3faffd640 1 -- 10.20.193.110:0/3602155992 >> v1:10.20.193.110:6790/0 conn(0x7fe40c057780 legacy=0x7fe3f00237b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:35.644 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:35.641+0000 7fe3faffd640 1 -- 10.20.193.110:0/3602155992 >> v1:10.20.193.188:6789/0 conn(0x7fe40c184b60 legacy=0x7fe3f0044f60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:27:35.644 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:35.641+0000 7fe3faffd640 1 -- 10.20.193.110:0/3602155992 >> v1:10.20.193.110:6789/0 conn(0x7fe40c089250 legacy=0x7fe3f0066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:35.644 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:35.641+0000 7fe3faffd640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:27:35.645 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:35.641+0000 7fe3faffd640 10 monclient(hunting): picked mon.noname-b con 0x7fe40c057780 addr v1:10.20.193.110:6790/0 2026-02-13T20:27:35.645 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:35.641+0000 7fe3faffd640 10 monclient(hunting): picked mon.noname-c con 0x7fe40c184b60 addr v1:10.20.193.188:6789/0 2026-02-13T20:27:35.645 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:35.641+0000 7fe3faffd640 10 monclient(hunting): picked mon.noname-a con 0x7fe40c089250 addr v1:10.20.193.110:6789/0 2026-02-13T20:27:35.645 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:35.641+0000 7fe3faffd640 1 -- 10.20.193.110:0/3602155992 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3f006b240 con 0x7fe40c089250 2026-02-13T20:27:35.645 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:35.641+0000 7fe3faffd640 1 -- 10.20.193.110:0/3602155992 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe40c089620 con 0x7fe40c184b60 2026-02-13T20:27:35.645 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:35.641+0000 7fe3faffd640 1 -- 10.20.193.110:0/3602155992 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3f00248e0 con 0x7fe40c057780 2026-02-13T20:27:35.645 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:35.641+0000 7fe3faffd640 10 monclient(hunting): _renew_subs 2026-02-13T20:27:35.645 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:35.641+0000 7fe410b8f640 1 -- 10.20.193.110:0/3602155992 >> v1:10.20.193.188:6789/0 conn(0x7fe40c184b60 legacy=0x7fe3f0044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:27:35.843 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:35.842+0000 7fe410b8f640 1 -- 10.20.193.110:0/3602155992 >> v1:10.20.193.188:6789/0 conn(0x7fe40c184b60 legacy=0x7fe3f0044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:27:36.244 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:36.243+0000 7fe410b8f640 1 -- 10.20.193.110:0/3602155992 >> v1:10.20.193.188:6789/0 conn(0x7fe40c184b60 legacy=0x7fe3f0044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:27:37.045 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.044+0000 7fe410b8f640 1 -- 10.20.193.110:0/3602155992 >> v1:10.20.193.188:6789/0 conn(0x7fe40c184b60 legacy=0x7fe3f0044f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:27:37.807 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.805+0000 7fe3fbfff640 1 -- 10.20.193.110:0/3602155992 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2588847408 0 0) 0x7fe3f006b240 con 0x7fe40c089250 2026-02-13T20:27:37.807 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.805+0000 7fe3fbfff640 10 monclient(hunting): _negotiate 2026-02-13T20:27:37.807 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.805+0000 7fe3fbfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:37.807 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.805+0000 7fe3fbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:37.807 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.805+0000 7fe3fbfff640 10 monclient(hunting): my global_id is 124464 2026-02-13T20:27:37.807 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.805+0000 7fe3fbfff640 1 -- 10.20.193.110:0/3602155992 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3f40035e0 con 0x7fe40c089250 2026-02-13T20:27:37.807 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.805+0000 7fe3fbfff640 1 -- 10.20.193.110:0/3602155992 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3268268740 0 0) 0x7fe3f00248e0 con 0x7fe40c057780 2026-02-13T20:27:37.807 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.805+0000 7fe3fbfff640 10 monclient(hunting): _negotiate 2026-02-13T20:27:37.808 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.805+0000 7fe3fbfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:37.808 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.805+0000 7fe3fbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:37.808 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.805+0000 7fe3fbfff640 10 monclient(hunting): my global_id is 154178 2026-02-13T20:27:37.808 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.805+0000 7fe3fbfff640 1 -- 10.20.193.110:0/3602155992 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3f006b240 con 0x7fe40c057780 2026-02-13T20:27:37.814 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.806+0000 7fe3fbfff640 1 -- 10.20.193.110:0/3602155992 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3546450954 0 0) 0x7fe3f006b240 con 0x7fe40c057780 2026-02-13T20:27:37.814 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.806+0000 7fe3fbfff640 1 -- 10.20.193.110:0/3602155992 >> v1:10.20.193.188:6789/0 conn(0x7fe40c184b60 legacy=0x7fe3f0044f60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:27:37.814 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.806+0000 7fe3fbfff640 1 -- 10.20.193.110:0/3602155992 >> v1:10.20.193.110:6789/0 conn(0x7fe40c089250 legacy=0x7fe3f00666b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:37.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.806+0000 7fe3fbfff640 10 monclient: _finish_hunting 0 2026-02-13T20:27:37.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.806+0000 7fe3fbfff640 1 monclient: found mon.noname-b 2026-02-13T20:27:37.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.806+0000 7fe3fbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:27:37.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.806+0000 7fe3fbfff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:27:37.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.806+0000 7fe3fbfff640 1 -- 10.20.193.110:0/3602155992 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3f0024b10 con 0x7fe40c057780 2026-02-13T20:27:37.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.806+0000 7fe3fbfff640 10 monclient: _finish_auth 0 2026-02-13T20:27:37.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.806+0000 7fe3fbfff640 10 monclient: _check_auth_tickets 2026-02-13T20:27:37.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.806+0000 7fe3fbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:27:37.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.806+0000 7fe3fbfff640 1 -- 10.20.193.110:0/3602155992 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe3fc002d20 con 0x7fe40c057780 2026-02-13T20:27:37.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.806+0000 7fe3fbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:37.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.806+0000 7fe3fbfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:27:37.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.806+0000 7fe3fbfff640 10 monclient: dump: 2026-02-13T20:27:37.816 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:37.816 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:37.816 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:37.816 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:37.816 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:37.816 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:37.816 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:37.816 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:37.816 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:37.816 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:37.816 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.806+0000 7fe41361b640 5 monclient: authenticate success, global_id 154178 2026-02-13T20:27:37.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.806+0000 7fe41361b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:27:37.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.806+0000 7fe3fbfff640 1 -- 10.20.193.110:0/3602155992 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe3fc002f20 con 0x7fe40c057780 2026-02-13T20:27:37.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.806+0000 7fe3fbfff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:27:37.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.806+0000 7fe3fbfff640 1 -- 10.20.193.110:0/3602155992 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe3fc003330 con 0x7fe40c057780 2026-02-13T20:27:37.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.806+0000 7fe3fbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:37.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.806+0000 7fe3fbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:27:37.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.806+0000 7fe3fbfff640 10 monclient: dump: 2026-02-13T20:27:37.817 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:37.817 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:37.817 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:37.817 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:37.817 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:37.818 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:37.818 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:37.818 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:37.818 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:37.818 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:37.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.806+0000 7fe41361b640 10 monclient: get_monmap_and_config success 2026-02-13T20:27:37.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.806+0000 7fe41361b640 4 set_mon_vals no callback set 2026-02-13T20:27:37.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.807+0000 7fe41361b640 10 monclient: shutdown 2026-02-13T20:27:37.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.807+0000 7fe41361b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:27:37.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.807+0000 7fe41361b640 1 -- 10.20.193.110:0/3602155992 >> v1:10.20.193.110:6790/0 conn(0x7fe40c057780 legacy=0x7fe3f006a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:37.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.807+0000 7fe41361b640 1 -- 10.20.193.110:0/3602155992 shutdown_connections 2026-02-13T20:27:37.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.807+0000 7fe41361b640 1 -- 10.20.193.110:0/3602155992 >> 10.20.193.110:0/3602155992 conn(0x7fe40c054330 msgr2=0x7fe40c054730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:27:37.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.807+0000 7fe41361b640 1 -- 10.20.193.110:0/3602155992 shutdown_connections 2026-02-13T20:27:37.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.807+0000 7fe41361b640 1 -- 10.20.193.110:0/3602155992 wait complete. 2026-02-13T20:27:37.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.807+0000 7fe41361b640 10 monclient: build_initial_monmap 2026-02-13T20:27:37.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.807+0000 7fe41361b640 10 monclient: monmap: 2026-02-13T20:27:37.819 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:27:37.819 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:27:37.819 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:27:37.819 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:27:37.819 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:27:37.819 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:27:37.819 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:27:37.819 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:27:37.820 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:27:37.820 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:37.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.807+0000 7fe41361b640 1 Processor -- start 2026-02-13T20:27:37.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.807+0000 7fe41361b640 1 -- start start 2026-02-13T20:27:37.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.807+0000 7fe41361b640 10 monclient: init 2026-02-13T20:27:37.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe41361b640 10 monclient: _reopen_session rank -1 2026-02-13T20:27:37.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe41361b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:27:37.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe41361b640 10 monclient(hunting): picked mon.noname-a con 0x7fe40c057780 addr v1:10.20.193.110:6789/0 2026-02-13T20:27:37.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe41361b640 10 monclient(hunting): picked mon.noname-c con 0x7fe40c089250 addr v1:10.20.193.110:6790/0 2026-02-13T20:27:37.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe41361b640 10 monclient(hunting): picked mon.noname-b con 0x7fe40c184b60 addr v1:10.20.193.188:6789/0 2026-02-13T20:27:37.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe41361b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe40c133850 con 0x7fe40c057780 2026-02-13T20:27:37.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe41361b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe40c14cbc0 con 0x7fe40c184b60 2026-02-13T20:27:37.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe41361b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe40c133e10 con 0x7fe40c089250 2026-02-13T20:27:37.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe41361b640 10 monclient(hunting): _renew_subs 2026-02-13T20:27:37.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe41361b640 10 monclient(hunting): authenticate will time out at 1619.499238s 2026-02-13T20:27:37.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe411390640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fe40c057780 0x7fe40c14c4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:39280/0 (socket says 10.20.193.110:39280) 2026-02-13T20:27:37.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe411390640 1 -- 10.20.193.110:0/335342155 learned_addr learned my addr 10.20.193.110:0/335342155 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:27:37.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe411b91640 1 -- 10.20.193.110:0/335342155 >> v1:10.20.193.188:6789/0 conn(0x7fe40c184b60 legacy=0x7fe40c174f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:27:37.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe3f9ffb640 1 -- 10.20.193.110:0/335342155 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1832609456 0 0) 0x7fe40c133850 con 0x7fe40c057780 2026-02-13T20:27:37.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe3f9ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:27:37.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe3f9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:37.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe3f9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:37.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe3f9ffb640 10 monclient(hunting): my global_id is 124467 2026-02-13T20:27:37.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe3f9ffb640 1 -- 10.20.193.110:0/335342155 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3dc0035e0 con 0x7fe40c057780 2026-02-13T20:27:37.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe3f9ffb640 1 -- 10.20.193.110:0/335342155 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2861088895 0 0) 0x7fe40c133e10 con 0x7fe40c089250 2026-02-13T20:27:37.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe3f9ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:27:37.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe3f9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:37.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe3f9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:37.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe3f9ffb640 10 monclient(hunting): my global_id is 154181 2026-02-13T20:27:37.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe3f9ffb640 1 -- 10.20.193.110:0/335342155 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe40c133850 con 0x7fe40c089250 2026-02-13T20:27:37.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe3f9ffb640 1 -- 10.20.193.110:0/335342155 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 301513331 0 0) 0x7fe3dc0035e0 con 0x7fe40c057780 2026-02-13T20:27:37.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe3f9ffb640 1 -- 10.20.193.110:0/335342155 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe40c133e10 con 0x7fe40c057780 2026-02-13T20:27:37.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe3f9ffb640 1 -- 10.20.193.110:0/335342155 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe3fc003300 con 0x7fe40c057780 2026-02-13T20:27:37.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe3f9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:27:37.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe3f9ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:27:37.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe3f9ffb640 10 monclient(hunting): dump: 2026-02-13T20:27:37.822 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:37.823 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:37.823 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:37.823 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:37.823 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:37.823 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:37.823 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:37.823 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:37.823 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:37.823 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:37.823 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe3f9ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:27:37.823 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe3f9ffb640 1 -- 10.20.193.110:0/335342155 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 655211181 0 0) 0x7fe40c133850 con 0x7fe40c089250 2026-02-13T20:27:37.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe3f9ffb640 1 -- 10.20.193.110:0/335342155 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe3dc0035e0 con 0x7fe40c089250 2026-02-13T20:27:37.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe3f9ffb640 1 -- 10.20.193.110:0/335342155 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe400002fc0 con 0x7fe40c089250 2026-02-13T20:27:37.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe3f9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:27:37.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe3f9ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:27:37.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe3f9ffb640 10 monclient(hunting): dump: 2026-02-13T20:27:37.824 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:37.824 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:37.824 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:37.824 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:37.824 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:37.824 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:37.824 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:37.825 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:37.825 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:37.825 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:37.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe3f9ffb640 1 -- 10.20.193.110:0/335342155 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3311291628 0 0) 0x7fe40c133e10 con 0x7fe40c057780 2026-02-13T20:27:37.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe3f9ffb640 1 -- 10.20.193.110:0/335342155 >> v1:10.20.193.110:6790/0 conn(0x7fe40c089250 legacy=0x7fe40c173860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:37.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe3f9ffb640 1 -- 10.20.193.110:0/335342155 >> v1:10.20.193.188:6789/0 conn(0x7fe40c184b60 legacy=0x7fe40c174f80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T20:27:37.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe3f9ffb640 10 monclient: _finish_hunting 0 2026-02-13T20:27:37.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe3f9ffb640 1 monclient: found mon.a 2026-02-13T20:27:37.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe3f9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:27:37.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe3f9ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:27:37.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe3f9ffb640 1 -- 10.20.193.110:0/335342155 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe40c132fa0 con 0x7fe40c057780 2026-02-13T20:27:37.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe3f9ffb640 10 monclient: _finish_auth 0 2026-02-13T20:27:37.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe3f9ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:27:37.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe3f9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:27:37.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe41361b640 5 monclient: authenticate success, global_id 124467 2026-02-13T20:27:37.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe41361b640 10 monclient: _renew_subs 2026-02-13T20:27:37.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe41361b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:27:37.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe41361b640 1 -- 10.20.193.110:0/335342155 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe40c131b10 con 0x7fe40c057780 2026-02-13T20:27:37.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe41361b640 10 monclient: _renew_subs 2026-02-13T20:27:37.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe41361b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:27:37.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe41361b640 1 -- 10.20.193.110:0/335342155 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe40c132610 con 0x7fe40c057780 2026-02-13T20:27:37.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe3f9ffb640 1 -- 10.20.193.110:0/335342155 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe3fc003980 con 0x7fe40c057780 2026-02-13T20:27:37.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe3f9ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T20:27:37.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe3f9ffb640 1 -- 10.20.193.110:0/335342155 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fe3fc0034d0 con 0x7fe40c057780 2026-02-13T20:27:37.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe3f9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:37.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe3f9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:27:37.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe3f9ffb640 10 monclient: dump: 2026-02-13T20:27:37.827 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:37.827 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:37.827 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:37.827 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:37.827 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:37.827 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:37.827 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:37.827 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:37.827 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:37.827 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:37.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.808+0000 7fe3fb7fe640 4 set_mon_vals no callback set 2026-02-13T20:27:37.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.809+0000 7fe3f9ffb640 1 -- 10.20.193.110:0/335342155 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fe3fc003d10 con 0x7fe40c057780 2026-02-13T20:27:37.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.809+0000 7fe41361b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:27:37.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.809+0000 7fe41361b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:27:37.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.809+0000 7fe41361b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:27:37.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.809+0000 7fe41361b640 1 -- 10.20.193.110:0/335342155 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe40c1335d0 con 0x7fe40c057780 2026-02-13T20:27:37.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.809+0000 7fe3f9ffb640 1 -- 10.20.193.110:0/335342155 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(774..774 src has 1..774) ==== 3947+0+0 (unknown 763813869 0 0) 0x7fe3fc04e930 con 0x7fe40c057780 2026-02-13T20:27:37.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.809+0000 7fe410b8f640 10 monclient: get_auth_request con 0x7fe3dc03fa50 auth_method 0 2026-02-13T20:27:37.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.812+0000 7fe3f9ffb640 1 -- 10.20.193.110:0/335342155 <== mon.0 v1:10.20.193.110:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fe3fc016ab0 con 0x7fe40c057780 2026-02-13T20:27:37.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.812+0000 7fe3f9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:27:37.828 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.812+0000 7fe3f9ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:27:37.959 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.957+0000 7fe41361b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T20:27:37.959 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.957+0000 7fe41361b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T20:27:37.959 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.957+0000 7fe41361b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:27:37.959 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.957+0000 7fe41361b640 1 -- 10.20.193.110:0/335342155 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe40c08a110 con 0x7fe40c057780 2026-02-13T20:27:37.960 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.957+0000 7fe3f9ffb640 1 -- 10.20.193.110:0/335342155 <== mon.0 v1:10.20.193.110:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1604 (unknown 254746657 0 2673533505) 0x7fe3fc0168d0 con 0x7fe40c057780 2026-02-13T20:27:37.960 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.957+0000 7fe3f9ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T20:27:37.960 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.957+0000 7fe3f9ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:27:37.960 INFO:teuthology.orchestra.run.trial110.stdout:{"election_epoch":62,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"c","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","modified":"2026-02-13T20:11:07.161192Z","created":"2026-02-13T20:11:07.161192Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6789","nonce":0}]},"addr":"10.20.193.110:6789/0","public_addr":"10.20.193.110:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161241+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6789","nonce":0}]},"addr":"10.20.193.188:6789/0","public_addr":"10.20.193.188:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161242+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6790","nonce":0}]},"addr":"10.20.193.110:6790/0","public_addr":"10.20.193.110:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161243+0000","crush_location":[]}]}} 2026-02-13T20:27:37.961 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.958+0000 7fe41361b640 1 -- 10.20.193.110:0/335342155 >> v1:10.20.193.188:6812/1623052694 conn(0x7fe3dc03fa50 legacy=0x7fe3dc05ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:37.961 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.958+0000 7fe41361b640 10 monclient: shutdown 2026-02-13T20:27:37.961 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.958+0000 7fe41361b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:27:37.961 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.958+0000 7fe41361b640 1 -- 10.20.193.110:0/335342155 >> v1:10.20.193.110:6789/0 conn(0x7fe40c057780 legacy=0x7fe40c14c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:37.961 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.958+0000 7fe41361b640 1 -- 10.20.193.110:0/335342155 shutdown_connections 2026-02-13T20:27:37.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.958+0000 7fe41361b640 1 -- 10.20.193.110:0/335342155 >> 10.20.193.110:0/335342155 conn(0x7fe40c054330 msgr2=0x7fe40c08c830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:27:37.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.958+0000 7fe41361b640 1 -- 10.20.193.110:0/335342155 shutdown_connections 2026-02-13T20:27:37.962 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:37.959+0000 7fe41361b640 1 -- 10.20.193.110:0/335342155 wait complete. 2026-02-13T20:27:37.968 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-13T20:27:37.968 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-13T20:27:37.969 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T20:27:38.044 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.034+0000 7f6f69a5b640 10 monclient: get_monmap_and_config 2026-02-13T20:27:38.044 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.034+0000 7f6f69a5b640 10 monclient: build_initial_monmap 2026-02-13T20:27:38.045 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.034+0000 7f6f69a5b640 10 monclient: monmap: 2026-02-13T20:27:38.045 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:27:38.045 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:38.045 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:27:38.035516+0000 2026-02-13T20:27:38.045 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:27:38.035516+0000 2026-02-13T20:27:38.045 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:27:38.045 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:38.045 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:27:38.045 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:27:38.045 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:27:38.046 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:38.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.034+0000 7f6f69a5b640 1 Processor -- start 2026-02-13T20:27:38.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.034+0000 7f6f69a5b640 1 -- start start 2026-02-13T20:27:38.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.034+0000 7f6f69a5b640 10 monclient: init 2026-02-13T20:27:38.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.034+0000 7f6f69a5b640 10 monclient: _reopen_session rank -1 2026-02-13T20:27:38.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.034+0000 7f6f69a5b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:27:38.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.034+0000 7f6f69a5b640 10 monclient(hunting): picked mon.noname-c con 0x7f6f641401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:27:38.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.034+0000 7f6f69a5b640 10 monclient(hunting): picked mon.noname-b con 0x7f6f64092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:27:38.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.034+0000 7f6f69a5b640 10 monclient(hunting): picked mon.noname-a con 0x7f6f64091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:27:38.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.034+0000 7f6f69a5b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f6408b730 con 0x7f6f64091950 2026-02-13T20:27:38.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.034+0000 7f6f69a5b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f6405c5b0 con 0x7f6f641401c0 2026-02-13T20:27:38.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.034+0000 7f6f69a5b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f6408bcf0 con 0x7f6f64092020 2026-02-13T20:27:38.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.034+0000 7f6f69a5b640 10 monclient(hunting): _renew_subs 2026-02-13T20:27:38.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.034+0000 7f6f69a5b640 10 monclient(hunting): authenticate will time out at 1619.725851s 2026-02-13T20:27:38.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.034+0000 7f6f62ffd640 1 -- >> v1:10.20.193.188:6789/0 conn(0x7f6f641401c0 legacy=0x7f6f64091240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:27:38.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.034+0000 7f6f627fc640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f6f64092020 0x7f6f641812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:41876/0 (socket says 10.20.193.110:41876) 2026-02-13T20:27:38.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.034+0000 7f6f637fe640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f6f64091950 0x7f6f641a2a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:39288/0 (socket says 10.20.193.110:39288) 2026-02-13T20:27:38.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.034+0000 7f6f627fc640 1 -- 10.20.193.110:0/63505758 learned_addr learned my addr 10.20.193.110:0/63505758 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:27:38.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.035+0000 7f6f61ffb640 1 -- 10.20.193.110:0/63505758 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 109587702 0 0) 0x7f6f6408b730 con 0x7f6f64091950 2026-02-13T20:27:38.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.035+0000 7f6f61ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:27:38.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.035+0000 7f6f61ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:38.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.035+0000 7f6f61ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:38.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.035+0000 7f6f61ffb640 10 monclient(hunting): my global_id is 124470 2026-02-13T20:27:38.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.035+0000 7f6f61ffb640 1 -- 10.20.193.110:0/63505758 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f500035e0 con 0x7f6f64091950 2026-02-13T20:27:38.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.035+0000 7f6f61ffb640 1 -- 10.20.193.110:0/63505758 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3803062794 0 0) 0x7f6f6408bcf0 con 0x7f6f64092020 2026-02-13T20:27:38.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.035+0000 7f6f61ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:27:38.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.035+0000 7f6f61ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:38.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.035+0000 7f6f61ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:38.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.035+0000 7f6f61ffb640 10 monclient(hunting): my global_id is 154184 2026-02-13T20:27:38.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.035+0000 7f6f61ffb640 1 -- 10.20.193.110:0/63505758 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f6408b730 con 0x7f6f64092020 2026-02-13T20:27:38.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.035+0000 7f6f61ffb640 1 -- 10.20.193.110:0/63505758 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3485276041 0 0) 0x7f6f500035e0 con 0x7f6f64091950 2026-02-13T20:27:38.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.035+0000 7f6f61ffb640 1 -- 10.20.193.110:0/63505758 >> v1:10.20.193.110:6790/0 conn(0x7f6f64092020 legacy=0x7f6f641812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:38.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.035+0000 7f6f61ffb640 1 -- 10.20.193.110:0/63505758 >> v1:10.20.193.188:6789/0 conn(0x7f6f641401c0 legacy=0x7f6f64091240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:27:38.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.035+0000 7f6f61ffb640 10 monclient: _finish_hunting 0 2026-02-13T20:27:38.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.035+0000 7f6f61ffb640 1 monclient: found mon.noname-a 2026-02-13T20:27:38.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.035+0000 7f6f61ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:27:38.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.035+0000 7f6f61ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:27:38.049 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.035+0000 7f6f61ffb640 1 -- 10.20.193.110:0/63505758 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f64140590 con 0x7f6f64091950 2026-02-13T20:27:38.049 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.035+0000 7f6f61ffb640 10 monclient: _finish_auth 0 2026-02-13T20:27:38.049 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.035+0000 7f6f61ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:27:38.049 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.035+0000 7f6f61ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:27:38.049 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.035+0000 7f6f61ffb640 1 -- 10.20.193.110:0/63505758 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f6f54003de0 con 0x7f6f64091950 2026-02-13T20:27:38.049 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.035+0000 7f6f69a5b640 5 monclient: authenticate success, global_id 124470 2026-02-13T20:27:38.049 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.035+0000 7f6f69a5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:27:38.049 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.035+0000 7f6f61ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:38.049 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.035+0000 7f6f61ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:27:38.049 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.035+0000 7f6f61ffb640 10 monclient: dump: 2026-02-13T20:27:38.049 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:38.049 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:38.050 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:38.050 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:38.050 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:38.050 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:38.050 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:38.050 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:38.050 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:38.050 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:38.050 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.035+0000 7f6f69a5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:27:38.050 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.035+0000 7f6f61ffb640 1 -- 10.20.193.110:0/63505758 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6f54003f70 con 0x7f6f64091950 2026-02-13T20:27:38.050 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.035+0000 7f6f61ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T20:27:38.050 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.035+0000 7f6f69a5b640 10 monclient: get_monmap_and_config success 2026-02-13T20:27:38.051 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.035+0000 7f6f61ffb640 1 -- 10.20.193.110:0/63505758 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f6f54004380 con 0x7f6f64091950 2026-02-13T20:27:38.051 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.035+0000 7f6f61ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:38.051 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.035+0000 7f6f69a5b640 4 set_mon_vals no callback set 2026-02-13T20:27:38.051 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.035+0000 7f6f61ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:27:38.051 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.035+0000 7f6f61ffb640 10 monclient: dump: 2026-02-13T20:27:38.051 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:38.051 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:38.051 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:38.051 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:38.051 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:38.051 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:38.051 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:38.051 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:38.052 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:38.052 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:38.052 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.035+0000 7f6f69a5b640 10 monclient: shutdown 2026-02-13T20:27:38.052 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.035+0000 7f6f69a5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:27:38.052 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.035+0000 7f6f69a5b640 1 -- 10.20.193.110:0/63505758 >> v1:10.20.193.110:6789/0 conn(0x7f6f64091950 legacy=0x7f6f641a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:38.052 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.035+0000 7f6f69a5b640 1 -- 10.20.193.110:0/63505758 shutdown_connections 2026-02-13T20:27:38.052 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.035+0000 7f6f69a5b640 1 -- 10.20.193.110:0/63505758 >> 10.20.193.110:0/63505758 conn(0x7f6f64054e90 msgr2=0x7f6f64058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:27:38.052 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.035+0000 7f6f69a5b640 1 -- 10.20.193.110:0/63505758 shutdown_connections 2026-02-13T20:27:38.052 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.035+0000 7f6f69a5b640 1 -- 10.20.193.110:0/63505758 wait complete. 2026-02-13T20:27:38.052 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.036+0000 7f6f69a5b640 10 monclient: build_initial_monmap 2026-02-13T20:27:38.052 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.036+0000 7f6f69a5b640 10 monclient: monmap: 2026-02-13T20:27:38.053 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:27:38.053 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:27:38.053 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:27:38.053 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:27:38.053 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:27:38.053 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:27:38.053 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:27:38.053 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:27:38.053 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:27:38.053 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:38.053 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.036+0000 7f6f69a5b640 1 Processor -- start 2026-02-13T20:27:38.053 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.036+0000 7f6f69a5b640 1 -- start start 2026-02-13T20:27:38.053 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.036+0000 7f6f69a5b640 10 monclient: init 2026-02-13T20:27:38.054 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.036+0000 7f6f69a5b640 10 monclient: _reopen_session rank -1 2026-02-13T20:27:38.054 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.036+0000 7f6f69a5b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:27:38.054 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.036+0000 7f6f69a5b640 10 monclient(hunting): picked mon.noname-b con 0x7f6f64091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:27:38.054 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.036+0000 7f6f69a5b640 10 monclient(hunting): picked mon.noname-a con 0x7f6f641401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:27:38.054 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.036+0000 7f6f69a5b640 10 monclient(hunting): picked mon.noname-c con 0x7f6f641947c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:27:38.054 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.036+0000 7f6f69a5b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f6413fa80 con 0x7f6f641401c0 2026-02-13T20:27:38.054 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.036+0000 7f6f69a5b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f6405d320 con 0x7f6f64091950 2026-02-13T20:27:38.054 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.036+0000 7f6f69a5b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f6413f240 con 0x7f6f641947c0 2026-02-13T20:27:38.054 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.036+0000 7f6f69a5b640 10 monclient(hunting): _renew_subs 2026-02-13T20:27:38.054 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.036+0000 7f6f69a5b640 10 monclient(hunting): authenticate will time out at 1619.727594s 2026-02-13T20:27:38.054 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.036+0000 7f6f627fc640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f6f641401c0 0x7f6f64089540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:39300/0 (socket says 10.20.193.110:39300) 2026-02-13T20:27:38.054 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.036+0000 7f6f627fc640 1 -- 10.20.193.110:0/2627702157 learned_addr learned my addr 10.20.193.110:0/2627702157 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:27:38.055 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.036+0000 7f6f62ffd640 1 -- 10.20.193.110:0/2627702157 >> v1:10.20.193.188:6789/0 conn(0x7f6f64091950 legacy=0x7f6f64088e30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:27:38.055 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.036+0000 7f6f3bfff640 1 -- 10.20.193.110:0/2627702157 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3919854415 0 0) 0x7f6f6413fa80 con 0x7f6f641401c0 2026-02-13T20:27:38.055 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.036+0000 7f6f3bfff640 10 monclient(hunting): _negotiate 2026-02-13T20:27:38.055 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.036+0000 7f6f3bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:38.055 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.036+0000 7f6f3bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:38.055 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.036+0000 7f6f3bfff640 10 monclient(hunting): my global_id is 124473 2026-02-13T20:27:38.055 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.036+0000 7f6f3bfff640 1 -- 10.20.193.110:0/2627702157 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f340035e0 con 0x7f6f641401c0 2026-02-13T20:27:38.055 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.036+0000 7f6f3bfff640 1 -- 10.20.193.110:0/2627702157 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 253821683 0 0) 0x7f6f6413f240 con 0x7f6f641947c0 2026-02-13T20:27:38.055 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.036+0000 7f6f3bfff640 10 monclient(hunting): _negotiate 2026-02-13T20:27:38.055 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.036+0000 7f6f3bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:38.055 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.036+0000 7f6f3bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:38.055 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.036+0000 7f6f3bfff640 10 monclient(hunting): my global_id is 154187 2026-02-13T20:27:38.056 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.036+0000 7f6f3bfff640 1 -- 10.20.193.110:0/2627702157 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f6413fa80 con 0x7f6f641947c0 2026-02-13T20:27:38.056 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.036+0000 7f6f3bfff640 1 -- 10.20.193.110:0/2627702157 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 199056310 0 0) 0x7f6f340035e0 con 0x7f6f641401c0 2026-02-13T20:27:38.056 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.036+0000 7f6f3bfff640 1 -- 10.20.193.110:0/2627702157 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6f6413f240 con 0x7f6f641401c0 2026-02-13T20:27:38.056 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.036+0000 7f6f3bfff640 1 -- 10.20.193.110:0/2627702157 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f6f4c0031f0 con 0x7f6f641401c0 2026-02-13T20:27:38.056 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.036+0000 7f6f3bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:27:38.056 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.036+0000 7f6f3bfff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:27:38.056 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.036+0000 7f6f3bfff640 10 monclient(hunting): dump: 2026-02-13T20:27:38.056 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:38.056 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:38.056 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:38.056 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:38.056 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:38.056 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:38.057 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:38.057 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:38.057 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:38.057 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:38.057 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.036+0000 7f6f3bfff640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:27:38.057 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.037+0000 7f6f3bfff640 1 -- 10.20.193.110:0/2627702157 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 616731596 0 0) 0x7f6f6413fa80 con 0x7f6f641947c0 2026-02-13T20:27:38.057 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.037+0000 7f6f3bfff640 1 -- 10.20.193.110:0/2627702157 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6f340035e0 con 0x7f6f641947c0 2026-02-13T20:27:38.057 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.037+0000 7f6f3bfff640 1 -- 10.20.193.110:0/2627702157 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f6f540040e0 con 0x7f6f641947c0 2026-02-13T20:27:38.057 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.037+0000 7f6f3bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:27:38.057 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.037+0000 7f6f3bfff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:27:38.057 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.037+0000 7f6f3bfff640 10 monclient(hunting): dump: 2026-02-13T20:27:38.057 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:38.058 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:38.058 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:38.058 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:38.058 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:38.058 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:38.058 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:38.058 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:38.058 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:38.058 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:38.058 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.037+0000 7f6f3bfff640 1 -- 10.20.193.110:0/2627702157 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4156143511 0 0) 0x7f6f340035e0 con 0x7f6f641947c0 2026-02-13T20:27:38.058 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.037+0000 7f6f3bfff640 1 -- 10.20.193.110:0/2627702157 >> v1:10.20.193.188:6789/0 conn(0x7f6f64091950 legacy=0x7f6f64088e30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T20:27:38.058 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.037+0000 7f6f3bfff640 1 -- 10.20.193.110:0/2627702157 >> v1:10.20.193.110:6789/0 conn(0x7f6f641401c0 legacy=0x7f6f64089540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:38.059 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.037+0000 7f6f3bfff640 10 monclient: _finish_hunting 0 2026-02-13T20:27:38.059 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.037+0000 7f6f3bfff640 1 monclient: found mon.c 2026-02-13T20:27:38.059 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.037+0000 7f6f3bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:27:38.059 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.037+0000 7f6f3bfff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:27:38.059 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.037+0000 7f6f3bfff640 1 -- 10.20.193.110:0/2627702157 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f64132260 con 0x7f6f641947c0 2026-02-13T20:27:38.059 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.037+0000 7f6f3bfff640 10 monclient: _finish_auth 0 2026-02-13T20:27:38.059 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.037+0000 7f6f3bfff640 10 monclient: _check_auth_tickets 2026-02-13T20:27:38.059 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.037+0000 7f6f3bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:27:38.059 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.037+0000 7f6f69a5b640 5 monclient: authenticate success, global_id 154187 2026-02-13T20:27:38.059 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.037+0000 7f6f69a5b640 10 monclient: _renew_subs 2026-02-13T20:27:38.059 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.037+0000 7f6f69a5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:27:38.059 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.037+0000 7f6f69a5b640 1 -- 10.20.193.110:0/2627702157 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6f64089c50 con 0x7f6f641947c0 2026-02-13T20:27:38.060 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.037+0000 7f6f69a5b640 10 monclient: _renew_subs 2026-02-13T20:27:38.060 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.037+0000 7f6f69a5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:27:38.060 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.037+0000 7f6f69a5b640 1 -- 10.20.193.110:0/2627702157 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f6f64131f80 con 0x7f6f641947c0 2026-02-13T20:27:38.060 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.037+0000 7f6f3bfff640 1 -- 10.20.193.110:0/2627702157 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6f54003930 con 0x7f6f641947c0 2026-02-13T20:27:38.060 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.037+0000 7f6f3bfff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:27:38.060 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.037+0000 7f6f3bfff640 1 -- 10.20.193.110:0/2627702157 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f6f54005b30 con 0x7f6f641947c0 2026-02-13T20:27:38.060 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.037+0000 7f6f3bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:38.060 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.037+0000 7f6f3bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:27:38.060 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.037+0000 7f6f617fa640 4 set_mon_vals no callback set 2026-02-13T20:27:38.060 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.037+0000 7f6f3bfff640 10 monclient: dump: 2026-02-13T20:27:38.060 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:38.060 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:38.060 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:38.061 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:38.061 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:38.061 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:38.061 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:38.061 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:38.061 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:38.061 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:38.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.037+0000 7f6f69a5b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:27:38.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.037+0000 7f6f69a5b640 1 -- 10.20.193.110:0/2627702157 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6f64130b20 con 0x7f6f64092020 2026-02-13T20:27:38.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.037+0000 7f6f3bfff640 1 -- 10.20.193.110:0/2627702157 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f6f540127a0 con 0x7f6f641947c0 2026-02-13T20:27:38.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.037+0000 7f6f3bfff640 1 -- 10.20.193.110:0/2627702157 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(774..774 src has 1..774) ==== 3947+0+0 (unknown 763813869 0 0) 0x7f6f5404f800 con 0x7f6f641947c0 2026-02-13T20:27:38.061 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.037+0000 7f6f3bfff640 1 -- 10.20.193.110:0/2627702157 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3693111738 0 0) 0x7f6f64130b20 con 0x7f6f64092020 2026-02-13T20:27:38.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.037+0000 7f6f3bfff640 10 monclient(hunting): _negotiate 2026-02-13T20:27:38.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.037+0000 7f6f3bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:38.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.037+0000 7f6f3bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:38.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.037+0000 7f6f3bfff640 10 monclient(hunting): my global_id is 124476 2026-02-13T20:27:38.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.037+0000 7f6f3bfff640 1 -- 10.20.193.110:0/2627702157 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f340035e0 con 0x7f6f64092020 2026-02-13T20:27:38.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.038+0000 7f6f627fc640 10 monclient: get_auth_request con 0x7f6f3403f960 auth_method 0 2026-02-13T20:27:38.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.038+0000 7f6f3bfff640 1 -- 10.20.193.110:0/2627702157 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1735379920 0 0) 0x7f6f340035e0 con 0x7f6f64092020 2026-02-13T20:27:38.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.038+0000 7f6f3bfff640 1 -- 10.20.193.110:0/2627702157 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6f64130b20 con 0x7f6f64092020 2026-02-13T20:27:38.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.038+0000 7f6f3bfff640 1 -- 10.20.193.110:0/2627702157 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f6f58003f80 con 0x7f6f64092020 2026-02-13T20:27:38.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.038+0000 7f6f3bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:38.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.038+0000 7f6f3bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:27:38.062 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.038+0000 7f6f3bfff640 10 monclient: dump: 2026-02-13T20:27:38.063 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:38.063 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:38.063 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:38.063 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:38.063 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:38.063 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:38.063 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:38.063 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:38.063 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:38.063 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:38.064 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.038+0000 7f6f3bfff640 1 -- 10.20.193.110:0/2627702157 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 594044450 0 0) 0x7f6f64130b20 con 0x7f6f64092020 2026-02-13T20:27:38.064 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.038+0000 7f6f3bfff640 1 -- 10.20.193.110:0/2627702157 --> v1:10.20.193.110:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6f6408b450 con 0x7f6f64092020 2026-02-13T20:27:38.064 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.038+0000 7f6f3bfff640 1 -- 10.20.193.110:0/2627702157 <== mon.0 v1:10.20.193.110:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f6f580062d0 con 0x7f6f64092020 2026-02-13T20:27:38.064 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.038+0000 7f6f3bfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:27:38.064 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.038+0000 7f6f3bfff640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:27:38.064 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.038+0000 7f6f3bfff640 1 -- 10.20.193.110:0/2627702157 >> v1:10.20.193.110:6789/0 conn(0x7f6f64092020 legacy=0x7f6f64127b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:38.064 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.038+0000 7f6f3bfff640 1 -- 10.20.193.110:0/2627702157 >> v1:10.20.193.110:6789/0 conn(0x7f6f64092020 legacy=0x7f6f64127b20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:27:38.064 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.041+0000 7f6f69a5b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:27:38.064 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.041+0000 7f6f69a5b640 1 -- 10.20.193.110:0/2627702157 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6f64055bb0 con 0x7f6f64128230 2026-02-13T20:27:38.064 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.041+0000 7f6f3bfff640 1 -- 10.20.193.110:0/2627702157 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1961805410 0 0) 0x7f6f64055bb0 con 0x7f6f64128230 2026-02-13T20:27:38.064 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.041+0000 7f6f3bfff640 10 monclient(hunting): _negotiate 2026-02-13T20:27:38.064 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.041+0000 7f6f3bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:38.064 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.041+0000 7f6f3bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:38.065 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.041+0000 7f6f3bfff640 10 monclient(hunting): my global_id is 124479 2026-02-13T20:27:38.065 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.041+0000 7f6f3bfff640 1 -- 10.20.193.110:0/2627702157 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f64130b20 con 0x7f6f64128230 2026-02-13T20:27:38.065 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.042+0000 7f6f3bfff640 1 -- 10.20.193.110:0/2627702157 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1277941428 0 0) 0x7f6f64130b20 con 0x7f6f64128230 2026-02-13T20:27:38.065 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.042+0000 7f6f3bfff640 1 -- 10.20.193.110:0/2627702157 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6f64055bb0 con 0x7f6f64128230 2026-02-13T20:27:38.065 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.042+0000 7f6f3bfff640 1 -- 10.20.193.110:0/2627702157 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f6f580048a0 con 0x7f6f64128230 2026-02-13T20:27:38.065 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.042+0000 7f6f3bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:38.065 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.042+0000 7f6f3bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:27:38.065 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.042+0000 7f6f3bfff640 10 monclient: dump: 2026-02-13T20:27:38.065 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:38.065 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:38.065 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:38.065 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:38.066 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:38.066 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:38.066 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:38.066 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:38.066 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:38.066 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:38.066 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.042+0000 7f6f3bfff640 1 -- 10.20.193.110:0/2627702157 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 263873855 0 0) 0x7f6f64055bb0 con 0x7f6f64128230 2026-02-13T20:27:38.066 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.042+0000 7f6f3bfff640 1 -- 10.20.193.110:0/2627702157 --> v1:10.20.193.110:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6f64131740 con 0x7f6f64128230 2026-02-13T20:27:38.066 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.042+0000 7f6f3bfff640 1 -- 10.20.193.110:0/2627702157 <== mon.0 v1:10.20.193.110:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4503 (unknown 0 0 147122252) 0x7f6f58005e40 con 0x7f6f64128230 2026-02-13T20:27:38.066 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.042+0000 7f6f3bfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:27:38.066 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.042+0000 7f6f3bfff640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:27:38.066 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.042+0000 7f6f3bfff640 1 -- 10.20.193.110:0/2627702157 >> v1:10.20.193.110:6789/0 conn(0x7f6f64128230 legacy=0x7f6f64197370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:38.067 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.042+0000 7f6f3bfff640 1 -- 10.20.193.110:0/2627702157 >> v1:10.20.193.110:6789/0 conn(0x7f6f64128230 legacy=0x7f6f64197370 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:27:38.067 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:27:38.067 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:27:38.067 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:27:38.067 INFO:teuthology.orchestra.run.trial110.stdout: "state": "peon", 2026-02-13T20:27:38.067 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 62, 2026-02-13T20:27:38.068 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 373461, 2026-02-13T20:27:38.068 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:27:38.068 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:27:38.068 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:27:38.068 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:27:38.068 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 0, 2026-02-13T20:27:38.068 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:27:38.068 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:27:38.068 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:27:38.068 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:27:38.068 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:27:38.068 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:27:38.069 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:27:38.069 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:27:38.069 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:27:38.069 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:27:38.069 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:27:38.069 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:27:38.069 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:27:38.069 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:27:38.069 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:27:38.069 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:27:38.069 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:27:38.069 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:27:38.069 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:27:38.070 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:27:38.070 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:27:38.070 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:27:38.070 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:27:38.070 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:27:38.070 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:27:38.070 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:27:38.070 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:27:38.070 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:27:38.070 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:27:38.070 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:27:38.070 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:27:38.070 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:27:38.070 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:27:38.071 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:38.071 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:27:38.071 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:27:38.071 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:27:38.071 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:27:38.071 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:27:38.071 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:27:38.071 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:27:38.071 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:27:38.071 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:27:38.071 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:27:38.071 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:27:38.071 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:27:38.072 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:27:38.072 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:27:38.072 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:27:38.072 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:27:38.072 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:27:38.072 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:27:38.072 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:27:38.072 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:27:38.072 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:27:38.072 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:27:38.072 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:27:38.072 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:27:38.072 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:27:38.072 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:27:38.073 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:27:38.073 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:27:38.073 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:27:38.073 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:27:38.073 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:27:38.073 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:27:38.073 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:38.073 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:27:38.073 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:38.073 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:27:38.073 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:27:38.073 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:27:38.073 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:27:38.073 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:38.073 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:27:38.074 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:27:38.074 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:27:38.074 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:38.074 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:27:38.074 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:38.074 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:27:38.074 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:27:38.074 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:27:38.074 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:27:38.074 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:27:38.074 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:27:38.074 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:38.074 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:38.074 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:27:38.074 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:27:38.074 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:27:38.075 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:27:38.075 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:38.075 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:27:38.075 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:27:38.075 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:27:38.075 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:38.075 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:27:38.075 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:38.075 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:27:38.075 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:27:38.075 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:27:38.075 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:27:38.075 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:27:38.075 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:27:38.075 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:38.076 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:38.076 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:27:38.076 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:27:38.076 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:27:38.076 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:27:38.076 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:38.076 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:27:38.076 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:27:38.076 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:27:38.076 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:38.076 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:27:38.076 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:38.076 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:27:38.076 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:27:38.076 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:27:38.076 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:27:38.077 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:27:38.077 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:27:38.077 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:38.077 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:27:38.077 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:38.077 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:27:38.077 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:27:38.077 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:38.077 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:27:38.077 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:27:38.077 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:27:38.077 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:38.077 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:27:38.077 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:27:38.077 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:38.078 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:27:38.078 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:27:38.078 INFO:teuthology.orchestra.run.trial110.stdout: "num": 4 2026-02-13T20:27:38.078 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:38.078 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:27:38.078 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:27:38.078 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:38.078 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:27:38.078 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:27:38.078 INFO:teuthology.orchestra.run.trial110.stdout: "num": 4 2026-02-13T20:27:38.078 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:38.078 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:27:38.078 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:38.078 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:27:38.078 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:27:38.080 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.042+0000 7f6f69a5b640 1 -- 10.20.193.110:0/2627702157 >> v1:10.20.193.188:6812/1623052694 conn(0x7f6f3403f960 legacy=0x7f6f3405fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:38.080 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.042+0000 7f6f69a5b640 10 monclient: shutdown 2026-02-13T20:27:38.080 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.042+0000 7f6f69a5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:27:38.080 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.042+0000 7f6f69a5b640 1 -- 10.20.193.110:0/2627702157 >> v1:10.20.193.110:6790/0 conn(0x7f6f641947c0 legacy=0x7f6f64194c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:38.080 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.042+0000 7f6f637fe640 1 -- 10.20.193.110:0/2627702157 reap_dead start 2026-02-13T20:27:38.080 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.042+0000 7f6f637fe640 1 -- 10.20.193.110:0/2627702157 reap_dead start 2026-02-13T20:27:38.080 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.042+0000 7f6f69a5b640 1 -- 10.20.193.110:0/2627702157 shutdown_connections 2026-02-13T20:27:38.080 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.042+0000 7f6f69a5b640 1 -- 10.20.193.110:0/2627702157 >> 10.20.193.110:0/2627702157 conn(0x7f6f64054e90 msgr2=0x7f6f6408db90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:27:38.080 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.042+0000 7f6f69a5b640 1 -- 10.20.193.110:0/2627702157 shutdown_connections 2026-02-13T20:27:38.080 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.042+0000 7f6f69a5b640 1 -- 10.20.193.110:0/2627702157 wait complete. 2026-02-13T20:27:38.081 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-13T20:27:38.081 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-13T20:27:38.081 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T20:27:38.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.145+0000 7f0dc470c640 10 monclient: get_monmap_and_config 2026-02-13T20:27:38.154 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.145+0000 7f0dc470c640 10 monclient: build_initial_monmap 2026-02-13T20:27:38.154 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.145+0000 7f0dc470c640 10 monclient: monmap: 2026-02-13T20:27:38.154 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:27:38.154 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:38.154 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:27:38.147090+0000 2026-02-13T20:27:38.154 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:27:38.147090+0000 2026-02-13T20:27:38.154 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:27:38.154 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:38.154 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:27:38.154 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:27:38.154 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:27:38.154 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:38.155 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.146+0000 7f0dc470c640 1 Processor -- start 2026-02-13T20:27:38.155 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.146+0000 7f0dc470c640 1 -- start start 2026-02-13T20:27:38.155 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.146+0000 7f0dc470c640 10 monclient: init 2026-02-13T20:27:38.155 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.146+0000 7f0dc470c640 10 monclient: _reopen_session rank -1 2026-02-13T20:27:38.155 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.146+0000 7f0dc470c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:27:38.155 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.146+0000 7f0dc470c640 10 monclient(hunting): picked mon.noname-b con 0x7f0dbc1401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:27:38.155 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.146+0000 7f0dc470c640 10 monclient(hunting): picked mon.noname-a con 0x7f0dbc092020 addr v1:10.20.193.110:6789/0 2026-02-13T20:27:38.155 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.146+0000 7f0dc470c640 10 monclient(hunting): picked mon.noname-c con 0x7f0dbc091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:27:38.155 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.146+0000 7f0dc470c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0dbc08b730 con 0x7f0dbc092020 2026-02-13T20:27:38.155 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.146+0000 7f0dc470c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0dbc05c5b0 con 0x7f0dbc091950 2026-02-13T20:27:38.155 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.146+0000 7f0dc470c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0dbc08bcf0 con 0x7f0dbc1401c0 2026-02-13T20:27:38.155 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.146+0000 7f0dc470c640 10 monclient(hunting): _renew_subs 2026-02-13T20:27:38.155 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.146+0000 7f0dc470c640 10 monclient(hunting): authenticate will time out at 1619.837464s 2026-02-13T20:27:38.156 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.146+0000 7f0dc2c82640 1 -- >> v1:10.20.193.188:6789/0 conn(0x7f0dbc091950 legacy=0x7f0dbc1a2a20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:27:38.156 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.146+0000 7f0dc1c80640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f0dbc092020 0x7f0dbc1812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:39332/0 (socket says 10.20.193.110:39332) 2026-02-13T20:27:38.156 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.146+0000 7f0dc1c80640 1 -- 10.20.193.110:0/1378477670 learned_addr learned my addr 10.20.193.110:0/1378477670 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:27:38.156 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.146+0000 7f0dc2481640 1 --1- 10.20.193.110:0/1378477670 >> v1:10.20.193.110:6790/0 conn(0x7f0dbc1401c0 0x7f0dbc091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:41892/0 (socket says 10.20.193.110:41892) 2026-02-13T20:27:38.156 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.146+0000 7f0dc147f640 1 -- 10.20.193.110:0/1378477670 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1544271788 0 0) 0x7f0dbc08b730 con 0x7f0dbc092020 2026-02-13T20:27:38.156 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.146+0000 7f0dc147f640 10 monclient(hunting): _negotiate 2026-02-13T20:27:38.156 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.146+0000 7f0dc147f640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:38.156 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.146+0000 7f0dc147f640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:38.156 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.146+0000 7f0dc147f640 10 monclient(hunting): my global_id is 124482 2026-02-13T20:27:38.156 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.146+0000 7f0dc147f640 1 -- 10.20.193.110:0/1378477670 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0da40035e0 con 0x7f0dbc092020 2026-02-13T20:27:38.156 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.146+0000 7f0dc147f640 1 -- 10.20.193.110:0/1378477670 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1150125871 0 0) 0x7f0dbc08bcf0 con 0x7f0dbc1401c0 2026-02-13T20:27:38.156 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.146+0000 7f0dc147f640 10 monclient(hunting): _negotiate 2026-02-13T20:27:38.156 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.146+0000 7f0dc147f640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:38.157 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.146+0000 7f0dc147f640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:38.157 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.146+0000 7f0dc147f640 10 monclient(hunting): my global_id is 154190 2026-02-13T20:27:38.157 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.146+0000 7f0dc147f640 1 -- 10.20.193.110:0/1378477670 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0dbc08b730 con 0x7f0dbc1401c0 2026-02-13T20:27:38.157 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.146+0000 7f0dc147f640 1 -- 10.20.193.110:0/1378477670 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3111322443 0 0) 0x7f0da40035e0 con 0x7f0dbc092020 2026-02-13T20:27:38.157 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.146+0000 7f0dc147f640 1 -- 10.20.193.110:0/1378477670 >> v1:10.20.193.110:6790/0 conn(0x7f0dbc1401c0 legacy=0x7f0dbc091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:38.157 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.146+0000 7f0dc147f640 1 -- 10.20.193.110:0/1378477670 >> v1:10.20.193.188:6789/0 conn(0x7f0dbc091950 legacy=0x7f0dbc1a2a20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:27:38.157 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.146+0000 7f0dc147f640 10 monclient: _finish_hunting 0 2026-02-13T20:27:38.157 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.146+0000 7f0dc147f640 1 monclient: found mon.noname-a 2026-02-13T20:27:38.157 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.147+0000 7f0dc147f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:27:38.157 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.147+0000 7f0dc147f640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:27:38.157 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.147+0000 7f0dc147f640 1 -- 10.20.193.110:0/1378477670 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dbc140590 con 0x7f0dbc092020 2026-02-13T20:27:38.157 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.147+0000 7f0dc147f640 10 monclient: _finish_auth 0 2026-02-13T20:27:38.157 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.147+0000 7f0dc147f640 10 monclient: _check_auth_tickets 2026-02-13T20:27:38.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.147+0000 7f0dc147f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:27:38.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.147+0000 7f0dc147f640 1 -- 10.20.193.110:0/1378477670 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f0db0002dd0 con 0x7f0dbc092020 2026-02-13T20:27:38.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.147+0000 7f0dc470c640 5 monclient: authenticate success, global_id 124482 2026-02-13T20:27:38.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.147+0000 7f0dc147f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:38.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.147+0000 7f0dc147f640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:27:38.158 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.147+0000 7f0dc147f640 10 monclient: dump: 2026-02-13T20:27:38.158 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:38.158 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:38.158 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:38.158 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:38.158 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:38.158 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:38.158 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:38.158 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:38.159 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:38.159 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:38.159 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.147+0000 7f0dc470c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:27:38.159 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.147+0000 7f0dc147f640 1 -- 10.20.193.110:0/1378477670 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0db0002fe0 con 0x7f0dbc092020 2026-02-13T20:27:38.159 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.147+0000 7f0dc147f640 10 monclient: handle_config config(0 keys) 2026-02-13T20:27:38.159 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.147+0000 7f0dc470c640 10 monclient: get_monmap_and_config success 2026-02-13T20:27:38.159 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.147+0000 7f0dc470c640 4 set_mon_vals no callback set 2026-02-13T20:27:38.159 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.147+0000 7f0dc147f640 1 -- 10.20.193.110:0/1378477670 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f0db00033b0 con 0x7f0dbc092020 2026-02-13T20:27:38.159 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.147+0000 7f0dc147f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:38.159 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.147+0000 7f0dc147f640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:27:38.159 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.147+0000 7f0dc147f640 10 monclient: dump: 2026-02-13T20:27:38.159 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:38.159 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:38.159 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:38.160 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:38.160 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:38.160 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:38.160 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:38.160 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:38.160 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:38.160 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:38.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.147+0000 7f0dc470c640 10 monclient: shutdown 2026-02-13T20:27:38.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.147+0000 7f0dc470c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:27:38.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.147+0000 7f0dc470c640 1 -- 10.20.193.110:0/1378477670 >> v1:10.20.193.110:6789/0 conn(0x7f0dbc092020 legacy=0x7f0dbc1812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:38.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.147+0000 7f0dc470c640 1 -- 10.20.193.110:0/1378477670 shutdown_connections 2026-02-13T20:27:38.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.147+0000 7f0dc470c640 1 -- 10.20.193.110:0/1378477670 >> 10.20.193.110:0/1378477670 conn(0x7f0dbc054e90 msgr2=0x7f0dbc058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:27:38.160 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.147+0000 7f0dc470c640 1 -- 10.20.193.110:0/1378477670 shutdown_connections 2026-02-13T20:27:38.161 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.147+0000 7f0dc470c640 1 -- 10.20.193.110:0/1378477670 wait complete. 2026-02-13T20:27:38.161 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.147+0000 7f0dc470c640 10 monclient: build_initial_monmap 2026-02-13T20:27:38.161 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.147+0000 7f0dc470c640 10 monclient: monmap: 2026-02-13T20:27:38.161 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:27:38.161 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:27:38.161 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:27:38.161 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:27:38.161 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:27:38.161 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:27:38.161 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:27:38.161 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:27:38.161 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:27:38.162 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:38.162 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.148+0000 7f0dc470c640 1 Processor -- start 2026-02-13T20:27:38.162 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.148+0000 7f0dc470c640 1 -- start start 2026-02-13T20:27:38.162 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.148+0000 7f0dc470c640 10 monclient: init 2026-02-13T20:27:38.162 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.148+0000 7f0dc470c640 10 monclient: _reopen_session rank -1 2026-02-13T20:27:38.162 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.148+0000 7f0dc470c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:27:38.162 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.148+0000 7f0dc470c640 10 monclient(hunting): picked mon.noname-b con 0x7f0dbc091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:27:38.162 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.148+0000 7f0dc470c640 10 monclient(hunting): picked mon.noname-a con 0x7f0dbc1401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:27:38.162 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.148+0000 7f0dc470c640 10 monclient(hunting): picked mon.noname-c con 0x7f0dbc12d260 addr v1:10.20.193.110:6790/0 2026-02-13T20:27:38.163 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.148+0000 7f0dc470c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0dbc08c1c0 con 0x7f0dbc1401c0 2026-02-13T20:27:38.163 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.148+0000 7f0dc470c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0dbc12dc70 con 0x7f0dbc091950 2026-02-13T20:27:38.163 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.148+0000 7f0dc470c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0dbc05d320 con 0x7f0dbc12d260 2026-02-13T20:27:38.163 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.148+0000 7f0dc470c640 10 monclient(hunting): _renew_subs 2026-02-13T20:27:38.163 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.148+0000 7f0dc470c640 10 monclient(hunting): authenticate will time out at 1619.839561s 2026-02-13T20:27:38.163 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.148+0000 7f0dc1c80640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f0dbc1401c0 0x7f0dbc191540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:39340/0 (socket says 10.20.193.110:39340) 2026-02-13T20:27:38.163 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.148+0000 7f0dc2481640 1 -- >> v1:10.20.193.188:6789/0 conn(0x7f0dbc091950 legacy=0x7f0dbc13e800 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:27:38.163 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.148+0000 7f0dc1c80640 1 -- 10.20.193.110:0/956439310 learned_addr learned my addr 10.20.193.110:0/956439310 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:27:38.163 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.148+0000 7f0da2ffd640 1 -- 10.20.193.110:0/956439310 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3916254698 0 0) 0x7f0dbc08c1c0 con 0x7f0dbc1401c0 2026-02-13T20:27:38.164 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.148+0000 7f0da2ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:27:38.164 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.148+0000 7f0da2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:38.164 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.148+0000 7f0da2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:38.164 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.148+0000 7f0da2ffd640 10 monclient(hunting): my global_id is 124485 2026-02-13T20:27:38.164 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.148+0000 7f0da2ffd640 1 -- 10.20.193.110:0/956439310 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d8c0035e0 con 0x7f0dbc1401c0 2026-02-13T20:27:38.164 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.148+0000 7f0da2ffd640 1 -- 10.20.193.110:0/956439310 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 394204550 0 0) 0x7f0dbc05d320 con 0x7f0dbc12d260 2026-02-13T20:27:38.164 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.148+0000 7f0da2ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:27:38.164 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.148+0000 7f0da2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:38.164 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.148+0000 7f0da2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:38.164 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.148+0000 7f0da2ffd640 10 monclient(hunting): my global_id is 154193 2026-02-13T20:27:38.165 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.148+0000 7f0da2ffd640 1 -- 10.20.193.110:0/956439310 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0dbc08c1c0 con 0x7f0dbc12d260 2026-02-13T20:27:38.165 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.148+0000 7f0da2ffd640 1 -- 10.20.193.110:0/956439310 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 289695176 0 0) 0x7f0d8c0035e0 con 0x7f0dbc1401c0 2026-02-13T20:27:38.165 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.148+0000 7f0da2ffd640 1 -- 10.20.193.110:0/956439310 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0dbc05d320 con 0x7f0dbc1401c0 2026-02-13T20:27:38.165 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.148+0000 7f0da2ffd640 1 -- 10.20.193.110:0/956439310 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f0db0003300 con 0x7f0dbc1401c0 2026-02-13T20:27:38.165 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.148+0000 7f0da2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:27:38.165 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.148+0000 7f0da2ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:27:38.165 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.148+0000 7f0da2ffd640 10 monclient(hunting): dump: 2026-02-13T20:27:38.165 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:38.165 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:38.166 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:38.166 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:38.166 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:38.166 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:38.166 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:38.166 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:38.166 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:38.166 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:38.166 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.148+0000 7f0da2ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:27:38.167 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.148+0000 7f0da2ffd640 1 -- 10.20.193.110:0/956439310 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1742941629 0 0) 0x7f0dbc08c1c0 con 0x7f0dbc12d260 2026-02-13T20:27:38.167 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.148+0000 7f0da2ffd640 1 -- 10.20.193.110:0/956439310 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0d8c0035e0 con 0x7f0dbc12d260 2026-02-13T20:27:38.167 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.148+0000 7f0da2ffd640 1 -- 10.20.193.110:0/956439310 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f0db8005160 con 0x7f0dbc12d260 2026-02-13T20:27:38.167 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.148+0000 7f0da2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:27:38.167 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.148+0000 7f0da2ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:27:38.167 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.148+0000 7f0da2ffd640 10 monclient(hunting): dump: 2026-02-13T20:27:38.167 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:38.167 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:38.167 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:38.168 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:38.168 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:38.168 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:38.168 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:38.168 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:38.168 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:38.168 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:38.168 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.149+0000 7f0da2ffd640 1 -- 10.20.193.110:0/956439310 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3485316223 0 0) 0x7f0dbc05d320 con 0x7f0dbc1401c0 2026-02-13T20:27:38.168 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.149+0000 7f0da2ffd640 1 -- 10.20.193.110:0/956439310 >> v1:10.20.193.110:6790/0 conn(0x7f0dbc12d260 legacy=0x7f0dbc192c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:38.169 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.149+0000 7f0da2ffd640 1 -- 10.20.193.110:0/956439310 >> v1:10.20.193.188:6789/0 conn(0x7f0dbc091950 legacy=0x7f0dbc13e800 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T20:27:38.169 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.149+0000 7f0da2ffd640 10 monclient: _finish_hunting 0 2026-02-13T20:27:38.169 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.149+0000 7f0da2ffd640 1 monclient: found mon.a 2026-02-13T20:27:38.169 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.149+0000 7f0da2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:27:38.169 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.149+0000 7f0da2ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:27:38.169 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.149+0000 7f0da2ffd640 1 -- 10.20.193.110:0/956439310 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dbc14e7e0 con 0x7f0dbc1401c0 2026-02-13T20:27:38.169 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.149+0000 7f0da2ffd640 10 monclient: _finish_auth 0 2026-02-13T20:27:38.169 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.149+0000 7f0da2ffd640 10 monclient: _check_auth_tickets 2026-02-13T20:27:38.169 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.149+0000 7f0da2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:27:38.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.149+0000 7f0dc470c640 5 monclient: authenticate success, global_id 124485 2026-02-13T20:27:38.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.149+0000 7f0dc470c640 10 monclient: _renew_subs 2026-02-13T20:27:38.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.149+0000 7f0dc470c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:27:38.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.149+0000 7f0dc470c640 1 -- 10.20.193.110:0/956439310 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0dbc12ffd0 con 0x7f0dbc1401c0 2026-02-13T20:27:38.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.149+0000 7f0dc470c640 10 monclient: _renew_subs 2026-02-13T20:27:38.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.149+0000 7f0dc470c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:27:38.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.149+0000 7f0dc470c640 1 -- 10.20.193.110:0/956439310 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f0dbc12e7d0 con 0x7f0dbc1401c0 2026-02-13T20:27:38.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.149+0000 7f0da2ffd640 1 -- 10.20.193.110:0/956439310 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0db0004b50 con 0x7f0dbc1401c0 2026-02-13T20:27:38.170 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.149+0000 7f0da2ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:27:38.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.149+0000 7f0da2ffd640 1 -- 10.20.193.110:0/956439310 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f0db00029d0 con 0x7f0dbc1401c0 2026-02-13T20:27:38.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.149+0000 7f0da2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:38.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.149+0000 7f0da2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:27:38.171 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.149+0000 7f0da2ffd640 10 monclient: dump: 2026-02-13T20:27:38.171 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:38.171 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:38.171 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:38.171 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:38.171 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:38.172 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:38.172 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:38.172 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:38.172 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:38.172 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:38.172 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.149+0000 7f0dc0c7e640 4 set_mon_vals no callback set 2026-02-13T20:27:38.172 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.149+0000 7f0dc470c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:27:38.172 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.149+0000 7f0dc470c640 1 -- 10.20.193.110:0/956439310 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0dbc12d660 con 0x7f0dbc092020 2026-02-13T20:27:38.172 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.149+0000 7f0da2ffd640 1 -- 10.20.193.110:0/956439310 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f0db0004eb0 con 0x7f0dbc1401c0 2026-02-13T20:27:38.173 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.149+0000 7f0da2ffd640 1 -- 10.20.193.110:0/956439310 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4107341065 0 0) 0x7f0dac002760 con 0x7f0dbc092020 2026-02-13T20:27:38.173 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.149+0000 7f0da2ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:27:38.173 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.149+0000 7f0da2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:38.173 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.149+0000 7f0da2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:38.173 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.149+0000 7f0da2ffd640 10 monclient(hunting): my global_id is 154196 2026-02-13T20:27:38.173 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.149+0000 7f0da2ffd640 1 -- 10.20.193.110:0/956439310 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0dbc05d320 con 0x7f0dbc092020 2026-02-13T20:27:38.173 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.149+0000 7f0da2ffd640 1 -- 10.20.193.110:0/956439310 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(774..774 src has 1..774) ==== 3947+0+0 (unknown 763813869 0 0) 0x7f0db004eb20 con 0x7f0dbc1401c0 2026-02-13T20:27:38.173 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.150+0000 7f0da2ffd640 1 -- 10.20.193.110:0/956439310 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3688439740 0 0) 0x7f0dbc05d320 con 0x7f0dbc092020 2026-02-13T20:27:38.173 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.150+0000 7f0da2ffd640 1 -- 10.20.193.110:0/956439310 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0dac002760 con 0x7f0dbc092020 2026-02-13T20:27:38.173 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.150+0000 7f0da2ffd640 1 -- 10.20.193.110:0/956439310 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f0dac003170 con 0x7f0dbc092020 2026-02-13T20:27:38.174 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.150+0000 7f0da2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:38.174 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.150+0000 7f0da2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:27:38.174 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.150+0000 7f0da2ffd640 10 monclient: dump: 2026-02-13T20:27:38.174 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:38.174 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:38.174 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:38.174 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:38.174 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:38.174 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:38.175 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:38.175 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:38.175 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:38.175 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:38.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.150+0000 7f0dc2c82640 10 monclient: get_auth_request con 0x7f0d8c03f9b0 auth_method 0 2026-02-13T20:27:38.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.150+0000 7f0da2ffd640 1 -- 10.20.193.110:0/956439310 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2493891405 0 0) 0x7f0dac002760 con 0x7f0dbc092020 2026-02-13T20:27:38.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.150+0000 7f0da2ffd640 1 -- 10.20.193.110:0/956439310 --> v1:10.20.193.110:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0dbc08b450 con 0x7f0dbc092020 2026-02-13T20:27:38.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.150+0000 7f0da2ffd640 1 -- 10.20.193.110:0/956439310 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f0dac003540 con 0x7f0dbc092020 2026-02-13T20:27:38.175 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.150+0000 7f0da2ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:27:38.176 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.150+0000 7f0da2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:27:38.176 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.150+0000 7f0da2ffd640 1 -- 10.20.193.110:0/956439310 >> v1:10.20.193.110:6790/0 conn(0x7f0dbc092020 legacy=0x7f0dbc127b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:38.176 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.150+0000 7f0da2ffd640 1 -- 10.20.193.110:0/956439310 >> v1:10.20.193.110:6790/0 conn(0x7f0dbc092020 legacy=0x7f0dbc127b20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:27:38.178 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.153+0000 7f0dc470c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:27:38.178 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.153+0000 7f0dc470c640 1 -- 10.20.193.110:0/956439310 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0dbc055bb0 con 0x7f0dbc128230 2026-02-13T20:27:38.178 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.153+0000 7f0da2ffd640 1 -- 10.20.193.110:0/956439310 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2467362007 0 0) 0x7f0dbc055bb0 con 0x7f0dbc128230 2026-02-13T20:27:38.179 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.153+0000 7f0da2ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:27:38.179 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.153+0000 7f0da2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:27:38.179 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.153+0000 7f0da2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:27:38.179 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.153+0000 7f0da2ffd640 10 monclient(hunting): my global_id is 154199 2026-02-13T20:27:38.179 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.153+0000 7f0da2ffd640 1 -- 10.20.193.110:0/956439310 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0dac002760 con 0x7f0dbc128230 2026-02-13T20:27:38.179 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.154+0000 7f0da2ffd640 1 -- 10.20.193.110:0/956439310 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3066166369 0 0) 0x7f0dac002760 con 0x7f0dbc128230 2026-02-13T20:27:38.179 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.154+0000 7f0da2ffd640 1 -- 10.20.193.110:0/956439310 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0dbc055bb0 con 0x7f0dbc128230 2026-02-13T20:27:38.179 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.154+0000 7f0da2ffd640 1 -- 10.20.193.110:0/956439310 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f0dac004cc0 con 0x7f0dbc128230 2026-02-13T20:27:38.179 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.154+0000 7f0da2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:27:38.179 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.154+0000 7f0da2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:27:38.180 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.154+0000 7f0da2ffd640 10 monclient: dump: 2026-02-13T20:27:38.180 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:27:38.180 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:27:38.180 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:38.180 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:27:38.180 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:27:38.180 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:27:38.180 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:27:38.180 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:27:38.180 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:27:38.180 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:27:38.181 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.154+0000 7f0da2ffd640 1 -- 10.20.193.110:0/956439310 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2583653746 0 0) 0x7f0dbc055bb0 con 0x7f0dbc128230 2026-02-13T20:27:38.181 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.154+0000 7f0da2ffd640 1 -- 10.20.193.110:0/956439310 --> v1:10.20.193.110:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0dbc058410 con 0x7f0dbc128230 2026-02-13T20:27:38.181 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.154+0000 7f0da2ffd640 1 -- 10.20.193.110:0/956439310 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4671 (unknown 0 0 1537426550) 0x7f0dac0050f0 con 0x7f0dbc128230 2026-02-13T20:27:38.181 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.154+0000 7f0da2ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:27:38.181 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.154+0000 7f0da2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:27:38.181 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.154+0000 7f0da2ffd640 1 -- 10.20.193.110:0/956439310 >> v1:10.20.193.110:6790/0 conn(0x7f0dbc128230 legacy=0x7f0dbc195390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:38.181 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.154+0000 7f0da2ffd640 1 -- 10.20.193.110:0/956439310 >> v1:10.20.193.110:6790/0 conn(0x7f0dbc128230 legacy=0x7f0dbc195390 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:27:38.182 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:27:38.182 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:27:38.182 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:27:38.182 INFO:teuthology.orchestra.run.trial110.stdout: "state": "leader", 2026-02-13T20:27:38.182 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 62, 2026-02-13T20:27:38.182 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 17433, 2026-02-13T20:27:38.182 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:27:38.182 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:27:38.183 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:27:38.183 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:27:38.183 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 0, 2026-02-13T20:27:38.183 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:27:38.183 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:27:38.183 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:27:38.183 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:27:38.183 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:27:38.183 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:27:38.183 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:27:38.183 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:27:38.184 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:27:38.184 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:27:38.184 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:27:38.184 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:27:38.184 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:27:38.184 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:27:38.184 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:27:38.184 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:27:38.184 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:27:38.184 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:27:38.185 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:27:38.185 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:27:38.185 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:27:38.185 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:27:38.185 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:27:38.185 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:27:38.185 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:27:38.185 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:27:38.185 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:27:38.185 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:27:38.185 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:27:38.185 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:27:38.186 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:27:38.186 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:27:38.186 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:27:38.186 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:38.186 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:27:38.186 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:27:38.186 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:27:38.186 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:27:38.186 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:27:38.186 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:27:38.186 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:27:38.186 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:27:38.187 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:27:38.187 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:27:38.187 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:27:38.187 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:27:38.187 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:27:38.187 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:27:38.187 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:27:38.187 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:27:38.187 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:27:38.187 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:27:38.187 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:27:38.187 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:27:38.187 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:27:38.187 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:27:38.188 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:27:38.188 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:27:38.188 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:27:38.188 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:27:38.188 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:27:38.188 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:27:38.188 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:27:38.188 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:27:38.188 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:27:38.188 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:27:38.188 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:38.188 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:27:38.188 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:38.188 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:27:38.188 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:27:38.188 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:27:38.188 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:27:38.188 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:38.188 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:27:38.189 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:27:38.189 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:27:38.189 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:38.189 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:27:38.189 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:38.189 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:27:38.189 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:27:38.189 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:27:38.189 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:27:38.189 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:27:38.189 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:27:38.189 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:38.189 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:38.189 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:27:38.189 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:27:38.189 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:27:38.189 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:27:38.189 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:38.190 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:27:38.190 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:27:38.190 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:27:38.190 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:38.190 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:27:38.190 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:38.190 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:27:38.190 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:27:38.190 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:27:38.190 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:27:38.190 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:27:38.190 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:27:38.190 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:38.190 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:38.190 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:27:38.190 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:27:38.190 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:27:38.190 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:27:38.190 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:38.190 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:27:38.191 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:27:38.191 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:27:38.191 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:38.191 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:27:38.191 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:38.191 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:27:38.191 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:27:38.191 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:27:38.191 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:27:38.191 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:27:38.191 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:27:38.191 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:38.191 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:27:38.191 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:38.191 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:27:38.191 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:27:38.191 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:38.191 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:27:38.191 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:27:38.191 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:27:38.192 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:38.192 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:27:38.192 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:27:38.192 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:38.192 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:27:38.192 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:27:38.192 INFO:teuthology.orchestra.run.trial110.stdout: "num": 2 2026-02-13T20:27:38.192 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:38.192 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:27:38.192 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:27:38.192 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:38.192 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:27:38.192 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:27:38.192 INFO:teuthology.orchestra.run.trial110.stdout: "num": 3 2026-02-13T20:27:38.192 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:38.192 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:27:38.192 INFO:teuthology.orchestra.run.trial110.stdout: "mgr": [ 2026-02-13T20:27:38.192 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:27:38.192 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:27:38.192 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:27:38.192 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:27:38.193 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:27:38.193 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:27:38.193 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:27:38.193 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:27:38.193 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:27:38.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.154+0000 7f0dc470c640 1 -- 10.20.193.110:0/956439310 >> v1:10.20.193.188:6812/1623052694 conn(0x7f0d8c03f9b0 legacy=0x7f0d8c05fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:38.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.154+0000 7f0dc470c640 10 monclient: shutdown 2026-02-13T20:27:38.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.154+0000 7f0dc470c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:27:38.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.154+0000 7f0dc470c640 1 -- 10.20.193.110:0/956439310 >> v1:10.20.193.110:6789/0 conn(0x7f0dbc1401c0 legacy=0x7f0dbc191540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:27:38.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.154+0000 7f0dc2c82640 1 -- 10.20.193.110:0/956439310 reap_dead start 2026-02-13T20:27:38.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.154+0000 7f0dc470c640 1 -- 10.20.193.110:0/956439310 shutdown_connections 2026-02-13T20:27:38.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.154+0000 7f0dc470c640 1 -- 10.20.193.110:0/956439310 >> 10.20.193.110:0/956439310 conn(0x7f0dbc054e90 msgr2=0x7f0dbc08dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:27:38.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.154+0000 7f0dc470c640 1 -- 10.20.193.110:0/956439310 shutdown_connections 2026-02-13T20:27:38.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:27:38.154+0000 7f0dc470c640 1 -- 10.20.193.110:0/956439310 wait complete. 2026-02-13T20:27:38.194 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-13T20:27:38.195 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-13T20:27:38.809 INFO:tasks.rados.rados.0.trial188.stdout:3619: done (0 left) 2026-02-13T20:27:38.809 INFO:tasks.rados.rados.0.trial188.stdout:3620: write oid 47 current snap is 380 2026-02-13T20:27:38.809 INFO:tasks.rados.rados.0.trial188.stdout:3620: seq_num 1260 ranges {776820=411985,1848841=544761,2918265=258555} 2026-02-13T20:27:38.813 INFO:tasks.rados.rados.0.trial188.stdout:3620: writing trial18843701-47 from 776820 to 1188805 tid 1 2026-02-13T20:27:38.817 INFO:tasks.rados.rados.0.trial188.stdout:3620: writing trial18843701-47 from 1848841 to 2393602 tid 2 2026-02-13T20:27:38.821 INFO:tasks.rados.rados.0.trial188.stdout:3620: writing trial18843701-47 from 2918265 to 3176820 tid 3 2026-02-13T20:27:38.821 INFO:tasks.rados.rados.0.trial188.stdout:3621: rollback oid 2 current snap is 380 2026-02-13T20:27:38.821 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 2 to 372 2026-02-13T20:27:38.821 INFO:tasks.rados.rados.0.trial188.stdout:3622: write oid 45 current snap is 380 2026-02-13T20:27:38.821 INFO:tasks.rados.rados.0.trial188.stdout:3622: seq_num 1261 ranges {793627=487234,1790970=404772,2829335=364292} 2026-02-13T20:27:38.826 INFO:tasks.rados.rados.0.trial188.stdout:3622: writing trial18843701-45 from 793627 to 1280861 tid 1 2026-02-13T20:27:38.830 INFO:tasks.rados.rados.0.trial188.stdout:3622: writing trial18843701-45 from 1790970 to 2195742 tid 2 2026-02-13T20:27:38.834 INFO:tasks.rados.rados.0.trial188.stdout:3622: writing trial18843701-45 from 2829335 to 3193627 tid 3 2026-02-13T20:27:38.834 INFO:tasks.rados.rados.0.trial188.stdout:3623: write oid 18 current snap is 380 2026-02-13T20:27:38.834 INFO:tasks.rados.rados.0.trial188.stdout:3623: seq_num 1262 ranges {410434=678836,1565805=548430,2573111=637323} 2026-02-13T20:27:38.838 INFO:tasks.rados.rados.0.trial188.stdout:3623: writing trial18843701-18 from 410434 to 1089270 tid 1 2026-02-13T20:27:38.842 INFO:tasks.rados.rados.0.trial188.stdout:3623: writing trial18843701-18 from 1565805 to 2114235 tid 2 2026-02-13T20:27:38.847 INFO:tasks.rados.rados.0.trial188.stdout:3623: writing trial18843701-18 from 2573111 to 3210434 tid 3 2026-02-13T20:27:38.847 INFO:tasks.rados.rados.0.trial188.stdout:3624: write oid 27 current snap is 380 2026-02-13T20:27:38.847 INFO:tasks.rados.rados.0.trial188.stdout:3621: finishing rollback tid 1 to trial18843701-2 2026-02-13T20:27:38.847 INFO:tasks.rados.rados.0.trial188.stdout:3624: seq_num 1263 ranges {427241=754085,1624287=408441,2600534=549964} 2026-02-13T20:27:38.852 INFO:tasks.rados.rados.0.trial188.stdout:3624: writing trial18843701-27 from 427241 to 1181326 tid 1 2026-02-13T20:27:38.855 INFO:tasks.rados.rados.0.trial188.stdout:3624: writing trial18843701-27 from 1624287 to 2032728 tid 2 2026-02-13T20:27:38.860 INFO:tasks.rados.rados.0.trial188.stdout:3624: writing trial18843701-27 from 2600534 to 3150498 tid 3 2026-02-13T20:27:38.860 INFO:tasks.rados.rados.0.trial188.stdout:3625: snap_create 2026-02-13T20:27:38.860 INFO:tasks.rados.rados.0.trial188.stdout:3621: finishing rollback tid 2 to trial18843701-2 2026-02-13T20:27:38.860 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 2 v 1745 (ObjNum 1231 snap 372 seq_num 1231) dirty exists 2026-02-13T20:27:38.860 INFO:tasks.rados.rados.0.trial188.stdout:3620: finishing write tid 1 to trial18843701-47 2026-02-13T20:27:38.860 INFO:tasks.rados.rados.0.trial188.stdout:3620: finishing write tid 2 to trial18843701-47 2026-02-13T20:27:38.860 INFO:tasks.rados.rados.0.trial188.stdout:3620: finishing write tid 3 to trial18843701-47 2026-02-13T20:27:38.861 INFO:tasks.rados.rados.0.trial188.stdout:3620: finishing write tid 4 to trial18843701-47 2026-02-13T20:27:38.861 INFO:tasks.rados.rados.0.trial188.stdout:3620: finishing write tid 5 to trial18843701-47 2026-02-13T20:27:38.861 INFO:tasks.rados.rados.0.trial188.stdout:3620: oid 47 updating version 0 to 1106 2026-02-13T20:27:38.861 INFO:tasks.rados.rados.0.trial188.stdout:3620: oid 47 version 1106 is already newer than 1105 2026-02-13T20:27:38.861 INFO:tasks.rados.rados.0.trial188.stdout:3620: oid 47 updating version 1106 to 1108 2026-02-13T20:27:38.861 INFO:tasks.rados.rados.0.trial188.stdout:3620: oid 47 version 1108 is already newer than 1107 2026-02-13T20:27:38.861 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 47 v 1108 (ObjNum 1260 snap 380 seq_num 1260) dirty exists 2026-02-13T20:27:38.861 INFO:tasks.rados.rados.0.trial188.stdout:3620: left oid 47 (ObjNum 1260 snap 380 seq_num 1260) 2026-02-13T20:27:38.861 INFO:tasks.rados.rados.0.trial188.stdout:3622: finishing write tid 1 to trial18843701-45 2026-02-13T20:27:38.861 INFO:tasks.rados.rados.0.trial188.stdout:3622: finishing write tid 2 to trial18843701-45 2026-02-13T20:27:38.861 INFO:tasks.rados.rados.0.trial188.stdout:3622: finishing write tid 3 to trial18843701-45 2026-02-13T20:27:38.861 INFO:tasks.rados.rados.0.trial188.stdout:3622: finishing write tid 4 to trial18843701-45 2026-02-13T20:27:38.862 INFO:tasks.rados.rados.0.trial188.stdout:3622: finishing write tid 5 to trial18843701-45 2026-02-13T20:27:38.862 INFO:tasks.rados.rados.0.trial188.stdout:3622: oid 45 updating version 0 to 1767 2026-02-13T20:27:38.862 INFO:tasks.rados.rados.0.trial188.stdout:3622: oid 45 version 1767 is already newer than 1764 2026-02-13T20:27:38.862 INFO:tasks.rados.rados.0.trial188.stdout:3622: oid 45 version 1767 is already newer than 1765 2026-02-13T20:27:38.862 INFO:tasks.rados.rados.0.trial188.stdout:3622: oid 45 version 1767 is already newer than 1766 2026-02-13T20:27:38.862 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 45 v 1767 (ObjNum 1261 snap 380 seq_num 1261) dirty exists 2026-02-13T20:27:38.862 INFO:tasks.rados.rados.0.trial188.stdout:3622: left oid 45 (ObjNum 1261 snap 380 seq_num 1261) 2026-02-13T20:27:38.867 INFO:tasks.rados.rados.0.trial188.stdout:3623: finishing write tid 1 to trial18843701-18 2026-02-13T20:27:38.867 INFO:tasks.rados.rados.0.trial188.stdout:3623: finishing write tid 2 to trial18843701-18 2026-02-13T20:27:38.868 INFO:tasks.rados.rados.0.trial188.stdout:3623: finishing write tid 3 to trial18843701-18 2026-02-13T20:27:38.868 INFO:tasks.rados.rados.0.trial188.stdout:3623: finishing write tid 4 to trial18843701-18 2026-02-13T20:27:38.868 INFO:tasks.rados.rados.0.trial188.stdout:3623: finishing write tid 5 to trial18843701-18 2026-02-13T20:27:38.868 INFO:tasks.rados.rados.0.trial188.stdout:3623: oid 18 updating version 0 to 1709 2026-02-13T20:27:38.868 INFO:tasks.rados.rados.0.trial188.stdout:3623: oid 18 updating version 1709 to 1710 2026-02-13T20:27:38.868 INFO:tasks.rados.rados.0.trial188.stdout:3623: oid 18 updating version 1710 to 1711 2026-02-13T20:27:38.868 INFO:tasks.rados.rados.0.trial188.stdout:3623: oid 18 updating version 1711 to 1712 2026-02-13T20:27:38.868 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 18 v 1712 (ObjNum 1262 snap 380 seq_num 1262) dirty exists 2026-02-13T20:27:38.868 INFO:tasks.rados.rados.0.trial188.stdout:3623: left oid 18 (ObjNum 1262 snap 380 seq_num 1262) 2026-02-13T20:27:38.878 INFO:tasks.rados.rados.0.trial188.stdout:3624: finishing write tid 1 to trial18843701-27 2026-02-13T20:27:38.878 INFO:tasks.rados.rados.0.trial188.stdout:3624: finishing write tid 2 to trial18843701-27 2026-02-13T20:27:38.878 INFO:tasks.rados.rados.0.trial188.stdout:3624: finishing write tid 3 to trial18843701-27 2026-02-13T20:27:38.879 INFO:tasks.rados.rados.0.trial188.stdout:3624: finishing write tid 4 to trial18843701-27 2026-02-13T20:27:38.879 INFO:tasks.rados.rados.0.trial188.stdout:3624: finishing write tid 5 to trial18843701-27 2026-02-13T20:27:38.879 INFO:tasks.rados.rados.0.trial188.stdout:3624: oid 27 updating version 0 to 1695 2026-02-13T20:27:38.879 INFO:tasks.rados.rados.0.trial188.stdout:3624: oid 27 updating version 1695 to 1697 2026-02-13T20:27:38.879 INFO:tasks.rados.rados.0.trial188.stdout:3624: oid 27 updating version 1697 to 1698 2026-02-13T20:27:38.879 INFO:tasks.rados.rados.0.trial188.stdout:3624: oid 27 version 1698 is already newer than 1696 2026-02-13T20:27:38.879 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 27 v 1698 (ObjNum 1263 snap 380 seq_num 1263) dirty exists 2026-02-13T20:27:38.879 INFO:tasks.rados.rados.0.trial188.stdout:3624: left oid 27 (ObjNum 1263 snap 380 seq_num 1263) 2026-02-13T20:27:39.814 INFO:tasks.rados.rados.0.trial188.stdout:3620: done (5 left) 2026-02-13T20:27:39.814 INFO:tasks.rados.rados.0.trial188.stdout:3621: done (4 left) 2026-02-13T20:27:39.814 INFO:tasks.rados.rados.0.trial188.stdout:3622: done (3 left) 2026-02-13T20:27:39.815 INFO:tasks.rados.rados.0.trial188.stdout:3623: done (2 left) 2026-02-13T20:27:39.815 INFO:tasks.rados.rados.0.trial188.stdout:3624: done (1 left) 2026-02-13T20:27:39.815 INFO:tasks.rados.rados.0.trial188.stdout:3625: done (0 left) 2026-02-13T20:27:39.815 INFO:tasks.rados.rados.0.trial188.stdout:3626: read oid 36 snap -1 2026-02-13T20:27:39.815 INFO:tasks.rados.rados.0.trial188.stdout:3626: expect (ObjNum 1230 snap 372 seq_num 1230) 2026-02-13T20:27:39.815 INFO:tasks.rados.rados.0.trial188.stdout:3627: read oid 25 snap 378 2026-02-13T20:27:39.816 INFO:tasks.rados.rados.0.trial188.stdout:3627: expect (ObjNum 1207 snap 369 seq_num 1207) 2026-02-13T20:27:39.816 INFO:tasks.rados.rados.0.trial188.stdout:3628: rollback oid 17 current snap is 381 2026-02-13T20:27:39.816 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 17 to 370 2026-02-13T20:27:39.816 INFO:tasks.rados.rados.0.trial188.stdout:3629: copy_from oid 24 from oid 49 current snap is 381 2026-02-13T20:27:39.816 INFO:tasks.rados.rados.0.trial188.stdout:3630: copy_from oid 8 from oid 19 current snap is 381 2026-02-13T20:27:39.816 INFO:tasks.rados.rados.0.trial188.stdout:3631: read oid 18 snap -1 2026-02-13T20:27:39.817 INFO:tasks.rados.rados.0.trial188.stdout:3631: expect (ObjNum 1262 snap 380 seq_num 1262) 2026-02-13T20:27:39.817 INFO:tasks.rados.rados.0.trial188.stdout:3632: rollback oid 41 current snap is 381 2026-02-13T20:27:39.817 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 41 to 362 2026-02-13T20:27:39.817 INFO:tasks.rados.rados.0.trial188.stdout:3633: write (excl) oid 37 current snap is 381 2026-02-13T20:27:39.817 INFO:tasks.rados.rados.0.trial188.stdout:3633: seq_num 1264 ranges {444048=429334,1282769=552099,2627957=616091} 2026-02-13T20:27:39.818 INFO:tasks.rados.rados.0.trial188.stdout:3633: writing trial18843701-37 from 444048 to 873382 tid 1 2026-02-13T20:27:39.819 INFO:tasks.rados.rados.0.trial188.stdout:3633: writing trial18843701-37 from 1282769 to 1834868 tid 2 2026-02-13T20:27:39.825 INFO:tasks.rados.rados.0.trial188.stdout:3633: writing trial18843701-37 from 2627957 to 3244048 tid 3 2026-02-13T20:27:39.825 INFO:tasks.rados.rados.0.trial188.stdout:3634: snap_remove snap 377 2026-02-13T20:27:40.728 INFO:tasks.rados.rados.0.trial188.stdout:3634: done (8 left) 2026-02-13T20:27:40.728 INFO:tasks.rados.rados.0.trial188.stdout:3635: delete oid 3 current snap is 381 2026-02-13T20:27:40.729 INFO:tasks.rados.rados.0.trial188.stdout:3632: finishing rollback tid 0 to trial18843701-41 2026-02-13T20:27:40.729 INFO:tasks.rados.rados.0.trial188.stdout:3632: finishing rollback tid 1 to trial18843701-41 2026-02-13T20:27:40.729 INFO:tasks.rados.rados.0.trial188.stdout:3632: finishing rollback tid 2 to trial18843701-41 2026-02-13T20:27:40.729 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 41 v 1727 (ObjNum 1161 snap 354 seq_num 1161) dirty exists 2026-02-13T20:27:40.729 INFO:tasks.rados.rados.0.trial188.stdout:3626: expect (ObjNum 1230 snap 372 seq_num 1230) 2026-02-13T20:27:40.747 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:27:40.766 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:27:40.786 INFO:tasks.rados.rados.0.trial188.stdout:3627: expect (ObjNum 1207 snap 369 seq_num 1207) 2026-02-13T20:27:40.807 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:27:40.829 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:27:40.850 INFO:tasks.rados.rados.0.trial188.stdout:3631: expect (ObjNum 1262 snap 380 seq_num 1262) 2026-02-13T20:27:40.865 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2534238 2026-02-13T20:27:40.872 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:27:40.932 INFO:tasks.rados.rados.0.trial188.stdout:3628: finishing rollback tid 1 to trial18843701-17 2026-02-13T20:27:40.932 INFO:tasks.rados.rados.0.trial188.stdout:3626: done (8 left) 2026-02-13T20:27:40.932 INFO:tasks.rados.rados.0.trial188.stdout:3627: done (7 left) 2026-02-13T20:27:40.932 INFO:tasks.rados.rados.0.trial188.stdout:3631: done (6 left) 2026-02-13T20:27:40.932 INFO:tasks.rados.rados.0.trial188.stdout:3632: done (5 left) 2026-02-13T20:27:40.933 INFO:tasks.rados.rados.0.trial188.stdout:3635: done (4 left) 2026-02-13T20:27:40.933 INFO:tasks.rados.rados.0.trial188.stdout:3636: copy_from oid 30 from oid 4 current snap is 381 2026-02-13T20:27:40.933 INFO:tasks.rados.rados.0.trial188.stdout:3628: finishing rollback tid 2 to trial18843701-17 2026-02-13T20:27:40.933 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 17 v 1714 (ObjNum 1206 snap 369 seq_num 1206) dirty exists 2026-02-13T20:27:40.933 INFO:tasks.rados.rados.0.trial188.stdout:3630: finishing copy_from racing read to trial18843701-8 2026-02-13T20:27:40.933 INFO:tasks.rados.rados.0.trial188.stdout:3629: finishing copy_from racing read to trial18843701-24 2026-02-13T20:27:40.933 INFO:tasks.rados.rados.0.trial188.stdout:3629: finishing copy_from to trial18843701-24 2026-02-13T20:27:40.933 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 24 v 1687 (ObjNum 1248 snap 375 seq_num 1248) dirty exists 2026-02-13T20:27:40.933 INFO:tasks.rados.rados.0.trial188.stdout:3633: finishing write tid 1 to trial18843701-37 2026-02-13T20:27:40.933 INFO:tasks.rados.rados.0.trial188.stdout:3630: finishing copy_from to trial18843701-8 2026-02-13T20:27:40.933 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 8 v 1522 (ObjNum 1196 snap 366 seq_num 1196) dirty exists 2026-02-13T20:27:40.933 INFO:tasks.rados.rados.0.trial188.stdout:3633: finishing write tid 2 to trial18843701-37 2026-02-13T20:27:40.934 INFO:tasks.rados.rados.0.trial188.stdout:3633: finishing write tid 3 to trial18843701-37 2026-02-13T20:27:40.934 INFO:tasks.rados.rados.0.trial188.stdout:3633: finishing write tid 4 to trial18843701-37 2026-02-13T20:27:40.934 INFO:tasks.rados.rados.0.trial188.stdout:3633: finishing write tid 5 to trial18843701-37 2026-02-13T20:27:40.934 INFO:tasks.rados.rados.0.trial188.stdout:3633: oid 37 updating version 0 to 1771 2026-02-13T20:27:40.934 INFO:tasks.rados.rados.0.trial188.stdout:3633: oid 37 updating version 1771 to 1772 2026-02-13T20:27:40.934 INFO:tasks.rados.rados.0.trial188.stdout:3633: oid 37 version 1772 is already newer than 1769 2026-02-13T20:27:40.934 INFO:tasks.rados.rados.0.trial188.stdout:3633: oid 37 updating version 1772 to 1773 2026-02-13T20:27:40.934 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 37 v 1773 (ObjNum 1264 snap 381 seq_num 1264) dirty exists 2026-02-13T20:27:40.934 INFO:tasks.rados.rados.0.trial188.stdout:3633: left oid 37 (ObjNum 1264 snap 381 seq_num 1264) 2026-02-13T20:27:40.934 INFO:tasks.rados.rados.0.trial188.stdout:3628: done (4 left) 2026-02-13T20:27:40.934 INFO:tasks.rados.rados.0.trial188.stdout:3629: done (3 left) 2026-02-13T20:27:40.934 INFO:tasks.rados.rados.0.trial188.stdout:3630: done (2 left) 2026-02-13T20:27:40.935 INFO:tasks.rados.rados.0.trial188.stdout:3633: done (1 left) 2026-02-13T20:27:40.935 INFO:tasks.rados.rados.0.trial188.stdout:3637: read oid 26 snap 365 2026-02-13T20:27:40.935 INFO:tasks.rados.rados.0.trial188.stdout:3637: expect (ObjNum 1162 snap 354 seq_num 1162) 2026-02-13T20:27:40.935 INFO:tasks.rados.rados.0.trial188.stdout:3638: copy_from oid 22 from oid 6 current snap is 381 2026-02-13T20:27:40.935 INFO:tasks.rados.rados.0.trial188.stdout:3639: read oid 11 snap -1 2026-02-13T20:27:40.935 INFO:tasks.rados.rados.0.trial188.stdout:3639: expect deleted 2026-02-13T20:27:40.935 INFO:tasks.rados.rados.0.trial188.stdout:3640: copy_from oid 12 from oid 16 current snap is 381 2026-02-13T20:27:40.935 INFO:tasks.rados.rados.0.trial188.stdout:3641: copy_from oid 23 from oid 20 current snap is 381 2026-02-13T20:27:40.935 INFO:tasks.rados.rados.0.trial188.stdout:3642: delete oid 44 current snap is 381 2026-02-13T20:27:40.936 INFO:tasks.rados.rados.0.trial188.stdout:3636: finishing copy_from to trial18843701-30 2026-02-13T20:27:40.936 INFO:tasks.rados.rados.0.trial188.stdout:3636: got expected ENOENT (src dne) 2026-02-13T20:27:40.936 INFO:tasks.rados.rados.0.trial188.stdout:3636: finishing copy_from racing read to trial18843701-30 2026-02-13T20:27:40.936 INFO:tasks.rados.rados.0.trial188.stdout:3636: done (6 left) 2026-02-13T20:27:40.937 INFO:tasks.rados.rados.0.trial188.stdout:3639: done (5 left) 2026-02-13T20:27:40.937 INFO:tasks.rados.rados.0.trial188.stdout:3642: done (4 left) 2026-02-13T20:27:40.937 INFO:tasks.rados.rados.0.trial188.stdout:3643: delete oid 13 current snap is 381 2026-02-13T20:27:40.937 INFO:tasks.rados.rados.0.trial188.stdout:3637: expect (ObjNum 1162 snap 354 seq_num 1162) 2026-02-13T20:27:41.030 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2567096 2026-02-13T20:27:41.103 INFO:tasks.rados.rados.0.trial188.stdout:3638: finishing copy_from to trial18843701-22 2026-02-13T20:27:41.104 INFO:tasks.rados.rados.0.trial188.stdout:3638: got expected ENOENT (src dne) 2026-02-13T20:27:41.104 INFO:tasks.rados.rados.0.trial188.stdout:3638: finishing copy_from racing read to trial18843701-22 2026-02-13T20:27:41.104 INFO:tasks.rados.rados.0.trial188.stdout:3641: finishing copy_from to trial18843701-23 2026-02-13T20:27:41.104 INFO:tasks.rados.rados.0.trial188.stdout:3641: got expected ENOENT (src dne) 2026-02-13T20:27:41.104 INFO:tasks.rados.rados.0.trial188.stdout:3641: finishing copy_from racing read to trial18843701-23 2026-02-13T20:27:41.104 INFO:tasks.rados.rados.0.trial188.stdout:3640: finishing copy_from racing read to trial18843701-12 2026-02-13T20:27:41.104 INFO:tasks.rados.rados.0.trial188.stdout:3640: finishing copy_from to trial18843701-12 2026-02-13T20:27:41.104 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 12 v 1721 (ObjNum 1121 snap 334 seq_num 1121) dirty exists 2026-02-13T20:27:41.104 INFO:tasks.rados.rados.0.trial188.stdout:3637: done (4 left) 2026-02-13T20:27:41.104 INFO:tasks.rados.rados.0.trial188.stdout:3638: done (3 left) 2026-02-13T20:27:41.104 INFO:tasks.rados.rados.0.trial188.stdout:3640: done (2 left) 2026-02-13T20:27:41.105 INFO:tasks.rados.rados.0.trial188.stdout:3641: done (1 left) 2026-02-13T20:27:41.105 INFO:tasks.rados.rados.0.trial188.stdout:3643: done (0 left) 2026-02-13T20:27:41.105 INFO:tasks.rados.rados.0.trial188.stdout:3644: read oid 41 snap -1 2026-02-13T20:27:41.105 INFO:tasks.rados.rados.0.trial188.stdout:3644: expect (ObjNum 1161 snap 354 seq_num 1161) 2026-02-13T20:27:41.105 INFO:tasks.rados.rados.0.trial188.stdout:3645: write oid 3 current snap is 381 2026-02-13T20:27:41.105 INFO:tasks.rados.rados.0.trial188.stdout:3645: seq_num 1268 ranges {511276=730330,1800344=559437,3021296=289980} 2026-02-13T20:27:41.107 INFO:tasks.rados.rados.0.trial188.stdout:3645: writing trial18843701-3 from 511276 to 1241606 tid 1 2026-02-13T20:27:41.111 INFO:tasks.rados.rados.0.trial188.stdout:3645: writing trial18843701-3 from 1800344 to 2359781 tid 2 2026-02-13T20:27:41.115 INFO:tasks.rados.rados.0.trial188.stdout:3645: writing trial18843701-3 from 3021296 to 3311276 tid 3 2026-02-13T20:27:41.115 INFO:tasks.rados.rados.0.trial188.stdout:3646: read oid 35 snap -1 2026-02-13T20:27:41.115 INFO:tasks.rados.rados.0.trial188.stdout:3646: expect (ObjNum 1256 snap 378 seq_num 1256) 2026-02-13T20:27:41.115 INFO:tasks.rados.rados.0.trial188.stdout:3647: snap_remove snap 376 2026-02-13T20:27:41.818 INFO:tasks.rados.rados.0.trial188.stdout:3647: done (3 left) 2026-02-13T20:27:41.819 INFO:tasks.rados.rados.0.trial188.stdout:3648: snap_create 2026-02-13T20:27:41.819 INFO:tasks.rados.rados.0.trial188.stdout:3644: expect (ObjNum 1161 snap 354 seq_num 1161) 2026-02-13T20:27:41.819 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:27:41.867 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2515476 2026-02-13T20:27:41.907 INFO:tasks.rados.rados.0.trial188.stdout:3646: expect (ObjNum 1256 snap 378 seq_num 1256) 2026-02-13T20:27:41.907 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:27:41.984 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:27:42.022 INFO:tasks.rados.rados.0.trial188.stdout:3645: finishing write tid 1 to trial18843701-3 2026-02-13T20:27:42.022 INFO:tasks.rados.rados.0.trial188.stdout:3645: finishing write tid 2 to trial18843701-3 2026-02-13T20:27:42.022 INFO:tasks.rados.rados.0.trial188.stdout:3645: finishing write tid 3 to trial18843701-3 2026-02-13T20:27:42.022 INFO:tasks.rados.rados.0.trial188.stdout:3645: finishing write tid 4 to trial18843701-3 2026-02-13T20:27:42.022 INFO:tasks.rados.rados.0.trial188.stdout:3645: finishing write tid 5 to trial18843701-3 2026-02-13T20:27:42.023 INFO:tasks.rados.rados.0.trial188.stdout:3645: oid 3 updating version 0 to 1543 2026-02-13T20:27:42.023 INFO:tasks.rados.rados.0.trial188.stdout:3645: oid 3 version 1543 is already newer than 1541 2026-02-13T20:27:42.023 INFO:tasks.rados.rados.0.trial188.stdout:3645: oid 3 version 1543 is already newer than 1542 2026-02-13T20:27:42.023 INFO:tasks.rados.rados.0.trial188.stdout:3645: oid 3 updating version 1543 to 1544 2026-02-13T20:27:42.023 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 3 v 1544 (ObjNum 1268 snap 381 seq_num 1268) dirty exists 2026-02-13T20:27:42.023 INFO:tasks.rados.rados.0.trial188.stdout:3645: left oid 3 (ObjNum 1268 snap 381 seq_num 1268) 2026-02-13T20:27:42.821 INFO:tasks.rados.rados.0.trial188.stdout:3644: done (3 left) 2026-02-13T20:27:42.821 INFO:tasks.rados.rados.0.trial188.stdout:3645: done (2 left) 2026-02-13T20:27:42.821 INFO:tasks.rados.rados.0.trial188.stdout:3646: done (1 left) 2026-02-13T20:27:42.821 INFO:tasks.rados.rados.0.trial188.stdout:3648: done (0 left) 2026-02-13T20:27:42.821 INFO:tasks.rados.rados.0.trial188.stdout:3649: read oid 28 snap -1 2026-02-13T20:27:42.821 INFO:tasks.rados.rados.0.trial188.stdout:3649: expect (ObjNum 1252 snap 378 seq_num 1252) 2026-02-13T20:27:42.821 INFO:tasks.rados.rados.0.trial188.stdout:3650: copy_from oid 4 from oid 24 current snap is 382 2026-02-13T20:27:42.821 INFO:tasks.rados.rados.0.trial188.stdout:3651: snap_create 2026-02-13T20:27:42.826 INFO:tasks.rados.rados.0.trial188.stdout:3649: expect (ObjNum 1252 snap 378 seq_num 1252) 2026-02-13T20:27:42.901 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:27:42.943 INFO:tasks.rados.rados.0.trial188.stdout:3650: finishing copy_from racing read to trial18843701-4 2026-02-13T20:27:42.943 INFO:tasks.rados.rados.0.trial188.stdout:3650: finishing copy_from to trial18843701-4 2026-02-13T20:27:42.943 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 4 v 1687 (ObjNum 1248 snap 375 seq_num 1248) dirty exists 2026-02-13T20:27:43.824 INFO:tasks.rados.rados.0.trial188.stdout:3649: done (2 left) 2026-02-13T20:27:43.824 INFO:tasks.rados.rados.0.trial188.stdout:3650: done (1 left) 2026-02-13T20:27:43.824 INFO:tasks.rados.rados.0.trial188.stdout:3651: done (0 left) 2026-02-13T20:27:43.824 INFO:tasks.rados.rados.0.trial188.stdout:3652: rollback oid 32 current snap is 383 2026-02-13T20:27:43.824 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 32 to 381 2026-02-13T20:27:43.824 INFO:tasks.rados.rados.0.trial188.stdout:3653: snap_create 2026-02-13T20:27:43.828 INFO:tasks.rados.rados.0.trial188.stdout:3652: finishing rollback tid 0 to trial18843701-32 2026-02-13T20:27:43.829 INFO:tasks.rados.rados.0.trial188.stdout:3652: finishing rollback tid 1 to trial18843701-32 2026-02-13T20:27:43.829 INFO:tasks.rados.rados.0.trial188.stdout:3652: finishing rollback tid 2 to trial18843701-32 2026-02-13T20:27:43.829 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 32 v 1730 (ObjNum 1198 snap 366 seq_num 1198) dirty exists 2026-02-13T20:27:44.824 INFO:tasks.rados.rados.0.trial188.stdout:3652: done (1 left) 2026-02-13T20:27:44.824 INFO:tasks.rados.rados.0.trial188.stdout:3653: done (0 left) 2026-02-13T20:27:44.824 INFO:tasks.rados.rados.0.trial188.stdout:3654: write oid 40 current snap is 384 2026-02-13T20:27:44.824 INFO:tasks.rados.rados.0.trial188.stdout:3654: seq_num 1269 ranges {528083=405579,1342473=419448,2248719=733949} 2026-02-13T20:27:44.828 INFO:tasks.rados.rados.0.trial188.stdout:3654: writing trial18843701-40 from 528083 to 933662 tid 1 2026-02-13T20:27:44.832 INFO:tasks.rados.rados.0.trial188.stdout:3654: writing trial18843701-40 from 1342473 to 1761921 tid 2 2026-02-13T20:27:44.836 INFO:tasks.rados.rados.0.trial188.stdout:3654: writing trial18843701-40 from 2248719 to 2982668 tid 3 2026-02-13T20:27:44.836 INFO:tasks.rados.rados.0.trial188.stdout:3655: write oid 34 current snap is 384 2026-02-13T20:27:44.836 INFO:tasks.rados.rados.0.trial188.stdout:3655: seq_num 1270 ranges {544890=597181,1917308=563106,3076142=268748} 2026-02-13T20:27:44.841 INFO:tasks.rados.rados.0.trial188.stdout:3655: writing trial18843701-34 from 544890 to 1142071 tid 1 2026-02-13T20:27:44.847 INFO:tasks.rados.rados.0.trial188.stdout:3655: writing trial18843701-34 from 1917308 to 2480414 tid 2 2026-02-13T20:27:44.850 INFO:tasks.rados.rados.0.trial188.stdout:3655: writing trial18843701-34 from 3076142 to 3344890 tid 3 2026-02-13T20:27:44.850 INFO:tasks.rados.rados.0.trial188.stdout:3656: write oid 48 current snap is 384 2026-02-13T20:27:44.850 INFO:tasks.rados.rados.0.trial188.stdout:3656: seq_num 1271 ranges {561697=672430,1975790=706764,3103565=258132} 2026-02-13T20:27:44.855 INFO:tasks.rados.rados.0.trial188.stdout:3656: writing trial18843701-48 from 561697 to 1234127 tid 1 2026-02-13T20:27:44.860 INFO:tasks.rados.rados.0.trial188.stdout:3656: writing trial18843701-48 from 1975790 to 2682554 tid 2 2026-02-13T20:27:44.863 INFO:tasks.rados.rados.0.trial188.stdout:3656: writing trial18843701-48 from 3103565 to 3361697 tid 3 2026-02-13T20:27:44.863 INFO:tasks.rados.rados.0.trial188.stdout:3657: snap_remove snap 372 2026-02-13T20:27:45.828 INFO:tasks.rados.rados.0.trial188.stdout:3657: done (3 left) 2026-02-13T20:27:45.829 INFO:tasks.rados.rados.0.trial188.stdout:3658: write (excl) oid 19 current snap is 384 2026-02-13T20:27:45.829 INFO:tasks.rados.rados.0.trial188.stdout:3658: seq_num 1272 ranges {578504=747679,2034272=566775,3130988=247516} 2026-02-13T20:27:45.834 INFO:tasks.rados.rados.0.trial188.stdout:3658: writing trial18843701-19 from 578504 to 1326183 tid 1 2026-02-13T20:27:45.840 INFO:tasks.rados.rados.0.trial188.stdout:3658: writing trial18843701-19 from 2034272 to 2601047 tid 2 2026-02-13T20:27:45.843 INFO:tasks.rados.rados.0.trial188.stdout:3658: writing trial18843701-19 from 3130988 to 3378504 tid 3 2026-02-13T20:27:45.843 INFO:tasks.rados.rados.0.trial188.stdout:3659: snap_remove snap 346 2026-02-13T20:27:45.843 INFO:tasks.rados.rados.0.trial188.stdout:3654: finishing write tid 1 to trial18843701-40 2026-02-13T20:27:46.832 INFO:tasks.rados.rados.0.trial188.stdout:3659: done (4 left) 2026-02-13T20:27:46.832 INFO:tasks.rados.rados.0.trial188.stdout:3660: snap_remove snap 383 2026-02-13T20:27:47.833 INFO:tasks.rados.rados.0.trial188.stdout:3660: done (4 left) 2026-02-13T20:27:47.834 INFO:tasks.rados.rados.0.trial188.stdout:3661: read oid 15 snap -1 2026-02-13T20:27:47.834 INFO:tasks.rados.rados.0.trial188.stdout:3661: expect deleted 2026-02-13T20:27:47.834 INFO:tasks.rados.rados.0.trial188.stdout:3662: rollback oid 25 current snap is 384 2026-02-13T20:27:47.834 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 25 to 373 2026-02-13T20:27:47.834 INFO:tasks.rados.rados.0.trial188.stdout:3654: finishing write tid 2 to trial18843701-40 2026-02-13T20:27:47.834 INFO:tasks.rados.rados.0.trial188.stdout:3654: finishing write tid 3 to trial18843701-40 2026-02-13T20:27:47.834 INFO:tasks.rados.rados.0.trial188.stdout:3654: finishing write tid 4 to trial18843701-40 2026-02-13T20:27:47.834 INFO:tasks.rados.rados.0.trial188.stdout:3654: finishing write tid 5 to trial18843701-40 2026-02-13T20:27:47.834 INFO:tasks.rados.rados.0.trial188.stdout:3654: oid 40 updating version 0 to 1734 2026-02-13T20:27:47.834 INFO:tasks.rados.rados.0.trial188.stdout:3654: oid 40 version 1734 is already newer than 1733 2026-02-13T20:27:47.834 INFO:tasks.rados.rados.0.trial188.stdout:3654: oid 40 version 1734 is already newer than 1731 2026-02-13T20:27:47.834 INFO:tasks.rados.rados.0.trial188.stdout:3654: oid 40 version 1734 is already newer than 1732 2026-02-13T20:27:47.834 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 40 v 1734 (ObjNum 1269 snap 384 seq_num 1269) dirty exists 2026-02-13T20:27:47.834 INFO:tasks.rados.rados.0.trial188.stdout:3654: left oid 40 (ObjNum 1269 snap 384 seq_num 1269) 2026-02-13T20:27:47.834 INFO:tasks.rados.rados.0.trial188.stdout:3655: finishing write tid 1 to trial18843701-34 2026-02-13T20:27:47.834 INFO:tasks.rados.rados.0.trial188.stdout:3655: finishing write tid 2 to trial18843701-34 2026-02-13T20:27:47.834 INFO:tasks.rados.rados.0.trial188.stdout:3655: finishing write tid 3 to trial18843701-34 2026-02-13T20:27:47.834 INFO:tasks.rados.rados.0.trial188.stdout:3655: finishing write tid 4 to trial18843701-34 2026-02-13T20:27:47.834 INFO:tasks.rados.rados.0.trial188.stdout:3655: finishing write tid 5 to trial18843701-34 2026-02-13T20:27:47.834 INFO:tasks.rados.rados.0.trial188.stdout:3655: oid 34 updating version 0 to 1783 2026-02-13T20:27:47.834 INFO:tasks.rados.rados.0.trial188.stdout:3655: oid 34 updating version 1783 to 1784 2026-02-13T20:27:47.834 INFO:tasks.rados.rados.0.trial188.stdout:3655: oid 34 updating version 1784 to 1785 2026-02-13T20:27:47.834 INFO:tasks.rados.rados.0.trial188.stdout:3655: oid 34 updating version 1785 to 1786 2026-02-13T20:27:47.834 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 34 v 1786 (ObjNum 1270 snap 384 seq_num 1270) dirty exists 2026-02-13T20:27:47.834 INFO:tasks.rados.rados.0.trial188.stdout:3655: left oid 34 (ObjNum 1270 snap 384 seq_num 1270) 2026-02-13T20:27:47.834 INFO:tasks.rados.rados.0.trial188.stdout:3656: finishing write tid 1 to trial18843701-48 2026-02-13T20:27:47.834 INFO:tasks.rados.rados.0.trial188.stdout:3656: finishing write tid 2 to trial18843701-48 2026-02-13T20:27:47.834 INFO:tasks.rados.rados.0.trial188.stdout:3656: finishing write tid 3 to trial18843701-48 2026-02-13T20:27:47.834 INFO:tasks.rados.rados.0.trial188.stdout:3656: finishing write tid 4 to trial18843701-48 2026-02-13T20:27:47.834 INFO:tasks.rados.rados.0.trial188.stdout:3656: finishing write tid 5 to trial18843701-48 2026-02-13T20:27:47.835 INFO:tasks.rados.rados.0.trial188.stdout:3656: oid 48 updating version 0 to 1117 2026-02-13T20:27:47.835 INFO:tasks.rados.rados.0.trial188.stdout:3656: oid 48 updating version 1117 to 1119 2026-02-13T20:27:47.835 INFO:tasks.rados.rados.0.trial188.stdout:3656: oid 48 updating version 1119 to 1120 2026-02-13T20:27:47.835 INFO:tasks.rados.rados.0.trial188.stdout:3656: oid 48 version 1120 is already newer than 1118 2026-02-13T20:27:47.835 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 48 v 1120 (ObjNum 1271 snap 384 seq_num 1271) dirty exists 2026-02-13T20:27:47.835 INFO:tasks.rados.rados.0.trial188.stdout:3656: left oid 48 (ObjNum 1271 snap 384 seq_num 1271) 2026-02-13T20:27:47.835 INFO:tasks.rados.rados.0.trial188.stdout:3654: done (5 left) 2026-02-13T20:27:47.835 INFO:tasks.rados.rados.0.trial188.stdout:3655: done (4 left) 2026-02-13T20:27:47.835 INFO:tasks.rados.rados.0.trial188.stdout:3656: done (3 left) 2026-02-13T20:27:47.835 INFO:tasks.rados.rados.0.trial188.stdout:3663: write oid 3 current snap is 384 2026-02-13T20:27:47.835 INFO:tasks.rados.rados.0.trial188.stdout:3663: seq_num 1273 ranges {595311=422928,1576401=710433,3042058=353253} 2026-02-13T20:27:47.837 INFO:tasks.rados.rados.0.trial188.stdout:3663: writing trial18843701-3 from 595311 to 1018239 tid 1 2026-02-13T20:27:47.842 INFO:tasks.rados.rados.0.trial188.stdout:3663: writing trial18843701-3 from 1576401 to 2286834 tid 2 2026-02-13T20:27:47.846 INFO:tasks.rados.rados.0.trial188.stdout:3663: writing trial18843701-3 from 3042058 to 3395311 tid 3 2026-02-13T20:27:47.846 INFO:tasks.rados.rados.0.trial188.stdout:3664: snap_remove snap 382 2026-02-13T20:27:48.837 INFO:tasks.rados.rados.0.trial188.stdout:3664: done (4 left) 2026-02-13T20:27:48.837 INFO:tasks.rados.rados.0.trial188.stdout:3665: write (excl) oid 44 current snap is 384 2026-02-13T20:27:48.837 INFO:tasks.rados.rados.0.trial188.stdout:3665: seq_num 1274 ranges {612118=498177,1634883=570444,2669481=706662} 2026-02-13T20:27:48.841 INFO:tasks.rados.rados.0.trial188.stdout:3665: writing trial18843701-44 from 612118 to 1110295 tid 1 2026-02-13T20:27:48.845 INFO:tasks.rados.rados.0.trial188.stdout:3665: writing trial18843701-44 from 1634883 to 2205327 tid 2 2026-02-13T20:27:48.850 INFO:tasks.rados.rados.0.trial188.stdout:3665: writing trial18843701-44 from 2669481 to 3376143 tid 3 2026-02-13T20:27:48.850 INFO:tasks.rados.rados.0.trial188.stdout:3666: read oid 42 snap -1 2026-02-13T20:27:48.850 INFO:tasks.rados.rados.0.trial188.stdout:3666: expect deleted 2026-02-13T20:27:48.850 INFO:tasks.rados.rados.0.trial188.stdout:3667: write (excl) oid 18 current snap is 384 2026-02-13T20:27:48.850 INFO:tasks.rados.rados.0.trial188.stdout:3667: seq_num 1275 ranges {628925=573426,1693365=714102,3096904=332021} 2026-02-13T20:27:48.854 INFO:tasks.rados.rados.0.trial188.stdout:3667: writing trial18843701-18 from 628925 to 1202351 tid 1 2026-02-13T20:27:48.858 INFO:tasks.rados.rados.0.trial188.stdout:3667: writing trial18843701-18 from 1693365 to 2407467 tid 2 2026-02-13T20:27:48.864 INFO:tasks.rados.rados.0.trial188.stdout:3667: writing trial18843701-18 from 3096904 to 3428925 tid 3 2026-02-13T20:27:48.864 INFO:tasks.rados.rados.0.trial188.stdout:3668: rollback oid 45 current snap is 384 2026-02-13T20:27:48.865 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 45 to 373 2026-02-13T20:27:48.865 INFO:tasks.rados.rados.0.trial188.stdout:3658: finishing write tid 1 to trial18843701-19 2026-02-13T20:27:48.865 INFO:tasks.rados.rados.0.trial188.stdout:3658: finishing write tid 2 to trial18843701-19 2026-02-13T20:27:48.865 INFO:tasks.rados.rados.0.trial188.stdout:3658: finishing write tid 3 to trial18843701-19 2026-02-13T20:27:48.865 INFO:tasks.rados.rados.0.trial188.stdout:3669: copy_from oid 29 from oid 40 current snap is 384 2026-02-13T20:27:48.865 INFO:tasks.rados.rados.0.trial188.stdout:3658: finishing write tid 4 to trial18843701-19 2026-02-13T20:27:48.865 INFO:tasks.rados.rados.0.trial188.stdout:3658: finishing write tid 5 to trial18843701-19 2026-02-13T20:27:48.865 INFO:tasks.rados.rados.0.trial188.stdout:3658: oid 19 updating version 0 to 1634 2026-02-13T20:27:48.865 INFO:tasks.rados.rados.0.trial188.stdout:3658: oid 19 version 1634 is already newer than 1633 2026-02-13T20:27:48.865 INFO:tasks.rados.rados.0.trial188.stdout:3658: oid 19 updating version 1634 to 1635 2026-02-13T20:27:48.865 INFO:tasks.rados.rados.0.trial188.stdout:3658: oid 19 version 1635 is already newer than 1632 2026-02-13T20:27:48.865 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 19 v 1635 (ObjNum 1272 snap 384 seq_num 1272) dirty exists 2026-02-13T20:27:48.866 INFO:tasks.rados.rados.0.trial188.stdout:3658: left oid 19 (ObjNum 1272 snap 384 seq_num 1272) 2026-02-13T20:27:48.866 INFO:tasks.rados.rados.0.trial188.stdout:3658: done (8 left) 2026-02-13T20:27:48.866 INFO:tasks.rados.rados.0.trial188.stdout:3670: rollback oid 9 current snap is 384 2026-02-13T20:27:48.866 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 9 to 381 2026-02-13T20:27:48.866 INFO:tasks.rados.rados.0.trial188.stdout:3662: finishing rollback tid 0 to trial18843701-25 2026-02-13T20:27:48.866 INFO:tasks.rados.rados.0.trial188.stdout:3662: finishing rollback tid 1 to trial18843701-25 2026-02-13T20:27:48.866 INFO:tasks.rados.rados.0.trial188.stdout:3662: finishing rollback tid 2 to trial18843701-25 2026-02-13T20:27:48.866 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 25 v 1720 (ObjNum 1207 snap 369 seq_num 1207) dirty exists 2026-02-13T20:27:48.866 INFO:tasks.rados.rados.0.trial188.stdout:3663: finishing write tid 1 to trial18843701-3 2026-02-13T20:27:48.866 INFO:tasks.rados.rados.0.trial188.stdout:3663: finishing write tid 2 to trial18843701-3 2026-02-13T20:27:48.866 INFO:tasks.rados.rados.0.trial188.stdout:3663: finishing write tid 3 to trial18843701-3 2026-02-13T20:27:48.866 INFO:tasks.rados.rados.0.trial188.stdout:3663: finishing write tid 4 to trial18843701-3 2026-02-13T20:27:48.867 INFO:tasks.rados.rados.0.trial188.stdout:3663: finishing write tid 5 to trial18843701-3 2026-02-13T20:27:48.867 INFO:tasks.rados.rados.0.trial188.stdout:3663: oid 3 updating version 0 to 1546 2026-02-13T20:27:48.867 INFO:tasks.rados.rados.0.trial188.stdout:3663: oid 3 version 1546 is already newer than 1545 2026-02-13T20:27:48.867 INFO:tasks.rados.rados.0.trial188.stdout:3663: oid 3 updating version 1546 to 1548 2026-02-13T20:27:48.867 INFO:tasks.rados.rados.0.trial188.stdout:3663: oid 3 version 1548 is already newer than 1547 2026-02-13T20:27:48.867 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 3 v 1548 (ObjNum 1273 snap 384 seq_num 1273) dirty exists 2026-02-13T20:27:48.867 INFO:tasks.rados.rados.0.trial188.stdout:3663: left oid 3 (ObjNum 1273 snap 384 seq_num 1273) 2026-02-13T20:27:48.867 INFO:tasks.rados.rados.0.trial188.stdout:3661: done (8 left) 2026-02-13T20:27:48.867 INFO:tasks.rados.rados.0.trial188.stdout:3662: done (7 left) 2026-02-13T20:27:48.867 INFO:tasks.rados.rados.0.trial188.stdout:3663: done (6 left) 2026-02-13T20:27:48.867 INFO:tasks.rados.rados.0.trial188.stdout:3666: done (5 left) 2026-02-13T20:27:48.867 INFO:tasks.rados.rados.0.trial188.stdout:3671: copy_from oid 8 from oid 14 current snap is 384 2026-02-13T20:27:48.867 INFO:tasks.rados.rados.0.trial188.stdout:3672: copy_from oid 5 from oid 12 current snap is 384 2026-02-13T20:27:48.868 INFO:tasks.rados.rados.0.trial188.stdout:3673: rollback oid 46 current snap is 384 2026-02-13T20:27:48.868 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 46 to 373 2026-02-13T20:27:48.868 INFO:tasks.rados.rados.0.trial188.stdout:3674: read oid 22 snap 373 2026-02-13T20:27:48.868 INFO:tasks.rados.rados.0.trial188.stdout:3674: expect (ObjNum 1223 snap 370 seq_num 1223) 2026-02-13T20:27:48.868 INFO:tasks.rados.rados.0.trial188.stdout:3675: snap_remove snap 380 2026-02-13T20:27:49.841 INFO:tasks.rados.rados.0.trial188.stdout:3675: done (9 left) 2026-02-13T20:27:49.841 INFO:tasks.rados.rados.0.trial188.stdout:3676: write (excl) oid 38 current snap is 384 2026-02-13T20:27:49.841 INFO:tasks.rados.rados.0.trial188.stdout:3676: seq_num 1276 ranges {645732=648675,1751847=574113,3124327=321405} 2026-02-13T20:27:49.846 INFO:tasks.rados.rados.0.trial188.stdout:3676: writing trial18843701-38 from 645732 to 1294407 tid 1 2026-02-13T20:27:49.850 INFO:tasks.rados.rados.0.trial188.stdout:3676: writing trial18843701-38 from 1751847 to 2325960 tid 2 2026-02-13T20:27:49.855 INFO:tasks.rados.rados.0.trial188.stdout:3676: writing trial18843701-38 from 3124327 to 3445732 tid 3 2026-02-13T20:27:49.855 INFO:tasks.rados.rados.0.trial188.stdout:3677: delete oid 28 current snap is 384 2026-02-13T20:27:49.855 INFO:tasks.rados.rados.0.trial188.stdout:3665: finishing write tid 1 to trial18843701-44 2026-02-13T20:27:49.855 INFO:tasks.rados.rados.0.trial188.stdout:3668: finishing rollback tid 0 to trial18843701-45 2026-02-13T20:27:49.855 INFO:tasks.rados.rados.0.trial188.stdout:3670: finishing rollback tid 0 to trial18843701-9 2026-02-13T20:27:49.855 INFO:tasks.rados.rados.0.trial188.stdout:3668: finishing rollback tid 1 to trial18843701-45 2026-02-13T20:27:49.855 INFO:tasks.rados.rados.0.trial188.stdout:3670: finishing rollback tid 1 to trial18843701-9 2026-02-13T20:27:49.855 INFO:tasks.rados.rados.0.trial188.stdout:3668: finishing rollback tid 2 to trial18843701-45 2026-02-13T20:27:49.855 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 45 v 1808 (ObjNum 1228 snap 372 seq_num 1228) dirty exists 2026-02-13T20:27:49.855 INFO:tasks.rados.rados.0.trial188.stdout:3670: finishing rollback tid 2 to trial18843701-9 2026-02-13T20:27:49.855 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 9 v 1550 (ObjNum 1154 snap 347 seq_num 1154) dirty exists 2026-02-13T20:27:49.855 INFO:tasks.rados.rados.0.trial188.stdout:3665: finishing write tid 2 to trial18843701-44 2026-02-13T20:27:49.856 INFO:tasks.rados.rados.0.trial188.stdout:3665: finishing write tid 3 to trial18843701-44 2026-02-13T20:27:49.856 INFO:tasks.rados.rados.0.trial188.stdout:3665: finishing write tid 4 to trial18843701-44 2026-02-13T20:27:49.856 INFO:tasks.rados.rados.0.trial188.stdout:3665: finishing write tid 5 to trial18843701-44 2026-02-13T20:27:49.856 INFO:tasks.rados.rados.0.trial188.stdout:3665: oid 44 updating version 0 to 1750 2026-02-13T20:27:49.856 INFO:tasks.rados.rados.0.trial188.stdout:3665: oid 44 version 1750 is already newer than 1748 2026-02-13T20:27:49.856 INFO:tasks.rados.rados.0.trial188.stdout:3665: oid 44 updating version 1750 to 1751 2026-02-13T20:27:49.856 INFO:tasks.rados.rados.0.trial188.stdout:3665: oid 44 version 1751 is already newer than 1749 2026-02-13T20:27:49.856 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 44 v 1751 (ObjNum 1274 snap 384 seq_num 1274) dirty exists 2026-02-13T20:27:49.856 INFO:tasks.rados.rados.0.trial188.stdout:3665: left oid 44 (ObjNum 1274 snap 384 seq_num 1274) 2026-02-13T20:27:49.856 INFO:tasks.rados.rados.0.trial188.stdout:3674: expect (ObjNum 1223 snap 370 seq_num 1223) 2026-02-13T20:27:49.874 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:27:49.892 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:27:49.912 INFO:tasks.rados.rados.0.trial188.stdout:3673: finishing rollback tid 0 to trial18843701-46 2026-02-13T20:27:49.912 INFO:tasks.rados.rados.0.trial188.stdout:3673: finishing rollback tid 1 to trial18843701-46 2026-02-13T20:27:49.913 INFO:tasks.rados.rados.0.trial188.stdout:3673: finishing rollback tid 2 to trial18843701-46 2026-02-13T20:27:49.913 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 46 v 1737 (ObjNum 1187 snap 363 seq_num 1187) dirty exists 2026-02-13T20:27:49.913 INFO:tasks.rados.rados.0.trial188.stdout:3667: finishing write tid 1 to trial18843701-18 2026-02-13T20:27:49.913 INFO:tasks.rados.rados.0.trial188.stdout:3667: finishing write tid 2 to trial18843701-18 2026-02-13T20:27:49.913 INFO:tasks.rados.rados.0.trial188.stdout:3667: finishing write tid 3 to trial18843701-18 2026-02-13T20:27:49.913 INFO:tasks.rados.rados.0.trial188.stdout:3667: finishing write tid 4 to trial18843701-18 2026-02-13T20:27:49.913 INFO:tasks.rados.rados.0.trial188.stdout:3667: finishing write tid 5 to trial18843701-18 2026-02-13T20:27:49.913 INFO:tasks.rados.rados.0.trial188.stdout:3667: oid 18 updating version 0 to 1723 2026-02-13T20:27:49.913 INFO:tasks.rados.rados.0.trial188.stdout:3667: oid 18 updating version 1723 to 1724 2026-02-13T20:27:49.913 INFO:tasks.rados.rados.0.trial188.stdout:3667: oid 18 updating version 1724 to 1725 2026-02-13T20:27:49.913 INFO:tasks.rados.rados.0.trial188.stdout:3667: oid 18 version 1725 is already newer than 1722 2026-02-13T20:27:49.913 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 18 v 1725 (ObjNum 1275 snap 384 seq_num 1275) dirty exists 2026-02-13T20:27:49.914 INFO:tasks.rados.rados.0.trial188.stdout:3667: left oid 18 (ObjNum 1275 snap 384 seq_num 1275) 2026-02-13T20:27:49.914 INFO:tasks.rados.rados.0.trial188.stdout:3671: finishing copy_from racing read to trial18843701-8 2026-02-13T20:27:49.914 INFO:tasks.rados.rados.0.trial188.stdout:3669: finishing copy_from racing read to trial18843701-29 2026-02-13T20:27:49.914 INFO:tasks.rados.rados.0.trial188.stdout:3665: done (10 left) 2026-02-13T20:27:49.914 INFO:tasks.rados.rados.0.trial188.stdout:3667: done (9 left) 2026-02-13T20:27:49.914 INFO:tasks.rados.rados.0.trial188.stdout:3668: done (8 left) 2026-02-13T20:27:49.914 INFO:tasks.rados.rados.0.trial188.stdout:3670: done (7 left) 2026-02-13T20:27:49.914 INFO:tasks.rados.rados.0.trial188.stdout:3673: done (6 left) 2026-02-13T20:27:49.914 INFO:tasks.rados.rados.0.trial188.stdout:3674: done (5 left) 2026-02-13T20:27:49.914 INFO:tasks.rados.rados.0.trial188.stdout:3677: done (4 left) 2026-02-13T20:27:49.914 INFO:tasks.rados.rados.0.trial188.stdout:3678: write (excl) oid 6 current snap is 384 2026-02-13T20:27:49.915 INFO:tasks.rados.rados.0.trial188.stdout:3672: finishing copy_from racing read to trial18843701-5 2026-02-13T20:27:49.915 INFO:tasks.rados.rados.0.trial188.stdout:3671: finishing copy_from to trial18843701-8 2026-02-13T20:27:49.915 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 8 v 1539 (ObjNum 1258 snap 378 seq_num 1258) dirty exists 2026-02-13T20:27:49.915 INFO:tasks.rados.rados.0.trial188.stdout:3669: finishing copy_from to trial18843701-29 2026-02-13T20:27:49.915 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 29 v 1734 (ObjNum 1269 snap 384 seq_num 1269) dirty exists 2026-02-13T20:27:49.915 INFO:tasks.rados.rados.0.trial188.stdout:3672: finishing copy_from to trial18843701-5 2026-02-13T20:27:49.915 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 5 v 1721 (ObjNum 1121 snap 334 seq_num 1121) dirty exists 2026-02-13T20:27:49.915 INFO:tasks.rados.rados.0.trial188.stdout:3676: finishing write tid 1 to trial18843701-38 2026-02-13T20:27:49.915 INFO:tasks.rados.rados.0.trial188.stdout:3676: finishing write tid 2 to trial18843701-38 2026-02-13T20:27:49.915 INFO:tasks.rados.rados.0.trial188.stdout:3676: finishing write tid 3 to trial18843701-38 2026-02-13T20:27:49.915 INFO:tasks.rados.rados.0.trial188.stdout:3676: finishing write tid 4 to trial18843701-38 2026-02-13T20:27:49.915 INFO:tasks.rados.rados.0.trial188.stdout:3676: finishing write tid 5 to trial18843701-38 2026-02-13T20:27:49.916 INFO:tasks.rados.rados.0.trial188.stdout:3676: oid 38 updating version 0 to 1729 2026-02-13T20:27:49.916 INFO:tasks.rados.rados.0.trial188.stdout:3676: oid 38 version 1729 is already newer than 1727 2026-02-13T20:27:49.916 INFO:tasks.rados.rados.0.trial188.stdout:3676: oid 38 version 1729 is already newer than 1726 2026-02-13T20:27:49.916 INFO:tasks.rados.rados.0.trial188.stdout:3676: oid 38 version 1729 is already newer than 1728 2026-02-13T20:27:49.916 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 38 v 1729 (ObjNum 1276 snap 384 seq_num 1276) dirty exists 2026-02-13T20:27:49.916 INFO:tasks.rados.rados.0.trial188.stdout:3676: left oid 38 (ObjNum 1276 snap 384 seq_num 1276) 2026-02-13T20:27:49.916 INFO:tasks.rados.rados.0.trial188.stdout:3678: seq_num 1278 ranges {679346=515526,1868811=577782,3179173=300173} 2026-02-13T20:27:49.917 INFO:tasks.rados.rados.0.trial188.stdout:3678: writing trial18843701-6 from 679346 to 1194872 tid 1 2026-02-13T20:27:49.920 INFO:tasks.rados.rados.0.trial188.stdout:3678: writing trial18843701-6 from 1868811 to 2446593 tid 2 2026-02-13T20:27:49.925 INFO:tasks.rados.rados.0.trial188.stdout:3678: writing trial18843701-6 from 3179173 to 3479346 tid 3 2026-02-13T20:27:49.925 INFO:tasks.rados.rados.0.trial188.stdout:3669: done (4 left) 2026-02-13T20:27:49.925 INFO:tasks.rados.rados.0.trial188.stdout:3671: done (3 left) 2026-02-13T20:27:49.925 INFO:tasks.rados.rados.0.trial188.stdout:3672: done (2 left) 2026-02-13T20:27:49.925 INFO:tasks.rados.rados.0.trial188.stdout:3676: done (1 left) 2026-02-13T20:27:49.925 INFO:tasks.rados.rados.0.trial188.stdout:3679: copy_from oid 47 from oid 16 current snap is 384 2026-02-13T20:27:49.925 INFO:tasks.rados.rados.0.trial188.stdout:3680: write (excl) oid 9 current snap is 384 2026-02-13T20:27:49.926 INFO:tasks.rados.rados.0.trial188.stdout:3680: seq_num 1279 ranges {696153=590775,1927293=721440,3206596=289557} 2026-02-13T20:27:49.930 INFO:tasks.rados.rados.0.trial188.stdout:3680: writing trial18843701-9 from 696153 to 1286928 tid 1 2026-02-13T20:27:49.935 INFO:tasks.rados.rados.0.trial188.stdout:3680: writing trial18843701-9 from 1927293 to 2648733 tid 2 2026-02-13T20:27:49.938 INFO:tasks.rados.rados.0.trial188.stdout:3680: writing trial18843701-9 from 3206596 to 3496153 tid 3 2026-02-13T20:27:49.938 INFO:tasks.rados.rados.0.trial188.stdout:3681: write oid 41 current snap is 384 2026-02-13T20:27:49.938 INFO:tasks.rados.rados.0.trial188.stdout:3681: seq_num 1280 ranges {712960=666024,1985775=581451,3234019=278941} 2026-02-13T20:27:49.943 INFO:tasks.rados.rados.0.trial188.stdout:3681: writing trial18843701-41 from 712960 to 1378984 tid 1 2026-02-13T20:27:49.948 INFO:tasks.rados.rados.0.trial188.stdout:3681: writing trial18843701-41 from 1985775 to 2567226 tid 2 2026-02-13T20:27:49.952 INFO:tasks.rados.rados.0.trial188.stdout:3681: writing trial18843701-41 from 3234019 to 3512960 tid 3 2026-02-13T20:27:49.952 INFO:tasks.rados.rados.0.trial188.stdout:3682: rollback oid 35 current snap is 384 2026-02-13T20:27:49.953 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 35 to 381 2026-02-13T20:27:49.953 INFO:tasks.rados.rados.0.trial188.stdout:3678: finishing write tid 1 to trial18843701-6 2026-02-13T20:27:49.953 INFO:tasks.rados.rados.0.trial188.stdout:3678: finishing write tid 2 to trial18843701-6 2026-02-13T20:27:49.953 INFO:tasks.rados.rados.0.trial188.stdout:3683: read oid 15 snap -1 2026-02-13T20:27:49.953 INFO:tasks.rados.rados.0.trial188.stdout:3683: expect deleted 2026-02-13T20:27:49.953 INFO:tasks.rados.rados.0.trial188.stdout:3684: write oid 49 current snap is 384 2026-02-13T20:27:49.953 INFO:tasks.rados.rados.0.trial188.stdout:3684: seq_num 1281 ranges {729767=741273,1927904=725109,3145089=384678} 2026-02-13T20:27:49.957 INFO:tasks.rados.rados.0.trial188.stdout:3684: writing trial18843701-49 from 729767 to 1471040 tid 1 2026-02-13T20:27:49.962 INFO:tasks.rados.rados.0.trial188.stdout:3684: writing trial18843701-49 from 1927904 to 2653013 tid 2 2026-02-13T20:27:49.966 INFO:tasks.rados.rados.0.trial188.stdout:3684: writing trial18843701-49 from 3145089 to 3529767 tid 3 2026-02-13T20:27:49.966 INFO:tasks.rados.rados.0.trial188.stdout:3685: rollback oid 33 current snap is 384 2026-02-13T20:27:49.966 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 33 to 359 2026-02-13T20:27:49.966 INFO:tasks.rados.rados.0.trial188.stdout:3678: finishing write tid 3 to trial18843701-6 2026-02-13T20:27:49.966 INFO:tasks.rados.rados.0.trial188.stdout:3678: finishing write tid 4 to trial18843701-6 2026-02-13T20:27:49.966 INFO:tasks.rados.rados.0.trial188.stdout:3678: finishing write tid 5 to trial18843701-6 2026-02-13T20:27:49.966 INFO:tasks.rados.rados.0.trial188.stdout:3678: oid 6 updating version 0 to 1866 2026-02-13T20:27:49.966 INFO:tasks.rados.rados.0.trial188.stdout:3678: oid 6 updating version 1866 to 1867 2026-02-13T20:27:49.967 INFO:tasks.rados.rados.0.trial188.stdout:3678: oid 6 updating version 1867 to 1868 2026-02-13T20:27:49.967 INFO:tasks.rados.rados.0.trial188.stdout:3678: oid 6 updating version 1868 to 1869 2026-02-13T20:27:49.967 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 6 v 1869 (ObjNum 1278 snap 384 seq_num 1278) dirty exists 2026-02-13T20:27:49.967 INFO:tasks.rados.rados.0.trial188.stdout:3678: left oid 6 (ObjNum 1278 snap 384 seq_num 1278) 2026-02-13T20:27:49.967 INFO:tasks.rados.rados.0.trial188.stdout:3678: done (7 left) 2026-02-13T20:27:49.967 INFO:tasks.rados.rados.0.trial188.stdout:3686: read oid 12 snap 362 2026-02-13T20:27:49.967 INFO:tasks.rados.rados.0.trial188.stdout:3686: expect (ObjNum 865 snap 250 seq_num 865) 2026-02-13T20:27:49.967 INFO:tasks.rados.rados.0.trial188.stdout:3687: snap_remove snap 373 2026-02-13T20:27:50.733 INFO:tasks.rados.rados.0.trial188.stdout:3687: done (8 left) 2026-02-13T20:27:50.733 INFO:tasks.rados.rados.0.trial188.stdout:3688: rollback oid 28 current snap is 384 2026-02-13T20:27:50.733 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 28 to 378 2026-02-13T20:27:50.733 INFO:tasks.rados.rados.0.trial188.stdout:3680: finishing write tid 1 to trial18843701-9 2026-02-13T20:27:50.733 INFO:tasks.rados.rados.0.trial188.stdout:3680: finishing write tid 2 to trial18843701-9 2026-02-13T20:27:50.734 INFO:tasks.rados.rados.0.trial188.stdout:3680: finishing write tid 3 to trial18843701-9 2026-02-13T20:27:50.734 INFO:tasks.rados.rados.0.trial188.stdout:3680: finishing write tid 4 to trial18843701-9 2026-02-13T20:27:50.734 INFO:tasks.rados.rados.0.trial188.stdout:3680: finishing write tid 5 to trial18843701-9 2026-02-13T20:27:50.734 INFO:tasks.rados.rados.0.trial188.stdout:3680: oid 9 updating version 0 to 1554 2026-02-13T20:27:50.734 INFO:tasks.rados.rados.0.trial188.stdout:3680: oid 9 version 1554 is already newer than 1553 2026-02-13T20:27:50.734 INFO:tasks.rados.rados.0.trial188.stdout:3680: oid 9 version 1554 is already newer than 1551 2026-02-13T20:27:50.734 INFO:tasks.rados.rados.0.trial188.stdout:3680: oid 9 version 1554 is already newer than 1552 2026-02-13T20:27:50.734 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 9 v 1554 (ObjNum 1279 snap 384 seq_num 1279) dirty exists 2026-02-13T20:27:50.734 INFO:tasks.rados.rados.0.trial188.stdout:3680: left oid 9 (ObjNum 1279 snap 384 seq_num 1279) 2026-02-13T20:27:50.734 INFO:tasks.rados.rados.0.trial188.stdout:3682: finishing rollback tid 0 to trial18843701-35 2026-02-13T20:27:50.734 INFO:tasks.rados.rados.0.trial188.stdout:3682: finishing rollback tid 1 to trial18843701-35 2026-02-13T20:27:50.734 INFO:tasks.rados.rados.0.trial188.stdout:3682: finishing rollback tid 2 to trial18843701-35 2026-02-13T20:27:50.734 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 35 v 1557 (ObjNum 1256 snap 378 seq_num 1256) dirty exists 2026-02-13T20:27:50.734 INFO:tasks.rados.rados.0.trial188.stdout:3681: finishing write tid 1 to trial18843701-41 2026-02-13T20:27:50.734 INFO:tasks.rados.rados.0.trial188.stdout:3681: finishing write tid 2 to trial18843701-41 2026-02-13T20:27:50.735 INFO:tasks.rados.rados.0.trial188.stdout:3680: done (8 left) 2026-02-13T20:27:50.735 INFO:tasks.rados.rados.0.trial188.stdout:3682: done (7 left) 2026-02-13T20:27:50.735 INFO:tasks.rados.rados.0.trial188.stdout:3683: done (6 left) 2026-02-13T20:27:50.735 INFO:tasks.rados.rados.0.trial188.stdout:3689: write (excl) oid 17 current snap is 384 2026-02-13T20:27:50.735 INFO:tasks.rados.rados.0.trial188.stdout:3681: finishing write tid 3 to trial18843701-41 2026-02-13T20:27:50.735 INFO:tasks.rados.rados.0.trial188.stdout:3681: finishing write tid 4 to trial18843701-41 2026-02-13T20:27:50.735 INFO:tasks.rados.rados.0.trial188.stdout:3681: finishing write tid 5 to trial18843701-41 2026-02-13T20:27:50.735 INFO:tasks.rados.rados.0.trial188.stdout:3681: oid 41 updating version 0 to 1738 2026-02-13T20:27:50.735 INFO:tasks.rados.rados.0.trial188.stdout:3681: oid 41 updating version 1738 to 1739 2026-02-13T20:27:50.735 INFO:tasks.rados.rados.0.trial188.stdout:3681: oid 41 updating version 1739 to 1740 2026-02-13T20:27:50.735 INFO:tasks.rados.rados.0.trial188.stdout:3681: oid 41 updating version 1740 to 1741 2026-02-13T20:27:50.735 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 41 v 1741 (ObjNum 1280 snap 384 seq_num 1280) dirty exists 2026-02-13T20:27:50.735 INFO:tasks.rados.rados.0.trial188.stdout:3681: left oid 41 (ObjNum 1280 snap 384 seq_num 1280) 2026-02-13T20:27:50.735 INFO:tasks.rados.rados.0.trial188.stdout:3686: expect (ObjNum 865 snap 250 seq_num 865) 2026-02-13T20:27:50.735 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:27:50.877 INFO:tasks.rados.rados.0.trial188.stdout:3679: finishing copy_from to trial18843701-47 2026-02-13T20:27:50.878 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 47 v 1721 (ObjNum 1121 snap 334 seq_num 1121) dirty exists 2026-02-13T20:27:50.878 INFO:tasks.rados.rados.0.trial188.stdout:3684: finishing write tid 1 to trial18843701-49 2026-02-13T20:27:50.878 INFO:tasks.rados.rados.0.trial188.stdout:3679: finishing copy_from racing read to trial18843701-47 2026-02-13T20:27:50.878 INFO:tasks.rados.rados.0.trial188.stdout:3684: finishing write tid 2 to trial18843701-49 2026-02-13T20:27:50.878 INFO:tasks.rados.rados.0.trial188.stdout:3685: finishing rollback tid 0 to trial18843701-33 2026-02-13T20:27:50.878 INFO:tasks.rados.rados.0.trial188.stdout:3685: finishing rollback tid 1 to trial18843701-33 2026-02-13T20:27:50.878 INFO:tasks.rados.rados.0.trial188.stdout:3685: finishing rollback tid 2 to trial18843701-33 2026-02-13T20:27:50.878 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 33 v 1724 (ObjNum 1102 snap 326 seq_num 1102) dirty exists 2026-02-13T20:27:50.878 INFO:tasks.rados.rados.0.trial188.stdout:3684: finishing write tid 3 to trial18843701-49 2026-02-13T20:27:50.878 INFO:tasks.rados.rados.0.trial188.stdout:3684: finishing write tid 4 to trial18843701-49 2026-02-13T20:27:50.878 INFO:tasks.rados.rados.0.trial188.stdout:3684: finishing write tid 5 to trial18843701-49 2026-02-13T20:27:50.878 INFO:tasks.rados.rados.0.trial188.stdout:3684: oid 49 updating version 0 to 1733 2026-02-13T20:27:50.878 INFO:tasks.rados.rados.0.trial188.stdout:3684: oid 49 version 1733 is already newer than 1732 2026-02-13T20:27:50.879 INFO:tasks.rados.rados.0.trial188.stdout:3684: oid 49 version 1733 is already newer than 1731 2026-02-13T20:27:50.879 INFO:tasks.rados.rados.0.trial188.stdout:3684: oid 49 updating version 1733 to 1734 2026-02-13T20:27:50.879 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 49 v 1734 (ObjNum 1281 snap 384 seq_num 1281) dirty exists 2026-02-13T20:27:50.879 INFO:tasks.rados.rados.0.trial188.stdout:3684: left oid 49 (ObjNum 1281 snap 384 seq_num 1281) 2026-02-13T20:27:50.879 INFO:tasks.rados.rados.0.trial188.stdout:3688: finishing rollback tid 1 to trial18843701-28 2026-02-13T20:27:50.879 INFO:tasks.rados.rados.0.trial188.stdout:3689: seq_num 1282 ranges {746574=416522,1586386=468767,2772512=629544} 2026-02-13T20:27:50.882 INFO:tasks.rados.rados.0.trial188.stdout:3689: writing trial18843701-17 from 746574 to 1163096 tid 1 2026-02-13T20:27:50.885 INFO:tasks.rados.rados.0.trial188.stdout:3689: writing trial18843701-17 from 1586386 to 2055153 tid 2 2026-02-13T20:27:50.891 INFO:tasks.rados.rados.0.trial188.stdout:3689: writing trial18843701-17 from 2772512 to 3402056 tid 3 2026-02-13T20:27:50.891 INFO:tasks.rados.rados.0.trial188.stdout:3679: done (6 left) 2026-02-13T20:27:50.891 INFO:tasks.rados.rados.0.trial188.stdout:3681: done (5 left) 2026-02-13T20:27:50.891 INFO:tasks.rados.rados.0.trial188.stdout:3684: done (4 left) 2026-02-13T20:27:50.892 INFO:tasks.rados.rados.0.trial188.stdout:3685: done (3 left) 2026-02-13T20:27:50.892 INFO:tasks.rados.rados.0.trial188.stdout:3686: done (2 left) 2026-02-13T20:27:50.892 INFO:tasks.rados.rados.0.trial188.stdout:3690: copy_from oid 25 from oid 16 current snap is 384 2026-02-13T20:27:50.892 INFO:tasks.rados.rados.0.trial188.stdout:3688: finishing rollback tid 2 to trial18843701-28 2026-02-13T20:27:50.892 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 28 v 1824 (ObjNum 1252 snap 378 seq_num 1252) dirty exists 2026-02-13T20:27:50.892 INFO:tasks.rados.rados.0.trial188.stdout:3688: done (2 left) 2026-02-13T20:27:50.892 INFO:tasks.rados.rados.0.trial188.stdout:3691: write oid 46 current snap is 384 2026-02-13T20:27:50.892 INFO:tasks.rados.rados.0.trial188.stdout:3691: seq_num 1283 ranges {763381=491771,2044868=728778,3199935=363446} 2026-02-13T20:27:50.896 INFO:tasks.rados.rados.0.trial188.stdout:3691: writing trial18843701-46 from 763381 to 1255152 tid 1 2026-02-13T20:27:50.902 INFO:tasks.rados.rados.0.trial188.stdout:3691: writing trial18843701-46 from 2044868 to 2773646 tid 2 2026-02-13T20:27:50.905 INFO:tasks.rados.rados.0.trial188.stdout:3691: writing trial18843701-46 from 3199935 to 3563381 tid 3 2026-02-13T20:27:50.905 INFO:tasks.rados.rados.0.trial188.stdout:3692: delete oid 26 current snap is 384 2026-02-13T20:27:50.905 INFO:tasks.rados.rados.0.trial188.stdout:3689: finishing write tid 1 to trial18843701-17 2026-02-13T20:27:50.905 INFO:tasks.rados.rados.0.trial188.stdout:3689: finishing write tid 2 to trial18843701-17 2026-02-13T20:27:50.907 INFO:tasks.rados.rados.0.trial188.stdout:3692: done (3 left) 2026-02-13T20:27:50.907 INFO:tasks.rados.rados.0.trial188.stdout:3693: read oid 9 snap -1 2026-02-13T20:27:50.907 INFO:tasks.rados.rados.0.trial188.stdout:3693: expect (ObjNum 1279 snap 384 seq_num 1279) 2026-02-13T20:27:50.907 INFO:tasks.rados.rados.0.trial188.stdout:3694: write oid 24 current snap is 384 2026-02-13T20:27:50.907 INFO:tasks.rados.rados.0.trial188.stdout:3694: seq_num 1285 ranges {796995=758622,2161832=732447} 2026-02-13T20:27:50.913 INFO:tasks.rados.rados.0.trial188.stdout:3694: writing trial18843701-24 from 796995 to 1555617 tid 1 2026-02-13T20:27:50.919 INFO:tasks.rados.rados.0.trial188.stdout:3694: writing trial18843701-24 from 2161832 to 2894279 tid 2 2026-02-13T20:27:50.919 INFO:tasks.rados.rados.0.trial188.stdout:3695: delete oid 27 current snap is 384 2026-02-13T20:27:50.919 INFO:tasks.rados.rados.0.trial188.stdout:3693: expect (ObjNum 1279 snap 384 seq_num 1279) 2026-02-13T20:27:50.993 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:27:51.143 INFO:tasks.rados.rados.0.trial188.stdout:3689: finishing write tid 3 to trial18843701-17 2026-02-13T20:27:51.143 INFO:tasks.rados.rados.0.trial188.stdout:3689: finishing write tid 4 to trial18843701-17 2026-02-13T20:27:51.143 INFO:tasks.rados.rados.0.trial188.stdout:3689: finishing write tid 5 to trial18843701-17 2026-02-13T20:27:51.143 INFO:tasks.rados.rados.0.trial188.stdout:3689: oid 17 updating version 0 to 1728 2026-02-13T20:27:51.143 INFO:tasks.rados.rados.0.trial188.stdout:3689: oid 17 version 1728 is already newer than 1726 2026-02-13T20:27:51.143 INFO:tasks.rados.rados.0.trial188.stdout:3689: oid 17 version 1728 is already newer than 1727 2026-02-13T20:27:51.143 INFO:tasks.rados.rados.0.trial188.stdout:3689: oid 17 updating version 1728 to 1729 2026-02-13T20:27:51.144 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 17 v 1729 (ObjNum 1282 snap 384 seq_num 1282) dirty exists 2026-02-13T20:27:51.144 INFO:tasks.rados.rados.0.trial188.stdout:3689: left oid 17 (ObjNum 1282 snap 384 seq_num 1282) 2026-02-13T20:27:51.144 INFO:tasks.rados.rados.0.trial188.stdout:3691: finishing write tid 1 to trial18843701-46 2026-02-13T20:27:51.144 INFO:tasks.rados.rados.0.trial188.stdout:3691: finishing write tid 2 to trial18843701-46 2026-02-13T20:27:51.144 INFO:tasks.rados.rados.0.trial188.stdout:3691: finishing write tid 3 to trial18843701-46 2026-02-13T20:27:51.144 INFO:tasks.rados.rados.0.trial188.stdout:3691: finishing write tid 4 to trial18843701-46 2026-02-13T20:27:51.144 INFO:tasks.rados.rados.0.trial188.stdout:3691: finishing write tid 5 to trial18843701-46 2026-02-13T20:27:51.144 INFO:tasks.rados.rados.0.trial188.stdout:3691: oid 46 updating version 0 to 1743 2026-02-13T20:27:51.144 INFO:tasks.rados.rados.0.trial188.stdout:3691: oid 46 updating version 1743 to 1745 2026-02-13T20:27:51.144 INFO:tasks.rados.rados.0.trial188.stdout:3691: oid 46 version 1745 is already newer than 1742 2026-02-13T20:27:51.144 INFO:tasks.rados.rados.0.trial188.stdout:3691: oid 46 version 1745 is already newer than 1744 2026-02-13T20:27:51.144 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 46 v 1745 (ObjNum 1283 snap 384 seq_num 1283) dirty exists 2026-02-13T20:27:51.144 INFO:tasks.rados.rados.0.trial188.stdout:3691: left oid 46 (ObjNum 1283 snap 384 seq_num 1283) 2026-02-13T20:27:51.144 INFO:tasks.rados.rados.0.trial188.stdout:3690: finishing copy_from racing read to trial18843701-25 2026-02-13T20:27:51.145 INFO:tasks.rados.rados.0.trial188.stdout:3690: finishing copy_from to trial18843701-25 2026-02-13T20:27:51.145 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 25 v 1721 (ObjNum 1121 snap 334 seq_num 1121) dirty exists 2026-02-13T20:27:51.145 INFO:tasks.rados.rados.0.trial188.stdout:3694: finishing write tid 1 to trial18843701-24 2026-02-13T20:27:51.145 INFO:tasks.rados.rados.0.trial188.stdout:3694: finishing write tid 2 to trial18843701-24 2026-02-13T20:27:51.145 INFO:tasks.rados.rados.0.trial188.stdout:3689: done (5 left) 2026-02-13T20:27:51.145 INFO:tasks.rados.rados.0.trial188.stdout:3690: done (4 left) 2026-02-13T20:27:51.145 INFO:tasks.rados.rados.0.trial188.stdout:3691: done (3 left) 2026-02-13T20:27:51.145 INFO:tasks.rados.rados.0.trial188.stdout:3693: done (2 left) 2026-02-13T20:27:51.145 INFO:tasks.rados.rados.0.trial188.stdout:3695: done (1 left) 2026-02-13T20:27:51.145 INFO:tasks.rados.rados.0.trial188.stdout:3696: write (excl) oid 46 current snap is 384 2026-02-13T20:27:51.145 INFO:tasks.rados.rados.0.trial188.stdout:3694: finishing write tid 3 to trial18843701-24 2026-02-13T20:27:51.145 INFO:tasks.rados.rados.0.trial188.stdout:3696: seq_num 1287 ranges {430609=509120,1478796=736116,2909627=602257} 2026-02-13T20:27:51.146 INFO:tasks.rados.rados.0.trial188.stdout:3696: writing trial18843701-46 from 430609 to 939729 tid 1 2026-02-13T20:27:51.150 INFO:tasks.rados.rados.0.trial188.stdout:3696: writing trial18843701-46 from 1478796 to 2214912 tid 2 2026-02-13T20:27:51.155 INFO:tasks.rados.rados.0.trial188.stdout:3696: writing trial18843701-46 from 2909627 to 3511884 tid 3 2026-02-13T20:27:51.156 INFO:tasks.rados.rados.0.trial188.stdout:3697: delete oid 37 current snap is 384 2026-02-13T20:27:51.156 INFO:tasks.rados.rados.0.trial188.stdout:3694: finishing write tid 4 to trial18843701-24 2026-02-13T20:27:51.156 INFO:tasks.rados.rados.0.trial188.stdout:3694: oid 24 updating version 0 to 1873 2026-02-13T20:27:51.156 INFO:tasks.rados.rados.0.trial188.stdout:3694: oid 24 updating version 1873 to 1874 2026-02-13T20:27:51.156 INFO:tasks.rados.rados.0.trial188.stdout:3694: oid 24 updating version 1874 to 1875 2026-02-13T20:27:51.156 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 24 v 1875 (ObjNum 1285 snap 384 seq_num 1285) dirty exists 2026-02-13T20:27:51.156 INFO:tasks.rados.rados.0.trial188.stdout:3694: left oid 24 (ObjNum 1285 snap 384 seq_num 1285) 2026-02-13T20:27:51.157 INFO:tasks.rados.rados.0.trial188.stdout:3694: done (2 left) 2026-02-13T20:27:51.157 INFO:tasks.rados.rados.0.trial188.stdout:3697: done (1 left) 2026-02-13T20:27:51.157 INFO:tasks.rados.rados.0.trial188.stdout:3698: rollback oid 1 current snap is 384 2026-02-13T20:27:51.158 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 1 to 369 2026-02-13T20:27:51.158 INFO:tasks.rados.rados.0.trial188.stdout:3699: snap_remove snap 378 2026-02-13T20:27:51.847 INFO:tasks.rados.rados.0.trial188.stdout:3699: done (2 left) 2026-02-13T20:27:51.847 INFO:tasks.rados.rados.0.trial188.stdout:3700: read oid 47 snap -1 2026-02-13T20:27:51.847 INFO:tasks.rados.rados.0.trial188.stdout:3700: expect (ObjNum 1121 snap 334 seq_num 1121) 2026-02-13T20:27:51.847 INFO:tasks.rados.rados.0.trial188.stdout:3701: rollback oid 29 current snap is 384 2026-02-13T20:27:51.847 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 29 to 369 2026-02-13T20:27:51.847 INFO:tasks.rados.rados.0.trial188.stdout:3696: finishing write tid 1 to trial18843701-46 2026-02-13T20:27:51.847 INFO:tasks.rados.rados.0.trial188.stdout:3698: finishing rollback tid 0 to trial18843701-1 2026-02-13T20:27:51.847 INFO:tasks.rados.rados.0.trial188.stdout:3698: finishing rollback tid 1 to trial18843701-1 2026-02-13T20:27:51.847 INFO:tasks.rados.rados.0.trial188.stdout:3698: finishing rollback tid 2 to trial18843701-1 2026-02-13T20:27:51.848 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 1 v 1766 (ObjNum 1189 snap 364 seq_num 1189) dirty exists 2026-02-13T20:27:51.848 INFO:tasks.rados.rados.0.trial188.stdout:3696: finishing write tid 2 to trial18843701-46 2026-02-13T20:27:51.848 INFO:tasks.rados.rados.0.trial188.stdout:3696: finishing write tid 3 to trial18843701-46 2026-02-13T20:27:51.848 INFO:tasks.rados.rados.0.trial188.stdout:3696: finishing write tid 4 to trial18843701-46 2026-02-13T20:27:51.848 INFO:tasks.rados.rados.0.trial188.stdout:3696: finishing write tid 5 to trial18843701-46 2026-02-13T20:27:51.848 INFO:tasks.rados.rados.0.trial188.stdout:3696: oid 46 updating version 0 to 1746 2026-02-13T20:27:51.848 INFO:tasks.rados.rados.0.trial188.stdout:3696: oid 46 updating version 1746 to 1747 2026-02-13T20:27:51.848 INFO:tasks.rados.rados.0.trial188.stdout:3696: oid 46 updating version 1747 to 1748 2026-02-13T20:27:51.848 INFO:tasks.rados.rados.0.trial188.stdout:3696: oid 46 updating version 1748 to 1749 2026-02-13T20:27:51.848 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 46 v 1749 (ObjNum 1287 snap 384 seq_num 1287) dirty exists 2026-02-13T20:27:51.848 INFO:tasks.rados.rados.0.trial188.stdout:3696: left oid 46 (ObjNum 1287 snap 384 seq_num 1287) 2026-02-13T20:27:51.848 INFO:tasks.rados.rados.0.trial188.stdout:3696: done (3 left) 2026-02-13T20:27:51.848 INFO:tasks.rados.rados.0.trial188.stdout:3698: done (2 left) 2026-02-13T20:27:51.848 INFO:tasks.rados.rados.0.trial188.stdout:3702: write oid 3 current snap is 384 2026-02-13T20:27:51.848 INFO:tasks.rados.rados.0.trial188.stdout:3702: seq_num 1289 ranges {464223=659618,1879407=739785,3248120=416103} 2026-02-13T20:27:51.852 INFO:tasks.rados.rados.0.trial188.stdout:3702: writing trial18843701-3 from 464223 to 1123841 tid 1 2026-02-13T20:27:51.858 INFO:tasks.rados.rados.0.trial188.stdout:3702: writing trial18843701-3 from 1879407 to 2619192 tid 2 2026-02-13T20:27:51.862 INFO:tasks.rados.rados.0.trial188.stdout:3702: writing trial18843701-3 from 3248120 to 3664223 tid 3 2026-02-13T20:27:51.862 INFO:tasks.rados.rados.0.trial188.stdout:3703: write (excl) oid 9 current snap is 384 2026-02-13T20:27:51.862 INFO:tasks.rados.rados.0.trial188.stdout:3703: seq_num 1290 ranges {481030=734867,1937889=483443,2875543=552426} 2026-02-13T20:27:51.866 INFO:tasks.rados.rados.0.trial188.stdout:3703: writing trial18843701-9 from 481030 to 1215897 tid 1 2026-02-13T20:27:51.871 INFO:tasks.rados.rados.0.trial188.stdout:3703: writing trial18843701-9 from 1937889 to 2421332 tid 2 2026-02-13T20:27:51.875 INFO:tasks.rados.rados.0.trial188.stdout:3703: writing trial18843701-9 from 2875543 to 3427969 tid 3 2026-02-13T20:27:51.875 INFO:tasks.rados.rados.0.trial188.stdout:3704: read oid 45 snap -1 2026-02-13T20:27:51.875 INFO:tasks.rados.rados.0.trial188.stdout:3704: expect (ObjNum 1228 snap 372 seq_num 1228) 2026-02-13T20:27:51.875 INFO:tasks.rados.rados.0.trial188.stdout:3705: write oid 17 current snap is 384 2026-02-13T20:27:51.875 INFO:tasks.rados.rados.0.trial188.stdout:3701: finishing rollback tid 0 to trial18843701-29 2026-02-13T20:27:51.875 INFO:tasks.rados.rados.0.trial188.stdout:3701: finishing rollback tid 1 to trial18843701-29 2026-02-13T20:27:51.875 INFO:tasks.rados.rados.0.trial188.stdout:3701: finishing rollback tid 2 to trial18843701-29 2026-02-13T20:27:51.875 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 29 v 1737 (ObjNum 1200 snap 367 seq_num 1200) dirty exists 2026-02-13T20:27:51.875 INFO:tasks.rados.rados.0.trial188.stdout:3700: expect (ObjNum 1121 snap 334 seq_num 1121) 2026-02-13T20:27:51.875 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:27:51.949 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:27:51.986 INFO:tasks.rados.rados.0.trial188.stdout:3704: expect (ObjNum 1228 snap 372 seq_num 1228) 2026-02-13T20:27:52.012 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1019623 2026-02-13T20:27:52.027 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:27:52.051 INFO:tasks.rados.rados.0.trial188.stdout:3702: finishing write tid 1 to trial18843701-3 2026-02-13T20:27:52.051 INFO:tasks.rados.rados.0.trial188.stdout:3702: finishing write tid 2 to trial18843701-3 2026-02-13T20:27:52.051 INFO:tasks.rados.rados.0.trial188.stdout:3702: finishing write tid 3 to trial18843701-3 2026-02-13T20:27:52.051 INFO:tasks.rados.rados.0.trial188.stdout:3703: finishing write tid 1 to trial18843701-9 2026-02-13T20:27:52.051 INFO:tasks.rados.rados.0.trial188.stdout:3705: seq_num 1291 ranges {497837=410116,1596371=743454,2902966=763698} 2026-02-13T20:27:52.054 INFO:tasks.rados.rados.0.trial188.stdout:3705: writing trial18843701-17 from 497837 to 907953 tid 1 2026-02-13T20:27:52.060 INFO:tasks.rados.rados.0.trial188.stdout:3705: writing trial18843701-17 from 1596371 to 2339825 tid 2 2026-02-13T20:27:52.067 INFO:tasks.rados.rados.0.trial188.stdout:3705: writing trial18843701-17 from 2902966 to 3666664 tid 3 2026-02-13T20:27:52.067 INFO:tasks.rados.rados.0.trial188.stdout:3700: done (5 left) 2026-02-13T20:27:52.067 INFO:tasks.rados.rados.0.trial188.stdout:3701: done (4 left) 2026-02-13T20:27:52.067 INFO:tasks.rados.rados.0.trial188.stdout:3704: done (3 left) 2026-02-13T20:27:52.067 INFO:tasks.rados.rados.0.trial188.stdout:3706: copy_from oid 18 from oid 46 current snap is 384 2026-02-13T20:27:52.068 INFO:tasks.rados.rados.0.trial188.stdout:3703: finishing write tid 2 to trial18843701-9 2026-02-13T20:27:52.068 INFO:tasks.rados.rados.0.trial188.stdout:3703: finishing write tid 3 to trial18843701-9 2026-02-13T20:27:52.068 INFO:tasks.rados.rados.0.trial188.stdout:3703: finishing write tid 4 to trial18843701-9 2026-02-13T20:27:52.068 INFO:tasks.rados.rados.0.trial188.stdout:3703: finishing write tid 5 to trial18843701-9 2026-02-13T20:27:52.068 INFO:tasks.rados.rados.0.trial188.stdout:3703: oid 9 updating version 0 to 1558 2026-02-13T20:27:52.068 INFO:tasks.rados.rados.0.trial188.stdout:3703: oid 9 updating version 1558 to 1561 2026-02-13T20:27:52.069 INFO:tasks.rados.rados.0.trial188.stdout:3703: oid 9 version 1561 is already newer than 1559 2026-02-13T20:27:52.069 INFO:tasks.rados.rados.0.trial188.stdout:3703: oid 9 version 1561 is already newer than 1560 2026-02-13T20:27:52.069 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 9 v 1561 (ObjNum 1290 snap 384 seq_num 1290) dirty exists 2026-02-13T20:27:52.069 INFO:tasks.rados.rados.0.trial188.stdout:3703: left oid 9 (ObjNum 1290 snap 384 seq_num 1290) 2026-02-13T20:27:52.069 INFO:tasks.rados.rados.0.trial188.stdout:3702: finishing write tid 4 to trial18843701-3 2026-02-13T20:27:52.069 INFO:tasks.rados.rados.0.trial188.stdout:3703: done (3 left) 2026-02-13T20:27:52.070 INFO:tasks.rados.rados.0.trial188.stdout:3707: delete oid 36 current snap is 384 2026-02-13T20:27:52.070 INFO:tasks.rados.rados.0.trial188.stdout:3702: finishing write tid 5 to trial18843701-3 2026-02-13T20:27:52.070 INFO:tasks.rados.rados.0.trial188.stdout:3702: oid 3 updating version 0 to 1552 2026-02-13T20:27:52.070 INFO:tasks.rados.rados.0.trial188.stdout:3702: oid 3 version 1552 is already newer than 1551 2026-02-13T20:27:52.070 INFO:tasks.rados.rados.0.trial188.stdout:3702: oid 3 version 1552 is already newer than 1550 2026-02-13T20:27:52.070 INFO:tasks.rados.rados.0.trial188.stdout:3702: oid 3 updating version 1552 to 1553 2026-02-13T20:27:52.070 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 3 v 1553 (ObjNum 1289 snap 384 seq_num 1289) dirty exists 2026-02-13T20:27:52.071 INFO:tasks.rados.rados.0.trial188.stdout:3702: left oid 3 (ObjNum 1289 snap 384 seq_num 1289) 2026-02-13T20:27:52.086 INFO:tasks.rados.rados.0.trial188.stdout:3705: finishing write tid 1 to trial18843701-17 2026-02-13T20:27:52.086 INFO:tasks.rados.rados.0.trial188.stdout:3705: finishing write tid 2 to trial18843701-17 2026-02-13T20:27:52.086 INFO:tasks.rados.rados.0.trial188.stdout:3702: done (3 left) 2026-02-13T20:27:52.086 INFO:tasks.rados.rados.0.trial188.stdout:3707: done (2 left) 2026-02-13T20:27:52.087 INFO:tasks.rados.rados.0.trial188.stdout:3708: write oid 36 current snap is 384 2026-02-13T20:27:52.087 INFO:tasks.rados.rados.0.trial188.stdout:3705: finishing write tid 3 to trial18843701-17 2026-02-13T20:27:52.087 INFO:tasks.rados.rados.0.trial188.stdout:3708: seq_num 1293 ranges {531451=676967,1713335=747123,2957812=502595} 2026-02-13T20:27:52.090 INFO:tasks.rados.rados.0.trial188.stdout:3708: writing trial18843701-36 from 531451 to 1208418 tid 1 2026-02-13T20:27:52.095 INFO:tasks.rados.rados.0.trial188.stdout:3708: writing trial18843701-36 from 1713335 to 2460458 tid 2 2026-02-13T20:27:52.099 INFO:tasks.rados.rados.0.trial188.stdout:3708: writing trial18843701-36 from 2957812 to 3460407 tid 3 2026-02-13T20:27:52.099 INFO:tasks.rados.rados.0.trial188.stdout:3709: snap_create 2026-02-13T20:27:52.099 INFO:tasks.rados.rados.0.trial188.stdout:3705: finishing write tid 4 to trial18843701-17 2026-02-13T20:27:52.099 INFO:tasks.rados.rados.0.trial188.stdout:3705: finishing write tid 5 to trial18843701-17 2026-02-13T20:27:52.099 INFO:tasks.rados.rados.0.trial188.stdout:3705: oid 17 updating version 0 to 1733 2026-02-13T20:27:52.099 INFO:tasks.rados.rados.0.trial188.stdout:3705: oid 17 version 1733 is already newer than 1731 2026-02-13T20:27:52.099 INFO:tasks.rados.rados.0.trial188.stdout:3705: oid 17 version 1733 is already newer than 1732 2026-02-13T20:27:52.099 INFO:tasks.rados.rados.0.trial188.stdout:3705: oid 17 version 1733 is already newer than 1730 2026-02-13T20:27:52.099 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 17 v 1733 (ObjNum 1291 snap 384 seq_num 1291) dirty exists 2026-02-13T20:27:52.099 INFO:tasks.rados.rados.0.trial188.stdout:3705: left oid 17 (ObjNum 1291 snap 384 seq_num 1291) 2026-02-13T20:27:52.118 INFO:tasks.rados.rados.0.trial188.stdout:3708: finishing write tid 1 to trial18843701-36 2026-02-13T20:27:52.118 INFO:tasks.rados.rados.0.trial188.stdout:3708: finishing write tid 2 to trial18843701-36 2026-02-13T20:27:52.119 INFO:tasks.rados.rados.0.trial188.stdout:3708: finishing write tid 3 to trial18843701-36 2026-02-13T20:27:52.120 INFO:tasks.rados.rados.0.trial188.stdout:3708: finishing write tid 4 to trial18843701-36 2026-02-13T20:27:52.120 INFO:tasks.rados.rados.0.trial188.stdout:3708: finishing write tid 5 to trial18843701-36 2026-02-13T20:27:52.120 INFO:tasks.rados.rados.0.trial188.stdout:3708: oid 36 updating version 0 to 1879 2026-02-13T20:27:52.120 INFO:tasks.rados.rados.0.trial188.stdout:3708: oid 36 updating version 1879 to 1881 2026-02-13T20:27:52.120 INFO:tasks.rados.rados.0.trial188.stdout:3708: oid 36 version 1881 is already newer than 1880 2026-02-13T20:27:52.120 INFO:tasks.rados.rados.0.trial188.stdout:3708: oid 36 version 1881 is already newer than 1878 2026-02-13T20:27:52.120 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 36 v 1881 (ObjNum 1293 snap 384 seq_num 1293) dirty exists 2026-02-13T20:27:52.120 INFO:tasks.rados.rados.0.trial188.stdout:3708: left oid 36 (ObjNum 1293 snap 384 seq_num 1293) 2026-02-13T20:27:52.130 INFO:tasks.rados.rados.0.trial188.stdout:3706: finishing copy_from racing read to trial18843701-18 2026-02-13T20:27:52.131 INFO:tasks.rados.rados.0.trial188.stdout:3706: finishing copy_from to trial18843701-18 2026-02-13T20:27:52.131 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 18 v 1749 (ObjNum 1287 snap 384 seq_num 1287) dirty exists 2026-02-13T20:27:52.851 INFO:tasks.rados.rados.0.trial188.stdout:3705: done (3 left) 2026-02-13T20:27:52.852 INFO:tasks.rados.rados.0.trial188.stdout:3706: done (2 left) 2026-02-13T20:27:52.852 INFO:tasks.rados.rados.0.trial188.stdout:3708: done (1 left) 2026-02-13T20:27:52.852 INFO:tasks.rados.rados.0.trial188.stdout:3709: done (0 left) 2026-02-13T20:27:52.852 INFO:tasks.rados.rados.0.trial188.stdout:3710: write oid 27 current snap is 385 2026-02-13T20:27:52.852 INFO:tasks.rados.rados.0.trial188.stdout:3710: seq_num 1294 ranges {548258=752216,1771817=490781,2985235=713867} 2026-02-13T20:27:52.857 INFO:tasks.rados.rados.0.trial188.stdout:3710: writing trial18843701-27 from 548258 to 1300474 tid 1 2026-02-13T20:27:52.861 INFO:tasks.rados.rados.0.trial188.stdout:3710: writing trial18843701-27 from 1771817 to 2262598 tid 2 2026-02-13T20:27:52.867 INFO:tasks.rados.rados.0.trial188.stdout:3710: writing trial18843701-27 from 2985235 to 3699102 tid 3 2026-02-13T20:27:52.867 INFO:tasks.rados.rados.0.trial188.stdout:3711: snap_remove snap 381 2026-02-13T20:27:53.853 INFO:tasks.rados.rados.0.trial188.stdout:3711: done (1 left) 2026-02-13T20:27:53.853 INFO:tasks.rados.rados.0.trial188.stdout:3712: copy_from oid 18 from oid 25 current snap is 385 2026-02-13T20:27:53.853 INFO:tasks.rados.rados.0.trial188.stdout:3710: finishing write tid 1 to trial18843701-27 2026-02-13T20:27:53.853 INFO:tasks.rados.rados.0.trial188.stdout:3710: finishing write tid 2 to trial18843701-27 2026-02-13T20:27:53.853 INFO:tasks.rados.rados.0.trial188.stdout:3710: finishing write tid 3 to trial18843701-27 2026-02-13T20:27:53.853 INFO:tasks.rados.rados.0.trial188.stdout:3710: finishing write tid 4 to trial18843701-27 2026-02-13T20:27:53.853 INFO:tasks.rados.rados.0.trial188.stdout:3710: finishing write tid 5 to trial18843701-27 2026-02-13T20:27:53.853 INFO:tasks.rados.rados.0.trial188.stdout:3710: oid 27 updating version 0 to 1755 2026-02-13T20:27:53.853 INFO:tasks.rados.rados.0.trial188.stdout:3710: oid 27 version 1755 is already newer than 1754 2026-02-13T20:27:53.853 INFO:tasks.rados.rados.0.trial188.stdout:3710: oid 27 version 1755 is already newer than 1752 2026-02-13T20:27:53.853 INFO:tasks.rados.rados.0.trial188.stdout:3710: oid 27 version 1755 is already newer than 1753 2026-02-13T20:27:53.853 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 27 v 1755 (ObjNum 1294 snap 385 seq_num 1294) dirty exists 2026-02-13T20:27:53.853 INFO:tasks.rados.rados.0.trial188.stdout:3710: left oid 27 (ObjNum 1294 snap 385 seq_num 1294) 2026-02-13T20:27:53.853 INFO:tasks.rados.rados.0.trial188.stdout:3710: done (1 left) 2026-02-13T20:27:53.853 INFO:tasks.rados.rados.0.trial188.stdout:3713: write oid 7 current snap is 385 2026-02-13T20:27:53.854 INFO:tasks.rados.rados.0.trial188.stdout:3713: seq_num 1295 ranges {565065=427465,1430299=634439,2496305=525139,3472104=292961} 2026-02-13T20:27:53.857 INFO:tasks.rados.rados.0.trial188.stdout:3713: writing trial18843701-7 from 565065 to 992530 tid 1 2026-02-13T20:27:53.862 INFO:tasks.rados.rados.0.trial188.stdout:3713: writing trial18843701-7 from 1430299 to 2064738 tid 2 2026-02-13T20:27:53.866 INFO:tasks.rados.rados.0.trial188.stdout:3713: writing trial18843701-7 from 2496305 to 3021444 tid 3 2026-02-13T20:27:53.869 INFO:tasks.rados.rados.0.trial188.stdout:3713: writing trial18843701-7 from 3472104 to 3765065 tid 4 2026-02-13T20:27:53.869 INFO:tasks.rados.rados.0.trial188.stdout:3714: copy_from oid 37 from oid 34 current snap is 385 2026-02-13T20:27:53.869 INFO:tasks.rados.rados.0.trial188.stdout:3715: read oid 27 snap -1 2026-02-13T20:27:53.870 INFO:tasks.rados.rados.0.trial188.stdout:3715: expect (ObjNum 1294 snap 385 seq_num 1294) 2026-02-13T20:27:53.870 INFO:tasks.rados.rados.0.trial188.stdout:3716: snap_remove snap 370 2026-02-13T20:27:54.859 INFO:tasks.rados.rados.0.trial188.stdout:3716: done (4 left) 2026-02-13T20:27:54.859 INFO:tasks.rados.rados.0.trial188.stdout:3717: snap_remove snap 362 2026-02-13T20:27:55.732 INFO:tasks.rados.rados.0.trial188.stdout:3717: done (4 left) 2026-02-13T20:27:55.732 INFO:tasks.rados.rados.0.trial188.stdout:3718: read oid 21 snap 384 2026-02-13T20:27:55.732 INFO:tasks.rados.rados.0.trial188.stdout:3718: expect (ObjNum 1238 snap 375 seq_num 1238) 2026-02-13T20:27:55.732 INFO:tasks.rados.rados.0.trial188.stdout:3719: rollback oid 32 current snap is 385 2026-02-13T20:27:55.732 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 32 to 369 2026-02-13T20:27:55.732 INFO:tasks.rados.rados.0.trial188.stdout:3715: expect (ObjNum 1294 snap 385 seq_num 1294) 2026-02-13T20:27:55.793 INFO:tasks.rados.rados.0.trial188.stdout:3712: finishing copy_from racing read to trial18843701-18 2026-02-13T20:27:55.793 INFO:tasks.rados.rados.0.trial188.stdout:3713: finishing write tid 1 to trial18843701-7 2026-02-13T20:27:55.793 INFO:tasks.rados.rados.0.trial188.stdout:3713: finishing write tid 2 to trial18843701-7 2026-02-13T20:27:55.793 INFO:tasks.rados.rados.0.trial188.stdout:3713: finishing write tid 3 to trial18843701-7 2026-02-13T20:27:55.793 INFO:tasks.rados.rados.0.trial188.stdout:3713: finishing write tid 4 to trial18843701-7 2026-02-13T20:27:55.793 INFO:tasks.rados.rados.0.trial188.stdout:3713: finishing write tid 5 to trial18843701-7 2026-02-13T20:27:55.793 INFO:tasks.rados.rados.0.trial188.stdout:3715: done (5 left) 2026-02-13T20:27:55.793 INFO:tasks.rados.rados.0.trial188.stdout:3720: snap_create 2026-02-13T20:27:55.793 INFO:tasks.rados.rados.0.trial188.stdout:3712: finishing copy_from to trial18843701-18 2026-02-13T20:27:55.793 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 18 v 1721 (ObjNum 1121 snap 334 seq_num 1121) dirty exists 2026-02-13T20:27:55.793 INFO:tasks.rados.rados.0.trial188.stdout:3713: finishing write tid 6 to trial18843701-7 2026-02-13T20:27:55.793 INFO:tasks.rados.rados.0.trial188.stdout:3713: oid 7 updating version 0 to 1741 2026-02-13T20:27:55.793 INFO:tasks.rados.rados.0.trial188.stdout:3713: oid 7 version 1741 is already newer than 1738 2026-02-13T20:27:55.794 INFO:tasks.rados.rados.0.trial188.stdout:3713: oid 7 version 1741 is already newer than 1739 2026-02-13T20:27:55.794 INFO:tasks.rados.rados.0.trial188.stdout:3713: oid 7 version 1741 is already newer than 1740 2026-02-13T20:27:55.794 INFO:tasks.rados.rados.0.trial188.stdout:3713: oid 7 updating version 1741 to 1742 2026-02-13T20:27:55.794 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 7 v 1742 (ObjNum 1295 snap 385 seq_num 1295) dirty exists 2026-02-13T20:27:55.794 INFO:tasks.rados.rados.0.trial188.stdout:3713: left oid 7 (ObjNum 1295 snap 385 seq_num 1295) 2026-02-13T20:27:55.794 INFO:tasks.rados.rados.0.trial188.stdout:3714: finishing copy_from racing read to trial18843701-37 2026-02-13T20:27:55.794 INFO:tasks.rados.rados.0.trial188.stdout:3714: finishing copy_from to trial18843701-37 2026-02-13T20:27:55.794 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 37 v 1786 (ObjNum 1270 snap 384 seq_num 1270) dirty exists 2026-02-13T20:27:55.794 INFO:tasks.rados.rados.0.trial188.stdout:3719: finishing rollback tid 0 to trial18843701-32 2026-02-13T20:27:55.794 INFO:tasks.rados.rados.0.trial188.stdout:3719: finishing rollback tid 1 to trial18843701-32 2026-02-13T20:27:55.794 INFO:tasks.rados.rados.0.trial188.stdout:3718: expect (ObjNum 1238 snap 375 seq_num 1238) 2026-02-13T20:27:55.859 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2467140 2026-02-13T20:27:55.865 INFO:tasks.rados.rados.0.trial188.stdout:3719: finishing rollback tid 2 to trial18843701-32 2026-02-13T20:27:55.865 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 32 v 1752 (ObjNum 1198 snap 366 seq_num 1198) dirty exists 2026-02-13T20:27:56.735 INFO:tasks.rados.rados.0.trial188.stdout:3712: done (5 left) 2026-02-13T20:27:56.735 INFO:tasks.rados.rados.0.trial188.stdout:3713: done (4 left) 2026-02-13T20:27:56.736 INFO:tasks.rados.rados.0.trial188.stdout:3714: done (3 left) 2026-02-13T20:27:56.736 INFO:tasks.rados.rados.0.trial188.stdout:3718: done (2 left) 2026-02-13T20:27:56.736 INFO:tasks.rados.rados.0.trial188.stdout:3719: done (1 left) 2026-02-13T20:27:56.736 INFO:tasks.rados.rados.0.trial188.stdout:3720: done (0 left) 2026-02-13T20:27:56.736 INFO:tasks.rados.rados.0.trial188.stdout:3721: rollback oid 8 current snap is 386 2026-02-13T20:27:56.736 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 8 to 369 2026-02-13T20:27:56.736 INFO:tasks.rados.rados.0.trial188.stdout:3722: read oid 22 snap -1 2026-02-13T20:27:56.736 INFO:tasks.rados.rados.0.trial188.stdout:3722: expect (ObjNum 1223 snap 370 seq_num 1223) 2026-02-13T20:27:56.737 INFO:tasks.rados.rados.0.trial188.stdout:3723: copy_from oid 41 from oid 19 current snap is 386 2026-02-13T20:27:56.737 INFO:tasks.rados.rados.0.trial188.stdout:3724: snap_create 2026-02-13T20:27:56.739 INFO:tasks.rados.rados.0.trial188.stdout:3722: expect (ObjNum 1223 snap 370 seq_num 1223) 2026-02-13T20:27:56.739 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:27:56.792 INFO:tasks.rados.rados.0.trial188.stdout:3721: finishing rollback tid 0 to trial18843701-8 2026-02-13T20:27:56.792 INFO:tasks.rados.rados.0.trial188.stdout:3721: finishing rollback tid 1 to trial18843701-8 2026-02-13T20:27:56.792 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 8 v 1866 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-13T20:27:56.792 INFO:tasks.rados.rados.0.trial188.stdout:3723: finishing copy_from racing read to trial18843701-41 2026-02-13T20:27:56.792 INFO:tasks.rados.rados.0.trial188.stdout:3723: finishing copy_from to trial18843701-41 2026-02-13T20:27:56.793 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 41 v 1635 (ObjNum 1272 snap 384 seq_num 1272) dirty exists 2026-02-13T20:27:57.735 INFO:tasks.rados.rados.0.trial188.stdout:3721: done (3 left) 2026-02-13T20:27:57.735 INFO:tasks.rados.rados.0.trial188.stdout:3722: done (2 left) 2026-02-13T20:27:57.735 INFO:tasks.rados.rados.0.trial188.stdout:3723: done (1 left) 2026-02-13T20:27:57.735 INFO:tasks.rados.rados.0.trial188.stdout:3724: done (0 left) 2026-02-13T20:27:57.735 INFO:tasks.rados.rados.0.trial188.stdout:3725: read oid 14 snap -1 2026-02-13T20:27:57.735 INFO:tasks.rados.rados.0.trial188.stdout:3725: expect (ObjNum 1258 snap 378 seq_num 1258) 2026-02-13T20:27:57.735 INFO:tasks.rados.rados.0.trial188.stdout:3726: snap_create 2026-02-13T20:27:57.742 INFO:tasks.rados.rados.0.trial188.stdout:3725: expect (ObjNum 1258 snap 378 seq_num 1258) 2026-02-13T20:27:57.745 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 789190 2026-02-13T20:27:57.762 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:27:57.788 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1948274 2026-02-13T20:27:58.738 INFO:tasks.rados.rados.0.trial188.stdout:3725: done (1 left) 2026-02-13T20:27:58.738 INFO:tasks.rados.rados.0.trial188.stdout:3726: done (0 left) 2026-02-13T20:27:58.738 INFO:tasks.rados.rados.0.trial188.stdout:3727: read oid 2 snap -1 2026-02-13T20:27:58.738 INFO:tasks.rados.rados.0.trial188.stdout:3727: expect (ObjNum 1231 snap 372 seq_num 1231) 2026-02-13T20:27:58.739 INFO:tasks.rados.rados.0.trial188.stdout:3728: read oid 45 snap -1 2026-02-13T20:27:58.739 INFO:tasks.rados.rados.0.trial188.stdout:3728: expect (ObjNum 1228 snap 372 seq_num 1228) 2026-02-13T20:27:58.739 INFO:tasks.rados.rados.0.trial188.stdout:3729: delete oid 5 current snap is 388 2026-02-13T20:27:58.743 INFO:tasks.rados.rados.0.trial188.stdout:3728: expect (ObjNum 1228 snap 372 seq_num 1228) 2026-02-13T20:27:58.783 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:27:58.807 INFO:tasks.rados.rados.0.trial188.stdout:3727: expect (ObjNum 1231 snap 372 seq_num 1231) 2026-02-13T20:27:58.807 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:27:58.903 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1436198 2026-02-13T20:27:59.028 INFO:tasks.rados.rados.0.trial188.stdout:3727: done (2 left) 2026-02-13T20:27:59.028 INFO:tasks.rados.rados.0.trial188.stdout:3728: done (1 left) 2026-02-13T20:27:59.028 INFO:tasks.rados.rados.0.trial188.stdout:3729: done (0 left) 2026-02-13T20:27:59.028 INFO:tasks.rados.rados.0.trial188.stdout:3730: write oid 44 current snap is 388 2026-02-13T20:27:59.028 INFO:tasks.rados.rados.0.trial188.stdout:3730: seq_num 1297 ranges {598679=577963,1947263=638108,3351151=447528} 2026-02-13T20:27:59.032 INFO:tasks.rados.rados.0.trial188.stdout:3730: writing trial18843701-44 from 598679 to 1176642 tid 1 2026-02-13T20:27:59.038 INFO:tasks.rados.rados.0.trial188.stdout:3730: writing trial18843701-44 from 1947263 to 2585371 tid 2 2026-02-13T20:27:59.042 INFO:tasks.rados.rados.0.trial188.stdout:3730: writing trial18843701-44 from 3351151 to 3798679 tid 3 2026-02-13T20:27:59.042 INFO:tasks.rados.rados.0.trial188.stdout:3731: snap_remove snap 385 2026-02-13T20:27:59.738 INFO:tasks.rados.rados.0.trial188.stdout:3731: done (1 left) 2026-02-13T20:27:59.738 INFO:tasks.rados.rados.0.trial188.stdout:3732: write oid 9 current snap is 388 2026-02-13T20:27:59.739 INFO:tasks.rados.rados.0.trial188.stdout:3730: finishing write tid 1 to trial18843701-44 2026-02-13T20:27:59.739 INFO:tasks.rados.rados.0.trial188.stdout:3730: finishing write tid 2 to trial18843701-44 2026-02-13T20:27:59.739 INFO:tasks.rados.rados.0.trial188.stdout:3730: finishing write tid 3 to trial18843701-44 2026-02-13T20:27:59.739 INFO:tasks.rados.rados.0.trial188.stdout:3730: finishing write tid 4 to trial18843701-44 2026-02-13T20:27:59.739 INFO:tasks.rados.rados.0.trial188.stdout:3730: finishing write tid 5 to trial18843701-44 2026-02-13T20:27:59.739 INFO:tasks.rados.rados.0.trial188.stdout:3730: oid 44 updating version 0 to 1804 2026-02-13T20:27:59.739 INFO:tasks.rados.rados.0.trial188.stdout:3730: oid 44 version 1804 is already newer than 1802 2026-02-13T20:27:59.739 INFO:tasks.rados.rados.0.trial188.stdout:3730: oid 44 updating version 1804 to 1805 2026-02-13T20:27:59.739 INFO:tasks.rados.rados.0.trial188.stdout:3730: oid 44 version 1805 is already newer than 1803 2026-02-13T20:27:59.739 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 44 v 1805 (ObjNum 1297 snap 388 seq_num 1297) dirty exists 2026-02-13T20:27:59.739 INFO:tasks.rados.rados.0.trial188.stdout:3730: left oid 44 (ObjNum 1297 snap 388 seq_num 1297) 2026-02-13T20:27:59.739 INFO:tasks.rados.rados.0.trial188.stdout:3732: seq_num 1298 ranges {615486=653212,1889392=498119,2978574=475308} 2026-02-13T20:27:59.744 INFO:tasks.rados.rados.0.trial188.stdout:3732: writing trial18843701-9 from 615486 to 1268698 tid 1 2026-02-13T20:27:59.749 INFO:tasks.rados.rados.0.trial188.stdout:3732: writing trial18843701-9 from 1889392 to 2387511 tid 2 2026-02-13T20:27:59.754 INFO:tasks.rados.rados.0.trial188.stdout:3732: writing trial18843701-9 from 2978574 to 3453882 tid 3 2026-02-13T20:27:59.754 INFO:tasks.rados.rados.0.trial188.stdout:3730: done (1 left) 2026-02-13T20:27:59.754 INFO:tasks.rados.rados.0.trial188.stdout:3733: read oid 36 snap -1 2026-02-13T20:27:59.754 INFO:tasks.rados.rados.0.trial188.stdout:3733: expect (ObjNum 1293 snap 384 seq_num 1293) 2026-02-13T20:27:59.754 INFO:tasks.rados.rados.0.trial188.stdout:3734: write oid 42 current snap is 388 2026-02-13T20:27:59.755 INFO:tasks.rados.rados.0.trial188.stdout:3734: seq_num 1299 ranges {632293=728461,1947874=641777,3005997=686580} 2026-02-13T20:27:59.759 INFO:tasks.rados.rados.0.trial188.stdout:3734: writing trial18843701-42 from 632293 to 1360754 tid 1 2026-02-13T20:27:59.763 INFO:tasks.rados.rados.0.trial188.stdout:3734: writing trial18843701-42 from 1947874 to 2589651 tid 2 2026-02-13T20:27:59.767 INFO:tasks.rados.rados.0.trial188.stdout:3734: writing trial18843701-42 from 3005997 to 3692577 tid 3 2026-02-13T20:27:59.768 INFO:tasks.rados.rados.0.trial188.stdout:3735: snap_create 2026-02-13T20:27:59.768 INFO:tasks.rados.rados.0.trial188.stdout:3733: expect (ObjNum 1293 snap 384 seq_num 1293) 2026-02-13T20:27:59.768 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:27:59.796 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 681180 2026-02-13T20:27:59.824 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1979170 2026-02-13T20:27:59.836 INFO:tasks.rados.rados.0.trial188.stdout:3732: finishing write tid 1 to trial18843701-9 2026-02-13T20:27:59.836 INFO:tasks.rados.rados.0.trial188.stdout:3732: finishing write tid 2 to trial18843701-9 2026-02-13T20:27:59.836 INFO:tasks.rados.rados.0.trial188.stdout:3732: finishing write tid 3 to trial18843701-9 2026-02-13T20:27:59.836 INFO:tasks.rados.rados.0.trial188.stdout:3732: finishing write tid 4 to trial18843701-9 2026-02-13T20:27:59.836 INFO:tasks.rados.rados.0.trial188.stdout:3732: finishing write tid 5 to trial18843701-9 2026-02-13T20:27:59.836 INFO:tasks.rados.rados.0.trial188.stdout:3732: oid 9 updating version 0 to 1562 2026-02-13T20:27:59.836 INFO:tasks.rados.rados.0.trial188.stdout:3732: oid 9 updating version 1562 to 1565 2026-02-13T20:27:59.837 INFO:tasks.rados.rados.0.trial188.stdout:3732: oid 9 version 1565 is already newer than 1564 2026-02-13T20:27:59.837 INFO:tasks.rados.rados.0.trial188.stdout:3732: oid 9 version 1565 is already newer than 1563 2026-02-13T20:27:59.837 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 9 v 1565 (ObjNum 1298 snap 388 seq_num 1298) dirty exists 2026-02-13T20:27:59.837 INFO:tasks.rados.rados.0.trial188.stdout:3732: left oid 9 (ObjNum 1298 snap 388 seq_num 1298) 2026-02-13T20:27:59.837 INFO:tasks.rados.rados.0.trial188.stdout:3734: finishing write tid 1 to trial18843701-42 2026-02-13T20:27:59.837 INFO:tasks.rados.rados.0.trial188.stdout:3734: finishing write tid 2 to trial18843701-42 2026-02-13T20:27:59.837 INFO:tasks.rados.rados.0.trial188.stdout:3734: finishing write tid 3 to trial18843701-42 2026-02-13T20:27:59.837 INFO:tasks.rados.rados.0.trial188.stdout:3734: finishing write tid 4 to trial18843701-42 2026-02-13T20:27:59.837 INFO:tasks.rados.rados.0.trial188.stdout:3734: finishing write tid 5 to trial18843701-42 2026-02-13T20:27:59.837 INFO:tasks.rados.rados.0.trial188.stdout:3734: oid 42 updating version 0 to 1569 2026-02-13T20:27:59.837 INFO:tasks.rados.rados.0.trial188.stdout:3734: oid 42 version 1569 is already newer than 1566 2026-02-13T20:27:59.837 INFO:tasks.rados.rados.0.trial188.stdout:3734: oid 42 version 1569 is already newer than 1567 2026-02-13T20:27:59.837 INFO:tasks.rados.rados.0.trial188.stdout:3734: oid 42 version 1569 is already newer than 1568 2026-02-13T20:27:59.838 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 42 v 1569 (ObjNum 1299 snap 388 seq_num 1299) dirty exists 2026-02-13T20:27:59.838 INFO:tasks.rados.rados.0.trial188.stdout:3734: left oid 42 (ObjNum 1299 snap 388 seq_num 1299) 2026-02-13T20:28:00.732 INFO:tasks.rados.rados.0.trial188.stdout:3732: done (3 left) 2026-02-13T20:28:00.733 INFO:tasks.rados.rados.0.trial188.stdout:3733: done (2 left) 2026-02-13T20:28:00.733 INFO:tasks.rados.rados.0.trial188.stdout:3734: done (1 left) 2026-02-13T20:28:00.733 INFO:tasks.rados.rados.0.trial188.stdout:3735: done (0 left) 2026-02-13T20:28:00.733 INFO:tasks.rados.rados.0.trial188.stdout:3736: rollback oid 19 current snap is 389 2026-02-13T20:28:00.733 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 19 to 369 2026-02-13T20:28:00.733 INFO:tasks.rados.rados.0.trial188.stdout:3737: snap_remove snap 386 2026-02-13T20:28:01.733 INFO:tasks.rados.rados.0.trial188.stdout:3737: done (1 left) 2026-02-13T20:28:01.733 INFO:tasks.rados.rados.0.trial188.stdout:3738: write oid 40 current snap is 389 2026-02-13T20:28:01.733 INFO:tasks.rados.rados.0.trial188.stdout:3738: seq_num 1300 ranges {649100=403710,1606356=501788,2633420=497852,3636005=213095} 2026-02-13T20:28:01.738 INFO:tasks.rados.rados.0.trial188.stdout:3738: writing trial18843701-40 from 649100 to 1052810 tid 1 2026-02-13T20:28:01.742 INFO:tasks.rados.rados.0.trial188.stdout:3738: writing trial18843701-40 from 1606356 to 2108144 tid 2 2026-02-13T20:28:01.745 INFO:tasks.rados.rados.0.trial188.stdout:3738: writing trial18843701-40 from 2633420 to 3131272 tid 3 2026-02-13T20:28:01.749 INFO:tasks.rados.rados.0.trial188.stdout:3738: writing trial18843701-40 from 3636005 to 3849100 tid 4 2026-02-13T20:28:01.749 INFO:tasks.rados.rados.0.trial188.stdout:3739: copy_from oid 2 from oid 6 current snap is 389 2026-02-13T20:28:01.749 INFO:tasks.rados.rados.0.trial188.stdout:3736: finishing rollback tid 0 to trial18843701-19 2026-02-13T20:28:01.749 INFO:tasks.rados.rados.0.trial188.stdout:3736: finishing rollback tid 1 to trial18843701-19 2026-02-13T20:28:01.749 INFO:tasks.rados.rados.0.trial188.stdout:3736: finishing rollback tid 2 to trial18843701-19 2026-02-13T20:28:01.749 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 19 v 1745 (ObjNum 1174 snap 360 seq_num 1174) dirty exists 2026-02-13T20:28:01.749 INFO:tasks.rados.rados.0.trial188.stdout:3736: done (2 left) 2026-02-13T20:28:01.750 INFO:tasks.rados.rados.0.trial188.stdout:3740: snap_create 2026-02-13T20:28:01.763 INFO:tasks.rados.rados.0.trial188.stdout:3738: finishing write tid 1 to trial18843701-40 2026-02-13T20:28:01.765 INFO:tasks.rados.rados.0.trial188.stdout:3738: finishing write tid 2 to trial18843701-40 2026-02-13T20:28:01.765 INFO:tasks.rados.rados.0.trial188.stdout:3738: finishing write tid 3 to trial18843701-40 2026-02-13T20:28:01.765 INFO:tasks.rados.rados.0.trial188.stdout:3738: finishing write tid 4 to trial18843701-40 2026-02-13T20:28:01.765 INFO:tasks.rados.rados.0.trial188.stdout:3738: finishing write tid 5 to trial18843701-40 2026-02-13T20:28:01.765 INFO:tasks.rados.rados.0.trial188.stdout:3738: finishing write tid 6 to trial18843701-40 2026-02-13T20:28:01.765 INFO:tasks.rados.rados.0.trial188.stdout:3738: oid 40 updating version 0 to 1753 2026-02-13T20:28:01.766 INFO:tasks.rados.rados.0.trial188.stdout:3738: oid 40 updating version 1753 to 1756 2026-02-13T20:28:01.766 INFO:tasks.rados.rados.0.trial188.stdout:3738: oid 40 updating version 1756 to 1757 2026-02-13T20:28:01.766 INFO:tasks.rados.rados.0.trial188.stdout:3738: oid 40 version 1757 is already newer than 1755 2026-02-13T20:28:01.766 INFO:tasks.rados.rados.0.trial188.stdout:3738: oid 40 version 1757 is already newer than 1754 2026-02-13T20:28:01.766 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 40 v 1757 (ObjNum 1300 snap 389 seq_num 1300) dirty exists 2026-02-13T20:28:01.766 INFO:tasks.rados.rados.0.trial188.stdout:3738: left oid 40 (ObjNum 1300 snap 389 seq_num 1300) 2026-02-13T20:28:01.777 INFO:tasks.rados.rados.0.trial188.stdout:3739: finishing copy_from racing read to trial18843701-2 2026-02-13T20:28:01.779 INFO:tasks.rados.rados.0.trial188.stdout:3739: finishing copy_from to trial18843701-2 2026-02-13T20:28:01.779 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 2 v 1869 (ObjNum 1278 snap 384 seq_num 1278) dirty exists 2026-02-13T20:28:02.745 INFO:tasks.rados.rados.0.trial188.stdout:3738: done (2 left) 2026-02-13T20:28:02.746 INFO:tasks.rados.rados.0.trial188.stdout:3739: done (1 left) 2026-02-13T20:28:02.746 INFO:tasks.rados.rados.0.trial188.stdout:3740: done (0 left) 2026-02-13T20:28:02.746 INFO:tasks.rados.rados.0.trial188.stdout:3741: write oid 41 current snap is 390 2026-02-13T20:28:02.746 INFO:tasks.rados.rados.0.trial188.stdout:3741: seq_num 1301 ranges {665907=595312,1781191=645446,3177196=688711} 2026-02-13T20:28:02.750 INFO:tasks.rados.rados.0.trial188.stdout:3741: writing trial18843701-41 from 665907 to 1261219 tid 1 2026-02-13T20:28:02.755 INFO:tasks.rados.rados.0.trial188.stdout:3741: writing trial18843701-41 from 1781191 to 2426637 tid 2 2026-02-13T20:28:02.761 INFO:tasks.rados.rados.0.trial188.stdout:3741: writing trial18843701-41 from 3177196 to 3865907 tid 3 2026-02-13T20:28:02.761 INFO:tasks.rados.rados.0.trial188.stdout:3742: copy_from oid 28 from oid 39 current snap is 390 2026-02-13T20:28:02.761 INFO:tasks.rados.rados.0.trial188.stdout:3743: rollback oid 7 current snap is 390 2026-02-13T20:28:02.761 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 7 to 389 2026-02-13T20:28:02.761 INFO:tasks.rados.rados.0.trial188.stdout:3744: write (excl) oid 35 current snap is 390 2026-02-13T20:28:02.761 INFO:tasks.rados.rados.0.trial188.stdout:3744: seq_num 1302 ranges {682714=670561,2123320=505457,3088266=636749} 2026-02-13T20:28:02.765 INFO:tasks.rados.rados.0.trial188.stdout:3744: writing trial18843701-35 from 682714 to 1353275 tid 1 2026-02-13T20:28:02.770 INFO:tasks.rados.rados.0.trial188.stdout:3744: writing trial18843701-35 from 2123320 to 2628777 tid 2 2026-02-13T20:28:02.775 INFO:tasks.rados.rados.0.trial188.stdout:3744: writing trial18843701-35 from 3088266 to 3725015 tid 3 2026-02-13T20:28:02.775 INFO:tasks.rados.rados.0.trial188.stdout:3745: read oid 21 snap -1 2026-02-13T20:28:02.775 INFO:tasks.rados.rados.0.trial188.stdout:3745: expect (ObjNum 1238 snap 375 seq_num 1238) 2026-02-13T20:28:02.775 INFO:tasks.rados.rados.0.trial188.stdout:3746: read oid 15 snap -1 2026-02-13T20:28:02.775 INFO:tasks.rados.rados.0.trial188.stdout:3746: expect deleted 2026-02-13T20:28:02.775 INFO:tasks.rados.rados.0.trial188.stdout:3747: read oid 48 snap 369 2026-02-13T20:28:02.775 INFO:tasks.rados.rados.0.trial188.stdout:3747: expect (ObjNum 1007 snap 299 seq_num 1007) 2026-02-13T20:28:02.775 INFO:tasks.rados.rados.0.trial188.stdout:3748: write (excl) oid 37 current snap is 390 2026-02-13T20:28:02.775 INFO:tasks.rados.rados.0.trial188.stdout:3743: finishing rollback tid 0 to trial18843701-7 2026-02-13T20:28:02.775 INFO:tasks.rados.rados.0.trial188.stdout:3742: finishing copy_from to trial18843701-28 2026-02-13T20:28:02.776 INFO:tasks.rados.rados.0.trial188.stdout:3742: got expected ENOENT (src dne) 2026-02-13T20:28:02.776 INFO:tasks.rados.rados.0.trial188.stdout:3743: finishing rollback tid 1 to trial18843701-7 2026-02-13T20:28:02.776 INFO:tasks.rados.rados.0.trial188.stdout:3743: finishing rollback tid 2 to trial18843701-7 2026-02-13T20:28:02.776 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 7 v 1748 (ObjNum 1295 snap 385 seq_num 1295) dirty exists 2026-02-13T20:28:02.776 INFO:tasks.rados.rados.0.trial188.stdout:3742: finishing copy_from racing read to trial18843701-28 2026-02-13T20:28:02.776 INFO:tasks.rados.rados.0.trial188.stdout:3748: seq_num 1303 ranges {699521=745810,2181802=649115,3515689=383832} 2026-02-13T20:28:02.779 INFO:tasks.rados.rados.0.trial188.stdout:3748: writing trial18843701-37 from 699521 to 1445331 tid 1 2026-02-13T20:28:02.784 INFO:tasks.rados.rados.0.trial188.stdout:3748: writing trial18843701-37 from 2181802 to 2830917 tid 2 2026-02-13T20:28:02.789 INFO:tasks.rados.rados.0.trial188.stdout:3748: writing trial18843701-37 from 3515689 to 3899521 tid 3 2026-02-13T20:28:02.789 INFO:tasks.rados.rados.0.trial188.stdout:3742: done (7 left) 2026-02-13T20:28:02.789 INFO:tasks.rados.rados.0.trial188.stdout:3743: done (6 left) 2026-02-13T20:28:02.789 INFO:tasks.rados.rados.0.trial188.stdout:3749: delete oid 24 current snap is 390 2026-02-13T20:28:02.789 INFO:tasks.rados.rados.0.trial188.stdout:3741: finishing write tid 1 to trial18843701-41 2026-02-13T20:28:02.790 INFO:tasks.rados.rados.0.trial188.stdout:3741: finishing write tid 2 to trial18843701-41 2026-02-13T20:28:02.790 INFO:tasks.rados.rados.0.trial188.stdout:3741: finishing write tid 3 to trial18843701-41 2026-02-13T20:28:02.790 INFO:tasks.rados.rados.0.trial188.stdout:3741: finishing write tid 4 to trial18843701-41 2026-02-13T20:28:02.790 INFO:tasks.rados.rados.0.trial188.stdout:3741: finishing write tid 5 to trial18843701-41 2026-02-13T20:28:02.790 INFO:tasks.rados.rados.0.trial188.stdout:3741: oid 41 updating version 0 to 1760 2026-02-13T20:28:02.790 INFO:tasks.rados.rados.0.trial188.stdout:3741: oid 41 updating version 1760 to 1761 2026-02-13T20:28:02.790 INFO:tasks.rados.rados.0.trial188.stdout:3741: oid 41 version 1761 is already newer than 1759 2026-02-13T20:28:02.790 INFO:tasks.rados.rados.0.trial188.stdout:3741: oid 41 version 1761 is already newer than 1758 2026-02-13T20:28:02.790 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 41 v 1761 (ObjNum 1301 snap 390 seq_num 1301) dirty exists 2026-02-13T20:28:02.791 INFO:tasks.rados.rados.0.trial188.stdout:3741: left oid 41 (ObjNum 1301 snap 390 seq_num 1301) 2026-02-13T20:28:02.791 INFO:tasks.rados.rados.0.trial188.stdout:3745: expect (ObjNum 1238 snap 375 seq_num 1238) 2026-02-13T20:28:02.826 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1960068 2026-02-13T20:28:02.838 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:28:02.867 INFO:tasks.rados.rados.0.trial188.stdout:3747: expect (ObjNum 1007 snap 299 seq_num 1007) 2026-02-13T20:28:02.936 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1231283 2026-02-13T20:28:02.961 INFO:tasks.rados.rados.0.trial188.stdout:3744: finishing write tid 1 to trial18843701-35 2026-02-13T20:28:02.962 INFO:tasks.rados.rados.0.trial188.stdout:3744: finishing write tid 2 to trial18843701-35 2026-02-13T20:28:02.962 INFO:tasks.rados.rados.0.trial188.stdout:3741: done (6 left) 2026-02-13T20:28:02.962 INFO:tasks.rados.rados.0.trial188.stdout:3745: done (5 left) 2026-02-13T20:28:02.962 INFO:tasks.rados.rados.0.trial188.stdout:3746: done (4 left) 2026-02-13T20:28:02.962 INFO:tasks.rados.rados.0.trial188.stdout:3747: done (3 left) 2026-02-13T20:28:02.962 INFO:tasks.rados.rados.0.trial188.stdout:3749: done (2 left) 2026-02-13T20:28:02.962 INFO:tasks.rados.rados.0.trial188.stdout:3750: snap_create 2026-02-13T20:28:02.962 INFO:tasks.rados.rados.0.trial188.stdout:3748: finishing write tid 1 to trial18843701-37 2026-02-13T20:28:02.963 INFO:tasks.rados.rados.0.trial188.stdout:3744: finishing write tid 3 to trial18843701-35 2026-02-13T20:28:02.963 INFO:tasks.rados.rados.0.trial188.stdout:3744: finishing write tid 4 to trial18843701-35 2026-02-13T20:28:02.963 INFO:tasks.rados.rados.0.trial188.stdout:3744: finishing write tid 5 to trial18843701-35 2026-02-13T20:28:02.963 INFO:tasks.rados.rados.0.trial188.stdout:3744: oid 35 updating version 0 to 1570 2026-02-13T20:28:02.963 INFO:tasks.rados.rados.0.trial188.stdout:3744: oid 35 updating version 1570 to 1572 2026-02-13T20:28:02.963 INFO:tasks.rados.rados.0.trial188.stdout:3744: oid 35 updating version 1572 to 1573 2026-02-13T20:28:02.963 INFO:tasks.rados.rados.0.trial188.stdout:3744: oid 35 version 1573 is already newer than 1571 2026-02-13T20:28:02.963 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 35 v 1573 (ObjNum 1302 snap 390 seq_num 1302) dirty exists 2026-02-13T20:28:02.963 INFO:tasks.rados.rados.0.trial188.stdout:3744: left oid 35 (ObjNum 1302 snap 390 seq_num 1302) 2026-02-13T20:28:02.963 INFO:tasks.rados.rados.0.trial188.stdout:3748: finishing write tid 2 to trial18843701-37 2026-02-13T20:28:02.963 INFO:tasks.rados.rados.0.trial188.stdout:3748: finishing write tid 3 to trial18843701-37 2026-02-13T20:28:02.964 INFO:tasks.rados.rados.0.trial188.stdout:3748: finishing write tid 4 to trial18843701-37 2026-02-13T20:28:02.964 INFO:tasks.rados.rados.0.trial188.stdout:3748: finishing write tid 5 to trial18843701-37 2026-02-13T20:28:02.964 INFO:tasks.rados.rados.0.trial188.stdout:3748: oid 37 updating version 0 to 1871 2026-02-13T20:28:02.964 INFO:tasks.rados.rados.0.trial188.stdout:3748: oid 37 updating version 1871 to 1873 2026-02-13T20:28:02.964 INFO:tasks.rados.rados.0.trial188.stdout:3748: oid 37 version 1873 is already newer than 1872 2026-02-13T20:28:02.964 INFO:tasks.rados.rados.0.trial188.stdout:3748: oid 37 version 1873 is already newer than 1870 2026-02-13T20:28:02.964 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 37 v 1873 (ObjNum 1303 snap 390 seq_num 1303) dirty exists 2026-02-13T20:28:02.964 INFO:tasks.rados.rados.0.trial188.stdout:3748: left oid 37 (ObjNum 1303 snap 390 seq_num 1303) 2026-02-13T20:28:03.748 INFO:tasks.rados.rados.0.trial188.stdout:3744: done (2 left) 2026-02-13T20:28:03.748 INFO:tasks.rados.rados.0.trial188.stdout:3748: done (1 left) 2026-02-13T20:28:03.748 INFO:tasks.rados.rados.0.trial188.stdout:3750: done (0 left) 2026-02-13T20:28:03.748 INFO:tasks.rados.rados.0.trial188.stdout:3751: copy_from oid 34 from oid 14 current snap is 391 2026-02-13T20:28:03.748 INFO:tasks.rados.rados.0.trial188.stdout:3752: read oid 49 snap -1 2026-02-13T20:28:03.748 INFO:tasks.rados.rados.0.trial188.stdout:3752: expect (ObjNum 1281 snap 384 seq_num 1281) 2026-02-13T20:28:03.748 INFO:tasks.rados.rados.0.trial188.stdout:3753: copy_from oid 2 from oid 26 current snap is 391 2026-02-13T20:28:03.748 INFO:tasks.rados.rados.0.trial188.stdout:3754: read oid 20 snap -1 2026-02-13T20:28:03.748 INFO:tasks.rados.rados.0.trial188.stdout:3754: expect deleted 2026-02-13T20:28:03.748 INFO:tasks.rados.rados.0.trial188.stdout:3755: snap_create 2026-02-13T20:28:03.750 INFO:tasks.rados.rados.0.trial188.stdout:3753: finishing copy_from to trial18843701-2 2026-02-13T20:28:03.750 INFO:tasks.rados.rados.0.trial188.stdout:3753: got expected ENOENT (src dne) 2026-02-13T20:28:03.750 INFO:tasks.rados.rados.0.trial188.stdout:3753: finishing copy_from racing read to trial18843701-2 2026-02-13T20:28:03.754 INFO:tasks.rados.rados.0.trial188.stdout:3752: expect (ObjNum 1281 snap 384 seq_num 1281) 2026-02-13T20:28:03.833 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 3003108 2026-02-13T20:28:03.840 INFO:tasks.rados.rados.0.trial188.stdout:3751: finishing copy_from racing read to trial18843701-34 2026-02-13T20:28:03.840 INFO:tasks.rados.rados.0.trial188.stdout:3751: finishing copy_from to trial18843701-34 2026-02-13T20:28:03.840 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 34 v 1539 (ObjNum 1258 snap 378 seq_num 1258) dirty exists 2026-02-13T20:28:04.748 INFO:tasks.rados.rados.0.trial188.stdout:3751: done (4 left) 2026-02-13T20:28:04.748 INFO:tasks.rados.rados.0.trial188.stdout:3752: done (3 left) 2026-02-13T20:28:04.748 INFO:tasks.rados.rados.0.trial188.stdout:3753: done (2 left) 2026-02-13T20:28:04.748 INFO:tasks.rados.rados.0.trial188.stdout:3754: done (1 left) 2026-02-13T20:28:04.748 INFO:tasks.rados.rados.0.trial188.stdout:3755: done (0 left) 2026-02-13T20:28:04.748 INFO:tasks.rados.rados.0.trial188.stdout:3756: write (excl) oid 11 current snap is 392 2026-02-13T20:28:04.748 INFO:tasks.rados.rados.0.trial188.stdout:3756: seq_num 1305 ranges {733135=496308,1898766=652784,3170535=470565} 2026-02-13T20:28:04.753 INFO:tasks.rados.rados.0.trial188.stdout:3756: writing trial18843701-11 from 733135 to 1229443 tid 1 2026-02-13T20:28:04.758 INFO:tasks.rados.rados.0.trial188.stdout:3756: writing trial18843701-11 from 1898766 to 2551550 tid 2 2026-02-13T20:28:04.763 INFO:tasks.rados.rados.0.trial188.stdout:3756: writing trial18843701-11 from 3170535 to 3641100 tid 3 2026-02-13T20:28:04.763 INFO:tasks.rados.rados.0.trial188.stdout:3757: snap_create 2026-02-13T20:28:04.776 INFO:tasks.rados.rados.0.trial188.stdout:3756: finishing write tid 1 to trial18843701-11 2026-02-13T20:28:04.777 INFO:tasks.rados.rados.0.trial188.stdout:3756: finishing write tid 2 to trial18843701-11 2026-02-13T20:28:04.777 INFO:tasks.rados.rados.0.trial188.stdout:3756: finishing write tid 3 to trial18843701-11 2026-02-13T20:28:04.778 INFO:tasks.rados.rados.0.trial188.stdout:3756: finishing write tid 4 to trial18843701-11 2026-02-13T20:28:04.778 INFO:tasks.rados.rados.0.trial188.stdout:3756: finishing write tid 5 to trial18843701-11 2026-02-13T20:28:04.778 INFO:tasks.rados.rados.0.trial188.stdout:3756: oid 11 updating version 0 to 1690 2026-02-13T20:28:04.778 INFO:tasks.rados.rados.0.trial188.stdout:3756: oid 11 updating version 1690 to 1691 2026-02-13T20:28:04.778 INFO:tasks.rados.rados.0.trial188.stdout:3756: oid 11 version 1691 is already newer than 1689 2026-02-13T20:28:04.778 INFO:tasks.rados.rados.0.trial188.stdout:3756: oid 11 version 1691 is already newer than 1688 2026-02-13T20:28:04.778 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 11 v 1691 (ObjNum 1305 snap 392 seq_num 1305) dirty exists 2026-02-13T20:28:04.778 INFO:tasks.rados.rados.0.trial188.stdout:3756: left oid 11 (ObjNum 1305 snap 392 seq_num 1305) 2026-02-13T20:28:05.732 INFO:tasks.rados.rados.0.trial188.stdout:3756: done (1 left) 2026-02-13T20:28:05.733 INFO:tasks.rados.rados.0.trial188.stdout:3757: done (0 left) 2026-02-13T20:28:05.733 INFO:tasks.rados.rados.0.trial188.stdout:3758: write oid 14 current snap is 393 2026-02-13T20:28:05.733 INFO:tasks.rados.rados.0.trial188.stdout:3758: seq_num 1306 ranges {749942=571557,1840895=796442,3365252=584690} 2026-02-13T20:28:05.737 INFO:tasks.rados.rados.0.trial188.stdout:3758: writing trial18843701-14 from 749942 to 1321499 tid 1 2026-02-13T20:28:05.742 INFO:tasks.rados.rados.0.trial188.stdout:3758: writing trial18843701-14 from 1840895 to 2637337 tid 2 2026-02-13T20:28:05.747 INFO:tasks.rados.rados.0.trial188.stdout:3758: writing trial18843701-14 from 3365252 to 3949942 tid 3 2026-02-13T20:28:05.747 INFO:tasks.rados.rados.0.trial188.stdout:3759: write oid 13 current snap is 393 2026-02-13T20:28:05.747 INFO:tasks.rados.rados.0.trial188.stdout:3759: seq_num 1307 ranges {766749=646806,1899377=656453,3109028=609462} 2026-02-13T20:28:05.752 INFO:tasks.rados.rados.0.trial188.stdout:3759: writing trial18843701-13 from 766749 to 1413555 tid 1 2026-02-13T20:28:05.757 INFO:tasks.rados.rados.0.trial188.stdout:3759: writing trial18843701-13 from 1899377 to 2555830 tid 2 2026-02-13T20:28:05.761 INFO:tasks.rados.rados.0.trial188.stdout:3759: writing trial18843701-13 from 3109028 to 3718490 tid 3 2026-02-13T20:28:05.762 INFO:tasks.rados.rados.0.trial188.stdout:3760: read oid 25 snap -1 2026-02-13T20:28:05.762 INFO:tasks.rados.rados.0.trial188.stdout:3760: expect (ObjNum 1121 snap 334 seq_num 1121) 2026-02-13T20:28:05.762 INFO:tasks.rados.rados.0.trial188.stdout:3761: read oid 50 snap -1 2026-02-13T20:28:05.762 INFO:tasks.rados.rados.0.trial188.stdout:3761: expect (ObjNum 1238 snap 375 seq_num 1238) 2026-02-13T20:28:05.762 INFO:tasks.rados.rados.0.trial188.stdout:3762: write oid 48 current snap is 393 2026-02-13T20:28:05.762 INFO:tasks.rados.rados.0.trial188.stdout:3762: seq_num 1308 ranges {783556=438408,1674212=400111,2736451=420734,3882270=101286} 2026-02-13T20:28:05.766 INFO:tasks.rados.rados.0.trial188.stdout:3762: writing trial18843701-48 from 783556 to 1221964 tid 1 2026-02-13T20:28:05.770 INFO:tasks.rados.rados.0.trial188.stdout:3762: writing trial18843701-48 from 1674212 to 2074323 tid 2 2026-02-13T20:28:05.774 INFO:tasks.rados.rados.0.trial188.stdout:3762: writing trial18843701-48 from 2736451 to 3157185 tid 3 2026-02-13T20:28:05.777 INFO:tasks.rados.rados.0.trial188.stdout:3762: writing trial18843701-48 from 3882270 to 3983556 tid 4 2026-02-13T20:28:05.777 INFO:tasks.rados.rados.0.trial188.stdout:3763: write oid 3 current snap is 393 2026-02-13T20:28:05.777 INFO:tasks.rados.rados.0.trial188.stdout:3763: seq_num 1309 ranges {400363=513657,1332694=660122} 2026-02-13T20:28:05.780 INFO:tasks.rados.rados.0.trial188.stdout:3763: writing trial18843701-3 from 400363 to 914020 tid 1 2026-02-13T20:28:05.784 INFO:tasks.rados.rados.0.trial188.stdout:3763: writing trial18843701-3 from 1332694 to 1992816 tid 2 2026-02-13T20:28:05.785 INFO:tasks.rados.rados.0.trial188.stdout:3764: write (excl) oid 30 current snap is 393 2026-02-13T20:28:05.785 INFO:tasks.rados.rados.0.trial188.stdout:3764: seq_num 1310 ranges {417170=588906,1674823=342347} 2026-02-13T20:28:05.788 INFO:tasks.rados.rados.0.trial188.stdout:3764: writing trial18843701-30 from 417170 to 1006076 tid 1 2026-02-13T20:28:05.792 INFO:tasks.rados.rados.0.trial188.stdout:3764: writing trial18843701-30 from 1674823 to 2017170 tid 2 2026-02-13T20:28:05.792 INFO:tasks.rados.rados.0.trial188.stdout:3765: rollback oid 19 current snap is 393 2026-02-13T20:28:05.792 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 19 to 388 2026-02-13T20:28:05.792 INFO:tasks.rados.rados.0.trial188.stdout:3760: expect (ObjNum 1121 snap 334 seq_num 1121) 2026-02-13T20:28:05.793 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 253458 2026-02-13T20:28:05.828 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:28:05.904 INFO:tasks.rados.rados.0.trial188.stdout:3758: finishing write tid 1 to trial18843701-14 2026-02-13T20:28:05.905 INFO:tasks.rados.rados.0.trial188.stdout:3758: finishing write tid 2 to trial18843701-14 2026-02-13T20:28:05.905 INFO:tasks.rados.rados.0.trial188.stdout:3760: done (7 left) 2026-02-13T20:28:05.905 INFO:tasks.rados.rados.0.trial188.stdout:3766: rollback oid 1 current snap is 393 2026-02-13T20:28:05.905 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 1 to 359 2026-02-13T20:28:05.905 INFO:tasks.rados.rados.0.trial188.stdout:3762: finishing write tid 1 to trial18843701-48 2026-02-13T20:28:05.905 INFO:tasks.rados.rados.0.trial188.stdout:3762: finishing write tid 2 to trial18843701-48 2026-02-13T20:28:05.905 INFO:tasks.rados.rados.0.trial188.stdout:3762: finishing write tid 3 to trial18843701-48 2026-02-13T20:28:05.905 INFO:tasks.rados.rados.0.trial188.stdout:3762: finishing write tid 4 to trial18843701-48 2026-02-13T20:28:05.905 INFO:tasks.rados.rados.0.trial188.stdout:3762: finishing write tid 5 to trial18843701-48 2026-02-13T20:28:05.906 INFO:tasks.rados.rados.0.trial188.stdout:3762: finishing write tid 6 to trial18843701-48 2026-02-13T20:28:05.906 INFO:tasks.rados.rados.0.trial188.stdout:3762: oid 48 updating version 0 to 1123 2026-02-13T20:28:05.906 INFO:tasks.rados.rados.0.trial188.stdout:3762: oid 48 version 1123 is already newer than 1122 2026-02-13T20:28:05.906 INFO:tasks.rados.rados.0.trial188.stdout:3762: oid 48 updating version 1123 to 1124 2026-02-13T20:28:05.906 INFO:tasks.rados.rados.0.trial188.stdout:3762: oid 48 updating version 1124 to 1125 2026-02-13T20:28:05.906 INFO:tasks.rados.rados.0.trial188.stdout:3762: oid 48 version 1125 is already newer than 1121 2026-02-13T20:28:05.906 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 48 v 1125 (ObjNum 1308 snap 393 seq_num 1308) dirty exists 2026-02-13T20:28:05.906 INFO:tasks.rados.rados.0.trial188.stdout:3762: left oid 48 (ObjNum 1308 snap 393 seq_num 1308) 2026-02-13T20:28:05.906 INFO:tasks.rados.rados.0.trial188.stdout:3758: finishing write tid 3 to trial18843701-14 2026-02-13T20:28:05.906 INFO:tasks.rados.rados.0.trial188.stdout:3759: finishing write tid 1 to trial18843701-13 2026-02-13T20:28:05.906 INFO:tasks.rados.rados.0.trial188.stdout:3759: finishing write tid 2 to trial18843701-13 2026-02-13T20:28:05.906 INFO:tasks.rados.rados.0.trial188.stdout:3759: finishing write tid 3 to trial18843701-13 2026-02-13T20:28:05.907 INFO:tasks.rados.rados.0.trial188.stdout:3759: finishing write tid 4 to trial18843701-13 2026-02-13T20:28:05.907 INFO:tasks.rados.rados.0.trial188.stdout:3765: finishing rollback tid 0 to trial18843701-19 2026-02-13T20:28:05.907 INFO:tasks.rados.rados.0.trial188.stdout:3759: finishing write tid 5 to trial18843701-13 2026-02-13T20:28:05.907 INFO:tasks.rados.rados.0.trial188.stdout:3759: oid 13 updating version 0 to 1871 2026-02-13T20:28:05.907 INFO:tasks.rados.rados.0.trial188.stdout:3759: oid 13 updating version 1871 to 1873 2026-02-13T20:28:05.907 INFO:tasks.rados.rados.0.trial188.stdout:3759: oid 13 version 1873 is already newer than 1872 2026-02-13T20:28:05.907 INFO:tasks.rados.rados.0.trial188.stdout:3759: oid 13 version 1873 is already newer than 1870 2026-02-13T20:28:05.907 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 13 v 1873 (ObjNum 1307 snap 393 seq_num 1307) dirty exists 2026-02-13T20:28:05.907 INFO:tasks.rados.rados.0.trial188.stdout:3759: left oid 13 (ObjNum 1307 snap 393 seq_num 1307) 2026-02-13T20:28:05.907 INFO:tasks.rados.rados.0.trial188.stdout:3765: finishing rollback tid 1 to trial18843701-19 2026-02-13T20:28:05.907 INFO:tasks.rados.rados.0.trial188.stdout:3765: finishing rollback tid 2 to trial18843701-19 2026-02-13T20:28:05.907 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 19 v 1751 (ObjNum 1272 snap 384 seq_num 1272) dirty exists 2026-02-13T20:28:05.908 INFO:tasks.rados.rados.0.trial188.stdout:3758: finishing write tid 4 to trial18843701-14 2026-02-13T20:28:05.908 INFO:tasks.rados.rados.0.trial188.stdout:3759: done (7 left) 2026-02-13T20:28:05.908 INFO:tasks.rados.rados.0.trial188.stdout:3762: done (6 left) 2026-02-13T20:28:05.908 INFO:tasks.rados.rados.0.trial188.stdout:3765: done (5 left) 2026-02-13T20:28:05.908 INFO:tasks.rados.rados.0.trial188.stdout:3767: rollback oid 35 current snap is 393 2026-02-13T20:28:05.908 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 35 to 388 2026-02-13T20:28:05.908 INFO:tasks.rados.rados.0.trial188.stdout:3758: finishing write tid 5 to trial18843701-14 2026-02-13T20:28:05.908 INFO:tasks.rados.rados.0.trial188.stdout:3758: oid 14 updating version 0 to 1555 2026-02-13T20:28:05.908 INFO:tasks.rados.rados.0.trial188.stdout:3758: oid 14 version 1555 is already newer than 1554 2026-02-13T20:28:05.908 INFO:tasks.rados.rados.0.trial188.stdout:3758: oid 14 updating version 1555 to 1556 2026-02-13T20:28:05.908 INFO:tasks.rados.rados.0.trial188.stdout:3758: oid 14 updating version 1556 to 1557 2026-02-13T20:28:05.908 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 14 v 1557 (ObjNum 1306 snap 393 seq_num 1306) dirty exists 2026-02-13T20:28:05.909 INFO:tasks.rados.rados.0.trial188.stdout:3758: left oid 14 (ObjNum 1306 snap 393 seq_num 1306) 2026-02-13T20:28:05.909 INFO:tasks.rados.rados.0.trial188.stdout:3761: expect (ObjNum 1238 snap 375 seq_num 1238) 2026-02-13T20:28:05.909 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:28:05.990 INFO:tasks.rados.rados.0.trial188.stdout:3764: finishing write tid 1 to trial18843701-30 2026-02-13T20:28:05.990 INFO:tasks.rados.rados.0.trial188.stdout:3764: finishing write tid 2 to trial18843701-30 2026-02-13T20:28:05.991 INFO:tasks.rados.rados.0.trial188.stdout:3764: finishing write tid 3 to trial18843701-30 2026-02-13T20:28:05.991 INFO:tasks.rados.rados.0.trial188.stdout:3764: finishing write tid 4 to trial18843701-30 2026-02-13T20:28:05.991 INFO:tasks.rados.rados.0.trial188.stdout:3764: oid 30 updating version 0 to 1778 2026-02-13T20:28:05.991 INFO:tasks.rados.rados.0.trial188.stdout:3764: oid 30 updating version 1778 to 1779 2026-02-13T20:28:05.991 INFO:tasks.rados.rados.0.trial188.stdout:3764: oid 30 version 1779 is already newer than 1777 2026-02-13T20:28:05.991 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 30 v 1779 (ObjNum 1310 snap 393 seq_num 1310) dirty exists 2026-02-13T20:28:05.991 INFO:tasks.rados.rados.0.trial188.stdout:3764: left oid 30 (ObjNum 1310 snap 393 seq_num 1310) 2026-02-13T20:28:05.991 INFO:tasks.rados.rados.0.trial188.stdout:3763: finishing write tid 1 to trial18843701-3 2026-02-13T20:28:05.991 INFO:tasks.rados.rados.0.trial188.stdout:3758: done (5 left) 2026-02-13T20:28:05.991 INFO:tasks.rados.rados.0.trial188.stdout:3761: done (4 left) 2026-02-13T20:28:05.991 INFO:tasks.rados.rados.0.trial188.stdout:3764: done (3 left) 2026-02-13T20:28:05.991 INFO:tasks.rados.rados.0.trial188.stdout:3768: delete oid 44 current snap is 393 2026-02-13T20:28:05.992 INFO:tasks.rados.rados.0.trial188.stdout:3763: finishing write tid 2 to trial18843701-3 2026-02-13T20:28:05.992 INFO:tasks.rados.rados.0.trial188.stdout:3763: finishing write tid 3 to trial18843701-3 2026-02-13T20:28:05.992 INFO:tasks.rados.rados.0.trial188.stdout:3763: finishing write tid 4 to trial18843701-3 2026-02-13T20:28:05.992 INFO:tasks.rados.rados.0.trial188.stdout:3763: oid 3 updating version 0 to 1560 2026-02-13T20:28:05.992 INFO:tasks.rados.rados.0.trial188.stdout:3763: oid 3 version 1560 is already newer than 1559 2026-02-13T20:28:05.992 INFO:tasks.rados.rados.0.trial188.stdout:3763: oid 3 version 1560 is already newer than 1558 2026-02-13T20:28:05.992 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 3 v 1560 (ObjNum 1309 snap 393 seq_num 1309) dirty exists 2026-02-13T20:28:05.992 INFO:tasks.rados.rados.0.trial188.stdout:3763: left oid 3 (ObjNum 1309 snap 393 seq_num 1309) 2026-02-13T20:28:05.992 INFO:tasks.rados.rados.0.trial188.stdout:3767: finishing rollback tid 0 to trial18843701-35 2026-02-13T20:28:05.992 INFO:tasks.rados.rados.0.trial188.stdout:3766: finishing rollback tid 0 to trial18843701-1 2026-02-13T20:28:05.992 INFO:tasks.rados.rados.0.trial188.stdout:3766: finishing rollback tid 1 to trial18843701-1 2026-02-13T20:28:05.992 INFO:tasks.rados.rados.0.trial188.stdout:3767: finishing rollback tid 1 to trial18843701-35 2026-02-13T20:28:05.992 INFO:tasks.rados.rados.0.trial188.stdout:3767: finishing rollback tid 2 to trial18843701-35 2026-02-13T20:28:05.993 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 35 v 1576 (ObjNum 1256 snap 378 seq_num 1256) dirty exists 2026-02-13T20:28:05.993 INFO:tasks.rados.rados.0.trial188.stdout:3766: finishing rollback tid 2 to trial18843701-1 2026-02-13T20:28:05.993 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 1 v 1876 (ObjNum 1106 snap 326 seq_num 1106) dirty exists 2026-02-13T20:28:05.994 INFO:tasks.rados.rados.0.trial188.stdout:3763: done (3 left) 2026-02-13T20:28:05.994 INFO:tasks.rados.rados.0.trial188.stdout:3766: done (2 left) 2026-02-13T20:28:05.994 INFO:tasks.rados.rados.0.trial188.stdout:3767: done (1 left) 2026-02-13T20:28:05.994 INFO:tasks.rados.rados.0.trial188.stdout:3768: done (0 left) 2026-02-13T20:28:05.994 INFO:tasks.rados.rados.0.trial188.stdout:3769: read oid 6 snap -1 2026-02-13T20:28:05.994 INFO:tasks.rados.rados.0.trial188.stdout:3769: expect (ObjNum 1278 snap 384 seq_num 1278) 2026-02-13T20:28:05.994 INFO:tasks.rados.rados.0.trial188.stdout:3770: read oid 39 snap -1 2026-02-13T20:28:05.994 INFO:tasks.rados.rados.0.trial188.stdout:3770: expect deleted 2026-02-13T20:28:05.994 INFO:tasks.rados.rados.0.trial188.stdout:3771: write (excl) oid 36 current snap is 393 2026-02-13T20:28:05.995 INFO:tasks.rados.rados.0.trial188.stdout:3771: seq_num 1312 ranges {450784=739404,1791787=258997} 2026-02-13T20:28:05.995 INFO:tasks.rados.rados.0.trial188.stdout:3771: writing trial18843701-36 from 450784 to 1190188 tid 1 2026-02-13T20:28:05.999 INFO:tasks.rados.rados.0.trial188.stdout:3771: writing trial18843701-36 from 1791787 to 2050784 tid 2 2026-02-13T20:28:05.999 INFO:tasks.rados.rados.0.trial188.stdout:3772: copy_from oid 41 from oid 24 current snap is 393 2026-02-13T20:28:05.999 INFO:tasks.rados.rados.0.trial188.stdout:3769: expect (ObjNum 1278 snap 384 seq_num 1278) 2026-02-13T20:28:06.013 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 333680 2026-02-13T20:28:06.059 INFO:tasks.rados.rados.0.trial188.stdout:3771: finishing write tid 1 to trial18843701-36 2026-02-13T20:28:06.059 INFO:tasks.rados.rados.0.trial188.stdout:3769: done (3 left) 2026-02-13T20:28:06.059 INFO:tasks.rados.rados.0.trial188.stdout:3770: done (2 left) 2026-02-13T20:28:06.059 INFO:tasks.rados.rados.0.trial188.stdout:3773: write (excl) oid 11 current snap is 393 2026-02-13T20:28:06.059 INFO:tasks.rados.rados.0.trial188.stdout:3773: seq_num 1313 ranges {467591=414653,1450269=617322} 2026-02-13T20:28:06.062 INFO:tasks.rados.rados.0.trial188.stdout:3773: writing trial18843701-11 from 467591 to 882244 tid 1 2026-02-13T20:28:06.067 INFO:tasks.rados.rados.0.trial188.stdout:3773: writing trial18843701-11 from 1450269 to 2067591 tid 2 2026-02-13T20:28:06.067 INFO:tasks.rados.rados.0.trial188.stdout:3774: read oid 4 snap -1 2026-02-13T20:28:06.067 INFO:tasks.rados.rados.0.trial188.stdout:3774: expect (ObjNum 1248 snap 375 seq_num 1248) 2026-02-13T20:28:06.067 INFO:tasks.rados.rados.0.trial188.stdout:3775: write (excl) oid 14 current snap is 393 2026-02-13T20:28:06.067 INFO:tasks.rados.rados.0.trial188.stdout:3775: seq_num 1314 ranges {484398=489902,1392398=411118} 2026-02-13T20:28:06.070 INFO:tasks.rados.rados.0.trial188.stdout:3775: writing trial18843701-14 from 484398 to 974300 tid 1 2026-02-13T20:28:06.073 INFO:tasks.rados.rados.0.trial188.stdout:3775: writing trial18843701-14 from 1392398 to 1803516 tid 2 2026-02-13T20:28:06.073 INFO:tasks.rados.rados.0.trial188.stdout:3776: snap_remove snap 359 2026-02-13T20:28:06.755 INFO:tasks.rados.rados.0.trial188.stdout:3776: done (5 left) 2026-02-13T20:28:06.756 INFO:tasks.rados.rados.0.trial188.stdout:3777: read oid 1 snap 387 2026-02-13T20:28:06.756 INFO:tasks.rados.rados.0.trial188.stdout:3777: expect (ObjNum 1189 snap 364 seq_num 1189) 2026-02-13T20:28:06.756 INFO:tasks.rados.rados.0.trial188.stdout:3778: rollback oid 13 current snap is 393 2026-02-13T20:28:06.756 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 13 to 365 2026-02-13T20:28:06.756 INFO:tasks.rados.rados.0.trial188.stdout:3772: finishing copy_from to trial18843701-41 2026-02-13T20:28:06.756 INFO:tasks.rados.rados.0.trial188.stdout:3772: got expected ENOENT (src dne) 2026-02-13T20:28:06.756 INFO:tasks.rados.rados.0.trial188.stdout:3771: finishing write tid 2 to trial18843701-36 2026-02-13T20:28:06.756 INFO:tasks.rados.rados.0.trial188.stdout:3772: finishing copy_from racing read to trial18843701-41 2026-02-13T20:28:06.756 INFO:tasks.rados.rados.0.trial188.stdout:3771: finishing write tid 3 to trial18843701-36 2026-02-13T20:28:06.757 INFO:tasks.rados.rados.0.trial188.stdout:3772: done (6 left) 2026-02-13T20:28:06.757 INFO:tasks.rados.rados.0.trial188.stdout:3779: delete oid 28 current snap is 393 2026-02-13T20:28:06.757 INFO:tasks.rados.rados.0.trial188.stdout:3771: finishing write tid 4 to trial18843701-36 2026-02-13T20:28:06.757 INFO:tasks.rados.rados.0.trial188.stdout:3771: oid 36 updating version 0 to 1901 2026-02-13T20:28:06.757 INFO:tasks.rados.rados.0.trial188.stdout:3771: oid 36 version 1901 is already newer than 1899 2026-02-13T20:28:06.757 INFO:tasks.rados.rados.0.trial188.stdout:3771: oid 36 version 1901 is already newer than 1900 2026-02-13T20:28:06.757 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 36 v 1901 (ObjNum 1312 snap 393 seq_num 1312) dirty exists 2026-02-13T20:28:06.757 INFO:tasks.rados.rados.0.trial188.stdout:3771: left oid 36 (ObjNum 1312 snap 393 seq_num 1312) 2026-02-13T20:28:06.757 INFO:tasks.rados.rados.0.trial188.stdout:3773: finishing write tid 1 to trial18843701-11 2026-02-13T20:28:06.757 INFO:tasks.rados.rados.0.trial188.stdout:3773: finishing write tid 2 to trial18843701-11 2026-02-13T20:28:06.757 INFO:tasks.rados.rados.0.trial188.stdout:3773: finishing write tid 3 to trial18843701-11 2026-02-13T20:28:06.757 INFO:tasks.rados.rados.0.trial188.stdout:3773: finishing write tid 4 to trial18843701-11 2026-02-13T20:28:06.758 INFO:tasks.rados.rados.0.trial188.stdout:3773: oid 11 updating version 0 to 1693 2026-02-13T20:28:06.758 INFO:tasks.rados.rados.0.trial188.stdout:3773: oid 11 updating version 1693 to 1694 2026-02-13T20:28:06.758 INFO:tasks.rados.rados.0.trial188.stdout:3773: oid 11 version 1694 is already newer than 1692 2026-02-13T20:28:06.758 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 11 v 1694 (ObjNum 1313 snap 393 seq_num 1313) dirty exists 2026-02-13T20:28:06.758 INFO:tasks.rados.rados.0.trial188.stdout:3773: left oid 11 (ObjNum 1313 snap 393 seq_num 1313) 2026-02-13T20:28:06.758 INFO:tasks.rados.rados.0.trial188.stdout:3774: expect (ObjNum 1248 snap 375 seq_num 1248) 2026-02-13T20:28:06.797 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2818803 2026-02-13T20:28:06.798 INFO:tasks.rados.rados.0.trial188.stdout:3775: finishing write tid 1 to trial18843701-14 2026-02-13T20:28:06.798 INFO:tasks.rados.rados.0.trial188.stdout:3775: finishing write tid 2 to trial18843701-14 2026-02-13T20:28:06.798 INFO:tasks.rados.rados.0.trial188.stdout:3775: finishing write tid 3 to trial18843701-14 2026-02-13T20:28:06.798 INFO:tasks.rados.rados.0.trial188.stdout:3775: finishing write tid 4 to trial18843701-14 2026-02-13T20:28:06.798 INFO:tasks.rados.rados.0.trial188.stdout:3775: oid 14 updating version 0 to 1562 2026-02-13T20:28:06.798 INFO:tasks.rados.rados.0.trial188.stdout:3775: oid 14 updating version 1562 to 1563 2026-02-13T20:28:06.799 INFO:tasks.rados.rados.0.trial188.stdout:3775: oid 14 version 1563 is already newer than 1561 2026-02-13T20:28:06.799 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 14 v 1563 (ObjNum 1314 snap 393 seq_num 1314) dirty exists 2026-02-13T20:28:06.799 INFO:tasks.rados.rados.0.trial188.stdout:3775: left oid 14 (ObjNum 1314 snap 393 seq_num 1314) 2026-02-13T20:28:06.799 INFO:tasks.rados.rados.0.trial188.stdout:3777: expect (ObjNum 1189 snap 364 seq_num 1189) 2026-02-13T20:28:06.799 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:28:06.878 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2037057 2026-02-13T20:28:06.931 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1879837 2026-02-13T20:28:06.961 INFO:tasks.rados.rados.0.trial188.stdout:3778: finishing rollback tid 0 to trial18843701-13 2026-02-13T20:28:06.961 INFO:tasks.rados.rados.0.trial188.stdout:3778: finishing rollback tid 1 to trial18843701-13 2026-02-13T20:28:06.961 INFO:tasks.rados.rados.0.trial188.stdout:3778: finishing rollback tid 2 to trial18843701-13 2026-02-13T20:28:06.961 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 13 v 1880 (ObjNum 1187 snap 363 seq_num 1187) dirty exists 2026-02-13T20:28:06.963 INFO:tasks.rados.rados.0.trial188.stdout:3771: done (6 left) 2026-02-13T20:28:06.963 INFO:tasks.rados.rados.0.trial188.stdout:3773: done (5 left) 2026-02-13T20:28:06.963 INFO:tasks.rados.rados.0.trial188.stdout:3774: done (4 left) 2026-02-13T20:28:06.963 INFO:tasks.rados.rados.0.trial188.stdout:3775: done (3 left) 2026-02-13T20:28:06.963 INFO:tasks.rados.rados.0.trial188.stdout:3777: done (2 left) 2026-02-13T20:28:06.963 INFO:tasks.rados.rados.0.trial188.stdout:3778: done (1 left) 2026-02-13T20:28:06.963 INFO:tasks.rados.rados.0.trial188.stdout:3779: done (0 left) 2026-02-13T20:28:06.963 INFO:tasks.rados.rados.0.trial188.stdout:3780: read oid 8 snap -1 2026-02-13T20:28:06.964 INFO:tasks.rados.rados.0.trial188.stdout:3780: expect deleted 2026-02-13T20:28:06.964 INFO:tasks.rados.rados.0.trial188.stdout:3781: delete oid 16 current snap is 393 2026-02-13T20:28:06.965 INFO:tasks.rados.rados.0.trial188.stdout:3780: done (1 left) 2026-02-13T20:28:06.965 INFO:tasks.rados.rados.0.trial188.stdout:3781: done (0 left) 2026-02-13T20:28:06.965 INFO:tasks.rados.rados.0.trial188.stdout:3782: write oid 27 current snap is 393 2026-02-13T20:28:06.965 INFO:tasks.rados.rados.0.trial188.stdout:3782: seq_num 1317 ranges {534819=432002,1684197=450622} 2026-02-13T20:28:06.968 INFO:tasks.rados.rados.0.trial188.stdout:3782: writing trial18843701-27 from 534819 to 966821 tid 1 2026-02-13T20:28:06.973 INFO:tasks.rados.rados.0.trial188.stdout:3782: writing trial18843701-27 from 1684197 to 2134819 tid 2 2026-02-13T20:28:06.973 INFO:tasks.rados.rados.0.trial188.stdout:3783: write (excl) oid 42 current snap is 393 2026-02-13T20:28:06.973 INFO:tasks.rados.rados.0.trial188.stdout:3783: seq_num 1318 ranges {551626=507251,1626326=418456} 2026-02-13T20:28:06.977 INFO:tasks.rados.rados.0.trial188.stdout:3783: writing trial18843701-42 from 551626 to 1058877 tid 1 2026-02-13T20:28:06.980 INFO:tasks.rados.rados.0.trial188.stdout:3783: writing trial18843701-42 from 1626326 to 2044782 tid 2 2026-02-13T20:28:06.980 INFO:tasks.rados.rados.0.trial188.stdout:3784: delete oid 22 current snap is 393 2026-02-13T20:28:06.982 INFO:tasks.rados.rados.0.trial188.stdout:3784: done (2 left) 2026-02-13T20:28:06.982 INFO:tasks.rados.rados.0.trial188.stdout:3785: write (excl) oid 35 current snap is 393 2026-02-13T20:28:06.982 INFO:tasks.rados.rados.0.trial188.stdout:3785: seq_num 1320 ranges {585240=657749,1743290=422125} 2026-02-13T20:28:06.986 INFO:tasks.rados.rados.0.trial188.stdout:3785: writing trial18843701-35 from 585240 to 1242989 tid 1 2026-02-13T20:28:06.990 INFO:tasks.rados.rados.0.trial188.stdout:3785: writing trial18843701-35 from 1743290 to 2165415 tid 2 2026-02-13T20:28:06.990 INFO:tasks.rados.rados.0.trial188.stdout:3786: copy_from oid 25 from oid 22 current snap is 393 2026-02-13T20:28:06.990 INFO:tasks.rados.rados.0.trial188.stdout:3782: finishing write tid 1 to trial18843701-27 2026-02-13T20:28:06.990 INFO:tasks.rados.rados.0.trial188.stdout:3782: finishing write tid 2 to trial18843701-27 2026-02-13T20:28:06.990 INFO:tasks.rados.rados.0.trial188.stdout:3787: write oid 20 current snap is 393 2026-02-13T20:28:06.990 INFO:tasks.rados.rados.0.trial188.stdout:3787: seq_num 1321 ranges {602047=732998,1801772=400275} 2026-02-13T20:28:06.995 INFO:tasks.rados.rados.0.trial188.stdout:3787: writing trial18843701-20 from 602047 to 1335045 tid 1 2026-02-13T20:28:06.999 INFO:tasks.rados.rados.0.trial188.stdout:3787: writing trial18843701-20 from 1801772 to 2202047 tid 2 2026-02-13T20:28:06.999 INFO:tasks.rados.rados.0.trial188.stdout:3788: delete oid 3 current snap is 393 2026-02-13T20:28:06.999 INFO:tasks.rados.rados.0.trial188.stdout:3782: finishing write tid 3 to trial18843701-27 2026-02-13T20:28:06.999 INFO:tasks.rados.rados.0.trial188.stdout:3782: finishing write tid 4 to trial18843701-27 2026-02-13T20:28:06.999 INFO:tasks.rados.rados.0.trial188.stdout:3782: oid 27 updating version 0 to 1789 2026-02-13T20:28:06.999 INFO:tasks.rados.rados.0.trial188.stdout:3782: oid 27 updating version 1789 to 1790 2026-02-13T20:28:06.999 INFO:tasks.rados.rados.0.trial188.stdout:3782: oid 27 updating version 1790 to 1791 2026-02-13T20:28:06.999 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 27 v 1791 (ObjNum 1317 snap 393 seq_num 1317) dirty exists 2026-02-13T20:28:06.999 INFO:tasks.rados.rados.0.trial188.stdout:3782: left oid 27 (ObjNum 1317 snap 393 seq_num 1317) 2026-02-13T20:28:07.000 INFO:tasks.rados.rados.0.trial188.stdout:3782: done (5 left) 2026-02-13T20:28:07.000 INFO:tasks.rados.rados.0.trial188.stdout:3788: done (4 left) 2026-02-13T20:28:07.000 INFO:tasks.rados.rados.0.trial188.stdout:3789: write (excl) oid 46 current snap is 393 2026-02-13T20:28:07.000 INFO:tasks.rados.rados.0.trial188.stdout:3789: seq_num 1323 ranges {635661=599849,1918736=316925} 2026-02-13T20:28:07.004 INFO:tasks.rados.rados.0.trial188.stdout:3789: writing trial18843701-46 from 635661 to 1235510 tid 1 2026-02-13T20:28:07.009 INFO:tasks.rados.rados.0.trial188.stdout:3789: writing trial18843701-46 from 1918736 to 2235661 tid 2 2026-02-13T20:28:07.009 INFO:tasks.rados.rados.0.trial188.stdout:3790: copy_from oid 32 from oid 43 current snap is 393 2026-02-13T20:28:07.009 INFO:tasks.rados.rados.0.trial188.stdout:3791: snap_remove snap 392 2026-02-13T20:28:07.761 INFO:tasks.rados.rados.0.trial188.stdout:3791: done (6 left) 2026-02-13T20:28:07.761 INFO:tasks.rados.rados.0.trial188.stdout:3792: read oid 15 snap -1 2026-02-13T20:28:07.761 INFO:tasks.rados.rados.0.trial188.stdout:3792: expect deleted 2026-02-13T20:28:07.761 INFO:tasks.rados.rados.0.trial188.stdout:3793: rollback oid 5 current snap is 393 2026-02-13T20:28:07.761 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 5 to 379 2026-02-13T20:28:07.761 INFO:tasks.rados.rados.0.trial188.stdout:3783: finishing write tid 1 to trial18843701-42 2026-02-13T20:28:07.761 INFO:tasks.rados.rados.0.trial188.stdout:3783: finishing write tid 2 to trial18843701-42 2026-02-13T20:28:07.761 INFO:tasks.rados.rados.0.trial188.stdout:3783: finishing write tid 3 to trial18843701-42 2026-02-13T20:28:07.761 INFO:tasks.rados.rados.0.trial188.stdout:3783: finishing write tid 4 to trial18843701-42 2026-02-13T20:28:07.762 INFO:tasks.rados.rados.0.trial188.stdout:3783: oid 42 updating version 0 to 1578 2026-02-13T20:28:07.762 INFO:tasks.rados.rados.0.trial188.stdout:3783: oid 42 version 1578 is already newer than 1577 2026-02-13T20:28:07.762 INFO:tasks.rados.rados.0.trial188.stdout:3783: oid 42 updating version 1578 to 1579 2026-02-13T20:28:07.762 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 42 v 1579 (ObjNum 1318 snap 393 seq_num 1318) dirty exists 2026-02-13T20:28:07.762 INFO:tasks.rados.rados.0.trial188.stdout:3783: left oid 42 (ObjNum 1318 snap 393 seq_num 1318) 2026-02-13T20:28:07.762 INFO:tasks.rados.rados.0.trial188.stdout:3787: finishing write tid 1 to trial18843701-20 2026-02-13T20:28:07.762 INFO:tasks.rados.rados.0.trial188.stdout:3783: done (7 left) 2026-02-13T20:28:07.762 INFO:tasks.rados.rados.0.trial188.stdout:3794: snap_remove snap 390 2026-02-13T20:28:08.764 INFO:tasks.rados.rados.0.trial188.stdout:3794: done (7 left) 2026-02-13T20:28:08.764 INFO:tasks.rados.rados.0.trial188.stdout:3795: read oid 19 snap -1 2026-02-13T20:28:08.765 INFO:tasks.rados.rados.0.trial188.stdout:3795: expect (ObjNum 1272 snap 384 seq_num 1272) 2026-02-13T20:28:08.765 INFO:tasks.rados.rados.0.trial188.stdout:3796: copy_from oid 31 from oid 42 current snap is 393 2026-02-13T20:28:08.765 INFO:tasks.rados.rados.0.trial188.stdout:3785: finishing write tid 1 to trial18843701-35 2026-02-13T20:28:08.765 INFO:tasks.rados.rados.0.trial188.stdout:3786: finishing copy_from to trial18843701-25 2026-02-13T20:28:08.765 INFO:tasks.rados.rados.0.trial188.stdout:3786: got expected ENOENT (src dne) 2026-02-13T20:28:08.765 INFO:tasks.rados.rados.0.trial188.stdout:3786: finishing copy_from racing read to trial18843701-25 2026-02-13T20:28:08.765 INFO:tasks.rados.rados.0.trial188.stdout:3785: finishing write tid 2 to trial18843701-35 2026-02-13T20:28:08.765 INFO:tasks.rados.rados.0.trial188.stdout:3787: finishing write tid 2 to trial18843701-20 2026-02-13T20:28:08.765 INFO:tasks.rados.rados.0.trial188.stdout:3787: finishing write tid 3 to trial18843701-20 2026-02-13T20:28:08.765 INFO:tasks.rados.rados.0.trial188.stdout:3786: done (8 left) 2026-02-13T20:28:08.765 INFO:tasks.rados.rados.0.trial188.stdout:3797: read oid 12 snap -1 2026-02-13T20:28:08.766 INFO:tasks.rados.rados.0.trial188.stdout:3797: expect (ObjNum 1121 snap 334 seq_num 1121) 2026-02-13T20:28:08.766 INFO:tasks.rados.rados.0.trial188.stdout:3798: snap_create 2026-02-13T20:28:08.766 INFO:tasks.rados.rados.0.trial188.stdout:3787: finishing write tid 4 to trial18843701-20 2026-02-13T20:28:08.766 INFO:tasks.rados.rados.0.trial188.stdout:3787: oid 20 updating version 0 to 1256 2026-02-13T20:28:08.766 INFO:tasks.rados.rados.0.trial188.stdout:3787: oid 20 updating version 1256 to 1258 2026-02-13T20:28:08.766 INFO:tasks.rados.rados.0.trial188.stdout:3787: oid 20 version 1258 is already newer than 1257 2026-02-13T20:28:08.766 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 20 v 1258 (ObjNum 1321 snap 393 seq_num 1321) dirty exists 2026-02-13T20:28:08.766 INFO:tasks.rados.rados.0.trial188.stdout:3787: left oid 20 (ObjNum 1321 snap 393 seq_num 1321) 2026-02-13T20:28:08.766 INFO:tasks.rados.rados.0.trial188.stdout:3785: finishing write tid 3 to trial18843701-35 2026-02-13T20:28:08.766 INFO:tasks.rados.rados.0.trial188.stdout:3785: finishing write tid 4 to trial18843701-35 2026-02-13T20:28:08.766 INFO:tasks.rados.rados.0.trial188.stdout:3785: oid 35 updating version 0 to 1581 2026-02-13T20:28:08.766 INFO:tasks.rados.rados.0.trial188.stdout:3785: oid 35 updating version 1581 to 1582 2026-02-13T20:28:08.766 INFO:tasks.rados.rados.0.trial188.stdout:3785: oid 35 version 1582 is already newer than 1580 2026-02-13T20:28:08.767 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 35 v 1582 (ObjNum 1320 snap 393 seq_num 1320) dirty exists 2026-02-13T20:28:08.767 INFO:tasks.rados.rados.0.trial188.stdout:3785: left oid 35 (ObjNum 1320 snap 393 seq_num 1320) 2026-02-13T20:28:08.767 INFO:tasks.rados.rados.0.trial188.stdout:3790: finishing copy_from to trial18843701-32 2026-02-13T20:28:08.767 INFO:tasks.rados.rados.0.trial188.stdout:3790: got expected ENOENT (src dne) 2026-02-13T20:28:08.767 INFO:tasks.rados.rados.0.trial188.stdout:3790: finishing copy_from racing read to trial18843701-32 2026-02-13T20:28:08.767 INFO:tasks.rados.rados.0.trial188.stdout:3789: finishing write tid 1 to trial18843701-46 2026-02-13T20:28:08.767 INFO:tasks.rados.rados.0.trial188.stdout:3789: finishing write tid 2 to trial18843701-46 2026-02-13T20:28:08.767 INFO:tasks.rados.rados.0.trial188.stdout:3789: finishing write tid 3 to trial18843701-46 2026-02-13T20:28:08.767 INFO:tasks.rados.rados.0.trial188.stdout:3789: finishing write tid 4 to trial18843701-46 2026-02-13T20:28:08.767 INFO:tasks.rados.rados.0.trial188.stdout:3789: oid 46 updating version 0 to 1764 2026-02-13T20:28:08.767 INFO:tasks.rados.rados.0.trial188.stdout:3789: oid 46 version 1764 is already newer than 1762 2026-02-13T20:28:08.767 INFO:tasks.rados.rados.0.trial188.stdout:3789: oid 46 version 1764 is already newer than 1763 2026-02-13T20:28:08.768 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 46 v 1764 (ObjNum 1323 snap 393 seq_num 1323) dirty exists 2026-02-13T20:28:08.768 INFO:tasks.rados.rados.0.trial188.stdout:3789: left oid 46 (ObjNum 1323 snap 393 seq_num 1323) 2026-02-13T20:28:08.768 INFO:tasks.rados.rados.0.trial188.stdout:3793: finishing rollback tid 1 to trial18843701-5 2026-02-13T20:28:08.768 INFO:tasks.rados.rados.0.trial188.stdout:3793: finishing rollback tid 2 to trial18843701-5 2026-02-13T20:28:08.768 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 5 v 1882 (ObjNum 1162 snap 354 seq_num 1162) dirty exists 2026-02-13T20:28:08.773 INFO:tasks.rados.rados.0.trial188.stdout:3795: expect (ObjNum 1272 snap 384 seq_num 1272) 2026-02-13T20:28:08.829 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 784398 2026-02-13T20:28:08.910 INFO:tasks.rados.rados.0.trial188.stdout:3797: expect (ObjNum 1121 snap 334 seq_num 1121) 2026-02-13T20:28:08.910 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:28:08.946 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:28:09.021 INFO:tasks.rados.rados.0.trial188.stdout:3796: finishing copy_from racing read to trial18843701-31 2026-02-13T20:28:09.021 INFO:tasks.rados.rados.0.trial188.stdout:3796: finishing copy_from to trial18843701-31 2026-02-13T20:28:09.021 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 31 v 1579 (ObjNum 1318 snap 393 seq_num 1318) dirty exists 2026-02-13T20:28:09.767 INFO:tasks.rados.rados.0.trial188.stdout:3785: done (9 left) 2026-02-13T20:28:09.768 INFO:tasks.rados.rados.0.trial188.stdout:3787: done (8 left) 2026-02-13T20:28:09.768 INFO:tasks.rados.rados.0.trial188.stdout:3789: done (7 left) 2026-02-13T20:28:09.768 INFO:tasks.rados.rados.0.trial188.stdout:3790: done (6 left) 2026-02-13T20:28:09.768 INFO:tasks.rados.rados.0.trial188.stdout:3792: done (5 left) 2026-02-13T20:28:09.768 INFO:tasks.rados.rados.0.trial188.stdout:3793: done (4 left) 2026-02-13T20:28:09.768 INFO:tasks.rados.rados.0.trial188.stdout:3795: done (3 left) 2026-02-13T20:28:09.768 INFO:tasks.rados.rados.0.trial188.stdout:3796: done (2 left) 2026-02-13T20:28:09.768 INFO:tasks.rados.rados.0.trial188.stdout:3797: done (1 left) 2026-02-13T20:28:09.768 INFO:tasks.rados.rados.0.trial188.stdout:3798: done (0 left) 2026-02-13T20:28:09.769 INFO:tasks.rados.rados.0.trial188.stdout:3799: write (excl) oid 11 current snap is 394 2026-02-13T20:28:09.769 INFO:tasks.rados.rados.0.trial188.stdout:3799: seq_num 1324 ranges {652468=675098,1977218=275250} 2026-02-13T20:28:09.773 INFO:tasks.rados.rados.0.trial188.stdout:3799: writing trial18843701-11 from 652468 to 1327566 tid 1 2026-02-13T20:28:09.777 INFO:tasks.rados.rados.0.trial188.stdout:3799: writing trial18843701-11 from 1977218 to 2252468 tid 2 2026-02-13T20:28:09.777 INFO:tasks.rados.rados.0.trial188.stdout:3800: copy_from oid 5 from oid 20 current snap is 394 2026-02-13T20:28:09.777 INFO:tasks.rados.rados.0.trial188.stdout:3801: write oid 49 current snap is 394 2026-02-13T20:28:09.777 INFO:tasks.rados.rados.0.trial188.stdout:3801: seq_num 1325 ranges {669275=750347,2035700=233575} 2026-02-13T20:28:09.783 INFO:tasks.rados.rados.0.trial188.stdout:3801: writing trial18843701-49 from 669275 to 1419622 tid 1 2026-02-13T20:28:09.787 INFO:tasks.rados.rados.0.trial188.stdout:3801: writing trial18843701-49 from 2035700 to 2269275 tid 2 2026-02-13T20:28:09.787 INFO:tasks.rados.rados.0.trial188.stdout:3802: snap_create 2026-02-13T20:28:09.789 INFO:tasks.rados.rados.0.trial188.stdout:3799: finishing write tid 1 to trial18843701-11 2026-02-13T20:28:09.797 INFO:tasks.rados.rados.0.trial188.stdout:3800: finishing copy_from racing read to trial18843701-5 2026-02-13T20:28:09.799 INFO:tasks.rados.rados.0.trial188.stdout:3799: finishing write tid 2 to trial18843701-11 2026-02-13T20:28:09.800 INFO:tasks.rados.rados.0.trial188.stdout:3800: finishing copy_from to trial18843701-5 2026-02-13T20:28:09.800 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 5 v 1258 (ObjNum 1321 snap 393 seq_num 1321) dirty exists 2026-02-13T20:28:09.800 INFO:tasks.rados.rados.0.trial188.stdout:3799: finishing write tid 3 to trial18843701-11 2026-02-13T20:28:09.800 INFO:tasks.rados.rados.0.trial188.stdout:3799: finishing write tid 4 to trial18843701-11 2026-02-13T20:28:09.801 INFO:tasks.rados.rados.0.trial188.stdout:3799: oid 11 updating version 0 to 1696 2026-02-13T20:28:09.801 INFO:tasks.rados.rados.0.trial188.stdout:3799: oid 11 updating version 1696 to 1697 2026-02-13T20:28:09.801 INFO:tasks.rados.rados.0.trial188.stdout:3799: oid 11 version 1697 is already newer than 1695 2026-02-13T20:28:09.801 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 11 v 1697 (ObjNum 1324 snap 394 seq_num 1324) dirty exists 2026-02-13T20:28:09.801 INFO:tasks.rados.rados.0.trial188.stdout:3799: left oid 11 (ObjNum 1324 snap 394 seq_num 1324) 2026-02-13T20:28:09.801 INFO:tasks.rados.rados.0.trial188.stdout:3801: finishing write tid 1 to trial18843701-49 2026-02-13T20:28:09.801 INFO:tasks.rados.rados.0.trial188.stdout:3801: finishing write tid 2 to trial18843701-49 2026-02-13T20:28:09.801 INFO:tasks.rados.rados.0.trial188.stdout:3801: finishing write tid 3 to trial18843701-49 2026-02-13T20:28:09.801 INFO:tasks.rados.rados.0.trial188.stdout:3801: finishing write tid 4 to trial18843701-49 2026-02-13T20:28:09.801 INFO:tasks.rados.rados.0.trial188.stdout:3801: oid 49 updating version 0 to 1803 2026-02-13T20:28:09.801 INFO:tasks.rados.rados.0.trial188.stdout:3801: oid 49 version 1803 is already newer than 1802 2026-02-13T20:28:09.801 INFO:tasks.rados.rados.0.trial188.stdout:3801: oid 49 version 1803 is already newer than 1801 2026-02-13T20:28:09.801 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 49 v 1803 (ObjNum 1325 snap 394 seq_num 1325) dirty exists 2026-02-13T20:28:09.802 INFO:tasks.rados.rados.0.trial188.stdout:3801: left oid 49 (ObjNum 1325 snap 394 seq_num 1325) 2026-02-13T20:28:10.734 INFO:tasks.rados.rados.0.trial188.stdout:3799: done (3 left) 2026-02-13T20:28:10.735 INFO:tasks.rados.rados.0.trial188.stdout:3800: done (2 left) 2026-02-13T20:28:10.735 INFO:tasks.rados.rados.0.trial188.stdout:3801: done (1 left) 2026-02-13T20:28:10.735 INFO:tasks.rados.rados.0.trial188.stdout:3802: done (0 left) 2026-02-13T20:28:10.735 INFO:tasks.rados.rados.0.trial188.stdout:3803: write oid 25 current snap is 395 2026-02-13T20:28:10.735 INFO:tasks.rados.rados.0.trial188.stdout:3803: seq_num 1326 ranges {686082=425596,1577829=433132} 2026-02-13T20:28:10.739 INFO:tasks.rados.rados.0.trial188.stdout:3803: writing trial18843701-25 from 686082 to 1111678 tid 1 2026-02-13T20:28:10.743 INFO:tasks.rados.rados.0.trial188.stdout:3803: writing trial18843701-25 from 1577829 to 2010961 tid 2 2026-02-13T20:28:10.743 INFO:tasks.rados.rados.0.trial188.stdout:3804: read oid 3 snap -1 2026-02-13T20:28:10.743 INFO:tasks.rados.rados.0.trial188.stdout:3804: expect deleted 2026-02-13T20:28:10.743 INFO:tasks.rados.rados.0.trial188.stdout:3805: copy_from oid 5 from oid 4 current snap is 395 2026-02-13T20:28:10.743 INFO:tasks.rados.rados.0.trial188.stdout:3806: read oid 26 snap -1 2026-02-13T20:28:10.743 INFO:tasks.rados.rados.0.trial188.stdout:3806: expect deleted 2026-02-13T20:28:10.743 INFO:tasks.rados.rados.0.trial188.stdout:3807: snap_remove snap 387 2026-02-13T20:28:11.735 INFO:tasks.rados.rados.0.trial188.stdout:3807: done (4 left) 2026-02-13T20:28:11.736 INFO:tasks.rados.rados.0.trial188.stdout:3808: rollback oid 33 current snap is 395 2026-02-13T20:28:11.736 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 33 to 388 2026-02-13T20:28:11.736 INFO:tasks.rados.rados.0.trial188.stdout:3803: finishing write tid 1 to trial18843701-25 2026-02-13T20:28:11.736 INFO:tasks.rados.rados.0.trial188.stdout:3803: finishing write tid 2 to trial18843701-25 2026-02-13T20:28:11.736 INFO:tasks.rados.rados.0.trial188.stdout:3803: finishing write tid 3 to trial18843701-25 2026-02-13T20:28:11.736 INFO:tasks.rados.rados.0.trial188.stdout:3803: finishing write tid 4 to trial18843701-25 2026-02-13T20:28:11.736 INFO:tasks.rados.rados.0.trial188.stdout:3803: oid 25 updating version 0 to 1807 2026-02-13T20:28:11.736 INFO:tasks.rados.rados.0.trial188.stdout:3803: oid 25 version 1807 is already newer than 1806 2026-02-13T20:28:11.736 INFO:tasks.rados.rados.0.trial188.stdout:3803: oid 25 version 1807 is already newer than 1805 2026-02-13T20:28:11.737 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 25 v 1807 (ObjNum 1326 snap 395 seq_num 1326) dirty exists 2026-02-13T20:28:11.737 INFO:tasks.rados.rados.0.trial188.stdout:3803: left oid 25 (ObjNum 1326 snap 395 seq_num 1326) 2026-02-13T20:28:11.737 INFO:tasks.rados.rados.0.trial188.stdout:3805: finishing copy_from racing read to trial18843701-5 2026-02-13T20:28:11.737 INFO:tasks.rados.rados.0.trial188.stdout:3805: finishing copy_from to trial18843701-5 2026-02-13T20:28:11.737 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 5 v 1687 (ObjNum 1248 snap 375 seq_num 1248) dirty exists 2026-02-13T20:28:11.737 INFO:tasks.rados.rados.0.trial188.stdout:3803: done (4 left) 2026-02-13T20:28:11.737 INFO:tasks.rados.rados.0.trial188.stdout:3804: done (3 left) 2026-02-13T20:28:11.737 INFO:tasks.rados.rados.0.trial188.stdout:3805: done (2 left) 2026-02-13T20:28:11.737 INFO:tasks.rados.rados.0.trial188.stdout:3806: done (1 left) 2026-02-13T20:28:11.737 INFO:tasks.rados.rados.0.trial188.stdout:3809: snap_create 2026-02-13T20:28:11.738 INFO:tasks.rados.rados.0.trial188.stdout:3808: finishing rollback tid 0 to trial18843701-33 2026-02-13T20:28:11.739 INFO:tasks.rados.rados.0.trial188.stdout:3808: finishing rollback tid 1 to trial18843701-33 2026-02-13T20:28:11.739 INFO:tasks.rados.rados.0.trial188.stdout:3808: finishing rollback tid 2 to trial18843701-33 2026-02-13T20:28:11.739 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 33 v 1727 (ObjNum 1102 snap 326 seq_num 1102) dirty exists 2026-02-13T20:28:12.735 INFO:tasks.rados.rados.0.trial188.stdout:3808: done (1 left) 2026-02-13T20:28:12.735 INFO:tasks.rados.rados.0.trial188.stdout:3809: done (0 left) 2026-02-13T20:28:12.735 INFO:tasks.rados.rados.0.trial188.stdout:3810: delete oid 1 current snap is 396 2026-02-13T20:28:12.737 INFO:tasks.rados.rados.0.trial188.stdout:3810: done (0 left) 2026-02-13T20:28:12.737 INFO:tasks.rados.rados.0.trial188.stdout:3811: read oid 29 snap -1 2026-02-13T20:28:12.737 INFO:tasks.rados.rados.0.trial188.stdout:3811: expect (ObjNum 1200 snap 367 seq_num 1200) 2026-02-13T20:28:12.737 INFO:tasks.rados.rados.0.trial188.stdout:3812: snap_remove snap 374 2026-02-13T20:28:13.736 INFO:tasks.rados.rados.0.trial188.stdout:3812: done (1 left) 2026-02-13T20:28:13.736 INFO:tasks.rados.rados.0.trial188.stdout:3813: write (excl) oid 47 current snap is 396 2026-02-13T20:28:13.737 INFO:tasks.rados.rados.0.trial188.stdout:3813: seq_num 1328 ranges {719696=576094,2094793=224903} 2026-02-13T20:28:13.741 INFO:tasks.rados.rados.0.trial188.stdout:3813: writing trial18843701-47 from 719696 to 1295790 tid 1 2026-02-13T20:28:13.746 INFO:tasks.rados.rados.0.trial188.stdout:3813: writing trial18843701-47 from 2094793 to 2319696 tid 2 2026-02-13T20:28:13.746 INFO:tasks.rados.rados.0.trial188.stdout:3814: read oid 41 snap -1 2026-02-13T20:28:13.746 INFO:tasks.rados.rados.0.trial188.stdout:3814: expect (ObjNum 1301 snap 390 seq_num 1301) 2026-02-13T20:28:13.746 INFO:tasks.rados.rados.0.trial188.stdout:3815: delete oid 7 current snap is 396 2026-02-13T20:28:13.746 INFO:tasks.rados.rados.0.trial188.stdout:3811: expect (ObjNum 1200 snap 367 seq_num 1200) 2026-02-13T20:28:13.801 INFO:tasks.rados.rados.0.trial188.stdout:3814: expect (ObjNum 1301 snap 390 seq_num 1301) 2026-02-13T20:28:13.850 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:28:13.964 INFO:tasks.rados.rados.0.trial188.stdout:3813: finishing write tid 1 to trial18843701-47 2026-02-13T20:28:13.964 INFO:tasks.rados.rados.0.trial188.stdout:3813: finishing write tid 2 to trial18843701-47 2026-02-13T20:28:13.964 INFO:tasks.rados.rados.0.trial188.stdout:3813: finishing write tid 3 to trial18843701-47 2026-02-13T20:28:13.964 INFO:tasks.rados.rados.0.trial188.stdout:3813: finishing write tid 4 to trial18843701-47 2026-02-13T20:28:13.964 INFO:tasks.rados.rados.0.trial188.stdout:3813: oid 47 updating version 0 to 1729 2026-02-13T20:28:13.964 INFO:tasks.rados.rados.0.trial188.stdout:3813: oid 47 version 1729 is already newer than 1728 2026-02-13T20:28:13.964 INFO:tasks.rados.rados.0.trial188.stdout:3813: oid 47 updating version 1729 to 1730 2026-02-13T20:28:13.965 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 47 v 1730 (ObjNum 1328 snap 396 seq_num 1328) dirty exists 2026-02-13T20:28:13.965 INFO:tasks.rados.rados.0.trial188.stdout:3813: left oid 47 (ObjNum 1328 snap 396 seq_num 1328) 2026-02-13T20:28:13.965 INFO:tasks.rados.rados.0.trial188.stdout:3811: done (3 left) 2026-02-13T20:28:13.965 INFO:tasks.rados.rados.0.trial188.stdout:3813: done (2 left) 2026-02-13T20:28:13.965 INFO:tasks.rados.rados.0.trial188.stdout:3814: done (1 left) 2026-02-13T20:28:13.965 INFO:tasks.rados.rados.0.trial188.stdout:3815: done (0 left) 2026-02-13T20:28:13.965 INFO:tasks.rados.rados.0.trial188.stdout:3816: write (excl) oid 20 current snap is 396 2026-02-13T20:28:13.965 INFO:tasks.rados.rados.0.trial188.stdout:3816: seq_num 1330 ranges {753310=726592,2095404=257906} 2026-02-13T20:28:13.969 INFO:tasks.rados.rados.0.trial188.stdout:3816: writing trial18843701-20 from 753310 to 1479902 tid 1 2026-02-13T20:28:13.972 INFO:tasks.rados.rados.0.trial188.stdout:3816: writing trial18843701-20 from 2095404 to 2353310 tid 2 2026-02-13T20:28:13.973 INFO:tasks.rados.rados.0.trial188.stdout:3817: copy_from oid 36 from oid 43 current snap is 396 2026-02-13T20:28:13.973 INFO:tasks.rados.rados.0.trial188.stdout:3818: snap_remove snap 379 2026-02-13T20:28:14.741 INFO:tasks.rados.rados.0.trial188.stdout:3818: done (2 left) 2026-02-13T20:28:14.741 INFO:tasks.rados.rados.0.trial188.stdout:3819: copy_from oid 34 from oid 22 current snap is 396 2026-02-13T20:28:14.741 INFO:tasks.rados.rados.0.trial188.stdout:3817: finishing copy_from to trial18843701-36 2026-02-13T20:28:14.741 INFO:tasks.rados.rados.0.trial188.stdout:3817: got expected ENOENT (src dne) 2026-02-13T20:28:14.742 INFO:tasks.rados.rados.0.trial188.stdout:3817: finishing copy_from racing read to trial18843701-36 2026-02-13T20:28:14.742 INFO:tasks.rados.rados.0.trial188.stdout:3816: finishing write tid 1 to trial18843701-20 2026-02-13T20:28:14.742 INFO:tasks.rados.rados.0.trial188.stdout:3816: finishing write tid 2 to trial18843701-20 2026-02-13T20:28:14.742 INFO:tasks.rados.rados.0.trial188.stdout:3816: finishing write tid 3 to trial18843701-20 2026-02-13T20:28:14.742 INFO:tasks.rados.rados.0.trial188.stdout:3816: finishing write tid 4 to trial18843701-20 2026-02-13T20:28:14.742 INFO:tasks.rados.rados.0.trial188.stdout:3816: oid 20 updating version 0 to 1261 2026-02-13T20:28:14.742 INFO:tasks.rados.rados.0.trial188.stdout:3816: oid 20 version 1261 is already newer than 1259 2026-02-13T20:28:14.742 INFO:tasks.rados.rados.0.trial188.stdout:3816: oid 20 version 1261 is already newer than 1260 2026-02-13T20:28:14.742 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 20 v 1261 (ObjNum 1330 snap 396 seq_num 1330) dirty exists 2026-02-13T20:28:14.742 INFO:tasks.rados.rados.0.trial188.stdout:3816: left oid 20 (ObjNum 1330 snap 396 seq_num 1330) 2026-02-13T20:28:14.742 INFO:tasks.rados.rados.0.trial188.stdout:3816: done (2 left) 2026-02-13T20:28:14.742 INFO:tasks.rados.rados.0.trial188.stdout:3817: done (1 left) 2026-02-13T20:28:14.743 INFO:tasks.rados.rados.0.trial188.stdout:3820: read oid 15 snap -1 2026-02-13T20:28:14.743 INFO:tasks.rados.rados.0.trial188.stdout:3820: expect deleted 2026-02-13T20:28:14.743 INFO:tasks.rados.rados.0.trial188.stdout:3821: copy_from oid 48 from oid 27 current snap is 396 2026-02-13T20:28:14.743 INFO:tasks.rados.rados.0.trial188.stdout:3822: rollback oid 47 current snap is 396 2026-02-13T20:28:14.743 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 47 to 395 2026-02-13T20:28:14.743 INFO:tasks.rados.rados.0.trial188.stdout:3823: write (excl) oid 33 current snap is 396 2026-02-13T20:28:14.743 INFO:tasks.rados.rados.0.trial188.stdout:3823: seq_num 1331 ranges {770117=518194,1870239=499878} 2026-02-13T20:28:14.745 INFO:tasks.rados.rados.0.trial188.stdout:3823: writing trial18843701-33 from 770117 to 1288311 tid 1 2026-02-13T20:28:14.750 INFO:tasks.rados.rados.0.trial188.stdout:3823: writing trial18843701-33 from 1870239 to 2370117 tid 2 2026-02-13T20:28:14.750 INFO:tasks.rados.rados.0.trial188.stdout:3824: snap_remove snap 391 2026-02-13T20:28:15.735 INFO:tasks.rados.rados.0.trial188.stdout:3824: done (5 left) 2026-02-13T20:28:15.735 INFO:tasks.rados.rados.0.trial188.stdout:3825: copy_from oid 43 from oid 25 current snap is 396 2026-02-13T20:28:15.736 INFO:tasks.rados.rados.0.trial188.stdout:3819: finishing copy_from to trial18843701-34 2026-02-13T20:28:15.736 INFO:tasks.rados.rados.0.trial188.stdout:3819: got expected ENOENT (src dne) 2026-02-13T20:28:15.736 INFO:tasks.rados.rados.0.trial188.stdout:3819: finishing copy_from racing read to trial18843701-34 2026-02-13T20:28:15.736 INFO:tasks.rados.rados.0.trial188.stdout:3822: finishing rollback tid 0 to trial18843701-47 2026-02-13T20:28:15.736 INFO:tasks.rados.rados.0.trial188.stdout:3822: finishing rollback tid 1 to trial18843701-47 2026-02-13T20:28:15.736 INFO:tasks.rados.rados.0.trial188.stdout:3822: finishing rollback tid 2 to trial18843701-47 2026-02-13T20:28:15.736 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 47 v 1733 (ObjNum 1121 snap 334 seq_num 1121) dirty exists 2026-02-13T20:28:15.736 INFO:tasks.rados.rados.0.trial188.stdout:3823: finishing write tid 1 to trial18843701-33 2026-02-13T20:28:15.736 INFO:tasks.rados.rados.0.trial188.stdout:3823: finishing write tid 2 to trial18843701-33 2026-02-13T20:28:15.736 INFO:tasks.rados.rados.0.trial188.stdout:3823: finishing write tid 3 to trial18843701-33 2026-02-13T20:28:15.736 INFO:tasks.rados.rados.0.trial188.stdout:3823: finishing write tid 4 to trial18843701-33 2026-02-13T20:28:15.736 INFO:tasks.rados.rados.0.trial188.stdout:3823: oid 33 updating version 0 to 1735 2026-02-13T20:28:15.736 INFO:tasks.rados.rados.0.trial188.stdout:3823: oid 33 version 1735 is already newer than 1734 2026-02-13T20:28:15.736 INFO:tasks.rados.rados.0.trial188.stdout:3823: oid 33 updating version 1735 to 1736 2026-02-13T20:28:15.736 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 33 v 1736 (ObjNum 1331 snap 396 seq_num 1331) dirty exists 2026-02-13T20:28:15.736 INFO:tasks.rados.rados.0.trial188.stdout:3823: left oid 33 (ObjNum 1331 snap 396 seq_num 1331) 2026-02-13T20:28:15.736 INFO:tasks.rados.rados.0.trial188.stdout:3821: finishing copy_from racing read to trial18843701-48 2026-02-13T20:28:15.736 INFO:tasks.rados.rados.0.trial188.stdout:3819: done (5 left) 2026-02-13T20:28:15.736 INFO:tasks.rados.rados.0.trial188.stdout:3820: done (4 left) 2026-02-13T20:28:15.736 INFO:tasks.rados.rados.0.trial188.stdout:3822: done (3 left) 2026-02-13T20:28:15.736 INFO:tasks.rados.rados.0.trial188.stdout:3823: done (2 left) 2026-02-13T20:28:15.736 INFO:tasks.rados.rados.0.trial188.stdout:3826: snap_remove snap 395 2026-02-13T20:28:16.737 INFO:tasks.rados.rados.0.trial188.stdout:3826: done (2 left) 2026-02-13T20:28:16.737 INFO:tasks.rados.rados.0.trial188.stdout:3827: write (excl) oid 18 current snap is 396 2026-02-13T20:28:16.737 INFO:tasks.rados.rados.0.trial188.stdout:3827: seq_num 1332 ranges {786924=593443,1928721=458203} 2026-02-13T20:28:16.742 INFO:tasks.rados.rados.0.trial188.stdout:3827: writing trial18843701-18 from 786924 to 1380367 tid 1 2026-02-13T20:28:16.746 INFO:tasks.rados.rados.0.trial188.stdout:3827: writing trial18843701-18 from 1928721 to 2386924 tid 2 2026-02-13T20:28:16.746 INFO:tasks.rados.rados.0.trial188.stdout:3828: rollback oid 47 current snap is 396 2026-02-13T20:28:16.746 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 47 to 389 2026-02-13T20:28:16.746 INFO:tasks.rados.rados.0.trial188.stdout:3821: finishing copy_from to trial18843701-48 2026-02-13T20:28:16.746 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 48 v 1791 (ObjNum 1317 snap 393 seq_num 1317) dirty exists 2026-02-13T20:28:16.746 INFO:tasks.rados.rados.0.trial188.stdout:3825: finishing copy_from racing read to trial18843701-43 2026-02-13T20:28:16.746 INFO:tasks.rados.rados.0.trial188.stdout:3825: finishing copy_from to trial18843701-43 2026-02-13T20:28:16.746 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 43 v 1807 (ObjNum 1326 snap 395 seq_num 1326) dirty exists 2026-02-13T20:28:16.746 INFO:tasks.rados.rados.0.trial188.stdout:3821: done (3 left) 2026-02-13T20:28:16.746 INFO:tasks.rados.rados.0.trial188.stdout:3825: done (2 left) 2026-02-13T20:28:16.746 INFO:tasks.rados.rados.0.trial188.stdout:3829: snap_remove snap 369 2026-02-13T20:28:17.742 INFO:tasks.rados.rados.0.trial188.stdout:3829: done (2 left) 2026-02-13T20:28:17.742 INFO:tasks.rados.rados.0.trial188.stdout:3830: read oid 21 snap -1 2026-02-13T20:28:17.742 INFO:tasks.rados.rados.0.trial188.stdout:3830: expect (ObjNum 1238 snap 375 seq_num 1238) 2026-02-13T20:28:17.742 INFO:tasks.rados.rados.0.trial188.stdout:3831: write oid 8 current snap is 396 2026-02-13T20:28:17.742 INFO:tasks.rados.rados.0.trial188.stdout:3831: seq_num 1333 ranges {403731=668692,1587203=587797} 2026-02-13T20:28:17.746 INFO:tasks.rados.rados.0.trial188.stdout:3831: writing trial18843701-8 from 403731 to 1072423 tid 1 2026-02-13T20:28:17.752 INFO:tasks.rados.rados.0.trial188.stdout:3831: writing trial18843701-8 from 1587203 to 2175000 tid 2 2026-02-13T20:28:17.752 INFO:tasks.rados.rados.0.trial188.stdout:3832: snap_create 2026-02-13T20:28:17.752 INFO:tasks.rados.rados.0.trial188.stdout:3828: finishing rollback tid 0 to trial18843701-47 2026-02-13T20:28:17.752 INFO:tasks.rados.rados.0.trial188.stdout:3828: finishing rollback tid 1 to trial18843701-47 2026-02-13T20:28:17.752 INFO:tasks.rados.rados.0.trial188.stdout:3828: finishing rollback tid 2 to trial18843701-47 2026-02-13T20:28:17.752 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 47 v 1739 (ObjNum 1121 snap 334 seq_num 1121) dirty exists 2026-02-13T20:28:17.753 INFO:tasks.rados.rados.0.trial188.stdout:3827: finishing write tid 1 to trial18843701-18 2026-02-13T20:28:17.753 INFO:tasks.rados.rados.0.trial188.stdout:3827: finishing write tid 2 to trial18843701-18 2026-02-13T20:28:17.753 INFO:tasks.rados.rados.0.trial188.stdout:3827: finishing write tid 3 to trial18843701-18 2026-02-13T20:28:17.753 INFO:tasks.rados.rados.0.trial188.stdout:3827: finishing write tid 4 to trial18843701-18 2026-02-13T20:28:17.753 INFO:tasks.rados.rados.0.trial188.stdout:3827: oid 18 updating version 0 to 1752 2026-02-13T20:28:17.753 INFO:tasks.rados.rados.0.trial188.stdout:3827: oid 18 version 1752 is already newer than 1750 2026-02-13T20:28:17.753 INFO:tasks.rados.rados.0.trial188.stdout:3827: oid 18 version 1752 is already newer than 1751 2026-02-13T20:28:17.753 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 18 v 1752 (ObjNum 1332 snap 396 seq_num 1332) dirty exists 2026-02-13T20:28:17.753 INFO:tasks.rados.rados.0.trial188.stdout:3827: left oid 18 (ObjNum 1332 snap 396 seq_num 1332) 2026-02-13T20:28:17.753 INFO:tasks.rados.rados.0.trial188.stdout:3830: expect (ObjNum 1238 snap 375 seq_num 1238) 2026-02-13T20:28:17.783 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 503571 2026-02-13T20:28:17.832 INFO:tasks.rados.rados.0.trial188.stdout:3831: finishing write tid 1 to trial18843701-8 2026-02-13T20:28:17.832 INFO:tasks.rados.rados.0.trial188.stdout:3831: finishing write tid 2 to trial18843701-8 2026-02-13T20:28:17.833 INFO:tasks.rados.rados.0.trial188.stdout:3831: finishing write tid 3 to trial18843701-8 2026-02-13T20:28:17.833 INFO:tasks.rados.rados.0.trial188.stdout:3831: finishing write tid 4 to trial18843701-8 2026-02-13T20:28:17.833 INFO:tasks.rados.rados.0.trial188.stdout:3831: oid 8 updating version 0 to 1921 2026-02-13T20:28:17.833 INFO:tasks.rados.rados.0.trial188.stdout:3831: oid 8 version 1921 is already newer than 1920 2026-02-13T20:28:17.833 INFO:tasks.rados.rados.0.trial188.stdout:3831: oid 8 updating version 1921 to 1922 2026-02-13T20:28:17.833 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 8 v 1922 (ObjNum 1333 snap 396 seq_num 1333) dirty exists 2026-02-13T20:28:17.833 INFO:tasks.rados.rados.0.trial188.stdout:3831: left oid 8 (ObjNum 1333 snap 396 seq_num 1333) 2026-02-13T20:28:18.745 INFO:tasks.rados.rados.0.trial188.stdout:3827: done (4 left) 2026-02-13T20:28:18.745 INFO:tasks.rados.rados.0.trial188.stdout:3828: done (3 left) 2026-02-13T20:28:18.745 INFO:tasks.rados.rados.0.trial188.stdout:3830: done (2 left) 2026-02-13T20:28:18.745 INFO:tasks.rados.rados.0.trial188.stdout:3831: done (1 left) 2026-02-13T20:28:18.745 INFO:tasks.rados.rados.0.trial188.stdout:3832: done (0 left) 2026-02-13T20:28:18.746 INFO:tasks.rados.rados.0.trial188.stdout:3833: delete oid 44 current snap is 397 2026-02-13T20:28:18.747 INFO:tasks.rados.rados.0.trial188.stdout:3833: done (0 left) 2026-02-13T20:28:18.747 INFO:tasks.rados.rados.0.trial188.stdout:3834: rollback oid 3 current snap is 397 2026-02-13T20:28:18.747 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 3 to 389 2026-02-13T20:28:18.747 INFO:tasks.rados.rados.0.trial188.stdout:3835: read oid 33 snap -1 2026-02-13T20:28:18.747 INFO:tasks.rados.rados.0.trial188.stdout:3835: expect (ObjNum 1331 snap 396 seq_num 1331) 2026-02-13T20:28:18.747 INFO:tasks.rados.rados.0.trial188.stdout:3836: snap_remove snap 394 2026-02-13T20:28:19.745 INFO:tasks.rados.rados.0.trial188.stdout:3836: done (2 left) 2026-02-13T20:28:19.745 INFO:tasks.rados.rados.0.trial188.stdout:3837: delete oid 14 current snap is 397 2026-02-13T20:28:19.745 INFO:tasks.rados.rados.0.trial188.stdout:3834: finishing rollback tid 1 to trial18843701-3 2026-02-13T20:28:19.745 INFO:tasks.rados.rados.0.trial188.stdout:3834: finishing rollback tid 2 to trial18843701-3 2026-02-13T20:28:19.745 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 3 v 1566 (ObjNum 1289 snap 384 seq_num 1289) dirty exists 2026-02-13T20:28:19.745 INFO:tasks.rados.rados.0.trial188.stdout:3835: expect (ObjNum 1331 snap 396 seq_num 1331) 2026-02-13T20:28:19.745 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:28:19.826 INFO:tasks.rados.rados.0.trial188.stdout:3834: done (2 left) 2026-02-13T20:28:19.827 INFO:tasks.rados.rados.0.trial188.stdout:3835: done (1 left) 2026-02-13T20:28:19.827 INFO:tasks.rados.rados.0.trial188.stdout:3837: done (0 left) 2026-02-13T20:28:19.827 INFO:tasks.rados.rados.0.trial188.stdout:3838: write (excl) oid 18 current snap is 397 2026-02-13T20:28:19.827 INFO:tasks.rados.rados.0.trial188.stdout:3838: seq_num 1336 ranges {454152=494439,1646296=735124} 2026-02-13T20:28:19.830 INFO:tasks.rados.rados.0.trial188.stdout:3838: writing trial18843701-18 from 454152 to 948591 tid 1 2026-02-13T20:28:19.836 INFO:tasks.rados.rados.0.trial188.stdout:3838: writing trial18843701-18 from 1646296 to 2381420 tid 2 2026-02-13T20:28:19.836 INFO:tasks.rados.rados.0.trial188.stdout:3839: snap_remove snap 388 2026-02-13T20:28:20.735 INFO:tasks.rados.rados.0.trial188.stdout:3839: done (1 left) 2026-02-13T20:28:20.735 INFO:tasks.rados.rados.0.trial188.stdout:3840: snap_remove snap 393 2026-02-13T20:28:21.740 INFO:tasks.rados.rados.0.trial188.stdout:3840: done (1 left) 2026-02-13T20:28:21.740 INFO:tasks.rados.rados.0.trial188.stdout:3841: write oid 2 current snap is 397 2026-02-13T20:28:21.740 INFO:tasks.rados.rados.0.trial188.stdout:3841: seq_num 1337 ranges {470959=569688,1704778=595135} 2026-02-13T20:28:21.744 INFO:tasks.rados.rados.0.trial188.stdout:3841: writing trial18843701-2 from 470959 to 1040647 tid 1 2026-02-13T20:28:21.749 INFO:tasks.rados.rados.0.trial188.stdout:3841: writing trial18843701-2 from 1704778 to 2299913 tid 2 2026-02-13T20:28:21.750 INFO:tasks.rados.rados.0.trial188.stdout:3842: delete oid 32 current snap is 397 2026-02-13T20:28:21.750 INFO:tasks.rados.rados.0.trial188.stdout:3838: finishing write tid 1 to trial18843701-18 2026-02-13T20:28:21.750 INFO:tasks.rados.rados.0.trial188.stdout:3838: finishing write tid 2 to trial18843701-18 2026-02-13T20:28:21.750 INFO:tasks.rados.rados.0.trial188.stdout:3838: finishing write tid 3 to trial18843701-18 2026-02-13T20:28:21.750 INFO:tasks.rados.rados.0.trial188.stdout:3838: finishing write tid 4 to trial18843701-18 2026-02-13T20:28:21.750 INFO:tasks.rados.rados.0.trial188.stdout:3838: oid 18 updating version 0 to 1753 2026-02-13T20:28:21.750 INFO:tasks.rados.rados.0.trial188.stdout:3838: oid 18 updating version 1753 to 1754 2026-02-13T20:28:21.750 INFO:tasks.rados.rados.0.trial188.stdout:3838: oid 18 updating version 1754 to 1755 2026-02-13T20:28:21.750 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 18 v 1755 (ObjNum 1336 snap 397 seq_num 1336) dirty exists 2026-02-13T20:28:21.750 INFO:tasks.rados.rados.0.trial188.stdout:3838: left oid 18 (ObjNum 1336 snap 397 seq_num 1336) 2026-02-13T20:28:21.763 INFO:tasks.rados.rados.0.trial188.stdout:3841: finishing write tid 1 to trial18843701-2 2026-02-13T20:28:21.763 INFO:tasks.rados.rados.0.trial188.stdout:3838: done (2 left) 2026-02-13T20:28:21.763 INFO:tasks.rados.rados.0.trial188.stdout:3842: done (1 left) 2026-02-13T20:28:21.763 INFO:tasks.rados.rados.0.trial188.stdout:3843: write oid 49 current snap is 397 2026-02-13T20:28:21.764 INFO:tasks.rados.rados.0.trial188.stdout:3843: seq_num 1339 ranges {504573=436539,1421742=598804,2437505=67068} 2026-02-13T20:28:21.767 INFO:tasks.rados.rados.0.trial188.stdout:3843: writing trial18843701-49 from 504573 to 941112 tid 1 2026-02-13T20:28:21.771 INFO:tasks.rados.rados.0.trial188.stdout:3843: writing trial18843701-49 from 1421742 to 2020546 tid 2 2026-02-13T20:28:21.773 INFO:tasks.rados.rados.0.trial188.stdout:3843: writing trial18843701-49 from 2437505 to 2504573 tid 3 2026-02-13T20:28:21.773 INFO:tasks.rados.rados.0.trial188.stdout:3844: delete oid 30 current snap is 397 2026-02-13T20:28:21.773 INFO:tasks.rados.rados.0.trial188.stdout:3841: finishing write tid 2 to trial18843701-2 2026-02-13T20:28:21.773 INFO:tasks.rados.rados.0.trial188.stdout:3841: finishing write tid 3 to trial18843701-2 2026-02-13T20:28:21.773 INFO:tasks.rados.rados.0.trial188.stdout:3841: finishing write tid 4 to trial18843701-2 2026-02-13T20:28:21.773 INFO:tasks.rados.rados.0.trial188.stdout:3841: oid 2 updating version 0 to 1913 2026-02-13T20:28:21.774 INFO:tasks.rados.rados.0.trial188.stdout:3841: oid 2 version 1913 is already newer than 1911 2026-02-13T20:28:21.774 INFO:tasks.rados.rados.0.trial188.stdout:3841: oid 2 version 1913 is already newer than 1912 2026-02-13T20:28:21.774 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 2 v 1913 (ObjNum 1337 snap 397 seq_num 1337) dirty exists 2026-02-13T20:28:21.774 INFO:tasks.rados.rados.0.trial188.stdout:3841: left oid 2 (ObjNum 1337 snap 397 seq_num 1337) 2026-02-13T20:28:21.784 INFO:tasks.rados.rados.0.trial188.stdout:3843: finishing write tid 1 to trial18843701-49 2026-02-13T20:28:21.784 INFO:tasks.rados.rados.0.trial188.stdout:3843: finishing write tid 2 to trial18843701-49 2026-02-13T20:28:21.784 INFO:tasks.rados.rados.0.trial188.stdout:3843: finishing write tid 3 to trial18843701-49 2026-02-13T20:28:21.786 INFO:tasks.rados.rados.0.trial188.stdout:3843: finishing write tid 4 to trial18843701-49 2026-02-13T20:28:21.786 INFO:tasks.rados.rados.0.trial188.stdout:3843: finishing write tid 5 to trial18843701-49 2026-02-13T20:28:21.786 INFO:tasks.rados.rados.0.trial188.stdout:3843: oid 49 updating version 0 to 1865 2026-02-13T20:28:21.786 INFO:tasks.rados.rados.0.trial188.stdout:3843: oid 49 version 1865 is already newer than 1863 2026-02-13T20:28:21.786 INFO:tasks.rados.rados.0.trial188.stdout:3843: oid 49 updating version 1865 to 1866 2026-02-13T20:28:21.786 INFO:tasks.rados.rados.0.trial188.stdout:3843: oid 49 version 1866 is already newer than 1864 2026-02-13T20:28:21.786 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 49 v 1866 (ObjNum 1339 snap 397 seq_num 1339) dirty exists 2026-02-13T20:28:21.786 INFO:tasks.rados.rados.0.trial188.stdout:3843: left oid 49 (ObjNum 1339 snap 397 seq_num 1339) 2026-02-13T20:28:21.786 INFO:tasks.rados.rados.0.trial188.stdout:3841: done (2 left) 2026-02-13T20:28:21.786 INFO:tasks.rados.rados.0.trial188.stdout:3843: done (1 left) 2026-02-13T20:28:21.787 INFO:tasks.rados.rados.0.trial188.stdout:3844: done (0 left) 2026-02-13T20:28:21.787 INFO:tasks.rados.rados.0.trial188.stdout:3845: write oid 22 current snap is 397 2026-02-13T20:28:21.787 INFO:tasks.rados.rados.0.trial188.stdout:3845: seq_num 1341 ranges {538187=587037,1538706=602473} 2026-02-13T20:28:21.790 INFO:tasks.rados.rados.0.trial188.stdout:3845: writing trial18843701-22 from 538187 to 1125224 tid 1 2026-02-13T20:28:21.794 INFO:tasks.rados.rados.0.trial188.stdout:3845: writing trial18843701-22 from 1538706 to 2141179 tid 2 2026-02-13T20:28:21.794 INFO:tasks.rados.rados.0.trial188.stdout:3846: delete oid 38 current snap is 397 2026-02-13T20:28:21.795 INFO:tasks.rados.rados.0.trial188.stdout:3846: done (1 left) 2026-02-13T20:28:21.795 INFO:tasks.rados.rados.0.trial188.stdout:3847: write (excl) oid 33 current snap is 397 2026-02-13T20:28:21.795 INFO:tasks.rados.rados.0.trial188.stdout:3847: seq_num 1343 ranges {571801=737535,1939317=489789} 2026-02-13T20:28:21.800 INFO:tasks.rados.rados.0.trial188.stdout:3847: writing trial18843701-33 from 571801 to 1309336 tid 1 2026-02-13T20:28:21.804 INFO:tasks.rados.rados.0.trial188.stdout:3847: writing trial18843701-33 from 1939317 to 2429106 tid 2 2026-02-13T20:28:21.804 INFO:tasks.rados.rados.0.trial188.stdout:3848: snap_create 2026-02-13T20:28:21.807 INFO:tasks.rados.rados.0.trial188.stdout:3845: finishing write tid 1 to trial18843701-22 2026-02-13T20:28:21.807 INFO:tasks.rados.rados.0.trial188.stdout:3845: finishing write tid 2 to trial18843701-22 2026-02-13T20:28:21.807 INFO:tasks.rados.rados.0.trial188.stdout:3845: finishing write tid 3 to trial18843701-22 2026-02-13T20:28:21.807 INFO:tasks.rados.rados.0.trial188.stdout:3845: finishing write tid 4 to trial18843701-22 2026-02-13T20:28:21.807 INFO:tasks.rados.rados.0.trial188.stdout:3845: oid 22 updating version 0 to 1808 2026-02-13T20:28:21.808 INFO:tasks.rados.rados.0.trial188.stdout:3845: oid 22 updating version 1808 to 1810 2026-02-13T20:28:21.808 INFO:tasks.rados.rados.0.trial188.stdout:3845: oid 22 version 1810 is already newer than 1809 2026-02-13T20:28:21.808 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 22 v 1810 (ObjNum 1341 snap 397 seq_num 1341) dirty exists 2026-02-13T20:28:21.808 INFO:tasks.rados.rados.0.trial188.stdout:3845: left oid 22 (ObjNum 1341 snap 397 seq_num 1341) 2026-02-13T20:28:21.824 INFO:tasks.rados.rados.0.trial188.stdout:3847: finishing write tid 1 to trial18843701-33 2026-02-13T20:28:21.825 INFO:tasks.rados.rados.0.trial188.stdout:3847: finishing write tid 2 to trial18843701-33 2026-02-13T20:28:21.825 INFO:tasks.rados.rados.0.trial188.stdout:3847: finishing write tid 3 to trial18843701-33 2026-02-13T20:28:21.825 INFO:tasks.rados.rados.0.trial188.stdout:3847: finishing write tid 4 to trial18843701-33 2026-02-13T20:28:21.825 INFO:tasks.rados.rados.0.trial188.stdout:3847: oid 33 updating version 0 to 1740 2026-02-13T20:28:21.825 INFO:tasks.rados.rados.0.trial188.stdout:3847: oid 33 updating version 1740 to 1741 2026-02-13T20:28:21.825 INFO:tasks.rados.rados.0.trial188.stdout:3847: oid 33 updating version 1741 to 1742 2026-02-13T20:28:21.825 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 33 v 1742 (ObjNum 1343 snap 397 seq_num 1343) dirty exists 2026-02-13T20:28:21.826 INFO:tasks.rados.rados.0.trial188.stdout:3847: left oid 33 (ObjNum 1343 snap 397 seq_num 1343) 2026-02-13T20:28:22.753 INFO:tasks.rados.rados.0.trial188.stdout:3845: done (2 left) 2026-02-13T20:28:22.753 INFO:tasks.rados.rados.0.trial188.stdout:3847: done (1 left) 2026-02-13T20:28:22.753 INFO:tasks.rados.rados.0.trial188.stdout:3848: done (0 left) 2026-02-13T20:28:22.753 INFO:tasks.rados.rados.0.trial188.stdout:3849: read oid 7 snap -1 2026-02-13T20:28:22.753 INFO:tasks.rados.rados.0.trial188.stdout:3849: expect deleted 2026-02-13T20:28:22.753 INFO:tasks.rados.rados.0.trial188.stdout:3850: read oid 50 snap 365 2026-02-13T20:28:22.753 INFO:tasks.rados.rados.0.trial188.stdout:3850: expect (ObjNum 1182 snap 362 seq_num 1182) 2026-02-13T20:28:22.753 INFO:tasks.rados.rados.0.trial188.stdout:3851: read oid 30 snap -1 2026-02-13T20:28:22.753 INFO:tasks.rados.rados.0.trial188.stdout:3851: expect deleted 2026-02-13T20:28:22.754 INFO:tasks.rados.rados.0.trial188.stdout:3852: snap_remove snap 396 2026-02-13T20:28:23.754 INFO:tasks.rados.rados.0.trial188.stdout:3852: done (3 left) 2026-02-13T20:28:23.754 INFO:tasks.rados.rados.0.trial188.stdout:3853: read oid 19 snap -1 2026-02-13T20:28:23.754 INFO:tasks.rados.rados.0.trial188.stdout:3853: expect (ObjNum 1272 snap 384 seq_num 1272) 2026-02-13T20:28:23.754 INFO:tasks.rados.rados.0.trial188.stdout:3854: read oid 16 snap 365 2026-02-13T20:28:23.754 INFO:tasks.rados.rados.0.trial188.stdout:3854: expect (ObjNum 1121 snap 334 seq_num 1121) 2026-02-13T20:28:23.754 INFO:tasks.rados.rados.0.trial188.stdout:3855: read oid 4 snap 397 2026-02-13T20:28:23.754 INFO:tasks.rados.rados.0.trial188.stdout:3855: expect (ObjNum 1248 snap 375 seq_num 1248) 2026-02-13T20:28:23.755 INFO:tasks.rados.rados.0.trial188.stdout:3856: snap_create 2026-02-13T20:28:23.755 INFO:tasks.rados.rados.0.trial188.stdout:3850: expect (ObjNum 1182 snap 362 seq_num 1182) 2026-02-13T20:28:23.755 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 555794 2026-02-13T20:28:23.844 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:28:23.894 INFO:tasks.rados.rados.0.trial188.stdout:3854: expect (ObjNum 1121 snap 334 seq_num 1121) 2026-02-13T20:28:23.894 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:28:23.964 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:28:24.004 INFO:tasks.rados.rados.0.trial188.stdout:3853: expect (ObjNum 1272 snap 384 seq_num 1272) 2026-02-13T20:28:24.005 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:28:24.133 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 3250159 2026-02-13T20:28:24.133 INFO:tasks.rados.rados.0.trial188.stdout:3855: expect (ObjNum 1248 snap 375 seq_num 1248) 2026-02-13T20:28:24.146 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:28:24.757 INFO:tasks.rados.rados.0.trial188.stdout:3849: done (6 left) 2026-02-13T20:28:24.758 INFO:tasks.rados.rados.0.trial188.stdout:3850: done (5 left) 2026-02-13T20:28:24.758 INFO:tasks.rados.rados.0.trial188.stdout:3851: done (4 left) 2026-02-13T20:28:24.758 INFO:tasks.rados.rados.0.trial188.stdout:3853: done (3 left) 2026-02-13T20:28:24.758 INFO:tasks.rados.rados.0.trial188.stdout:3854: done (2 left) 2026-02-13T20:28:24.758 INFO:tasks.rados.rados.0.trial188.stdout:3855: done (1 left) 2026-02-13T20:28:24.758 INFO:tasks.rados.rados.0.trial188.stdout:3856: done (0 left) 2026-02-13T20:28:24.758 INFO:tasks.rados.rados.0.trial188.stdout:3857: write (excl) oid 30 current snap is 399 2026-02-13T20:28:24.758 INFO:tasks.rados.rados.0.trial188.stdout:3857: seq_num 1344 ranges {588608=412784,1597799=749800} 2026-02-13T20:28:24.761 INFO:tasks.rados.rados.0.trial188.stdout:3857: writing trial18843701-30 from 588608 to 1001392 tid 1 2026-02-13T20:28:24.767 INFO:tasks.rados.rados.0.trial188.stdout:3857: writing trial18843701-30 from 1597799 to 2347599 tid 2 2026-02-13T20:28:24.767 INFO:tasks.rados.rados.0.trial188.stdout:3858: delete oid 29 current snap is 399 2026-02-13T20:28:24.769 INFO:tasks.rados.rados.0.trial188.stdout:3858: done (1 left) 2026-02-13T20:28:24.769 INFO:tasks.rados.rados.0.trial188.stdout:3859: read oid 42 snap 397 2026-02-13T20:28:24.769 INFO:tasks.rados.rados.0.trial188.stdout:3859: expect (ObjNum 1318 snap 393 seq_num 1318) 2026-02-13T20:28:24.769 INFO:tasks.rados.rados.0.trial188.stdout:3860: read oid 26 snap -1 2026-02-13T20:28:24.770 INFO:tasks.rados.rados.0.trial188.stdout:3860: expect deleted 2026-02-13T20:28:24.770 INFO:tasks.rados.rados.0.trial188.stdout:3861: snap_create 2026-02-13T20:28:24.779 INFO:tasks.rados.rados.0.trial188.stdout:3857: finishing write tid 1 to trial18843701-30 2026-02-13T20:28:24.781 INFO:tasks.rados.rados.0.trial188.stdout:3857: finishing write tid 2 to trial18843701-30 2026-02-13T20:28:24.781 INFO:tasks.rados.rados.0.trial188.stdout:3857: finishing write tid 3 to trial18843701-30 2026-02-13T20:28:24.781 INFO:tasks.rados.rados.0.trial188.stdout:3859: expect (ObjNum 1318 snap 393 seq_num 1318) 2026-02-13T20:28:24.781 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:28:24.844 INFO:tasks.rados.rados.0.trial188.stdout:3857: finishing write tid 4 to trial18843701-30 2026-02-13T20:28:24.844 INFO:tasks.rados.rados.0.trial188.stdout:3857: oid 30 updating version 0 to 1877 2026-02-13T20:28:24.844 INFO:tasks.rados.rados.0.trial188.stdout:3857: oid 30 updating version 1877 to 1878 2026-02-13T20:28:24.844 INFO:tasks.rados.rados.0.trial188.stdout:3857: oid 30 updating version 1878 to 1879 2026-02-13T20:28:24.844 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 30 v 1879 (ObjNum 1344 snap 399 seq_num 1344) dirty exists 2026-02-13T20:28:24.844 INFO:tasks.rados.rados.0.trial188.stdout:3857: left oid 30 (ObjNum 1344 snap 399 seq_num 1344) 2026-02-13T20:28:25.736 INFO:tasks.rados.rados.0.trial188.stdout:3857: done (3 left) 2026-02-13T20:28:25.736 INFO:tasks.rados.rados.0.trial188.stdout:3859: done (2 left) 2026-02-13T20:28:25.736 INFO:tasks.rados.rados.0.trial188.stdout:3860: done (1 left) 2026-02-13T20:28:25.736 INFO:tasks.rados.rados.0.trial188.stdout:3861: done (0 left) 2026-02-13T20:28:25.737 INFO:tasks.rados.rados.0.trial188.stdout:3862: snap_remove snap 397 2026-02-13T20:28:26.739 INFO:tasks.rados.rados.0.trial188.stdout:3862: done (0 left) 2026-02-13T20:28:26.739 INFO:tasks.rados.rados.0.trial188.stdout:3863: copy_from oid 34 from oid 24 current snap is 400 2026-02-13T20:28:26.739 INFO:tasks.rados.rados.0.trial188.stdout:3864: read oid 39 snap -1 2026-02-13T20:28:26.739 INFO:tasks.rados.rados.0.trial188.stdout:3864: expect deleted 2026-02-13T20:28:26.739 INFO:tasks.rados.rados.0.trial188.stdout:3865: rollback oid 31 current snap is 400 2026-02-13T20:28:26.739 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 31 to 365 2026-02-13T20:28:26.739 INFO:tasks.rados.rados.0.trial188.stdout:3866: snap_create 2026-02-13T20:28:26.740 INFO:tasks.rados.rados.0.trial188.stdout:3863: finishing copy_from to trial18843701-34 2026-02-13T20:28:26.740 INFO:tasks.rados.rados.0.trial188.stdout:3863: got expected ENOENT (src dne) 2026-02-13T20:28:26.740 INFO:tasks.rados.rados.0.trial188.stdout:3863: finishing copy_from racing read to trial18843701-34 2026-02-13T20:28:26.742 INFO:tasks.rados.rados.0.trial188.stdout:3865: finishing rollback tid 0 to trial18843701-31 2026-02-13T20:28:26.742 INFO:tasks.rados.rados.0.trial188.stdout:3865: finishing rollback tid 1 to trial18843701-31 2026-02-13T20:28:26.742 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 31 v 1581 (ObjNum 225 snap 0 seq_num 16249712) dirty dne 2026-02-13T20:28:27.739 INFO:tasks.rados.rados.0.trial188.stdout:3863: done (3 left) 2026-02-13T20:28:27.740 INFO:tasks.rados.rados.0.trial188.stdout:3864: done (2 left) 2026-02-13T20:28:27.740 INFO:tasks.rados.rados.0.trial188.stdout:3865: done (1 left) 2026-02-13T20:28:27.740 INFO:tasks.rados.rados.0.trial188.stdout:3866: done (0 left) 2026-02-13T20:28:27.740 INFO:tasks.rados.rados.0.trial188.stdout:3867: read oid 29 snap 399 2026-02-13T20:28:27.740 INFO:tasks.rados.rados.0.trial188.stdout:3867: expect deleted 2026-02-13T20:28:27.740 INFO:tasks.rados.rados.0.trial188.stdout:3868: snap_remove snap 389 2026-02-13T20:28:28.743 INFO:tasks.rados.rados.0.trial188.stdout:3868: done (1 left) 2026-02-13T20:28:28.743 INFO:tasks.rados.rados.0.trial188.stdout:3869: copy_from oid 24 from oid 23 current snap is 401 2026-02-13T20:28:28.743 INFO:tasks.rados.rados.0.trial188.stdout:3867: done (1 left) 2026-02-13T20:28:28.743 INFO:tasks.rados.rados.0.trial188.stdout:3870: read oid 19 snap -1 2026-02-13T20:28:28.743 INFO:tasks.rados.rados.0.trial188.stdout:3870: expect (ObjNum 1272 snap 384 seq_num 1272) 2026-02-13T20:28:28.743 INFO:tasks.rados.rados.0.trial188.stdout:3871: write (excl) oid 41 current snap is 401 2026-02-13T20:28:28.744 INFO:tasks.rados.rados.0.trial188.stdout:3871: seq_num 1346 ranges {622222=679635,1831116=753469} 2026-02-13T20:28:28.748 INFO:tasks.rados.rados.0.trial188.stdout:3871: writing trial18843701-41 from 622222 to 1301857 tid 1 2026-02-13T20:28:28.753 INFO:tasks.rados.rados.0.trial188.stdout:3871: writing trial18843701-41 from 1831116 to 2584585 tid 2 2026-02-13T20:28:28.753 INFO:tasks.rados.rados.0.trial188.stdout:3872: read oid 20 snap -1 2026-02-13T20:28:28.753 INFO:tasks.rados.rados.0.trial188.stdout:3872: expect (ObjNum 1330 snap 396 seq_num 1330) 2026-02-13T20:28:28.753 INFO:tasks.rados.rados.0.trial188.stdout:3873: read oid 16 snap -1 2026-02-13T20:28:28.754 INFO:tasks.rados.rados.0.trial188.stdout:3873: expect deleted 2026-02-13T20:28:28.754 INFO:tasks.rados.rados.0.trial188.stdout:3874: rollback oid 32 current snap is 401 2026-02-13T20:28:28.754 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 32 to 365 2026-02-13T20:28:28.754 INFO:tasks.rados.rados.0.trial188.stdout:3870: expect (ObjNum 1272 snap 384 seq_num 1272) 2026-02-13T20:28:28.754 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 267705 2026-02-13T20:28:28.822 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1840517 2026-02-13T20:28:28.839 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:28:28.884 INFO:tasks.rados.rados.0.trial188.stdout:3872: expect (ObjNum 1330 snap 396 seq_num 1330) 2026-02-13T20:28:28.941 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2325570 2026-02-13T20:28:28.942 INFO:tasks.rados.rados.0.trial188.stdout:3871: finishing write tid 1 to trial18843701-41 2026-02-13T20:28:28.942 INFO:tasks.rados.rados.0.trial188.stdout:3871: finishing write tid 2 to trial18843701-41 2026-02-13T20:28:28.942 INFO:tasks.rados.rados.0.trial188.stdout:3870: done (5 left) 2026-02-13T20:28:28.942 INFO:tasks.rados.rados.0.trial188.stdout:3872: done (4 left) 2026-02-13T20:28:28.942 INFO:tasks.rados.rados.0.trial188.stdout:3875: delete oid 13 current snap is 401 2026-02-13T20:28:28.942 INFO:tasks.rados.rados.0.trial188.stdout:3871: finishing write tid 3 to trial18843701-41 2026-02-13T20:28:28.942 INFO:tasks.rados.rados.0.trial188.stdout:3871: finishing write tid 4 to trial18843701-41 2026-02-13T20:28:28.942 INFO:tasks.rados.rados.0.trial188.stdout:3871: oid 41 updating version 0 to 1766 2026-02-13T20:28:28.942 INFO:tasks.rados.rados.0.trial188.stdout:3871: oid 41 updating version 1766 to 1768 2026-02-13T20:28:28.942 INFO:tasks.rados.rados.0.trial188.stdout:3871: oid 41 version 1768 is already newer than 1767 2026-02-13T20:28:28.942 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 41 v 1768 (ObjNum 1346 snap 401 seq_num 1346) dirty exists 2026-02-13T20:28:28.943 INFO:tasks.rados.rados.0.trial188.stdout:3871: left oid 41 (ObjNum 1346 snap 401 seq_num 1346) 2026-02-13T20:28:28.943 INFO:tasks.rados.rados.0.trial188.stdout:3874: finishing rollback tid 1 to trial18843701-32 2026-02-13T20:28:28.943 INFO:tasks.rados.rados.0.trial188.stdout:3874: finishing rollback tid 2 to trial18843701-32 2026-02-13T20:28:28.943 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 32 v 1770 (ObjNum 1181 snap 360 seq_num 1181) dirty exists 2026-02-13T20:28:28.943 INFO:tasks.rados.rados.0.trial188.stdout:3869: finishing copy_from racing read to trial18843701-24 2026-02-13T20:28:28.943 INFO:tasks.rados.rados.0.trial188.stdout:3869: finishing copy_from to trial18843701-24 2026-02-13T20:28:28.943 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 24 v 1482 (ObjNum 1161 snap 354 seq_num 1161) dirty exists 2026-02-13T20:28:28.944 INFO:tasks.rados.rados.0.trial188.stdout:3869: done (4 left) 2026-02-13T20:28:28.944 INFO:tasks.rados.rados.0.trial188.stdout:3871: done (3 left) 2026-02-13T20:28:28.944 INFO:tasks.rados.rados.0.trial188.stdout:3873: done (2 left) 2026-02-13T20:28:28.944 INFO:tasks.rados.rados.0.trial188.stdout:3874: done (1 left) 2026-02-13T20:28:28.944 INFO:tasks.rados.rados.0.trial188.stdout:3875: done (0 left) 2026-02-13T20:28:28.944 INFO:tasks.rados.rados.0.trial188.stdout:3876: copy_from oid 44 from oid 35 current snap is 401 2026-02-13T20:28:28.944 INFO:tasks.rados.rados.0.trial188.stdout:3877: snap_remove snap 400 2026-02-13T20:28:29.747 INFO:tasks.rados.rados.0.trial188.stdout:3877: done (1 left) 2026-02-13T20:28:29.748 INFO:tasks.rados.rados.0.trial188.stdout:3878: read oid 17 snap -1 2026-02-13T20:28:29.748 INFO:tasks.rados.rados.0.trial188.stdout:3878: expect (ObjNum 1291 snap 384 seq_num 1291) 2026-02-13T20:28:29.748 INFO:tasks.rados.rados.0.trial188.stdout:3879: read oid 6 snap -1 2026-02-13T20:28:29.748 INFO:tasks.rados.rados.0.trial188.stdout:3879: expect (ObjNum 1278 snap 384 seq_num 1278) 2026-02-13T20:28:29.748 INFO:tasks.rados.rados.0.trial188.stdout:3880: rollback oid 21 current snap is 401 2026-02-13T20:28:29.748 INFO:tasks.rados.rados.0.trial188.stdout:3876: finishing copy_from racing read to trial18843701-44 2026-02-13T20:28:29.748 INFO:tasks.rados.rados.0.trial188.stdout:3876: finishing copy_from to trial18843701-44 2026-02-13T20:28:29.748 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 44 v 1582 (ObjNum 1320 snap 393 seq_num 1320) dirty exists 2026-02-13T20:28:29.748 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 21 to 384 2026-02-13T20:28:29.748 INFO:tasks.rados.rados.0.trial188.stdout:3876: done (3 left) 2026-02-13T20:28:29.749 INFO:tasks.rados.rados.0.trial188.stdout:3881: snap_remove snap 398 2026-02-13T20:28:30.738 INFO:tasks.rados.rados.0.trial188.stdout:3881: done (3 left) 2026-02-13T20:28:30.739 INFO:tasks.rados.rados.0.trial188.stdout:3882: write oid 32 current snap is 401 2026-02-13T20:28:30.739 INFO:tasks.rados.rados.0.trial188.stdout:3882: seq_num 1348 ranges {655836=430133,1831727=757138} 2026-02-13T20:28:30.743 INFO:tasks.rados.rados.0.trial188.stdout:3882: writing trial18843701-32 from 655836 to 1085969 tid 1 2026-02-13T20:28:30.749 INFO:tasks.rados.rados.0.trial188.stdout:3882: writing trial18843701-32 from 1831727 to 2588865 tid 2 2026-02-13T20:28:30.750 INFO:tasks.rados.rados.0.trial188.stdout:3883: copy_from oid 41 from oid 19 current snap is 401 2026-02-13T20:28:30.750 INFO:tasks.rados.rados.0.trial188.stdout:3880: finishing rollback tid 0 to trial18843701-21 2026-02-13T20:28:30.750 INFO:tasks.rados.rados.0.trial188.stdout:3884: read oid 30 snap -1 2026-02-13T20:28:30.750 INFO:tasks.rados.rados.0.trial188.stdout:3884: expect (ObjNum 1344 snap 399 seq_num 1344) 2026-02-13T20:28:30.750 INFO:tasks.rados.rados.0.trial188.stdout:3885: write (excl) oid 10 current snap is 401 2026-02-13T20:28:30.750 INFO:tasks.rados.rados.0.trial188.stdout:3879: expect (ObjNum 1278 snap 384 seq_num 1278) 2026-02-13T20:28:30.750 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:28:30.778 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1057436 2026-02-13T20:28:30.808 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 3374215 2026-02-13T20:28:30.809 INFO:tasks.rados.rados.0.trial188.stdout:3880: finishing rollback tid 1 to trial18843701-21 2026-02-13T20:28:30.809 INFO:tasks.rados.rados.0.trial188.stdout:3880: finishing rollback tid 2 to trial18843701-21 2026-02-13T20:28:30.809 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 21 v 1794 (ObjNum 1238 snap 375 seq_num 1238) dirty exists 2026-02-13T20:28:30.809 INFO:tasks.rados.rados.0.trial188.stdout:3878: expect (ObjNum 1291 snap 384 seq_num 1291) 2026-02-13T20:28:30.871 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:28:30.931 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:28:30.992 INFO:tasks.rados.rados.0.trial188.stdout:3884: expect (ObjNum 1344 snap 399 seq_num 1344) 2026-02-13T20:28:31.000 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2160677 2026-02-13T20:28:31.011 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2049562 2026-02-13T20:28:31.034 INFO:tasks.rados.rados.0.trial188.stdout:3882: finishing write tid 1 to trial18843701-32 2026-02-13T20:28:31.034 INFO:tasks.rados.rados.0.trial188.stdout:3882: finishing write tid 2 to trial18843701-32 2026-02-13T20:28:31.034 INFO:tasks.rados.rados.0.trial188.stdout:3883: finishing copy_from racing read to trial18843701-41 2026-02-13T20:28:31.034 INFO:tasks.rados.rados.0.trial188.stdout:3882: finishing write tid 3 to trial18843701-32 2026-02-13T20:28:31.034 INFO:tasks.rados.rados.0.trial188.stdout:3882: finishing write tid 4 to trial18843701-32 2026-02-13T20:28:31.034 INFO:tasks.rados.rados.0.trial188.stdout:3882: oid 32 updating version 0 to 1773 2026-02-13T20:28:31.034 INFO:tasks.rados.rados.0.trial188.stdout:3882: oid 32 version 1773 is already newer than 1772 2026-02-13T20:28:31.034 INFO:tasks.rados.rados.0.trial188.stdout:3882: oid 32 version 1773 is already newer than 1771 2026-02-13T20:28:31.034 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 32 v 1773 (ObjNum 1348 snap 401 seq_num 1348) dirty exists 2026-02-13T20:28:31.034 INFO:tasks.rados.rados.0.trial188.stdout:3882: left oid 32 (ObjNum 1348 snap 401 seq_num 1348) 2026-02-13T20:28:31.035 INFO:tasks.rados.rados.0.trial188.stdout:3883: finishing copy_from to trial18843701-41 2026-02-13T20:28:31.035 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 41 v 1751 (ObjNum 1272 snap 384 seq_num 1272) dirty exists 2026-02-13T20:28:31.035 INFO:tasks.rados.rados.0.trial188.stdout:3885: seq_num 1349 ranges {672643=505382,1890209=500796} 2026-02-13T20:28:31.038 INFO:tasks.rados.rados.0.trial188.stdout:3885: writing trial18843701-10 from 672643 to 1178025 tid 1 2026-02-13T20:28:31.043 INFO:tasks.rados.rados.0.trial188.stdout:3885: writing trial18843701-10 from 1890209 to 2391005 tid 2 2026-02-13T20:28:31.043 INFO:tasks.rados.rados.0.trial188.stdout:3878: done (6 left) 2026-02-13T20:28:31.043 INFO:tasks.rados.rados.0.trial188.stdout:3879: done (5 left) 2026-02-13T20:28:31.043 INFO:tasks.rados.rados.0.trial188.stdout:3880: done (4 left) 2026-02-13T20:28:31.043 INFO:tasks.rados.rados.0.trial188.stdout:3882: done (3 left) 2026-02-13T20:28:31.044 INFO:tasks.rados.rados.0.trial188.stdout:3883: done (2 left) 2026-02-13T20:28:31.044 INFO:tasks.rados.rados.0.trial188.stdout:3884: done (1 left) 2026-02-13T20:28:31.044 INFO:tasks.rados.rados.0.trial188.stdout:3886: write oid 6 current snap is 401 2026-02-13T20:28:31.044 INFO:tasks.rados.rados.0.trial188.stdout:3886: seq_num 1350 ranges {689450=580631,1948691=740759} 2026-02-13T20:28:31.048 INFO:tasks.rados.rados.0.trial188.stdout:3886: writing trial18843701-6 from 689450 to 1270081 tid 1 2026-02-13T20:28:31.053 INFO:tasks.rados.rados.0.trial188.stdout:3886: writing trial18843701-6 from 1948691 to 2689450 tid 2 2026-02-13T20:28:31.054 INFO:tasks.rados.rados.0.trial188.stdout:3887: copy_from oid 37 from oid 8 current snap is 401 2026-02-13T20:28:31.054 INFO:tasks.rados.rados.0.trial188.stdout:3888: rollback oid 16 current snap is 401 2026-02-13T20:28:31.054 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 16 to 399 2026-02-13T20:28:31.054 INFO:tasks.rados.rados.0.trial188.stdout:3889: read oid 43 snap -1 2026-02-13T20:28:31.054 INFO:tasks.rados.rados.0.trial188.stdout:3889: expect (ObjNum 1326 snap 395 seq_num 1326) 2026-02-13T20:28:31.054 INFO:tasks.rados.rados.0.trial188.stdout:3890: snap_create 2026-02-13T20:28:31.056 INFO:tasks.rados.rados.0.trial188.stdout:3885: finishing write tid 1 to trial18843701-10 2026-02-13T20:28:31.058 INFO:tasks.rados.rados.0.trial188.stdout:3889: expect (ObjNum 1326 snap 395 seq_num 1326) 2026-02-13T20:28:31.059 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:28:31.151 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1676753 2026-02-13T20:28:31.167 INFO:tasks.rados.rados.0.trial188.stdout:3885: finishing write tid 2 to trial18843701-10 2026-02-13T20:28:31.167 INFO:tasks.rados.rados.0.trial188.stdout:3885: finishing write tid 3 to trial18843701-10 2026-02-13T20:28:31.167 INFO:tasks.rados.rados.0.trial188.stdout:3885: finishing write tid 4 to trial18843701-10 2026-02-13T20:28:31.167 INFO:tasks.rados.rados.0.trial188.stdout:3885: oid 10 updating version 0 to 1698 2026-02-13T20:28:31.168 INFO:tasks.rados.rados.0.trial188.stdout:3885: oid 10 updating version 1698 to 1700 2026-02-13T20:28:31.168 INFO:tasks.rados.rados.0.trial188.stdout:3885: oid 10 version 1700 is already newer than 1699 2026-02-13T20:28:31.168 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 10 v 1700 (ObjNum 1349 snap 401 seq_num 1349) dirty exists 2026-02-13T20:28:31.168 INFO:tasks.rados.rados.0.trial188.stdout:3885: left oid 10 (ObjNum 1349 snap 401 seq_num 1349) 2026-02-13T20:28:31.168 INFO:tasks.rados.rados.0.trial188.stdout:3886: finishing write tid 1 to trial18843701-6 2026-02-13T20:28:31.168 INFO:tasks.rados.rados.0.trial188.stdout:3886: finishing write tid 2 to trial18843701-6 2026-02-13T20:28:31.168 INFO:tasks.rados.rados.0.trial188.stdout:3886: finishing write tid 3 to trial18843701-6 2026-02-13T20:28:31.168 INFO:tasks.rados.rados.0.trial188.stdout:3886: finishing write tid 4 to trial18843701-6 2026-02-13T20:28:31.168 INFO:tasks.rados.rados.0.trial188.stdout:3886: oid 6 updating version 0 to 1966 2026-02-13T20:28:31.168 INFO:tasks.rados.rados.0.trial188.stdout:3886: oid 6 updating version 1966 to 1967 2026-02-13T20:28:31.168 INFO:tasks.rados.rados.0.trial188.stdout:3886: oid 6 updating version 1967 to 1968 2026-02-13T20:28:31.168 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 6 v 1968 (ObjNum 1350 snap 401 seq_num 1350) dirty exists 2026-02-13T20:28:31.169 INFO:tasks.rados.rados.0.trial188.stdout:3886: left oid 6 (ObjNum 1350 snap 401 seq_num 1350) 2026-02-13T20:28:31.169 INFO:tasks.rados.rados.0.trial188.stdout:3888: finishing rollback tid 1 to trial18843701-16 2026-02-13T20:28:31.169 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 16 v 1913 (ObjNum 289 snap 0 seq_num 1) dirty dne 2026-02-13T20:28:31.169 INFO:tasks.rados.rados.0.trial188.stdout:3887: finishing copy_from racing read to trial18843701-37 2026-02-13T20:28:31.169 INFO:tasks.rados.rados.0.trial188.stdout:3887: finishing copy_from to trial18843701-37 2026-02-13T20:28:31.169 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 37 v 1922 (ObjNum 1333 snap 396 seq_num 1333) dirty exists 2026-02-13T20:28:31.752 INFO:tasks.rados.rados.0.trial188.stdout:3885: done (5 left) 2026-02-13T20:28:31.752 INFO:tasks.rados.rados.0.trial188.stdout:3886: done (4 left) 2026-02-13T20:28:31.752 INFO:tasks.rados.rados.0.trial188.stdout:3887: done (3 left) 2026-02-13T20:28:31.752 INFO:tasks.rados.rados.0.trial188.stdout:3888: done (2 left) 2026-02-13T20:28:31.752 INFO:tasks.rados.rados.0.trial188.stdout:3889: done (1 left) 2026-02-13T20:28:31.752 INFO:tasks.rados.rados.0.trial188.stdout:3890: done (0 left) 2026-02-13T20:28:31.752 INFO:tasks.rados.rados.0.trial188.stdout:3891: write oid 31 current snap is 402 2026-02-13T20:28:31.752 INFO:tasks.rados.rados.0.trial188.stdout:3891: seq_num 1351 ranges {706257=655880,1890820=504465} 2026-02-13T20:28:31.756 INFO:tasks.rados.rados.0.trial188.stdout:3891: writing trial18843701-31 from 706257 to 1362137 tid 1 2026-02-13T20:28:31.760 INFO:tasks.rados.rados.0.trial188.stdout:3891: writing trial18843701-31 from 1890820 to 2395285 tid 2 2026-02-13T20:28:31.760 INFO:tasks.rados.rados.0.trial188.stdout:3892: delete oid 10 current snap is 402 2026-02-13T20:28:31.773 INFO:tasks.rados.rados.0.trial188.stdout:3891: finishing write tid 1 to trial18843701-31 2026-02-13T20:28:31.773 INFO:tasks.rados.rados.0.trial188.stdout:3891: finishing write tid 2 to trial18843701-31 2026-02-13T20:28:31.773 INFO:tasks.rados.rados.0.trial188.stdout:3891: finishing write tid 3 to trial18843701-31 2026-02-13T20:28:31.773 INFO:tasks.rados.rados.0.trial188.stdout:3891: finishing write tid 4 to trial18843701-31 2026-02-13T20:28:31.774 INFO:tasks.rados.rados.0.trial188.stdout:3891: oid 31 updating version 0 to 1583 2026-02-13T20:28:31.774 INFO:tasks.rados.rados.0.trial188.stdout:3891: oid 31 updating version 1583 to 1584 2026-02-13T20:28:31.774 INFO:tasks.rados.rados.0.trial188.stdout:3891: oid 31 version 1584 is already newer than 1582 2026-02-13T20:28:31.774 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 31 v 1584 (ObjNum 1351 snap 402 seq_num 1351) dirty exists 2026-02-13T20:28:31.774 INFO:tasks.rados.rados.0.trial188.stdout:3891: left oid 31 (ObjNum 1351 snap 402 seq_num 1351) 2026-02-13T20:28:31.775 INFO:tasks.rados.rados.0.trial188.stdout:3891: done (1 left) 2026-02-13T20:28:31.775 INFO:tasks.rados.rados.0.trial188.stdout:3892: done (0 left) 2026-02-13T20:28:31.775 INFO:tasks.rados.rados.0.trial188.stdout:3893: copy_from oid 2 from oid 23 current snap is 402 2026-02-13T20:28:31.775 INFO:tasks.rados.rados.0.trial188.stdout:3894: snap_create 2026-02-13T20:28:31.818 INFO:tasks.rados.rados.0.trial188.stdout:3893: finishing copy_from racing read to trial18843701-2 2026-02-13T20:28:31.819 INFO:tasks.rados.rados.0.trial188.stdout:3893: finishing copy_from to trial18843701-2 2026-02-13T20:28:31.820 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 2 v 1482 (ObjNum 1161 snap 354 seq_num 1161) dirty exists 2026-02-13T20:28:32.757 INFO:tasks.rados.rados.0.trial188.stdout:3893: done (1 left) 2026-02-13T20:28:32.757 INFO:tasks.rados.rados.0.trial188.stdout:3894: done (0 left) 2026-02-13T20:28:32.757 INFO:tasks.rados.rados.0.trial188.stdout:3895: rollback oid 25 current snap is 403 2026-02-13T20:28:32.757 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 25 to 384 2026-02-13T20:28:32.757 INFO:tasks.rados.rados.0.trial188.stdout:3896: rollback oid 17 current snap is 403 2026-02-13T20:28:32.757 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 17 to 384 2026-02-13T20:28:32.757 INFO:tasks.rados.rados.0.trial188.stdout:3897: read oid 22 snap -1 2026-02-13T20:28:32.757 INFO:tasks.rados.rados.0.trial188.stdout:3897: expect (ObjNum 1341 snap 397 seq_num 1341) 2026-02-13T20:28:32.758 INFO:tasks.rados.rados.0.trial188.stdout:3898: read oid 31 snap -1 2026-02-13T20:28:32.758 INFO:tasks.rados.rados.0.trial188.stdout:3898: expect (ObjNum 1351 snap 402 seq_num 1351) 2026-02-13T20:28:32.758 INFO:tasks.rados.rados.0.trial188.stdout:3899: snap_create 2026-02-13T20:28:32.761 INFO:tasks.rados.rados.0.trial188.stdout:3895: finishing rollback tid 0 to trial18843701-25 2026-02-13T20:28:32.762 INFO:tasks.rados.rados.0.trial188.stdout:3895: finishing rollback tid 1 to trial18843701-25 2026-02-13T20:28:32.762 INFO:tasks.rados.rados.0.trial188.stdout:3895: finishing rollback tid 2 to trial18843701-25 2026-02-13T20:28:32.762 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 25 v 1893 (ObjNum 1121 snap 334 seq_num 1121) dirty exists 2026-02-13T20:28:32.763 INFO:tasks.rados.rados.0.trial188.stdout:3897: expect (ObjNum 1341 snap 397 seq_num 1341) 2026-02-13T20:28:32.763 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:28:32.795 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:28:32.813 INFO:tasks.rados.rados.0.trial188.stdout:3898: expect (ObjNum 1351 snap 402 seq_num 1351) 2026-02-13T20:28:32.813 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:28:32.843 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:28:32.862 INFO:tasks.rados.rados.0.trial188.stdout:3896: finishing rollback tid 0 to trial18843701-17 2026-02-13T20:28:32.863 INFO:tasks.rados.rados.0.trial188.stdout:3896: finishing rollback tid 1 to trial18843701-17 2026-02-13T20:28:32.863 INFO:tasks.rados.rados.0.trial188.stdout:3896: finishing rollback tid 2 to trial18843701-17 2026-02-13T20:28:32.863 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 17 v 1758 (ObjNum 1291 snap 384 seq_num 1291) dirty exists 2026-02-13T20:28:33.758 INFO:tasks.rados.rados.0.trial188.stdout:3895: done (4 left) 2026-02-13T20:28:33.758 INFO:tasks.rados.rados.0.trial188.stdout:3896: done (3 left) 2026-02-13T20:28:33.758 INFO:tasks.rados.rados.0.trial188.stdout:3897: done (2 left) 2026-02-13T20:28:33.758 INFO:tasks.rados.rados.0.trial188.stdout:3898: done (1 left) 2026-02-13T20:28:33.758 INFO:tasks.rados.rados.0.trial188.stdout:3899: done (0 left) 2026-02-13T20:28:33.758 INFO:tasks.rados.rados.0.trial188.stdout:3900: write (excl) oid 6 current snap is 404 2026-02-13T20:28:33.758 INFO:tasks.rados.rados.0.trial188.stdout:3900: seq_num 1353 ranges {739871=406378,1607784=508134} 2026-02-13T20:28:33.762 INFO:tasks.rados.rados.0.trial188.stdout:3900: writing trial18843701-6 from 739871 to 1146249 tid 1 2026-02-13T20:28:33.767 INFO:tasks.rados.rados.0.trial188.stdout:3900: writing trial18843701-6 from 1607784 to 2115918 tid 2 2026-02-13T20:28:33.767 INFO:tasks.rados.rados.0.trial188.stdout:3901: read oid 40 snap -1 2026-02-13T20:28:33.767 INFO:tasks.rados.rados.0.trial188.stdout:3901: expect (ObjNum 1300 snap 389 seq_num 1300) 2026-02-13T20:28:33.767 INFO:tasks.rados.rados.0.trial188.stdout:3902: read oid 1 snap -1 2026-02-13T20:28:33.767 INFO:tasks.rados.rados.0.trial188.stdout:3902: expect deleted 2026-02-13T20:28:33.767 INFO:tasks.rados.rados.0.trial188.stdout:3903: read oid 29 snap -1 2026-02-13T20:28:33.767 INFO:tasks.rados.rados.0.trial188.stdout:3903: expect deleted 2026-02-13T20:28:33.767 INFO:tasks.rados.rados.0.trial188.stdout:3904: read oid 50 snap -1 2026-02-13T20:28:33.767 INFO:tasks.rados.rados.0.trial188.stdout:3904: expect (ObjNum 1238 snap 375 seq_num 1238) 2026-02-13T20:28:33.768 INFO:tasks.rados.rados.0.trial188.stdout:3905: rollback oid 11 current snap is 404 2026-02-13T20:28:33.768 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 11 to 403 2026-02-13T20:28:33.768 INFO:tasks.rados.rados.0.trial188.stdout:3906: snap_remove snap 365 2026-02-13T20:28:34.762 INFO:tasks.rados.rados.0.trial188.stdout:3906: done (6 left) 2026-02-13T20:28:34.762 INFO:tasks.rados.rados.0.trial188.stdout:3907: snap_create 2026-02-13T20:28:34.762 INFO:tasks.rados.rados.0.trial188.stdout:3905: finishing rollback tid 0 to trial18843701-11 2026-02-13T20:28:34.763 INFO:tasks.rados.rados.0.trial188.stdout:3905: finishing rollback tid 1 to trial18843701-11 2026-02-13T20:28:34.763 INFO:tasks.rados.rados.0.trial188.stdout:3905: finishing rollback tid 2 to trial18843701-11 2026-02-13T20:28:34.763 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 11 v 1704 (ObjNum 1324 snap 394 seq_num 1324) dirty exists 2026-02-13T20:28:34.763 INFO:tasks.rados.rados.0.trial188.stdout:3901: expect (ObjNum 1300 snap 389 seq_num 1300) 2026-02-13T20:28:34.777 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2492743 2026-02-13T20:28:34.859 INFO:tasks.rados.rados.0.trial188.stdout:3900: finishing write tid 1 to trial18843701-6 2026-02-13T20:28:34.859 INFO:tasks.rados.rados.0.trial188.stdout:3900: finishing write tid 2 to trial18843701-6 2026-02-13T20:28:34.860 INFO:tasks.rados.rados.0.trial188.stdout:3900: finishing write tid 3 to trial18843701-6 2026-02-13T20:28:34.860 INFO:tasks.rados.rados.0.trial188.stdout:3900: finishing write tid 4 to trial18843701-6 2026-02-13T20:28:34.860 INFO:tasks.rados.rados.0.trial188.stdout:3900: oid 6 updating version 0 to 1971 2026-02-13T20:28:34.860 INFO:tasks.rados.rados.0.trial188.stdout:3900: oid 6 updating version 1971 to 1972 2026-02-13T20:28:34.860 INFO:tasks.rados.rados.0.trial188.stdout:3900: oid 6 updating version 1972 to 1973 2026-02-13T20:28:34.860 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 6 v 1973 (ObjNum 1353 snap 404 seq_num 1353) dirty exists 2026-02-13T20:28:34.860 INFO:tasks.rados.rados.0.trial188.stdout:3900: left oid 6 (ObjNum 1353 snap 404 seq_num 1353) 2026-02-13T20:28:34.860 INFO:tasks.rados.rados.0.trial188.stdout:3904: expect (ObjNum 1238 snap 375 seq_num 1238) 2026-02-13T20:28:34.860 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:28:34.931 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2424551 2026-02-13T20:28:35.739 INFO:tasks.rados.rados.0.trial188.stdout:3900: done (6 left) 2026-02-13T20:28:35.739 INFO:tasks.rados.rados.0.trial188.stdout:3901: done (5 left) 2026-02-13T20:28:35.739 INFO:tasks.rados.rados.0.trial188.stdout:3902: done (4 left) 2026-02-13T20:28:35.739 INFO:tasks.rados.rados.0.trial188.stdout:3903: done (3 left) 2026-02-13T20:28:35.740 INFO:tasks.rados.rados.0.trial188.stdout:3904: done (2 left) 2026-02-13T20:28:35.740 INFO:tasks.rados.rados.0.trial188.stdout:3905: done (1 left) 2026-02-13T20:28:35.740 INFO:tasks.rados.rados.0.trial188.stdout:3907: done (0 left) 2026-02-13T20:28:35.740 INFO:tasks.rados.rados.0.trial188.stdout:3908: read oid 45 snap -1 2026-02-13T20:28:35.740 INFO:tasks.rados.rados.0.trial188.stdout:3908: expect (ObjNum 1228 snap 372 seq_num 1228) 2026-02-13T20:28:35.740 INFO:tasks.rados.rados.0.trial188.stdout:3909: delete oid 9 current snap is 405 2026-02-13T20:28:35.744 INFO:tasks.rados.rados.0.trial188.stdout:3909: done (1 left) 2026-02-13T20:28:35.744 INFO:tasks.rados.rados.0.trial188.stdout:3910: write oid 39 current snap is 405 2026-02-13T20:28:35.744 INFO:tasks.rados.rados.0.trial188.stdout:3910: seq_num 1355 ranges {773485=673229,2124748=511803} 2026-02-13T20:28:35.749 INFO:tasks.rados.rados.0.trial188.stdout:3910: writing trial18843701-39 from 773485 to 1446714 tid 1 2026-02-13T20:28:35.755 INFO:tasks.rados.rados.0.trial188.stdout:3910: writing trial18843701-39 from 2124748 to 2636551 tid 2 2026-02-13T20:28:35.755 INFO:tasks.rados.rados.0.trial188.stdout:3911: read oid 16 snap 399 2026-02-13T20:28:35.755 INFO:tasks.rados.rados.0.trial188.stdout:3911: expect deleted 2026-02-13T20:28:35.755 INFO:tasks.rados.rados.0.trial188.stdout:3912: delete oid 25 current snap is 405 2026-02-13T20:28:35.755 INFO:tasks.rados.rados.0.trial188.stdout:3908: expect (ObjNum 1228 snap 372 seq_num 1228) 2026-02-13T20:28:35.755 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:28:35.780 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:28:35.830 INFO:tasks.rados.rados.0.trial188.stdout:3910: finishing write tid 1 to trial18843701-39 2026-02-13T20:28:35.830 INFO:tasks.rados.rados.0.trial188.stdout:3910: finishing write tid 2 to trial18843701-39 2026-02-13T20:28:35.831 INFO:tasks.rados.rados.0.trial188.stdout:3908: done (3 left) 2026-02-13T20:28:35.831 INFO:tasks.rados.rados.0.trial188.stdout:3911: done (2 left) 2026-02-13T20:28:35.831 INFO:tasks.rados.rados.0.trial188.stdout:3912: done (1 left) 2026-02-13T20:28:35.831 INFO:tasks.rados.rados.0.trial188.stdout:3913: read oid 49 snap 403 2026-02-13T20:28:35.831 INFO:tasks.rados.rados.0.trial188.stdout:3913: expect (ObjNum 1339 snap 397 seq_num 1339) 2026-02-13T20:28:35.831 INFO:tasks.rados.rados.0.trial188.stdout:3914: snap_create 2026-02-13T20:28:35.831 INFO:tasks.rados.rados.0.trial188.stdout:3910: finishing write tid 3 to trial18843701-39 2026-02-13T20:28:35.831 INFO:tasks.rados.rados.0.trial188.stdout:3910: finishing write tid 4 to trial18843701-39 2026-02-13T20:28:35.831 INFO:tasks.rados.rados.0.trial188.stdout:3910: oid 39 updating version 0 to 1754 2026-02-13T20:28:35.831 INFO:tasks.rados.rados.0.trial188.stdout:3910: oid 39 updating version 1754 to 1755 2026-02-13T20:28:35.831 INFO:tasks.rados.rados.0.trial188.stdout:3910: oid 39 updating version 1755 to 1756 2026-02-13T20:28:35.831 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 39 v 1756 (ObjNum 1355 snap 405 seq_num 1355) dirty exists 2026-02-13T20:28:35.832 INFO:tasks.rados.rados.0.trial188.stdout:3910: left oid 39 (ObjNum 1355 snap 405 seq_num 1355) 2026-02-13T20:28:35.834 INFO:tasks.rados.rados.0.trial188.stdout:3913: expect (ObjNum 1339 snap 397 seq_num 1339) 2026-02-13T20:28:35.834 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:28:35.865 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:28:35.896 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:28:36.766 INFO:tasks.rados.rados.0.trial188.stdout:3910: done (2 left) 2026-02-13T20:28:36.766 INFO:tasks.rados.rados.0.trial188.stdout:3913: done (1 left) 2026-02-13T20:28:36.766 INFO:tasks.rados.rados.0.trial188.stdout:3914: done (0 left) 2026-02-13T20:28:36.766 INFO:tasks.rados.rados.0.trial188.stdout:3915: write oid 10 current snap is 406 2026-02-13T20:28:36.766 INFO:tasks.rados.rados.0.trial188.stdout:3915: seq_num 1357 ranges {407099=423727,1441712=515472,2582060=225039} 2026-02-13T20:28:36.770 INFO:tasks.rados.rados.0.trial188.stdout:3915: writing trial18843701-10 from 407099 to 830826 tid 1 2026-02-13T20:28:36.774 INFO:tasks.rados.rados.0.trial188.stdout:3915: writing trial18843701-10 from 1441712 to 1957184 tid 2 2026-02-13T20:28:36.777 INFO:tasks.rados.rados.0.trial188.stdout:3915: writing trial18843701-10 from 2582060 to 2807099 tid 3 2026-02-13T20:28:36.777 INFO:tasks.rados.rados.0.trial188.stdout:3916: read oid 5 snap -1 2026-02-13T20:28:36.777 INFO:tasks.rados.rados.0.trial188.stdout:3916: expect (ObjNum 1248 snap 375 seq_num 1248) 2026-02-13T20:28:36.777 INFO:tasks.rados.rados.0.trial188.stdout:3917: read oid 43 snap -1 2026-02-13T20:28:36.777 INFO:tasks.rados.rados.0.trial188.stdout:3917: expect (ObjNum 1326 snap 395 seq_num 1326) 2026-02-13T20:28:36.777 INFO:tasks.rados.rados.0.trial188.stdout:3918: read oid 4 snap -1 2026-02-13T20:28:36.778 INFO:tasks.rados.rados.0.trial188.stdout:3918: expect (ObjNum 1248 snap 375 seq_num 1248) 2026-02-13T20:28:36.778 INFO:tasks.rados.rados.0.trial188.stdout:3919: copy_from oid 30 from oid 23 current snap is 406 2026-02-13T20:28:36.778 INFO:tasks.rados.rados.0.trial188.stdout:3920: read oid 27 snap -1 2026-02-13T20:28:36.778 INFO:tasks.rados.rados.0.trial188.stdout:3920: expect (ObjNum 1317 snap 393 seq_num 1317) 2026-02-13T20:28:36.778 INFO:tasks.rados.rados.0.trial188.stdout:3921: rollback oid 21 current snap is 406 2026-02-13T20:28:36.778 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 21 to 405 2026-02-13T20:28:36.778 INFO:tasks.rados.rados.0.trial188.stdout:3922: rollback oid 36 current snap is 406 2026-02-13T20:28:36.778 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 36 to 399 2026-02-13T20:28:36.778 INFO:tasks.rados.rados.0.trial188.stdout:3923: copy_from oid 50 from oid 19 current snap is 406 2026-02-13T20:28:36.778 INFO:tasks.rados.rados.0.trial188.stdout:3924: copy_from oid 12 from oid 17 current snap is 406 2026-02-13T20:28:36.778 INFO:tasks.rados.rados.0.trial188.stdout:3925: read oid 37 snap 404 2026-02-13T20:28:36.778 INFO:tasks.rados.rados.0.trial188.stdout:3925: expect (ObjNum 1333 snap 396 seq_num 1333) 2026-02-13T20:28:36.778 INFO:tasks.rados.rados.0.trial188.stdout:3926: delete oid 29 current snap is 406 2026-02-13T20:28:36.780 INFO:tasks.rados.rados.0.trial188.stdout:3920: expect (ObjNum 1317 snap 393 seq_num 1317) 2026-02-13T20:28:36.780 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:28:36.816 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 781700 2026-02-13T20:28:36.829 INFO:tasks.rados.rados.0.trial188.stdout:3920: done (11 left) 2026-02-13T20:28:36.829 INFO:tasks.rados.rados.0.trial188.stdout:3926: done (10 left) 2026-02-13T20:28:36.830 INFO:tasks.rados.rados.0.trial188.stdout:3927: delete oid 2 current snap is 406 2026-02-13T20:28:36.830 INFO:tasks.rados.rados.0.trial188.stdout:3917: expect (ObjNum 1326 snap 395 seq_num 1326) 2026-02-13T20:28:36.882 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1979721 2026-02-13T20:28:36.898 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 537052 2026-02-13T20:28:36.932 INFO:tasks.rados.rados.0.trial188.stdout:3925: expect (ObjNum 1333 snap 396 seq_num 1333) 2026-02-13T20:28:36.971 INFO:tasks.rados.rados.0.trial188.stdout:3915: finishing write tid 1 to trial18843701-10 2026-02-13T20:28:36.971 INFO:tasks.rados.rados.0.trial188.stdout:3922: finishing rollback tid 0 to trial18843701-36 2026-02-13T20:28:36.971 INFO:tasks.rados.rados.0.trial188.stdout:3921: finishing rollback tid 0 to trial18843701-21 2026-02-13T20:28:36.971 INFO:tasks.rados.rados.0.trial188.stdout:3917: done (10 left) 2026-02-13T20:28:36.972 INFO:tasks.rados.rados.0.trial188.stdout:3925: done (9 left) 2026-02-13T20:28:36.972 INFO:tasks.rados.rados.0.trial188.stdout:3927: done (8 left) 2026-02-13T20:28:36.972 INFO:tasks.rados.rados.0.trial188.stdout:3928: snap_remove snap 403 2026-02-13T20:28:37.769 INFO:tasks.rados.rados.0.trial188.stdout:3928: done (8 left) 2026-02-13T20:28:37.770 INFO:tasks.rados.rados.0.trial188.stdout:3929: snap_remove snap 402 2026-02-13T20:28:38.771 INFO:tasks.rados.rados.0.trial188.stdout:3929: done (8 left) 2026-02-13T20:28:38.771 INFO:tasks.rados.rados.0.trial188.stdout:3930: snap_remove snap 401 2026-02-13T20:28:39.776 INFO:tasks.rados.rados.0.trial188.stdout:3930: done (8 left) 2026-02-13T20:28:39.776 INFO:tasks.rados.rados.0.trial188.stdout:3931: delete oid 42 current snap is 406 2026-02-13T20:28:39.777 INFO:tasks.rados.rados.0.trial188.stdout:3922: finishing rollback tid 1 to trial18843701-36 2026-02-13T20:28:39.777 INFO:tasks.rados.rados.0.trial188.stdout:3922: finishing rollback tid 2 to trial18843701-36 2026-02-13T20:28:39.777 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 36 v 1987 (ObjNum 1312 snap 393 seq_num 1312) dirty exists 2026-02-13T20:28:39.777 INFO:tasks.rados.rados.0.trial188.stdout:3921: finishing rollback tid 1 to trial18843701-21 2026-02-13T20:28:39.777 INFO:tasks.rados.rados.0.trial188.stdout:3921: finishing rollback tid 2 to trial18843701-21 2026-02-13T20:28:39.777 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 21 v 1797 (ObjNum 1238 snap 375 seq_num 1238) dirty exists 2026-02-13T20:28:39.777 INFO:tasks.rados.rados.0.trial188.stdout:3915: finishing write tid 2 to trial18843701-10 2026-02-13T20:28:39.777 INFO:tasks.rados.rados.0.trial188.stdout:3918: expect (ObjNum 1248 snap 375 seq_num 1248) 2026-02-13T20:28:39.782 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2542774 2026-02-13T20:28:39.806 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1746934 2026-02-13T20:28:39.815 INFO:tasks.rados.rados.0.trial188.stdout:3915: finishing write tid 3 to trial18843701-10 2026-02-13T20:28:39.815 INFO:tasks.rados.rados.0.trial188.stdout:3918: done (8 left) 2026-02-13T20:28:39.815 INFO:tasks.rados.rados.0.trial188.stdout:3921: done (7 left) 2026-02-13T20:28:39.815 INFO:tasks.rados.rados.0.trial188.stdout:3922: done (6 left) 2026-02-13T20:28:39.815 INFO:tasks.rados.rados.0.trial188.stdout:3931: done (5 left) 2026-02-13T20:28:39.815 INFO:tasks.rados.rados.0.trial188.stdout:3932: read oid 24 snap -1 2026-02-13T20:28:39.815 INFO:tasks.rados.rados.0.trial188.stdout:3932: expect (ObjNum 1161 snap 354 seq_num 1161) 2026-02-13T20:28:39.815 INFO:tasks.rados.rados.0.trial188.stdout:3933: copy_from oid 11 from oid 32 current snap is 406 2026-02-13T20:28:39.815 INFO:tasks.rados.rados.0.trial188.stdout:3915: finishing write tid 4 to trial18843701-10 2026-02-13T20:28:39.816 INFO:tasks.rados.rados.0.trial188.stdout:3915: finishing write tid 5 to trial18843701-10 2026-02-13T20:28:39.816 INFO:tasks.rados.rados.0.trial188.stdout:3915: oid 10 updating version 0 to 1707 2026-02-13T20:28:39.816 INFO:tasks.rados.rados.0.trial188.stdout:3915: oid 10 version 1707 is already newer than 1705 2026-02-13T20:28:39.816 INFO:tasks.rados.rados.0.trial188.stdout:3915: oid 10 version 1707 is already newer than 1706 2026-02-13T20:28:39.816 INFO:tasks.rados.rados.0.trial188.stdout:3915: oid 10 updating version 1707 to 1708 2026-02-13T20:28:39.816 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 10 v 1708 (ObjNum 1357 snap 406 seq_num 1357) dirty exists 2026-02-13T20:28:39.816 INFO:tasks.rados.rados.0.trial188.stdout:3915: left oid 10 (ObjNum 1357 snap 406 seq_num 1357) 2026-02-13T20:28:39.816 INFO:tasks.rados.rados.0.trial188.stdout:3916: expect (ObjNum 1248 snap 375 seq_num 1248) 2026-02-13T20:28:39.825 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2887704 2026-02-13T20:28:39.825 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:28:39.846 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:28:39.867 INFO:tasks.rados.rados.0.trial188.stdout:3919: finishing copy_from racing read to trial18843701-30 2026-02-13T20:28:39.867 INFO:tasks.rados.rados.0.trial188.stdout:3923: finishing copy_from racing read to trial18843701-50 2026-02-13T20:28:39.867 INFO:tasks.rados.rados.0.trial188.stdout:3923: finishing copy_from to trial18843701-50 2026-02-13T20:28:39.867 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 50 v 1751 (ObjNum 1272 snap 384 seq_num 1272) dirty exists 2026-02-13T20:28:39.868 INFO:tasks.rados.rados.0.trial188.stdout:3919: finishing copy_from to trial18843701-30 2026-02-13T20:28:39.868 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 30 v 1482 (ObjNum 1161 snap 354 seq_num 1161) dirty exists 2026-02-13T20:28:39.868 INFO:tasks.rados.rados.0.trial188.stdout:3924: finishing copy_from racing read to trial18843701-12 2026-02-13T20:28:39.868 INFO:tasks.rados.rados.0.trial188.stdout:3915: done (6 left) 2026-02-13T20:28:39.868 INFO:tasks.rados.rados.0.trial188.stdout:3916: done (5 left) 2026-02-13T20:28:39.868 INFO:tasks.rados.rados.0.trial188.stdout:3919: done (4 left) 2026-02-13T20:28:39.868 INFO:tasks.rados.rados.0.trial188.stdout:3923: done (3 left) 2026-02-13T20:28:39.868 INFO:tasks.rados.rados.0.trial188.stdout:3934: write oid 23 current snap is 406 2026-02-13T20:28:39.868 INFO:tasks.rados.rados.0.trial188.stdout:3934: seq_num 1361 ranges {474327=441076,1675640=522810,2808105=66222} 2026-02-13T20:28:39.871 INFO:tasks.rados.rados.0.trial188.stdout:3934: writing trial18843701-23 from 474327 to 915403 tid 1 2026-02-13T20:28:39.876 INFO:tasks.rados.rados.0.trial188.stdout:3934: writing trial18843701-23 from 1675640 to 2198450 tid 2 2026-02-13T20:28:39.878 INFO:tasks.rados.rados.0.trial188.stdout:3934: writing trial18843701-23 from 2808105 to 2874327 tid 3 2026-02-13T20:28:39.879 INFO:tasks.rados.rados.0.trial188.stdout:3935: write (excl) oid 33 current snap is 406 2026-02-13T20:28:39.879 INFO:tasks.rados.rados.0.trial188.stdout:3935: seq_num 1362 ranges {491134=516325,1734122=666468} 2026-02-13T20:28:39.882 INFO:tasks.rados.rados.0.trial188.stdout:3935: writing trial18843701-33 from 491134 to 1007459 tid 1 2026-02-13T20:28:39.888 INFO:tasks.rados.rados.0.trial188.stdout:3935: writing trial18843701-33 from 1734122 to 2400590 tid 2 2026-02-13T20:28:39.888 INFO:tasks.rados.rados.0.trial188.stdout:3936: rollback oid 44 current snap is 406 2026-02-13T20:28:39.888 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 44 to 404 2026-02-13T20:28:39.888 INFO:tasks.rados.rados.0.trial188.stdout:3924: finishing copy_from to trial18843701-12 2026-02-13T20:28:39.888 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 12 v 1758 (ObjNum 1291 snap 384 seq_num 1291) dirty exists 2026-02-13T20:28:39.888 INFO:tasks.rados.rados.0.trial188.stdout:3932: expect (ObjNum 1161 snap 354 seq_num 1161) 2026-02-13T20:28:39.920 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:28:39.958 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 808992 2026-02-13T20:28:39.984 INFO:tasks.rados.rados.0.trial188.stdout:3933: finishing copy_from racing read to trial18843701-11 2026-02-13T20:28:39.984 INFO:tasks.rados.rados.0.trial188.stdout:3933: finishing copy_from to trial18843701-11 2026-02-13T20:28:39.984 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 11 v 1773 (ObjNum 1348 snap 401 seq_num 1348) dirty exists 2026-02-13T20:28:39.984 INFO:tasks.rados.rados.0.trial188.stdout:3934: finishing write tid 1 to trial18843701-23 2026-02-13T20:28:39.984 INFO:tasks.rados.rados.0.trial188.stdout:3924: done (5 left) 2026-02-13T20:28:39.984 INFO:tasks.rados.rados.0.trial188.stdout:3932: done (4 left) 2026-02-13T20:28:39.984 INFO:tasks.rados.rados.0.trial188.stdout:3933: done (3 left) 2026-02-13T20:28:39.984 INFO:tasks.rados.rados.0.trial188.stdout:3937: write (excl) oid 1 current snap is 406 2026-02-13T20:28:39.984 INFO:tasks.rados.rados.0.trial188.stdout:3937: seq_num 1363 ranges {507941=591574,1676251=526479,2746598=161343} 2026-02-13T20:28:39.990 INFO:tasks.rados.rados.0.trial188.stdout:3937: writing trial18843701-1 from 507941 to 1099515 tid 1 2026-02-13T20:28:39.998 INFO:tasks.rados.rados.0.trial188.stdout:3937: writing trial18843701-1 from 1676251 to 2202730 tid 2 2026-02-13T20:28:40.003 INFO:tasks.rados.rados.0.trial188.stdout:3937: writing trial18843701-1 from 2746598 to 2907941 tid 3 2026-02-13T20:28:40.004 INFO:tasks.rados.rados.0.trial188.stdout:3938: copy_from oid 6 from oid 16 current snap is 406 2026-02-13T20:28:40.004 INFO:tasks.rados.rados.0.trial188.stdout:3934: finishing write tid 2 to trial18843701-23 2026-02-13T20:28:40.004 INFO:tasks.rados.rados.0.trial188.stdout:3934: finishing write tid 3 to trial18843701-23 2026-02-13T20:28:40.004 INFO:tasks.rados.rados.0.trial188.stdout:3934: finishing write tid 4 to trial18843701-23 2026-02-13T20:28:40.004 INFO:tasks.rados.rados.0.trial188.stdout:3934: finishing write tid 5 to trial18843701-23 2026-02-13T20:28:40.004 INFO:tasks.rados.rados.0.trial188.stdout:3934: oid 23 updating version 0 to 2010 2026-02-13T20:28:40.004 INFO:tasks.rados.rados.0.trial188.stdout:3934: oid 23 updating version 2010 to 2012 2026-02-13T20:28:40.004 INFO:tasks.rados.rados.0.trial188.stdout:3934: oid 23 version 2012 is already newer than 2011 2026-02-13T20:28:40.004 INFO:tasks.rados.rados.0.trial188.stdout:3934: oid 23 version 2012 is already newer than 2009 2026-02-13T20:28:40.004 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 23 v 2012 (ObjNum 1361 snap 406 seq_num 1361) dirty exists 2026-02-13T20:28:40.004 INFO:tasks.rados.rados.0.trial188.stdout:3934: left oid 23 (ObjNum 1361 snap 406 seq_num 1361) 2026-02-13T20:28:40.005 INFO:tasks.rados.rados.0.trial188.stdout:3936: finishing rollback tid 0 to trial18843701-44 2026-02-13T20:28:40.005 INFO:tasks.rados.rados.0.trial188.stdout:3936: finishing rollback tid 1 to trial18843701-44 2026-02-13T20:28:40.005 INFO:tasks.rados.rados.0.trial188.stdout:3935: finishing write tid 1 to trial18843701-33 2026-02-13T20:28:40.005 INFO:tasks.rados.rados.0.trial188.stdout:3936: finishing rollback tid 2 to trial18843701-44 2026-02-13T20:28:40.005 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 44 v 1948 (ObjNum 1320 snap 393 seq_num 1320) dirty exists 2026-02-13T20:28:40.005 INFO:tasks.rados.rados.0.trial188.stdout:3935: finishing write tid 2 to trial18843701-33 2026-02-13T20:28:40.005 INFO:tasks.rados.rados.0.trial188.stdout:3934: done (4 left) 2026-02-13T20:28:40.005 INFO:tasks.rados.rados.0.trial188.stdout:3936: done (3 left) 2026-02-13T20:28:40.005 INFO:tasks.rados.rados.0.trial188.stdout:3939: rollback oid 37 current snap is 406 2026-02-13T20:28:40.005 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 37 to 384 2026-02-13T20:28:40.005 INFO:tasks.rados.rados.0.trial188.stdout:3935: finishing write tid 3 to trial18843701-33 2026-02-13T20:28:40.005 INFO:tasks.rados.rados.0.trial188.stdout:3935: finishing write tid 4 to trial18843701-33 2026-02-13T20:28:40.005 INFO:tasks.rados.rados.0.trial188.stdout:3935: oid 33 updating version 0 to 1745 2026-02-13T20:28:40.006 INFO:tasks.rados.rados.0.trial188.stdout:3935: oid 33 version 1745 is already newer than 1744 2026-02-13T20:28:40.006 INFO:tasks.rados.rados.0.trial188.stdout:3935: oid 33 version 1745 is already newer than 1743 2026-02-13T20:28:40.006 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 33 v 1745 (ObjNum 1362 snap 406 seq_num 1362) dirty exists 2026-02-13T20:28:40.006 INFO:tasks.rados.rados.0.trial188.stdout:3935: left oid 33 (ObjNum 1362 snap 406 seq_num 1362) 2026-02-13T20:28:40.006 INFO:tasks.rados.rados.0.trial188.stdout:3935: done (3 left) 2026-02-13T20:28:40.006 INFO:tasks.rados.rados.0.trial188.stdout:3940: rollback oid 13 current snap is 406 2026-02-13T20:28:40.006 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 13 to 399 2026-02-13T20:28:40.006 INFO:tasks.rados.rados.0.trial188.stdout:3941: snap_remove snap 404 2026-02-13T20:28:40.741 INFO:tasks.rados.rados.0.trial188.stdout:3941: done (4 left) 2026-02-13T20:28:40.741 INFO:tasks.rados.rados.0.trial188.stdout:3942: write oid 25 current snap is 406 2026-02-13T20:28:40.741 INFO:tasks.rados.rados.0.trial188.stdout:3942: seq_num 1364 ranges {524748=666823,1734733=670137} 2026-02-13T20:28:40.745 INFO:tasks.rados.rados.0.trial188.stdout:3942: writing trial18843701-25 from 524748 to 1191571 tid 1 2026-02-13T20:28:40.750 INFO:tasks.rados.rados.0.trial188.stdout:3942: writing trial18843701-25 from 1734733 to 2404870 tid 2 2026-02-13T20:28:40.750 INFO:tasks.rados.rados.0.trial188.stdout:3943: snap_create 2026-02-13T20:28:40.751 INFO:tasks.rados.rados.0.trial188.stdout:3938: finishing copy_from to trial18843701-6 2026-02-13T20:28:40.751 INFO:tasks.rados.rados.0.trial188.stdout:3938: got expected ENOENT (src dne) 2026-02-13T20:28:40.751 INFO:tasks.rados.rados.0.trial188.stdout:3938: finishing copy_from racing read to trial18843701-6 2026-02-13T20:28:40.751 INFO:tasks.rados.rados.0.trial188.stdout:3937: finishing write tid 1 to trial18843701-1 2026-02-13T20:28:40.751 INFO:tasks.rados.rados.0.trial188.stdout:3937: finishing write tid 2 to trial18843701-1 2026-02-13T20:28:40.751 INFO:tasks.rados.rados.0.trial188.stdout:3939: finishing rollback tid 0 to trial18843701-37 2026-02-13T20:28:40.751 INFO:tasks.rados.rados.0.trial188.stdout:3939: finishing rollback tid 1 to trial18843701-37 2026-02-13T20:28:40.751 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 37 v 1945 (ObjNum 33 snap 0 seq_num 13768400) dirty dne 2026-02-13T20:28:40.751 INFO:tasks.rados.rados.0.trial188.stdout:3937: finishing write tid 3 to trial18843701-1 2026-02-13T20:28:40.751 INFO:tasks.rados.rados.0.trial188.stdout:3937: finishing write tid 4 to trial18843701-1 2026-02-13T20:28:40.751 INFO:tasks.rados.rados.0.trial188.stdout:3937: finishing write tid 5 to trial18843701-1 2026-02-13T20:28:40.752 INFO:tasks.rados.rados.0.trial188.stdout:3937: oid 1 updating version 0 to 1953 2026-02-13T20:28:40.752 INFO:tasks.rados.rados.0.trial188.stdout:3937: oid 1 version 1953 is already newer than 1952 2026-02-13T20:28:40.752 INFO:tasks.rados.rados.0.trial188.stdout:3937: oid 1 updating version 1953 to 1954 2026-02-13T20:28:40.752 INFO:tasks.rados.rados.0.trial188.stdout:3937: oid 1 version 1954 is already newer than 1951 2026-02-13T20:28:40.752 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 1 v 1954 (ObjNum 1363 snap 406 seq_num 1363) dirty exists 2026-02-13T20:28:40.752 INFO:tasks.rados.rados.0.trial188.stdout:3937: left oid 1 (ObjNum 1363 snap 406 seq_num 1363) 2026-02-13T20:28:40.752 INFO:tasks.rados.rados.0.trial188.stdout:3940: finishing rollback tid 1 to trial18843701-13 2026-02-13T20:28:40.752 INFO:tasks.rados.rados.0.trial188.stdout:3940: finishing rollback tid 2 to trial18843701-13 2026-02-13T20:28:40.752 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 13 v 1956 (ObjNum 1187 snap 363 seq_num 1187) dirty exists 2026-02-13T20:28:40.764 INFO:tasks.rados.rados.0.trial188.stdout:3942: finishing write tid 1 to trial18843701-25 2026-02-13T20:28:40.766 INFO:tasks.rados.rados.0.trial188.stdout:3942: finishing write tid 2 to trial18843701-25 2026-02-13T20:28:40.766 INFO:tasks.rados.rados.0.trial188.stdout:3942: finishing write tid 3 to trial18843701-25 2026-02-13T20:28:40.766 INFO:tasks.rados.rados.0.trial188.stdout:3942: finishing write tid 4 to trial18843701-25 2026-02-13T20:28:40.766 INFO:tasks.rados.rados.0.trial188.stdout:3942: oid 25 updating version 0 to 1923 2026-02-13T20:28:40.766 INFO:tasks.rados.rados.0.trial188.stdout:3942: oid 25 updating version 1923 to 1924 2026-02-13T20:28:40.766 INFO:tasks.rados.rados.0.trial188.stdout:3942: oid 25 version 1924 is already newer than 1918 2026-02-13T20:28:40.767 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 25 v 1924 (ObjNum 1364 snap 406 seq_num 1364) dirty exists 2026-02-13T20:28:40.767 INFO:tasks.rados.rados.0.trial188.stdout:3942: left oid 25 (ObjNum 1364 snap 406 seq_num 1364) 2026-02-13T20:28:41.740 INFO:tasks.rados.rados.0.trial188.stdout:3937: done (5 left) 2026-02-13T20:28:41.741 INFO:tasks.rados.rados.0.trial188.stdout:3938: done (4 left) 2026-02-13T20:28:41.741 INFO:tasks.rados.rados.0.trial188.stdout:3939: done (3 left) 2026-02-13T20:28:41.741 INFO:tasks.rados.rados.0.trial188.stdout:3940: done (2 left) 2026-02-13T20:28:41.741 INFO:tasks.rados.rados.0.trial188.stdout:3942: done (1 left) 2026-02-13T20:28:41.741 INFO:tasks.rados.rados.0.trial188.stdout:3943: done (0 left) 2026-02-13T20:28:41.741 INFO:tasks.rados.rados.0.trial188.stdout:3944: write (excl) oid 5 current snap is 407 2026-02-13T20:28:41.741 INFO:tasks.rados.rados.0.trial188.stdout:3944: seq_num 1365 ranges {541555=742072,1793215=530148,2801444=140111} 2026-02-13T20:28:41.745 INFO:tasks.rados.rados.0.trial188.stdout:3944: writing trial18843701-5 from 541555 to 1283627 tid 1 2026-02-13T20:28:41.749 INFO:tasks.rados.rados.0.trial188.stdout:3944: writing trial18843701-5 from 1793215 to 2323363 tid 2 2026-02-13T20:28:41.752 INFO:tasks.rados.rados.0.trial188.stdout:3944: writing trial18843701-5 from 2801444 to 2941555 tid 3 2026-02-13T20:28:41.752 INFO:tasks.rados.rados.0.trial188.stdout:3945: read oid 42 snap -1 2026-02-13T20:28:41.752 INFO:tasks.rados.rados.0.trial188.stdout:3945: expect deleted 2026-02-13T20:28:41.752 INFO:tasks.rados.rados.0.trial188.stdout:3946: snap_create 2026-02-13T20:28:41.768 INFO:tasks.rados.rados.0.trial188.stdout:3944: finishing write tid 1 to trial18843701-5 2026-02-13T20:28:41.770 INFO:tasks.rados.rados.0.trial188.stdout:3944: finishing write tid 2 to trial18843701-5 2026-02-13T20:28:41.770 INFO:tasks.rados.rados.0.trial188.stdout:3944: finishing write tid 3 to trial18843701-5 2026-02-13T20:28:41.770 INFO:tasks.rados.rados.0.trial188.stdout:3944: finishing write tid 4 to trial18843701-5 2026-02-13T20:28:41.770 INFO:tasks.rados.rados.0.trial188.stdout:3944: finishing write tid 5 to trial18843701-5 2026-02-13T20:28:41.770 INFO:tasks.rados.rados.0.trial188.stdout:3944: oid 5 updating version 0 to 1963 2026-02-13T20:28:41.770 INFO:tasks.rados.rados.0.trial188.stdout:3944: oid 5 updating version 1963 to 1964 2026-02-13T20:28:41.770 INFO:tasks.rados.rados.0.trial188.stdout:3944: oid 5 updating version 1964 to 1965 2026-02-13T20:28:41.770 INFO:tasks.rados.rados.0.trial188.stdout:3944: oid 5 version 1965 is already newer than 1962 2026-02-13T20:28:41.771 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 5 v 1965 (ObjNum 1365 snap 407 seq_num 1365) dirty exists 2026-02-13T20:28:41.771 INFO:tasks.rados.rados.0.trial188.stdout:3944: left oid 5 (ObjNum 1365 snap 407 seq_num 1365) 2026-02-13T20:28:42.741 INFO:tasks.rados.rados.0.trial188.stdout:3944: done (2 left) 2026-02-13T20:28:42.741 INFO:tasks.rados.rados.0.trial188.stdout:3945: done (1 left) 2026-02-13T20:28:42.741 INFO:tasks.rados.rados.0.trial188.stdout:3946: done (0 left) 2026-02-13T20:28:42.741 INFO:tasks.rados.rados.0.trial188.stdout:3947: delete oid 47 current snap is 408 2026-02-13T20:28:42.744 INFO:tasks.rados.rados.0.trial188.stdout:3947: done (0 left) 2026-02-13T20:28:42.744 INFO:tasks.rados.rados.0.trial188.stdout:3948: read oid 12 snap -1 2026-02-13T20:28:42.745 INFO:tasks.rados.rados.0.trial188.stdout:3948: expect (ObjNum 1291 snap 384 seq_num 1291) 2026-02-13T20:28:42.745 INFO:tasks.rados.rados.0.trial188.stdout:3949: read oid 7 snap -1 2026-02-13T20:28:42.745 INFO:tasks.rados.rados.0.trial188.stdout:3949: expect deleted 2026-02-13T20:28:42.745 INFO:tasks.rados.rados.0.trial188.stdout:3950: read oid 41 snap -1 2026-02-13T20:28:42.745 INFO:tasks.rados.rados.0.trial188.stdout:3950: expect (ObjNum 1272 snap 384 seq_num 1272) 2026-02-13T20:28:42.745 INFO:tasks.rados.rados.0.trial188.stdout:3951: write (excl) oid 1 current snap is 408 2026-02-13T20:28:42.745 INFO:tasks.rados.rados.0.trial188.stdout:3951: seq_num 1367 ranges {575169=492570,1793826=417464,2623584=351585} 2026-02-13T20:28:42.748 INFO:tasks.rados.rados.0.trial188.stdout:3951: writing trial18843701-1 from 575169 to 1067739 tid 1 2026-02-13T20:28:42.752 INFO:tasks.rados.rados.0.trial188.stdout:3951: writing trial18843701-1 from 1793826 to 2211290 tid 2 2026-02-13T20:28:42.756 INFO:tasks.rados.rados.0.trial188.stdout:3951: writing trial18843701-1 from 2623584 to 2975169 tid 3 2026-02-13T20:28:42.756 INFO:tasks.rados.rados.0.trial188.stdout:3952: read oid 24 snap -1 2026-02-13T20:28:42.756 INFO:tasks.rados.rados.0.trial188.stdout:3952: expect (ObjNum 1161 snap 354 seq_num 1161) 2026-02-13T20:28:42.756 INFO:tasks.rados.rados.0.trial188.stdout:3953: copy_from oid 32 from oid 26 current snap is 408 2026-02-13T20:28:42.756 INFO:tasks.rados.rados.0.trial188.stdout:3949: done (5 left) 2026-02-13T20:28:42.756 INFO:tasks.rados.rados.0.trial188.stdout:3954: read oid 3 snap -1 2026-02-13T20:28:42.756 INFO:tasks.rados.rados.0.trial188.stdout:3954: expect (ObjNum 1289 snap 384 seq_num 1289) 2026-02-13T20:28:42.756 INFO:tasks.rados.rados.0.trial188.stdout:3955: snap_create 2026-02-13T20:28:42.757 INFO:tasks.rados.rados.0.trial188.stdout:3950: expect (ObjNum 1272 snap 384 seq_num 1272) 2026-02-13T20:28:42.894 INFO:tasks.rados.rados.0.trial188.stdout:3953: finishing copy_from to trial18843701-32 2026-02-13T20:28:42.894 INFO:tasks.rados.rados.0.trial188.stdout:3953: got expected ENOENT (src dne) 2026-02-13T20:28:42.895 INFO:tasks.rados.rados.0.trial188.stdout:3953: finishing copy_from racing read to trial18843701-32 2026-02-13T20:28:42.895 INFO:tasks.rados.rados.0.trial188.stdout:3948: expect (ObjNum 1291 snap 384 seq_num 1291) 2026-02-13T20:28:42.895 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:28:42.954 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:28:43.073 INFO:tasks.rados.rados.0.trial188.stdout:3952: expect (ObjNum 1161 snap 354 seq_num 1161) 2026-02-13T20:28:43.083 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2003080 2026-02-13T20:28:43.132 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:28:43.166 INFO:tasks.rados.rados.0.trial188.stdout:3951: finishing write tid 1 to trial18843701-1 2026-02-13T20:28:43.166 INFO:tasks.rados.rados.0.trial188.stdout:3951: finishing write tid 2 to trial18843701-1 2026-02-13T20:28:43.166 INFO:tasks.rados.rados.0.trial188.stdout:3951: finishing write tid 3 to trial18843701-1 2026-02-13T20:28:43.166 INFO:tasks.rados.rados.0.trial188.stdout:3951: finishing write tid 4 to trial18843701-1 2026-02-13T20:28:43.166 INFO:tasks.rados.rados.0.trial188.stdout:3951: finishing write tid 5 to trial18843701-1 2026-02-13T20:28:43.166 INFO:tasks.rados.rados.0.trial188.stdout:3951: oid 1 updating version 0 to 1967 2026-02-13T20:28:43.166 INFO:tasks.rados.rados.0.trial188.stdout:3951: oid 1 updating version 1967 to 1970 2026-02-13T20:28:43.166 INFO:tasks.rados.rados.0.trial188.stdout:3951: oid 1 version 1970 is already newer than 1968 2026-02-13T20:28:43.167 INFO:tasks.rados.rados.0.trial188.stdout:3951: oid 1 version 1970 is already newer than 1969 2026-02-13T20:28:43.167 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 1 v 1970 (ObjNum 1367 snap 408 seq_num 1367) dirty exists 2026-02-13T20:28:43.167 INFO:tasks.rados.rados.0.trial188.stdout:3951: left oid 1 (ObjNum 1367 snap 408 seq_num 1367) 2026-02-13T20:28:43.167 INFO:tasks.rados.rados.0.trial188.stdout:3954: expect (ObjNum 1289 snap 384 seq_num 1289) 2026-02-13T20:28:43.185 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2604189 2026-02-13T20:28:43.742 INFO:tasks.rados.rados.0.trial188.stdout:3948: done (6 left) 2026-02-13T20:28:43.742 INFO:tasks.rados.rados.0.trial188.stdout:3950: done (5 left) 2026-02-13T20:28:43.743 INFO:tasks.rados.rados.0.trial188.stdout:3951: done (4 left) 2026-02-13T20:28:43.743 INFO:tasks.rados.rados.0.trial188.stdout:3952: done (3 left) 2026-02-13T20:28:43.743 INFO:tasks.rados.rados.0.trial188.stdout:3953: done (2 left) 2026-02-13T20:28:43.743 INFO:tasks.rados.rados.0.trial188.stdout:3954: done (1 left) 2026-02-13T20:28:43.743 INFO:tasks.rados.rados.0.trial188.stdout:3955: done (0 left) 2026-02-13T20:28:43.743 INFO:tasks.rados.rados.0.trial188.stdout:3956: read oid 31 snap -1 2026-02-13T20:28:43.743 INFO:tasks.rados.rados.0.trial188.stdout:3956: expect (ObjNum 1351 snap 402 seq_num 1351) 2026-02-13T20:28:43.743 INFO:tasks.rados.rados.0.trial188.stdout:3957: rollback oid 50 current snap is 409 2026-02-13T20:28:43.743 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 50 to 405 2026-02-13T20:28:43.743 INFO:tasks.rados.rados.0.trial188.stdout:3958: copy_from oid 29 from oid 36 current snap is 409 2026-02-13T20:28:43.743 INFO:tasks.rados.rados.0.trial188.stdout:3959: delete oid 6 current snap is 409 2026-02-13T20:28:43.744 INFO:tasks.rados.rados.0.trial188.stdout:3956: expect (ObjNum 1351 snap 402 seq_num 1351) 2026-02-13T20:28:43.768 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1109885 2026-02-13T20:28:43.788 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 2281789 2026-02-13T20:28:43.791 INFO:tasks.rados.rados.0.trial188.stdout:3957: finishing rollback tid 0 to trial18843701-50 2026-02-13T20:28:43.792 INFO:tasks.rados.rados.0.trial188.stdout:3957: finishing rollback tid 1 to trial18843701-50 2026-02-13T20:28:43.792 INFO:tasks.rados.rados.0.trial188.stdout:3956: done (3 left) 2026-02-13T20:28:43.792 INFO:tasks.rados.rados.0.trial188.stdout:3959: done (2 left) 2026-02-13T20:28:43.792 INFO:tasks.rados.rados.0.trial188.stdout:3960: delete oid 16 current snap is 409 2026-02-13T20:28:43.792 INFO:tasks.rados.rados.0.trial188.stdout:3957: finishing rollback tid 2 to trial18843701-50 2026-02-13T20:28:43.792 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 50 v 2022 (ObjNum 1238 snap 375 seq_num 1238) dirty exists 2026-02-13T20:28:43.792 INFO:tasks.rados.rados.0.trial188.stdout:3958: finishing copy_from racing read to trial18843701-29 2026-02-13T20:28:43.792 INFO:tasks.rados.rados.0.trial188.stdout:3958: finishing copy_from to trial18843701-29 2026-02-13T20:28:43.792 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 29 v 1987 (ObjNum 1312 snap 393 seq_num 1312) dirty exists 2026-02-13T20:28:43.793 INFO:tasks.rados.rados.0.trial188.stdout:3957: done (2 left) 2026-02-13T20:28:43.793 INFO:tasks.rados.rados.0.trial188.stdout:3958: done (1 left) 2026-02-13T20:28:43.793 INFO:tasks.rados.rados.0.trial188.stdout:3960: done (0 left) 2026-02-13T20:28:43.793 INFO:tasks.rados.rados.0.trial188.stdout:3961: read oid 24 snap 384 2026-02-13T20:28:43.794 INFO:tasks.rados.rados.0.trial188.stdout:3961: expect (ObjNum 1285 snap 384 seq_num 1285) 2026-02-13T20:28:43.794 INFO:tasks.rados.rados.0.trial188.stdout:3962: rollback oid 25 current snap is 409 2026-02-13T20:28:43.794 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 25 to 408 2026-02-13T20:28:43.794 INFO:tasks.rados.rados.0.trial188.stdout:3963: snap_remove snap 406 2026-02-13T20:28:44.746 INFO:tasks.rados.rados.0.trial188.stdout:3963: done (2 left) 2026-02-13T20:28:44.746 INFO:tasks.rados.rados.0.trial188.stdout:3964: write (excl) oid 17 current snap is 409 2026-02-13T20:28:44.746 INFO:tasks.rados.rados.0.trial188.stdout:3962: finishing rollback tid 0 to trial18843701-25 2026-02-13T20:28:44.746 INFO:tasks.rados.rados.0.trial188.stdout:3962: finishing rollback tid 1 to trial18843701-25 2026-02-13T20:28:44.746 INFO:tasks.rados.rados.0.trial188.stdout:3962: finishing rollback tid 2 to trial18843701-25 2026-02-13T20:28:44.747 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 25 v 1928 (ObjNum 1364 snap 406 seq_num 1364) dirty exists 2026-02-13T20:28:44.747 INFO:tasks.rados.rados.0.trial188.stdout:3961: expect (ObjNum 1285 snap 384 seq_num 1285) 2026-02-13T20:28:44.791 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1988784 2026-02-13T20:28:44.843 INFO:tasks.rados.rados.0.trial188.stdout:3964: seq_num 1370 ranges {625590=434670,1685625=681144,2822206=203384} 2026-02-13T20:28:44.847 INFO:tasks.rados.rados.0.trial188.stdout:3964: writing trial18843701-17 from 625590 to 1060260 tid 1 2026-02-13T20:28:44.852 INFO:tasks.rados.rados.0.trial188.stdout:3964: writing trial18843701-17 from 1685625 to 2366769 tid 2 2026-02-13T20:28:44.855 INFO:tasks.rados.rados.0.trial188.stdout:3964: writing trial18843701-17 from 2822206 to 3025590 tid 3 2026-02-13T20:28:44.855 INFO:tasks.rados.rados.0.trial188.stdout:3961: done (2 left) 2026-02-13T20:28:44.855 INFO:tasks.rados.rados.0.trial188.stdout:3962: done (1 left) 2026-02-13T20:28:44.855 INFO:tasks.rados.rados.0.trial188.stdout:3965: snap_create 2026-02-13T20:28:44.868 INFO:tasks.rados.rados.0.trial188.stdout:3964: finishing write tid 1 to trial18843701-17 2026-02-13T20:28:44.868 INFO:tasks.rados.rados.0.trial188.stdout:3964: finishing write tid 2 to trial18843701-17 2026-02-13T20:28:44.869 INFO:tasks.rados.rados.0.trial188.stdout:3964: finishing write tid 3 to trial18843701-17 2026-02-13T20:28:44.869 INFO:tasks.rados.rados.0.trial188.stdout:3964: finishing write tid 4 to trial18843701-17 2026-02-13T20:28:44.869 INFO:tasks.rados.rados.0.trial188.stdout:3964: finishing write tid 5 to trial18843701-17 2026-02-13T20:28:44.869 INFO:tasks.rados.rados.0.trial188.stdout:3964: oid 17 updating version 0 to 1762 2026-02-13T20:28:44.869 INFO:tasks.rados.rados.0.trial188.stdout:3964: oid 17 version 1762 is already newer than 1759 2026-02-13T20:28:44.870 INFO:tasks.rados.rados.0.trial188.stdout:3964: oid 17 version 1762 is already newer than 1761 2026-02-13T20:28:44.870 INFO:tasks.rados.rados.0.trial188.stdout:3964: oid 17 version 1762 is already newer than 1760 2026-02-13T20:28:44.870 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 17 v 1762 (ObjNum 1370 snap 409 seq_num 1370) dirty exists 2026-02-13T20:28:44.870 INFO:tasks.rados.rados.0.trial188.stdout:3964: left oid 17 (ObjNum 1370 snap 409 seq_num 1370) 2026-02-13T20:28:45.740 INFO:tasks.rados.rados.0.trial188.stdout:3964: done (1 left) 2026-02-13T20:28:45.740 INFO:tasks.rados.rados.0.trial188.stdout:3965: done (0 left) 2026-02-13T20:28:45.741 INFO:tasks.rados.rados.0.trial188.stdout:3966: write (excl) oid 9 current snap is 410 2026-02-13T20:28:45.741 INFO:tasks.rados.rados.0.trial188.stdout:3966: seq_num 1371 ranges {642397=509919,1627754=424802,2733276=309121} 2026-02-13T20:28:45.744 INFO:tasks.rados.rados.0.trial188.stdout:3966: writing trial18843701-9 from 642397 to 1152316 tid 1 2026-02-13T20:28:45.748 INFO:tasks.rados.rados.0.trial188.stdout:3966: writing trial18843701-9 from 1627754 to 2052556 tid 2 2026-02-13T20:28:45.752 INFO:tasks.rados.rados.0.trial188.stdout:3966: writing trial18843701-9 from 2733276 to 3042397 tid 3 2026-02-13T20:28:45.752 INFO:tasks.rados.rados.0.trial188.stdout:3967: read oid 17 snap -1 2026-02-13T20:28:45.752 INFO:tasks.rados.rados.0.trial188.stdout:3967: expect (ObjNum 1370 snap 409 seq_num 1370) 2026-02-13T20:28:45.752 INFO:tasks.rados.rados.0.trial188.stdout:3968: read oid 23 snap -1 2026-02-13T20:28:45.752 INFO:tasks.rados.rados.0.trial188.stdout:3968: expect (ObjNum 1361 snap 406 seq_num 1361) 2026-02-13T20:28:45.753 INFO:tasks.rados.rados.0.trial188.stdout:3969: read oid 14 snap -1 2026-02-13T20:28:45.753 INFO:tasks.rados.rados.0.trial188.stdout:3969: expect deleted 2026-02-13T20:28:45.753 INFO:tasks.rados.rados.0.trial188.stdout:3970: rollback oid 34 current snap is 410 2026-02-13T20:28:45.753 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 34 to 399 2026-02-13T20:28:45.753 INFO:tasks.rados.rados.0.trial188.stdout:3971: snap_remove snap 408 2026-02-13T20:28:46.751 INFO:tasks.rados.rados.0.trial188.stdout:3971: done (5 left) 2026-02-13T20:28:46.751 INFO:tasks.rados.rados.0.trial188.stdout:3972: read oid 18 snap -1 2026-02-13T20:28:46.752 INFO:tasks.rados.rados.0.trial188.stdout:3972: expect (ObjNum 1336 snap 397 seq_num 1336) 2026-02-13T20:28:46.752 INFO:tasks.rados.rados.0.trial188.stdout:3973: copy_from oid 39 from oid 20 current snap is 410 2026-02-13T20:28:46.752 INFO:tasks.rados.rados.0.trial188.stdout:3970: finishing rollback tid 0 to trial18843701-34 2026-02-13T20:28:46.752 INFO:tasks.rados.rados.0.trial188.stdout:3970: finishing rollback tid 1 to trial18843701-34 2026-02-13T20:28:46.752 INFO:tasks.rados.rados.0.trial188.stdout:3970: finishing rollback tid 2 to trial18843701-34 2026-02-13T20:28:46.752 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 34 v 1951 (ObjNum 1258 snap 378 seq_num 1258) dirty exists 2026-02-13T20:28:46.752 INFO:tasks.rados.rados.0.trial188.stdout:3967: expect (ObjNum 1370 snap 409 seq_num 1370) 2026-02-13T20:28:46.752 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:28:46.810 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:28:46.928 INFO:tasks.rados.rados.0.trial188.stdout:3968: expect (ObjNum 1361 snap 406 seq_num 1361) 2026-02-13T20:28:46.995 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:28:47.029 INFO:tasks.rados.rados.0.trial188.stdout:3966: finishing write tid 1 to trial18843701-9 2026-02-13T20:28:47.029 INFO:tasks.rados.rados.0.trial188.stdout:3966: finishing write tid 2 to trial18843701-9 2026-02-13T20:28:47.029 INFO:tasks.rados.rados.0.trial188.stdout:3967: done (6 left) 2026-02-13T20:28:47.029 INFO:tasks.rados.rados.0.trial188.stdout:3968: done (5 left) 2026-02-13T20:28:47.029 INFO:tasks.rados.rados.0.trial188.stdout:3969: done (4 left) 2026-02-13T20:28:47.029 INFO:tasks.rados.rados.0.trial188.stdout:3970: done (3 left) 2026-02-13T20:28:47.030 INFO:tasks.rados.rados.0.trial188.stdout:3974: read oid 11 snap -1 2026-02-13T20:28:47.030 INFO:tasks.rados.rados.0.trial188.stdout:3974: expect (ObjNum 1348 snap 401 seq_num 1348) 2026-02-13T20:28:47.030 INFO:tasks.rados.rados.0.trial188.stdout:3975: read oid 32 snap -1 2026-02-13T20:28:47.030 INFO:tasks.rados.rados.0.trial188.stdout:3975: expect (ObjNum 1348 snap 401 seq_num 1348) 2026-02-13T20:28:47.030 INFO:tasks.rados.rados.0.trial188.stdout:3976: write (excl) oid 49 current snap is 410 2026-02-13T20:28:47.030 INFO:tasks.rados.rados.0.trial188.stdout:3966: finishing write tid 3 to trial18843701-9 2026-02-13T20:28:47.030 INFO:tasks.rados.rados.0.trial188.stdout:3976: seq_num 1372 ranges {659204=585168,1686236=684813} 2026-02-13T20:28:47.033 INFO:tasks.rados.rados.0.trial188.stdout:3976: writing trial18843701-49 from 659204 to 1244372 tid 1 2026-02-13T20:28:47.037 INFO:tasks.rados.rados.0.trial188.stdout:3976: writing trial18843701-49 from 1686236 to 2371049 tid 2 2026-02-13T20:28:47.038 INFO:tasks.rados.rados.0.trial188.stdout:3977: copy_from oid 2 from oid 27 current snap is 410 2026-02-13T20:28:47.038 INFO:tasks.rados.rados.0.trial188.stdout:3966: finishing write tid 4 to trial18843701-9 2026-02-13T20:28:47.038 INFO:tasks.rados.rados.0.trial188.stdout:3966: finishing write tid 5 to trial18843701-9 2026-02-13T20:28:47.038 INFO:tasks.rados.rados.0.trial188.stdout:3966: oid 9 updating version 0 to 1587 2026-02-13T20:28:47.038 INFO:tasks.rados.rados.0.trial188.stdout:3966: oid 9 updating version 1587 to 1588 2026-02-13T20:28:47.038 INFO:tasks.rados.rados.0.trial188.stdout:3966: oid 9 version 1588 is already newer than 1585 2026-02-13T20:28:47.038 INFO:tasks.rados.rados.0.trial188.stdout:3966: oid 9 version 1588 is already newer than 1586 2026-02-13T20:28:47.038 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 9 v 1588 (ObjNum 1371 snap 410 seq_num 1371) dirty exists 2026-02-13T20:28:47.038 INFO:tasks.rados.rados.0.trial188.stdout:3966: left oid 9 (ObjNum 1371 snap 410 seq_num 1371) 2026-02-13T20:28:47.038 INFO:tasks.rados.rados.0.trial188.stdout:3972: expect (ObjNum 1336 snap 397 seq_num 1336) 2026-02-13T20:28:47.079 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:28:47.128 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1379786 2026-02-13T20:28:47.158 INFO:tasks.rados.rados.0.trial188.stdout:3973: finishing copy_from racing read to trial18843701-39 2026-02-13T20:28:47.158 INFO:tasks.rados.rados.0.trial188.stdout:3966: done (6 left) 2026-02-13T20:28:47.159 INFO:tasks.rados.rados.0.trial188.stdout:3972: done (5 left) 2026-02-13T20:28:47.159 INFO:tasks.rados.rados.0.trial188.stdout:3978: rollback oid 10 current snap is 410 2026-02-13T20:28:47.159 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 10 to 409 2026-02-13T20:28:47.159 INFO:tasks.rados.rados.0.trial188.stdout:3973: finishing copy_from to trial18843701-39 2026-02-13T20:28:47.159 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 39 v 1261 (ObjNum 1330 snap 396 seq_num 1330) dirty exists 2026-02-13T20:28:47.159 INFO:tasks.rados.rados.0.trial188.stdout:3974: expect (ObjNum 1348 snap 401 seq_num 1348) 2026-02-13T20:28:47.160 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:28:47.252 INFO:tasks.rados.rados.0.trial188.stdout:3975: expect (ObjNum 1348 snap 401 seq_num 1348) 2026-02-13T20:28:47.287 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 0 2026-02-13T20:28:47.323 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 161304 2026-02-13T20:28:47.359 INFO:tasks.rados.rados.0.trial188.stdout:3976: finishing write tid 1 to trial18843701-49 2026-02-13T20:28:47.359 INFO:tasks.rados.rados.0.trial188.stdout:3976: finishing write tid 2 to trial18843701-49 2026-02-13T20:28:47.360 INFO:tasks.rados.rados.0.trial188.stdout:3976: finishing write tid 3 to trial18843701-49 2026-02-13T20:28:47.360 INFO:tasks.rados.rados.0.trial188.stdout:3976: finishing write tid 4 to trial18843701-49 2026-02-13T20:28:47.360 INFO:tasks.rados.rados.0.trial188.stdout:3976: oid 49 updating version 0 to 1935 2026-02-13T20:28:47.360 INFO:tasks.rados.rados.0.trial188.stdout:3976: oid 49 version 1935 is already newer than 1934 2026-02-13T20:28:47.360 INFO:tasks.rados.rados.0.trial188.stdout:3976: oid 49 updating version 1935 to 1936 2026-02-13T20:28:47.360 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 49 v 1936 (ObjNum 1372 snap 410 seq_num 1372) dirty exists 2026-02-13T20:28:47.360 INFO:tasks.rados.rados.0.trial188.stdout:3976: left oid 49 (ObjNum 1372 snap 410 seq_num 1372) 2026-02-13T20:28:47.360 INFO:tasks.rados.rados.0.trial188.stdout:3977: finishing copy_from racing read to trial18843701-2 2026-02-13T20:28:47.360 INFO:tasks.rados.rados.0.trial188.stdout:3977: finishing copy_from to trial18843701-2 2026-02-13T20:28:47.361 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 2 v 1791 (ObjNum 1317 snap 393 seq_num 1317) dirty exists 2026-02-13T20:28:47.361 INFO:tasks.rados.rados.0.trial188.stdout:3978: finishing rollback tid 0 to trial18843701-10 2026-02-13T20:28:47.361 INFO:tasks.rados.rados.0.trial188.stdout:3973: done (5 left) 2026-02-13T20:28:47.361 INFO:tasks.rados.rados.0.trial188.stdout:3974: done (4 left) 2026-02-13T20:28:47.361 INFO:tasks.rados.rados.0.trial188.stdout:3975: done (3 left) 2026-02-13T20:28:47.361 INFO:tasks.rados.rados.0.trial188.stdout:3976: done (2 left) 2026-02-13T20:28:47.361 INFO:tasks.rados.rados.0.trial188.stdout:3977: done (1 left) 2026-02-13T20:28:47.361 INFO:tasks.rados.rados.0.trial188.stdout:3979: delete oid 15 current snap is 410 2026-02-13T20:28:47.361 INFO:tasks.rados.rados.0.trial188.stdout:3978: finishing rollback tid 1 to trial18843701-10 2026-02-13T20:28:47.361 INFO:tasks.rados.rados.0.trial188.stdout:3978: finishing rollback tid 2 to trial18843701-10 2026-02-13T20:28:47.361 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 10 v 1776 (ObjNum 1357 snap 406 seq_num 1357) dirty exists 2026-02-13T20:28:47.363 INFO:tasks.rados.rados.0.trial188.stdout:3978: done (1 left) 2026-02-13T20:28:47.363 INFO:tasks.rados.rados.0.trial188.stdout:3979: done (0 left) 2026-02-13T20:28:47.363 INFO:tasks.rados.rados.0.trial188.stdout:3980: read oid 4 snap 407 2026-02-13T20:28:47.363 INFO:tasks.rados.rados.0.trial188.stdout:3980: expect (ObjNum 1248 snap 375 seq_num 1248) 2026-02-13T20:28:47.363 INFO:tasks.rados.rados.0.trial188.stdout:3981: snap_remove snap 405 2026-02-13T20:28:47.754 INFO:tasks.rados.rados.0.trial188.stdout:3981: done (1 left) 2026-02-13T20:28:47.754 INFO:tasks.rados.rados.0.trial188.stdout:3982: write (excl) oid 14 current snap is 410 2026-02-13T20:28:47.754 INFO:tasks.rados.rados.0.trial188.stdout:3982: seq_num 1374 ranges {692818=735666,2203200=688482} 2026-02-13T20:28:47.760 INFO:tasks.rados.rados.0.trial188.stdout:3982: writing trial18843701-14 from 692818 to 1428484 tid 1 2026-02-13T20:28:47.766 INFO:tasks.rados.rados.0.trial188.stdout:3982: writing trial18843701-14 from 2203200 to 2891682 tid 2 2026-02-13T20:28:47.766 INFO:tasks.rados.rados.0.trial188.stdout:3983: write oid 36 current snap is 410 2026-02-13T20:28:47.766 INFO:tasks.rados.rados.0.trial188.stdout:3983: seq_num 1375 ranges {709625=410915,1745329=432140,2726615=383010} 2026-02-13T20:28:47.770 INFO:tasks.rados.rados.0.trial188.stdout:3983: writing trial18843701-36 from 709625 to 1120540 tid 1 2026-02-13T20:28:47.774 INFO:tasks.rados.rados.0.trial188.stdout:3983: writing trial18843701-36 from 1745329 to 2177469 tid 2 2026-02-13T20:28:47.778 INFO:tasks.rados.rados.0.trial188.stdout:3983: writing trial18843701-36 from 2726615 to 3109625 tid 3 2026-02-13T20:28:47.778 INFO:tasks.rados.rados.0.trial188.stdout:3984: write oid 28 current snap is 410 2026-02-13T20:28:47.778 INFO:tasks.rados.rados.0.trial188.stdout:3984: seq_num 1376 ranges {726432=486164,1803811=692151} 2026-02-13T20:28:47.782 INFO:tasks.rados.rados.0.trial188.stdout:3984: writing trial18843701-28 from 726432 to 1212596 tid 1 2026-02-13T20:28:47.787 INFO:tasks.rados.rados.0.trial188.stdout:3984: writing trial18843701-28 from 1803811 to 2495962 tid 2 2026-02-13T20:28:47.787 INFO:tasks.rados.rados.0.trial188.stdout:3985: write oid 9 current snap is 410 2026-02-13T20:28:47.787 INFO:tasks.rados.rados.0.trial188.stdout:3985: seq_num 1377 ranges {743239=677766,1978646=435809,2897814=245425} 2026-02-13T20:28:47.792 INFO:tasks.rados.rados.0.trial188.stdout:3985: writing trial18843701-9 from 743239 to 1421005 tid 1 2026-02-13T20:28:47.796 INFO:tasks.rados.rados.0.trial188.stdout:3985: writing trial18843701-9 from 1978646 to 2414455 tid 2 2026-02-13T20:28:47.800 INFO:tasks.rados.rados.0.trial188.stdout:3985: writing trial18843701-9 from 2897814 to 3143239 tid 3 2026-02-13T20:28:47.800 INFO:tasks.rados.rados.0.trial188.stdout:3986: snap_create 2026-02-13T20:28:47.800 INFO:tasks.rados.rados.0.trial188.stdout:3980: expect (ObjNum 1248 snap 375 seq_num 1248) 2026-02-13T20:28:47.808 INFO:tasks.rados.rados.0.trial188.stdout:seeking to 1964413 2026-02-13T20:28:47.845 INFO:tasks.rados.rados.0.trial188.stdout:3982: finishing write tid 1 to trial18843701-14 2026-02-13T20:28:47.845 INFO:tasks.rados.rados.0.trial188.stdout:3982: finishing write tid 2 to trial18843701-14 2026-02-13T20:28:47.846 INFO:tasks.rados.rados.0.trial188.stdout:3982: finishing write tid 3 to trial18843701-14 2026-02-13T20:28:47.846 INFO:tasks.rados.rados.0.trial188.stdout:3982: finishing write tid 4 to trial18843701-14 2026-02-13T20:28:47.846 INFO:tasks.rados.rados.0.trial188.stdout:3982: oid 14 updating version 0 to 1570 2026-02-13T20:28:47.846 INFO:tasks.rados.rados.0.trial188.stdout:3982: oid 14 version 1570 is already newer than 1569 2026-02-13T20:28:47.846 INFO:tasks.rados.rados.0.trial188.stdout:3982: oid 14 version 1570 is already newer than 1568 2026-02-13T20:28:47.846 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 14 v 1570 (ObjNum 1374 snap 410 seq_num 1374) dirty exists 2026-02-13T20:28:47.846 INFO:tasks.rados.rados.0.trial188.stdout:3982: left oid 14 (ObjNum 1374 snap 410 seq_num 1374) 2026-02-13T20:28:47.846 INFO:tasks.rados.rados.0.trial188.stdout:3983: finishing write tid 1 to trial18843701-36 2026-02-13T20:28:47.846 INFO:tasks.rados.rados.0.trial188.stdout:3983: finishing write tid 2 to trial18843701-36 2026-02-13T20:28:47.846 INFO:tasks.rados.rados.0.trial188.stdout:3984: finishing write tid 1 to trial18843701-28 2026-02-13T20:28:47.846 INFO:tasks.rados.rados.0.trial188.stdout:3983: finishing write tid 3 to trial18843701-36 2026-02-13T20:28:47.846 INFO:tasks.rados.rados.0.trial188.stdout:3984: finishing write tid 2 to trial18843701-28 2026-02-13T20:28:47.847 INFO:tasks.rados.rados.0.trial188.stdout:3984: finishing write tid 3 to trial18843701-28 2026-02-13T20:28:47.847 INFO:tasks.rados.rados.0.trial188.stdout:3984: finishing write tid 4 to trial18843701-28 2026-02-13T20:28:47.847 INFO:tasks.rados.rados.0.trial188.stdout:3984: oid 28 updating version 0 to 1958 2026-02-13T20:28:47.847 INFO:tasks.rados.rados.0.trial188.stdout:3984: oid 28 updating version 1958 to 1959 2026-02-13T20:28:47.847 INFO:tasks.rados.rados.0.trial188.stdout:3984: oid 28 updating version 1959 to 1960 2026-02-13T20:28:47.847 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 28 v 1960 (ObjNum 1376 snap 410 seq_num 1376) dirty exists 2026-02-13T20:28:47.847 INFO:tasks.rados.rados.0.trial188.stdout:3984: left oid 28 (ObjNum 1376 snap 410 seq_num 1376) 2026-02-13T20:28:47.847 INFO:tasks.rados.rados.0.trial188.stdout:3983: finishing write tid 4 to trial18843701-36 2026-02-13T20:28:47.847 INFO:tasks.rados.rados.0.trial188.stdout:3983: finishing write tid 5 to trial18843701-36 2026-02-13T20:28:47.847 INFO:tasks.rados.rados.0.trial188.stdout:3983: oid 36 updating version 0 to 2046 2026-02-13T20:28:47.847 INFO:tasks.rados.rados.0.trial188.stdout:3983: oid 36 version 2046 is already newer than 2044 2026-02-13T20:28:47.847 INFO:tasks.rados.rados.0.trial188.stdout:3983: oid 36 version 2046 is already newer than 2045 2026-02-13T20:28:47.847 INFO:tasks.rados.rados.0.trial188.stdout:3983: oid 36 version 2046 is already newer than 2043 2026-02-13T20:28:47.848 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 36 v 2046 (ObjNum 1375 snap 410 seq_num 1375) dirty exists 2026-02-13T20:28:47.848 INFO:tasks.rados.rados.0.trial188.stdout:3983: left oid 36 (ObjNum 1375 snap 410 seq_num 1375) 2026-02-13T20:28:47.848 INFO:tasks.rados.rados.0.trial188.stdout:3985: finishing write tid 1 to trial18843701-9 2026-02-13T20:28:47.848 INFO:tasks.rados.rados.0.trial188.stdout:3985: finishing write tid 2 to trial18843701-9 2026-02-13T20:28:47.848 INFO:tasks.rados.rados.0.trial188.stdout:3985: finishing write tid 3 to trial18843701-9 2026-02-13T20:28:47.848 INFO:tasks.rados.rados.0.trial188.stdout:3985: finishing write tid 4 to trial18843701-9 2026-02-13T20:28:47.848 INFO:tasks.rados.rados.0.trial188.stdout:3985: finishing write tid 5 to trial18843701-9 2026-02-13T20:28:47.848 INFO:tasks.rados.rados.0.trial188.stdout:3985: oid 9 updating version 0 to 1590 2026-02-13T20:28:47.848 INFO:tasks.rados.rados.0.trial188.stdout:3985: oid 9 version 1590 is already newer than 1589 2026-02-13T20:28:47.848 INFO:tasks.rados.rados.0.trial188.stdout:3985: oid 9 updating version 1590 to 1592 2026-02-13T20:28:47.848 INFO:tasks.rados.rados.0.trial188.stdout:3985: oid 9 version 1592 is already newer than 1591 2026-02-13T20:28:47.848 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 9 v 1592 (ObjNum 1377 snap 410 seq_num 1377) dirty exists 2026-02-13T20:28:47.849 INFO:tasks.rados.rados.0.trial188.stdout:3985: left oid 9 (ObjNum 1377 snap 410 seq_num 1377) 2026-02-13T20:28:48.758 INFO:tasks.rados.rados.0.trial188.stdout:3980: done (5 left) 2026-02-13T20:28:48.758 INFO:tasks.rados.rados.0.trial188.stdout:3982: done (4 left) 2026-02-13T20:28:48.758 INFO:tasks.rados.rados.0.trial188.stdout:3983: done (3 left) 2026-02-13T20:28:48.758 INFO:tasks.rados.rados.0.trial188.stdout:3984: done (2 left) 2026-02-13T20:28:48.758 INFO:tasks.rados.rados.0.trial188.stdout:3985: done (1 left) 2026-02-13T20:28:48.758 INFO:tasks.rados.rados.0.trial188.stdout:3986: done (0 left) 2026-02-13T20:28:48.758 INFO:tasks.rados.rados.0.trial188.stdout:3987: read oid 34 snap 399 2026-02-13T20:28:48.759 INFO:tasks.rados.rados.0.trial188.stdout:3987: expect (ObjNum 1258 snap 378 seq_num 1258) 2026-02-13T20:28:48.759 INFO:tasks.rados.rados.0.trial188.stdout:3988: snap_create 2026-02-13T20:28:48.769 INFO:tasks.rados.rados.0.trial188.stdout:3987: expect (ObjNum 1258 snap 378 seq_num 1258) 2026-02-13T20:28:49.759 INFO:tasks.rados.rados.0.trial188.stdout:3987: done (1 left) 2026-02-13T20:28:49.760 INFO:tasks.rados.rados.0.trial188.stdout:3988: done (0 left) 2026-02-13T20:28:49.760 INFO:tasks.rados.rados.0.trial188.stdout:3989: rollback oid 44 current snap is 412 2026-02-13T20:28:49.760 INFO:tasks.rados.rados.0.trial188.stdout:rollback oid 44 to 411 2026-02-13T20:28:49.760 INFO:tasks.rados.rados.0.trial188.stdout:3990: write oid 50 current snap is 412 2026-02-13T20:28:49.760 INFO:tasks.rados.rados.0.trial188.stdout:3990: seq_num 1378 ranges {760046=753015,2037128=695820} 2026-02-13T20:28:49.766 INFO:tasks.rados.rados.0.trial188.stdout:3990: writing trial18843701-50 from 760046 to 1513061 tid 1 2026-02-13T20:28:49.771 INFO:tasks.rados.rados.0.trial188.stdout:3990: writing trial18843701-50 from 2037128 to 2732948 tid 2 2026-02-13T20:28:49.771 INFO:tasks.rados.rados.0.trial188.stdout:3991: delete oid 11 current snap is 412 2026-02-13T20:28:49.771 INFO:tasks.rados.rados.0.trial188.stdout:3989: finishing rollback tid 0 to trial18843701-44 2026-02-13T20:28:49.771 INFO:tasks.rados.rados.0.trial188.stdout:3989: finishing rollback tid 1 to trial18843701-44 2026-02-13T20:28:49.771 INFO:tasks.rados.rados.0.trial188.stdout:3989: finishing rollback tid 2 to trial18843701-44 2026-02-13T20:28:49.771 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 44 v 1985 (ObjNum 1320 snap 393 seq_num 1320) dirty exists 2026-02-13T20:28:49.788 INFO:tasks.rados.rados.0.trial188.stdout:3989: done (2 left) 2026-02-13T20:28:49.788 INFO:tasks.rados.rados.0.trial188.stdout:3991: done (1 left) 2026-02-13T20:28:49.789 INFO:tasks.rados.rados.0.trial188.stdout:3992: write (excl) oid 34 current snap is 412 2026-02-13T20:28:49.789 INFO:tasks.rados.rados.0.trial188.stdout:3992: seq_num 1380 ranges {793660=503513,2037739=583136} 2026-02-13T20:28:49.794 INFO:tasks.rados.rados.0.trial188.stdout:3992: writing trial18843701-34 from 793660 to 1297173 tid 1 2026-02-13T20:28:49.799 INFO:tasks.rados.rados.0.trial188.stdout:3992: writing trial18843701-34 from 2037739 to 2620875 tid 2 2026-02-13T20:28:49.799 INFO:tasks.rados.rados.0.trial188.stdout:3993: read oid 38 snap -1 2026-02-13T20:28:49.799 INFO:tasks.rados.rados.0.trial188.stdout:3993: expect deleted 2026-02-13T20:28:49.799 INFO:tasks.rados.rados.0.trial188.stdout:3994: read oid 7 snap 407 2026-02-13T20:28:49.799 INFO:tasks.rados.rados.0.trial188.stdout:3994: expect deleted 2026-02-13T20:28:49.800 INFO:tasks.rados.rados.0.trial188.stdout:3995: write oid 41 current snap is 412 2026-02-13T20:28:49.800 INFO:tasks.rados.rados.0.trial188.stdout:3995: seq_num 1381 ranges {410467=578762,1696221=443147,2891153=319314} 2026-02-13T20:28:49.802 INFO:tasks.rados.rados.0.trial188.stdout:3995: writing trial18843701-41 from 410467 to 989229 tid 1 2026-02-13T20:28:49.807 INFO:tasks.rados.rados.0.trial188.stdout:3995: writing trial18843701-41 from 1696221 to 2139368 tid 2 2026-02-13T20:28:49.811 INFO:tasks.rados.rados.0.trial188.stdout:3995: writing trial18843701-41 from 2891153 to 3210467 tid 3 2026-02-13T20:28:49.812 INFO:tasks.rados.rados.0.trial188.stdout:3996: read oid 42 snap -1 2026-02-13T20:28:49.812 INFO:tasks.rados.rados.0.trial188.stdout:3996: expect deleted 2026-02-13T20:28:49.812 INFO:tasks.rados.rados.0.trial188.stdout:3997: copy_from oid 8 from oid 23 current snap is 412 2026-02-13T20:28:49.812 INFO:tasks.rados.rados.0.trial188.stdout:3990: finishing write tid 1 to trial18843701-50 2026-02-13T20:28:49.812 INFO:tasks.rados.rados.0.trial188.stdout:3990: finishing write tid 2 to trial18843701-50 2026-02-13T20:28:49.812 INFO:tasks.rados.rados.0.trial188.stdout:3990: finishing write tid 3 to trial18843701-50 2026-02-13T20:28:49.812 INFO:tasks.rados.rados.0.trial188.stdout:3990: finishing write tid 4 to trial18843701-50 2026-02-13T20:28:49.812 INFO:tasks.rados.rados.0.trial188.stdout:3990: oid 50 updating version 0 to 2048 2026-02-13T20:28:49.812 INFO:tasks.rados.rados.0.trial188.stdout:3990: oid 50 updating version 2048 to 2049 2026-02-13T20:28:49.812 INFO:tasks.rados.rados.0.trial188.stdout:3990: oid 50 updating version 2049 to 2050 2026-02-13T20:28:49.812 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 50 v 2050 (ObjNum 1378 snap 412 seq_num 1378) dirty exists 2026-02-13T20:28:49.813 INFO:tasks.rados.rados.0.trial188.stdout:3990: left oid 50 (ObjNum 1378 snap 412 seq_num 1378) 2026-02-13T20:28:49.813 INFO:tasks.rados.rados.0.trial188.stdout:3990: done (6 left) 2026-02-13T20:28:49.813 INFO:tasks.rados.rados.0.trial188.stdout:3998: write oid 39 current snap is 412 2026-02-13T20:28:49.813 INFO:tasks.rados.rados.0.trial188.stdout:3998: seq_num 1382 ranges {427274=654011,1754703=586805,2918576=308698} 2026-02-13T20:28:49.815 INFO:tasks.rados.rados.0.trial188.stdout:3998: writing trial18843701-39 from 427274 to 1081285 tid 1 2026-02-13T20:28:49.820 INFO:tasks.rados.rados.0.trial188.stdout:3998: writing trial18843701-39 from 1754703 to 2341508 tid 2 2026-02-13T20:28:49.823 INFO:tasks.rados.rados.0.trial188.stdout:3998: writing trial18843701-39 from 2918576 to 3227274 tid 3 2026-02-13T20:28:49.823 INFO:tasks.rados.rados.0.trial188.stdout:3999: write (excl) oid 26 current snap is 412 2026-02-13T20:28:49.823 INFO:tasks.rados.rados.0.trial188.stdout:3999: seq_num 1383 ranges {444081=729260,1813185=446816,2945999=298082} 2026-02-13T20:28:49.827 INFO:tasks.rados.rados.0.trial188.stdout:3999: writing trial18843701-26 from 444081 to 1173341 tid 1 2026-02-13T20:28:49.831 INFO:tasks.rados.rados.0.trial188.stdout:3999: writing trial18843701-26 from 1813185 to 2260001 tid 2 2026-02-13T20:28:49.836 INFO:tasks.rados.rados.0.trial188.stdout:3999: writing trial18843701-26 from 2945999 to 3244081 tid 3 2026-02-13T20:28:49.836 INFO:tasks.rados.rados.0.trial188.stdout: waiting on 8 2026-02-13T20:28:49.836 INFO:tasks.rados.rados.0.trial188.stdout:3993: done (7 left) 2026-02-13T20:28:49.836 INFO:tasks.rados.rados.0.trial188.stdout:3994: done (6 left) 2026-02-13T20:28:49.836 INFO:tasks.rados.rados.0.trial188.stdout: waiting on 6 2026-02-13T20:28:49.837 INFO:tasks.rados.rados.0.trial188.stdout:3992: finishing write tid 1 to trial18843701-34 2026-02-13T20:28:49.837 INFO:tasks.rados.rados.0.trial188.stdout:3992: finishing write tid 2 to trial18843701-34 2026-02-13T20:28:49.837 INFO:tasks.rados.rados.0.trial188.stdout:3992: finishing write tid 3 to trial18843701-34 2026-02-13T20:28:49.837 INFO:tasks.rados.rados.0.trial188.stdout:3996: done (5 left) 2026-02-13T20:28:49.837 INFO:tasks.rados.rados.0.trial188.stdout: waiting on 5 2026-02-13T20:28:49.837 INFO:tasks.rados.rados.0.trial188.stdout:3992: finishing write tid 4 to trial18843701-34 2026-02-13T20:28:49.837 INFO:tasks.rados.rados.0.trial188.stdout:3992: oid 34 updating version 0 to 1962 2026-02-13T20:28:49.837 INFO:tasks.rados.rados.0.trial188.stdout:3992: oid 34 updating version 1962 to 1963 2026-02-13T20:28:49.837 INFO:tasks.rados.rados.0.trial188.stdout:3992: oid 34 updating version 1963 to 1964 2026-02-13T20:28:49.837 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 34 v 1964 (ObjNum 1380 snap 412 seq_num 1380) dirty exists 2026-02-13T20:28:49.837 INFO:tasks.rados.rados.0.trial188.stdout:3992: left oid 34 (ObjNum 1380 snap 412 seq_num 1380) 2026-02-13T20:28:49.837 INFO:tasks.rados.rados.0.trial188.stdout:3995: finishing write tid 1 to trial18843701-41 2026-02-13T20:28:49.838 INFO:tasks.rados.rados.0.trial188.stdout:3995: finishing write tid 2 to trial18843701-41 2026-02-13T20:28:49.838 INFO:tasks.rados.rados.0.trial188.stdout:3992: done (4 left) 2026-02-13T20:28:49.838 INFO:tasks.rados.rados.0.trial188.stdout: waiting on 4 2026-02-13T20:28:49.838 INFO:tasks.rados.rados.0.trial188.stdout:3995: finishing write tid 3 to trial18843701-41 2026-02-13T20:28:49.838 INFO:tasks.rados.rados.0.trial188.stdout:3995: finishing write tid 4 to trial18843701-41 2026-02-13T20:28:49.838 INFO:tasks.rados.rados.0.trial188.stdout:3995: finishing write tid 5 to trial18843701-41 2026-02-13T20:28:49.838 INFO:tasks.rados.rados.0.trial188.stdout:3995: oid 41 updating version 0 to 1777 2026-02-13T20:28:49.838 INFO:tasks.rados.rados.0.trial188.stdout:3995: oid 41 version 1777 is already newer than 1775 2026-02-13T20:28:49.838 INFO:tasks.rados.rados.0.trial188.stdout:3995: oid 41 version 1777 is already newer than 1774 2026-02-13T20:28:49.838 INFO:tasks.rados.rados.0.trial188.stdout:3995: oid 41 version 1777 is already newer than 1776 2026-02-13T20:28:49.838 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 41 v 1777 (ObjNum 1381 snap 412 seq_num 1381) dirty exists 2026-02-13T20:28:49.838 INFO:tasks.rados.rados.0.trial188.stdout:3995: left oid 41 (ObjNum 1381 snap 412 seq_num 1381) 2026-02-13T20:28:49.838 INFO:tasks.rados.rados.0.trial188.stdout:3995: done (3 left) 2026-02-13T20:28:49.839 INFO:tasks.rados.rados.0.trial188.stdout: waiting on 3 2026-02-13T20:28:49.839 INFO:tasks.rados.rados.0.trial188.stdout:3998: finishing write tid 1 to trial18843701-39 2026-02-13T20:28:49.846 INFO:tasks.rados.rados.0.trial188.stdout:3998: finishing write tid 2 to trial18843701-39 2026-02-13T20:28:49.848 INFO:tasks.rados.rados.0.trial188.stdout:3997: finishing copy_from racing read to trial18843701-8 2026-02-13T20:28:49.857 INFO:tasks.rados.rados.0.trial188.stdout:3999: finishing write tid 1 to trial18843701-26 2026-02-13T20:28:49.857 INFO:tasks.rados.rados.0.trial188.stdout:3997: finishing copy_from to trial18843701-8 2026-02-13T20:28:49.857 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 8 v 2012 (ObjNum 1361 snap 406 seq_num 1361) dirty exists 2026-02-13T20:28:49.857 INFO:tasks.rados.rados.0.trial188.stdout:3997: done (2 left) 2026-02-13T20:28:49.857 INFO:tasks.rados.rados.0.trial188.stdout: waiting on 2 2026-02-13T20:28:49.860 INFO:tasks.rados.rados.0.trial188.stdout:3998: finishing write tid 3 to trial18843701-39 2026-02-13T20:28:49.861 INFO:tasks.rados.rados.0.trial188.stdout:3999: finishing write tid 2 to trial18843701-26 2026-02-13T20:28:49.861 INFO:tasks.rados.rados.0.trial188.stdout:3998: finishing write tid 4 to trial18843701-39 2026-02-13T20:28:49.861 INFO:tasks.rados.rados.0.trial188.stdout:3998: finishing write tid 5 to trial18843701-39 2026-02-13T20:28:49.861 INFO:tasks.rados.rados.0.trial188.stdout:3998: oid 39 updating version 0 to 1989 2026-02-13T20:28:49.861 INFO:tasks.rados.rados.0.trial188.stdout:3998: oid 39 version 1989 is already newer than 1988 2026-02-13T20:28:49.861 INFO:tasks.rados.rados.0.trial188.stdout:3998: oid 39 updating version 1989 to 1991 2026-02-13T20:28:49.861 INFO:tasks.rados.rados.0.trial188.stdout:3998: oid 39 version 1991 is already newer than 1990 2026-02-13T20:28:49.861 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 39 v 1991 (ObjNum 1382 snap 412 seq_num 1382) dirty exists 2026-02-13T20:28:49.861 INFO:tasks.rados.rados.0.trial188.stdout:3998: left oid 39 (ObjNum 1382 snap 412 seq_num 1382) 2026-02-13T20:28:49.861 INFO:tasks.rados.rados.0.trial188.stdout:3998: done (1 left) 2026-02-13T20:28:49.862 INFO:tasks.rados.rados.0.trial188.stdout: waiting on 1 2026-02-13T20:28:49.862 INFO:tasks.rados.rados.0.trial188.stdout:3999: finishing write tid 3 to trial18843701-26 2026-02-13T20:28:49.862 INFO:tasks.rados.rados.0.trial188.stdout:3999: finishing write tid 4 to trial18843701-26 2026-02-13T20:28:49.862 INFO:tasks.rados.rados.0.trial188.stdout:3999: finishing write tid 5 to trial18843701-26 2026-02-13T20:28:49.862 INFO:tasks.rados.rados.0.trial188.stdout:3999: oid 26 updating version 0 to 1572 2026-02-13T20:28:49.862 INFO:tasks.rados.rados.0.trial188.stdout:3999: oid 26 updating version 1572 to 1574 2026-02-13T20:28:49.862 INFO:tasks.rados.rados.0.trial188.stdout:3999: oid 26 version 1574 is already newer than 1573 2026-02-13T20:28:49.862 INFO:tasks.rados.rados.0.trial188.stdout:3999: oid 26 version 1574 is already newer than 1571 2026-02-13T20:28:49.862 INFO:tasks.rados.rados.0.trial188.stdout:update_object_version oid 26 v 1574 (ObjNum 1383 snap 412 seq_num 1383) dirty exists 2026-02-13T20:28:49.862 INFO:tasks.rados.rados.0.trial188.stdout:3999: left oid 26 (ObjNum 1383 snap 412 seq_num 1383) 2026-02-13T20:28:49.862 INFO:tasks.rados.rados.0.trial188.stdout:3999: done (0 left) 2026-02-13T20:28:49.863 INFO:tasks.rados.rados.0.trial188.stderr:0 errors. 2026-02-13T20:28:49.864 INFO:tasks.rados.rados.0.trial188.stderr: 2026-02-13T20:28:50.009 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-13T20:28:50.079 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.079+0000 7ffada90c640 10 monclient: get_monmap_and_config 2026-02-13T20:28:50.080 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.079+0000 7ffada90c640 10 monclient: build_initial_monmap 2026-02-13T20:28:50.080 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.079+0000 7ffada90c640 10 monclient: monmap: 2026-02-13T20:28:50.080 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:28:50.080 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:28:50.080 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:28:50.079999+0000 2026-02-13T20:28:50.080 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:28:50.079999+0000 2026-02-13T20:28:50.080 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:28:50.080 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:28:50.081 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:28:50.081 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:28:50.081 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:28:50.081 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:28:50.089 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.080+0000 7ffada90c640 1 Processor -- start 2026-02-13T20:28:50.089 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.080+0000 7ffada90c640 1 -- start start 2026-02-13T20:28:50.089 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.080+0000 7ffada90c640 10 monclient: init 2026-02-13T20:28:50.089 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.080+0000 7ffada90c640 10 monclient: _reopen_session rank -1 2026-02-13T20:28:50.089 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.080+0000 7ffada90c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:28:50.089 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.080+0000 7ffada90c640 10 monclient(hunting): picked mon.noname-a con 0x7ffad4089250 addr v1:10.20.193.110:6789/0 2026-02-13T20:28:50.089 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.080+0000 7ffada90c640 10 monclient(hunting): picked mon.noname-c con 0x7ffad4057780 addr v1:10.20.193.188:6789/0 2026-02-13T20:28:50.089 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.080+0000 7ffada90c640 10 monclient(hunting): picked mon.noname-b con 0x7ffad4184b60 addr v1:10.20.193.110:6790/0 2026-02-13T20:28:50.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.080+0000 7ffada90c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffad408a950 con 0x7ffad4089250 2026-02-13T20:28:50.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.080+0000 7ffada90c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffad4089620 con 0x7ffad4057780 2026-02-13T20:28:50.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.080+0000 7ffada90c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffad4057c60 con 0x7ffad4184b60 2026-02-13T20:28:50.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.080+0000 7ffada90c640 10 monclient(hunting): _renew_subs 2026-02-13T20:28:50.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.080+0000 7ffada90c640 10 monclient(hunting): authenticate will time out at 1691.770462s 2026-02-13T20:28:50.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.080+0000 7ffad37fe640 1 -- >> v1:10.20.193.188:6789/0 conn(0x7ffad4057780 legacy=0x7ffad4183440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:28:50.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.080+0000 7ffad8e82640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7ffad4184b60 0x7ffad41a4f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:34220/0 (socket says 10.20.193.110:34220) 2026-02-13T20:28:50.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.080+0000 7ffad3fff640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7ffad4089250 0x7ffad40580b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:56878/0 (socket says 10.20.193.110:56878) 2026-02-13T20:28:50.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.080+0000 7ffad8e82640 1 -- 10.20.193.110:0/2971700973 learned_addr learned my addr 10.20.193.110:0/2971700973 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:28:50.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.080+0000 7ffad2ffd640 1 -- 10.20.193.110:0/2971700973 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 466858138 0 0) 0x7ffad4057c60 con 0x7ffad4184b60 2026-02-13T20:28:50.090 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.080+0000 7ffad2ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:28:50.091 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.080+0000 7ffad2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:28:50.091 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.080+0000 7ffad2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:28:50.091 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.080+0000 7ffad2ffd640 10 monclient(hunting): my global_id is 154202 2026-02-13T20:28:50.091 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.080+0000 7ffad2ffd640 1 -- 10.20.193.110:0/2971700973 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffab80035e0 con 0x7ffad4184b60 2026-02-13T20:28:50.091 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.080+0000 7ffad2ffd640 1 -- 10.20.193.110:0/2971700973 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1460382951 0 0) 0x7ffad408a950 con 0x7ffad4089250 2026-02-13T20:28:50.091 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.080+0000 7ffad2ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:28:50.091 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.080+0000 7ffad2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:28:50.091 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.080+0000 7ffad2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:28:50.091 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.080+0000 7ffad2ffd640 10 monclient(hunting): my global_id is 124488 2026-02-13T20:28:50.091 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.080+0000 7ffad2ffd640 1 -- 10.20.193.110:0/2971700973 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffad4057c60 con 0x7ffad4089250 2026-02-13T20:28:50.091 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.080+0000 7ffad2ffd640 1 -- 10.20.193.110:0/2971700973 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2449320640 0 0) 0x7ffab80035e0 con 0x7ffad4184b60 2026-02-13T20:28:50.091 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.080+0000 7ffad2ffd640 1 -- 10.20.193.110:0/2971700973 >> v1:10.20.193.188:6789/0 conn(0x7ffad4057780 legacy=0x7ffad4183440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:28:50.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.080+0000 7ffad2ffd640 1 -- 10.20.193.110:0/2971700973 >> v1:10.20.193.110:6789/0 conn(0x7ffad4089250 legacy=0x7ffad40580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:28:50.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.081+0000 7ffad2ffd640 10 monclient: _finish_hunting 0 2026-02-13T20:28:50.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.081+0000 7ffad2ffd640 1 monclient: found mon.noname-b 2026-02-13T20:28:50.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.081+0000 7ffad2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:28:50.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.081+0000 7ffad2ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:28:50.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.081+0000 7ffad2ffd640 1 -- 10.20.193.110:0/2971700973 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffad4089a50 con 0x7ffad4184b60 2026-02-13T20:28:50.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.081+0000 7ffad2ffd640 10 monclient: _finish_auth 0 2026-02-13T20:28:50.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.081+0000 7ffad2ffd640 10 monclient: _check_auth_tickets 2026-02-13T20:28:50.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.081+0000 7ffad2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:28:50.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.081+0000 7ffad2ffd640 1 -- 10.20.193.110:0/2971700973 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ffac8003eb0 con 0x7ffad4184b60 2026-02-13T20:28:50.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.081+0000 7ffada90c640 5 monclient: authenticate success, global_id 154202 2026-02-13T20:28:50.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.081+0000 7ffada90c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:28:50.092 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.081+0000 7ffad2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:28:50.093 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.081+0000 7ffad2ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:28:50.093 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.081+0000 7ffad2ffd640 10 monclient: dump: 2026-02-13T20:28:50.093 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:28:50.093 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:28:50.093 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:28:50.093 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:28:50.093 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:28:50.093 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:28:50.093 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:28:50.093 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:28:50.093 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:28:50.093 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:28:50.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.081+0000 7ffada90c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:28:50.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.081+0000 7ffad2ffd640 1 -- 10.20.193.110:0/2971700973 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ffac8004130 con 0x7ffad4184b60 2026-02-13T20:28:50.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.081+0000 7ffad2ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:28:50.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.081+0000 7ffad2ffd640 1 -- 10.20.193.110:0/2971700973 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ffac8004540 con 0x7ffad4184b60 2026-02-13T20:28:50.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.081+0000 7ffad2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:28:50.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.081+0000 7ffad2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:28:50.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.081+0000 7ffad2ffd640 10 monclient: dump: 2026-02-13T20:28:50.094 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:28:50.094 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:28:50.094 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:28:50.094 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:28:50.094 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:28:50.095 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:28:50.095 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:28:50.095 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:28:50.095 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:28:50.095 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:28:50.095 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.081+0000 7ffada90c640 10 monclient: get_monmap_and_config success 2026-02-13T20:28:50.095 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.081+0000 7ffada90c640 4 set_mon_vals no callback set 2026-02-13T20:28:50.095 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.081+0000 7ffada90c640 10 monclient: shutdown 2026-02-13T20:28:50.095 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.081+0000 7ffada90c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:28:50.095 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.081+0000 7ffada90c640 1 -- 10.20.193.110:0/2971700973 >> v1:10.20.193.110:6790/0 conn(0x7ffad4184b60 legacy=0x7ffad41a4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:28:50.095 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.081+0000 7ffada90c640 1 -- 10.20.193.110:0/2971700973 shutdown_connections 2026-02-13T20:28:50.095 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.081+0000 7ffada90c640 1 -- 10.20.193.110:0/2971700973 >> 10.20.193.110:0/2971700973 conn(0x7ffad4054330 msgr2=0x7ffad4054730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:28:50.096 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.081+0000 7ffada90c640 1 -- 10.20.193.110:0/2971700973 shutdown_connections 2026-02-13T20:28:50.096 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.081+0000 7ffada90c640 1 -- 10.20.193.110:0/2971700973 wait complete. 2026-02-13T20:28:50.096 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.081+0000 7ffada90c640 10 monclient: build_initial_monmap 2026-02-13T20:28:50.096 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.081+0000 7ffada90c640 10 monclient: monmap: 2026-02-13T20:28:50.096 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:28:50.096 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:28:50.096 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:28:50.096 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:28:50.096 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:28:50.096 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:28:50.096 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:28:50.096 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:28:50.096 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:28:50.097 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:28:50.097 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.082+0000 7ffada90c640 1 Processor -- start 2026-02-13T20:28:50.097 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.082+0000 7ffada90c640 1 -- start start 2026-02-13T20:28:50.097 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.082+0000 7ffada90c640 10 monclient: init 2026-02-13T20:28:50.097 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.082+0000 7ffada90c640 10 monclient: _reopen_session rank -1 2026-02-13T20:28:50.097 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.082+0000 7ffada90c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:28:50.097 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.082+0000 7ffada90c640 10 monclient(hunting): picked mon.noname-c con 0x7ffad4057780 addr v1:10.20.193.110:6790/0 2026-02-13T20:28:50.097 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.082+0000 7ffada90c640 10 monclient(hunting): picked mon.noname-a con 0x7ffad4089250 addr v1:10.20.193.110:6789/0 2026-02-13T20:28:50.097 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.082+0000 7ffada90c640 10 monclient(hunting): picked mon.noname-b con 0x7ffad4184b60 addr v1:10.20.193.188:6789/0 2026-02-13T20:28:50.097 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.082+0000 7ffada90c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffad408a160 con 0x7ffad4089250 2026-02-13T20:28:50.097 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.082+0000 7ffada90c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffad408d650 con 0x7ffad4184b60 2026-02-13T20:28:50.097 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.082+0000 7ffada90c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffad41a4a70 con 0x7ffad4057780 2026-02-13T20:28:50.098 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.082+0000 7ffada90c640 10 monclient(hunting): _renew_subs 2026-02-13T20:28:50.098 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.082+0000 7ffada90c640 10 monclient(hunting): authenticate will time out at 1691.772542s 2026-02-13T20:28:50.098 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.082+0000 7ffad3fff640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7ffad4057780 0x7ffad41a1980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:34228/0 (socket says 10.20.193.110:34228) 2026-02-13T20:28:50.098 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.082+0000 7ffad37fe640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7ffad4089250 0x7ffad41a2090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:56890/0 (socket says 10.20.193.110:56890) 2026-02-13T20:28:50.098 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.082+0000 7ffad3fff640 1 -- 10.20.193.110:0/2466465404 learned_addr learned my addr 10.20.193.110:0/2466465404 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:28:50.098 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.082+0000 7ffad8e82640 1 -- 10.20.193.110:0/2466465404 >> v1:10.20.193.188:6789/0 conn(0x7ffad4184b60 legacy=0x7ffad4173210 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:28:50.098 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.082+0000 7ffad0ff9640 1 -- 10.20.193.110:0/2466465404 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2390447358 0 0) 0x7ffad41a4a70 con 0x7ffad4057780 2026-02-13T20:28:50.098 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.082+0000 7ffad0ff9640 10 monclient(hunting): _negotiate 2026-02-13T20:28:50.098 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.082+0000 7ffad0ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:28:50.098 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.082+0000 7ffad0ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:28:50.098 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.082+0000 7ffad0ff9640 10 monclient(hunting): my global_id is 154205 2026-02-13T20:28:50.098 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.082+0000 7ffad0ff9640 1 -- 10.20.193.110:0/2466465404 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffaa40035e0 con 0x7ffad4057780 2026-02-13T20:28:50.099 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.082+0000 7ffad0ff9640 1 -- 10.20.193.110:0/2466465404 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2270037750 0 0) 0x7ffad408a160 con 0x7ffad4089250 2026-02-13T20:28:50.099 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.082+0000 7ffad0ff9640 10 monclient(hunting): _negotiate 2026-02-13T20:28:50.099 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.082+0000 7ffad0ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:28:50.099 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.082+0000 7ffad0ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:28:50.099 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.082+0000 7ffad0ff9640 10 monclient(hunting): my global_id is 124491 2026-02-13T20:28:50.099 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.082+0000 7ffad0ff9640 1 -- 10.20.193.110:0/2466465404 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffad41a4a70 con 0x7ffad4089250 2026-02-13T20:28:50.099 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.082+0000 7ffad0ff9640 1 -- 10.20.193.110:0/2466465404 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 810998224 0 0) 0x7ffaa40035e0 con 0x7ffad4057780 2026-02-13T20:28:50.099 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.082+0000 7ffad0ff9640 1 -- 10.20.193.110:0/2466465404 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffad408a160 con 0x7ffad4057780 2026-02-13T20:28:50.099 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.082+0000 7ffad0ff9640 1 -- 10.20.193.110:0/2466465404 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ffac0003170 con 0x7ffad4057780 2026-02-13T20:28:50.099 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.082+0000 7ffad0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:28:50.099 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.082+0000 7ffad0ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:28:50.099 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.082+0000 7ffad0ff9640 10 monclient(hunting): dump: 2026-02-13T20:28:50.099 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:28:50.100 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:28:50.100 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:28:50.100 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:28:50.100 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:28:50.100 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:28:50.100 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:28:50.100 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:28:50.100 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:28:50.100 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:28:50.100 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.082+0000 7ffad0ff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:28:50.100 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.082+0000 7ffad0ff9640 1 -- 10.20.193.110:0/2466465404 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3395041098 0 0) 0x7ffad41a4a70 con 0x7ffad4089250 2026-02-13T20:28:50.100 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.082+0000 7ffad0ff9640 1 -- 10.20.193.110:0/2466465404 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffaa40035e0 con 0x7ffad4089250 2026-02-13T20:28:50.100 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.082+0000 7ffad0ff9640 1 -- 10.20.193.110:0/2466465404 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ffac4004140 con 0x7ffad4089250 2026-02-13T20:28:50.101 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.082+0000 7ffad0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:28:50.101 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.082+0000 7ffad0ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:28:50.101 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.082+0000 7ffad0ff9640 10 monclient(hunting): dump: 2026-02-13T20:28:50.101 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:28:50.101 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:28:50.101 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:28:50.101 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:28:50.101 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:28:50.101 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:28:50.101 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:28:50.101 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:28:50.101 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:28:50.101 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:28:50.102 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.083+0000 7ffad0ff9640 1 -- 10.20.193.110:0/2466465404 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3194731283 0 0) 0x7ffad408a160 con 0x7ffad4057780 2026-02-13T20:28:50.102 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.083+0000 7ffad0ff9640 1 -- 10.20.193.110:0/2466465404 >> v1:10.20.193.188:6789/0 conn(0x7ffad4184b60 legacy=0x7ffad4173210 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T20:28:50.102 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.083+0000 7ffad0ff9640 1 -- 10.20.193.110:0/2466465404 >> v1:10.20.193.110:6789/0 conn(0x7ffad4089250 legacy=0x7ffad41a2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:28:50.102 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.083+0000 7ffad0ff9640 10 monclient: _finish_hunting 0 2026-02-13T20:28:50.102 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.083+0000 7ffad0ff9640 1 monclient: found mon.c 2026-02-13T20:28:50.102 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.083+0000 7ffad0ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:28:50.102 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.083+0000 7ffad0ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:28:50.102 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.083+0000 7ffad0ff9640 1 -- 10.20.193.110:0/2466465404 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffad41a27a0 con 0x7ffad4057780 2026-02-13T20:28:50.102 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.083+0000 7ffad0ff9640 10 monclient: _finish_auth 0 2026-02-13T20:28:50.102 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.083+0000 7ffad0ff9640 10 monclient: _check_auth_tickets 2026-02-13T20:28:50.102 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.083+0000 7ffad0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:28:50.103 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.083+0000 7ffada90c640 5 monclient: authenticate success, global_id 154205 2026-02-13T20:28:50.103 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.083+0000 7ffada90c640 10 monclient: _renew_subs 2026-02-13T20:28:50.103 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.083+0000 7ffada90c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:28:50.103 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.083+0000 7ffada90c640 1 -- 10.20.193.110:0/2466465404 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ffad41a6450 con 0x7ffad4057780 2026-02-13T20:28:50.103 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.083+0000 7ffada90c640 10 monclient: _renew_subs 2026-02-13T20:28:50.103 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.083+0000 7ffada90c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:28:50.103 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.083+0000 7ffada90c640 1 -- 10.20.193.110:0/2466465404 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7ffad41a3c00 con 0x7ffad4057780 2026-02-13T20:28:50.103 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.083+0000 7ffad0ff9640 1 -- 10.20.193.110:0/2466465404 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ffac0003480 con 0x7ffad4057780 2026-02-13T20:28:50.103 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.083+0000 7ffad0ff9640 10 monclient: handle_config config(0 keys) 2026-02-13T20:28:50.103 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.083+0000 7ffad0ff9640 1 -- 10.20.193.110:0/2466465404 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7ffac0004d00 con 0x7ffad4057780 2026-02-13T20:28:50.103 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.083+0000 7ffad0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:28:50.103 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.083+0000 7ffad0ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:28:50.103 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.083+0000 7ffad27fc640 4 set_mon_vals no callback set 2026-02-13T20:28:50.104 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.083+0000 7ffad0ff9640 10 monclient: dump: 2026-02-13T20:28:50.104 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:28:50.104 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:28:50.104 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:28:50.104 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:28:50.104 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:28:50.104 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:28:50.104 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:28:50.104 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:28:50.104 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:28:50.104 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:28:50.104 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.083+0000 7ffada90c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:28:50.104 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.083+0000 7ffada90c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:28:50.105 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.083+0000 7ffada90c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:28:50.105 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.083+0000 7ffada90c640 1 -- 10.20.193.110:0/2466465404 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffad4089030 con 0x7ffad4057780 2026-02-13T20:28:50.105 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.083+0000 7ffad0ff9640 1 -- 10.20.193.110:0/2466465404 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7ffac0011970 con 0x7ffad4057780 2026-02-13T20:28:50.105 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.083+0000 7ffad0ff9640 1 -- 10.20.193.110:0/2466465404 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(846..846 src has 1..846) ==== 3931+0+0 (unknown 1574598522 0 0) 0x7ffac004e9e0 con 0x7ffad4057780 2026-02-13T20:28:50.105 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.084+0000 7ffad37fe640 10 monclient: get_auth_request con 0x7ffaa403fa50 auth_method 0 2026-02-13T20:28:50.105 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.085+0000 7ffad0ff9640 1 -- 10.20.193.110:0/2466465404 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7ffac0017120 con 0x7ffad4057780 2026-02-13T20:28:50.105 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.085+0000 7ffad0ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:28:50.105 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.085+0000 7ffad0ff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:28:50.190 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.189+0000 7ffada90c640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-13T20:28:50.190 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.189+0000 7ffada90c640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-13T20:28:50.190 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.189+0000 7ffada90c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:28:50.190 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.189+0000 7ffada90c640 1 -- 10.20.193.110:0/2466465404 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffad4055bb0 con 0x7ffad4057780 2026-02-13T20:28:50.190 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.189+0000 7ffad0ff9640 1 -- 10.20.193.110:0/2466465404 <== mon.2 v1:10.20.193.110:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v846) ==== 74+0+12902 (unknown 2964673637 0 2777219754) 0x7ffac00168d0 con 0x7ffad4057780 2026-02-13T20:28:50.190 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.189+0000 7ffad0ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-13T20:28:50.190 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.189+0000 7ffad0ff9640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:28:50.191 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:28:50.191 INFO:teuthology.orchestra.run.trial110.stdout:{"epoch":846,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","created":"2026-02-13T20:11:18.047609+0000","modified":"2026-02-13T20:28:49.756472+0000","last_up_change":"2026-02-13T20:11:22.252754+0000","last_in_change":"2026-02-13T20:11:19.250528+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T20:11:24.136325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-13T20:11:27.043171+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"unique_pool_0","create_time":"2026-02-13T20:11:55.484324+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":16,"pg_placement_num":16,"pg_placement_num_target":16,"pg_num_target":16,"pg_num_pending":16,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"846","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":420,"snap_epoch":846,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88457b09-7bbe-4ebe-8a8b-4c980153af2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6808","nonce":2638069221}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6809","nonce":2638069221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6811","nonce":2638069221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6810","nonce":2638069221}]},"public_addr":"10.20.193.110:6808/2638069221","cluster_addr":"10.20.193.110:6809/2638069221","heartbeat_back_addr":"10.20.193.110:6811/2638069221","heartbeat_front_addr":"10.20.193.110:6810/2638069221","state":["exists","up"]},{"osd":1,"uuid":"efb2f419-77ef-44b0-ae26-4c448073556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6800","nonce":3182322764}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6801","nonce":3182322764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6803","nonce":3182322764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6802","nonce":3182322764}]},"public_addr":"10.20.193.110:6800/3182322764","cluster_addr":"10.20.193.110:6801/3182322764","heartbeat_back_addr":"10.20.193.110:6803/3182322764","heartbeat_front_addr":"10.20.193.110:6802/3182322764","state":["exists","up"]},{"osd":2,"uuid":"c5a08402-8e10-4d4d-87fe-6236a6766128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6804","nonce":2437753968}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6805","nonce":2437753968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6807","nonce":2437753968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6806","nonce":2437753968}]},"public_addr":"10.20.193.110:6804/2437753968","cluster_addr":"10.20.193.110:6805/2437753968","heartbeat_back_addr":"10.20.193.110:6807/2437753968","heartbeat_front_addr":"10.20.193.110:6806/2437753968","state":["exists","up"]},{"osd":3,"uuid":"3062e357-c62b-4a5d-a4b2-9715c16cfd37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6800","nonce":3648478668}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6801","nonce":3648478668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6803","nonce":3648478668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6802","nonce":3648478668}]},"public_addr":"10.20.193.188:6800/3648478668","cluster_addr":"10.20.193.188:6801/3648478668","heartbeat_back_addr":"10.20.193.188:6803/3648478668","heartbeat_front_addr":"10.20.193.188:6802/3648478668","state":["exists","up"]},{"osd":4,"uuid":"718e9755-3c16-47c8-9df8-c08e4193063d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6804","nonce":1615982170}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6806","nonce":1615982170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6810","nonce":1615982170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6808","nonce":1615982170}]},"public_addr":"10.20.193.188:6804/1615982170","cluster_addr":"10.20.193.188:6806/1615982170","heartbeat_back_addr":"10.20.193.188:6810/1615982170","heartbeat_front_addr":"10.20.193.188:6808/1615982170","state":["exists","up"]},{"osd":5,"uuid":"1508f970-10c7-486a-96d1-76881e826af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6805","nonce":4130810301}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6807","nonce":4130810301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6811","nonce":4130810301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6809","nonce":4130810301}]},"public_addr":"10.20.193.188:6805/4130810301","cluster_addr":"10.20.193.188:6807/4130810301","heartbeat_back_addr":"10.20.193.188:6811/4130810301","heartbeat_front_addr":"10.20.193.188:6809/4130810301","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T20:11:20.798845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T20:11:20.817774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T20:11:20.860524+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T20:11:20.994431+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T20:11:20.970325+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T20:11:21.011291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":410,"length":1},{"begin":413,"length":3},{"begin":417,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T20:28:50.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.190+0000 7ffada90c640 1 -- 10.20.193.110:0/2466465404 >> v1:10.20.193.188:6812/1623052694 conn(0x7ffaa403fa50 legacy=0x7ffaa405ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:28:50.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.190+0000 7ffada90c640 10 monclient: shutdown 2026-02-13T20:28:50.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.190+0000 7ffada90c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:28:50.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.190+0000 7ffada90c640 1 -- 10.20.193.110:0/2466465404 >> v1:10.20.193.110:6790/0 conn(0x7ffad4057780 legacy=0x7ffad41a1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:28:50.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.190+0000 7ffada90c640 1 -- 10.20.193.110:0/2466465404 shutdown_connections 2026-02-13T20:28:50.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.190+0000 7ffada90c640 1 -- 10.20.193.110:0/2466465404 >> 10.20.193.110:0/2466465404 conn(0x7ffad4054330 msgr2=0x7ffad4091780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:28:50.193 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.190+0000 7ffada90c640 1 -- 10.20.193.110:0/2466465404 shutdown_connections 2026-02-13T20:28:50.193 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.190+0000 7ffada90c640 1 -- 10.20.193.110:0/2466465404 wait complete. 2026-02-13T20:28:50.199 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-13T20:28:50.264 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.264+0000 7f68f4f9d640 10 monclient: get_monmap_and_config 2026-02-13T20:28:50.265 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.264+0000 7f68f4f9d640 10 monclient: build_initial_monmap 2026-02-13T20:28:50.265 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.264+0000 7f68f4f9d640 10 monclient: monmap: 2026-02-13T20:28:50.265 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:28:50.265 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:28:50.265 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:28:50.264516+0000 2026-02-13T20:28:50.265 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:28:50.264516+0000 2026-02-13T20:28:50.265 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:28:50.265 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:28:50.265 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:28:50.265 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:28:50.266 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:28:50.266 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:28:50.266 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.264+0000 7f68f4f9d640 1 Processor -- start 2026-02-13T20:28:50.266 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.264+0000 7f68f4f9d640 1 -- start start 2026-02-13T20:28:50.266 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.264+0000 7f68f4f9d640 10 monclient: init 2026-02-13T20:28:50.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.264+0000 7f68f4f9d640 10 monclient: _reopen_session rank -1 2026-02-13T20:28:50.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.264+0000 7f68f4f9d640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:28:50.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.264+0000 7f68f4f9d640 10 monclient(hunting): picked mon.noname-a con 0x7f68f0091e20 addr v1:10.20.193.110:6789/0 2026-02-13T20:28:50.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.264+0000 7f68f4f9d640 10 monclient(hunting): picked mon.noname-b con 0x7f68f0089540 addr v1:10.20.193.110:6790/0 2026-02-13T20:28:50.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.264+0000 7f68f4f9d640 10 monclient(hunting): picked mon.noname-c con 0x7f68f0089980 addr v1:10.20.193.188:6789/0 2026-02-13T20:28:50.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.264+0000 7f68f4f9d640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68f005b3d0 con 0x7f68f0091e20 2026-02-13T20:28:50.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.264+0000 7f68f4f9d640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68f005b6b0 con 0x7f68f0089980 2026-02-13T20:28:50.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.264+0000 7f68f4f9d640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68f005cd90 con 0x7f68f0089540 2026-02-13T20:28:50.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.264+0000 7f68f4f9d640 10 monclient(hunting): _renew_subs 2026-02-13T20:28:50.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.264+0000 7f68f4f9d640 10 monclient(hunting): authenticate will time out at 1691.954893s 2026-02-13T20:28:50.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.264+0000 7f68eed76640 1 -- >> v1:10.20.193.188:6789/0 conn(0x7f68f0089980 legacy=0x7f68f01a5430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:28:50.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.264+0000 7f68edd74640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f68f0089540 0x7f68f0183d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:34234/0 (socket says 10.20.193.110:34234) 2026-02-13T20:28:50.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.264+0000 7f68edd74640 1 -- 10.20.193.110:0/3468477495 learned_addr learned my addr 10.20.193.110:0/3468477495 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:28:50.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.265+0000 7f68ed573640 1 -- 10.20.193.110:0/3468477495 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1875982655 0 0) 0x7f68f005cd90 con 0x7f68f0089540 2026-02-13T20:28:50.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.265+0000 7f68ed573640 10 monclient(hunting): _negotiate 2026-02-13T20:28:50.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.265+0000 7f68ed573640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:28:50.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.265+0000 7f68ed573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:28:50.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.265+0000 7f68ed573640 10 monclient(hunting): my global_id is 154208 2026-02-13T20:28:50.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.265+0000 7f68ed573640 1 -- 10.20.193.110:0/3468477495 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68dc0035e0 con 0x7f68f0089540 2026-02-13T20:28:50.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.265+0000 7f68ed573640 1 -- 10.20.193.110:0/3468477495 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1764515395 0 0) 0x7f68f005b3d0 con 0x7f68f0091e20 2026-02-13T20:28:50.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.265+0000 7f68ed573640 10 monclient(hunting): _negotiate 2026-02-13T20:28:50.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.265+0000 7f68ed573640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:28:50.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.265+0000 7f68ed573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:28:50.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.265+0000 7f68ed573640 10 monclient(hunting): my global_id is 124494 2026-02-13T20:28:50.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.265+0000 7f68ed573640 1 -- 10.20.193.110:0/3468477495 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68f005cd90 con 0x7f68f0091e20 2026-02-13T20:28:50.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.265+0000 7f68ed573640 1 -- 10.20.193.110:0/3468477495 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2726959135 0 0) 0x7f68dc0035e0 con 0x7f68f0089540 2026-02-13T20:28:50.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.265+0000 7f68ed573640 1 -- 10.20.193.110:0/3468477495 >> v1:10.20.193.188:6789/0 conn(0x7f68f0089980 legacy=0x7f68f01a5430 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:28:50.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.265+0000 7f68ed573640 1 -- 10.20.193.110:0/3468477495 >> v1:10.20.193.110:6789/0 conn(0x7f68f0091e20 legacy=0x7f68f0088e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:28:50.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.265+0000 7f68ed573640 10 monclient: _finish_hunting 0 2026-02-13T20:28:50.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.265+0000 7f68ed573640 1 monclient: found mon.noname-b 2026-02-13T20:28:50.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.265+0000 7f68ed573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:28:50.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.265+0000 7f68ed573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:28:50.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.265+0000 7f68ed573640 1 -- 10.20.193.110:0/3468477495 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68f008ad10 con 0x7f68f0089540 2026-02-13T20:28:50.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.265+0000 7f68ed573640 10 monclient: _finish_auth 0 2026-02-13T20:28:50.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.265+0000 7f68ed573640 10 monclient: _check_auth_tickets 2026-02-13T20:28:50.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.265+0000 7f68ed573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:28:50.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.265+0000 7f68f4f9d640 5 monclient: authenticate success, global_id 154208 2026-02-13T20:28:50.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.265+0000 7f68ed573640 1 -- 10.20.193.110:0/3468477495 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f68d8002dd0 con 0x7f68f0089540 2026-02-13T20:28:50.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.265+0000 7f68f4f9d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:28:50.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.265+0000 7f68ed573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:28:50.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.265+0000 7f68ed573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:28:50.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.265+0000 7f68ed573640 10 monclient: dump: 2026-02-13T20:28:50.277 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:28:50.277 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:28:50.277 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:28:50.277 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:28:50.277 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:28:50.277 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:28:50.277 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:28:50.277 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:28:50.277 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:28:50.277 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:28:50.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.265+0000 7f68f4f9d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:28:50.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.265+0000 7f68ed573640 1 -- 10.20.193.110:0/3468477495 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f68d8003050 con 0x7f68f0089540 2026-02-13T20:28:50.278 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.265+0000 7f68ed573640 10 monclient: handle_config config(0 keys) 2026-02-13T20:28:50.278 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.265+0000 7f68f4f9d640 10 monclient: get_monmap_and_config success 2026-02-13T20:28:50.278 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.265+0000 7f68ed573640 1 -- 10.20.193.110:0/3468477495 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f68d8003460 con 0x7f68f0089540 2026-02-13T20:28:50.278 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.265+0000 7f68f4f9d640 4 set_mon_vals no callback set 2026-02-13T20:28:50.278 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.265+0000 7f68ed573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:28:50.278 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.265+0000 7f68ed573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:28:50.278 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.265+0000 7f68ed573640 10 monclient: dump: 2026-02-13T20:28:50.278 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:28:50.278 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:28:50.278 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:28:50.278 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:28:50.278 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:28:50.278 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:28:50.279 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:28:50.279 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:28:50.279 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:28:50.279 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:28:50.279 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.265+0000 7f68f4f9d640 10 monclient: shutdown 2026-02-13T20:28:50.279 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.265+0000 7f68f4f9d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:28:50.279 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.265+0000 7f68f4f9d640 1 -- 10.20.193.110:0/3468477495 >> v1:10.20.193.110:6790/0 conn(0x7f68f0089540 legacy=0x7f68f0183d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:28:50.279 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.265+0000 7f68f4f9d640 1 -- 10.20.193.110:0/3468477495 shutdown_connections 2026-02-13T20:28:50.279 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.265+0000 7f68f4f9d640 1 -- 10.20.193.110:0/3468477495 >> 10.20.193.110:0/3468477495 conn(0x7f68f0054e90 msgr2=0x7f68f0058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:28:50.279 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.265+0000 7f68f4f9d640 1 -- 10.20.193.110:0/3468477495 shutdown_connections 2026-02-13T20:28:50.279 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.265+0000 7f68f4f9d640 1 -- 10.20.193.110:0/3468477495 wait complete. 2026-02-13T20:28:50.279 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.266+0000 7f68f4f9d640 10 monclient: build_initial_monmap 2026-02-13T20:28:50.280 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.266+0000 7f68f4f9d640 10 monclient: monmap: 2026-02-13T20:28:50.280 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:28:50.280 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:28:50.280 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:28:50.280 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:28:50.280 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:28:50.280 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:28:50.280 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:28:50.280 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:28:50.280 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:28:50.280 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:28:50.281 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.266+0000 7f68f4f9d640 1 Processor -- start 2026-02-13T20:28:50.281 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.266+0000 7f68f4f9d640 1 -- start start 2026-02-13T20:28:50.281 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.266+0000 7f68f4f9d640 10 monclient: init 2026-02-13T20:28:50.281 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.266+0000 7f68f4f9d640 10 monclient: _reopen_session rank -1 2026-02-13T20:28:50.281 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.266+0000 7f68f4f9d640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:28:50.281 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.266+0000 7f68f4f9d640 10 monclient(hunting): picked mon.noname-a con 0x7f68f0089540 addr v1:10.20.193.110:6789/0 2026-02-13T20:28:50.281 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.266+0000 7f68f4f9d640 10 monclient(hunting): picked mon.noname-c con 0x7f68f0089980 addr v1:10.20.193.110:6790/0 2026-02-13T20:28:50.281 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.266+0000 7f68f4f9d640 10 monclient(hunting): picked mon.noname-b con 0x7f68f0091e20 addr v1:10.20.193.188:6789/0 2026-02-13T20:28:50.281 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.266+0000 7f68f4f9d640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68f005d320 con 0x7f68f0089540 2026-02-13T20:28:50.281 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.266+0000 7f68f4f9d640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68f0059340 con 0x7f68f0091e20 2026-02-13T20:28:50.281 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.266+0000 7f68f4f9d640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68f01950b0 con 0x7f68f0089980 2026-02-13T20:28:50.281 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.266+0000 7f68f4f9d640 10 monclient(hunting): _renew_subs 2026-02-13T20:28:50.281 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.266+0000 7f68f4f9d640 10 monclient(hunting): authenticate will time out at 1691.956575s 2026-02-13T20:28:50.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.266+0000 7f68ee575640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f68f0089540 0x7f68f0191360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:56910/0 (socket says 10.20.193.110:56910) 2026-02-13T20:28:50.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.266+0000 7f68ee575640 1 -- 10.20.193.110:0/1817757935 learned_addr learned my addr 10.20.193.110:0/1817757935 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:28:50.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.266+0000 7f68eed76640 1 -- 10.20.193.110:0/1817757935 >> v1:10.20.193.188:6789/0 conn(0x7f68f0091e20 legacy=0x7f68f023c050 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:28:50.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.266+0000 7f68d6ffd640 1 -- 10.20.193.110:0/1817757935 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 781122711 0 0) 0x7f68f01950b0 con 0x7f68f0089980 2026-02-13T20:28:50.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.266+0000 7f68d6ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:28:50.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.266+0000 7f68d6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:28:50.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.266+0000 7f68d6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:28:50.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.266+0000 7f68d6ffd640 10 monclient(hunting): my global_id is 154211 2026-02-13T20:28:50.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.266+0000 7f68d6ffd640 1 -- 10.20.193.110:0/1817757935 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68bc0035e0 con 0x7f68f0089980 2026-02-13T20:28:50.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.266+0000 7f68d6ffd640 1 -- 10.20.193.110:0/1817757935 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2783798038 0 0) 0x7f68f005d320 con 0x7f68f0089540 2026-02-13T20:28:50.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.266+0000 7f68d6ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:28:50.282 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.266+0000 7f68d6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:28:50.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.266+0000 7f68d6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:28:50.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.266+0000 7f68d6ffd640 10 monclient(hunting): my global_id is 124497 2026-02-13T20:28:50.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.266+0000 7f68d6ffd640 1 -- 10.20.193.110:0/1817757935 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68f01950b0 con 0x7f68f0089540 2026-02-13T20:28:50.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.266+0000 7f68d6ffd640 1 -- 10.20.193.110:0/1817757935 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2183460468 0 0) 0x7f68bc0035e0 con 0x7f68f0089980 2026-02-13T20:28:50.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.266+0000 7f68d6ffd640 1 -- 10.20.193.110:0/1817757935 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f68f005d320 con 0x7f68f0089980 2026-02-13T20:28:50.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.266+0000 7f68d6ffd640 1 -- 10.20.193.110:0/1817757935 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f68d8003370 con 0x7f68f0089980 2026-02-13T20:28:50.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.266+0000 7f68d6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:28:50.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.266+0000 7f68d6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:28:50.283 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.266+0000 7f68d6ffd640 10 monclient(hunting): dump: 2026-02-13T20:28:50.283 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:28:50.283 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:28:50.283 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:28:50.284 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:28:50.284 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:28:50.284 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:28:50.284 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:28:50.284 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:28:50.284 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:28:50.284 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:28:50.284 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.266+0000 7f68d6ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:28:50.284 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.266+0000 7f68d6ffd640 1 -- 10.20.193.110:0/1817757935 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 882995998 0 0) 0x7f68f01950b0 con 0x7f68f0089540 2026-02-13T20:28:50.284 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.266+0000 7f68d6ffd640 1 -- 10.20.193.110:0/1817757935 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f68bc0035e0 con 0x7f68f0089540 2026-02-13T20:28:50.284 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.266+0000 7f68d6ffd640 1 -- 10.20.193.110:0/1817757935 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f68e4003150 con 0x7f68f0089540 2026-02-13T20:28:50.284 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.266+0000 7f68d6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:28:50.284 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.266+0000 7f68d6ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:28:50.285 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.266+0000 7f68d6ffd640 10 monclient(hunting): dump: 2026-02-13T20:28:50.285 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:28:50.285 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:28:50.285 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:28:50.285 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:28:50.285 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:28:50.285 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:28:50.285 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:28:50.285 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:28:50.285 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:28:50.285 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:28:50.285 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.266+0000 7f68d6ffd640 1 -- 10.20.193.110:0/1817757935 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 58233136 0 0) 0x7f68f005d320 con 0x7f68f0089980 2026-02-13T20:28:50.286 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.267+0000 7f68d6ffd640 1 -- 10.20.193.110:0/1817757935 >> v1:10.20.193.188:6789/0 conn(0x7f68f0091e20 legacy=0x7f68f023c050 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T20:28:50.286 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.267+0000 7f68d6ffd640 1 -- 10.20.193.110:0/1817757935 >> v1:10.20.193.110:6789/0 conn(0x7f68f0089540 legacy=0x7f68f0191360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:28:50.286 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.267+0000 7f68d6ffd640 10 monclient: _finish_hunting 0 2026-02-13T20:28:50.286 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.267+0000 7f68d6ffd640 1 monclient: found mon.c 2026-02-13T20:28:50.286 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.267+0000 7f68d6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:28:50.286 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.267+0000 7f68d6ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:28:50.286 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.267+0000 7f68d6ffd640 1 -- 10.20.193.110:0/1817757935 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68f0192180 con 0x7f68f0089980 2026-02-13T20:28:50.286 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.267+0000 7f68d6ffd640 10 monclient: _finish_auth 0 2026-02-13T20:28:50.286 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.267+0000 7f68d6ffd640 10 monclient: _check_auth_tickets 2026-02-13T20:28:50.286 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.267+0000 7f68d6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:28:50.286 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.267+0000 7f68f4f9d640 5 monclient: authenticate success, global_id 154211 2026-02-13T20:28:50.286 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.267+0000 7f68f4f9d640 10 monclient: _renew_subs 2026-02-13T20:28:50.286 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.267+0000 7f68f4f9d640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:28:50.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.267+0000 7f68f4f9d640 1 -- 10.20.193.110:0/1817757935 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f68f0194240 con 0x7f68f0089980 2026-02-13T20:28:50.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.267+0000 7f68f4f9d640 10 monclient: _renew_subs 2026-02-13T20:28:50.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.267+0000 7f68f4f9d640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:28:50.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.267+0000 7f68f4f9d640 1 -- 10.20.193.110:0/1817757935 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f68f0194dd0 con 0x7f68f0089980 2026-02-13T20:28:50.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.267+0000 7f68d6ffd640 1 -- 10.20.193.110:0/1817757935 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f68d8002830 con 0x7f68f0089980 2026-02-13T20:28:50.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.267+0000 7f68d6ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:28:50.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.267+0000 7f68d6ffd640 1 -- 10.20.193.110:0/1817757935 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f68d8004e60 con 0x7f68f0089980 2026-02-13T20:28:50.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.267+0000 7f68d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:28:50.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.267+0000 7f68d6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:28:50.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.267+0000 7f68ecd72640 4 set_mon_vals no callback set 2026-02-13T20:28:50.287 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.267+0000 7f68d6ffd640 10 monclient: dump: 2026-02-13T20:28:50.288 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:28:50.288 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:28:50.288 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:28:50.288 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:28:50.288 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:28:50.288 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:28:50.288 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:28:50.288 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:28:50.288 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:28:50.288 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:28:50.288 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.267+0000 7f68f4f9d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:28:50.288 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.267+0000 7f68f4f9d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:28:50.288 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.267+0000 7f68f4f9d640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:28:50.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.267+0000 7f68f4f9d640 1 -- 10.20.193.110:0/1817757935 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68f01a8b50 con 0x7f68f0089980 2026-02-13T20:28:50.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.267+0000 7f68d6ffd640 1 -- 10.20.193.110:0/1817757935 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f68d8011ad0 con 0x7f68f0089980 2026-02-13T20:28:50.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.267+0000 7f68d6ffd640 1 -- 10.20.193.110:0/1817757935 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(846..846 src has 1..846) ==== 3931+0+0 (unknown 1574598522 0 0) 0x7f68d804e9c0 con 0x7f68f0089980 2026-02-13T20:28:50.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.267+0000 7f68ee575640 10 monclient: get_auth_request con 0x7f68bc03fa20 auth_method 0 2026-02-13T20:28:50.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.270+0000 7f68d6ffd640 1 -- 10.20.193.110:0/1817757935 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f68d8017220 con 0x7f68f0089980 2026-02-13T20:28:50.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.270+0000 7f68d6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:28:50.289 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.270+0000 7f68d6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:28:50.371 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.371+0000 7f68f4f9d640 1 -- 10.20.193.110:0/1817757935 --> v1:10.20.193.188:6812/1623052694 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f68f005a3e0 con 0x7f68bc03fa20 2026-02-13T20:28:50.373 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.372+0000 7f68d6ffd640 1 -- 10.20.193.110:0/1817757935 <== mgr.4105 v1:10.20.193.188:6812/1623052694 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+78309 (unknown 2965378022 0 2233039280) 0x7f68e40078a0 con 0x7f68bc03fa20 2026-02-13T20:28:50.373 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:28:50.374 INFO:teuthology.orchestra.run.trial110.stderr:dumped all 2026-02-13T20:28:50.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.373+0000 7f68f4f9d640 1 -- 10.20.193.110:0/1817757935 >> v1:10.20.193.188:6812/1623052694 conn(0x7f68bc03fa20 legacy=0x7f68bc05fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:28:50.375 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.373+0000 7f68f4f9d640 10 monclient: shutdown 2026-02-13T20:28:50.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.373+0000 7f68f4f9d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:28:50.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.373+0000 7f68f4f9d640 1 -- 10.20.193.110:0/1817757935 >> v1:10.20.193.110:6790/0 conn(0x7f68f0089980 legacy=0x7f68f0191a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:28:50.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.373+0000 7f68f4f9d640 1 -- 10.20.193.110:0/1817757935 shutdown_connections 2026-02-13T20:28:50.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.373+0000 7f68f4f9d640 1 -- 10.20.193.110:0/1817757935 >> 10.20.193.110:0/1817757935 conn(0x7f68f0054e90 msgr2=0x7f68f01a90c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:28:50.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.373+0000 7f68f4f9d640 1 -- 10.20.193.110:0/1817757935 shutdown_connections 2026-02-13T20:28:50.376 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.373+0000 7f68f4f9d640 1 -- 10.20.193.110:0/1817757935 wait complete. 2026-02-13T20:28:50.381 INFO:teuthology.orchestra.run.trial110.stdout:{"pg_ready":true,"pg_map":{"version":1362,"stamp":"2026-02-13T20:28:50.244164+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":266113595,"num_objects":118,"num_object_clones":66,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":118,"num_whiteouts":8,"num_read":7813,"num_read_kb":6120729,"num_write":5847,"num_write_kb":2324851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19312,"ondisk_log_size":19312,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":562308,"kb_used_data":364452,"kb_used_omap":8839,"kb_used_meta":188920,"kb_avail":565668732,"statfs":{"total":579820584960,"available":579244781568,"internally_reserved":0,"allocated":373198848,"data_stored":503964899,"data_compressed":143869015,"data_compressed_allocated":130867200,"data_compressed_original":243888861,"omap_allocated":9051591,"internal_metadata":193454649},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":18854768,"num_objects":8,"num_object_clones":8,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":-3,"num_read":76,"num_read_kb":77532,"num_write":38,"num_write_kb":13959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000547"},"pg_stats":[{"pgid":"3.f","version":"843'1936","reported_seq":5977,"reported_epoch":843,"state":"active+clean","last_fresh":"2026-02-13T20:28:47.052201+0000","last_change":"2026-02-13T20:28:46.752879+0000","last_active":"2026-02-13T20:28:47.052201+0000","last_peered":"2026-02-13T20:28:47.052201+0000","last_clean":"2026-02-13T20:28:47.052201+0000","last_became_active":"2026-02-13T20:11:56.543118+0000","last_became_peered":"2026-02-13T20:11:56.543118+0000","last_unstale":"2026-02-13T20:28:47.052201+0000","last_undegraded":"2026-02-13T20:28:47.052201+0000","last_fullsized":"2026-02-13T20:28:47.052201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:55.534406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:55.534406+0000","last_clean_scrub_stamp":"2026-02-13T20:11:55.534406+0000","objects_scrubbed":0,"log_size":1936,"log_dups_size":0,"ondisk_log_size":1936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T22:10:15.643112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029321920000000001,"stat_sum":{"num_bytes":28164661,"num_objects":13,"num_object_clones":8,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":1,"num_read":794,"num_read_kb":598784,"num_write":596,"num_write_kb":217101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"19a","length":"1"},{"start":"19d","length":"1"},{"start":"19f","length":"1"},{"start":"1a1","length":"1"}]},{"pgid":"3.e","version":"841'908","reported_seq":4976,"reported_epoch":843,"state":"active+clean","last_fresh":"2026-02-13T20:28:46.750471+0000","last_change":"2026-02-13T20:28:46.750545+0000","last_active":"2026-02-13T20:28:46.750471+0000","last_peered":"2026-02-13T20:28:46.750471+0000","last_clean":"2026-02-13T20:28:46.750471+0000","last_became_active":"2026-02-13T20:11:56.543797+0000","last_became_peered":"2026-02-13T20:11:56.543797+0000","last_unstale":"2026-02-13T20:28:46.750471+0000","last_undegraded":"2026-02-13T20:28:46.750471+0000","last_fullsized":"2026-02-13T20:28:46.750471+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:55.534406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:55.534406+0000","last_clean_scrub_stamp":"2026-02-13T20:11:55.534406+0000","objects_scrubbed":0,"log_size":908,"log_dups_size":0,"ondisk_log_size":908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T20:31:57.317347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035447300000000001,"stat_sum":{"num_bytes":9625132,"num_objects":6,"num_object_clones":4,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":421,"num_read_kb":372946,"num_write":230,"num_write_kb":87699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"19a","length":"1"},{"start":"19d","length":"1"},{"start":"19f","length":"1"},{"start":"1a1","length":"1"}]},{"pgid":"3.d","version":"843'1953","reported_seq":5957,"reported_epoch":843,"state":"active+clean","last_fresh":"2026-02-13T20:28:46.752694+0000","last_change":"2026-02-13T20:28:46.752816+0000","last_active":"2026-02-13T20:28:46.752694+0000","last_peered":"2026-02-13T20:28:46.752694+0000","last_clean":"2026-02-13T20:28:46.752694+0000","last_became_active":"2026-02-13T20:11:56.543833+0000","last_became_peered":"2026-02-13T20:11:56.543833+0000","last_unstale":"2026-02-13T20:28:46.752694+0000","last_undegraded":"2026-02-13T20:28:46.752694+0000","last_fullsized":"2026-02-13T20:28:46.752694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:55.534406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:55.534406+0000","last_clean_scrub_stamp":"2026-02-13T20:11:55.534406+0000","objects_scrubbed":0,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T00:06:03.215147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027428180000000002,"stat_sum":{"num_bytes":24019645,"num_objects":11,"num_object_clones":6,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":2,"num_read":689,"num_read_kb":524322,"num_write":587,"num_write_kb":245006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"19a","length":"1"},{"start":"19d","length":"1"},{"start":"19f","length":"1"},{"start":"1a1","length":"1"}]},{"pgid":"3.c","version":"0'0","reported_seq":4043,"reported_epoch":843,"state":"active+clean","last_fresh":"2026-02-13T20:28:46.750103+0000","last_change":"2026-02-13T20:28:46.750308+0000","last_active":"2026-02-13T20:28:46.750103+0000","last_peered":"2026-02-13T20:28:46.750103+0000","last_clean":"2026-02-13T20:28:46.750103+0000","last_became_active":"2026-02-13T20:11:56.543490+0000","last_became_peered":"2026-02-13T20:11:56.543490+0000","last_unstale":"2026-02-13T20:28:46.750103+0000","last_undegraded":"2026-02-13T20:28:46.750103+0000","last_fullsized":"2026-02-13T20:28:46.750103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:55.534406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:55.534406+0000","last_clean_scrub_stamp":"2026-02-13T20:11:55.534406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T03:02:57.081903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036061600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"19a","length":"1"},{"start":"19d","length":"1"},{"start":"19f","length":"1"},{"start":"1a1","length":"1"}]},{"pgid":"3.b","version":"843'963","reported_seq":5099,"reported_epoch":843,"state":"active+clean","last_fresh":"2026-02-13T20:28:46.759243+0000","last_change":"2026-02-13T20:28:46.759324+0000","last_active":"2026-02-13T20:28:46.759243+0000","last_peered":"2026-02-13T20:28:46.759243+0000","last_clean":"2026-02-13T20:28:46.759243+0000","last_became_active":"2026-02-13T20:11:56.544093+0000","last_became_peered":"2026-02-13T20:11:56.544093+0000","last_unstale":"2026-02-13T20:28:46.759243+0000","last_undegraded":"2026-02-13T20:28:46.759243+0000","last_fullsized":"2026-02-13T20:28:46.759243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:55.534406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:55.534406+0000","last_clean_scrub_stamp":"2026-02-13T20:11:55.534406+0000","objects_scrubbed":0,"log_size":963,"log_dups_size":0,"ondisk_log_size":963,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T04:50:02.494087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0066502749999999998,"stat_sum":{"num_bytes":17640280,"num_objects":7,"num_object_clones":4,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":444,"num_read_kb":350248,"num_write":321,"num_write_kb":139665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"19a","length":"1"},{"start":"19d","length":"1"},{"start":"19f","length":"1"},{"start":"1a1","length":"1"}]},{"pgid":"3.a","version":"831'338","reported_seq":4416,"reported_epoch":843,"state":"active+clean","last_fresh":"2026-02-13T20:28:46.750285+0000","last_change":"2026-02-13T20:28:46.750285+0000","last_active":"2026-02-13T20:28:46.750285+0000","last_peered":"2026-02-13T20:28:46.750285+0000","last_clean":"2026-02-13T20:28:46.750285+0000","last_became_active":"2026-02-13T20:11:56.543149+0000","last_became_peered":"2026-02-13T20:11:56.543149+0000","last_unstale":"2026-02-13T20:28:46.750285+0000","last_undegraded":"2026-02-13T20:28:46.750285+0000","last_fullsized":"2026-02-13T20:28:46.750285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:55.534406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:55.534406+0000","last_clean_scrub_stamp":"2026-02-13T20:11:55.534406+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T21:14:39.335216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045900999999999998,"stat_sum":{"num_bytes":2353310,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":87065,"num_write":94,"num_write_kb":32456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"19a","length":"1"},{"start":"19d","length":"1"},{"start":"19f","length":"1"},{"start":"1a1","length":"1"}]},{"pgid":"3.9","version":"843'1975","reported_seq":5997,"reported_epoch":843,"state":"active+clean","last_fresh":"2026-02-13T20:28:47.070557+0000","last_change":"2026-02-13T20:28:47.038258+0000","last_active":"2026-02-13T20:28:47.070557+0000","last_peered":"2026-02-13T20:28:47.070557+0000","last_clean":"2026-02-13T20:28:47.070557+0000","last_became_active":"2026-02-13T20:11:56.544051+0000","last_became_peered":"2026-02-13T20:11:56.544051+0000","last_unstale":"2026-02-13T20:28:47.070557+0000","last_undegraded":"2026-02-13T20:28:47.070557+0000","last_fullsized":"2026-02-13T20:28:47.070557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:55.534406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:55.534406+0000","last_clean_scrub_stamp":"2026-02-13T20:11:55.534406+0000","objects_scrubbed":0,"log_size":1975,"log_dups_size":0,"ondisk_log_size":1975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T00:55:53.465415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034168000000000002,"stat_sum":{"num_bytes":39686495,"num_objects":15,"num_object_clones":10,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":699,"num_read_kb":538454,"num_write":596,"num_write_kb":271670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"19a","length":"1"},{"start":"19d","length":"1"},{"start":"19f","length":"1"},{"start":"1a1","length":"1"}]},{"pgid":"3.8","version":"844'2046","reported_seq":6137,"reported_epoch":845,"state":"active+clean","last_fresh":"2026-02-13T20:28:48.757778+0000","last_change":"2026-02-13T20:28:47.760561+0000","last_active":"2026-02-13T20:28:48.757778+0000","last_peered":"2026-02-13T20:28:48.757778+0000","last_clean":"2026-02-13T20:28:48.757778+0000","last_became_active":"2026-02-13T20:11:56.544858+0000","last_became_peered":"2026-02-13T20:11:56.544858+0000","last_unstale":"2026-02-13T20:28:48.757778+0000","last_undegraded":"2026-02-13T20:28:48.757778+0000","last_fullsized":"2026-02-13T20:28:48.757778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:55.534406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:55.534406+0000","last_clean_scrub_stamp":"2026-02-13T20:11:55.534406+0000","objects_scrubbed":0,"log_size":2046,"log_dups_size":0,"ondisk_log_size":2046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T05:48:57.416014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0049452469999999998,"stat_sum":{"num_bytes":35183367,"num_objects":16,"num_object_clones":10,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":2,"num_read":853,"num_read_kb":694767,"num_write":589,"num_write_kb":229885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"19a","length":"1"},{"start":"19d","length":"3"},{"start":"1a1","length":"1"}]},{"pgid":"1.0","version":"14'112","reported_seq":1786,"reported_epoch":843,"state":"active+clean","last_fresh":"2026-02-13T20:28:46.750048+0000","last_change":"2026-02-13T20:11:25.262882+0000","last_active":"2026-02-13T20:28:46.750048+0000","last_peered":"2026-02-13T20:28:46.750048+0000","last_clean":"2026-02-13T20:28:46.750048+0000","last_became_active":"2026-02-13T20:11:25.262766+0000","last_became_peered":"2026-02-13T20:11:25.262766+0000","last_unstale":"2026-02-13T20:28:46.750048+0000","last_undegraded":"2026-02-13T20:28:46.750048+0000","last_fullsized":"2026-02-13T20:28:46.750048+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:24.258524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:24.258524+0000","last_clean_scrub_stamp":"2026-02-13T20:11:24.258524+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T22:58:36.956434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":1649,"reported_epoch":843,"state":"active+clean","last_fresh":"2026-02-13T20:28:46.750131+0000","last_change":"2026-02-13T20:11:30.562730+0000","last_active":"2026-02-13T20:28:46.750131+0000","last_peered":"2026-02-13T20:28:46.750131+0000","last_clean":"2026-02-13T20:28:46.750131+0000","last_became_active":"2026-02-13T20:11:28.558943+0000","last_became_peered":"2026-02-13T20:11:28.558943+0000","last_unstale":"2026-02-13T20:28:46.750131+0000","last_undegraded":"2026-02-13T20:28:46.750131+0000","last_fullsized":"2026-02-13T20:28:46.750131+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T21:39:10.290168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032435800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"843'1150","reported_seq":5251,"reported_epoch":843,"state":"active+clean","last_fresh":"2026-02-13T20:28:47.159944+0000","last_change":"2026-02-13T20:28:46.758550+0000","last_active":"2026-02-13T20:28:47.159944+0000","last_peered":"2026-02-13T20:28:47.159944+0000","last_clean":"2026-02-13T20:28:47.159944+0000","last_became_active":"2026-02-13T20:11:56.544213+0000","last_became_peered":"2026-02-13T20:11:56.544213+0000","last_unstale":"2026-02-13T20:28:47.159944+0000","last_undegraded":"2026-02-13T20:28:47.159944+0000","last_fullsized":"2026-02-13T20:28:47.159944+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:55.534406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:55.534406+0000","last_clean_scrub_stamp":"2026-02-13T20:11:55.534406+0000","objects_scrubbed":0,"log_size":1150,"log_dups_size":0,"ondisk_log_size":1150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T06:03:34.126487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00574298,"stat_sum":{"num_bytes":13228693,"num_objects":7,"num_object_clones":4,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":462,"num_read_kb":323061,"num_write":348,"num_write_kb":148149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"19a","length":"1"},{"start":"19d","length":"1"},{"start":"19f","length":"1"},{"start":"1a1","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":1649,"reported_epoch":843,"state":"active+clean","last_fresh":"2026-02-13T20:28:46.749977+0000","last_change":"2026-02-13T20:11:30.561332+0000","last_active":"2026-02-13T20:28:46.749977+0000","last_peered":"2026-02-13T20:28:46.749977+0000","last_clean":"2026-02-13T20:28:46.749977+0000","last_became_active":"2026-02-13T20:11:28.559211+0000","last_became_peered":"2026-02-13T20:11:28.559211+0000","last_unstale":"2026-02-13T20:28:46.749977+0000","last_undegraded":"2026-02-13T20:28:46.749977+0000","last_fullsized":"2026-02-13T20:28:46.749977+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T22:32:44.601301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029208800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"831'1525","reported_seq":5617,"reported_epoch":844,"state":"active+clean","last_fresh":"2026-02-13T20:28:47.758501+0000","last_change":"2026-02-13T20:28:47.758676+0000","last_active":"2026-02-13T20:28:47.758501+0000","last_peered":"2026-02-13T20:28:47.758501+0000","last_clean":"2026-02-13T20:28:47.758501+0000","last_became_active":"2026-02-13T20:11:56.544584+0000","last_became_peered":"2026-02-13T20:11:56.544584+0000","last_unstale":"2026-02-13T20:28:47.758501+0000","last_undegraded":"2026-02-13T20:28:47.758501+0000","last_fullsized":"2026-02-13T20:28:47.758501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:55.534406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:55.534406+0000","last_clean_scrub_stamp":"2026-02-13T20:11:55.534406+0000","objects_scrubbed":0,"log_size":1525,"log_dups_size":0,"ondisk_log_size":1525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T01:44:03.393073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030004700000000001,"stat_sum":{"num_bytes":25347826,"num_objects":9,"num_object_clones":5,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":576,"num_read_kb":433898,"num_write":427,"num_write_kb":188234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"19a","length":"1"},{"start":"19d","length":"3"},{"start":"1a1","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":1663,"reported_epoch":845,"state":"active+clean","last_fresh":"2026-02-13T20:28:48.757882+0000","last_change":"2026-02-13T20:11:30.823369+0000","last_active":"2026-02-13T20:28:48.757882+0000","last_peered":"2026-02-13T20:28:48.757882+0000","last_clean":"2026-02-13T20:28:48.757882+0000","last_became_active":"2026-02-13T20:11:28.559802+0000","last_became_peered":"2026-02-13T20:11:28.559802+0000","last_unstale":"2026-02-13T20:28:48.757882+0000","last_undegraded":"2026-02-13T20:28:48.757882+0000","last_fullsized":"2026-02-13T20:28:48.757882+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T05:27:34.220283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000230979,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"843'1737","reported_seq":5838,"reported_epoch":843,"state":"active+clean","last_fresh":"2026-02-13T20:28:46.778042+0000","last_change":"2026-02-13T20:28:46.778042+0000","last_active":"2026-02-13T20:28:46.778042+0000","last_peered":"2026-02-13T20:28:46.778042+0000","last_clean":"2026-02-13T20:28:46.778042+0000","last_became_active":"2026-02-13T20:11:56.544809+0000","last_became_peered":"2026-02-13T20:11:56.544809+0000","last_unstale":"2026-02-13T20:28:46.778042+0000","last_undegraded":"2026-02-13T20:28:46.778042+0000","last_fullsized":"2026-02-13T20:28:46.778042+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:55.534406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:55.534406+0000","last_clean_scrub_stamp":"2026-02-13T20:11:55.534406+0000","objects_scrubbed":0,"log_size":1737,"log_dups_size":0,"ondisk_log_size":1737,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T23:41:07.624084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.025173629999999999,"stat_sum":{"num_bytes":18910053,"num_objects":8,"num_object_clones":4,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":1,"num_read":765,"num_read_kb":645605,"num_write":476,"num_write_kb":203679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"19a","length":"1"},{"start":"19d","length":"1"},{"start":"19f","length":"1"},{"start":"1a1","length":"1"}]},{"pgid":"2.2","version":"19'2","reported_seq":1650,"reported_epoch":843,"state":"active+clean","last_fresh":"2026-02-13T20:28:46.750173+0000","last_change":"2026-02-13T20:11:30.563087+0000","last_active":"2026-02-13T20:28:46.750173+0000","last_peered":"2026-02-13T20:28:46.750173+0000","last_clean":"2026-02-13T20:28:46.750173+0000","last_became_active":"2026-02-13T20:11:28.557848+0000","last_became_peered":"2026-02-13T20:11:28.557848+0000","last_unstale":"2026-02-13T20:28:46.750173+0000","last_undegraded":"2026-02-13T20:28:46.750173+0000","last_fullsized":"2026-02-13T20:28:46.750173+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T21:44:09.052237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064918699999999996,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"831'664","reported_seq":4798,"reported_epoch":843,"state":"active+clean","last_fresh":"2026-02-13T20:28:47.038072+0000","last_change":"2026-02-13T20:28:47.038236+0000","last_active":"2026-02-13T20:28:47.038072+0000","last_peered":"2026-02-13T20:28:47.038072+0000","last_clean":"2026-02-13T20:28:47.038072+0000","last_became_active":"2026-02-13T20:11:56.543375+0000","last_became_peered":"2026-02-13T20:11:56.543375+0000","last_unstale":"2026-02-13T20:28:47.038072+0000","last_undegraded":"2026-02-13T20:28:47.038072+0000","last_fullsized":"2026-02-13T20:28:47.038072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:55.534406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:55.534406+0000","last_clean_scrub_stamp":"2026-02-13T20:11:55.534406+0000","objects_scrubbed":0,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T21:21:16.580134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028780899999999998,"stat_sum":{"num_bytes":7379230,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":348,"num_read_kb":299021,"num_write":186,"num_write_kb":77190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"19a","length":"1"},{"start":"19d","length":"1"},{"start":"19f","length":"1"},{"start":"1a1","length":"1"}]},{"pgid":"3.5","version":"842'1274","reported_seq":5356,"reported_epoch":843,"state":"active+clean","last_fresh":"2026-02-13T20:28:46.750354+0000","last_change":"2026-02-13T20:28:46.750430+0000","last_active":"2026-02-13T20:28:46.750354+0000","last_peered":"2026-02-13T20:28:46.750354+0000","last_clean":"2026-02-13T20:28:46.750354+0000","last_became_active":"2026-02-13T20:11:56.544153+0000","last_became_peered":"2026-02-13T20:11:56.544153+0000","last_unstale":"2026-02-13T20:28:46.750354+0000","last_undegraded":"2026-02-13T20:28:46.750354+0000","last_fullsized":"2026-02-13T20:28:46.750354+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:55.534406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:55.534406+0000","last_clean_scrub_stamp":"2026-02-13T20:11:55.534406+0000","objects_scrubbed":0,"log_size":1274,"log_dups_size":0,"ondisk_log_size":1274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T03:18:57.046079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032995799999999999,"stat_sum":{"num_bytes":14955725,"num_objects":7,"num_object_clones":4,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":547,"num_read_kb":453078,"num_write":394,"num_write_kb":172661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"19a","length":"1"},{"start":"19d","length":"1"},{"start":"19f","length":"1"},{"start":"1a1","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":1663,"reported_epoch":843,"state":"active+clean","last_fresh":"2026-02-13T20:28:46.752939+0000","last_change":"2026-02-13T20:11:30.561668+0000","last_active":"2026-02-13T20:28:46.752939+0000","last_peered":"2026-02-13T20:28:46.752939+0000","last_clean":"2026-02-13T20:28:46.752939+0000","last_became_active":"2026-02-13T20:11:28.558441+0000","last_became_peered":"2026-02-13T20:11:28.558441+0000","last_unstale":"2026-02-13T20:28:46.752939+0000","last_undegraded":"2026-02-13T20:28:46.752939+0000","last_fullsized":"2026-02-13T20:28:46.752939+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T22:32:58.917639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000231139,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"828'409","reported_seq":4532,"reported_epoch":843,"state":"active+clean","last_fresh":"2026-02-13T20:28:46.752817+0000","last_change":"2026-02-13T20:28:46.758429+0000","last_active":"2026-02-13T20:28:46.752817+0000","last_peered":"2026-02-13T20:28:46.752817+0000","last_clean":"2026-02-13T20:28:46.752817+0000","last_became_active":"2026-02-13T20:11:56.544796+0000","last_became_peered":"2026-02-13T20:11:56.544796+0000","last_unstale":"2026-02-13T20:28:46.752817+0000","last_undegraded":"2026-02-13T20:28:46.752817+0000","last_fullsized":"2026-02-13T20:28:46.752817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:55.534406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:55.534406+0000","last_clean_scrub_stamp":"2026-02-13T20:11:55.534406+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T00:24:29.622907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.005729545,"stat_sum":{"num_bytes":7160739,"num_objects":3,"num_object_clones":2,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":154,"num_read_kb":135469,"num_write":122,"num_write_kb":51735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"19a","length":"1"},{"start":"19d","length":"1"},{"start":"19f","length":"1"},{"start":"1a1","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":1649,"reported_epoch":843,"state":"active+clean","last_fresh":"2026-02-13T20:28:46.749920+0000","last_change":"2026-02-13T20:11:30.561240+0000","last_active":"2026-02-13T20:28:46.749920+0000","last_peered":"2026-02-13T20:28:46.749920+0000","last_clean":"2026-02-13T20:28:46.749920+0000","last_became_active":"2026-02-13T20:11:28.559005+0000","last_became_peered":"2026-02-13T20:11:28.559005+0000","last_unstale":"2026-02-13T20:28:46.749920+0000","last_undegraded":"2026-02-13T20:28:46.749920+0000","last_fullsized":"2026-02-13T20:28:46.749920+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T02:48:59.423627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027156000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"844'1411","reported_seq":5505,"reported_epoch":845,"state":"active+clean","last_fresh":"2026-02-13T20:28:48.757781+0000","last_change":"2026-02-13T20:28:47.755852+0000","last_active":"2026-02-13T20:28:48.757781+0000","last_peered":"2026-02-13T20:28:48.757781+0000","last_clean":"2026-02-13T20:28:48.757781+0000","last_became_active":"2026-02-13T20:11:56.544811+0000","last_became_peered":"2026-02-13T20:11:56.544811+0000","last_unstale":"2026-02-13T20:28:48.757781+0000","last_undegraded":"2026-02-13T20:28:48.757781+0000","last_fullsized":"2026-02-13T20:28:48.757781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:55.534406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:55.534406+0000","last_clean_scrub_stamp":"2026-02-13T20:11:55.534406+0000","objects_scrubbed":0,"log_size":1411,"log_dups_size":0,"ondisk_log_size":1411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T23:00:23.425572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00022251399999999999,"stat_sum":{"num_bytes":13564470,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":533,"num_read_kb":403799,"num_write":445,"num_write_kb":172836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"19a","length":"1"},{"start":"19d","length":"3"},{"start":"1a1","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":1662,"reported_epoch":843,"state":"active+clean","last_fresh":"2026-02-13T20:28:46.752938+0000","last_change":"2026-02-13T20:11:30.561637+0000","last_active":"2026-02-13T20:28:46.752938+0000","last_peered":"2026-02-13T20:28:46.752938+0000","last_clean":"2026-02-13T20:28:46.752938+0000","last_became_active":"2026-02-13T20:11:28.559585+0000","last_became_peered":"2026-02-13T20:11:28.559585+0000","last_unstale":"2026-02-13T20:28:46.752938+0000","last_undegraded":"2026-02-13T20:28:46.752938+0000","last_fullsized":"2026-02-13T20:28:46.752938+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T23:13:24.610860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00021035100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"844'908","reported_seq":5014,"reported_epoch":844,"state":"active+clean","last_fresh":"2026-02-13T20:28:47.760124+0000","last_change":"2026-02-13T20:28:47.760230+0000","last_active":"2026-02-13T20:28:47.760124+0000","last_peered":"2026-02-13T20:28:47.760124+0000","last_clean":"2026-02-13T20:28:47.760124+0000","last_became_active":"2026-02-13T20:11:56.545035+0000","last_became_peered":"2026-02-13T20:11:56.545035+0000","last_unstale":"2026-02-13T20:28:47.760124+0000","last_undegraded":"2026-02-13T20:28:47.760124+0000","last_fullsized":"2026-02-13T20:28:47.760124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:55.534406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:55.534406+0000","last_clean_scrub_stamp":"2026-02-13T20:11:55.534406+0000","objects_scrubbed":0,"log_size":908,"log_dups_size":0,"ondisk_log_size":908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T20:46:40.048106+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.001925127,"stat_sum":{"num_bytes":8303582,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":328,"num_read_kb":260139,"num_write":289,"num_write_kb":84211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"19a","length":"1"},{"start":"19d","length":"3"},{"start":"1a1","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":1648,"reported_epoch":843,"state":"active+clean","last_fresh":"2026-02-13T20:28:46.749840+0000","last_change":"2026-02-13T20:11:30.561334+0000","last_active":"2026-02-13T20:28:46.749840+0000","last_peered":"2026-02-13T20:28:46.749840+0000","last_clean":"2026-02-13T20:28:46.749840+0000","last_became_active":"2026-02-13T20:11:29.018116+0000","last_became_peered":"2026-02-13T20:11:29.018116+0000","last_unstale":"2026-02-13T20:28:46.749840+0000","last_undegraded":"2026-02-13T20:28:46.749840+0000","last_fullsized":"2026-02-13T20:28:46.749840+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T03:21:19.857098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000335309,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":265523208,"num_objects":114,"num_object_clones":66,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":114,"num_whiteouts":8,"num_read":7727,"num_read_kb":6120656,"num_write":5700,"num_write_kb":2322177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":335794176,"data_stored":488907027,"data_compressed":146503173,"data_compressed_allocated":133685248,"data_compressed_original":247197342,"omap_allocated":0,"internal_metadata":0},"log_size":19197,"ondisk_log_size":19197,"up":32,"acting":32,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1180736,"data_compressed":16424,"data_compressed_allocated":98304,"data_compressed_original":1179648,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640467,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":75532,"kb_used_data":48572,"kb_used_omap":1347,"kb_used_meta":25596,"kb_avail":94296308,"statfs":{"total":96636764160,"available":96559419392,"internally_reserved":0,"allocated":49737728,"data_stored":62698841,"data_compressed":15413753,"data_compressed_allocated":12480512,"data_compressed_original":23262080,"omap_allocated":1379677,"internal_metadata":26210979},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640468,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":87372,"kb_used_data":60412,"kb_used_omap":1237,"kb_used_meta":25706,"kb_avail":94284468,"statfs":{"total":96636764160,"available":96547295232,"internally_reserved":0,"allocated":61861888,"data_stored":85429556,"data_compressed":26121845,"data_compressed_allocated":22065152,"data_compressed_original":45817708,"omap_allocated":1267412,"internal_metadata":26323244},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640468,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68176,"kb_used_data":41216,"kb_used_omap":1124,"kb_used_meta":25819,"kb_avail":94303664,"statfs":{"total":96636764160,"available":96566951936,"internally_reserved":0,"allocated":42205184,"data_stored":53737782,"data_compressed":13067649,"data_compressed_allocated":12025856,"data_compressed_original":24749672,"omap_allocated":1151488,"internal_metadata":26439168},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640468,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138772,"kb_used_data":93764,"kb_used_omap":2182,"kb_used_meta":42809,"kb_avail":94233068,"statfs":{"total":96636764160,"available":96494661632,"internally_reserved":0,"allocated":96014336,"data_stored":135269909,"data_compressed":39646172,"data_compressed_allocated":35512320,"data_compressed_original":70961512,"omap_allocated":2234999,"internal_metadata":43836809},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640467,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":116280,"kb_used_data":71272,"kb_used_omap":1798,"kb_used_meta":43193,"kb_avail":94255560,"statfs":{"total":96636764160,"available":96517693440,"internally_reserved":0,"allocated":72982528,"data_stored":103115780,"data_compressed":33099654,"data_compressed_allocated":31539200,"data_compressed_original":51719251,"omap_allocated":1841821,"internal_metadata":44229987},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640468,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76176,"kb_used_data":49216,"kb_used_omap":1148,"kb_used_meta":25795,"kb_avail":94295664,"statfs":{"total":96636764160,"available":96558759936,"internally_reserved":0,"allocated":50397184,"data_stored":63713031,"data_compressed":16519942,"data_compressed_allocated":17244160,"data_compressed_original":27378638,"omap_allocated":1176194,"internal_metadata":26414462},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":590368,"data_compressed":8212,"data_compressed_allocated":49152,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":590368,"data_compressed":8212,"data_compressed_allocated":49152,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":43421696,"data_stored":59344242,"data_compressed":16511730,"data_compressed_allocated":17195008,"data_compressed_original":26788814,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":67637248,"data_stored":102866609,"data_compressed":34531572,"data_compressed_allocated":33112064,"data_compressed_original":54072561,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":89092096,"data_stored":131491488,"data_compressed":39646172,"data_compressed_allocated":35512320,"data_compressed_original":70961512,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":35237888,"data_stored":49373523,"data_compressed":13059437,"data_compressed_allocated":11976704,"data_compressed_original":24159848,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":56299520,"data_stored":83795030,"data_compressed":27340509,"data_compressed_allocated":23408640,"data_compressed_original":47952527,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":44105728,"data_stored":62036135,"data_compressed":15413753,"data_compressed_allocated":12480512,"data_compressed_original":23262080,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T20:28:50.384 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_0 2026-02-13T20:28:50.385 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2026-02-13T20:28:50.451 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.451+0000 7fa187807640 10 monclient: get_monmap_and_config 2026-02-13T20:28:50.452 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.451+0000 7fa187807640 10 monclient: build_initial_monmap 2026-02-13T20:28:50.452 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.451+0000 7fa187807640 10 monclient: monmap: 2026-02-13T20:28:50.452 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:28:50.452 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:28:50.452 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:28:50.451963+0000 2026-02-13T20:28:50.452 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:28:50.451963+0000 2026-02-13T20:28:50.452 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:28:50.452 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:28:50.452 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:28:50.452 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:28:50.453 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:28:50.453 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:28:50.460 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.451+0000 7fa187807640 1 Processor -- start 2026-02-13T20:28:50.460 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.451+0000 7fa187807640 1 -- start start 2026-02-13T20:28:50.461 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.451+0000 7fa187807640 10 monclient: init 2026-02-13T20:28:50.461 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.452+0000 7fa187807640 10 monclient: _reopen_session rank -1 2026-02-13T20:28:50.461 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.452+0000 7fa187807640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:28:50.461 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.452+0000 7fa187807640 10 monclient(hunting): picked mon.noname-b con 0x7fa1801401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:28:50.461 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.452+0000 7fa187807640 10 monclient(hunting): picked mon.noname-c con 0x7fa180092020 addr v1:10.20.193.188:6789/0 2026-02-13T20:28:50.461 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.452+0000 7fa187807640 10 monclient(hunting): picked mon.noname-a con 0x7fa180091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:28:50.461 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.452+0000 7fa187807640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa18008b730 con 0x7fa180091950 2026-02-13T20:28:50.461 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.452+0000 7fa187807640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa18005c5b0 con 0x7fa180092020 2026-02-13T20:28:50.461 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.452+0000 7fa187807640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa18008bcf0 con 0x7fa1801401c0 2026-02-13T20:28:50.461 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.452+0000 7fa187807640 10 monclient(hunting): _renew_subs 2026-02-13T20:28:50.461 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.452+0000 7fa187807640 10 monclient(hunting): authenticate will time out at 1692.142563s 2026-02-13T20:28:50.461 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.452+0000 7fa18557c640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fa1801401c0 0x7fa180091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:34242/0 (socket says 10.20.193.110:34242) 2026-02-13T20:28:50.462 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.452+0000 7fa18557c640 1 -- 10.20.193.110:0/3457262844 learned_addr learned my addr 10.20.193.110:0/3457262844 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:28:50.462 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.452+0000 7fa184d7b640 1 -- >> v1:10.20.193.188:6789/0 conn(0x7fa180092020 legacy=0x7fa1801812f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:28:50.462 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.452+0000 7fa16ffff640 1 -- 10.20.193.110:0/3457262844 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1325421654 0 0) 0x7fa18008bcf0 con 0x7fa1801401c0 2026-02-13T20:28:50.462 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.452+0000 7fa16ffff640 10 monclient(hunting): _negotiate 2026-02-13T20:28:50.462 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.452+0000 7fa16ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:28:50.462 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.452+0000 7fa16ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:28:50.462 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.452+0000 7fa16ffff640 10 monclient(hunting): my global_id is 154214 2026-02-13T20:28:50.462 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.452+0000 7fa16ffff640 1 -- 10.20.193.110:0/3457262844 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1680035e0 con 0x7fa1801401c0 2026-02-13T20:28:50.462 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.452+0000 7fa16ffff640 1 -- 10.20.193.110:0/3457262844 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1230199109 0 0) 0x7fa18008b730 con 0x7fa180091950 2026-02-13T20:28:50.462 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.452+0000 7fa16ffff640 10 monclient(hunting): _negotiate 2026-02-13T20:28:50.462 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.452+0000 7fa16ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:28:50.462 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.452+0000 7fa16ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:28:50.463 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.452+0000 7fa16ffff640 10 monclient(hunting): my global_id is 124500 2026-02-13T20:28:50.463 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.452+0000 7fa16ffff640 1 -- 10.20.193.110:0/3457262844 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa18008bcf0 con 0x7fa180091950 2026-02-13T20:28:50.463 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.453+0000 7fa16ffff640 1 -- 10.20.193.110:0/3457262844 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4242558476 0 0) 0x7fa18008bcf0 con 0x7fa180091950 2026-02-13T20:28:50.463 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.453+0000 7fa16ffff640 1 -- 10.20.193.110:0/3457262844 >> v1:10.20.193.110:6790/0 conn(0x7fa1801401c0 legacy=0x7fa180091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:28:50.463 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.453+0000 7fa16ffff640 1 -- 10.20.193.110:0/3457262844 >> v1:10.20.193.188:6789/0 conn(0x7fa180092020 legacy=0x7fa1801812f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T20:28:50.463 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.453+0000 7fa16ffff640 10 monclient: _finish_hunting 0 2026-02-13T20:28:50.463 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.453+0000 7fa16ffff640 1 monclient: found mon.noname-a 2026-02-13T20:28:50.463 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.453+0000 7fa16ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:28:50.463 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.453+0000 7fa16ffff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:28:50.463 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.453+0000 7fa16ffff640 1 -- 10.20.193.110:0/3457262844 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa180140590 con 0x7fa180091950 2026-02-13T20:28:50.463 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.453+0000 7fa16ffff640 10 monclient: _finish_auth 0 2026-02-13T20:28:50.463 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.453+0000 7fa16ffff640 10 monclient: _check_auth_tickets 2026-02-13T20:28:50.464 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.453+0000 7fa16ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:28:50.464 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.453+0000 7fa16ffff640 1 -- 10.20.193.110:0/3457262844 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa17c003eb0 con 0x7fa180091950 2026-02-13T20:28:50.464 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.453+0000 7fa187807640 5 monclient: authenticate success, global_id 124500 2026-02-13T20:28:50.464 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.453+0000 7fa187807640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:28:50.464 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.453+0000 7fa16ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:28:50.464 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.453+0000 7fa16ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:28:50.464 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.453+0000 7fa16ffff640 10 monclient: dump: 2026-02-13T20:28:50.464 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:28:50.464 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:28:50.464 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:28:50.464 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:28:50.464 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:28:50.464 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:28:50.465 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:28:50.465 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:28:50.465 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:28:50.465 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:28:50.465 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.453+0000 7fa187807640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:28:50.465 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.453+0000 7fa16ffff640 1 -- 10.20.193.110:0/3457262844 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa17c004100 con 0x7fa180091950 2026-02-13T20:28:50.465 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.453+0000 7fa16ffff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:28:50.465 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.453+0000 7fa16ffff640 1 -- 10.20.193.110:0/3457262844 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa17c004510 con 0x7fa180091950 2026-02-13T20:28:50.465 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.453+0000 7fa16ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:28:50.465 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.453+0000 7fa16ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:28:50.465 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.453+0000 7fa16ffff640 10 monclient: dump: 2026-02-13T20:28:50.465 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:28:50.466 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:28:50.466 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:28:50.466 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:28:50.466 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:28:50.466 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:28:50.466 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:28:50.466 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:28:50.466 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:28:50.466 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:28:50.466 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.453+0000 7fa187807640 10 monclient: get_monmap_and_config success 2026-02-13T20:28:50.466 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.453+0000 7fa187807640 4 set_mon_vals no callback set 2026-02-13T20:28:50.466 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.453+0000 7fa187807640 10 monclient: shutdown 2026-02-13T20:28:50.466 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.453+0000 7fa187807640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:28:50.467 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.453+0000 7fa187807640 1 -- 10.20.193.110:0/3457262844 >> v1:10.20.193.110:6789/0 conn(0x7fa180091950 legacy=0x7fa1801a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:28:50.467 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.453+0000 7fa187807640 1 -- 10.20.193.110:0/3457262844 shutdown_connections 2026-02-13T20:28:50.467 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.453+0000 7fa187807640 1 -- 10.20.193.110:0/3457262844 >> 10.20.193.110:0/3457262844 conn(0x7fa180054e90 msgr2=0x7fa180058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:28:50.467 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.453+0000 7fa187807640 1 -- 10.20.193.110:0/3457262844 shutdown_connections 2026-02-13T20:28:50.467 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.453+0000 7fa187807640 1 -- 10.20.193.110:0/3457262844 wait complete. 2026-02-13T20:28:50.467 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.453+0000 7fa187807640 10 monclient: build_initial_monmap 2026-02-13T20:28:50.467 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.453+0000 7fa187807640 10 monclient: monmap: 2026-02-13T20:28:50.467 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:28:50.467 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:28:50.467 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:28:50.467 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:28:50.467 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:28:50.468 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:28:50.468 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:28:50.468 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:28:50.468 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:28:50.468 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:28:50.468 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa187807640 1 Processor -- start 2026-02-13T20:28:50.468 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa187807640 1 -- start start 2026-02-13T20:28:50.468 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa187807640 10 monclient: init 2026-02-13T20:28:50.468 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa187807640 10 monclient: _reopen_session rank -1 2026-02-13T20:28:50.468 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa187807640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:28:50.468 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa187807640 10 monclient(hunting): picked mon.noname-a con 0x7fa180091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:28:50.468 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa187807640 10 monclient(hunting): picked mon.noname-c con 0x7fa1801401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:28:50.468 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa187807640 10 monclient(hunting): picked mon.noname-b con 0x7fa18012ced0 addr v1:10.20.193.188:6789/0 2026-02-13T20:28:50.469 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa187807640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa18013f440 con 0x7fa180091950 2026-02-13T20:28:50.469 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa187807640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa18005d320 con 0x7fa18012ced0 2026-02-13T20:28:50.469 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa187807640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa18012d8e0 con 0x7fa1801401c0 2026-02-13T20:28:50.469 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa187807640 10 monclient(hunting): _renew_subs 2026-02-13T20:28:50.469 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa187807640 10 monclient(hunting): authenticate will time out at 1692.144461s 2026-02-13T20:28:50.469 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa184d7b640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fa1801401c0 0x7fa180191560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:34248/0 (socket says 10.20.193.110:34248) 2026-02-13T20:28:50.469 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa184d7b640 1 -- 10.20.193.110:0/137120587 learned_addr learned my addr 10.20.193.110:0/137120587 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:28:50.469 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa18557c640 1 --1- 10.20.193.110:0/137120587 >> v1:10.20.193.110:6789/0 conn(0x7fa180091950 0x7fa18013e470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:56918/0 (socket says 10.20.193.110:56918) 2026-02-13T20:28:50.469 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa185d7d640 1 -- 10.20.193.110:0/137120587 >> v1:10.20.193.188:6789/0 conn(0x7fa18012ced0 legacy=0x7fa180192c80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.188:6789/0 2026-02-13T20:28:50.469 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa16dffb640 1 -- 10.20.193.110:0/137120587 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1822377002 0 0) 0x7fa18012d8e0 con 0x7fa1801401c0 2026-02-13T20:28:50.469 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa16dffb640 10 monclient(hunting): _negotiate 2026-02-13T20:28:50.469 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa16dffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:28:50.470 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa16dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:28:50.470 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa16dffb640 10 monclient(hunting): my global_id is 154217 2026-02-13T20:28:50.470 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa16dffb640 1 -- 10.20.193.110:0/137120587 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1500035e0 con 0x7fa1801401c0 2026-02-13T20:28:50.470 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa16dffb640 1 -- 10.20.193.110:0/137120587 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 32457938 0 0) 0x7fa18013f440 con 0x7fa180091950 2026-02-13T20:28:50.470 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa16dffb640 10 monclient(hunting): _negotiate 2026-02-13T20:28:50.470 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa16dffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:28:50.470 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa16dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:28:50.470 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa16dffb640 10 monclient(hunting): my global_id is 124503 2026-02-13T20:28:50.470 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa16dffb640 1 -- 10.20.193.110:0/137120587 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa18012d8e0 con 0x7fa180091950 2026-02-13T20:28:50.470 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa16dffb640 1 -- 10.20.193.110:0/137120587 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 800763485 0 0) 0x7fa1500035e0 con 0x7fa1801401c0 2026-02-13T20:28:50.470 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa16dffb640 1 -- 10.20.193.110:0/137120587 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa18013f440 con 0x7fa1801401c0 2026-02-13T20:28:50.470 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa16dffb640 1 -- 10.20.193.110:0/137120587 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa174004200 con 0x7fa1801401c0 2026-02-13T20:28:50.470 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa16dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:28:50.471 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa16dffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:28:50.471 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa16dffb640 10 monclient(hunting): dump: 2026-02-13T20:28:50.471 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:28:50.471 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:28:50.471 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:28:50.471 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:28:50.471 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:28:50.471 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:28:50.471 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:28:50.471 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:28:50.471 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:28:50.471 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:28:50.471 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa16dffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:28:50.472 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa16dffb640 1 -- 10.20.193.110:0/137120587 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3882528027 0 0) 0x7fa18012d8e0 con 0x7fa180091950 2026-02-13T20:28:50.472 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa16dffb640 1 -- 10.20.193.110:0/137120587 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa1500035e0 con 0x7fa180091950 2026-02-13T20:28:50.472 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa16dffb640 1 -- 10.20.193.110:0/137120587 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa170003090 con 0x7fa180091950 2026-02-13T20:28:50.472 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa16dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:28:50.472 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa16dffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:28:50.472 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa16dffb640 10 monclient(hunting): dump: 2026-02-13T20:28:50.472 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:28:50.472 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:28:50.472 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:28:50.472 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:28:50.472 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:28:50.472 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:28:50.473 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:28:50.473 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:28:50.473 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:28:50.473 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:28:50.473 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa16dffb640 1 -- 10.20.193.110:0/137120587 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1362598163 0 0) 0x7fa18013f440 con 0x7fa1801401c0 2026-02-13T20:28:50.473 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa16dffb640 1 -- 10.20.193.110:0/137120587 >> v1:10.20.193.188:6789/0 conn(0x7fa18012ced0 legacy=0x7fa180192c80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T20:28:50.473 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa16dffb640 1 -- 10.20.193.110:0/137120587 >> v1:10.20.193.110:6789/0 conn(0x7fa180091950 legacy=0x7fa18013e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:28:50.473 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa16dffb640 10 monclient: _finish_hunting 0 2026-02-13T20:28:50.473 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa16dffb640 1 monclient: found mon.c 2026-02-13T20:28:50.473 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa16dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:28:50.473 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa16dffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:28:50.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa16dffb640 1 -- 10.20.193.110:0/137120587 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa18012fc40 con 0x7fa1801401c0 2026-02-13T20:28:50.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa16dffb640 10 monclient: _finish_auth 0 2026-02-13T20:28:50.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa16dffb640 10 monclient: _check_auth_tickets 2026-02-13T20:28:50.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa16dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:28:50.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa187807640 5 monclient: authenticate success, global_id 154217 2026-02-13T20:28:50.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa187807640 10 monclient: _renew_subs 2026-02-13T20:28:50.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa187807640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:28:50.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa187807640 1 -- 10.20.193.110:0/137120587 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa18012e440 con 0x7fa1801401c0 2026-02-13T20:28:50.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.454+0000 7fa187807640 10 monclient: _renew_subs 2026-02-13T20:28:50.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.455+0000 7fa187807640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:28:50.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.455+0000 7fa187807640 1 -- 10.20.193.110:0/137120587 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fa18013ed20 con 0x7fa1801401c0 2026-02-13T20:28:50.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.455+0000 7fa16dffb640 1 -- 10.20.193.110:0/137120587 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa1740043d0 con 0x7fa1801401c0 2026-02-13T20:28:50.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.455+0000 7fa16dffb640 10 monclient: handle_config config(0 keys) 2026-02-13T20:28:50.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.455+0000 7fa16dffb640 1 -- 10.20.193.110:0/137120587 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa1740047b0 con 0x7fa1801401c0 2026-02-13T20:28:50.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.455+0000 7fa16dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:28:50.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.455+0000 7fa16dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:28:50.476 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.455+0000 7fa16dffb640 10 monclient: dump: 2026-02-13T20:28:50.476 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:28:50.476 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:28:50.476 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:28:50.476 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:28:50.476 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:28:50.476 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:28:50.477 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:28:50.477 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:28:50.477 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:28:50.477 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:28:50.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.455+0000 7fa16f7fe640 4 set_mon_vals no callback set 2026-02-13T20:28:50.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.455+0000 7fa187807640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:28:50.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.455+0000 7fa187807640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:28:50.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.455+0000 7fa187807640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:28:50.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.455+0000 7fa187807640 1 -- 10.20.193.110:0/137120587 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1800008d0 con 0x7fa1801401c0 2026-02-13T20:28:50.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.455+0000 7fa16dffb640 1 -- 10.20.193.110:0/137120587 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fa174004910 con 0x7fa1801401c0 2026-02-13T20:28:50.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.455+0000 7fa16dffb640 1 -- 10.20.193.110:0/137120587 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(846..846 src has 1..846) ==== 3931+0+0 (unknown 1574598522 0 0) 0x7fa17404e890 con 0x7fa1801401c0 2026-02-13T20:28:50.477 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.456+0000 7fa18557c640 10 monclient: get_auth_request con 0x7fa15003f9e0 auth_method 0 2026-02-13T20:28:50.478 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.458+0000 7fa16dffb640 1 -- 10.20.193.110:0/137120587 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fa174016fd0 con 0x7fa1801401c0 2026-02-13T20:28:50.478 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.458+0000 7fa16dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:28:50.478 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.458+0000 7fa16dffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:28:50.561 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.561+0000 7fa187807640 10 start_mon_command cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}] 2026-02-13T20:28:50.561 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.561+0000 7fa187807640 10 monclient: _send_command 2 [{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}] 2026-02-13T20:28:50.561 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.561+0000 7fa187807640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:28:50.562 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.561+0000 7fa187807640 1 -- 10.20.193.110:0/137120587 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa180058410 con 0x7fa1801401c0 2026-02-13T20:28:50.740 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.739+0000 7fa16dffb640 1 -- 10.20.193.110:0/137120587 <== mon.2 v1:10.20.193.110:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]=0 pool 'unique_pool_0' removed v847) ==== 175+0+0 (unknown 3402959311 0 0) 0x7fa174016780 con 0x7fa1801401c0 2026-02-13T20:28:50.740 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.739+0000 7fa16dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}] 2026-02-13T20:28:50.740 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.739+0000 7fa16dffb640 10 monclient: _finish_command 2 = system:0 pool 'unique_pool_0' removed 2026-02-13T20:28:50.740 INFO:teuthology.orchestra.run.trial110.stderr:pool 'unique_pool_0' removed 2026-02-13T20:28:50.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.741+0000 7fa187807640 1 -- 10.20.193.110:0/137120587 >> v1:10.20.193.188:6812/1623052694 conn(0x7fa15003f9e0 legacy=0x7fa15005fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:28:50.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.741+0000 7fa187807640 10 monclient: shutdown 2026-02-13T20:28:50.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.741+0000 7fa187807640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:28:50.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.741+0000 7fa187807640 1 -- 10.20.193.110:0/137120587 >> v1:10.20.193.110:6790/0 conn(0x7fa1801401c0 legacy=0x7fa180191560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:28:50.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.741+0000 7fa187807640 1 -- 10.20.193.110:0/137120587 shutdown_connections 2026-02-13T20:28:50.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.741+0000 7fa187807640 1 -- 10.20.193.110:0/137120587 >> 10.20.193.110:0/137120587 conn(0x7fa180054e90 msgr2=0x7fa18008dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:28:50.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.741+0000 7fa187807640 1 -- 10.20.193.110:0/137120587 shutdown_connections 2026-02-13T20:28:50.742 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:28:50.741+0000 7fa187807640 1 -- 10.20.193.110:0/137120587 wait complete. 2026-02-13T20:28:50.752 DEBUG:teuthology.run_tasks:Unwinding manager mon_thrash 2026-02-13T20:28:50.769 INFO:tasks.mon_thrash:joining mon_thrasher 2026-02-13T20:29:08.195 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2026-02-13T20:29:08.195 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2026-02-13T20:29:08.195 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-13T20:29:08.195 DEBUG:teuthology.orchestra.run.trial188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-13T20:29:08.198 INFO:tasks.ceph.mon.b:Started 2026-02-13T20:29:08.198 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-13T20:29:08.198 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T20:29:08.263 INFO:tasks.ceph.mon.b.trial188.stderr:2026-02-13T20:29:08.260+0000 7f779763cc00 -1 mon.b@-1(???).log v0 log_external_backlog rewinding external_log_to from 661 -> 0 (sync_force? mon rebuild?) 2026-02-13T20:29:08.265 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.264+0000 7fbcf70cc640 10 monclient: get_monmap_and_config 2026-02-13T20:29:08.265 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.264+0000 7fbcf70cc640 10 monclient: build_initial_monmap 2026-02-13T20:29:08.265 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.264+0000 7fbcf70cc640 10 monclient: monmap: 2026-02-13T20:29:08.265 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:29:08.266 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:08.266 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:29:08.265696+0000 2026-02-13T20:29:08.266 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:29:08.265696+0000 2026-02-13T20:29:08.266 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:29:08.266 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:08.266 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:29:08.266 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:29:08.266 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:29:08.266 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:08.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.264+0000 7fbcf70cc640 1 Processor -- start 2026-02-13T20:29:08.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.264+0000 7fbcf70cc640 1 -- start start 2026-02-13T20:29:08.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.264+0000 7fbcf70cc640 10 monclient: init 2026-02-13T20:29:08.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.264+0000 7fbcf70cc640 10 monclient: _reopen_session rank -1 2026-02-13T20:29:08.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.264+0000 7fbcf70cc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:29:08.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.264+0000 7fbcf70cc640 10 monclient(hunting): picked mon.noname-a con 0x7fbcf01401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:29:08.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbcf70cc640 10 monclient(hunting): picked mon.noname-b con 0x7fbcf0092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:29:08.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbcf70cc640 10 monclient(hunting): picked mon.noname-c con 0x7fbcf0091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:29:08.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbcf70cc640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcf008b730 con 0x7fbcf01401c0 2026-02-13T20:29:08.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbcf70cc640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcf005c5b0 con 0x7fbcf0091950 2026-02-13T20:29:08.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbcf70cc640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcf008bcf0 con 0x7fbcf0092020 2026-02-13T20:29:08.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbcf70cc640 10 monclient(hunting): _renew_subs 2026-02-13T20:29:08.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbcf70cc640 10 monclient(hunting): authenticate will time out at 1709.956041s 2026-02-13T20:29:08.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbce7fff640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fbcf0092020 0x7fbcf01812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:55116/0 (socket says 10.20.193.110:55116) 2026-02-13T20:29:08.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbcf4e41640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fbcf01401c0 0x7fbcf0091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:58840/0 (socket says 10.20.193.110:58840) 2026-02-13T20:29:08.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbce7fff640 1 -- 10.20.193.110:0/2714083796 learned_addr learned my addr 10.20.193.110:0/2714083796 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:29:08.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbce77fe640 1 -- 10.20.193.110:0/2714083796 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1547321835 0 0) 0x7fbcf008bcf0 con 0x7fbcf0092020 2026-02-13T20:29:08.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbce77fe640 10 monclient(hunting): _negotiate 2026-02-13T20:29:08.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbce77fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:08.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbce77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:08.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbce77fe640 10 monclient(hunting): my global_id is 154220 2026-02-13T20:29:08.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbce77fe640 1 -- 10.20.193.110:0/2714083796 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcdc0035e0 con 0x7fbcf0092020 2026-02-13T20:29:08.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbce77fe640 1 -- 10.20.193.110:0/2714083796 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 243821675 0 0) 0x7fbcf008b730 con 0x7fbcf01401c0 2026-02-13T20:29:08.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbce77fe640 10 monclient(hunting): _negotiate 2026-02-13T20:29:08.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbce77fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:08.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbce77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:08.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbce77fe640 10 monclient(hunting): my global_id is 124506 2026-02-13T20:29:08.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbce77fe640 1 -- 10.20.193.110:0/2714083796 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcf008bcf0 con 0x7fbcf01401c0 2026-02-13T20:29:08.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbce77fe640 1 -- 10.20.193.110:0/2714083796 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2077748225 0 0) 0x7fbcdc0035e0 con 0x7fbcf0092020 2026-02-13T20:29:08.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbce77fe640 1 -- 10.20.193.110:0/2714083796 >> v1:10.20.193.188:6789/0 conn(0x7fbcf0091950 legacy=0x7fbcf01a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T20:29:08.273 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbce77fe640 1 -- 10.20.193.110:0/2714083796 >> v1:10.20.193.110:6789/0 conn(0x7fbcf01401c0 legacy=0x7fbcf0091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:08.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbce77fe640 10 monclient: _finish_hunting 0 2026-02-13T20:29:08.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbce77fe640 1 monclient: found mon.noname-b 2026-02-13T20:29:08.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbce77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:29:08.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbce77fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:29:08.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbce77fe640 1 -- 10.20.193.110:0/2714083796 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf0140590 con 0x7fbcf0092020 2026-02-13T20:29:08.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbce77fe640 10 monclient: _finish_auth 0 2026-02-13T20:29:08.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbce77fe640 10 monclient: _check_auth_tickets 2026-02-13T20:29:08.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbce77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:29:08.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbce77fe640 1 -- 10.20.193.110:0/2714083796 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fbcd8002dd0 con 0x7fbcf0092020 2026-02-13T20:29:08.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbce77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:08.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbce77fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:29:08.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbce77fe640 10 monclient: dump: 2026-02-13T20:29:08.274 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:08.274 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:08.274 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.274 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.274 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:08.274 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:08.274 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:08.274 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:08.274 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:08.274 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:08.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbcf70cc640 5 monclient: authenticate success, global_id 154220 2026-02-13T20:29:08.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbcf70cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:29:08.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbce77fe640 1 -- 10.20.193.110:0/2714083796 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbcd8002f60 con 0x7fbcf0092020 2026-02-13T20:29:08.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbce77fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:29:08.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbce77fe640 1 -- 10.20.193.110:0/2714083796 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fbcd8003370 con 0x7fbcf0092020 2026-02-13T20:29:08.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbcf70cc640 10 monclient: get_monmap_and_config success 2026-02-13T20:29:08.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbcf70cc640 4 set_mon_vals no callback set 2026-02-13T20:29:08.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbce77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:08.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbce77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:29:08.274 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbce77fe640 10 monclient: dump: 2026-02-13T20:29:08.274 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:08.274 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:08.274 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.274 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.274 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:08.274 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:08.274 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:08.274 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:08.274 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:08.274 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:08.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbcf70cc640 10 monclient: shutdown 2026-02-13T20:29:08.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbcf70cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:29:08.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbcf70cc640 1 -- 10.20.193.110:0/2714083796 >> v1:10.20.193.110:6790/0 conn(0x7fbcf0092020 legacy=0x7fbcf01812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:08.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbcf70cc640 1 -- 10.20.193.110:0/2714083796 shutdown_connections 2026-02-13T20:29:08.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbcf70cc640 1 -- 10.20.193.110:0/2714083796 >> 10.20.193.110:0/2714083796 conn(0x7fbcf0054e90 msgr2=0x7fbcf0058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:29:08.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbcf70cc640 1 -- 10.20.193.110:0/2714083796 shutdown_connections 2026-02-13T20:29:08.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.265+0000 7fbcf70cc640 1 -- 10.20.193.110:0/2714083796 wait complete. 2026-02-13T20:29:08.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.266+0000 7fbcf70cc640 10 monclient: build_initial_monmap 2026-02-13T20:29:08.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.266+0000 7fbcf70cc640 10 monclient: monmap: 2026-02-13T20:29:08.275 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:29:08.275 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:29:08.275 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:29:08.275 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:29:08.275 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:29:08.275 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:29:08.275 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:29:08.275 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:29:08.275 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:29:08.275 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:08.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.266+0000 7fbcf70cc640 1 Processor -- start 2026-02-13T20:29:08.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.266+0000 7fbcf70cc640 1 -- start start 2026-02-13T20:29:08.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.266+0000 7fbcf70cc640 10 monclient: init 2026-02-13T20:29:08.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.266+0000 7fbcf70cc640 10 monclient: _reopen_session rank -1 2026-02-13T20:29:08.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.266+0000 7fbcf70cc640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:29:08.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.266+0000 7fbcf70cc640 10 monclient(hunting): picked mon.noname-a con 0x7fbcf0091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:29:08.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.266+0000 7fbcf70cc640 10 monclient(hunting): picked mon.noname-b con 0x7fbcf01401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:29:08.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.266+0000 7fbcf70cc640 10 monclient(hunting): picked mon.noname-c con 0x7fbcf01503a0 addr v1:10.20.193.110:6790/0 2026-02-13T20:29:08.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.266+0000 7fbcf70cc640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcf012daa0 con 0x7fbcf0091950 2026-02-13T20:29:08.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.266+0000 7fbcf70cc640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcf01507c0 con 0x7fbcf01401c0 2026-02-13T20:29:08.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.266+0000 7fbcf70cc640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcf013f440 con 0x7fbcf01503a0 2026-02-13T20:29:08.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.266+0000 7fbcf70cc640 10 monclient(hunting): _renew_subs 2026-02-13T20:29:08.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.266+0000 7fbcf70cc640 10 monclient(hunting): authenticate will time out at 1709.957641s 2026-02-13T20:29:08.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.266+0000 7fbcf4e41640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fbcf0091950 0x7fbcf013e630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:58846/0 (socket says 10.20.193.110:58846) 2026-02-13T20:29:08.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.266+0000 7fbcf4e41640 1 -- 10.20.193.110:0/1352245103 learned_addr learned my addr 10.20.193.110:0/1352245103 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:29:08.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.266+0000 7fbce57fa640 1 -- 10.20.193.110:0/1352245103 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 351328792 0 0) 0x7fbcf012daa0 con 0x7fbcf0091950 2026-02-13T20:29:08.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.266+0000 7fbce57fa640 10 monclient(hunting): _negotiate 2026-02-13T20:29:08.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.266+0000 7fbce57fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:08.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.266+0000 7fbce57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:08.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.266+0000 7fbce57fa640 10 monclient(hunting): my global_id is 124509 2026-02-13T20:29:08.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.266+0000 7fbce57fa640 1 -- 10.20.193.110:0/1352245103 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcc00035e0 con 0x7fbcf0091950 2026-02-13T20:29:08.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.266+0000 7fbce57fa640 1 -- 10.20.193.110:0/1352245103 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 218924456 0 0) 0x7fbcf013f440 con 0x7fbcf01503a0 2026-02-13T20:29:08.275 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.266+0000 7fbce57fa640 10 monclient(hunting): _negotiate 2026-02-13T20:29:08.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.266+0000 7fbce57fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:08.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.266+0000 7fbce57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:08.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.266+0000 7fbce57fa640 10 monclient(hunting): my global_id is 154223 2026-02-13T20:29:08.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.266+0000 7fbce57fa640 1 -- 10.20.193.110:0/1352245103 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcf012daa0 con 0x7fbcf01503a0 2026-02-13T20:29:08.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.266+0000 7fbce57fa640 1 -- 10.20.193.110:0/1352245103 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3627688052 0 0) 0x7fbcc00035e0 con 0x7fbcf0091950 2026-02-13T20:29:08.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.266+0000 7fbce57fa640 1 -- 10.20.193.110:0/1352245103 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbcf013f440 con 0x7fbcf0091950 2026-02-13T20:29:08.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.267+0000 7fbce57fa640 1 -- 10.20.193.110:0/1352245103 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4233680308 0 0) 0x7fbcf012daa0 con 0x7fbcf01503a0 2026-02-13T20:29:08.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.267+0000 7fbce57fa640 1 -- 10.20.193.110:0/1352245103 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbcc00035e0 con 0x7fbcf01503a0 2026-02-13T20:29:08.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.267+0000 7fbce57fa640 1 -- 10.20.193.110:0/1352245103 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fbce0003170 con 0x7fbcf0091950 2026-02-13T20:29:08.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.267+0000 7fbce57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:29:08.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.267+0000 7fbce57fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:29:08.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.267+0000 7fbce57fa640 10 monclient(hunting): dump: 2026-02-13T20:29:08.276 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:08.276 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:08.276 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.276 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.276 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:08.276 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:08.276 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:08.276 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:08.276 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:08.276 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:08.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.267+0000 7fbce57fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:29:08.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.267+0000 7fbce57fa640 1 -- 10.20.193.110:0/1352245103 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fbcec003d80 con 0x7fbcf01503a0 2026-02-13T20:29:08.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.267+0000 7fbce57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:29:08.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.267+0000 7fbce57fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:29:08.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.267+0000 7fbce57fa640 10 monclient(hunting): dump: 2026-02-13T20:29:08.276 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:08.276 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:08.276 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.276 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.276 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:08.276 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:08.276 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:08.276 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:08.276 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:08.276 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:08.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.267+0000 7fbce57fa640 1 -- 10.20.193.110:0/1352245103 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3630126248 0 0) 0x7fbcf013f440 con 0x7fbcf0091950 2026-02-13T20:29:08.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.267+0000 7fbce57fa640 1 -- 10.20.193.110:0/1352245103 >> v1:10.20.193.110:6790/0 conn(0x7fbcf01503a0 legacy=0x7fbcf0192e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:08.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.267+0000 7fbce57fa640 1 -- 10.20.193.110:0/1352245103 >> v1:10.20.193.188:6789/0 conn(0x7fbcf01401c0 legacy=0x7fbcf0191720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:08.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.267+0000 7fbce57fa640 10 monclient: _finish_hunting 0 2026-02-13T20:29:08.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.267+0000 7fbce57fa640 1 monclient: found mon.a 2026-02-13T20:29:08.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.267+0000 7fbce57fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:29:08.276 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.267+0000 7fbce57fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:29:08.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.267+0000 7fbce57fa640 1 -- 10.20.193.110:0/1352245103 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf005d320 con 0x7fbcf0091950 2026-02-13T20:29:08.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.267+0000 7fbce57fa640 10 monclient: _finish_auth 0 2026-02-13T20:29:08.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.267+0000 7fbce57fa640 10 monclient: _check_auth_tickets 2026-02-13T20:29:08.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.267+0000 7fbce57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:29:08.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.267+0000 7fbcf70cc640 5 monclient: authenticate success, global_id 124509 2026-02-13T20:29:08.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.267+0000 7fbcf70cc640 10 monclient: _renew_subs 2026-02-13T20:29:08.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.267+0000 7fbcf70cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:29:08.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.267+0000 7fbcf70cc640 1 -- 10.20.193.110:0/1352245103 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbcf0150a50 con 0x7fbcf0091950 2026-02-13T20:29:08.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.267+0000 7fbcf70cc640 10 monclient: _renew_subs 2026-02-13T20:29:08.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.267+0000 7fbcf70cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:29:08.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.267+0000 7fbcf70cc640 1 -- 10.20.193.110:0/1352245103 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fbcf012f560 con 0x7fbcf0091950 2026-02-13T20:29:08.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.267+0000 7fbce57fa640 1 -- 10.20.193.110:0/1352245103 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbce00032d0 con 0x7fbcf0091950 2026-02-13T20:29:08.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.267+0000 7fbce57fa640 10 monclient: handle_config config(0 keys) 2026-02-13T20:29:08.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.267+0000 7fbce57fa640 1 -- 10.20.193.110:0/1352245103 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fbce0003540 con 0x7fbcf0091950 2026-02-13T20:29:08.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.267+0000 7fbce57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:08.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.267+0000 7fbce57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:29:08.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.267+0000 7fbce57fa640 10 monclient: dump: 2026-02-13T20:29:08.277 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:08.277 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:08.277 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.277 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.277 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:08.277 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:08.277 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:08.277 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:08.277 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:08.277 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:08.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.267+0000 7fbce6ffd640 4 set_mon_vals no callback set 2026-02-13T20:29:08.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.267+0000 7fbcf70cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:08.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.267+0000 7fbcf70cc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:08.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.267+0000 7fbcf70cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:29:08.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.267+0000 7fbcf70cc640 1 -- 10.20.193.110:0/1352245103 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcf00008d0 con 0x7fbcf0091950 2026-02-13T20:29:08.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.267+0000 7fbce57fa640 1 -- 10.20.193.110:0/1352245103 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fbce0011810 con 0x7fbcf0091950 2026-02-13T20:29:08.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.268+0000 7fbce57fa640 1 -- 10.20.193.110:0/1352245103 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(847..847 src has 1..847) ==== 3591+0+0 (unknown 4078645555 0 0) 0x7fbce004e880 con 0x7fbcf0091950 2026-02-13T20:29:08.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.268+0000 7fbce7fff640 10 monclient: get_auth_request con 0x7fbcc003f9c0 auth_method 0 2026-02-13T20:29:08.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.270+0000 7fbce57fa640 1 -- 10.20.193.110:0/1352245103 <== mon.0 v1:10.20.193.110:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fbce00170b0 con 0x7fbcf0091950 2026-02-13T20:29:08.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.270+0000 7fbce57fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:08.277 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.270+0000 7fbce57fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:29:08.428 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.427+0000 7fbcf70cc640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T20:29:08.428 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.427+0000 7fbcf70cc640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T20:29:08.428 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.427+0000 7fbcf70cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:29:08.429 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.427+0000 7fbcf70cc640 1 -- 10.20.193.110:0/1352245103 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fbcf012e600 con 0x7fbcf0091950 2026-02-13T20:29:08.429 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.427+0000 7fbce57fa640 1 -- 10.20.193.110:0/1352245103 <== mon.0 v1:10.20.193.110:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 3789901752) 0x7fbce0016860 con 0x7fbcf0091950 2026-02-13T20:29:08.429 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.427+0000 7fbce57fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T20:29:08.429 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.427+0000 7fbce57fa640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:29:08.429 INFO:teuthology.orchestra.run.trial110.stdout:{"election_epoch":64,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","modified":"2026-02-13T20:11:07.161192Z","created":"2026-02-13T20:11:07.161192Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6789","nonce":0}]},"addr":"10.20.193.110:6789/0","public_addr":"10.20.193.110:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161241+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6789","nonce":0}]},"addr":"10.20.193.188:6789/0","public_addr":"10.20.193.188:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161242+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6790","nonce":0}]},"addr":"10.20.193.110:6790/0","public_addr":"10.20.193.110:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161243+0000","crush_location":[]}]}} 2026-02-13T20:29:08.430 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.428+0000 7fbcf70cc640 1 -- 10.20.193.110:0/1352245103 >> v1:10.20.193.188:6812/1623052694 conn(0x7fbcc003f9c0 legacy=0x7fbcc005fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:08.430 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.428+0000 7fbcf70cc640 10 monclient: shutdown 2026-02-13T20:29:08.430 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.428+0000 7fbcf70cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:29:08.430 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.428+0000 7fbcf70cc640 1 -- 10.20.193.110:0/1352245103 >> v1:10.20.193.110:6789/0 conn(0x7fbcf0091950 legacy=0x7fbcf013e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:08.430 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.429+0000 7fbcf70cc640 1 -- 10.20.193.110:0/1352245103 shutdown_connections 2026-02-13T20:29:08.430 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.429+0000 7fbcf70cc640 1 -- 10.20.193.110:0/1352245103 >> 10.20.193.110:0/1352245103 conn(0x7fbcf0054e90 msgr2=0x7fbcf008db80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:29:08.430 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.429+0000 7fbcf70cc640 1 -- 10.20.193.110:0/1352245103 shutdown_connections 2026-02-13T20:29:08.430 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.429+0000 7fbcf70cc640 1 -- 10.20.193.110:0/1352245103 wait complete. 2026-02-13T20:29:08.437 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-13T20:29:08.437 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-13T20:29:08.438 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T20:29:08.505 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.503+0000 7f108abc2640 10 monclient: get_monmap_and_config 2026-02-13T20:29:08.506 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.503+0000 7f108abc2640 10 monclient: build_initial_monmap 2026-02-13T20:29:08.506 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.503+0000 7f108abc2640 10 monclient: monmap: 2026-02-13T20:29:08.506 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:29:08.506 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:08.506 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:29:08.505385+0000 2026-02-13T20:29:08.506 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:29:08.505385+0000 2026-02-13T20:29:08.506 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:29:08.506 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:08.507 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:29:08.507 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:29:08.507 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:29:08.507 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:08.507 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.504+0000 7f108abc2640 1 Processor -- start 2026-02-13T20:29:08.507 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.504+0000 7f108abc2640 1 -- start start 2026-02-13T20:29:08.507 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.504+0000 7f108abc2640 10 monclient: init 2026-02-13T20:29:08.517 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.504+0000 7f108abc2640 10 monclient: _reopen_session rank -1 2026-02-13T20:29:08.517 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.504+0000 7f108abc2640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:29:08.517 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.504+0000 7f108abc2640 10 monclient(hunting): picked mon.noname-b con 0x7f108405c540 addr v1:10.20.193.110:6790/0 2026-02-13T20:29:08.517 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.504+0000 7f108abc2640 10 monclient(hunting): picked mon.noname-c con 0x7f108405d050 addr v1:10.20.193.188:6789/0 2026-02-13T20:29:08.517 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.505+0000 7f108abc2640 10 monclient(hunting): picked mon.noname-a con 0x7f1084142430 addr v1:10.20.193.110:6789/0 2026-02-13T20:29:08.517 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.505+0000 7f108abc2640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f108408f370 con 0x7f1084142430 2026-02-13T20:29:08.517 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.505+0000 7f108abc2640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f108408f540 con 0x7f108405d050 2026-02-13T20:29:08.517 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.505+0000 7f108abc2640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10840905e0 con 0x7f108405c540 2026-02-13T20:29:08.517 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.505+0000 7f108abc2640 10 monclient(hunting): _renew_subs 2026-02-13T20:29:08.517 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.505+0000 7f108abc2640 10 monclient(hunting): authenticate will time out at 1710.196059s 2026-02-13T20:29:08.517 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.505+0000 7f1089138640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f1084142430 0x7f10841a4c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:58850/0 (socket says 10.20.193.110:58850) 2026-02-13T20:29:08.517 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.505+0000 7f1088937640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f108405c540 0x7f108405c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:55136/0 (socket says 10.20.193.110:55136) 2026-02-13T20:29:08.517 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.505+0000 7f1089138640 1 -- 10.20.193.110:0/1359098865 learned_addr learned my addr 10.20.193.110:0/1359098865 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:29:08.517 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.505+0000 7f107b7fe640 1 -- 10.20.193.110:0/1359098865 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3689444191 0 0) 0x7f10840905e0 con 0x7f108405c540 2026-02-13T20:29:08.517 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.505+0000 7f107b7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:29:08.517 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.505+0000 7f107b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:08.517 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.505+0000 7f107b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:08.517 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.505+0000 7f107b7fe640 10 monclient(hunting): my global_id is 154226 2026-02-13T20:29:08.517 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.505+0000 7f107b7fe640 1 -- 10.20.193.110:0/1359098865 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10700035e0 con 0x7f108405c540 2026-02-13T20:29:08.517 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.505+0000 7f107b7fe640 1 -- 10.20.193.110:0/1359098865 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2555283139 0 0) 0x7f108408f370 con 0x7f1084142430 2026-02-13T20:29:08.517 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.505+0000 7f107b7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:29:08.517 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.505+0000 7f107b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:08.517 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.505+0000 7f107b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:08.517 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.505+0000 7f107b7fe640 10 monclient(hunting): my global_id is 124512 2026-02-13T20:29:08.517 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.505+0000 7f107b7fe640 1 -- 10.20.193.110:0/1359098865 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10840905e0 con 0x7f1084142430 2026-02-13T20:29:08.517 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.505+0000 7f107b7fe640 1 -- 10.20.193.110:0/1359098865 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2953747059 0 0) 0x7f10700035e0 con 0x7f108405c540 2026-02-13T20:29:08.517 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.505+0000 7f107b7fe640 1 -- 10.20.193.110:0/1359098865 >> v1:10.20.193.188:6789/0 conn(0x7f108405d050 legacy=0x7f1084183540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:08.517 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.505+0000 7f107b7fe640 1 -- 10.20.193.110:0/1359098865 >> v1:10.20.193.110:6789/0 conn(0x7f1084142430 legacy=0x7f10841a4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:08.517 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.505+0000 7f107b7fe640 10 monclient: _finish_hunting 0 2026-02-13T20:29:08.517 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.505+0000 7f107b7fe640 1 monclient: found mon.noname-b 2026-02-13T20:29:08.518 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.505+0000 7f107b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:29:08.518 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.505+0000 7f107b7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:29:08.518 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.505+0000 7f107b7fe640 1 -- 10.20.193.110:0/1359098865 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1084142850 con 0x7f108405c540 2026-02-13T20:29:08.518 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.505+0000 7f107b7fe640 10 monclient: _finish_auth 0 2026-02-13T20:29:08.518 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.505+0000 7f107b7fe640 10 monclient: _check_auth_tickets 2026-02-13T20:29:08.518 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.505+0000 7f107b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:29:08.518 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.505+0000 7f107b7fe640 1 -- 10.20.193.110:0/1359098865 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f1074002dd0 con 0x7f108405c540 2026-02-13T20:29:08.518 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.505+0000 7f108abc2640 5 monclient: authenticate success, global_id 154226 2026-02-13T20:29:08.518 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.505+0000 7f107b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:08.518 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.505+0000 7f107b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:29:08.518 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.505+0000 7f107b7fe640 10 monclient: dump: 2026-02-13T20:29:08.518 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:08.518 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:08.518 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.518 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.518 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:08.518 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:08.518 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:08.518 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:08.518 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:08.518 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:08.518 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.505+0000 7f108abc2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:29:08.518 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.505+0000 7f107b7fe640 1 -- 10.20.193.110:0/1359098865 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1074002fa0 con 0x7f108405c540 2026-02-13T20:29:08.518 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.505+0000 7f107b7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:29:08.518 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.506+0000 7f107b7fe640 1 -- 10.20.193.110:0/1359098865 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f10740033b0 con 0x7f108405c540 2026-02-13T20:29:08.518 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.506+0000 7f108abc2640 10 monclient: get_monmap_and_config success 2026-02-13T20:29:08.518 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.506+0000 7f108abc2640 4 set_mon_vals no callback set 2026-02-13T20:29:08.518 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.506+0000 7f107b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:08.518 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.506+0000 7f107b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:29:08.518 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.506+0000 7f107b7fe640 10 monclient: dump: 2026-02-13T20:29:08.518 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:08.518 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:08.518 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.518 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.518 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:08.518 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:08.518 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:08.518 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:08.518 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:08.518 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:08.518 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.506+0000 7f108abc2640 10 monclient: shutdown 2026-02-13T20:29:08.518 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.506+0000 7f108abc2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:29:08.518 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.506+0000 7f108abc2640 1 -- 10.20.193.110:0/1359098865 >> v1:10.20.193.110:6790/0 conn(0x7f108405c540 legacy=0x7f108405c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:08.518 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.506+0000 7f108abc2640 1 -- 10.20.193.110:0/1359098865 shutdown_connections 2026-02-13T20:29:08.519 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.506+0000 7f108abc2640 1 -- 10.20.193.110:0/1359098865 >> 10.20.193.110:0/1359098865 conn(0x7f1084093270 msgr2=0x7f1084054330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:29:08.519 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.506+0000 7f108abc2640 1 -- 10.20.193.110:0/1359098865 shutdown_connections 2026-02-13T20:29:08.519 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.506+0000 7f108abc2640 1 -- 10.20.193.110:0/1359098865 wait complete. 2026-02-13T20:29:08.519 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.506+0000 7f108abc2640 10 monclient: build_initial_monmap 2026-02-13T20:29:08.519 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.506+0000 7f108abc2640 10 monclient: monmap: 2026-02-13T20:29:08.519 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:29:08.519 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:29:08.519 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:29:08.519 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:29:08.519 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:29:08.519 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:29:08.519 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:29:08.519 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:29:08.519 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:29:08.519 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:08.519 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.507+0000 7f108abc2640 1 Processor -- start 2026-02-13T20:29:08.519 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.507+0000 7f108abc2640 1 -- start start 2026-02-13T20:29:08.519 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.507+0000 7f108abc2640 10 monclient: init 2026-02-13T20:29:08.519 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.507+0000 7f108abc2640 10 monclient: _reopen_session rank -1 2026-02-13T20:29:08.519 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.507+0000 7f108abc2640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:29:08.519 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.507+0000 7f108abc2640 10 monclient(hunting): picked mon.noname-c con 0x7f108405c540 addr v1:10.20.193.110:6790/0 2026-02-13T20:29:08.519 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.507+0000 7f108abc2640 10 monclient(hunting): picked mon.noname-a con 0x7f108405d050 addr v1:10.20.193.110:6789/0 2026-02-13T20:29:08.519 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.507+0000 7f108abc2640 10 monclient(hunting): picked mon.noname-b con 0x7f1084142430 addr v1:10.20.193.188:6789/0 2026-02-13T20:29:08.519 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.507+0000 7f108abc2640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1084131730 con 0x7f108405d050 2026-02-13T20:29:08.519 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.507+0000 7f108abc2640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f108412fc70 con 0x7f1084142430 2026-02-13T20:29:08.519 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.507+0000 7f108abc2640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f108405d590 con 0x7f108405c540 2026-02-13T20:29:08.519 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.507+0000 7f108abc2640 10 monclient(hunting): _renew_subs 2026-02-13T20:29:08.519 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.507+0000 7f108abc2640 10 monclient(hunting): authenticate will time out at 1710.198334s 2026-02-13T20:29:08.519 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.507+0000 7f1088937640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f108405c540 0x7f10841405d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:55140/0 (socket says 10.20.193.110:55140) 2026-02-13T20:29:08.519 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.507+0000 7f1088937640 1 -- 10.20.193.110:0/748166890 learned_addr learned my addr 10.20.193.110:0/748166890 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:29:08.519 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.507+0000 7f10797fa640 1 -- 10.20.193.110:0/748166890 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4032060276 0 0) 0x7f108405d590 con 0x7f108405c540 2026-02-13T20:29:08.519 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.507+0000 7f10797fa640 10 monclient(hunting): _negotiate 2026-02-13T20:29:08.519 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.507+0000 7f10797fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:08.519 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.507+0000 7f10797fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:08.519 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.507+0000 7f10797fa640 10 monclient(hunting): my global_id is 154229 2026-02-13T20:29:08.519 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.507+0000 7f10797fa640 1 -- 10.20.193.110:0/748166890 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10540035e0 con 0x7f108405c540 2026-02-13T20:29:08.519 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.507+0000 7f10797fa640 1 -- 10.20.193.110:0/748166890 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1099587147 0 0) 0x7f108412fc70 con 0x7f1084142430 2026-02-13T20:29:08.519 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.507+0000 7f10797fa640 10 monclient(hunting): _negotiate 2026-02-13T20:29:08.519 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.507+0000 7f10797fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:08.519 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.507+0000 7f10797fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:08.519 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.507+0000 7f10797fa640 10 monclient(hunting): my global_id is 164098 2026-02-13T20:29:08.519 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.507+0000 7f10797fa640 1 -- 10.20.193.110:0/748166890 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f108405d590 con 0x7f1084142430 2026-02-13T20:29:08.519 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.507+0000 7f10797fa640 1 -- 10.20.193.110:0/748166890 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3299058994 0 0) 0x7f10540035e0 con 0x7f108405c540 2026-02-13T20:29:08.519 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.507+0000 7f10797fa640 1 -- 10.20.193.110:0/748166890 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f108412fc70 con 0x7f108405c540 2026-02-13T20:29:08.519 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.507+0000 7f10797fa640 1 -- 10.20.193.110:0/748166890 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f10740032c0 con 0x7f108405c540 2026-02-13T20:29:08.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.507+0000 7f10797fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:29:08.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.507+0000 7f10797fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:29:08.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.507+0000 7f10797fa640 10 monclient(hunting): dump: 2026-02-13T20:29:08.520 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:08.520 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:08.520 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.520 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.520 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:08.520 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:08.520 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:08.520 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:08.520 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:08.520 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:08.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.507+0000 7f10797fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:29:08.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.508+0000 7f10797fa640 1 -- 10.20.193.110:0/748166890 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4174339321 0 0) 0x7f108412fc70 con 0x7f108405c540 2026-02-13T20:29:08.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.508+0000 7f10797fa640 1 -- 10.20.193.110:0/748166890 >> v1:10.20.193.188:6789/0 conn(0x7f1084142430 legacy=0x7f1084195030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:08.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.508+0000 7f10797fa640 1 -- 10.20.193.110:0/748166890 >> v1:10.20.193.110:6789/0 conn(0x7f108405d050 legacy=0x7f1084193910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:08.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.508+0000 7f10797fa640 10 monclient: _finish_hunting 0 2026-02-13T20:29:08.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.508+0000 7f10797fa640 1 monclient: found mon.c 2026-02-13T20:29:08.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.508+0000 7f10797fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:29:08.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.508+0000 7f10797fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:08.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.508+0000 7f10797fa640 1 -- 10.20.193.110:0/748166890 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1084131cf0 con 0x7f108405c540 2026-02-13T20:29:08.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.508+0000 7f10797fa640 10 monclient: _finish_auth 0 2026-02-13T20:29:08.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.508+0000 7f10797fa640 10 monclient: _check_auth_tickets 2026-02-13T20:29:08.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.508+0000 7f10797fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:29:08.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.508+0000 7f108abc2640 5 monclient: authenticate success, global_id 154229 2026-02-13T20:29:08.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.508+0000 7f108abc2640 10 monclient: _renew_subs 2026-02-13T20:29:08.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.508+0000 7f108abc2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:08.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.508+0000 7f108abc2640 1 -- 10.20.193.110:0/748166890 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1084131fd0 con 0x7f108405c540 2026-02-13T20:29:08.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.508+0000 7f108abc2640 10 monclient: _renew_subs 2026-02-13T20:29:08.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.508+0000 7f108abc2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:08.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.508+0000 7f108abc2640 1 -- 10.20.193.110:0/748166890 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f10841527e0 con 0x7f108405c540 2026-02-13T20:29:08.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.508+0000 7f10797fa640 1 -- 10.20.193.110:0/748166890 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1074003420 con 0x7f108405c540 2026-02-13T20:29:08.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.508+0000 7f10797fa640 10 monclient: handle_config config(0 keys) 2026-02-13T20:29:08.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.508+0000 7f10797fa640 1 -- 10.20.193.110:0/748166890 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f1074004d00 con 0x7f108405c540 2026-02-13T20:29:08.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.508+0000 7f10797fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:08.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.508+0000 7f10797fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:29:08.520 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.508+0000 7f10797fa640 10 monclient: dump: 2026-02-13T20:29:08.520 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:08.520 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:08.520 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.520 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.520 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:08.520 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:08.520 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:08.521 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:08.521 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:08.521 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:08.521 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.508+0000 7f107affd640 4 set_mon_vals no callback set 2026-02-13T20:29:08.521 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.508+0000 7f108abc2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:08.521 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.508+0000 7f108abc2640 1 -- 10.20.193.110:0/748166890 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1084091630 con 0x7f10841a65a0 2026-02-13T20:29:08.521 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.508+0000 7f10797fa640 1 -- 10.20.193.110:0/748166890 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f1074004e60 con 0x7f108405c540 2026-02-13T20:29:08.521 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.508+0000 7f10797fa640 1 -- 10.20.193.110:0/748166890 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(847..847 src has 1..847) ==== 3591+0+0 (unknown 4078645555 0 0) 0x7f107404e860 con 0x7f108405c540 2026-02-13T20:29:08.521 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.509+0000 7f10797fa640 1 -- 10.20.193.110:0/748166890 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1623496817 0 0) 0x7f1084091630 con 0x7f10841a65a0 2026-02-13T20:29:08.521 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.509+0000 7f10797fa640 10 monclient(hunting): _negotiate 2026-02-13T20:29:08.521 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.509+0000 7f10797fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:08.521 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.509+0000 7f10797fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:08.521 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.509+0000 7f10797fa640 10 monclient(hunting): my global_id is 124515 2026-02-13T20:29:08.521 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.509+0000 7f10797fa640 1 -- 10.20.193.110:0/748166890 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f108412fc70 con 0x7f10841a65a0 2026-02-13T20:29:08.521 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.509+0000 7f1089138640 10 monclient: get_auth_request con 0x7f105403f6a0 auth_method 0 2026-02-13T20:29:08.521 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.509+0000 7f10797fa640 1 -- 10.20.193.110:0/748166890 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 856876251 0 0) 0x7f108412fc70 con 0x7f10841a65a0 2026-02-13T20:29:08.521 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.509+0000 7f10797fa640 1 -- 10.20.193.110:0/748166890 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1084091630 con 0x7f10841a65a0 2026-02-13T20:29:08.521 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.509+0000 7f10797fa640 1 -- 10.20.193.110:0/748166890 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f106c002e10 con 0x7f10841a65a0 2026-02-13T20:29:08.521 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.509+0000 7f10797fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:08.521 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.509+0000 7f10797fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:29:08.521 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.509+0000 7f10797fa640 10 monclient: dump: 2026-02-13T20:29:08.521 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:08.521 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:08.521 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.521 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.521 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:08.521 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:08.521 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:08.521 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:08.521 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:08.521 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:08.521 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.509+0000 7f10797fa640 1 -- 10.20.193.110:0/748166890 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 33659564 0 0) 0x7f1084091630 con 0x7f10841a65a0 2026-02-13T20:29:08.521 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.509+0000 7f10797fa640 1 -- 10.20.193.110:0/748166890 --> v1:10.20.193.110:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1084152ae0 con 0x7f10841a65a0 2026-02-13T20:29:08.521 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.509+0000 7f10797fa640 1 -- 10.20.193.110:0/748166890 <== mon.0 v1:10.20.193.110:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f106c003370 con 0x7f10841a65a0 2026-02-13T20:29:08.521 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.509+0000 7f10797fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:08.521 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.509+0000 7f10797fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:29:08.521 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.509+0000 7f10797fa640 1 -- 10.20.193.110:0/748166890 >> v1:10.20.193.110:6789/0 conn(0x7f10841a65a0 legacy=0x7f1084129d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:08.521 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.509+0000 7f10797fa640 1 -- 10.20.193.110:0/748166890 >> v1:10.20.193.110:6789/0 conn(0x7f10841a65a0 legacy=0x7f1084129d90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:29:08.521 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.512+0000 7f108abc2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:29:08.521 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.512+0000 7f108abc2640 1 -- 10.20.193.110:0/748166890 --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f10841318e0 con 0x7f1084140ce0 2026-02-13T20:29:08.521 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.513+0000 7f10797fa640 1 -- 10.20.193.110:0/748166890 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1306741160 0 0) 0x7f1084131730 con 0x7f1084140ce0 2026-02-13T20:29:08.521 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.513+0000 7f10797fa640 10 monclient(hunting): _negotiate 2026-02-13T20:29:08.521 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.513+0000 7f10797fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:08.521 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.513+0000 7f10797fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:08.522 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.513+0000 7f10797fa640 10 monclient(hunting): my global_id is 124518 2026-02-13T20:29:08.522 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.513+0000 7f10797fa640 1 -- 10.20.193.110:0/748166890 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1084091630 con 0x7f1084140ce0 2026-02-13T20:29:08.522 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.513+0000 7f10797fa640 1 -- 10.20.193.110:0/748166890 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2240849110 0 0) 0x7f1084091630 con 0x7f1084140ce0 2026-02-13T20:29:08.522 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.513+0000 7f10797fa640 1 -- 10.20.193.110:0/748166890 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1084131730 con 0x7f1084140ce0 2026-02-13T20:29:08.522 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.513+0000 7f10797fa640 1 -- 10.20.193.110:0/748166890 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f106c003b60 con 0x7f1084140ce0 2026-02-13T20:29:08.522 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.513+0000 7f10797fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:08.522 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.513+0000 7f10797fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:29:08.522 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.513+0000 7f10797fa640 10 monclient: dump: 2026-02-13T20:29:08.522 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:08.522 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:08.522 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.522 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.522 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:08.522 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:08.522 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:08.522 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:08.522 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:08.522 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:08.522 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.513+0000 7f10797fa640 1 -- 10.20.193.110:0/748166890 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2227008277 0 0) 0x7f1084131730 con 0x7f1084140ce0 2026-02-13T20:29:08.522 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.513+0000 7f10797fa640 1 -- 10.20.193.110:0/748166890 --> v1:10.20.193.110:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f10841410e0 con 0x7f1084140ce0 2026-02-13T20:29:08.522 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.513+0000 7f10797fa640 1 -- 10.20.193.110:0/748166890 <== mon.0 v1:10.20.193.110:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4514 (unknown 0 0 1487449189) 0x7f106c004700 con 0x7f1084140ce0 2026-02-13T20:29:08.522 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.513+0000 7f10797fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:29:08.522 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.513+0000 7f10797fa640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:29:08.522 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.513+0000 7f10797fa640 1 -- 10.20.193.110:0/748166890 >> v1:10.20.193.110:6789/0 conn(0x7f1084140ce0 legacy=0x7f108412a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:08.522 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.513+0000 7f10797fa640 1 -- 10.20.193.110:0/748166890 >> v1:10.20.193.110:6789/0 conn(0x7f1084140ce0 legacy=0x7f108412a4a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:29:08.522 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:29:08.522 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:29:08.522 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:29:08.522 INFO:teuthology.orchestra.run.trial110.stdout: "state": "peon", 2026-02-13T20:29:08.522 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 64, 2026-02-13T20:29:08.522 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 463932, 2026-02-13T20:29:08.522 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:29:08.522 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:29:08.522 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:29:08.522 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:29:08.522 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:29:08.522 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 0, 2026-02-13T20:29:08.522 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:29:08.523 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:29:08.523 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:29:08.523 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:29:08.523 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:29:08.523 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:29:08.523 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:29:08.523 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:29:08.523 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:29:08.523 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:29:08.523 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:29:08.523 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:29:08.523 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:29:08.523 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:29:08.523 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:29:08.523 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:29:08.523 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:29:08.523 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:29:08.523 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:29:08.523 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:29:08.523 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:29:08.523 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:29:08.523 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:29:08.523 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:29:08.523 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:29:08.523 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:29:08.523 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:29:08.523 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:29:08.523 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:29:08.523 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:29:08.523 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:29:08.523 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:29:08.523 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:29:08.523 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:29:08.523 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:29:08.523 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:29:08.523 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:29:08.523 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:29:08.523 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:29:08.523 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:29:08.523 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:29:08.523 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:29:08.523 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:29:08.523 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:29:08.523 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:29:08.524 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:29:08.524 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:29:08.524 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:29:08.524 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:29:08.524 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:29:08.524 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:29:08.524 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:29:08.524 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:29:08.524 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:29:08.524 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:29:08.524 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:29:08.524 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:29:08.524 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:29:08.524 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:29:08.524 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:29:08.524 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:29:08.524 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:29:08.524 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:29:08.524 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:29:08.524 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:29:08.524 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:29:08.524 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:29:08.524 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:29:08.524 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:29:08.524 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:29:08.524 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:29:08.524 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:29:08.524 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:29:08.524 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:29:08.524 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:29:08.524 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:29:08.524 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:29:08.524 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:29:08.524 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:29:08.524 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:29:08.524 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:29:08.524 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:29:08.524 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:29:08.524 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:29:08.524 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:29:08.524 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:29:08.524 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:29:08.524 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:29:08.524 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:29:08.524 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:29:08.525 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:29:08.525 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:29:08.525 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:29:08.525 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:29:08.525 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:29:08.525 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:29:08.525 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:29:08.525 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:29:08.525 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:29:08.525 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:29:08.525 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:29:08.525 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:29:08.525 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:29:08.525 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:29:08.525 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:29:08.525 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:29:08.525 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:29:08.525 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:29:08.525 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:29:08.525 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:29:08.525 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:29:08.525 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:29:08.525 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:29:08.525 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:29:08.525 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:29:08.525 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:29:08.525 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:29:08.525 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:29:08.525 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:29:08.525 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:29:08.525 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:29:08.525 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:29:08.525 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:29:08.525 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:29:08.525 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:29:08.525 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:29:08.525 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:29:08.525 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:29:08.525 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:29:08.525 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:29:08.525 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:29:08.525 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:29:08.525 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:29:08.525 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:29:08.525 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:29:08.526 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:29:08.526 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:29:08.526 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:29:08.526 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:29:08.526 INFO:teuthology.orchestra.run.trial110.stdout: "num": 4 2026-02-13T20:29:08.526 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:29:08.526 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:29:08.526 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:29:08.526 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:29:08.526 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:29:08.526 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:29:08.526 INFO:teuthology.orchestra.run.trial110.stdout: "num": 4 2026-02-13T20:29:08.526 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:29:08.526 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:29:08.526 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:29:08.526 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:29:08.526 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:29:08.526 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.513+0000 7f108abc2640 1 -- 10.20.193.110:0/748166890 >> v1:10.20.193.188:6812/1623052694 conn(0x7f105403f6a0 legacy=0x7f105405fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:08.526 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.513+0000 7f108abc2640 10 monclient: shutdown 2026-02-13T20:29:08.526 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.513+0000 7f108abc2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:29:08.527 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.513+0000 7f108abc2640 1 -- 10.20.193.110:0/748166890 >> v1:10.20.193.110:6790/0 conn(0x7f108405c540 legacy=0x7f10841405d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:08.527 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.513+0000 7f1089138640 1 -- 10.20.193.110:0/748166890 reap_dead start 2026-02-13T20:29:08.527 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.513+0000 7f1089138640 1 -- 10.20.193.110:0/748166890 reap_dead start 2026-02-13T20:29:08.527 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.513+0000 7f108abc2640 1 -- 10.20.193.110:0/748166890 shutdown_connections 2026-02-13T20:29:08.527 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.513+0000 7f108abc2640 1 -- 10.20.193.110:0/748166890 >> 10.20.193.110:0/748166890 conn(0x7f1084093270 msgr2=0x7f1084057e30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:29:08.527 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.513+0000 7f108abc2640 1 -- 10.20.193.110:0/748166890 shutdown_connections 2026-02-13T20:29:08.527 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.514+0000 7f108abc2640 1 -- 10.20.193.110:0/748166890 wait complete. 2026-02-13T20:29:08.527 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:29:08.527 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-13T20:29:08.527 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T20:29:08.594 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.592+0000 7f70cca1b640 10 monclient: get_monmap_and_config 2026-02-13T20:29:08.594 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.592+0000 7f70cca1b640 10 monclient: build_initial_monmap 2026-02-13T20:29:08.594 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.592+0000 7f70cca1b640 10 monclient: monmap: 2026-02-13T20:29:08.594 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:29:08.594 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:08.594 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:29:08.593883+0000 2026-02-13T20:29:08.594 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:29:08.593883+0000 2026-02-13T20:29:08.594 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:29:08.594 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:08.594 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:29:08.594 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:29:08.594 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:29:08.594 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:08.594 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.592+0000 7f70cca1b640 1 Processor -- start 2026-02-13T20:29:08.594 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.592+0000 7f70cca1b640 1 -- start start 2026-02-13T20:29:08.594 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.592+0000 7f70cca1b640 10 monclient: init 2026-02-13T20:29:08.596 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70cca1b640 10 monclient: _reopen_session rank -1 2026-02-13T20:29:08.596 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70cca1b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:29:08.596 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70cca1b640 10 monclient(hunting): picked mon.noname-b con 0x7f70c81401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:29:08.596 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70cca1b640 10 monclient(hunting): picked mon.noname-c con 0x7f70c8092020 addr v1:10.20.193.188:6789/0 2026-02-13T20:29:08.596 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70cca1b640 10 monclient(hunting): picked mon.noname-a con 0x7f70c8091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:29:08.596 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70cca1b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70c808b730 con 0x7f70c8091950 2026-02-13T20:29:08.596 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70cca1b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70c805c5b0 con 0x7f70c8092020 2026-02-13T20:29:08.596 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70cca1b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70c808bcf0 con 0x7f70c81401c0 2026-02-13T20:29:08.596 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70cca1b640 10 monclient(hunting): _renew_subs 2026-02-13T20:29:08.596 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70cca1b640 10 monclient(hunting): authenticate will time out at 1710.284217s 2026-02-13T20:29:08.596 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70c6d76640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f70c8091950 0x7f70c81a2a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:58882/0 (socket says 10.20.193.110:58882) 2026-02-13T20:29:08.596 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70c6d76640 1 -- 10.20.193.110:0/1901249902 learned_addr learned my addr 10.20.193.110:0/1901249902 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:29:08.596 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70c5573640 1 -- 10.20.193.110:0/1901249902 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3415308229 0 0) 0x7f70c808bcf0 con 0x7f70c81401c0 2026-02-13T20:29:08.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70c5573640 10 monclient(hunting): _negotiate 2026-02-13T20:29:08.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70c5573640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:08.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70c5573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:08.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70c5573640 10 monclient(hunting): my global_id is 154232 2026-02-13T20:29:08.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70c5573640 1 -- 10.20.193.110:0/1901249902 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70b40035e0 con 0x7f70c81401c0 2026-02-13T20:29:08.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70c5573640 1 -- 10.20.193.110:0/1901249902 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2214459087 0 0) 0x7f70c808b730 con 0x7f70c8091950 2026-02-13T20:29:08.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70c5573640 10 monclient(hunting): _negotiate 2026-02-13T20:29:08.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70c5573640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:08.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70c5573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:08.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70c5573640 10 monclient(hunting): my global_id is 124521 2026-02-13T20:29:08.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70c5573640 1 -- 10.20.193.110:0/1901249902 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70c808bcf0 con 0x7f70c8091950 2026-02-13T20:29:08.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70c5573640 1 -- 10.20.193.110:0/1901249902 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1828868000 0 0) 0x7f70b40035e0 con 0x7f70c81401c0 2026-02-13T20:29:08.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70c5573640 1 -- 10.20.193.110:0/1901249902 >> v1:10.20.193.188:6789/0 conn(0x7f70c8092020 legacy=0x7f70c81812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T20:29:08.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70c5573640 1 -- 10.20.193.110:0/1901249902 >> v1:10.20.193.110:6789/0 conn(0x7f70c8091950 legacy=0x7f70c81a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:08.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70c5573640 10 monclient: _finish_hunting 0 2026-02-13T20:29:08.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70c5573640 1 monclient: found mon.noname-b 2026-02-13T20:29:08.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70c5573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:29:08.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70c5573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:29:08.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70c5573640 1 -- 10.20.193.110:0/1901249902 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70c8140590 con 0x7f70c81401c0 2026-02-13T20:29:08.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70c5573640 10 monclient: _finish_auth 0 2026-02-13T20:29:08.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70c5573640 10 monclient: _check_auth_tickets 2026-02-13T20:29:08.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70c5573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:29:08.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70c5573640 1 -- 10.20.193.110:0/1901249902 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f70bc002dd0 con 0x7f70c81401c0 2026-02-13T20:29:08.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70cca1b640 5 monclient: authenticate success, global_id 154232 2026-02-13T20:29:08.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70cca1b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:29:08.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70c5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:08.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70c5573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:29:08.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70c5573640 10 monclient: dump: 2026-02-13T20:29:08.597 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:08.597 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:08.597 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.597 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.597 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:08.597 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:08.597 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:08.597 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:08.597 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:08.597 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:08.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70cca1b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:29:08.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70c5573640 1 -- 10.20.193.110:0/1901249902 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f70bc002fa0 con 0x7f70c81401c0 2026-02-13T20:29:08.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70c5573640 10 monclient: handle_config config(0 keys) 2026-02-13T20:29:08.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70c5573640 1 -- 10.20.193.110:0/1901249902 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f70bc0033b0 con 0x7f70c81401c0 2026-02-13T20:29:08.598 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70cca1b640 10 monclient: get_monmap_and_config success 2026-02-13T20:29:08.598 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70cca1b640 4 set_mon_vals no callback set 2026-02-13T20:29:08.598 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70c5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:08.598 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70c5573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:29:08.598 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70c5573640 10 monclient: dump: 2026-02-13T20:29:08.598 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:08.598 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:08.598 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.598 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.598 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:08.598 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:08.598 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:08.598 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:08.598 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:08.598 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:08.598 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70cca1b640 10 monclient: shutdown 2026-02-13T20:29:08.598 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70cca1b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:29:08.598 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.593+0000 7f70cca1b640 1 -- 10.20.193.110:0/1901249902 >> v1:10.20.193.110:6790/0 conn(0x7f70c81401c0 legacy=0x7f70c8091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:08.598 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.594+0000 7f70cca1b640 1 -- 10.20.193.110:0/1901249902 shutdown_connections 2026-02-13T20:29:08.598 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.594+0000 7f70cca1b640 1 -- 10.20.193.110:0/1901249902 >> 10.20.193.110:0/1901249902 conn(0x7f70c8054e90 msgr2=0x7f70c8058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:29:08.598 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.594+0000 7f70cca1b640 1 -- 10.20.193.110:0/1901249902 shutdown_connections 2026-02-13T20:29:08.598 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.594+0000 7f70cca1b640 1 -- 10.20.193.110:0/1901249902 wait complete. 2026-02-13T20:29:08.598 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.594+0000 7f70cca1b640 10 monclient: build_initial_monmap 2026-02-13T20:29:08.598 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.594+0000 7f70cca1b640 10 monclient: monmap: 2026-02-13T20:29:08.598 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:29:08.598 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:29:08.598 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:29:08.598 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:29:08.598 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:29:08.598 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:29:08.598 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:29:08.598 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:29:08.598 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:29:08.598 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:08.598 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.594+0000 7f70cca1b640 1 Processor -- start 2026-02-13T20:29:08.598 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.594+0000 7f70cca1b640 1 -- start start 2026-02-13T20:29:08.598 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.594+0000 7f70cca1b640 10 monclient: init 2026-02-13T20:29:08.598 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.594+0000 7f70cca1b640 10 monclient: _reopen_session rank -1 2026-02-13T20:29:08.598 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.594+0000 7f70cca1b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:29:08.598 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.594+0000 7f70cca1b640 10 monclient(hunting): picked mon.noname-b con 0x7f70c8091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:29:08.598 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.594+0000 7f70cca1b640 10 monclient(hunting): picked mon.noname-c con 0x7f70c81401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:29:08.598 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.594+0000 7f70cca1b640 10 monclient(hunting): picked mon.noname-a con 0x7f70c81526e0 addr v1:10.20.193.110:6789/0 2026-02-13T20:29:08.598 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.594+0000 7f70cca1b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70c8153160 con 0x7f70c81526e0 2026-02-13T20:29:08.598 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.594+0000 7f70cca1b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70c805d320 con 0x7f70c8091950 2026-02-13T20:29:08.598 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.594+0000 7f70cca1b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70c8132380 con 0x7f70c81401c0 2026-02-13T20:29:08.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.594+0000 7f70cca1b640 10 monclient(hunting): _renew_subs 2026-02-13T20:29:08.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.594+0000 7f70cca1b640 10 monclient(hunting): authenticate will time out at 1710.285857s 2026-02-13T20:29:08.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.594+0000 7f70c5d74640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f70c81401c0 0x7f70c8193a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:55168/0 (socket says 10.20.193.110:55168) 2026-02-13T20:29:08.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.594+0000 7f70c6d76640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f70c81526e0 0x7f70c8195160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:58886/0 (socket says 10.20.193.110:58886) 2026-02-13T20:29:08.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.594+0000 7f70c5d74640 1 -- 10.20.193.110:0/516155034 learned_addr learned my addr 10.20.193.110:0/516155034 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:29:08.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70aeffd640 1 -- 10.20.193.110:0/516155034 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1569363974 0 0) 0x7f70c8132380 con 0x7f70c81401c0 2026-02-13T20:29:08.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70aeffd640 10 monclient(hunting): _negotiate 2026-02-13T20:29:08.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70aeffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:08.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70aeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:08.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70aeffd640 10 monclient(hunting): my global_id is 154235 2026-02-13T20:29:08.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70aeffd640 1 -- 10.20.193.110:0/516155034 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70940035e0 con 0x7f70c81401c0 2026-02-13T20:29:08.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70aeffd640 1 -- 10.20.193.110:0/516155034 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2822635407 0 0) 0x7f70c8153160 con 0x7f70c81526e0 2026-02-13T20:29:08.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70aeffd640 10 monclient(hunting): _negotiate 2026-02-13T20:29:08.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70aeffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:08.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70aeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:08.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70aeffd640 10 monclient(hunting): my global_id is 124524 2026-02-13T20:29:08.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70aeffd640 1 -- 10.20.193.110:0/516155034 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70c8132380 con 0x7f70c81526e0 2026-02-13T20:29:08.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70aeffd640 1 -- 10.20.193.110:0/516155034 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3649336186 0 0) 0x7f70c805d320 con 0x7f70c8091950 2026-02-13T20:29:08.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70aeffd640 10 monclient(hunting): _negotiate 2026-02-13T20:29:08.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70aeffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:08.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70aeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:08.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70aeffd640 10 monclient(hunting): my global_id is 164101 2026-02-13T20:29:08.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70aeffd640 1 -- 10.20.193.110:0/516155034 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70c8153160 con 0x7f70c8091950 2026-02-13T20:29:08.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70aeffd640 1 -- 10.20.193.110:0/516155034 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 312679215 0 0) 0x7f70940035e0 con 0x7f70c81401c0 2026-02-13T20:29:08.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70aeffd640 1 -- 10.20.193.110:0/516155034 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f70c805d320 con 0x7f70c81401c0 2026-02-13T20:29:08.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70aeffd640 1 -- 10.20.193.110:0/516155034 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f70b00040b0 con 0x7f70c81401c0 2026-02-13T20:29:08.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70aeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:29:08.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70aeffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:29:08.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70aeffd640 10 monclient(hunting): dump: 2026-02-13T20:29:08.599 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:08.599 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:08.599 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.599 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.599 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:08.599 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:08.599 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:08.599 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:08.599 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:08.599 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:08.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70aeffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:29:08.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70aeffd640 1 -- 10.20.193.110:0/516155034 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1619225097 0 0) 0x7f70c805d320 con 0x7f70c81401c0 2026-02-13T20:29:08.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70aeffd640 1 -- 10.20.193.110:0/516155034 >> v1:10.20.193.188:6789/0 conn(0x7f70c8091950 legacy=0x7f70c813e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:08.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70aeffd640 1 -- 10.20.193.110:0/516155034 >> v1:10.20.193.110:6789/0 conn(0x7f70c81526e0 legacy=0x7f70c8195160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:08.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70aeffd640 10 monclient: _finish_hunting 0 2026-02-13T20:29:08.599 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70aeffd640 1 monclient: found mon.c 2026-02-13T20:29:08.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70aeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:29:08.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70aeffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:08.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70aeffd640 1 -- 10.20.193.110:0/516155034 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70c8090ff0 con 0x7f70c81401c0 2026-02-13T20:29:08.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70aeffd640 10 monclient: _finish_auth 0 2026-02-13T20:29:08.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70aeffd640 10 monclient: _check_auth_tickets 2026-02-13T20:29:08.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70aeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:29:08.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70cca1b640 5 monclient: authenticate success, global_id 154235 2026-02-13T20:29:08.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70cca1b640 10 monclient: _renew_subs 2026-02-13T20:29:08.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70cca1b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:08.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70cca1b640 1 -- 10.20.193.110:0/516155034 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f70c808c430 con 0x7f70c81401c0 2026-02-13T20:29:08.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70cca1b640 10 monclient: _renew_subs 2026-02-13T20:29:08.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70cca1b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:08.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70cca1b640 1 -- 10.20.193.110:0/516155034 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f70c81320a0 con 0x7f70c81401c0 2026-02-13T20:29:08.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70aeffd640 1 -- 10.20.193.110:0/516155034 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f70b00026a0 con 0x7f70c81401c0 2026-02-13T20:29:08.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70aeffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:29:08.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70aeffd640 1 -- 10.20.193.110:0/516155034 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f70b0004280 con 0x7f70c81401c0 2026-02-13T20:29:08.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70aeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:08.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70aeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:29:08.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70aeffd640 10 monclient: dump: 2026-02-13T20:29:08.600 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:08.600 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:08.600 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.600 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.600 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:08.600 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:08.600 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:08.600 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:08.600 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:08.600 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:08.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70c4d72640 4 set_mon_vals no callback set 2026-02-13T20:29:08.600 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70cca1b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:08.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70cca1b640 1 -- 10.20.193.110:0/516155034 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f70c8131ae0 con 0x7f70c8092020 2026-02-13T20:29:08.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.595+0000 7f70aeffd640 1 -- 10.20.193.110:0/516155034 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f70b0002a70 con 0x7f70c81401c0 2026-02-13T20:29:08.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.596+0000 7f70aeffd640 1 -- 10.20.193.110:0/516155034 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(847..847 src has 1..847) ==== 3591+0+0 (unknown 4078645555 0 0) 0x7f70b004e620 con 0x7f70c81401c0 2026-02-13T20:29:08.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.596+0000 7f70aeffd640 1 -- 10.20.193.110:0/516155034 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2176655621 0 0) 0x7f70c8153160 con 0x7f70c8092020 2026-02-13T20:29:08.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.596+0000 7f70aeffd640 10 monclient(hunting): _negotiate 2026-02-13T20:29:08.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.596+0000 7f70aeffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:08.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.596+0000 7f70aeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:08.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.596+0000 7f70aeffd640 10 monclient(hunting): my global_id is 154238 2026-02-13T20:29:08.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.596+0000 7f70aeffd640 1 -- 10.20.193.110:0/516155034 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70c805d320 con 0x7f70c8092020 2026-02-13T20:29:08.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.596+0000 7f70c6d76640 10 monclient: get_auth_request con 0x7f709403f890 auth_method 0 2026-02-13T20:29:08.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.596+0000 7f70aeffd640 1 -- 10.20.193.110:0/516155034 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 809179544 0 0) 0x7f70c805d320 con 0x7f70c8092020 2026-02-13T20:29:08.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.596+0000 7f70aeffd640 1 -- 10.20.193.110:0/516155034 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f70c8153160 con 0x7f70c8092020 2026-02-13T20:29:08.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.596+0000 7f70aeffd640 1 -- 10.20.193.110:0/516155034 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f70bc0029f0 con 0x7f70c8092020 2026-02-13T20:29:08.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.596+0000 7f70aeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:08.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.596+0000 7f70aeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:29:08.601 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.596+0000 7f70aeffd640 10 monclient: dump: 2026-02-13T20:29:08.602 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:08.602 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:08.602 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.602 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.602 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:08.602 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:08.602 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:08.602 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:08.602 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:08.602 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:08.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.596+0000 7f70aeffd640 1 -- 10.20.193.110:0/516155034 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 801480784 0 0) 0x7f70c8153160 con 0x7f70c8092020 2026-02-13T20:29:08.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.596+0000 7f70aeffd640 1 -- 10.20.193.110:0/516155034 --> v1:10.20.193.110:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f70c808a890 con 0x7f70c8092020 2026-02-13T20:29:08.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.596+0000 7f70aeffd640 1 -- 10.20.193.110:0/516155034 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f70bc0036b0 con 0x7f70c8092020 2026-02-13T20:29:08.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.596+0000 7f70aeffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:08.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.596+0000 7f70aeffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:29:08.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.596+0000 7f70aeffd640 1 -- 10.20.193.110:0/516155034 >> v1:10.20.193.110:6790/0 conn(0x7f70c8092020 legacy=0x7f70c8127b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:08.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.596+0000 7f70aeffd640 1 -- 10.20.193.110:0/516155034 >> v1:10.20.193.110:6790/0 conn(0x7f70c8092020 legacy=0x7f70c8127b20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:29:08.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.599+0000 7f70cca1b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:29:08.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.599+0000 7f70cca1b640 1 -- 10.20.193.110:0/516155034 --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f70c8055bb0 con 0x7f70c8128230 2026-02-13T20:29:08.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.600+0000 7f70aeffd640 1 -- 10.20.193.110:0/516155034 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2096555444 0 0) 0x7f70c8055bb0 con 0x7f70c8128230 2026-02-13T20:29:08.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.600+0000 7f70aeffd640 10 monclient(hunting): _negotiate 2026-02-13T20:29:08.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.600+0000 7f70aeffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:08.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.600+0000 7f70aeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:08.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.600+0000 7f70aeffd640 10 monclient(hunting): my global_id is 154241 2026-02-13T20:29:08.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.600+0000 7f70aeffd640 1 -- 10.20.193.110:0/516155034 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70c8153160 con 0x7f70c8128230 2026-02-13T20:29:08.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.600+0000 7f70aeffd640 1 -- 10.20.193.110:0/516155034 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3581303973 0 0) 0x7f70c8153160 con 0x7f70c8128230 2026-02-13T20:29:08.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.600+0000 7f70aeffd640 1 -- 10.20.193.110:0/516155034 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f70c8055bb0 con 0x7f70c8128230 2026-02-13T20:29:08.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.600+0000 7f70aeffd640 1 -- 10.20.193.110:0/516155034 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f70bc003bc0 con 0x7f70c8128230 2026-02-13T20:29:08.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.600+0000 7f70aeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:08.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.600+0000 7f70aeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:29:08.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.600+0000 7f70aeffd640 10 monclient: dump: 2026-02-13T20:29:08.602 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:08.602 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:08.602 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.602 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.602 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:08.602 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:08.602 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:08.602 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:08.602 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:08.602 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:08.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.600+0000 7f70aeffd640 1 -- 10.20.193.110:0/516155034 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3020265594 0 0) 0x7f70c8055bb0 con 0x7f70c8128230 2026-02-13T20:29:08.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.600+0000 7f70aeffd640 1 -- 10.20.193.110:0/516155034 --> v1:10.20.193.110:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f70c808b450 con 0x7f70c8128230 2026-02-13T20:29:08.602 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.600+0000 7f70aeffd640 1 -- 10.20.193.110:0/516155034 <== mon.2 v1:10.20.193.110:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4683 (unknown 0 0 1912823703) 0x7f70bc003f80 con 0x7f70c8128230 2026-02-13T20:29:08.603 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.600+0000 7f70aeffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:29:08.603 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.600+0000 7f70aeffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:29:08.603 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.600+0000 7f70aeffd640 1 -- 10.20.193.110:0/516155034 >> v1:10.20.193.110:6790/0 conn(0x7f70c8128230 legacy=0x7f70c8197890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:08.603 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.600+0000 7f70aeffd640 1 -- 10.20.193.110:0/516155034 >> v1:10.20.193.110:6790/0 conn(0x7f70c8128230 legacy=0x7f70c8197890 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:29:08.603 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:29:08.603 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:29:08.603 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:29:08.603 INFO:teuthology.orchestra.run.trial110.stdout: "state": "leader", 2026-02-13T20:29:08.603 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 64, 2026-02-13T20:29:08.603 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 107879, 2026-02-13T20:29:08.603 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:29:08.603 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:29:08.603 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:29:08.603 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:29:08.603 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:29:08.603 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 0, 2026-02-13T20:29:08.603 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:29:08.603 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:29:08.603 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:29:08.603 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:29:08.603 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:29:08.603 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:29:08.603 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:29:08.603 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:29:08.603 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:29:08.603 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:29:08.603 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:29:08.603 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:29:08.603 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:29:08.603 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:29:08.603 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:29:08.603 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:29:08.603 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:29:08.603 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:29:08.603 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:29:08.603 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:29:08.603 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:29:08.603 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:29:08.603 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:29:08.604 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:29:08.604 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:29:08.604 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:29:08.604 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:29:08.604 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:29:08.604 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:29:08.604 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:29:08.604 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:29:08.604 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:29:08.604 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:29:08.604 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:29:08.604 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:29:08.604 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:29:08.604 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:29:08.604 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:29:08.604 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:29:08.604 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:29:08.604 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:29:08.604 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:29:08.604 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:29:08.604 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:29:08.604 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:29:08.604 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:29:08.604 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:29:08.604 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:29:08.604 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:29:08.604 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:29:08.604 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:29:08.604 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:29:08.604 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:29:08.604 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:29:08.604 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:29:08.604 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:29:08.604 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:29:08.604 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:29:08.604 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:29:08.604 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:29:08.604 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:29:08.604 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:29:08.604 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:29:08.604 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:29:08.604 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:29:08.604 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:29:08.605 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:29:08.605 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:29:08.605 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:29:08.605 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:29:08.605 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:29:08.605 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:29:08.605 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:29:08.605 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:29:08.605 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:29:08.605 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:29:08.605 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:29:08.605 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:29:08.605 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:29:08.605 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:29:08.605 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:29:08.605 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:29:08.605 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:29:08.605 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:29:08.605 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:29:08.605 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:29:08.605 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:29:08.605 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:29:08.605 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:29:08.605 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:29:08.605 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:29:08.605 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:29:08.605 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:29:08.605 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:29:08.605 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:29:08.605 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:29:08.605 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:29:08.605 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:29:08.605 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:29:08.605 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:29:08.605 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:29:08.605 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:29:08.605 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:29:08.605 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:29:08.605 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:29:08.605 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:29:08.605 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:29:08.605 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:29:08.605 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:29:08.605 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:29:08.606 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:29:08.606 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:29:08.606 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:29:08.606 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:29:08.606 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:29:08.606 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:29:08.606 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:29:08.606 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:29:08.606 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:29:08.606 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:29:08.606 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:29:08.606 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:29:08.606 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:29:08.606 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:29:08.606 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:29:08.606 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:29:08.606 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:29:08.606 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:29:08.606 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:29:08.606 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:29:08.606 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:29:08.606 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:29:08.606 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:29:08.606 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:29:08.606 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:29:08.606 INFO:teuthology.orchestra.run.trial110.stdout: "osd": [ 2026-02-13T20:29:08.606 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:29:08.606 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:29:08.606 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:29:08.606 INFO:teuthology.orchestra.run.trial110.stdout: "num": 2 2026-02-13T20:29:08.606 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:29:08.606 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:29:08.606 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:29:08.606 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:29:08.606 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:29:08.606 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:29:08.606 INFO:teuthology.orchestra.run.trial110.stdout: "num": 3 2026-02-13T20:29:08.606 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:29:08.606 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:29:08.606 INFO:teuthology.orchestra.run.trial110.stdout: "mgr": [ 2026-02-13T20:29:08.606 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:29:08.606 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:29:08.606 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:29:08.606 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:29:08.607 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:29:08.607 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:29:08.607 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:29:08.607 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:29:08.607 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:29:08.607 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.600+0000 7f70cca1b640 1 -- 10.20.193.110:0/516155034 >> v1:10.20.193.188:6812/1623052694 conn(0x7f709403f890 legacy=0x7f709405fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:08.607 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.600+0000 7f70cca1b640 10 monclient: shutdown 2026-02-13T20:29:08.607 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.600+0000 7f70cca1b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:29:08.607 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.600+0000 7f70cca1b640 1 -- 10.20.193.110:0/516155034 >> v1:10.20.193.110:6790/0 conn(0x7f70c81401c0 legacy=0x7f70c8193a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:08.607 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.600+0000 7f70c6d76640 1 -- 10.20.193.110:0/516155034 reap_dead start 2026-02-13T20:29:08.607 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.600+0000 7f70c6d76640 1 -- 10.20.193.110:0/516155034 reap_dead start 2026-02-13T20:29:08.607 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.600+0000 7f70cca1b640 1 -- 10.20.193.110:0/516155034 shutdown_connections 2026-02-13T20:29:08.607 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.600+0000 7f70cca1b640 1 -- 10.20.193.110:0/516155034 >> 10.20.193.110:0/516155034 conn(0x7f70c8054e90 msgr2=0x7f70c808ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:29:08.607 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.600+0000 7f70cca1b640 1 -- 10.20.193.110:0/516155034 shutdown_connections 2026-02-13T20:29:08.607 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.600+0000 7f70cca1b640 1 -- 10.20.193.110:0/516155034 wait complete. 2026-02-13T20:29:08.607 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:29:08.607 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-13T20:29:08.608 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T20:29:08.673 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.671+0000 7f464174c640 10 monclient: get_monmap_and_config 2026-02-13T20:29:08.673 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.671+0000 7f464174c640 10 monclient: build_initial_monmap 2026-02-13T20:29:08.673 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.671+0000 7f464174c640 10 monclient: monmap: 2026-02-13T20:29:08.673 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:29:08.673 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:08.673 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:29:08.673314+0000 2026-02-13T20:29:08.673 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:29:08.673314+0000 2026-02-13T20:29:08.673 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:29:08.673 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:08.673 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:29:08.673 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:29:08.673 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:29:08.673 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:08.673 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.672+0000 7f464174c640 1 Processor -- start 2026-02-13T20:29:08.673 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.672+0000 7f464174c640 1 -- start start 2026-02-13T20:29:08.673 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.672+0000 7f464174c640 10 monclient: init 2026-02-13T20:29:08.673 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.672+0000 7f464174c640 10 monclient: _reopen_session rank -1 2026-02-13T20:29:08.673 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.672+0000 7f464174c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:29:08.673 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.672+0000 7f464174c640 10 monclient(hunting): picked mon.noname-a con 0x7f463c13f280 addr v1:10.20.193.110:6789/0 2026-02-13T20:29:08.673 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.672+0000 7f464174c640 10 monclient(hunting): picked mon.noname-b con 0x7f463c13ee70 addr v1:10.20.193.110:6790/0 2026-02-13T20:29:08.673 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.672+0000 7f464174c640 10 monclient(hunting): picked mon.noname-c con 0x7f463c089a90 addr v1:10.20.193.188:6789/0 2026-02-13T20:29:08.673 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.672+0000 7f464174c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f463c08a310 con 0x7f463c13f280 2026-02-13T20:29:08.673 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.672+0000 7f464174c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f463c08a5f0 con 0x7f463c089a90 2026-02-13T20:29:08.673 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.672+0000 7f464174c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f463c08a8d0 con 0x7f463c13ee70 2026-02-13T20:29:08.674 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.672+0000 7f464174c640 10 monclient(hunting): _renew_subs 2026-02-13T20:29:08.674 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.672+0000 7f464174c640 10 monclient(hunting): authenticate will time out at 1710.363684s 2026-02-13T20:29:08.674 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.672+0000 7f463affd640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f463c13f280 0x7f463c13f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:58898/0 (socket says 10.20.193.110:58898) 2026-02-13T20:29:08.674 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.672+0000 7f463affd640 1 -- 10.20.193.110:0/1661475196 learned_addr learned my addr 10.20.193.110:0/1661475196 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:29:08.674 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.672+0000 7f4639ffb640 1 -- 10.20.193.110:0/1661475196 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2739354958 0 0) 0x7f463c08a8d0 con 0x7f463c13ee70 2026-02-13T20:29:08.674 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.672+0000 7f4639ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:29:08.674 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.672+0000 7f4639ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:08.674 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.672+0000 7f4639ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:08.674 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.672+0000 7f4639ffb640 10 monclient(hunting): my global_id is 154244 2026-02-13T20:29:08.674 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.673+0000 7f4639ffb640 1 -- 10.20.193.110:0/1661475196 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46280035e0 con 0x7f463c13ee70 2026-02-13T20:29:08.674 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.673+0000 7f4639ffb640 1 -- 10.20.193.110:0/1661475196 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 808330811 0 0) 0x7f463c08a310 con 0x7f463c13f280 2026-02-13T20:29:08.674 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.673+0000 7f4639ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:29:08.674 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.673+0000 7f4639ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:08.674 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.673+0000 7f4639ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:08.674 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.673+0000 7f4639ffb640 10 monclient(hunting): my global_id is 124527 2026-02-13T20:29:08.675 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.673+0000 7f4639ffb640 1 -- 10.20.193.110:0/1661475196 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f463c08a8d0 con 0x7f463c13f280 2026-02-13T20:29:08.675 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.673+0000 7f4639ffb640 1 -- 10.20.193.110:0/1661475196 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 992673710 0 0) 0x7f46280035e0 con 0x7f463c13ee70 2026-02-13T20:29:08.675 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.673+0000 7f4639ffb640 1 -- 10.20.193.110:0/1661475196 >> v1:10.20.193.188:6789/0 conn(0x7f463c089a90 legacy=0x7f463c1a18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:08.675 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.673+0000 7f4639ffb640 1 -- 10.20.193.110:0/1661475196 >> v1:10.20.193.110:6789/0 conn(0x7f463c13f280 legacy=0x7f463c13f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:08.675 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.673+0000 7f4639ffb640 10 monclient: _finish_hunting 0 2026-02-13T20:29:08.675 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.673+0000 7f4639ffb640 1 monclient: found mon.noname-b 2026-02-13T20:29:08.675 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.673+0000 7f4639ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:29:08.675 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.673+0000 7f4639ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:29:08.675 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.673+0000 7f4639ffb640 1 -- 10.20.193.110:0/1661475196 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f463c08abb0 con 0x7f463c13ee70 2026-02-13T20:29:08.675 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.673+0000 7f4639ffb640 10 monclient: _finish_auth 0 2026-02-13T20:29:08.675 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.673+0000 7f4639ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:29:08.675 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.673+0000 7f4639ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:29:08.675 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.673+0000 7f464174c640 5 monclient: authenticate success, global_id 154244 2026-02-13T20:29:08.675 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.673+0000 7f4639ffb640 1 -- 10.20.193.110:0/1661475196 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f4624002dd0 con 0x7f463c13ee70 2026-02-13T20:29:08.675 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.673+0000 7f4639ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:08.675 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.673+0000 7f4639ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:29:08.675 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.673+0000 7f4639ffb640 10 monclient: dump: 2026-02-13T20:29:08.675 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:08.675 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:08.675 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.675 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.675 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:08.675 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:08.675 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:08.675 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:08.675 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:08.675 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:08.675 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.673+0000 7f464174c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:29:08.675 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.673+0000 7f4639ffb640 1 -- 10.20.193.110:0/1661475196 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4624003050 con 0x7f463c13ee70 2026-02-13T20:29:08.675 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.673+0000 7f4639ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T20:29:08.675 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.673+0000 7f4639ffb640 1 -- 10.20.193.110:0/1661475196 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f4624003460 con 0x7f463c13ee70 2026-02-13T20:29:08.675 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.673+0000 7f464174c640 10 monclient: get_monmap_and_config success 2026-02-13T20:29:08.675 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.673+0000 7f464174c640 4 set_mon_vals no callback set 2026-02-13T20:29:08.675 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.673+0000 7f4639ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:08.675 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.673+0000 7f4639ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:29:08.675 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.673+0000 7f4639ffb640 10 monclient: dump: 2026-02-13T20:29:08.675 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:08.675 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:08.675 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.675 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.675 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:08.675 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:08.675 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:08.676 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:08.676 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:08.676 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:08.676 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.673+0000 7f464174c640 10 monclient: shutdown 2026-02-13T20:29:08.676 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.673+0000 7f464174c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:29:08.676 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.673+0000 7f464174c640 1 -- 10.20.193.110:0/1661475196 >> v1:10.20.193.110:6790/0 conn(0x7f463c13ee70 legacy=0x7f463c180190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:08.676 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.673+0000 7f464174c640 1 -- 10.20.193.110:0/1661475196 shutdown_connections 2026-02-13T20:29:08.676 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.673+0000 7f464174c640 1 -- 10.20.193.110:0/1661475196 >> 10.20.193.110:0/1661475196 conn(0x7f463c054e90 msgr2=0x7f463c058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:29:08.676 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.673+0000 7f464174c640 1 -- 10.20.193.110:0/1661475196 shutdown_connections 2026-02-13T20:29:08.676 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.673+0000 7f464174c640 1 -- 10.20.193.110:0/1661475196 wait complete. 2026-02-13T20:29:08.677 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.673+0000 7f464174c640 10 monclient: build_initial_monmap 2026-02-13T20:29:08.678 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.673+0000 7f464174c640 10 monclient: monmap: 2026-02-13T20:29:08.678 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:29:08.678 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:29:08.678 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:29:08.678 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:29:08.678 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:29:08.678 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:29:08.678 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:29:08.678 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:29:08.678 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:29:08.678 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:08.678 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f464174c640 1 Processor -- start 2026-02-13T20:29:08.678 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f464174c640 1 -- start start 2026-02-13T20:29:08.678 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f464174c640 10 monclient: init 2026-02-13T20:29:08.678 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f464174c640 10 monclient: _reopen_session rank -1 2026-02-13T20:29:08.678 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f464174c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:29:08.678 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f464174c640 10 monclient(hunting): picked mon.noname-a con 0x7f463c089a90 addr v1:10.20.193.110:6789/0 2026-02-13T20:29:08.678 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f464174c640 10 monclient(hunting): picked mon.noname-b con 0x7f463c13ee70 addr v1:10.20.193.188:6789/0 2026-02-13T20:29:08.678 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f464174c640 10 monclient(hunting): picked mon.noname-c con 0x7f463c13f280 addr v1:10.20.193.110:6790/0 2026-02-13T20:29:08.678 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f464174c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f463c112190 con 0x7f463c089a90 2026-02-13T20:29:08.678 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f464174c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f463c110110 con 0x7f463c13ee70 2026-02-13T20:29:08.678 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f464174c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f463c08bee0 con 0x7f463c13f280 2026-02-13T20:29:08.678 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f464174c640 10 monclient(hunting): _renew_subs 2026-02-13T20:29:08.678 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f464174c640 10 monclient(hunting): authenticate will time out at 1710.365314s 2026-02-13T20:29:08.678 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f463affd640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f463c089a90 0x7f463c132300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:58906/0 (socket says 10.20.193.110:58906) 2026-02-13T20:29:08.678 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f463affd640 1 -- 10.20.193.110:0/1032891194 learned_addr learned my addr 10.20.193.110:0/1032891194 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:29:08.678 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f463b7fe640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f463c13f280 0x7f463c1a1600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:55196/0 (socket says 10.20.193.110:55196) 2026-02-13T20:29:08.678 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f461b7fe640 1 -- 10.20.193.110:0/1032891194 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3578072292 0 0) 0x7f463c08bee0 con 0x7f463c13f280 2026-02-13T20:29:08.678 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f461b7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:29:08.678 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f461b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:08.678 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f461b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:08.678 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f461b7fe640 10 monclient(hunting): my global_id is 154247 2026-02-13T20:29:08.678 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f461b7fe640 1 -- 10.20.193.110:0/1032891194 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46080035e0 con 0x7f463c13f280 2026-02-13T20:29:08.678 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f461b7fe640 1 -- 10.20.193.110:0/1032891194 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3055487861 0 0) 0x7f463c112190 con 0x7f463c089a90 2026-02-13T20:29:08.678 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f461b7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:29:08.678 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f461b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:08.678 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f461b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:08.678 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f461b7fe640 10 monclient(hunting): my global_id is 124530 2026-02-13T20:29:08.678 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f461b7fe640 1 -- 10.20.193.110:0/1032891194 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f463c08bee0 con 0x7f463c089a90 2026-02-13T20:29:08.678 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f461b7fe640 1 -- 10.20.193.110:0/1032891194 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1300189242 0 0) 0x7f463c110110 con 0x7f463c13ee70 2026-02-13T20:29:08.678 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f461b7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:29:08.679 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f461b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:08.679 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f461b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:08.679 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f461b7fe640 10 monclient(hunting): my global_id is 164107 2026-02-13T20:29:08.679 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f461b7fe640 1 -- 10.20.193.110:0/1032891194 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f463c112190 con 0x7f463c13ee70 2026-02-13T20:29:08.679 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f461b7fe640 1 -- 10.20.193.110:0/1032891194 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 705968922 0 0) 0x7f46080035e0 con 0x7f463c13f280 2026-02-13T20:29:08.679 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f461b7fe640 1 -- 10.20.193.110:0/1032891194 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f463c110110 con 0x7f463c13f280 2026-02-13T20:29:08.679 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f461b7fe640 1 -- 10.20.193.110:0/1032891194 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f462c0040e0 con 0x7f463c13f280 2026-02-13T20:29:08.679 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f461b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:29:08.679 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f461b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:29:08.679 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f461b7fe640 10 monclient(hunting): dump: 2026-02-13T20:29:08.679 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:08.679 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:08.679 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.679 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.679 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:08.679 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:08.679 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:08.679 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:08.679 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:08.679 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:08.679 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f461b7fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:29:08.679 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f461b7fe640 1 -- 10.20.193.110:0/1032891194 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 678916049 0 0) 0x7f463c08bee0 con 0x7f463c089a90 2026-02-13T20:29:08.679 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f461b7fe640 1 -- 10.20.193.110:0/1032891194 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f46080035e0 con 0x7f463c089a90 2026-02-13T20:29:08.679 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f461b7fe640 1 -- 10.20.193.110:0/1032891194 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f4630003090 con 0x7f463c089a90 2026-02-13T20:29:08.679 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f461b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:29:08.679 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f461b7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:29:08.679 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f461b7fe640 10 monclient(hunting): dump: 2026-02-13T20:29:08.679 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:08.679 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:08.679 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.679 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.679 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:08.679 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:08.679 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:08.679 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:08.679 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:08.679 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:08.679 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f461b7fe640 1 -- 10.20.193.110:0/1032891194 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 944642736 0 0) 0x7f463c110110 con 0x7f463c13f280 2026-02-13T20:29:08.679 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f461b7fe640 1 -- 10.20.193.110:0/1032891194 >> v1:10.20.193.188:6789/0 conn(0x7f463c13ee70 legacy=0x7f463c19fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:08.679 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f461b7fe640 1 -- 10.20.193.110:0/1032891194 >> v1:10.20.193.110:6789/0 conn(0x7f463c089a90 legacy=0x7f463c132300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:08.679 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f461b7fe640 10 monclient: _finish_hunting 0 2026-02-13T20:29:08.679 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f461b7fe640 1 monclient: found mon.c 2026-02-13T20:29:08.679 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f461b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:29:08.679 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f461b7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:08.680 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f461b7fe640 1 -- 10.20.193.110:0/1032891194 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f463c05d320 con 0x7f463c13f280 2026-02-13T20:29:08.680 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f461b7fe640 10 monclient: _finish_auth 0 2026-02-13T20:29:08.680 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f461b7fe640 10 monclient: _check_auth_tickets 2026-02-13T20:29:08.680 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f461b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:29:08.680 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f464174c640 5 monclient: authenticate success, global_id 154247 2026-02-13T20:29:08.680 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f464174c640 10 monclient: _renew_subs 2026-02-13T20:29:08.680 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f464174c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:08.680 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f464174c640 1 -- 10.20.193.110:0/1032891194 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f463c121a30 con 0x7f463c13f280 2026-02-13T20:29:08.680 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f464174c640 10 monclient: _renew_subs 2026-02-13T20:29:08.680 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f464174c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:08.680 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f464174c640 1 -- 10.20.193.110:0/1032891194 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f463c110c70 con 0x7f463c13f280 2026-02-13T20:29:08.680 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f461b7fe640 1 -- 10.20.193.110:0/1032891194 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f462c004240 con 0x7f463c13f280 2026-02-13T20:29:08.680 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f461b7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:29:08.680 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f461b7fe640 1 -- 10.20.193.110:0/1032891194 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f462c0049e0 con 0x7f463c13f280 2026-02-13T20:29:08.680 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f461b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:08.680 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f461b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:29:08.680 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f46397fa640 4 set_mon_vals no callback set 2026-02-13T20:29:08.680 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.674+0000 7f461b7fe640 10 monclient: dump: 2026-02-13T20:29:08.680 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:08.680 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:08.680 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.680 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.680 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:08.680 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:08.680 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:08.680 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:08.680 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:08.680 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:08.680 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.675+0000 7f464174c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:08.680 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.675+0000 7f464174c640 1 -- 10.20.193.110:0/1032891194 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f463c0008d0 con 0x7f463c05ac90 2026-02-13T20:29:08.680 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.675+0000 7f461b7fe640 1 -- 10.20.193.110:0/1032891194 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f462c004b40 con 0x7f463c13f280 2026-02-13T20:29:08.680 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.675+0000 7f461b7fe640 1 -- 10.20.193.110:0/1032891194 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(847..847 src has 1..847) ==== 3591+0+0 (unknown 4078645555 0 0) 0x7f462c04f710 con 0x7f463c13f280 2026-02-13T20:29:08.680 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.675+0000 7f463a7fc640 10 monclient: get_auth_request con 0x7f460803fc40 auth_method 0 2026-02-13T20:29:08.680 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.675+0000 7f461b7fe640 1 -- 10.20.193.110:0/1032891194 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2888143215 0 0) 0x7f463c0008d0 con 0x7f463c05ac90 2026-02-13T20:29:08.680 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.675+0000 7f461b7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:29:08.680 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.675+0000 7f461b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:08.680 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.675+0000 7f461b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:08.680 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.675+0000 7f461b7fe640 10 monclient(hunting): my global_id is 164110 2026-02-13T20:29:08.680 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.675+0000 7f461b7fe640 1 -- 10.20.193.110:0/1032891194 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f463c110110 con 0x7f463c05ac90 2026-02-13T20:29:08.680 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.676+0000 7f461b7fe640 1 -- 10.20.193.110:0/1032891194 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2340488345 0 0) 0x7f463c110110 con 0x7f463c05ac90 2026-02-13T20:29:08.680 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.676+0000 7f461b7fe640 1 -- 10.20.193.110:0/1032891194 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f463c0008d0 con 0x7f463c05ac90 2026-02-13T20:29:08.680 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.676+0000 7f461b7fe640 1 -- 10.20.193.110:0/1032891194 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f4630004a50 con 0x7f463c05ac90 2026-02-13T20:29:08.680 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.676+0000 7f461b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:08.680 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.676+0000 7f461b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:29:08.680 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.676+0000 7f461b7fe640 10 monclient: dump: 2026-02-13T20:29:08.681 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:08.681 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:08.681 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.681 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.681 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:08.681 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:08.681 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:08.681 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:08.681 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:08.681 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:08.681 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.676+0000 7f461b7fe640 1 -- 10.20.193.110:0/1032891194 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3006002621 0 0) 0x7f463c0008d0 con 0x7f463c05ac90 2026-02-13T20:29:08.681 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.676+0000 7f461b7fe640 1 -- 10.20.193.110:0/1032891194 --> v1:10.20.193.188:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f463c058410 con 0x7f463c05ac90 2026-02-13T20:29:08.681 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.676+0000 7f461b7fe640 1 -- 10.20.193.110:0/1032891194 <== mon.1 v1:10.20.193.188:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f4630005990 con 0x7f463c05ac90 2026-02-13T20:29:08.681 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.676+0000 7f461b7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:08.681 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.676+0000 7f461b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:29:08.681 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.676+0000 7f461b7fe640 1 -- 10.20.193.110:0/1032891194 >> v1:10.20.193.188:6789/0 conn(0x7f463c05ac90 legacy=0x7f463c08e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:08.681 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.676+0000 7f461b7fe640 1 -- 10.20.193.110:0/1032891194 >> v1:10.20.193.188:6789/0 conn(0x7f463c05ac90 legacy=0x7f463c08e670 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:29:08.681 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.679+0000 7f464174c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T20:29:08.681 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.679+0000 7f464174c640 1 -- 10.20.193.110:0/1032891194 --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f463c04d8d0 con 0x7f463c10f6c0 2026-02-13T20:29:08.681 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.680+0000 7f461b7fe640 1 -- 10.20.193.110:0/1032891194 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3378804271 0 0) 0x7f463c04d8d0 con 0x7f463c10f6c0 2026-02-13T20:29:08.681 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.680+0000 7f461b7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:29:08.681 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.680+0000 7f461b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:08.681 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.680+0000 7f461b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:08.681 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.680+0000 7f461b7fe640 10 monclient(hunting): my global_id is 164113 2026-02-13T20:29:08.682 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.680+0000 7f461b7fe640 1 -- 10.20.193.110:0/1032891194 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f463c0008d0 con 0x7f463c10f6c0 2026-02-13T20:29:08.682 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.680+0000 7f461b7fe640 1 -- 10.20.193.110:0/1032891194 <== mon.1 v1:10.20.193.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2084210036 0 0) 0x7f463c0008d0 con 0x7f463c10f6c0 2026-02-13T20:29:08.682 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.680+0000 7f461b7fe640 1 -- 10.20.193.110:0/1032891194 --> v1:10.20.193.188:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f463c04d8d0 con 0x7f463c10f6c0 2026-02-13T20:29:08.682 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.680+0000 7f461b7fe640 1 -- 10.20.193.110:0/1032891194 <== mon.1 v1:10.20.193.188:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f4630005170 con 0x7f463c10f6c0 2026-02-13T20:29:08.682 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.680+0000 7f461b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:08.682 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.680+0000 7f461b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T20:29:08.682 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.680+0000 7f461b7fe640 10 monclient: dump: 2026-02-13T20:29:08.682 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:08.682 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:08.682 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.682 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.682 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:08.682 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:08.682 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:08.682 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:08.682 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:08.682 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:08.682 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.680+0000 7f461b7fe640 1 -- 10.20.193.110:0/1032891194 <== mon.1 v1:10.20.193.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3755185596 0 0) 0x7f463c04d8d0 con 0x7f463c10f6c0 2026-02-13T20:29:08.682 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.680+0000 7f461b7fe640 1 -- 10.20.193.110:0/1032891194 --> v1:10.20.193.188:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f463c10fa90 con 0x7f463c10f6c0 2026-02-13T20:29:08.682 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.680+0000 7f461b7fe640 1 -- 10.20.193.110:0/1032891194 <== mon.1 v1:10.20.193.188:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4344 (unknown 0 0 3473295089) 0x7f4630005590 con 0x7f463c10f6c0 2026-02-13T20:29:08.682 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.680+0000 7f461b7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T20:29:08.682 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.680+0000 7f461b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:29:08.682 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.680+0000 7f461b7fe640 1 -- 10.20.193.110:0/1032891194 >> v1:10.20.193.188:6789/0 conn(0x7f463c10f6c0 legacy=0x7f463c04d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:08.682 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.680+0000 7f461b7fe640 1 -- 10.20.193.110:0/1032891194 >> v1:10.20.193.188:6789/0 conn(0x7f463c10f6c0 legacy=0x7f463c04d1c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T20:29:08.682 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:29:08.682 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:29:08.682 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:29:08.682 INFO:teuthology.orchestra.run.trial110.stdout: "state": "peon", 2026-02-13T20:29:08.682 INFO:teuthology.orchestra.run.trial110.stdout: "election_epoch": 64, 2026-02-13T20:29:08.682 INFO:teuthology.orchestra.run.trial110.stdout: "uptime": 424, 2026-02-13T20:29:08.682 INFO:teuthology.orchestra.run.trial110.stdout: "quorum": [ 2026-02-13T20:29:08.682 INFO:teuthology.orchestra.run.trial110.stdout: 0, 2026-02-13T20:29:08.682 INFO:teuthology.orchestra.run.trial110.stdout: 1, 2026-02-13T20:29:08.682 INFO:teuthology.orchestra.run.trial110.stdout: 2 2026-02-13T20:29:08.682 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:29:08.682 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_age": 0, 2026-02-13T20:29:08.682 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:29:08.683 INFO:teuthology.orchestra.run.trial110.stdout: "required_con": "2453899407728394244", 2026-02-13T20:29:08.683 INFO:teuthology.orchestra.run.trial110.stdout: "required_mon": [ 2026-02-13T20:29:08.683 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:29:08.683 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:29:08.683 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:29:08.683 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:29:08.683 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:29:08.683 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:29:08.683 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:29:08.683 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:29:08.683 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:29:08.683 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:29:08.683 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:29:08.683 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:29:08.683 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:29:08.683 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:29:08.683 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_con": "4544132024016699391", 2026-02-13T20:29:08.683 INFO:teuthology.orchestra.run.trial110.stdout: "quorum_mon": [ 2026-02-13T20:29:08.683 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:29:08.683 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:29:08.683 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:29:08.683 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:29:08.683 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:29:08.683 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:29:08.683 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:29:08.683 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:29:08.683 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:29:08.683 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:29:08.683 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:29:08.683 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:29:08.683 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:29:08.683 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:29:08.683 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:29:08.683 INFO:teuthology.orchestra.run.trial110.stdout: "outside_quorum": [], 2026-02-13T20:29:08.683 INFO:teuthology.orchestra.run.trial110.stdout: "extra_probe_peers": [], 2026-02-13T20:29:08.683 INFO:teuthology.orchestra.run.trial110.stdout: "sync_provider": [], 2026-02-13T20:29:08.683 INFO:teuthology.orchestra.run.trial110.stdout: "monmap": { 2026-02-13T20:29:08.683 INFO:teuthology.orchestra.run.trial110.stdout: "epoch": 1, 2026-02-13T20:29:08.683 INFO:teuthology.orchestra.run.trial110.stdout: "fsid": "edd4d072-2e11-43ec-9240-2fd608d0b4f8", 2026-02-13T20:29:08.683 INFO:teuthology.orchestra.run.trial110.stdout: "modified": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:29:08.683 INFO:teuthology.orchestra.run.trial110.stdout: "created": "2026-02-13T20:11:07.161192Z", 2026-02-13T20:29:08.683 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release": 20, 2026-02-13T20:29:08.683 INFO:teuthology.orchestra.run.trial110.stdout: "min_mon_release_name": "tentacle", 2026-02-13T20:29:08.683 INFO:teuthology.orchestra.run.trial110.stdout: "election_strategy": 3, 2026-02-13T20:29:08.684 INFO:teuthology.orchestra.run.trial110.stdout: "disallowed_leaders": "", 2026-02-13T20:29:08.684 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false, 2026-02-13T20:29:08.684 INFO:teuthology.orchestra.run.trial110.stdout: "tiebreaker_mon": "", 2026-02-13T20:29:08.684 INFO:teuthology.orchestra.run.trial110.stdout: "removed_ranks": "", 2026-02-13T20:29:08.684 INFO:teuthology.orchestra.run.trial110.stdout: "features": { 2026-02-13T20:29:08.684 INFO:teuthology.orchestra.run.trial110.stdout: "persistent": [ 2026-02-13T20:29:08.684 INFO:teuthology.orchestra.run.trial110.stdout: "kraken", 2026-02-13T20:29:08.684 INFO:teuthology.orchestra.run.trial110.stdout: "luminous", 2026-02-13T20:29:08.684 INFO:teuthology.orchestra.run.trial110.stdout: "mimic", 2026-02-13T20:29:08.684 INFO:teuthology.orchestra.run.trial110.stdout: "osdmap-prune", 2026-02-13T20:29:08.684 INFO:teuthology.orchestra.run.trial110.stdout: "nautilus", 2026-02-13T20:29:08.684 INFO:teuthology.orchestra.run.trial110.stdout: "octopus", 2026-02-13T20:29:08.684 INFO:teuthology.orchestra.run.trial110.stdout: "pacific", 2026-02-13T20:29:08.684 INFO:teuthology.orchestra.run.trial110.stdout: "elector-pinging", 2026-02-13T20:29:08.684 INFO:teuthology.orchestra.run.trial110.stdout: "quincy", 2026-02-13T20:29:08.684 INFO:teuthology.orchestra.run.trial110.stdout: "reef", 2026-02-13T20:29:08.684 INFO:teuthology.orchestra.run.trial110.stdout: "squid", 2026-02-13T20:29:08.684 INFO:teuthology.orchestra.run.trial110.stdout: "tentacle", 2026-02-13T20:29:08.684 INFO:teuthology.orchestra.run.trial110.stdout: "nvmeof_beacon_diff" 2026-02-13T20:29:08.684 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:29:08.684 INFO:teuthology.orchestra.run.trial110.stdout: "optional": [] 2026-02-13T20:29:08.684 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:29:08.684 INFO:teuthology.orchestra.run.trial110.stdout: "mons": [ 2026-02-13T20:29:08.684 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:29:08.684 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 0, 2026-02-13T20:29:08.684 INFO:teuthology.orchestra.run.trial110.stdout: "name": "a", 2026-02-13T20:29:08.684 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:29:08.684 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:29:08.684 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:29:08.684 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:29:08.684 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789", 2026-02-13T20:29:08.684 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:29:08.684 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:29:08.684 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:29:08.684 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:29:08.684 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6789/0", 2026-02-13T20:29:08.684 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6789/0", 2026-02-13T20:29:08.684 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:29:08.684 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:29:08.684 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161241+0000", 2026-02-13T20:29:08.684 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:29:08.684 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:29:08.684 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:29:08.684 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 1, 2026-02-13T20:29:08.684 INFO:teuthology.orchestra.run.trial110.stdout: "name": "b", 2026-02-13T20:29:08.684 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:29:08.685 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:29:08.685 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:29:08.685 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:29:08.685 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789", 2026-02-13T20:29:08.685 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:29:08.685 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:29:08.685 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:29:08.685 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:29:08.685 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.188:6789/0", 2026-02-13T20:29:08.685 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.188:6789/0", 2026-02-13T20:29:08.685 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:29:08.685 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:29:08.685 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161242+0000", 2026-02-13T20:29:08.685 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:29:08.685 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:29:08.685 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:29:08.685 INFO:teuthology.orchestra.run.trial110.stdout: "rank": 2, 2026-02-13T20:29:08.685 INFO:teuthology.orchestra.run.trial110.stdout: "name": "c", 2026-02-13T20:29:08.685 INFO:teuthology.orchestra.run.trial110.stdout: "public_addrs": { 2026-02-13T20:29:08.685 INFO:teuthology.orchestra.run.trial110.stdout: "addrvec": [ 2026-02-13T20:29:08.685 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:29:08.685 INFO:teuthology.orchestra.run.trial110.stdout: "type": "v1", 2026-02-13T20:29:08.685 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790", 2026-02-13T20:29:08.685 INFO:teuthology.orchestra.run.trial110.stdout: "nonce": 0 2026-02-13T20:29:08.685 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:29:08.685 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:29:08.685 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:29:08.685 INFO:teuthology.orchestra.run.trial110.stdout: "addr": "10.20.193.110:6790/0", 2026-02-13T20:29:08.685 INFO:teuthology.orchestra.run.trial110.stdout: "public_addr": "10.20.193.110:6790/0", 2026-02-13T20:29:08.685 INFO:teuthology.orchestra.run.trial110.stdout: "priority": 0, 2026-02-13T20:29:08.685 INFO:teuthology.orchestra.run.trial110.stdout: "weight": 0, 2026-02-13T20:29:08.685 INFO:teuthology.orchestra.run.trial110.stdout: "time_added": "2026-02-13T20:11:07:161243+0000", 2026-02-13T20:29:08.685 INFO:teuthology.orchestra.run.trial110.stdout: "crush_location": [] 2026-02-13T20:29:08.685 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:29:08.685 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:29:08.685 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:29:08.685 INFO:teuthology.orchestra.run.trial110.stdout: "feature_map": { 2026-02-13T20:29:08.685 INFO:teuthology.orchestra.run.trial110.stdout: "mon": [ 2026-02-13T20:29:08.685 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:29:08.685 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:29:08.685 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:29:08.685 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:29:08.685 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:29:08.685 INFO:teuthology.orchestra.run.trial110.stdout: ], 2026-02-13T20:29:08.686 INFO:teuthology.orchestra.run.trial110.stdout: "client": [ 2026-02-13T20:29:08.686 INFO:teuthology.orchestra.run.trial110.stdout: { 2026-02-13T20:29:08.686 INFO:teuthology.orchestra.run.trial110.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T20:29:08.686 INFO:teuthology.orchestra.run.trial110.stdout: "release": "squid", 2026-02-13T20:29:08.686 INFO:teuthology.orchestra.run.trial110.stdout: "num": 1 2026-02-13T20:29:08.686 INFO:teuthology.orchestra.run.trial110.stdout: } 2026-02-13T20:29:08.686 INFO:teuthology.orchestra.run.trial110.stdout: ] 2026-02-13T20:29:08.686 INFO:teuthology.orchestra.run.trial110.stdout: }, 2026-02-13T20:29:08.686 INFO:teuthology.orchestra.run.trial110.stdout: "stretch_mode": false 2026-02-13T20:29:08.686 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:29:08.686 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.680+0000 7f464174c640 1 -- 10.20.193.110:0/1032891194 >> v1:10.20.193.188:6812/1623052694 conn(0x7f460803fc40 legacy=0x7f46080600f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:08.686 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.680+0000 7f464174c640 10 monclient: shutdown 2026-02-13T20:29:08.686 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.680+0000 7f464174c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:29:08.686 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.680+0000 7f464174c640 1 -- 10.20.193.110:0/1032891194 >> v1:10.20.193.110:6790/0 conn(0x7f463c13f280 legacy=0x7f463c1a1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:08.686 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.680+0000 7f463b7fe640 1 -- 10.20.193.110:0/1032891194 reap_dead start 2026-02-13T20:29:08.686 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.680+0000 7f463b7fe640 1 -- 10.20.193.110:0/1032891194 reap_dead start 2026-02-13T20:29:08.686 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.680+0000 7f464174c640 1 -- 10.20.193.110:0/1032891194 shutdown_connections 2026-02-13T20:29:08.686 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.680+0000 7f464174c640 1 -- 10.20.193.110:0/1032891194 >> 10.20.193.110:0/1032891194 conn(0x7f463c054e90 msgr2=0x7f463c122610 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:29:08.686 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.680+0000 7f464174c640 1 -- 10.20.193.110:0/1032891194 shutdown_connections 2026-02-13T20:29:08.686 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.680+0000 7f464174c640 1 -- 10.20.193.110:0/1032891194 wait complete. 2026-02-13T20:29:08.687 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T20:29:08.687 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-13T20:29:08.687 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-13T20:29:08.749 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.748+0000 7f0db570c640 10 monclient: get_monmap_and_config 2026-02-13T20:29:08.749 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.748+0000 7f0db570c640 10 monclient: build_initial_monmap 2026-02-13T20:29:08.750 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.748+0000 7f0db570c640 10 monclient: monmap: 2026-02-13T20:29:08.750 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:29:08.750 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:08.750 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:29:08.750305+0000 2026-02-13T20:29:08.750 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:29:08.750305+0000 2026-02-13T20:29:08.750 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:29:08.750 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:08.750 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:29:08.750 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:29:08.750 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:29:08.750 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:08.750 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.749+0000 7f0db570c640 1 Processor -- start 2026-02-13T20:29:08.750 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.749+0000 7f0db570c640 1 -- start start 2026-02-13T20:29:08.750 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.749+0000 7f0db570c640 10 monclient: init 2026-02-13T20:29:08.750 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.749+0000 7f0db570c640 10 monclient: _reopen_session rank -1 2026-02-13T20:29:08.750 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.749+0000 7f0db570c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:29:08.750 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.749+0000 7f0db570c640 10 monclient(hunting): picked mon.noname-a con 0x7f0db01401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:29:08.750 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.749+0000 7f0db570c640 10 monclient(hunting): picked mon.noname-c con 0x7f0db0092020 addr v1:10.20.193.188:6789/0 2026-02-13T20:29:08.750 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.749+0000 7f0db570c640 10 monclient(hunting): picked mon.noname-b con 0x7f0db0091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:29:08.750 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.749+0000 7f0db570c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0db008b730 con 0x7f0db01401c0 2026-02-13T20:29:08.750 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.749+0000 7f0db570c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0db005c5b0 con 0x7f0db0092020 2026-02-13T20:29:08.750 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.749+0000 7f0db570c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0db008bcf0 con 0x7f0db0091950 2026-02-13T20:29:08.750 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.749+0000 7f0db570c640 10 monclient(hunting): _renew_subs 2026-02-13T20:29:08.751 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.749+0000 7f0db570c640 10 monclient(hunting): authenticate will time out at 1710.440661s 2026-02-13T20:29:08.751 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.749+0000 7f0daeffd640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f0db01401c0 0x7f0db0091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:58908/0 (socket says 10.20.193.110:58908) 2026-02-13T20:29:08.751 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.749+0000 7f0daeffd640 1 -- 10.20.193.110:0/1439104042 learned_addr learned my addr 10.20.193.110:0/1439104042 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:29:08.751 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.749+0000 7f0dadffb640 1 -- 10.20.193.110:0/1439104042 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 314725693 0 0) 0x7f0db008b730 con 0x7f0db01401c0 2026-02-13T20:29:08.751 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.749+0000 7f0dadffb640 10 monclient(hunting): _negotiate 2026-02-13T20:29:08.751 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.749+0000 7f0dadffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:08.751 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.749+0000 7f0dadffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:08.751 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.749+0000 7f0dadffb640 10 monclient(hunting): my global_id is 124533 2026-02-13T20:29:08.751 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.749+0000 7f0dadffb640 1 -- 10.20.193.110:0/1439104042 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d9c0035e0 con 0x7f0db01401c0 2026-02-13T20:29:08.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.749+0000 7f0dadffb640 1 -- 10.20.193.110:0/1439104042 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 531811682 0 0) 0x7f0db008bcf0 con 0x7f0db0091950 2026-02-13T20:29:08.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.749+0000 7f0dadffb640 10 monclient(hunting): _negotiate 2026-02-13T20:29:08.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.749+0000 7f0dadffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:08.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.749+0000 7f0dadffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:08.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.749+0000 7f0dadffb640 10 monclient(hunting): my global_id is 154250 2026-02-13T20:29:08.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.749+0000 7f0dadffb640 1 -- 10.20.193.110:0/1439104042 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0db008b730 con 0x7f0db0091950 2026-02-13T20:29:08.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.750+0000 7f0dadffb640 1 -- 10.20.193.110:0/1439104042 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1833212563 0 0) 0x7f0d9c0035e0 con 0x7f0db01401c0 2026-02-13T20:29:08.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.750+0000 7f0dadffb640 1 -- 10.20.193.110:0/1439104042 >> v1:10.20.193.110:6790/0 conn(0x7f0db0091950 legacy=0x7f0db01a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:08.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.750+0000 7f0dadffb640 1 -- 10.20.193.110:0/1439104042 >> v1:10.20.193.188:6789/0 conn(0x7f0db0092020 legacy=0x7f0db01812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:08.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.750+0000 7f0dadffb640 10 monclient: _finish_hunting 0 2026-02-13T20:29:08.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.750+0000 7f0dadffb640 1 monclient: found mon.noname-a 2026-02-13T20:29:08.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.750+0000 7f0dadffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:29:08.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.750+0000 7f0dadffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:29:08.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.750+0000 7f0dadffb640 1 -- 10.20.193.110:0/1439104042 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0db0140590 con 0x7f0db01401c0 2026-02-13T20:29:08.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.750+0000 7f0dadffb640 10 monclient: _finish_auth 0 2026-02-13T20:29:08.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.750+0000 7f0dadffb640 10 monclient: _check_auth_tickets 2026-02-13T20:29:08.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.750+0000 7f0dadffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:29:08.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.750+0000 7f0dadffb640 1 -- 10.20.193.110:0/1439104042 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f0da4002dd0 con 0x7f0db01401c0 2026-02-13T20:29:08.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.750+0000 7f0db570c640 5 monclient: authenticate success, global_id 124533 2026-02-13T20:29:08.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.750+0000 7f0db570c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:29:08.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.750+0000 7f0dadffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:08.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.750+0000 7f0dadffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:29:08.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.750+0000 7f0dadffb640 10 monclient: dump: 2026-02-13T20:29:08.752 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:08.752 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:08.752 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.752 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.752 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:08.752 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:08.752 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:08.752 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:08.752 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:08.752 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:08.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.750+0000 7f0db570c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:29:08.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.750+0000 7f0dadffb640 1 -- 10.20.193.110:0/1439104042 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0da4002f60 con 0x7f0db01401c0 2026-02-13T20:29:08.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.750+0000 7f0dadffb640 10 monclient: handle_config config(0 keys) 2026-02-13T20:29:08.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.750+0000 7f0dadffb640 1 -- 10.20.193.110:0/1439104042 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f0da4003370 con 0x7f0db01401c0 2026-02-13T20:29:08.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.750+0000 7f0db570c640 10 monclient: get_monmap_and_config success 2026-02-13T20:29:08.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.750+0000 7f0dadffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:08.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.750+0000 7f0db570c640 4 set_mon_vals no callback set 2026-02-13T20:29:08.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.750+0000 7f0dadffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:29:08.752 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.750+0000 7f0dadffb640 10 monclient: dump: 2026-02-13T20:29:08.752 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:08.752 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:08.753 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.753 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.753 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:08.753 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:08.753 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:08.753 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:08.753 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:08.753 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:08.753 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.750+0000 7f0db570c640 10 monclient: shutdown 2026-02-13T20:29:08.753 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.750+0000 7f0db570c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:29:08.753 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.750+0000 7f0db570c640 1 -- 10.20.193.110:0/1439104042 >> v1:10.20.193.110:6789/0 conn(0x7f0db01401c0 legacy=0x7f0db0091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:08.753 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.750+0000 7f0db570c640 1 -- 10.20.193.110:0/1439104042 shutdown_connections 2026-02-13T20:29:08.753 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.750+0000 7f0db570c640 1 -- 10.20.193.110:0/1439104042 >> 10.20.193.110:0/1439104042 conn(0x7f0db0054e90 msgr2=0x7f0db0058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:29:08.753 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.750+0000 7f0db570c640 1 -- 10.20.193.110:0/1439104042 shutdown_connections 2026-02-13T20:29:08.753 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.750+0000 7f0db570c640 1 -- 10.20.193.110:0/1439104042 wait complete. 2026-02-13T20:29:08.753 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.750+0000 7f0db570c640 10 monclient: build_initial_monmap 2026-02-13T20:29:08.753 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.750+0000 7f0db570c640 10 monclient: monmap: 2026-02-13T20:29:08.753 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:29:08.753 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:29:08.753 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:29:08.753 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:29:08.753 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:29:08.753 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:29:08.753 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:29:08.753 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:29:08.753 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:29:08.753 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:08.754 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0db570c640 1 Processor -- start 2026-02-13T20:29:08.754 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0db570c640 1 -- start start 2026-02-13T20:29:08.754 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0db570c640 10 monclient: init 2026-02-13T20:29:08.754 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0db570c640 10 monclient: _reopen_session rank -1 2026-02-13T20:29:08.754 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0db570c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:29:08.754 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0db570c640 10 monclient(hunting): picked mon.noname-a con 0x7f0db0091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:29:08.754 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0db570c640 10 monclient(hunting): picked mon.noname-b con 0x7f0db01401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:29:08.754 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0db570c640 10 monclient(hunting): picked mon.noname-c con 0x7f0db012b8f0 addr v1:10.20.193.110:6790/0 2026-02-13T20:29:08.755 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0db570c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0db0091460 con 0x7f0db0091950 2026-02-13T20:29:08.755 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0db570c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0db012d0f0 con 0x7f0db01401c0 2026-02-13T20:29:08.755 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0db570c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0db012a0f0 con 0x7f0db012b8f0 2026-02-13T20:29:08.755 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0db570c640 10 monclient(hunting): _renew_subs 2026-02-13T20:29:08.755 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0db570c640 10 monclient(hunting): authenticate will time out at 1710.442384s 2026-02-13T20:29:08.755 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0daeffd640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f0db0091950 0x7f0db01292d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:58914/0 (socket says 10.20.193.110:58914) 2026-02-13T20:29:08.755 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0daeffd640 1 -- 10.20.193.110:0/1656851088 learned_addr learned my addr 10.20.193.110:0/1656851088 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:29:08.755 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0d8f7fe640 1 -- 10.20.193.110:0/1656851088 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3767151218 0 0) 0x7f0db012a0f0 con 0x7f0db012b8f0 2026-02-13T20:29:08.755 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0d8f7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:29:08.755 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0d8f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:08.755 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0d8f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:08.755 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0d8f7fe640 10 monclient(hunting): my global_id is 154253 2026-02-13T20:29:08.755 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0d8f7fe640 1 -- 10.20.193.110:0/1656851088 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d7c0035e0 con 0x7f0db012b8f0 2026-02-13T20:29:08.755 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0d8f7fe640 1 -- 10.20.193.110:0/1656851088 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 322310489 0 0) 0x7f0db0091460 con 0x7f0db0091950 2026-02-13T20:29:08.755 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0d8f7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:29:08.755 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0d8f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:08.755 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0d8f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:08.755 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0d8f7fe640 10 monclient(hunting): my global_id is 124536 2026-02-13T20:29:08.755 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0d8f7fe640 1 -- 10.20.193.110:0/1656851088 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0db012a0f0 con 0x7f0db0091950 2026-02-13T20:29:08.755 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0d8f7fe640 1 -- 10.20.193.110:0/1656851088 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3407715513 0 0) 0x7f0d7c0035e0 con 0x7f0db012b8f0 2026-02-13T20:29:08.755 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0d8f7fe640 1 -- 10.20.193.110:0/1656851088 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0db0091460 con 0x7f0db012b8f0 2026-02-13T20:29:08.755 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0d8f7fe640 1 -- 10.20.193.110:0/1656851088 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f0da0004170 con 0x7f0db012b8f0 2026-02-13T20:29:08.755 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0d8f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:29:08.755 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0d8f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:29:08.755 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0d8f7fe640 10 monclient(hunting): dump: 2026-02-13T20:29:08.755 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:08.755 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:08.755 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.755 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.755 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:08.755 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:08.755 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:08.755 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:08.755 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:08.755 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:08.755 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0d8f7fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:29:08.755 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0d8f7fe640 1 -- 10.20.193.110:0/1656851088 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 95446910 0 0) 0x7f0db012a0f0 con 0x7f0db0091950 2026-02-13T20:29:08.755 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0d8f7fe640 1 -- 10.20.193.110:0/1656851088 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0d7c0035e0 con 0x7f0db0091950 2026-02-13T20:29:08.755 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0d8f7fe640 1 -- 10.20.193.110:0/1656851088 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f0da4003280 con 0x7f0db0091950 2026-02-13T20:29:08.755 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0d8f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:29:08.755 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0d8f7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:29:08.755 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0d8f7fe640 10 monclient(hunting): dump: 2026-02-13T20:29:08.755 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:08.755 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:08.755 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.756 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.756 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:08.756 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:08.756 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:08.756 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:08.756 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:08.756 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:08.756 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0d8f7fe640 1 -- 10.20.193.110:0/1656851088 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2298262921 0 0) 0x7f0db0091460 con 0x7f0db012b8f0 2026-02-13T20:29:08.756 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0d8f7fe640 1 -- 10.20.193.110:0/1656851088 >> v1:10.20.193.188:6789/0 conn(0x7f0db01401c0 legacy=0x7f0db01299e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:08.756 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0d8f7fe640 1 -- 10.20.193.110:0/1656851088 >> v1:10.20.193.110:6789/0 conn(0x7f0db0091950 legacy=0x7f0db01292d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:08.756 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0d8f7fe640 10 monclient: _finish_hunting 0 2026-02-13T20:29:08.756 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0d8f7fe640 1 monclient: found mon.c 2026-02-13T20:29:08.756 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0d8f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:29:08.756 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0d8f7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:08.756 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0d8f7fe640 1 -- 10.20.193.110:0/1656851088 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0db005d320 con 0x7f0db012b8f0 2026-02-13T20:29:08.756 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0d8f7fe640 10 monclient: _finish_auth 0 2026-02-13T20:29:08.756 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0d8f7fe640 10 monclient: _check_auth_tickets 2026-02-13T20:29:08.756 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0d8f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:29:08.756 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0db570c640 5 monclient: authenticate success, global_id 154253 2026-02-13T20:29:08.756 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0db570c640 10 monclient: _renew_subs 2026-02-13T20:29:08.756 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0db570c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:08.756 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0db570c640 1 -- 10.20.193.110:0/1656851088 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0db012c280 con 0x7f0db012b8f0 2026-02-13T20:29:08.756 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0db570c640 10 monclient: _renew_subs 2026-02-13T20:29:08.756 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0db570c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:08.756 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.751+0000 7f0db570c640 1 -- 10.20.193.110:0/1656851088 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f0db013da40 con 0x7f0db012b8f0 2026-02-13T20:29:08.756 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.752+0000 7f0d8f7fe640 1 -- 10.20.193.110:0/1656851088 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0da00047b0 con 0x7f0db012b8f0 2026-02-13T20:29:08.756 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.752+0000 7f0d8f7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:29:08.756 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.752+0000 7f0d8f7fe640 1 -- 10.20.193.110:0/1656851088 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f0da0004ad0 con 0x7f0db012b8f0 2026-02-13T20:29:08.756 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.752+0000 7f0d8f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:08.756 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.752+0000 7f0d8f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:29:08.756 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.752+0000 7f0d8f7fe640 10 monclient: dump: 2026-02-13T20:29:08.756 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:08.756 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:08.756 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.756 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:08.756 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:08.756 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:08.756 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:08.756 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:08.756 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:08.756 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:08.756 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.752+0000 7f0dad7fa640 4 set_mon_vals no callback set 2026-02-13T20:29:08.756 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.752+0000 7f0db570c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:08.756 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.752+0000 7f0db570c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:08.756 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.752+0000 7f0db570c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:08.756 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.752+0000 7f0db570c640 1 -- 10.20.193.110:0/1656851088 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0db00597f0 con 0x7f0db012b8f0 2026-02-13T20:29:08.757 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.752+0000 7f0d8f7fe640 1 -- 10.20.193.110:0/1656851088 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f0da0011740 con 0x7f0db012b8f0 2026-02-13T20:29:08.757 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.752+0000 7f0d8f7fe640 1 -- 10.20.193.110:0/1656851088 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(847..847 src has 1..847) ==== 3591+0+0 (unknown 4078645555 0 0) 0x7f0da004e460 con 0x7f0db012b8f0 2026-02-13T20:29:08.757 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.752+0000 7f0daeffd640 10 monclient: get_auth_request con 0x7f0d7c03fac0 auth_method 0 2026-02-13T20:29:08.757 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.754+0000 7f0d8f7fe640 1 -- 10.20.193.110:0/1656851088 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f0da0016e60 con 0x7f0db012b8f0 2026-02-13T20:29:08.757 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.754+0000 7f0d8f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:08.757 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.754+0000 7f0d8f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:29:08.899 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.898+0000 7f0db570c640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-13T20:29:08.899 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.898+0000 7f0db570c640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-13T20:29:08.899 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.898+0000 7f0db570c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:08.899 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.898+0000 7f0db570c640 1 -- 10.20.193.110:0/1656851088 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f0db012c850 con 0x7f0db012b8f0 2026-02-13T20:29:08.900 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.899+0000 7f0d8f7fe640 1 -- 10.20.193.110:0/1656851088 <== mon.2 v1:10.20.193.110:6790/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7f0da0016610 con 0x7f0db012b8f0 2026-02-13T20:29:08.900 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.899+0000 7f0d8f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-13T20:29:08.900 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.899+0000 7f0d8f7fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:29:08.900 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.899+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.900 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.899+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=24,config=2,health=13,kv=11,logm=50} crc {auth=1295186113,config=1618278320,health=195400677,kv=1564860261,logm=546277980}) 2026-02-13T20:29:08.900 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.899+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=23,config=2,health=13,kv=10,logm=52} crc {auth=1677683893,config=1618278320,health=195400677,kv=220646511,logm=3608720051}) 2026-02-13T20:29:08.900 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.899+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.900 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.899+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=24,config=2,health=13,kv=11,logm=50} crc {auth=1295186113,config=1618278320,health=195400677,kv=1564860261,logm=546277980}) 2026-02-13T20:29:08.900 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.899+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=25,config=2,health=13,kv=10,logm=50} crc {auth=2523771489,config=1618278320,health=2019829929,kv=2847523468,logm=246829628}) 2026-02-13T20:29:08.900 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.899+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.900 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.899+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1917318858}) 2026-02-13T20:29:08.900 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.899+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=426430692}) 2026-02-13T20:29:08.900 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.899+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.900 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.899+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1917318858}) 2026-02-13T20:29:08.900 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.899+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=623514336}) 2026-02-13T20:29:08.901 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.900+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.901 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.900+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2804706567}) 2026-02-13T20:29:08.901 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.900+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=518249910}) 2026-02-13T20:29:08.901 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.900+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.901 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.900+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2804706567}) 2026-02-13T20:29:08.901 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.900+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=550640567}) 2026-02-13T20:29:08.901 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.900+0000 7f0db570c640 1 -- 10.20.193.110:0/1656851088 >> v1:10.20.193.188:6812/1623052694 conn(0x7f0d7c03fac0 legacy=0x7f0d7c05ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:08.901 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.900+0000 7f0db570c640 10 monclient: shutdown 2026-02-13T20:29:08.901 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.900+0000 7f0db570c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:29:08.901 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.900+0000 7f0db570c640 1 -- 10.20.193.110:0/1656851088 >> v1:10.20.193.110:6790/0 conn(0x7f0db012b8f0 legacy=0x7f0db0191130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:08.901 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.900+0000 7f0db570c640 1 -- 10.20.193.110:0/1656851088 shutdown_connections 2026-02-13T20:29:08.901 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.900+0000 7f0db570c640 1 -- 10.20.193.110:0/1656851088 >> 10.20.193.110:0/1656851088 conn(0x7f0db0054e90 msgr2=0x7f0db00893e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:29:08.901 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.900+0000 7f0db570c640 1 -- 10.20.193.110:0/1656851088 shutdown_connections 2026-02-13T20:29:08.901 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:08.900+0000 7f0db570c640 1 -- 10.20.193.110:0/1656851088 wait complete. 2026-02-13T20:29:08.902 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.900+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.902 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.900+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1341228175}) 2026-02-13T20:29:08.902 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.900+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=297621933}) 2026-02-13T20:29:08.902 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.900+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.902 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.900+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1341228175}) 2026-02-13T20:29:08.902 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.900+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3503776726}) 2026-02-13T20:29:08.902 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.901+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.902 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.901+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2630608710}) 2026-02-13T20:29:08.902 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.901+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4221576496}) 2026-02-13T20:29:08.902 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.901+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.902 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.901+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2630608710}) 2026-02-13T20:29:08.902 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.901+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3970245332}) 2026-02-13T20:29:08.902 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.901+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.902 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.901+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3759108966}) 2026-02-13T20:29:08.902 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.901+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=873249690}) 2026-02-13T20:29:08.902 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.901+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.902 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.901+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3759108966}) 2026-02-13T20:29:08.902 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.901+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3775242047}) 2026-02-13T20:29:08.903 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.902+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.903 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.902+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3361882690}) 2026-02-13T20:29:08.903 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.902+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1884729566}) 2026-02-13T20:29:08.903 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.902+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.903 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.902+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3361882690}) 2026-02-13T20:29:08.903 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.902+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3531613226}) 2026-02-13T20:29:08.903 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.902+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.903 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.902+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=710323147}) 2026-02-13T20:29:08.903 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.902+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1248182591}) 2026-02-13T20:29:08.903 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.902+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.903 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.902+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=710323147}) 2026-02-13T20:29:08.903 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.902+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3462921326}) 2026-02-13T20:29:08.904 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.903+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.904 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.903+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1789875825}) 2026-02-13T20:29:08.904 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.903+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2340602656}) 2026-02-13T20:29:08.904 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.903+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.904 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.903+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1789875825}) 2026-02-13T20:29:08.904 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.903+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2693586403}) 2026-02-13T20:29:08.904 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.903+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.904 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.903+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1403441997}) 2026-02-13T20:29:08.904 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.903+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1327886996}) 2026-02-13T20:29:08.904 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.903+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.904 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.903+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1403441997}) 2026-02-13T20:29:08.904 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.903+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4062112106}) 2026-02-13T20:29:08.904 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.903+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.905 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.903+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3387397583}) 2026-02-13T20:29:08.905 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.903+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3723880628}) 2026-02-13T20:29:08.905 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.903+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.905 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.903+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3387397583}) 2026-02-13T20:29:08.905 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.904+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=545438131}) 2026-02-13T20:29:08.905 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.904+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.905 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.904+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1294117264}) 2026-02-13T20:29:08.905 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.904+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1920615125}) 2026-02-13T20:29:08.905 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.904+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.905 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.904+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1294117264}) 2026-02-13T20:29:08.905 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.904+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1462743136}) 2026-02-13T20:29:08.905 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.904+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.905 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.904+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=403867729}) 2026-02-13T20:29:08.906 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.904+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3032377330}) 2026-02-13T20:29:08.906 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.904+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.906 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.904+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=403867729}) 2026-02-13T20:29:08.906 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.904+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1100623364}) 2026-02-13T20:29:08.906 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.905+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.906 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.905+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1971603476}) 2026-02-13T20:29:08.906 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.905+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3080914605}) 2026-02-13T20:29:08.906 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.905+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.906 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.905+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1971603476}) 2026-02-13T20:29:08.906 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.905+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3487468590}) 2026-02-13T20:29:08.906 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.905+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.906 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.905+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2739700668}) 2026-02-13T20:29:08.906 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.905+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2016673211}) 2026-02-13T20:29:08.906 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.905+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.906 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.905+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2739700668}) 2026-02-13T20:29:08.906 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.905+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1879531113}) 2026-02-13T20:29:08.907 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.906+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.907 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.906+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=272153026}) 2026-02-13T20:29:08.907 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.906+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1620602836}) 2026-02-13T20:29:08.907 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.906+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.907 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.906+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=272153026}) 2026-02-13T20:29:08.907 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.906+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4084213769}) 2026-02-13T20:29:08.910 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.906+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.911 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.906+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=661643084}) 2026-02-13T20:29:08.911 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.906+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2359539685}) 2026-02-13T20:29:08.911 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.906+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.911 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.906+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=661643084}) 2026-02-13T20:29:08.911 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.906+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1657389318}) 2026-02-13T20:29:08.911 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.907+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.911 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.907+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1321572527}) 2026-02-13T20:29:08.911 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.907+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1411520933}) 2026-02-13T20:29:08.911 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.907+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.911 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.907+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1321572527}) 2026-02-13T20:29:08.912 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.907+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2284877052}) 2026-02-13T20:29:08.912 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.907+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.912 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.907+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3816366197}) 2026-02-13T20:29:08.912 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.907+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1026022067}) 2026-02-13T20:29:08.912 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.907+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.912 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.907+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3816366197}) 2026-02-13T20:29:08.912 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.907+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=938954023}) 2026-02-13T20:29:08.912 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.908+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.912 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.908+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1702890056}) 2026-02-13T20:29:08.912 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.908+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=69469616}) 2026-02-13T20:29:08.912 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.908+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.912 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.908+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1702890056}) 2026-02-13T20:29:08.913 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.908+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3416134395}) 2026-02-13T20:29:08.913 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.908+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.913 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.908+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=411582160}) 2026-02-13T20:29:08.913 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.908+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=951778553}) 2026-02-13T20:29:08.913 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.908+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.913 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.908+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=411582160}) 2026-02-13T20:29:08.913 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.908+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=360900914}) 2026-02-13T20:29:08.913 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.908+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.913 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.908+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2866952936}) 2026-02-13T20:29:08.913 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.908+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4163694495}) 2026-02-13T20:29:08.913 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.908+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.913 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.908+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2866952936}) 2026-02-13T20:29:08.914 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.908+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1424427862}) 2026-02-13T20:29:08.914 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.909+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.914 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.909+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1824469019}) 2026-02-13T20:29:08.914 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.909+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3698449721}) 2026-02-13T20:29:08.914 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.909+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.914 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.909+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1824469019}) 2026-02-13T20:29:08.914 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.909+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3804733462}) 2026-02-13T20:29:08.915 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.909+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.915 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.909+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1065507141}) 2026-02-13T20:29:08.916 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.909+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2452159208}) 2026-02-13T20:29:08.916 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.909+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.916 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.909+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1065507141}) 2026-02-13T20:29:08.916 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.909+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1624225950}) 2026-02-13T20:29:08.917 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-13T20:29:08.926 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.910+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.926 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.910+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2702548514}) 2026-02-13T20:29:08.926 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.910+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=644359069}) 2026-02-13T20:29:08.926 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.910+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.926 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.910+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2702548514}) 2026-02-13T20:29:08.926 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.910+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1201851351}) 2026-02-13T20:29:08.926 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.910+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.926 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.910+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3083059375}) 2026-02-13T20:29:08.926 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.910+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3260814401}) 2026-02-13T20:29:08.927 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.910+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.927 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.910+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3083059375}) 2026-02-13T20:29:08.927 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.910+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1908637134}) 2026-02-13T20:29:08.927 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.911+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.927 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.911+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1612632676}) 2026-02-13T20:29:08.927 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.911+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1408044258}) 2026-02-13T20:29:08.927 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.911+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.927 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.911+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1612632676}) 2026-02-13T20:29:08.927 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.911+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=622990212}) 2026-02-13T20:29:08.927 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.911+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.927 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.911+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2138549204}) 2026-02-13T20:29:08.927 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.911+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1194078267}) 2026-02-13T20:29:08.927 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.911+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.927 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.911+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2138549204}) 2026-02-13T20:29:08.927 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.911+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=934756510}) 2026-02-13T20:29:08.927 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.912+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.927 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.912+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4091012635}) 2026-02-13T20:29:08.927 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.912+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2353971023}) 2026-02-13T20:29:08.928 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.912+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.928 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.912+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4091012635}) 2026-02-13T20:29:08.928 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.912+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4090141946}) 2026-02-13T20:29:08.928 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.912+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.928 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.912+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2537733309}) 2026-02-13T20:29:08.928 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.912+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2198103506}) 2026-02-13T20:29:08.928 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.912+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.928 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.912+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2537733309}) 2026-02-13T20:29:08.928 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.912+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3550239218}) 2026-02-13T20:29:08.928 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.913+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.928 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.913+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=805299233}) 2026-02-13T20:29:08.928 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.913+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=961645506}) 2026-02-13T20:29:08.928 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.913+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.928 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.913+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=805299233}) 2026-02-13T20:29:08.928 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.913+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=195290933}) 2026-02-13T20:29:08.928 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.913+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.928 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.913+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1201895593}) 2026-02-13T20:29:08.928 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.913+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=843999543}) 2026-02-13T20:29:08.928 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.913+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.929 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.913+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1201895593}) 2026-02-13T20:29:08.929 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.913+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4161367153}) 2026-02-13T20:29:08.929 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.914+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.929 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.914+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2260453835}) 2026-02-13T20:29:08.929 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.914+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2780331262}) 2026-02-13T20:29:08.929 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.914+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.929 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.914+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2260453835}) 2026-02-13T20:29:08.929 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.914+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2005678469}) 2026-02-13T20:29:08.929 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.914+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.929 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.914+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1607351803}) 2026-02-13T20:29:08.929 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.914+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1931154166}) 2026-02-13T20:29:08.929 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.914+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.929 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.914+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1607351803}) 2026-02-13T20:29:08.929 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.914+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=855216266}) 2026-02-13T20:29:08.929 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.914+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.929 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.914+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3553416682}) 2026-02-13T20:29:08.929 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.914+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3218560955}) 2026-02-13T20:29:08.929 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.914+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.930 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.914+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3553416682}) 2026-02-13T20:29:08.930 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.914+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3209275618}) 2026-02-13T20:29:08.930 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.915+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.930 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.915+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=701459350}) 2026-02-13T20:29:08.930 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.915+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4076459127}) 2026-02-13T20:29:08.930 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.915+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.930 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.915+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=701459350}) 2026-02-13T20:29:08.930 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.915+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=613342866}) 2026-02-13T20:29:08.930 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.915+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.930 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.915+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3886302740}) 2026-02-13T20:29:08.930 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.915+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2375937937}) 2026-02-13T20:29:08.930 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.915+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.930 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.915+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3886302740}) 2026-02-13T20:29:08.930 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.915+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3936245692}) 2026-02-13T20:29:08.930 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.916+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.930 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.916+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=87,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1} crc {logm=470779150,mdsmap=3740562891,mgr=2881591710,mgr_command_descs=714296370,mgr_metadata=2819730505}) 2026-02-13T20:29:08.930 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.916+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=87,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1} crc {logm=1528727154,mdsmap=3740562891,mgr=2881591710,mgr_command_descs=714296370,mgr_metadata=2819730505}) 2026-02-13T20:29:08.930 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.916+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.930 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.916+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=87,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1} crc {logm=470779150,mdsmap=3740562891,mgr=2881591710,mgr_command_descs=714296370,mgr_metadata=2819730505}) 2026-02-13T20:29:08.930 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.916+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=89,mdsmap=3,mgr=6,mgr_command_descs=1,mgr_metadata=1} crc {logm=4274869529,mdsmap=3740562891,mgr=2340547469,mgr_command_descs=714296370,mgr_metadata=2819730505}) 2026-02-13T20:29:08.931 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.916+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.931 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.916+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {mgrstat=9,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=69} crc {mgrstat=720014301,mon_config_key=1317016591,monmap=207866894,nvmeofgw=3360707892,osd_metadata=91123727,osd_pg_creating=3379497551,osd_snap=3701441986}) 2026-02-13T20:29:08.931 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.916+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mgrstat=9,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=69} crc {mgrstat=720014301,mon_config_key=2606719207,monmap=207866894,nvmeofgw=3360707892,osd_metadata=91123727,osd_pg_creating=3379497551,osd_snap=3706212073}) 2026-02-13T20:29:08.931 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.916+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.931 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.916+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {mgrstat=9,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=69} crc {mgrstat=720014301,mon_config_key=1317016591,monmap=207866894,nvmeofgw=3360707892,osd_metadata=91123727,osd_pg_creating=3379497551,osd_snap=3701441986}) 2026-02-13T20:29:08.931 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.916+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {mgrstat=7,mon_config_key=8,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=72} crc {mgrstat=3572388984,mon_config_key=1894209440,monmap=207866894,nvmeofgw=3360707892,osd_metadata=91123727,osd_pg_creating=3379497551,osd_snap=1015589683}) 2026-02-13T20:29:08.931 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.917+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.931 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.917+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=99,osdmap=1} crc {osd_snap=3209917163,osdmap=1283064123}) 2026-02-13T20:29:08.931 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.917+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=96,osdmap=4} crc {osd_snap=2526964458,osdmap=109052974}) 2026-02-13T20:29:08.931 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.917+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.931 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.917+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=99,osdmap=1} crc {osd_snap=3209917163,osdmap=1283064123}) 2026-02-13T20:29:08.931 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.917+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=97,osdmap=3} crc {osd_snap=2904371330,osdmap=3862764920}) 2026-02-13T20:29:08.931 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.917+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.931 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.917+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2371190227}) 2026-02-13T20:29:08.931 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.917+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2293525805}) 2026-02-13T20:29:08.931 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.917+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.931 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.917+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2371190227}) 2026-02-13T20:29:08.931 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.917+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1042335259}) 2026-02-13T20:29:08.931 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.918+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.932 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.918+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=8747132}) 2026-02-13T20:29:08.932 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.918+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=918356880}) 2026-02-13T20:29:08.932 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.918+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.932 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.918+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=8747132}) 2026-02-13T20:29:08.932 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.918+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3582300418}) 2026-02-13T20:29:08.932 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.918+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.932 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.918+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2902585517}) 2026-02-13T20:29:08.932 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.918+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=919174740}) 2026-02-13T20:29:08.932 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.918+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.932 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.918+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2902585517}) 2026-02-13T20:29:08.932 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.918+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3260795042}) 2026-02-13T20:29:08.932 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.918+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.932 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.918+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1994839266}) 2026-02-13T20:29:08.932 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.918+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3165450248}) 2026-02-13T20:29:08.932 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.918+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.932 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.918+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1994839266}) 2026-02-13T20:29:08.932 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.918+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2240445637}) 2026-02-13T20:29:08.932 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.919+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.932 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.919+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2215003566}) 2026-02-13T20:29:08.932 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.919+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2141225183}) 2026-02-13T20:29:08.932 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.919+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.933 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.919+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2215003566}) 2026-02-13T20:29:08.933 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.919+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3526944067}) 2026-02-13T20:29:08.933 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.919+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.933 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.919+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=4108713135}) 2026-02-13T20:29:08.933 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.919+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1818505303}) 2026-02-13T20:29:08.933 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.919+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.933 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.919+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=4108713135}) 2026-02-13T20:29:08.933 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.919+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3036846830}) 2026-02-13T20:29:08.933 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.920+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.933 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.920+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3481486675}) 2026-02-13T20:29:08.933 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.920+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2484062561}) 2026-02-13T20:29:08.933 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.920+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.933 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.920+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3481486675}) 2026-02-13T20:29:08.933 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.920+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1047772400}) 2026-02-13T20:29:08.933 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.920+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.933 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.920+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1213190312}) 2026-02-13T20:29:08.933 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.920+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3307376307}) 2026-02-13T20:29:08.933 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.920+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.933 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.920+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1213190312}) 2026-02-13T20:29:08.933 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.920+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1784949227}) 2026-02-13T20:29:08.933 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.921+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.934 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.921+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=97690314}) 2026-02-13T20:29:08.934 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.921+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3515364900}) 2026-02-13T20:29:08.934 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.921+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.934 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.921+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=97690314}) 2026-02-13T20:29:08.934 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.921+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1422976124}) 2026-02-13T20:29:08.934 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.922+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.934 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.922+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3851856417}) 2026-02-13T20:29:08.934 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.922+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1315413203}) 2026-02-13T20:29:08.934 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.922+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.934 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.922+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3851856417}) 2026-02-13T20:29:08.934 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.922+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1436654274}) 2026-02-13T20:29:08.934 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.922+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.934 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.922+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1935074853}) 2026-02-13T20:29:08.934 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.922+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=604127321}) 2026-02-13T20:29:08.934 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.922+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.934 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.922+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1935074853}) 2026-02-13T20:29:08.934 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.922+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=829755444}) 2026-02-13T20:29:08.934 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.923+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.934 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.923+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3337771182}) 2026-02-13T20:29:08.934 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.923+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4281307226}) 2026-02-13T20:29:08.934 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.923+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.934 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.923+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3337771182}) 2026-02-13T20:29:08.934 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.923+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1315212203}) 2026-02-13T20:29:08.935 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.926+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.935 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.926+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=27} crc {osdmap=3225590408}) 2026-02-13T20:29:08.935 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.926+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=24} crc {osdmap=3110744831}) 2026-02-13T20:29:08.935 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.926+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T20:29:08.935 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.926+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=27} crc {osdmap=3225590408}) 2026-02-13T20:29:08.935 INFO:tasks.ceph.mon.c.trial110.stderr:2026-02-13T20:29:08.926+0000 7f75d89f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=25} crc {osdmap=2781313716}) 2026-02-13T20:29:09.918 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-13T20:29:09.918 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T20:29:09.985 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.984+0000 7f4a9da12640 10 monclient: get_monmap_and_config 2026-02-13T20:29:09.985 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.984+0000 7f4a9da12640 10 monclient: build_initial_monmap 2026-02-13T20:29:09.985 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.984+0000 7f4a9da12640 10 monclient: monmap: 2026-02-13T20:29:09.985 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:29:09.985 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:09.985 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:29:09.985626+0000 2026-02-13T20:29:09.985 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:29:09.985626+0000 2026-02-13T20:29:09.985 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:29:09.985 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:09.985 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:29:09.985 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:29:09.985 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:29:09.985 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:09.985 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.984+0000 7f4a9da12640 1 Processor -- start 2026-02-13T20:29:09.986 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.984+0000 7f4a9da12640 1 -- start start 2026-02-13T20:29:09.986 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.984+0000 7f4a9da12640 10 monclient: init 2026-02-13T20:29:09.986 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.984+0000 7f4a9da12640 10 monclient: _reopen_session rank -1 2026-02-13T20:29:09.986 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.984+0000 7f4a9da12640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:29:09.986 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.984+0000 7f4a9da12640 10 monclient(hunting): picked mon.noname-b con 0x7f4a981401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:29:09.986 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.984+0000 7f4a9da12640 10 monclient(hunting): picked mon.noname-a con 0x7f4a98092020 addr v1:10.20.193.110:6789/0 2026-02-13T20:29:09.986 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.984+0000 7f4a9da12640 10 monclient(hunting): picked mon.noname-c con 0x7f4a98091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:29:09.986 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.984+0000 7f4a9da12640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a9808b730 con 0x7f4a98092020 2026-02-13T20:29:09.986 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.984+0000 7f4a9da12640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a9805c5b0 con 0x7f4a98091950 2026-02-13T20:29:09.986 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.984+0000 7f4a9da12640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a9808bcf0 con 0x7f4a981401c0 2026-02-13T20:29:09.986 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.984+0000 7f4a9da12640 10 monclient(hunting): _renew_subs 2026-02-13T20:29:09.986 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.984+0000 7f4a9da12640 10 monclient(hunting): authenticate will time out at 1711.675937s 2026-02-13T20:29:09.986 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.985+0000 7f4a96ffd640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f4a981401c0 0x7f4a98091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:55242/0 (socket says 10.20.193.110:55242) 2026-02-13T20:29:09.986 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.985+0000 7f4a96ffd640 1 -- 10.20.193.110:0/804543502 learned_addr learned my addr 10.20.193.110:0/804543502 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:29:09.987 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.985+0000 7f4a95ffb640 1 -- 10.20.193.110:0/804543502 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2998061004 0 0) 0x7f4a9808bcf0 con 0x7f4a981401c0 2026-02-13T20:29:09.987 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.985+0000 7f4a95ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:29:09.987 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.985+0000 7f4a95ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:09.987 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.985+0000 7f4a95ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:09.987 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.985+0000 7f4a95ffb640 10 monclient(hunting): my global_id is 154256 2026-02-13T20:29:09.987 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.985+0000 7f4a95ffb640 1 -- 10.20.193.110:0/804543502 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a840035e0 con 0x7f4a981401c0 2026-02-13T20:29:09.987 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.985+0000 7f4a95ffb640 1 -- 10.20.193.110:0/804543502 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 334251689 0 0) 0x7f4a9808b730 con 0x7f4a98092020 2026-02-13T20:29:09.987 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.985+0000 7f4a95ffb640 10 monclient(hunting): _negotiate 2026-02-13T20:29:09.987 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.985+0000 7f4a95ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:09.987 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.985+0000 7f4a95ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:09.987 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.985+0000 7f4a95ffb640 10 monclient(hunting): my global_id is 124539 2026-02-13T20:29:09.987 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.985+0000 7f4a95ffb640 1 -- 10.20.193.110:0/804543502 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a9808bcf0 con 0x7f4a98092020 2026-02-13T20:29:09.987 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.985+0000 7f4a95ffb640 1 -- 10.20.193.110:0/804543502 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4279584831 0 0) 0x7f4a840035e0 con 0x7f4a981401c0 2026-02-13T20:29:09.987 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.985+0000 7f4a95ffb640 1 -- 10.20.193.110:0/804543502 >> v1:10.20.193.188:6789/0 conn(0x7f4a98091950 legacy=0x7f4a981a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:09.987 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.985+0000 7f4a95ffb640 1 -- 10.20.193.110:0/804543502 >> v1:10.20.193.110:6789/0 conn(0x7f4a98092020 legacy=0x7f4a981812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:09.987 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.985+0000 7f4a95ffb640 10 monclient: _finish_hunting 0 2026-02-13T20:29:09.987 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.985+0000 7f4a95ffb640 1 monclient: found mon.noname-b 2026-02-13T20:29:09.987 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.985+0000 7f4a95ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:29:09.987 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.985+0000 7f4a95ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:29:09.987 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.985+0000 7f4a95ffb640 1 -- 10.20.193.110:0/804543502 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a98140590 con 0x7f4a981401c0 2026-02-13T20:29:09.987 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.985+0000 7f4a95ffb640 10 monclient: _finish_auth 0 2026-02-13T20:29:09.987 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.985+0000 7f4a95ffb640 10 monclient: _check_auth_tickets 2026-02-13T20:29:09.987 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.985+0000 7f4a95ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:29:09.987 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.985+0000 7f4a95ffb640 1 -- 10.20.193.110:0/804543502 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f4a8c002dd0 con 0x7f4a981401c0 2026-02-13T20:29:09.987 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.985+0000 7f4a9da12640 5 monclient: authenticate success, global_id 154256 2026-02-13T20:29:09.987 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.985+0000 7f4a9da12640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:29:09.987 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.985+0000 7f4a95ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:09.987 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.985+0000 7f4a95ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:29:09.987 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.985+0000 7f4a95ffb640 10 monclient: dump: 2026-02-13T20:29:09.987 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:09.987 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:09.987 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:09.987 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:09.987 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:09.987 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:09.987 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:09.987 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:09.987 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:09.987 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:09.988 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.985+0000 7f4a9da12640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:29:09.988 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.985+0000 7f4a95ffb640 1 -- 10.20.193.110:0/804543502 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4a8c003020 con 0x7f4a981401c0 2026-02-13T20:29:09.988 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.985+0000 7f4a95ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T20:29:09.988 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.985+0000 7f4a9da12640 10 monclient: get_monmap_and_config success 2026-02-13T20:29:09.988 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.985+0000 7f4a9da12640 4 set_mon_vals no callback set 2026-02-13T20:29:09.988 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.985+0000 7f4a95ffb640 1 -- 10.20.193.110:0/804543502 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f4a8c003430 con 0x7f4a981401c0 2026-02-13T20:29:09.988 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.985+0000 7f4a95ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:09.988 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.985+0000 7f4a95ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:29:09.988 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.985+0000 7f4a95ffb640 10 monclient: dump: 2026-02-13T20:29:09.988 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:09.988 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:09.988 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:09.988 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:09.988 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:09.988 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:09.988 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:09.988 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:09.988 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:09.988 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:09.988 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.985+0000 7f4a9da12640 10 monclient: shutdown 2026-02-13T20:29:09.988 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.985+0000 7f4a9da12640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:29:09.988 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.985+0000 7f4a9da12640 1 -- 10.20.193.110:0/804543502 >> v1:10.20.193.110:6790/0 conn(0x7f4a981401c0 legacy=0x7f4a98091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:09.988 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.985+0000 7f4a9da12640 1 -- 10.20.193.110:0/804543502 shutdown_connections 2026-02-13T20:29:09.988 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.985+0000 7f4a9da12640 1 -- 10.20.193.110:0/804543502 >> 10.20.193.110:0/804543502 conn(0x7f4a98054e90 msgr2=0x7f4a98058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:29:09.988 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.985+0000 7f4a9da12640 1 -- 10.20.193.110:0/804543502 shutdown_connections 2026-02-13T20:29:09.988 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.985+0000 7f4a9da12640 1 -- 10.20.193.110:0/804543502 wait complete. 2026-02-13T20:29:09.988 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.986+0000 7f4a9da12640 10 monclient: build_initial_monmap 2026-02-13T20:29:09.988 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.986+0000 7f4a9da12640 10 monclient: monmap: 2026-02-13T20:29:09.988 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:29:09.988 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:29:09.988 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:29:09.988 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:29:09.988 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:29:09.988 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:29:09.988 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:29:09.988 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:29:09.988 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:29:09.988 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:09.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.986+0000 7f4a9da12640 1 Processor -- start 2026-02-13T20:29:09.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.986+0000 7f4a9da12640 1 -- start start 2026-02-13T20:29:09.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.986+0000 7f4a9da12640 10 monclient: init 2026-02-13T20:29:09.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.986+0000 7f4a9da12640 10 monclient: _reopen_session rank -1 2026-02-13T20:29:09.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.986+0000 7f4a9da12640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:29:09.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.986+0000 7f4a9da12640 10 monclient(hunting): picked mon.noname-c con 0x7f4a98091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:29:09.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.986+0000 7f4a9da12640 10 monclient(hunting): picked mon.noname-a con 0x7f4a981401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:29:09.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.986+0000 7f4a9da12640 10 monclient(hunting): picked mon.noname-b con 0x7f4a98089eb0 addr v1:10.20.193.188:6789/0 2026-02-13T20:29:09.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.986+0000 7f4a9da12640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a98130e70 con 0x7f4a981401c0 2026-02-13T20:29:09.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.986+0000 7f4a9da12640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a98090fc0 con 0x7f4a98089eb0 2026-02-13T20:29:09.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.986+0000 7f4a9da12640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a98132390 con 0x7f4a98091950 2026-02-13T20:29:09.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.986+0000 7f4a9da12640 10 monclient(hunting): _renew_subs 2026-02-13T20:29:09.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.986+0000 7f4a9da12640 10 monclient(hunting): authenticate will time out at 1711.677592s 2026-02-13T20:29:09.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.986+0000 7f4a96ffd640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f4a98091950 0x7f4a98089090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:55248/0 (socket says 10.20.193.110:55248) 2026-02-13T20:29:09.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.986+0000 7f4a967fc640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f4a981401c0 0x7f4a980897a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:58928/0 (socket says 10.20.193.110:58928) 2026-02-13T20:29:09.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.986+0000 7f4a96ffd640 1 -- 10.20.193.110:0/2680451436 learned_addr learned my addr 10.20.193.110:0/2680451436 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:29:09.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.986+0000 7f4a6ffff640 1 -- 10.20.193.110:0/2680451436 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2431028316 0 0) 0x7f4a98132390 con 0x7f4a98091950 2026-02-13T20:29:09.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.986+0000 7f4a6ffff640 10 monclient(hunting): _negotiate 2026-02-13T20:29:09.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.986+0000 7f4a6ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:09.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.986+0000 7f4a6ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:09.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.986+0000 7f4a6ffff640 10 monclient(hunting): my global_id is 154259 2026-02-13T20:29:09.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.986+0000 7f4a6ffff640 1 -- 10.20.193.110:0/2680451436 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a680035e0 con 0x7f4a98091950 2026-02-13T20:29:09.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.986+0000 7f4a6ffff640 1 -- 10.20.193.110:0/2680451436 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1792466652 0 0) 0x7f4a98130e70 con 0x7f4a981401c0 2026-02-13T20:29:09.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.986+0000 7f4a6ffff640 10 monclient(hunting): _negotiate 2026-02-13T20:29:09.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.986+0000 7f4a6ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:09.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.986+0000 7f4a6ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:09.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.986+0000 7f4a6ffff640 10 monclient(hunting): my global_id is 124542 2026-02-13T20:29:09.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.986+0000 7f4a6ffff640 1 -- 10.20.193.110:0/2680451436 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a98132390 con 0x7f4a981401c0 2026-02-13T20:29:09.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.986+0000 7f4a6ffff640 1 -- 10.20.193.110:0/2680451436 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 586702946 0 0) 0x7f4a680035e0 con 0x7f4a98091950 2026-02-13T20:29:09.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.986+0000 7f4a6ffff640 1 -- 10.20.193.110:0/2680451436 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4a98130e70 con 0x7f4a98091950 2026-02-13T20:29:09.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.987+0000 7f4a6ffff640 1 -- 10.20.193.110:0/2680451436 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f4a8c003340 con 0x7f4a98091950 2026-02-13T20:29:09.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.987+0000 7f4a6ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:29:09.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.987+0000 7f4a6ffff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:29:09.990 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.987+0000 7f4a6ffff640 10 monclient(hunting): dump: 2026-02-13T20:29:09.990 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:09.990 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:09.990 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:09.990 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:09.991 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:09.991 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:09.991 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:09.991 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:09.991 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:09.991 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:09.991 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.987+0000 7f4a6ffff640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:29:09.991 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.987+0000 7f4a6ffff640 1 -- 10.20.193.110:0/2680451436 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 25823759 0 0) 0x7f4a98132390 con 0x7f4a981401c0 2026-02-13T20:29:09.991 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.987+0000 7f4a6ffff640 1 -- 10.20.193.110:0/2680451436 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4a680035e0 con 0x7f4a981401c0 2026-02-13T20:29:09.991 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.987+0000 7f4a6ffff640 1 -- 10.20.193.110:0/2680451436 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f4a80003090 con 0x7f4a981401c0 2026-02-13T20:29:09.991 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.987+0000 7f4a6ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:29:09.991 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.987+0000 7f4a6ffff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:29:09.991 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.987+0000 7f4a6ffff640 10 monclient(hunting): dump: 2026-02-13T20:29:09.991 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:09.991 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:09.991 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:09.991 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:09.991 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:09.991 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:09.991 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:09.991 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:09.991 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:09.991 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:09.991 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.987+0000 7f4a6ffff640 1 -- 10.20.193.110:0/2680451436 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3140906005 0 0) 0x7f4a98130e70 con 0x7f4a98091950 2026-02-13T20:29:09.991 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.987+0000 7f4a6ffff640 1 -- 10.20.193.110:0/2680451436 >> v1:10.20.193.188:6789/0 conn(0x7f4a98089eb0 legacy=0x7f4a98195170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:09.991 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.987+0000 7f4a6ffff640 1 -- 10.20.193.110:0/2680451436 >> v1:10.20.193.110:6789/0 conn(0x7f4a981401c0 legacy=0x7f4a980897a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:09.991 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.987+0000 7f4a6ffff640 10 monclient: _finish_hunting 0 2026-02-13T20:29:09.991 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.987+0000 7f4a6ffff640 1 monclient: found mon.c 2026-02-13T20:29:09.991 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.987+0000 7f4a6ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:29:09.991 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.987+0000 7f4a6ffff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:09.991 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.987+0000 7f4a6ffff640 1 -- 10.20.193.110:0/2680451436 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a98132670 con 0x7f4a98091950 2026-02-13T20:29:09.991 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.987+0000 7f4a6ffff640 10 monclient: _finish_auth 0 2026-02-13T20:29:09.991 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.987+0000 7f4a6ffff640 10 monclient: _check_auth_tickets 2026-02-13T20:29:09.991 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.987+0000 7f4a6ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:29:09.991 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.987+0000 7f4a9da12640 5 monclient: authenticate success, global_id 154259 2026-02-13T20:29:09.991 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.987+0000 7f4a9da12640 10 monclient: _renew_subs 2026-02-13T20:29:09.991 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.987+0000 7f4a9da12640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:09.991 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.987+0000 7f4a9da12640 1 -- 10.20.193.110:0/2680451436 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4a9808c410 con 0x7f4a98091950 2026-02-13T20:29:09.991 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.987+0000 7f4a9da12640 10 monclient: _renew_subs 2026-02-13T20:29:09.991 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.987+0000 7f4a9da12640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:09.991 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.987+0000 7f4a9da12640 1 -- 10.20.193.110:0/2680451436 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f4a981320b0 con 0x7f4a98091950 2026-02-13T20:29:09.991 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.987+0000 7f4a6ffff640 1 -- 10.20.193.110:0/2680451436 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4a8c004cb0 con 0x7f4a98091950 2026-02-13T20:29:09.991 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.987+0000 7f4a6ffff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:29:09.991 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.987+0000 7f4a6ffff640 1 -- 10.20.193.110:0/2680451436 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f4a8c004fd0 con 0x7f4a98091950 2026-02-13T20:29:09.992 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.987+0000 7f4a6ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:09.992 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.987+0000 7f4a6ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:29:09.992 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.987+0000 7f4a6ffff640 10 monclient: dump: 2026-02-13T20:29:09.992 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:09.992 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:09.992 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:09.992 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:09.992 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:09.992 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:09.992 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:09.992 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:09.992 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:09.992 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:09.992 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.987+0000 7f4a957fa640 4 set_mon_vals no callback set 2026-02-13T20:29:09.992 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.987+0000 7f4a9da12640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:09.992 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.987+0000 7f4a9da12640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:09.992 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.987+0000 7f4a9da12640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:09.992 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.987+0000 7f4a9da12640 1 -- 10.20.193.110:0/2680451436 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a9808d070 con 0x7f4a98091950 2026-02-13T20:29:09.992 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.987+0000 7f4a6ffff640 1 -- 10.20.193.110:0/2680451436 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f4a8c011c40 con 0x7f4a98091950 2026-02-13T20:29:09.992 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.987+0000 7f4a6ffff640 1 -- 10.20.193.110:0/2680451436 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(847..847 src has 1..847) ==== 3591+0+0 (unknown 4078645555 0 0) 0x7f4a8c04e940 con 0x7f4a98091950 2026-02-13T20:29:09.992 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.988+0000 7f4a967fc640 10 monclient: get_auth_request con 0x7f4a6803fa50 auth_method 0 2026-02-13T20:29:09.992 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.990+0000 7f4a6ffff640 1 -- 10.20.193.110:0/2680451436 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f4a8c017290 con 0x7f4a98091950 2026-02-13T20:29:09.992 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.990+0000 7f4a6ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:09.992 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:09.990+0000 7f4a6ffff640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:29:10.136 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.135+0000 7f4a9da12640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T20:29:10.136 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.135+0000 7f4a9da12640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T20:29:10.136 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.135+0000 7f4a9da12640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:10.136 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.135+0000 7f4a9da12640 1 -- 10.20.193.110:0/2680451436 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f4a98130bc0 con 0x7f4a98091950 2026-02-13T20:29:10.136 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.135+0000 7f4a6ffff640 1 -- 10.20.193.110:0/2680451436 <== mon.2 v1:10.20.193.110:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1610 (unknown 254746657 0 4131862488) 0x7f4a8c016a40 con 0x7f4a98091950 2026-02-13T20:29:10.136 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.135+0000 7f4a6ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T20:29:10.136 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.135+0000 7f4a6ffff640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:29:10.136 INFO:teuthology.orchestra.run.trial110.stdout:{"election_epoch":64,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"c","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","modified":"2026-02-13T20:11:07.161192Z","created":"2026-02-13T20:11:07.161192Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6789","nonce":0}]},"addr":"10.20.193.110:6789/0","public_addr":"10.20.193.110:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161241+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6789","nonce":0}]},"addr":"10.20.193.188:6789/0","public_addr":"10.20.193.188:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161242+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6790","nonce":0}]},"addr":"10.20.193.110:6790/0","public_addr":"10.20.193.110:6790/0","priority":0,"weight":0,"time_added":"2026-02-13T20:11:07:161243+0000","crush_location":[]}]}} 2026-02-13T20:29:10.137 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.136+0000 7f4a9da12640 1 -- 10.20.193.110:0/2680451436 >> v1:10.20.193.188:6812/1623052694 conn(0x7f4a6803fa50 legacy=0x7f4a6805ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:10.137 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.136+0000 7f4a9da12640 10 monclient: shutdown 2026-02-13T20:29:10.137 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.136+0000 7f4a9da12640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:29:10.138 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.136+0000 7f4a9da12640 1 -- 10.20.193.110:0/2680451436 >> v1:10.20.193.110:6790/0 conn(0x7f4a98091950 legacy=0x7f4a98089090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:10.138 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.136+0000 7f4a9da12640 1 -- 10.20.193.110:0/2680451436 shutdown_connections 2026-02-13T20:29:10.138 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.136+0000 7f4a9da12640 1 -- 10.20.193.110:0/2680451436 >> 10.20.193.110:0/2680451436 conn(0x7f4a98054e90 msgr2=0x7f4a9808dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:29:10.138 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.136+0000 7f4a9da12640 1 -- 10.20.193.110:0/2680451436 shutdown_connections 2026-02-13T20:29:10.138 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.136+0000 7f4a9da12640 1 -- 10.20.193.110:0/2680451436 wait complete. 2026-02-13T20:29:10.145 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-13T20:29:10.145 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-13T20:29:10.158 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-13T20:29:10.159 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-13T20:29:10.223 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.222+0000 7f4ef9e8c640 10 monclient: get_monmap_and_config 2026-02-13T20:29:10.223 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.222+0000 7f4ef9e8c640 10 monclient: build_initial_monmap 2026-02-13T20:29:10.223 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.222+0000 7f4ef9e8c640 10 monclient: monmap: 2026-02-13T20:29:10.223 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:29:10.223 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:10.223 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:29:10.223721+0000 2026-02-13T20:29:10.223 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:29:10.223721+0000 2026-02-13T20:29:10.223 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:29:10.223 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:10.223 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:29:10.223 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:29:10.223 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:29:10.223 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:10.224 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.222+0000 7f4ef9e8c640 1 Processor -- start 2026-02-13T20:29:10.224 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.222+0000 7f4ef9e8c640 1 -- start start 2026-02-13T20:29:10.224 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.222+0000 7f4ef9e8c640 10 monclient: init 2026-02-13T20:29:10.224 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.222+0000 7f4ef9e8c640 10 monclient: _reopen_session rank -1 2026-02-13T20:29:10.224 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.222+0000 7f4ef9e8c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:29:10.224 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.222+0000 7f4ef9e8c640 10 monclient(hunting): picked mon.noname-c con 0x7f4ef41401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:29:10.224 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.222+0000 7f4ef9e8c640 10 monclient(hunting): picked mon.noname-b con 0x7f4ef4092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:29:10.224 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef9e8c640 10 monclient(hunting): picked mon.noname-a con 0x7f4ef4091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:29:10.224 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef9e8c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ef408b730 con 0x7f4ef4091950 2026-02-13T20:29:10.224 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef9e8c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ef405c5b0 con 0x7f4ef41401c0 2026-02-13T20:29:10.224 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef9e8c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ef408bcf0 con 0x7f4ef4092020 2026-02-13T20:29:10.224 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef9e8c640 10 monclient(hunting): _renew_subs 2026-02-13T20:29:10.224 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef9e8c640 10 monclient(hunting): authenticate will time out at 1711.914037s 2026-02-13T20:29:10.224 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef2ffd640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f4ef4092020 0x7f4ef41812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:55254/0 (socket says 10.20.193.110:55254) 2026-02-13T20:29:10.224 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef2ffd640 1 -- 10.20.193.110:0/1084226462 learned_addr learned my addr 10.20.193.110:0/1084226462 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:29:10.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef27fc640 1 -- 10.20.193.110:0/1084226462 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1053046755 0 0) 0x7f4ef408b730 con 0x7f4ef4091950 2026-02-13T20:29:10.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef27fc640 10 monclient(hunting): _negotiate 2026-02-13T20:29:10.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef27fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:10.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:10.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef27fc640 10 monclient(hunting): my global_id is 124545 2026-02-13T20:29:10.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef27fc640 1 -- 10.20.193.110:0/1084226462 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ed80035e0 con 0x7f4ef4091950 2026-02-13T20:29:10.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef27fc640 1 -- 10.20.193.110:0/1084226462 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 840330502 0 0) 0x7f4ef408bcf0 con 0x7f4ef4092020 2026-02-13T20:29:10.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef27fc640 10 monclient(hunting): _negotiate 2026-02-13T20:29:10.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef27fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:10.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:10.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef27fc640 10 monclient(hunting): my global_id is 154262 2026-02-13T20:29:10.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef27fc640 1 -- 10.20.193.110:0/1084226462 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ef408b730 con 0x7f4ef4092020 2026-02-13T20:29:10.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef27fc640 1 -- 10.20.193.110:0/1084226462 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1142944401 0 0) 0x7f4ed80035e0 con 0x7f4ef4091950 2026-02-13T20:29:10.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef27fc640 1 -- 10.20.193.110:0/1084226462 >> v1:10.20.193.110:6790/0 conn(0x7f4ef4092020 legacy=0x7f4ef41812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:10.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef27fc640 1 -- 10.20.193.110:0/1084226462 >> v1:10.20.193.188:6789/0 conn(0x7f4ef41401c0 legacy=0x7f4ef4091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T20:29:10.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef27fc640 10 monclient: _finish_hunting 0 2026-02-13T20:29:10.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef27fc640 1 monclient: found mon.noname-a 2026-02-13T20:29:10.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:29:10.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef27fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:29:10.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef27fc640 1 -- 10.20.193.110:0/1084226462 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ef4140590 con 0x7f4ef4091950 2026-02-13T20:29:10.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef27fc640 10 monclient: _finish_auth 0 2026-02-13T20:29:10.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef27fc640 10 monclient: _check_auth_tickets 2026-02-13T20:29:10.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:29:10.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef27fc640 1 -- 10.20.193.110:0/1084226462 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f4ee8003eb0 con 0x7f4ef4091950 2026-02-13T20:29:10.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef9e8c640 5 monclient: authenticate success, global_id 124545 2026-02-13T20:29:10.225 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef9e8c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:29:10.226 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:10.226 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:29:10.226 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef27fc640 10 monclient: dump: 2026-02-13T20:29:10.226 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:10.226 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:10.226 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:10.226 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:10.226 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:10.226 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:10.226 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:10.226 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:10.226 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:10.226 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:10.226 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef9e8c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:29:10.226 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef27fc640 1 -- 10.20.193.110:0/1084226462 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4ee8004100 con 0x7f4ef4091950 2026-02-13T20:29:10.226 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef27fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:29:10.226 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef27fc640 1 -- 10.20.193.110:0/1084226462 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f4ee8004510 con 0x7f4ef4091950 2026-02-13T20:29:10.226 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef9e8c640 10 monclient: get_monmap_and_config success 2026-02-13T20:29:10.226 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef9e8c640 4 set_mon_vals no callback set 2026-02-13T20:29:10.226 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:10.226 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:29:10.226 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef27fc640 10 monclient: dump: 2026-02-13T20:29:10.226 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:10.226 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:10.226 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:10.226 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:10.226 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:10.226 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:10.226 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:10.226 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:10.226 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:10.226 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:10.226 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef9e8c640 10 monclient: shutdown 2026-02-13T20:29:10.226 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef9e8c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:29:10.226 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef9e8c640 1 -- 10.20.193.110:0/1084226462 >> v1:10.20.193.110:6789/0 conn(0x7f4ef4091950 legacy=0x7f4ef41a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:10.226 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef9e8c640 1 -- 10.20.193.110:0/1084226462 shutdown_connections 2026-02-13T20:29:10.226 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef9e8c640 1 -- 10.20.193.110:0/1084226462 >> 10.20.193.110:0/1084226462 conn(0x7f4ef4054e90 msgr2=0x7f4ef4058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:29:10.226 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef9e8c640 1 -- 10.20.193.110:0/1084226462 shutdown_connections 2026-02-13T20:29:10.226 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.223+0000 7f4ef9e8c640 1 -- 10.20.193.110:0/1084226462 wait complete. 2026-02-13T20:29:10.226 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.224+0000 7f4ef9e8c640 10 monclient: build_initial_monmap 2026-02-13T20:29:10.226 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.224+0000 7f4ef9e8c640 10 monclient: monmap: 2026-02-13T20:29:10.226 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:29:10.226 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:29:10.226 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:29:10.227 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:29:10.227 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:29:10.227 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:29:10.227 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:29:10.227 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:29:10.227 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:29:10.227 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:10.227 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.224+0000 7f4ef9e8c640 1 Processor -- start 2026-02-13T20:29:10.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.224+0000 7f4ef9e8c640 1 -- start start 2026-02-13T20:29:10.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.224+0000 7f4ef9e8c640 10 monclient: init 2026-02-13T20:29:10.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.224+0000 7f4ef9e8c640 10 monclient: _reopen_session rank -1 2026-02-13T20:29:10.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.224+0000 7f4ef9e8c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:29:10.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.224+0000 7f4ef9e8c640 10 monclient(hunting): picked mon.noname-b con 0x7f4ef4091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:29:10.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.224+0000 7f4ef9e8c640 10 monclient(hunting): picked mon.noname-a con 0x7f4ef41401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:29:10.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.224+0000 7f4ef9e8c640 10 monclient(hunting): picked mon.noname-c con 0x7f4ef413eae0 addr v1:10.20.193.110:6790/0 2026-02-13T20:29:10.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.224+0000 7f4ef9e8c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ef412fa90 con 0x7f4ef41401c0 2026-02-13T20:29:10.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.224+0000 7f4ef9e8c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ef413f440 con 0x7f4ef4091950 2026-02-13T20:29:10.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.224+0000 7f4ef9e8c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ef405d320 con 0x7f4ef413eae0 2026-02-13T20:29:10.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.224+0000 7f4ef9e8c640 10 monclient(hunting): _renew_subs 2026-02-13T20:29:10.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.224+0000 7f4ef9e8c640 10 monclient(hunting): authenticate will time out at 1711.915790s 2026-02-13T20:29:10.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.224+0000 7f4ef2ffd640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f4ef41401c0 0x7f4ef41937b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:58952/0 (socket says 10.20.193.110:58952) 2026-02-13T20:29:10.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.224+0000 7f4ef2ffd640 1 -- 10.20.193.110:0/2998500558 learned_addr learned my addr 10.20.193.110:0/2998500558 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:29:10.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.224+0000 7f4ecffff640 1 -- 10.20.193.110:0/2998500558 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 179859191 0 0) 0x7f4ef412fa90 con 0x7f4ef41401c0 2026-02-13T20:29:10.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.224+0000 7f4ecffff640 10 monclient(hunting): _negotiate 2026-02-13T20:29:10.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.224+0000 7f4ecffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:10.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.224+0000 7f4ecffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:10.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.224+0000 7f4ecffff640 10 monclient(hunting): my global_id is 124548 2026-02-13T20:29:10.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.225+0000 7f4ecffff640 1 -- 10.20.193.110:0/2998500558 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ec40035e0 con 0x7f4ef41401c0 2026-02-13T20:29:10.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.225+0000 7f4ecffff640 1 -- 10.20.193.110:0/2998500558 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2484033350 0 0) 0x7f4ef405d320 con 0x7f4ef413eae0 2026-02-13T20:29:10.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.225+0000 7f4ecffff640 10 monclient(hunting): _negotiate 2026-02-13T20:29:10.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.225+0000 7f4ecffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:10.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.225+0000 7f4ecffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:10.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.225+0000 7f4ecffff640 10 monclient(hunting): my global_id is 154265 2026-02-13T20:29:10.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.225+0000 7f4ecffff640 1 -- 10.20.193.110:0/2998500558 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ef412fa90 con 0x7f4ef413eae0 2026-02-13T20:29:10.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.225+0000 7f4ecffff640 1 -- 10.20.193.110:0/2998500558 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2518219759 0 0) 0x7f4ec40035e0 con 0x7f4ef41401c0 2026-02-13T20:29:10.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.225+0000 7f4ecffff640 1 -- 10.20.193.110:0/2998500558 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4ef405d320 con 0x7f4ef41401c0 2026-02-13T20:29:10.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.225+0000 7f4ecffff640 1 -- 10.20.193.110:0/2998500558 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f4ee4003210 con 0x7f4ef41401c0 2026-02-13T20:29:10.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.225+0000 7f4ecffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:29:10.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.225+0000 7f4ecffff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:29:10.228 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.225+0000 7f4ecffff640 10 monclient(hunting): dump: 2026-02-13T20:29:10.228 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:10.229 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:10.229 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:10.229 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:10.229 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:10.229 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:10.229 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:10.229 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:10.229 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:10.229 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:10.229 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.225+0000 7f4ecffff640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:29:10.229 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.225+0000 7f4ecffff640 1 -- 10.20.193.110:0/2998500558 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2697916428 0 0) 0x7f4ef412fa90 con 0x7f4ef413eae0 2026-02-13T20:29:10.229 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.225+0000 7f4ecffff640 1 -- 10.20.193.110:0/2998500558 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4ec40035e0 con 0x7f4ef413eae0 2026-02-13T20:29:10.229 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.225+0000 7f4ecffff640 1 -- 10.20.193.110:0/2998500558 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f4ee8004420 con 0x7f4ef413eae0 2026-02-13T20:29:10.229 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.225+0000 7f4ecffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:29:10.229 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.225+0000 7f4ecffff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:29:10.229 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.225+0000 7f4ecffff640 10 monclient(hunting): dump: 2026-02-13T20:29:10.229 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:10.229 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:10.229 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:10.229 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:10.229 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:10.229 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:10.229 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:10.229 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:10.229 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:10.229 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:10.229 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.225+0000 7f4ecffff640 1 -- 10.20.193.110:0/2998500558 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1662638620 0 0) 0x7f4ef405d320 con 0x7f4ef41401c0 2026-02-13T20:29:10.229 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.225+0000 7f4ecffff640 1 -- 10.20.193.110:0/2998500558 >> v1:10.20.193.110:6790/0 conn(0x7f4ef413eae0 legacy=0x7f4ef4194ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:10.229 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.225+0000 7f4ecffff640 1 -- 10.20.193.110:0/2998500558 >> v1:10.20.193.188:6789/0 conn(0x7f4ef4091950 legacy=0x7f4ef413e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:10.229 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.225+0000 7f4ecffff640 10 monclient: _finish_hunting 0 2026-02-13T20:29:10.229 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.225+0000 7f4ecffff640 1 monclient: found mon.a 2026-02-13T20:29:10.229 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.225+0000 7f4ecffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:29:10.229 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.225+0000 7f4ecffff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:29:10.229 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.225+0000 7f4ecffff640 1 -- 10.20.193.110:0/2998500558 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ef4131df0 con 0x7f4ef41401c0 2026-02-13T20:29:10.229 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.225+0000 7f4ecffff640 10 monclient: _finish_auth 0 2026-02-13T20:29:10.229 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.225+0000 7f4ecffff640 10 monclient: _check_auth_tickets 2026-02-13T20:29:10.229 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.225+0000 7f4ecffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:29:10.229 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.225+0000 7f4ef9e8c640 5 monclient: authenticate success, global_id 124548 2026-02-13T20:29:10.229 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.225+0000 7f4ef9e8c640 10 monclient: _renew_subs 2026-02-13T20:29:10.229 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.225+0000 7f4ef9e8c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:29:10.229 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.225+0000 7f4ef9e8c640 1 -- 10.20.193.110:0/2998500558 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4ef4131550 con 0x7f4ef41401c0 2026-02-13T20:29:10.229 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.225+0000 7f4ef9e8c640 10 monclient: _renew_subs 2026-02-13T20:29:10.229 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.225+0000 7f4ef9e8c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:29:10.229 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.225+0000 7f4ef9e8c640 1 -- 10.20.193.110:0/2998500558 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4ef4152680 con 0x7f4ef41401c0 2026-02-13T20:29:10.230 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.225+0000 7f4ecffff640 1 -- 10.20.193.110:0/2998500558 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4ee40026a0 con 0x7f4ef41401c0 2026-02-13T20:29:10.230 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.225+0000 7f4ecffff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:29:10.230 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.225+0000 7f4ecffff640 1 -- 10.20.193.110:0/2998500558 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f4ee4004ad0 con 0x7f4ef41401c0 2026-02-13T20:29:10.230 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.225+0000 7f4ecffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:10.230 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.225+0000 7f4ecffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:29:10.230 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.225+0000 7f4ecffff640 10 monclient: dump: 2026-02-13T20:29:10.230 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:10.230 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:10.230 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:10.230 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:10.230 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:10.230 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:10.230 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:10.230 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:10.230 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:10.230 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:10.230 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.225+0000 7f4ef1ffb640 4 set_mon_vals no callback set 2026-02-13T20:29:10.230 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.225+0000 7f4ef9e8c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:10.230 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.225+0000 7f4ef9e8c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:10.230 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.225+0000 7f4ef9e8c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:29:10.230 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.225+0000 7f4ef9e8c640 1 -- 10.20.193.110:0/2998500558 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ef4131890 con 0x7f4ef41401c0 2026-02-13T20:29:10.230 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.225+0000 7f4ecffff640 1 -- 10.20.193.110:0/2998500558 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f4ee4004c30 con 0x7f4ef41401c0 2026-02-13T20:29:10.230 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.226+0000 7f4ecffff640 1 -- 10.20.193.110:0/2998500558 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(847..847 src has 1..847) ==== 3591+0+0 (unknown 4078645555 0 0) 0x7f4ee404e7e0 con 0x7f4ef41401c0 2026-02-13T20:29:10.230 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.226+0000 7f4ef37fe640 10 monclient: get_auth_request con 0x7f4ec403fae0 auth_method 0 2026-02-13T20:29:10.230 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.228+0000 7f4ecffff640 1 -- 10.20.193.110:0/2998500558 <== mon.0 v1:10.20.193.110:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f4ef4131890 con 0x7f4ef41401c0 2026-02-13T20:29:10.230 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.228+0000 7f4ecffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:10.230 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.228+0000 7f4ecffff640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:29:10.332 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.331+0000 7f4ef9e8c640 1 -- 10.20.193.110:0/2998500558 --> v1:10.20.193.188:6812/1623052694 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4ef408b450 con 0x7f4ec403fae0 2026-02-13T20:29:10.333 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.333+0000 7f4ecffff640 1 -- 10.20.193.110:0/2998500558 <== mgr.4105 v1:10.20.193.188:6812/1623052694 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34048 (unknown 2965378022 0 372038984) 0x7f4ee0007ae0 con 0x7f4ec403fae0 2026-02-13T20:29:10.333 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:29:10.333 INFO:teuthology.orchestra.run.trial110.stderr:dumped all 2026-02-13T20:29:10.334 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.333+0000 7f4ef9e8c640 1 -- 10.20.193.110:0/2998500558 >> v1:10.20.193.188:6812/1623052694 conn(0x7f4ec403fae0 legacy=0x7f4ec405ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:10.334 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.333+0000 7f4ef9e8c640 10 monclient: shutdown 2026-02-13T20:29:10.334 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.333+0000 7f4ef9e8c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:29:10.334 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.333+0000 7f4ef9e8c640 1 -- 10.20.193.110:0/2998500558 >> v1:10.20.193.110:6789/0 conn(0x7f4ef41401c0 legacy=0x7f4ef41937b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:10.334 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.333+0000 7f4ef9e8c640 1 -- 10.20.193.110:0/2998500558 shutdown_connections 2026-02-13T20:29:10.334 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.333+0000 7f4ef9e8c640 1 -- 10.20.193.110:0/2998500558 >> 10.20.193.110:0/2998500558 conn(0x7f4ef4054e90 msgr2=0x7f4ef408a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:29:10.334 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.333+0000 7f4ef9e8c640 1 -- 10.20.193.110:0/2998500558 shutdown_connections 2026-02-13T20:29:10.334 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.333+0000 7f4ef9e8c640 1 -- 10.20.193.110:0/2998500558 wait complete. 2026-02-13T20:29:10.341 INFO:teuthology.orchestra.run.trial110.stdout:{"pg_ready":true,"pg_map":{"version":1373,"stamp":"2026-02-13T20:29:10.245970+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":238696,"kb_used_data":40840,"kb_used_omap":8891,"kb_used_meta":188868,"kb_avail":565992344,"statfs":{"total":579820584960,"available":579576160256,"internally_reserved":0,"allocated":41820160,"data_stored":23930254,"data_compressed":16424,"data_compressed_allocated":98304,"data_compressed_original":1179648,"omap_allocated":9104596,"internal_metadata":193401644},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.000971"},"pg_stats":[{"pgid":"1.0","version":"14'112","reported_seq":1794,"reported_epoch":847,"state":"active+clean","last_fresh":"2026-02-13T20:28:50.740927+0000","last_change":"2026-02-13T20:11:25.262882+0000","last_active":"2026-02-13T20:28:50.740927+0000","last_peered":"2026-02-13T20:28:50.740927+0000","last_clean":"2026-02-13T20:28:50.740927+0000","last_became_active":"2026-02-13T20:11:25.262766+0000","last_became_peered":"2026-02-13T20:11:25.262766+0000","last_unstale":"2026-02-13T20:28:50.740927+0000","last_undegraded":"2026-02-13T20:28:50.740927+0000","last_fullsized":"2026-02-13T20:28:50.740927+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:24.258524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:24.258524+0000","last_clean_scrub_stamp":"2026-02-13T20:11:24.258524+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T22:58:36.956434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":1657,"reported_epoch":847,"state":"active+clean","last_fresh":"2026-02-13T20:28:50.950103+0000","last_change":"2026-02-13T20:11:30.562730+0000","last_active":"2026-02-13T20:28:50.950103+0000","last_peered":"2026-02-13T20:28:50.950103+0000","last_clean":"2026-02-13T20:28:50.950103+0000","last_became_active":"2026-02-13T20:11:28.558943+0000","last_became_peered":"2026-02-13T20:11:28.558943+0000","last_unstale":"2026-02-13T20:28:50.950103+0000","last_undegraded":"2026-02-13T20:28:50.950103+0000","last_fullsized":"2026-02-13T20:28:50.950103+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T21:39:10.290168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032435800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1657,"reported_epoch":847,"state":"active+clean","last_fresh":"2026-02-13T20:28:50.740712+0000","last_change":"2026-02-13T20:11:30.561332+0000","last_active":"2026-02-13T20:28:50.740712+0000","last_peered":"2026-02-13T20:28:50.740712+0000","last_clean":"2026-02-13T20:28:50.740712+0000","last_became_active":"2026-02-13T20:11:28.559211+0000","last_became_peered":"2026-02-13T20:11:28.559211+0000","last_unstale":"2026-02-13T20:28:50.740712+0000","last_undegraded":"2026-02-13T20:28:50.740712+0000","last_fullsized":"2026-02-13T20:28:50.740712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T22:32:44.601301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029208800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1667,"reported_epoch":847,"state":"active+clean","last_fresh":"2026-02-13T20:28:50.952757+0000","last_change":"2026-02-13T20:11:30.823369+0000","last_active":"2026-02-13T20:28:50.952757+0000","last_peered":"2026-02-13T20:28:50.952757+0000","last_clean":"2026-02-13T20:28:50.952757+0000","last_became_active":"2026-02-13T20:11:28.559802+0000","last_became_peered":"2026-02-13T20:11:28.559802+0000","last_unstale":"2026-02-13T20:28:50.952757+0000","last_undegraded":"2026-02-13T20:28:50.952757+0000","last_fullsized":"2026-02-13T20:28:50.952757+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T05:27:34.220283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000230979,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":1658,"reported_epoch":847,"state":"active+clean","last_fresh":"2026-02-13T20:28:50.950215+0000","last_change":"2026-02-13T20:11:30.563087+0000","last_active":"2026-02-13T20:28:50.950215+0000","last_peered":"2026-02-13T20:28:50.950215+0000","last_clean":"2026-02-13T20:28:50.950215+0000","last_became_active":"2026-02-13T20:11:28.557848+0000","last_became_peered":"2026-02-13T20:11:28.557848+0000","last_unstale":"2026-02-13T20:28:50.950215+0000","last_undegraded":"2026-02-13T20:28:50.950215+0000","last_fullsized":"2026-02-13T20:28:50.950215+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T21:44:09.052237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064918699999999996,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1671,"reported_epoch":847,"state":"active+clean","last_fresh":"2026-02-13T20:28:50.953520+0000","last_change":"2026-02-13T20:11:30.561668+0000","last_active":"2026-02-13T20:28:50.953520+0000","last_peered":"2026-02-13T20:28:50.953520+0000","last_clean":"2026-02-13T20:28:50.953520+0000","last_became_active":"2026-02-13T20:11:28.558441+0000","last_became_peered":"2026-02-13T20:11:28.558441+0000","last_unstale":"2026-02-13T20:28:50.953520+0000","last_undegraded":"2026-02-13T20:28:50.953520+0000","last_fullsized":"2026-02-13T20:28:50.953520+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T22:32:58.917639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000231139,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1657,"reported_epoch":847,"state":"active+clean","last_fresh":"2026-02-13T20:28:50.740673+0000","last_change":"2026-02-13T20:11:30.561240+0000","last_active":"2026-02-13T20:28:50.740673+0000","last_peered":"2026-02-13T20:28:50.740673+0000","last_clean":"2026-02-13T20:28:50.740673+0000","last_became_active":"2026-02-13T20:11:28.559005+0000","last_became_peered":"2026-02-13T20:11:28.559005+0000","last_unstale":"2026-02-13T20:28:50.740673+0000","last_undegraded":"2026-02-13T20:28:50.740673+0000","last_fullsized":"2026-02-13T20:28:50.740673+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T02:48:59.423627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027156000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1671,"reported_epoch":847,"state":"active+clean","last_fresh":"2026-02-13T20:28:50.953498+0000","last_change":"2026-02-13T20:11:30.561637+0000","last_active":"2026-02-13T20:28:50.953498+0000","last_peered":"2026-02-13T20:28:50.953498+0000","last_clean":"2026-02-13T20:28:50.953498+0000","last_became_active":"2026-02-13T20:11:28.559585+0000","last_became_peered":"2026-02-13T20:11:28.559585+0000","last_unstale":"2026-02-13T20:28:50.953498+0000","last_undegraded":"2026-02-13T20:28:50.953498+0000","last_fullsized":"2026-02-13T20:28:50.953498+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T23:13:24.610860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00021035100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1657,"reported_epoch":847,"state":"active+clean","last_fresh":"2026-02-13T20:28:50.740649+0000","last_change":"2026-02-13T20:11:30.561334+0000","last_active":"2026-02-13T20:28:50.740649+0000","last_peered":"2026-02-13T20:28:50.740649+0000","last_clean":"2026-02-13T20:28:50.740649+0000","last_became_active":"2026-02-13T20:11:29.018116+0000","last_became_peered":"2026-02-13T20:11:29.018116+0000","last_unstale":"2026-02-13T20:28:50.740649+0000","last_undegraded":"2026-02-13T20:28:50.740649+0000","last_fullsized":"2026-02-13T20:28:50.740649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T03:21:19.857098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000335309,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1180736,"data_compressed":16424,"data_compressed_allocated":98304,"data_compressed_original":1179648,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640471,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33752,"kb_used_data":6792,"kb_used_omap":1355,"kb_used_meta":25588,"kb_avail":94338088,"statfs":{"total":96636764160,"available":96602202112,"internally_reserved":0,"allocated":6955008,"data_stored":3791599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1388487,"internal_metadata":26202169},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640472,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33748,"kb_used_data":6788,"kb_used_omap":1240,"kb_used_meta":25703,"kb_avail":94338092,"statfs":{"total":96636764160,"available":96602206208,"internally_reserved":0,"allocated":6950912,"data_stored":3791580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1270080,"internal_metadata":26320576},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640472,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33800,"kb_used_data":6840,"kb_used_omap":1132,"kb_used_meta":25811,"kb_avail":94338040,"statfs":{"total":96636764160,"available":96602152960,"internally_reserved":0,"allocated":7004160,"data_stored":4381948,"data_compressed":8212,"data_compressed_allocated":49152,"data_compressed_original":589824,"omap_allocated":1159884,"internal_metadata":26430772},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640472,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51796,"kb_used_data":6788,"kb_used_omap":2201,"kb_used_meta":42790,"kb_avail":94320044,"statfs":{"total":96636764160,"available":96583725056,"internally_reserved":0,"allocated":6950912,"data_stored":3791580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2254483,"internal_metadata":43817325},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640471,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51800,"kb_used_data":6792,"kb_used_omap":1806,"kb_used_meta":43185,"kb_avail":94320040,"statfs":{"total":96636764160,"available":96583720960,"internally_reserved":0,"allocated":6955008,"data_stored":3791599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1849790,"internal_metadata":44222018},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640472,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33800,"kb_used_data":6840,"kb_used_omap":1154,"kb_used_meta":25789,"kb_avail":94338040,"statfs":{"total":96636764160,"available":96602152960,"internally_reserved":0,"allocated":7004160,"data_stored":4381948,"data_compressed":8212,"data_compressed_allocated":49152,"data_compressed_original":589824,"omap_allocated":1181872,"internal_metadata":26408784},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":590368,"data_compressed":8212,"data_compressed_allocated":49152,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":590368,"data_compressed":8212,"data_compressed_allocated":49152,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T20:29:10.342 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-13T20:29:10.414 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.405+0000 7fa5c5a1b640 10 monclient: get_monmap_and_config 2026-02-13T20:29:10.414 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.405+0000 7fa5c5a1b640 10 monclient: build_initial_monmap 2026-02-13T20:29:10.414 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.405+0000 7fa5c5a1b640 10 monclient: monmap: 2026-02-13T20:29:10.414 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:29:10.414 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:10.414 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:29:10.406856+0000 2026-02-13T20:29:10.414 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:29:10.406856+0000 2026-02-13T20:29:10.414 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:29:10.414 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:10.414 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:29:10.414 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:29:10.414 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:29:10.414 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:10.414 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.405+0000 7fa5c5a1b640 1 Processor -- start 2026-02-13T20:29:10.414 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.405+0000 7fa5c5a1b640 1 -- start start 2026-02-13T20:29:10.414 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.405+0000 7fa5c5a1b640 10 monclient: init 2026-02-13T20:29:10.414 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5c5a1b640 10 monclient: _reopen_session rank -1 2026-02-13T20:29:10.414 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5c5a1b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:29:10.414 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5c5a1b640 10 monclient(hunting): picked mon.noname-a con 0x7fa5c01401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:29:10.414 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5c5a1b640 10 monclient(hunting): picked mon.noname-b con 0x7fa5c0092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:29:10.414 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5c5a1b640 10 monclient(hunting): picked mon.noname-c con 0x7fa5c0091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:29:10.414 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5c5a1b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5c008b730 con 0x7fa5c01401c0 2026-02-13T20:29:10.414 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5c5a1b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5c005c5b0 con 0x7fa5c0091950 2026-02-13T20:29:10.414 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5c5a1b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5c008bcf0 con 0x7fa5c0092020 2026-02-13T20:29:10.414 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5c5a1b640 10 monclient(hunting): _renew_subs 2026-02-13T20:29:10.414 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5c5a1b640 10 monclient(hunting): authenticate will time out at 1712.097164s 2026-02-13T20:29:10.414 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5beffd640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fa5c01401c0 0x7fa5c0091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:58954/0 (socket says 10.20.193.110:58954) 2026-02-13T20:29:10.414 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5beffd640 1 -- 10.20.193.110:0/87430801 learned_addr learned my addr 10.20.193.110:0/87430801 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:29:10.414 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5bdffb640 1 -- 10.20.193.110:0/87430801 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1022820259 0 0) 0x7fa5c008bcf0 con 0x7fa5c0092020 2026-02-13T20:29:10.414 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5bdffb640 10 monclient(hunting): _negotiate 2026-02-13T20:29:10.414 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5bdffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:10.414 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5bdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:10.414 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5bdffb640 10 monclient(hunting): my global_id is 154268 2026-02-13T20:29:10.414 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5bdffb640 1 -- 10.20.193.110:0/87430801 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5ac0035e0 con 0x7fa5c0092020 2026-02-13T20:29:10.415 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5bdffb640 1 -- 10.20.193.110:0/87430801 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3706560225 0 0) 0x7fa5c008b730 con 0x7fa5c01401c0 2026-02-13T20:29:10.415 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5bdffb640 10 monclient(hunting): _negotiate 2026-02-13T20:29:10.415 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5bdffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:10.415 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5bdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:10.415 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5bdffb640 10 monclient(hunting): my global_id is 124551 2026-02-13T20:29:10.415 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5bdffb640 1 -- 10.20.193.110:0/87430801 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5c008bcf0 con 0x7fa5c01401c0 2026-02-13T20:29:10.415 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5bdffb640 1 -- 10.20.193.110:0/87430801 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2558794057 0 0) 0x7fa5ac0035e0 con 0x7fa5c0092020 2026-02-13T20:29:10.415 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5bdffb640 1 -- 10.20.193.110:0/87430801 >> v1:10.20.193.188:6789/0 conn(0x7fa5c0091950 legacy=0x7fa5c01a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:10.415 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5bdffb640 1 -- 10.20.193.110:0/87430801 >> v1:10.20.193.110:6789/0 conn(0x7fa5c01401c0 legacy=0x7fa5c0091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:10.415 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5bdffb640 10 monclient: _finish_hunting 0 2026-02-13T20:29:10.415 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5bdffb640 1 monclient: found mon.noname-b 2026-02-13T20:29:10.415 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5bdffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:29:10.415 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5bdffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:29:10.415 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5bdffb640 1 -- 10.20.193.110:0/87430801 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5c0140590 con 0x7fa5c0092020 2026-02-13T20:29:10.415 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5bdffb640 10 monclient: _finish_auth 0 2026-02-13T20:29:10.415 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5bdffb640 10 monclient: _check_auth_tickets 2026-02-13T20:29:10.415 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5bdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:29:10.415 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5bdffb640 1 -- 10.20.193.110:0/87430801 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa5a8002dd0 con 0x7fa5c0092020 2026-02-13T20:29:10.415 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5bdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:10.415 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5bdffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:29:10.415 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5bdffb640 10 monclient: dump: 2026-02-13T20:29:10.415 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:10.415 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:10.415 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:10.415 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:10.415 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:10.415 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:10.415 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:10.415 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:10.415 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:10.415 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:10.415 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5c5a1b640 5 monclient: authenticate success, global_id 154268 2026-02-13T20:29:10.415 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5c5a1b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:29:10.415 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5bdffb640 1 -- 10.20.193.110:0/87430801 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa5a8003020 con 0x7fa5c0092020 2026-02-13T20:29:10.415 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5bdffb640 10 monclient: handle_config config(0 keys) 2026-02-13T20:29:10.415 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5c5a1b640 10 monclient: get_monmap_and_config success 2026-02-13T20:29:10.415 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5c5a1b640 4 set_mon_vals no callback set 2026-02-13T20:29:10.415 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5bdffb640 1 -- 10.20.193.110:0/87430801 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa5a8003430 con 0x7fa5c0092020 2026-02-13T20:29:10.415 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5bdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:10.415 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5bdffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:29:10.415 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5bdffb640 10 monclient: dump: 2026-02-13T20:29:10.415 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:10.416 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:10.416 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:10.416 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:10.416 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:10.416 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:10.416 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:10.416 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:10.416 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:10.416 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:10.416 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5c5a1b640 10 monclient: shutdown 2026-02-13T20:29:10.416 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5c5a1b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:29:10.416 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.406+0000 7fa5c5a1b640 1 -- 10.20.193.110:0/87430801 >> v1:10.20.193.110:6790/0 conn(0x7fa5c0092020 legacy=0x7fa5c01812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:10.416 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.407+0000 7fa5c5a1b640 1 -- 10.20.193.110:0/87430801 shutdown_connections 2026-02-13T20:29:10.416 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.407+0000 7fa5c5a1b640 1 -- 10.20.193.110:0/87430801 >> 10.20.193.110:0/87430801 conn(0x7fa5c0054e90 msgr2=0x7fa5c0058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:29:10.416 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.407+0000 7fa5c5a1b640 1 -- 10.20.193.110:0/87430801 shutdown_connections 2026-02-13T20:29:10.416 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.407+0000 7fa5c5a1b640 1 -- 10.20.193.110:0/87430801 wait complete. 2026-02-13T20:29:10.416 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.407+0000 7fa5c5a1b640 10 monclient: build_initial_monmap 2026-02-13T20:29:10.416 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.407+0000 7fa5c5a1b640 10 monclient: monmap: 2026-02-13T20:29:10.416 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:29:10.416 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:29:10.416 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:29:10.416 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:29:10.416 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:29:10.416 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:29:10.416 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:29:10.416 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:29:10.416 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:29:10.416 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:10.416 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.407+0000 7fa5c5a1b640 1 Processor -- start 2026-02-13T20:29:10.416 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.407+0000 7fa5c5a1b640 1 -- start start 2026-02-13T20:29:10.416 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.407+0000 7fa5c5a1b640 10 monclient: init 2026-02-13T20:29:10.416 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.407+0000 7fa5c5a1b640 10 monclient: _reopen_session rank -1 2026-02-13T20:29:10.416 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.407+0000 7fa5c5a1b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:29:10.416 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.407+0000 7fa5c5a1b640 10 monclient(hunting): picked mon.noname-b con 0x7fa5c0091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:29:10.416 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa5c5a1b640 10 monclient(hunting): picked mon.noname-c con 0x7fa5c01401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:29:10.416 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa5c5a1b640 10 monclient(hunting): picked mon.noname-a con 0x7fa5c0130860 addr v1:10.20.193.110:6789/0 2026-02-13T20:29:10.416 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa5c5a1b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5c008a360 con 0x7fa5c0130860 2026-02-13T20:29:10.416 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa5c5a1b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5c008c410 con 0x7fa5c0091950 2026-02-13T20:29:10.416 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa5c5a1b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5c0131870 con 0x7fa5c01401c0 2026-02-13T20:29:10.416 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa5c5a1b640 10 monclient(hunting): _renew_subs 2026-02-13T20:29:10.416 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa5c5a1b640 10 monclient(hunting): authenticate will time out at 1712.099042s 2026-02-13T20:29:10.416 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa5bf7fe640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fa5c0130860 0x7fa5c01952d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:58966/0 (socket says 10.20.193.110:58966) 2026-02-13T20:29:10.416 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa5bf7fe640 1 -- 10.20.193.110:0/2679992268 learned_addr learned my addr 10.20.193.110:0/2679992268 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:29:10.416 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa5be7fc640 1 --1- 10.20.193.110:0/2679992268 >> v1:10.20.193.110:6790/0 conn(0x7fa5c01401c0 0x7fa5c0193bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:55274/0 (socket says 10.20.193.110:55274) 2026-02-13T20:29:10.417 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa597fff640 1 -- 10.20.193.110:0/2679992268 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2448796425 0 0) 0x7fa5c0131870 con 0x7fa5c01401c0 2026-02-13T20:29:10.417 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa597fff640 10 monclient(hunting): _negotiate 2026-02-13T20:29:10.417 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa597fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:10.417 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa597fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:10.417 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa597fff640 10 monclient(hunting): my global_id is 154271 2026-02-13T20:29:10.417 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa597fff640 1 -- 10.20.193.110:0/2679992268 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5900035e0 con 0x7fa5c01401c0 2026-02-13T20:29:10.417 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa597fff640 1 -- 10.20.193.110:0/2679992268 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4011148580 0 0) 0x7fa5c005c5b0 con 0x7fa5c0130860 2026-02-13T20:29:10.417 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa597fff640 10 monclient(hunting): _negotiate 2026-02-13T20:29:10.417 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa597fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:10.417 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa597fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:10.417 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa597fff640 10 monclient(hunting): my global_id is 124554 2026-02-13T20:29:10.417 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa597fff640 1 -- 10.20.193.110:0/2679992268 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5c0131870 con 0x7fa5c0130860 2026-02-13T20:29:10.417 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa597fff640 1 -- 10.20.193.110:0/2679992268 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1049334284 0 0) 0x7fa5900035e0 con 0x7fa5c01401c0 2026-02-13T20:29:10.417 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa597fff640 1 -- 10.20.193.110:0/2679992268 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa5c005c5b0 con 0x7fa5c01401c0 2026-02-13T20:29:10.417 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa597fff640 1 -- 10.20.193.110:0/2679992268 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa5a8003360 con 0x7fa5c01401c0 2026-02-13T20:29:10.417 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa597fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:29:10.417 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa597fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:29:10.417 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa597fff640 10 monclient(hunting): dump: 2026-02-13T20:29:10.417 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:10.417 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:10.417 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:10.417 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:10.417 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:10.417 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:10.417 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:10.417 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:10.417 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:10.417 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:10.417 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa597fff640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:29:10.417 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa597fff640 1 -- 10.20.193.110:0/2679992268 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4134267361 0 0) 0x7fa5c0131870 con 0x7fa5c0130860 2026-02-13T20:29:10.417 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa597fff640 1 -- 10.20.193.110:0/2679992268 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa5900035e0 con 0x7fa5c0130860 2026-02-13T20:29:10.417 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa597fff640 1 -- 10.20.193.110:0/2679992268 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa5b00041d0 con 0x7fa5c0130860 2026-02-13T20:29:10.417 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa597fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:29:10.417 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa597fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:29:10.417 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa597fff640 10 monclient(hunting): dump: 2026-02-13T20:29:10.417 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:10.417 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:10.417 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:10.417 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:10.417 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:10.417 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:10.417 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:10.417 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:10.417 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:10.418 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:10.418 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa597fff640 1 -- 10.20.193.110:0/2679992268 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2285784621 0 0) 0x7fa5c005c5b0 con 0x7fa5c01401c0 2026-02-13T20:29:10.418 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa597fff640 1 -- 10.20.193.110:0/2679992268 >> v1:10.20.193.188:6789/0 conn(0x7fa5c0091950 legacy=0x7fa5c013e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:10.418 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa597fff640 1 -- 10.20.193.110:0/2679992268 >> v1:10.20.193.110:6789/0 conn(0x7fa5c0130860 legacy=0x7fa5c01952d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:10.418 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa597fff640 10 monclient: _finish_hunting 0 2026-02-13T20:29:10.418 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa597fff640 1 monclient: found mon.c 2026-02-13T20:29:10.418 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa597fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:29:10.418 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa597fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:10.418 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa597fff640 1 -- 10.20.193.110:0/2679992268 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5c013ed50 con 0x7fa5c01401c0 2026-02-13T20:29:10.418 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa597fff640 10 monclient: _finish_auth 0 2026-02-13T20:29:10.418 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa597fff640 10 monclient: _check_auth_tickets 2026-02-13T20:29:10.418 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa597fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:29:10.418 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa5c5a1b640 5 monclient: authenticate success, global_id 154271 2026-02-13T20:29:10.418 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa5c5a1b640 10 monclient: _renew_subs 2026-02-13T20:29:10.418 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa5c5a1b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:10.418 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa5c5a1b640 1 -- 10.20.193.110:0/2679992268 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa5c005d320 con 0x7fa5c01401c0 2026-02-13T20:29:10.418 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa5c5a1b640 10 monclient: _renew_subs 2026-02-13T20:29:10.418 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa5c5a1b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:10.418 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa5c5a1b640 1 -- 10.20.193.110:0/2679992268 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fa5c0130ca0 con 0x7fa5c01401c0 2026-02-13T20:29:10.418 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa597fff640 1 -- 10.20.193.110:0/2679992268 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa5a8003530 con 0x7fa5c01401c0 2026-02-13T20:29:10.418 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa597fff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:29:10.418 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa597fff640 1 -- 10.20.193.110:0/2679992268 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa5a8003ae0 con 0x7fa5c01401c0 2026-02-13T20:29:10.418 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa597fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:10.418 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa597fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:29:10.418 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa597fff640 10 monclient: dump: 2026-02-13T20:29:10.418 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:10.418 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:10.418 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:10.418 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:10.418 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:10.418 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:10.418 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:10.418 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:10.418 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:10.418 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:10.418 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.408+0000 7fa5bd7fa640 4 set_mon_vals no callback set 2026-02-13T20:29:10.418 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.409+0000 7fa5c5a1b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:10.418 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.409+0000 7fa5c5a1b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:10.418 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.409+0000 7fa5c5a1b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:10.418 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.409+0000 7fa5c5a1b640 1 -- 10.20.193.110:0/2679992268 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5c00008d0 con 0x7fa5c01401c0 2026-02-13T20:29:10.418 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.409+0000 7fa597fff640 1 -- 10.20.193.110:0/2679992268 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fa5a8003c40 con 0x7fa5c01401c0 2026-02-13T20:29:10.418 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.409+0000 7fa597fff640 1 -- 10.20.193.110:0/2679992268 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(847..847 src has 1..847) ==== 3591+0+0 (unknown 4078645555 0 0) 0x7fa5a804e840 con 0x7fa5c01401c0 2026-02-13T20:29:10.418 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.409+0000 7fa5beffd640 10 monclient: get_auth_request con 0x7fa59003fae0 auth_method 0 2026-02-13T20:29:10.418 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.411+0000 7fa597fff640 1 -- 10.20.193.110:0/2679992268 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fa5a80171f0 con 0x7fa5c01401c0 2026-02-13T20:29:10.419 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.411+0000 7fa597fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:10.419 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.411+0000 7fa597fff640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:29:10.514 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.513+0000 7fa5c5a1b640 1 -- 10.20.193.110:0/2679992268 --> v1:10.20.193.188:6812/1623052694 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa5c008b450 con 0x7fa59003fae0 2026-02-13T20:29:10.514 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.513+0000 7fa597fff640 1 -- 10.20.193.110:0/2679992268 <== mgr.4105 v1:10.20.193.188:6812/1623052694 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34048 (unknown 2965378022 0 372038984) 0x7fa5b40079b0 con 0x7fa59003fae0 2026-02-13T20:29:10.514 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:29:10.515 INFO:teuthology.orchestra.run.trial110.stderr:dumped all 2026-02-13T20:29:10.515 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.514+0000 7fa5c5a1b640 1 -- 10.20.193.110:0/2679992268 >> v1:10.20.193.188:6812/1623052694 conn(0x7fa59003fae0 legacy=0x7fa59005ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:10.515 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.514+0000 7fa5c5a1b640 10 monclient: shutdown 2026-02-13T20:29:10.515 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.514+0000 7fa5c5a1b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:29:10.515 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.514+0000 7fa5c5a1b640 1 -- 10.20.193.110:0/2679992268 >> v1:10.20.193.110:6790/0 conn(0x7fa5c01401c0 legacy=0x7fa5c0193bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:10.515 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.514+0000 7fa5c5a1b640 1 -- 10.20.193.110:0/2679992268 shutdown_connections 2026-02-13T20:29:10.515 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.514+0000 7fa5c5a1b640 1 -- 10.20.193.110:0/2679992268 >> 10.20.193.110:0/2679992268 conn(0x7fa5c0054e90 msgr2=0x7fa5c008ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:29:10.515 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.514+0000 7fa5c5a1b640 1 -- 10.20.193.110:0/2679992268 shutdown_connections 2026-02-13T20:29:10.515 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.514+0000 7fa5c5a1b640 1 -- 10.20.193.110:0/2679992268 wait complete. 2026-02-13T20:29:10.523 INFO:teuthology.orchestra.run.trial110.stdout:{"pg_ready":true,"pg_map":{"version":1373,"stamp":"2026-02-13T20:29:10.245970+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":238696,"kb_used_data":40840,"kb_used_omap":8891,"kb_used_meta":188868,"kb_avail":565992344,"statfs":{"total":579820584960,"available":579576160256,"internally_reserved":0,"allocated":41820160,"data_stored":23930254,"data_compressed":16424,"data_compressed_allocated":98304,"data_compressed_original":1179648,"omap_allocated":9104596,"internal_metadata":193401644},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.000971"},"pg_stats":[{"pgid":"1.0","version":"14'112","reported_seq":1794,"reported_epoch":847,"state":"active+clean","last_fresh":"2026-02-13T20:28:50.740927+0000","last_change":"2026-02-13T20:11:25.262882+0000","last_active":"2026-02-13T20:28:50.740927+0000","last_peered":"2026-02-13T20:28:50.740927+0000","last_clean":"2026-02-13T20:28:50.740927+0000","last_became_active":"2026-02-13T20:11:25.262766+0000","last_became_peered":"2026-02-13T20:11:25.262766+0000","last_unstale":"2026-02-13T20:28:50.740927+0000","last_undegraded":"2026-02-13T20:28:50.740927+0000","last_fullsized":"2026-02-13T20:28:50.740927+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:24.258524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:24.258524+0000","last_clean_scrub_stamp":"2026-02-13T20:11:24.258524+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T22:58:36.956434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":1657,"reported_epoch":847,"state":"active+clean","last_fresh":"2026-02-13T20:28:50.950103+0000","last_change":"2026-02-13T20:11:30.562730+0000","last_active":"2026-02-13T20:28:50.950103+0000","last_peered":"2026-02-13T20:28:50.950103+0000","last_clean":"2026-02-13T20:28:50.950103+0000","last_became_active":"2026-02-13T20:11:28.558943+0000","last_became_peered":"2026-02-13T20:11:28.558943+0000","last_unstale":"2026-02-13T20:28:50.950103+0000","last_undegraded":"2026-02-13T20:28:50.950103+0000","last_fullsized":"2026-02-13T20:28:50.950103+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T21:39:10.290168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032435800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1657,"reported_epoch":847,"state":"active+clean","last_fresh":"2026-02-13T20:28:50.740712+0000","last_change":"2026-02-13T20:11:30.561332+0000","last_active":"2026-02-13T20:28:50.740712+0000","last_peered":"2026-02-13T20:28:50.740712+0000","last_clean":"2026-02-13T20:28:50.740712+0000","last_became_active":"2026-02-13T20:11:28.559211+0000","last_became_peered":"2026-02-13T20:11:28.559211+0000","last_unstale":"2026-02-13T20:28:50.740712+0000","last_undegraded":"2026-02-13T20:28:50.740712+0000","last_fullsized":"2026-02-13T20:28:50.740712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T22:32:44.601301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029208800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1667,"reported_epoch":847,"state":"active+clean","last_fresh":"2026-02-13T20:28:50.952757+0000","last_change":"2026-02-13T20:11:30.823369+0000","last_active":"2026-02-13T20:28:50.952757+0000","last_peered":"2026-02-13T20:28:50.952757+0000","last_clean":"2026-02-13T20:28:50.952757+0000","last_became_active":"2026-02-13T20:11:28.559802+0000","last_became_peered":"2026-02-13T20:11:28.559802+0000","last_unstale":"2026-02-13T20:28:50.952757+0000","last_undegraded":"2026-02-13T20:28:50.952757+0000","last_fullsized":"2026-02-13T20:28:50.952757+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T05:27:34.220283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000230979,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":1658,"reported_epoch":847,"state":"active+clean","last_fresh":"2026-02-13T20:28:50.950215+0000","last_change":"2026-02-13T20:11:30.563087+0000","last_active":"2026-02-13T20:28:50.950215+0000","last_peered":"2026-02-13T20:28:50.950215+0000","last_clean":"2026-02-13T20:28:50.950215+0000","last_became_active":"2026-02-13T20:11:28.557848+0000","last_became_peered":"2026-02-13T20:11:28.557848+0000","last_unstale":"2026-02-13T20:28:50.950215+0000","last_undegraded":"2026-02-13T20:28:50.950215+0000","last_fullsized":"2026-02-13T20:28:50.950215+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T21:44:09.052237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064918699999999996,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1671,"reported_epoch":847,"state":"active+clean","last_fresh":"2026-02-13T20:28:50.953520+0000","last_change":"2026-02-13T20:11:30.561668+0000","last_active":"2026-02-13T20:28:50.953520+0000","last_peered":"2026-02-13T20:28:50.953520+0000","last_clean":"2026-02-13T20:28:50.953520+0000","last_became_active":"2026-02-13T20:11:28.558441+0000","last_became_peered":"2026-02-13T20:11:28.558441+0000","last_unstale":"2026-02-13T20:28:50.953520+0000","last_undegraded":"2026-02-13T20:28:50.953520+0000","last_fullsized":"2026-02-13T20:28:50.953520+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T22:32:58.917639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000231139,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1657,"reported_epoch":847,"state":"active+clean","last_fresh":"2026-02-13T20:28:50.740673+0000","last_change":"2026-02-13T20:11:30.561240+0000","last_active":"2026-02-13T20:28:50.740673+0000","last_peered":"2026-02-13T20:28:50.740673+0000","last_clean":"2026-02-13T20:28:50.740673+0000","last_became_active":"2026-02-13T20:11:28.559005+0000","last_became_peered":"2026-02-13T20:11:28.559005+0000","last_unstale":"2026-02-13T20:28:50.740673+0000","last_undegraded":"2026-02-13T20:28:50.740673+0000","last_fullsized":"2026-02-13T20:28:50.740673+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T02:48:59.423627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027156000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1671,"reported_epoch":847,"state":"active+clean","last_fresh":"2026-02-13T20:28:50.953498+0000","last_change":"2026-02-13T20:11:30.561637+0000","last_active":"2026-02-13T20:28:50.953498+0000","last_peered":"2026-02-13T20:28:50.953498+0000","last_clean":"2026-02-13T20:28:50.953498+0000","last_became_active":"2026-02-13T20:11:28.559585+0000","last_became_peered":"2026-02-13T20:11:28.559585+0000","last_unstale":"2026-02-13T20:28:50.953498+0000","last_undegraded":"2026-02-13T20:28:50.953498+0000","last_fullsized":"2026-02-13T20:28:50.953498+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T23:13:24.610860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00021035100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1657,"reported_epoch":847,"state":"active+clean","last_fresh":"2026-02-13T20:28:50.740649+0000","last_change":"2026-02-13T20:11:30.561334+0000","last_active":"2026-02-13T20:28:50.740649+0000","last_peered":"2026-02-13T20:28:50.740649+0000","last_clean":"2026-02-13T20:28:50.740649+0000","last_became_active":"2026-02-13T20:11:29.018116+0000","last_became_peered":"2026-02-13T20:11:29.018116+0000","last_unstale":"2026-02-13T20:28:50.740649+0000","last_undegraded":"2026-02-13T20:28:50.740649+0000","last_fullsized":"2026-02-13T20:28:50.740649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T03:21:19.857098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000335309,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1180736,"data_compressed":16424,"data_compressed_allocated":98304,"data_compressed_original":1179648,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640471,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33752,"kb_used_data":6792,"kb_used_omap":1355,"kb_used_meta":25588,"kb_avail":94338088,"statfs":{"total":96636764160,"available":96602202112,"internally_reserved":0,"allocated":6955008,"data_stored":3791599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1388487,"internal_metadata":26202169},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640472,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33748,"kb_used_data":6788,"kb_used_omap":1240,"kb_used_meta":25703,"kb_avail":94338092,"statfs":{"total":96636764160,"available":96602206208,"internally_reserved":0,"allocated":6950912,"data_stored":3791580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1270080,"internal_metadata":26320576},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640472,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33800,"kb_used_data":6840,"kb_used_omap":1132,"kb_used_meta":25811,"kb_avail":94338040,"statfs":{"total":96636764160,"available":96602152960,"internally_reserved":0,"allocated":7004160,"data_stored":4381948,"data_compressed":8212,"data_compressed_allocated":49152,"data_compressed_original":589824,"omap_allocated":1159884,"internal_metadata":26430772},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640472,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51796,"kb_used_data":6788,"kb_used_omap":2201,"kb_used_meta":42790,"kb_avail":94320044,"statfs":{"total":96636764160,"available":96583725056,"internally_reserved":0,"allocated":6950912,"data_stored":3791580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2254483,"internal_metadata":43817325},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640471,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51800,"kb_used_data":6792,"kb_used_omap":1806,"kb_used_meta":43185,"kb_avail":94320040,"statfs":{"total":96636764160,"available":96583720960,"internally_reserved":0,"allocated":6955008,"data_stored":3791599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1849790,"internal_metadata":44222018},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640472,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33800,"kb_used_data":6840,"kb_used_omap":1154,"kb_used_meta":25789,"kb_avail":94338040,"statfs":{"total":96636764160,"available":96602152960,"internally_reserved":0,"allocated":7004160,"data_stored":4381948,"data_compressed":8212,"data_compressed_allocated":49152,"data_compressed_original":589824,"omap_allocated":1181872,"internal_metadata":26408784},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":590368,"data_compressed":8212,"data_compressed_allocated":49152,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":590368,"data_compressed":8212,"data_compressed_allocated":49152,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T20:29:10.523 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-13T20:29:10.523 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-13T20:29:10.590 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.588+0000 7f44cf05b640 10 monclient: get_monmap_and_config 2026-02-13T20:29:10.590 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.588+0000 7f44cf05b640 10 monclient: build_initial_monmap 2026-02-13T20:29:10.590 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.588+0000 7f44cf05b640 10 monclient: monmap: 2026-02-13T20:29:10.590 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:29:10.590 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:10.590 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:29:10.590414+0000 2026-02-13T20:29:10.590 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:29:10.590414+0000 2026-02-13T20:29:10.590 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:29:10.590 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:10.590 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:29:10.590 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:29:10.590 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:29:10.590 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:10.590 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.589+0000 7f44cf05b640 1 Processor -- start 2026-02-13T20:29:10.590 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.589+0000 7f44cf05b640 1 -- start start 2026-02-13T20:29:10.590 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.589+0000 7f44cf05b640 10 monclient: init 2026-02-13T20:29:10.591 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.590+0000 7f44cf05b640 10 monclient: _reopen_session rank -1 2026-02-13T20:29:10.591 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.590+0000 7f44cf05b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:29:10.591 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.590+0000 7f44cf05b640 10 monclient(hunting): picked mon.noname-c con 0x7f44c8091470 addr v1:10.20.193.188:6789/0 2026-02-13T20:29:10.591 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.590+0000 7f44cf05b640 10 monclient(hunting): picked mon.noname-b con 0x7f44c8092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:29:10.591 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.590+0000 7f44cf05b640 10 monclient(hunting): picked mon.noname-a con 0x7f44c81401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:29:10.591 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.590+0000 7f44cf05b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c805c5b0 con 0x7f44c81401c0 2026-02-13T20:29:10.591 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.590+0000 7f44cf05b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c8140620 con 0x7f44c8091470 2026-02-13T20:29:10.591 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.590+0000 7f44cf05b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c808b450 con 0x7f44c8092020 2026-02-13T20:29:10.591 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.590+0000 7f44cf05b640 10 monclient(hunting): _renew_subs 2026-02-13T20:29:10.591 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.590+0000 7f44cf05b640 10 monclient(hunting): authenticate will time out at 1712.281093s 2026-02-13T20:29:10.591 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.590+0000 7f44bffff640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f44c8092020 0x7f44c81812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:55284/0 (socket says 10.20.193.110:55284) 2026-02-13T20:29:10.591 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.590+0000 7f44bffff640 1 -- 10.20.193.110:0/848001299 learned_addr learned my addr 10.20.193.110:0/848001299 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:29:10.592 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.590+0000 7f44bf7fe640 1 -- 10.20.193.110:0/848001299 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1501377311 0 0) 0x7f44c808b450 con 0x7f44c8092020 2026-02-13T20:29:10.592 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.590+0000 7f44bf7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:29:10.592 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.590+0000 7f44bf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:10.592 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.590+0000 7f44bf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:10.592 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.590+0000 7f44bf7fe640 10 monclient(hunting): my global_id is 154274 2026-02-13T20:29:10.592 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.590+0000 7f44bf7fe640 1 -- 10.20.193.110:0/848001299 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44b40035e0 con 0x7f44c8092020 2026-02-13T20:29:10.592 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.590+0000 7f44bf7fe640 1 -- 10.20.193.110:0/848001299 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 975451860 0 0) 0x7f44c805c5b0 con 0x7f44c81401c0 2026-02-13T20:29:10.592 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.590+0000 7f44bf7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:29:10.592 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.590+0000 7f44bf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:10.592 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.590+0000 7f44bf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:10.592 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.590+0000 7f44bf7fe640 10 monclient(hunting): my global_id is 124557 2026-02-13T20:29:10.592 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.590+0000 7f44bf7fe640 1 -- 10.20.193.110:0/848001299 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44c808b450 con 0x7f44c81401c0 2026-02-13T20:29:10.592 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.590+0000 7f44bf7fe640 1 -- 10.20.193.110:0/848001299 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2891372608 0 0) 0x7f44b40035e0 con 0x7f44c8092020 2026-02-13T20:29:10.592 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.590+0000 7f44bf7fe640 1 -- 10.20.193.110:0/848001299 >> v1:10.20.193.188:6789/0 conn(0x7f44c8091470 legacy=0x7f44c8091840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:10.592 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.590+0000 7f44bf7fe640 1 -- 10.20.193.110:0/848001299 >> v1:10.20.193.110:6789/0 conn(0x7f44c81401c0 legacy=0x7f44c81a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:10.592 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.590+0000 7f44bf7fe640 10 monclient: _finish_hunting 0 2026-02-13T20:29:10.592 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.590+0000 7f44bf7fe640 1 monclient: found mon.noname-b 2026-02-13T20:29:10.592 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.590+0000 7f44bf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:29:10.592 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.590+0000 7f44bf7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:29:10.592 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.590+0000 7f44bf7fe640 1 -- 10.20.193.110:0/848001299 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44c808b730 con 0x7f44c8092020 2026-02-13T20:29:10.592 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.590+0000 7f44bf7fe640 10 monclient: _finish_auth 0 2026-02-13T20:29:10.592 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.590+0000 7f44bf7fe640 10 monclient: _check_auth_tickets 2026-02-13T20:29:10.592 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.590+0000 7f44bf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:29:10.592 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.590+0000 7f44bf7fe640 1 -- 10.20.193.110:0/848001299 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f44b0002dd0 con 0x7f44c8092020 2026-02-13T20:29:10.592 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.590+0000 7f44bf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:10.592 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.590+0000 7f44bf7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:29:10.592 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.590+0000 7f44bf7fe640 10 monclient: dump: 2026-02-13T20:29:10.592 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:10.593 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:10.593 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:10.593 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:10.593 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:10.593 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:10.593 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:10.593 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:10.593 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:10.593 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:10.593 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.590+0000 7f44cf05b640 5 monclient: authenticate success, global_id 154274 2026-02-13T20:29:10.593 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.590+0000 7f44cf05b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:29:10.593 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.590+0000 7f44bf7fe640 1 -- 10.20.193.110:0/848001299 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f44b0002fd0 con 0x7f44c8092020 2026-02-13T20:29:10.593 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.590+0000 7f44bf7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:29:10.593 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.590+0000 7f44bf7fe640 1 -- 10.20.193.110:0/848001299 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f44b00033e0 con 0x7f44c8092020 2026-02-13T20:29:10.593 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.590+0000 7f44bf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:10.593 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.590+0000 7f44bf7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:29:10.593 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.590+0000 7f44bf7fe640 10 monclient: dump: 2026-02-13T20:29:10.593 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:10.593 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:10.593 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:10.593 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:10.593 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:10.593 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:10.593 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:10.593 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:10.593 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:10.593 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:10.593 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.590+0000 7f44cf05b640 10 monclient: get_monmap_and_config success 2026-02-13T20:29:10.593 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.590+0000 7f44cf05b640 4 set_mon_vals no callback set 2026-02-13T20:29:10.593 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.591+0000 7f44cf05b640 10 monclient: shutdown 2026-02-13T20:29:10.593 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.591+0000 7f44cf05b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:29:10.593 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.591+0000 7f44cf05b640 1 -- 10.20.193.110:0/848001299 >> v1:10.20.193.110:6790/0 conn(0x7f44c8092020 legacy=0x7f44c81812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:10.593 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.591+0000 7f44cf05b640 1 -- 10.20.193.110:0/848001299 shutdown_connections 2026-02-13T20:29:10.593 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.591+0000 7f44cf05b640 1 -- 10.20.193.110:0/848001299 >> 10.20.193.110:0/848001299 conn(0x7f44c8054e90 msgr2=0x7f44c8058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:29:10.593 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.591+0000 7f44cf05b640 1 -- 10.20.193.110:0/848001299 shutdown_connections 2026-02-13T20:29:10.593 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.591+0000 7f44cf05b640 1 -- 10.20.193.110:0/848001299 wait complete. 2026-02-13T20:29:10.595 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.591+0000 7f44cf05b640 10 monclient: build_initial_monmap 2026-02-13T20:29:10.595 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.591+0000 7f44cf05b640 10 monclient: monmap: 2026-02-13T20:29:10.595 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:29:10.595 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:29:10.595 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:29:10.595 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:29:10.595 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:29:10.595 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:29:10.595 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:29:10.595 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:29:10.595 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:29:10.595 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:10.595 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.591+0000 7f44cf05b640 1 Processor -- start 2026-02-13T20:29:10.595 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.591+0000 7f44cf05b640 1 -- start start 2026-02-13T20:29:10.595 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.591+0000 7f44cf05b640 10 monclient: init 2026-02-13T20:29:10.595 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44cf05b640 10 monclient: _reopen_session rank -1 2026-02-13T20:29:10.595 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44cf05b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:29:10.595 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44cf05b640 10 monclient(hunting): picked mon.noname-c con 0x7f44c8091470 addr v1:10.20.193.110:6790/0 2026-02-13T20:29:10.595 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44cf05b640 10 monclient(hunting): picked mon.noname-a con 0x7f44c81401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:29:10.595 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44cf05b640 10 monclient(hunting): picked mon.noname-b con 0x7f44c812ce80 addr v1:10.20.193.188:6789/0 2026-02-13T20:29:10.595 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44cf05b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c813fb00 con 0x7f44c81401c0 2026-02-13T20:29:10.595 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44cf05b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c805d320 con 0x7f44c812ce80 2026-02-13T20:29:10.595 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44cf05b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c812d8e0 con 0x7f44c8091470 2026-02-13T20:29:10.595 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44cf05b640 10 monclient(hunting): _renew_subs 2026-02-13T20:29:10.595 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44cf05b640 10 monclient(hunting): authenticate will time out at 1712.283082s 2026-02-13T20:29:10.595 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44ccdd0640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f44c8091470 0x7f44c813e470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:55294/0 (socket says 10.20.193.110:55294) 2026-02-13T20:29:10.595 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44ccdd0640 1 -- 10.20.193.110:0/4288731833 learned_addr learned my addr 10.20.193.110:0/4288731833 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:29:10.595 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44bd7fa640 1 -- 10.20.193.110:0/4288731833 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3883020929 0 0) 0x7f44c812d8e0 con 0x7f44c8091470 2026-02-13T20:29:10.595 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44bd7fa640 10 monclient(hunting): _negotiate 2026-02-13T20:29:10.595 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44bd7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:10.595 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44bd7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:10.595 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44bd7fa640 10 monclient(hunting): my global_id is 154277 2026-02-13T20:29:10.595 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44bd7fa640 1 -- 10.20.193.110:0/4288731833 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44980035e0 con 0x7f44c8091470 2026-02-13T20:29:10.595 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44bd7fa640 1 -- 10.20.193.110:0/4288731833 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1015176379 0 0) 0x7f44c813fb00 con 0x7f44c81401c0 2026-02-13T20:29:10.595 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44bd7fa640 10 monclient(hunting): _negotiate 2026-02-13T20:29:10.595 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44bd7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:10.596 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44bd7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:10.596 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44bd7fa640 10 monclient(hunting): my global_id is 124560 2026-02-13T20:29:10.596 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44bd7fa640 1 -- 10.20.193.110:0/4288731833 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44c812d8e0 con 0x7f44c81401c0 2026-02-13T20:29:10.596 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44bd7fa640 1 -- 10.20.193.110:0/4288731833 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2524334989 0 0) 0x7f44c812d8e0 con 0x7f44c81401c0 2026-02-13T20:29:10.596 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44bd7fa640 1 -- 10.20.193.110:0/4288731833 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f44c813fb00 con 0x7f44c81401c0 2026-02-13T20:29:10.596 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44bd7fa640 1 -- 10.20.193.110:0/4288731833 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f44b0002b30 con 0x7f44c81401c0 2026-02-13T20:29:10.596 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44bd7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:29:10.596 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44bd7fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:29:10.596 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44bd7fa640 10 monclient(hunting): dump: 2026-02-13T20:29:10.596 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:10.596 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:10.596 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:10.596 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:10.596 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:10.596 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:10.596 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:10.596 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:10.596 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:10.596 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:10.596 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44bd7fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:29:10.596 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44bd7fa640 1 -- 10.20.193.110:0/4288731833 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 239139031 0 0) 0x7f44980035e0 con 0x7f44c8091470 2026-02-13T20:29:10.596 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44bd7fa640 1 -- 10.20.193.110:0/4288731833 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f44c812d8e0 con 0x7f44c8091470 2026-02-13T20:29:10.596 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44bd7fa640 1 -- 10.20.193.110:0/4288731833 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f44b8003050 con 0x7f44c8091470 2026-02-13T20:29:10.596 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44bd7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:29:10.596 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44bd7fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:29:10.596 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44bd7fa640 10 monclient(hunting): dump: 2026-02-13T20:29:10.596 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:10.596 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:10.596 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:10.596 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:10.596 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:10.596 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:10.596 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:10.596 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:10.596 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:10.596 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:10.596 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44bd7fa640 1 -- 10.20.193.110:0/4288731833 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2317970255 0 0) 0x7f44c813fb00 con 0x7f44c81401c0 2026-02-13T20:29:10.596 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44bd7fa640 1 -- 10.20.193.110:0/4288731833 >> v1:10.20.193.110:6790/0 conn(0x7f44c8091470 legacy=0x7f44c813e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:10.596 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44bd7fa640 1 -- 10.20.193.110:0/4288731833 >> v1:10.20.193.188:6789/0 conn(0x7f44c812ce80 legacy=0x7f44c8192f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:10.596 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44bd7fa640 10 monclient: _finish_hunting 0 2026-02-13T20:29:10.596 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44bd7fa640 1 monclient: found mon.a 2026-02-13T20:29:10.596 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44bd7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:29:10.596 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44bd7fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:29:10.596 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44bd7fa640 1 -- 10.20.193.110:0/4288731833 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44c812fc40 con 0x7f44c81401c0 2026-02-13T20:29:10.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44bd7fa640 10 monclient: _finish_auth 0 2026-02-13T20:29:10.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44bd7fa640 10 monclient: _check_auth_tickets 2026-02-13T20:29:10.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44bd7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:29:10.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44cf05b640 5 monclient: authenticate success, global_id 124560 2026-02-13T20:29:10.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44cf05b640 10 monclient: _renew_subs 2026-02-13T20:29:10.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44cf05b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:29:10.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44cf05b640 1 -- 10.20.193.110:0/4288731833 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f44c812f3a0 con 0x7f44c81401c0 2026-02-13T20:29:10.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44cf05b640 10 monclient: _renew_subs 2026-02-13T20:29:10.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44cf05b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:29:10.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44cf05b640 1 -- 10.20.193.110:0/4288731833 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f44c813eb80 con 0x7f44c81401c0 2026-02-13T20:29:10.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44bd7fa640 1 -- 10.20.193.110:0/4288731833 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f44b0002d00 con 0x7f44c81401c0 2026-02-13T20:29:10.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44bd7fa640 10 monclient: handle_config config(0 keys) 2026-02-13T20:29:10.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44bd7fa640 1 -- 10.20.193.110:0/4288731833 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f44b0004d00 con 0x7f44c81401c0 2026-02-13T20:29:10.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44bd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:10.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44bd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:29:10.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44bd7fa640 10 monclient: dump: 2026-02-13T20:29:10.597 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:10.597 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:10.597 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:10.597 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:10.597 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:10.597 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:10.597 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:10.597 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:10.597 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:10.597 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:10.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44beffd640 4 set_mon_vals no callback set 2026-02-13T20:29:10.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44cf05b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:10.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44cf05b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:10.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44cf05b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:29:10.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.592+0000 7f44cf05b640 1 -- 10.20.193.110:0/4288731833 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44c80008d0 con 0x7f44c81401c0 2026-02-13T20:29:10.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.593+0000 7f44bd7fa640 1 -- 10.20.193.110:0/4288731833 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f44b0011970 con 0x7f44c81401c0 2026-02-13T20:29:10.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.593+0000 7f44bd7fa640 1 -- 10.20.193.110:0/4288731833 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(847..847 src has 1..847) ==== 3591+0+0 (unknown 4078645555 0 0) 0x7f44b004e7c0 con 0x7f44c81401c0 2026-02-13T20:29:10.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.593+0000 7f44ccdd0640 10 monclient: get_auth_request con 0x7f449803fa50 auth_method 0 2026-02-13T20:29:10.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.595+0000 7f44bd7fa640 1 -- 10.20.193.110:0/4288731833 <== mon.0 v1:10.20.193.110:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f44b0017110 con 0x7f44c81401c0 2026-02-13T20:29:10.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.595+0000 7f44bd7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:10.597 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.595+0000 7f44bd7fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:29:10.696 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.695+0000 7f44cf05b640 1 -- 10.20.193.110:0/4288731833 --> v1:10.20.193.188:6812/1623052694 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f44c805b9a0 con 0x7f449803fa50 2026-02-13T20:29:10.697 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.696+0000 7f44bd7fa640 1 -- 10.20.193.110:0/4288731833 <== mgr.4105 v1:10.20.193.188:6812/1623052694 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34048 (unknown 2965378022 0 372038984) 0x7f44b80078a0 con 0x7f449803fa50 2026-02-13T20:29:10.697 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:29:10.697 INFO:teuthology.orchestra.run.trial110.stderr:dumped all 2026-02-13T20:29:10.698 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.697+0000 7f44cf05b640 1 -- 10.20.193.110:0/4288731833 >> v1:10.20.193.188:6812/1623052694 conn(0x7f449803fa50 legacy=0x7f449805ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:10.698 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.697+0000 7f44cf05b640 10 monclient: shutdown 2026-02-13T20:29:10.698 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.697+0000 7f44cf05b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:29:10.698 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.697+0000 7f44cf05b640 1 -- 10.20.193.110:0/4288731833 >> v1:10.20.193.110:6789/0 conn(0x7f44c81401c0 legacy=0x7f44c8191820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:10.698 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.697+0000 7f44cf05b640 1 -- 10.20.193.110:0/4288731833 shutdown_connections 2026-02-13T20:29:10.698 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.697+0000 7f44cf05b640 1 -- 10.20.193.110:0/4288731833 >> 10.20.193.110:0/4288731833 conn(0x7f44c8054e90 msgr2=0x7f44c808d530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:29:10.698 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.697+0000 7f44cf05b640 1 -- 10.20.193.110:0/4288731833 shutdown_connections 2026-02-13T20:29:10.698 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.697+0000 7f44cf05b640 1 -- 10.20.193.110:0/4288731833 wait complete. 2026-02-13T20:29:10.706 INFO:teuthology.orchestra.run.trial110.stdout:{"pg_ready":true,"pg_map":{"version":1373,"stamp":"2026-02-13T20:29:10.245970+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":238696,"kb_used_data":40840,"kb_used_omap":8891,"kb_used_meta":188868,"kb_avail":565992344,"statfs":{"total":579820584960,"available":579576160256,"internally_reserved":0,"allocated":41820160,"data_stored":23930254,"data_compressed":16424,"data_compressed_allocated":98304,"data_compressed_original":1179648,"omap_allocated":9104596,"internal_metadata":193401644},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.000971"},"pg_stats":[{"pgid":"1.0","version":"14'112","reported_seq":1794,"reported_epoch":847,"state":"active+clean","last_fresh":"2026-02-13T20:28:50.740927+0000","last_change":"2026-02-13T20:11:25.262882+0000","last_active":"2026-02-13T20:28:50.740927+0000","last_peered":"2026-02-13T20:28:50.740927+0000","last_clean":"2026-02-13T20:28:50.740927+0000","last_became_active":"2026-02-13T20:11:25.262766+0000","last_became_peered":"2026-02-13T20:11:25.262766+0000","last_unstale":"2026-02-13T20:28:50.740927+0000","last_undegraded":"2026-02-13T20:28:50.740927+0000","last_fullsized":"2026-02-13T20:28:50.740927+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:24.258524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:24.258524+0000","last_clean_scrub_stamp":"2026-02-13T20:11:24.258524+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T22:58:36.956434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":1657,"reported_epoch":847,"state":"active+clean","last_fresh":"2026-02-13T20:28:50.950103+0000","last_change":"2026-02-13T20:11:30.562730+0000","last_active":"2026-02-13T20:28:50.950103+0000","last_peered":"2026-02-13T20:28:50.950103+0000","last_clean":"2026-02-13T20:28:50.950103+0000","last_became_active":"2026-02-13T20:11:28.558943+0000","last_became_peered":"2026-02-13T20:11:28.558943+0000","last_unstale":"2026-02-13T20:28:50.950103+0000","last_undegraded":"2026-02-13T20:28:50.950103+0000","last_fullsized":"2026-02-13T20:28:50.950103+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T21:39:10.290168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032435800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1657,"reported_epoch":847,"state":"active+clean","last_fresh":"2026-02-13T20:28:50.740712+0000","last_change":"2026-02-13T20:11:30.561332+0000","last_active":"2026-02-13T20:28:50.740712+0000","last_peered":"2026-02-13T20:28:50.740712+0000","last_clean":"2026-02-13T20:28:50.740712+0000","last_became_active":"2026-02-13T20:11:28.559211+0000","last_became_peered":"2026-02-13T20:11:28.559211+0000","last_unstale":"2026-02-13T20:28:50.740712+0000","last_undegraded":"2026-02-13T20:28:50.740712+0000","last_fullsized":"2026-02-13T20:28:50.740712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T22:32:44.601301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029208800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1667,"reported_epoch":847,"state":"active+clean","last_fresh":"2026-02-13T20:28:50.952757+0000","last_change":"2026-02-13T20:11:30.823369+0000","last_active":"2026-02-13T20:28:50.952757+0000","last_peered":"2026-02-13T20:28:50.952757+0000","last_clean":"2026-02-13T20:28:50.952757+0000","last_became_active":"2026-02-13T20:11:28.559802+0000","last_became_peered":"2026-02-13T20:11:28.559802+0000","last_unstale":"2026-02-13T20:28:50.952757+0000","last_undegraded":"2026-02-13T20:28:50.952757+0000","last_fullsized":"2026-02-13T20:28:50.952757+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T05:27:34.220283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000230979,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":1658,"reported_epoch":847,"state":"active+clean","last_fresh":"2026-02-13T20:28:50.950215+0000","last_change":"2026-02-13T20:11:30.563087+0000","last_active":"2026-02-13T20:28:50.950215+0000","last_peered":"2026-02-13T20:28:50.950215+0000","last_clean":"2026-02-13T20:28:50.950215+0000","last_became_active":"2026-02-13T20:11:28.557848+0000","last_became_peered":"2026-02-13T20:11:28.557848+0000","last_unstale":"2026-02-13T20:28:50.950215+0000","last_undegraded":"2026-02-13T20:28:50.950215+0000","last_fullsized":"2026-02-13T20:28:50.950215+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T21:44:09.052237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064918699999999996,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1671,"reported_epoch":847,"state":"active+clean","last_fresh":"2026-02-13T20:28:50.953520+0000","last_change":"2026-02-13T20:11:30.561668+0000","last_active":"2026-02-13T20:28:50.953520+0000","last_peered":"2026-02-13T20:28:50.953520+0000","last_clean":"2026-02-13T20:28:50.953520+0000","last_became_active":"2026-02-13T20:11:28.558441+0000","last_became_peered":"2026-02-13T20:11:28.558441+0000","last_unstale":"2026-02-13T20:28:50.953520+0000","last_undegraded":"2026-02-13T20:28:50.953520+0000","last_fullsized":"2026-02-13T20:28:50.953520+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T22:32:58.917639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000231139,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1657,"reported_epoch":847,"state":"active+clean","last_fresh":"2026-02-13T20:28:50.740673+0000","last_change":"2026-02-13T20:11:30.561240+0000","last_active":"2026-02-13T20:28:50.740673+0000","last_peered":"2026-02-13T20:28:50.740673+0000","last_clean":"2026-02-13T20:28:50.740673+0000","last_became_active":"2026-02-13T20:11:28.559005+0000","last_became_peered":"2026-02-13T20:11:28.559005+0000","last_unstale":"2026-02-13T20:28:50.740673+0000","last_undegraded":"2026-02-13T20:28:50.740673+0000","last_fullsized":"2026-02-13T20:28:50.740673+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T02:48:59.423627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027156000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1671,"reported_epoch":847,"state":"active+clean","last_fresh":"2026-02-13T20:28:50.953498+0000","last_change":"2026-02-13T20:11:30.561637+0000","last_active":"2026-02-13T20:28:50.953498+0000","last_peered":"2026-02-13T20:28:50.953498+0000","last_clean":"2026-02-13T20:28:50.953498+0000","last_became_active":"2026-02-13T20:11:28.559585+0000","last_became_peered":"2026-02-13T20:11:28.559585+0000","last_unstale":"2026-02-13T20:28:50.953498+0000","last_undegraded":"2026-02-13T20:28:50.953498+0000","last_fullsized":"2026-02-13T20:28:50.953498+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T23:13:24.610860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00021035100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1657,"reported_epoch":847,"state":"active+clean","last_fresh":"2026-02-13T20:28:50.740649+0000","last_change":"2026-02-13T20:11:30.561334+0000","last_active":"2026-02-13T20:28:50.740649+0000","last_peered":"2026-02-13T20:28:50.740649+0000","last_clean":"2026-02-13T20:28:50.740649+0000","last_became_active":"2026-02-13T20:11:29.018116+0000","last_became_peered":"2026-02-13T20:11:29.018116+0000","last_unstale":"2026-02-13T20:28:50.740649+0000","last_undegraded":"2026-02-13T20:28:50.740649+0000","last_fullsized":"2026-02-13T20:28:50.740649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T03:21:19.857098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000335309,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1180736,"data_compressed":16424,"data_compressed_allocated":98304,"data_compressed_original":1179648,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640471,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33752,"kb_used_data":6792,"kb_used_omap":1355,"kb_used_meta":25588,"kb_avail":94338088,"statfs":{"total":96636764160,"available":96602202112,"internally_reserved":0,"allocated":6955008,"data_stored":3791599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1388487,"internal_metadata":26202169},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640472,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33748,"kb_used_data":6788,"kb_used_omap":1240,"kb_used_meta":25703,"kb_avail":94338092,"statfs":{"total":96636764160,"available":96602206208,"internally_reserved":0,"allocated":6950912,"data_stored":3791580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1270080,"internal_metadata":26320576},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640472,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33800,"kb_used_data":6840,"kb_used_omap":1132,"kb_used_meta":25811,"kb_avail":94338040,"statfs":{"total":96636764160,"available":96602152960,"internally_reserved":0,"allocated":7004160,"data_stored":4381948,"data_compressed":8212,"data_compressed_allocated":49152,"data_compressed_original":589824,"omap_allocated":1159884,"internal_metadata":26430772},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640472,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51796,"kb_used_data":6788,"kb_used_omap":2201,"kb_used_meta":42790,"kb_avail":94320044,"statfs":{"total":96636764160,"available":96583725056,"internally_reserved":0,"allocated":6950912,"data_stored":3791580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2254483,"internal_metadata":43817325},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640471,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51800,"kb_used_data":6792,"kb_used_omap":1806,"kb_used_meta":43185,"kb_avail":94320040,"statfs":{"total":96636764160,"available":96583720960,"internally_reserved":0,"allocated":6955008,"data_stored":3791599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1849790,"internal_metadata":44222018},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640472,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33800,"kb_used_data":6840,"kb_used_omap":1154,"kb_used_meta":25789,"kb_avail":94338040,"statfs":{"total":96636764160,"available":96602152960,"internally_reserved":0,"allocated":7004160,"data_stored":4381948,"data_compressed":8212,"data_compressed_allocated":49152,"data_compressed_original":589824,"omap_allocated":1181872,"internal_metadata":26408784},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":590368,"data_compressed":8212,"data_compressed_allocated":49152,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":590368,"data_compressed":8212,"data_compressed_allocated":49152,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T20:29:10.708 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-13T20:29:10.772 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.770+0000 7f110fb94640 10 monclient: get_monmap_and_config 2026-02-13T20:29:10.772 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.770+0000 7f110fb94640 10 monclient: build_initial_monmap 2026-02-13T20:29:10.772 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.770+0000 7f110fb94640 10 monclient: monmap: 2026-02-13T20:29:10.772 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:29:10.772 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:10.772 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:29:10.772051+0000 2026-02-13T20:29:10.772 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:29:10.772051+0000 2026-02-13T20:29:10.772 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:29:10.772 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:10.772 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:29:10.772 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:29:10.772 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:29:10.772 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:10.772 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.771+0000 7f110fb94640 1 Processor -- start 2026-02-13T20:29:10.772 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.771+0000 7f110fb94640 1 -- start start 2026-02-13T20:29:10.772 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.771+0000 7f110fb94640 10 monclient: init 2026-02-13T20:29:10.773 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.771+0000 7f110fb94640 10 monclient: _reopen_session rank -1 2026-02-13T20:29:10.773 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.771+0000 7f110fb94640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:29:10.773 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.771+0000 7f110fb94640 10 monclient(hunting): picked mon.noname-b con 0x7f110813f280 addr v1:10.20.193.110:6790/0 2026-02-13T20:29:10.773 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.771+0000 7f110fb94640 10 monclient(hunting): picked mon.noname-c con 0x7f110813ee70 addr v1:10.20.193.188:6789/0 2026-02-13T20:29:10.773 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.771+0000 7f110fb94640 10 monclient(hunting): picked mon.noname-a con 0x7f1108089a90 addr v1:10.20.193.110:6789/0 2026-02-13T20:29:10.773 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.771+0000 7f110fb94640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f110808a310 con 0x7f1108089a90 2026-02-13T20:29:10.773 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.771+0000 7f110fb94640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f110808a5f0 con 0x7f110813ee70 2026-02-13T20:29:10.773 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.771+0000 7f110fb94640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f110808a8d0 con 0x7f110813f280 2026-02-13T20:29:10.773 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.771+0000 7f110fb94640 10 monclient(hunting): _renew_subs 2026-02-13T20:29:10.773 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.771+0000 7f110fb94640 10 monclient(hunting): authenticate will time out at 1712.462603s 2026-02-13T20:29:10.773 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.771+0000 7f110d909640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f110813f280 0x7f110813f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:55296/0 (socket says 10.20.193.110:55296) 2026-02-13T20:29:10.773 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.771+0000 7f110d909640 1 -- 10.20.193.110:0/3314343789 learned_addr learned my addr 10.20.193.110:0/3314343789 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:29:10.773 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.771+0000 7f110c907640 1 -- 10.20.193.110:0/3314343789 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1620351595 0 0) 0x7f110808a310 con 0x7f1108089a90 2026-02-13T20:29:10.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.771+0000 7f110c907640 10 monclient(hunting): _negotiate 2026-02-13T20:29:10.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.771+0000 7f110c907640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:10.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.771+0000 7f110c907640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:10.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.771+0000 7f110c907640 10 monclient(hunting): my global_id is 124563 2026-02-13T20:29:10.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.771+0000 7f110c907640 1 -- 10.20.193.110:0/3314343789 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10f00035e0 con 0x7f1108089a90 2026-02-13T20:29:10.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.771+0000 7f110c907640 1 -- 10.20.193.110:0/3314343789 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 750825028 0 0) 0x7f110808a8d0 con 0x7f110813f280 2026-02-13T20:29:10.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.771+0000 7f110c907640 10 monclient(hunting): _negotiate 2026-02-13T20:29:10.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.771+0000 7f110c907640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:10.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.771+0000 7f110c907640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:10.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.771+0000 7f110c907640 10 monclient(hunting): my global_id is 154280 2026-02-13T20:29:10.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.771+0000 7f110c907640 1 -- 10.20.193.110:0/3314343789 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f110808a310 con 0x7f110813f280 2026-02-13T20:29:10.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.772+0000 7f110c907640 1 -- 10.20.193.110:0/3314343789 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2617856637 0 0) 0x7f10f00035e0 con 0x7f1108089a90 2026-02-13T20:29:10.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.772+0000 7f110c907640 1 -- 10.20.193.110:0/3314343789 >> v1:10.20.193.110:6790/0 conn(0x7f110813f280 legacy=0x7f110813f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:10.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.772+0000 7f110c907640 1 -- 10.20.193.110:0/3314343789 >> v1:10.20.193.188:6789/0 conn(0x7f110813ee70 legacy=0x7f1108180190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T20:29:10.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.772+0000 7f110c907640 10 monclient: _finish_hunting 0 2026-02-13T20:29:10.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.772+0000 7f110c907640 1 monclient: found mon.noname-a 2026-02-13T20:29:10.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.772+0000 7f110c907640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:29:10.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.772+0000 7f110c907640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:29:10.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.772+0000 7f110c907640 1 -- 10.20.193.110:0/3314343789 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f110808abb0 con 0x7f1108089a90 2026-02-13T20:29:10.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.772+0000 7f110c907640 10 monclient: _finish_auth 0 2026-02-13T20:29:10.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.772+0000 7f110c907640 10 monclient: _check_auth_tickets 2026-02-13T20:29:10.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.772+0000 7f110c907640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:29:10.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.772+0000 7f110c907640 1 -- 10.20.193.110:0/3314343789 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f1104003de0 con 0x7f1108089a90 2026-02-13T20:29:10.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.772+0000 7f110fb94640 5 monclient: authenticate success, global_id 124563 2026-02-13T20:29:10.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.772+0000 7f110fb94640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:29:10.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.772+0000 7f110c907640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:10.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.772+0000 7f110c907640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:29:10.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.772+0000 7f110c907640 10 monclient: dump: 2026-02-13T20:29:10.774 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:10.774 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:10.774 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:10.774 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:10.774 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:10.774 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:10.774 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:10.774 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:10.774 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:10.774 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:10.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.772+0000 7f110fb94640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:29:10.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.772+0000 7f110c907640 1 -- 10.20.193.110:0/3314343789 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f11040040a0 con 0x7f1108089a90 2026-02-13T20:29:10.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.772+0000 7f110c907640 10 monclient: handle_config config(0 keys) 2026-02-13T20:29:10.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.772+0000 7f110c907640 1 -- 10.20.193.110:0/3314343789 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f11040044b0 con 0x7f1108089a90 2026-02-13T20:29:10.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.772+0000 7f110c907640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:10.774 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.772+0000 7f110c907640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:29:10.775 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.772+0000 7f110c907640 10 monclient: dump: 2026-02-13T20:29:10.775 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:10.775 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:10.775 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:10.775 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:10.775 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:10.775 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:10.775 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:10.775 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:10.775 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:10.775 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:10.775 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.772+0000 7f110fb94640 10 monclient: get_monmap_and_config success 2026-02-13T20:29:10.775 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.772+0000 7f110fb94640 4 set_mon_vals no callback set 2026-02-13T20:29:10.775 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.772+0000 7f110fb94640 10 monclient: shutdown 2026-02-13T20:29:10.775 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.772+0000 7f110fb94640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:29:10.775 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.772+0000 7f110fb94640 1 -- 10.20.193.110:0/3314343789 >> v1:10.20.193.110:6789/0 conn(0x7f1108089a90 legacy=0x7f11081a18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:10.775 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.772+0000 7f110fb94640 1 -- 10.20.193.110:0/3314343789 shutdown_connections 2026-02-13T20:29:10.775 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.772+0000 7f110fb94640 1 -- 10.20.193.110:0/3314343789 >> 10.20.193.110:0/3314343789 conn(0x7f1108054e90 msgr2=0x7f1108058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:29:10.775 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.772+0000 7f110fb94640 1 -- 10.20.193.110:0/3314343789 shutdown_connections 2026-02-13T20:29:10.775 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.772+0000 7f110fb94640 1 -- 10.20.193.110:0/3314343789 wait complete. 2026-02-13T20:29:10.776 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.772+0000 7f110fb94640 10 monclient: build_initial_monmap 2026-02-13T20:29:10.776 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.772+0000 7f110fb94640 10 monclient: monmap: 2026-02-13T20:29:10.776 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:29:10.776 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:29:10.776 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:29:10.776 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:29:10.776 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:29:10.776 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:29:10.776 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:29:10.776 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:29:10.776 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:29:10.777 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:10.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f110fb94640 1 Processor -- start 2026-02-13T20:29:10.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f110fb94640 1 -- start start 2026-02-13T20:29:10.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f110fb94640 10 monclient: init 2026-02-13T20:29:10.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f110fb94640 10 monclient: _reopen_session rank -1 2026-02-13T20:29:10.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f110fb94640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:29:10.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f110fb94640 10 monclient(hunting): picked mon.noname-b con 0x7f1108089a90 addr v1:10.20.193.188:6789/0 2026-02-13T20:29:10.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f110fb94640 10 monclient(hunting): picked mon.noname-a con 0x7f110813ee70 addr v1:10.20.193.110:6789/0 2026-02-13T20:29:10.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f110fb94640 10 monclient(hunting): picked mon.noname-c con 0x7f110813f280 addr v1:10.20.193.110:6790/0 2026-02-13T20:29:10.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f110fb94640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f110810ffb0 con 0x7f110813ee70 2026-02-13T20:29:10.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f110fb94640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f110805d320 con 0x7f1108089a90 2026-02-13T20:29:10.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f110fb94640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11081119e0 con 0x7f110813f280 2026-02-13T20:29:10.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f110fb94640 10 monclient(hunting): _renew_subs 2026-02-13T20:29:10.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f110fb94640 10 monclient(hunting): authenticate will time out at 1712.464512s 2026-02-13T20:29:10.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f110d108640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f110813ee70 0x7f1108133210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:58996/0 (socket says 10.20.193.110:58996) 2026-02-13T20:29:10.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f110e10a640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f110813f280 0x7f1108134930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:55306/0 (socket says 10.20.193.110:55306) 2026-02-13T20:29:10.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f110d108640 1 -- 10.20.193.110:0/2236049265 learned_addr learned my addr 10.20.193.110:0/2236049265 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:29:10.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f10f67fc640 1 -- 10.20.193.110:0/2236049265 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 682726321 0 0) 0x7f110810ffb0 con 0x7f110813ee70 2026-02-13T20:29:10.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f10f67fc640 10 monclient(hunting): _negotiate 2026-02-13T20:29:10.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f10f67fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:10.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f10f67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:10.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f10f67fc640 10 monclient(hunting): my global_id is 124566 2026-02-13T20:29:10.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f10f67fc640 1 -- 10.20.193.110:0/2236049265 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10d80035e0 con 0x7f110813ee70 2026-02-13T20:29:10.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f10f67fc640 1 -- 10.20.193.110:0/2236049265 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 597050075 0 0) 0x7f11081119e0 con 0x7f110813f280 2026-02-13T20:29:10.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f10f67fc640 10 monclient(hunting): _negotiate 2026-02-13T20:29:10.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f10f67fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:10.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f10f67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:10.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f10f67fc640 10 monclient(hunting): my global_id is 154283 2026-02-13T20:29:10.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f10f67fc640 1 -- 10.20.193.110:0/2236049265 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f110810ffb0 con 0x7f110813f280 2026-02-13T20:29:10.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f10f67fc640 1 -- 10.20.193.110:0/2236049265 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 812222292 0 0) 0x7f10d80035e0 con 0x7f110813ee70 2026-02-13T20:29:10.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f10f67fc640 1 -- 10.20.193.110:0/2236049265 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f11081119e0 con 0x7f110813ee70 2026-02-13T20:29:10.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f10f67fc640 1 -- 10.20.193.110:0/2236049265 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f10fc004050 con 0x7f110813ee70 2026-02-13T20:29:10.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f10f67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:29:10.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f10f67fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:29:10.777 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f10f67fc640 10 monclient(hunting): dump: 2026-02-13T20:29:10.777 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:10.777 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:10.777 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:10.777 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:10.777 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:10.777 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:10.777 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:10.777 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:10.777 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:10.778 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:10.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f10f67fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:29:10.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f10f67fc640 1 -- 10.20.193.110:0/2236049265 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4229006558 0 0) 0x7f110810ffb0 con 0x7f110813f280 2026-02-13T20:29:10.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f10f67fc640 1 -- 10.20.193.110:0/2236049265 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f10d80035e0 con 0x7f110813f280 2026-02-13T20:29:10.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f10f67fc640 1 -- 10.20.193.110:0/2236049265 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f1104003da0 con 0x7f110813f280 2026-02-13T20:29:10.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f10f67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:29:10.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f10f67fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:29:10.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f10f67fc640 10 monclient(hunting): dump: 2026-02-13T20:29:10.778 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:10.778 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:10.778 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:10.778 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:10.778 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:10.778 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:10.778 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:10.778 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:10.778 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:10.778 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:10.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f10f67fc640 1 -- 10.20.193.110:0/2236049265 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1519930827 0 0) 0x7f11081119e0 con 0x7f110813ee70 2026-02-13T20:29:10.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f10f67fc640 1 -- 10.20.193.110:0/2236049265 >> v1:10.20.193.110:6790/0 conn(0x7f110813f280 legacy=0x7f1108134930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:10.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f10f67fc640 1 -- 10.20.193.110:0/2236049265 >> v1:10.20.193.188:6789/0 conn(0x7f1108089a90 legacy=0x7f1108132200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:10.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f10f67fc640 10 monclient: _finish_hunting 0 2026-02-13T20:29:10.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f10f67fc640 1 monclient: found mon.a 2026-02-13T20:29:10.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f10f67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:29:10.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f10f67fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:29:10.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f10f67fc640 1 -- 10.20.193.110:0/2236049265 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1108111cc0 con 0x7f110813ee70 2026-02-13T20:29:10.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f10f67fc640 10 monclient: _finish_auth 0 2026-02-13T20:29:10.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f10f67fc640 10 monclient: _check_auth_tickets 2026-02-13T20:29:10.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f10f67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:29:10.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f110fb94640 5 monclient: authenticate success, global_id 124566 2026-02-13T20:29:10.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f110fb94640 10 monclient: _renew_subs 2026-02-13T20:29:10.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f110fb94640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:29:10.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f110fb94640 1 -- 10.20.193.110:0/2236049265 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1108112280 con 0x7f110813ee70 2026-02-13T20:29:10.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f110fb94640 10 monclient: _renew_subs 2026-02-13T20:29:10.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f110fb94640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:29:10.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.773+0000 7f110fb94640 1 -- 10.20.193.110:0/2236049265 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1108111fa0 con 0x7f110813ee70 2026-02-13T20:29:10.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.774+0000 7f10f67fc640 1 -- 10.20.193.110:0/2236049265 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f10fc004220 con 0x7f110813ee70 2026-02-13T20:29:10.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.774+0000 7f10f67fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:29:10.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.774+0000 7f10f67fc640 1 -- 10.20.193.110:0/2236049265 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f10fc002910 con 0x7f110813ee70 2026-02-13T20:29:10.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.774+0000 7f10f67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:10.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.774+0000 7f10f67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:29:10.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.774+0000 7f10f7fff640 4 set_mon_vals no callback set 2026-02-13T20:29:10.778 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.774+0000 7f10f67fc640 10 monclient: dump: 2026-02-13T20:29:10.778 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:10.778 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:10.779 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:10.779 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:10.779 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:10.779 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:10.779 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:10.779 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:10.779 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:10.779 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:10.779 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.774+0000 7f110fb94640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:10.779 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.774+0000 7f110fb94640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:10.779 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.774+0000 7f110fb94640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:29:10.779 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.774+0000 7f110fb94640 1 -- 10.20.193.110:0/2236049265 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11080008d0 con 0x7f110813ee70 2026-02-13T20:29:10.779 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.774+0000 7f10f67fc640 1 -- 10.20.193.110:0/2236049265 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f10fc002a70 con 0x7f110813ee70 2026-02-13T20:29:10.779 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.774+0000 7f10f67fc640 1 -- 10.20.193.110:0/2236049265 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(847..847 src has 1..847) ==== 3591+0+0 (unknown 4078645555 0 0) 0x7f10fc04e6d0 con 0x7f110813ee70 2026-02-13T20:29:10.779 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.774+0000 7f110d909640 10 monclient: get_auth_request con 0x7f10d803fa50 auth_method 0 2026-02-13T20:29:10.779 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.777+0000 7f10f67fc640 1 -- 10.20.193.110:0/2236049265 <== mon.0 v1:10.20.193.110:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f10fc0168f0 con 0x7f110813ee70 2026-02-13T20:29:10.779 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.777+0000 7f10f67fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:10.779 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.777+0000 7f10f67fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:29:10.881 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.879+0000 7f110fb94640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-13T20:29:10.881 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.879+0000 7f110fb94640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-13T20:29:10.881 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.879+0000 7f110fb94640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:29:10.881 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.879+0000 7f110fb94640 1 -- 10.20.193.110:0/2236049265 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1108058410 con 0x7f110813ee70 2026-02-13T20:29:10.881 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.879+0000 7f10f67fc640 1 -- 10.20.193.110:0/2236049265 <== mon.0 v1:10.20.193.110:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v847) ==== 74+0+11090 (unknown 1314010562 0 2652590912) 0x7f10fc016710 con 0x7f110813ee70 2026-02-13T20:29:10.881 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.879+0000 7f10f67fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-13T20:29:10.881 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.879+0000 7f10f67fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:29:10.881 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:29:10.881 INFO:teuthology.orchestra.run.trial110.stdout:{"epoch":847,"fsid":"edd4d072-2e11-43ec-9240-2fd608d0b4f8","created":"2026-02-13T20:11:18.047609+0000","modified":"2026-02-13T20:28:50.739018+0000","last_up_change":"2026-02-13T20:11:22.252754+0000","last_in_change":"2026-02-13T20:11:19.250528+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T20:11:24.136325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-13T20:11:27.043171+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"88457b09-7bbe-4ebe-8a8b-4c980153af2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6808","nonce":2638069221}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6809","nonce":2638069221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6811","nonce":2638069221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6810","nonce":2638069221}]},"public_addr":"10.20.193.110:6808/2638069221","cluster_addr":"10.20.193.110:6809/2638069221","heartbeat_back_addr":"10.20.193.110:6811/2638069221","heartbeat_front_addr":"10.20.193.110:6810/2638069221","state":["exists","up"]},{"osd":1,"uuid":"efb2f419-77ef-44b0-ae26-4c448073556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6800","nonce":3182322764}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6801","nonce":3182322764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6803","nonce":3182322764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6802","nonce":3182322764}]},"public_addr":"10.20.193.110:6800/3182322764","cluster_addr":"10.20.193.110:6801/3182322764","heartbeat_back_addr":"10.20.193.110:6803/3182322764","heartbeat_front_addr":"10.20.193.110:6802/3182322764","state":["exists","up"]},{"osd":2,"uuid":"c5a08402-8e10-4d4d-87fe-6236a6766128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6804","nonce":2437753968}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6805","nonce":2437753968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6807","nonce":2437753968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.110:6806","nonce":2437753968}]},"public_addr":"10.20.193.110:6804/2437753968","cluster_addr":"10.20.193.110:6805/2437753968","heartbeat_back_addr":"10.20.193.110:6807/2437753968","heartbeat_front_addr":"10.20.193.110:6806/2437753968","state":["exists","up"]},{"osd":3,"uuid":"3062e357-c62b-4a5d-a4b2-9715c16cfd37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6800","nonce":3648478668}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6801","nonce":3648478668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6803","nonce":3648478668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6802","nonce":3648478668}]},"public_addr":"10.20.193.188:6800/3648478668","cluster_addr":"10.20.193.188:6801/3648478668","heartbeat_back_addr":"10.20.193.188:6803/3648478668","heartbeat_front_addr":"10.20.193.188:6802/3648478668","state":["exists","up"]},{"osd":4,"uuid":"718e9755-3c16-47c8-9df8-c08e4193063d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6804","nonce":1615982170}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6806","nonce":1615982170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6810","nonce":1615982170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6808","nonce":1615982170}]},"public_addr":"10.20.193.188:6804/1615982170","cluster_addr":"10.20.193.188:6806/1615982170","heartbeat_back_addr":"10.20.193.188:6810/1615982170","heartbeat_front_addr":"10.20.193.188:6808/1615982170","state":["exists","up"]},{"osd":5,"uuid":"1508f970-10c7-486a-96d1-76881e826af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6805","nonce":4130810301}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6807","nonce":4130810301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6811","nonce":4130810301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.188:6809","nonce":4130810301}]},"public_addr":"10.20.193.188:6805/4130810301","cluster_addr":"10.20.193.188:6807/4130810301","heartbeat_back_addr":"10.20.193.188:6811/4130810301","heartbeat_front_addr":"10.20.193.188:6809/4130810301","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T20:11:20.798845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T20:11:20.817774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T20:11:20.860524+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T20:11:20.994431+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T20:11:20.970325+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T20:11:21.011291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":414,"length":2},{"begin":417,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":410,"length":1},{"begin":413,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T20:29:10.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.880+0000 7f110fb94640 1 -- 10.20.193.110:0/2236049265 >> v1:10.20.193.188:6812/1623052694 conn(0x7f10d803fa50 legacy=0x7f10d805ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:10.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.880+0000 7f110fb94640 10 monclient: shutdown 2026-02-13T20:29:10.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.880+0000 7f110fb94640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:29:10.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.880+0000 7f110fb94640 1 -- 10.20.193.110:0/2236049265 >> v1:10.20.193.110:6789/0 conn(0x7f110813ee70 legacy=0x7f1108133210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:10.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.880+0000 7f110fb94640 1 -- 10.20.193.110:0/2236049265 shutdown_connections 2026-02-13T20:29:10.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.881+0000 7f110fb94640 1 -- 10.20.193.110:0/2236049265 >> 10.20.193.110:0/2236049265 conn(0x7f1108054e90 msgr2=0x7f11081225a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:29:10.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.881+0000 7f110fb94640 1 -- 10.20.193.110:0/2236049265 shutdown_connections 2026-02-13T20:29:10.882 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:10.881+0000 7f110fb94640 1 -- 10.20.193.110:0/2236049265 wait complete. 2026-02-13T20:29:11.890 INFO:tasks.ceph:Scrubbing osd.0 2026-02-13T20:29:11.890 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-13T20:29:11.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.955+0000 7f88a7b65640 10 monclient: get_monmap_and_config 2026-02-13T20:29:11.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.955+0000 7f88a7b65640 10 monclient: build_initial_monmap 2026-02-13T20:29:11.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.955+0000 7f88a7b65640 10 monclient: monmap: 2026-02-13T20:29:11.963 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:29:11.963 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:11.963 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:29:11.957220+0000 2026-02-13T20:29:11.963 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:29:11.957220+0000 2026-02-13T20:29:11.963 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:29:11.963 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:11.963 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:29:11.963 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:29:11.963 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:29:11.963 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:11.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.956+0000 7f88a7b65640 1 Processor -- start 2026-02-13T20:29:11.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.956+0000 7f88a7b65640 1 -- start start 2026-02-13T20:29:11.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.956+0000 7f88a7b65640 10 monclient: init 2026-02-13T20:29:11.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.956+0000 7f88a7b65640 10 monclient: _reopen_session rank -1 2026-02-13T20:29:11.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.956+0000 7f88a7b65640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:29:11.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.956+0000 7f88a7b65640 10 monclient(hunting): picked mon.noname-c con 0x7f88a01401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:29:11.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.956+0000 7f88a7b65640 10 monclient(hunting): picked mon.noname-b con 0x7f88a0092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:29:11.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.956+0000 7f88a7b65640 10 monclient(hunting): picked mon.noname-a con 0x7f88a0091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:29:11.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.956+0000 7f88a7b65640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88a008b730 con 0x7f88a0091950 2026-02-13T20:29:11.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.956+0000 7f88a7b65640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88a005c5b0 con 0x7f88a01401c0 2026-02-13T20:29:11.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.956+0000 7f88a7b65640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88a008bcf0 con 0x7f88a0092020 2026-02-13T20:29:11.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.956+0000 7f88a7b65640 10 monclient(hunting): _renew_subs 2026-02-13T20:29:11.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.956+0000 7f88a7b65640 10 monclient(hunting): authenticate will time out at 1713.647567s 2026-02-13T20:29:11.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.956+0000 7f88a60db640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f88a0091950 0x7f88a01a2a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:34198/0 (socket says 10.20.193.110:34198) 2026-02-13T20:29:11.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.956+0000 7f88a50d9640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f88a0092020 0x7f88a01812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:57822/0 (socket says 10.20.193.110:57822) 2026-02-13T20:29:11.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.956+0000 7f88a60db640 1 -- 10.20.193.110:0/3840804851 learned_addr learned my addr 10.20.193.110:0/3840804851 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:29:11.963 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.956+0000 7f88a48d8640 1 -- 10.20.193.110:0/3840804851 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1789350248 0 0) 0x7f88a008b730 con 0x7f88a0091950 2026-02-13T20:29:11.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.956+0000 7f88a48d8640 10 monclient(hunting): _negotiate 2026-02-13T20:29:11.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.956+0000 7f88a48d8640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:11.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.956+0000 7f88a48d8640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:11.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.956+0000 7f88a48d8640 10 monclient(hunting): my global_id is 124569 2026-02-13T20:29:11.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.956+0000 7f88a48d8640 1 -- 10.20.193.110:0/3840804851 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88880035e0 con 0x7f88a0091950 2026-02-13T20:29:11.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.956+0000 7f88a48d8640 1 -- 10.20.193.110:0/3840804851 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2777059440 0 0) 0x7f88a008bcf0 con 0x7f88a0092020 2026-02-13T20:29:11.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.956+0000 7f88a48d8640 10 monclient(hunting): _negotiate 2026-02-13T20:29:11.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.956+0000 7f88a48d8640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:11.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.956+0000 7f88a48d8640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:11.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.956+0000 7f88a48d8640 10 monclient(hunting): my global_id is 154286 2026-02-13T20:29:11.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.956+0000 7f88a48d8640 1 -- 10.20.193.110:0/3840804851 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88a008b730 con 0x7f88a0092020 2026-02-13T20:29:11.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.957+0000 7f88a48d8640 1 -- 10.20.193.110:0/3840804851 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 690114425 0 0) 0x7f88880035e0 con 0x7f88a0091950 2026-02-13T20:29:11.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.957+0000 7f88a48d8640 1 -- 10.20.193.110:0/3840804851 >> v1:10.20.193.110:6790/0 conn(0x7f88a0092020 legacy=0x7f88a01812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:11.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.957+0000 7f88a48d8640 1 -- 10.20.193.110:0/3840804851 >> v1:10.20.193.188:6789/0 conn(0x7f88a01401c0 legacy=0x7f88a0091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T20:29:11.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.957+0000 7f88a48d8640 10 monclient: _finish_hunting 0 2026-02-13T20:29:11.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.957+0000 7f88a48d8640 1 monclient: found mon.noname-a 2026-02-13T20:29:11.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.957+0000 7f88a48d8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:29:11.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.957+0000 7f88a48d8640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:29:11.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.957+0000 7f88a48d8640 1 -- 10.20.193.110:0/3840804851 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88a0140590 con 0x7f88a0091950 2026-02-13T20:29:11.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.957+0000 7f88a48d8640 10 monclient: _finish_auth 0 2026-02-13T20:29:11.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.957+0000 7f88a48d8640 10 monclient: _check_auth_tickets 2026-02-13T20:29:11.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.957+0000 7f88a48d8640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:29:11.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.957+0000 7f88a48d8640 1 -- 10.20.193.110:0/3840804851 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f889c003eb0 con 0x7f88a0091950 2026-02-13T20:29:11.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.957+0000 7f88a48d8640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:11.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.957+0000 7f88a48d8640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:29:11.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.957+0000 7f88a48d8640 10 monclient: dump: 2026-02-13T20:29:11.964 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:11.964 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:11.964 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:11.964 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:11.964 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:11.964 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:11.964 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:11.964 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:11.964 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:11.964 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:11.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.957+0000 7f88a7b65640 5 monclient: authenticate success, global_id 124569 2026-02-13T20:29:11.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.957+0000 7f88a7b65640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:29:11.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.957+0000 7f88a48d8640 1 -- 10.20.193.110:0/3840804851 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f889c004100 con 0x7f88a0091950 2026-02-13T20:29:11.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.957+0000 7f88a48d8640 10 monclient: handle_config config(0 keys) 2026-02-13T20:29:11.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.957+0000 7f88a48d8640 1 -- 10.20.193.110:0/3840804851 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f889c004510 con 0x7f88a0091950 2026-02-13T20:29:11.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.957+0000 7f88a48d8640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:11.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.957+0000 7f88a48d8640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:29:11.964 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.957+0000 7f88a48d8640 10 monclient: dump: 2026-02-13T20:29:11.965 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:11.965 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:11.965 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:11.965 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:11.965 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:11.965 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:11.965 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:11.965 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:11.965 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:11.965 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:11.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.957+0000 7f88a7b65640 10 monclient: get_monmap_and_config success 2026-02-13T20:29:11.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.957+0000 7f88a7b65640 4 set_mon_vals no callback set 2026-02-13T20:29:11.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.957+0000 7f88a7b65640 10 monclient: shutdown 2026-02-13T20:29:11.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.957+0000 7f88a7b65640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:29:11.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.957+0000 7f88a7b65640 1 -- 10.20.193.110:0/3840804851 >> v1:10.20.193.110:6789/0 conn(0x7f88a0091950 legacy=0x7f88a01a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:11.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.957+0000 7f88a7b65640 1 -- 10.20.193.110:0/3840804851 shutdown_connections 2026-02-13T20:29:11.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.957+0000 7f88a7b65640 1 -- 10.20.193.110:0/3840804851 >> 10.20.193.110:0/3840804851 conn(0x7f88a0054e90 msgr2=0x7f88a0058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:29:11.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.957+0000 7f88a7b65640 1 -- 10.20.193.110:0/3840804851 shutdown_connections 2026-02-13T20:29:11.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.957+0000 7f88a7b65640 1 -- 10.20.193.110:0/3840804851 wait complete. 2026-02-13T20:29:11.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.957+0000 7f88a7b65640 10 monclient: build_initial_monmap 2026-02-13T20:29:11.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.957+0000 7f88a7b65640 10 monclient: monmap: 2026-02-13T20:29:11.965 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:29:11.965 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:29:11.965 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:29:11.965 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:29:11.965 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:29:11.965 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:29:11.965 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:29:11.965 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:29:11.965 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:29:11.965 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:11.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.958+0000 7f88a7b65640 1 Processor -- start 2026-02-13T20:29:11.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.958+0000 7f88a7b65640 1 -- start start 2026-02-13T20:29:11.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.958+0000 7f88a7b65640 10 monclient: init 2026-02-13T20:29:11.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.958+0000 7f88a7b65640 10 monclient: _reopen_session rank -1 2026-02-13T20:29:11.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.958+0000 7f88a7b65640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:29:11.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.958+0000 7f88a7b65640 10 monclient(hunting): picked mon.noname-b con 0x7f88a0091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:29:11.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.958+0000 7f88a7b65640 10 monclient(hunting): picked mon.noname-c con 0x7f88a01401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:29:11.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.958+0000 7f88a7b65640 10 monclient(hunting): picked mon.noname-a con 0x7f88a013eac0 addr v1:10.20.193.110:6789/0 2026-02-13T20:29:11.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.958+0000 7f88a7b65640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88a012da50 con 0x7f88a013eac0 2026-02-13T20:29:11.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.958+0000 7f88a7b65640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88a008c410 con 0x7f88a0091950 2026-02-13T20:29:11.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.958+0000 7f88a7b65640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88a005d320 con 0x7f88a01401c0 2026-02-13T20:29:11.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.958+0000 7f88a7b65640 10 monclient(hunting): _renew_subs 2026-02-13T20:29:11.965 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.958+0000 7f88a7b65640 10 monclient(hunting): authenticate will time out at 1713.649488s 2026-02-13T20:29:11.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.958+0000 7f88a50d9640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f88a01401c0 0x7f88a0191790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:57824/0 (socket says 10.20.193.110:57824) 2026-02-13T20:29:11.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.958+0000 7f88a60db640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f88a013eac0 0x7f88a0192eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:34214/0 (socket says 10.20.193.110:34214) 2026-02-13T20:29:11.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.958+0000 7f88a50d9640 1 -- 10.20.193.110:0/2898302078 learned_addr learned my addr 10.20.193.110:0/2898302078 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:29:11.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.958+0000 7f888e7fc640 1 -- 10.20.193.110:0/2898302078 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2518330755 0 0) 0x7f88a012da50 con 0x7f88a013eac0 2026-02-13T20:29:11.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.958+0000 7f888e7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:29:11.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.958+0000 7f888e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:11.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.958+0000 7f888e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:11.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.958+0000 7f888e7fc640 10 monclient(hunting): my global_id is 124572 2026-02-13T20:29:11.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.958+0000 7f888e7fc640 1 -- 10.20.193.110:0/2898302078 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88700035e0 con 0x7f88a013eac0 2026-02-13T20:29:11.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.958+0000 7f888e7fc640 1 -- 10.20.193.110:0/2898302078 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2350777482 0 0) 0x7f88a005d320 con 0x7f88a01401c0 2026-02-13T20:29:11.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.958+0000 7f888e7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:29:11.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.958+0000 7f888e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:11.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.958+0000 7f888e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:11.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.958+0000 7f888e7fc640 10 monclient(hunting): my global_id is 154289 2026-02-13T20:29:11.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.958+0000 7f888e7fc640 1 -- 10.20.193.110:0/2898302078 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88a012da50 con 0x7f88a01401c0 2026-02-13T20:29:11.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.958+0000 7f888e7fc640 1 -- 10.20.193.110:0/2898302078 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2662731888 0 0) 0x7f88700035e0 con 0x7f88a013eac0 2026-02-13T20:29:11.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.958+0000 7f888e7fc640 1 -- 10.20.193.110:0/2898302078 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f88a005d320 con 0x7f88a013eac0 2026-02-13T20:29:11.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.958+0000 7f888e7fc640 1 -- 10.20.193.110:0/2898302078 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f889c004420 con 0x7f88a013eac0 2026-02-13T20:29:11.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.958+0000 7f888e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:29:11.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.958+0000 7f888e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:29:11.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.958+0000 7f888e7fc640 10 monclient(hunting): dump: 2026-02-13T20:29:11.966 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:11.966 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:11.966 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:11.966 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:11.966 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:11.966 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:11.966 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:11.966 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:11.966 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:11.966 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:11.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.958+0000 7f888e7fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:29:11.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.958+0000 7f888e7fc640 1 -- 10.20.193.110:0/2898302078 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2396101915 0 0) 0x7f88a012da50 con 0x7f88a01401c0 2026-02-13T20:29:11.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.958+0000 7f888e7fc640 1 -- 10.20.193.110:0/2898302078 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f88700035e0 con 0x7f88a01401c0 2026-02-13T20:29:11.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.958+0000 7f888e7fc640 1 -- 10.20.193.110:0/2898302078 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f88940030f0 con 0x7f88a01401c0 2026-02-13T20:29:11.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.958+0000 7f888e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:29:11.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.958+0000 7f888e7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:29:11.966 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.958+0000 7f888e7fc640 10 monclient(hunting): dump: 2026-02-13T20:29:11.966 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:11.966 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:11.966 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:11.966 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:11.966 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:11.966 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:11.966 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:11.966 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:11.967 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:11.967 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:11.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.958+0000 7f888e7fc640 1 -- 10.20.193.110:0/2898302078 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1316317097 0 0) 0x7f88a005d320 con 0x7f88a013eac0 2026-02-13T20:29:11.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.958+0000 7f888e7fc640 1 -- 10.20.193.110:0/2898302078 >> v1:10.20.193.110:6790/0 conn(0x7f88a01401c0 legacy=0x7f88a0191790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:11.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.959+0000 7f888e7fc640 1 -- 10.20.193.110:0/2898302078 >> v1:10.20.193.188:6789/0 conn(0x7f88a0091950 legacy=0x7f88a013e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:11.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.959+0000 7f888e7fc640 10 monclient: _finish_hunting 0 2026-02-13T20:29:11.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.959+0000 7f888e7fc640 1 monclient: found mon.a 2026-02-13T20:29:11.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.959+0000 7f888e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:29:11.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.959+0000 7f888e7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:29:11.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.959+0000 7f888e7fc640 1 -- 10.20.193.110:0/2898302078 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88a012fdb0 con 0x7f88a013eac0 2026-02-13T20:29:11.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.959+0000 7f888e7fc640 10 monclient: _finish_auth 0 2026-02-13T20:29:11.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.959+0000 7f888e7fc640 10 monclient: _check_auth_tickets 2026-02-13T20:29:11.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.959+0000 7f888e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:29:11.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.959+0000 7f88a7b65640 5 monclient: authenticate success, global_id 124572 2026-02-13T20:29:11.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.959+0000 7f88a7b65640 10 monclient: _renew_subs 2026-02-13T20:29:11.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.959+0000 7f88a7b65640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:29:11.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.959+0000 7f88a7b65640 1 -- 10.20.193.110:0/2898302078 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f88a012f510 con 0x7f88a013eac0 2026-02-13T20:29:11.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.959+0000 7f88a7b65640 10 monclient: _renew_subs 2026-02-13T20:29:11.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.959+0000 7f88a7b65640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:29:11.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.959+0000 7f88a7b65640 1 -- 10.20.193.110:0/2898302078 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f88a0150660 con 0x7f88a013eac0 2026-02-13T20:29:11.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.959+0000 7f888e7fc640 1 -- 10.20.193.110:0/2898302078 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f889c0039d0 con 0x7f88a013eac0 2026-02-13T20:29:11.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.959+0000 7f888e7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:29:11.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.959+0000 7f888e7fc640 1 -- 10.20.193.110:0/2898302078 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f889c005de0 con 0x7f88a013eac0 2026-02-13T20:29:11.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.959+0000 7f888e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:11.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.959+0000 7f888ffff640 4 set_mon_vals no callback set 2026-02-13T20:29:11.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.959+0000 7f888e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:29:11.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.959+0000 7f888e7fc640 10 monclient: dump: 2026-02-13T20:29:11.967 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:11.967 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:11.967 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:11.967 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:11.967 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:11.967 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:11.967 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:11.967 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:11.967 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:11.967 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:11.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.959+0000 7f88a7b65640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:29:11.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.959+0000 7f88a7b65640 1 -- 10.20.193.110:0/2898302078 --> v1:10.20.193.110:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f88a008b450 con 0x7f88a013eac0 2026-02-13T20:29:11.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.959+0000 7f888e7fc640 1 -- 10.20.193.110:0/2898302078 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f889c012a50 con 0x7f88a013eac0 2026-02-13T20:29:11.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.959+0000 7f888e7fc640 1 -- 10.20.193.110:0/2898302078 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(847..847 src has 1..847) ==== 3591+0+0 (unknown 4078645555 0 0) 0x7f889c04f890 con 0x7f88a013eac0 2026-02-13T20:29:11.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.959+0000 7f888e7fc640 1 -- 10.20.193.110:0/2898302078 --> v1:10.20.193.110:6808/2638069221 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8870086340 con 0x7f88700646e0 2026-02-13T20:29:11.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.959+0000 7f888e7fc640 1 -- 10.20.193.110:0/2898302078 <== mon.0 v1:10.20.193.110:6789/0 9 ==== mon_get_version_reply(handle=1 version=847) ==== 24+0+0 (unknown 1600256361 0 0) 0x7f889c04fca0 con 0x7f88a013eac0 2026-02-13T20:29:11.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.959+0000 7f888e7fc640 10 monclient: handle_get_version_reply finishing 1 version 847 2026-02-13T20:29:11.967 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.960+0000 7f88a50d9640 10 monclient: get_auth_request con 0x7f88700646e0 auth_method 0 2026-02-13T20:29:11.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.960+0000 7f88a58da640 10 monclient: get_auth_request con 0x7f887003fa50 auth_method 0 2026-02-13T20:29:11.968 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.960+0000 7f888e7fc640 1 -- 10.20.193.110:0/2898302078 <== osd.0 v1:10.20.193.110:6808/2638069221 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (unknown 0 0 784407017) 0x7f8870086340 con 0x7f88700646e0 2026-02-13T20:29:11.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.967+0000 7f88a7b65640 1 -- 10.20.193.110:0/2898302078 --> v1:10.20.193.110:6808/2638069221 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f88a012e260 con 0x7f88700646e0 2026-02-13T20:29:11.969 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.967+0000 7f888e7fc640 1 -- 10.20.193.110:0/2898302078 <== osd.0 v1:10.20.193.110:6808/2638069221 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f88940078f0 con 0x7f88700646e0 2026-02-13T20:29:11.969 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:29:11.970 INFO:teuthology.orchestra.run.trial110.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-13T20:29:11.970 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:29:11.971 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.967+0000 7f88a7b65640 1 -- 10.20.193.110:0/2898302078 >> v1:10.20.193.110:6808/2638069221 conn(0x7f88700646e0 legacy=0x7f8870084af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:11.971 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.967+0000 7f88a7b65640 1 -- 10.20.193.110:0/2898302078 >> v1:10.20.193.188:6812/1623052694 conn(0x7f887003fa50 legacy=0x7f887005ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:11.971 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.967+0000 7f88a7b65640 10 monclient: shutdown 2026-02-13T20:29:11.971 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.967+0000 7f88a7b65640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:29:11.971 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.967+0000 7f88a7b65640 1 -- 10.20.193.110:0/2898302078 >> v1:10.20.193.110:6789/0 conn(0x7f88a013eac0 legacy=0x7f88a0192eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:11.971 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.967+0000 7f88a60db640 1 -- 10.20.193.110:0/2898302078 reap_dead start 2026-02-13T20:29:11.971 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.967+0000 7f88a7b65640 1 -- 10.20.193.110:0/2898302078 shutdown_connections 2026-02-13T20:29:11.971 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.967+0000 7f88a7b65640 1 -- 10.20.193.110:0/2898302078 >> 10.20.193.110:0/2898302078 conn(0x7f88a0054e90 msgr2=0x7f88a008de10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:29:11.972 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.967+0000 7f88a7b65640 1 -- 10.20.193.110:0/2898302078 shutdown_connections 2026-02-13T20:29:11.972 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:11.967+0000 7f88a7b65640 1 -- 10.20.193.110:0/2898302078 wait complete. 2026-02-13T20:29:11.974 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-13T20:29:12.041 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.039+0000 7f16da45b640 10 monclient: get_monmap_and_config 2026-02-13T20:29:12.041 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.039+0000 7f16da45b640 10 monclient: build_initial_monmap 2026-02-13T20:29:12.041 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.039+0000 7f16da45b640 10 monclient: monmap: 2026-02-13T20:29:12.041 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:29:12.041 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:12.041 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:29:12.041127+0000 2026-02-13T20:29:12.041 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:29:12.041127+0000 2026-02-13T20:29:12.041 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:29:12.041 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:12.041 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:29:12.041 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:29:12.041 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:29:12.041 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:12.041 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.040+0000 7f16da45b640 1 Processor -- start 2026-02-13T20:29:12.041 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.040+0000 7f16da45b640 1 -- start start 2026-02-13T20:29:12.041 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.040+0000 7f16da45b640 10 monclient: init 2026-02-13T20:29:12.042 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.040+0000 7f16da45b640 10 monclient: _reopen_session rank -1 2026-02-13T20:29:12.042 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.040+0000 7f16da45b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:29:12.042 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.040+0000 7f16da45b640 10 monclient(hunting): picked mon.noname-b con 0x7f16d41401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:29:12.042 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.040+0000 7f16da45b640 10 monclient(hunting): picked mon.noname-c con 0x7f16d4092020 addr v1:10.20.193.188:6789/0 2026-02-13T20:29:12.042 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.040+0000 7f16da45b640 10 monclient(hunting): picked mon.noname-a con 0x7f16d4091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:29:12.042 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.040+0000 7f16da45b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16d408b730 con 0x7f16d4091950 2026-02-13T20:29:12.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.040+0000 7f16da45b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16d405c5b0 con 0x7f16d4092020 2026-02-13T20:29:12.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.040+0000 7f16da45b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16d408bcf0 con 0x7f16d41401c0 2026-02-13T20:29:12.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.040+0000 7f16da45b640 10 monclient(hunting): _renew_subs 2026-02-13T20:29:12.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.040+0000 7f16da45b640 10 monclient(hunting): authenticate will time out at 1713.731486s 2026-02-13T20:29:12.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.040+0000 7f16d3fff640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f16d41401c0 0x7f16d4091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:57836/0 (socket says 10.20.193.110:57836) 2026-02-13T20:29:12.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.040+0000 7f16d3fff640 1 -- 10.20.193.110:0/3370581597 learned_addr learned my addr 10.20.193.110:0/3370581597 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:29:12.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.040+0000 7f16d2ffd640 1 -- 10.20.193.110:0/3370581597 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4136397584 0 0) 0x7f16d408bcf0 con 0x7f16d41401c0 2026-02-13T20:29:12.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.040+0000 7f16d2ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:29:12.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.040+0000 7f16d2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:12.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.040+0000 7f16d2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:12.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.040+0000 7f16d2ffd640 10 monclient(hunting): my global_id is 154292 2026-02-13T20:29:12.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.040+0000 7f16d2ffd640 1 -- 10.20.193.110:0/3370581597 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16b80035e0 con 0x7f16d41401c0 2026-02-13T20:29:12.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.040+0000 7f16d2ffd640 1 -- 10.20.193.110:0/3370581597 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3695721685 0 0) 0x7f16d408b730 con 0x7f16d4091950 2026-02-13T20:29:12.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.040+0000 7f16d2ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:29:12.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.040+0000 7f16d2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:12.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.040+0000 7f16d2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:12.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.040+0000 7f16d2ffd640 10 monclient(hunting): my global_id is 124575 2026-02-13T20:29:12.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.040+0000 7f16d2ffd640 1 -- 10.20.193.110:0/3370581597 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16d408bcf0 con 0x7f16d4091950 2026-02-13T20:29:12.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.040+0000 7f16d2ffd640 1 -- 10.20.193.110:0/3370581597 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2952342380 0 0) 0x7f16d405c5b0 con 0x7f16d4092020 2026-02-13T20:29:12.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.040+0000 7f16d2ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:29:12.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.040+0000 7f16d2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:12.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.040+0000 7f16d2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:12.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.040+0000 7f16d2ffd640 10 monclient(hunting): my global_id is 164137 2026-02-13T20:29:12.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.040+0000 7f16d2ffd640 1 -- 10.20.193.110:0/3370581597 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16d408b730 con 0x7f16d4092020 2026-02-13T20:29:12.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.041+0000 7f16d2ffd640 1 -- 10.20.193.110:0/3370581597 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 83323216 0 0) 0x7f16d408bcf0 con 0x7f16d4091950 2026-02-13T20:29:12.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.041+0000 7f16d2ffd640 1 -- 10.20.193.110:0/3370581597 >> v1:10.20.193.110:6790/0 conn(0x7f16d41401c0 legacy=0x7f16d4091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:12.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.041+0000 7f16d2ffd640 1 -- 10.20.193.110:0/3370581597 >> v1:10.20.193.188:6789/0 conn(0x7f16d4092020 legacy=0x7f16d41812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:12.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.041+0000 7f16d2ffd640 10 monclient: _finish_hunting 0 2026-02-13T20:29:12.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.041+0000 7f16d2ffd640 1 monclient: found mon.noname-a 2026-02-13T20:29:12.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.041+0000 7f16d2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:29:12.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.041+0000 7f16d2ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:29:12.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.041+0000 7f16d2ffd640 1 -- 10.20.193.110:0/3370581597 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16d4140590 con 0x7f16d4091950 2026-02-13T20:29:12.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.041+0000 7f16d2ffd640 10 monclient: _finish_auth 0 2026-02-13T20:29:12.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.041+0000 7f16d2ffd640 10 monclient: _check_auth_tickets 2026-02-13T20:29:12.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.041+0000 7f16d2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:29:12.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.041+0000 7f16d2ffd640 1 -- 10.20.193.110:0/3370581597 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f16c8003eb0 con 0x7f16d4091950 2026-02-13T20:29:12.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.041+0000 7f16da45b640 5 monclient: authenticate success, global_id 124575 2026-02-13T20:29:12.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.041+0000 7f16da45b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:29:12.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.041+0000 7f16d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:12.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.041+0000 7f16d2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:29:12.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.041+0000 7f16d2ffd640 10 monclient: dump: 2026-02-13T20:29:12.043 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:12.043 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:12.044 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.044 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.044 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:12.044 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:12.044 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:12.044 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:12.044 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:12.044 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:12.044 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.041+0000 7f16da45b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:29:12.044 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.041+0000 7f16d2ffd640 1 -- 10.20.193.110:0/3370581597 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f16c8004010 con 0x7f16d4091950 2026-02-13T20:29:12.044 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.041+0000 7f16d2ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:29:12.044 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.041+0000 7f16d2ffd640 1 -- 10.20.193.110:0/3370581597 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f16c8004420 con 0x7f16d4091950 2026-02-13T20:29:12.044 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.041+0000 7f16d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:12.044 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.041+0000 7f16d2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:29:12.044 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.041+0000 7f16d2ffd640 10 monclient: dump: 2026-02-13T20:29:12.044 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:12.044 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:12.044 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.044 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.044 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:12.044 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:12.044 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:12.044 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:12.044 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:12.044 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:12.044 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.041+0000 7f16da45b640 10 monclient: get_monmap_and_config success 2026-02-13T20:29:12.044 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.041+0000 7f16da45b640 4 set_mon_vals no callback set 2026-02-13T20:29:12.044 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.041+0000 7f16da45b640 10 monclient: shutdown 2026-02-13T20:29:12.044 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.041+0000 7f16da45b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:29:12.044 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.041+0000 7f16da45b640 1 -- 10.20.193.110:0/3370581597 >> v1:10.20.193.110:6789/0 conn(0x7f16d4091950 legacy=0x7f16d41a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:12.044 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.041+0000 7f16da45b640 1 -- 10.20.193.110:0/3370581597 shutdown_connections 2026-02-13T20:29:12.044 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.041+0000 7f16da45b640 1 -- 10.20.193.110:0/3370581597 >> 10.20.193.110:0/3370581597 conn(0x7f16d4054e90 msgr2=0x7f16d4058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:29:12.044 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.041+0000 7f16da45b640 1 -- 10.20.193.110:0/3370581597 shutdown_connections 2026-02-13T20:29:12.044 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.041+0000 7f16da45b640 1 -- 10.20.193.110:0/3370581597 wait complete. 2026-02-13T20:29:12.044 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.041+0000 7f16da45b640 10 monclient: build_initial_monmap 2026-02-13T20:29:12.044 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.041+0000 7f16da45b640 10 monclient: monmap: 2026-02-13T20:29:12.044 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:29:12.044 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:29:12.044 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:29:12.044 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:29:12.044 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:29:12.044 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:29:12.044 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:29:12.044 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:29:12.045 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:29:12.045 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:12.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.041+0000 7f16da45b640 1 Processor -- start 2026-02-13T20:29:12.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16da45b640 1 -- start start 2026-02-13T20:29:12.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16da45b640 10 monclient: init 2026-02-13T20:29:12.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16da45b640 10 monclient: _reopen_session rank -1 2026-02-13T20:29:12.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16da45b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:29:12.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16da45b640 10 monclient(hunting): picked mon.noname-b con 0x7f16d4091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:29:12.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16da45b640 10 monclient(hunting): picked mon.noname-a con 0x7f16d41401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:29:12.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16da45b640 10 monclient(hunting): picked mon.noname-c con 0x7f16d4117940 addr v1:10.20.193.110:6790/0 2026-02-13T20:29:12.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16da45b640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16d412e3b0 con 0x7f16d41401c0 2026-02-13T20:29:12.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16da45b640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16d412cfc0 con 0x7f16d4091950 2026-02-13T20:29:12.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16da45b640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16d412ea80 con 0x7f16d4117940 2026-02-13T20:29:12.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16da45b640 10 monclient(hunting): _renew_subs 2026-02-13T20:29:12.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16da45b640 10 monclient(hunting): authenticate will time out at 1713.733250s 2026-02-13T20:29:12.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16d89d1640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f16d4117940 0x7f16d41a2760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:57842/0 (socket says 10.20.193.110:57842) 2026-02-13T20:29:12.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16d89d1640 1 -- 10.20.193.110:0/3357404617 learned_addr learned my addr 10.20.193.110:0/3357404617 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:29:12.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16d37fe640 1 --1- 10.20.193.110:0/3357404617 >> v1:10.20.193.110:6789/0 conn(0x7f16d41401c0 0x7f16d41a1040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:34232/0 (socket says 10.20.193.110:34232) 2026-02-13T20:29:12.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16d0ff9640 1 -- 10.20.193.110:0/3357404617 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 817848598 0 0) 0x7f16d412e3b0 con 0x7f16d41401c0 2026-02-13T20:29:12.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16d0ff9640 10 monclient(hunting): _negotiate 2026-02-13T20:29:12.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16d0ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:12.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16d0ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:12.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16d0ff9640 10 monclient(hunting): my global_id is 124578 2026-02-13T20:29:12.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16d0ff9640 1 -- 10.20.193.110:0/3357404617 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16a40035e0 con 0x7f16d41401c0 2026-02-13T20:29:12.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16d0ff9640 1 -- 10.20.193.110:0/3357404617 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1507121611 0 0) 0x7f16d412ea80 con 0x7f16d4117940 2026-02-13T20:29:12.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16d0ff9640 10 monclient(hunting): _negotiate 2026-02-13T20:29:12.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16d0ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:12.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16d0ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:12.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16d0ff9640 10 monclient(hunting): my global_id is 154295 2026-02-13T20:29:12.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16d0ff9640 1 -- 10.20.193.110:0/3357404617 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16d412e3b0 con 0x7f16d4117940 2026-02-13T20:29:12.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16d0ff9640 1 -- 10.20.193.110:0/3357404617 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2139266479 0 0) 0x7f16a40035e0 con 0x7f16d41401c0 2026-02-13T20:29:12.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16d0ff9640 1 -- 10.20.193.110:0/3357404617 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f16d412ea80 con 0x7f16d41401c0 2026-02-13T20:29:12.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16d0ff9640 1 -- 10.20.193.110:0/3357404617 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f16c4003090 con 0x7f16d41401c0 2026-02-13T20:29:12.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16d0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:29:12.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16d0ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:29:12.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16d0ff9640 10 monclient(hunting): dump: 2026-02-13T20:29:12.046 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:12.047 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:12.047 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.047 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.047 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:12.047 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:12.047 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:12.047 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:12.047 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:12.047 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:12.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16d0ff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:29:12.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16d0ff9640 1 -- 10.20.193.110:0/3357404617 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4286780860 0 0) 0x7f16d412e3b0 con 0x7f16d4117940 2026-02-13T20:29:12.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16d0ff9640 1 -- 10.20.193.110:0/3357404617 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f16a40035e0 con 0x7f16d4117940 2026-02-13T20:29:12.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16d0ff9640 1 -- 10.20.193.110:0/3357404617 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f16c8003e70 con 0x7f16d4117940 2026-02-13T20:29:12.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16d0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:29:12.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16d0ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:29:12.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16d0ff9640 10 monclient(hunting): dump: 2026-02-13T20:29:12.047 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:12.047 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:12.047 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.047 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.047 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:12.047 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:12.047 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:12.047 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:12.047 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:12.047 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:12.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16d0ff9640 1 -- 10.20.193.110:0/3357404617 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2881286149 0 0) 0x7f16d412ea80 con 0x7f16d41401c0 2026-02-13T20:29:12.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16d0ff9640 1 -- 10.20.193.110:0/3357404617 >> v1:10.20.193.110:6790/0 conn(0x7f16d4117940 legacy=0x7f16d41a2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:12.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16d0ff9640 1 -- 10.20.193.110:0/3357404617 >> v1:10.20.193.188:6789/0 conn(0x7f16d4091950 legacy=0x7f16d4117230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:12.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16d0ff9640 10 monclient: _finish_hunting 0 2026-02-13T20:29:12.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16d0ff9640 1 monclient: found mon.a 2026-02-13T20:29:12.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16d0ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:29:12.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16d0ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:29:12.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16d0ff9640 1 -- 10.20.193.110:0/3357404617 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16d412ed60 con 0x7f16d41401c0 2026-02-13T20:29:12.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16d0ff9640 10 monclient: _finish_auth 0 2026-02-13T20:29:12.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16d0ff9640 10 monclient: _check_auth_tickets 2026-02-13T20:29:12.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16d0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:29:12.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16da45b640 5 monclient: authenticate success, global_id 124578 2026-02-13T20:29:12.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16da45b640 10 monclient: _renew_subs 2026-02-13T20:29:12.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16da45b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:29:12.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16da45b640 1 -- 10.20.193.110:0/3357404617 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f16d41a3e80 con 0x7f16d41401c0 2026-02-13T20:29:12.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16da45b640 10 monclient: _renew_subs 2026-02-13T20:29:12.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16da45b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:29:12.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16da45b640 1 -- 10.20.193.110:0/3357404617 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f16d41257e0 con 0x7f16d41401c0 2026-02-13T20:29:12.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16d0ff9640 1 -- 10.20.193.110:0/3357404617 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f16c40036d0 con 0x7f16d41401c0 2026-02-13T20:29:12.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16d0ff9640 10 monclient: handle_config config(0 keys) 2026-02-13T20:29:12.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16d0ff9640 1 -- 10.20.193.110:0/3357404617 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f16c4003ab0 con 0x7f16d41401c0 2026-02-13T20:29:12.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16d0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:12.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16d0ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:29:12.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16d0ff9640 10 monclient: dump: 2026-02-13T20:29:12.048 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:12.048 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:12.048 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.048 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.048 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:12.048 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:12.048 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:12.048 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:12.048 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:12.048 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:12.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.042+0000 7f16d27fc640 4 set_mon_vals no callback set 2026-02-13T20:29:12.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.043+0000 7f16da45b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:12.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.043+0000 7f16da45b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:12.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.043+0000 7f16da45b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:29:12.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.043+0000 7f16da45b640 1 -- 10.20.193.110:0/3357404617 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16d412ef50 con 0x7f16d41401c0 2026-02-13T20:29:12.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.043+0000 7f16d0ff9640 1 -- 10.20.193.110:0/3357404617 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f16c4003c10 con 0x7f16d41401c0 2026-02-13T20:29:12.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.043+0000 7f16d0ff9640 1 -- 10.20.193.110:0/3357404617 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(847..847 src has 1..847) ==== 3591+0+0 (unknown 4078645555 0 0) 0x7f16c404e7a0 con 0x7f16d41401c0 2026-02-13T20:29:12.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.043+0000 7f16d3fff640 10 monclient: get_auth_request con 0x7f16a403fa50 auth_method 0 2026-02-13T20:29:12.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.045+0000 7f16d0ff9640 1 -- 10.20.193.110:0/3357404617 <== mon.0 v1:10.20.193.110:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f16c4017030 con 0x7f16d41401c0 2026-02-13T20:29:12.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.045+0000 7f16d0ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:12.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.045+0000 7f16d0ff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:29:12.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.150+0000 7f16da45b640 1 -- 10.20.193.110:0/3357404617 --> v1:10.20.193.188:6812/1623052694 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f16d408b450 con 0x7f16a403fa50 2026-02-13T20:29:12.151 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.150+0000 7f16d0ff9640 1 -- 10.20.193.110:0/3357404617 <== mgr.4105 v1:10.20.193.188:6812/1623052694 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (unknown 2057319476 0 0) 0x7f16c0003430 con 0x7f16a403fa50 2026-02-13T20:29:12.152 INFO:teuthology.orchestra.run.trial110.stderr:instructed osd(s) 0 to deep-scrub 2026-02-13T20:29:12.152 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.151+0000 7f16da45b640 1 -- 10.20.193.110:0/3357404617 >> v1:10.20.193.188:6812/1623052694 conn(0x7f16a403fa50 legacy=0x7f16a405ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:12.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.151+0000 7f16da45b640 10 monclient: shutdown 2026-02-13T20:29:12.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.151+0000 7f16da45b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:29:12.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.151+0000 7f16da45b640 1 -- 10.20.193.110:0/3357404617 >> v1:10.20.193.110:6789/0 conn(0x7f16d41401c0 legacy=0x7f16d41a1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:12.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.151+0000 7f16da45b640 1 -- 10.20.193.110:0/3357404617 shutdown_connections 2026-02-13T20:29:12.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.151+0000 7f16da45b640 1 -- 10.20.193.110:0/3357404617 >> 10.20.193.110:0/3357404617 conn(0x7f16d4054e90 msgr2=0x7f16d413f010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:29:12.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.151+0000 7f16da45b640 1 -- 10.20.193.110:0/3357404617 shutdown_connections 2026-02-13T20:29:12.153 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.151+0000 7f16da45b640 1 -- 10.20.193.110:0/3357404617 wait complete. 2026-02-13T20:29:12.160 INFO:tasks.ceph:Scrubbing osd.1 2026-02-13T20:29:12.160 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-13T20:29:12.230 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.228+0000 7fef7570c640 10 monclient: get_monmap_and_config 2026-02-13T20:29:12.230 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.228+0000 7fef7570c640 10 monclient: build_initial_monmap 2026-02-13T20:29:12.230 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.228+0000 7fef7570c640 10 monclient: monmap: 2026-02-13T20:29:12.230 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:29:12.230 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:12.231 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:29:12.230222+0000 2026-02-13T20:29:12.231 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:29:12.230222+0000 2026-02-13T20:29:12.231 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:29:12.231 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:12.231 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:29:12.231 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:29:12.231 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:29:12.231 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:12.231 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.229+0000 7fef7570c640 1 Processor -- start 2026-02-13T20:29:12.231 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.229+0000 7fef7570c640 1 -- start start 2026-02-13T20:29:12.231 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.229+0000 7fef7570c640 10 monclient: init 2026-02-13T20:29:12.239 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.229+0000 7fef7570c640 10 monclient: _reopen_session rank -1 2026-02-13T20:29:12.239 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.229+0000 7fef7570c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:29:12.239 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.229+0000 7fef7570c640 10 monclient(hunting): picked mon.noname-c con 0x7fef701401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:29:12.239 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.229+0000 7fef7570c640 10 monclient(hunting): picked mon.noname-b con 0x7fef70092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:29:12.239 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.229+0000 7fef7570c640 10 monclient(hunting): picked mon.noname-a con 0x7fef70091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:29:12.239 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.229+0000 7fef7570c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef7008b730 con 0x7fef70091950 2026-02-13T20:29:12.239 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.229+0000 7fef7570c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef7005c5b0 con 0x7fef701401c0 2026-02-13T20:29:12.239 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.229+0000 7fef7570c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef7008bcf0 con 0x7fef70092020 2026-02-13T20:29:12.239 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.229+0000 7fef7570c640 10 monclient(hunting): _renew_subs 2026-02-13T20:29:12.239 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.229+0000 7fef7570c640 10 monclient(hunting): authenticate will time out at 1713.920584s 2026-02-13T20:29:12.240 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.229+0000 7fef6f7fe640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fef70091950 0x7fef701a2a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:34246/0 (socket says 10.20.193.110:34246) 2026-02-13T20:29:12.240 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.229+0000 7fef6e7fc640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fef70092020 0x7fef701812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:57856/0 (socket says 10.20.193.110:57856) 2026-02-13T20:29:12.240 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.229+0000 7fef6f7fe640 1 -- 10.20.193.110:0/1169234730 learned_addr learned my addr 10.20.193.110:0/1169234730 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:29:12.240 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.229+0000 7fef6dffb640 1 -- 10.20.193.110:0/1169234730 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 350608832 0 0) 0x7fef7008b730 con 0x7fef70091950 2026-02-13T20:29:12.240 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.229+0000 7fef6dffb640 10 monclient(hunting): _negotiate 2026-02-13T20:29:12.240 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.229+0000 7fef6dffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:12.240 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.229+0000 7fef6dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:12.240 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.229+0000 7fef6dffb640 10 monclient(hunting): my global_id is 124581 2026-02-13T20:29:12.240 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.229+0000 7fef6dffb640 1 -- 10.20.193.110:0/1169234730 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef5c0035e0 con 0x7fef70091950 2026-02-13T20:29:12.240 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.229+0000 7fef6dffb640 1 -- 10.20.193.110:0/1169234730 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 197470124 0 0) 0x7fef7008bcf0 con 0x7fef70092020 2026-02-13T20:29:12.240 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.229+0000 7fef6dffb640 10 monclient(hunting): _negotiate 2026-02-13T20:29:12.240 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.229+0000 7fef6dffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:12.241 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.229+0000 7fef6dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:12.241 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.229+0000 7fef6dffb640 10 monclient(hunting): my global_id is 154298 2026-02-13T20:29:12.241 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.229+0000 7fef6dffb640 1 -- 10.20.193.110:0/1169234730 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef7008b730 con 0x7fef70092020 2026-02-13T20:29:12.241 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.230+0000 7fef6dffb640 1 -- 10.20.193.110:0/1169234730 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1136431881 0 0) 0x7fef5c0035e0 con 0x7fef70091950 2026-02-13T20:29:12.241 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.230+0000 7fef6dffb640 1 -- 10.20.193.110:0/1169234730 >> v1:10.20.193.110:6790/0 conn(0x7fef70092020 legacy=0x7fef701812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:12.241 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.230+0000 7fef6dffb640 1 -- 10.20.193.110:0/1169234730 >> v1:10.20.193.188:6789/0 conn(0x7fef701401c0 legacy=0x7fef70091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:12.241 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.230+0000 7fef6dffb640 10 monclient: _finish_hunting 0 2026-02-13T20:29:12.241 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.230+0000 7fef6dffb640 1 monclient: found mon.noname-a 2026-02-13T20:29:12.241 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.230+0000 7fef6dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:29:12.241 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.230+0000 7fef6dffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:29:12.241 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.230+0000 7fef6dffb640 1 -- 10.20.193.110:0/1169234730 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef70140590 con 0x7fef70091950 2026-02-13T20:29:12.241 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.230+0000 7fef6dffb640 10 monclient: _finish_auth 0 2026-02-13T20:29:12.242 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.230+0000 7fef6dffb640 10 monclient: _check_auth_tickets 2026-02-13T20:29:12.242 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.230+0000 7fef6dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:29:12.242 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.230+0000 7fef6dffb640 1 -- 10.20.193.110:0/1169234730 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fef60003eb0 con 0x7fef70091950 2026-02-13T20:29:12.242 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.230+0000 7fef7570c640 5 monclient: authenticate success, global_id 124581 2026-02-13T20:29:12.242 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.230+0000 7fef7570c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:29:12.242 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.230+0000 7fef6dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:12.242 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.230+0000 7fef6dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:29:12.242 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.230+0000 7fef6dffb640 10 monclient: dump: 2026-02-13T20:29:12.242 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:12.242 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:12.242 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.242 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.242 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:12.243 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:12.243 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:12.243 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:12.243 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:12.243 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:12.243 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.230+0000 7fef7570c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:29:12.243 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.230+0000 7fef6dffb640 1 -- 10.20.193.110:0/1169234730 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fef60004080 con 0x7fef70091950 2026-02-13T20:29:12.243 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.230+0000 7fef6dffb640 10 monclient: handle_config config(0 keys) 2026-02-13T20:29:12.243 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.230+0000 7fef6dffb640 1 -- 10.20.193.110:0/1169234730 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fef60004490 con 0x7fef70091950 2026-02-13T20:29:12.243 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.230+0000 7fef7570c640 10 monclient: get_monmap_and_config success 2026-02-13T20:29:12.243 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.230+0000 7fef7570c640 4 set_mon_vals no callback set 2026-02-13T20:29:12.243 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.230+0000 7fef6dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:12.244 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.230+0000 7fef6dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:29:12.244 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.230+0000 7fef6dffb640 10 monclient: dump: 2026-02-13T20:29:12.244 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:12.244 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:12.244 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.244 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.244 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:12.244 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:12.244 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:12.244 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:12.244 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:12.244 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:12.245 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.230+0000 7fef7570c640 10 monclient: shutdown 2026-02-13T20:29:12.245 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.230+0000 7fef7570c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:29:12.245 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.230+0000 7fef7570c640 1 -- 10.20.193.110:0/1169234730 >> v1:10.20.193.110:6789/0 conn(0x7fef70091950 legacy=0x7fef701a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:12.245 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.230+0000 7fef7570c640 1 -- 10.20.193.110:0/1169234730 shutdown_connections 2026-02-13T20:29:12.245 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.230+0000 7fef7570c640 1 -- 10.20.193.110:0/1169234730 >> 10.20.193.110:0/1169234730 conn(0x7fef70054e90 msgr2=0x7fef70058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:29:12.245 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.230+0000 7fef7570c640 1 -- 10.20.193.110:0/1169234730 shutdown_connections 2026-02-13T20:29:12.245 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.230+0000 7fef7570c640 1 -- 10.20.193.110:0/1169234730 wait complete. 2026-02-13T20:29:12.245 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.230+0000 7fef7570c640 10 monclient: build_initial_monmap 2026-02-13T20:29:12.245 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.230+0000 7fef7570c640 10 monclient: monmap: 2026-02-13T20:29:12.245 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:29:12.245 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:29:12.245 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:29:12.245 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:29:12.246 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:29:12.246 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:29:12.246 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:29:12.246 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:29:12.246 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:29:12.246 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:12.246 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef7570c640 1 Processor -- start 2026-02-13T20:29:12.246 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef7570c640 1 -- start start 2026-02-13T20:29:12.246 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef7570c640 10 monclient: init 2026-02-13T20:29:12.246 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef7570c640 10 monclient: _reopen_session rank -1 2026-02-13T20:29:12.246 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef7570c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:29:12.246 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef7570c640 10 monclient(hunting): picked mon.noname-a con 0x7fef70091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:29:12.247 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef7570c640 10 monclient(hunting): picked mon.noname-c con 0x7fef701401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:29:12.247 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef7570c640 10 monclient(hunting): picked mon.noname-b con 0x7fef70152750 addr v1:10.20.193.188:6789/0 2026-02-13T20:29:12.247 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef7570c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef7013e7e0 con 0x7fef70091950 2026-02-13T20:29:12.247 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef7570c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef7013ec30 con 0x7fef70152750 2026-02-13T20:29:12.247 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef7570c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef70131130 con 0x7fef701401c0 2026-02-13T20:29:12.247 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef7570c640 10 monclient(hunting): _renew_subs 2026-02-13T20:29:12.247 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef7570c640 10 monclient(hunting): authenticate will time out at 1713.922304s 2026-02-13T20:29:12.247 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef6effd640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fef70091950 0x7fef7013d610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:34254/0 (socket says 10.20.193.110:34254) 2026-02-13T20:29:12.247 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef6effd640 1 -- 10.20.193.110:0/274163580 learned_addr learned my addr 10.20.193.110:0/274163580 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:29:12.247 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef4f7fe640 1 -- 10.20.193.110:0/274163580 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 573700410 0 0) 0x7fef7013e7e0 con 0x7fef70091950 2026-02-13T20:29:12.247 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef4f7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:29:12.247 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef4f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:12.248 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef4f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:12.248 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef4f7fe640 10 monclient(hunting): my global_id is 124584 2026-02-13T20:29:12.248 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef4f7fe640 1 -- 10.20.193.110:0/274163580 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef3c0035e0 con 0x7fef70091950 2026-02-13T20:29:12.248 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef4f7fe640 1 -- 10.20.193.110:0/274163580 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 796666862 0 0) 0x7fef70131130 con 0x7fef701401c0 2026-02-13T20:29:12.248 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef4f7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:29:12.248 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef4f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:12.248 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef4f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:12.248 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef4f7fe640 10 monclient(hunting): my global_id is 154301 2026-02-13T20:29:12.248 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef4f7fe640 1 -- 10.20.193.110:0/274163580 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef7013e7e0 con 0x7fef701401c0 2026-02-13T20:29:12.248 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef4f7fe640 1 -- 10.20.193.110:0/274163580 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2843478870 0 0) 0x7fef3c0035e0 con 0x7fef70091950 2026-02-13T20:29:12.248 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef4f7fe640 1 -- 10.20.193.110:0/274163580 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fef70131130 con 0x7fef70091950 2026-02-13T20:29:12.248 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef4f7fe640 1 -- 10.20.193.110:0/274163580 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fef640030e0 con 0x7fef70091950 2026-02-13T20:29:12.248 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef4f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:29:12.249 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef4f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:29:12.249 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef4f7fe640 10 monclient(hunting): dump: 2026-02-13T20:29:12.249 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:12.249 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:12.249 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.249 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.249 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:12.249 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:12.249 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:12.249 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:12.249 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:12.249 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:12.249 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef4f7fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:29:12.250 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef4f7fe640 1 -- 10.20.193.110:0/274163580 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3217213513 0 0) 0x7fef7013ec30 con 0x7fef70152750 2026-02-13T20:29:12.250 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef4f7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:29:12.250 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef4f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:12.250 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef4f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:12.250 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef4f7fe640 10 monclient(hunting): my global_id is 164146 2026-02-13T20:29:12.250 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef4f7fe640 1 -- 10.20.193.110:0/274163580 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef3c0035e0 con 0x7fef70152750 2026-02-13T20:29:12.250 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef4f7fe640 1 -- 10.20.193.110:0/274163580 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2299117883 0 0) 0x7fef7013e7e0 con 0x7fef701401c0 2026-02-13T20:29:12.250 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef4f7fe640 1 -- 10.20.193.110:0/274163580 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fef7013ec30 con 0x7fef701401c0 2026-02-13T20:29:12.250 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef4f7fe640 1 -- 10.20.193.110:0/274163580 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fef58003090 con 0x7fef701401c0 2026-02-13T20:29:12.250 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef4f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:29:12.250 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef4f7fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:29:12.250 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef4f7fe640 10 monclient(hunting): dump: 2026-02-13T20:29:12.251 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:12.251 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:12.251 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.251 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.251 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:12.251 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:12.251 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:12.251 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:12.251 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:12.251 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:12.251 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef4f7fe640 1 -- 10.20.193.110:0/274163580 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2160963320 0 0) 0x7fef70131130 con 0x7fef70091950 2026-02-13T20:29:12.251 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef4f7fe640 1 -- 10.20.193.110:0/274163580 >> v1:10.20.193.110:6790/0 conn(0x7fef701401c0 legacy=0x7fef70193ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:12.251 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef4f7fe640 1 -- 10.20.193.110:0/274163580 >> v1:10.20.193.188:6789/0 conn(0x7fef70152750 legacy=0x7fef701951f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:12.252 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef4f7fe640 10 monclient: _finish_hunting 0 2026-02-13T20:29:12.252 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef4f7fe640 1 monclient: found mon.a 2026-02-13T20:29:12.252 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef4f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:29:12.252 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef4f7fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:29:12.252 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef4f7fe640 1 -- 10.20.193.110:0/274163580 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef7005d320 con 0x7fef70091950 2026-02-13T20:29:12.252 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef4f7fe640 10 monclient: _finish_auth 0 2026-02-13T20:29:12.252 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef4f7fe640 10 monclient: _check_auth_tickets 2026-02-13T20:29:12.252 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef4f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:29:12.252 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef7570c640 5 monclient: authenticate success, global_id 124584 2026-02-13T20:29:12.252 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef7570c640 10 monclient: _renew_subs 2026-02-13T20:29:12.252 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef7570c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:29:12.252 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef7570c640 1 -- 10.20.193.110:0/274163580 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fef7012edd0 con 0x7fef70091950 2026-02-13T20:29:12.253 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef7570c640 10 monclient: _renew_subs 2026-02-13T20:29:12.253 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef7570c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:29:12.253 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef7570c640 1 -- 10.20.193.110:0/274163580 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fef7013dd20 con 0x7fef70091950 2026-02-13T20:29:12.253 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef4f7fe640 1 -- 10.20.193.110:0/274163580 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fef640032b0 con 0x7fef70091950 2026-02-13T20:29:12.253 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef4f7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:29:12.253 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef4f7fe640 1 -- 10.20.193.110:0/274163580 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fef64003980 con 0x7fef70091950 2026-02-13T20:29:12.253 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef4f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:12.253 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef4f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:29:12.253 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef4f7fe640 10 monclient: dump: 2026-02-13T20:29:12.253 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:12.253 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:12.253 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.254 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.254 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:12.254 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:12.254 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:12.254 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:12.254 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:12.254 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:12.254 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.231+0000 7fef6d7fa640 4 set_mon_vals no callback set 2026-02-13T20:29:12.254 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.232+0000 7fef7570c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:29:12.254 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.232+0000 7fef7570c640 1 -- 10.20.193.110:0/274163580 --> v1:10.20.193.110:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fef7008b450 con 0x7fef70091950 2026-02-13T20:29:12.254 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.232+0000 7fef4f7fe640 1 -- 10.20.193.110:0/274163580 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fef64003ae0 con 0x7fef70091950 2026-02-13T20:29:12.254 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.232+0000 7fef4f7fe640 1 -- 10.20.193.110:0/274163580 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(847..847 src has 1..847) ==== 3591+0+0 (unknown 4078645555 0 0) 0x7fef6404e7f0 con 0x7fef70091950 2026-02-13T20:29:12.254 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.232+0000 7fef4f7fe640 1 -- 10.20.193.110:0/274163580 --> v1:10.20.193.110:6800/3182322764 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fef3c086510 con 0x7fef3c0648b0 2026-02-13T20:29:12.255 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.232+0000 7fef4f7fe640 1 -- 10.20.193.110:0/274163580 <== mon.0 v1:10.20.193.110:6789/0 9 ==== mon_get_version_reply(handle=1 version=847) ==== 24+0+0 (unknown 1600256361 0 0) 0x7fef6404ec00 con 0x7fef70091950 2026-02-13T20:29:12.255 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.232+0000 7fef4f7fe640 10 monclient: handle_get_version_reply finishing 1 version 847 2026-02-13T20:29:12.255 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.232+0000 7fef6f7fe640 10 monclient: get_auth_request con 0x7fef3c0648b0 auth_method 0 2026-02-13T20:29:12.255 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.232+0000 7fef6e7fc640 10 monclient: get_auth_request con 0x7fef3c03fcc0 auth_method 0 2026-02-13T20:29:12.255 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.233+0000 7fef4f7fe640 1 -- 10.20.193.110:0/274163580 <== osd.1 v1:10.20.193.110:6800/3182322764 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (unknown 0 0 784407017) 0x7fef3c086510 con 0x7fef3c0648b0 2026-02-13T20:29:12.256 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.240+0000 7fef7570c640 1 -- 10.20.193.110:0/274163580 --> v1:10.20.193.110:6800/3182322764 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fef701531d0 con 0x7fef3c0648b0 2026-02-13T20:29:12.256 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.240+0000 7fef4f7fe640 1 -- 10.20.193.110:0/274163580 <== osd.1 v1:10.20.193.110:6800/3182322764 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fef60003ad0 con 0x7fef3c0648b0 2026-02-13T20:29:12.256 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:29:12.256 INFO:teuthology.orchestra.run.trial110.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-13T20:29:12.256 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:29:12.258 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.240+0000 7fef7570c640 1 -- 10.20.193.110:0/274163580 >> v1:10.20.193.110:6800/3182322764 conn(0x7fef3c0648b0 legacy=0x7fef3c084cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:12.258 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.240+0000 7fef7570c640 1 -- 10.20.193.110:0/274163580 >> v1:10.20.193.188:6812/1623052694 conn(0x7fef3c03fcc0 legacy=0x7fef3c060170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:12.258 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.240+0000 7fef7570c640 10 monclient: shutdown 2026-02-13T20:29:12.258 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.240+0000 7fef7570c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:29:12.258 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.240+0000 7fef7570c640 1 -- 10.20.193.110:0/274163580 >> v1:10.20.193.110:6789/0 conn(0x7fef70091950 legacy=0x7fef7013d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:12.258 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.240+0000 7fef6f7fe640 1 -- 10.20.193.110:0/274163580 reap_dead start 2026-02-13T20:29:12.258 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.240+0000 7fef7570c640 1 -- 10.20.193.110:0/274163580 shutdown_connections 2026-02-13T20:29:12.259 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.240+0000 7fef7570c640 1 -- 10.20.193.110:0/274163580 >> 10.20.193.110:0/274163580 conn(0x7fef70054e90 msgr2=0x7fef700898c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:29:12.259 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.240+0000 7fef7570c640 1 -- 10.20.193.110:0/274163580 shutdown_connections 2026-02-13T20:29:12.259 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.240+0000 7fef7570c640 1 -- 10.20.193.110:0/274163580 wait complete. 2026-02-13T20:29:12.259 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-13T20:29:12.325 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.324+0000 7f5b04d4c640 10 monclient: get_monmap_and_config 2026-02-13T20:29:12.326 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.324+0000 7f5b04d4c640 10 monclient: build_initial_monmap 2026-02-13T20:29:12.326 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.324+0000 7f5b04d4c640 10 monclient: monmap: 2026-02-13T20:29:12.326 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:29:12.326 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:12.326 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:29:12.326066+0000 2026-02-13T20:29:12.326 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:29:12.326066+0000 2026-02-13T20:29:12.326 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:29:12.326 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:12.326 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:29:12.327 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:29:12.327 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:29:12.327 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:12.335 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.325+0000 7f5b04d4c640 1 Processor -- start 2026-02-13T20:29:12.335 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.325+0000 7f5b04d4c640 1 -- start start 2026-02-13T20:29:12.335 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.325+0000 7f5b04d4c640 10 monclient: init 2026-02-13T20:29:12.335 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.325+0000 7f5b04d4c640 10 monclient: _reopen_session rank -1 2026-02-13T20:29:12.335 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.325+0000 7f5b04d4c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:29:12.335 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.325+0000 7f5b04d4c640 10 monclient(hunting): picked mon.noname-a con 0x7f5b001401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:29:12.335 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.325+0000 7f5b04d4c640 10 monclient(hunting): picked mon.noname-b con 0x7f5b00092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:29:12.335 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.325+0000 7f5b04d4c640 10 monclient(hunting): picked mon.noname-c con 0x7f5b00091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:29:12.335 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.325+0000 7f5b04d4c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b0008b730 con 0x7f5b001401c0 2026-02-13T20:29:12.335 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.325+0000 7f5b04d4c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b0005c5b0 con 0x7f5b00091950 2026-02-13T20:29:12.336 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.325+0000 7f5b04d4c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b0008bcf0 con 0x7f5b00092020 2026-02-13T20:29:12.336 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.325+0000 7f5b04d4c640 10 monclient(hunting): _renew_subs 2026-02-13T20:29:12.336 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.325+0000 7f5b04d4c640 10 monclient(hunting): authenticate will time out at 1714.016467s 2026-02-13T20:29:12.336 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.325+0000 7f5afdd74640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f5b00092020 0x7f5b001812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:57872/0 (socket says 10.20.193.110:57872) 2026-02-13T20:29:12.336 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.325+0000 7f5afe575640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f5b001401c0 0x7f5b00091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:34268/0 (socket says 10.20.193.110:34268) 2026-02-13T20:29:12.336 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.325+0000 7f5afdd74640 1 -- 10.20.193.110:0/3780609764 learned_addr learned my addr 10.20.193.110:0/3780609764 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:29:12.336 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.325+0000 7f5afd573640 1 -- 10.20.193.110:0/3780609764 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3873221425 0 0) 0x7f5b0008bcf0 con 0x7f5b00092020 2026-02-13T20:29:12.336 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.325+0000 7f5afd573640 10 monclient(hunting): _negotiate 2026-02-13T20:29:12.336 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.325+0000 7f5afd573640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:12.336 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.325+0000 7f5afd573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:12.336 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.325+0000 7f5afd573640 10 monclient(hunting): my global_id is 154304 2026-02-13T20:29:12.336 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.325+0000 7f5afd573640 1 -- 10.20.193.110:0/3780609764 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5aec0035e0 con 0x7f5b00092020 2026-02-13T20:29:12.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.325+0000 7f5afd573640 1 -- 10.20.193.110:0/3780609764 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3349800374 0 0) 0x7f5b0008b730 con 0x7f5b001401c0 2026-02-13T20:29:12.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.325+0000 7f5afd573640 10 monclient(hunting): _negotiate 2026-02-13T20:29:12.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.325+0000 7f5afd573640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:12.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.325+0000 7f5afd573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:12.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.325+0000 7f5afd573640 10 monclient(hunting): my global_id is 124587 2026-02-13T20:29:12.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.325+0000 7f5afd573640 1 -- 10.20.193.110:0/3780609764 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b0008bcf0 con 0x7f5b001401c0 2026-02-13T20:29:12.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.325+0000 7f5afd573640 1 -- 10.20.193.110:0/3780609764 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1085922388 0 0) 0x7f5aec0035e0 con 0x7f5b00092020 2026-02-13T20:29:12.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.325+0000 7f5afd573640 1 -- 10.20.193.110:0/3780609764 >> v1:10.20.193.188:6789/0 conn(0x7f5b00091950 legacy=0x7f5b001a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:12.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.325+0000 7f5afd573640 1 -- 10.20.193.110:0/3780609764 >> v1:10.20.193.110:6789/0 conn(0x7f5b001401c0 legacy=0x7f5b00091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:12.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.325+0000 7f5afd573640 10 monclient: _finish_hunting 0 2026-02-13T20:29:12.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.325+0000 7f5afd573640 1 monclient: found mon.noname-b 2026-02-13T20:29:12.337 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.325+0000 7f5afd573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:29:12.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.326+0000 7f5afd573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:29:12.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.326+0000 7f5afd573640 1 -- 10.20.193.110:0/3780609764 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b00140590 con 0x7f5b00092020 2026-02-13T20:29:12.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.326+0000 7f5afd573640 10 monclient: _finish_auth 0 2026-02-13T20:29:12.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.326+0000 7f5afd573640 10 monclient: _check_auth_tickets 2026-02-13T20:29:12.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.326+0000 7f5afd573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:29:12.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.326+0000 7f5afd573640 1 -- 10.20.193.110:0/3780609764 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f5ae8002dd0 con 0x7f5b00092020 2026-02-13T20:29:12.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.326+0000 7f5afd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:12.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.326+0000 7f5afd573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:29:12.338 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.326+0000 7f5afd573640 10 monclient: dump: 2026-02-13T20:29:12.338 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:12.338 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:12.338 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.338 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.339 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:12.339 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:12.339 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:12.339 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:12.339 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:12.339 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:12.339 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.326+0000 7f5b04d4c640 5 monclient: authenticate success, global_id 154304 2026-02-13T20:29:12.339 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.326+0000 7f5b04d4c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:29:12.339 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.326+0000 7f5afd573640 1 -- 10.20.193.110:0/3780609764 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5ae8002fe0 con 0x7f5b00092020 2026-02-13T20:29:12.339 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.326+0000 7f5afd573640 10 monclient: handle_config config(0 keys) 2026-02-13T20:29:12.339 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.326+0000 7f5afd573640 1 -- 10.20.193.110:0/3780609764 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f5ae80033f0 con 0x7f5b00092020 2026-02-13T20:29:12.339 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.326+0000 7f5afd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:12.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.326+0000 7f5afd573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:29:12.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.326+0000 7f5afd573640 10 monclient: dump: 2026-02-13T20:29:12.340 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:12.340 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:12.340 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.340 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.340 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:12.340 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:12.340 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:12.340 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:12.340 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:12.340 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:12.340 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.326+0000 7f5b04d4c640 10 monclient: get_monmap_and_config success 2026-02-13T20:29:12.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.326+0000 7f5b04d4c640 4 set_mon_vals no callback set 2026-02-13T20:29:12.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.326+0000 7f5b04d4c640 10 monclient: shutdown 2026-02-13T20:29:12.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.326+0000 7f5b04d4c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:29:12.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.326+0000 7f5b04d4c640 1 -- 10.20.193.110:0/3780609764 >> v1:10.20.193.110:6790/0 conn(0x7f5b00092020 legacy=0x7f5b001812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:12.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.326+0000 7f5b04d4c640 1 -- 10.20.193.110:0/3780609764 shutdown_connections 2026-02-13T20:29:12.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.326+0000 7f5b04d4c640 1 -- 10.20.193.110:0/3780609764 >> 10.20.193.110:0/3780609764 conn(0x7f5b00054e90 msgr2=0x7f5b00058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:29:12.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.326+0000 7f5b04d4c640 1 -- 10.20.193.110:0/3780609764 shutdown_connections 2026-02-13T20:29:12.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.326+0000 7f5b04d4c640 1 -- 10.20.193.110:0/3780609764 wait complete. 2026-02-13T20:29:12.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.326+0000 7f5b04d4c640 10 monclient: build_initial_monmap 2026-02-13T20:29:12.341 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.326+0000 7f5b04d4c640 10 monclient: monmap: 2026-02-13T20:29:12.341 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:29:12.342 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:29:12.342 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:29:12.342 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:29:12.342 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:29:12.342 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:29:12.342 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:29:12.342 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:29:12.343 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:29:12.343 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:12.343 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5b04d4c640 1 Processor -- start 2026-02-13T20:29:12.343 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5b04d4c640 1 -- start start 2026-02-13T20:29:12.343 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5b04d4c640 10 monclient: init 2026-02-13T20:29:12.343 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5b04d4c640 10 monclient: _reopen_session rank -1 2026-02-13T20:29:12.343 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5b04d4c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:29:12.343 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5b04d4c640 10 monclient(hunting): picked mon.noname-b con 0x7f5b00091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:29:12.343 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5b04d4c640 10 monclient(hunting): picked mon.noname-a con 0x7f5b001401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:29:12.343 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5b04d4c640 10 monclient(hunting): picked mon.noname-c con 0x7f5b00194930 addr v1:10.20.193.110:6790/0 2026-02-13T20:29:12.343 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5b04d4c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b00090f00 con 0x7f5b001401c0 2026-02-13T20:29:12.343 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5b04d4c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b0005d320 con 0x7f5b00091950 2026-02-13T20:29:12.344 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5b04d4c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b00130830 con 0x7f5b00194930 2026-02-13T20:29:12.344 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5b04d4c640 10 monclient(hunting): _renew_subs 2026-02-13T20:29:12.344 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5b04d4c640 10 monclient(hunting): authenticate will time out at 1714.018305s 2026-02-13T20:29:12.344 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5afdd74640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f5b001401c0 0x7f5b00089540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:34282/0 (socket says 10.20.193.110:34282) 2026-02-13T20:29:12.344 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5afdd74640 1 -- 10.20.193.110:0/3862221958 learned_addr learned my addr 10.20.193.110:0/3862221958 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:29:12.344 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5ae6ffd640 1 -- 10.20.193.110:0/3862221958 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1204102147 0 0) 0x7f5b00130830 con 0x7f5b00194930 2026-02-13T20:29:12.344 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5ae6ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:29:12.344 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5ae6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:12.344 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5ae6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:12.344 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5ae6ffd640 10 monclient(hunting): my global_id is 154307 2026-02-13T20:29:12.344 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5ae6ffd640 1 -- 10.20.193.110:0/3862221958 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5acc0035e0 con 0x7f5b00194930 2026-02-13T20:29:12.344 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5ae6ffd640 1 -- 10.20.193.110:0/3862221958 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3885825313 0 0) 0x7f5b00090f00 con 0x7f5b001401c0 2026-02-13T20:29:12.345 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5ae6ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:29:12.345 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5ae6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:12.345 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5ae6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:12.345 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5ae6ffd640 10 monclient(hunting): my global_id is 124590 2026-02-13T20:29:12.345 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5ae6ffd640 1 -- 10.20.193.110:0/3862221958 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b00130830 con 0x7f5b001401c0 2026-02-13T20:29:12.345 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5ae6ffd640 1 -- 10.20.193.110:0/3862221958 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1901420859 0 0) 0x7f5acc0035e0 con 0x7f5b00194930 2026-02-13T20:29:12.345 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5ae6ffd640 1 -- 10.20.193.110:0/3862221958 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5b00090f00 con 0x7f5b00194930 2026-02-13T20:29:12.345 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5ae6ffd640 1 -- 10.20.193.110:0/3862221958 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f5af00040d0 con 0x7f5b00194930 2026-02-13T20:29:12.345 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5ae6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:29:12.345 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5ae6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:29:12.345 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5ae6ffd640 10 monclient(hunting): dump: 2026-02-13T20:29:12.345 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:12.345 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:12.346 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.346 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.346 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:12.346 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:12.346 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:12.346 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:12.346 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:12.346 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:12.346 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5ae6ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:29:12.346 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5ae6ffd640 1 -- 10.20.193.110:0/3862221958 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2218322978 0 0) 0x7f5b00130830 con 0x7f5b001401c0 2026-02-13T20:29:12.346 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5ae6ffd640 1 -- 10.20.193.110:0/3862221958 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5acc0035e0 con 0x7f5b001401c0 2026-02-13T20:29:12.347 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5ae6ffd640 1 -- 10.20.193.110:0/3862221958 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f5ae8003300 con 0x7f5b001401c0 2026-02-13T20:29:12.347 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5ae6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:29:12.347 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5ae6ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:29:12.347 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5ae6ffd640 10 monclient(hunting): dump: 2026-02-13T20:29:12.347 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:12.347 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:12.347 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.347 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.347 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:12.347 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:12.347 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:12.347 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:12.347 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:12.348 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:12.348 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5ae6ffd640 1 -- 10.20.193.110:0/3862221958 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2585271494 0 0) 0x7f5b0005d320 con 0x7f5b00091950 2026-02-13T20:29:12.348 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5ae6ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:29:12.348 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5ae6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:12.348 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5ae6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:12.348 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5ae6ffd640 10 monclient(hunting): my global_id is 164152 2026-02-13T20:29:12.348 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5ae6ffd640 1 -- 10.20.193.110:0/3862221958 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b00130830 con 0x7f5b00091950 2026-02-13T20:29:12.348 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5ae6ffd640 1 -- 10.20.193.110:0/3862221958 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3380339890 0 0) 0x7f5b00090f00 con 0x7f5b00194930 2026-02-13T20:29:12.348 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5ae6ffd640 1 -- 10.20.193.110:0/3862221958 >> v1:10.20.193.188:6789/0 conn(0x7f5b00091950 legacy=0x7f5b00088e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:12.348 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5ae6ffd640 1 -- 10.20.193.110:0/3862221958 >> v1:10.20.193.110:6789/0 conn(0x7f5b001401c0 legacy=0x7f5b00089540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:12.348 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5ae6ffd640 10 monclient: _finish_hunting 0 2026-02-13T20:29:12.348 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5ae6ffd640 1 monclient: found mon.c 2026-02-13T20:29:12.348 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5ae6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:29:12.349 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5ae6ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:12.349 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5ae6ffd640 1 -- 10.20.193.110:0/3862221958 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b00131eb0 con 0x7f5b00194930 2026-02-13T20:29:12.349 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5ae6ffd640 10 monclient: _finish_auth 0 2026-02-13T20:29:12.349 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5ae6ffd640 10 monclient: _check_auth_tickets 2026-02-13T20:29:12.349 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5ae6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:29:12.349 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5b04d4c640 5 monclient: authenticate success, global_id 154307 2026-02-13T20:29:12.349 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5b04d4c640 10 monclient: _renew_subs 2026-02-13T20:29:12.349 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5b04d4c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:12.349 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5b04d4c640 1 -- 10.20.193.110:0/3862221958 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5b00089c50 con 0x7f5b00194930 2026-02-13T20:29:12.349 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5b04d4c640 10 monclient: _renew_subs 2026-02-13T20:29:12.349 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5b04d4c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:12.349 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5b04d4c640 1 -- 10.20.193.110:0/3862221958 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f5b0008a830 con 0x7f5b00194930 2026-02-13T20:29:12.349 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5ae6ffd640 1 -- 10.20.193.110:0/3862221958 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5af00042a0 con 0x7f5b00194930 2026-02-13T20:29:12.350 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5ae6ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:29:12.350 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5ae6ffd640 1 -- 10.20.193.110:0/3862221958 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f5af00048a0 con 0x7f5b00194930 2026-02-13T20:29:12.350 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5ae6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:12.350 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5ae6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:29:12.350 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5ae6ffd640 10 monclient: dump: 2026-02-13T20:29:12.350 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:12.350 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:12.350 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.350 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.350 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:12.350 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:12.350 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:12.351 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:12.351 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:12.351 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:12.351 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.327+0000 7f5afcd72640 4 set_mon_vals no callback set 2026-02-13T20:29:12.351 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.328+0000 7f5b04d4c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:12.351 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.328+0000 7f5b04d4c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:12.351 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.328+0000 7f5b04d4c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:12.351 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.328+0000 7f5b04d4c640 1 -- 10.20.193.110:0/3862221958 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b00131c30 con 0x7f5b00194930 2026-02-13T20:29:12.351 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.328+0000 7f5ae6ffd640 1 -- 10.20.193.110:0/3862221958 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f5af0004a00 con 0x7f5b00194930 2026-02-13T20:29:12.351 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.328+0000 7f5ae6ffd640 1 -- 10.20.193.110:0/3862221958 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(847..847 src has 1..847) ==== 3591+0+0 (unknown 4078645555 0 0) 0x7f5af004e5e0 con 0x7f5b00194930 2026-02-13T20:29:12.351 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.328+0000 7f5afe575640 10 monclient: get_auth_request con 0x7f5acc03fc70 auth_method 0 2026-02-13T20:29:12.351 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.331+0000 7f5ae6ffd640 1 -- 10.20.193.110:0/3862221958 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f5af0004ce0 con 0x7f5b00194930 2026-02-13T20:29:12.352 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.331+0000 7f5ae6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:12.352 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.331+0000 7f5ae6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:29:12.436 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.435+0000 7f5b04d4c640 1 -- 10.20.193.110:0/3862221958 --> v1:10.20.193.188:6812/1623052694 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f5b0008b450 con 0x7f5acc03fc70 2026-02-13T20:29:12.437 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.435+0000 7f5ae6ffd640 1 -- 10.20.193.110:0/3862221958 <== mgr.4105 v1:10.20.193.188:6812/1623052694 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (unknown 489605429 0 0) 0x7f5af4002fc0 con 0x7f5acc03fc70 2026-02-13T20:29:12.437 INFO:teuthology.orchestra.run.trial110.stderr:instructed osd(s) 1 to deep-scrub 2026-02-13T20:29:12.438 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.436+0000 7f5b04d4c640 1 -- 10.20.193.110:0/3862221958 >> v1:10.20.193.188:6812/1623052694 conn(0x7f5acc03fc70 legacy=0x7f5acc060120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:12.438 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.436+0000 7f5b04d4c640 10 monclient: shutdown 2026-02-13T20:29:12.438 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.436+0000 7f5b04d4c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:29:12.438 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.436+0000 7f5b04d4c640 1 -- 10.20.193.110:0/3862221958 >> v1:10.20.193.110:6790/0 conn(0x7f5b00194930 legacy=0x7f5b00194db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:12.438 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.436+0000 7f5b04d4c640 1 -- 10.20.193.110:0/3862221958 shutdown_connections 2026-02-13T20:29:12.438 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.436+0000 7f5b04d4c640 1 -- 10.20.193.110:0/3862221958 >> 10.20.193.110:0/3862221958 conn(0x7f5b00054e90 msgr2=0x7f5b0008dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:29:12.438 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.436+0000 7f5b04d4c640 1 -- 10.20.193.110:0/3862221958 shutdown_connections 2026-02-13T20:29:12.438 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.436+0000 7f5b04d4c640 1 -- 10.20.193.110:0/3862221958 wait complete. 2026-02-13T20:29:12.445 INFO:tasks.ceph:Scrubbing osd.2 2026-02-13T20:29:12.445 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-13T20:29:12.513 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.511+0000 7fa0471ed640 10 monclient: get_monmap_and_config 2026-02-13T20:29:12.513 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.511+0000 7fa0471ed640 10 monclient: build_initial_monmap 2026-02-13T20:29:12.513 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.511+0000 7fa0471ed640 10 monclient: monmap: 2026-02-13T20:29:12.513 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:29:12.513 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:12.513 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:29:12.513280+0000 2026-02-13T20:29:12.513 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:29:12.513280+0000 2026-02-13T20:29:12.514 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:29:12.514 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:12.514 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:29:12.514 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:29:12.514 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:29:12.514 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:12.522 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.512+0000 7fa0471ed640 1 Processor -- start 2026-02-13T20:29:12.522 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.512+0000 7fa0471ed640 1 -- start start 2026-02-13T20:29:12.522 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.512+0000 7fa0471ed640 10 monclient: init 2026-02-13T20:29:12.522 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.512+0000 7fa0471ed640 10 monclient: _reopen_session rank -1 2026-02-13T20:29:12.522 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.512+0000 7fa0471ed640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T20:29:12.522 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.512+0000 7fa0471ed640 10 monclient(hunting): picked mon.noname-b con 0x7fa0401401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:29:12.522 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.512+0000 7fa0471ed640 10 monclient(hunting): picked mon.noname-c con 0x7fa040092020 addr v1:10.20.193.188:6789/0 2026-02-13T20:29:12.522 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.512+0000 7fa0471ed640 10 monclient(hunting): picked mon.noname-a con 0x7fa040091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:29:12.522 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.512+0000 7fa0471ed640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa04008b730 con 0x7fa040091950 2026-02-13T20:29:12.522 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.512+0000 7fa0471ed640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa04005c5b0 con 0x7fa040092020 2026-02-13T20:29:12.523 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.512+0000 7fa0471ed640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa04008bcf0 con 0x7fa0401401c0 2026-02-13T20:29:12.523 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.512+0000 7fa0471ed640 10 monclient(hunting): _renew_subs 2026-02-13T20:29:12.523 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.512+0000 7fa0471ed640 10 monclient(hunting): authenticate will time out at 1714.203739s 2026-02-13T20:29:12.523 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.512+0000 7fa044f62640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fa0401401c0 0x7fa040091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:57894/0 (socket says 10.20.193.110:57894) 2026-02-13T20:29:12.523 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.512+0000 7fa044f62640 1 -- 10.20.193.110:0/1599032240 learned_addr learned my addr 10.20.193.110:0/1599032240 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:29:12.523 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.513+0000 7fa0377fe640 1 -- 10.20.193.110:0/1599032240 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3298659641 0 0) 0x7fa04008bcf0 con 0x7fa0401401c0 2026-02-13T20:29:12.523 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.513+0000 7fa0377fe640 10 monclient(hunting): _negotiate 2026-02-13T20:29:12.523 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.513+0000 7fa0377fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:12.523 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.513+0000 7fa0377fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:12.523 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.513+0000 7fa0377fe640 10 monclient(hunting): my global_id is 154310 2026-02-13T20:29:12.524 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.513+0000 7fa0377fe640 1 -- 10.20.193.110:0/1599032240 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa02c0035e0 con 0x7fa0401401c0 2026-02-13T20:29:12.524 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.513+0000 7fa0377fe640 1 -- 10.20.193.110:0/1599032240 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1247010644 0 0) 0x7fa04008b730 con 0x7fa040091950 2026-02-13T20:29:12.524 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.513+0000 7fa0377fe640 10 monclient(hunting): _negotiate 2026-02-13T20:29:12.524 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.513+0000 7fa0377fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:12.524 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.513+0000 7fa0377fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:12.524 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.513+0000 7fa0377fe640 10 monclient(hunting): my global_id is 124593 2026-02-13T20:29:12.524 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.513+0000 7fa0377fe640 1 -- 10.20.193.110:0/1599032240 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa04008bcf0 con 0x7fa040091950 2026-02-13T20:29:12.524 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.513+0000 7fa0377fe640 1 -- 10.20.193.110:0/1599032240 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 300586702 0 0) 0x7fa02c0035e0 con 0x7fa0401401c0 2026-02-13T20:29:12.524 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.513+0000 7fa0377fe640 1 -- 10.20.193.110:0/1599032240 >> v1:10.20.193.188:6789/0 conn(0x7fa040092020 legacy=0x7fa0401812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:12.524 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.513+0000 7fa0377fe640 1 -- 10.20.193.110:0/1599032240 >> v1:10.20.193.110:6789/0 conn(0x7fa040091950 legacy=0x7fa0401a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:12.524 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.513+0000 7fa0377fe640 10 monclient: _finish_hunting 0 2026-02-13T20:29:12.524 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.513+0000 7fa0377fe640 1 monclient: found mon.noname-b 2026-02-13T20:29:12.525 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.513+0000 7fa0377fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:29:12.525 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.513+0000 7fa0377fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:29:12.525 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.513+0000 7fa0377fe640 1 -- 10.20.193.110:0/1599032240 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa040140590 con 0x7fa0401401c0 2026-02-13T20:29:12.525 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.513+0000 7fa0377fe640 10 monclient: _finish_auth 0 2026-02-13T20:29:12.525 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.513+0000 7fa0377fe640 10 monclient: _check_auth_tickets 2026-02-13T20:29:12.525 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.513+0000 7fa0377fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:29:12.525 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.513+0000 7fa0377fe640 1 -- 10.20.193.110:0/1599032240 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa030002dd0 con 0x7fa0401401c0 2026-02-13T20:29:12.525 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.513+0000 7fa0377fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:12.525 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.513+0000 7fa0377fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:29:12.525 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.513+0000 7fa0377fe640 10 monclient: dump: 2026-02-13T20:29:12.525 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:12.525 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:12.526 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.526 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.526 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:12.526 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:12.526 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:12.526 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:12.526 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:12.526 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:12.526 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.513+0000 7fa0471ed640 5 monclient: authenticate success, global_id 154310 2026-02-13T20:29:12.526 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.513+0000 7fa0471ed640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:29:12.526 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.513+0000 7fa0377fe640 1 -- 10.20.193.110:0/1599032240 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa030003020 con 0x7fa0401401c0 2026-02-13T20:29:12.526 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.513+0000 7fa0377fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:29:12.526 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.513+0000 7fa0377fe640 1 -- 10.20.193.110:0/1599032240 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa030003430 con 0x7fa0401401c0 2026-02-13T20:29:12.527 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.513+0000 7fa0471ed640 10 monclient: get_monmap_and_config success 2026-02-13T20:29:12.527 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.513+0000 7fa0471ed640 4 set_mon_vals no callback set 2026-02-13T20:29:12.527 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.513+0000 7fa0377fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:12.527 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.513+0000 7fa0377fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:29:12.527 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.513+0000 7fa0377fe640 10 monclient: dump: 2026-02-13T20:29:12.527 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:12.527 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:12.527 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.527 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.527 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:12.527 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:12.527 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:12.528 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:12.528 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:12.528 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:12.528 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.513+0000 7fa0471ed640 10 monclient: shutdown 2026-02-13T20:29:12.528 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.513+0000 7fa0471ed640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:29:12.528 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.513+0000 7fa0471ed640 1 -- 10.20.193.110:0/1599032240 >> v1:10.20.193.110:6790/0 conn(0x7fa0401401c0 legacy=0x7fa040091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:12.528 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.513+0000 7fa0471ed640 1 -- 10.20.193.110:0/1599032240 shutdown_connections 2026-02-13T20:29:12.528 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.513+0000 7fa0471ed640 1 -- 10.20.193.110:0/1599032240 >> 10.20.193.110:0/1599032240 conn(0x7fa040054e90 msgr2=0x7fa040058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:29:12.528 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.513+0000 7fa0471ed640 1 -- 10.20.193.110:0/1599032240 shutdown_connections 2026-02-13T20:29:12.528 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.513+0000 7fa0471ed640 1 -- 10.20.193.110:0/1599032240 wait complete. 2026-02-13T20:29:12.528 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.514+0000 7fa0471ed640 10 monclient: build_initial_monmap 2026-02-13T20:29:12.528 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.514+0000 7fa0471ed640 10 monclient: monmap: 2026-02-13T20:29:12.529 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:29:12.529 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:29:12.529 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:29:12.529 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:29:12.529 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:29:12.529 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:29:12.529 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:29:12.529 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:29:12.529 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:29:12.529 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:12.529 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.514+0000 7fa0471ed640 1 Processor -- start 2026-02-13T20:29:12.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.514+0000 7fa0471ed640 1 -- start start 2026-02-13T20:29:12.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.514+0000 7fa0471ed640 10 monclient: init 2026-02-13T20:29:12.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.514+0000 7fa0471ed640 10 monclient: _reopen_session rank -1 2026-02-13T20:29:12.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.514+0000 7fa0471ed640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:29:12.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.514+0000 7fa0471ed640 10 monclient(hunting): picked mon.noname-a con 0x7fa040091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:29:12.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.514+0000 7fa0471ed640 10 monclient(hunting): picked mon.noname-b con 0x7fa0401401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:29:12.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.514+0000 7fa0471ed640 10 monclient(hunting): picked mon.noname-c con 0x7fa040152750 addr v1:10.20.193.110:6790/0 2026-02-13T20:29:12.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.514+0000 7fa0471ed640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa040130eb0 con 0x7fa040091950 2026-02-13T20:29:12.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.514+0000 7fa0471ed640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa040132130 con 0x7fa0401401c0 2026-02-13T20:29:12.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.514+0000 7fa0471ed640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa040091070 con 0x7fa040152750 2026-02-13T20:29:12.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.514+0000 7fa0471ed640 10 monclient(hunting): _renew_subs 2026-02-13T20:29:12.530 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.514+0000 7fa0471ed640 10 monclient(hunting): authenticate will time out at 1714.205696s 2026-02-13T20:29:12.531 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.514+0000 7fa044f62640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fa040091950 0x7fa04013e8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:34292/0 (socket says 10.20.193.110:34292) 2026-02-13T20:29:12.531 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.514+0000 7fa044f62640 1 -- 10.20.193.110:0/321779758 learned_addr learned my addr 10.20.193.110:0/321779758 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:29:12.531 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.514+0000 7fa0357fa640 1 -- 10.20.193.110:0/321779758 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3342805523 0 0) 0x7fa040091070 con 0x7fa040152750 2026-02-13T20:29:12.531 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.514+0000 7fa0357fa640 10 monclient(hunting): _negotiate 2026-02-13T20:29:12.531 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.514+0000 7fa0357fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:12.531 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.514+0000 7fa0357fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:12.531 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.514+0000 7fa0357fa640 10 monclient(hunting): my global_id is 154313 2026-02-13T20:29:12.531 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.514+0000 7fa0357fa640 1 -- 10.20.193.110:0/321779758 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0100035e0 con 0x7fa040152750 2026-02-13T20:29:12.531 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.514+0000 7fa0357fa640 1 -- 10.20.193.110:0/321779758 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4195546080 0 0) 0x7fa040130eb0 con 0x7fa040091950 2026-02-13T20:29:12.531 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.514+0000 7fa0357fa640 10 monclient(hunting): _negotiate 2026-02-13T20:29:12.531 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.514+0000 7fa0357fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:12.531 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.514+0000 7fa0357fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:12.532 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.514+0000 7fa0357fa640 10 monclient(hunting): my global_id is 124596 2026-02-13T20:29:12.532 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.514+0000 7fa0357fa640 1 -- 10.20.193.110:0/321779758 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa040091070 con 0x7fa040091950 2026-02-13T20:29:12.532 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.515+0000 7fa0357fa640 1 -- 10.20.193.110:0/321779758 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2540104033 0 0) 0x7fa040091070 con 0x7fa040091950 2026-02-13T20:29:12.532 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.515+0000 7fa0357fa640 1 -- 10.20.193.110:0/321779758 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa040130eb0 con 0x7fa040091950 2026-02-13T20:29:12.532 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.515+0000 7fa0357fa640 1 -- 10.20.193.110:0/321779758 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa030003340 con 0x7fa040091950 2026-02-13T20:29:12.532 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.515+0000 7fa0357fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:29:12.532 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.515+0000 7fa0357fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:29:12.532 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.515+0000 7fa0357fa640 10 monclient(hunting): dump: 2026-02-13T20:29:12.532 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:12.532 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:12.532 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.532 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.532 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:12.533 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:12.533 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:12.533 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:12.533 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:12.533 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:12.533 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.515+0000 7fa0357fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:29:12.533 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.515+0000 7fa0357fa640 1 -- 10.20.193.110:0/321779758 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 995750336 0 0) 0x7fa0100035e0 con 0x7fa040152750 2026-02-13T20:29:12.533 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.515+0000 7fa0357fa640 1 -- 10.20.193.110:0/321779758 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa040091070 con 0x7fa040152750 2026-02-13T20:29:12.533 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.515+0000 7fa0357fa640 1 -- 10.20.193.110:0/321779758 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa03c004170 con 0x7fa040152750 2026-02-13T20:29:12.533 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.515+0000 7fa0357fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:29:12.533 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.515+0000 7fa0357fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:29:12.533 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.515+0000 7fa0357fa640 10 monclient(hunting): dump: 2026-02-13T20:29:12.534 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:12.534 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:12.534 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.534 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.534 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:12.534 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:12.534 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:12.534 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:12.534 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:12.534 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:12.534 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.515+0000 7fa0357fa640 1 -- 10.20.193.110:0/321779758 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 633962410 0 0) 0x7fa040132130 con 0x7fa0401401c0 2026-02-13T20:29:12.534 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.515+0000 7fa0357fa640 10 monclient(hunting): _negotiate 2026-02-13T20:29:12.534 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.515+0000 7fa0357fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:12.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.515+0000 7fa0357fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:12.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.515+0000 7fa0357fa640 10 monclient(hunting): my global_id is 164158 2026-02-13T20:29:12.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.515+0000 7fa0357fa640 1 -- 10.20.193.110:0/321779758 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0100035e0 con 0x7fa0401401c0 2026-02-13T20:29:12.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.515+0000 7fa0357fa640 1 -- 10.20.193.110:0/321779758 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4261809746 0 0) 0x7fa040130eb0 con 0x7fa040091950 2026-02-13T20:29:12.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.515+0000 7fa0357fa640 1 -- 10.20.193.110:0/321779758 >> v1:10.20.193.110:6790/0 conn(0x7fa040152750 legacy=0x7fa0401951f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:12.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.515+0000 7fa0357fa640 1 -- 10.20.193.110:0/321779758 >> v1:10.20.193.188:6789/0 conn(0x7fa0401401c0 legacy=0x7fa040193ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:12.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.515+0000 7fa0357fa640 10 monclient: _finish_hunting 0 2026-02-13T20:29:12.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.515+0000 7fa0357fa640 1 monclient: found mon.a 2026-02-13T20:29:12.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.515+0000 7fa0357fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:29:12.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.515+0000 7fa0357fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:29:12.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.515+0000 7fa0357fa640 1 -- 10.20.193.110:0/321779758 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa04005d320 con 0x7fa040091950 2026-02-13T20:29:12.535 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.515+0000 7fa0357fa640 10 monclient: _finish_auth 0 2026-02-13T20:29:12.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.515+0000 7fa0357fa640 10 monclient: _check_auth_tickets 2026-02-13T20:29:12.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.515+0000 7fa0357fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:29:12.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.515+0000 7fa0471ed640 5 monclient: authenticate success, global_id 124596 2026-02-13T20:29:12.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.515+0000 7fa0471ed640 10 monclient: _renew_subs 2026-02-13T20:29:12.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.515+0000 7fa0471ed640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:29:12.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.515+0000 7fa0471ed640 1 -- 10.20.193.110:0/321779758 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa04008c410 con 0x7fa040091950 2026-02-13T20:29:12.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.515+0000 7fa0471ed640 10 monclient: _renew_subs 2026-02-13T20:29:12.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.515+0000 7fa0471ed640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:29:12.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.515+0000 7fa0471ed640 1 -- 10.20.193.110:0/321779758 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa0401323f0 con 0x7fa040091950 2026-02-13T20:29:12.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.515+0000 7fa0357fa640 1 -- 10.20.193.110:0/321779758 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa030002940 con 0x7fa040091950 2026-02-13T20:29:12.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.515+0000 7fa0357fa640 10 monclient: handle_config config(0 keys) 2026-02-13T20:29:12.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.515+0000 7fa0357fa640 1 -- 10.20.193.110:0/321779758 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fa030004e60 con 0x7fa040091950 2026-02-13T20:29:12.536 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.515+0000 7fa0357fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:12.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.515+0000 7fa0357fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:29:12.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.515+0000 7fa036ffd640 4 set_mon_vals no callback set 2026-02-13T20:29:12.537 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.515+0000 7fa0357fa640 10 monclient: dump: 2026-02-13T20:29:12.537 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:12.537 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:12.537 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.537 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.537 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:12.537 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:12.537 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:12.537 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:12.537 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:12.538 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:12.538 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.515+0000 7fa0471ed640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:29:12.538 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.515+0000 7fa0471ed640 1 -- 10.20.193.110:0/321779758 --> v1:10.20.193.110:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fa04008b450 con 0x7fa040091950 2026-02-13T20:29:12.538 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.515+0000 7fa0357fa640 1 -- 10.20.193.110:0/321779758 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fa030011ad0 con 0x7fa040091950 2026-02-13T20:29:12.538 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.516+0000 7fa0357fa640 1 -- 10.20.193.110:0/321779758 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(847..847 src has 1..847) ==== 3591+0+0 (unknown 4078645555 0 0) 0x7fa03004e900 con 0x7fa040091950 2026-02-13T20:29:12.538 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.516+0000 7fa0357fa640 1 -- 10.20.193.110:0/321779758 --> v1:10.20.193.110:6804/2437753968 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa010086480 con 0x7fa010064820 2026-02-13T20:29:12.538 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.516+0000 7fa0357fa640 1 -- 10.20.193.110:0/321779758 <== mon.0 v1:10.20.193.110:6789/0 9 ==== mon_get_version_reply(handle=1 version=847) ==== 24+0+0 (unknown 1600256361 0 0) 0x7fa03004ed10 con 0x7fa040091950 2026-02-13T20:29:12.538 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.516+0000 7fa0357fa640 10 monclient: handle_get_version_reply finishing 1 version 847 2026-02-13T20:29:12.538 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.516+0000 7fa045763640 10 monclient: get_auth_request con 0x7fa010064820 auth_method 0 2026-02-13T20:29:12.538 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.516+0000 7fa037fff640 10 monclient: get_auth_request con 0x7fa01003fc70 auth_method 0 2026-02-13T20:29:12.538 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.516+0000 7fa0357fa640 1 -- 10.20.193.110:0/321779758 <== osd.2 v1:10.20.193.110:6804/2437753968 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (unknown 0 0 784407017) 0x7fa010086480 con 0x7fa010064820 2026-02-13T20:29:12.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.524+0000 7fa0471ed640 1 -- 10.20.193.110:0/321779758 --> v1:10.20.193.110:6804/2437753968 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa04013efe0 con 0x7fa010064820 2026-02-13T20:29:12.539 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.524+0000 7fa0357fa640 1 -- 10.20.193.110:0/321779758 <== osd.2 v1:10.20.193.110:6804/2437753968 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fa04013efe0 con 0x7fa010064820 2026-02-13T20:29:12.539 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:29:12.540 INFO:teuthology.orchestra.run.trial110.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-13T20:29:12.540 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:29:12.541 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.524+0000 7fa0471ed640 1 -- 10.20.193.110:0/321779758 >> v1:10.20.193.110:6804/2437753968 conn(0x7fa010064820 legacy=0x7fa010084c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:12.541 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.524+0000 7fa0471ed640 1 -- 10.20.193.110:0/321779758 >> v1:10.20.193.188:6812/1623052694 conn(0x7fa01003fc70 legacy=0x7fa010060120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:12.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.524+0000 7fa0471ed640 10 monclient: shutdown 2026-02-13T20:29:12.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.524+0000 7fa0471ed640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:29:12.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.524+0000 7fa0471ed640 1 -- 10.20.193.110:0/321779758 >> v1:10.20.193.110:6789/0 conn(0x7fa040091950 legacy=0x7fa04013e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:12.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.524+0000 7fa045763640 1 -- 10.20.193.110:0/321779758 reap_dead start 2026-02-13T20:29:12.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.524+0000 7fa0471ed640 1 -- 10.20.193.110:0/321779758 shutdown_connections 2026-02-13T20:29:12.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.524+0000 7fa0471ed640 1 -- 10.20.193.110:0/321779758 >> 10.20.193.110:0/321779758 conn(0x7fa040054e90 msgr2=0x7fa040088e30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:29:12.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.524+0000 7fa0471ed640 1 -- 10.20.193.110:0/321779758 shutdown_connections 2026-02-13T20:29:12.542 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.524+0000 7fa0471ed640 1 -- 10.20.193.110:0/321779758 wait complete. 2026-02-13T20:29:12.543 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-13T20:29:12.619 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.608+0000 7f3541bb9640 10 monclient: get_monmap_and_config 2026-02-13T20:29:12.619 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.608+0000 7f3541bb9640 10 monclient: build_initial_monmap 2026-02-13T20:29:12.619 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.608+0000 7f3541bb9640 10 monclient: monmap: 2026-02-13T20:29:12.619 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:29:12.620 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:12.620 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:29:12.610064+0000 2026-02-13T20:29:12.620 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:29:12.610064+0000 2026-02-13T20:29:12.620 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:29:12.620 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:12.620 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:29:12.620 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:29:12.620 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:29:12.620 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:12.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.609+0000 7f3541bb9640 1 Processor -- start 2026-02-13T20:29:12.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.609+0000 7f3541bb9640 1 -- start start 2026-02-13T20:29:12.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.609+0000 7f3541bb9640 10 monclient: init 2026-02-13T20:29:12.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.609+0000 7f3541bb9640 10 monclient: _reopen_session rank -1 2026-02-13T20:29:12.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.609+0000 7f3541bb9640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:29:12.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.609+0000 7f3541bb9640 10 monclient(hunting): picked mon.noname-b con 0x7f353c1401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:29:12.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.609+0000 7f3541bb9640 10 monclient(hunting): picked mon.noname-a con 0x7f353c092020 addr v1:10.20.193.110:6789/0 2026-02-13T20:29:12.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.609+0000 7f3541bb9640 10 monclient(hunting): picked mon.noname-c con 0x7f353c091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:29:12.621 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.609+0000 7f3541bb9640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f353c08b730 con 0x7f353c092020 2026-02-13T20:29:12.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.609+0000 7f3541bb9640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f353c05c5b0 con 0x7f353c091950 2026-02-13T20:29:12.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.609+0000 7f3541bb9640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f353c08bcf0 con 0x7f353c1401c0 2026-02-13T20:29:12.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.609+0000 7f3541bb9640 10 monclient(hunting): _renew_subs 2026-02-13T20:29:12.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.609+0000 7f3541bb9640 10 monclient(hunting): authenticate will time out at 1714.300552s 2026-02-13T20:29:12.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.609+0000 7f353b7fe640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f353c1401c0 0x7f353c091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:57918/0 (socket says 10.20.193.110:57918) 2026-02-13T20:29:12.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.609+0000 7f353affd640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f353c092020 0x7f353c1812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:34296/0 (socket says 10.20.193.110:34296) 2026-02-13T20:29:12.622 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.609+0000 7f353b7fe640 1 -- 10.20.193.110:0/1171587149 learned_addr learned my addr 10.20.193.110:0/1171587149 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:29:12.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.609+0000 7f353a7fc640 1 -- 10.20.193.110:0/1171587149 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4192024466 0 0) 0x7f353c08b730 con 0x7f353c092020 2026-02-13T20:29:12.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.609+0000 7f353a7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:29:12.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.609+0000 7f353a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:12.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.609+0000 7f353a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:12.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.609+0000 7f353a7fc640 10 monclient(hunting): my global_id is 124599 2026-02-13T20:29:12.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.609+0000 7f353a7fc640 1 -- 10.20.193.110:0/1171587149 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35200035e0 con 0x7f353c092020 2026-02-13T20:29:12.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.609+0000 7f353a7fc640 1 -- 10.20.193.110:0/1171587149 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2221514031 0 0) 0x7f353c08bcf0 con 0x7f353c1401c0 2026-02-13T20:29:12.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.609+0000 7f353a7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:29:12.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.609+0000 7f353a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:12.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.609+0000 7f353a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:12.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.609+0000 7f353a7fc640 10 monclient(hunting): my global_id is 154316 2026-02-13T20:29:12.623 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.609+0000 7f353a7fc640 1 -- 10.20.193.110:0/1171587149 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f353c08b730 con 0x7f353c1401c0 2026-02-13T20:29:12.624 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.610+0000 7f353a7fc640 1 -- 10.20.193.110:0/1171587149 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 173692459 0 0) 0x7f35200035e0 con 0x7f353c092020 2026-02-13T20:29:12.624 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.610+0000 7f353a7fc640 1 -- 10.20.193.110:0/1171587149 >> v1:10.20.193.110:6790/0 conn(0x7f353c1401c0 legacy=0x7f353c091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:12.624 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.610+0000 7f353a7fc640 1 -- 10.20.193.110:0/1171587149 >> v1:10.20.193.188:6789/0 conn(0x7f353c091950 legacy=0x7f353c1a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T20:29:12.624 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.610+0000 7f353a7fc640 10 monclient: _finish_hunting 0 2026-02-13T20:29:12.624 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.610+0000 7f353a7fc640 1 monclient: found mon.noname-a 2026-02-13T20:29:12.624 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.610+0000 7f353a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:29:12.624 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.610+0000 7f353a7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:29:12.624 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.610+0000 7f353a7fc640 1 -- 10.20.193.110:0/1171587149 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f353c140590 con 0x7f353c092020 2026-02-13T20:29:12.624 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.610+0000 7f353a7fc640 10 monclient: _finish_auth 0 2026-02-13T20:29:12.624 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.610+0000 7f353a7fc640 10 monclient: _check_auth_tickets 2026-02-13T20:29:12.624 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.610+0000 7f353a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:29:12.624 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.610+0000 7f353a7fc640 1 -- 10.20.193.110:0/1171587149 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f352c002d00 con 0x7f353c092020 2026-02-13T20:29:12.625 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.610+0000 7f3541bb9640 5 monclient: authenticate success, global_id 124599 2026-02-13T20:29:12.625 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.610+0000 7f3541bb9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:29:12.625 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.610+0000 7f353a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:12.625 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.610+0000 7f353a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:29:12.625 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.610+0000 7f353a7fc640 10 monclient: dump: 2026-02-13T20:29:12.625 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:12.625 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:12.625 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.625 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.625 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:12.625 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:12.625 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:12.625 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:12.626 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:12.626 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:12.626 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.610+0000 7f3541bb9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:29:12.626 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.610+0000 7f353a7fc640 1 -- 10.20.193.110:0/1171587149 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f352c002ed0 con 0x7f353c092020 2026-02-13T20:29:12.626 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.610+0000 7f353a7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:29:12.626 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.610+0000 7f3541bb9640 10 monclient: get_monmap_and_config success 2026-02-13T20:29:12.626 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.610+0000 7f353a7fc640 1 -- 10.20.193.110:0/1171587149 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f352c0032e0 con 0x7f353c092020 2026-02-13T20:29:12.626 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.610+0000 7f3541bb9640 4 set_mon_vals no callback set 2026-02-13T20:29:12.626 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.610+0000 7f353a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:12.626 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.610+0000 7f353a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:29:12.626 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.610+0000 7f353a7fc640 10 monclient: dump: 2026-02-13T20:29:12.626 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:12.627 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:12.627 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.627 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.627 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:12.627 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:12.627 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:12.627 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:12.627 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:12.627 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:12.627 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.610+0000 7f3541bb9640 10 monclient: shutdown 2026-02-13T20:29:12.627 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.610+0000 7f3541bb9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:29:12.627 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.610+0000 7f3541bb9640 1 -- 10.20.193.110:0/1171587149 >> v1:10.20.193.110:6789/0 conn(0x7f353c092020 legacy=0x7f353c1812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:12.628 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.610+0000 7f3541bb9640 1 -- 10.20.193.110:0/1171587149 shutdown_connections 2026-02-13T20:29:12.628 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.610+0000 7f3541bb9640 1 -- 10.20.193.110:0/1171587149 >> 10.20.193.110:0/1171587149 conn(0x7f353c054e90 msgr2=0x7f353c058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:29:12.628 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.610+0000 7f3541bb9640 1 -- 10.20.193.110:0/1171587149 shutdown_connections 2026-02-13T20:29:12.628 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.610+0000 7f3541bb9640 1 -- 10.20.193.110:0/1171587149 wait complete. 2026-02-13T20:29:12.628 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.610+0000 7f3541bb9640 10 monclient: build_initial_monmap 2026-02-13T20:29:12.628 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.610+0000 7f3541bb9640 10 monclient: monmap: 2026-02-13T20:29:12.628 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:29:12.628 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:29:12.628 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:29:12.628 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:29:12.628 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:29:12.628 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:29:12.629 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:29:12.629 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:29:12.629 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:29:12.629 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:12.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3541bb9640 1 Processor -- start 2026-02-13T20:29:12.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3541bb9640 1 -- start start 2026-02-13T20:29:12.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3541bb9640 10 monclient: init 2026-02-13T20:29:12.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3541bb9640 10 monclient: _reopen_session rank -1 2026-02-13T20:29:12.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3541bb9640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T20:29:12.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3541bb9640 10 monclient(hunting): picked mon.noname-b con 0x7f353c091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:29:12.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3541bb9640 10 monclient(hunting): picked mon.noname-c con 0x7f353c1401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:29:12.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3541bb9640 10 monclient(hunting): picked mon.noname-a con 0x7f353c13f1b0 addr v1:10.20.193.110:6789/0 2026-02-13T20:29:12.629 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3541bb9640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f353c130160 con 0x7f353c13f1b0 2026-02-13T20:29:12.630 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3541bb9640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f353c08c2a0 con 0x7f353c091950 2026-02-13T20:29:12.630 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3541bb9640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f353c05d320 con 0x7f353c1401c0 2026-02-13T20:29:12.630 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3541bb9640 10 monclient(hunting): _renew_subs 2026-02-13T20:29:12.630 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3541bb9640 10 monclient(hunting): authenticate will time out at 1714.302381s 2026-02-13T20:29:12.630 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f353affd640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f353c1401c0 0x7f353c193940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:57922/0 (socket says 10.20.193.110:57922) 2026-02-13T20:29:12.630 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f353affd640 1 -- 10.20.193.110:0/1382232530 learned_addr learned my addr 10.20.193.110:0/1382232530 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:29:12.630 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f353bfff640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f353c13f1b0 0x7f353c195060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:34300/0 (socket says 10.20.193.110:34300) 2026-02-13T20:29:12.630 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3517fff640 1 -- 10.20.193.110:0/1382232530 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1320627128 0 0) 0x7f353c05d320 con 0x7f353c1401c0 2026-02-13T20:29:12.630 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3517fff640 10 monclient(hunting): _negotiate 2026-02-13T20:29:12.630 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3517fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:12.630 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3517fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:12.630 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3517fff640 10 monclient(hunting): my global_id is 154319 2026-02-13T20:29:12.631 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3517fff640 1 -- 10.20.193.110:0/1382232530 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f350c0035e0 con 0x7f353c1401c0 2026-02-13T20:29:12.631 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3517fff640 1 -- 10.20.193.110:0/1382232530 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2205136971 0 0) 0x7f353c130160 con 0x7f353c13f1b0 2026-02-13T20:29:12.631 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3517fff640 10 monclient(hunting): _negotiate 2026-02-13T20:29:12.631 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3517fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:12.631 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3517fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:12.631 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3517fff640 10 monclient(hunting): my global_id is 124602 2026-02-13T20:29:12.631 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3517fff640 1 -- 10.20.193.110:0/1382232530 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f353c05d320 con 0x7f353c13f1b0 2026-02-13T20:29:12.631 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3517fff640 1 -- 10.20.193.110:0/1382232530 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3590006392 0 0) 0x7f350c0035e0 con 0x7f353c1401c0 2026-02-13T20:29:12.631 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3517fff640 1 -- 10.20.193.110:0/1382232530 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f353c130160 con 0x7f353c1401c0 2026-02-13T20:29:12.631 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3517fff640 1 -- 10.20.193.110:0/1382232530 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4016753998 0 0) 0x7f353c05d320 con 0x7f353c13f1b0 2026-02-13T20:29:12.631 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3517fff640 1 -- 10.20.193.110:0/1382232530 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f350c0035e0 con 0x7f353c13f1b0 2026-02-13T20:29:12.631 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3517fff640 1 -- 10.20.193.110:0/1382232530 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f352c002c10 con 0x7f353c1401c0 2026-02-13T20:29:12.632 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3517fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:29:12.632 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3517fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:29:12.632 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3517fff640 10 monclient(hunting): dump: 2026-02-13T20:29:12.632 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:12.632 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:12.632 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.632 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.632 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:12.632 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:12.632 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:12.632 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:12.632 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:12.632 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:12.633 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3517fff640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:29:12.633 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3517fff640 1 -- 10.20.193.110:0/1382232530 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f3530004fd0 con 0x7f353c13f1b0 2026-02-13T20:29:12.633 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3517fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:29:12.633 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3517fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:29:12.633 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3517fff640 10 monclient(hunting): dump: 2026-02-13T20:29:12.633 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:12.633 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:12.633 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.633 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.633 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:12.633 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:12.633 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:12.634 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:12.634 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:12.634 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:12.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3517fff640 1 -- 10.20.193.110:0/1382232530 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2003832141 0 0) 0x7f353c130160 con 0x7f353c1401c0 2026-02-13T20:29:12.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3517fff640 1 -- 10.20.193.110:0/1382232530 >> v1:10.20.193.188:6789/0 conn(0x7f353c091950 legacy=0x7f353c13eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:12.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3517fff640 1 -- 10.20.193.110:0/1382232530 >> v1:10.20.193.110:6789/0 conn(0x7f353c13f1b0 legacy=0x7f353c195060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:12.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3517fff640 10 monclient: _finish_hunting 0 2026-02-13T20:29:12.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3517fff640 1 monclient: found mon.c 2026-02-13T20:29:12.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3517fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:29:12.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3517fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:12.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3517fff640 1 -- 10.20.193.110:0/1382232530 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f353c1324c0 con 0x7f353c1401c0 2026-02-13T20:29:12.634 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3517fff640 10 monclient: _finish_auth 0 2026-02-13T20:29:12.635 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3517fff640 10 monclient: _check_auth_tickets 2026-02-13T20:29:12.635 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3517fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:29:12.635 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3541bb9640 5 monclient: authenticate success, global_id 154319 2026-02-13T20:29:12.635 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3541bb9640 10 monclient: _renew_subs 2026-02-13T20:29:12.635 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3541bb9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:12.635 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3541bb9640 1 -- 10.20.193.110:0/1382232530 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f353c131c20 con 0x7f353c1401c0 2026-02-13T20:29:12.635 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3541bb9640 10 monclient: _renew_subs 2026-02-13T20:29:12.635 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3541bb9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:12.635 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.611+0000 7f3541bb9640 1 -- 10.20.193.110:0/1382232530 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f353c130e60 con 0x7f353c1401c0 2026-02-13T20:29:12.635 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.612+0000 7f3517fff640 1 -- 10.20.193.110:0/1382232530 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f352c004b50 con 0x7f353c1401c0 2026-02-13T20:29:12.635 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.612+0000 7f3517fff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:29:12.635 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.612+0000 7f3517fff640 1 -- 10.20.193.110:0/1382232530 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f352c004e70 con 0x7f353c1401c0 2026-02-13T20:29:12.635 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.612+0000 7f3517fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:12.636 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.612+0000 7f3517fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:29:12.636 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.612+0000 7f3517fff640 10 monclient: dump: 2026-02-13T20:29:12.636 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:12.636 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:12.636 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.636 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.636 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:12.636 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:12.636 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:12.636 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:12.636 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:12.636 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:12.637 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.612+0000 7f3539ffb640 4 set_mon_vals no callback set 2026-02-13T20:29:12.637 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.612+0000 7f3541bb9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:12.637 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.612+0000 7f3541bb9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:12.637 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.612+0000 7f3541bb9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:12.637 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.612+0000 7f3541bb9640 1 -- 10.20.193.110:0/1382232530 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f353c0008d0 con 0x7f353c1401c0 2026-02-13T20:29:12.637 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.612+0000 7f3517fff640 1 -- 10.20.193.110:0/1382232530 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f352c011ae0 con 0x7f353c1401c0 2026-02-13T20:29:12.637 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.613+0000 7f3517fff640 1 -- 10.20.193.110:0/1382232530 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(847..847 src has 1..847) ==== 3591+0+0 (unknown 4078645555 0 0) 0x7f352c04e8a0 con 0x7f353c1401c0 2026-02-13T20:29:12.637 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.613+0000 7f353b7fe640 10 monclient: get_auth_request con 0x7f350c03f9a0 auth_method 0 2026-02-13T20:29:12.637 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.615+0000 7f3517fff640 1 -- 10.20.193.110:0/1382232530 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f352c017190 con 0x7f353c1401c0 2026-02-13T20:29:12.637 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.615+0000 7f3517fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:12.637 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.615+0000 7f3517fff640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:29:12.719 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.718+0000 7f3541bb9640 1 -- 10.20.193.110:0/1382232530 --> v1:10.20.193.188:6812/1623052694 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f353c08b450 con 0x7f350c03f9a0 2026-02-13T20:29:12.719 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.718+0000 7f3517fff640 1 -- 10.20.193.110:0/1382232530 <== mgr.4105 v1:10.20.193.188:6812/1623052694 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (unknown 3049115190 0 0) 0x7f3528002c50 con 0x7f350c03f9a0 2026-02-13T20:29:12.720 INFO:teuthology.orchestra.run.trial110.stderr:instructed osd(s) 2 to deep-scrub 2026-02-13T20:29:12.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.719+0000 7f3541bb9640 1 -- 10.20.193.110:0/1382232530 >> v1:10.20.193.188:6812/1623052694 conn(0x7f350c03f9a0 legacy=0x7f350c05fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:12.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.719+0000 7f3541bb9640 10 monclient: shutdown 2026-02-13T20:29:12.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.719+0000 7f3541bb9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:29:12.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.719+0000 7f3541bb9640 1 -- 10.20.193.110:0/1382232530 >> v1:10.20.193.110:6790/0 conn(0x7f353c1401c0 legacy=0x7f353c193940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:12.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.719+0000 7f3541bb9640 1 -- 10.20.193.110:0/1382232530 shutdown_connections 2026-02-13T20:29:12.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.719+0000 7f3541bb9640 1 -- 10.20.193.110:0/1382232530 >> 10.20.193.110:0/1382232530 conn(0x7f353c054e90 msgr2=0x7f353c089f40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:29:12.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.719+0000 7f3541bb9640 1 -- 10.20.193.110:0/1382232530 shutdown_connections 2026-02-13T20:29:12.721 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.719+0000 7f3541bb9640 1 -- 10.20.193.110:0/1382232530 wait complete. 2026-02-13T20:29:12.728 INFO:tasks.ceph:Scrubbing osd.3 2026-02-13T20:29:12.729 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2026-02-13T20:29:12.804 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.795+0000 7f4488fef640 10 monclient: get_monmap_and_config 2026-02-13T20:29:12.804 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.795+0000 7f4488fef640 10 monclient: build_initial_monmap 2026-02-13T20:29:12.805 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.795+0000 7f4488fef640 10 monclient: monmap: 2026-02-13T20:29:12.805 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:29:12.805 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:12.805 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:29:12.796504+0000 2026-02-13T20:29:12.805 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:29:12.796504+0000 2026-02-13T20:29:12.805 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:29:12.805 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:12.805 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:29:12.805 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:29:12.805 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:29:12.806 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:12.806 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.795+0000 7f4488fef640 1 Processor -- start 2026-02-13T20:29:12.806 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.795+0000 7f4488fef640 1 -- start start 2026-02-13T20:29:12.806 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.795+0000 7f4488fef640 10 monclient: init 2026-02-13T20:29:12.806 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.795+0000 7f4488fef640 10 monclient: _reopen_session rank -1 2026-02-13T20:29:12.806 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.795+0000 7f4488fef640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:29:12.806 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.795+0000 7f4488fef640 10 monclient(hunting): picked mon.noname-a con 0x7f4484140180 addr v1:10.20.193.110:6789/0 2026-02-13T20:29:12.806 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.795+0000 7f4488fef640 10 monclient(hunting): picked mon.noname-c con 0x7f448405ca00 addr v1:10.20.193.188:6789/0 2026-02-13T20:29:12.806 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.795+0000 7f4488fef640 10 monclient(hunting): picked mon.noname-b con 0x7f448408be90 addr v1:10.20.193.110:6790/0 2026-02-13T20:29:12.806 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.795+0000 7f4488fef640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f448408b160 con 0x7f4484140180 2026-02-13T20:29:12.806 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.795+0000 7f4488fef640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f448405bb90 con 0x7f448405ca00 2026-02-13T20:29:12.806 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.795+0000 7f4488fef640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f448408b440 con 0x7f448408be90 2026-02-13T20:29:12.807 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.795+0000 7f4488fef640 10 monclient(hunting): _renew_subs 2026-02-13T20:29:12.807 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.795+0000 7f4488fef640 10 monclient(hunting): authenticate will time out at 1714.486858s 2026-02-13T20:29:12.807 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.795+0000 7f44837fe640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f4484140180 0x7f4484140550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:34314/0 (socket says 10.20.193.110:34314) 2026-02-13T20:29:12.807 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.795+0000 7f44837fe640 1 -- 10.20.193.110:0/1688179369 learned_addr learned my addr 10.20.193.110:0/1688179369 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:29:12.807 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.795+0000 7f4483fff640 1 --1- 10.20.193.110:0/1688179369 >> v1:10.20.193.110:6790/0 conn(0x7f448408be90 0x7f44841a26a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:57930/0 (socket says 10.20.193.110:57930) 2026-02-13T20:29:12.807 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.796+0000 7f44827fc640 1 -- 10.20.193.110:0/1688179369 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3886129256 0 0) 0x7f448408b440 con 0x7f448408be90 2026-02-13T20:29:12.807 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.796+0000 7f44827fc640 10 monclient(hunting): _negotiate 2026-02-13T20:29:12.807 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.796+0000 7f44827fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:12.807 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.796+0000 7f44827fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:12.807 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.796+0000 7f44827fc640 10 monclient(hunting): my global_id is 154322 2026-02-13T20:29:12.807 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.796+0000 7f44827fc640 1 -- 10.20.193.110:0/1688179369 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44680035e0 con 0x7f448408be90 2026-02-13T20:29:12.807 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.796+0000 7f44827fc640 1 -- 10.20.193.110:0/1688179369 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1921100987 0 0) 0x7f448408b160 con 0x7f4484140180 2026-02-13T20:29:12.808 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.796+0000 7f44827fc640 10 monclient(hunting): _negotiate 2026-02-13T20:29:12.808 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.796+0000 7f44827fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:12.808 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.796+0000 7f44827fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:12.808 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.796+0000 7f44827fc640 10 monclient(hunting): my global_id is 124605 2026-02-13T20:29:12.808 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.796+0000 7f44827fc640 1 -- 10.20.193.110:0/1688179369 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f448408b440 con 0x7f4484140180 2026-02-13T20:29:12.808 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.796+0000 7f44827fc640 1 -- 10.20.193.110:0/1688179369 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2863771220 0 0) 0x7f44680035e0 con 0x7f448408be90 2026-02-13T20:29:12.808 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.796+0000 7f44827fc640 1 -- 10.20.193.110:0/1688179369 >> v1:10.20.193.188:6789/0 conn(0x7f448405ca00 legacy=0x7f4484180f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:12.808 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.796+0000 7f44827fc640 1 -- 10.20.193.110:0/1688179369 >> v1:10.20.193.110:6789/0 conn(0x7f4484140180 legacy=0x7f4484140550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:12.808 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.796+0000 7f44827fc640 10 monclient: _finish_hunting 0 2026-02-13T20:29:12.808 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.796+0000 7f44827fc640 1 monclient: found mon.noname-b 2026-02-13T20:29:12.809 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.796+0000 7f44827fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:29:12.809 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.796+0000 7f44827fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:29:12.809 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.796+0000 7f44827fc640 1 -- 10.20.193.110:0/1688179369 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f448405bfe0 con 0x7f448408be90 2026-02-13T20:29:12.809 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.796+0000 7f44827fc640 10 monclient: _finish_auth 0 2026-02-13T20:29:12.809 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.796+0000 7f44827fc640 10 monclient: _check_auth_tickets 2026-02-13T20:29:12.809 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.796+0000 7f44827fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:29:12.810 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.796+0000 7f44827fc640 1 -- 10.20.193.110:0/1688179369 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f4478003eb0 con 0x7f448408be90 2026-02-13T20:29:12.810 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.796+0000 7f44827fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:12.810 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.796+0000 7f44827fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:29:12.810 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.796+0000 7f44827fc640 10 monclient: dump: 2026-02-13T20:29:12.810 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:12.810 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:12.811 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.811 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.811 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:12.811 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:12.811 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:12.811 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:12.811 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:12.812 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:12.812 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.796+0000 7f4488fef640 5 monclient: authenticate success, global_id 154322 2026-02-13T20:29:12.812 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.796+0000 7f4488fef640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:29:12.812 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.796+0000 7f44827fc640 1 -- 10.20.193.110:0/1688179369 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4478004040 con 0x7f448408be90 2026-02-13T20:29:12.812 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.796+0000 7f44827fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:29:12.812 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.796+0000 7f44827fc640 1 -- 10.20.193.110:0/1688179369 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f4478004450 con 0x7f448408be90 2026-02-13T20:29:12.812 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.796+0000 7f44827fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:12.812 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.796+0000 7f44827fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:29:12.812 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.796+0000 7f44827fc640 10 monclient: dump: 2026-02-13T20:29:12.812 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:12.813 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:12.813 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.813 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.813 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:12.813 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:12.813 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:12.814 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:12.814 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:12.814 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:12.814 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.796+0000 7f4488fef640 10 monclient: get_monmap_and_config success 2026-02-13T20:29:12.814 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.796+0000 7f4488fef640 4 set_mon_vals no callback set 2026-02-13T20:29:12.814 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.796+0000 7f4488fef640 10 monclient: shutdown 2026-02-13T20:29:12.814 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.796+0000 7f4488fef640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:29:12.814 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.796+0000 7f4488fef640 1 -- 10.20.193.110:0/1688179369 >> v1:10.20.193.110:6790/0 conn(0x7f448408be90 legacy=0x7f44841a26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:12.814 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.796+0000 7f4488fef640 1 -- 10.20.193.110:0/1688179369 shutdown_connections 2026-02-13T20:29:12.814 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.796+0000 7f4488fef640 1 -- 10.20.193.110:0/1688179369 >> 10.20.193.110:0/1688179369 conn(0x7f4484054d30 msgr2=0x7f4484058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:29:12.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.796+0000 7f4488fef640 1 -- 10.20.193.110:0/1688179369 shutdown_connections 2026-02-13T20:29:12.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.796+0000 7f4488fef640 1 -- 10.20.193.110:0/1688179369 wait complete. 2026-02-13T20:29:12.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.797+0000 7f4488fef640 10 monclient: build_initial_monmap 2026-02-13T20:29:12.815 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.797+0000 7f4488fef640 10 monclient: monmap: 2026-02-13T20:29:12.815 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:29:12.815 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:29:12.815 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:29:12.815 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:29:12.815 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:29:12.815 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:29:12.815 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:29:12.815 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:29:12.816 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:29:12.816 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:12.816 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.797+0000 7f4488fef640 1 Processor -- start 2026-02-13T20:29:12.816 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.797+0000 7f4488fef640 1 -- start start 2026-02-13T20:29:12.816 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.797+0000 7f4488fef640 10 monclient: init 2026-02-13T20:29:12.816 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.797+0000 7f4488fef640 10 monclient: _reopen_session rank -1 2026-02-13T20:29:12.816 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.797+0000 7f4488fef640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:29:12.816 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.797+0000 7f4488fef640 10 monclient(hunting): picked mon.noname-a con 0x7f448408be90 addr v1:10.20.193.110:6789/0 2026-02-13T20:29:12.816 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.797+0000 7f4488fef640 10 monclient(hunting): picked mon.noname-c con 0x7f4484140180 addr v1:10.20.193.110:6790/0 2026-02-13T20:29:12.816 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.797+0000 7f4488fef640 10 monclient(hunting): picked mon.noname-b con 0x7f44841a1590 addr v1:10.20.193.188:6789/0 2026-02-13T20:29:12.816 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.797+0000 7f4488fef640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f448410d200 con 0x7f448408be90 2026-02-13T20:29:12.816 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.797+0000 7f4488fef640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f448410a200 con 0x7f44841a1590 2026-02-13T20:29:12.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.797+0000 7f4488fef640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f448408c330 con 0x7f4484140180 2026-02-13T20:29:12.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.797+0000 7f4488fef640 10 monclient(hunting): _renew_subs 2026-02-13T20:29:12.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.797+0000 7f4488fef640 10 monclient(hunting): authenticate will time out at 1714.488564s 2026-02-13T20:29:12.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.797+0000 7f44837fe640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f448408be90 0x7f44841093e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:34330/0 (socket says 10.20.193.110:34330) 2026-02-13T20:29:12.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.797+0000 7f4482ffd640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f4484140180 0x7f4484109af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:57938/0 (socket says 10.20.193.110:57938) 2026-02-13T20:29:12.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.797+0000 7f44837fe640 1 -- 10.20.193.110:0/1652353213 learned_addr learned my addr 10.20.193.110:0/1652353213 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:29:12.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.797+0000 7f445ffff640 1 -- 10.20.193.110:0/1652353213 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4086184394 0 0) 0x7f448408c330 con 0x7f4484140180 2026-02-13T20:29:12.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.797+0000 7f445ffff640 10 monclient(hunting): _negotiate 2026-02-13T20:29:12.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.797+0000 7f445ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:12.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.797+0000 7f445ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:12.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.797+0000 7f445ffff640 10 monclient(hunting): my global_id is 154325 2026-02-13T20:29:12.817 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.797+0000 7f445ffff640 1 -- 10.20.193.110:0/1652353213 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44540035e0 con 0x7f4484140180 2026-02-13T20:29:12.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.797+0000 7f445ffff640 1 -- 10.20.193.110:0/1652353213 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3520134310 0 0) 0x7f448410d200 con 0x7f448408be90 2026-02-13T20:29:12.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.797+0000 7f445ffff640 10 monclient(hunting): _negotiate 2026-02-13T20:29:12.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.797+0000 7f445ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:12.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.797+0000 7f445ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:12.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.797+0000 7f445ffff640 10 monclient(hunting): my global_id is 124608 2026-02-13T20:29:12.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.797+0000 7f445ffff640 1 -- 10.20.193.110:0/1652353213 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f448408c330 con 0x7f448408be90 2026-02-13T20:29:12.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.797+0000 7f445ffff640 1 -- 10.20.193.110:0/1652353213 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3642084819 0 0) 0x7f44540035e0 con 0x7f4484140180 2026-02-13T20:29:12.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.797+0000 7f445ffff640 1 -- 10.20.193.110:0/1652353213 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f448410d200 con 0x7f4484140180 2026-02-13T20:29:12.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.797+0000 7f445ffff640 1 -- 10.20.193.110:0/1652353213 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f4474003080 con 0x7f4484140180 2026-02-13T20:29:12.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.797+0000 7f445ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:29:12.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.797+0000 7f445ffff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:29:12.818 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.797+0000 7f445ffff640 10 monclient(hunting): dump: 2026-02-13T20:29:12.819 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:12.819 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:12.819 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.819 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.819 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:12.819 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:12.819 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:12.819 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:12.819 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:12.819 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:12.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.797+0000 7f445ffff640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:29:12.819 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.797+0000 7f445ffff640 1 -- 10.20.193.110:0/1652353213 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1561218877 0 0) 0x7f448410a200 con 0x7f44841a1590 2026-02-13T20:29:12.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.797+0000 7f445ffff640 10 monclient(hunting): _negotiate 2026-02-13T20:29:12.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.797+0000 7f445ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:12.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.797+0000 7f445ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:12.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.797+0000 7f445ffff640 10 monclient(hunting): my global_id is 164167 2026-02-13T20:29:12.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.797+0000 7f445ffff640 1 -- 10.20.193.110:0/1652353213 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44540035e0 con 0x7f44841a1590 2026-02-13T20:29:12.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.797+0000 7f445ffff640 1 -- 10.20.193.110:0/1652353213 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1167124080 0 0) 0x7f448408c330 con 0x7f448408be90 2026-02-13T20:29:12.820 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.797+0000 7f445ffff640 1 -- 10.20.193.110:0/1652353213 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f448410a200 con 0x7f448408be90 2026-02-13T20:29:12.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.797+0000 7f445ffff640 1 -- 10.20.193.110:0/1652353213 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f44700030a0 con 0x7f448408be90 2026-02-13T20:29:12.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.797+0000 7f445ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:29:12.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.797+0000 7f445ffff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:29:12.821 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.797+0000 7f445ffff640 10 monclient(hunting): dump: 2026-02-13T20:29:12.821 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:12.821 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:12.821 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.821 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.821 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:12.821 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:12.821 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:12.821 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:12.822 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:12.822 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:12.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.798+0000 7f445ffff640 1 -- 10.20.193.110:0/1652353213 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3673516939 0 0) 0x7f448410d200 con 0x7f4484140180 2026-02-13T20:29:12.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.798+0000 7f445ffff640 1 -- 10.20.193.110:0/1652353213 >> v1:10.20.193.188:6789/0 conn(0x7f44841a1590 legacy=0x7f44841a19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:12.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.798+0000 7f445ffff640 1 -- 10.20.193.110:0/1652353213 >> v1:10.20.193.110:6789/0 conn(0x7f448408be90 legacy=0x7f44841093e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:12.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.798+0000 7f445ffff640 10 monclient: _finish_hunting 0 2026-02-13T20:29:12.822 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.798+0000 7f445ffff640 1 monclient: found mon.c 2026-02-13T20:29:12.823 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.798+0000 7f445ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:29:12.823 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.798+0000 7f445ffff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:12.823 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.798+0000 7f445ffff640 1 -- 10.20.193.110:0/1652353213 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f448405d320 con 0x7f4484140180 2026-02-13T20:29:12.823 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.798+0000 7f445ffff640 10 monclient: _finish_auth 0 2026-02-13T20:29:12.823 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.798+0000 7f445ffff640 10 monclient: _check_auth_tickets 2026-02-13T20:29:12.823 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.798+0000 7f445ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:29:12.823 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.798+0000 7f4488fef640 5 monclient: authenticate success, global_id 154325 2026-02-13T20:29:12.823 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.798+0000 7f4488fef640 10 monclient: _renew_subs 2026-02-13T20:29:12.823 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.798+0000 7f4488fef640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:12.823 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.798+0000 7f4488fef640 1 -- 10.20.193.110:0/1652353213 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f448410c390 con 0x7f4484140180 2026-02-13T20:29:12.823 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.798+0000 7f4488fef640 10 monclient: _renew_subs 2026-02-13T20:29:12.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.798+0000 7f4488fef640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:12.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.798+0000 7f4488fef640 1 -- 10.20.193.110:0/1652353213 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f448410cf20 con 0x7f4484140180 2026-02-13T20:29:12.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.798+0000 7f445ffff640 1 -- 10.20.193.110:0/1652353213 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f44740036d0 con 0x7f4484140180 2026-02-13T20:29:12.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.798+0000 7f445ffff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:29:12.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.798+0000 7f445ffff640 1 -- 10.20.193.110:0/1652353213 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f4474003a70 con 0x7f4484140180 2026-02-13T20:29:12.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.798+0000 7f445ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:12.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.798+0000 7f445ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:29:12.824 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.798+0000 7f445ffff640 10 monclient: dump: 2026-02-13T20:29:12.824 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:12.824 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:12.824 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.824 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.825 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:12.825 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:12.825 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:12.825 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:12.825 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:12.825 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:12.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.798+0000 7f4481ffb640 4 set_mon_vals no callback set 2026-02-13T20:29:12.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.798+0000 7f4488fef640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:12.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.798+0000 7f4488fef640 1 -- 10.20.193.110:0/1652353213 --> v1:10.20.193.110:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f4484058410 con 0x7f4484140180 2026-02-13T20:29:12.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.798+0000 7f445ffff640 1 -- 10.20.193.110:0/1652353213 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f4474003bd0 con 0x7f4484140180 2026-02-13T20:29:12.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.798+0000 7f445ffff640 1 -- 10.20.193.110:0/1652353213 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(847..847 src has 1..847) ==== 3591+0+0 (unknown 4078645555 0 0) 0x7f447404e800 con 0x7f4484140180 2026-02-13T20:29:12.825 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.798+0000 7f445ffff640 1 -- 10.20.193.110:0/1652353213 --> v1:10.20.193.188:6800/3648478668 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4454086580 con 0x7f4454064920 2026-02-13T20:29:12.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.798+0000 7f445ffff640 1 -- 10.20.193.110:0/1652353213 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_get_version_reply(handle=1 version=847) ==== 24+0+0 (unknown 1600256361 0 0) 0x7f447404ec10 con 0x7f4484140180 2026-02-13T20:29:12.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.798+0000 7f445ffff640 10 monclient: handle_get_version_reply finishing 1 version 847 2026-02-13T20:29:12.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.798+0000 7f44837fe640 10 monclient: get_auth_request con 0x7f445403fcc0 auth_method 0 2026-02-13T20:29:12.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.799+0000 7f4483fff640 10 monclient: get_auth_request con 0x7f4454064920 auth_method 0 2026-02-13T20:29:12.826 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.800+0000 7f445ffff640 1 -- 10.20.193.110:0/1652353213 <== osd.3 v1:10.20.193.188:6800/3648478668 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (unknown 0 0 784407017) 0x7f4454086580 con 0x7f4454064920 2026-02-13T20:29:12.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.808+0000 7f4488fef640 1 -- 10.20.193.110:0/1652353213 --> v1:10.20.193.188:6800/3648478668 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f4484058580 con 0x7f4454064920 2026-02-13T20:29:12.827 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.808+0000 7f445ffff640 1 -- 10.20.193.110:0/1652353213 <== osd.3 v1:10.20.193.188:6800/3648478668 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f44780089b0 con 0x7f4454064920 2026-02-13T20:29:12.827 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:29:12.827 INFO:teuthology.orchestra.run.trial110.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-13T20:29:12.827 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:29:12.829 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.808+0000 7f4488fef640 1 -- 10.20.193.110:0/1652353213 >> v1:10.20.193.188:6800/3648478668 conn(0x7f4454064920 legacy=0x7f4454084d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:12.829 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.808+0000 7f4488fef640 1 -- 10.20.193.110:0/1652353213 >> v1:10.20.193.188:6812/1623052694 conn(0x7f445403fcc0 legacy=0x7f4454060170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:12.829 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.808+0000 7f4488fef640 10 monclient: shutdown 2026-02-13T20:29:12.829 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.808+0000 7f4488fef640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:29:12.829 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.808+0000 7f4488fef640 1 -- 10.20.193.110:0/1652353213 >> v1:10.20.193.110:6790/0 conn(0x7f4484140180 legacy=0x7f4484109af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:12.829 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.808+0000 7f4483fff640 1 -- 10.20.193.110:0/1652353213 reap_dead start 2026-02-13T20:29:12.830 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.808+0000 7f4488fef640 1 -- 10.20.193.110:0/1652353213 shutdown_connections 2026-02-13T20:29:12.830 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.808+0000 7f4488fef640 1 -- 10.20.193.110:0/1652353213 >> 10.20.193.110:0/1652353213 conn(0x7f4484054d30 msgr2=0x7f4484121c50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:29:12.830 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.808+0000 7f4488fef640 1 -- 10.20.193.110:0/1652353213 shutdown_connections 2026-02-13T20:29:12.830 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.808+0000 7f4488fef640 1 -- 10.20.193.110:0/1652353213 wait complete. 2026-02-13T20:29:12.830 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2026-02-13T20:29:12.897 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.896+0000 7fddf66c3640 10 monclient: get_monmap_and_config 2026-02-13T20:29:12.897 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.896+0000 7fddf66c3640 10 monclient: build_initial_monmap 2026-02-13T20:29:12.897 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.896+0000 7fddf66c3640 10 monclient: monmap: 2026-02-13T20:29:12.897 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:29:12.897 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:12.898 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:29:12.897428+0000 2026-02-13T20:29:12.898 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:29:12.897428+0000 2026-02-13T20:29:12.898 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:29:12.898 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:12.898 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:29:12.898 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:29:12.898 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:29:12.898 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:12.906 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.896+0000 7fddf66c3640 1 Processor -- start 2026-02-13T20:29:12.906 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.896+0000 7fddf66c3640 1 -- start start 2026-02-13T20:29:12.906 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.896+0000 7fddf66c3640 10 monclient: init 2026-02-13T20:29:12.906 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.896+0000 7fddf66c3640 10 monclient: _reopen_session rank -1 2026-02-13T20:29:12.906 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.896+0000 7fddf66c3640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:29:12.906 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.896+0000 7fddf66c3640 10 monclient(hunting): picked mon.noname-b con 0x7fddf01398d0 addr v1:10.20.193.110:6790/0 2026-02-13T20:29:12.906 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.896+0000 7fddf66c3640 10 monclient(hunting): picked mon.noname-a con 0x7fddf0139ca0 addr v1:10.20.193.110:6789/0 2026-02-13T20:29:12.906 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.896+0000 7fddf66c3640 10 monclient(hunting): picked mon.noname-c con 0x7fddf013a140 addr v1:10.20.193.188:6789/0 2026-02-13T20:29:12.906 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.896+0000 7fddf66c3640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddf0090890 con 0x7fddf0139ca0 2026-02-13T20:29:12.906 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.896+0000 7fddf66c3640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddf0090b70 con 0x7fddf013a140 2026-02-13T20:29:12.907 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.896+0000 7fddf66c3640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddf0090e50 con 0x7fddf01398d0 2026-02-13T20:29:12.907 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.896+0000 7fddf66c3640 10 monclient(hunting): _renew_subs 2026-02-13T20:29:12.907 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.896+0000 7fddf66c3640 10 monclient(hunting): authenticate will time out at 1714.587878s 2026-02-13T20:29:12.907 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.896+0000 7fddef7fe640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fddf0139ca0 0x7fddf0181200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:34342/0 (socket says 10.20.193.110:34342) 2026-02-13T20:29:12.907 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.896+0000 7fddef7fe640 1 -- 10.20.193.110:0/4062084854 learned_addr learned my addr 10.20.193.110:0/4062084854 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:29:12.907 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.897+0000 7fddeeffd640 1 -- 10.20.193.110:0/4062084854 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3328960229 0 0) 0x7fddf0090890 con 0x7fddf0139ca0 2026-02-13T20:29:12.907 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.897+0000 7fddeeffd640 10 monclient(hunting): _negotiate 2026-02-13T20:29:12.907 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.897+0000 7fddeeffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:12.907 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.897+0000 7fddeeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:12.907 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.897+0000 7fddeeffd640 10 monclient(hunting): my global_id is 124611 2026-02-13T20:29:12.907 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.897+0000 7fddeeffd640 1 -- 10.20.193.110:0/4062084854 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fddd40035e0 con 0x7fddf0139ca0 2026-02-13T20:29:12.907 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.897+0000 7fddeeffd640 1 -- 10.20.193.110:0/4062084854 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1020349634 0 0) 0x7fddf0090e50 con 0x7fddf01398d0 2026-02-13T20:29:12.908 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.897+0000 7fddeeffd640 10 monclient(hunting): _negotiate 2026-02-13T20:29:12.908 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.897+0000 7fddeeffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:12.908 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.897+0000 7fddeeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:12.908 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.897+0000 7fddeeffd640 10 monclient(hunting): my global_id is 154328 2026-02-13T20:29:12.908 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.897+0000 7fddeeffd640 1 -- 10.20.193.110:0/4062084854 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fddf0090890 con 0x7fddf01398d0 2026-02-13T20:29:12.908 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.897+0000 7fddeeffd640 1 -- 10.20.193.110:0/4062084854 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 374999175 0 0) 0x7fddd40035e0 con 0x7fddf0139ca0 2026-02-13T20:29:12.908 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.897+0000 7fddeeffd640 1 -- 10.20.193.110:0/4062084854 >> v1:10.20.193.110:6790/0 conn(0x7fddf01398d0 legacy=0x7fddf0091400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:12.908 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.897+0000 7fddeeffd640 1 -- 10.20.193.110:0/4062084854 >> v1:10.20.193.188:6789/0 conn(0x7fddf013a140 legacy=0x7fddf01a2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:12.908 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.897+0000 7fddeeffd640 10 monclient: _finish_hunting 0 2026-02-13T20:29:12.908 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.897+0000 7fddeeffd640 1 monclient: found mon.noname-a 2026-02-13T20:29:12.908 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.897+0000 7fddeeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:29:12.908 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.897+0000 7fddeeffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:29:12.909 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.897+0000 7fddeeffd640 1 -- 10.20.193.110:0/4062084854 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddf008fa80 con 0x7fddf0139ca0 2026-02-13T20:29:12.909 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.897+0000 7fddeeffd640 10 monclient: _finish_auth 0 2026-02-13T20:29:12.909 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.897+0000 7fddeeffd640 10 monclient: _check_auth_tickets 2026-02-13T20:29:12.909 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.897+0000 7fddeeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:29:12.909 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.897+0000 7fddeeffd640 1 -- 10.20.193.110:0/4062084854 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fdde0002dd0 con 0x7fddf0139ca0 2026-02-13T20:29:12.909 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.897+0000 7fddeeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:12.909 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.897+0000 7fddeeffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:29:12.909 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.897+0000 7fddeeffd640 10 monclient: dump: 2026-02-13T20:29:12.909 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:12.909 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:12.909 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.909 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.910 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:12.910 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:12.910 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:12.910 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:12.910 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:12.910 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:12.910 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.897+0000 7fddf66c3640 5 monclient: authenticate success, global_id 124611 2026-02-13T20:29:12.910 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.897+0000 7fddf66c3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:29:12.910 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.897+0000 7fddeeffd640 1 -- 10.20.193.110:0/4062084854 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdde0002fd0 con 0x7fddf0139ca0 2026-02-13T20:29:12.911 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.897+0000 7fddeeffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:29:12.911 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.897+0000 7fddeeffd640 1 -- 10.20.193.110:0/4062084854 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fdde00033e0 con 0x7fddf0139ca0 2026-02-13T20:29:12.911 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.897+0000 7fddeeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:12.911 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.897+0000 7fddeeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:29:12.911 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.897+0000 7fddeeffd640 10 monclient: dump: 2026-02-13T20:29:12.911 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:12.911 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:12.911 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.912 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.912 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:12.912 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:12.912 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:12.912 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:12.912 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:12.912 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:12.912 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.897+0000 7fddf66c3640 10 monclient: get_monmap_and_config success 2026-02-13T20:29:12.912 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.897+0000 7fddf66c3640 4 set_mon_vals no callback set 2026-02-13T20:29:12.912 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.897+0000 7fddf66c3640 10 monclient: shutdown 2026-02-13T20:29:12.912 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.897+0000 7fddf66c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:29:12.912 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.897+0000 7fddf66c3640 1 -- 10.20.193.110:0/4062084854 >> v1:10.20.193.110:6789/0 conn(0x7fddf0139ca0 legacy=0x7fddf0181200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:12.913 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.897+0000 7fddf66c3640 1 -- 10.20.193.110:0/4062084854 shutdown_connections 2026-02-13T20:29:12.913 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.897+0000 7fddf66c3640 1 -- 10.20.193.110:0/4062084854 >> 10.20.193.110:0/4062084854 conn(0x7fddf0054330 msgr2=0x7fddf0054730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:29:12.913 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.897+0000 7fddf66c3640 1 -- 10.20.193.110:0/4062084854 shutdown_connections 2026-02-13T20:29:12.913 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.897+0000 7fddf66c3640 1 -- 10.20.193.110:0/4062084854 wait complete. 2026-02-13T20:29:12.913 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.898+0000 7fddf66c3640 10 monclient: build_initial_monmap 2026-02-13T20:29:12.913 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.898+0000 7fddf66c3640 10 monclient: monmap: 2026-02-13T20:29:12.913 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:29:12.913 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:29:12.913 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:29:12.913 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:29:12.913 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:29:12.913 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:29:12.914 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:29:12.914 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:29:12.914 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:29:12.914 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:12.914 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.898+0000 7fddf66c3640 1 Processor -- start 2026-02-13T20:29:12.914 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.898+0000 7fddf66c3640 1 -- start start 2026-02-13T20:29:12.914 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.898+0000 7fddf66c3640 10 monclient: init 2026-02-13T20:29:12.914 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.898+0000 7fddf66c3640 10 monclient: _reopen_session rank -1 2026-02-13T20:29:12.914 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.898+0000 7fddf66c3640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:29:12.914 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.898+0000 7fddf66c3640 10 monclient(hunting): picked mon.noname-a con 0x7fddf01398d0 addr v1:10.20.193.110:6789/0 2026-02-13T20:29:12.914 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.898+0000 7fddf66c3640 10 monclient(hunting): picked mon.noname-c con 0x7fddf0139ca0 addr v1:10.20.193.110:6790/0 2026-02-13T20:29:12.914 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.898+0000 7fddf66c3640 10 monclient(hunting): picked mon.noname-b con 0x7fddf013a140 addr v1:10.20.193.188:6789/0 2026-02-13T20:29:12.915 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.898+0000 7fddf66c3640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddf010df30 con 0x7fddf01398d0 2026-02-13T20:29:12.915 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.898+0000 7fddf66c3640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddf008a700 con 0x7fddf013a140 2026-02-13T20:29:12.915 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.898+0000 7fddf66c3640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddf010cc30 con 0x7fddf0139ca0 2026-02-13T20:29:12.915 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.898+0000 7fddf66c3640 10 monclient(hunting): _renew_subs 2026-02-13T20:29:12.915 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.898+0000 7fddf66c3640 10 monclient(hunting): authenticate will time out at 1714.589685s 2026-02-13T20:29:12.915 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.898+0000 7fddeffff640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fddf01398d0 0x7fddf0088e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:34354/0 (socket says 10.20.193.110:34354) 2026-02-13T20:29:12.915 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.898+0000 7fddeffff640 1 -- 10.20.193.110:0/1815465345 learned_addr learned my addr 10.20.193.110:0/1815465345 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:29:12.915 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.898+0000 7fddecff9640 1 -- 10.20.193.110:0/1815465345 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 817110583 0 0) 0x7fddf010df30 con 0x7fddf01398d0 2026-02-13T20:29:12.915 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.898+0000 7fddecff9640 10 monclient(hunting): _negotiate 2026-02-13T20:29:12.915 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.898+0000 7fddecff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:12.915 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.898+0000 7fddecff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:12.916 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.898+0000 7fddecff9640 10 monclient(hunting): my global_id is 124614 2026-02-13T20:29:12.916 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.898+0000 7fddecff9640 1 -- 10.20.193.110:0/1815465345 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fddc00035e0 con 0x7fddf01398d0 2026-02-13T20:29:12.916 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.898+0000 7fddecff9640 1 -- 10.20.193.110:0/1815465345 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3314978503 0 0) 0x7fddf010cc30 con 0x7fddf0139ca0 2026-02-13T20:29:12.916 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.898+0000 7fddecff9640 10 monclient(hunting): _negotiate 2026-02-13T20:29:12.916 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.898+0000 7fddecff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:12.916 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.898+0000 7fddecff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:12.916 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.898+0000 7fddecff9640 10 monclient(hunting): my global_id is 154331 2026-02-13T20:29:12.916 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.898+0000 7fddecff9640 1 -- 10.20.193.110:0/1815465345 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fddf010df30 con 0x7fddf0139ca0 2026-02-13T20:29:12.916 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.899+0000 7fddecff9640 1 -- 10.20.193.110:0/1815465345 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 368491379 0 0) 0x7fddc00035e0 con 0x7fddf01398d0 2026-02-13T20:29:12.916 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.899+0000 7fddecff9640 1 -- 10.20.193.110:0/1815465345 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fddf010cc30 con 0x7fddf01398d0 2026-02-13T20:29:12.916 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.899+0000 7fddecff9640 1 -- 10.20.193.110:0/1815465345 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fdddc003150 con 0x7fddf01398d0 2026-02-13T20:29:12.916 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.899+0000 7fddecff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:29:12.916 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.899+0000 7fddecff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:29:12.917 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.899+0000 7fddecff9640 10 monclient(hunting): dump: 2026-02-13T20:29:12.917 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:12.917 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:12.917 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.917 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.917 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:12.917 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:12.917 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:12.917 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:12.917 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:12.917 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:12.917 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.899+0000 7fddecff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:29:12.918 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.899+0000 7fddecff9640 1 -- 10.20.193.110:0/1815465345 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1434561534 0 0) 0x7fddf010df30 con 0x7fddf0139ca0 2026-02-13T20:29:12.918 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.899+0000 7fddecff9640 1 -- 10.20.193.110:0/1815465345 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fddc00035e0 con 0x7fddf0139ca0 2026-02-13T20:29:12.918 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.899+0000 7fddecff9640 1 -- 10.20.193.110:0/1815465345 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fdde0002ce0 con 0x7fddf0139ca0 2026-02-13T20:29:12.918 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.899+0000 7fddecff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:29:12.918 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.899+0000 7fddecff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:29:12.918 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.899+0000 7fddecff9640 10 monclient(hunting): dump: 2026-02-13T20:29:12.918 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:12.918 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:12.918 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.918 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.918 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:12.918 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:12.918 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:12.919 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:12.919 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:12.919 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:12.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.899+0000 7fddecff9640 1 -- 10.20.193.110:0/1815465345 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1887609131 0 0) 0x7fddf010cc30 con 0x7fddf01398d0 2026-02-13T20:29:12.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.899+0000 7fddecff9640 1 -- 10.20.193.110:0/1815465345 >> v1:10.20.193.110:6790/0 conn(0x7fddf0139ca0 legacy=0x7fddf0089540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:12.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.899+0000 7fddecff9640 1 -- 10.20.193.110:0/1815465345 >> v1:10.20.193.188:6789/0 conn(0x7fddf013a140 legacy=0x7fddf019ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:12.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.899+0000 7fddecff9640 10 monclient: _finish_hunting 0 2026-02-13T20:29:12.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.899+0000 7fddecff9640 1 monclient: found mon.a 2026-02-13T20:29:12.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.899+0000 7fddecff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:29:12.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.899+0000 7fddecff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:29:12.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.899+0000 7fddecff9640 1 -- 10.20.193.110:0/1815465345 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddf010d750 con 0x7fddf01398d0 2026-02-13T20:29:12.919 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.899+0000 7fddecff9640 10 monclient: _finish_auth 0 2026-02-13T20:29:12.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.899+0000 7fddecff9640 10 monclient: _check_auth_tickets 2026-02-13T20:29:12.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.899+0000 7fddecff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:29:12.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.899+0000 7fddf66c3640 5 monclient: authenticate success, global_id 124614 2026-02-13T20:29:12.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.899+0000 7fddf66c3640 10 monclient: _renew_subs 2026-02-13T20:29:12.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.899+0000 7fddf66c3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:29:12.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.899+0000 7fddf66c3640 1 -- 10.20.193.110:0/1815465345 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fddf0089c50 con 0x7fddf01398d0 2026-02-13T20:29:12.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.899+0000 7fddf66c3640 10 monclient: _renew_subs 2026-02-13T20:29:12.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.899+0000 7fddf66c3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:29:12.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.899+0000 7fddf66c3640 1 -- 10.20.193.110:0/1815465345 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fddf005db70 con 0x7fddf01398d0 2026-02-13T20:29:12.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.899+0000 7fddecff9640 1 -- 10.20.193.110:0/1815465345 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdddc0033a0 con 0x7fddf01398d0 2026-02-13T20:29:12.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.899+0000 7fddecff9640 10 monclient: handle_config config(0 keys) 2026-02-13T20:29:12.920 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.899+0000 7fddecff9640 1 -- 10.20.193.110:0/1815465345 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fdddc003b30 con 0x7fddf01398d0 2026-02-13T20:29:12.921 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.899+0000 7fddecff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:12.921 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.899+0000 7fddecff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:29:12.921 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.899+0000 7fddee7fc640 4 set_mon_vals no callback set 2026-02-13T20:29:12.921 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.899+0000 7fddecff9640 10 monclient: dump: 2026-02-13T20:29:12.921 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:12.921 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:12.921 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.921 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:12.921 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:12.921 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:12.921 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:12.921 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:12.921 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:12.922 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:12.922 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.899+0000 7fddf66c3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:12.922 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.899+0000 7fddf66c3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:12.922 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.899+0000 7fddf66c3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:29:12.922 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.899+0000 7fddf66c3640 1 -- 10.20.193.110:0/1815465345 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddf011f3e0 con 0x7fddf01398d0 2026-02-13T20:29:12.922 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.899+0000 7fddecff9640 1 -- 10.20.193.110:0/1815465345 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fdddc003c90 con 0x7fddf01398d0 2026-02-13T20:29:12.922 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.900+0000 7fddecff9640 1 -- 10.20.193.110:0/1815465345 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(847..847 src has 1..847) ==== 3591+0+0 (unknown 4078645555 0 0) 0x7fdddc04e940 con 0x7fddf01398d0 2026-02-13T20:29:12.922 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.900+0000 7fddef7fe640 10 monclient: get_auth_request con 0x7fddc003fa50 auth_method 0 2026-02-13T20:29:12.922 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.902+0000 7fddecff9640 1 -- 10.20.193.110:0/1815465345 <== mon.0 v1:10.20.193.110:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fdddc004520 con 0x7fddf01398d0 2026-02-13T20:29:12.922 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.902+0000 7fddecff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:12.922 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:12.902+0000 7fddecff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:29:13.008 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.007+0000 7fddf66c3640 1 -- 10.20.193.110:0/1815465345 --> v1:10.20.193.188:6812/1623052694 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fddf008ec50 con 0x7fddc003fa50 2026-02-13T20:29:13.009 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.007+0000 7fddecff9640 1 -- 10.20.193.110:0/1815465345 <== mgr.4105 v1:10.20.193.188:6812/1623052694 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (unknown 3526570807 0 0) 0x7fddf008ec50 con 0x7fddc003fa50 2026-02-13T20:29:13.009 INFO:teuthology.orchestra.run.trial110.stderr:instructed osd(s) 3 to deep-scrub 2026-02-13T20:29:13.010 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.008+0000 7fddf66c3640 1 -- 10.20.193.110:0/1815465345 >> v1:10.20.193.188:6812/1623052694 conn(0x7fddc003fa50 legacy=0x7fddc005ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:13.010 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.008+0000 7fddf66c3640 10 monclient: shutdown 2026-02-13T20:29:13.010 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.008+0000 7fddf66c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:29:13.010 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.008+0000 7fddf66c3640 1 -- 10.20.193.110:0/1815465345 >> v1:10.20.193.110:6789/0 conn(0x7fddf01398d0 legacy=0x7fddf0088e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:13.011 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.008+0000 7fddf66c3640 1 -- 10.20.193.110:0/1815465345 shutdown_connections 2026-02-13T20:29:13.011 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.008+0000 7fddf66c3640 1 -- 10.20.193.110:0/1815465345 >> 10.20.193.110:0/1815465345 conn(0x7fddf0054330 msgr2=0x7fddf008b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:29:13.011 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.008+0000 7fddf66c3640 1 -- 10.20.193.110:0/1815465345 shutdown_connections 2026-02-13T20:29:13.011 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.008+0000 7fddf66c3640 1 -- 10.20.193.110:0/1815465345 wait complete. 2026-02-13T20:29:13.018 INFO:tasks.ceph:Scrubbing osd.4 2026-02-13T20:29:13.018 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2026-02-13T20:29:13.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.085+0000 7fbee108c640 10 monclient: get_monmap_and_config 2026-02-13T20:29:13.094 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.085+0000 7fbee108c640 10 monclient: build_initial_monmap 2026-02-13T20:29:13.095 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.085+0000 7fbee108c640 10 monclient: monmap: 2026-02-13T20:29:13.095 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:29:13.095 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:13.095 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:29:13.086495+0000 2026-02-13T20:29:13.095 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:29:13.086495+0000 2026-02-13T20:29:13.095 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:29:13.095 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:13.095 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:29:13.095 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:29:13.095 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:29:13.095 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:13.096 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.085+0000 7fbee108c640 1 Processor -- start 2026-02-13T20:29:13.096 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.085+0000 7fbee108c640 1 -- start start 2026-02-13T20:29:13.096 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.085+0000 7fbee108c640 10 monclient: init 2026-02-13T20:29:13.096 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.085+0000 7fbee108c640 10 monclient: _reopen_session rank -1 2026-02-13T20:29:13.096 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.085+0000 7fbee108c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:29:13.096 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.085+0000 7fbee108c640 10 monclient(hunting): picked mon.noname-b con 0x7fbedc057be0 addr v1:10.20.193.110:6790/0 2026-02-13T20:29:13.096 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.085+0000 7fbee108c640 10 monclient(hunting): picked mon.noname-a con 0x7fbedc0577a0 addr v1:10.20.193.110:6789/0 2026-02-13T20:29:13.096 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.085+0000 7fbee108c640 10 monclient(hunting): picked mon.noname-c con 0x7fbedc089900 addr v1:10.20.193.188:6789/0 2026-02-13T20:29:13.096 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.085+0000 7fbee108c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbedc08aa20 con 0x7fbedc0577a0 2026-02-13T20:29:13.096 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.085+0000 7fbee108c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbedc08a0f0 con 0x7fbedc089900 2026-02-13T20:29:13.096 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.085+0000 7fbee108c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbedc08a3d0 con 0x7fbedc057be0 2026-02-13T20:29:13.096 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.085+0000 7fbee108c640 10 monclient(hunting): _renew_subs 2026-02-13T20:29:13.097 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.085+0000 7fbee108c640 10 monclient(hunting): authenticate will time out at 1714.776863s 2026-02-13T20:29:13.097 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.085+0000 7fbeda575640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fbedc0577a0 0x7fbedc1834b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:34356/0 (socket says 10.20.193.110:34356) 2026-02-13T20:29:13.097 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.085+0000 7fbeda575640 1 -- 10.20.193.110:0/2463338722 learned_addr learned my addr 10.20.193.110:0/2463338722 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:29:13.097 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.086+0000 7fbed9d74640 1 -- 10.20.193.110:0/2463338722 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 29273303 0 0) 0x7fbedc08a3d0 con 0x7fbedc057be0 2026-02-13T20:29:13.097 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.086+0000 7fbed9d74640 10 monclient(hunting): _negotiate 2026-02-13T20:29:13.097 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.086+0000 7fbed9d74640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:13.097 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.086+0000 7fbed9d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:13.097 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.086+0000 7fbed9d74640 10 monclient(hunting): my global_id is 154334 2026-02-13T20:29:13.097 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.086+0000 7fbed9d74640 1 -- 10.20.193.110:0/2463338722 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbec80035e0 con 0x7fbedc057be0 2026-02-13T20:29:13.097 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.086+0000 7fbed9d74640 1 -- 10.20.193.110:0/2463338722 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3693582589 0 0) 0x7fbedc08aa20 con 0x7fbedc0577a0 2026-02-13T20:29:13.097 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.086+0000 7fbed9d74640 10 monclient(hunting): _negotiate 2026-02-13T20:29:13.097 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.086+0000 7fbed9d74640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:13.098 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.086+0000 7fbed9d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:13.098 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.086+0000 7fbed9d74640 10 monclient(hunting): my global_id is 124617 2026-02-13T20:29:13.098 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.086+0000 7fbed9d74640 1 -- 10.20.193.110:0/2463338722 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbedc08a3d0 con 0x7fbedc0577a0 2026-02-13T20:29:13.098 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.086+0000 7fbed9d74640 1 -- 10.20.193.110:0/2463338722 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 702613623 0 0) 0x7fbedc08a0f0 con 0x7fbedc089900 2026-02-13T20:29:13.098 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.086+0000 7fbed9d74640 10 monclient(hunting): _negotiate 2026-02-13T20:29:13.098 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.086+0000 7fbed9d74640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:13.098 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.086+0000 7fbed9d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:13.098 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.086+0000 7fbed9d74640 10 monclient(hunting): my global_id is 164176 2026-02-13T20:29:13.098 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.086+0000 7fbed9d74640 1 -- 10.20.193.110:0/2463338722 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbedc08aa20 con 0x7fbedc089900 2026-02-13T20:29:13.098 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.086+0000 7fbed9d74640 1 -- 10.20.193.110:0/2463338722 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2868767072 0 0) 0x7fbec80035e0 con 0x7fbedc057be0 2026-02-13T20:29:13.098 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.086+0000 7fbed9d74640 1 -- 10.20.193.110:0/2463338722 >> v1:10.20.193.188:6789/0 conn(0x7fbedc089900 legacy=0x7fbedc1a4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:13.098 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.086+0000 7fbed9d74640 1 -- 10.20.193.110:0/2463338722 >> v1:10.20.193.110:6789/0 conn(0x7fbedc0577a0 legacy=0x7fbedc1834b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:13.098 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.086+0000 7fbed9d74640 10 monclient: _finish_hunting 0 2026-02-13T20:29:13.099 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.086+0000 7fbed9d74640 1 monclient: found mon.noname-b 2026-02-13T20:29:13.099 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.086+0000 7fbed9d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:29:13.099 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.086+0000 7fbed9d74640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:29:13.099 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.086+0000 7fbed9d74640 1 -- 10.20.193.110:0/2463338722 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbedc08a6b0 con 0x7fbedc057be0 2026-02-13T20:29:13.099 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.086+0000 7fbed9d74640 10 monclient: _finish_auth 0 2026-02-13T20:29:13.099 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.086+0000 7fbed9d74640 10 monclient: _check_auth_tickets 2026-02-13T20:29:13.099 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.086+0000 7fbed9d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:29:13.100 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.086+0000 7fbed9d74640 1 -- 10.20.193.110:0/2463338722 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fbed0002dd0 con 0x7fbedc057be0 2026-02-13T20:29:13.100 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.086+0000 7fbed9d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:13.100 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.086+0000 7fbed9d74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:29:13.100 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.086+0000 7fbed9d74640 10 monclient: dump: 2026-02-13T20:29:13.100 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:13.100 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:13.100 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:13.100 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:13.100 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:13.100 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:13.101 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:13.101 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:13.101 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:13.101 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:13.101 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.086+0000 7fbee108c640 5 monclient: authenticate success, global_id 154334 2026-02-13T20:29:13.101 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.086+0000 7fbee108c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:29:13.101 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.086+0000 7fbed9d74640 1 -- 10.20.193.110:0/2463338722 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbed0003050 con 0x7fbedc057be0 2026-02-13T20:29:13.101 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.086+0000 7fbed9d74640 10 monclient: handle_config config(0 keys) 2026-02-13T20:29:13.101 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.086+0000 7fbed9d74640 1 -- 10.20.193.110:0/2463338722 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fbed0003430 con 0x7fbedc057be0 2026-02-13T20:29:13.101 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.086+0000 7fbed9d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:13.101 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.086+0000 7fbed9d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:29:13.101 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.086+0000 7fbed9d74640 10 monclient: dump: 2026-02-13T20:29:13.102 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:13.102 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:13.102 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:13.102 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:13.102 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:13.102 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:13.102 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:13.102 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:13.102 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:13.102 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:13.102 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.086+0000 7fbee108c640 10 monclient: get_monmap_and_config success 2026-02-13T20:29:13.102 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.086+0000 7fbee108c640 4 set_mon_vals no callback set 2026-02-13T20:29:13.103 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.086+0000 7fbee108c640 10 monclient: shutdown 2026-02-13T20:29:13.103 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.086+0000 7fbee108c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:29:13.103 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.086+0000 7fbee108c640 1 -- 10.20.193.110:0/2463338722 >> v1:10.20.193.110:6790/0 conn(0x7fbedc057be0 legacy=0x7fbedc057fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:13.103 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.086+0000 7fbee108c640 1 -- 10.20.193.110:0/2463338722 shutdown_connections 2026-02-13T20:29:13.103 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.086+0000 7fbee108c640 1 -- 10.20.193.110:0/2463338722 >> 10.20.193.110:0/2463338722 conn(0x7fbedc054330 msgr2=0x7fbedc054730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:29:13.103 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.086+0000 7fbee108c640 1 -- 10.20.193.110:0/2463338722 shutdown_connections 2026-02-13T20:29:13.103 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.086+0000 7fbee108c640 1 -- 10.20.193.110:0/2463338722 wait complete. 2026-02-13T20:29:13.103 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.087+0000 7fbee108c640 10 monclient: build_initial_monmap 2026-02-13T20:29:13.103 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.087+0000 7fbee108c640 10 monclient: monmap: 2026-02-13T20:29:13.103 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:29:13.103 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:29:13.103 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:29:13.103 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:29:13.104 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:29:13.104 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:29:13.104 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:29:13.104 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:29:13.104 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:29:13.104 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:13.104 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.087+0000 7fbee108c640 1 Processor -- start 2026-02-13T20:29:13.104 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.087+0000 7fbee108c640 1 -- start start 2026-02-13T20:29:13.104 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.087+0000 7fbee108c640 10 monclient: init 2026-02-13T20:29:13.104 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.087+0000 7fbee108c640 10 monclient: _reopen_session rank -1 2026-02-13T20:29:13.105 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.087+0000 7fbee108c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:29:13.105 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.087+0000 7fbee108c640 10 monclient(hunting): picked mon.noname-a con 0x7fbedc0577a0 addr v1:10.20.193.110:6789/0 2026-02-13T20:29:13.105 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.087+0000 7fbee108c640 10 monclient(hunting): picked mon.noname-c con 0x7fbedc057be0 addr v1:10.20.193.110:6790/0 2026-02-13T20:29:13.105 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.087+0000 7fbee108c640 10 monclient(hunting): picked mon.noname-b con 0x7fbedc089900 addr v1:10.20.193.188:6789/0 2026-02-13T20:29:13.105 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.087+0000 7fbee108c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbedc10db40 con 0x7fbedc0577a0 2026-02-13T20:29:13.105 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.087+0000 7fbee108c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbedc10f340 con 0x7fbedc089900 2026-02-13T20:29:13.106 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.087+0000 7fbee108c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbedc10cd60 con 0x7fbedc057be0 2026-02-13T20:29:13.106 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.087+0000 7fbee108c640 10 monclient(hunting): _renew_subs 2026-02-13T20:29:13.106 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.087+0000 7fbee108c640 10 monclient(hunting): authenticate will time out at 1714.778871s 2026-02-13T20:29:13.106 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.087+0000 7fbedad76640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fbedc0577a0 0x7fbedc10bf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:34358/0 (socket says 10.20.193.110:34358) 2026-02-13T20:29:13.106 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.087+0000 7fbedad76640 1 -- 10.20.193.110:0/335561859 learned_addr learned my addr 10.20.193.110:0/335561859 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:29:13.106 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbebb7fe640 1 -- 10.20.193.110:0/335561859 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2216188725 0 0) 0x7fbedc10cd60 con 0x7fbedc057be0 2026-02-13T20:29:13.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbebb7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:29:13.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbebb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:13.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbebb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:13.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbebb7fe640 10 monclient(hunting): my global_id is 154337 2026-02-13T20:29:13.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbebb7fe640 1 -- 10.20.193.110:0/335561859 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbea80035e0 con 0x7fbedc057be0 2026-02-13T20:29:13.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbebb7fe640 1 -- 10.20.193.110:0/335561859 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1963611374 0 0) 0x7fbedc10db40 con 0x7fbedc0577a0 2026-02-13T20:29:13.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbebb7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:29:13.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbebb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:13.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbebb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:13.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbebb7fe640 10 monclient(hunting): my global_id is 124620 2026-02-13T20:29:13.107 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbebb7fe640 1 -- 10.20.193.110:0/335561859 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbedc10cd60 con 0x7fbedc0577a0 2026-02-13T20:29:13.108 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbebb7fe640 1 -- 10.20.193.110:0/335561859 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1772592064 0 0) 0x7fbea80035e0 con 0x7fbedc057be0 2026-02-13T20:29:13.108 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbebb7fe640 1 -- 10.20.193.110:0/335561859 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbedc10db40 con 0x7fbedc057be0 2026-02-13T20:29:13.108 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbebb7fe640 1 -- 10.20.193.110:0/335561859 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fbec4002d40 con 0x7fbedc057be0 2026-02-13T20:29:13.108 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbebb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:29:13.108 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbebb7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:29:13.108 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbebb7fe640 10 monclient(hunting): dump: 2026-02-13T20:29:13.108 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:13.108 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:13.108 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:13.108 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:13.108 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:13.108 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:13.108 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:13.109 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:13.109 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:13.109 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:13.109 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbebb7fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:29:13.109 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbebb7fe640 1 -- 10.20.193.110:0/335561859 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3503602766 0 0) 0x7fbedc10cd60 con 0x7fbedc0577a0 2026-02-13T20:29:13.109 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbebb7fe640 1 -- 10.20.193.110:0/335561859 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbea80035e0 con 0x7fbedc0577a0 2026-02-13T20:29:13.109 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbebb7fe640 1 -- 10.20.193.110:0/335561859 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fbed0003370 con 0x7fbedc0577a0 2026-02-13T20:29:13.109 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbebb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:29:13.109 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbebb7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:29:13.109 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbebb7fe640 10 monclient(hunting): dump: 2026-02-13T20:29:13.109 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:13.109 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:13.110 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:13.110 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:13.110 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:13.110 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:13.110 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:13.110 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:13.110 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:13.110 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:13.110 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbebb7fe640 1 -- 10.20.193.110:0/335561859 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3545845809 0 0) 0x7fbedc10db40 con 0x7fbedc057be0 2026-02-13T20:29:13.110 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbebb7fe640 1 -- 10.20.193.110:0/335561859 >> v1:10.20.193.188:6789/0 conn(0x7fbedc089900 legacy=0x7fbedc1a42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:13.110 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbebb7fe640 1 -- 10.20.193.110:0/335561859 >> v1:10.20.193.110:6789/0 conn(0x7fbedc0577a0 legacy=0x7fbedc10bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:13.110 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbebb7fe640 10 monclient: _finish_hunting 0 2026-02-13T20:29:13.110 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbebb7fe640 1 monclient: found mon.c 2026-02-13T20:29:13.111 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbebb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:29:13.111 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbebb7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:13.111 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbebb7fe640 1 -- 10.20.193.110:0/335561859 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbedc08c780 con 0x7fbedc057be0 2026-02-13T20:29:13.111 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbebb7fe640 10 monclient: _finish_auth 0 2026-02-13T20:29:13.111 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbebb7fe640 10 monclient: _check_auth_tickets 2026-02-13T20:29:13.111 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbebb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:29:13.111 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbee108c640 5 monclient: authenticate success, global_id 154337 2026-02-13T20:29:13.111 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbee108c640 10 monclient: _renew_subs 2026-02-13T20:29:13.111 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbee108c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:13.111 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbee108c640 1 -- 10.20.193.110:0/335561859 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbedc062290 con 0x7fbedc057be0 2026-02-13T20:29:13.111 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbee108c640 10 monclient: _renew_subs 2026-02-13T20:29:13.111 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbee108c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:13.112 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbee108c640 1 -- 10.20.193.110:0/335561859 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fbedc10de10 con 0x7fbedc057be0 2026-02-13T20:29:13.112 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbebb7fe640 1 -- 10.20.193.110:0/335561859 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbec40031e0 con 0x7fbedc057be0 2026-02-13T20:29:13.112 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbebb7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:29:13.112 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbebb7fe640 1 -- 10.20.193.110:0/335561859 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fbec4004a90 con 0x7fbedc057be0 2026-02-13T20:29:13.112 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbebb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:13.112 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbebb7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:29:13.112 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbebb7fe640 10 monclient: dump: 2026-02-13T20:29:13.112 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:13.112 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:13.112 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:13.112 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:13.112 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:13.112 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:13.113 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:13.113 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:13.113 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:13.113 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:13.113 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbed9573640 4 set_mon_vals no callback set 2026-02-13T20:29:13.113 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbee108c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:13.113 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbee108c640 1 -- 10.20.193.110:0/335561859 --> v1:10.20.193.110:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fbedc058780 con 0x7fbedc057be0 2026-02-13T20:29:13.113 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.088+0000 7fbebb7fe640 1 -- 10.20.193.110:0/335561859 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fbec4011700 con 0x7fbedc057be0 2026-02-13T20:29:13.113 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.089+0000 7fbebb7fe640 1 -- 10.20.193.110:0/335561859 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(847..847 src has 1..847) ==== 3591+0+0 (unknown 4078645555 0 0) 0x7fbec404e720 con 0x7fbedc057be0 2026-02-13T20:29:13.113 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.089+0000 7fbebb7fe640 1 -- 10.20.193.110:0/335561859 --> v1:10.20.193.188:6804/1615982170 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbea80863d0 con 0x7fbea8064770 2026-02-13T20:29:13.113 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.089+0000 7fbebb7fe640 1 -- 10.20.193.110:0/335561859 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_get_version_reply(handle=1 version=847) ==== 24+0+0 (unknown 1600256361 0 0) 0x7fbec404eb30 con 0x7fbedc057be0 2026-02-13T20:29:13.113 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.089+0000 7fbebb7fe640 10 monclient: handle_get_version_reply finishing 1 version 847 2026-02-13T20:29:13.114 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.089+0000 7fbedad76640 10 monclient: get_auth_request con 0x7fbea803fae0 auth_method 0 2026-02-13T20:29:13.114 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.089+0000 7fbedb577640 10 monclient: get_auth_request con 0x7fbea8064770 auth_method 0 2026-02-13T20:29:13.114 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.090+0000 7fbebb7fe640 1 -- 10.20.193.110:0/335561859 <== osd.4 v1:10.20.193.188:6804/1615982170 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (unknown 0 0 784407017) 0x7fbea80863d0 con 0x7fbea8064770 2026-02-13T20:29:13.114 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.097+0000 7fbee108c640 1 -- 10.20.193.110:0/335561859 --> v1:10.20.193.188:6804/1615982170 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbedc093860 con 0x7fbea8064770 2026-02-13T20:29:13.115 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.097+0000 7fbebb7fe640 1 -- 10.20.193.110:0/335561859 <== osd.4 v1:10.20.193.188:6804/1615982170 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fbedc093860 con 0x7fbea8064770 2026-02-13T20:29:13.115 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:29:13.115 INFO:teuthology.orchestra.run.trial110.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-13T20:29:13.115 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:29:13.117 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.098+0000 7fbee108c640 1 -- 10.20.193.110:0/335561859 >> v1:10.20.193.188:6804/1615982170 conn(0x7fbea8064770 legacy=0x7fbea8084b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:13.117 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.098+0000 7fbee108c640 1 -- 10.20.193.110:0/335561859 >> v1:10.20.193.188:6812/1623052694 conn(0x7fbea803fae0 legacy=0x7fbea805ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:13.117 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.098+0000 7fbee108c640 10 monclient: shutdown 2026-02-13T20:29:13.117 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.098+0000 7fbee108c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:29:13.117 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.098+0000 7fbee108c640 1 -- 10.20.193.110:0/335561859 >> v1:10.20.193.110:6790/0 conn(0x7fbedc057be0 legacy=0x7fbedc10c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:13.117 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.098+0000 7fbedb577640 1 -- 10.20.193.110:0/335561859 reap_dead start 2026-02-13T20:29:13.117 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.098+0000 7fbee108c640 1 -- 10.20.193.110:0/335561859 shutdown_connections 2026-02-13T20:29:13.118 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.098+0000 7fbee108c640 1 -- 10.20.193.110:0/335561859 >> 10.20.193.110:0/335561859 conn(0x7fbedc054330 msgr2=0x7fbedc08adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:29:13.118 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.098+0000 7fbee108c640 1 -- 10.20.193.110:0/335561859 shutdown_connections 2026-02-13T20:29:13.118 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.098+0000 7fbee108c640 1 -- 10.20.193.110:0/335561859 wait complete. 2026-02-13T20:29:13.118 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2026-02-13T20:29:13.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.183+0000 7fde8e7dd640 10 monclient: get_monmap_and_config 2026-02-13T20:29:13.192 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.183+0000 7fde8e7dd640 10 monclient: build_initial_monmap 2026-02-13T20:29:13.193 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.183+0000 7fde8e7dd640 10 monclient: monmap: 2026-02-13T20:29:13.193 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:29:13.193 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:13.193 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:29:13.184942+0000 2026-02-13T20:29:13.193 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:29:13.184942+0000 2026-02-13T20:29:13.193 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:29:13.193 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:13.193 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:29:13.193 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:29:13.193 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:29:13.193 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:13.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.183+0000 7fde8e7dd640 1 Processor -- start 2026-02-13T20:29:13.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.183+0000 7fde8e7dd640 1 -- start start 2026-02-13T20:29:13.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.183+0000 7fde8e7dd640 10 monclient: init 2026-02-13T20:29:13.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde8e7dd640 10 monclient: _reopen_session rank -1 2026-02-13T20:29:13.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde8e7dd640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:29:13.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde8e7dd640 10 monclient(hunting): picked mon.noname-c con 0x7fde881401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:29:13.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde8e7dd640 10 monclient(hunting): picked mon.noname-a con 0x7fde88092020 addr v1:10.20.193.110:6789/0 2026-02-13T20:29:13.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde8e7dd640 10 monclient(hunting): picked mon.noname-b con 0x7fde88091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:29:13.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde8e7dd640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde8808b730 con 0x7fde88092020 2026-02-13T20:29:13.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde8e7dd640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde8805c5b0 con 0x7fde881401c0 2026-02-13T20:29:13.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde8e7dd640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde8808bcf0 con 0x7fde88091950 2026-02-13T20:29:13.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde8e7dd640 10 monclient(hunting): _renew_subs 2026-02-13T20:29:13.194 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde8e7dd640 10 monclient(hunting): authenticate will time out at 1714.875330s 2026-02-13T20:29:13.195 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde8cd53640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fde88091950 0x7fde881a2a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:57962/0 (socket says 10.20.193.110:57962) 2026-02-13T20:29:13.195 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde8cd53640 1 -- 10.20.193.110:0/3365161542 learned_addr learned my addr 10.20.193.110:0/3365161542 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:29:13.195 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde877fe640 1 --1- 10.20.193.110:0/3365161542 >> v1:10.20.193.110:6789/0 conn(0x7fde88092020 0x7fde881812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:34370/0 (socket says 10.20.193.110:34370) 2026-02-13T20:29:13.195 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde86ffd640 1 -- 10.20.193.110:0/3365161542 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 963984972 0 0) 0x7fde8808bcf0 con 0x7fde88091950 2026-02-13T20:29:13.195 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde86ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:29:13.195 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde86ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:13.195 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde86ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:13.195 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde86ffd640 10 monclient(hunting): my global_id is 154340 2026-02-13T20:29:13.195 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde86ffd640 1 -- 10.20.193.110:0/3365161542 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde6c0035e0 con 0x7fde88091950 2026-02-13T20:29:13.195 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde86ffd640 1 -- 10.20.193.110:0/3365161542 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 264313158 0 0) 0x7fde8808b730 con 0x7fde88092020 2026-02-13T20:29:13.195 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde86ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:29:13.196 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde86ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:13.196 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde86ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:13.196 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde86ffd640 10 monclient(hunting): my global_id is 124623 2026-02-13T20:29:13.196 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde86ffd640 1 -- 10.20.193.110:0/3365161542 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde8808bcf0 con 0x7fde88092020 2026-02-13T20:29:13.196 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde86ffd640 1 -- 10.20.193.110:0/3365161542 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3487727465 0 0) 0x7fde6c0035e0 con 0x7fde88091950 2026-02-13T20:29:13.196 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde86ffd640 1 -- 10.20.193.110:0/3365161542 >> v1:10.20.193.188:6789/0 conn(0x7fde881401c0 legacy=0x7fde88091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T20:29:13.196 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde86ffd640 1 -- 10.20.193.110:0/3365161542 >> v1:10.20.193.110:6789/0 conn(0x7fde88092020 legacy=0x7fde881812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:13.196 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde86ffd640 10 monclient: _finish_hunting 0 2026-02-13T20:29:13.196 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde86ffd640 1 monclient: found mon.noname-b 2026-02-13T20:29:13.196 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde86ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:29:13.196 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde86ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:29:13.196 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde86ffd640 1 -- 10.20.193.110:0/3365161542 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde88140590 con 0x7fde88091950 2026-02-13T20:29:13.197 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde86ffd640 10 monclient: _finish_auth 0 2026-02-13T20:29:13.197 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde86ffd640 10 monclient: _check_auth_tickets 2026-02-13T20:29:13.197 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde86ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:29:13.197 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde8e7dd640 5 monclient: authenticate success, global_id 154340 2026-02-13T20:29:13.197 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde86ffd640 1 -- 10.20.193.110:0/3365161542 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fde7c003eb0 con 0x7fde88091950 2026-02-13T20:29:13.197 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde8e7dd640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:29:13.197 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde86ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:13.197 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde86ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:29:13.197 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde86ffd640 10 monclient: dump: 2026-02-13T20:29:13.197 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:13.197 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:13.197 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:13.197 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:13.197 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:13.198 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:13.198 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:13.198 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:13.198 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:13.198 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:13.198 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde8e7dd640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:29:13.198 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde86ffd640 1 -- 10.20.193.110:0/3365161542 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fde7c0040c0 con 0x7fde88091950 2026-02-13T20:29:13.198 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde86ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:29:13.198 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde86ffd640 1 -- 10.20.193.110:0/3365161542 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fde7c0044d0 con 0x7fde88091950 2026-02-13T20:29:13.198 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde8e7dd640 10 monclient: get_monmap_and_config success 2026-02-13T20:29:13.198 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde8e7dd640 4 set_mon_vals no callback set 2026-02-13T20:29:13.198 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde86ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:13.199 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde86ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:29:13.199 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.184+0000 7fde86ffd640 10 monclient: dump: 2026-02-13T20:29:13.199 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:13.199 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:13.199 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:13.199 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:13.199 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:13.199 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:13.199 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:13.199 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:13.199 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:13.199 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:13.199 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.185+0000 7fde8e7dd640 10 monclient: shutdown 2026-02-13T20:29:13.200 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.185+0000 7fde8e7dd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:29:13.200 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.185+0000 7fde8e7dd640 1 -- 10.20.193.110:0/3365161542 >> v1:10.20.193.110:6790/0 conn(0x7fde88091950 legacy=0x7fde881a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:13.200 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.185+0000 7fde8e7dd640 1 -- 10.20.193.110:0/3365161542 shutdown_connections 2026-02-13T20:29:13.200 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.185+0000 7fde8e7dd640 1 -- 10.20.193.110:0/3365161542 >> 10.20.193.110:0/3365161542 conn(0x7fde88054e90 msgr2=0x7fde88058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:29:13.200 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.185+0000 7fde8e7dd640 1 -- 10.20.193.110:0/3365161542 shutdown_connections 2026-02-13T20:29:13.200 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.185+0000 7fde8e7dd640 1 -- 10.20.193.110:0/3365161542 wait complete. 2026-02-13T20:29:13.200 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.185+0000 7fde8e7dd640 10 monclient: build_initial_monmap 2026-02-13T20:29:13.200 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.185+0000 7fde8e7dd640 10 monclient: monmap: 2026-02-13T20:29:13.200 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:29:13.200 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:29:13.200 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:29:13.201 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:29:13.201 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:29:13.201 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:29:13.201 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:29:13.201 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:29:13.201 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:29:13.201 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:13.201 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.185+0000 7fde8e7dd640 1 Processor -- start 2026-02-13T20:29:13.201 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.185+0000 7fde8e7dd640 1 -- start start 2026-02-13T20:29:13.201 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.185+0000 7fde8e7dd640 10 monclient: init 2026-02-13T20:29:13.201 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde8e7dd640 10 monclient: _reopen_session rank -1 2026-02-13T20:29:13.201 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde8e7dd640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T20:29:13.201 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde8e7dd640 10 monclient(hunting): picked mon.noname-c con 0x7fde88091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:29:13.202 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde8e7dd640 10 monclient(hunting): picked mon.noname-a con 0x7fde881401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:29:13.202 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde8e7dd640 10 monclient(hunting): picked mon.noname-b con 0x7fde88089770 addr v1:10.20.193.188:6789/0 2026-02-13T20:29:13.202 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde8e7dd640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde8808c3d0 con 0x7fde881401c0 2026-02-13T20:29:13.202 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde8e7dd640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde88131f10 con 0x7fde88089770 2026-02-13T20:29:13.202 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde8e7dd640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde881321f0 con 0x7fde88091950 2026-02-13T20:29:13.202 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde8e7dd640 10 monclient(hunting): _renew_subs 2026-02-13T20:29:13.202 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde8e7dd640 10 monclient(hunting): authenticate will time out at 1714.877227s 2026-02-13T20:29:13.202 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde87fff640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fde88091950 0x7fde88089060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:57976/0 (socket says 10.20.193.110:57976) 2026-02-13T20:29:13.202 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde87fff640 1 -- 10.20.193.110:0/4063055355 learned_addr learned my addr 10.20.193.110:0/4063055355 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:29:13.202 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde84ff9640 1 -- 10.20.193.110:0/4063055355 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1310310959 0 0) 0x7fde881321f0 con 0x7fde88091950 2026-02-13T20:29:13.202 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde84ff9640 10 monclient(hunting): _negotiate 2026-02-13T20:29:13.202 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde84ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:13.202 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde84ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:13.203 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde84ff9640 10 monclient(hunting): my global_id is 154343 2026-02-13T20:29:13.203 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde84ff9640 1 -- 10.20.193.110:0/4063055355 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde580035e0 con 0x7fde88091950 2026-02-13T20:29:13.203 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde84ff9640 1 -- 10.20.193.110:0/4063055355 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3511991342 0 0) 0x7fde8808c3d0 con 0x7fde881401c0 2026-02-13T20:29:13.203 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde84ff9640 10 monclient(hunting): _negotiate 2026-02-13T20:29:13.203 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde84ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:13.203 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde84ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:13.203 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde84ff9640 10 monclient(hunting): my global_id is 124626 2026-02-13T20:29:13.203 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde84ff9640 1 -- 10.20.193.110:0/4063055355 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde881321f0 con 0x7fde881401c0 2026-02-13T20:29:13.203 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde84ff9640 1 -- 10.20.193.110:0/4063055355 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1658337086 0 0) 0x7fde580035e0 con 0x7fde88091950 2026-02-13T20:29:13.203 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde84ff9640 1 -- 10.20.193.110:0/4063055355 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fde8808c3d0 con 0x7fde88091950 2026-02-13T20:29:13.203 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde84ff9640 1 -- 10.20.193.110:0/4063055355 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fde740030a0 con 0x7fde88091950 2026-02-13T20:29:13.203 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde84ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:29:13.204 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde84ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:29:13.204 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde84ff9640 10 monclient(hunting): dump: 2026-02-13T20:29:13.204 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:13.204 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:13.204 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:13.204 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:13.204 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:13.204 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:13.204 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:13.204 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:13.204 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:13.204 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:13.205 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde84ff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:29:13.205 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde84ff9640 1 -- 10.20.193.110:0/4063055355 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4061679958 0 0) 0x7fde881321f0 con 0x7fde881401c0 2026-02-13T20:29:13.205 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde84ff9640 1 -- 10.20.193.110:0/4063055355 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fde580035e0 con 0x7fde881401c0 2026-02-13T20:29:13.205 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde84ff9640 1 -- 10.20.193.110:0/4063055355 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fde78003200 con 0x7fde881401c0 2026-02-13T20:29:13.205 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde84ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:29:13.205 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde84ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:29:13.205 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde84ff9640 10 monclient(hunting): dump: 2026-02-13T20:29:13.205 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:13.205 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:13.205 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:13.205 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:13.205 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:13.205 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:13.206 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:13.206 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:13.206 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:13.206 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:13.206 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde84ff9640 1 -- 10.20.193.110:0/4063055355 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3493158702 0 0) 0x7fde88131f10 con 0x7fde88089770 2026-02-13T20:29:13.206 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde84ff9640 10 monclient(hunting): _negotiate 2026-02-13T20:29:13.206 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde84ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:13.206 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde84ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:13.206 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde84ff9640 10 monclient(hunting): my global_id is 164185 2026-02-13T20:29:13.206 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde84ff9640 1 -- 10.20.193.110:0/4063055355 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde881321f0 con 0x7fde88089770 2026-02-13T20:29:13.206 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde84ff9640 1 -- 10.20.193.110:0/4063055355 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 888457495 0 0) 0x7fde8808c3d0 con 0x7fde88091950 2026-02-13T20:29:13.206 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde84ff9640 1 -- 10.20.193.110:0/4063055355 >> v1:10.20.193.188:6789/0 conn(0x7fde88089770 legacy=0x7fde88194f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:13.206 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde84ff9640 1 -- 10.20.193.110:0/4063055355 >> v1:10.20.193.110:6789/0 conn(0x7fde881401c0 legacy=0x7fde88193840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:13.207 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde84ff9640 10 monclient: _finish_hunting 0 2026-02-13T20:29:13.207 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde84ff9640 1 monclient: found mon.c 2026-02-13T20:29:13.207 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde84ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:29:13.207 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde84ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:13.207 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde84ff9640 1 -- 10.20.193.110:0/4063055355 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde8808a880 con 0x7fde88091950 2026-02-13T20:29:13.207 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde84ff9640 10 monclient: _finish_auth 0 2026-02-13T20:29:13.207 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde84ff9640 10 monclient: _check_auth_tickets 2026-02-13T20:29:13.207 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde84ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:29:13.207 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde8e7dd640 5 monclient: authenticate success, global_id 154343 2026-02-13T20:29:13.207 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde8e7dd640 10 monclient: _renew_subs 2026-02-13T20:29:13.207 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde8e7dd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:13.207 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde8e7dd640 1 -- 10.20.193.110:0/4063055355 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fde881306d0 con 0x7fde88091950 2026-02-13T20:29:13.208 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde8e7dd640 10 monclient: _renew_subs 2026-02-13T20:29:13.208 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde8e7dd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:13.208 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde8e7dd640 1 -- 10.20.193.110:0/4063055355 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fde881309f0 con 0x7fde88091950 2026-02-13T20:29:13.208 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde84ff9640 1 -- 10.20.193.110:0/4063055355 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fde74003410 con 0x7fde88091950 2026-02-13T20:29:13.208 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde84ff9640 10 monclient: handle_config config(0 keys) 2026-02-13T20:29:13.208 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde84ff9640 1 -- 10.20.193.110:0/4063055355 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fde74003b30 con 0x7fde88091950 2026-02-13T20:29:13.208 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde84ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:13.208 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde84ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:29:13.208 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde84ff9640 10 monclient: dump: 2026-02-13T20:29:13.208 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:13.208 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:13.208 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:13.209 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:13.209 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:13.209 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:13.209 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:13.209 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:13.209 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:13.209 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:13.209 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.186+0000 7fde867fc640 4 set_mon_vals no callback set 2026-02-13T20:29:13.209 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.187+0000 7fde8e7dd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:13.209 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.187+0000 7fde8e7dd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:13.209 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.187+0000 7fde8e7dd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:13.209 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.187+0000 7fde8e7dd640 1 -- 10.20.193.110:0/4063055355 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde880008d0 con 0x7fde88091950 2026-02-13T20:29:13.209 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.187+0000 7fde84ff9640 1 -- 10.20.193.110:0/4063055355 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fde74003c90 con 0x7fde88091950 2026-02-13T20:29:13.210 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.187+0000 7fde84ff9640 1 -- 10.20.193.110:0/4063055355 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(847..847 src has 1..847) ==== 3591+0+0 (unknown 4078645555 0 0) 0x7fde7404e7f0 con 0x7fde88091950 2026-02-13T20:29:13.210 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.187+0000 7fde877fe640 10 monclient: get_auth_request con 0x7fde5803fcc0 auth_method 0 2026-02-13T20:29:13.210 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.189+0000 7fde84ff9640 1 -- 10.20.193.110:0/4063055355 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fde74003f70 con 0x7fde88091950 2026-02-13T20:29:13.210 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.189+0000 7fde84ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:13.210 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.189+0000 7fde84ff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:29:13.294 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.292+0000 7fde8e7dd640 1 -- 10.20.193.110:0/4063055355 --> v1:10.20.193.188:6812/1623052694 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fde88089cd0 con 0x7fde5803fcc0 2026-02-13T20:29:13.294 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.293+0000 7fde84ff9640 1 -- 10.20.193.110:0/4063055355 <== mgr.4105 v1:10.20.193.188:6812/1623052694 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (unknown 3782719169 0 0) 0x7fde88089cd0 con 0x7fde5803fcc0 2026-02-13T20:29:13.295 INFO:teuthology.orchestra.run.trial110.stderr:instructed osd(s) 4 to deep-scrub 2026-02-13T20:29:13.296 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.294+0000 7fde8e7dd640 1 -- 10.20.193.110:0/4063055355 >> v1:10.20.193.188:6812/1623052694 conn(0x7fde5803fcc0 legacy=0x7fde58060170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:13.296 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.294+0000 7fde8e7dd640 10 monclient: shutdown 2026-02-13T20:29:13.296 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.294+0000 7fde8e7dd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:29:13.296 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.294+0000 7fde8e7dd640 1 -- 10.20.193.110:0/4063055355 >> v1:10.20.193.110:6790/0 conn(0x7fde88091950 legacy=0x7fde88089060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:13.297 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.294+0000 7fde8e7dd640 1 -- 10.20.193.110:0/4063055355 shutdown_connections 2026-02-13T20:29:13.297 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.294+0000 7fde8e7dd640 1 -- 10.20.193.110:0/4063055355 >> 10.20.193.110:0/4063055355 conn(0x7fde88054e90 msgr2=0x7fde8808dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:29:13.297 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.294+0000 7fde8e7dd640 1 -- 10.20.193.110:0/4063055355 shutdown_connections 2026-02-13T20:29:13.297 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.294+0000 7fde8e7dd640 1 -- 10.20.193.110:0/4063055355 wait complete. 2026-02-13T20:29:13.303 INFO:tasks.ceph:Scrubbing osd.5 2026-02-13T20:29:13.303 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2026-02-13T20:29:13.371 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.369+0000 7f75d1acc640 10 monclient: get_monmap_and_config 2026-02-13T20:29:13.371 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.369+0000 7f75d1acc640 10 monclient: build_initial_monmap 2026-02-13T20:29:13.371 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.369+0000 7f75d1acc640 10 monclient: monmap: 2026-02-13T20:29:13.371 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:29:13.371 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:13.371 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:29:13.371271+0000 2026-02-13T20:29:13.371 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:29:13.371271+0000 2026-02-13T20:29:13.372 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:29:13.372 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:13.372 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:29:13.372 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:29:13.372 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:29:13.372 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:13.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.370+0000 7f75d1acc640 1 Processor -- start 2026-02-13T20:29:13.379 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.370+0000 7f75d1acc640 1 -- start start 2026-02-13T20:29:13.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.370+0000 7f75d1acc640 10 monclient: init 2026-02-13T20:29:13.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.370+0000 7f75d1acc640 10 monclient: _reopen_session rank -1 2026-02-13T20:29:13.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.370+0000 7f75d1acc640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:29:13.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.370+0000 7f75d1acc640 10 monclient(hunting): picked mon.noname-c con 0x7f75cc1401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:29:13.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.370+0000 7f75d1acc640 10 monclient(hunting): picked mon.noname-a con 0x7f75cc092020 addr v1:10.20.193.110:6789/0 2026-02-13T20:29:13.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.370+0000 7f75d1acc640 10 monclient(hunting): picked mon.noname-b con 0x7f75cc091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:29:13.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.370+0000 7f75d1acc640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75cc08b730 con 0x7f75cc092020 2026-02-13T20:29:13.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.370+0000 7f75d1acc640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75cc05c5b0 con 0x7f75cc1401c0 2026-02-13T20:29:13.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.370+0000 7f75d1acc640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75cc08bcf0 con 0x7f75cc091950 2026-02-13T20:29:13.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.370+0000 7f75d1acc640 10 monclient(hunting): _renew_subs 2026-02-13T20:29:13.380 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.370+0000 7f75d1acc640 10 monclient(hunting): authenticate will time out at 1715.061756s 2026-02-13T20:29:13.381 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.370+0000 7f75cbfff640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f75cc091950 0x7f75cc1a2a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:57992/0 (socket says 10.20.193.110:57992) 2026-02-13T20:29:13.381 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.370+0000 7f75cbfff640 1 -- 10.20.193.110:0/796550711 learned_addr learned my addr 10.20.193.110:0/796550711 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:29:13.381 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.371+0000 7f75ca7fc640 1 -- 10.20.193.110:0/796550711 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2639765146 0 0) 0x7f75cc08b730 con 0x7f75cc092020 2026-02-13T20:29:13.381 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.371+0000 7f75ca7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:29:13.381 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.371+0000 7f75ca7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:13.381 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.371+0000 7f75ca7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:13.381 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.371+0000 7f75ca7fc640 10 monclient(hunting): my global_id is 124629 2026-02-13T20:29:13.381 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.371+0000 7f75ca7fc640 1 -- 10.20.193.110:0/796550711 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f75b00035e0 con 0x7f75cc092020 2026-02-13T20:29:13.381 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.371+0000 7f75ca7fc640 1 -- 10.20.193.110:0/796550711 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1288453075 0 0) 0x7f75cc08bcf0 con 0x7f75cc091950 2026-02-13T20:29:13.381 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.371+0000 7f75ca7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:29:13.381 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.371+0000 7f75ca7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:13.381 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.371+0000 7f75ca7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:13.382 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.371+0000 7f75ca7fc640 10 monclient(hunting): my global_id is 154346 2026-02-13T20:29:13.382 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.371+0000 7f75ca7fc640 1 -- 10.20.193.110:0/796550711 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f75cc08b730 con 0x7f75cc091950 2026-02-13T20:29:13.382 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.371+0000 7f75ca7fc640 1 -- 10.20.193.110:0/796550711 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2313224509 0 0) 0x7f75b00035e0 con 0x7f75cc092020 2026-02-13T20:29:13.382 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.371+0000 7f75ca7fc640 1 -- 10.20.193.110:0/796550711 >> v1:10.20.193.110:6790/0 conn(0x7f75cc091950 legacy=0x7f75cc1a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:13.382 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.371+0000 7f75ca7fc640 1 -- 10.20.193.110:0/796550711 >> v1:10.20.193.188:6789/0 conn(0x7f75cc1401c0 legacy=0x7f75cc091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:13.382 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.371+0000 7f75ca7fc640 10 monclient: _finish_hunting 0 2026-02-13T20:29:13.382 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.371+0000 7f75ca7fc640 1 monclient: found mon.noname-a 2026-02-13T20:29:13.382 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.371+0000 7f75ca7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:29:13.382 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.371+0000 7f75ca7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:29:13.382 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.371+0000 7f75ca7fc640 1 -- 10.20.193.110:0/796550711 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75cc140590 con 0x7f75cc092020 2026-02-13T20:29:13.382 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.371+0000 7f75ca7fc640 10 monclient: _finish_auth 0 2026-02-13T20:29:13.382 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.371+0000 7f75ca7fc640 10 monclient: _check_auth_tickets 2026-02-13T20:29:13.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.371+0000 7f75ca7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:29:13.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.371+0000 7f75ca7fc640 1 -- 10.20.193.110:0/796550711 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f75bc002dd0 con 0x7f75cc092020 2026-02-13T20:29:13.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.371+0000 7f75d1acc640 5 monclient: authenticate success, global_id 124629 2026-02-13T20:29:13.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.371+0000 7f75d1acc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:29:13.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.371+0000 7f75ca7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:13.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.371+0000 7f75ca7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:29:13.383 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.371+0000 7f75ca7fc640 10 monclient: dump: 2026-02-13T20:29:13.383 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:13.383 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:13.383 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:13.383 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:13.383 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:13.384 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:13.384 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:13.384 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:13.384 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:13.384 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:13.384 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.371+0000 7f75d1acc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:29:13.384 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.371+0000 7f75ca7fc640 1 -- 10.20.193.110:0/796550711 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f75bc002fa0 con 0x7f75cc092020 2026-02-13T20:29:13.384 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.371+0000 7f75ca7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:29:13.384 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.371+0000 7f75ca7fc640 1 -- 10.20.193.110:0/796550711 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f75bc0033b0 con 0x7f75cc092020 2026-02-13T20:29:13.384 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.371+0000 7f75ca7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:13.384 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.371+0000 7f75ca7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:29:13.384 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.371+0000 7f75ca7fc640 10 monclient: dump: 2026-02-13T20:29:13.385 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:13.385 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:13.385 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:13.385 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:13.385 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:13.385 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:13.385 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:13.385 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:13.385 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:13.385 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:13.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.371+0000 7f75d1acc640 10 monclient: get_monmap_and_config success 2026-02-13T20:29:13.385 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.371+0000 7f75d1acc640 4 set_mon_vals no callback set 2026-02-13T20:29:13.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.371+0000 7f75d1acc640 10 monclient: shutdown 2026-02-13T20:29:13.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.371+0000 7f75d1acc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:29:13.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.371+0000 7f75d1acc640 1 -- 10.20.193.110:0/796550711 >> v1:10.20.193.110:6789/0 conn(0x7f75cc092020 legacy=0x7f75cc1812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:13.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.371+0000 7f75d1acc640 1 -- 10.20.193.110:0/796550711 shutdown_connections 2026-02-13T20:29:13.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.371+0000 7f75d1acc640 1 -- 10.20.193.110:0/796550711 >> 10.20.193.110:0/796550711 conn(0x7f75cc054e90 msgr2=0x7f75cc058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:29:13.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.371+0000 7f75d1acc640 1 -- 10.20.193.110:0/796550711 shutdown_connections 2026-02-13T20:29:13.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.371+0000 7f75d1acc640 1 -- 10.20.193.110:0/796550711 wait complete. 2026-02-13T20:29:13.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.371+0000 7f75d1acc640 10 monclient: build_initial_monmap 2026-02-13T20:29:13.386 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75d1acc640 10 monclient: monmap: 2026-02-13T20:29:13.386 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:29:13.386 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:29:13.386 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:29:13.386 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:29:13.387 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:29:13.387 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:29:13.387 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:29:13.387 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:29:13.387 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:29:13.387 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:13.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75d1acc640 1 Processor -- start 2026-02-13T20:29:13.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75d1acc640 1 -- start start 2026-02-13T20:29:13.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75d1acc640 10 monclient: init 2026-02-13T20:29:13.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75d1acc640 10 monclient: _reopen_session rank -1 2026-02-13T20:29:13.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75d1acc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:29:13.387 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75d1acc640 10 monclient(hunting): picked mon.noname-a con 0x7f75cc091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:29:13.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75d1acc640 10 monclient(hunting): picked mon.noname-c con 0x7f75cc1401c0 addr v1:10.20.193.110:6790/0 2026-02-13T20:29:13.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75d1acc640 10 monclient(hunting): picked mon.noname-b con 0x7f75cc150430 addr v1:10.20.193.188:6789/0 2026-02-13T20:29:13.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75d1acc640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75cc150890 con 0x7f75cc091950 2026-02-13T20:29:13.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75d1acc640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75cc08c430 con 0x7f75cc150430 2026-02-13T20:29:13.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75d1acc640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75cc05d320 con 0x7f75cc1401c0 2026-02-13T20:29:13.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75d1acc640 10 monclient(hunting): _renew_subs 2026-02-13T20:29:13.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75d1acc640 10 monclient(hunting): authenticate will time out at 1715.063497s 2026-02-13T20:29:13.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75cb7fe640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f75cc091950 0x7f75cc13e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:34384/0 (socket says 10.20.193.110:34384) 2026-02-13T20:29:13.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75cb7fe640 1 -- 10.20.193.110:0/3928584893 learned_addr learned my addr 10.20.193.110:0/3928584893 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:29:13.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75a7fff640 1 -- 10.20.193.110:0/3928584893 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3834169397 0 0) 0x7f75cc150890 con 0x7f75cc091950 2026-02-13T20:29:13.388 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75a7fff640 10 monclient(hunting): _negotiate 2026-02-13T20:29:13.389 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75a7fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:13.389 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75a7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:13.389 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75a7fff640 10 monclient(hunting): my global_id is 124632 2026-02-13T20:29:13.389 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75a7fff640 1 -- 10.20.193.110:0/3928584893 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f759c0035e0 con 0x7f75cc091950 2026-02-13T20:29:13.389 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75a7fff640 1 -- 10.20.193.110:0/3928584893 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4276198545 0 0) 0x7f75cc05d320 con 0x7f75cc1401c0 2026-02-13T20:29:13.389 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75a7fff640 10 monclient(hunting): _negotiate 2026-02-13T20:29:13.389 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75a7fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:13.389 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75a7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:13.389 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75a7fff640 10 monclient(hunting): my global_id is 154349 2026-02-13T20:29:13.389 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75a7fff640 1 -- 10.20.193.110:0/3928584893 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f75cc150890 con 0x7f75cc1401c0 2026-02-13T20:29:13.389 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75a7fff640 1 -- 10.20.193.110:0/3928584893 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 346483372 0 0) 0x7f75cc150890 con 0x7f75cc1401c0 2026-02-13T20:29:13.389 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75a7fff640 1 -- 10.20.193.110:0/3928584893 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f75cc05d320 con 0x7f75cc1401c0 2026-02-13T20:29:13.390 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75a7fff640 1 -- 10.20.193.110:0/3928584893 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f75bc002ce0 con 0x7f75cc1401c0 2026-02-13T20:29:13.390 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75a7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:29:13.390 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75a7fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:29:13.390 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75a7fff640 10 monclient(hunting): dump: 2026-02-13T20:29:13.390 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:13.390 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:13.390 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:13.390 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:13.390 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:13.390 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:13.390 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:13.390 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:13.390 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:13.391 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:13.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75a7fff640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:29:13.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75a7fff640 1 -- 10.20.193.110:0/3928584893 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2574667133 0 0) 0x7f759c0035e0 con 0x7f75cc091950 2026-02-13T20:29:13.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75a7fff640 1 -- 10.20.193.110:0/3928584893 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f75cc150890 con 0x7f75cc091950 2026-02-13T20:29:13.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75a7fff640 1 -- 10.20.193.110:0/3928584893 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f75b80030f0 con 0x7f75cc091950 2026-02-13T20:29:13.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75a7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:29:13.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75a7fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:29:13.391 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75a7fff640 10 monclient(hunting): dump: 2026-02-13T20:29:13.391 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:13.391 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:13.391 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:13.391 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:13.392 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:13.392 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:13.392 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:13.392 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:13.392 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:13.392 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:13.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75a7fff640 1 -- 10.20.193.110:0/3928584893 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2104676699 0 0) 0x7f75cc05d320 con 0x7f75cc1401c0 2026-02-13T20:29:13.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75a7fff640 1 -- 10.20.193.110:0/3928584893 >> v1:10.20.193.188:6789/0 conn(0x7f75cc150430 legacy=0x7f75cc192eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:13.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75a7fff640 1 -- 10.20.193.110:0/3928584893 >> v1:10.20.193.110:6789/0 conn(0x7f75cc091950 legacy=0x7f75cc13e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:13.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75a7fff640 10 monclient: _finish_hunting 0 2026-02-13T20:29:13.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75a7fff640 1 monclient: found mon.c 2026-02-13T20:29:13.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75a7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:29:13.392 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75a7fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:13.393 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75a7fff640 1 -- 10.20.193.110:0/3928584893 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75cc150ae0 con 0x7f75cc1401c0 2026-02-13T20:29:13.393 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75a7fff640 10 monclient: _finish_auth 0 2026-02-13T20:29:13.393 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75a7fff640 10 monclient: _check_auth_tickets 2026-02-13T20:29:13.393 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75a7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:29:13.393 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.372+0000 7f75d1acc640 5 monclient: authenticate success, global_id 154349 2026-02-13T20:29:13.393 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.373+0000 7f75d1acc640 10 monclient: _renew_subs 2026-02-13T20:29:13.393 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.373+0000 7f75d1acc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:13.393 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.373+0000 7f75d1acc640 1 -- 10.20.193.110:0/3928584893 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f75cc12d830 con 0x7f75cc1401c0 2026-02-13T20:29:13.393 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.373+0000 7f75d1acc640 10 monclient: _renew_subs 2026-02-13T20:29:13.393 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.373+0000 7f75d1acc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:13.393 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.373+0000 7f75d1acc640 1 -- 10.20.193.110:0/3928584893 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f75cc12e390 con 0x7f75cc1401c0 2026-02-13T20:29:13.393 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.373+0000 7f75a7fff640 1 -- 10.20.193.110:0/3928584893 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f75bc0038d0 con 0x7f75cc1401c0 2026-02-13T20:29:13.394 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.373+0000 7f75a7fff640 10 monclient: handle_config config(0 keys) 2026-02-13T20:29:13.394 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.373+0000 7f75a7fff640 1 -- 10.20.193.110:0/3928584893 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f75bc003bf0 con 0x7f75cc1401c0 2026-02-13T20:29:13.394 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.373+0000 7f75a7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:13.394 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.373+0000 7f75a7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:29:13.394 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.373+0000 7f75a7fff640 10 monclient: dump: 2026-02-13T20:29:13.394 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:13.394 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:13.394 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:13.394 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:13.394 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:13.394 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:13.394 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:13.395 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:13.395 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:13.395 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:13.395 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.373+0000 7f75c9ffb640 4 set_mon_vals no callback set 2026-02-13T20:29:13.395 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.373+0000 7f75d1acc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:13.395 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.373+0000 7f75d1acc640 1 -- 10.20.193.110:0/3928584893 --> v1:10.20.193.110:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f75cc12f3a0 con 0x7f75cc1401c0 2026-02-13T20:29:13.395 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.373+0000 7f75a7fff640 1 -- 10.20.193.110:0/3928584893 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f75bc010860 con 0x7f75cc1401c0 2026-02-13T20:29:13.395 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.373+0000 7f75a7fff640 1 -- 10.20.193.110:0/3928584893 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(847..847 src has 1..847) ==== 3591+0+0 (unknown 4078645555 0 0) 0x7f75bc04d660 con 0x7f75cc1401c0 2026-02-13T20:29:13.395 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.373+0000 7f75a7fff640 1 -- 10.20.193.110:0/3928584893 --> v1:10.20.193.188:6805/4130810301 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f759c086340 con 0x7f759c0646e0 2026-02-13T20:29:13.395 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.373+0000 7f75a7fff640 1 -- 10.20.193.110:0/3928584893 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_get_version_reply(handle=1 version=847) ==== 24+0+0 (unknown 1600256361 0 0) 0x7f75bc04da70 con 0x7f75cc1401c0 2026-02-13T20:29:13.395 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.373+0000 7f75a7fff640 10 monclient: handle_get_version_reply finishing 1 version 847 2026-02-13T20:29:13.395 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.373+0000 7f75cb7fe640 10 monclient: get_auth_request con 0x7f759c03faa0 auth_method 0 2026-02-13T20:29:13.395 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.374+0000 7f75cbfff640 10 monclient: get_auth_request con 0x7f759c0646e0 auth_method 0 2026-02-13T20:29:13.396 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.375+0000 7f75a7fff640 1 -- 10.20.193.110:0/3928584893 <== osd.5 v1:10.20.193.188:6805/4130810301 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (unknown 0 0 784407017) 0x7f759c086340 con 0x7f759c0646e0 2026-02-13T20:29:13.396 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.382+0000 7f75d1acc640 1 -- 10.20.193.110:0/3928584893 --> v1:10.20.193.188:6805/4130810301 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f75cc08b450 con 0x7f759c0646e0 2026-02-13T20:29:13.396 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.382+0000 7f75a7fff640 1 -- 10.20.193.110:0/3928584893 <== osd.5 v1:10.20.193.188:6805/4130810301 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f75c0008b10 con 0x7f759c0646e0 2026-02-13T20:29:13.397 INFO:teuthology.orchestra.run.trial110.stdout:{ 2026-02-13T20:29:13.397 INFO:teuthology.orchestra.run.trial110.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-13T20:29:13.397 INFO:teuthology.orchestra.run.trial110.stdout:} 2026-02-13T20:29:13.399 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.382+0000 7f75d1acc640 1 -- 10.20.193.110:0/3928584893 >> v1:10.20.193.188:6805/4130810301 conn(0x7f759c0646e0 legacy=0x7f759c084af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:13.399 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.382+0000 7f75d1acc640 1 -- 10.20.193.110:0/3928584893 >> v1:10.20.193.188:6812/1623052694 conn(0x7f759c03faa0 legacy=0x7f759c05ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:13.399 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.382+0000 7f75d1acc640 10 monclient: shutdown 2026-02-13T20:29:13.399 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.382+0000 7f75d1acc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:29:13.399 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.382+0000 7f75d1acc640 1 -- 10.20.193.110:0/3928584893 >> v1:10.20.193.110:6790/0 conn(0x7f75cc1401c0 legacy=0x7f75cc191790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:13.399 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.382+0000 7f75cbfff640 1 -- 10.20.193.110:0/3928584893 reap_dead start 2026-02-13T20:29:13.399 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.382+0000 7f75d1acc640 1 -- 10.20.193.110:0/3928584893 shutdown_connections 2026-02-13T20:29:13.399 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.382+0000 7f75d1acc640 1 -- 10.20.193.110:0/3928584893 >> 10.20.193.110:0/3928584893 conn(0x7f75cc054e90 msgr2=0x7f75cc08d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:29:13.399 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.382+0000 7f75d1acc640 1 -- 10.20.193.110:0/3928584893 shutdown_connections 2026-02-13T20:29:13.399 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.382+0000 7f75d1acc640 1 -- 10.20.193.110:0/3928584893 wait complete. 2026-02-13T20:29:13.400 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2026-02-13T20:29:13.465 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.464+0000 7f32152cc640 10 monclient: get_monmap_and_config 2026-02-13T20:29:13.466 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.464+0000 7f32152cc640 10 monclient: build_initial_monmap 2026-02-13T20:29:13.466 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.464+0000 7f32152cc640 10 monclient: monmap: 2026-02-13T20:29:13.466 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:29:13.466 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:13.466 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:29:13.465899+0000 2026-02-13T20:29:13.466 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:29:13.465899+0000 2026-02-13T20:29:13.466 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:29:13.466 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:13.466 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:29:13.466 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:29:13.467 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:29:13.467 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:13.471 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.464+0000 7f32152cc640 1 Processor -- start 2026-02-13T20:29:13.471 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f32152cc640 1 -- start start 2026-02-13T20:29:13.471 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f32152cc640 10 monclient: init 2026-02-13T20:29:13.471 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f32152cc640 10 monclient: _reopen_session rank -1 2026-02-13T20:29:13.471 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f32152cc640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:29:13.471 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f32152cc640 10 monclient(hunting): picked mon.noname-c con 0x7f32101401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:29:13.471 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f32152cc640 10 monclient(hunting): picked mon.noname-a con 0x7f3210092020 addr v1:10.20.193.110:6789/0 2026-02-13T20:29:13.471 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f32152cc640 10 monclient(hunting): picked mon.noname-b con 0x7f3210091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:29:13.471 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f32152cc640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f321008b730 con 0x7f3210092020 2026-02-13T20:29:13.471 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f32152cc640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f321005c5b0 con 0x7f32101401c0 2026-02-13T20:29:13.471 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f32152cc640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f321008bcf0 con 0x7f3210091950 2026-02-13T20:29:13.471 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f32152cc640 10 monclient(hunting): _renew_subs 2026-02-13T20:29:13.471 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f32152cc640 10 monclient(hunting): authenticate will time out at 1715.156412s 2026-02-13T20:29:13.471 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f320f7fe640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7f3210091950 0x7f32101a2a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:58004/0 (socket says 10.20.193.110:58004) 2026-02-13T20:29:13.471 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f320f7fe640 1 -- 10.20.193.110:0/3964181506 learned_addr learned my addr 10.20.193.110:0/3964181506 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:29:13.471 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f320e7fc640 1 --1- 10.20.193.110:0/3964181506 >> v1:10.20.193.110:6789/0 conn(0x7f3210092020 0x7f32101812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:34392/0 (socket says 10.20.193.110:34392) 2026-02-13T20:29:13.471 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f320dffb640 1 -- 10.20.193.110:0/3964181506 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2864149881 0 0) 0x7f321008b730 con 0x7f3210092020 2026-02-13T20:29:13.471 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f320dffb640 10 monclient(hunting): _negotiate 2026-02-13T20:29:13.471 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f320dffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:13.471 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f320dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:13.471 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f320dffb640 10 monclient(hunting): my global_id is 124635 2026-02-13T20:29:13.471 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f320dffb640 1 -- 10.20.193.110:0/3964181506 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31fc0035e0 con 0x7f3210092020 2026-02-13T20:29:13.471 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f320dffb640 1 -- 10.20.193.110:0/3964181506 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1471539603 0 0) 0x7f321008bcf0 con 0x7f3210091950 2026-02-13T20:29:13.471 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f320dffb640 10 monclient(hunting): _negotiate 2026-02-13T20:29:13.471 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f320dffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:13.471 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f320dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:13.471 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f320dffb640 10 monclient(hunting): my global_id is 154352 2026-02-13T20:29:13.471 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f320dffb640 1 -- 10.20.193.110:0/3964181506 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f321008b730 con 0x7f3210091950 2026-02-13T20:29:13.471 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f320dffb640 1 -- 10.20.193.110:0/3964181506 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1817074445 0 0) 0x7f31fc0035e0 con 0x7f3210092020 2026-02-13T20:29:13.471 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f320dffb640 1 -- 10.20.193.110:0/3964181506 >> v1:10.20.193.110:6790/0 conn(0x7f3210091950 legacy=0x7f32101a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:13.471 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f320dffb640 1 -- 10.20.193.110:0/3964181506 >> v1:10.20.193.188:6789/0 conn(0x7f32101401c0 legacy=0x7f3210091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:13.471 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f320dffb640 10 monclient: _finish_hunting 0 2026-02-13T20:29:13.471 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f320dffb640 1 monclient: found mon.noname-a 2026-02-13T20:29:13.471 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f320dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:29:13.472 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f320dffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:29:13.472 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f320dffb640 1 -- 10.20.193.110:0/3964181506 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3210140590 con 0x7f3210092020 2026-02-13T20:29:13.472 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f320dffb640 10 monclient: _finish_auth 0 2026-02-13T20:29:13.472 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f320dffb640 10 monclient: _check_auth_tickets 2026-02-13T20:29:13.472 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f320dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:29:13.472 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f320dffb640 1 -- 10.20.193.110:0/3964181506 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f31f8002dd0 con 0x7f3210092020 2026-02-13T20:29:13.472 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f320dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:13.472 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f320dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:29:13.472 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f320dffb640 10 monclient: dump: 2026-02-13T20:29:13.472 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:13.472 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:13.472 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:13.472 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:13.472 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:13.472 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:13.472 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:13.472 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:13.472 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:13.472 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:13.472 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f32152cc640 5 monclient: authenticate success, global_id 124635 2026-02-13T20:29:13.472 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f32152cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:29:13.472 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f320dffb640 1 -- 10.20.193.110:0/3964181506 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f31f8002fa0 con 0x7f3210092020 2026-02-13T20:29:13.472 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f320dffb640 10 monclient: handle_config config(0 keys) 2026-02-13T20:29:13.472 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f320dffb640 1 -- 10.20.193.110:0/3964181506 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f31f80033b0 con 0x7f3210092020 2026-02-13T20:29:13.472 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f320dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:13.472 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f320dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:29:13.472 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f320dffb640 10 monclient: dump: 2026-02-13T20:29:13.472 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:13.472 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:13.472 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:13.472 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:13.472 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:13.472 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:13.472 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:13.472 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:13.472 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:13.472 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:13.472 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f32152cc640 10 monclient: get_monmap_and_config success 2026-02-13T20:29:13.472 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.465+0000 7f32152cc640 4 set_mon_vals no callback set 2026-02-13T20:29:13.472 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.466+0000 7f32152cc640 10 monclient: shutdown 2026-02-13T20:29:13.472 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.466+0000 7f32152cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:29:13.472 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.466+0000 7f32152cc640 1 -- 10.20.193.110:0/3964181506 >> v1:10.20.193.110:6789/0 conn(0x7f3210092020 legacy=0x7f32101812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:13.472 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.466+0000 7f32152cc640 1 -- 10.20.193.110:0/3964181506 shutdown_connections 2026-02-13T20:29:13.472 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.466+0000 7f32152cc640 1 -- 10.20.193.110:0/3964181506 >> 10.20.193.110:0/3964181506 conn(0x7f3210054e90 msgr2=0x7f3210058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:29:13.472 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.466+0000 7f32152cc640 1 -- 10.20.193.110:0/3964181506 shutdown_connections 2026-02-13T20:29:13.473 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.466+0000 7f32152cc640 1 -- 10.20.193.110:0/3964181506 wait complete. 2026-02-13T20:29:13.473 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.466+0000 7f32152cc640 10 monclient: build_initial_monmap 2026-02-13T20:29:13.473 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.466+0000 7f32152cc640 10 monclient: monmap: 2026-02-13T20:29:13.473 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:29:13.473 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:29:13.473 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:29:13.473 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:29:13.473 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:29:13.473 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:29:13.473 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:29:13.473 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:29:13.473 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:29:13.473 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:13.473 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.466+0000 7f32152cc640 1 Processor -- start 2026-02-13T20:29:13.473 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.466+0000 7f32152cc640 1 -- start start 2026-02-13T20:29:13.473 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.466+0000 7f32152cc640 10 monclient: init 2026-02-13T20:29:13.473 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f32152cc640 10 monclient: _reopen_session rank -1 2026-02-13T20:29:13.473 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f32152cc640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:29:13.473 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f32152cc640 10 monclient(hunting): picked mon.noname-a con 0x7f3210091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:29:13.473 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f32152cc640 10 monclient(hunting): picked mon.noname-b con 0x7f32101401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:29:13.473 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f32152cc640 10 monclient(hunting): picked mon.noname-c con 0x7f321013dc90 addr v1:10.20.193.110:6790/0 2026-02-13T20:29:13.473 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f32152cc640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f321005d320 con 0x7f3210091950 2026-02-13T20:29:13.473 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f32152cc640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3210130720 con 0x7f32101401c0 2026-02-13T20:29:13.473 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f32152cc640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3210130ce0 con 0x7f321013dc90 2026-02-13T20:29:13.473 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f32152cc640 10 monclient(hunting): _renew_subs 2026-02-13T20:29:13.473 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f32152cc640 10 monclient(hunting): authenticate will time out at 1715.158190s 2026-02-13T20:29:13.473 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f320effd640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f3210091950 0x7f321013d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:34408/0 (socket says 10.20.193.110:34408) 2026-02-13T20:29:13.473 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f320effd640 1 -- 10.20.193.110:0/2128235520 learned_addr learned my addr 10.20.193.110:0/2128235520 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:29:13.473 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f31ef7fe640 1 -- 10.20.193.110:0/2128235520 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 572981277 0 0) 0x7f321005d320 con 0x7f3210091950 2026-02-13T20:29:13.473 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f31ef7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:29:13.473 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f31ef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:13.473 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f31ef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:13.473 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f31ef7fe640 10 monclient(hunting): my global_id is 124638 2026-02-13T20:29:13.473 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f31ef7fe640 1 -- 10.20.193.110:0/2128235520 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31dc0035e0 con 0x7f3210091950 2026-02-13T20:29:13.473 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f31ef7fe640 1 -- 10.20.193.110:0/2128235520 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 741883679 0 0) 0x7f3210130ce0 con 0x7f321013dc90 2026-02-13T20:29:13.473 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f31ef7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:29:13.473 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f31ef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:13.473 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f31ef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:13.473 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f31ef7fe640 10 monclient(hunting): my global_id is 154355 2026-02-13T20:29:13.473 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f31ef7fe640 1 -- 10.20.193.110:0/2128235520 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f321005d320 con 0x7f321013dc90 2026-02-13T20:29:13.473 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f31ef7fe640 1 -- 10.20.193.110:0/2128235520 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1415784953 0 0) 0x7f321005d320 con 0x7f321013dc90 2026-02-13T20:29:13.473 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f31ef7fe640 1 -- 10.20.193.110:0/2128235520 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3210130ce0 con 0x7f321013dc90 2026-02-13T20:29:13.473 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f31ef7fe640 1 -- 10.20.193.110:0/2128235520 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2477437189 0 0) 0x7f31dc0035e0 con 0x7f3210091950 2026-02-13T20:29:13.473 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f31ef7fe640 1 -- 10.20.193.110:0/2128235520 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f321005d320 con 0x7f3210091950 2026-02-13T20:29:13.473 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f31ef7fe640 1 -- 10.20.193.110:0/2128235520 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f32000040f0 con 0x7f321013dc90 2026-02-13T20:29:13.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f31ef7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:29:13.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f31ef7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:29:13.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f31ef7fe640 10 monclient(hunting): dump: 2026-02-13T20:29:13.474 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:13.474 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:13.474 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:13.474 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:13.474 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:13.474 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:13.474 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:13.474 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:13.474 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:13.474 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:13.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f31ef7fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:29:13.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f31ef7fe640 1 -- 10.20.193.110:0/2128235520 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f3204003170 con 0x7f3210091950 2026-02-13T20:29:13.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f31ef7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:29:13.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f31ef7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:29:13.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f31ef7fe640 10 monclient(hunting): dump: 2026-02-13T20:29:13.474 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:13.474 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:13.474 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:13.474 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:13.474 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:13.474 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:13.474 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:13.474 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:13.474 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:13.474 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:13.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f31ef7fe640 1 -- 10.20.193.110:0/2128235520 <== mon.1 v1:10.20.193.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3450058900 0 0) 0x7f3210130720 con 0x7f32101401c0 2026-02-13T20:29:13.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f31ef7fe640 10 monclient(hunting): _negotiate 2026-02-13T20:29:13.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f31ef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:13.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f31ef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:13.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f31ef7fe640 10 monclient(hunting): my global_id is 164197 2026-02-13T20:29:13.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f31ef7fe640 1 -- 10.20.193.110:0/2128235520 --> v1:10.20.193.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31dc0035e0 con 0x7f32101401c0 2026-02-13T20:29:13.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f31ef7fe640 1 -- 10.20.193.110:0/2128235520 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2305834499 0 0) 0x7f3210130ce0 con 0x7f321013dc90 2026-02-13T20:29:13.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f31ef7fe640 1 -- 10.20.193.110:0/2128235520 >> v1:10.20.193.188:6789/0 conn(0x7f32101401c0 legacy=0x7f3210193960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:13.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f31ef7fe640 1 -- 10.20.193.110:0/2128235520 >> v1:10.20.193.110:6789/0 conn(0x7f3210091950 legacy=0x7f321013d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:13.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f31ef7fe640 10 monclient: _finish_hunting 0 2026-02-13T20:29:13.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f31ef7fe640 1 monclient: found mon.c 2026-02-13T20:29:13.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f31ef7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:29:13.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f31ef7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:13.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f31ef7fe640 1 -- 10.20.193.110:0/2128235520 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3210130fc0 con 0x7f321013dc90 2026-02-13T20:29:13.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f31ef7fe640 10 monclient: _finish_auth 0 2026-02-13T20:29:13.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f31ef7fe640 10 monclient: _check_auth_tickets 2026-02-13T20:29:13.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f31ef7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:29:13.474 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f32152cc640 5 monclient: authenticate success, global_id 154355 2026-02-13T20:29:13.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f32152cc640 10 monclient: _renew_subs 2026-02-13T20:29:13.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f32152cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:13.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f32152cc640 1 -- 10.20.193.110:0/2128235520 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f321012ff70 con 0x7f321013dc90 2026-02-13T20:29:13.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f32152cc640 10 monclient: _renew_subs 2026-02-13T20:29:13.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f32152cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:13.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f32152cc640 1 -- 10.20.193.110:0/2128235520 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f321012f960 con 0x7f321013dc90 2026-02-13T20:29:13.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f31ef7fe640 1 -- 10.20.193.110:0/2128235520 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3200004610 con 0x7f321013dc90 2026-02-13T20:29:13.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f31ef7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T20:29:13.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f31ef7fe640 1 -- 10.20.193.110:0/2128235520 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f3200005b30 con 0x7f321013dc90 2026-02-13T20:29:13.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f31ef7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:13.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f31ef7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:29:13.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f31ef7fe640 10 monclient: dump: 2026-02-13T20:29:13.475 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:13.475 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:13.475 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:13.475 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:13.475 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:13.475 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:13.475 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:13.475 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:13.475 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:13.475 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:13.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.467+0000 7f320d7fa640 4 set_mon_vals no callback set 2026-02-13T20:29:13.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.468+0000 7f32152cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:13.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.468+0000 7f32152cc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:13.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.468+0000 7f32152cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:13.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.468+0000 7f32152cc640 1 -- 10.20.193.110:0/2128235520 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32100008d0 con 0x7f321013dc90 2026-02-13T20:29:13.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.468+0000 7f31ef7fe640 1 -- 10.20.193.110:0/2128235520 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f3200005c90 con 0x7f321013dc90 2026-02-13T20:29:13.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.468+0000 7f31ef7fe640 1 -- 10.20.193.110:0/2128235520 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(847..847 src has 1..847) ==== 3591+0+0 (unknown 4078645555 0 0) 0x7f320004f670 con 0x7f321013dc90 2026-02-13T20:29:13.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.468+0000 7f320effd640 10 monclient: get_auth_request con 0x7f31dc03fc90 auth_method 0 2026-02-13T20:29:13.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.470+0000 7f31ef7fe640 1 -- 10.20.193.110:0/2128235520 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f3200018070 con 0x7f321013dc90 2026-02-13T20:29:13.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.470+0000 7f31ef7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:13.475 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.470+0000 7f31ef7fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:29:13.575 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.574+0000 7f32152cc640 1 -- 10.20.193.110:0/2128235520 --> v1:10.20.193.188:6812/1623052694 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f321008b450 con 0x7f31dc03fc90 2026-02-13T20:29:13.575 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.574+0000 7f31ef7fe640 1 -- 10.20.193.110:0/2128235520 <== mgr.4105 v1:10.20.193.188:6812/1623052694 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (unknown 2264484800 0 0) 0x7f3204005a20 con 0x7f31dc03fc90 2026-02-13T20:29:13.575 INFO:teuthology.orchestra.run.trial110.stderr:instructed osd(s) 5 to deep-scrub 2026-02-13T20:29:13.576 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.575+0000 7f32152cc640 1 -- 10.20.193.110:0/2128235520 >> v1:10.20.193.188:6812/1623052694 conn(0x7f31dc03fc90 legacy=0x7f31dc060140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:13.576 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.575+0000 7f32152cc640 10 monclient: shutdown 2026-02-13T20:29:13.576 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.575+0000 7f32152cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:29:13.576 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.575+0000 7f32152cc640 1 -- 10.20.193.110:0/2128235520 >> v1:10.20.193.110:6790/0 conn(0x7f321013dc90 legacy=0x7f3210195080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:13.576 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.575+0000 7f32152cc640 1 -- 10.20.193.110:0/2128235520 shutdown_connections 2026-02-13T20:29:13.576 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.575+0000 7f32152cc640 1 -- 10.20.193.110:0/2128235520 >> 10.20.193.110:0/2128235520 conn(0x7f3210054e90 msgr2=0x7f3210089920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:29:13.576 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.575+0000 7f32152cc640 1 -- 10.20.193.110:0/2128235520 shutdown_connections 2026-02-13T20:29:13.576 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.575+0000 7f32152cc640 1 -- 10.20.193.110:0/2128235520 wait complete. 2026-02-13T20:29:13.583 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-13T20:29:13.647 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.646+0000 7fc588052640 10 monclient: get_monmap_and_config 2026-02-13T20:29:13.647 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.646+0000 7fc588052640 10 monclient: build_initial_monmap 2026-02-13T20:29:13.647 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.646+0000 7fc588052640 10 monclient: monmap: 2026-02-13T20:29:13.647 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:29:13.647 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:13.647 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:29:13.648156+0000 2026-02-13T20:29:13.648 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:29:13.648156+0000 2026-02-13T20:29:13.648 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:29:13.648 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:13.648 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:29:13.648 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:29:13.648 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:29:13.648 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:13.648 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.647+0000 7fc588052640 1 Processor -- start 2026-02-13T20:29:13.648 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.647+0000 7fc588052640 1 -- start start 2026-02-13T20:29:13.648 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.647+0000 7fc588052640 10 monclient: init 2026-02-13T20:29:13.648 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.647+0000 7fc588052640 10 monclient: _reopen_session rank -1 2026-02-13T20:29:13.648 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.647+0000 7fc588052640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:29:13.648 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.647+0000 7fc588052640 10 monclient(hunting): picked mon.noname-c con 0x7fc5801401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:29:13.648 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.647+0000 7fc588052640 10 monclient(hunting): picked mon.noname-a con 0x7fc580092020 addr v1:10.20.193.110:6789/0 2026-02-13T20:29:13.648 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.647+0000 7fc588052640 10 monclient(hunting): picked mon.noname-b con 0x7fc580091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:29:13.648 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.647+0000 7fc588052640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc58008b730 con 0x7fc580092020 2026-02-13T20:29:13.648 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.647+0000 7fc588052640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc58005c5b0 con 0x7fc5801401c0 2026-02-13T20:29:13.648 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.647+0000 7fc588052640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc58008bcf0 con 0x7fc580091950 2026-02-13T20:29:13.648 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.647+0000 7fc588052640 10 monclient(hunting): _renew_subs 2026-02-13T20:29:13.648 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.647+0000 7fc588052640 10 monclient(hunting): authenticate will time out at 1715.338530s 2026-02-13T20:29:13.648 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.647+0000 7fc5865c8640 1 --1- >> v1:10.20.193.110:6790/0 conn(0x7fc580091950 0x7fc5801a2a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:58018/0 (socket says 10.20.193.110:58018) 2026-02-13T20:29:13.648 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.647+0000 7fc5865c8640 1 -- 10.20.193.110:0/3030669278 learned_addr learned my addr 10.20.193.110:0/3030669278 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:29:13.649 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.647+0000 7fc584dc5640 1 -- 10.20.193.110:0/3030669278 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3200239020 0 0) 0x7fc58008b730 con 0x7fc580092020 2026-02-13T20:29:13.649 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.647+0000 7fc584dc5640 10 monclient(hunting): _negotiate 2026-02-13T20:29:13.649 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.647+0000 7fc584dc5640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:13.649 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.647+0000 7fc584dc5640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:13.649 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.647+0000 7fc584dc5640 10 monclient(hunting): my global_id is 124641 2026-02-13T20:29:13.649 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.647+0000 7fc584dc5640 1 -- 10.20.193.110:0/3030669278 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5680035e0 con 0x7fc580092020 2026-02-13T20:29:13.649 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.647+0000 7fc584dc5640 1 -- 10.20.193.110:0/3030669278 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3315573606 0 0) 0x7fc58008bcf0 con 0x7fc580091950 2026-02-13T20:29:13.649 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.647+0000 7fc584dc5640 10 monclient(hunting): _negotiate 2026-02-13T20:29:13.649 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.647+0000 7fc584dc5640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:13.649 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.647+0000 7fc584dc5640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:13.649 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.647+0000 7fc584dc5640 10 monclient(hunting): my global_id is 154358 2026-02-13T20:29:13.649 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.647+0000 7fc584dc5640 1 -- 10.20.193.110:0/3030669278 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc58008b730 con 0x7fc580091950 2026-02-13T20:29:13.649 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.648+0000 7fc584dc5640 1 -- 10.20.193.110:0/3030669278 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2627674072 0 0) 0x7fc5680035e0 con 0x7fc580092020 2026-02-13T20:29:13.649 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.648+0000 7fc584dc5640 1 -- 10.20.193.110:0/3030669278 >> v1:10.20.193.110:6790/0 conn(0x7fc580091950 legacy=0x7fc5801a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:13.649 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.648+0000 7fc584dc5640 1 -- 10.20.193.110:0/3030669278 >> v1:10.20.193.188:6789/0 conn(0x7fc5801401c0 legacy=0x7fc580091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:13.649 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.648+0000 7fc584dc5640 10 monclient: _finish_hunting 0 2026-02-13T20:29:13.649 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.648+0000 7fc584dc5640 1 monclient: found mon.noname-a 2026-02-13T20:29:13.650 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.648+0000 7fc584dc5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:29:13.650 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.648+0000 7fc584dc5640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:29:13.650 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.648+0000 7fc584dc5640 1 -- 10.20.193.110:0/3030669278 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc580140590 con 0x7fc580092020 2026-02-13T20:29:13.650 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.648+0000 7fc584dc5640 10 monclient: _finish_auth 0 2026-02-13T20:29:13.650 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.648+0000 7fc584dc5640 10 monclient: _check_auth_tickets 2026-02-13T20:29:13.650 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.648+0000 7fc584dc5640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:29:13.650 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.648+0000 7fc584dc5640 1 -- 10.20.193.110:0/3030669278 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc574002dd0 con 0x7fc580092020 2026-02-13T20:29:13.650 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.648+0000 7fc588052640 5 monclient: authenticate success, global_id 124641 2026-02-13T20:29:13.650 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.648+0000 7fc588052640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:29:13.650 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.648+0000 7fc584dc5640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:13.650 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.648+0000 7fc584dc5640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:29:13.650 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.648+0000 7fc584dc5640 10 monclient: dump: 2026-02-13T20:29:13.650 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:13.650 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:13.650 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:13.650 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:13.650 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:13.650 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:13.650 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:13.650 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:13.650 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:13.650 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:13.650 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.648+0000 7fc588052640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:29:13.650 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.648+0000 7fc584dc5640 1 -- 10.20.193.110:0/3030669278 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc574002fa0 con 0x7fc580092020 2026-02-13T20:29:13.650 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.648+0000 7fc584dc5640 10 monclient: handle_config config(0 keys) 2026-02-13T20:29:13.650 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.648+0000 7fc588052640 10 monclient: get_monmap_and_config success 2026-02-13T20:29:13.650 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.648+0000 7fc588052640 4 set_mon_vals no callback set 2026-02-13T20:29:13.650 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.648+0000 7fc584dc5640 1 -- 10.20.193.110:0/3030669278 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc5740033b0 con 0x7fc580092020 2026-02-13T20:29:13.650 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.648+0000 7fc584dc5640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:13.650 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.648+0000 7fc584dc5640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:29:13.650 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.648+0000 7fc584dc5640 10 monclient: dump: 2026-02-13T20:29:13.650 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:13.650 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:13.650 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:13.650 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:13.650 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:13.650 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:13.650 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:13.650 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:13.650 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:13.650 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:13.650 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.648+0000 7fc588052640 10 monclient: shutdown 2026-02-13T20:29:13.650 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.648+0000 7fc588052640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:29:13.650 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.648+0000 7fc588052640 1 -- 10.20.193.110:0/3030669278 >> v1:10.20.193.110:6789/0 conn(0x7fc580092020 legacy=0x7fc5801812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:13.650 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.648+0000 7fc588052640 1 -- 10.20.193.110:0/3030669278 shutdown_connections 2026-02-13T20:29:13.651 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.648+0000 7fc588052640 1 -- 10.20.193.110:0/3030669278 >> 10.20.193.110:0/3030669278 conn(0x7fc580054e90 msgr2=0x7fc580058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:29:13.651 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.648+0000 7fc588052640 1 -- 10.20.193.110:0/3030669278 shutdown_connections 2026-02-13T20:29:13.651 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.648+0000 7fc588052640 1 -- 10.20.193.110:0/3030669278 wait complete. 2026-02-13T20:29:13.652 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.648+0000 7fc588052640 10 monclient: build_initial_monmap 2026-02-13T20:29:13.652 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.648+0000 7fc588052640 10 monclient: monmap: 2026-02-13T20:29:13.652 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:29:13.652 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:29:13.652 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:29:13.652 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:29:13.652 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:29:13.652 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:29:13.652 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:29:13.652 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:29:13.652 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:29:13.652 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:13.652 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc588052640 1 Processor -- start 2026-02-13T20:29:13.652 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc588052640 1 -- start start 2026-02-13T20:29:13.652 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc588052640 10 monclient: init 2026-02-13T20:29:13.652 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc588052640 10 monclient: _reopen_session rank -1 2026-02-13T20:29:13.652 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc588052640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:29:13.652 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc588052640 10 monclient(hunting): picked mon.noname-a con 0x7fc580091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:29:13.652 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc588052640 10 monclient(hunting): picked mon.noname-b con 0x7fc5801401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:29:13.652 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc588052640 10 monclient(hunting): picked mon.noname-c con 0x7fc58012bb50 addr v1:10.20.193.110:6790/0 2026-02-13T20:29:13.652 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc588052640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc58008c430 con 0x7fc580091950 2026-02-13T20:29:13.652 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc588052640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc58005d320 con 0x7fc5801401c0 2026-02-13T20:29:13.652 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc588052640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc58012aff0 con 0x7fc58012bb50 2026-02-13T20:29:13.652 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc588052640 10 monclient(hunting): _renew_subs 2026-02-13T20:29:13.652 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc588052640 10 monclient(hunting): authenticate will time out at 1715.340328s 2026-02-13T20:29:13.652 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc585dc7640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fc580091950 0x7fc580114350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:34434/0 (socket says 10.20.193.110:34434) 2026-02-13T20:29:13.652 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc585dc7640 1 -- 10.20.193.110:0/1629012560 learned_addr learned my addr 10.20.193.110:0/1629012560 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:29:13.652 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc56e7fc640 1 -- 10.20.193.110:0/1629012560 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 931715098 0 0) 0x7fc58008c430 con 0x7fc580091950 2026-02-13T20:29:13.652 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc56e7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:29:13.652 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc56e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:13.652 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc56e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:13.653 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc56e7fc640 10 monclient(hunting): my global_id is 124644 2026-02-13T20:29:13.653 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc56e7fc640 1 -- 10.20.193.110:0/1629012560 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5500035e0 con 0x7fc580091950 2026-02-13T20:29:13.653 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc56e7fc640 1 -- 10.20.193.110:0/1629012560 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 804370804 0 0) 0x7fc58012aff0 con 0x7fc58012bb50 2026-02-13T20:29:13.653 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc56e7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:29:13.653 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc56e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:13.653 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc56e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:13.653 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc56e7fc640 10 monclient(hunting): my global_id is 154361 2026-02-13T20:29:13.653 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc56e7fc640 1 -- 10.20.193.110:0/1629012560 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc58008c430 con 0x7fc58012bb50 2026-02-13T20:29:13.653 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc56e7fc640 1 -- 10.20.193.110:0/1629012560 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 769253447 0 0) 0x7fc58008c430 con 0x7fc58012bb50 2026-02-13T20:29:13.653 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc56e7fc640 1 -- 10.20.193.110:0/1629012560 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc58012aff0 con 0x7fc58012bb50 2026-02-13T20:29:13.653 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc56e7fc640 1 -- 10.20.193.110:0/1629012560 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc57c0040f0 con 0x7fc58012bb50 2026-02-13T20:29:13.653 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc56e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:29:13.653 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc56e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:29:13.653 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc56e7fc640 10 monclient(hunting): dump: 2026-02-13T20:29:13.653 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:13.653 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:13.653 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:13.653 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:13.653 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:13.653 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:13.653 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:13.653 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:13.653 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:13.653 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:13.653 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc56e7fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:29:13.653 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc56e7fc640 1 -- 10.20.193.110:0/1629012560 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1133327590 0 0) 0x7fc5500035e0 con 0x7fc580091950 2026-02-13T20:29:13.653 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc56e7fc640 1 -- 10.20.193.110:0/1629012560 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc58008c430 con 0x7fc580091950 2026-02-13T20:29:13.653 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc56e7fc640 1 -- 10.20.193.110:0/1629012560 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc570003170 con 0x7fc580091950 2026-02-13T20:29:13.653 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc56e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:29:13.653 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc56e7fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:29:13.653 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc56e7fc640 10 monclient(hunting): dump: 2026-02-13T20:29:13.653 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:13.653 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:13.653 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:13.653 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:13.653 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:13.653 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:13.653 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:13.653 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:13.653 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:13.653 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:13.653 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc56e7fc640 1 -- 10.20.193.110:0/1629012560 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1045521339 0 0) 0x7fc58012aff0 con 0x7fc58012bb50 2026-02-13T20:29:13.653 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc56e7fc640 1 -- 10.20.193.110:0/1629012560 >> v1:10.20.193.188:6789/0 conn(0x7fc5801401c0 legacy=0x7fc580114a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:13.653 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc56e7fc640 1 -- 10.20.193.110:0/1629012560 >> v1:10.20.193.110:6789/0 conn(0x7fc580091950 legacy=0x7fc580114350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:13.653 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc56e7fc640 10 monclient: _finish_hunting 0 2026-02-13T20:29:13.653 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc56e7fc640 1 monclient: found mon.c 2026-02-13T20:29:13.653 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc56e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:29:13.654 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc56e7fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:13.654 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc56e7fc640 1 -- 10.20.193.110:0/1629012560 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc58012d350 con 0x7fc58012bb50 2026-02-13T20:29:13.654 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc56e7fc640 10 monclient: _finish_auth 0 2026-02-13T20:29:13.654 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc56e7fc640 10 monclient: _check_auth_tickets 2026-02-13T20:29:13.654 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc56e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:29:13.654 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc588052640 5 monclient: authenticate success, global_id 154361 2026-02-13T20:29:13.654 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc588052640 10 monclient: _renew_subs 2026-02-13T20:29:13.654 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc588052640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:13.654 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc588052640 1 -- 10.20.193.110:0/1629012560 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc58012cab0 con 0x7fc58012bb50 2026-02-13T20:29:13.654 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc588052640 10 monclient: _renew_subs 2026-02-13T20:29:13.654 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc588052640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:13.654 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.649+0000 7fc588052640 1 -- 10.20.193.110:0/1629012560 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fc5801a3970 con 0x7fc58012bb50 2026-02-13T20:29:13.654 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.650+0000 7fc56e7fc640 1 -- 10.20.193.110:0/1629012560 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc57c004610 con 0x7fc58012bb50 2026-02-13T20:29:13.654 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.650+0000 7fc56e7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:29:13.654 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.650+0000 7fc56e7fc640 1 -- 10.20.193.110:0/1629012560 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fc57c005b30 con 0x7fc58012bb50 2026-02-13T20:29:13.654 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.650+0000 7fc56e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:13.654 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.650+0000 7fc56e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:29:13.654 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.650+0000 7fc56e7fc640 10 monclient: dump: 2026-02-13T20:29:13.654 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:13.654 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:13.654 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:13.654 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:13.654 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:13.654 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:13.654 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:13.654 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:13.654 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:13.654 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:13.654 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.650+0000 7fc56ffff640 4 set_mon_vals no callback set 2026-02-13T20:29:13.654 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.650+0000 7fc588052640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:13.654 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.650+0000 7fc588052640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:13.654 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.650+0000 7fc588052640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:13.654 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.650+0000 7fc588052640 1 -- 10.20.193.110:0/1629012560 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5800008d0 con 0x7fc58012bb50 2026-02-13T20:29:13.654 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.650+0000 7fc56e7fc640 1 -- 10.20.193.110:0/1629012560 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fc57c005c90 con 0x7fc58012bb50 2026-02-13T20:29:13.654 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.650+0000 7fc56e7fc640 1 -- 10.20.193.110:0/1629012560 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(847..847 src has 1..847) ==== 3591+0+0 (unknown 4078645555 0 0) 0x7fc57c04f770 con 0x7fc58012bb50 2026-02-13T20:29:13.654 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.650+0000 7fc585dc7640 10 monclient: get_auth_request con 0x7fc55003fae0 auth_method 0 2026-02-13T20:29:13.654 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.653+0000 7fc56e7fc640 1 -- 10.20.193.110:0/1629012560 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fc57c005f70 con 0x7fc58012bb50 2026-02-13T20:29:13.654 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.653+0000 7fc56e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:13.654 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.653+0000 7fc56e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:29:13.755 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.754+0000 7fc588052640 1 -- 10.20.193.110:0/1629012560 --> v1:10.20.193.188:6812/1623052694 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc58008b450 con 0x7fc55003fae0 2026-02-13T20:29:13.756 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.755+0000 7fc56e7fc640 1 -- 10.20.193.110:0/1629012560 <== mgr.4105 v1:10.20.193.188:6812/1623052694 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34048 (unknown 2965378022 0 4264536108) 0x7fc5700078a0 con 0x7fc55003fae0 2026-02-13T20:29:13.756 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:29:13.756 INFO:teuthology.orchestra.run.trial110.stderr:dumped all 2026-02-13T20:29:13.757 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.756+0000 7fc588052640 1 -- 10.20.193.110:0/1629012560 >> v1:10.20.193.188:6812/1623052694 conn(0x7fc55003fae0 legacy=0x7fc55005ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:13.757 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.756+0000 7fc588052640 10 monclient: shutdown 2026-02-13T20:29:13.757 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.756+0000 7fc588052640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:29:13.757 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.756+0000 7fc588052640 1 -- 10.20.193.110:0/1629012560 >> v1:10.20.193.110:6790/0 conn(0x7fc58012bb50 legacy=0x7fc5801a2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:13.757 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.756+0000 7fc588052640 1 -- 10.20.193.110:0/1629012560 shutdown_connections 2026-02-13T20:29:13.757 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.756+0000 7fc588052640 1 -- 10.20.193.110:0/1629012560 >> 10.20.193.110:0/1629012560 conn(0x7fc580054e90 msgr2=0x7fc58008de20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:29:13.757 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.756+0000 7fc588052640 1 -- 10.20.193.110:0/1629012560 shutdown_connections 2026-02-13T20:29:13.757 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:13.756+0000 7fc588052640 1 -- 10.20.193.110:0/1629012560 wait complete. 2026-02-13T20:29:13.764 INFO:teuthology.orchestra.run.trial110.stdout:{"pg_ready":true,"pg_map":{"version":1374,"stamp":"2026-02-13T20:29:12.246173+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":238696,"kb_used_data":40840,"kb_used_omap":8891,"kb_used_meta":188868,"kb_avail":565992344,"statfs":{"total":579820584960,"available":579576160256,"internally_reserved":0,"allocated":41820160,"data_stored":23930254,"data_compressed":16424,"data_compressed_allocated":98304,"data_compressed_original":1179648,"omap_allocated":9104596,"internal_metadata":193401644},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001017"},"pg_stats":[{"pgid":"1.0","version":"14'112","reported_seq":1794,"reported_epoch":847,"state":"active+clean","last_fresh":"2026-02-13T20:28:50.740927+0000","last_change":"2026-02-13T20:11:25.262882+0000","last_active":"2026-02-13T20:28:50.740927+0000","last_peered":"2026-02-13T20:28:50.740927+0000","last_clean":"2026-02-13T20:28:50.740927+0000","last_became_active":"2026-02-13T20:11:25.262766+0000","last_became_peered":"2026-02-13T20:11:25.262766+0000","last_unstale":"2026-02-13T20:28:50.740927+0000","last_undegraded":"2026-02-13T20:28:50.740927+0000","last_fullsized":"2026-02-13T20:28:50.740927+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:24.258524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:24.258524+0000","last_clean_scrub_stamp":"2026-02-13T20:11:24.258524+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T22:58:36.956434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":1657,"reported_epoch":847,"state":"active+clean","last_fresh":"2026-02-13T20:28:50.950103+0000","last_change":"2026-02-13T20:11:30.562730+0000","last_active":"2026-02-13T20:28:50.950103+0000","last_peered":"2026-02-13T20:28:50.950103+0000","last_clean":"2026-02-13T20:28:50.950103+0000","last_became_active":"2026-02-13T20:11:28.558943+0000","last_became_peered":"2026-02-13T20:11:28.558943+0000","last_unstale":"2026-02-13T20:28:50.950103+0000","last_undegraded":"2026-02-13T20:28:50.950103+0000","last_fullsized":"2026-02-13T20:28:50.950103+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T21:39:10.290168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032435800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1657,"reported_epoch":847,"state":"active+clean","last_fresh":"2026-02-13T20:28:50.740712+0000","last_change":"2026-02-13T20:11:30.561332+0000","last_active":"2026-02-13T20:28:50.740712+0000","last_peered":"2026-02-13T20:28:50.740712+0000","last_clean":"2026-02-13T20:28:50.740712+0000","last_became_active":"2026-02-13T20:11:28.559211+0000","last_became_peered":"2026-02-13T20:11:28.559211+0000","last_unstale":"2026-02-13T20:28:50.740712+0000","last_undegraded":"2026-02-13T20:28:50.740712+0000","last_fullsized":"2026-02-13T20:28:50.740712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T22:32:44.601301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029208800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1667,"reported_epoch":847,"state":"active+clean","last_fresh":"2026-02-13T20:28:50.952757+0000","last_change":"2026-02-13T20:11:30.823369+0000","last_active":"2026-02-13T20:28:50.952757+0000","last_peered":"2026-02-13T20:28:50.952757+0000","last_clean":"2026-02-13T20:28:50.952757+0000","last_became_active":"2026-02-13T20:11:28.559802+0000","last_became_peered":"2026-02-13T20:11:28.559802+0000","last_unstale":"2026-02-13T20:28:50.952757+0000","last_undegraded":"2026-02-13T20:28:50.952757+0000","last_fullsized":"2026-02-13T20:28:50.952757+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T05:27:34.220283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000230979,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":1658,"reported_epoch":847,"state":"active+clean","last_fresh":"2026-02-13T20:28:50.950215+0000","last_change":"2026-02-13T20:11:30.563087+0000","last_active":"2026-02-13T20:28:50.950215+0000","last_peered":"2026-02-13T20:28:50.950215+0000","last_clean":"2026-02-13T20:28:50.950215+0000","last_became_active":"2026-02-13T20:11:28.557848+0000","last_became_peered":"2026-02-13T20:11:28.557848+0000","last_unstale":"2026-02-13T20:28:50.950215+0000","last_undegraded":"2026-02-13T20:28:50.950215+0000","last_fullsized":"2026-02-13T20:28:50.950215+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T21:44:09.052237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064918699999999996,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1671,"reported_epoch":847,"state":"active+clean","last_fresh":"2026-02-13T20:28:50.953520+0000","last_change":"2026-02-13T20:11:30.561668+0000","last_active":"2026-02-13T20:28:50.953520+0000","last_peered":"2026-02-13T20:28:50.953520+0000","last_clean":"2026-02-13T20:28:50.953520+0000","last_became_active":"2026-02-13T20:11:28.558441+0000","last_became_peered":"2026-02-13T20:11:28.558441+0000","last_unstale":"2026-02-13T20:28:50.953520+0000","last_undegraded":"2026-02-13T20:28:50.953520+0000","last_fullsized":"2026-02-13T20:28:50.953520+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T22:32:58.917639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000231139,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1657,"reported_epoch":847,"state":"active+clean","last_fresh":"2026-02-13T20:28:50.740673+0000","last_change":"2026-02-13T20:11:30.561240+0000","last_active":"2026-02-13T20:28:50.740673+0000","last_peered":"2026-02-13T20:28:50.740673+0000","last_clean":"2026-02-13T20:28:50.740673+0000","last_became_active":"2026-02-13T20:11:28.559005+0000","last_became_peered":"2026-02-13T20:11:28.559005+0000","last_unstale":"2026-02-13T20:28:50.740673+0000","last_undegraded":"2026-02-13T20:28:50.740673+0000","last_fullsized":"2026-02-13T20:28:50.740673+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T02:48:59.423627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027156000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1671,"reported_epoch":847,"state":"active+clean","last_fresh":"2026-02-13T20:28:50.953498+0000","last_change":"2026-02-13T20:11:30.561637+0000","last_active":"2026-02-13T20:28:50.953498+0000","last_peered":"2026-02-13T20:28:50.953498+0000","last_clean":"2026-02-13T20:28:50.953498+0000","last_became_active":"2026-02-13T20:11:28.559585+0000","last_became_peered":"2026-02-13T20:11:28.559585+0000","last_unstale":"2026-02-13T20:28:50.953498+0000","last_undegraded":"2026-02-13T20:28:50.953498+0000","last_fullsized":"2026-02-13T20:28:50.953498+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T23:13:24.610860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00021035100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1657,"reported_epoch":847,"state":"active+clean","last_fresh":"2026-02-13T20:28:50.740649+0000","last_change":"2026-02-13T20:11:30.561334+0000","last_active":"2026-02-13T20:28:50.740649+0000","last_peered":"2026-02-13T20:28:50.740649+0000","last_clean":"2026-02-13T20:28:50.740649+0000","last_became_active":"2026-02-13T20:11:29.018116+0000","last_became_peered":"2026-02-13T20:11:29.018116+0000","last_unstale":"2026-02-13T20:28:50.740649+0000","last_undegraded":"2026-02-13T20:28:50.740649+0000","last_fullsized":"2026-02-13T20:28:50.740649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:11:27.551461+0000","last_clean_scrub_stamp":"2026-02-13T20:11:27.551461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T03:21:19.857098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000335309,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1180736,"data_compressed":16424,"data_compressed_allocated":98304,"data_compressed_original":1179648,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640471,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33752,"kb_used_data":6792,"kb_used_omap":1355,"kb_used_meta":25588,"kb_avail":94338088,"statfs":{"total":96636764160,"available":96602202112,"internally_reserved":0,"allocated":6955008,"data_stored":3791599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1388487,"internal_metadata":26202169},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640472,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33748,"kb_used_data":6788,"kb_used_omap":1240,"kb_used_meta":25703,"kb_avail":94338092,"statfs":{"total":96636764160,"available":96602206208,"internally_reserved":0,"allocated":6950912,"data_stored":3791580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1270080,"internal_metadata":26320576},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640472,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33800,"kb_used_data":6840,"kb_used_omap":1132,"kb_used_meta":25811,"kb_avail":94338040,"statfs":{"total":96636764160,"available":96602152960,"internally_reserved":0,"allocated":7004160,"data_stored":4381948,"data_compressed":8212,"data_compressed_allocated":49152,"data_compressed_original":589824,"omap_allocated":1159884,"internal_metadata":26430772},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640472,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51796,"kb_used_data":6788,"kb_used_omap":2201,"kb_used_meta":42790,"kb_avail":94320044,"statfs":{"total":96636764160,"available":96583725056,"internally_reserved":0,"allocated":6950912,"data_stored":3791580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2254483,"internal_metadata":43817325},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640471,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51800,"kb_used_data":6792,"kb_used_omap":1806,"kb_used_meta":43185,"kb_avail":94320040,"statfs":{"total":96636764160,"available":96583720960,"internally_reserved":0,"allocated":6955008,"data_stored":3791599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1849790,"internal_metadata":44222018},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640472,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33800,"kb_used_data":6840,"kb_used_omap":1154,"kb_used_meta":25789,"kb_avail":94338040,"statfs":{"total":96636764160,"available":96602152960,"internally_reserved":0,"allocated":7004160,"data_stored":4381948,"data_compressed":8212,"data_compressed_allocated":49152,"data_compressed_original":589824,"omap_allocated":1181872,"internal_metadata":26408784},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":590368,"data_compressed":8212,"data_compressed_allocated":49152,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":590368,"data_compressed":8212,"data_compressed_allocated":49152,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T20:29:13.767 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-02-13T20:11:24.258524+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=20, tm_min=11, tm_sec=24, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=20, tm_min=29, tm_sec=10, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T20:29:13.767 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2026-02-13T20:11:27.551461+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=20, tm_min=11, tm_sec=27, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=20, tm_min=29, tm_sec=10, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T20:29:13.767 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2026-02-13T20:11:27.551461+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=20, tm_min=11, tm_sec=27, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=20, tm_min=29, tm_sec=10, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T20:29:13.767 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2026-02-13T20:11:27.551461+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=20, tm_min=11, tm_sec=27, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=20, tm_min=29, tm_sec=10, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T20:29:13.767 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2026-02-13T20:11:27.551461+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=20, tm_min=11, tm_sec=27, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=20, tm_min=29, tm_sec=10, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T20:29:13.767 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2026-02-13T20:11:27.551461+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=20, tm_min=11, tm_sec=27, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=20, tm_min=29, tm_sec=10, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T20:29:13.767 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2026-02-13T20:11:27.551461+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=20, tm_min=11, tm_sec=27, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=20, tm_min=29, tm_sec=10, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T20:29:13.767 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2026-02-13T20:11:27.551461+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=20, tm_min=11, tm_sec=27, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=20, tm_min=29, tm_sec=10, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T20:29:13.767 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2026-02-13T20:11:27.551461+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=20, tm_min=11, tm_sec=27, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=20, tm_min=29, tm_sec=10, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T20:29:13.767 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-13T20:29:33.768 DEBUG:teuthology.orchestra.run.trial110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-13T20:29:33.837 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.837+0000 7f4e67d0c640 10 monclient: get_monmap_and_config 2026-02-13T20:29:33.837 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.837+0000 7f4e67d0c640 10 monclient: build_initial_monmap 2026-02-13T20:29:33.837 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.837+0000 7f4e67d0c640 10 monclient: monmap: 2026-02-13T20:29:33.838 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:29:33.838 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:33.838 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:29:33.837693+0000 2026-02-13T20:29:33.838 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:29:33.837693+0000 2026-02-13T20:29:33.838 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:29:33.838 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:33.838 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:29:33.838 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:29:33.838 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:29:33.838 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:33.846 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.837+0000 7f4e67d0c640 1 Processor -- start 2026-02-13T20:29:33.847 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.837+0000 7f4e67d0c640 1 -- start start 2026-02-13T20:29:33.847 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.837+0000 7f4e67d0c640 10 monclient: init 2026-02-13T20:29:33.847 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.837+0000 7f4e67d0c640 10 monclient: _reopen_session rank -1 2026-02-13T20:29:33.847 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e67d0c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T20:29:33.847 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e67d0c640 10 monclient(hunting): picked mon.noname-a con 0x7f4e601401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:29:33.847 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e67d0c640 10 monclient(hunting): picked mon.noname-b con 0x7f4e60092020 addr v1:10.20.193.110:6790/0 2026-02-13T20:29:33.847 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e67d0c640 10 monclient(hunting): picked mon.noname-c con 0x7f4e60091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:29:33.847 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e67d0c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e6008b730 con 0x7f4e601401c0 2026-02-13T20:29:33.847 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e67d0c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e6005c5b0 con 0x7f4e60091950 2026-02-13T20:29:33.847 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e67d0c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e6008bcf0 con 0x7f4e60092020 2026-02-13T20:29:33.848 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e67d0c640 10 monclient(hunting): _renew_subs 2026-02-13T20:29:33.848 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e67d0c640 10 monclient(hunting): authenticate will time out at 1735.528064s 2026-02-13T20:29:33.848 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e65a81640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f4e601401c0 0x7f4e60091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:39638/0 (socket says 10.20.193.110:39638) 2026-02-13T20:29:33.848 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e65a81640 1 -- 10.20.193.110:0/2449982532 learned_addr learned my addr 10.20.193.110:0/2449982532 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:29:33.848 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e65280640 1 --1- 10.20.193.110:0/2449982532 >> v1:10.20.193.110:6790/0 conn(0x7f4e60092020 0x7f4e601812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:58662/0 (socket says 10.20.193.110:58662) 2026-02-13T20:29:33.848 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e64a7f640 1 -- 10.20.193.110:0/2449982532 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3535973906 0 0) 0x7f4e6008bcf0 con 0x7f4e60092020 2026-02-13T20:29:33.848 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e64a7f640 10 monclient(hunting): _negotiate 2026-02-13T20:29:33.848 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e64a7f640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:33.848 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e64a7f640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:33.848 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e64a7f640 10 monclient(hunting): my global_id is 154364 2026-02-13T20:29:33.848 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e64a7f640 1 -- 10.20.193.110:0/2449982532 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e480035e0 con 0x7f4e60092020 2026-02-13T20:29:33.848 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e64a7f640 1 -- 10.20.193.110:0/2449982532 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1616686042 0 0) 0x7f4e6008b730 con 0x7f4e601401c0 2026-02-13T20:29:33.849 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e64a7f640 10 monclient(hunting): _negotiate 2026-02-13T20:29:33.849 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e64a7f640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:33.849 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e64a7f640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:33.849 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e64a7f640 10 monclient(hunting): my global_id is 124647 2026-02-13T20:29:33.849 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e64a7f640 1 -- 10.20.193.110:0/2449982532 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e6008bcf0 con 0x7f4e601401c0 2026-02-13T20:29:33.849 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e64a7f640 1 -- 10.20.193.110:0/2449982532 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3957599450 0 0) 0x7f4e480035e0 con 0x7f4e60092020 2026-02-13T20:29:33.849 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e64a7f640 1 -- 10.20.193.110:0/2449982532 >> v1:10.20.193.188:6789/0 conn(0x7f4e60091950 legacy=0x7f4e601a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T20:29:33.849 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e64a7f640 1 -- 10.20.193.110:0/2449982532 >> v1:10.20.193.110:6789/0 conn(0x7f4e601401c0 legacy=0x7f4e60091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:33.849 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e64a7f640 10 monclient: _finish_hunting 0 2026-02-13T20:29:33.849 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e64a7f640 1 monclient: found mon.noname-b 2026-02-13T20:29:33.849 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e64a7f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:29:33.849 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e64a7f640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.110:6790/0 2026-02-13T20:29:33.849 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e64a7f640 1 -- 10.20.193.110:0/2449982532 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e60140590 con 0x7f4e60092020 2026-02-13T20:29:33.850 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e64a7f640 10 monclient: _finish_auth 0 2026-02-13T20:29:33.850 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e64a7f640 10 monclient: _check_auth_tickets 2026-02-13T20:29:33.850 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e64a7f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:29:33.850 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e64a7f640 1 -- 10.20.193.110:0/2449982532 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f4e54002dd0 con 0x7f4e60092020 2026-02-13T20:29:33.850 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e64a7f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:33.850 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e64a7f640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T20:29:33.850 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e64a7f640 10 monclient: dump: 2026-02-13T20:29:33.850 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:33.850 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:33.850 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:33.850 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:33.850 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:33.851 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:33.851 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:33.851 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:33.851 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:33.851 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:33.851 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e67d0c640 5 monclient: authenticate success, global_id 154364 2026-02-13T20:29:33.851 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e67d0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:29:33.851 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e64a7f640 1 -- 10.20.193.110:0/2449982532 <== mon.2 v1:10.20.193.110:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4e54003020 con 0x7f4e60092020 2026-02-13T20:29:33.851 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e64a7f640 10 monclient: handle_config config(0 keys) 2026-02-13T20:29:33.851 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e67d0c640 10 monclient: get_monmap_and_config success 2026-02-13T20:29:33.851 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e67d0c640 4 set_mon_vals no callback set 2026-02-13T20:29:33.851 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e64a7f640 1 -- 10.20.193.110:0/2449982532 <== mon.2 v1:10.20.193.110:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f4e54003430 con 0x7f4e60092020 2026-02-13T20:29:33.852 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e64a7f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:33.852 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e64a7f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:29:33.852 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e64a7f640 10 monclient: dump: 2026-02-13T20:29:33.852 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:33.852 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:33.852 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:33.852 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:33.852 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:33.852 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:33.852 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:33.852 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:33.852 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:33.852 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:33.853 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e67d0c640 10 monclient: shutdown 2026-02-13T20:29:33.853 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e67d0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:29:33.853 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e67d0c640 1 -- 10.20.193.110:0/2449982532 >> v1:10.20.193.110:6790/0 conn(0x7f4e60092020 legacy=0x7f4e601812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:33.853 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e67d0c640 1 -- 10.20.193.110:0/2449982532 shutdown_connections 2026-02-13T20:29:33.853 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e67d0c640 1 -- 10.20.193.110:0/2449982532 >> 10.20.193.110:0/2449982532 conn(0x7f4e60054e90 msgr2=0x7f4e60058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:29:33.853 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e67d0c640 1 -- 10.20.193.110:0/2449982532 shutdown_connections 2026-02-13T20:29:33.853 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.838+0000 7f4e67d0c640 1 -- 10.20.193.110:0/2449982532 wait complete. 2026-02-13T20:29:33.853 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.839+0000 7f4e67d0c640 10 monclient: build_initial_monmap 2026-02-13T20:29:33.853 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.839+0000 7f4e67d0c640 10 monclient: monmap: 2026-02-13T20:29:33.853 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:29:33.853 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:29:33.853 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:29:33.854 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:29:33.854 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:29:33.854 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:29:33.854 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:29:33.854 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:29:33.854 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:29:33.854 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:33.854 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.839+0000 7f4e67d0c640 1 Processor -- start 2026-02-13T20:29:33.854 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.839+0000 7f4e67d0c640 1 -- start start 2026-02-13T20:29:33.854 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.839+0000 7f4e67d0c640 10 monclient: init 2026-02-13T20:29:33.854 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.839+0000 7f4e67d0c640 10 monclient: _reopen_session rank -1 2026-02-13T20:29:33.854 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.839+0000 7f4e67d0c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T20:29:33.855 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.839+0000 7f4e67d0c640 10 monclient(hunting): picked mon.noname-b con 0x7f4e60091950 addr v1:10.20.193.188:6789/0 2026-02-13T20:29:33.855 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.839+0000 7f4e67d0c640 10 monclient(hunting): picked mon.noname-a con 0x7f4e601401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:29:33.855 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.839+0000 7f4e67d0c640 10 monclient(hunting): picked mon.noname-c con 0x7f4e60116340 addr v1:10.20.193.110:6790/0 2026-02-13T20:29:33.855 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.839+0000 7f4e67d0c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e6005d320 con 0x7f4e601401c0 2026-02-13T20:29:33.855 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.839+0000 7f4e67d0c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e6012dde0 con 0x7f4e60091950 2026-02-13T20:29:33.855 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.839+0000 7f4e67d0c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e6008a880 con 0x7f4e60116340 2026-02-13T20:29:33.855 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.839+0000 7f4e67d0c640 10 monclient(hunting): _renew_subs 2026-02-13T20:29:33.855 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.839+0000 7f4e67d0c640 10 monclient(hunting): authenticate will time out at 1735.529703s 2026-02-13T20:29:33.855 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.839+0000 7f4e65280640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7f4e601401c0 0x7f4e601a1040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:39648/0 (socket says 10.20.193.110:39648) 2026-02-13T20:29:33.855 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.839+0000 7f4e65280640 1 -- 10.20.193.110:0/2426621040 learned_addr learned my addr 10.20.193.110:0/2426621040 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:29:33.855 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.839+0000 7f4e4e7fc640 1 -- 10.20.193.110:0/2426621040 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2509502533 0 0) 0x7f4e6005d320 con 0x7f4e601401c0 2026-02-13T20:29:33.855 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.839+0000 7f4e4e7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:29:33.855 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.839+0000 7f4e4e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:33.856 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.839+0000 7f4e4e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:33.856 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.839+0000 7f4e4e7fc640 10 monclient(hunting): my global_id is 124650 2026-02-13T20:29:33.856 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.839+0000 7f4e4e7fc640 1 -- 10.20.193.110:0/2426621040 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e300035e0 con 0x7f4e601401c0 2026-02-13T20:29:33.856 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.839+0000 7f4e4e7fc640 1 -- 10.20.193.110:0/2426621040 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3087194286 0 0) 0x7f4e6008a880 con 0x7f4e60116340 2026-02-13T20:29:33.856 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.839+0000 7f4e4e7fc640 10 monclient(hunting): _negotiate 2026-02-13T20:29:33.856 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.839+0000 7f4e4e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:33.856 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.839+0000 7f4e4e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:33.856 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.839+0000 7f4e4e7fc640 10 monclient(hunting): my global_id is 154367 2026-02-13T20:29:33.856 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.839+0000 7f4e4e7fc640 1 -- 10.20.193.110:0/2426621040 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e6005d320 con 0x7f4e60116340 2026-02-13T20:29:33.856 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.840+0000 7f4e4e7fc640 1 -- 10.20.193.110:0/2426621040 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4049516440 0 0) 0x7f4e300035e0 con 0x7f4e601401c0 2026-02-13T20:29:33.856 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.840+0000 7f4e4e7fc640 1 -- 10.20.193.110:0/2426621040 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4e6008a880 con 0x7f4e601401c0 2026-02-13T20:29:33.856 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.840+0000 7f4e4e7fc640 1 -- 10.20.193.110:0/2426621040 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f4e54003400 con 0x7f4e601401c0 2026-02-13T20:29:33.856 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.840+0000 7f4e4e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:29:33.857 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.840+0000 7f4e4e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:29:33.857 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.840+0000 7f4e4e7fc640 10 monclient(hunting): dump: 2026-02-13T20:29:33.857 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:33.857 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:33.857 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:33.857 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:33.857 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:33.857 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:33.857 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:33.857 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:33.857 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:33.857 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:33.857 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.840+0000 7f4e4e7fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:29:33.858 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.840+0000 7f4e4e7fc640 1 -- 10.20.193.110:0/2426621040 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 512855579 0 0) 0x7f4e6005d320 con 0x7f4e60116340 2026-02-13T20:29:33.858 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.840+0000 7f4e4e7fc640 1 -- 10.20.193.110:0/2426621040 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4e300035e0 con 0x7f4e60116340 2026-02-13T20:29:33.858 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.840+0000 7f4e4e7fc640 1 -- 10.20.193.110:0/2426621040 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f4e5c003d00 con 0x7f4e60116340 2026-02-13T20:29:33.858 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.840+0000 7f4e4e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:29:33.858 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.840+0000 7f4e4e7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T20:29:33.858 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.840+0000 7f4e4e7fc640 10 monclient(hunting): dump: 2026-02-13T20:29:33.858 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:33.858 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:33.858 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:33.858 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:33.858 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:33.858 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:33.859 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:33.859 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:33.859 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:33.859 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:33.859 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.840+0000 7f4e4e7fc640 1 -- 10.20.193.110:0/2426621040 <== mon.0 v1:10.20.193.110:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2127457640 0 0) 0x7f4e6008a880 con 0x7f4e601401c0 2026-02-13T20:29:33.859 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.840+0000 7f4e4e7fc640 1 -- 10.20.193.110:0/2426621040 >> v1:10.20.193.110:6790/0 conn(0x7f4e60116340 legacy=0x7f4e601a2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:33.859 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.840+0000 7f4e4e7fc640 1 -- 10.20.193.110:0/2426621040 >> v1:10.20.193.188:6789/0 conn(0x7f4e60091950 legacy=0x7f4e60116b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:33.859 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.840+0000 7f4e4e7fc640 10 monclient: _finish_hunting 0 2026-02-13T20:29:33.859 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.840+0000 7f4e4e7fc640 1 monclient: found mon.a 2026-02-13T20:29:33.859 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.840+0000 7f4e4e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:29:33.859 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.840+0000 7f4e4e7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:29:33.859 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.840+0000 7f4e4e7fc640 1 -- 10.20.193.110:0/2426621040 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e60117220 con 0x7f4e601401c0 2026-02-13T20:29:33.859 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.840+0000 7f4e4e7fc640 10 monclient: _finish_auth 0 2026-02-13T20:29:33.860 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.840+0000 7f4e4e7fc640 10 monclient: _check_auth_tickets 2026-02-13T20:29:33.860 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.840+0000 7f4e4e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:29:33.860 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.840+0000 7f4e67d0c640 5 monclient: authenticate success, global_id 124650 2026-02-13T20:29:33.860 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.840+0000 7f4e67d0c640 10 monclient: _renew_subs 2026-02-13T20:29:33.860 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.840+0000 7f4e67d0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:29:33.860 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.840+0000 7f4e67d0c640 1 -- 10.20.193.110:0/2426621040 --> v1:10.20.193.110:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4e6012f540 con 0x7f4e601401c0 2026-02-13T20:29:33.860 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.840+0000 7f4e67d0c640 10 monclient: _renew_subs 2026-02-13T20:29:33.860 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.840+0000 7f4e67d0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:29:33.860 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.840+0000 7f4e67d0c640 1 -- 10.20.193.110:0/2426621040 --> v1:10.20.193.110:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4e6012eca0 con 0x7f4e601401c0 2026-02-13T20:29:33.860 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.840+0000 7f4e4e7fc640 1 -- 10.20.193.110:0/2426621040 <== mon.0 v1:10.20.193.110:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4e54004bf0 con 0x7f4e601401c0 2026-02-13T20:29:33.860 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.840+0000 7f4e4e7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T20:29:33.860 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.840+0000 7f4e4e7fc640 1 -- 10.20.193.110:0/2426621040 <== mon.0 v1:10.20.193.110:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7f4e540029d0 con 0x7f4e601401c0 2026-02-13T20:29:33.861 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.840+0000 7f4e4e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:33.861 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.840+0000 7f4e4e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:29:33.861 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.840+0000 7f4e4e7fc640 10 monclient: dump: 2026-02-13T20:29:33.861 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:33.861 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:33.861 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:33.861 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:33.861 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:33.861 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:33.861 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:33.861 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:33.861 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:33.861 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:33.862 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.840+0000 7f4e4ffff640 4 set_mon_vals no callback set 2026-02-13T20:29:33.862 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.840+0000 7f4e4e7fc640 1 -- 10.20.193.110:0/2426621040 <== mon.0 v1:10.20.193.110:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7f4e54004f90 con 0x7f4e601401c0 2026-02-13T20:29:33.862 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.840+0000 7f4e67d0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:33.862 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.840+0000 7f4e67d0c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:33.862 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.840+0000 7f4e67d0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.110:6789/0 2026-02-13T20:29:33.862 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.840+0000 7f4e67d0c640 1 -- 10.20.193.110:0/2426621040 --> v1:10.20.193.110:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e6012da20 con 0x7f4e601401c0 2026-02-13T20:29:33.862 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.840+0000 7f4e4e7fc640 1 -- 10.20.193.110:0/2426621040 <== mon.0 v1:10.20.193.110:6789/0 8 ==== osd_map(847..847 src has 1..847) ==== 3591+0+0 (unknown 4078645555 0 0) 0x7f4e5404e9e0 con 0x7f4e601401c0 2026-02-13T20:29:33.862 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.841+0000 7f4e65a81640 10 monclient: get_auth_request con 0x7f4e3003fa50 auth_method 0 2026-02-13T20:29:33.862 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.843+0000 7f4e4e7fc640 1 -- 10.20.193.110:0/2426621040 <== mon.0 v1:10.20.193.110:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f4e54006730 con 0x7f4e601401c0 2026-02-13T20:29:33.862 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.843+0000 7f4e4e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:33.862 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.843+0000 7f4e4e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:29:33.948 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.948+0000 7f4e67d0c640 1 -- 10.20.193.110:0/2426621040 --> v1:10.20.193.188:6812/1623052694 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4e6008b450 con 0x7f4e3003fa50 2026-02-13T20:29:33.949 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.949+0000 7f4e4e7fc640 1 -- 10.20.193.110:0/2426621040 <== mgr.4105 v1:10.20.193.188:6812/1623052694 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34067 (unknown 2965378022 0 3700073917) 0x7f4e500079b0 con 0x7f4e3003fa50 2026-02-13T20:29:33.950 INFO:teuthology.orchestra.run.trial110.stdout: 2026-02-13T20:29:33.951 INFO:teuthology.orchestra.run.trial110.stderr:dumped all 2026-02-13T20:29:33.951 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.950+0000 7f4e67d0c640 1 -- 10.20.193.110:0/2426621040 >> v1:10.20.193.188:6812/1623052694 conn(0x7f4e3003fa50 legacy=0x7f4e3005ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:33.951 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.950+0000 7f4e67d0c640 10 monclient: shutdown 2026-02-13T20:29:33.951 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.950+0000 7f4e67d0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:29:33.951 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.950+0000 7f4e67d0c640 1 -- 10.20.193.110:0/2426621040 >> v1:10.20.193.110:6789/0 conn(0x7f4e601401c0 legacy=0x7f4e601a1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:33.951 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.950+0000 7f4e67d0c640 1 -- 10.20.193.110:0/2426621040 shutdown_connections 2026-02-13T20:29:33.951 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.950+0000 7f4e67d0c640 1 -- 10.20.193.110:0/2426621040 >> 10.20.193.110:0/2426621040 conn(0x7f4e60054e90 msgr2=0x7f4e6008dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:29:33.951 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.950+0000 7f4e67d0c640 1 -- 10.20.193.110:0/2426621040 shutdown_connections 2026-02-13T20:29:33.952 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:33.950+0000 7f4e67d0c640 1 -- 10.20.193.110:0/2426621040 wait complete. 2026-02-13T20:29:33.959 INFO:teuthology.orchestra.run.trial110.stdout:{"pg_ready":true,"pg_map":{"version":1384,"stamp":"2026-02-13T20:29:32.248283+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":238696,"kb_used_data":40840,"kb_used_omap":8891,"kb_used_meta":188868,"kb_avail":565992344,"statfs":{"total":579820584960,"available":579576160256,"internally_reserved":0,"allocated":41820160,"data_stored":23930254,"data_compressed":16424,"data_compressed_allocated":98304,"data_compressed_original":1179648,"omap_allocated":9104596,"internal_metadata":193401644},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001231"},"pg_stats":[{"pgid":"1.0","version":"847'114","reported_seq":1805,"reported_epoch":847,"state":"active+clean","last_fresh":"2026-02-13T20:29:13.182707+0000","last_change":"2026-02-13T20:29:13.182640+0000","last_active":"2026-02-13T20:29:13.182707+0000","last_peered":"2026-02-13T20:29:13.182707+0000","last_clean":"2026-02-13T20:29:13.182707+0000","last_became_active":"2026-02-13T20:11:25.262766+0000","last_became_peered":"2026-02-13T20:11:25.262766+0000","last_unstale":"2026-02-13T20:29:13.182707+0000","last_undegraded":"2026-02-13T20:29:13.182707+0000","last_fullsized":"2026-02-13T20:29:13.182707+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"847'114","last_scrub_stamp":"2026-02-13T20:29:13.182583+0000","last_deep_scrub":"847'114","last_deep_scrub_stamp":"2026-02-13T20:29:13.182583+0000","last_clean_scrub_stamp":"2026-02-13T20:29:13.182583+0000","objects_scrubbed":2,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T07:07:57.776477+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"847'2","reported_seq":1666,"reported_epoch":847,"state":"active+clean","last_fresh":"2026-02-13T20:29:15.258158+0000","last_change":"2026-02-13T20:29:15.258158+0000","last_active":"2026-02-13T20:29:15.258158+0000","last_peered":"2026-02-13T20:29:15.258158+0000","last_clean":"2026-02-13T20:29:15.258158+0000","last_became_active":"2026-02-13T20:11:28.558943+0000","last_became_peered":"2026-02-13T20:11:28.558943+0000","last_unstale":"2026-02-13T20:29:15.258158+0000","last_undegraded":"2026-02-13T20:29:15.258158+0000","last_fullsized":"2026-02-13T20:29:15.258158+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"847'2","last_scrub_stamp":"2026-02-13T20:29:15.258130+0000","last_deep_scrub":"847'2","last_deep_scrub_stamp":"2026-02-13T20:29:15.258130+0000","last_clean_scrub_stamp":"2026-02-13T20:29:15.258130+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T06:12:31.608417+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00032435800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1665,"reported_epoch":847,"state":"active+clean","last_fresh":"2026-02-13T20:29:14.172644+0000","last_change":"2026-02-13T20:29:14.172644+0000","last_active":"2026-02-13T20:29:14.172644+0000","last_peered":"2026-02-13T20:29:14.172644+0000","last_clean":"2026-02-13T20:29:14.172644+0000","last_became_active":"2026-02-13T20:11:28.559211+0000","last_became_peered":"2026-02-13T20:11:28.559211+0000","last_unstale":"2026-02-13T20:29:14.172644+0000","last_undegraded":"2026-02-13T20:29:14.172644+0000","last_fullsized":"2026-02-13T20:29:14.172644+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:29:14.172585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:29:14.172585+0000","last_clean_scrub_stamp":"2026-02-13T20:29:14.172585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T04:11:26.415257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029208800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1675,"reported_epoch":847,"state":"active+clean","last_fresh":"2026-02-13T20:29:12.821708+0000","last_change":"2026-02-13T20:29:12.821708+0000","last_active":"2026-02-13T20:29:12.821708+0000","last_peered":"2026-02-13T20:29:12.821708+0000","last_clean":"2026-02-13T20:29:12.821708+0000","last_became_active":"2026-02-13T20:11:28.559802+0000","last_became_peered":"2026-02-13T20:11:28.559802+0000","last_unstale":"2026-02-13T20:29:12.821708+0000","last_undegraded":"2026-02-13T20:29:12.821708+0000","last_fullsized":"2026-02-13T20:29:12.821708+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:29:12.821667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:29:12.821667+0000","last_clean_scrub_stamp":"2026-02-13T20:29:12.821667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T21:57:12.680157+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.000230979,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"847'3","reported_seq":1667,"reported_epoch":847,"state":"active+clean","last_fresh":"2026-02-13T20:29:14.279375+0000","last_change":"2026-02-13T20:29:14.279375+0000","last_active":"2026-02-13T20:29:14.279375+0000","last_peered":"2026-02-13T20:29:14.279375+0000","last_clean":"2026-02-13T20:29:14.279375+0000","last_became_active":"2026-02-13T20:11:28.557848+0000","last_became_peered":"2026-02-13T20:11:28.557848+0000","last_unstale":"2026-02-13T20:29:14.279375+0000","last_undegraded":"2026-02-13T20:29:14.279375+0000","last_fullsized":"2026-02-13T20:29:14.279375+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"847'3","last_scrub_stamp":"2026-02-13T20:29:14.279339+0000","last_deep_scrub":"847'3","last_deep_scrub_stamp":"2026-02-13T20:29:14.279339+0000","last_clean_scrub_stamp":"2026-02-13T20:29:14.279339+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T01:20:31.292940+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00064918699999999996,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1679,"reported_epoch":847,"state":"active+clean","last_fresh":"2026-02-13T20:29:12.884206+0000","last_change":"2026-02-13T20:29:12.884206+0000","last_active":"2026-02-13T20:29:12.884206+0000","last_peered":"2026-02-13T20:29:12.884206+0000","last_clean":"2026-02-13T20:29:12.884206+0000","last_became_active":"2026-02-13T20:11:28.558441+0000","last_became_peered":"2026-02-13T20:11:28.558441+0000","last_unstale":"2026-02-13T20:29:12.884206+0000","last_undegraded":"2026-02-13T20:29:12.884206+0000","last_fullsized":"2026-02-13T20:29:12.884206+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:29:12.884156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:29:12.884156+0000","last_clean_scrub_stamp":"2026-02-13T20:29:12.884156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T07:52:55.059375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000231139,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1665,"reported_epoch":847,"state":"active+clean","last_fresh":"2026-02-13T20:29:15.167420+0000","last_change":"2026-02-13T20:29:15.167420+0000","last_active":"2026-02-13T20:29:15.167420+0000","last_peered":"2026-02-13T20:29:15.167420+0000","last_clean":"2026-02-13T20:29:15.167420+0000","last_became_active":"2026-02-13T20:11:28.559005+0000","last_became_peered":"2026-02-13T20:11:28.559005+0000","last_unstale":"2026-02-13T20:29:15.167420+0000","last_undegraded":"2026-02-13T20:29:15.167420+0000","last_fullsized":"2026-02-13T20:29:15.167420+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:29:15.167393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:29:15.167393+0000","last_clean_scrub_stamp":"2026-02-13T20:29:15.167393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T21:09:18.179044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027156000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1679,"reported_epoch":847,"state":"active+clean","last_fresh":"2026-02-13T20:29:13.882292+0000","last_change":"2026-02-13T20:29:13.882292+0000","last_active":"2026-02-13T20:29:13.882292+0000","last_peered":"2026-02-13T20:29:13.882292+0000","last_clean":"2026-02-13T20:29:13.882292+0000","last_became_active":"2026-02-13T20:11:28.559585+0000","last_became_peered":"2026-02-13T20:11:28.559585+0000","last_unstale":"2026-02-13T20:29:13.882292+0000","last_undegraded":"2026-02-13T20:29:13.882292+0000","last_fullsized":"2026-02-13T20:29:13.882292+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:29:13.882242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:29:13.882242+0000","last_clean_scrub_stamp":"2026-02-13T20:29:13.882242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T03:27:54.451068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00021035100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1665,"reported_epoch":847,"state":"active+clean","last_fresh":"2026-02-13T20:29:16.158029+0000","last_change":"2026-02-13T20:29:16.158029+0000","last_active":"2026-02-13T20:29:16.158029+0000","last_peered":"2026-02-13T20:29:16.158029+0000","last_clean":"2026-02-13T20:29:16.158029+0000","last_became_active":"2026-02-13T20:11:29.018116+0000","last_became_peered":"2026-02-13T20:11:29.018116+0000","last_unstale":"2026-02-13T20:29:16.158029+0000","last_undegraded":"2026-02-13T20:29:16.158029+0000","last_fullsized":"2026-02-13T20:29:16.158029+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T20:29:16.157976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T20:29:16.157976+0000","last_clean_scrub_stamp":"2026-02-13T20:29:16.157976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-15T05:29:15.754353+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.000335309,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1180736,"data_compressed":16424,"data_compressed_allocated":98304,"data_compressed_original":1179648,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640475,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33752,"kb_used_data":6792,"kb_used_omap":1355,"kb_used_meta":25588,"kb_avail":94338088,"statfs":{"total":96636764160,"available":96602202112,"internally_reserved":0,"allocated":6955008,"data_stored":3791599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1388487,"internal_metadata":26202169},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640476,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33748,"kb_used_data":6788,"kb_used_omap":1240,"kb_used_meta":25703,"kb_avail":94338092,"statfs":{"total":96636764160,"available":96602206208,"internally_reserved":0,"allocated":6950912,"data_stored":3791580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1270080,"internal_metadata":26320576},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640476,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33800,"kb_used_data":6840,"kb_used_omap":1132,"kb_used_meta":25811,"kb_avail":94338040,"statfs":{"total":96636764160,"available":96602152960,"internally_reserved":0,"allocated":7004160,"data_stored":4381948,"data_compressed":8212,"data_compressed_allocated":49152,"data_compressed_original":589824,"omap_allocated":1159884,"internal_metadata":26430772},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640476,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51796,"kb_used_data":6788,"kb_used_omap":2201,"kb_used_meta":42790,"kb_avail":94320044,"statfs":{"total":96636764160,"available":96583725056,"internally_reserved":0,"allocated":6950912,"data_stored":3791580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2254483,"internal_metadata":43817325},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640475,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51800,"kb_used_data":6792,"kb_used_omap":1806,"kb_used_meta":43185,"kb_avail":94320040,"statfs":{"total":96636764160,"available":96583720960,"internally_reserved":0,"allocated":6955008,"data_stored":3791599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1849790,"internal_metadata":44222018},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640476,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33800,"kb_used_data":6840,"kb_used_omap":1154,"kb_used_meta":25789,"kb_avail":94338040,"statfs":{"total":96636764160,"available":96602152960,"internally_reserved":0,"allocated":7004160,"data_stored":4381948,"data_compressed":8212,"data_compressed_allocated":49152,"data_compressed_original":589824,"omap_allocated":1181872,"internal_metadata":26408784},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":590368,"data_compressed":8212,"data_compressed_allocated":49152,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":590368,"data_compressed":8212,"data_compressed_allocated":49152,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T20:29:33.961 DEBUG:teuthology.orchestra.run.trial110:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-13T20:29:34.026 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.026+0000 7fd12e68c640 10 monclient: get_monmap_and_config 2026-02-13T20:29:34.026 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.026+0000 7fd12e68c640 10 monclient: build_initial_monmap 2026-02-13T20:29:34.027 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.026+0000 7fd12e68c640 10 monclient: monmap: 2026-02-13T20:29:34.027 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:29:34.027 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:34.027 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:29:34.026749+0000 2026-02-13T20:29:34.027 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:29:34.026749+0000 2026-02-13T20:29:34.027 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:29:34.027 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:34.027 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:29:34.027 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-c 2026-02-13T20:29:34.027 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-b 2026-02-13T20:29:34.028 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:34.035 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.026+0000 7fd12e68c640 1 Processor -- start 2026-02-13T20:29:34.035 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.026+0000 7fd12e68c640 1 -- start start 2026-02-13T20:29:34.035 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.026+0000 7fd12e68c640 10 monclient: init 2026-02-13T20:29:34.035 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.027+0000 7fd12e68c640 10 monclient: _reopen_session rank -1 2026-02-13T20:29:34.035 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.027+0000 7fd12e68c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:29:34.036 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.027+0000 7fd12e68c640 10 monclient(hunting): picked mon.noname-a con 0x7fd1281401c0 addr v1:10.20.193.110:6789/0 2026-02-13T20:29:34.036 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.027+0000 7fd12e68c640 10 monclient(hunting): picked mon.noname-c con 0x7fd128092020 addr v1:10.20.193.188:6789/0 2026-02-13T20:29:34.036 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.027+0000 7fd12e68c640 10 monclient(hunting): picked mon.noname-b con 0x7fd128091950 addr v1:10.20.193.110:6790/0 2026-02-13T20:29:34.036 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.027+0000 7fd12e68c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd12808b730 con 0x7fd1281401c0 2026-02-13T20:29:34.036 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.027+0000 7fd12e68c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd12805c5b0 con 0x7fd128092020 2026-02-13T20:29:34.036 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.027+0000 7fd12e68c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd12808bcf0 con 0x7fd128091950 2026-02-13T20:29:34.036 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.027+0000 7fd12e68c640 10 monclient(hunting): _renew_subs 2026-02-13T20:29:34.036 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.027+0000 7fd12e68c640 10 monclient(hunting): authenticate will time out at 1735.717341s 2026-02-13T20:29:34.036 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.027+0000 7fd127fff640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fd1281401c0 0x7fd128091240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:39654/0 (socket says 10.20.193.110:39654) 2026-02-13T20:29:34.036 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.027+0000 7fd127fff640 1 -- 10.20.193.110:0/876572196 learned_addr learned my addr 10.20.193.110:0/876572196 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:29:34.036 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.027+0000 7fd126ffd640 1 -- 10.20.193.110:0/876572196 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3147485424 0 0) 0x7fd12808b730 con 0x7fd1281401c0 2026-02-13T20:29:34.036 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.027+0000 7fd126ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:29:34.037 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.027+0000 7fd126ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:34.037 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.027+0000 7fd126ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:34.037 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.027+0000 7fd126ffd640 10 monclient(hunting): my global_id is 124653 2026-02-13T20:29:34.037 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.027+0000 7fd126ffd640 1 -- 10.20.193.110:0/876572196 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd10c0035e0 con 0x7fd1281401c0 2026-02-13T20:29:34.037 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.027+0000 7fd126ffd640 1 -- 10.20.193.110:0/876572196 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 740939987 0 0) 0x7fd12808bcf0 con 0x7fd128091950 2026-02-13T20:29:34.037 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.027+0000 7fd126ffd640 10 monclient(hunting): _negotiate 2026-02-13T20:29:34.037 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.027+0000 7fd126ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:34.037 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.027+0000 7fd126ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:34.037 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.027+0000 7fd126ffd640 10 monclient(hunting): my global_id is 154370 2026-02-13T20:29:34.037 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.027+0000 7fd126ffd640 1 -- 10.20.193.110:0/876572196 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd12808b730 con 0x7fd128091950 2026-02-13T20:29:34.037 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.027+0000 7fd126ffd640 1 -- 10.20.193.110:0/876572196 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 192258711 0 0) 0x7fd10c0035e0 con 0x7fd1281401c0 2026-02-13T20:29:34.037 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.027+0000 7fd126ffd640 1 -- 10.20.193.110:0/876572196 >> v1:10.20.193.110:6790/0 conn(0x7fd128091950 legacy=0x7fd1281a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:34.038 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.027+0000 7fd126ffd640 1 -- 10.20.193.110:0/876572196 >> v1:10.20.193.188:6789/0 conn(0x7fd128092020 legacy=0x7fd1281812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:34.038 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.027+0000 7fd126ffd640 10 monclient: _finish_hunting 0 2026-02-13T20:29:34.038 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.027+0000 7fd126ffd640 1 monclient: found mon.noname-a 2026-02-13T20:29:34.038 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.027+0000 7fd126ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:29:34.038 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.027+0000 7fd126ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.110:6789/0 2026-02-13T20:29:34.038 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.027+0000 7fd126ffd640 1 -- 10.20.193.110:0/876572196 --> v1:10.20.193.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd128140590 con 0x7fd1281401c0 2026-02-13T20:29:34.038 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.027+0000 7fd126ffd640 10 monclient: _finish_auth 0 2026-02-13T20:29:34.038 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.027+0000 7fd126ffd640 10 monclient: _check_auth_tickets 2026-02-13T20:29:34.038 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.027+0000 7fd126ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:29:34.038 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.027+0000 7fd126ffd640 1 -- 10.20.193.110:0/876572196 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fd114002dd0 con 0x7fd1281401c0 2026-02-13T20:29:34.038 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.027+0000 7fd12e68c640 5 monclient: authenticate success, global_id 124653 2026-02-13T20:29:34.038 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.027+0000 7fd12e68c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:29:34.039 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.027+0000 7fd126ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:34.039 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.027+0000 7fd126ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T20:29:34.039 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.027+0000 7fd126ffd640 10 monclient: dump: 2026-02-13T20:29:34.039 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:34.039 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:34.039 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:34.039 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:34.039 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:34.039 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:34.039 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:34.039 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:34.039 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:34.039 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:34.040 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.027+0000 7fd12e68c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T20:29:34.040 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.027+0000 7fd126ffd640 1 -- 10.20.193.110:0/876572196 <== mon.0 v1:10.20.193.110:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd114002f60 con 0x7fd1281401c0 2026-02-13T20:29:34.040 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.027+0000 7fd126ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T20:29:34.040 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.027+0000 7fd126ffd640 1 -- 10.20.193.110:0/876572196 <== mon.0 v1:10.20.193.110:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fd114003330 con 0x7fd1281401c0 2026-02-13T20:29:34.040 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.027+0000 7fd126ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:34.040 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.027+0000 7fd126ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T20:29:34.040 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.027+0000 7fd126ffd640 10 monclient: dump: 2026-02-13T20:29:34.040 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:34.040 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:34.040 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:34.040 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:34.040 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:34.041 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:34.041 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:34.041 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:34.041 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:34.041 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:34.041 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.027+0000 7fd12e68c640 10 monclient: get_monmap_and_config success 2026-02-13T20:29:34.041 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.027+0000 7fd12e68c640 4 set_mon_vals no callback set 2026-02-13T20:29:34.041 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.028+0000 7fd12e68c640 10 monclient: shutdown 2026-02-13T20:29:34.041 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.028+0000 7fd12e68c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:29:34.041 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.028+0000 7fd12e68c640 1 -- 10.20.193.110:0/876572196 >> v1:10.20.193.110:6789/0 conn(0x7fd1281401c0 legacy=0x7fd128091240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:34.041 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.028+0000 7fd12e68c640 1 -- 10.20.193.110:0/876572196 shutdown_connections 2026-02-13T20:29:34.041 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.028+0000 7fd12e68c640 1 -- 10.20.193.110:0/876572196 >> 10.20.193.110:0/876572196 conn(0x7fd128054e90 msgr2=0x7fd128058700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:29:34.042 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.028+0000 7fd12e68c640 1 -- 10.20.193.110:0/876572196 shutdown_connections 2026-02-13T20:29:34.042 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.028+0000 7fd12e68c640 1 -- 10.20.193.110:0/876572196 wait complete. 2026-02-13T20:29:34.042 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.028+0000 7fd12e68c640 10 monclient: build_initial_monmap 2026-02-13T20:29:34.042 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.028+0000 7fd12e68c640 10 monclient: monmap: 2026-02-13T20:29:34.042 INFO:teuthology.orchestra.run.trial110.stderr:epoch 0 2026-02-13T20:29:34.042 INFO:teuthology.orchestra.run.trial110.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T20:29:34.042 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 0.000000 2026-02-13T20:29:34.042 INFO:teuthology.orchestra.run.trial110.stderr:created 0.000000 2026-02-13T20:29:34.042 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 0 (unknown) 2026-02-13T20:29:34.042 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 1 2026-02-13T20:29:34.042 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.noname-a 2026-02-13T20:29:34.042 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.noname-b 2026-02-13T20:29:34.042 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.noname-c 2026-02-13T20:29:34.043 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:34.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.028+0000 7fd12e68c640 1 Processor -- start 2026-02-13T20:29:34.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.028+0000 7fd12e68c640 1 -- start start 2026-02-13T20:29:34.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.028+0000 7fd12e68c640 10 monclient: init 2026-02-13T20:29:34.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.028+0000 7fd12e68c640 10 monclient: _reopen_session rank -1 2026-02-13T20:29:34.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd12e68c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T20:29:34.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd12e68c640 10 monclient(hunting): picked mon.noname-a con 0x7fd128091950 addr v1:10.20.193.110:6789/0 2026-02-13T20:29:34.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd12e68c640 10 monclient(hunting): picked mon.noname-b con 0x7fd1281401c0 addr v1:10.20.193.188:6789/0 2026-02-13T20:29:34.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd12e68c640 10 monclient(hunting): picked mon.noname-c con 0x7fd128194970 addr v1:10.20.193.110:6790/0 2026-02-13T20:29:34.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd12e68c640 1 -- --> v1:10.20.193.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd128130a40 con 0x7fd128091950 2026-02-13T20:29:34.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd12e68c640 1 -- --> v1:10.20.193.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd12808c3f0 con 0x7fd1281401c0 2026-02-13T20:29:34.043 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd12e68c640 1 -- --> v1:10.20.193.110:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd128090f80 con 0x7fd128194970 2026-02-13T20:29:34.044 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd12e68c640 10 monclient(hunting): _renew_subs 2026-02-13T20:29:34.044 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd12e68c640 10 monclient(hunting): authenticate will time out at 1735.719053s 2026-02-13T20:29:34.044 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd127fff640 1 --1- >> v1:10.20.193.110:6789/0 conn(0x7fd128091950 0x7fd128088e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6789/0 says I am v1:10.20.193.110:39656/0 (socket says 10.20.193.110:39656) 2026-02-13T20:29:34.044 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd127fff640 1 -- 10.20.193.110:0/63854557 learned_addr learned my addr 10.20.193.110:0/63854557 (peer_addr_for_me v1:10.20.193.110:0/0) 2026-02-13T20:29:34.044 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd12cc02640 1 --1- 10.20.193.110:0/63854557 >> v1:10.20.193.110:6790/0 conn(0x7fd128194970 0x7fd128194df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.110:6790/0 says I am v1:10.20.193.110:58694/0 (socket says 10.20.193.110:58694) 2026-02-13T20:29:34.044 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd124ff9640 1 -- 10.20.193.110:0/63854557 <== mon.2 v1:10.20.193.110:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4036997291 0 0) 0x7fd128090f80 con 0x7fd128194970 2026-02-13T20:29:34.044 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd124ff9640 10 monclient(hunting): _negotiate 2026-02-13T20:29:34.044 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd124ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:34.044 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd124ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:34.044 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd124ff9640 10 monclient(hunting): my global_id is 154373 2026-02-13T20:29:34.044 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd124ff9640 1 -- 10.20.193.110:0/63854557 --> v1:10.20.193.110:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0f80035e0 con 0x7fd128194970 2026-02-13T20:29:34.044 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd124ff9640 1 -- 10.20.193.110:0/63854557 <== mon.0 v1:10.20.193.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 750905905 0 0) 0x7fd128130a40 con 0x7fd128091950 2026-02-13T20:29:34.045 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd124ff9640 10 monclient(hunting): _negotiate 2026-02-13T20:29:34.045 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd124ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T20:29:34.045 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd124ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T20:29:34.045 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd124ff9640 10 monclient(hunting): my global_id is 124656 2026-02-13T20:29:34.045 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd124ff9640 1 -- 10.20.193.110:0/63854557 --> v1:10.20.193.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd128090f80 con 0x7fd128091950 2026-02-13T20:29:34.045 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd124ff9640 1 -- 10.20.193.110:0/63854557 <== mon.2 v1:10.20.193.110:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2186287743 0 0) 0x7fd0f80035e0 con 0x7fd128194970 2026-02-13T20:29:34.045 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd124ff9640 1 -- 10.20.193.110:0/63854557 --> v1:10.20.193.110:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd128130a40 con 0x7fd128194970 2026-02-13T20:29:34.045 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd124ff9640 1 -- 10.20.193.110:0/63854557 <== mon.2 v1:10.20.193.110:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fd11c004290 con 0x7fd128194970 2026-02-13T20:29:34.045 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd124ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:29:34.045 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd124ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T20:29:34.045 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd124ff9640 10 monclient(hunting): dump: 2026-02-13T20:29:34.045 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:34.045 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:34.046 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:34.046 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:34.046 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:34.046 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:34.046 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:34.046 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:34.046 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:34.046 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:34.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd124ff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T20:29:34.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd124ff9640 1 -- 10.20.193.110:0/63854557 <== mon.0 v1:10.20.193.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3433982177 0 0) 0x7fd128090f80 con 0x7fd128091950 2026-02-13T20:29:34.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd124ff9640 1 -- 10.20.193.110:0/63854557 --> v1:10.20.193.110:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd0f80035e0 con 0x7fd128091950 2026-02-13T20:29:34.046 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd124ff9640 1 -- 10.20.193.110:0/63854557 <== mon.0 v1:10.20.193.110:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fd114002890 con 0x7fd128091950 2026-02-13T20:29:34.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd124ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T20:29:34.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd124ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T20:29:34.047 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd124ff9640 10 monclient(hunting): dump: 2026-02-13T20:29:34.047 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:34.047 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:34.047 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:34.047 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:34.047 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:34.047 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:34.047 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:34.047 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:34.047 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:34.047 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:34.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd124ff9640 1 -- 10.20.193.110:0/63854557 <== mon.2 v1:10.20.193.110:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3990009681 0 0) 0x7fd128130a40 con 0x7fd128194970 2026-02-13T20:29:34.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd124ff9640 1 -- 10.20.193.110:0/63854557 >> v1:10.20.193.188:6789/0 conn(0x7fd1281401c0 legacy=0x7fd128089540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:34.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd124ff9640 1 -- 10.20.193.110:0/63854557 >> v1:10.20.193.110:6789/0 conn(0x7fd128091950 legacy=0x7fd128088e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:34.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd124ff9640 10 monclient: _finish_hunting 0 2026-02-13T20:29:34.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd124ff9640 1 monclient: found mon.c 2026-02-13T20:29:34.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd124ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T20:29:34.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd124ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:34.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd124ff9640 1 -- 10.20.193.110:0/63854557 --> v1:10.20.193.110:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd128131f60 con 0x7fd128194970 2026-02-13T20:29:34.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd124ff9640 10 monclient: _finish_auth 0 2026-02-13T20:29:34.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd124ff9640 10 monclient: _check_auth_tickets 2026-02-13T20:29:34.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd124ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T20:29:34.048 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd12e68c640 5 monclient: authenticate success, global_id 154373 2026-02-13T20:29:34.049 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd12e68c640 10 monclient: _renew_subs 2026-02-13T20:29:34.049 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd12e68c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:34.049 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd12e68c640 1 -- 10.20.193.110:0/63854557 --> v1:10.20.193.110:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd128089c50 con 0x7fd128194970 2026-02-13T20:29:34.049 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd12e68c640 10 monclient: _renew_subs 2026-02-13T20:29:34.049 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd12e68c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:34.049 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd12e68c640 1 -- 10.20.193.110:0/63854557 --> v1:10.20.193.110:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fd128131c80 con 0x7fd128194970 2026-02-13T20:29:34.049 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd124ff9640 1 -- 10.20.193.110:0/63854557 <== mon.2 v1:10.20.193.110:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd11c004730 con 0x7fd128194970 2026-02-13T20:29:34.049 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd124ff9640 10 monclient: handle_config config(0 keys) 2026-02-13T20:29:34.049 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd124ff9640 1 -- 10.20.193.110:0/63854557 <== mon.2 v1:10.20.193.110:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 4047289622 0 0) 0x7fd11c004b40 con 0x7fd128194970 2026-02-13T20:29:34.049 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd124ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T20:29:34.049 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd124ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T20:29:34.049 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd124ff9640 10 monclient: dump: 2026-02-13T20:29:34.050 INFO:teuthology.orchestra.run.trial110.stderr:epoch 1 2026-02-13T20:29:34.050 INFO:teuthology.orchestra.run.trial110.stderr:fsid edd4d072-2e11-43ec-9240-2fd608d0b4f8 2026-02-13T20:29:34.050 INFO:teuthology.orchestra.run.trial110.stderr:last_changed 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:34.050 INFO:teuthology.orchestra.run.trial110.stderr:created 2026-02-13T20:11:07.161192+0000 2026-02-13T20:29:34.050 INFO:teuthology.orchestra.run.trial110.stderr:min_mon_release 20 (tentacle) 2026-02-13T20:29:34.050 INFO:teuthology.orchestra.run.trial110.stderr:election_strategy: 3 2026-02-13T20:29:34.050 INFO:teuthology.orchestra.run.trial110.stderr:0: v1:10.20.193.110:6789/0 mon.a 2026-02-13T20:29:34.050 INFO:teuthology.orchestra.run.trial110.stderr:1: v1:10.20.193.188:6789/0 mon.b 2026-02-13T20:29:34.050 INFO:teuthology.orchestra.run.trial110.stderr:2: v1:10.20.193.110:6790/0 mon.c 2026-02-13T20:29:34.050 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:34.050 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.029+0000 7fd1267fc640 4 set_mon_vals no callback set 2026-02-13T20:29:34.050 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.030+0000 7fd12e68c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:34.051 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.030+0000 7fd12e68c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:34.051 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.030+0000 7fd12e68c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:34.051 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.030+0000 7fd12e68c640 1 -- 10.20.193.110:0/63854557 --> v1:10.20.193.110:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1280008d0 con 0x7fd128194970 2026-02-13T20:29:34.051 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.030+0000 7fd124ff9640 1 -- 10.20.193.110:0/63854557 <== mon.2 v1:10.20.193.110:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 2970473617 0 0) 0x7fd11c004ca0 con 0x7fd128194970 2026-02-13T20:29:34.051 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.030+0000 7fd124ff9640 1 -- 10.20.193.110:0/63854557 <== mon.2 v1:10.20.193.110:6790/0 8 ==== osd_map(847..847 src has 1..847) ==== 3591+0+0 (unknown 4078645555 0 0) 0x7fd11c04f680 con 0x7fd128194970 2026-02-13T20:29:34.051 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.030+0000 7fd127fff640 10 monclient: get_auth_request con 0x7fd0f803fa00 auth_method 0 2026-02-13T20:29:34.051 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.032+0000 7fd124ff9640 1 -- 10.20.193.110:0/63854557 <== mon.2 v1:10.20.193.110:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fd11c017950 con 0x7fd128194970 2026-02-13T20:29:34.051 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.032+0000 7fd124ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T20:29:34.051 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.032+0000 7fd124ff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T20:29:34.137 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.137+0000 7fd12e68c640 10 start_mon_command cmd=[{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-13T20:29:34.137 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.137+0000 7fd12e68c640 10 monclient: _send_command 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-13T20:29:34.138 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.137+0000 7fd12e68c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.110:6790/0 2026-02-13T20:29:34.138 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.137+0000 7fd12e68c640 1 -- 10.20.193.110:0/63854557 --> v1:10.20.193.110:6790/0 -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fd128058410 con 0x7fd128194970 2026-02-13T20:29:34.139 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.139+0000 7fd124ff9640 1 -- 10.20.193.110:0/63854557 <== mon.2 v1:10.20.193.110:6790/0 10 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v3)=0 v3) ==== 123+0+0 (unknown 3022875181 0 0) 0x7fd11c017770 con 0x7fd128194970 2026-02-13T20:29:34.139 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.139+0000 7fd124ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-13T20:29:34.139 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.139+0000 7fd124ff9640 10 monclient: _finish_command 2 = system:0 2026-02-13T20:29:34.140 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.140+0000 7fd124ff9640 1 -- 10.20.193.110:0/63854557 <== mon.2 v1:10.20.193.110:6790/0 11 ==== config(1 keys) ==== 35+0+0 (unknown 2555425225 0 0) 0x7fd11c017770 con 0x7fd128194970 2026-02-13T20:29:34.140 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.140+0000 7fd124ff9640 10 monclient: handle_config config(1 keys) 2026-02-13T20:29:34.140 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.140+0000 7fd125ffb640 4 set_mon_vals no callback set 2026-02-13T20:29:34.140 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.140+0000 7fd125ffb640 10 set_mon_vals mon_health_to_clog = false 2026-02-13T20:29:34.141 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.141+0000 7fd12e68c640 1 -- 10.20.193.110:0/63854557 >> v1:10.20.193.188:6812/1623052694 conn(0x7fd0f803fa00 legacy=0x7fd0f805feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:34.141 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.141+0000 7fd12e68c640 10 monclient: shutdown 2026-02-13T20:29:34.141 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.141+0000 7fd12e68c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T20:29:34.141 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.141+0000 7fd12e68c640 1 -- 10.20.193.110:0/63854557 >> v1:10.20.193.110:6790/0 conn(0x7fd128194970 legacy=0x7fd128194df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T20:29:34.141 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.141+0000 7fd12e68c640 1 -- 10.20.193.110:0/63854557 shutdown_connections 2026-02-13T20:29:34.141 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.141+0000 7fd12e68c640 1 -- 10.20.193.110:0/63854557 >> 10.20.193.110:0/63854557 conn(0x7fd128054e90 msgr2=0x7fd12808dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T20:29:34.141 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.141+0000 7fd12e68c640 1 -- 10.20.193.110:0/63854557 shutdown_connections 2026-02-13T20:29:34.141 INFO:teuthology.orchestra.run.trial110.stderr:2026-02-13T20:29:34.141+0000 7fd12e68c640 1 -- 10.20.193.110:0/63854557 wait complete. 2026-02-13T20:29:34.151 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-13T20:29:34.151 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-13T20:29:34.151 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-13T20:29:34.151 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T20:29:34.188 INFO:tasks.ceph.osd.0:Stopped 2026-02-13T20:29:34.188 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-13T20:29:34.188 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T20:29:34.269 INFO:tasks.ceph.osd.1:Stopped 2026-02-13T20:29:34.269 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-13T20:29:34.269 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T20:29:34.347 INFO:tasks.ceph.osd.2:Stopped 2026-02-13T20:29:34.347 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-13T20:29:34.347 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T20:29:34.380 INFO:tasks.ceph.osd.3:Stopped 2026-02-13T20:29:34.380 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2026-02-13T20:29:34.380 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T20:29:34.453 INFO:tasks.ceph.osd.4:Stopped 2026-02-13T20:29:34.453 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2026-02-13T20:29:34.453 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T20:29:34.532 INFO:tasks.ceph.osd.5:Stopped 2026-02-13T20:29:34.532 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-13T20:29:34.532 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-13T20:29:34.532 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T20:29:34.601 INFO:tasks.ceph.mgr.x:Stopped 2026-02-13T20:29:34.601 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-13T20:29:34.601 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-13T20:29:34.601 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T20:29:34.615 INFO:tasks.ceph.mon.a:Stopped 2026-02-13T20:29:34.615 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-13T20:29:34.615 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T20:29:34.665 INFO:tasks.ceph.mon.c:Stopped 2026-02-13T20:29:34.665 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-13T20:29:34.665 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T20:29:34.674 INFO:tasks.ceph.mon.b:Stopped 2026-02-13T20:29:34.674 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-13T20:29:34.674 DEBUG:teuthology.orchestra.run.trial110:> sudo grep -E '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v ScrubResult | grep -E -v 'scrub mismatch' | grep -E -v 'overall HEALTH_' | grep -E -v '\(MGR_DOWN\)' | grep -E -v '\(PG_AVAILABILITY\)' | grep -E -v '\(SLOW_OPS\)' | grep -E -v 'slow request' | grep -E -v '\(OSD_SLOW_PING_TIME' | grep -E -v '\(MON_NETSPLIT)' | grep -E -v 'overall HEALTH_' | grep -E -v '\(MON_DOWN\)' | grep -E -v '\(TOO_FEW_PGS\)' | grep -E -v '\(POOL_APP_NOT_ENABLED\)' | head -n 1 2026-02-13T20:29:34.731 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial110.front.sepia.ceph.com 2026-02-13T20:29:34.731 DEBUG:teuthology.orchestra.run.trial110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-13T20:29:34.804 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial110.front.sepia.ceph.com 2026-02-13T20:29:34.804 DEBUG:teuthology.orchestra.run.trial110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-13T20:29:34.880 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial110.front.sepia.ceph.com 2026-02-13T20:29:34.880 DEBUG:teuthology.orchestra.run.trial110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-13T20:29:34.955 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial188.front.sepia.ceph.com 2026-02-13T20:29:34.955 DEBUG:teuthology.orchestra.run.trial188:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-13T20:29:34.994 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@trial188.front.sepia.ceph.com 2026-02-13T20:29:34.994 DEBUG:teuthology.orchestra.run.trial188:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2026-02-13T20:29:35.063 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@trial188.front.sepia.ceph.com 2026-02-13T20:29:35.063 DEBUG:teuthology.orchestra.run.trial188:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2026-02-13T20:29:35.138 INFO:tasks.ceph:Archiving mon data... 2026-02-13T20:29:35.140 DEBUG:teuthology.misc:Transferring archived files from trial110:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/yuriw-2026-02-13_16:37:03-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/49987/data/mon.a.tgz 2026-02-13T20:29:35.140 DEBUG:teuthology.orchestra.run.trial110:> mktemp 2026-02-13T20:29:35.159 INFO:teuthology.orchestra.run.trial110.stdout:/tmp/tmp.0mxMph85Wo 2026-02-13T20:29:35.159 DEBUG:teuthology.orchestra.run.trial110:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.0mxMph85Wo 2026-02-13T20:29:35.275 DEBUG:teuthology.orchestra.run.trial110:> sudo chmod 0666 /tmp/tmp.0mxMph85Wo 2026-02-13T20:29:35.359 DEBUG:teuthology.orchestra.remote:trial110:/tmp/tmp.0mxMph85Wo is 478KB 2026-02-13T20:29:35.455 DEBUG:teuthology.orchestra.run.trial110:> rm -fr /tmp/tmp.0mxMph85Wo 2026-02-13T20:29:35.473 DEBUG:teuthology.misc:Transferring archived files from trial110:/var/lib/ceph/mon/ceph-c to /home/teuthworker/mnt/teuthology/yuriw-2026-02-13_16:37:03-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/49987/data/mon.c.tgz 2026-02-13T20:29:35.473 DEBUG:teuthology.orchestra.run.trial110:> mktemp 2026-02-13T20:29:35.529 INFO:teuthology.orchestra.run.trial110.stdout:/tmp/tmp.uDbcvn6zW5 2026-02-13T20:29:35.529 DEBUG:teuthology.orchestra.run.trial110:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.uDbcvn6zW5 2026-02-13T20:29:35.645 DEBUG:teuthology.orchestra.run.trial110:> sudo chmod 0666 /tmp/tmp.uDbcvn6zW5 2026-02-13T20:29:35.726 DEBUG:teuthology.orchestra.remote:trial110:/tmp/tmp.uDbcvn6zW5 is 474KB 2026-02-13T20:29:35.822 DEBUG:teuthology.orchestra.run.trial110:> rm -fr /tmp/tmp.uDbcvn6zW5 2026-02-13T20:29:35.839 DEBUG:teuthology.misc:Transferring archived files from trial188:/var/lib/ceph/mon/ceph-b to /home/teuthworker/mnt/teuthology/yuriw-2026-02-13_16:37:03-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/49987/data/mon.b.tgz 2026-02-13T20:29:35.839 DEBUG:teuthology.orchestra.run.trial188:> mktemp 2026-02-13T20:29:35.857 INFO:teuthology.orchestra.run.trial188.stdout:/tmp/tmp.YRxbH3svsH 2026-02-13T20:29:35.857 DEBUG:teuthology.orchestra.run.trial188:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.YRxbH3svsH 2026-02-13T20:29:35.973 DEBUG:teuthology.orchestra.run.trial188:> sudo chmod 0666 /tmp/tmp.YRxbH3svsH 2026-02-13T20:29:36.054 DEBUG:teuthology.orchestra.remote:trial188:/tmp/tmp.YRxbH3svsH is 473KB 2026-02-13T20:29:36.142 DEBUG:teuthology.orchestra.run.trial188:> rm -fr /tmp/tmp.YRxbH3svsH 2026-02-13T20:29:36.159 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-13T20:29:36.159 DEBUG:teuthology.orchestra.run.trial110:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-13T20:29:36.161 DEBUG:teuthology.orchestra.run.trial188:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-13T20:29:36.240 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-13T20:29:36.280 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-13T20:29:36.280 INFO:tasks.ceph:Archiving crash dumps... 2026-02-13T20:29:36.282 DEBUG:teuthology.misc:Transferring archived files from trial110:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-13_16:37:03-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/49987/remote/trial110/crash 2026-02-13T20:29:36.283 DEBUG:teuthology.orchestra.run.trial110:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-13T20:29:36.307 DEBUG:teuthology.misc:Transferring archived files from trial188:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-13_16:37:03-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/49987/remote/trial188/crash 2026-02-13T20:29:36.309 DEBUG:teuthology.orchestra.run.trial188:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-13T20:29:36.344 INFO:tasks.ceph:Compressing logs... 2026-02-13T20:29:36.344 DEBUG:teuthology.orchestra.run.trial110:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T20:29:36.352 DEBUG:teuthology.orchestra.run.trial188:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T20:29:36.373 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47243.log 2026-02-13T20:29:36.375 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-13T20:29:36.375 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.47243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53351.log 2026-02-13T20:29:36.375 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-osd.2.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47243.log.gz 2026-02-13T20:29:36.375 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46441.log 2026-02-13T20:29:36.376 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47391.log 2026-02-13T20:29:36.376 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.53351.log: /var/log/ceph/ceph-client.admin.46441.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-13T20:29:36.376 INFO:teuthology.orchestra.run.trial110.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53351.log.gz 2026-02-13T20:29:36.376 INFO:teuthology.orchestra.run.trial110.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46441.log.gz 2026-02-13T20:29:36.376 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.47391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44570.log 2026-02-13T20:29:36.376 INFO:teuthology.orchestra.run.trial110.stderr: 88.6%/var/log/ceph/ceph-mon.a.log: -- replaced with /var/log/ceph/ceph-client.admin.47391.log.gz 2026-02-13T20:29:36.376 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47685.log 2026-02-13T20:29:36.406 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.44570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48054.log 2026-02-13T20:29:36.406 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.47685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51452.log 2026-02-13T20:29:36.406 INFO:teuthology.orchestra.run.trial110.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44570.log.gz 2026-02-13T20:29:36.406 INFO:teuthology.orchestra.run.trial110.stderr:gzip/var/log/ceph/ceph-client.admin.48054.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.51975.log 2026-02-13T20:29:36.406 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.51452.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47685.log.gz 2026-02-13T20:29:36.406 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49448.log 2026-02-13T20:29:36.406 INFO:teuthology.orchestra.run.trial110.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48054.log.gz 2026-02-13T20:29:36.407 INFO:teuthology.orchestra.run.trial110.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51452.log.gz 2026-02-13T20:29:36.407 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.51975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44574.log 2026-02-13T20:29:36.407 INFO:teuthology.orchestra.run.trial110.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51975.log.gz 2026-02-13T20:29:36.407 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.49448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51877.log 2026-02-13T20:29:36.407 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.44574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49922.log 2026-02-13T20:29:36.407 INFO:teuthology.orchestra.run.trial110.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49448.log.gz 2026-02-13T20:29:36.407 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.51877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47636.log 2026-02-13T20:29:36.407 INFO:teuthology.orchestra.run.trial110.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44574.log.gz 2026-02-13T20:29:36.407 INFO:teuthology.orchestra.run.trial110.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51877.log.gz 2026-02-13T20:29:36.407 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.49922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52122.log 2026-02-13T20:29:36.407 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.47636.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-13T20:29:36.407 INFO:teuthology.orchestra.run.trial110.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49922.log.gz 2026-02-13T20:29:36.407 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.52122.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47636.log.gz 2026-02-13T20:29:36.407 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49203.log 2026-02-13T20:29:36.408 INFO:teuthology.orchestra.run.trial110.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52122.log.gz 2026-02-13T20:29:36.408 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47538.log 2026-02-13T20:29:36.408 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.49203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52171.log 2026-02-13T20:29:36.408 INFO:teuthology.orchestra.run.trial110.stderr:gzip/var/log/ceph/ceph-client.admin.47538.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.46833.log 2026-02-13T20:29:36.408 INFO:teuthology.orchestra.run.trial110.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49203.log.gz 2026-02-13T20:29:36.408 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.52171.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.47538.log.gz 2026-02-13T20:29:36.408 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52318.log 2026-02-13T20:29:36.408 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.46833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51305.log 88.9% 2026-02-13T20:29:36.408 INFO:teuthology.orchestra.run.trial110.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52171.log.gz 2026-02-13T20:29:36.408 INFO:teuthology.orchestra.run.trial110.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.46833.log.gz 2026-02-13T20:29:36.408 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.52318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44157.log 2026-02-13T20:29:36.408 INFO:teuthology.orchestra.run.trial110.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52318.log.gz 2026-02-13T20:29:36.408 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.51305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53645.log 2026-02-13T20:29:36.408 INFO:teuthology.orchestra.run.trial110.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51305.log.gz 2026-02-13T20:29:36.408 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.44157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51158.log 2026-02-13T20:29:36.409 INFO:teuthology.orchestra.run.trial110.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.44157.log.gz 2026-02-13T20:29:36.409 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.53645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48810.log 2026-02-13T20:29:36.409 INFO:teuthology.orchestra.run.trial110.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53645.log.gz 2026-02-13T20:29:36.409 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.51158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52714.log 2026-02-13T20:29:36.409 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.48810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52616.log 2026-02-13T20:29:36.409 INFO:teuthology.orchestra.run.trial110.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51158.log.gz 2026-02-13T20:29:36.409 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.52714.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48810.log.gz 2026-02-13T20:29:36.409 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53841.log 2026-02-13T20:29:36.409 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.52616.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52714.log.gz 2026-02-13T20:29:36.409 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47342.log 2026-02-13T20:29:36.409 INFO:teuthology.orchestra.run.trial110.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52616.log.gz 2026-02-13T20:29:36.409 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.53841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48614.log 2026-02-13T20:29:36.409 INFO:teuthology.orchestra.run.trial110.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.53841.log.gz 2026-02-13T20:29:36.409 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.47342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45374.log 2026-02-13T20:29:36.409 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.48614.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47342.log.gz 2026-02-13T20:29:36.409 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49007.log 2026-02-13T20:29:36.410 INFO:teuthology.orchestra.run.trial110.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48614.log.gz 2026-02-13T20:29:36.410 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.45374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48761.log 2026-02-13T20:29:36.410 INFO:teuthology.orchestra.run.trial110.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45374.log.gz 2026-02-13T20:29:36.410 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.49007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46784.log 2026-02-13T20:29:36.410 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.48761.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49007.log.gz 2026-02-13T20:29:36.410 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47194.log 2026-02-13T20:29:36.410 INFO:teuthology.orchestra.run.trial110.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48761.log.gz 2026-02-13T20:29:36.410 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.46784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46063.log 2026-02-13T20:29:36.410 INFO:teuthology.orchestra.run.trial110.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.46784.log.gz 2026-02-13T20:29:36.410 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.47194.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2026-02-13T20:29:36.410 INFO:teuthology.orchestra.run.trial110.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47194.log.gz 2026-02-13T20:29:36.410 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.46063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51550.log 2026-02-13T20:29:36.410 INFO:teuthology.orchestra.run.trial110.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.46063.log.gz 2026-02-13T20:29:36.410 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50714.log 2026-02-13T20:29:36.410 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.51550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44247.log 2026-02-13T20:29:36.410 INFO:teuthology.orchestra.run.trial110.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.51550.log.gz 2026-02-13T20:29:36.411 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.50714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52514.log 2026-02-13T20:29:36.411 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.44247.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50714.log.gz 2026-02-13T20:29:36.411 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49971.log 2026-02-13T20:29:36.411 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.52514.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44247.log.gz 2026-02-13T20:29:36.411 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48859.log 2026-02-13T20:29:36.411 INFO:teuthology.orchestra.run.trial110.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52514.log.gz 2026-02-13T20:29:36.411 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.49971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45792.log 2026-02-13T20:29:36.411 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.48859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48299.log 2026-02-13T20:29:36.411 INFO:teuthology.orchestra.run.trial110.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49971.log.gz 2026-02-13T20:29:36.411 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.45792.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48859.log.gz 2026-02-13T20:29:36.411 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46392.log 2026-02-13T20:29:36.411 INFO:teuthology.orchestra.run.trial110.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45792.log.gz 2026-02-13T20:29:36.411 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.48299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47440.log 2026-02-13T20:29:36.411 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.46392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53596.log 2026-02-13T20:29:36.411 INFO:teuthology.orchestra.run.trial110.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48299.log.gz 2026-02-13T20:29:36.411 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.47440.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46392.log.gz 2026-02-13T20:29:36.411 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48663.log 2026-02-13T20:29:36.412 INFO:teuthology.orchestra.run.trial110.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47440.log.gz 2026-02-13T20:29:36.412 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.53596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48957.log 2026-02-13T20:29:36.412 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.48663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49154.log 2026-02-13T20:29:36.412 INFO:teuthology.orchestra.run.trial110.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53596.log.gz 2026-02-13T20:29:36.412 INFO:teuthology.orchestra.run.trial110.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.48663.log.gz 2026-02-13T20:29:36.412 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.48957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53204.log 2026-02-13T20:29:36.412 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.49154.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48957.log.gz 2026-02-13T20:29:36.412 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49540.log 2026-02-13T20:29:36.412 INFO:teuthology.orchestra.run.trial110.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49154.log.gz 2026-02-13T20:29:36.412 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.53204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51256.log 2026-02-13T20:29:36.412 INFO:teuthology.orchestra.run.trial110.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53204.log.gz 2026-02-13T20:29:36.412 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.49540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50616.log 2026-02-13T20:29:36.412 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.51256.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.49540.log.gz 2026-02-13T20:29:36.412 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53498.log 2026-02-13T20:29:36.412 INFO:teuthology.orchestra.run.trial110.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51256.log.gz 2026-02-13T20:29:36.412 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.50616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48712.log 2026-02-13T20:29:36.412 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.53498.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50616.log.gz 2026-02-13T20:29:36.413 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45083.log 2026-02-13T20:29:36.413 INFO:teuthology.orchestra.run.trial110.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53498.log.gz 2026-02-13T20:29:36.413 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.48712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50518.log 2026-02-13T20:29:36.413 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.45083.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.48712.log.gz 2026-02-13T20:29:36.413 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53694.log 2026-02-13T20:29:36.413 INFO:teuthology.orchestra.run.trial110.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45083.log.gz 2026-02-13T20:29:36.413 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.50518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51354.log 2026-02-13T20:29:36.413 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.53694.log: gzip -5 --verbose 88.7% -- -- replaced with /var/log/ceph/ceph-client.admin.50518.log.gz /var/log/ceph/ceph-client.admin.48565.log 2026-02-13T20:29:36.413 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:36.413 INFO:teuthology.orchestra.run.trial110.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.53694.log.gz 2026-02-13T20:29:36.413 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.51354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52812.log 2026-02-13T20:29:36.413 INFO:teuthology.orchestra.run.trial110.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51354.log.gz 2026-02-13T20:29:36.413 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.48565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44871.log 2026-02-13T20:29:36.413 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.52812.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48565.log.gz 2026-02-13T20:29:36.413 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51501.log 2026-02-13T20:29:36.413 INFO:teuthology.orchestra.run.trial110.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52812.log.gz 2026-02-13T20:29:36.413 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.44871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46637.log 2026-02-13T20:29:36.414 INFO:teuthology.orchestra.run.trial110.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44871.log.gz 2026-02-13T20:29:36.414 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.51501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52220.log 2026-02-13T20:29:36.414 INFO:teuthology.orchestra.run.trial110.stderr: 86.8%/var/log/ceph/ceph-client.admin.46637.log: -- replaced with /var/log/ceph/ceph-client.admin.51501.log.gz 2026-02-13T20:29:36.414 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44872.log 2026-02-13T20:29:36.414 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.52220.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46637.log.gz 2026-02-13T20:29:36.414 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41272.log 2026-02-13T20:29:36.414 INFO:teuthology.orchestra.run.trial110.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52220.log.gz 2026-02-13T20:29:36.414 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.44872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49252.log 2026-02-13T20:29:36.414 INFO:teuthology.orchestra.run.trial110.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44872.log.gz 2026-02-13T20:29:36.414 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.41272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50020.log 2026-02-13T20:29:36.414 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.49252.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41272.log.gz 2026-02-13T20:29:36.414 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50321.log 2026-02-13T20:29:36.414 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.50020.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.49252.log.gz 2026-02-13T20:29:36.414 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52959.log 2026-02-13T20:29:36.414 INFO:teuthology.orchestra.run.trial110.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50020.log.gz 2026-02-13T20:29:36.414 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.50321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50223.log 2026-02-13T20:29:36.414 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.52959.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.50321.log.gz 2026-02-13T20:29:36.414 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47145.log 2026-02-13T20:29:36.415 INFO:teuthology.orchestra.run.trial110.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52959.log.gz 2026-02-13T20:29:36.415 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.50223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48908.log 2026-02-13T20:29:36.415 INFO:teuthology.orchestra.run.trial110.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.50223.log.gz 2026-02-13T20:29:36.415 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51403.log 2026-02-13T20:29:36.415 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.47145.log: /var/log/ceph/ceph-client.admin.48908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50069.log 2026-02-13T20:29:36.415 INFO:teuthology.orchestra.run.trial110.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47145.log.gz 2026-02-13T20:29:36.415 INFO:teuthology.orchestra.run.trial110.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48908.log.gz 2026-02-13T20:29:36.415 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.51403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45175.log 2026-02-13T20:29:36.415 INFO:teuthology.orchestra.run.trial110.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51403.log.gz 2026-02-13T20:29:36.415 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.50069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45521.log 2026-02-13T20:29:36.415 INFO:teuthology.orchestra.run.trial110.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50069.log.gz 2026-02-13T20:29:36.415 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.45175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53547.log 2026-02-13T20:29:36.415 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.45521.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45175.log.gz 2026-02-13T20:29:36.415 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48398.log 2026-02-13T20:29:36.415 INFO:teuthology.orchestra.run.trial110.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45521.log.gz 2026-02-13T20:29:36.415 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.53547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50812.log 2026-02-13T20:29:36.415 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.48398.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.53547.log.gz 2026-02-13T20:29:36.415 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46686.log 2026-02-13T20:29:36.416 INFO:teuthology.orchestra.run.trial110.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48398.log.gz 2026-02-13T20:29:36.416 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.50812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48447.log 2026-02-13T20:29:36.416 INFO:teuthology.orchestra.run.trial110.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50812.log.gz 2026-02-13T20:29:36.416 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.46686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50763.log 2026-02-13T20:29:36.416 INFO:teuthology.orchestra.run.trial110.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46686.log.gz 2026-02-13T20:29:36.416 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.48447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46490.log 2026-02-13T20:29:36.416 INFO:teuthology.orchestra.run.trial110.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48447.log.gz 2026-02-13T20:29:36.416 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.50763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44869.log 2026-02-13T20:29:36.416 INFO:teuthology.orchestra.run.trial110.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50763.log.gz 2026-02-13T20:29:36.416 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.46490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50959.log 2026-02-13T20:29:36.416 INFO:teuthology.orchestra.run.trial110.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46490.log.gz 2026-02-13T20:29:36.416 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52073.log 2026-02-13T20:29:36.416 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.44869.log: /var/log/ceph/ceph-client.admin.50959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45668.log 2026-02-13T20:29:36.416 INFO:teuthology.orchestra.run.trial110.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44869.log.gz 2026-02-13T20:29:36.416 INFO:teuthology.orchestra.run.trial110.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50959.log.gz 2026-02-13T20:29:36.416 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.52073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47489.log 2026-02-13T20:29:36.416 INFO:teuthology.orchestra.run.trial110.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52073.log.gz 2026-02-13T20:29:36.416 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.45668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48005.log 2026-02-13T20:29:36.417 INFO:teuthology.orchestra.run.trial110.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45668.log.gz 2026-02-13T20:29:36.417 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.47489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47734.log 2026-02-13T20:29:36.417 INFO:teuthology.orchestra.run.trial110.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47489.log.gz 2026-02-13T20:29:36.417 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.48005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46931.log 2026-02-13T20:29:36.417 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.47734.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48005.log.gz 2026-02-13T20:29:36.417 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45084.log 2026-02-13T20:29:36.417 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.46931.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47734.log.gz 2026-02-13T20:29:36.417 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47818.log 2026-02-13T20:29:36.417 INFO:teuthology.orchestra.run.trial110.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46931.log.gz 2026-02-13T20:29:36.417 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.45084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51697.log 2026-02-13T20:29:36.417 INFO:teuthology.orchestra.run.trial110.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45084.log.gz 2026-02-13T20:29:36.417 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.47818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44345.log 2026-02-13T20:29:36.417 INFO:teuthology.orchestra.run.trial110.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.47818.log.gz 2026-02-13T20:29:36.417 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.51697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44577.log 2026-02-13T20:29:36.417 INFO:teuthology.orchestra.run.trial110.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51697.log.gz 2026-02-13T20:29:36.417 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.44345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44394.log 2026-02-13T20:29:36.417 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.44577.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44345.log.gz 2026-02-13T20:29:36.417 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44575.log 2026-02-13T20:29:36.418 INFO:teuthology.orchestra.run.trial110.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44577.log.gz 2026-02-13T20:29:36.418 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48349.log/var/log/ceph/ceph-client.admin.44394.log: 2026-02-13T20:29:36.418 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.44575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45865.log 2026-02-13T20:29:36.418 INFO:teuthology.orchestra.run.trial110.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44394.log.gz 2026-02-13T20:29:36.418 INFO:teuthology.orchestra.run.trial110.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44575.log.gz 2026-02-13T20:29:36.418 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.48349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50174.log 2026-02-13T20:29:36.418 INFO:teuthology.orchestra.run.trial110.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48349.log.gz 2026-02-13T20:29:36.418 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.45865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45174.log 2026-02-13T20:29:36.418 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.50174.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45865.log.gz 2026-02-13T20:29:36.418 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48152.log 2026-02-13T20:29:36.418 INFO:teuthology.orchestra.run.trial110.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.50174.log.gz 2026-02-13T20:29:36.418 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.45174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51926.log 2026-02-13T20:29:36.418 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.48152.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45174.log.gz 2026-02-13T20:29:36.418 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50371.log 2026-02-13T20:29:36.418 INFO:teuthology.orchestra.run.trial110.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48152.log.gz 2026-02-13T20:29:36.418 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.51926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45325.log 2026-02-13T20:29:36.418 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.50371.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51926.log.gz 2026-02-13T20:29:36.418 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49628.log 2026-02-13T20:29:36.418 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.45325.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50371.log.gz 2026-02-13T20:29:36.419 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44296.log 2026-02-13T20:29:36.419 INFO:teuthology.orchestra.run.trial110.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45325.log.gz 2026-02-13T20:29:36.419 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.49628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51648.log 2026-02-13T20:29:36.419 INFO:teuthology.orchestra.run.trial110.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49628.log.gz 2026-02-13T20:29:36.419 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.44296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44578.log 2026-02-13T20:29:36.419 INFO:teuthology.orchestra.run.trial110.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44296.log.gz 2026-02-13T20:29:36.419 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.51648.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-13T20:29:36.419 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.44578.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51648.log.gz 2026-02-13T20:29:36.419 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45793.log 2026-02-13T20:29:36.419 INFO:teuthology.orchestra.run.trial110.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44578.log.gz 2026-02-13T20:29:36.419 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50861.log 2026-02-13T20:29:36.424 INFO:teuthology.orchestra.run.trial188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2026-02-13T20:29:36.424 INFO:teuthology.orchestra.run.trial188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40989.log 2026-02-13T20:29:36.424 INFO:teuthology.orchestra.run.trial188.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40895.log 2026-02-13T20:29:36.424 INFO:teuthology.orchestra.run.trial188.stderr:/var/log/ceph/ceph-client.admin.40989.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2026-02-13T20:29:36.424 INFO:teuthology.orchestra.run.trial188.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.40989.log.gz 2026-02-13T20:29:36.424 INFO:teuthology.orchestra.run.trial188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2026-02-13T20:29:36.424 INFO:teuthology.orchestra.run.trial188.stderr:/var/log/ceph/ceph-client.admin.40895.log: /var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-13T20:29:36.424 INFO:teuthology.orchestra.run.trial188.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.40895.log.gz 2026-02-13T20:29:36.424 INFO:teuthology.orchestra.run.trial188.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40801.log 2026-02-13T20:29:36.424 INFO:teuthology.orchestra.run.trial188.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2026-02-13T20:29:36.424 INFO:teuthology.orchestra.run.trial188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40754.log 2026-02-13T20:29:36.424 INFO:teuthology.orchestra.run.trial188.stderr:/var/log/ceph/ceph-client.admin.40801.log: /var/log/ceph/ceph-mon.b.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40801.log.gz 2026-02-13T20:29:36.424 INFO:teuthology.orchestra.run.trial188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-13T20:29:36.424 INFO:teuthology.orchestra.run.trial188.stderr: 89.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-13T20:29:36.424 INFO:teuthology.orchestra.run.trial188.stderr:/var/log/ceph/ceph-client.admin.40754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40942.log 2026-02-13T20:29:36.424 INFO:teuthology.orchestra.run.trial188.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.40754.log.gz 2026-02-13T20:29:36.424 INFO:teuthology.orchestra.run.trial188.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-13T20:29:36.425 INFO:teuthology.orchestra.run.trial188.stderr:/var/log/ceph/ceph-client.admin.40942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40848.log 2026-02-13T20:29:36.425 INFO:teuthology.orchestra.run.trial188.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43701.log 2026-02-13T20:29:36.425 INFO:teuthology.orchestra.run.trial188.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.40942.log.gz 2026-02-13T20:29:36.425 INFO:teuthology.orchestra.run.trial188.stderr:/var/log/ceph/ceph-client.admin.40848.log: /var/log/ceph/ceph-client.0.43701.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.40848.log.gz 2026-02-13T20:29:36.425 INFO:teuthology.orchestra.run.trial188.stderr: 86.6% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-13T20:29:36.434 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.45793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51599.log 2026-02-13T20:29:36.434 INFO:teuthology.orchestra.run.trial110.stderr: 88.3%/var/log/ceph/ceph-client.admin.50861.log: -- replaced with /var/log/ceph/ceph-client.admin.45793.log.gz 2026-02-13T20:29:36.434 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48201.log 2026-02-13T20:29:36.434 INFO:teuthology.orchestra.run.trial110.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.50861.log.gz 2026-02-13T20:29:36.434 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.51599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47587.log 2026-02-13T20:29:36.434 INFO:teuthology.orchestra.run.trial110.stderr: 93.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-13T20:29:36.434 INFO:teuthology.orchestra.run.trial110.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51599.log.gz 2026-02-13T20:29:36.434 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.48201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52367.log 2026-02-13T20:29:36.434 INFO:teuthology.orchestra.run.trial110.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48201.log.gz 2026-02-13T20:29:36.434 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.47587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52910.log 2026-02-13T20:29:36.434 INFO:teuthology.orchestra.run.trial110.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.47587.log.gz 2026-02-13T20:29:36.434 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.52367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45085.log 2026-02-13T20:29:36.434 INFO:teuthology.orchestra.run.trial110.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.52367.log.gz 2026-02-13T20:29:36.434 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.52910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51207.log 2026-02-13T20:29:36.434 INFO:teuthology.orchestra.run.trial110.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52910.log.gz 2026-02-13T20:29:36.434 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.45085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49726.log 2026-02-13T20:29:36.434 INFO:teuthology.orchestra.run.trial110.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45085.log.gz 2026-02-13T20:29:36.434 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.51207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53008.log 2026-02-13T20:29:36.434 INFO:teuthology.orchestra.run.trial110.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51207.log.gz 2026-02-13T20:29:36.434 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.49726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49677.log 2026-02-13T20:29:36.434 INFO:teuthology.orchestra.run.trial110.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49726.log.gz 2026-02-13T20:29:36.435 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.53008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53302.log 2026-02-13T20:29:36.435 INFO:teuthology.orchestra.run.trial110.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.53008.log.gz 2026-02-13T20:29:36.435 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.49677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43999.log 2026-02-13T20:29:36.435 INFO:teuthology.orchestra.run.trial110.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49677.log.gz 2026-02-13T20:29:36.435 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.53302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53253.log 2026-02-13T20:29:36.435 INFO:teuthology.orchestra.run.trial110.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53302.log.gz 2026-02-13T20:29:36.435 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.43999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41319.log 2026-02-13T20:29:36.435 INFO:teuthology.orchestra.run.trial110.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43999.log.gz 2026-02-13T20:29:36.435 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.53253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53743.log 2026-02-13T20:29:36.435 INFO:teuthology.orchestra.run.trial110.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53253.log.gz 2026-02-13T20:29:36.435 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.41319.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-13T20:29:36.435 INFO:teuthology.orchestra.run.trial110.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41319.log.gz/var/log/ceph/ceph-client.admin.53743.log: 2026-02-13T20:29:36.435 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44576.log 2026-02-13T20:29:36.435 INFO:teuthology.orchestra.run.trial110.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53743.log.gz 2026-02-13T20:29:36.435 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48250.log 2026-02-13T20:29:36.435 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.44576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52465.log 2026-02-13T20:29:36.435 INFO:teuthology.orchestra.run.trial110.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44576.log.gz 2026-02-13T20:29:36.435 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.48250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52665.log 2026-02-13T20:29:36.435 INFO:teuthology.orchestra.run.trial110.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48250.log.gz 2026-02-13T20:29:36.435 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.52465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46980.log 2026-02-13T20:29:36.435 INFO:teuthology.orchestra.run.trial110.stderr: 88.6%/var/log/ceph/ceph-client.admin.52665.log: -- replaced with /var/log/ceph/ceph-client.admin.52465.log.gz 2026-02-13T20:29:36.435 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51109.log 2026-02-13T20:29:36.435 INFO:teuthology.orchestra.run.trial110.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52665.log.gz 2026-02-13T20:29:36.435 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.46980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50910.log 2026-02-13T20:29:36.435 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.51109.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46980.log.gz 2026-02-13T20:29:36.435 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50665.log 2026-02-13T20:29:36.435 INFO:teuthology.orchestra.run.trial110.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51109.log.gz 2026-02-13T20:29:36.435 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.50910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49301.log 2026-02-13T20:29:36.436 INFO:teuthology.orchestra.run.trial110.stderr: 88.5%/var/log/ceph/ceph-client.admin.50665.log: -- replaced with /var/log/ceph/ceph-client.admin.50910.log.gz 2026-02-13T20:29:36.436 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45619.log 2026-02-13T20:29:36.436 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.49301.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50665.log.gz 2026-02-13T20:29:36.436 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50469.log 2026-02-13T20:29:36.436 INFO:teuthology.orchestra.run.trial110.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.49301.log.gz 2026-02-13T20:29:36.436 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.45619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49873.log 2026-02-13T20:29:36.436 INFO:teuthology.orchestra.run.trial110.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45619.log.gz 2026-02-13T20:29:36.436 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.50469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52567.log 2026-02-13T20:29:36.436 INFO:teuthology.orchestra.run.trial110.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50469.log.gz 2026-02-13T20:29:36.436 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.49873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52416.log 2026-02-13T20:29:36.436 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.52567.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49873.log.gz 2026-02-13T20:29:36.436 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53155.log 2026-02-13T20:29:36.436 INFO:teuthology.orchestra.run.trial110.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52567.log.gz 2026-02-13T20:29:36.436 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.52416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41521.log 2026-02-13T20:29:36.436 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.53155.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52416.log.gz 2026-02-13T20:29:36.436 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45226.log 2026-02-13T20:29:36.436 INFO:teuthology.orchestra.run.trial110.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53155.log.gz 2026-02-13T20:29:36.436 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.41521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46735.log 2026-02-13T20:29:36.436 INFO:teuthology.orchestra.run.trial110.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41521.log.gz 2026-02-13T20:29:36.436 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.45226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49824.log 2026-02-13T20:29:36.436 INFO:teuthology.orchestra.run.trial110.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45226.log.gz 2026-02-13T20:29:36.436 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.46735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46112.log 2026-02-13T20:29:36.436 INFO:teuthology.orchestra.run.trial110.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46735.log.gz 2026-02-13T20:29:36.436 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.49824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45472.log 2026-02-13T20:29:36.436 INFO:teuthology.orchestra.run.trial110.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49824.log.gz 2026-02-13T20:29:36.436 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.46112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52269.log 2026-02-13T20:29:36.436 INFO:teuthology.orchestra.run.trial110.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46112.log.gz 2026-02-13T20:29:36.436 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.45472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52763.log 2026-02-13T20:29:36.436 INFO:teuthology.orchestra.run.trial110.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45472.log.gz 2026-02-13T20:29:36.437 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.52269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50567.log 2026-02-13T20:29:36.437 INFO:teuthology.orchestra.run.trial110.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52269.log.gz 2026-02-13T20:29:36.437 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.52763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49399.log 2026-02-13T20:29:36.437 INFO:teuthology.orchestra.run.trial110.stderr: 88.2%/var/log/ceph/ceph-client.admin.50567.log: -- replaced with /var/log/ceph/ceph-client.admin.52763.log.gz 2026-02-13T20:29:36.437 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45570.log 2026-02-13T20:29:36.437 INFO:teuthology.orchestra.run.trial110.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50567.log.gz 2026-02-13T20:29:36.437 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.49399.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.36445.log 2026-02-13T20:29:36.437 INFO:teuthology.orchestra.run.trial110.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49399.log.gz 2026-02-13T20:29:36.437 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.45570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49105.log 2026-02-13T20:29:36.437 INFO:teuthology.orchestra.run.trial110.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45570.log.gz 2026-02-13T20:29:36.437 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph.tmp-client.admin.36445.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.36445.log.gz 2026-02-13T20:29:36.437 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45423.log 2026-02-13T20:29:36.437 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.49105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49775.log 2026-02-13T20:29:36.437 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.45423.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49105.log.gz 2026-02-13T20:29:36.437 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44870.log 2026-02-13T20:29:36.437 INFO:teuthology.orchestra.run.trial110.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45423.log.gz 2026-02-13T20:29:36.437 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.49775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44087.log 2026-02-13T20:29:36.437 INFO:teuthology.orchestra.run.trial110.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49775.log.gz 2026-02-13T20:29:36.437 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.44870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47956.log 2026-02-13T20:29:36.437 INFO:teuthology.orchestra.run.trial110.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44870.log.gz 2026-02-13T20:29:36.437 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.44087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51060.log 2026-02-13T20:29:36.437 INFO:teuthology.orchestra.run.trial110.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44087.log.gz 2026-02-13T20:29:36.437 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.47956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52861.log 2026-02-13T20:29:36.437 INFO:teuthology.orchestra.run.trial110.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47956.log.gz 2026-02-13T20:29:36.437 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.51060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46588.log 2026-02-13T20:29:36.437 INFO:teuthology.orchestra.run.trial110.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.51060.log.gz 2026-02-13T20:29:36.437 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.52861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46162.log 2026-02-13T20:29:36.437 INFO:teuthology.orchestra.run.trial110.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52861.log.gz 2026-02-13T20:29:36.437 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.46588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49350.log 2026-02-13T20:29:36.438 INFO:teuthology.orchestra.run.trial110.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46588.log.gz 2026-02-13T20:29:36.438 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.46162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46882.log 2026-02-13T20:29:36.438 INFO:teuthology.orchestra.run.trial110.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46162.log.gz 2026-02-13T20:29:36.438 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.49350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51008.log 2026-02-13T20:29:36.438 INFO:teuthology.orchestra.run.trial110.stderr: 89.0%/var/log/ceph/ceph-client.admin.46882.log: -- replaced with /var/log/ceph/ceph-client.admin.49350.log.gz 2026-02-13T20:29:36.438 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47292.log 2026-02-13T20:29:36.438 INFO:teuthology.orchestra.run.trial110.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46882.log.gz 2026-02-13T20:29:36.438 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.51008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49056.log 2026-02-13T20:29:36.438 INFO:teuthology.orchestra.run.trial110.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51008.log.gz 2026-02-13T20:29:36.438 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.47292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53057.log 2026-02-13T20:29:36.438 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.49056.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47292.log.gz 2026-02-13T20:29:36.438 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47907.log 2026-02-13T20:29:36.438 INFO:teuthology.orchestra.run.trial110.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49056.log.gz 2026-02-13T20:29:36.438 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.53057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46539.log 2026-02-13T20:29:36.438 INFO:teuthology.orchestra.run.trial110.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.53057.log.gz 2026-02-13T20:29:36.438 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.47907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53106.log 2026-02-13T20:29:36.438 INFO:teuthology.orchestra.run.trial110.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47907.log.gz 2026-02-13T20:29:36.438 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.46539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48103.log 2026-02-13T20:29:36.438 INFO:teuthology.orchestra.run.trial110.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46539.log.gz 2026-02-13T20:29:36.438 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.53106.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-13T20:29:36.438 INFO:teuthology.orchestra.run.trial110.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.53106.log.gz 2026-02-13T20:29:36.438 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.48103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44182.log 2026-02-13T20:29:36.438 INFO:teuthology.orchestra.run.trial110.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48103.log.gz 2026-02-13T20:29:36.438 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45717.log 2026-02-13T20:29:36.438 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.44182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44867.log 2026-02-13T20:29:36.438 INFO:teuthology.orchestra.run.trial110.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.44182.log.gz 2026-02-13T20:29:36.438 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46343.log/var/log/ceph/ceph-client.admin.45717.log: 2026-02-13T20:29:36.438 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.44867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47056.log 2026-02-13T20:29:36.438 INFO:teuthology.orchestra.run.trial110.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45717.log.gz 2026-02-13T20:29:36.438 INFO:teuthology.orchestra.run.trial110.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44867.log.gz 2026-02-13T20:29:36.438 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.46343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45963.log 2026-02-13T20:29:36.439 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.47056.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46343.log.gz 2026-02-13T20:29:36.439 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53400.log 2026-02-13T20:29:36.439 INFO:teuthology.orchestra.run.trial110.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.47056.log.gz 2026-02-13T20:29:36.439 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.45963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51788.log 2026-02-13T20:29:36.439 INFO:teuthology.orchestra.run.trial110.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45963.log.gz 2026-02-13T20:29:36.439 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.53400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44868.log 2026-02-13T20:29:36.439 INFO:teuthology.orchestra.run.trial110.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53400.log.gz 2026-02-13T20:29:36.439 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.51788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53888.log 2026-02-13T20:29:36.439 INFO:teuthology.orchestra.run.trial110.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.51788.log.gz 2026-02-13T20:29:36.439 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.44868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50118.log 2026-02-13T20:29:36.439 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.53888.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44868.log.gz 2026-02-13T20:29:36.439 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50272.log 2026-02-13T20:29:36.439 INFO:teuthology.orchestra.run.trial110.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53888.log.gz 2026-02-13T20:29:36.439 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.50118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46294.log 2026-02-13T20:29:36.439 INFO:teuthology.orchestra.run.trial110.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50118.log.gz 2026-02-13T20:29:36.439 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.50272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46012.log 2026-02-13T20:29:36.439 INFO:teuthology.orchestra.run.trial110.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.50272.log.gz 2026-02-13T20:29:36.439 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.46294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50420.log 2026-02-13T20:29:36.439 INFO:teuthology.orchestra.run.trial110.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46294.log.gz 2026-02-13T20:29:36.439 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.46012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45914.log 2026-02-13T20:29:36.439 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.50420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53792.log 2026-02-13T20:29:36.439 INFO:teuthology.orchestra.run.trial110.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46012.log.gz 2026-02-13T20:29:36.439 INFO:teuthology.orchestra.run.trial110.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50420.log.gz 2026-02-13T20:29:36.439 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.45914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53449.log 2026-02-13T20:29:36.439 INFO:teuthology.orchestra.run.trial110.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45914.log.gz 2026-02-13T20:29:36.439 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.53792.log: 91.2% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-13T20:29:36.439 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52024.log 2026-02-13T20:29:36.439 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.53449.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.53792.log.gz 2026-02-13T20:29:36.439 INFO:teuthology.orchestra.run.trial110.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.53449.log.gz 2026-02-13T20:29:36.439 INFO:teuthology.orchestra.run.trial110.stderr:/var/log/ceph/ceph-client.admin.52024.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52024.log.gz 2026-02-13T20:29:36.461 INFO:teuthology.orchestra.run.trial188.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.0.43701.log.gz 2026-02-13T20:29:36.488 INFO:teuthology.orchestra.run.trial188.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-13T20:29:37.043 INFO:teuthology.orchestra.run.trial110.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-13T20:29:37.336 INFO:teuthology.orchestra.run.trial110.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2026-02-13T20:29:37.377 INFO:teuthology.orchestra.run.trial188.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2026-02-13T20:29:38.044 INFO:teuthology.orchestra.run.trial110.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-13T20:29:38.093 INFO:teuthology.orchestra.run.trial188.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2026-02-13T20:29:38.287 INFO:teuthology.orchestra.run.trial188.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2026-02-13T20:29:38.556 INFO:teuthology.orchestra.run.trial188.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2026-02-13T20:29:38.557 INFO:teuthology.orchestra.run.trial188.stderr: 2026-02-13T20:29:38.558 INFO:teuthology.orchestra.run.trial188.stderr:real 0m2.154s 2026-02-13T20:29:38.558 INFO:teuthology.orchestra.run.trial188.stderr:user 0m6.482s 2026-02-13T20:29:38.558 INFO:teuthology.orchestra.run.trial188.stderr:sys 0m0.313s 2026-02-13T20:29:39.284 INFO:teuthology.orchestra.run.trial110.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-13T20:29:39.359 INFO:teuthology.orchestra.run.trial110.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-13T20:29:39.360 INFO:teuthology.orchestra.run.trial110.stderr: 2026-02-13T20:29:39.361 INFO:teuthology.orchestra.run.trial110.stderr:real 0m2.995s 2026-02-13T20:29:39.361 INFO:teuthology.orchestra.run.trial110.stderr:user 0m8.774s 2026-02-13T20:29:39.361 INFO:teuthology.orchestra.run.trial110.stderr:sys 0m0.531s 2026-02-13T20:29:39.361 INFO:tasks.ceph:Archiving logs... 2026-02-13T20:29:39.362 DEBUG:teuthology.misc:Transferring archived files from trial110:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-13_16:37:03-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/49987/remote/trial110/log 2026-02-13T20:29:39.363 DEBUG:teuthology.orchestra.run.trial110:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-13T20:29:40.341 DEBUG:teuthology.misc:Transferring archived files from trial188:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-13_16:37:03-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/49987/remote/trial188/log 2026-02-13T20:29:40.342 DEBUG:teuthology.orchestra.run.trial188:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-13T20:29:40.942 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-13T20:29:40.953 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-13T20:29:40.953 DEBUG:teuthology.orchestra.run.trial110:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-13T20:29:40.955 DEBUG:teuthology.orchestra.run.trial188:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-13T20:29:41.133 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-13T20:29:41.144 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-13T20:29:41.144 DEBUG:teuthology.orchestra.run.trial110:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T20:29:41.146 DEBUG:teuthology.orchestra.run.trial188:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T20:29:41.160 INFO:teuthology.orchestra.run.trial110.stderr:bash: line 1: ntpq: command not found 2026-02-13T20:29:41.162 INFO:teuthology.orchestra.run.trial188.stderr:bash: line 1: ntpq: command not found 2026-02-13T20:29:41.189 INFO:teuthology.orchestra.run.trial188.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T20:29:41.189 INFO:teuthology.orchestra.run.trial188.stdout:=============================================================================== 2026-02-13T20:29:41.190 INFO:teuthology.orchestra.run.trial188.stdout:^- ntp.maxhost.io 2 7 317 40 -365us[ -365us] +/- 55ms 2026-02-13T20:29:41.190 INFO:teuthology.orchestra.run.trial188.stdout:^* 66.205.249.28 2 6 377 44 -194us[ -144us] +/- 15ms 2026-02-13T20:29:41.190 INFO:teuthology.orchestra.run.trial188.stdout:^- ntp1.lax.us.hojmark.net 2 7 377 109 +1260us[+1285us] +/- 55ms 2026-02-13T20:29:41.190 INFO:teuthology.orchestra.run.trial188.stdout:^+ s2-b.time.mci1.us.rozint> 2 6 377 48 +349us[ +398us] +/- 23ms 2026-02-13T20:29:41.194 INFO:teuthology.orchestra.run.trial110.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T20:29:41.194 INFO:teuthology.orchestra.run.trial110.stdout:=============================================================================== 2026-02-13T20:29:41.194 INFO:teuthology.orchestra.run.trial110.stdout:^+ 198.71.50.75 3 6 377 49 +909us[ +909us] +/- 35ms 2026-02-13T20:29:41.194 INFO:teuthology.orchestra.run.trial110.stdout:^+ 157.245.125.229 2 7 377 108 +1871us[+1871us] +/- 46ms 2026-02-13T20:29:41.194 INFO:teuthology.orchestra.run.trial110.stdout:^* 209.205.228.50 2 7 377 111 +248us[ +242us] +/- 26ms 2026-02-13T20:29:41.195 INFO:teuthology.orchestra.run.trial110.stdout:^+ 172-234-25-10.ip.linodeu> 2 7 377 110 -5987us[-5987us] +/- 76ms 2026-02-13T20:29:41.196 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-13T20:29:41.207 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-13T20:29:41.208 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-13T20:29:41.221 DEBUG:teuthology.orchestra.run.trial110:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-13T20:29:41.294 DEBUG:teuthology.orchestra.run.trial188:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-13T20:29:41.349 DEBUG:teuthology.orchestra.run.trial110:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-13T20:29:41.378 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T20:29:41.378 DEBUG:teuthology.orchestra.run.trial188:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-13T20:29:41.404 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T20:29:41.405 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-13T20:29:41.420 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-13T20:29:41.436 INFO:teuthology.task.internal:Duration was 1381.732063 seconds 2026-02-13T20:29:41.436 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-13T20:29:41.459 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-13T20:29:41.459 DEBUG:teuthology.orchestra.run.trial110:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-13T20:29:41.462 DEBUG:teuthology.orchestra.run.trial188:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-13T20:29:41.497 INFO:teuthology.orchestra.run.trial110.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T20:29:41.500 INFO:teuthology.orchestra.run.trial188.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T20:29:41.682 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-13T20:29:41.682 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial110.front.sepia.ceph.com 2026-02-13T20:29:41.683 DEBUG:teuthology.orchestra.run.trial110:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-13T20:29:41.726 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial188.front.sepia.ceph.com 2026-02-13T20:29:41.727 DEBUG:teuthology.orchestra.run.trial188:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-13T20:29:41.746 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-13T20:29:41.746 DEBUG:teuthology.orchestra.run.trial110:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T20:29:41.768 DEBUG:teuthology.orchestra.run.trial188:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T20:29:41.846 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-13T20:29:41.847 DEBUG:teuthology.orchestra.run.trial110:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T20:29:41.849 DEBUG:teuthology.orchestra.run.trial188:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T20:29:41.870 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T20:29:41.871 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T20:29:41.872 INFO:teuthology.orchestra.run.trial110.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-13T20:29:41.872 INFO:teuthology.orchestra.run.trial110.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T20:29:41.872 INFO:teuthology.orchestra.run.trial110.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-13T20:29:41.872 INFO:teuthology.orchestra.run.trial188.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T20:29:41.874 INFO:teuthology.orchestra.run.trial188.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T20:29:41.874 INFO:teuthology.orchestra.run.trial188.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T20:29:41.874 INFO:teuthology.orchestra.run.trial188.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-13T20:29:41.874 INFO:teuthology.orchestra.run.trial188.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-13T20:29:41.881 INFO:teuthology.orchestra.run.trial110.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 83.2% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-13T20:29:41.883 INFO:teuthology.orchestra.run.trial188.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 81.9% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-13T20:29:41.885 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-13T20:29:41.903 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-13T20:29:41.903 DEBUG:teuthology.orchestra.run.trial110:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-13T20:29:41.949 DEBUG:teuthology.orchestra.run.trial188:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-13T20:29:41.973 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-13T20:29:41.991 DEBUG:teuthology.orchestra.run.trial110:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-13T20:29:41.993 DEBUG:teuthology.orchestra.run.trial188:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-13T20:29:42.014 INFO:teuthology.orchestra.run.trial110.stdout:kernel.core_pattern = core 2026-02-13T20:29:42.037 INFO:teuthology.orchestra.run.trial188.stdout:kernel.core_pattern = core 2026-02-13T20:29:42.054 DEBUG:teuthology.orchestra.run.trial110:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-13T20:29:42.083 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T20:29:42.084 DEBUG:teuthology.orchestra.run.trial188:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-13T20:29:42.109 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T20:29:42.110 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-13T20:29:42.128 INFO:teuthology.task.internal:Transferring archived files... 2026-02-13T20:29:42.129 DEBUG:teuthology.misc:Transferring archived files from trial110:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-13_16:37:03-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/49987/remote/trial110 2026-02-13T20:29:42.129 DEBUG:teuthology.orchestra.run.trial110:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-13T20:29:42.166 DEBUG:teuthology.misc:Transferring archived files from trial188:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-13_16:37:03-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/49987/remote/trial188 2026-02-13T20:29:42.167 DEBUG:teuthology.orchestra.run.trial188:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-13T20:29:42.201 INFO:teuthology.task.internal:Removing archive directory... 2026-02-13T20:29:42.202 DEBUG:teuthology.orchestra.run.trial110:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-13T20:29:42.204 DEBUG:teuthology.orchestra.run.trial188:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-13T20:29:42.250 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-13T20:29:42.271 INFO:teuthology.task.internal:Not uploading archives. 2026-02-13T20:29:42.271 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-13T20:29:42.290 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-13T20:29:42.290 DEBUG:teuthology.orchestra.run.trial110:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-13T20:29:42.293 DEBUG:teuthology.orchestra.run.trial188:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-13T20:29:42.308 INFO:teuthology.orchestra.run.trial110.stdout: 786525 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 13 20:29 /home/ubuntu/cephtest 2026-02-13T20:29:42.311 INFO:teuthology.orchestra.run.trial188.stdout: 786461 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 13 20:29 /home/ubuntu/cephtest 2026-02-13T20:29:42.313 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-13T20:29:42.333 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-13T20:29:42.377 INFO:teuthology.run:Summary data: description: rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/{bluestore/{alloc$/{stupid} base mem$/{low} onode-segment$/{256K} write$/{v2/{compr$/{yes$/{zlib}} v2}}}} rados supported-random-distro$/{centos_latest} thrashers/force-sync-many workloads/snaps-few-objects} duration: 1381.7320625782013 flavor: default owner: scheduled_yuriw@soko04.front.sepia.ceph.com success: true 2026-02-13T20:29:42.377 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T20:29:42.506 INFO:teuthology.run:pass